-- Logs begin at Thu 2022-07-14 13:32:53 UTC, end at Thu 2022-07-14 16:10:45 UTC. -- Jul 14 14:14:06.328140 n-d-767704-28 systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 14:14:06.338975 n-d-767704-28 devstack@n-api.service[104155]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 14:14:06.341015 n-d-767704-28 devstack@n-api.service[104155]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 14:14:06 2022] *** Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: nodename: n-d-767704-28 Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: machine: x86_64 Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: clock source: unix Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: pcre jit disabled Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: detected number of CPU cores: 4 Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: current working directory: / Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: detected binary path: /usr/bin/uwsgi-core Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: your processes number limit is 47680 Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: your memory page size is 4096 bytes Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: detected max file descriptor number: 2048 Jul 14 14:14:06.341129 n-d-767704-28 devstack@n-api.service[104155]: lock engine: pthread robust mutexes Jul 14 14:14:06.342188 n-d-767704-28 devstack@n-api.service[104155]: thunder lock: enabled Jul 14 14:14:06.342188 n-d-767704-28 devstack@n-api.service[104155]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 14:14:06.342188 n-d-767704-28 devstack@n-api.service[104155]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 14:14:06.385129 n-d-767704-28 devstack@n-api.service[104155]: Python main interpreter initialized at 0x5651a4f709c0 Jul 14 14:14:06.385129 n-d-767704-28 devstack@n-api.service[104155]: python threads support enabled Jul 14 14:14:06.385129 n-d-767704-28 devstack@n-api.service[104155]: your server socket listen backlog is limited to 100 connections Jul 14 14:14:06.385129 n-d-767704-28 devstack@n-api.service[104155]: your mercy for graceful operations on workers is 90 seconds Jul 14 14:14:06.385686 n-d-767704-28 devstack@n-api.service[104155]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 14:14:06.385686 n-d-767704-28 devstack@n-api.service[104155]: *** Operational MODE: preforking *** Jul 14 14:14:06.385851 n-d-767704-28 devstack@n-api.service[104155]: *** uWSGI is running in multiple interpreter mode *** Jul 14 14:14:06.385851 n-d-767704-28 devstack@n-api.service[104155]: spawned uWSGI master process (pid: 104155) Jul 14 14:14:06.386036 n-d-767704-28 systemd[1]: Started Devstack devstack@n-api.service. Jul 14 14:14:06.386856 n-d-767704-28 devstack@n-api.service[104155]: spawned uWSGI worker 1 (pid: 104156, cores: 1) Jul 14 14:14:06.386972 n-d-767704-28 devstack@n-api.service[104155]: spawned uWSGI worker 2 (pid: 104157, cores: 1) Jul 14 14:14:06.392972 n-d-767704-28 devstack@n-api.service[104155]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 14:14:07.065796 n-d-767704-28 devstack@n-api.service[104156]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 14:14:07.073578 n-d-767704-28 devstack@n-api.service[104157]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 14:14:08.214907 n-d-767704-28 devstack@n-api.service[104157]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:14:08.214907 n-d-767704-28 devstack@n-api.service[104157]: from cryptography.utils import int_from_bytes Jul 14 14:14:08.215654 n-d-767704-28 devstack@n-api.service[104157]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:14:08.215654 n-d-767704-28 devstack@n-api.service[104157]: from cryptography.utils import int_from_bytes Jul 14 14:14:08.215806 n-d-767704-28 devstack@n-api.service[104156]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:14:08.215806 n-d-767704-28 devstack@n-api.service[104156]: from cryptography.utils import int_from_bytes Jul 14 14:14:08.215806 n-d-767704-28 devstack@n-api.service[104156]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:14:08.215806 n-d-767704-28 devstack@n-api.service[104156]: from cryptography.utils import int_from_bytes Jul 14 14:14:10.723304 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:14:10.723948 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:14:10.724286 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:14:10.724649 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:14:10.724898 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:14:10.725305 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.725626 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.725940 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.726254 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.726581 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.726885 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.727206 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.727516 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.727839 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.728136 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.728408 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.728726 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-767704-28 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.729070 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.729375 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.729688 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.730007 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.730304 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.730621 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.730922 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.731126 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:14:10.731486 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:14:10.731619 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.732656 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.732809 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:14:10.732919 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.733098 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:14:10.733186 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.733266 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:14:10.733353 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.733447 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.733589 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.733674 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.733806 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.733896 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.733989 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.734070 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.734162 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.734242 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.734425 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.734521 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.734734 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.734822 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.735077 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.735173 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-767704-28 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.735407 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.735495 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.735670 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.735765 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.735987 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.736091 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.736312 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-767704-28 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.736400 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.736640 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.736741 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.736969 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.737074 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.737291 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.737391 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.737611 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.737701 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.737918 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.738014 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.738245 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.738343 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.738546 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.738643 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.738861 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.739059 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.739207 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.739376 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.739998 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.740312 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.740622 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.740729 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.740935 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.741060 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.741261 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.741412 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.741564 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.741738 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.741825 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.742056 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.742145 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.742384 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.742472 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.742701 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.742800 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.743017 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.743109 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.743266 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.743365 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.743513 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.743719 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-767704-28 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.743830 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.744038 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.744126 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.744354 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.744443 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.744671 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.744760 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.745031 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.745123 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.745335 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.745424 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.745636 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.745730 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.745936 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.746024 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.746237 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.746350 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.746813 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.746963 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.747126 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.747252 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.747558 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.747646 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.747880 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.747967 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.748185 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.748288 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.748493 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.748581 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.748805 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.748899 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.749146 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.749290 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.749453 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.749554 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.749767 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.749862 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.750075 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.750178 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.750328 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.750424 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.750675 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.750778 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.750961 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.751056 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.751271 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.751359 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.751572 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.751676 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.751837 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.751926 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.752089 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.752178 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.752412 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.752514 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.752735 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.752840 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.753012 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.753103 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.753312 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.753411 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.753614 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.753702 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.753927 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.754017 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.754229 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.754325 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.754530 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.754619 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.754828 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.754916 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.755716 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.755955 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.756052 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.756469 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.756564 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.756776 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.756887 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.757112 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.757211 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.757414 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.757502 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.757715 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.757815 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.758018 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.758196 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.758321 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.758457 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.758623 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.758775 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.758939 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.759123 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.759264 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.759453 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.759553 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.759763 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.759853 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.760088 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.760175 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.760413 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.760506 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.760727 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.760817 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.761054 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.761146 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.761359 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.761456 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.761678 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.761776 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.761980 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.762067 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.762282 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.762438 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.762612 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.762707 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.762919 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.763006 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.763230 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.763330 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.763553 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.763649 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.763866 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.763961 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.764177 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.764274 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.764487 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.764575 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.764790 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.764883 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.765123 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.765222 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.765423 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.765509 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.765724 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.765818 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.766025 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.766121 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.766326 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.766413 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.766625 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.766712 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.766926 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.767016 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.767223 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.767322 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.767528 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.767623 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.767844 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.767931 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.768148 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.768251 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.768450 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.768538 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.768752 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.768840 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.769079 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.769184 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.769394 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.769505 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.769719 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.769825 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.770031 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.770124 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.770341 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.770436 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.770691 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.770783 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.771191 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.771530 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.771630 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.771849 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.771954 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.772177 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.772270 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.772494 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.772585 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.772808 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.772900 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.773143 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.773235 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.773457 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.773559 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.773771 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.773863 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.774084 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.774196 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.774394 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.774484 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.774707 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.774805 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.775016 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.775115 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.775325 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.775413 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.775630 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.775718 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.775936 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.776023 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.776244 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.776342 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.776554 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.776652 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.776875 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.776990 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.777203 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.777365 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.777531 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.777628 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.777844 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.777964 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.778162 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.778290 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.778472 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.778607 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.778796 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:14:10.778974 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.779139 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.779236 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.779519 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.779664 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.779806 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.779953 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.780129 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.780227 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.780446 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.780547 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.780756 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.780883 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.781089 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.781194 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.781398 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.781487 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.781706 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.781802 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.782013 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.782110 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.782320 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.782409 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.782649 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.782737 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.782957 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.783044 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.783268 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.783355 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.783575 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.783663 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.783885 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.783982 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.784192 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.784287 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.784499 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.784586 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.784805 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.784897 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.785131 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.785221 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.785431 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.785537 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.785731 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.785820 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.786034 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.786130 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.786960 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.787237 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.787370 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.787527 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.787648 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.787890 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.788041 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.788212 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.788301 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.788531 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.788619 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.788840 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.788928 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.789173 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.789271 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.789479 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.789581 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.789780 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.789885 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.790088 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.790177 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.790401 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.790489 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.790702 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.790807 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.791023 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.791111 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.791330 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.791418 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.791631 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.791728 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.791939 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.792026 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.792239 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.792334 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.792540 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.792637 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.792849 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.792937 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.793180 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.793280 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.793487 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.793577 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.793795 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.793883 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.794102 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.794198 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.794414 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.794508 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.794720 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.794814 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.795026 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.795114 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.795335 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.795422 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.795645 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.795798 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.795954 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.796103 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.796267 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.796423 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.796573 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.796744 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.796899 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.797081 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.797253 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.797380 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.797568 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.797685 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.797903 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.798001 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.798213 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.798301 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.798528 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.798617 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.798843 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.798946 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.799137 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.799224 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.799436 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.799524 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.799735 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.799881 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.800033 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.800121 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.800336 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.800423 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.800652 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.800749 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.801007 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.801101 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.801283 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.801371 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.801579 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.801669 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.802054 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.802141 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.802777 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.802865 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.803684 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.803778 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.804004 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.804268 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.804394 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.804627 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.804790 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.804962 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.805297 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.805395 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.805618 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.805782 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.805934 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.806250 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.806337 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.806591 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.806712 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.806901 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.807183 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.807316 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.807543 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.807678 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.807869 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.808174 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.808269 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.808485 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.808654 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.808791 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.809144 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.809323 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.809421 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.809658 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.809746 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.810023 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.810129 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.810328 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.810563 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.810650 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.810925 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.811019 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.811230 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.811465 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.811552 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.811853 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.811938 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.812161 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.812350 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.812467 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.812774 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.812859 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.813150 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.813317 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.813460 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.813799 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.813887 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.814136 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.814262 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.814458 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.814742 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.814830 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.815086 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.815172 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.815405 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.815648 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.815743 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.816018 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.816111 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.816333 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.816541 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.816636 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.816971 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.817062 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.817294 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.817503 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.817647 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.818006 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.818516 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.818617 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.818856 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.819024 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.819177 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.819489 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.819579 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.819806 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.819981 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.820128 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.820435 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.820533 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.820800 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.821010 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.821155 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.821456 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.821553 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.821787 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.821911 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.822108 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.822383 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.822470 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.822726 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.822860 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.823042 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.823310 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.823398 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.823666 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.823762 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.823982 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.824228 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.824330 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.824602 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.824696 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.824930 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.825135 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.825267 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.825584 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.825672 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.825889 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.826053 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.826207 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.826496 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.826583 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.826861 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.826956 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.827175 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.827380 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.827476 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.827809 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.827903 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.828123 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.828367 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.828454 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.828737 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.828821 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.829139 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.829292 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.829383 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.829684 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.829771 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.830004 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.830126 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.830317 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.830612 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.830699 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.830928 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.831067 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.831508 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.831792 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.831942 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.832114 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.832235 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.832421 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.832701 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.832790 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.833075 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.833263 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.833745 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.833910 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.834195 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.834284 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.834563 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.834648 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.834874 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.835097 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.835185 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.835497 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.835590 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.835811 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.835956 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.836118 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.836411 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.836505 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.836720 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.836926 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.837089 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.837397 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.837760 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.837847 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.837916 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.838019 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.838343 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.838445 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.838658 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.838833 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.838975 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.839281 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.839416 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.839592 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.839798 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.839918 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.840235 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.840357 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.840547 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.840724 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.840865 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.841198 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.841288 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.841512 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.841667 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.841824 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.842110 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.842207 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.842450 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.842536 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.842762 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.842989 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.843077 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.843367 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.843460 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.843678 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.843867 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.843997 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.844323 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.844572 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.844759 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.844926 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.845236 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.845323 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.845557 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.845687 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.845877 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.846133 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.846222 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.846519 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.846605 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.846850 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.847008 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.847195 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.847510 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.847780 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.847869 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.848115 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.848301 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.848422 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.848735 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.849411 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.849778 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.850077 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.850205 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.850396 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.850710 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.850833 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.851027 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.851226 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.851341 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.851650 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.851748 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.851959 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.852137 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.852267 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.852579 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.852667 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.852886 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.853057 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.853229 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.853508 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.853604 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.853853 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.853949 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.854167 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.854383 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.854471 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.854770 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.854857 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.855077 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.855233 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.855423 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.855669 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.855757 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.856065 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.856160 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.856398 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.856520 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.856744 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.856994 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.857100 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.857373 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.857460 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.857700 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.857875 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.858000 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.858313 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.858400 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.858620 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.858815 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.858932 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.859244 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.859343 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.859549 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.859709 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.859860 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.860173 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.860259 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.860486 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.860641 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.860797 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.861127 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.861215 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.861445 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.861568 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.861753 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.862014 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.862101 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.862368 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.862507 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.862676 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.862957 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.863045 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.863278 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.863466 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.863591 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.863895 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.863989 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.864206 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.864452 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.865442 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.865596 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.865875 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.865964 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.866189 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.866349 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.866503 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.866790 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.866877 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.867113 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.867209 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.867429 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.867643 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.867732 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.868052 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.868186 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.868367 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.868570 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.868702 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.868995 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.869085 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.869310 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.869526 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.869624 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.869910 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.870023 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.870221 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.870479 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.870574 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.870854 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.870952 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.871159 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.871369 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.871465 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.871763 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.871858 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.872067 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.872272 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.872360 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.872668 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.872755 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.872998 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.873199 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.873289 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.873676 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.873778 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.873900 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.874051 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.874205 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.874494 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.874584 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.874825 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.874984 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.875130 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.875365 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.875454 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.875725 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.875811 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.876074 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.876214 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.876383 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.876664 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.876760 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.877068 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.877172 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.877388 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.877571 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.877707 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.878008 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.878095 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.878340 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.878535 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.878623 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.878934 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.879020 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.879254 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.879454 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.879567 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.879951 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.880074 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.880393 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.880616 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.880853 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.881046 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.881306 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.881396 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.881636 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.881856 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.881944 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.882275 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.882362 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.882605 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.882692 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.882942 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.883136 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.883256 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.883574 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.883660 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.883894 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.884026 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.884209 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.884465 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.884560 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.884826 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.884921 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.885169 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.885358 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.885489 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.885796 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.885883 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.886111 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.886233 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.886428 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.886678 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.886765 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.887038 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.887137 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.887353 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.887526 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.887663 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.887956 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.888057 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.888291 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.888419 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.888605 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.888868 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.889029 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.889237 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.889397 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.889550 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.889840 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.889929 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.890288 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.890383 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.890606 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.890745 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.890931 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.891242 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.891398 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.891553 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.891861 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.891957 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.892177 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.892330 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.892497 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.892805 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.892892 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.893260 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.893349 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.893576 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.893723 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.893891 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.894175 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.894263 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.894502 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.894644 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.894808 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.895091 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.895180 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.895442 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.895548 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.896497 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.898210 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.898727 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.898727 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.898956 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.899130 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.899247 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.899364 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.899472 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.899585 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.899691 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.899797 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.899911 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.900017 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.900017 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.900213 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.900318 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.900422 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.900535 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.900649 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.900770 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.900877 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.901009 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.901202 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.901330 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.901439 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.901544 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.901648 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.901762 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.901869 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.902488 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.902575 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.902656 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.902744 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.902836 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.902918 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.903045 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.903170 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.903254 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.903342 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.903437 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.903519 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.903599 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.903677 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.903757 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.903835 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.903923 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.904005 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.904084 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.904152 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.904226 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.904301 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.904390 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.904574 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.904663 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.904901 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.905026 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.905275 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.905364 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.905585 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.905675 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.905897 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.905985 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.906206 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.906303 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.906591 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.906678 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.906900 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.906989 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.907208 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.907305 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.907523 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.907612 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.907833 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.907923 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.908142 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.908233 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.908455 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.908543 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.908767 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.908863 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.909096 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.909217 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.909406 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.909524 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.909715 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.909842 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.910022 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.910156 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.910327 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.910470 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.910653 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.910778 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.910959 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.911086 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.911820 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.912017 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.912417 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.912732 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.912820 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.913069 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.913200 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.913381 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.913470 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.913710 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.913798 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.914018 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.914110 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.914344 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.914434 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.914655 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.914752 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.914970 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.915058 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.915282 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.915372 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.915634 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.915768 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.915946 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.916081 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.916275 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.916396 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.916612 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.916709 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.916963 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.917060 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.917292 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.917381 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.917634 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.917740 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.917967 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.918058 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.918276 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.918363 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.918601 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.918689 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.918927 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.919015 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.919235 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.919330 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.919551 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.919649 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.919857 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.919953 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.920164 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.920251 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.920473 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.920563 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.920780 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.920923 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.921136 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.921251 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.921484 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.921573 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.921791 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.921883 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.922097 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.922199 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.922424 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.922524 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.922731 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.922820 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.923059 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.923157 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.923374 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.923472 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.923682 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.923778 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.923987 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.924087 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.924292 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.924396 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.924640 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.924746 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.924965 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.925071 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.925285 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.925373 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.925598 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.925688 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.925911 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.926001 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.926216 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.926304 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.926520 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.926609 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.926845 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.927519 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.927739 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.928064 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.928198 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.928381 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.928530 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.928708 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.928855 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.929069 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.929203 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.929379 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.929530 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.929705 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.929852 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.930017 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.930172 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.930323 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.930485 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.930627 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.930805 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.930933 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.931124 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.931278 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.931447 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.931584 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.931909 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.931993 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.932247 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.932345 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.932577 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.932666 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.932888 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.933028 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.933249 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.933349 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.933564 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.933652 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.933875 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.933963 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.934188 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.934285 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.934502 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.934590 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.934806 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.934901 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.935113 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.935202 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.935423 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.935511 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.935730 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.935827 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.936034 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.936123 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.936339 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.936427 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.936649 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.936755 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.936965 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.937058 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.937276 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.937370 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.937578 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.937675 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.937899 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.937989 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.938202 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.938298 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.938526 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.938627 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.938837 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.938926 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.939142 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.939231 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.939445 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.939542 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.939748 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.939836 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.940075 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.940163 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.940379 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.940467 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.940697 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.940836 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.941041 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.941133 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.941354 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.941451 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.941668 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.941758 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.941977 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.942073 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.942299 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.942388 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.942640 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.942769 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.943040 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.943360 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.943490 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.943751 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.943844 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.944074 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.944171 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.944392 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.944483 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.944706 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.944929 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.945036 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.945272 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.945380 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.945612 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.945702 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.945945 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.946036 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.946274 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.946499 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.946588 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.946826 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.946914 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.947140 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.947241 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.947455 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.947552 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.947769 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.947857 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.948082 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.948179 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.948396 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.948493 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.948702 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.948798 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.949036 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.949142 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.949346 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.949436 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.949659 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.949748 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.949980 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.950070 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.950292 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.950381 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.950615 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.950831 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.950932 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.951186 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.951276 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.951508 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.951597 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.951840 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.951938 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.952155 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.952300 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.952478 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.952577 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.952788 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.952878 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.953128 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.953225 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.953443 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.953546 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.953752 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.953849 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.954064 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.954151 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.954374 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.954461 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.954682 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.954779 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.954985 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.955081 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.955295 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.955392 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.955605 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.955701 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.955910 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.955998 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.956474 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.956577 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.956785 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.956880 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.957131 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.957221 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.957439 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.957534 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.957749 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.957828 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.958061 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.958170 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.958480 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.958641 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.959043 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.959178 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.959583 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.959804 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.959957 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.960118 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.960203 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.960429 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.960533 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.960744 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.960859 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.961078 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.961202 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.961394 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.961520 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.961705 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.961846 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.962020 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.962159 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.962354 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.962452 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.962641 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.962759 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.962997 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.963076 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.963328 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.963406 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.963638 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.963717 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.963945 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.964032 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.964248 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.964379 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.964567 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.964664 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.964876 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.964993 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.965223 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.965447 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.965555 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.965797 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.965886 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.966116 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.966205 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.966445 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.966771 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.966900 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.967091 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.967183 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.967399 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.967503 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.967723 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.967812 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.968031 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.968119 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.968339 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.968441 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.968657 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.968746 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.969027 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.969122 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.969294 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.969396 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.969601 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.969698 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.969912 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.970004 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.970223 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.970313 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.970529 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.970618 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.970841 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.970937 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.971145 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.971247 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.971457 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.971546 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.971766 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.971861 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.972080 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.972169 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.972398 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.972536 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.972693 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.972795 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.973021 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.973111 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.973380 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.973477 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.973635 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.973738 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.974634 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.975069 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.975165 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.975418 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.975506 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.975735 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.975825 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.976044 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.976142 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.976358 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.976448 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.976667 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.976765 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.977000 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.977091 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.977321 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.977419 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.977637 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.977733 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.977958 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.978047 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.978270 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.978371 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.978589 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.978677 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.978898 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.978985 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.979221 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.979321 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.979534 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.979624 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.979846 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.979935 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.980197 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.980287 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.980514 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.980604 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.980873 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.981077 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.981247 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.981420 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.981532 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.981744 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.981857 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.982080 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.982178 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.982418 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.982507 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.982728 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.982815 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.983036 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.983139 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.983346 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.983435 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.983671 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.983759 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.983985 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.984081 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.984297 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.984385 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.984610 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.984698 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.984921 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.985144 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.985259 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.985349 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.985571 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.985659 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.985881 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.985973 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.986192 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.986281 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.986501 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.986604 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.986810 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.986897 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.987118 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.987207 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.987425 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.987522 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.987733 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.987822 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.988037 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.988124 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.988345 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.988447 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.988651 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.988749 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.988995 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.989094 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.989283 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.989404 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.990316 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.990632 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.990729 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.990944 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.991042 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.991260 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.991348 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.991572 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.991659 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.991882 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.991984 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.992197 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.992286 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.992510 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.992599 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.992819 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.992918 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.993204 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.993303 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.993528 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.993618 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.993859 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.993956 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.994177 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.994265 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.994496 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.994628 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.994809 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.994899 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.995180 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.995296 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.995447 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.995545 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.995765 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.995858 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.996074 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.996161 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.996402 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.996490 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.996716 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.996806 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.997075 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.997176 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.997381 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.997491 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.997693 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.997782 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.997998 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.998087 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.998304 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.998402 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.998614 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.998703 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.998935 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.999023 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.999244 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.999342 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.999549 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.999638 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.999853 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:10.999950 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.000162 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.000253 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.000465 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.000554 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.000768 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.000857 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.001095 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.001187 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.001401 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.001490 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.001708 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.001796 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.002009 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.002100 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.002316 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.002406 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.002619 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.002717 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.002921 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.003021 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.003226 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.003322 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.003529 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.003626 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.003839 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.003928 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.004143 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.004232 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.004446 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.004543 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.004747 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.004825 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.005117 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.005244 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.005417 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.005750 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.005916 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.006083 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.006264 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.006398 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.006628 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.006725 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.006955 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.007044 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.007311 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.007400 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.007623 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.007711 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.007945 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.008041 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.008266 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.008365 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.008576 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.008665 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.008825 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:14:11.008915 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.009228 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.009539 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.009851 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.010163 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.010474 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.010784 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.011095 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.011421 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.011745 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.012049 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.012381 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.012697 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.013043 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.013360 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.013669 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.013999 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.014314 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.014624 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.014933 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.015242 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.015551 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.015865 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.016173 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.016482 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.016797 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.017134 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.017462 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.017785 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.018094 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.018416 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.018744 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.019091 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.019400 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.019745 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.020073 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.020388 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.020733 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.021060 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:14:11.021307 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:14:11.073541 n-d-767704-28 devstack@n-api.service[104156]: INFO dbcounter [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] Registered counter for database nova_api Jul 14 14:14:11.084502 n-d-767704-28 devstack@n-api.service[104157]: INFO dbcounter [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Registered counter for database nova_api Jul 14 14:14:11.192584 n-d-767704-28 devstack@n-api.service[104156]: DEBUG oslo_db.sqlalchemy.engines [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:14:11.198154 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_db.sqlalchemy.engines [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:14:11.200192 n-d-767704-28 devstack@n-api.service[104156]: DEBUG dbcounter [-] [104156] Writer thread running {{(pid=104156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:14:11.204658 n-d-767704-28 devstack@n-api.service[104157]: DEBUG dbcounter [-] [104157] Writer thread running {{(pid=104157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:14:11.257525 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.context [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) {{(pid=104156) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 14:14:11.261393 n-d-767704-28 devstack@n-api.service[104156]: DEBUG oslo_concurrency.lockutils [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:14:11.262830 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.context [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) {{(pid=104157) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 14:14:11.262963 n-d-767704-28 devstack@n-api.service[104156]: DEBUG oslo_concurrency.lockutils [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:14:11.263767 n-d-767704-28 devstack@n-api.service[104156]: DEBUG oslo_concurrency.lockutils [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:14:11.265937 n-d-767704-28 devstack@n-api.service[104156]: DEBUG oslo_concurrency.lockutils [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:14:11.266886 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_concurrency.lockutils [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:14:11.267927 n-d-767704-28 devstack@n-api.service[104156]: INFO dbcounter [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] Registered counter for database nova_cell0 Jul 14 14:14:11.268485 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_concurrency.lockutils [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:14:11.269329 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_concurrency.lockutils [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:14:11.271709 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_concurrency.lockutils [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:14:11.271942 n-d-767704-28 devstack@n-api.service[104156]: INFO dbcounter [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] Registered counter for database nova_cell1 Jul 14 14:14:11.273753 n-d-767704-28 devstack@n-api.service[104157]: INFO dbcounter [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Registered counter for database nova_cell0 Jul 14 14:14:11.277859 n-d-767704-28 devstack@n-api.service[104157]: INFO dbcounter [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Registered counter for database nova_cell1 Jul 14 14:14:11.280793 n-d-767704-28 devstack@n-api.service[104156]: DEBUG oslo_db.sqlalchemy.engines [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:14:11.281803 n-d-767704-28 devstack@n-api.service[104156]: DEBUG oslo_db.sqlalchemy.engines [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:14:11.285069 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_db.sqlalchemy.engines [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:14:11.287727 n-d-767704-28 devstack@n-api.service[104156]: DEBUG dbcounter [-] [104156] Writer thread running {{(pid=104156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:14:11.288343 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_db.sqlalchemy.engines [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:14:11.290287 n-d-767704-28 devstack@n-api.service[104156]: DEBUG dbcounter [-] [104156] Writer thread running {{(pid=104156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:14:11.290909 n-d-767704-28 devstack@n-api.service[104157]: DEBUG dbcounter [-] [104157] Writer thread running {{(pid=104157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:14:11.437955 n-d-767704-28 devstack@n-api.service[104156]: INFO dbcounter [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] Registered counter for database nova_cell0 Jul 14 14:14:11.445613 n-d-767704-28 devstack@n-api.service[104157]: DEBUG dbcounter [-] [104157] Writer thread running {{(pid=104157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:14:11.445965 n-d-767704-28 devstack@n-api.service[104156]: DEBUG oslo_db.sqlalchemy.engines [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:14:11.450546 n-d-767704-28 devstack@n-api.service[104156]: DEBUG dbcounter [-] [104156] Writer thread running {{(pid=104156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:14:11.455357 n-d-767704-28 devstack@n-api.service[104157]: INFO dbcounter [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Registered counter for database nova_cell0 Jul 14 14:14:11.463297 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_db.sqlalchemy.engines [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:14:11.467842 n-d-767704-28 devstack@n-api.service[104157]: DEBUG dbcounter [-] [104157] Writer thread running {{(pid=104157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:14:11.797032 n-d-767704-28 devstack@n-api.service[104157]: WARNING keystonemiddleware.auth_token [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:14:11.798699 n-d-767704-28 devstack@n-api.service[104156]: WARNING keystonemiddleware.auth_token [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:14:11.805067 n-d-767704-28 devstack@n-api.service[104157]: WARNING keystonemiddleware.auth_token [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:14:11.806563 n-d-767704-28 devstack@n-api.service[104156]: WARNING keystonemiddleware.auth_token [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:14:12.156284 n-d-767704-28 devstack@n-api.service[104157]: WARNING keystonemiddleware.auth_token [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:14:12.162305 n-d-767704-28 devstack@n-api.service[104156]: WARNING keystonemiddleware.auth_token [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:14:12.162450 n-d-767704-28 devstack@n-api.service[104157]: WARNING keystonemiddleware.auth_token [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:14:12.167620 n-d-767704-28 devstack@n-api.service[104157]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651a4f709c0 pid: 104157 (default app) Jul 14 14:14:12.168252 n-d-767704-28 devstack@n-api.service[104156]: WARNING keystonemiddleware.auth_token [None req-749985c7-7e84-4423-a508-8d1d681a864a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:14:12.169720 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:14:12.170918 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] 10.222.0.81 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001790 Jul 14 14:14:12.171328 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 788 bytes} [Thu Jul 14 14:14:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:14:12.173625 n-d-767704-28 devstack@n-api.service[104156]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651a4f709c0 pid: 104156 (default app) Jul 14 14:15:33.339680 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:15:33.340804 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 14 14:15:33.341327 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 2/2] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:15:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:15:33.356595 n-d-767704-28 devstack@n-api.service[104156]: DEBUG dbcounter [-] [104156] Writing DB stats nova_api:SELECT=3 {{(pid=104156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:15:33.359205 n-d-767704-28 devstack@n-api.service[104156]: DEBUG dbcounter [-] [104156] Writing DB stats nova_cell0:SELECT=3 {{(pid=104156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:15:33.360671 n-d-767704-28 devstack@n-api.service[104156]: DEBUG dbcounter [-] [104156] Writing DB stats nova_cell1:SELECT=3 {{(pid=104156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:15:33.361815 n-d-767704-28 devstack@n-api.service[104156]: DEBUG dbcounter [-] [104156] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:15:34.373403 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-b1109014-3836-4cb5-9bf8-3d0f6521c707 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:15:34.405167 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-b1109014-3836-4cb5-9bf8-3d0f6521c707 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.055332 Jul 14 14:15:34.405824 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 1/3] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jul 14 14:15:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:15:36.707044 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:15:36.709899 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-6c4c57b5-4f33-4329-b1ab-d9ad1f9b9427 None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003225 Jul 14 14:15:36.710381 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 3/4] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:15:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:15:37.222868 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-77210cf7-aa65-42b8-96df-ea35beaf0b1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "name": "cirros256", "vcpus": 1, "swap": 0}} {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:37.240888 n-d-767704-28 devstack@n-api.service[104156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:15:37.240888 n-d-767704-28 devstack@n-api.service[104156]: warnings.warn(msg) Jul 14 14:15:37.270676 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-77210cf7-aa65-42b8-96df-ea35beaf0b1d admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.552805 Jul 14 14:15:37.271417 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 2/5] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jul 14 14:15:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:15:37.285608 n-d-767704-28 devstack@n-api.service[104157]: DEBUG dbcounter [-] [104157] Writing DB stats nova_api:SELECT=3 {{(pid=104157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:15:37.286725 n-d-767704-28 devstack@n-api.service[104157]: DEBUG dbcounter [-] [104157] Writing DB stats nova_cell0:SELECT=3 {{(pid=104157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:15:37.287637 n-d-767704-28 devstack@n-api.service[104157]: DEBUG dbcounter [-] [104157] Writing DB stats nova_cell1:SELECT=3 {{(pid=104157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:15:37.288535 n-d-767704-28 devstack@n-api.service[104157]: DEBUG dbcounter [-] [104157] Writing DB stats nova_cell0:SELECT=3 {{(pid=104157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:15:37.495555 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-4d6b9635-d875-48aa-afb3-120acb245ea0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:37.498024 n-d-767704-28 devstack@n-api.service[104157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:15:37.498024 n-d-767704-28 devstack@n-api.service[104157]: warnings.warn(msg) Jul 14 14:15:37.567801 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-4d6b9635-d875-48aa-afb3-120acb245ea0 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288134 Jul 14 14:15:37.568811 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 4/6] 10.222.0.81 () {64 vars in 1335 bytes} [Thu Jul 14 14:15:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:15:39.881229 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-77210cf7-aa65-42b8-96df-ea35beaf0b1d admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:15:39.882173 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-77210cf7-aa65-42b8-96df-ea35beaf0b1d admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001726 Jul 14 14:15:39.882570 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 3/7] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:15:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:15:40.675182 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-31324e7a-1d8f-4ac5-8008-21914acc4473 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 512}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:40.708427 n-d-767704-28 devstack@n-api.service[104157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:15:40.708427 n-d-767704-28 devstack@n-api.service[104157]: warnings.warn(msg) Jul 14 14:15:40.739919 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-31324e7a-1d8f-4ac5-8008-21914acc4473 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.850736 Jul 14 14:15:40.740668 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 5/8] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jul 14 14:15:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:15:40.752926 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-7e6194b4-a5ce-4f25-b3d1-1354db011b32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:40.755295 n-d-767704-28 devstack@n-api.service[104156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:15:40.755295 n-d-767704-28 devstack@n-api.service[104156]: warnings.warn(msg) Jul 14 14:15:40.790942 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-7e6194b4-a5ce-4f25-b3d1-1354db011b32 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041593 Jul 14 14:15:40.805014 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 4/9] 10.222.0.81 () {64 vars in 1335 bytes} [Thu Jul 14 14:15:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:15:43.274454 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-31324e7a-1d8f-4ac5-8008-21914acc4473 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:15:43.277115 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-31324e7a-1d8f-4ac5-8008-21914acc4473 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001757 Jul 14 14:15:43.277859 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 6/10] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:15:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:15:43.904303 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-f26e895f-2fc2-4717-b91d-603fc8aa233c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:43.929607 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-f26e895f-2fc2-4717-b91d-603fc8aa233c admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.643533 Jul 14 14:15:43.930505 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 5/11] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jul 14 14:15:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:15:43.943078 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-449ac52f-fd6b-40be-b442-d4424a5557b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:43.971887 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-449ac52f-fd6b-40be-b442-d4424a5557b2 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033344 Jul 14 14:15:43.984025 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 7/12] 10.222.0.81 () {64 vars in 1335 bytes} [Thu Jul 14 14:15:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:15:46.390875 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-f26e895f-2fc2-4717-b91d-603fc8aa233c admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:15:46.392041 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-f26e895f-2fc2-4717-b91d-603fc8aa233c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Jul 14 14:15:46.392816 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 6/13] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:15:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:15:46.834320 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-2b51429c-ac7b-4be9-b853-463a6c54378d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "id": "d3", "ram": 2048}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:46.853097 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-2b51429c-ac7b-4be9-b853-463a6c54378d admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453905 Jul 14 14:15:46.853640 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 8/14] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jul 14 14:15:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:15:46.866196 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-dd18b18f-735c-423c-8422-181adf099a34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:46.889248 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-dd18b18f-735c-423c-8422-181adf099a34 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027378 Jul 14 14:15:46.889928 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 7/15] 10.222.0.81 () {64 vars in 1335 bytes} [Thu Jul 14 14:15:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:15:49.255302 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-2b51429c-ac7b-4be9-b853-463a6c54378d admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:15:49.257223 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-2b51429c-ac7b-4be9-b853-463a6c54378d admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002290 Jul 14 14:15:49.258304 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 9/16] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:15:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:15:49.750902 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-0be5fd8a-0b8c-4319-aedd-cf1a3a908514 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "name": "ds4G", "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:49.793752 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-0be5fd8a-0b8c-4319-aedd-cf1a3a908514 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.524101 Jul 14 14:15:49.794638 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 8/17] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jul 14 14:15:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:15:49.809422 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-7165467d-21d8-4e96-9c91-10f41878c6a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:49.837992 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-7165467d-21d8-4e96-9c91-10f41878c6a1 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032230 Jul 14 14:15:49.838766 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 10/18] 10.222.0.81 () {64 vars in 1335 bytes} [Thu Jul 14 14:15:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:15:52.220641 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-0be5fd8a-0b8c-4319-aedd-cf1a3a908514 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:15:52.222327 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-0be5fd8a-0b8c-4319-aedd-cf1a3a908514 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Jul 14 14:15:52.222727 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 9/19] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:15:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:15:52.777740 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-c123cb7f-75cb-43f2-80a3-825f4d62b774 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:15:52.805956 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-c123cb7f-75cb-43f2-80a3-825f4d62b774 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.577004 Jul 14 14:15:52.828086 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 11/20] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jul 14 14:15:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:15:55.199687 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-0be5fd8a-0b8c-4319-aedd-cf1a3a908514 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:15:55.200702 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-0be5fd8a-0b8c-4319-aedd-cf1a3a908514 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 14 14:15:55.201197 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 10/21] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:15:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:15:55.657204 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-050b5928-c11c-4eb0-85f8-d2156981c2f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "ram": 512}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:55.676919 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-050b5928-c11c-4eb0-85f8-d2156981c2f4 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.468945 Jul 14 14:15:55.677506 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 12/22] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jul 14 14:15:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:15:55.691924 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-44e7f9cd-efb5-4146-bc70-61f81ba3caea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:55.717007 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-44e7f9cd-efb5-4146-bc70-61f81ba3caea admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029437 Jul 14 14:15:55.717574 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 11/23] 10.222.0.81 () {64 vars in 1332 bytes} [Thu Jul 14 14:15:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:15:58.370259 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-050b5928-c11c-4eb0-85f8-d2156981c2f4 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:15:58.371359 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-050b5928-c11c-4eb0-85f8-d2156981c2f4 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jul 14 14:15:58.371800 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 13/24] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:15:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:15:58.847666 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-262ba117-f62a-4d4c-866b-917639fca905 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:58.866325 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-262ba117-f62a-4d4c-866b-917639fca905 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.488407 Jul 14 14:15:58.866879 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 12/25] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jul 14 14:15:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:15:58.879259 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-1d912f10-4bc5-4bac-9774-663302ae20df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:15:58.903304 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-1d912f10-4bc5-4bac-9774-663302ae20df admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027727 Jul 14 14:15:58.903742 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 14/26] 10.222.0.81 () {64 vars in 1332 bytes} [Thu Jul 14 14:15:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:16:01.184680 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-262ba117-f62a-4d4c-866b-917639fca905 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:01.185661 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-262ba117-f62a-4d4c-866b-917639fca905 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 14 14:16:01.186071 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 13/27] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:16:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:16:01.602498 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-cb482794-cf55-47e9-a9c6-29c2a349121e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "id": "3", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:16:01.621217 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-cb482794-cf55-47e9-a9c6-29c2a349121e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.428761 Jul 14 14:16:01.621819 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 15/28] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jul 14 14:16:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:16:01.635533 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-bf0ed260-7337-4eb3-b375-28e01e56adf8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:16:01.658927 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-bf0ed260-7337-4eb3-b375-28e01e56adf8 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026617 Jul 14 14:16:01.659538 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 14/29] 10.222.0.81 () {64 vars in 1332 bytes} [Thu Jul 14 14:16:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:16:03.913856 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-cb482794-cf55-47e9-a9c6-29c2a349121e admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:03.914899 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-cb482794-cf55-47e9-a9c6-29c2a349121e admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004202 Jul 14 14:16:03.925055 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 16/30] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:16:03 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:16:04.386483 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-3d4d1b95-090b-4761-b078-318a28643ce4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:16:04.395376 n-d-767704-28 devstack@n-api.service[104156]: DEBUG dbcounter [-] [104156] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:16:04.406855 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-3d4d1b95-090b-4761-b078-318a28643ce4 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.484565 Jul 14 14:16:04.407417 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 15/31] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jul 14 14:16:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:16:04.425762 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-11380368-0091-4f20-b7c1-26dbfe7c6df5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:16:04.451976 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-11380368-0091-4f20-b7c1-26dbfe7c6df5 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030555 Jul 14 14:16:04.452562 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 17/32] 10.222.0.81 () {64 vars in 1332 bytes} [Thu Jul 14 14:16:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:16:06.834464 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-3d4d1b95-090b-4761-b078-318a28643ce4 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:06.835523 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-3d4d1b95-090b-4761-b078-318a28643ce4 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 14 14:16:06.836246 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 16/33] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:16:07.313822 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-92c2c40c-bed4-41ee-aea2-337b5c2f53ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5"}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:16:07.334359 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-92c2c40c-bed4-41ee-aea2-337b5c2f53ba admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.492651 Jul 14 14:16:07.335056 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 18/34] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jul 14 14:16:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:16:07.347755 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-935a3d60-4a02-41fc-8183-b3896e618d35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:16:07.371573 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-935a3d60-4a02-41fc-8183-b3896e618d35 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028412 Jul 14 14:16:07.372157 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 17/35] 10.222.0.81 () {64 vars in 1332 bytes} [Thu Jul 14 14:16:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:16:32.297203 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-92c2c40c-bed4-41ee-aea2-337b5c2f53ba admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:32.298143 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-92c2c40c-bed4-41ee-aea2-337b5c2f53ba admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 14 14:16:32.298552 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 19/36] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:16:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:16:32.309492 n-d-767704-28 devstack@n-api.service[104156]: DEBUG dbcounter [-] [104156] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:16:32.743088 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-1790dec7-9f84-46f5-a778-67dc761fef72 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:32.761076 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-1790dec7-9f84-46f5-a778-67dc761fef72 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.456208 Jul 14 14:16:32.761613 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 18/37] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jul 14 14:16:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:16:33.889470 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-92c2c40c-bed4-41ee-aea2-337b5c2f53ba admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:33.890490 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-92c2c40c-bed4-41ee-aea2-337b5c2f53ba admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 14 14:16:33.890919 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 20/38] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jul 14 14:16:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:16:34.548273 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-1cb96182-78a8-4a7a-9a43-7aa1588a8675 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:34.554200 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.wsgi [None req-1cb96182-78a8-4a7a-9a43-7aa1588a8675 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-1cb96182-78a8-4a7a-9a43-7aa1588a8675 admin admin] Request method failure captured: Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: Accept: application/json Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: Accept-Encoding: gzip, deflate Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: Connection: keep-alive Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: Content-Length: 0 Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: Host: 10.222.0.81 Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: Openstack-Api-Version: compute 2.90 Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: Openstack-System-Scope: None Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: User-Agent: python-novaclient Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: X-Auth-Token: gAAAAABi0CVB0PAt9ix5MmRzIWxhYyFZzmP2wc8B-6qxBBtTrJB5UD_w9sj2T9ttUs8t_Yp_yGmH4t-r10cLeCz9FC4YskQCZsvd767XF5Wnv0LSypcdtEx-otdqvLvPuACAcmVh3rTkSV7OSmyCqvI4ysJgqt7uKCrFBOU8hdRwx6b0HiNdIDg Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: X-Domain-Id: None Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: X-Domain-Name: None Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: X-Identity-Status: Confirmed Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: X-Is-Admin-Project: True Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: X-Project-Domain-Id: default Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: X-Project-Domain-Name: Default Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: X-Project-Id: d63b8c6c04eb4fd0bf21450bfce1f08a Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: X-Project-Name: admin Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: X-Role: reader,member,admin Jul 14 14:16:34.557556 n-d-767704-28 devstack@n-api.service[104156]: X-Roles: reader,member,admin Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d63b8c6c04eb4fd0bf21450bfce1f08a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}] Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: X-Tenant: admin Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: X-Tenant-Id: d63b8c6c04eb4fd0bf21450bfce1f08a Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: X-Tenant-Name: admin Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: X-User: admin Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: X-User-Domain-Id: default Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: X-User-Domain-Name: Default Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: X-User-Id: 1f675880a94e41b0ad78c80305cdd708 Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: X-User-Name: admin Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: method: > Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: exception: Flavor 42 could not be found. Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: action_args: {'id': '42'} Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:16:34.559277 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:16:34.560223 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:34.561575 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-1cb96182-78a8-4a7a-9a43-7aa1588a8675 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:16:34.562625 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-1cb96182-78a8-4a7a-9a43-7aa1588a8675 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.441252 Jul 14 14:16:34.562625 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 19/39] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:16:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:16:34.569192 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-e66ba95d-fab3-4d4a-8214-38548fcc1dc0 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:34.572222 n-d-767704-28 devstack@n-api.service[104157]: DEBUG dbcounter [-] [104157] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:16:34.592700 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-e66ba95d-fab3-4d4a-8214-38548fcc1dc0 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026897 Jul 14 14:16:34.593317 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 21/40] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jul 14 14:16:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:16:34.605021 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-4bcf5714-a1e5-4152-8a19-909c28f52f4a admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:34.629251 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-4bcf5714-a1e5-4152-8a19-909c28f52f4a admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027997 Jul 14 14:16:34.629832 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 20/41] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jul 14 14:16:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:16:34.650153 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-bff58bc3-5a64-4fc2-8d04-f5b9824f89e9 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:34.662642 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.wsgi [None req-bff58bc3-5a64-4fc2-8d04-f5b9824f89e9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-bff58bc3-5a64-4fc2-8d04-f5b9824f89e9 admin admin] Request method failure captured: Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: Accept: application/json Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: Accept-Encoding: gzip, deflate Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: Connection: keep-alive Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: Content-Length: 0 Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: Host: 10.222.0.81 Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: Openstack-Api-Version: compute 2.90 Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: Openstack-System-Scope: None Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: User-Agent: python-novaclient Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: X-Auth-Token: gAAAAABi0CVB0PAt9ix5MmRzIWxhYyFZzmP2wc8B-6qxBBtTrJB5UD_w9sj2T9ttUs8t_Yp_yGmH4t-r10cLeCz9FC4YskQCZsvd767XF5Wnv0LSypcdtEx-otdqvLvPuACAcmVh3rTkSV7OSmyCqvI4ysJgqt7uKCrFBOU8hdRwx6b0HiNdIDg Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: X-Domain-Id: None Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: X-Domain-Name: None Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: X-Identity-Status: Confirmed Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: X-Is-Admin-Project: True Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: X-Project-Domain-Id: default Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: X-Project-Domain-Name: Default Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: X-Project-Id: d63b8c6c04eb4fd0bf21450bfce1f08a Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: X-Project-Name: admin Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: X-Role: reader,member,admin Jul 14 14:16:34.669162 n-d-767704-28 devstack@n-api.service[104157]: X-Roles: reader,member,admin Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d63b8c6c04eb4fd0bf21450bfce1f08a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}] Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: X-Tenant: admin Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: X-Tenant-Id: d63b8c6c04eb4fd0bf21450bfce1f08a Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: X-Tenant-Name: admin Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: X-User: admin Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: X-User-Domain-Id: default Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: X-User-Domain-Name: Default Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: X-User-Id: 1f675880a94e41b0ad78c80305cdd708 Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: X-User-Name: admin Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: method: > Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: exception: Flavor 42 could not be found. Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: action_args: {'id': '42'} Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:16:34.670781 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:16:34.671837 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:34.673391 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-bff58bc3-5a64-4fc2-8d04-f5b9824f89e9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:16:34.675076 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-bff58bc3-5a64-4fc2-8d04-f5b9824f89e9 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.030939 Jul 14 14:16:34.675076 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 22/42] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:16:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:16:35.755921 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-4bcf5714-a1e5-4152-8a19-909c28f52f4a admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:35.757012 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-4bcf5714-a1e5-4152-8a19-909c28f52f4a admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jul 14 14:16:35.757429 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 21/43] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jul 14 14:16:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:16:36.353178 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-53688c3b-5a1c-43d1-92a2-a4f36db4435a admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:36.359680 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.wsgi [None req-53688c3b-5a1c-43d1-92a2-a4f36db4435a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-53688c3b-5a1c-43d1-92a2-a4f36db4435a admin admin] Request method failure captured: Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: Accept: application/json Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: Accept-Encoding: gzip, deflate Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: Connection: keep-alive Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: Content-Length: 0 Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: Host: 10.222.0.81 Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: Openstack-Api-Version: compute 2.90 Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: Openstack-System-Scope: None Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: User-Agent: python-novaclient Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: X-Auth-Token: gAAAAABi0CVDchnuNWxIxDB-az13Gphep7qzj0Eu9MqgXgZmMU1-z9j5WDTmpzYQGcQRIVzqb8_iVqyhAXyG-fV6UPw-SqSDLTQ5qx1FrnfHLAQu85zezis7-LjDFDOdqCIzjz00ohy5w-BAwm67St-SH296KFp-jyFA-GuhZ2MfZZ4-puuXN7s Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: X-Domain-Id: None Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: X-Domain-Name: None Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: X-Identity-Status: Confirmed Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: X-Is-Admin-Project: True Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: X-Project-Domain-Id: default Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: X-Project-Domain-Name: Default Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: X-Project-Id: d63b8c6c04eb4fd0bf21450bfce1f08a Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: X-Project-Name: admin Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: X-Role: reader,member,admin Jul 14 14:16:36.361767 n-d-767704-28 devstack@n-api.service[104157]: X-Roles: reader,member,admin Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d63b8c6c04eb4fd0bf21450bfce1f08a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}] Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: X-Tenant: admin Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: X-Tenant-Id: d63b8c6c04eb4fd0bf21450bfce1f08a Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: X-Tenant-Name: admin Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: X-User: admin Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: X-User-Domain-Id: default Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: X-User-Domain-Name: Default Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: X-User-Id: 1f675880a94e41b0ad78c80305cdd708 Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: X-User-Name: admin Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: method: > Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: exception: Flavor 84 could not be found. Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: action_args: {'id': '84'} Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:16:36.364892 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:16:36.366964 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:36.369293 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-53688c3b-5a1c-43d1-92a2-a4f36db4435a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:16:36.371878 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-53688c3b-5a1c-43d1-92a2-a4f36db4435a admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.464635 Jul 14 14:16:36.371878 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 23/44] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:16:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 466 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:16:36.374986 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-9186549c-10ef-42e6-8bc2-ccfb12253110 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:36.390408 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-9186549c-10ef-42e6-8bc2-ccfb12253110 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019152 Jul 14 14:16:36.391514 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 22/45] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jul 14 14:16:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:16:36.401879 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-2a791423-5cb5-4fcf-b903-78358018eee6 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:36.418943 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-2a791423-5cb5-4fcf-b903-78358018eee6 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020754 Jul 14 14:16:36.419529 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 24/46] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jul 14 14:16:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:16:36.430420 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-d1e3d0c1-d521-44c9-952e-3516672672b9 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:36.436526 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.wsgi [None req-d1e3d0c1-d521-44c9-952e-3516672672b9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-d1e3d0c1-d521-44c9-952e-3516672672b9 admin admin] Request method failure captured: Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: Accept: application/json Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: Accept-Encoding: gzip, deflate Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: Connection: keep-alive Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: Content-Length: 0 Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: Host: 10.222.0.81 Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: Openstack-Api-Version: compute 2.90 Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: Openstack-System-Scope: None Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: User-Agent: python-novaclient Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: X-Auth-Token: gAAAAABi0CVDchnuNWxIxDB-az13Gphep7qzj0Eu9MqgXgZmMU1-z9j5WDTmpzYQGcQRIVzqb8_iVqyhAXyG-fV6UPw-SqSDLTQ5qx1FrnfHLAQu85zezis7-LjDFDOdqCIzjz00ohy5w-BAwm67St-SH296KFp-jyFA-GuhZ2MfZZ4-puuXN7s Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: X-Domain-Id: None Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: X-Domain-Name: None Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: X-Identity-Status: Confirmed Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: X-Is-Admin-Project: True Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: X-Project-Domain-Id: default Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: X-Project-Domain-Name: Default Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: X-Project-Id: d63b8c6c04eb4fd0bf21450bfce1f08a Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: X-Project-Name: admin Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: X-Role: reader,member,admin Jul 14 14:16:36.438845 n-d-767704-28 devstack@n-api.service[104156]: X-Roles: reader,member,admin Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d63b8c6c04eb4fd0bf21450bfce1f08a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}] Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: X-Tenant: admin Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: X-Tenant-Id: d63b8c6c04eb4fd0bf21450bfce1f08a Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: X-Tenant-Name: admin Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: X-User: admin Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: X-User-Domain-Id: default Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: X-User-Domain-Name: Default Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: X-User-Id: 1f675880a94e41b0ad78c80305cdd708 Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: X-User-Name: admin Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: method: > Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: exception: Flavor 84 could not be found. Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: action_args: {'id': '84'} Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:16:36.441410 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:16:36.442871 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:36.444867 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-d1e3d0c1-d521-44c9-952e-3516672672b9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:16:36.446714 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-d1e3d0c1-d521-44c9-952e-3516672672b9 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014000 Jul 14 14:16:36.446714 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 23/47] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:16:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 14:16:37.534697 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-2a791423-5cb5-4fcf-b903-78358018eee6 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:37.535723 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-2a791423-5cb5-4fcf-b903-78358018eee6 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 14 14:16:37.536125 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 25/48] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jul 14 14:16:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:16:38.098576 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-aac54216-2842-4861-be0b-cf020f91d3f8 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:38.104454 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.wsgi [None req-aac54216-2842-4861-be0b-cf020f91d3f8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-aac54216-2842-4861-be0b-cf020f91d3f8 admin admin] Request method failure captured: Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: Accept: application/json Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: Accept-Encoding: gzip, deflate Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: Connection: keep-alive Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: Content-Length: 0 Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: Host: 10.222.0.81 Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: Openstack-Api-Version: compute 2.90 Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: Openstack-System-Scope: None Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: User-Agent: python-novaclient Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: X-Auth-Token: gAAAAABi0CVFoZbaPwRjsQkUT2PBjVv7kbMdwqX5ZJaak8SrpZmDpTDzZz-v4zxOxGc1at7AvDlBC5djand8jpHP44W4mJtwU782gNeowRNmLKS9jnhPkU28IE4iB-mNiz-0IaLbpccz-vakiGb6Udd_p1rArXok27ROTmGaeIs6GeokDxWyhfY Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: X-Domain-Id: None Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: X-Domain-Name: None Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: X-Identity-Status: Confirmed Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: X-Is-Admin-Project: True Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: X-Project-Domain-Id: default Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: X-Project-Domain-Name: Default Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: X-Project-Id: d63b8c6c04eb4fd0bf21450bfce1f08a Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: X-Project-Name: admin Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: X-Role: reader,member,admin Jul 14 14:16:38.106008 n-d-767704-28 devstack@n-api.service[104156]: X-Roles: reader,member,admin Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d63b8c6c04eb4fd0bf21450bfce1f08a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}] Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: X-Tenant: admin Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: X-Tenant-Id: d63b8c6c04eb4fd0bf21450bfce1f08a Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: X-Tenant-Name: admin Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: X-User: admin Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: X-User-Domain-Id: default Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: X-User-Domain-Name: Default Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: X-User-Id: 1f675880a94e41b0ad78c80305cdd708 Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: X-User-Name: admin Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: method: > Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: exception: Flavor 451 could not be found. Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: action_args: {'id': '451'} Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:16:38.107579 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:16:38.108602 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: ERROR nova.api.openstack.wsgi Jul 14 14:16:38.110349 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-aac54216-2842-4861-be0b-cf020f91d3f8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:16:38.111645 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-aac54216-2842-4861-be0b-cf020f91d3f8 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.424927 Jul 14 14:16:38.111645 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 24/49] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:16:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:16:38.117495 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-8c3de255-9b10-4855-aeb4-f4c056967b67 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:38.135152 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-8c3de255-9b10-4855-aeb4-f4c056967b67 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021186 Jul 14 14:16:38.135737 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 26/50] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jul 14 14:16:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:16:38.146323 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:38.162530 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019855 Jul 14 14:16:38.163083 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 25/51] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jul 14 14:16:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:16:38.174260 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-23279c48-0b89-4ad0-82d2-0e0d1ba53a74 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:38.179934 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.wsgi [None req-23279c48-0b89-4ad0-82d2-0e0d1ba53a74 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-23279c48-0b89-4ad0-82d2-0e0d1ba53a74 admin admin] Request method failure captured: Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: Accept: application/json Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: Accept-Encoding: gzip, deflate Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: Connection: keep-alive Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: Content-Length: 0 Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: Host: 10.222.0.81 Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: Openstack-Api-Version: compute 2.90 Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: Openstack-System-Scope: None Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: User-Agent: python-novaclient Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: X-Auth-Token: gAAAAABi0CVFoZbaPwRjsQkUT2PBjVv7kbMdwqX5ZJaak8SrpZmDpTDzZz-v4zxOxGc1at7AvDlBC5djand8jpHP44W4mJtwU782gNeowRNmLKS9jnhPkU28IE4iB-mNiz-0IaLbpccz-vakiGb6Udd_p1rArXok27ROTmGaeIs6GeokDxWyhfY Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: X-Domain-Id: None Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: X-Domain-Name: None Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: X-Identity-Status: Confirmed Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: X-Is-Admin-Project: True Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: X-Project-Domain-Id: default Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: X-Project-Domain-Name: Default Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: X-Project-Id: d63b8c6c04eb4fd0bf21450bfce1f08a Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: X-Project-Name: admin Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: X-Role: reader,member,admin Jul 14 14:16:38.181487 n-d-767704-28 devstack@n-api.service[104157]: X-Roles: reader,member,admin Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d63b8c6c04eb4fd0bf21450bfce1f08a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d63b8c6c04eb4fd0bf21450bfce1f08a"}]}] Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: X-Tenant: admin Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: X-Tenant-Id: d63b8c6c04eb4fd0bf21450bfce1f08a Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: X-Tenant-Name: admin Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: X-User: admin Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: X-User-Domain-Id: default Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: X-User-Domain-Name: Default Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: X-User-Id: 1f675880a94e41b0ad78c80305cdd708 Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: X-User-Name: admin Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: method: > Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: exception: Flavor 451 could not be found. Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: action_args: {'id': '451'} Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:16:38.183136 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:16:38.184120 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: ERROR nova.api.openstack.wsgi Jul 14 14:16:38.185449 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-23279c48-0b89-4ad0-82d2-0e0d1ba53a74 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:16:38.186717 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-23279c48-0b89-4ad0-82d2-0e0d1ba53a74 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013332 Jul 14 14:16:38.186717 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 27/52] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:16:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 14:16:39.217968 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:39.219744 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 14 14:16:39.220103 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 26/53] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jul 14 14:16:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:16:39.814115 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-3168277b-e646-4f5b-bbc8-8c0bfbe7af72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:16:39.833255 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-3168277b-e646-4f5b-bbc8-8c0bfbe7af72 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.473675 Jul 14 14:16:39.833809 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 28/54] 10.222.0.81 () {64 vars in 1235 bytes} [Thu Jul 14 14:16:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:16:40.880641 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:40.881680 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 14 14:16:40.882100 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 27/55] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jul 14 14:16:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:16:41.478288 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-8bc0d650-4063-4e33-b905-f23ed831ea3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:16:41.498646 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-8bc0d650-4063-4e33-b905-f23ed831ea3d admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.476953 Jul 14 14:16:41.499392 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 29/56] 10.222.0.81 () {64 vars in 1235 bytes} [Thu Jul 14 14:16:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:16:42.552411 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:42.554051 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002279 Jul 14 14:16:42.554669 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 28/57] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jul 14 14:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:16:43.192283 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-4f8ca2e4-1603-438b-af94-4fc6a12bd229 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:16:43.212777 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-4f8ca2e4-1603-438b-af94-4fc6a12bd229 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.513289 Jul 14 14:16:43.213393 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 30/58] 10.222.0.81 () {64 vars in 1235 bytes} [Thu Jul 14 14:16:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:16:44.256006 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:44.257054 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 14 14:16:44.257458 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 29/59] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jul 14 14:16:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:16:44.871158 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-f70d051b-2018-44b8-b68c-fca36b3eb2da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:16:44.892263 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-f70d051b-2018-44b8-b68c-fca36b3eb2da admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.487126 Jul 14 14:16:44.892820 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 31/60] 10.222.0.81 () {64 vars in 1235 bytes} [Thu Jul 14 14:16:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:16:45.974542 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:45.975554 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 14 14:16:45.975949 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 30/61] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jul 14 14:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:16:46.552604 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-773995b5-40e6-49d6-bd96-43d30a050f1f admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:16:46.573160 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-773995b5-40e6-49d6-bd96-43d30a050f1f admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.458113 Jul 14 14:16:46.573730 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 32/62] 10.222.0.81 () {60 vars in 1202 bytes} [Thu Jul 14 14:16:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:17:41.646838 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:17:41.648012 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-a348a856-aef7-4a71-a889-04bc507df91c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 14 14:17:41.648290 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 31/63] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jul 14 14:17:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:17:41.660065 n-d-767704-28 devstack@n-api.service[104157]: DEBUG dbcounter [-] [104157] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:17:42.063417 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-4cec2548-d281-45ef-a4b1-0a4da6223ba4 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:17:42.084594 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-4cec2548-d281-45ef-a4b1-0a4da6223ba4 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.428920 Jul 14 14:17:42.085105 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 33/64] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jul 14 14:17:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:17:42.106862 n-d-767704-28 devstack@n-api.service[104156]: DEBUG dbcounter [-] [104156] Writing DB stats nova_api:SELECT=14 {{(pid=104156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:17:42.110746 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-36b6705e-7e3d-4e2f-93b4-0383afbca4cc admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:17:42.120818 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-36b6705e-7e3d-4e2f-93b4-0383afbca4cc admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015572 Jul 14 14:17:42.121495 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 32/65] 10.222.0.81 () {60 vars in 1282 bytes} [Thu Jul 14 14:17:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:17:42.133563 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-7d6c4bf7-4e18-425a-a249-b67644b2ef85 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:17:42.142304 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-7d6c4bf7-4e18-425a-a249-b67644b2ef85 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012283 Jul 14 14:17:42.142944 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 34/66] 10.222.0.81 () {60 vars in 1285 bytes} [Thu Jul 14 14:17:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:17:42.155365 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-c4fc6979-5152-49c7-95f2-48f0ecf661f5 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:17:42.163559 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-c4fc6979-5152-49c7-95f2-48f0ecf661f5 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012341 Jul 14 14:17:42.164104 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 33/67] 10.222.0.81 () {60 vars in 1285 bytes} [Thu Jul 14 14:17:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:17:42.176868 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-c4cde1d2-b1ed-44b4-8509-0279ff89116c admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:17:42.184686 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-c4cde1d2-b1ed-44b4-8509-0279ff89116c admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012017 Jul 14 14:17:42.185342 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 35/68] 10.222.0.81 () {60 vars in 1282 bytes} [Thu Jul 14 14:17:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:24.265310 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-c4fc6979-5152-49c7-95f2-48f0ecf661f5 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:24.266360 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-c4fc6979-5152-49c7-95f2-48f0ecf661f5 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Jul 14 14:23:24.266765 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 34/69] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jul 14 14:23:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:24.418216 n-d-767704-28 devstack@n-api.service[104157]: DEBUG dbcounter [-] [104157] Writing DB stats nova_api:SELECT=6 {{(pid=104157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:24.564719 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-36e204b2-db8e-431f-9487-f355e1769223 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:24.565981 n-d-767704-28 devstack@n-api.service[104157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:23:24.565981 n-d-767704-28 devstack@n-api.service[104157]: warnings.warn(msg) Jul 14 14:23:24.567320 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_concurrency.lockutils [None req-36e204b2-db8e-431f-9487-f355e1769223 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:23:24.567791 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_concurrency.lockutils [None req-36e204b2-db8e-431f-9487-f355e1769223 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:23:24.568703 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_concurrency.lockutils [None req-36e204b2-db8e-431f-9487-f355e1769223 admin admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:23:24.569185 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_concurrency.lockutils [None req-36e204b2-db8e-431f-9487-f355e1769223 admin admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:23:24.611521 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-36e204b2-db8e-431f-9487-f355e1769223 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.198863 Jul 14 14:23:24.612094 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 36/70] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:23:24 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:23:25.456811 n-d-767704-28 devstack@n-api.service[104156]: DEBUG nova.api.openstack.wsgi [None req-c4fc6979-5152-49c7-95f2-48f0ecf661f5 admin admin] Calling method '>' {{(pid=104156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:25.457858 n-d-767704-28 devstack@n-api.service[104156]: INFO nova.api.openstack.requestlog [None req-c4fc6979-5152-49c7-95f2-48f0ecf661f5 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 14 14:23:25.458257 n-d-767704-28 devstack@n-api.service[104156]: [pid: 104156|app: 0|req: 35/71] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jul 14 14:23:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:25.656426 n-d-767704-28 devstack@n-api.service[104157]: DEBUG nova.api.openstack.wsgi [None req-4b78cb99-1b13-4d57-a1b1-e1a1c27a1110 admin admin] Calling method '>' {{(pid=104157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:25.657628 n-d-767704-28 devstack@n-api.service[104157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:23:25.657628 n-d-767704-28 devstack@n-api.service[104157]: warnings.warn(msg) Jul 14 14:23:25.658809 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_concurrency.lockutils [None req-4b78cb99-1b13-4d57-a1b1-e1a1c27a1110 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:23:25.659247 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_concurrency.lockutils [None req-4b78cb99-1b13-4d57-a1b1-e1a1c27a1110 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:23:25.660043 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_concurrency.lockutils [None req-4b78cb99-1b13-4d57-a1b1-e1a1c27a1110 admin admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:23:25.660471 n-d-767704-28 devstack@n-api.service[104157]: DEBUG oslo_concurrency.lockutils [None req-4b78cb99-1b13-4d57-a1b1-e1a1c27a1110 admin admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:23:25.684578 n-d-767704-28 devstack@n-api.service[104157]: INFO nova.api.openstack.requestlog [None req-4b78cb99-1b13-4d57-a1b1-e1a1c27a1110 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.080920 Jul 14 14:23:25.685174 n-d-767704-28 devstack@n-api.service[104157]: [pid: 104157|app: 0|req: 37/72] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:23:25 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:24:12.292805 n-d-767704-28 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 14:24:12.293387 n-d-767704-28 devstack@n-api.service[104155]: Thu Jul 14 14:24:12 2022 - graceful shutdown triggered... Jul 14 14:24:12.293837 n-d-767704-28 devstack@n-api.service[104156]: Gracefully killing worker 1 (pid: 104156)... Jul 14 14:24:12.294484 n-d-767704-28 devstack@n-api.service[104157]: Gracefully killing worker 2 (pid: 104157)... Jul 14 14:24:13.294264 n-d-767704-28 devstack@n-api.service[104155]: worker 1 buried after 1 seconds Jul 14 14:24:13.294264 n-d-767704-28 devstack@n-api.service[104155]: worker 2 buried after 1 seconds Jul 14 14:24:13.294264 n-d-767704-28 devstack@n-api.service[104155]: goodbye to uWSGI. Jul 14 14:24:13.295903 n-d-767704-28 systemd[1]: devstack@n-api.service: Succeeded. Jul 14 14:24:13.296535 n-d-767704-28 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 14:24:13.300115 n-d-767704-28 systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 14:24:13.318101 n-d-767704-28 devstack@n-api.service[119502]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 14:24:13 2022] *** Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: nodename: n-d-767704-28 Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: machine: x86_64 Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: clock source: unix Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: pcre jit disabled Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: detected number of CPU cores: 4 Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: current working directory: / Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: detected binary path: /usr/bin/uwsgi-core Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: your processes number limit is 47680 Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: your memory page size is 4096 bytes Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: detected max file descriptor number: 2048 Jul 14 14:24:13.338602 n-d-767704-28 devstack@n-api.service[119502]: lock engine: pthread robust mutexes Jul 14 14:24:13.339734 n-d-767704-28 devstack@n-api.service[119502]: thunder lock: enabled Jul 14 14:24:13.339734 n-d-767704-28 devstack@n-api.service[119502]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 14:24:13.339734 n-d-767704-28 devstack@n-api.service[119502]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 14:24:13.384650 n-d-767704-28 devstack@n-api.service[119502]: Python main interpreter initialized at 0x55ca890489c0 Jul 14 14:24:13.384650 n-d-767704-28 devstack@n-api.service[119502]: python threads support enabled Jul 14 14:24:13.384650 n-d-767704-28 devstack@n-api.service[119502]: your server socket listen backlog is limited to 100 connections Jul 14 14:24:13.384650 n-d-767704-28 devstack@n-api.service[119502]: your mercy for graceful operations on workers is 90 seconds Jul 14 14:24:13.385258 n-d-767704-28 devstack@n-api.service[119502]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 14:24:13.385403 n-d-767704-28 devstack@n-api.service[119502]: *** Operational MODE: preforking *** Jul 14 14:24:13.385720 n-d-767704-28 devstack@n-api.service[119502]: *** uWSGI is running in multiple interpreter mode *** Jul 14 14:24:13.385720 n-d-767704-28 devstack@n-api.service[119502]: spawned uWSGI master process (pid: 119502) Jul 14 14:24:13.385926 n-d-767704-28 systemd[1]: Started Devstack devstack@n-api.service. Jul 14 14:24:13.387316 n-d-767704-28 devstack@n-api.service[119502]: spawned uWSGI worker 1 (pid: 119511, cores: 1) Jul 14 14:24:13.387316 n-d-767704-28 devstack@n-api.service[119502]: spawned uWSGI worker 2 (pid: 119512, cores: 1) Jul 14 14:24:13.387316 n-d-767704-28 devstack@n-api.service[119502]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 14:24:14.058079 n-d-767704-28 devstack@n-api.service[119511]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 14:24:14.061335 n-d-767704-28 devstack@n-api.service[119512]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 14:24:15.282254 n-d-767704-28 devstack@n-api.service[119511]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:24:15.282254 n-d-767704-28 devstack@n-api.service[119511]: from cryptography.utils import int_from_bytes Jul 14 14:24:15.283068 n-d-767704-28 devstack@n-api.service[119511]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:24:15.283068 n-d-767704-28 devstack@n-api.service[119511]: from cryptography.utils import int_from_bytes Jul 14 14:24:15.289328 n-d-767704-28 devstack@n-api.service[119512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:24:15.289328 n-d-767704-28 devstack@n-api.service[119512]: from cryptography.utils import int_from_bytes Jul 14 14:24:15.289963 n-d-767704-28 devstack@n-api.service[119512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:24:15.289963 n-d-767704-28 devstack@n-api.service[119512]: from cryptography.utils import int_from_bytes Jul 14 14:24:17.616307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:24:17.616895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:24:17.617330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:24:17.618000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:24:17.618451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:24:17.618999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.619341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.619674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.620006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.620349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.620671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.621022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.621357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.621692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.621958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.622281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.622612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-767704-28 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.622942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.623256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.623576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.623987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.624413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.624518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.624834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.625371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.626459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.626459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.626459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.626842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.627086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.627400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.627733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.628050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.628386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.628711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.629149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-767704-28 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.629482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.629807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.630128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.630557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.630878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.631196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.631528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.631864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.632188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.632669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.633305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.633693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.634030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.634341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.634660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.634980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.635309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.635622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.635934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.636191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.636509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.636835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.637192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.637530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.637787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.638035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.638358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.638698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.639016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.639333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.639647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.639961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.640271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.640583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.640898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.641239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.641886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.641886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.642206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.642526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.642853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.643268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.643526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.643843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.644009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:24:17.644489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.644640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:24:17.644778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.644928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:24:17.645155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.645301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:24:17.645461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.645607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:24:17.645747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.645887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.646020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.646168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.646333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.646475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.646607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.646747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.646887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.647035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.647181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.647323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.647455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.647585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.647722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.647877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.648527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.649117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.649289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.649437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.649579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.649729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.649872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.650004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-767704-28 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.650135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.650274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.650415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.650645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.650787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.650927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.651068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.651208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.651348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.651494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.651628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.651759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.651899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.652038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.652183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.652183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.652468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.652639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.652794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.652928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.653105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.653247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.653388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.653531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.653671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.653804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.654229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.654379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.654512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.654652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.654794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.654940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.655074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.655205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.655349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.655481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.655621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.655761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.655900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-767704-28 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.656049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.656189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.656329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.656471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.656613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.656753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.656937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.657115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.657256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.657390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.657521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.657690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.657841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.658015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.658172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.658796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.659050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.659223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.659396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.659537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.659669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.659801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.659931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.660075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.660215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.660356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.660498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.660629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.660759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.660900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.661074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.661208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.661347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.661480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.661611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.661757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.661899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.662039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.662170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.662308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.662454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.662590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.662730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.662870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.663003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.663144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.663284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.663424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.663580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.663746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.664553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.664553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.664841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.665028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.665177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.665311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.665444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.665589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.665730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.665870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.666013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.666155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.666295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.666436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.666579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.666711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.666842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.666972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.667110 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.667255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.667387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.667517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.667652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.667783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.667974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.668123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.668273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.668985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.668985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.669352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.669495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.669627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.669627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.669873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.669873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.670129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.670273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.670405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.670405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.670661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.670790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.670922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.671062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.671201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.671342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.671489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.671621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.671762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.671894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.672093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.672237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.672442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.672652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.672804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.672989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.673124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.673268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.673409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.673542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.673709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.673845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.673985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.674138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.674283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.674645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.674802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.674936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.675068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.675206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.676743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.676902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.677263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.677435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.677629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.677821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.677966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.678098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.678854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.679095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.679269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.679553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.679693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.679835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.679835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.680085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.680226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.680367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.680367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.680625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.682106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.682258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.684047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.684201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.684336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.684568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.684982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.685122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.685267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.685267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.685539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.685678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.685809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.685948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.686080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.686266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.686407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.686539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.686677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.686816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.686956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.687089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.687242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.687383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.687525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.687657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.687796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.687935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.688078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.688212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.688342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.688533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.688681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.688829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.690087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.690232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.690374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.690505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.690650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.690795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.690941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.691080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.691219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.691359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.691503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.691641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.691772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.691908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.692039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.692178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.692320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.694063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.694239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.694386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.694528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.694670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.695294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.695449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.695592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.695592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.695852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.696002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.696002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.696260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.696401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.696535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.696812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.696812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.697149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.697290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.697290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.697555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.697709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.697709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.697957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.698101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.698101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.698364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:24:17.698506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.698506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.698764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.698895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.698895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.699146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.699287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.699287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.699549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.699690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.699820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.699961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.700114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.700357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.700499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.700636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.700766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.700914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.701072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.701212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.701212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.701212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.701212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.701212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.701212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.701954 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.702100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.702243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.702383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.702527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.702657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.702795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.702933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.703063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.703202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.703332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.703469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.703607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.703736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.703875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.704013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.704259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.704394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.704394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.704647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.704775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.704915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.705082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.705472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.705621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.705753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.705883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.706022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.706153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.706290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.706422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.706551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.706692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.706835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.706976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.707107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.707236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.707365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.707508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.707652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.707858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.708006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.708671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.708818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.708982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.709117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.709247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.709388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.709519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.709519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.709786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.709917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.710045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.710184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.710314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.711045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.711227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.711393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.711540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.711688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.711828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.711974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.712375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.712510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.712647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.712777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.712914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.713180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.713316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.713446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.713574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.713702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.713839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.713983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.714115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.714244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.714381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.714511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.714806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.715100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.715237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.715617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.715754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.715883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.716021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.716160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.716298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.716298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.716553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.716691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.716838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.716987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.717118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.717247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.717388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.717521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.717665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.717795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.717924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.718052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.718188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.718317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.718460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.718598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.718736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.718736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.718990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.719128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.719257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.719385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.719513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.719652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.719782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.720665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.720809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.720991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.721229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.721750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.721904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.722056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.722187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.722325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.722454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.722591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.722721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.722850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.722978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.723107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.723245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.723383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.723521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.723664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.723804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.723941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.724297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.724433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.724573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.724713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.727822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.727994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.728142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.728291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.728435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.728575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.728717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.728849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.728999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.729130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.729130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.729397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.729526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.729654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.729791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.729930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.730070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.730201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.730328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.730456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.730584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.730727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.730858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.730986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.731123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.731267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.731485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.731485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.732135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.732716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.732716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.732716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.733126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.733268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.733268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.733510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.733637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.733763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.733899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.734042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.734179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.734308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.734435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.734569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.734569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.734835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.734978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.735114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.735233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.735368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.735504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.735655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.735861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.735995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.736125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.736334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.736494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.736707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.736854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.737097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.737245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.737392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.737523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.737662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.737791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.737929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.737929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.738577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.739143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.739143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.739415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.739556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.739556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.739831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.739970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.740108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.740238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.740380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.740526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.740670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.740816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.741276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.741427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.741568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.741725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.741958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.742092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.742221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.742501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.742637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.742755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.742891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.743021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.743157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.743300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.743437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.743566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.743703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.743833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.743969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.744112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.744241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.744379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.744517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.744646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.744861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.745023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.745023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.745023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.745023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.745501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.745646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.745785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.746004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.746144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.746263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.746473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.746617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.746748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.746888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.747018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.747227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.747368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.747508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.747639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.747775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.747916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.747916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.748178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.748317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.748455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.748593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.748726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.748855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.749033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.749174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.749304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.749441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.749585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.749715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.749852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.749982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.750110 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.750246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.750384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.750513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.750664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.750864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.751005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.751143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.751273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.751417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.751555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.751684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.751813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.751964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.752321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.752473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.752638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.752785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.752922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.753074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.753196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.753339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.753478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.753616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.753746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.753882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.754021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.754161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.754299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.754437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.754555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.754692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.754832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.754962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.755098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.755230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.755367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.755494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.755640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.755771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.755909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.756127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.756269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.756408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.756666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.756666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.757040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.757040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.757413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.757558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.757699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.757832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.757961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.758099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.758239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.758380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.758522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.758653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.758782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.758919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.759057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.759057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.759321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.759321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.759613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.759751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.759881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.760019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.760150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.760261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.760372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.760491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.760602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.760602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.760833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.760833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.761090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.761233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.761373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.761513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.761652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.761783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.761920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.762051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.762208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.762208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.762561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.762681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.762790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.762790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.763027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.763165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.763284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.763419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.763548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.763686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.763825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.763963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.764101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.764239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.764369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.764514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.764654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.764792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.764931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.765083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.765212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.765212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.765478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.765610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.765749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.765879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.766008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.766165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.766388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.766531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.766741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.766883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.767014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.767196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.767328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.767542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.767684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.767824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.767973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.768113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.768257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.768395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.768540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.768672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.768810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.768930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.769157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.769292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.769430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.769569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.769700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.769830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.769961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.770105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.770243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.770382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.770512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.770649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.770780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.770923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.771043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.771180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.771318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.771455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.771593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.771732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.771862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.771992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.772122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.772251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.772387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.772690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.772825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.773488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.773687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.773841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.773983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.774125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.774255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.774384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.774576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.774709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.774852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.774983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.775121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.775260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.775398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.775529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.775673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.775804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.775942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.776072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.776211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.776373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.776584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.776732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.776932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.777101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.777234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.777368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.777489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.777700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.777825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.777938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.778047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.778165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.778285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.778404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.778514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.778631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.778742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.778864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.778975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.779099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.779215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.779334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.779444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.779632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.779753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.779884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.780021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.780161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.780300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.780439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.780577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.780707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.780844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.781037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.781181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.781181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.781429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.781566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.781704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.781842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.781986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.782116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.782253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.782390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.782530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.782772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.782918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.783057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.783188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.783317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.783454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.783599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.783733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.783873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.783873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.784138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.784277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.784422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.784555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.784693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.784824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.784973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.785118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.785259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.785397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.785535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.785675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.785794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.785922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.786061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.786228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.786367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.786498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.786715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.786858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.787073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.787207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.787337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.787479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.787610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.787828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.787969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.788100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.788237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.788367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.788497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.788667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.789371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.789521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.789663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.789955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.790103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.790246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.790377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.790507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.790507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.791345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.791486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.791619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.791758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.791891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.792021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.792151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.792294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.792426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.792544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.792672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.792822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.793076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.793221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.793352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.793481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.793610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.793739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.793866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.794009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.794148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.794279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.794409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.794537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.794681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.794811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.794941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.795071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.795209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.795346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.795486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.795616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.795752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.795882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.796021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.796161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.796305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.796444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.796582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.796734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.796924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.797265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.797416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.797549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.797680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.797832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.798039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.798182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.798315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.798444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.798584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.798714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.798856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.798997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.799131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.799263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.799392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.799530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.799669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.799813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.799944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.800081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.800212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.800343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.800472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.800620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.800832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.801004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.801138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.801283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.801416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.801546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.801687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.801826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.801957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.802095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.802235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.802373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.802505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.802634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.802763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.802910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.803102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.803327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.803473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.803612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.803753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.803874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.803998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.804128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.804288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.804443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.804727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.804871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.805033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.805164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.805294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.805423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.805567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.805699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.805840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.805972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.806110 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.806248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.806389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.806520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.806659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.806789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.806943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.807150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.807371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.807505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.807643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.807774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.807969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.808198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.808341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.808472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.808602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.808740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.808871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.809065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.809199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.809328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.809458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.809594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.809736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.809876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.810005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.810134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.810263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.810400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.810544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.810689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.810821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.810958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.811167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.811295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.811422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.811535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.811535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.811757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.811888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.812026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.812167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.812298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.812435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.812566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.812566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.812819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.812976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.813121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.813262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.813492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.813634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.813779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.813921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.814060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.814199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.814330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.814459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.814602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.814733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.814863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.814993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.815122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.815262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.815402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.815540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.815671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.815810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.815940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.816086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.816225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.816364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.816501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.816634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.816773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.816913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.817077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.817293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.817511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.817645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.817783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.817913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.818042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.818193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.818399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.818541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.818688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.818819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.818948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.819086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.819226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.819365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.819508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.819640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.819779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.820458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.820617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.820750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.820899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.821072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.821205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.821336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.821482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.821482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.821747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.821871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.822000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.822129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.822260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.822404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.822536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.822665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.822802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.822941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.823072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.823216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.823349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.823494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.823494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.823846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.823985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.824124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.824245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.824377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.824516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.824655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.824800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.824931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.825097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.825233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.825354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.825487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.825626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.825756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.825886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.826014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.826143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.826272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.826410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.826543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.826673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.826802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.826931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.827069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.827301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.827524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.827721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.827854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.827984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.828133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.828265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.828479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.828629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.828800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.829005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.829154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.829287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.829479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.829612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.829801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.829943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.830122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.830257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.830435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.830568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.830743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.830889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.831049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.831183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.831362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.831496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.831670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.831819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.831978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.832120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.832286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.832419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.832594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.832735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.832903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.833063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.833232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.833375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.833537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.833697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.833920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.834052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.834259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.834382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.834521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.834659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.834795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.834926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.835055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.835184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.835352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.835540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.836240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.836456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.836677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.836868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.837347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.837496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.856057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.856407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.856555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.856667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.856766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.856879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.857079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.857201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.857310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.857409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.857515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.857608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.857719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.857860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.858062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.858062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.858381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.858493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.858614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.858726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.858849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.858977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.859102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.859207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.859409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.859544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.859719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.859852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.860738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.860833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.860925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.861056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.861154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.861246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.861337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.861428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.861518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.861617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.861711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.865826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.865974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.866096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.866216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.866349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.866472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.866472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.866718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.866840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.866964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.867077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.867193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.867312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.867431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.867431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.867724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.867868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.868001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.868216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.868216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.868216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.868216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.868833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.868980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.869099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.869220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.869345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.869555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.869672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.869799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.869799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.870021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.870152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.870276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.870389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.870506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.870641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.870753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.870864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.870864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.871081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.871207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.871329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.871442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.871597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.871728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.871862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.871989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.872115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.872253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.872378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.872510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.872649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.872775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.872775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.873043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.873170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.873306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.873433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.873557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.873682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.873809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.873809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.874065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.874065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.874301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.874301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.874594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.874760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.874914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.875058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.875204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.875346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.875490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.875659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.875804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.875959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.876111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.876325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.876482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.876482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.876767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.876917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.877088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.877215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.877215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.877475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.877475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.877786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.877934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.877934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.878230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.878469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.878697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.878697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.879004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.879161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.879306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.879466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.879708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.879844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.879986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.880129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.880290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.880429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.880556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.880697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.880845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.881002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.881164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.881316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.881461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.881623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.881623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.881916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.882085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.882242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.882994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.883192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.883405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.883560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.883721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.883721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.884002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.884144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.884283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.884418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.884544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.884671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.884671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.884907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.885119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.885259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.885387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.885512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.885637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.885805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.885954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.886098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.886313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.886473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.886631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.886804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.886948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.887124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.887302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.887438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.887571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.887743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.887743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.888160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.888338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.888617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.888917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.889109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.889252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.889382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.889510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.889646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.889646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.890056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.890194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.890320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.890417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.890513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.890613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.890708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.890812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.890910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.891995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.893035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.893173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.893173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.893173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.893173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.893173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.893173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.893903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.893903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.894161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.894491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.894491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.894749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.894882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.895009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.895135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.895272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.895408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.895536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.895704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.895857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.895857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.896096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.896281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.896415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.896415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.896653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.896779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.896779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.897075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.897215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.897344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.897470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.897596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.897722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.897860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.897860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.898693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.899201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.899423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.899563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.899703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.899845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.900116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.900252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.900380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.900516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.900516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:24:17.900758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.900758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.900758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.900758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.900758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.900758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.900758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.900758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.901778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.901778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.901778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.901778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.901778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.901778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.901778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.901778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.902714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.902714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.902714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.902714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.902714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.902714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.902714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.902714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.903636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.903636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.903636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.903636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.903636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.903636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.903636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.903636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.904567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.904567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.904567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.904567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.904567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.904567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.904567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.904567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.906078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.906078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.906078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.906078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.906078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.906078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.906078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.906078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.907019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.907019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.907019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.907019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.907019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.907019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.907019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.907835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.907835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.907835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.908183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.908316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.908577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.908913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.909245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.910481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.910481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.910481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.910481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.911006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.911006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.911431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.911621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.912085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.912311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.912632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.912986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.913305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.913724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.914018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.914345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.914674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.915103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.915313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.915654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.916011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.916291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.916996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.916996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.917382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.917587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.917928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.918260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.918574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.918908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.919238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.919559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.919883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.920404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.920696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.921521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.921521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.921521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.921869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.922102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.922422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.922816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.923141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.923676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.923836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.924355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.924577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.924935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.925339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.925679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.926190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.926379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.926732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.927067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.927457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.927697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.928011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:24:17.928257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:24:18.045964 n-d-767704-28 devstack@n-api.service[119511]: INFO dbcounter [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] Registered counter for database nova_api Jul 14 14:24:18.066993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_db.sqlalchemy.engines [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:24:18.074061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writer thread running {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:24:18.084213 n-d-767704-28 devstack@n-api.service[119512]: INFO dbcounter [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] Registered counter for database nova_api Jul 14 14:24:18.105172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_db.sqlalchemy.engines [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:24:18.111780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writer thread running {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:24:18.132073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.context [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) {{(pid=119511) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 14:24:18.136314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:24:18.137958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:24:18.138806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:24:18.140849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:24:18.142921 n-d-767704-28 devstack@n-api.service[119511]: INFO dbcounter [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] Registered counter for database nova_cell0 Jul 14 14:24:18.147103 n-d-767704-28 devstack@n-api.service[119511]: INFO dbcounter [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] Registered counter for database nova_cell1 Jul 14 14:24:18.156237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_db.sqlalchemy.engines [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:24:18.157041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_db.sqlalchemy.engines [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:24:18.164209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writer thread running {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:24:18.170743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.context [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) {{(pid=119512) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 14:24:18.174905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:24:18.176495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:24:18.177324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:24:18.180658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:24:18.182013 n-d-767704-28 devstack@n-api.service[119512]: INFO dbcounter [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] Registered counter for database nova_cell0 Jul 14 14:24:18.186255 n-d-767704-28 devstack@n-api.service[119512]: INFO dbcounter [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] Registered counter for database nova_cell1 Jul 14 14:24:18.194057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_db.sqlalchemy.engines [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:24:18.196587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_db.sqlalchemy.engines [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:24:18.206279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writer thread running {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:24:18.207599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writer thread running {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:24:18.309266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writer thread running {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:24:18.319900 n-d-767704-28 devstack@n-api.service[119511]: INFO dbcounter [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] Registered counter for database nova_cell0 Jul 14 14:24:18.327246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_db.sqlalchemy.engines [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:24:18.336637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writer thread running {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:24:18.369101 n-d-767704-28 devstack@n-api.service[119512]: INFO dbcounter [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] Registered counter for database nova_cell0 Jul 14 14:24:18.377315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_db.sqlalchemy.engines [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:24:18.382158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writer thread running {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:24:18.659620 n-d-767704-28 devstack@n-api.service[119511]: WARNING keystonemiddleware.auth_token [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:24:18.667025 n-d-767704-28 devstack@n-api.service[119511]: WARNING keystonemiddleware.auth_token [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:24:18.710539 n-d-767704-28 devstack@n-api.service[119512]: WARNING keystonemiddleware.auth_token [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:24:18.718778 n-d-767704-28 devstack@n-api.service[119512]: WARNING keystonemiddleware.auth_token [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:24:19.013288 n-d-767704-28 devstack@n-api.service[119511]: WARNING keystonemiddleware.auth_token [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:24:19.019315 n-d-767704-28 devstack@n-api.service[119511]: WARNING keystonemiddleware.auth_token [None req-41f058a8-364a-4283-8308-d611c5fd91e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:24:19.025711 n-d-767704-28 devstack@n-api.service[119511]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca890489c0 pid: 119511 (default app) Jul 14 14:24:19.066079 n-d-767704-28 devstack@n-api.service[119512]: WARNING keystonemiddleware.auth_token [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:24:19.072845 n-d-767704-28 devstack@n-api.service[119512]: WARNING keystonemiddleware.auth_token [None req-a51edd52-3593-4070-ac93-e7c04ea11a5a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:24:19.079234 n-d-767704-28 devstack@n-api.service[119512]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca890489c0 pid: 119512 (default app) Jul 14 14:25:05.623686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:05.626383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:05.627350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:05.629297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:07.392811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:07.395663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:07.396882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:07.405942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:07.615945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2d71aae2-1574-4023-8011-efb05dbc34a1 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1787539566", "id": 156941635, "os-flavor-access:is_public": "False"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:07.646179 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:07.646179 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:07.712765 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2d71aae2-1574-4023-8011-efb05dbc34a1 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 2.102124 Jul 14 14:25:07.715137 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1/1] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:25:05 2022] POST /compute/v2.1/flavors => generated 428 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:08.071068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f59f92f7-2ad9-42c2-a2aa-d7b1b12136e3 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Calling method '.version_select at 0x7fd6c84f1e50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:08.072654 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:08.072654 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:08.079314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f59f92f7-2ad9-42c2-a2aa-d7b1b12136e3 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) {{(pid=119511) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 14 14:25:08.080526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f59f92f7-2ad9-42c2-a2aa-d7b1b12136e3 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:08.081133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f59f92f7-2ad9-42c2-a2aa-d7b1b12136e3 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:08.113253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f59f92f7-2ad9-42c2-a2aa-d7b1b12136e3 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:08.113856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f59f92f7-2ad9-42c2-a2aa-d7b1b12136e3 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:08.133654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f59f92f7-2ad9-42c2-a2aa-d7b1b12136e3 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:08.134358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f59f92f7-2ad9-42c2-a2aa-d7b1b12136e3 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:08.144465 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f59f92f7-2ad9-42c2-a2aa-d7b1b12136e3 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.427535 Jul 14 14:25:08.155494 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2/2] 10.222.0.81 () {60 vars in 1207 bytes} [Thu Jul 14 14:25:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:25:08.326972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f68b15d-3599-4e22-a76b-2c890bd42ca0 tempest-FlavorMetadataValidation-1748016475 tempest-FlavorMetadataValidation-1748016475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1929943158", "id": 1053232631, "os-flavor-access:is_public": "True"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:08.329488 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:08.329488 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:08.361352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a2c8762f-3c50-432d-92b0-a99874cfbccf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:08.364823 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:08.364823 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:08.367523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2c8762f-3c50-432d-92b0-a99874cfbccf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:08.368484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2c8762f-3c50-432d-92b0-a99874cfbccf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:08.369419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2c8762f-3c50-432d-92b0-a99874cfbccf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:08.370071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2c8762f-3c50-432d-92b0-a99874cfbccf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:08.379856 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f68b15d-3599-4e22-a76b-2c890bd42ca0 tempest-FlavorMetadataValidation-1748016475 tempest-FlavorMetadataValidation-1748016475-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.232521 Jul 14 14:25:08.383279 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3/3] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:25:08 2022] POST /compute/v2.1/flavors => generated 471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:08.389744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-74307926-43c6-489d-92c1-d7def720de20 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d618357563954e8f9d62d91f513d0c6d"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:08.391333 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:08.391333 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:08.435955 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a2c8762f-3c50-432d-92b0-a99874cfbccf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 1.053896 Jul 14 14:25:08.437107 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1/4] 10.222.0.81 () {58 vars in 1175 bytes} [Thu Jul 14 14:25:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:08.562319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cbfcd504-9e3a-4e83-b6dc-1ab855e22bca tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '.version_select at 0x7fd6c83c2700>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:08.565240 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:08.565240 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:08.581405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cbfcd504-9e3a-4e83-b6dc-1ab855e22bca tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) {{(pid=119512) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 14 14:25:08.583901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cbfcd504-9e3a-4e83-b6dc-1ab855e22bca tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:08.585180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cbfcd504-9e3a-4e83-b6dc-1ab855e22bca tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:08.660377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cbfcd504-9e3a-4e83-b6dc-1ab855e22bca tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:08.661394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cbfcd504-9e3a-4e83-b6dc-1ab855e22bca tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:08.696443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cbfcd504-9e3a-4e83-b6dc-1ab855e22bca tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:08.697610 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-74307926-43c6-489d-92c1-d7def720de20 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/156941635/action" status: 200 len: 96 microversion: 2.1 time: 0.312798 Jul 14 14:25:08.697964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cbfcd504-9e3a-4e83-b6dc-1ab855e22bca tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:08.708725 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 4/5] 10.222.0.81 () {60 vars in 1196 bytes} [Thu Jul 14 14:25:08 2022] POST /compute/v2.1/flavors/156941635/action => generated 96 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:25:08.710128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-74307926-43c6-489d-92c1-d7def720de20 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:08.711636 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cbfcd504-9e3a-4e83-b6dc-1ab855e22bca tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.272110 Jul 14 14:25:08.712341 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-74307926-43c6-489d-92c1-d7def720de20 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] 10.222.0.81 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002478 Jul 14 14:25:08.712845 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 5/6] 10.222.0.81 () {56 vars in 885 bytes} [Thu Jul 14 14:25:08 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 14 14:25:08.728585 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2/7] 10.222.0.81 () {58 vars in 1166 bytes} [Thu Jul 14 14:25:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:08.738800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-afa01fb2-5ea0-4d5e-b375-b0e1b819897f tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1568401373"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:08.759209 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:08.759209 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:08.761151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.aggregate [None req-afa01fb2-5ea0-4d5e-b375-b0e1b819897f tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Generated uuid aa29f5ae-a3e9-446d-aceb-273a851d96a6 for aggregate {{(pid=119512) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:25:08.876873 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-afa01fb2-5ea0-4d5e-b375-b0e1b819897f tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.146509 Jul 14 14:25:08.883756 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3/8] 10.222.0.81 () {62 vars in 1204 bytes} [Thu Jul 14 14:25:08 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:08.888791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5ef3180b-f3b4-4d85-bd85-3cffd69d98f6 tempest-FlavorMetadataValidation-1748016475 tempest-FlavorMetadataValidation-1748016475-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:08.890664 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:08.890664 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:09.031293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f769267-fa74-4466-a6e1-9800de97a08d tempest-AZAdminNegativeTestJSON-467419624 tempest-AZAdminNegativeTestJSON-467419624-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:09.032288 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:09.032288 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:09.033555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1f769267-fa74-4466-a6e1-9800de97a08d tempest-AZAdminNegativeTestJSON-467419624 tempest-AZAdminNegativeTestJSON-467419624-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '4ce493f87d914e71b799e4afe04fbe5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f954cab438f840e09234e87014455050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f769267-fa74-4466-a6e1-9800de97a08d tempest-AZAdminNegativeTestJSON-467419624 tempest-AZAdminNegativeTestJSON-467419624-project] Request method failure captured: Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdA87EHS_lFwJNivF9zrrWnWXQR8bT__nAeanL1A4pQPU0pdAjwsDYn_hpvIhb_eBYSLr-U1mG2yQ8ThwXJg8wpA0uYiTVeUaq7vihtfXV8T5AoJbMxEgdSmHlBaW_e0-RANhY9XPffuSVJOh3LGM5ckmJqJYzn0LkaOwXOUISfFP4 Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: f954cab438f840e09234e87014455050 Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AZAdminNegativeTestJSON-467419624 Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:25:09.036632 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:25:09.037907 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f954cab438f840e09234e87014455050"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f954cab438f840e09234e87014455050"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f954cab438f840e09234e87014455050", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f954cab438f840e09234e87014455050"}]}] Jul 14 14:25:09.037907 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AZAdminNegativeTestJSON-467419624 Jul 14 14:25:09.037907 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: f954cab438f840e09234e87014455050 Jul 14 14:25:09.037907 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-467419624 Jul 14 14:25:09.037907 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AZAdminNegativeTestJSON-467419624-project Jul 14 14:25:09.037907 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:25:09.037907 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:25:09.037907 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4ce493f87d914e71b799e4afe04fbe5a Jul 14 14:25:09.037907 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AZAdminNegativeTestJSON-467419624-project Jul 14 14:25:09.037907 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:25:09.037907 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 14 14:25:09.037907 n-d-767704-28 devstack@n-api.service[119511]: action_args: {} Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:25:09.038600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:25:09.039791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f769267-fa74-4466-a6e1-9800de97a08d tempest-AZAdminNegativeTestJSON-467419624 tempest-AZAdminNegativeTestJSON-467419624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:25:09.047622 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f769267-fa74-4466-a6e1-9800de97a08d tempest-AZAdminNegativeTestJSON-467419624 tempest-AZAdminNegativeTestJSON-467419624-project] 10.222.0.81 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.333556 Jul 14 14:25:09.048181 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 6/9] 10.222.0.81 () {58 vars in 1184 bytes} [Thu Jul 14 14:25:08 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 335 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:25:09.419609 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5ef3180b-f3b4-4d85-bd85-3cffd69d98f6 tempest-FlavorMetadataValidation-1748016475 tempest-FlavorMetadataValidation-1748016475-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/1053232631/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.534092 Jul 14 14:25:09.430186 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 4/10] 10.222.0.81 () {62 vars in 1264 bytes} [Thu Jul 14 14:25:08 2022] POST /compute/v2.1/flavors/1053232631/os-extra_specs => generated 62 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:09.444067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-98793efb-4e97-4bc2-8ac4-d50da916790d tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-635790992"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:09.649429 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:09.649429 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:09.753742 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-98793efb-4e97-4bc2-8ac4-d50da916790d tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.318538 Jul 14 14:25:09.755979 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 5/11] 10.222.0.81 () {62 vars in 1209 bytes} [Thu Jul 14 14:25:09 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:09.774367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-48f2246d-1024-406b-975a-c3ec903628a1 tempest-FlavorMetadataValidation-1748016475 tempest-FlavorMetadataValidation-1748016475-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:09.776114 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:09.776114 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:09.830828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d6354c41-9669-4e82-bcd2-79a05773542b tempest-FlavorsAccessTestJSON-149281015 tempest-FlavorsAccessTestJSON-149281015-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:09.842025 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-48f2246d-1024-406b-975a-c3ec903628a1 tempest-FlavorMetadataValidation-1748016475 tempest-FlavorMetadataValidation-1748016475-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1053232631" status: 202 len: 0 microversion: 2.86 time: 0.084255 Jul 14 14:25:09.843752 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 6/12] 10.222.0.81 () {60 vars in 1201 bytes} [Thu Jul 14 14:25:09 2022] DELETE /compute/v2.1/flavors/1053232631 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:09.855434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6072441a-4442-47c0-862b-7f6f5e556204 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:09.856677 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:09.856677 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:09.872209 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6072441a-4442-47c0-862b-7f6f5e556204 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.027122 Jul 14 14:25:09.873184 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 7/13] 10.222.0.81 () {60 vars in 1189 bytes} [Thu Jul 14 14:25:09 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:09.879289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-381101b3-ad8e-48fe-9949-3fd0f5f6fcc1 tempest-FlavorMetadataValidation-1748016475 tempest-FlavorMetadataValidation-1748016475-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:09.921804 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-381101b3-ad8e-48fe-9949-3fd0f5f6fcc1 tempest-FlavorMetadataValidation-1748016475 tempest-FlavorMetadataValidation-1748016475-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.046069 Jul 14 14:25:09.938918 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 8/14] 10.222.0.81 () {60 vars in 1186 bytes} [Thu Jul 14 14:25:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:25:09.946981 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d6354c41-9669-4e82-bcd2-79a05773542b tempest-FlavorsAccessTestJSON-149281015 tempest-FlavorsAccessTestJSON-149281015-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.891062 Jul 14 14:25:09.947414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e4de2c91-a029-4a64-bb03-13efb3d9aa61 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-767704-28"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:09.949116 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 7/15] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:25:09 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:09.950695 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:09.950695 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:09.973770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1fad24c2-62f1-4940-a4d9-51906166629c tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d618357563954e8f9d62d91f513d0c6d"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:09.975046 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:09.975046 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:09.994460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4de2c91-a029-4a64-bb03-13efb3d9aa61 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:10.000618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4de2c91-a029-4a64-bb03-13efb3d9aa61 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:10.390123 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1fad24c2-62f1-4940-a4d9-51906166629c tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/156941635/action" status: 200 len: 21 microversion: 2.1 time: 0.419563 Jul 14 14:25:10.392095 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 8/16] 10.222.0.81 () {60 vars in 1196 bytes} [Thu Jul 14 14:25:09 2022] POST /compute/v2.1/flavors/156941635/action => generated 21 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:25:10.416575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e4bfd984-ba53-4263-a64f-d609c1e7bc3a tempest-FlavorsAccessTestJSON-149281015 tempest-FlavorsAccessTestJSON-149281015-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:10.520819 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e4bfd984-ba53-4263-a64f-d609c1e7bc3a tempest-FlavorsAccessTestJSON-149281015 tempest-FlavorsAccessTestJSON-149281015-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.122196 Jul 14 14:25:10.523061 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 9/17] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:25:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:10.545784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6ebb38ce-1df9-40f1-83bf-ac8a1bfa3620 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:10.546638 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:10.546638 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:10.594445 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6ebb38ce-1df9-40f1-83bf-ac8a1bfa3620 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/156941635" status: 202 len: 0 microversion: 2.1 time: 0.060370 Jul 14 14:25:10.595871 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 10/18] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:25:10 2022] DELETE /compute/v2.1/flavors/156941635 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:25:10.606561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-479820fc-07cf-4a71-86ce-abde50487621 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:10.662390 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-479820fc-07cf-4a71-86ce-abde50487621 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062117 Jul 14 14:25:10.664766 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 11/19] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:25:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:10.713081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-90942a5f-5f74-4325-8447-7d20f1a65f66 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-497828613", "id": 198516857, "os-flavor-access:is_public": "False"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:10.787852 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-90942a5f-5f74-4325-8447-7d20f1a65f66 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.106668 Jul 14 14:25:10.791000 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 12/20] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:25:10 2022] POST /compute/v2.1/flavors => generated 427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:10.806507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fc95741c-b98e-461a-9fc0-296b7bdc52fd tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:10.807920 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:10.807920 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:10.836572 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fc95741c-b98e-461a-9fc0-296b7bdc52fd tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/198516857/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.036298 Jul 14 14:25:10.839274 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 13/21] 10.222.0.81 () {58 vars in 1205 bytes} [Thu Jul 14 14:25:10 2022] GET /compute/v2.1/flavors/198516857/os-flavor-access => generated 21 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:25:10.872747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d71127e8-4cbd-472e-860c-5dc48372e99f tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:10.935844 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d71127e8-4cbd-472e-860c-5dc48372e99f tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/198516857" status: 202 len: 0 microversion: 2.1 time: 0.084838 Jul 14 14:25:10.941943 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 14/22] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:25:10 2022] DELETE /compute/v2.1/flavors/198516857 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:25:10.950143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80a44e52-d7dd-43b0-bed8-19e625fc9957 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:11.005086 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80a44e52-d7dd-43b0-bed8-19e625fc9957 tempest-FlavorsAccessTestJSON-2124891627 tempest-FlavorsAccessTestJSON-2124891627-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061824 Jul 14 14:25:11.008570 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 15/23] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:25:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:11.914076 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e4de2c91-a029-4a64-bb03-13efb3d9aa61 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 1.973251 Jul 14 14:25:11.915390 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 9/24] 10.222.0.81 () {62 vars in 1231 bytes} [Thu Jul 14 14:25:09 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:11.930132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-028a3e94-76da-4929-b2bc-3cfbe924f521 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-767704-28"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:11.932738 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:11.932738 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:11.975602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-028a3e94-76da-4929-b2bc-3cfbe924f521 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:11.975925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-028a3e94-76da-4929-b2bc-3cfbe924f521 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:13.326280 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-028a3e94-76da-4929-b2bc-3cfbe924f521 tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 1.403876 Jul 14 14:25:13.332557 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 16/25] 10.222.0.81 () {62 vars in 1231 bytes} [Thu Jul 14 14:25:11 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:25:13.349959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5925a443-60ec-4731-a332-e9a8e8e0563f tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:13.354671 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:13.354671 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:13.405610 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5925a443-60ec-4731-a332-e9a8e8e0563f tempest-AggregatesAdminTestV241-674078064 tempest-AggregatesAdminTestV241-674078064-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.068544 Jul 14 14:25:13.406869 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 10/26] 10.222.0.81 () {60 vars in 1192 bytes} [Thu Jul 14 14:25:13 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:13.501290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aaeec629-210b-4e11-9592-ce0376878432 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-76053544", "name": "tempest-test_aggregate-1209331957"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:13.522165 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:13.522165 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:13.524122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.aggregate [None req-aaeec629-210b-4e11-9592-ce0376878432 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Generated uuid 4d848316-cc32-4338-aad2-08fc33bc9fe8 for aggregate {{(pid=119511) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:25:13.566719 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aaeec629-210b-4e11-9592-ce0376878432 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.069042 Jul 14 14:25:13.567601 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 17/27] 10.222.0.81 () {60 vars in 1164 bytes} [Thu Jul 14 14:25:13 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:13.580835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-76b0ca64-c03b-43ec-9d3c-07f96a8b37ce tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:13.581646 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:13.581646 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:13.593317 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-76b0ca64-c03b-43ec-9d3c-07f96a8b37ce tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates" status: 200 len: 299 microversion: 2.1 time: 0.016680 Jul 14 14:25:13.594137 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 11/28] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:25:13 2022] GET /compute/v2.1/os-aggregates => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:13.605774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d5477aa-8dd8-4786-a286-1157ce6e6376 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-767704-28"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:13.607065 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:13.607065 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:13.616578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d5477aa-8dd8-4786-a286-1157ce6e6376 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:13.617846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d5477aa-8dd8-4786-a286-1157ce6e6376 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:13.810920 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d5477aa-8dd8-4786-a286-1157ce6e6376 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 312 microversion: 2.1 time: 0.209788 Jul 14 14:25:13.814527 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 18/29] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:25:13 2022] POST /compute/v2.1/os-aggregates/2/action => generated 312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:14.713781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-315522464", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "availability_zone": "tempest-test_az-76053544"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:14.801504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:14.803129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:14.806254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:14.807135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:16.655594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:25:17.498567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:25:17.499272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:25:17.499762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:25:17.500258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:25:17.500710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:25:17.557647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:17.558390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:17.560739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:17.561379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:17.643015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Getting quotas for project 9bc1942c7de94649a21a347bfc86b77e. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:25:17.665358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Getting quotas for user d397a86992f44f43965e29597a1a540c and project 9bc1942c7de94649a21a347bfc86b77e. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:25:17.692366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:25:17.696451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:25:17.827447 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2c5f0c29-c9b3-4342-9f08-f1781ceb39d2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.561737 Jul 14 14:25:17.828206 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 12/30] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:25:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:25:17.842050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-65fefd9e-48ef-4f66-af74-5fa9fde4db3e tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:17.856028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-65fefd9e-48ef-4f66-af74-5fa9fde4db3e tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:19.707647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-65fefd9e-48ef-4f66-af74-5fa9fde4db3e tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:19.746057 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-65fefd9e-48ef-4f66-af74-5fa9fde4db3e tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1240 microversion: 2.1 time: 1.910428 Jul 14 14:25:19.757056 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 19/31] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:17 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1240 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:20.764248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed3b040a-fc5a-4584-b9f6-9bf0ddd64545 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:20.765806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ed3b040a-fc5a-4584-b9f6-9bf0ddd64545 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:20.776012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed3b040a-fc5a-4584-b9f6-9bf0ddd64545 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:20.779732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed3b040a-fc5a-4584-b9f6-9bf0ddd64545 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:20.782121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed3b040a-fc5a-4584-b9f6-9bf0ddd64545 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:20.782924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed3b040a-fc5a-4584-b9f6-9bf0ddd64545 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:21.201382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ed3b040a-fc5a-4584-b9f6-9bf0ddd64545 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:21.223832 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed3b040a-fc5a-4584-b9f6-9bf0ddd64545 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1288 microversion: 2.1 time: 0.463996 Jul 14 14:25:21.228752 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 20/32] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:20 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1288 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:21.362375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-381e23bf-f34d-4361-aee5-d370c17bf7dc tempest-FlavorsV255TestJSON-1346836088 tempest-FlavorsV255TestJSON-1346836088-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-231258767", "id": 999411869, "os-flavor-access:is_public": "True"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:21.364867 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:21.364867 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:21.420969 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-381e23bf-f34d-4361-aee5-d370c17bf7dc tempest-FlavorsV255TestJSON-1346836088 tempest-FlavorsV255TestJSON-1346836088-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.829126 Jul 14 14:25:21.421614 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 13/33] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:25:20 2022] POST /compute/v2.1/flavors => generated 445 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:21.728047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-50a4f7cf-b384-4891-8d78-2f3121db60c0 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Calling method '.version_select at 0x7fd6c69a4700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:21.730484 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:21.730484 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:21.733108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50a4f7cf-b384-4891-8d78-2f3121db60c0 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:21.737484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50a4f7cf-b384-4891-8d78-2f3121db60c0 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:21.738594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50a4f7cf-b384-4891-8d78-2f3121db60c0 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:21.739379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50a4f7cf-b384-4891-8d78-2f3121db60c0 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:21.848812 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-50a4f7cf-b384-4891-8d78-2f3121db60c0 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.607360 Jul 14 14:25:21.848812 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 21/34] 10.222.0.81 () {58 vars in 1127 bytes} [Thu Jul 14 14:25:21 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:22.058668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b0c7b67b-fe2f-401e-baac-d6f5c2826415 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Calling method '.version_select at 0x7fd6ce059dc0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:22.065222 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:22.065222 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:22.067292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0c7b67b-fe2f-401e-baac-d6f5c2826415 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.073947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0c7b67b-fe2f-401e-baac-d6f5c2826415 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.111702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0c7b67b-fe2f-401e-baac-d6f5c2826415 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.116643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0c7b67b-fe2f-401e-baac-d6f5c2826415 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.130057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0c7b67b-fe2f-401e-baac-d6f5c2826415 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.130873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0c7b67b-fe2f-401e-baac-d6f5c2826415 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.140305 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b0c7b67b-fe2f-401e-baac-d6f5c2826415 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.712746 Jul 14 14:25:22.143720 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 14/35] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:25:21 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:22.160477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-039b87d7-e590-4469-8b3f-5306eab1bb94 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Calling method '.version_select at 0x7fd6c6973670>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:22.164469 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:22.164469 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:22.171005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-039b87d7-e590-4469-8b3f-5306eab1bb94 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.171502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-039b87d7-e590-4469-8b3f-5306eab1bb94 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.182895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-039b87d7-e590-4469-8b3f-5306eab1bb94 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.183431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-039b87d7-e590-4469-8b3f-5306eab1bb94 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.304837 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-039b87d7-e590-4469-8b3f-5306eab1bb94 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.156371 Jul 14 14:25:22.316266 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 15/36] 10.222.0.81 () {58 vars in 1138 bytes} [Thu Jul 14 14:25:22 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:22.326837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3334c70f-0bc3-4636-b3c3-ce8e128fdd0a tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Calling method '.version_select at 0x7fd6c69ccaf0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:22.341208 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:22.341208 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:22.349223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3334c70f-0bc3-4636-b3c3-ce8e128fdd0a tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.350313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3334c70f-0bc3-4636-b3c3-ce8e128fdd0a tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.388200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3334c70f-0bc3-4636-b3c3-ce8e128fdd0a tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.389575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3334c70f-0bc3-4636-b3c3-ce8e128fdd0a tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.410817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3334c70f-0bc3-4636-b3c3-ce8e128fdd0a tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.411824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3334c70f-0bc3-4636-b3c3-ce8e128fdd0a tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.421584 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3334c70f-0bc3-4636-b3c3-ce8e128fdd0a tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1508 microversion: 2.1 time: 0.104010 Jul 14 14:25:22.424834 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 16/37] 10.222.0.81 () {58 vars in 1166 bytes} [Thu Jul 14 14:25:22 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1508 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:22.456109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0da144fe-15a2-424b-abcc-3228f24d3be2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:22.457828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0da144fe-15a2-424b-abcc-3228f24d3be2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:22.478322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0da144fe-15a2-424b-abcc-3228f24d3be2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.479854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0da144fe-15a2-424b-abcc-3228f24d3be2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.481583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0da144fe-15a2-424b-abcc-3228f24d3be2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.482316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0da144fe-15a2-424b-abcc-3228f24d3be2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.568818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-671e6e78-6693-4078-a95c-865a93560f3f tempest-FlavorsV255TestJSON-844267794 tempest-FlavorsV255TestJSON-844267794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:22.641491 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-671e6e78-6693-4078-a95c-865a93560f3f tempest-FlavorsV255TestJSON-844267794 tempest-FlavorsV255TestJSON-844267794-project] 10.222.0.81 "GET /compute/v2.1/flavors/999411869" status: 200 len: 445 microversion: 2.55 time: 0.796028 Jul 14 14:25:22.642222 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 22/38] 10.222.0.81 () {60 vars in 1195 bytes} [Thu Jul 14 14:25:21 2022] GET /compute/v2.1/flavors/999411869 => generated 445 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:22.667966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-90b01fce-e790-4097-aee9-2fb265876ed0 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Calling method '.version_select at 0x7fd6c69a4e50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:22.678485 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:22.678485 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:22.679892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90b01fce-e790-4097-aee9-2fb265876ed0 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.690833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90b01fce-e790-4097-aee9-2fb265876ed0 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.692159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90b01fce-e790-4097-aee9-2fb265876ed0 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.697434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90b01fce-e790-4097-aee9-2fb265876ed0 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.786995 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-90b01fce-e790-4097-aee9-2fb265876ed0 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.143602 Jul 14 14:25:22.801025 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 23/39] 10.222.0.81 () {58 vars in 1144 bytes} [Thu Jul 14 14:25:22 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:25:22.812436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9392d31-7a65-4fc4-ac58-9b8157330ab5 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Calling method '.version_select at 0x7fd6c69a4ee0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:22.817615 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:22.817615 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:22.825767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9392d31-7a65-4fc4-ac58-9b8157330ab5 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.826396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9392d31-7a65-4fc4-ac58-9b8157330ab5 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.866052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:22.870294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9392d31-7a65-4fc4-ac58-9b8157330ab5 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.871299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9392d31-7a65-4fc4-ac58-9b8157330ab5 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.906464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0da144fe-15a2-424b-abcc-3228f24d3be2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:22.912785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9392d31-7a65-4fc4-ac58-9b8157330ab5 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.916390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9392d31-7a65-4fc4-ac58-9b8157330ab5 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.926576 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c9392d31-7a65-4fc4-ac58-9b8157330ab5 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.122837 Jul 14 14:25:22.928020 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 24/40] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:25:22 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:22.936637 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0da144fe-15a2-424b-abcc-3228f24d3be2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1294 microversion: 2.1 time: 0.508561 Jul 14 14:25:22.937325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99d2ae5c-6960-4226-97be-4c563bfc7a4d tempest-FlavorsV255TestJSON-1346836088 tempest-FlavorsV255TestJSON-1346836088-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c88b4dc0>, body: {"flavor": {"description": "new"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:22.938034 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 17/41] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:22 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1294 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:22.948156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a2fd087f-4afb-4de0-851d-21491fc62d03 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Calling method '.version_select at 0x7fd6c68b0940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:22.951757 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:22.951757 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:22.953570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2fd087f-4afb-4de0-851d-21491fc62d03 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.954781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2fd087f-4afb-4de0-851d-21491fc62d03 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:22.986172 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:22.986172 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:22.988580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2fd087f-4afb-4de0-851d-21491fc62d03 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:22.989241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2fd087f-4afb-4de0-851d-21491fc62d03 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.015896 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a2fd087f-4afb-4de0-851d-21491fc62d03 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.060330 Jul 14 14:25:23.028749 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 18/42] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:25:22 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:23.038519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b1625485-027d-4e9f-b19a-ceacb7f884eb tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Calling method '.version_select at 0x7fd6c68a5940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:23.045337 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:23.045337 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:23.047666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1625485-027d-4e9f-b19a-ceacb7f884eb tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.048289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1625485-027d-4e9f-b19a-ceacb7f884eb tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.077804 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99d2ae5c-6960-4226-97be-4c563bfc7a4d tempest-FlavorsV255TestJSON-1346836088 tempest-FlavorsV255TestJSON-1346836088-project-admin] 10.222.0.81 "PUT /compute/v2.1/flavors/999411869" status: 200 len: 446 microversion: 2.55 time: 0.148038 Jul 14 14:25:23.081718 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 25/43] 10.222.0.81 () {62 vars in 1215 bytes} [Thu Jul 14 14:25:22 2022] PUT /compute/v2.1/flavors/999411869 => generated 446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:23.097609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-db665c03-4a70-4c04-b1ca-c63b05481662 tempest-FlavorsV255TestJSON-844267794 tempest-FlavorsV255TestJSON-844267794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:23.101819 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b1625485-027d-4e9f-b19a-ceacb7f884eb tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.071508 Jul 14 14:25:23.117739 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 19/44] 10.222.0.81 () {58 vars in 1178 bytes} [Thu Jul 14 14:25:23 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:23.129253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ed072594-bc82-4bb9-bb9d-752ea8868a1d tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Calling method '.version_select at 0x7fd6c697f310>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:23.131881 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:23.131881 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:23.135796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed072594-bc82-4bb9-bb9d-752ea8868a1d tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.136851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed072594-bc82-4bb9-bb9d-752ea8868a1d tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.144716 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-db665c03-4a70-4c04-b1ca-c63b05481662 tempest-FlavorsV255TestJSON-844267794 tempest-FlavorsV255TestJSON-844267794-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.055665 Jul 14 14:25:23.148334 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 26/45] 10.222.0.81 () {60 vars in 1186 bytes} [Thu Jul 14 14:25:23 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:25:23.167211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac430ede-5e56-48a2-ad17-661d2561b5c2 tempest-FlavorsV255TestJSON-844267794 tempest-FlavorsV255TestJSON-844267794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:23.180897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:23.194948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed072594-bc82-4bb9-bb9d-752ea8868a1d tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.195594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed072594-bc82-4bb9-bb9d-752ea8868a1d tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.236669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed072594-bc82-4bb9-bb9d-752ea8868a1d tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.238079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed072594-bc82-4bb9-bb9d-752ea8868a1d tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.263242 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ed072594-bc82-4bb9-bb9d-752ea8868a1d tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.141136 Jul 14 14:25:23.265460 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ac430ede-5e56-48a2-ad17-661d2561b5c2 tempest-FlavorsV255TestJSON-844267794 tempest-FlavorsV255TestJSON-844267794-project] 10.222.0.81 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.102941 Jul 14 14:25:23.268481 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 27/46] 10.222.0.81 () {60 vars in 1165 bytes} [Thu Jul 14 14:25:23 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:25:23.279611 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 20/47] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:25:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:23.287103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea8d747f-dd45-4c50-a5c9-385c6f8b3d30 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Calling method '.version_select at 0x7fd6c69a4f70>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:23.288511 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:23.288511 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:23.298887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea8d747f-dd45-4c50-a5c9-385c6f8b3d30 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.304620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea8d747f-dd45-4c50-a5c9-385c6f8b3d30 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.314803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-50ef6030-76b3-4198-bbaa-ae6b36d3c76d tempest-FlavorsV255TestJSON-1346836088 tempest-FlavorsV255TestJSON-1346836088-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:23.319393 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:23.319393 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:23.377634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea8d747f-dd45-4c50-a5c9-385c6f8b3d30 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.379083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea8d747f-dd45-4c50-a5c9-385c6f8b3d30 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.379944 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-50ef6030-76b3-4198-bbaa-ae6b36d3c76d tempest-FlavorsV255TestJSON-1346836088 tempest-FlavorsV255TestJSON-1346836088-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/999411869" status: 202 len: 0 microversion: 2.55 time: 0.084141 Jul 14 14:25:23.381654 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 21/48] 10.222.0.81 () {60 vars in 1198 bytes} [Thu Jul 14 14:25:23 2022] DELETE /compute/v2.1/flavors/999411869 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:23.426716 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ea8d747f-dd45-4c50-a5c9-385c6f8b3d30 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.145005 Jul 14 14:25:23.427669 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 28/49] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:25:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:25:23.442576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-353d4440-53a7-46ce-94f3-23cc26e55a9f tempest-FlavorsV255TestJSON-1346836088 tempest-FlavorsV255TestJSON-1346836088-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:23.508889 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-353d4440-53a7-46ce-94f3-23cc26e55a9f tempest-FlavorsV255TestJSON-1346836088 tempest-FlavorsV255TestJSON-1346836088-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.080085 Jul 14 14:25:23.529124 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 29/50] 10.222.0.81 () {60 vars in 1186 bytes} [Thu Jul 14 14:25:23 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:25:23.537912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-76a59235-f6d3-42a3-b4bc-e01f9c42d54c tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Calling method '.version_select at 0x7fd6c6942430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:23.543688 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:23.543688 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:23.547314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76a59235-f6d3-42a3-b4bc-e01f9c42d54c tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.550283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76a59235-f6d3-42a3-b4bc-e01f9c42d54c tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.598971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76a59235-f6d3-42a3-b4bc-e01f9c42d54c tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.598971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76a59235-f6d3-42a3-b4bc-e01f9c42d54c tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.629142 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-76a59235-f6d3-42a3-b4bc-e01f9c42d54c tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.098393 Jul 14 14:25:23.650569 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 30/51] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:25:23 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:23.670734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-54c58541-0460-4096-a9f2-daa35535ed72 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Calling method '.version_select at 0x7fd6c69a4700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:23.675085 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:23.675085 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:23.680188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54c58541-0460-4096-a9f2-daa35535ed72 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.681027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54c58541-0460-4096-a9f2-daa35535ed72 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.730354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54c58541-0460-4096-a9f2-daa35535ed72 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.732333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54c58541-0460-4096-a9f2-daa35535ed72 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.747404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54c58541-0460-4096-a9f2-daa35535ed72 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.748984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54c58541-0460-4096-a9f2-daa35535ed72 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.755920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54c58541-0460-4096-a9f2-daa35535ed72 tempest-HypervisorAdminTestJSON-1552918211 tempest-HypervisorAdminTestJSON-1552918211-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=119511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:25:23.757637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1ea98f6-ef06-40b1-a078-31a9d8f8f4ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.759460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1ea98f6-ef06-40b1-a078-31a9d8f8f4ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.760616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1ea98f6-ef06-40b1-a078-31a9d8f8f4ff None None] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:23.761321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1ea98f6-ef06-40b1-a078-31a9d8f8f4ff None None] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:23.773686 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.compute.rpcapi [None req-a1ea98f6-ef06-40b1-a078-31a9d8f8f4ff None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 14:25:23.775212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1ea98f6-ef06-40b1-a078-31a9d8f8f4ff None None] Releasing lock "compute-rpcapi-router" {{(pid=119511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:25:23.835203 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a1ea98f6-ef06-40b1-a078-31a9d8f8f4ff None None] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.182417 Jul 14 14:25:23.837898 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 31/52] 10.222.0.81 () {58 vars in 1172 bytes} [Thu Jul 14 14:25:23 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:24.008714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b974dd63-e08a-49f0-8172-74de8f6bb447 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:24.045292 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b974dd63-e08a-49f0-8172-74de8f6bb447 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.660412 Jul 14 14:25:24.048939 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 22/53] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:25:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:24.069535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-df169d34-9f81-49fd-9082-994153f1eb05 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:24.072428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-df169d34-9f81-49fd-9082-994153f1eb05 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:24.096079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df169d34-9f81-49fd-9082-994153f1eb05 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:24.096592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df169d34-9f81-49fd-9082-994153f1eb05 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:24.099382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df169d34-9f81-49fd-9082-994153f1eb05 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:24.100071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df169d34-9f81-49fd-9082-994153f1eb05 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:24.462533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-df169d34-9f81-49fd-9082-994153f1eb05 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:24.475965 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-df169d34-9f81-49fd-9082-994153f1eb05 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 0.425645 Jul 14 14:25:24.477740 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 23/54] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:24 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:25.020836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6987bfaf-94b5-443e-8a93-698cdff123cc tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Calling method '.version_select at 0x7fd6c69424c0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:25.022229 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:25.022229 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:25.033326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6987bfaf-94b5-443e-8a93-698cdff123cc tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.035118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6987bfaf-94b5-443e-8a93-698cdff123cc tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.102460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6987bfaf-94b5-443e-8a93-698cdff123cc tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.103805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6987bfaf-94b5-443e-8a93-698cdff123cc tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.131172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6987bfaf-94b5-443e-8a93-698cdff123cc tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.131999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6987bfaf-94b5-443e-8a93-698cdff123cc tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.147315 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6987bfaf-94b5-443e-8a93-698cdff123cc tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.243667 Jul 14 14:25:25.152882 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 32/55] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:25:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:25:25.178476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2254be4a-fc31-496b-a69d-6e2ca0a224b8 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Calling method '.version_select at 0x7fd6c68f0a60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:25.180996 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:25.180996 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:25.182498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2254be4a-fc31-496b-a69d-6e2ca0a224b8 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.184395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2254be4a-fc31-496b-a69d-6e2ca0a224b8 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.245412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2254be4a-fc31-496b-a69d-6e2ca0a224b8 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.247652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2254be4a-fc31-496b-a69d-6e2ca0a224b8 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.347637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2254be4a-fc31-496b-a69d-6e2ca0a224b8 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.348203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2254be4a-fc31-496b-a69d-6e2ca0a224b8 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.364601 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2254be4a-fc31-496b-a69d-6e2ca0a224b8 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/n-h2-767704-28/servers" status: 200 len: 197 microversion: 2.1 time: 0.205002 Jul 14 14:25:25.366015 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 33/56] 10.222.0.81 () {58 vars in 1214 bytes} [Thu Jul 14 14:25:25 2022] GET /compute/v2.1/os-hypervisors/n-h2-767704-28/servers => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:25.381349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5f316df-2011-4642-8bf6-f91886a38035 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Calling method '.version_select at 0x7fd6c68848b0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:25.385269 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:25.385269 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:25.387047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5f316df-2011-4642-8bf6-f91886a38035 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.389372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5f316df-2011-4642-8bf6-f91886a38035 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.427308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5f316df-2011-4642-8bf6-f91886a38035 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.428317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5f316df-2011-4642-8bf6-f91886a38035 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.456567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5f316df-2011-4642-8bf6-f91886a38035 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.458093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5f316df-2011-4642-8bf6-f91886a38035 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.474335 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e5f316df-2011-4642-8bf6-f91886a38035 tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.098008 Jul 14 14:25:25.479063 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 34/57] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:25:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:25:25.489917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e54be74-54b2-4f5b-b8cd-152217bef8fb tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Calling method '.version_select at 0x7fd6c68f0dc0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:25.492743 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:25.492743 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:25.496881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e54be74-54b2-4f5b-b8cd-152217bef8fb tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.499522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e54be74-54b2-4f5b-b8cd-152217bef8fb tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.530549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e54be74-54b2-4f5b-b8cd-152217bef8fb tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.531741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e54be74-54b2-4f5b-b8cd-152217bef8fb tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.555109 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e54be74-54b2-4f5b-b8cd-152217bef8fb tempest-HypervisorAdminUnderV252Test-1460321305 tempest-HypervisorAdminUnderV252Test-1460321305-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/n-h2-767704-28/search" status: 200 len: 105 microversion: 2.1 time: 0.070384 Jul 14 14:25:25.557602 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 35/58] 10.222.0.81 () {58 vars in 1211 bytes} [Thu Jul 14 14:25:25 2022] GET /compute/v2.1/os-hypervisors/n-h2-767704-28/search => generated 105 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:25:25.563316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-05c2fd64-c3fe-4c5a-8c43-456c1475fe9c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:25.573286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-05c2fd64-c3fe-4c5a-8c43-456c1475fe9c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:25.591702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05c2fd64-c3fe-4c5a-8c43-456c1475fe9c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.592729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05c2fd64-c3fe-4c5a-8c43-456c1475fe9c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.593794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05c2fd64-c3fe-4c5a-8c43-456c1475fe9c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:25.595878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05c2fd64-c3fe-4c5a-8c43-456c1475fe9c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:25.701704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-45100fbc-b6d3-4eda-8e57-7c96478774c8 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-63060092", "id": 741277973, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:25.703913 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:25.703913 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:25.737787 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-45100fbc-b6d3-4eda-8e57-7c96478774c8 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 420 microversion: 2.1 time: 1.257818 Jul 14 14:25:25.739968 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 24/59] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:25:24 2022] POST /compute/v2.1/flavors => generated 420 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:25.753468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ad66b977-86ff-44d3-8aa4-0e6dae5fc8f0 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:25.774322 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ad66b977-86ff-44d3-8aa4-0e6dae5fc8f0 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024821 Jul 14 14:25:25.783134 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 25/60] 10.222.0.81 () {58 vars in 1181 bytes} [Thu Jul 14 14:25:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:25:25.789868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-26a6629c-29c1-4d64-9498-a4b95f7c4710 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-243638437", "id": 1732943815, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:25.821904 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-26a6629c-29c1-4d64-9498-a4b95f7c4710 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.037079 Jul 14 14:25:25.823197 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 26/61] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:25:25 2022] POST /compute/v2.1/flavors => generated 424 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:25.848797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-58fcdc12-000d-4135-805a-373baf07cd21 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:25.877806 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-58fcdc12-000d-4135-805a-373baf07cd21 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.045177 Jul 14 14:25:25.880741 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 27/62] 10.222.0.81 () {58 vars in 1181 bytes} [Thu Jul 14 14:25:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:25:25.894220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e427bd26-33bd-4a09-b579-7aa4ca2e4748 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Action: 'create', calling method: .version_select at 0x7fd6c6862ca0>, body: {"keypair": {"name": "tempest-keypair-1254310316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3cpkibbcfbdvBKxpH+swoXE+sfIct5g9w637hCUpXpFztNsKDr58H95apaNBS+3WX/hXtvnkNPMYWV8r2XGU/uFsRbndmLRfz2IpAIoSXeQUj5rLmJelc/TDSjwaI6qg=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:25.947356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e427bd26-33bd-4a09-b579-7aa4ca2e4748 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Getting quotas for project 53cea64d639b4a58ae486bf556526b25. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:25:25.974247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e427bd26-33bd-4a09-b579-7aa4ca2e4748 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Getting quotas for user 05b7a8b4d7344e5cb2938c8e2f1ab1f7 and project 53cea64d639b4a58ae486bf556526b25. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:25:26.056522 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e427bd26-33bd-4a09-b579-7aa4ca2e4748 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167132 Jul 14 14:25:26.057746 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 28/63] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:25:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:27.987121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-05c2fd64-c3fe-4c5a-8c43-456c1475fe9c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:28.042817 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-05c2fd64-c3fe-4c5a-8c43-456c1475fe9c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 2.483372 Jul 14 14:25:28.056404 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 36/64] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:25 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 2497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:29.086324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-347c7b72-7f1b-4f7e-98c7-3931f638939d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:29.087489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-347c7b72-7f1b-4f7e-98c7-3931f638939d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:29.125126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-347c7b72-7f1b-4f7e-98c7-3931f638939d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:29.125126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-347c7b72-7f1b-4f7e-98c7-3931f638939d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:29.126372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-347c7b72-7f1b-4f7e-98c7-3931f638939d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:29.127197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-347c7b72-7f1b-4f7e-98c7-3931f638939d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:29.729801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:29.922127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-347c7b72-7f1b-4f7e-98c7-3931f638939d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:29.942546 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-347c7b72-7f1b-4f7e-98c7-3931f638939d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 0.872111 Jul 14 14:25:29.948247 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 37/65] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:29 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:30.123470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-853fc1bb-59cc-4073-aa50-1b3f41618068 req-f562f49a-fbd1-4553-ae22-5636d282be99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c562a5-9c0e-42d4-8472-7e3439921cc5", "tag": "dca95444-4dd1-4c2f-a827-f796be313222"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:30.156528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-853fc1bb-59cc-4073-aa50-1b3f41618068 req-f562f49a-fbd1-4553-ae22-5636d282be99 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:30.158661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-853fc1bb-59cc-4073-aa50-1b3f41618068 req-f562f49a-fbd1-4553-ae22-5636d282be99 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:30.222309 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-853fc1bb-59cc-4073-aa50-1b3f41618068 req-f562f49a-fbd1-4553-ae22-5636d282be99 service nova] Creating event network-changed:dca95444-4dd1-4c2f-a827-f796be313222 for instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 on n-h2-767704-28 Jul 14 14:25:30.224778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-853fc1bb-59cc-4073-aa50-1b3f41618068 req-f562f49a-fbd1-4553-ae22-5636d282be99 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:25:30.231174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe19082f-f5bb-466a-b5c0-82e19b7a6408 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:30.232491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe19082f-f5bb-466a-b5c0-82e19b7a6408 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:30.236056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe19082f-f5bb-466a-b5c0-82e19b7a6408 None None] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:30.236677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe19082f-f5bb-466a-b5c0-82e19b7a6408 None None] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:30.251898 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.compute.rpcapi [None req-fe19082f-f5bb-466a-b5c0-82e19b7a6408 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 14:25:30.253078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe19082f-f5bb-466a-b5c0-82e19b7a6408 None None] Releasing lock "compute-rpcapi-router" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:25:30.314539 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fe19082f-f5bb-466a-b5c0-82e19b7a6408 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.282930 Jul 14 14:25:30.315303 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 29/66] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:30.965389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7b889a88-657d-43ec-93ca-55ca11d94340 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:30.970884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7b889a88-657d-43ec-93ca-55ca11d94340 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:31.024875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b889a88-657d-43ec-93ca-55ca11d94340 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:31.031529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b889a88-657d-43ec-93ca-55ca11d94340 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:31.035370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b889a88-657d-43ec-93ca-55ca11d94340 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:31.039403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b889a88-657d-43ec-93ca-55ca11d94340 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:32.145613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7b889a88-657d-43ec-93ca-55ca11d94340 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:32.157917 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7b889a88-657d-43ec-93ca-55ca11d94340 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 1.197548 Jul 14 14:25:32.168707 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 38/67] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:30 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:33.180800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-046e29e0-89f5-496c-a591-f44fabeb53f1 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:33.183845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-046e29e0-89f5-496c-a591-f44fabeb53f1 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:33.203812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-046e29e0-89f5-496c-a591-f44fabeb53f1 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:33.209661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-046e29e0-89f5-496c-a591-f44fabeb53f1 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:33.210788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-046e29e0-89f5-496c-a591-f44fabeb53f1 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:33.211226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-046e29e0-89f5-496c-a591-f44fabeb53f1 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:33.716275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-046e29e0-89f5-496c-a591-f44fabeb53f1 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:33.750047 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-046e29e0-89f5-496c-a591-f44fabeb53f1 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 0.570065 Jul 14 14:25:33.765937 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 30/68] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:33 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:34.330676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1301581261", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "1732943815", "adminPass": "***", "networks": [{"uuid": "891c87a7-1e27-454b-b01b-81dd6e00ddeb"}], "security_groups": [{"name": "tempest-securitygroup--1494786813"}], "key_name": "tempest-keypair-1254310316", "user_data": "}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:34.344541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:34.527880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] validate_networks() for [('891c87a7-1e27-454b-b01b-81dd6e00ddeb', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:25:34.772077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e508675a-234c-447c-b3c2-b56d4d287d90 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:34.774996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e508675a-234c-447c-b3c2-b56d4d287d90 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:34.783133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e508675a-234c-447c-b3c2-b56d4d287d90 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:34.784122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e508675a-234c-447c-b3c2-b56d4d287d90 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:34.786409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e508675a-234c-447c-b3c2-b56d4d287d90 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:34.787470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e508675a-234c-447c-b3c2-b56d4d287d90 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.136311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e508675a-234c-447c-b3c2-b56d4d287d90 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:35.147391 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e508675a-234c-447c-b3c2-b56d4d287d90 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 0.379792 Jul 14 14:25:35.148966 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 31/69] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:34 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:25:35.556048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8c443f87-59c4-4ad0-8c01-098a0c3f3e41 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Calling method '.version_select at 0x7fd6c68c14c0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:35.557661 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:35.557661 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:35.559081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c443f87-59c4-4ad0-8c01-098a0c3f3e41 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.559543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c443f87-59c4-4ad0-8c01-098a0c3f3e41 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.585387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c443f87-59c4-4ad0-8c01-098a0c3f3e41 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.586503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c443f87-59c4-4ad0-8c01-098a0c3f3e41 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.636040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c443f87-59c4-4ad0-8c01-098a0c3f3e41 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.636606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c443f87-59c4-4ad0-8c01-098a0c3f3e41 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.658538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c443f87-59c4-4ad0-8c01-098a0c3f3e41 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.658992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c443f87-59c4-4ad0-8c01-098a0c3f3e41 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.688032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c443f87-59c4-4ad0-8c01-098a0c3f3e41 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.691201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c443f87-59c4-4ad0-8c01-098a0c3f3e41 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.700078 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8c443f87-59c4-4ad0-8c01-098a0c3f3e41 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1668 microversion: 2.53 time: 0.338408 Jul 14 14:25:35.709714 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 32/70] 10.222.0.81 () {60 vars in 1242 bytes} [Thu Jul 14 14:25:35 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1668 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:25:35.715553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4d2c9c99-6546-4cc8-8009-d5aaf2bec723 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Calling method '.version_select at 0x7fd6c67b4040>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:35.716915 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:35.716915 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:35.718197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2c9c99-6546-4cc8-8009-d5aaf2bec723 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.718659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2c9c99-6546-4cc8-8009-d5aaf2bec723 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.737031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2c9c99-6546-4cc8-8009-d5aaf2bec723 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.737497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2c9c99-6546-4cc8-8009-d5aaf2bec723 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.759911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2c9c99-6546-4cc8-8009-d5aaf2bec723 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.761111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2c9c99-6546-4cc8-8009-d5aaf2bec723 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.775828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2c9c99-6546-4cc8-8009-d5aaf2bec723 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.777387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2c9c99-6546-4cc8-8009-d5aaf2bec723 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.783434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:25:35.783963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:25:35.784312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:25:35.784715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:25:35.785154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:25:35.794565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2c9c99-6546-4cc8-8009-d5aaf2bec723 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.795021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2c9c99-6546-4cc8-8009-d5aaf2bec723 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.803882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.804304 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4d2c9c99-6546-4cc8-8009-d5aaf2bec723 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 359 microversion: 2.53 time: 0.092501 Jul 14 14:25:35.805230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.805687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.806133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.806803 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 33/71] 10.222.0.81 () {60 vars in 1221 bytes} [Thu Jul 14 14:25:35 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 359 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:35.822187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4d70e787-1ea5-4373-aba1-a22b8c8c2545 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Calling method '.version_select at 0x7fd6c68621f0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:35.823505 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:35.823505 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:35.824801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d70e787-1ea5-4373-aba1-a22b8c8c2545 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.826262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=89 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:35.829655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d70e787-1ea5-4373-aba1-a22b8c8c2545 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.846412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Getting quotas for project 53cea64d639b4a58ae486bf556526b25. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:25:35.854560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Getting quotas for user 05b7a8b4d7344e5cb2938c8e2f1ab1f7 and project 53cea64d639b4a58ae486bf556526b25. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:25:35.871232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d70e787-1ea5-4373-aba1-a22b8c8c2545 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:35.872028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d70e787-1ea5-4373-aba1-a22b8c8c2545 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:35.875436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:25:35.879295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:25:35.886015 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4d70e787-1ea5-4373-aba1-a22b8c8c2545 tempest-HypervisorAdminV253TestBase-1676954844 tempest-HypervisorAdminV253TestBase-1676954844-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/63702b9c-21dc-4f2e-8822-0dbe405dddc1" status: 200 len: 794 microversion: 2.53 time: 0.073928 Jul 14 14:25:35.887140 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 34/72] 10.222.0.81 () {60 vars in 1297 bytes} [Thu Jul 14 14:25:35 2022] GET /compute/v2.1/os-hypervisors/63702b9c-21dc-4f2e-8822-0dbe405dddc1 => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:25:35.943438 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fef3fe58-ad78-4c01-87bf-e08612d0869c tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.617207 Jul 14 14:25:35.947933 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 39/73] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:25:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:25:35.958933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e07a1d92-1566-434c-8e15-b4f052c03976 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:35.960111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e07a1d92-1566-434c-8e15-b4f052c03976 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:36.011766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=10 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:36.066221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e07a1d92-1566-434c-8e15-b4f052c03976 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:36.078890 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e07a1d92-1566-434c-8e15-b4f052c03976 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1265 microversion: 2.1 time: 0.125173 Jul 14 14:25:36.080050 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 35/74] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:35 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:36.168053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-79445cd5-2e7b-42c0-936d-dc4cd67b2b71 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:36.168998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-79445cd5-2e7b-42c0-936d-dc4cd67b2b71 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:36.190783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79445cd5-2e7b-42c0-936d-dc4cd67b2b71 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:36.191954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79445cd5-2e7b-42c0-936d-dc4cd67b2b71 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:36.193164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79445cd5-2e7b-42c0-936d-dc4cd67b2b71 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:36.193885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79445cd5-2e7b-42c0-936d-dc4cd67b2b71 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:36.428873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-79445cd5-2e7b-42c0-936d-dc4cd67b2b71 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:36.441854 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-79445cd5-2e7b-42c0-936d-dc4cd67b2b71 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 0.277754 Jul 14 14:25:36.450158 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 40/75] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:36 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:37.100918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ec17045c-e10c-4fea-9d1d-16cff3355e0e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:37.102879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ec17045c-e10c-4fea-9d1d-16cff3355e0e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:37.119427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec17045c-e10c-4fea-9d1d-16cff3355e0e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:37.121604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec17045c-e10c-4fea-9d1d-16cff3355e0e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:37.122714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec17045c-e10c-4fea-9d1d-16cff3355e0e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:37.124088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec17045c-e10c-4fea-9d1d-16cff3355e0e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:37.161534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:37.251981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ec17045c-e10c-4fea-9d1d-16cff3355e0e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:37.262525 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ec17045c-e10c-4fea-9d1d-16cff3355e0e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1269 microversion: 2.1 time: 0.167488 Jul 14 14:25:37.274898 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 36/76] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:37 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1269 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:37.463049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fdba3a5c-4cac-4f41-98c5-a2538fc6cbf2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:37.463938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fdba3a5c-4cac-4f41-98c5-a2538fc6cbf2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:37.480634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdba3a5c-4cac-4f41-98c5-a2538fc6cbf2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:37.480634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdba3a5c-4cac-4f41-98c5-a2538fc6cbf2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:37.489078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdba3a5c-4cac-4f41-98c5-a2538fc6cbf2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:37.491798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdba3a5c-4cac-4f41-98c5-a2538fc6cbf2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:37.941960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fdba3a5c-4cac-4f41-98c5-a2538fc6cbf2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:37.969916 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fdba3a5c-4cac-4f41-98c5-a2538fc6cbf2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 0.510615 Jul 14 14:25:37.970689 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 41/77] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:37 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:38.033274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7e051739-0f5b-4898-85b2-c0925ef2a4d6 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:38.034474 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:38.034474 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:38.035824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e051739-0f5b-4898-85b2-c0925ef2a4d6 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:38.036290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e051739-0f5b-4898-85b2-c0925ef2a4d6 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:38.037111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e051739-0f5b-4898-85b2-c0925ef2a4d6 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:38.037552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e051739-0f5b-4898-85b2-c0925ef2a4d6 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:38.043251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=11 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:38.096112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-906e6851-a13f-4d26-abf3-40140594cceb tempest-NetworksTest-1952982208 tempest-NetworksTest-1952982208-project-admin] Calling method '.version_select at 0x7fd6c677c4c0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:38.124859 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7e051739-0f5b-4898-85b2-c0925ef2a4d6 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 969 microversion: 2.1 time: 0.635420 Jul 14 14:25:38.134766 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 37/78] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:25:37 2022] GET /compute/v2.1/os-services => generated 969 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:38.140909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cb201f4b-a630-42f3-868e-b9cd0aa17930 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:38.143265 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:38.143265 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:38.145361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb201f4b-a630-42f3-868e-b9cd0aa17930 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:38.145940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb201f4b-a630-42f3-868e-b9cd0aa17930 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:38.147009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb201f4b-a630-42f3-868e-b9cd0aa17930 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:38.147693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb201f4b-a630-42f3-868e-b9cd0aa17930 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:38.178639 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cb201f4b-a630-42f3-868e-b9cd0aa17930 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?host=n-d-767704-28" status: 200 len: 581 microversion: 2.1 time: 0.042490 Jul 14 14:25:38.179531 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 38/79] 10.222.0.81 () {58 vars in 1173 bytes} [Thu Jul 14 14:25:38 2022] GET /compute/v2.1/os-services?host=n-d-767704-28 => generated 581 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:38.201344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f7c533d-61a0-4d19-ae1c-dce0a9a34978 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:38.202851 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:38.202851 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:38.208756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f7c533d-61a0-4d19-ae1c-dce0a9a34978 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:38.209450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f7c533d-61a0-4d19-ae1c-dce0a9a34978 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:38.211237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f7c533d-61a0-4d19-ae1c-dce0a9a34978 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:38.214557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f7c533d-61a0-4d19-ae1c-dce0a9a34978 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:38.283408 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f7c533d-61a0-4d19-ae1c-dce0a9a34978 tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.093116 Jul 14 14:25:38.284720 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 39/80] 10.222.0.81 () {58 vars in 1175 bytes} [Thu Jul 14 14:25:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:38.297372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6367ef46-399e-4f25-9b03-1008a168fafa tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:38.298822 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:38.298822 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:25:38.302999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6367ef46-399e-4f25-9b03-1008a168fafa tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:38.307289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6367ef46-399e-4f25-9b03-1008a168fafa tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:38.308753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6367ef46-399e-4f25-9b03-1008a168fafa tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:38.311167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6367ef46-399e-4f25-9b03-1008a168fafa tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:38.379306 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6367ef46-399e-4f25-9b03-1008a168fafa tempest-ServicesAdminTestJSON-1207236766 tempest-ServicesAdminTestJSON-1207236766-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 969 microversion: 2.1 time: 0.086676 Jul 14 14:25:38.381909 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 40/81] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:25:38 2022] GET /compute/v2.1/os-services => generated 969 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:25:38.394762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e9430d3b-2d5e-46d6-84d0-829239fa779a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:38.401325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e9430d3b-2d5e-46d6-84d0-829239fa779a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:38.421464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9430d3b-2d5e-46d6-84d0-829239fa779a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:38.422572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9430d3b-2d5e-46d6-84d0-829239fa779a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:38.423625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9430d3b-2d5e-46d6-84d0-829239fa779a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:38.424278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9430d3b-2d5e-46d6-84d0-829239fa779a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:38.672209 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-906e6851-a13f-4d26-abf3-40140594cceb tempest-NetworksTest-1952982208 tempest-NetworksTest-1952982208-project-admin] 10.222.0.81 "GET /compute/v2.1/os-networks" status: 200 len: 4024 microversion: 2.1 time: 0.688053 Jul 14 14:25:38.672711 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 42/82] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:25:37 2022] GET /compute/v2.1/os-networks => generated 4024 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:38.682896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6589c114-dd03-41b9-b255-b283cab80ff5 tempest-NetworksTest-1952982208 tempest-NetworksTest-1952982208-project-admin] Calling method '.version_select at 0x7fd6c677c9d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:38.687075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e9430d3b-2d5e-46d6-84d0-829239fa779a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:38.703182 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e9430d3b-2d5e-46d6-84d0-829239fa779a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1335 microversion: 2.1 time: 0.318867 Jul 14 14:25:38.719514 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 41/83] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:38 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1335 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:38.988810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b1ee862a-342b-4f23-9a22-4c26e934647c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:38.989583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b1ee862a-342b-4f23-9a22-4c26e934647c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:39.000717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1ee862a-342b-4f23-9a22-4c26e934647c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:39.004221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1ee862a-342b-4f23-9a22-4c26e934647c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:39.007230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1ee862a-342b-4f23-9a22-4c26e934647c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:39.008606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1ee862a-342b-4f23-9a22-4c26e934647c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:39.255340 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6589c114-dd03-41b9-b255-b283cab80ff5 tempest-NetworksTest-1952982208 tempest-NetworksTest-1952982208-project-admin] 10.222.0.81 "GET /compute/v2.1/os-networks/dbf616c8-e7bc-4fbe-bb65-7c29f219160a" status: 200 len: 652 microversion: 2.1 time: 0.577246 Jul 14 14:25:39.257233 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 43/84] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 14:25:38 2022] GET /compute/v2.1/os-networks/dbf616c8-e7bc-4fbe-bb65-7c29f219160a => generated 652 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:39.268714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af608c0c-9b76-4a71-b071-66e0425feea7 tempest-NetworksTest-1952982208 tempest-NetworksTest-1952982208-project-admin] Calling method '.version_select at 0x7fd6c680a0d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:39.468516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b1ee862a-342b-4f23-9a22-4c26e934647c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:39.488774 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b1ee862a-342b-4f23-9a22-4c26e934647c tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 0.495463 Jul 14 14:25:39.488774 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 42/85] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:38 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:39.560908 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-af608c0c-9b76-4a71-b071-66e0425feea7 tempest-NetworksTest-1952982208 tempest-NetworksTest-1952982208-project-admin] 10.222.0.81 "GET /compute/v2.1/os-networks" status: 200 len: 4024 microversion: 2.1 time: 0.296154 Jul 14 14:25:39.565150 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 44/86] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:25:39 2022] GET /compute/v2.1/os-networks => generated 4024 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:39.730179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-309698be-3057-4f1c-b1a1-2a6c33f5f8ef tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:39.731068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-309698be-3057-4f1c-b1a1-2a6c33f5f8ef tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:39.741164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-309698be-3057-4f1c-b1a1-2a6c33f5f8ef tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:39.742334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-309698be-3057-4f1c-b1a1-2a6c33f5f8ef tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:39.743654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-309698be-3057-4f1c-b1a1-2a6c33f5f8ef tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:39.744411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-309698be-3057-4f1c-b1a1-2a6c33f5f8ef tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:39.915578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-309698be-3057-4f1c-b1a1-2a6c33f5f8ef tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:39.929062 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-309698be-3057-4f1c-b1a1-2a6c33f5f8ef tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1323 microversion: 2.1 time: 0.202473 Jul 14 14:25:39.934245 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 43/87] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:39 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1323 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:40.516058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-111f0773-3d67-4fc6-b6cd-8030b58159ff tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:40.517614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-111f0773-3d67-4fc6-b6cd-8030b58159ff tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:40.548742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-111f0773-3d67-4fc6-b6cd-8030b58159ff tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:40.549564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-111f0773-3d67-4fc6-b6cd-8030b58159ff tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:40.551422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-111f0773-3d67-4fc6-b6cd-8030b58159ff tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:40.552204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-111f0773-3d67-4fc6-b6cd-8030b58159ff tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:40.961156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4ff414f1-d564-48f9-a185-e25739a38fd5 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:40.963641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4ff414f1-d564-48f9-a185-e25739a38fd5 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:40.975785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ff414f1-d564-48f9-a185-e25739a38fd5 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:40.981481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ff414f1-d564-48f9-a185-e25739a38fd5 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:40.982672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ff414f1-d564-48f9-a185-e25739a38fd5 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:40.983286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ff414f1-d564-48f9-a185-e25739a38fd5 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:41.208618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-111f0773-3d67-4fc6-b6cd-8030b58159ff tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:41.228101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4ff414f1-d564-48f9-a185-e25739a38fd5 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:41.240667 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4ff414f1-d564-48f9-a185-e25739a38fd5 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1323 microversion: 2.1 time: 0.283778 Jul 14 14:25:41.244036 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-111f0773-3d67-4fc6-b6cd-8030b58159ff tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 0.734697 Jul 14 14:25:41.245740 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 44/88] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:40 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1323 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:41.249047 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 45/89] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:40 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:42.260176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-acc7b5e1-825a-4fae-aefa-3f84257f5c5d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:42.262215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-acc7b5e1-825a-4fae-aefa-3f84257f5c5d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:42.265400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bcc3c73e-ee93-44a2-8096-b549079a9ab4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:42.267431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bcc3c73e-ee93-44a2-8096-b549079a9ab4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:42.280623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-acc7b5e1-825a-4fae-aefa-3f84257f5c5d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:42.281164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-acc7b5e1-825a-4fae-aefa-3f84257f5c5d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:42.282387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-acc7b5e1-825a-4fae-aefa-3f84257f5c5d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:42.282969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-acc7b5e1-825a-4fae-aefa-3f84257f5c5d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:42.283572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bcc3c73e-ee93-44a2-8096-b549079a9ab4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:42.284339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bcc3c73e-ee93-44a2-8096-b549079a9ab4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:42.290403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bcc3c73e-ee93-44a2-8096-b549079a9ab4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:42.293280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bcc3c73e-ee93-44a2-8096-b549079a9ab4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:42.457818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-acc7b5e1-825a-4fae-aefa-3f84257f5c5d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:42.470476 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-acc7b5e1-825a-4fae-aefa-3f84257f5c5d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1323 microversion: 2.1 time: 0.214830 Jul 14 14:25:42.473253 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 45/90] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:42 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1323 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:42.626896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bcc3c73e-ee93-44a2-8096-b549079a9ab4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:42.648576 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bcc3c73e-ee93-44a2-8096-b549079a9ab4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 0.390628 Jul 14 14:25:42.651871 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 46/91] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:42 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:43.489767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-be04eeca-eb2d-47c7-b324-279451c9a8c9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:43.491062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-be04eeca-eb2d-47c7-b324-279451c9a8c9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:43.511122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-be04eeca-eb2d-47c7-b324-279451c9a8c9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:43.514943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-be04eeca-eb2d-47c7-b324-279451c9a8c9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:43.517663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-be04eeca-eb2d-47c7-b324-279451c9a8c9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:43.518505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-be04eeca-eb2d-47c7-b324-279451c9a8c9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:43.630372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-be04eeca-eb2d-47c7-b324-279451c9a8c9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:43.639208 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-be04eeca-eb2d-47c7-b324-279451c9a8c9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1323 microversion: 2.1 time: 0.154349 Jul 14 14:25:43.640126 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 46/92] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:43 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:25:43.668681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-34c6332b-0fbf-4a78-9b8e-3c6bda3192b3 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:43.669899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-34c6332b-0fbf-4a78-9b8e-3c6bda3192b3 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:43.678023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34c6332b-0fbf-4a78-9b8e-3c6bda3192b3 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:43.678679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34c6332b-0fbf-4a78-9b8e-3c6bda3192b3 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:43.681035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34c6332b-0fbf-4a78-9b8e-3c6bda3192b3 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:43.681635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34c6332b-0fbf-4a78-9b8e-3c6bda3192b3 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:43.919488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-34c6332b-0fbf-4a78-9b8e-3c6bda3192b3 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:43.931261 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-34c6332b-0fbf-4a78-9b8e-3c6bda3192b3 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 0.269865 Jul 14 14:25:43.932527 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 47/93] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:43 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:43.968654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-84590491", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:44.048463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:25:44.427123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:25:44.427842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:25:44.428309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:25:44.428721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:25:44.429293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:25:44.448722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:44.453513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:44.454533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:44.454981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:44.512551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Getting quotas for project c3e95b24eb1b4f9fbc5eb6f4d6f3d308. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:25:44.540341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Getting quotas for user 89894c4d380a4632870ebcb10a2ffe81 and project c3e95b24eb1b4f9fbc5eb6f4d6f3d308. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:25:44.575594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:25:44.580661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:25:44.657715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9dc31f09-e206-4260-9783-9f8b68c9f64b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:44.658332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9dc31f09-e206-4260-9783-9f8b68c9f64b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:44.675597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dc31f09-e206-4260-9783-9f8b68c9f64b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:44.700539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dc31f09-e206-4260-9783-9f8b68c9f64b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:44.701506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dc31f09-e206-4260-9783-9f8b68c9f64b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:44.702111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dc31f09-e206-4260-9783-9f8b68c9f64b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:44.721559 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-77aee3b9-5cc8-4149-baf7-fda321965052 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.058675 Jul 14 14:25:44.722954 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 47/94] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:25:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:25:44.734127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fcc332f5-99b0-4139-b0f5-47437fd2d49a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:44.734760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fcc332f5-99b0-4139-b0f5-47437fd2d49a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:45.010023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fcc332f5-99b0-4139-b0f5-47437fd2d49a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:45.015394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9dc31f09-e206-4260-9783-9f8b68c9f64b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:45.029100 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9dc31f09-e206-4260-9783-9f8b68c9f64b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1323 microversion: 2.1 time: 0.370742 Jul 14 14:25:45.032227 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 48/95] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:44 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1323 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:25:45.042108 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fcc332f5-99b0-4139-b0f5-47437fd2d49a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1211 microversion: 2.1 time: 0.312421 Jul 14 14:25:45.042751 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 48/96] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:44 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1211 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:45.046016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4ddc311-fc63-4bd3-b8ab-44f2c2322773 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:45.046874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d4ddc311-fc63-4bd3-b8ab-44f2c2322773 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:45.051436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:45.072970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4ddc311-fc63-4bd3-b8ab-44f2c2322773 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:45.073683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4ddc311-fc63-4bd3-b8ab-44f2c2322773 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:45.074841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4ddc311-fc63-4bd3-b8ab-44f2c2322773 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:45.075451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4ddc311-fc63-4bd3-b8ab-44f2c2322773 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:45.365074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e1c8077b-0aa5-4300-ba50-3760e5b3744a req-5249f13e-1e0c-4af3-a288-2f7dc5709edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c562a5-9c0e-42d4-8472-7e3439921cc5", "name": "network-vif-plugged", "status": "completed", "tag": "dca95444-4dd1-4c2f-a827-f796be313222"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:45.446629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e1c8077b-0aa5-4300-ba50-3760e5b3744a req-5249f13e-1e0c-4af3-a288-2f7dc5709edc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:45.447343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e1c8077b-0aa5-4300-ba50-3760e5b3744a req-5249f13e-1e0c-4af3-a288-2f7dc5709edc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:45.487782 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e1c8077b-0aa5-4300-ba50-3760e5b3744a req-5249f13e-1e0c-4af3-a288-2f7dc5709edc service nova] Creating event network-vif-plugged:dca95444-4dd1-4c2f-a827-f796be313222 for instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 on n-h2-767704-28 Jul 14 14:25:45.495626 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e1c8077b-0aa5-4300-ba50-3760e5b3744a req-5249f13e-1e0c-4af3-a288-2f7dc5709edc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.437986 Jul 14 14:25:45.498887 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 49/97] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:45.662847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d4ddc311-fc63-4bd3-b8ab-44f2c2322773 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:45.678398 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d4ddc311-fc63-4bd3-b8ab-44f2c2322773 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 0.643780 Jul 14 14:25:45.682693 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 49/98] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:45 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:46.049222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-429d082b-a7ce-4704-9b63-6ef4147e972b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:46.050617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-429d082b-a7ce-4704-9b63-6ef4147e972b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:46.061590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-13e23be6-34ed-4e17-bb93-7e519785efa9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:46.062691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-13e23be6-34ed-4e17-bb93-7e519785efa9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:46.074666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13e23be6-34ed-4e17-bb93-7e519785efa9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:46.079913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13e23be6-34ed-4e17-bb93-7e519785efa9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:46.081087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13e23be6-34ed-4e17-bb93-7e519785efa9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:46.085180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13e23be6-34ed-4e17-bb93-7e519785efa9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:46.086076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-429d082b-a7ce-4704-9b63-6ef4147e972b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:46.087697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-429d082b-a7ce-4704-9b63-6ef4147e972b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:46.091124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-429d082b-a7ce-4704-9b63-6ef4147e972b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:46.092316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:46.097637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-429d082b-a7ce-4704-9b63-6ef4147e972b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:46.381287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-13e23be6-34ed-4e17-bb93-7e519785efa9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:46.398048 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-13e23be6-34ed-4e17-bb93-7e519785efa9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1207 microversion: 2.1 time: 0.341472 Jul 14 14:25:46.409136 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 50/99] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:46 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1207 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:46.547822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-429d082b-a7ce-4704-9b63-6ef4147e972b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:46.560028 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-429d082b-a7ce-4704-9b63-6ef4147e972b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1391 microversion: 2.1 time: 0.515643 Jul 14 14:25:46.561484 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 50/100] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:46 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1391 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:46.704180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6adbb812-d7c7-4808-8daa-16cfaa955efd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:46.704829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6adbb812-d7c7-4808-8daa-16cfaa955efd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:46.745013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6adbb812-d7c7-4808-8daa-16cfaa955efd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:46.745952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6adbb812-d7c7-4808-8daa-16cfaa955efd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:46.749739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6adbb812-d7c7-4808-8daa-16cfaa955efd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:46.751752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6adbb812-d7c7-4808-8daa-16cfaa955efd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:46.813784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-11431405-14dd-4cbe-a219-cd5373e516d9 tempest-SecurityGroupsTestAdminJSON-922826509 tempest-SecurityGroupsTestAdminJSON-922826509-project] Action: 'create', calling method: .version_select at 0x7fd6c67ae160>, body: {"security_group": {"name": "tempest-securitygroup-1493182185", "description": "tempest-description-458209753"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:47.221702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6adbb812-d7c7-4808-8daa-16cfaa955efd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:47.248187 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6adbb812-d7c7-4808-8daa-16cfaa955efd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 0.553116 Jul 14 14:25:47.249131 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 51/101] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:46 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:47.420889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-02f2d8d0-08d6-421d-b7e1-3cd0b5c1aaa1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:47.422067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-02f2d8d0-08d6-421d-b7e1-3cd0b5c1aaa1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:47.430322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02f2d8d0-08d6-421d-b7e1-3cd0b5c1aaa1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:47.431483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02f2d8d0-08d6-421d-b7e1-3cd0b5c1aaa1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:47.432781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02f2d8d0-08d6-421d-b7e1-3cd0b5c1aaa1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:47.433636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02f2d8d0-08d6-421d-b7e1-3cd0b5c1aaa1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:47.669311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-02f2d8d0-08d6-421d-b7e1-3cd0b5c1aaa1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:47.682673 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-02f2d8d0-08d6-421d-b7e1-3cd0b5c1aaa1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1269 microversion: 2.1 time: 0.266188 Jul 14 14:25:47.683832 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 52/102] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:47 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1269 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:47.688628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7be0fc49-983b-4d20-9c8e-cb244faa2571 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:47.697565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7be0fc49-983b-4d20-9c8e-cb244faa2571 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:47.725063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7be0fc49-983b-4d20-9c8e-cb244faa2571 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:47.725817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7be0fc49-983b-4d20-9c8e-cb244faa2571 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:47.727656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7be0fc49-983b-4d20-9c8e-cb244faa2571 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:47.728395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7be0fc49-983b-4d20-9c8e-cb244faa2571 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:47.802721 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-11431405-14dd-4cbe-a219-cd5373e516d9 tempest-SecurityGroupsTestAdminJSON-922826509 tempest-SecurityGroupsTestAdminJSON-922826509-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.382456 Jul 14 14:25:47.810075 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 51/103] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:25:46 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:47.823399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f162145d-223f-4a6e-8db2-e3dade30b0f6 tempest-SecurityGroupsTestAdminJSON-922826509 tempest-SecurityGroupsTestAdminJSON-922826509-project] Action: 'create', calling method: .version_select at 0x7fd6c67d1f70>, body: {"security_group": {"name": "tempest-securitygroup-1691309443", "description": "tempest-description-1536383730"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:48.172538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7be0fc49-983b-4d20-9c8e-cb244faa2571 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:48.204612 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7be0fc49-983b-4d20-9c8e-cb244faa2571 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1391 microversion: 2.1 time: 0.517912 Jul 14 14:25:48.207132 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 53/104] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:47 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1391 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:48.268844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-31fb768a-f7d1-4ad7-9f3f-1e122c2a73af tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:48.269573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-31fb768a-f7d1-4ad7-9f3f-1e122c2a73af tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:48.271597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:48.280391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-31fb768a-f7d1-4ad7-9f3f-1e122c2a73af tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:48.281311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-31fb768a-f7d1-4ad7-9f3f-1e122c2a73af tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:48.283186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-31fb768a-f7d1-4ad7-9f3f-1e122c2a73af tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:48.284606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-31fb768a-f7d1-4ad7-9f3f-1e122c2a73af tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:48.331742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=7 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:48.695935 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f162145d-223f-4a6e-8db2-e3dade30b0f6 tempest-SecurityGroupsTestAdminJSON-922826509 tempest-SecurityGroupsTestAdminJSON-922826509-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.877687 Jul 14 14:25:48.705068 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 52/105] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:25:47 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:48.713377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-8e1fd42c-7bdc-41d3-b9f3-2ab9c5b27f3e req-465a2b89-72f9-4343-ad23-d1796103a082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f119f8-47c2-4c9b-a800-d16194ab2e49", "tag": "26034b4d-8bdb-42fb-bdf2-a8ae6c01b5be"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:48.740038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8e1fd42c-7bdc-41d3-b9f3-2ab9c5b27f3e req-465a2b89-72f9-4343-ad23-d1796103a082 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:48.740628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8e1fd42c-7bdc-41d3-b9f3-2ab9c5b27f3e req-465a2b89-72f9-4343-ad23-d1796103a082 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:48.772019 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-8e1fd42c-7bdc-41d3-b9f3-2ab9c5b27f3e req-465a2b89-72f9-4343-ad23-d1796103a082 service nova] Creating event network-changed:26034b4d-8bdb-42fb-bdf2-a8ae6c01b5be for instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 on n-h1-767704-28 Jul 14 14:25:48.779119 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-8e1fd42c-7bdc-41d3-b9f3-2ab9c5b27f3e req-465a2b89-72f9-4343-ad23-d1796103a082 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072432 Jul 14 14:25:48.779740 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 53/106] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:48.791953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4b1d3768-6e19-46da-be94-975a3ec7e23d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:48.801986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4b1d3768-6e19-46da-be94-975a3ec7e23d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:48.812757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b1d3768-6e19-46da-be94-975a3ec7e23d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:48.813246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b1d3768-6e19-46da-be94-975a3ec7e23d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:48.814036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b1d3768-6e19-46da-be94-975a3ec7e23d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:48.814467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b1d3768-6e19-46da-be94-975a3ec7e23d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:49.202302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4b1d3768-6e19-46da-be94-975a3ec7e23d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:49.218059 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4b1d3768-6e19-46da-be94-975a3ec7e23d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1269 microversion: 2.1 time: 0.432284 Jul 14 14:25:49.223500 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 54/107] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:48 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1269 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:49.256229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-31fb768a-f7d1-4ad7-9f3f-1e122c2a73af tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:49.267903 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-31fb768a-f7d1-4ad7-9f3f-1e122c2a73af tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1336 microversion: 2.1 time: 1.003251 Jul 14 14:25:49.275061 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 54/108] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:48 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1336 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:49.283183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9e35a9d7-c76c-4066-9746-e4c11d02418f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:49.284281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9e35a9d7-c76c-4066-9746-e4c11d02418f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:49.305941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e35a9d7-c76c-4066-9746-e4c11d02418f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:49.306267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e35a9d7-c76c-4066-9746-e4c11d02418f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:49.313728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e35a9d7-c76c-4066-9746-e4c11d02418f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:49.314438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e35a9d7-c76c-4066-9746-e4c11d02418f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:49.647022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f84839e9-fada-4752-9c46-a58f706187aa tempest-SecurityGroupsTestAdminJSON-722867865 tempest-SecurityGroupsTestAdminJSON-722867865-project-admin] Action: 'create', calling method: .version_select at 0x7fd6c67d1e50>, body: {"security_group": {"name": "tempest-securitygroup-661978312", "description": "tempest-description-689094230"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:49.885751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e35a9d7-c76c-4066-9746-e4c11d02418f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:49.903199 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9e35a9d7-c76c-4066-9746-e4c11d02418f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1391 microversion: 2.1 time: 0.627066 Jul 14 14:25:49.904018 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 55/109] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:49 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1391 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:50.240115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-01d9769b-be0d-4afc-9e1a-b2c3f2bcdfe5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:50.240772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-01d9769b-be0d-4afc-9e1a-b2c3f2bcdfe5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:50.247543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-01d9769b-be0d-4afc-9e1a-b2c3f2bcdfe5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:50.247924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-01d9769b-be0d-4afc-9e1a-b2c3f2bcdfe5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:50.248692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-01d9769b-be0d-4afc-9e1a-b2c3f2bcdfe5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:50.256363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-01d9769b-be0d-4afc-9e1a-b2c3f2bcdfe5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:50.676668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-01d9769b-be0d-4afc-9e1a-b2c3f2bcdfe5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:50.700505 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-01d9769b-be0d-4afc-9e1a-b2c3f2bcdfe5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1311 microversion: 2.1 time: 0.464418 Jul 14 14:25:50.703412 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 56/110] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:50 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1311 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:25:50.730860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-acd42787-e028-4b9b-81cc-c5a418b4844d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:50.732718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-acd42787-e028-4b9b-81cc-c5a418b4844d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:50.749818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acd42787-e028-4b9b-81cc-c5a418b4844d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:50.751223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acd42787-e028-4b9b-81cc-c5a418b4844d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:50.754483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acd42787-e028-4b9b-81cc-c5a418b4844d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:50.755374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acd42787-e028-4b9b-81cc-c5a418b4844d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:50.865495 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f84839e9-fada-4752-9c46-a58f706187aa tempest-SecurityGroupsTestAdminJSON-722867865 tempest-SecurityGroupsTestAdminJSON-722867865-project-admin] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.640393 Jul 14 14:25:50.867274 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 55/111] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:25:49 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:50.880525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc9758d0-1b94-49d4-be65-05b0b93805cf tempest-SecurityGroupsTestAdminJSON-722867865 tempest-SecurityGroupsTestAdminJSON-722867865-project-admin] Action: 'create', calling method: .version_select at 0x7fd6c6741700>, body: {"security_group": {"name": "tempest-securitygroup-393962818", "description": "tempest-description-1553546021"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:51.183779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-acd42787-e028-4b9b-81cc-c5a418b4844d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:51.209880 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-acd42787-e028-4b9b-81cc-c5a418b4844d tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1486 microversion: 2.1 time: 0.497503 Jul 14 14:25:51.210540 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 57/112] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:50 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1486 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:51.232721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-06f13b2e-93ad-40bd-9240-a569c788bf97 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:51.233416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-06f13b2e-93ad-40bd-9240-a569c788bf97 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:51.256002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06f13b2e-93ad-40bd-9240-a569c788bf97 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:51.256341 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc9758d0-1b94-49d4-be65-05b0b93805cf tempest-SecurityGroupsTestAdminJSON-722867865 tempest-SecurityGroupsTestAdminJSON-722867865-project-admin] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.380987 Jul 14 14:25:51.260253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06f13b2e-93ad-40bd-9240-a569c788bf97 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:51.262675 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 56/113] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:25:50 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:25:51.263704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06f13b2e-93ad-40bd-9240-a569c788bf97 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:51.264207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06f13b2e-93ad-40bd-9240-a569c788bf97 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:51.268894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-642b04fc-036e-480d-9203-8a435bcbd315 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:51.269435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-642b04fc-036e-480d-9203-8a435bcbd315 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:51.280430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-642b04fc-036e-480d-9203-8a435bcbd315 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:51.280887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-642b04fc-036e-480d-9203-8a435bcbd315 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:51.281748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-642b04fc-036e-480d-9203-8a435bcbd315 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:51.282187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-642b04fc-036e-480d-9203-8a435bcbd315 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:51.699771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-06f13b2e-93ad-40bd-9240-a569c788bf97 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:51.715826 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-06f13b2e-93ad-40bd-9240-a569c788bf97 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1391 microversion: 2.1 time: 0.503386 Jul 14 14:25:51.716801 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 58/114] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:51 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1391 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:51.727838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-243bc9ee-686c-46c4-89be-9ac7a7299bbe tempest-SecurityGroupsTestAdminJSON-722867865 tempest-SecurityGroupsTestAdminJSON-722867865-project-admin] Calling method '.version_select at 0x7fd6c67e4940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:52.494408 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-642b04fc-036e-480d-9203-8a435bcbd315 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1639 microversion: 2.1 time: 1.230533 Jul 14 14:25:52.495003 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 57/115] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:51 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1639 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:52.517403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-29b8a822-b897-4470-9c52-a6ad231d8ae9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:52.518054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-29b8a822-b897-4470-9c52-a6ad231d8ae9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:52.527502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-29b8a822-b897-4470-9c52-a6ad231d8ae9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:52.528873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-29b8a822-b897-4470-9c52-a6ad231d8ae9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:52.531492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-29b8a822-b897-4470-9c52-a6ad231d8ae9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:52.533386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-29b8a822-b897-4470-9c52-a6ad231d8ae9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:53.137077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-29b8a822-b897-4470-9c52-a6ad231d8ae9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:53.146212 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-29b8a822-b897-4470-9c52-a6ad231d8ae9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1311 microversion: 2.1 time: 0.639998 Jul 14 14:25:53.150985 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 58/116] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:52 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1311 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:53.167659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dae2e471-cee3-4b7c-b307-3514ceacb0b2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:53.168287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dae2e471-cee3-4b7c-b307-3514ceacb0b2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:53.182105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dae2e471-cee3-4b7c-b307-3514ceacb0b2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:53.183586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dae2e471-cee3-4b7c-b307-3514ceacb0b2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:53.185945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dae2e471-cee3-4b7c-b307-3514ceacb0b2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:53.188642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dae2e471-cee3-4b7c-b307-3514ceacb0b2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:53.245365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dae2e471-cee3-4b7c-b307-3514ceacb0b2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:25:53.344646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:53.824246 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dae2e471-cee3-4b7c-b307-3514ceacb0b2 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 204 len: 0 microversion: 2.1 time: 0.670225 Jul 14 14:25:53.826250 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 59/117] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:25:53 2022] DELETE /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:25:53.845320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65c44359-26bc-46b4-aa28-1d5038fc2482 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:53.847163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-65c44359-26bc-46b4-aa28-1d5038fc2482 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:53.872886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65c44359-26bc-46b4-aa28-1d5038fc2482 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:53.873643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65c44359-26bc-46b4-aa28-1d5038fc2482 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:53.874763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65c44359-26bc-46b4-aa28-1d5038fc2482 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:53.875387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65c44359-26bc-46b4-aa28-1d5038fc2482 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:54.343812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-65c44359-26bc-46b4-aa28-1d5038fc2482 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:54.355485 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65c44359-26bc-46b4-aa28-1d5038fc2482 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1391 microversion: 2.1 time: 0.527647 Jul 14 14:25:54.356067 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 60/118] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:53 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1391 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:54.360744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c92c2146-9771-483a-854f-3f12699d8ba7 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:54.365669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c92c2146-9771-483a-854f-3f12699d8ba7 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:54.378650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c92c2146-9771-483a-854f-3f12699d8ba7 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:54.382109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c92c2146-9771-483a-854f-3f12699d8ba7 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:54.383687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c92c2146-9771-483a-854f-3f12699d8ba7 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:54.389589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c92c2146-9771-483a-854f-3f12699d8ba7 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:54.471261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:54.793434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c92c2146-9771-483a-854f-3f12699d8ba7 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:54.802432 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c92c2146-9771-483a-854f-3f12699d8ba7 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1492 microversion: 2.1 time: 0.445118 Jul 14 14:25:54.813255 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 61/119] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:54 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1492 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:54.818515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e6feb5f3-243e-4c3d-ae9a-ec5b4bb4451e req-cbe77062-983c-450a-8d1d-0203e11ab612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2395da0-b1d7-4882-a1ac-e2029c5fad94", "tag": "b00304cb-9535-4ecd-a778-337437c2dd15"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:54.839005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e6feb5f3-243e-4c3d-ae9a-ec5b4bb4451e req-cbe77062-983c-450a-8d1d-0203e11ab612 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:54.840487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e6feb5f3-243e-4c3d-ae9a-ec5b4bb4451e req-cbe77062-983c-450a-8d1d-0203e11ab612 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:54.858820 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e6feb5f3-243e-4c3d-ae9a-ec5b4bb4451e req-cbe77062-983c-450a-8d1d-0203e11ab612 service nova] Creating event network-changed:b00304cb-9535-4ecd-a778-337437c2dd15 for instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 on n-h1-767704-28 Jul 14 14:25:54.866042 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e6feb5f3-243e-4c3d-ae9a-ec5b4bb4451e req-cbe77062-983c-450a-8d1d-0203e11ab612 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050989 Jul 14 14:25:54.867816 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 62/120] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:54.874343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b7d1e94-45b0-447c-b44f-a00a5618f546 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:54.875399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b7d1e94-45b0-447c-b44f-a00a5618f546 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:54.884300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b7d1e94-45b0-447c-b44f-a00a5618f546 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:54.885063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b7d1e94-45b0-447c-b44f-a00a5618f546 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:54.886274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b7d1e94-45b0-447c-b44f-a00a5618f546 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:54.887819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b7d1e94-45b0-447c-b44f-a00a5618f546 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:55.018974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=14 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:55.292720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9b7d1e94-45b0-447c-b44f-a00a5618f546 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:55.306531 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9b7d1e94-45b0-447c-b44f-a00a5618f546 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1311 microversion: 2.1 time: 0.437093 Jul 14 14:25:55.309352 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 63/121] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:54 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1311 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:55.376712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-20309cc7-d041-4760-beac-287b0eb97e41 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:55.377797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-20309cc7-d041-4760-beac-287b0eb97e41 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:55.387221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20309cc7-d041-4760-beac-287b0eb97e41 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:55.391316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20309cc7-d041-4760-beac-287b0eb97e41 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:55.392361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20309cc7-d041-4760-beac-287b0eb97e41 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:55.392886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20309cc7-d041-4760-beac-287b0eb97e41 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:55.686686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-20309cc7-d041-4760-beac-287b0eb97e41 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:55.695401 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-20309cc7-d041-4760-beac-287b0eb97e41 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1391 microversion: 2.1 time: 0.327102 Jul 14 14:25:55.699298 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 64/122] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:55 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1391 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:25:55.738488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-d31a208e-2e08-4408-8b1d-a7f8d12a230c req-b7f07006-ad20-4f87-8972-17ab7148fd6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f119f8-47c2-4c9b-a800-d16194ab2e49", "name": "network-vif-plugged", "status": "completed", "tag": "26034b4d-8bdb-42fb-bdf2-a8ae6c01b5be"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:55.755509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d31a208e-2e08-4408-8b1d-a7f8d12a230c req-b7f07006-ad20-4f87-8972-17ab7148fd6c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:55.756251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d31a208e-2e08-4408-8b1d-a7f8d12a230c req-b7f07006-ad20-4f87-8972-17ab7148fd6c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:55.779781 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-d31a208e-2e08-4408-8b1d-a7f8d12a230c req-b7f07006-ad20-4f87-8972-17ab7148fd6c service nova] Creating event network-vif-plugged:26034b4d-8bdb-42fb-bdf2-a8ae6c01b5be for instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 on n-h1-767704-28 Jul 14 14:25:55.797535 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-d31a208e-2e08-4408-8b1d-a7f8d12a230c req-b7f07006-ad20-4f87-8972-17ab7148fd6c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061839 Jul 14 14:25:55.798960 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 65/123] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:25:55.843739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-72b5c633-50f0-4102-a0ef-6fd1af2acadd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:55.847048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-72b5c633-50f0-4102-a0ef-6fd1af2acadd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:55.874044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72b5c633-50f0-4102-a0ef-6fd1af2acadd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:55.874983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72b5c633-50f0-4102-a0ef-6fd1af2acadd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:55.876507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72b5c633-50f0-4102-a0ef-6fd1af2acadd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:55.886271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72b5c633-50f0-4102-a0ef-6fd1af2acadd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:56.407324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-72b5c633-50f0-4102-a0ef-6fd1af2acadd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:56.419920 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-72b5c633-50f0-4102-a0ef-6fd1af2acadd tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1492 microversion: 2.1 time: 0.600862 Jul 14 14:25:56.421379 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 66/124] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:55 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1492 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:56.427644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-14e934f9-836d-4cf6-a903-190e0e131bc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:56.428464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-14e934f9-836d-4cf6-a903-190e0e131bc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:56.438011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14e934f9-836d-4cf6-a903-190e0e131bc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:56.438699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14e934f9-836d-4cf6-a903-190e0e131bc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:56.439670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14e934f9-836d-4cf6-a903-190e0e131bc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:56.440305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14e934f9-836d-4cf6-a903-190e0e131bc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:56.890996 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-243bc9ee-686c-46c4-89be-9ac7a7299bbe tempest-SecurityGroupsTestAdminJSON-722867865 tempest-SecurityGroupsTestAdminJSON-722867865-project-admin] 10.222.0.81 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9683 microversion: 2.1 time: 5.169663 Jul 14 14:25:56.891603 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 59/125] 10.222.0.81 () {58 vars in 1190 bytes} [Thu Jul 14 14:25:51 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9683 bytes in 5171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:56.896828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fded4f7b-8a8f-4ef9-9dc6-996910801739 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:56.897570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fded4f7b-8a8f-4ef9-9dc6-996910801739 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:56.910501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fded4f7b-8a8f-4ef9-9dc6-996910801739 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:56.910955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fded4f7b-8a8f-4ef9-9dc6-996910801739 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:56.911736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fded4f7b-8a8f-4ef9-9dc6-996910801739 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:56.912168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fded4f7b-8a8f-4ef9-9dc6-996910801739 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:56.954023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-14e934f9-836d-4cf6-a903-190e0e131bc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:56.972027 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-14e934f9-836d-4cf6-a903-190e0e131bc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1311 microversion: 2.1 time: 0.548915 Jul 14 14:25:56.982715 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 67/126] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:56 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1311 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:56.989836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-306dae04-c6a0-4ef5-9fb8-c8997d88c559 tempest-SecurityGroupsTestAdminJSON-922826509 tempest-SecurityGroupsTestAdminJSON-922826509-project] Calling method '.version_select at 0x7fd6c6862a60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:57.552889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fded4f7b-8a8f-4ef9-9dc6-996910801739 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:57.571624 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fded4f7b-8a8f-4ef9-9dc6-996910801739 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1391 microversion: 2.1 time: 0.678412 Jul 14 14:25:57.584981 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 60/127] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:56 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1391 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:57.584981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b98a6310-ae80-4b06-b34a-af71b8942fc4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:57.584981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b98a6310-ae80-4b06-b34a-af71b8942fc4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:57.592707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b98a6310-ae80-4b06-b34a-af71b8942fc4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:57.593471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b98a6310-ae80-4b06-b34a-af71b8942fc4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:57.594554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b98a6310-ae80-4b06-b34a-af71b8942fc4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:57.595207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b98a6310-ae80-4b06-b34a-af71b8942fc4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:57.607861 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-306dae04-c6a0-4ef5-9fb8-c8997d88c559 tempest-SecurityGroupsTestAdminJSON-922826509 tempest-SecurityGroupsTestAdminJSON-922826509-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.623758 Jul 14 14:25:57.619578 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 68/128] 10.222.0.81 () {58 vars in 1190 bytes} [Thu Jul 14 14:25:56 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:57.626365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4b138f91-895f-42dc-9032-4b763bd4a30f req-7a2d5b21-21dd-4491-91f4-386493470215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c562a5-9c0e-42d4-8472-7e3439921cc5", "name": "network-vif-deleted", "tag": "dca95444-4dd1-4c2f-a827-f796be313222"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:57.644788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4b138f91-895f-42dc-9032-4b763bd4a30f req-7a2d5b21-21dd-4491-91f4-386493470215 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:57.645558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4b138f91-895f-42dc-9032-4b763bd4a30f req-7a2d5b21-21dd-4491-91f4-386493470215 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:57.678939 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4b138f91-895f-42dc-9032-4b763bd4a30f req-7a2d5b21-21dd-4491-91f4-386493470215 service nova] Creating event network-vif-deleted:dca95444-4dd1-4c2f-a827-f796be313222 for instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 on n-h2-767704-28 Jul 14 14:25:57.686763 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4b138f91-895f-42dc-9032-4b763bd4a30f req-7a2d5b21-21dd-4491-91f4-386493470215 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065428 Jul 14 14:25:57.687669 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 69/129] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:57.694420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-afd3033d-9390-4ccd-88bc-2b43153d336b tempest-SecurityGroupsTestAdminJSON-722867865 tempest-SecurityGroupsTestAdminJSON-722867865-project-admin] Calling method '.version_select at 0x7fd6c684fb80>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:57.789931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b98a6310-ae80-4b06-b34a-af71b8942fc4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd397a86992f44f43965e29597a1a540c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc1942c7de94649a21a347bfc86b77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:57.803305 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b98a6310-ae80-4b06-b34a-af71b8942fc4 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 200 len: 1321 microversion: 2.1 time: 0.229404 Jul 14 14:25:57.805371 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 61/130] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:57 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:57.989924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c398a71c-e6db-45f6-9ff6-d47f0a330785 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:57.991326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c398a71c-e6db-45f6-9ff6-d47f0a330785 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:58.002881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c398a71c-e6db-45f6-9ff6-d47f0a330785 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:58.010506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c398a71c-e6db-45f6-9ff6-d47f0a330785 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:58.013334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c398a71c-e6db-45f6-9ff6-d47f0a330785 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:58.019285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c398a71c-e6db-45f6-9ff6-d47f0a330785 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:58.405820 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-afd3033d-9390-4ccd-88bc-2b43153d336b tempest-SecurityGroupsTestAdminJSON-722867865 tempest-SecurityGroupsTestAdminJSON-722867865-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/1baf33d1-dfe1-434b-a3c9-511dc51e8925" status: 202 len: 0 microversion: 2.1 time: 0.715860 Jul 14 14:25:58.406584 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 70/131] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:25:57 2022] DELETE /compute/v2.1/os-security-groups/1baf33d1-dfe1-434b-a3c9-511dc51e8925 => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:25:58.415326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f5d913f2-38bf-4253-8d96-c0f35fb27f43 tempest-SecurityGroupsTestAdminJSON-722867865 tempest-SecurityGroupsTestAdminJSON-722867865-project-admin] Calling method '.version_select at 0x7fd6c672eb80>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:58.487367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c398a71c-e6db-45f6-9ff6-d47f0a330785 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:58.504934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:58.517217 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c398a71c-e6db-45f6-9ff6-d47f0a330785 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1311 microversion: 2.1 time: 0.531612 Jul 14 14:25:58.517849 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 62/132] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:57 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1311 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:25:58.603379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5981efec-77de-420e-83e4-c3417e86fe1f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:58.604264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5981efec-77de-420e-83e4-c3417e86fe1f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:58.611757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5981efec-77de-420e-83e4-c3417e86fe1f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:58.612275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5981efec-77de-420e-83e4-c3417e86fe1f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:58.613773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5981efec-77de-420e-83e4-c3417e86fe1f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:58.614686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5981efec-77de-420e-83e4-c3417e86fe1f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:59.105253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5981efec-77de-420e-83e4-c3417e86fe1f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:25:59.114198 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5981efec-77de-420e-83e4-c3417e86fe1f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1391 microversion: 2.1 time: 0.519612 Jul 14 14:25:59.124476 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 63/133] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:58 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1391 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:59.129894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5cdb7930-24ab-442c-ab18-92c9acc33bd8 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:59.135261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5cdb7930-24ab-442c-ab18-92c9acc33bd8 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:59.163423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5cdb7930-24ab-442c-ab18-92c9acc33bd8 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:59.177557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5cdb7930-24ab-442c-ab18-92c9acc33bd8 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:59.179103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5cdb7930-24ab-442c-ab18-92c9acc33bd8 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:59.187359 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f5d913f2-38bf-4253-8d96-c0f35fb27f43 tempest-SecurityGroupsTestAdminJSON-722867865 tempest-SecurityGroupsTestAdminJSON-722867865-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/61df9f70-9aa9-4ca4-b946-86a2c295afb5" status: 202 len: 0 microversion: 2.1 time: 0.775955 Jul 14 14:25:59.187842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5cdb7930-24ab-442c-ab18-92c9acc33bd8 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:59.188436 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 71/134] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:25:58 2022] DELETE /compute/v2.1/os-security-groups/61df9f70-9aa9-4ca4-b946-86a2c295afb5 => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:25:59.199680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-181fa7bc-9be3-46d4-9df8-f28000419f57 tempest-SecurityGroupsTestAdminJSON-922826509 tempest-SecurityGroupsTestAdminJSON-922826509-project] Calling method '.version_select at 0x7fd6c6862ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:59.247898 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-5cdb7930-24ab-442c-ab18-92c9acc33bd8 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] HTTP exception thrown: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5cdb7930-24ab-442c-ab18-92c9acc33bd8 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Request method failure captured: Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 HTTP/1.1 Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdA_l0xP9cTBavRE0Y6uzY54lgp2zXrqOWuKZ51Fz58soZrEWU-xsvkDW9vldnXmBSLC5C8fFloL2D7QoGww-mYRqdATeQ2cIBr9POMGk9uoPSpgyPgESHMqBkFvHNHFJC98JVz0teefvQHjuqu0gVw3w00DuDIxnyWJB7ijspCSx0 Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 9bc1942c7de94649a21a347bfc86b77e Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AggregatesAdminTestJSON-919434995 Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:25:59.266704 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:25:59.268006 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9bc1942c7de94649a21a347bfc86b77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9bc1942c7de94649a21a347bfc86b77e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9bc1942c7de94649a21a347bfc86b77e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9bc1942c7de94649a21a347bfc86b77e"}]}] Jul 14 14:25:59.268006 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AggregatesAdminTestJSON-919434995 Jul 14 14:25:59.268006 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 9bc1942c7de94649a21a347bfc86b77e Jul 14 14:25:59.268006 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-919434995 Jul 14 14:25:59.268006 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AggregatesAdminTestJSON-919434995-project Jul 14 14:25:59.268006 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:25:59.268006 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:25:59.268006 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d397a86992f44f43965e29597a1a540c Jul 14 14:25:59.268006 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AggregatesAdminTestJSON-919434995-project Jul 14 14:25:59.268006 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:25:59.268006 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:25:59.268006 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'b0c562a5-9c0e-42d4-8472-7e3439921cc5'} Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:25:59.268665 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:25:59.269768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:25:59.270726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5cdb7930-24ab-442c-ab18-92c9acc33bd8 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Returning 404 to user: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:25:59.270726 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5cdb7930-24ab-442c-ab18-92c9acc33bd8 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 404 len: 111 microversion: 2.1 time: 0.142573 Jul 14 14:25:59.272419 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 64/135] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:59 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:25:59.279612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a726ebfc-1cb2-4310-ad87-ef754b58b12a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-767704-28"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:59.281257 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:59.281257 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:25:59.301845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a726ebfc-1cb2-4310-ad87-ef754b58b12a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:59.302293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a726ebfc-1cb2-4310-ad87-ef754b58b12a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:59.628141 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a726ebfc-1cb2-4310-ad87-ef754b58b12a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 296 microversion: 2.1 time: 0.350269 Jul 14 14:25:59.630695 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 65/136] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:25:59 2022] POST /compute/v2.1/os-aggregates/2/action => generated 296 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:59.651525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f1b72517-0e24-4b95-a0fd-0691938aa85e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:59.654974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f1b72517-0e24-4b95-a0fd-0691938aa85e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:25:59.688013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1b72517-0e24-4b95-a0fd-0691938aa85e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:59.689535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1b72517-0e24-4b95-a0fd-0691938aa85e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:25:59.691401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1b72517-0e24-4b95-a0fd-0691938aa85e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:25:59.693065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1b72517-0e24-4b95-a0fd-0691938aa85e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:00.091842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f1b72517-0e24-4b95-a0fd-0691938aa85e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:00.100810 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f1b72517-0e24-4b95-a0fd-0691938aa85e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1311 microversion: 2.1 time: 0.465617 Jul 14 14:26:00.112909 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 66/137] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:25:59 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1311 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:00.118856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0fe86fc8-5912-413c-aee3-476741f86104 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:00.125954 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:00.125954 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:00.184376 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0fe86fc8-5912-413c-aee3-476741f86104 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.069232 Jul 14 14:26:00.188512 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 67/138] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:00 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:00.198625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d6c918ec-e557-4e2e-be3e-ce5de3b8fe43 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:00.201915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d6c918ec-e557-4e2e-be3e-ce5de3b8fe43 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:00.220006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6c918ec-e557-4e2e-be3e-ce5de3b8fe43 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:00.220811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6c918ec-e557-4e2e-be3e-ce5de3b8fe43 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:00.222023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6c918ec-e557-4e2e-be3e-ce5de3b8fe43 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:00.222801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6c918ec-e557-4e2e-be3e-ce5de3b8fe43 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:00.343569 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-181fa7bc-9be3-46d4-9df8-f28000419f57 tempest-SecurityGroupsTestAdminJSON-922826509 tempest-SecurityGroupsTestAdminJSON-922826509-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/201f3238-3509-4658-a84d-a36b1f52920b" status: 202 len: 0 microversion: 2.1 time: 1.150114 Jul 14 14:26:00.344643 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 72/139] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:25:59 2022] DELETE /compute/v2.1/os-security-groups/201f3238-3509-4658-a84d-a36b1f52920b => generated 0 bytes in 1152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:26:00.349692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b93d84e-e5d9-4caf-a21d-a3c2081bfaee tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-158683285"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:00.351391 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:00.351391 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:00.355224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.aggregate [None req-0b93d84e-e5d9-4caf-a21d-a3c2081bfaee tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Generated uuid 5e460ea9-93de-4abc-9897-f0478268c068 for aggregate {{(pid=119512) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:00.408234 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0b93d84e-e5d9-4caf-a21d-a3c2081bfaee tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.060765 Jul 14 14:26:00.412539 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 73/140] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:00 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:00.425541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-724b7674-7d0e-4610-bbab-3fbab4dd6fd7 tempest-SecurityGroupsTestAdminJSON-922826509 tempest-SecurityGroupsTestAdminJSON-922826509-project] Calling method '.version_select at 0x7fd6c6862ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:00.482445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d6c918ec-e557-4e2e-be3e-ce5de3b8fe43 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:00.489955 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d6c918ec-e557-4e2e-be3e-ce5de3b8fe43 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1590 microversion: 2.1 time: 0.299336 Jul 14 14:26:00.490705 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 68/141] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:00 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1590 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:00.500340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44d09b77-9134-4620-9af1-eb4cca14a6fe tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-767704-28"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:00.503670 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:00.503670 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:00.516301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44d09b77-9134-4620-9af1-eb4cca14a6fe tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:00.517179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44d09b77-9134-4620-9af1-eb4cca14a6fe tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:00.684771 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-44d09b77-9134-4620-9af1-eb4cca14a6fe tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.192757 Jul 14 14:26:00.686704 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 69/142] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:00 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:00.693126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-08681627-c38a-4444-b023-1d4417ced94e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:00.693695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-08681627-c38a-4444-b023-1d4417ced94e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:00.704468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08681627-c38a-4444-b023-1d4417ced94e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:00.704992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08681627-c38a-4444-b023-1d4417ced94e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:00.705789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08681627-c38a-4444-b023-1d4417ced94e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:00.707020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08681627-c38a-4444-b023-1d4417ced94e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:00.774888 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-724b7674-7d0e-4610-bbab-3fbab4dd6fd7 tempest-SecurityGroupsTestAdminJSON-922826509 tempest-SecurityGroupsTestAdminJSON-922826509-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/bd84d70c-9fb1-4c9d-9cf5-9b46cbccac20" status: 202 len: 0 microversion: 2.1 time: 0.360969 Jul 14 14:26:00.776296 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 74/143] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:26:00 2022] DELETE /compute/v2.1/os-security-groups/bd84d70c-9fb1-4c9d-9cf5-9b46cbccac20 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:26:00.783821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4ee2f289-2451-481a-9994-27730a5e09ed tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:00.784903 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:00.784903 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:00.800694 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4ee2f289-2451-481a-9994-27730a5e09ed tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.023197 Jul 14 14:26:00.807052 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 75/144] 10.222.0.81 () {58 vars in 1148 bytes} [Thu Jul 14 14:26:00 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:00.812918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f70743b7-05dc-4c86-8f7a-bdf95857d792 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-767704-28"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:00.814191 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:00.814191 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:00.840214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f70743b7-05dc-4c86-8f7a-bdf95857d792 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:00.840957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f70743b7-05dc-4c86-8f7a-bdf95857d792 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:01.014945 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-08681627-c38a-4444-b023-1d4417ced94e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.326639 Jul 14 14:26:01.015626 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 70/145] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:26:00 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49/os-interface => generated 284 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:01.033562 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f70743b7-05dc-4c86-8f7a-bdf95857d792 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.225128 Jul 14 14:26:01.034585 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 76/146] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:00 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:26:01.074683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2e9c71c6-d329-4fbd-a8f7-0655a17dda9b tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:01.080225 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:01.080225 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:01.125184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3318a31b-5b9f-4a52-a464-dede10e5d07a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:01.126290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3318a31b-5b9f-4a52-a464-dede10e5d07a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:01.152388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3318a31b-5b9f-4a52-a464-dede10e5d07a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:01.152858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3318a31b-5b9f-4a52-a464-dede10e5d07a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:01.157615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3318a31b-5b9f-4a52-a464-dede10e5d07a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:01.158083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3318a31b-5b9f-4a52-a464-dede10e5d07a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:01.159667 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2e9c71c6-d329-4fbd-a8f7-0655a17dda9b tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.117182 Jul 14 14:26:01.162437 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 71/147] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:01 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:01.172343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1ddbf40a-6c9c-4372-b335-4b3004cd9435 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-769444147"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:01.174576 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:01.174576 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:01.175543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.aggregate [None req-1ddbf40a-6c9c-4372-b335-4b3004cd9435 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Generated uuid 4a48b602-8145-4582-abff-ab480c8a9877 for aggregate {{(pid=119511) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:01.205568 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1ddbf40a-6c9c-4372-b335-4b3004cd9435 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.037786 Jul 14 14:26:01.213511 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 72/148] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:01 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:26:01.222037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c4700f1a-5fb0-4041-98f3-ad429ce960c5 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-767704-28"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:01.229462 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:01.229462 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:01.259936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4700f1a-5fb0-4041-98f3-ad429ce960c5 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:01.261608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4700f1a-5fb0-4041-98f3-ad429ce960c5 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:01.471618 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c4700f1a-5fb0-4041-98f3-ad429ce960c5 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.256792 Jul 14 14:26:01.472226 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 73/149] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:01 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:01.483498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c8412706-ca53-41cc-bc71-016e6c16e930 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:01.484266 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:01.484266 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:01.516616 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c8412706-ca53-41cc-bc71-016e6c16e930 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.030406 Jul 14 14:26:01.518526 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 74/150] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:26:01 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:26:01.563182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3999f6a2-434b-4706-9564-0a4fdecaa2da tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-767704-28"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:01.570608 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:01.570608 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:01.611087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3999f6a2-434b-4706-9564-0a4fdecaa2da tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:01.613336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3999f6a2-434b-4706-9564-0a4fdecaa2da tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:01.845793 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3999f6a2-434b-4706-9564-0a4fdecaa2da tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.310484 Jul 14 14:26:01.858144 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 75/151] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:01 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:01.871655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5c27d231-1229-4ca0-8f9f-79a877ce3afd tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:01.872509 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:01.872509 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:01.884959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3318a31b-5b9f-4a52-a464-dede10e5d07a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:01.892810 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3318a31b-5b9f-4a52-a464-dede10e5d07a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1311 microversion: 2.1 time: 0.772487 Jul 14 14:26:01.897495 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 77/152] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:01 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1311 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:01.930574 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5c27d231-1229-4ca0-8f9f-79a877ce3afd tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.067621 Jul 14 14:26:01.931603 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 76/153] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:01 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:01.943951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8ba66a9b-1083-4f26-84ab-96afd76b8a3b tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1027759348"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:01.945550 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:01.945550 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:01.946486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.aggregate [None req-8ba66a9b-1083-4f26-84ab-96afd76b8a3b tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Generated uuid 99a46c63-44a3-4341-a385-40f8f89d6cce for aggregate {{(pid=119512) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:01.997394 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8ba66a9b-1083-4f26-84ab-96afd76b8a3b tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057221 Jul 14 14:26:02.002308 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 78/154] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:02.014130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-22d2233d-84c2-4c3d-bff0-a86c62b48ccb tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-767704-28"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:02.018632 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:02.018632 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:02.034619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-22d2233d-84c2-4c3d-bff0-a86c62b48ccb tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:02.035634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-22d2233d-84c2-4c3d-bff0-a86c62b48ccb tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:02.211393 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-22d2233d-84c2-4c3d-bff0-a86c62b48ccb tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.205117 Jul 14 14:26:02.215293 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 77/155] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:02 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:02.222624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-df6318e2-cb12-4f0d-acd7-bef33d0d482a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-767704-28"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:02.224562 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:02.224562 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:02.241210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df6318e2-cb12-4f0d-acd7-bef33d0d482a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:02.241816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df6318e2-cb12-4f0d-acd7-bef33d0d482a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:02.435516 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-df6318e2-cb12-4f0d-acd7-bef33d0d482a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.216661 Jul 14 14:26:02.436726 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 79/156] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:02 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:02.447955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0de56667-e5c8-4daf-99c6-ada39c55e805 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:02.449367 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:02.449367 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:02.496892 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0de56667-e5c8-4daf-99c6-ada39c55e805 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.053947 Jul 14 14:26:02.504163 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 78/157] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:02 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:02.513082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4768ef74-145e-4ac2-81aa-91cf8fe9649c tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1487547993"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:02.515408 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:02.515408 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:02.516426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.aggregate [None req-4768ef74-145e-4ac2-81aa-91cf8fe9649c tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Generated uuid 90fe340c-d8d5-4afc-8756-ab5c977b82a0 for aggregate {{(pid=119512) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:02.545830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-894dc3a2-2244-4dc5-b5d6-3baec5b07352 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-310120897"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:02.554976 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:02.554976 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:02.556372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.aggregate [None req-894dc3a2-2244-4dc5-b5d6-3baec5b07352 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Generated uuid 7bbe1665-65fe-442d-a2da-4e2422c9337e for aggregate {{(pid=119511) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:02.577429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4768ef74-145e-4ac2-81aa-91cf8fe9649c tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.070102 Jul 14 14:26:02.586020 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 80/158] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:02.596084 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-894dc3a2-2244-4dc5-b5d6-3baec5b07352 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053897 Jul 14 14:26:02.603427 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 79/159] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:02 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:26:02.609755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f335fe92-3eed-4f6f-8123-c54b01084f00 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-767704-28"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:02.611285 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:02.611285 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:02.611611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9c16684d-9a96-4db5-8727-cd4909afa302 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:02.612899 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:02.612899 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:02.621716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f335fe92-3eed-4f6f-8123-c54b01084f00 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:02.622410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f335fe92-3eed-4f6f-8123-c54b01084f00 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:02.672005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=10,nova_api:INSERT=5 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:02.672673 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9c16684d-9a96-4db5-8727-cd4909afa302 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.084338 Jul 14 14:26:02.673692 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 81/160] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:02 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:02.691913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-95fd9a59-ab29-44b4-a2c0-8dab60c5254f tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:02.692852 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:02.692852 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:02.717070 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-95fd9a59-ab29-44b4-a2c0-8dab60c5254f tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-95fd9a59-ab29-44b4-a2c0-8dab60c5254f tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Request method failure captured: Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdDsC7_kA5kltumr2rujjNSDTrRUsQFwC06CwPTm-luZD6L1QJvdvkmpF1eiR0UCNjz-nJxaiJVMP2bPzM8D3m1L0oAvOqsu2Q4OewpSZ5ddwBG5sfT7QHWuYGGslYiEDqvqQ040oSFzZcuPD9uA93eQg7VwILPNljreVW3iQgfVjI Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: cf56d0d8d3e94860b425e2f82a93e5d2 Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminTestJSON-88434763 Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:26:02.731347 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf56d0d8d3e94860b425e2f82a93e5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf56d0d8d3e94860b425e2f82a93e5d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf56d0d8d3e94860b425e2f82a93e5d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf56d0d8d3e94860b425e2f82a93e5d2"}]}] Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminTestJSON-88434763 Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: cf56d0d8d3e94860b425e2f82a93e5d2 Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-88434763 Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminTestJSON-88434763-project-admin Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 43b056f2878f4c8fb653ca5045b08625 Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminTestJSON-88434763-project-admin Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: exception: Aggregate 6 could not be found. Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6'} Jul 14 14:26:02.732889 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:02.733795 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jul 14 14:26:02.735015 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:02.739451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-95fd9a59-ab29-44b4-a2c0-8dab60c5254f tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:02.740579 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-95fd9a59-ab29-44b4-a2c0-8dab60c5254f tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.062191 Jul 14 14:26:02.745814 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 82/161] 10.222.0.81 () {58 vars in 1148 bytes} [Thu Jul 14 14:26:02 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:26:02.759353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37bba618-9c17-4398-88fd-01cf87828b1a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:02.761672 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:02.761672 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:02.811577 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-37bba618-9c17-4398-88fd-01cf87828b1a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37bba618-9c17-4398-88fd-01cf87828b1a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Request method failure captured: Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdDsC7_kA5kltumr2rujjNSDTrRUsQFwC06CwPTm-luZD6L1QJvdvkmpF1eiR0UCNjz-nJxaiJVMP2bPzM8D3m1L0oAvOqsu2Q4OewpSZ5ddwBG5sfT7QHWuYGGslYiEDqvqQ040oSFzZcuPD9uA93eQg7VwILPNljreVW3iQgfVjI Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: cf56d0d8d3e94860b425e2f82a93e5d2 Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminTestJSON-88434763 Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:26:02.813769 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf56d0d8d3e94860b425e2f82a93e5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf56d0d8d3e94860b425e2f82a93e5d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf56d0d8d3e94860b425e2f82a93e5d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf56d0d8d3e94860b425e2f82a93e5d2"}]}] Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminTestJSON-88434763 Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: cf56d0d8d3e94860b425e2f82a93e5d2 Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-88434763 Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminTestJSON-88434763-project-admin Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 43b056f2878f4c8fb653ca5045b08625 Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminTestJSON-88434763-project-admin Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: exception: Aggregate 6 could not be found. Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6'} Jul 14 14:26:02.815330 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:26:02.816183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:02.817470 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:02.820604 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:02.820604 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:02.820604 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:02.820604 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jul 14 14:26:02.820604 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:02.820604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37bba618-9c17-4398-88fd-01cf87828b1a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:02.820604 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-37bba618-9c17-4398-88fd-01cf87828b1a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.069586 Jul 14 14:26:02.830349 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 83/162] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:02 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:26:02.841977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8ae0d459-ec08-44b3-801a-f780ce8afa6b tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1208617017", "name": "tempest-test_aggregate-782393377"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:02.897711 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:02.897711 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:02.903765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.aggregate [None req-8ae0d459-ec08-44b3-801a-f780ce8afa6b tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Generated uuid 96eabb6a-21aa-474d-9b09-b8a2723e698e for aggregate {{(pid=119512) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:02.924217 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f335fe92-3eed-4f6f-8123-c54b01084f00 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.319375 Jul 14 14:26:02.925197 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 80/163] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:02 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:02.946005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9cdcc352-48b8-4503-b119-6215f15fcbcb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:02.950163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9cdcc352-48b8-4503-b119-6215f15fcbcb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:02.977136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cdcc352-48b8-4503-b119-6215f15fcbcb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:02.977751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cdcc352-48b8-4503-b119-6215f15fcbcb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:02.985911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cdcc352-48b8-4503-b119-6215f15fcbcb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:02.986479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cdcc352-48b8-4503-b119-6215f15fcbcb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:02.988446 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8ae0d459-ec08-44b3-801a-f780ce8afa6b tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.154469 Jul 14 14:26:02.994340 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 84/164] 10.222.0.81 () {60 vars in 1164 bytes} [Thu Jul 14 14:26:02 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:03.005312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-360be5d2-5d5d-48d9-90df-41010a86eacf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-767704-28"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:03.006882 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:03.006882 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:03.027701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-360be5d2-5d5d-48d9-90df-41010a86eacf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:03.031602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-360be5d2-5d5d-48d9-90df-41010a86eacf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:03.079988 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-360be5d2-5d5d-48d9-90df-41010a86eacf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h2-767704-28. Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-360be5d2-5d5d-48d9-90df-41010a86eacf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Request method failure captured: Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 40 Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdDMY-EWeEPeZyv7kMHLzhOirtOwkrMQDbd56KqfskRfEacm1Ty68WEOzXKXUBMkcMrh2vT_085m0vcgRHTQ8TMt5RpMrn3O10inNmwLGCwxkC-rjIILJh4Gzw33FMTq2tCHMUhtNlYkZ2blzgkYczy28m4VXVJaoFeIO9UL_48eIk Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:26:03.105733 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9e3720941eec4a67932ed626f180fa1e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}] Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: b7fb4e8411814741968d6eb6112ff981 Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: {"add_host": {"host": "n-h2-767704-28"}} Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:03.107336 n-d-767704-28 devstack@n-api.service[119512]: exception: Aggregate 7 already has host n-h2-767704-28. Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h2-767704-28'}}} Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result.read() Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:26:03.108203 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-767704-28-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi session.flush() Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 14:26:03.109664 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 14:26:03.110927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:26:03.112145 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result.read() Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-767704-28-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 14, 14, 26, 3, 71574), 'updated_at': None, 'host': 'n-h2-767704-28', 'aggregate_id': 7}] Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:03.113297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h2-767704-28. Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.114328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h2-767704-28. Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:03.115586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:03.119783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h2-767704-28. Jul 14 14:26:03.119783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.120383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-360be5d2-5d5d-48d9-90df-41010a86eacf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Returning 409 to user: Aggregate 7 already has host n-h2-767704-28. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:03.121446 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-360be5d2-5d5d-48d9-90df-41010a86eacf tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 96 microversion: 2.1 time: 0.125772 Jul 14 14:26:03.122536 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 85/165] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:02 2022] POST /compute/v2.1/os-aggregates/7/action => generated 96 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 14 14:26:03.127553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-88f4fb78-1565-477c-b786-c5f280edd16e tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:03.129248 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:03.129248 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:03.165187 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-88f4fb78-1565-477c-b786-c5f280edd16e tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.039623 Jul 14 14:26:03.166418 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 86/166] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:03 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:03.183842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e9107431-3326-4af0-a762-191a3e977377 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-767704-28"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:03.185771 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:03.185771 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:03.198620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:03.200216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9107431-3326-4af0-a762-191a3e977377 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:03.200712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9107431-3326-4af0-a762-191a3e977377 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:03.370024 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e9107431-3326-4af0-a762-191a3e977377 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.202211 Jul 14 14:26:03.370661 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 87/167] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:03 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:03.382081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7c5dd5bb-e6a7-4310-ba85-b33659d88c49 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:03.382280 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:03.382280 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:03.404513 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-7c5dd5bb-e6a7-4310-ba85-b33659d88c49 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7c5dd5bb-e6a7-4310-ba85-b33659d88c49 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Request method failure captured: Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdDsC7_kA5kltumr2rujjNSDTrRUsQFwC06CwPTm-luZD6L1QJvdvkmpF1eiR0UCNjz-nJxaiJVMP2bPzM8D3m1L0oAvOqsu2Q4OewpSZ5ddwBG5sfT7QHWuYGGslYiEDqvqQ040oSFzZcuPD9uA93eQg7VwILPNljreVW3iQgfVjI Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: cf56d0d8d3e94860b425e2f82a93e5d2 Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminTestJSON-88434763 Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:26:03.409633 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf56d0d8d3e94860b425e2f82a93e5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf56d0d8d3e94860b425e2f82a93e5d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf56d0d8d3e94860b425e2f82a93e5d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf56d0d8d3e94860b425e2f82a93e5d2"}]}] Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminTestJSON-88434763 Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: cf56d0d8d3e94860b425e2f82a93e5d2 Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-88434763 Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminTestJSON-88434763-project-admin Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 43b056f2878f4c8fb653ca5045b08625 Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminTestJSON-88434763-project-admin Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: exception: Aggregate 8 could not be found. Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '8'} Jul 14 14:26:03.411238 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:03.412067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.413268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7c5dd5bb-e6a7-4310-ba85-b33659d88c49 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:03.418290 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7c5dd5bb-e6a7-4310-ba85-b33659d88c49 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.038967 Jul 14 14:26:03.419952 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 88/168] 10.222.0.81 () {58 vars in 1148 bytes} [Thu Jul 14 14:26:03 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:26:03.431712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-02889808-a321-4236-bbbf-5abd9635b880 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:03.432060 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:03.432060 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:03.488968 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-02889808-a321-4236-bbbf-5abd9635b880 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.067473 Jul 14 14:26:03.494822 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 89/169] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:03 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:03.501979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b170623-49bc-4771-9681-ca7ae2cbe5a9 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:03.506626 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:03.506626 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:03.546756 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3b170623-49bc-4771-9681-ca7ae2cbe5a9 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b170623-49bc-4771-9681-ca7ae2cbe5a9 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Request method failure captured: Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdDsC7_kA5kltumr2rujjNSDTrRUsQFwC06CwPTm-luZD6L1QJvdvkmpF1eiR0UCNjz-nJxaiJVMP2bPzM8D3m1L0oAvOqsu2Q4OewpSZ5ddwBG5sfT7QHWuYGGslYiEDqvqQ040oSFzZcuPD9uA93eQg7VwILPNljreVW3iQgfVjI Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: cf56d0d8d3e94860b425e2f82a93e5d2 Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminTestJSON-88434763 Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:26:03.548550 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf56d0d8d3e94860b425e2f82a93e5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cf56d0d8d3e94860b425e2f82a93e5d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cf56d0d8d3e94860b425e2f82a93e5d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cf56d0d8d3e94860b425e2f82a93e5d2"}]}] Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminTestJSON-88434763 Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: cf56d0d8d3e94860b425e2f82a93e5d2 Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-88434763 Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminTestJSON-88434763-project-admin Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 43b056f2878f4c8fb653ca5045b08625 Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminTestJSON-88434763-project-admin Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: exception: Aggregate 8 could not be found. Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '8'} Jul 14 14:26:03.550019 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:26:03.550714 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:03.551681 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:03.552771 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:03.552771 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:03.552771 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:03.552771 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Jul 14 14:26:03.552771 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:03.552771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b170623-49bc-4771-9681-ca7ae2cbe5a9 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:03.557478 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b170623-49bc-4771-9681-ca7ae2cbe5a9 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.064713 Jul 14 14:26:03.566024 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 90/170] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:03 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:26:03.575964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fe1d239d-4fb5-41e1-990d-eab3b0b60200 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-34390728"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:03.575964 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:03.575964 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:03.575964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.aggregate [None req-fe1d239d-4fb5-41e1-990d-eab3b0b60200 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Generated uuid f13816ac-de01-4a8d-b83c-07e69c7e4048 for aggregate {{(pid=119512) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:03.621348 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fe1d239d-4fb5-41e1-990d-eab3b0b60200 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.056628 Jul 14 14:26:03.622085 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 91/171] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:03 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:03.628192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-558c7db3-93c1-4ca5-a838-1fa57414a782 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Calling method '.version_select at 0x7fd6c6555ee0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:03.630272 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:03.630272 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:03.631781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-558c7db3-93c1-4ca5-a838-1fa57414a782 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:03.632087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-558c7db3-93c1-4ca5-a838-1fa57414a782 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:03.635224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-558c7db3-93c1-4ca5-a838-1fa57414a782 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:03.635686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-558c7db3-93c1-4ca5-a838-1fa57414a782 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:03.712406 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-558c7db3-93c1-4ca5-a838-1fa57414a782 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.088966 Jul 14 14:26:03.722895 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 92/172] 10.222.0.81 () {58 vars in 1127 bytes} [Thu Jul 14 14:26:03 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:03.732070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65a6e11d-b5b2-4de9-9600-fb9aa115a5e7 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1367995239"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:03.736775 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:03.736775 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:03.738286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.aggregate [None req-65a6e11d-b5b2-4de9-9600-fb9aa115a5e7 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Generated uuid 6f80cde2-c149-4ac3-a793-d7873914583e for aggregate {{(pid=119512) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:03.769296 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65a6e11d-b5b2-4de9-9600-fb9aa115a5e7 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.041257 Jul 14 14:26:03.775786 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 93/173] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:03 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:03.802321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9cdcc352-48b8-4503-b119-6215f15fcbcb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:03.814073 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9cdcc352-48b8-4503-b119-6215f15fcbcb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1311 microversion: 2.1 time: 0.879459 Jul 14 14:26:03.815978 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 81/174] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:02 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1311 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:03.823136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7da623bb-f4f1-45c5-a4cb-f7468267a550 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Calling method '.version_select at 0x7fd6c6610700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:03.825718 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:03.825718 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:03.827357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7da623bb-f4f1-45c5-a4cb-f7468267a550 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:03.828024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7da623bb-f4f1-45c5-a4cb-f7468267a550 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:03.829116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7da623bb-f4f1-45c5-a4cb-f7468267a550 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:03.833726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7da623bb-f4f1-45c5-a4cb-f7468267a550 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:03.931260 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7da623bb-f4f1-45c5-a4cb-f7468267a550 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.105848 Jul 14 14:26:03.932530 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 82/175] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:26:03 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:03.948920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf9a004d-11a5-46d4-875a-2aa55779e073 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:03.950997 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:03.950997 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:03.970820 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf9a004d-11a5-46d4-875a-2aa55779e073 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 228 microversion: 2.1 time: 0.036976 Jul 14 14:26:03.971823 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 83/176] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:03 2022] GET /compute/v2.1/os-aggregates/10 => generated 228 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:03.990012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f47cc3a9-4942-416c-8432-a32f3c51bdfc tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Calling method '.version_select at 0x7fd6c6748940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:03.992462 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:03.992462 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:03.994922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f47cc3a9-4942-416c-8432-a32f3c51bdfc tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:03.998837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f47cc3a9-4942-416c-8432-a32f3c51bdfc tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:03.999913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f47cc3a9-4942-416c-8432-a32f3c51bdfc tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:04.000414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f47cc3a9-4942-416c-8432-a32f3c51bdfc tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:04.057523 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f47cc3a9-4942-416c-8432-a32f3c51bdfc tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.083430 Jul 14 14:26:04.067691 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 84/177] 10.222.0.81 () {58 vars in 1127 bytes} [Thu Jul 14 14:26:03 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:04.082953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d0107a06-f38b-4c2a-9895-c1daa7a6348b tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:04.085073 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.085073 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:04.147899 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d0107a06-f38b-4c2a-9895-c1daa7a6348b tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 266 microversion: 2.1 time: 0.085441 Jul 14 14:26:04.149017 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 85/178] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:26:04 2022] POST /compute/v2.1/os-aggregates/10/action => generated 266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:04.162662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3fdf0083-9820-4848-9666-8a155b1c1bf4 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-767704-28"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:04.166160 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.166160 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:04.167482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3fdf0083-9820-4848-9666-8a155b1c1bf4 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'de23236b13d344bca4b564295f463f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbb8886230d413fb991c85c5c692a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:04.171765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9b15f63f-f24f-4aad-b451-5fab7f7276a7 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Calling method '.version_select at 0x7fd6c66105e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:04.172976 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.172976 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3fdf0083-9820-4848-9666-8a155b1c1bf4 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Request method failure captured: Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 40 Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdA_ep6yMFYUCVc-Y_NnzGiGlOeM2eeqRRbtz0jTh0L-o8qUmRAEI7Wp2v-B5Vr6hSRCyZHpHSbKqhun8bNPb45GY2mR3IX0mwfeDR13myIW60E_F4qJl5Ql-epK5BjmaxApDyTPnKgVDwfuk1F8kUNuMSANAUscwQsx-V1jfGk53g Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3fbb8886230d413fb991c85c5c692a56 Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:26:04.173214 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3fbb8886230d413fb991c85c5c692a56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3fbb8886230d413fb991c85c5c692a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3fbb8886230d413fb991c85c5c692a56", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3fbb8886230d413fb991c85c5c692a56"}]}] Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3fbb8886230d413fb991c85c5c692a56 Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminNegativeTestJSON-1239802778-project Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: de23236b13d344bca4b564295f463f35 Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778-project Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: {"add_host": {"host": "n-h2-767704-28"}} Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:04.174866 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h2-767704-28'}}} Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:04.175838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 14 14:26:04.177231 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.179932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3fdf0083-9820-4848-9666-8a155b1c1bf4 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:04.183620 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3fdf0083-9820-4848-9666-8a155b1c1bf4 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] 10.222.0.81 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.412282 Jul 14 14:26:04.184207 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 94/179] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:03 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 413 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:04.194024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b15f63f-f24f-4aad-b451-5fab7f7276a7 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:04.195645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b15f63f-f24f-4aad-b451-5fab7f7276a7 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:04.196096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab6d569c-ec93-401c-978a-a54bb74c9fdf tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:04.197151 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.197151 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:04.210055 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ab6d569c-ec93-401c-978a-a54bb74c9fdf tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 242 microversion: 2.1 time: 0.023349 Jul 14 14:26:04.215714 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 95/180] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:04 2022] GET /compute/v2.1/os-aggregates/10 => generated 242 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:04.220572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-989106b8-784c-490f-b655-15f246d22a9c tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:04.224150 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.224150 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:04.229542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b15f63f-f24f-4aad-b451-5fab7f7276a7 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:04.230431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b15f63f-f24f-4aad-b451-5fab7f7276a7 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:04.255215 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9b15f63f-f24f-4aad-b451-5fab7f7276a7 tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts/n-h2-767704-28" status: 200 len: 335 microversion: 2.1 time: 0.104817 Jul 14 14:26:04.259435 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 86/181] 10.222.0.81 () {58 vars in 1172 bytes} [Thu Jul 14 14:26:04 2022] GET /compute/v2.1/os-hosts/n-h2-767704-28 => generated 335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:04.266498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3113df67-ca64-4df5-bcd8-78f1a7b9d188 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:04.272620 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.272620 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:04.279429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-989106b8-784c-490f-b655-15f246d22a9c tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.061846 Jul 14 14:26:04.284181 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 96/182] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:04 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:04.290823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f33b1d32-6bd2-4cd3-a384-52c0e5075c1f tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Calling method '.version_select at 0x7fd6c639fd30>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:04.303759 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.303759 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:04.310825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f33b1d32-6bd2-4cd3-a384-52c0e5075c1f tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:04.313526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f33b1d32-6bd2-4cd3-a384-52c0e5075c1f tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:04.345044 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3113df67-ca64-4df5-bcd8-78f1a7b9d188 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.083231 Jul 14 14:26:04.345897 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 87/183] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:26:04 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:04.362273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-09c13192-924d-4298-922c-311b9a0fdfba tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1916345519"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:04.363914 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.363914 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:04.366082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.aggregate [None req-09c13192-924d-4298-922c-311b9a0fdfba tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Generated uuid 4f1129d7-fe5b-4ae9-b0b4-7f7723eadcaf for aggregate {{(pid=119511) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:04.367570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f33b1d32-6bd2-4cd3-a384-52c0e5075c1f tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:04.370218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f33b1d32-6bd2-4cd3-a384-52c0e5075c1f tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:04.425312 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f33b1d32-6bd2-4cd3-a384-52c0e5075c1f tempest-HostsAdminTestJSON-1556794480 tempest-HostsAdminTestJSON-1556794480-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts/n-h1-767704-28" status: 200 len: 603 microversion: 2.1 time: 0.139672 Jul 14 14:26:04.428009 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 97/184] 10.222.0.81 () {58 vars in 1172 bytes} [Thu Jul 14 14:26:04 2022] GET /compute/v2.1/os-hosts/n-h1-767704-28 => generated 603 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:04.433908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6861127b-ea71-49fd-b0c6-9caa37af171e tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1254243799", "availability_zone": "tempest-test_az-992495380"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:04.444206 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.444206 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:04.450668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.aggregate [None req-6861127b-ea71-49fd-b0c6-9caa37af171e tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Generated uuid 6883c45a-658d-4f08-8e27-2a69f5e90330 for aggregate {{(pid=119512) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:04.472286 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-09c13192-924d-4298-922c-311b9a0fdfba tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.116384 Jul 14 14:26:04.479493 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 88/185] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:04 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:04.499759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-120ef087-671c-4311-9e96-64d78f2dd9f1 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-605403890"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:04.506924 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6861127b-ea71-49fd-b0c6-9caa37af171e tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.077373 Jul 14 14:26:04.511063 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 98/186] 10.222.0.81 () {60 vars in 1164 bytes} [Thu Jul 14 14:26:04 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:04.518786 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.518786 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:04.521435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8988949-421d-4178-a3f2-faf1c0e0717a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1254243799_new", "availability_zone": "tempest-test_az-992495380_new"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:04.524883 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.524883 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:04.557148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-120ef087-671c-4311-9e96-64d78f2dd9f1 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:04.557705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-120ef087-671c-4311-9e96-64d78f2dd9f1 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:04.587516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-120ef087-671c-4311-9e96-64d78f2dd9f1 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:04.589107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-120ef087-671c-4311-9e96-64d78f2dd9f1 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:04.606398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8988949-421d-4178-a3f2-faf1c0e0717a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:04.618582 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-120ef087-671c-4311-9e96-64d78f2dd9f1 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-605403890 could not be found. Jul 14 14:26:04.623926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8988949-421d-4178-a3f2-faf1c0e0717a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-120ef087-671c-4311-9e96-64d78f2dd9f1 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Request method failure captured: Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 57 Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdDMY-EWeEPeZyv7kMHLzhOirtOwkrMQDbd56KqfskRfEacm1Ty68WEOzXKXUBMkcMrh2vT_085m0vcgRHTQ8TMt5RpMrn3O10inNmwLGCwxkC-rjIILJh4Gzw33FMTq2tCHMUhtNlYkZ2blzgkYczy28m4VXVJaoFeIO9UL_48eIk Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:26:04.642140 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9e3720941eec4a67932ed626f180fa1e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}] Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: b7fb4e8411814741968d6eb6112ff981 Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: {"add_host": {"host": "tempest-nonexist_host-605403890"}} Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:26:04.643857 n-d-767704-28 devstack@n-api.service[119511]: exception: Compute host tempest-nonexist_host-605403890 could not be found. Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-605403890'}}} Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-605403890' is not mapped to any cell Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:04.645373 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 14 14:26:04.646953 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-605403890 could not be found. Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-605403890 could not be found. Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:04.649613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.651466 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:04.651466 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:04.651466 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:04.651466 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:04.651466 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:04.651466 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-605403890 could not be found. Jul 14 14:26:04.651466 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.651466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-120ef087-671c-4311-9e96-64d78f2dd9f1 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-605403890 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:04.651466 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-120ef087-671c-4311-9e96-64d78f2dd9f1 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.164601 Jul 14 14:26:04.663951 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 89/187] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:26:04 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:04.686873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf69b9d7-915c-479d-8cc4-457815daa598 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:04.690801 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.690801 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:04.766387 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf69b9d7-915c-479d-8cc4-457815daa598 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.094082 Jul 14 14:26:04.777545 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 90/188] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:26:04 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:04.780607 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8988949-421d-4178-a3f2-faf1c0e0717a tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 335 microversion: 2.1 time: 0.259454 Jul 14 14:26:04.784438 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 99/189] 10.222.0.81 () {60 vars in 1172 bytes} [Thu Jul 14 14:26:04 2022] PUT /compute/v2.1/os-aggregates/12 => generated 335 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:04.793652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3362c0cb-9352-499c-b729-54972830f184 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:04.794447 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.794447 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:04.808801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8c9d2959-2069-4d31-ac6b-efd73fc6fb7c tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:04.827063 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3362c0cb-9352-499c-b729-54972830f184 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.038600 Jul 14 14:26:04.841076 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 100/190] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:26:04 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8c9d2959-2069-4d31-ac6b-efd73fc6fb7c tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Request method failure captured: Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 283 Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdDMY-EWeEPeZyv7kMHLzhOirtOwkrMQDbd56KqfskRfEacm1Ty68WEOzXKXUBMkcMrh2vT_085m0vcgRHTQ8TMt5RpMrn3O10inNmwLGCwxkC-rjIILJh4Gzw33FMTq2tCHMUhtNlYkZ2blzgkYczy28m4VXVJaoFeIO9UL_48eIk Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:26:04.845437 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:26:04.846923 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9e3720941eec4a67932ed626f180fa1e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}] Jul 14 14:26:04.846923 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:04.846923 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:04.846923 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:04.846923 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:04.846923 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:26:04.846923 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:26:04.846923 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: b7fb4e8411814741968d6eb6112ff981 Jul 14 14:26:04.846923 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:04.846923 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:26:04.846923 n-d-767704-28 devstack@n-api.service[119511]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 14 14:26:04.847655 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:26:04.847655 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:26:04.847655 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 14 14:26:04.847655 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:04.847655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:04.847655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:26:04.847655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:26:04.847655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:26:04.847655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:26:04.847655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:26:04.847655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:26:04.848429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:26:04.849773 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:26:04.850649 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:26:04.850649 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:04.850649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8c9d2959-2069-4d31-ac6b-efd73fc6fb7c tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:04.850889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8a9a1f3c-84b7-4c98-9056-a0194707baa7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:04.851530 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8c9d2959-2069-4d31-ac6b-efd73fc6fb7c tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.063203 Jul 14 14:26:04.851761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8a9a1f3c-84b7-4c98-9056-a0194707baa7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:04.862233 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 91/191] 10.222.0.81 () {60 vars in 1164 bytes} [Thu Jul 14 14:26:04 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:26:04.892069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a9a1f3c-84b7-4c98-9056-a0194707baa7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:04.892560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a9a1f3c-84b7-4c98-9056-a0194707baa7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:04.893394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a9a1f3c-84b7-4c98-9056-a0194707baa7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:04.893837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a9a1f3c-84b7-4c98-9056-a0194707baa7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:04.906003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45e78cb0-f1da-45ae-ba59-fb17c937a984 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:04.909136 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:04.909136 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:04.994770 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-45e78cb0-f1da-45ae-ba59-fb17c937a984 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.117123 Jul 14 14:26:04.995412 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 92/192] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:26:04 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:05.016673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0f67a1b9-743e-468f-8be9-a25e45452a73 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0f67a1b9-743e-468f-8be9-a25e45452a73 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Request method failure captured: Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 27 Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdDMY-EWeEPeZyv7kMHLzhOirtOwkrMQDbd56KqfskRfEacm1Ty68WEOzXKXUBMkcMrh2vT_085m0vcgRHTQ8TMt5RpMrn3O10inNmwLGCwxkC-rjIILJh4Gzw33FMTq2tCHMUhtNlYkZ2blzgkYczy28m4VXVJaoFeIO9UL_48eIk Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:26:05.021328 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9e3720941eec4a67932ed626f180fa1e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}] Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: b7fb4e8411814741968d6eb6112ff981 Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: {"aggregate": {"name": ""}} Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:26:05.022665 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi '' Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:05.023981 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:26:05.025265 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.027827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0f67a1b9-743e-468f-8be9-a25e45452a73 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:05.030077 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0f67a1b9-743e-468f-8be9-a25e45452a73 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.031123 Jul 14 14:26:05.031091 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 93/193] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:04 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:26:05.045559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c50fabdf-bf01-4c1b-baaf-0d2261b8cb3c tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-146233570"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:05.046925 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:05.046925 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:05.047822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.aggregate [None req-c50fabdf-bf01-4c1b-baaf-0d2261b8cb3c tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Generated uuid db419e0f-1635-442d-abe9-41babcb02342 for aggregate {{(pid=119511) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:05.117360 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c50fabdf-bf01-4c1b-baaf-0d2261b8cb3c tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082223 Jul 14 14:26:05.121436 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 94/194] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:05.136645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cdcb08bc-39f4-41be-9783-eb880b98d07c tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1409356660"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:05.140812 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:05.140812 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:05.143087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cdcb08bc-39f4-41be-9783-eb880b98d07c tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'de23236b13d344bca4b564295f463f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbb8886230d413fb991c85c5c692a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cdcb08bc-39f4-41be-9783-eb880b98d07c tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Request method failure captured: Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 60 Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdA_ep6yMFYUCVc-Y_NnzGiGlOeM2eeqRRbtz0jTh0L-o8qUmRAEI7Wp2v-B5Vr6hSRCyZHpHSbKqhun8bNPb45GY2mR3IX0mwfeDR13myIW60E_F4qJl5Ql-epK5BjmaxApDyTPnKgVDwfuk1F8kUNuMSANAUscwQsx-V1jfGk53g Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3fbb8886230d413fb991c85c5c692a56 Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:26:05.149216 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3fbb8886230d413fb991c85c5c692a56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3fbb8886230d413fb991c85c5c692a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3fbb8886230d413fb991c85c5c692a56", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3fbb8886230d413fb991c85c5c692a56"}]}] Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3fbb8886230d413fb991c85c5c692a56 Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AggregatesAdminNegativeTestJSON-1239802778-project Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: de23236b13d344bca4b564295f463f35 Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778-project Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: {"aggregate": {"name": "tempest-test_aggregate-1409356660"}} Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:26:05.150530 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1409356660'}}} Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:26:05.151299 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:26:05.152295 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 14 14:26:05.156475 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.156475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cdcb08bc-39f4-41be-9783-eb880b98d07c tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:05.156475 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cdcb08bc-39f4-41be-9783-eb880b98d07c tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.029061 Jul 14 14:26:05.160075 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 95/195] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:05 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:05.165824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0e068b8e-7330-462f-86b3-c49e038acf28 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:05.166706 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:05.166706 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:05.182660 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0e068b8e-7330-462f-86b3-c49e038acf28 tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.021186 Jul 14 14:26:05.183663 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 96/196] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:26:05 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:05.191862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-868d3e34-210f-4402-8fce-3e5756b984e2 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-273945032"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:05.195966 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:05.195966 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:05.201076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.aggregate [None req-868d3e34-210f-4402-8fce-3e5756b984e2 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Generated uuid 23f9b6e6-3c02-4efa-852f-170e2e06a66d for aggregate {{(pid=119511) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:05.261796 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-868d3e34-210f-4402-8fce-3e5756b984e2 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.076947 Jul 14 14:26:05.277642 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 97/197] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:05.291257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d29e1cc8-5ea4-4817-928d-077eb35a621e tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:05.292058 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:05.292058 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:05.344251 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d29e1cc8-5ea4-4817-928d-077eb35a621e tempest-AggregatesAdminTestJSON-88434763 tempest-AggregatesAdminTestJSON-88434763-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.057424 Jul 14 14:26:05.347091 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 98/198] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:26:05 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:05.370115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1d6d8260-016b-41f3-8dbf-3099502d537e tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-273945032"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:05.373729 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:05.373729 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:05.379756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.aggregate [None req-1d6d8260-016b-41f3-8dbf-3099502d537e tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Generated uuid eb87f0e6-cc74-42fd-9106-05c08c73b0a4 for aggregate {{(pid=119511) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:05.411014 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-1d6d8260-016b-41f3-8dbf-3099502d537e tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-273945032 already exists. Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1d6d8260-016b-41f3-8dbf-3099502d537e tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Request method failure captured: Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 59 Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdDMY-EWeEPeZyv7kMHLzhOirtOwkrMQDbd56KqfskRfEacm1Ty68WEOzXKXUBMkcMrh2vT_085m0vcgRHTQ8TMt5RpMrn3O10inNmwLGCwxkC-rjIILJh4Gzw33FMTq2tCHMUhtNlYkZ2blzgkYczy28m4VXVJaoFeIO9UL_48eIk Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:26:05.413948 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9e3720941eec4a67932ed626f180fa1e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}] Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: b7fb4e8411814741968d6eb6112ff981 Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: {"aggregate": {"name": "tempest-test_aggregate-273945032"}} Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:26:05.419526 n-d-767704-28 devstack@n-api.service[119511]: exception: Aggregate tempest-test_aggregate-273945032 already exists. Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-273945032'}}} Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 14 14:26:05.420267 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-273945032 already exists. Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:05.421335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-273945032 already exists. Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-273945032 already exists. Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1d6d8260-016b-41f3-8dbf-3099502d537e tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-273945032 already exists. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:05.422551 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1d6d8260-016b-41f3-8dbf-3099502d537e tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.065391 Jul 14 14:26:05.424787 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 99/199] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:05 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:26:05.441960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e55e75d8-a801-4aaf-a87c-3eb2c6186708 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:05.442479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e55e75d8-a801-4aaf-a87c-3eb2c6186708 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:05.459589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e55e75d8-a801-4aaf-a87c-3eb2c6186708 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:05.460055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e55e75d8-a801-4aaf-a87c-3eb2c6186708 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:05.460904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e55e75d8-a801-4aaf-a87c-3eb2c6186708 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:05.466415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e55e75d8-a801-4aaf-a87c-3eb2c6186708 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:05.513800 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-e55e75d8-a801-4aaf-a87c-3eb2c6186708 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] HTTP exception thrown: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e55e75d8-a801-4aaf-a87c-3eb2c6186708 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Request method failure captured: Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 HTTP/1.1 Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdA_l0xP9cTBavRE0Y6uzY54lgp2zXrqOWuKZ51Fz58soZrEWU-xsvkDW9vldnXmBSLC5C8fFloL2D7QoGww-mYRqdATeQ2cIBr9POMGk9uoPSpgyPgESHMqBkFvHNHFJC98JVz0teefvQHjuqu0gVw3w00DuDIxnyWJB7ijspCSx0 Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 9bc1942c7de94649a21a347bfc86b77e Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AggregatesAdminTestJSON-919434995 Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:26:05.515426 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:26:05.516756 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9bc1942c7de94649a21a347bfc86b77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9bc1942c7de94649a21a347bfc86b77e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9bc1942c7de94649a21a347bfc86b77e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9bc1942c7de94649a21a347bfc86b77e"}]}] Jul 14 14:26:05.516756 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AggregatesAdminTestJSON-919434995 Jul 14 14:26:05.516756 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 9bc1942c7de94649a21a347bfc86b77e Jul 14 14:26:05.516756 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-919434995 Jul 14 14:26:05.516756 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AggregatesAdminTestJSON-919434995-project Jul 14 14:26:05.516756 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:26:05.516756 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:26:05.516756 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d397a86992f44f43965e29597a1a540c Jul 14 14:26:05.516756 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AggregatesAdminTestJSON-919434995-project Jul 14 14:26:05.516756 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:26:05.516756 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:26:05.516756 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'b0c562a5-9c0e-42d4-8472-7e3439921cc5'} Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:05.517463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:26:05.518655 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.519766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e55e75d8-a801-4aaf-a87c-3eb2c6186708 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Returning 404 to user: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:05.520422 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e55e75d8-a801-4aaf-a87c-3eb2c6186708 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 404 len: 111 microversion: 2.1 time: 0.094314 Jul 14 14:26:05.525285 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 100/200] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:26:05 2022] DELETE /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:05.533921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3b5abfce-11bd-42af-b9e9-ff9a95584bbf tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:05.534794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3b5abfce-11bd-42af-b9e9-ff9a95584bbf tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:05.556317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b5abfce-11bd-42af-b9e9-ff9a95584bbf tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:05.556781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b5abfce-11bd-42af-b9e9-ff9a95584bbf tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:05.563909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b5abfce-11bd-42af-b9e9-ff9a95584bbf tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:05.564582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b5abfce-11bd-42af-b9e9-ff9a95584bbf tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:05.684701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8a9a1f3c-84b7-4c98-9056-a0194707baa7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:05.697578 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8a9a1f3c-84b7-4c98-9056-a0194707baa7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1311 microversion: 2.1 time: 0.850555 Jul 14 14:26:05.697578 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 101/201] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:04 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1311 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:05.718409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ff8f6704-5da4-4c5f-a403-ee2846e250e3 req-f64aca77-9de4-401a-baf6-9ed42501a193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f119f8-47c2-4c9b-a800-d16194ab2e49", "tag": "26034b4d-8bdb-42fb-bdf2-a8ae6c01b5be"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:05.752444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ff8f6704-5da4-4c5f-a403-ee2846e250e3 req-f64aca77-9de4-401a-baf6-9ed42501a193 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:05.752444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ff8f6704-5da4-4c5f-a403-ee2846e250e3 req-f64aca77-9de4-401a-baf6-9ed42501a193 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:05.793836 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ff8f6704-5da4-4c5f-a403-ee2846e250e3 req-f64aca77-9de4-401a-baf6-9ed42501a193 service nova] Creating event network-changed:26034b4d-8bdb-42fb-bdf2-a8ae6c01b5be for instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 on n-h1-767704-28 Jul 14 14:26:05.807382 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ff8f6704-5da4-4c5f-a403-ee2846e250e3 req-f64aca77-9de4-401a-baf6-9ed42501a193 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109143 Jul 14 14:26:05.808475 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 102/202] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:05.816805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a4207e2-d38c-4f02-959c-001505f94cae tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:05.818367 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:05.818367 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:05.859291 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a4207e2-d38c-4f02-959c-001505f94cae tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.049001 Jul 14 14:26:05.860619 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 103/203] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:26:05 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:05.873406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6002f4aa-f30c-4815-a404-8b0384f80620 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:05.874727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6002f4aa-f30c-4815-a404-8b0384f80620 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] [instance: b0c562a5-9c0e-42d4-8472-7e3439921cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:05.895186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6002f4aa-f30c-4815-a404-8b0384f80620 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:05.897464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6002f4aa-f30c-4815-a404-8b0384f80620 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:05.900305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6002f4aa-f30c-4815-a404-8b0384f80620 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:05.902488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6002f4aa-f30c-4815-a404-8b0384f80620 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:05.938968 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-6002f4aa-f30c-4815-a404-8b0384f80620 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] HTTP exception thrown: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6002f4aa-f30c-4815-a404-8b0384f80620 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Request method failure captured: Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 HTTP/1.1 Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdA_l0xP9cTBavRE0Y6uzY54lgp2zXrqOWuKZ51Fz58soZrEWU-xsvkDW9vldnXmBSLC5C8fFloL2D7QoGww-mYRqdATeQ2cIBr9POMGk9uoPSpgyPgESHMqBkFvHNHFJC98JVz0teefvQHjuqu0gVw3w00DuDIxnyWJB7ijspCSx0 Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 9bc1942c7de94649a21a347bfc86b77e Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminTestJSON-919434995 Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:26:05.954855 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:26:05.956301 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9bc1942c7de94649a21a347bfc86b77e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9bc1942c7de94649a21a347bfc86b77e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9bc1942c7de94649a21a347bfc86b77e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9bc1942c7de94649a21a347bfc86b77e"}]}] Jul 14 14:26:05.956301 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminTestJSON-919434995 Jul 14 14:26:05.956301 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 9bc1942c7de94649a21a347bfc86b77e Jul 14 14:26:05.956301 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-919434995 Jul 14 14:26:05.956301 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminTestJSON-919434995-project Jul 14 14:26:05.956301 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:05.956301 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:05.956301 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d397a86992f44f43965e29597a1a540c Jul 14 14:26:05.956301 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminTestJSON-919434995-project Jul 14 14:26:05.956301 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:05.956301 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:26:05.956301 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'b0c562a5-9c0e-42d4-8472-7e3439921cc5'} Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:05.957069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. Jul 14 14:26:05.958554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:05.969290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6002f4aa-f30c-4815-a404-8b0384f80620 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] Returning 404 to user: Instance b0c562a5-9c0e-42d4-8472-7e3439921cc5 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:05.972268 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6002f4aa-f30c-4815-a404-8b0384f80620 tempest-AggregatesAdminTestJSON-919434995 tempest-AggregatesAdminTestJSON-919434995-project] 10.222.0.81 "GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5" status: 404 len: 111 microversion: 2.1 time: 0.108505 Jul 14 14:26:05.976441 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 104/204] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:05 2022] GET /compute/v2.1/servers/b0c562a5-9c0e-42d4-8472-7e3439921cc5 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:05.996544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3d3cee0d-1538-4af3-9393-c051d368e493 req-2839df58-efa4-4c64-9e11-bcd6d26330bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2395da0-b1d7-4882-a1ac-e2029c5fad94", "name": "network-vif-plugged", "status": "completed", "tag": "b00304cb-9535-4ecd-a778-337437c2dd15"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:06.032846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3d3cee0d-1538-4af3-9393-c051d368e493 req-2839df58-efa4-4c64-9e11-bcd6d26330bc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:06.034030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3d3cee0d-1538-4af3-9393-c051d368e493 req-2839df58-efa4-4c64-9e11-bcd6d26330bc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:06.059818 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3d3cee0d-1538-4af3-9393-c051d368e493 req-2839df58-efa4-4c64-9e11-bcd6d26330bc service nova] Creating event network-vif-plugged:b00304cb-9535-4ecd-a778-337437c2dd15 for instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 on n-h1-767704-28 Jul 14 14:26:06.067107 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3d3cee0d-1538-4af3-9393-c051d368e493 req-2839df58-efa4-4c64-9e11-bcd6d26330bc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088994 Jul 14 14:26:06.068867 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 105/205] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:06.075524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7f5d14d6-a5f8-4f64-b3cc-bdfda054eb5b tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-123174687"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:06.077361 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:06.077361 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:06.078515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.aggregate [None req-7f5d14d6-a5f8-4f64-b3cc-bdfda054eb5b tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Generated uuid e4e98c9e-4042-4519-8b17-a32b05531bd3 for aggregate {{(pid=119512) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:06.123158 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7f5d14d6-a5f8-4f64-b3cc-bdfda054eb5b tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052767 Jul 14 14:26:06.124503 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 106/206] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:06.150990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2de8e286-9302-4766-acc1-6f0c79a23c24 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:06.152524 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:06.152524 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:06.168041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2de8e286-9302-4766-acc1-6f0c79a23c24 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'de23236b13d344bca4b564295f463f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbb8886230d413fb991c85c5c692a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2de8e286-9302-4766-acc1-6f0c79a23c24 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Request method failure captured: Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdA_ep6yMFYUCVc-Y_NnzGiGlOeM2eeqRRbtz0jTh0L-o8qUmRAEI7Wp2v-B5Vr6hSRCyZHpHSbKqhun8bNPb45GY2mR3IX0mwfeDR13myIW60E_F4qJl5Ql-epK5BjmaxApDyTPnKgVDwfuk1F8kUNuMSANAUscwQsx-V1jfGk53g Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3fbb8886230d413fb991c85c5c692a56 Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:26:06.180110 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:26:06.181494 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3fbb8886230d413fb991c85c5c692a56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3fbb8886230d413fb991c85c5c692a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3fbb8886230d413fb991c85c5c692a56", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3fbb8886230d413fb991c85c5c692a56"}]}] Jul 14 14:26:06.181494 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:06.181494 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3fbb8886230d413fb991c85c5c692a56 Jul 14 14:26:06.181494 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:06.181494 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminNegativeTestJSON-1239802778-project Jul 14 14:26:06.181494 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:06.181494 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:06.181494 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: de23236b13d344bca4b564295f463f35 Jul 14 14:26:06.181494 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778-project Jul 14 14:26:06.181494 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:06.181494 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 14 14:26:06.181494 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '15'} Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:06.182215 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 14 14:26:06.183350 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.187049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2de8e286-9302-4766-acc1-6f0c79a23c24 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:06.194097 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2de8e286-9302-4766-acc1-6f0c79a23c24 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.060876 Jul 14 14:26:06.199069 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 107/207] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:26:06 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 67 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:06.215457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fc62d9d3-1126-4c8c-8a57-4e3d81f42215 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:06.274027 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fc62d9d3-1126-4c8c-8a57-4e3d81f42215 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.065782 Jul 14 14:26:06.275363 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 108/208] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:26:06 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:06.290995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9034de5e-aad8-49d1-8fba-13fb6c617425 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:06.292681 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:06.292681 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:06.322743 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-9034de5e-aad8-49d1-8fba-13fb6c617425 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9034de5e-aad8-49d1-8fba-13fb6c617425 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Request method failure captured: Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdDMY-EWeEPeZyv7kMHLzhOirtOwkrMQDbd56KqfskRfEacm1Ty68WEOzXKXUBMkcMrh2vT_085m0vcgRHTQ8TMt5RpMrn3O10inNmwLGCwxkC-rjIILJh4Gzw33FMTq2tCHMUhtNlYkZ2blzgkYczy28m4VXVJaoFeIO9UL_48eIk Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:26:06.327645 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:26:06.329020 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9e3720941eec4a67932ed626f180fa1e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}] Jul 14 14:26:06.329020 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:06.329020 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:06.329020 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:06.329020 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:06.329020 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:06.329020 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:06.329020 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: b7fb4e8411814741968d6eb6112ff981 Jul 14 14:26:06.329020 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:06.329020 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:06.329020 n-d-767704-28 devstack@n-api.service[119512]: exception: Aggregate -1 could not be found. Jul 14 14:26:06.329020 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '-1'} Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 14 14:26:06.329697 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.330896 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:06.332239 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:06.332239 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:06.332239 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:06.332239 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:06.332239 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 14 14:26:06.332239 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.336222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9034de5e-aad8-49d1-8fba-13fb6c617425 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:06.341124 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9034de5e-aad8-49d1-8fba-13fb6c617425 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.058183 Jul 14 14:26:06.344353 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 109/209] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:26:06 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:26:06.358400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a94b6d5f-fc50-49d4-a45a-006fa7171cec tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2024849919"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:06.363636 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:06.363636 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:06.367738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.aggregate [None req-a94b6d5f-fc50-49d4-a45a-006fa7171cec tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Generated uuid ab03360a-ea68-41d3-84a1-11cc8a2aebc1 for aggregate {{(pid=119512) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:06.439984 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a94b6d5f-fc50-49d4-a45a-006fa7171cec tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.090680 Jul 14 14:26:06.441882 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 110/210] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:06.479688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a8f0a825-8405-4613-b3e2-d7c247f68284 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:06.481628 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:06.481628 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:06.483577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a8f0a825-8405-4613-b3e2-d7c247f68284 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'de23236b13d344bca4b564295f463f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbb8886230d413fb991c85c5c692a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a8f0a825-8405-4613-b3e2-d7c247f68284 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Request method failure captured: Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdA_ep6yMFYUCVc-Y_NnzGiGlOeM2eeqRRbtz0jTh0L-o8qUmRAEI7Wp2v-B5Vr6hSRCyZHpHSbKqhun8bNPb45GY2mR3IX0mwfeDR13myIW60E_F4qJl5Ql-epK5BjmaxApDyTPnKgVDwfuk1F8kUNuMSANAUscwQsx-V1jfGk53g Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3fbb8886230d413fb991c85c5c692a56 Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:26:06.489561 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:26:06.491199 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3fbb8886230d413fb991c85c5c692a56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3fbb8886230d413fb991c85c5c692a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3fbb8886230d413fb991c85c5c692a56", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3fbb8886230d413fb991c85c5c692a56"}]}] Jul 14 14:26:06.491199 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:06.491199 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3fbb8886230d413fb991c85c5c692a56 Jul 14 14:26:06.491199 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:06.491199 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminNegativeTestJSON-1239802778-project Jul 14 14:26:06.491199 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:06.491199 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:06.491199 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: de23236b13d344bca4b564295f463f35 Jul 14 14:26:06.491199 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778-project Jul 14 14:26:06.491199 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:06.491199 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 14 14:26:06.491199 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '16'} Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:06.492012 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 14 14:26:06.493070 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.497404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a8f0a825-8405-4613-b3e2-d7c247f68284 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:06.500968 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a8f0a825-8405-4613-b3e2-d7c247f68284 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] 10.222.0.81 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.045205 Jul 14 14:26:06.504457 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 111/211] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:06 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:06.515039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-45109b47-d47a-4ef2-a9f7-1725806a6895 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:06.520275 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:06.520275 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:06.570688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3b5abfce-11bd-42af-b9e9-ff9a95584bbf tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:06.586799 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-45109b47-d47a-4ef2-a9f7-1725806a6895 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.077786 Jul 14 14:26:06.594141 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 112/212] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:26:06 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:06.601761 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3b5abfce-11bd-42af-b9e9-ff9a95584bbf tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 200 len: 1590 microversion: 2.1 time: 1.075034 Jul 14 14:26:06.602354 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 101/213] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:05 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 1590 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:06.613381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e07ae261-3c15-4b3e-bac5-082d41c4ff84 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:06.613381 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:06.613381 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:06.631217 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-e07ae261-3c15-4b3e-bac5-082d41c4ff84 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e07ae261-3c15-4b3e-bac5-082d41c4ff84 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Request method failure captured: Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdDMY-EWeEPeZyv7kMHLzhOirtOwkrMQDbd56KqfskRfEacm1Ty68WEOzXKXUBMkcMrh2vT_085m0vcgRHTQ8TMt5RpMrn3O10inNmwLGCwxkC-rjIILJh4Gzw33FMTq2tCHMUhtNlYkZ2blzgkYczy28m4VXVJaoFeIO9UL_48eIk Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:26:06.636150 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:26:06.637660 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9e3720941eec4a67932ed626f180fa1e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}] Jul 14 14:26:06.637660 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:06.637660 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:06.637660 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:06.637660 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:06.637660 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:06.637660 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:06.637660 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: b7fb4e8411814741968d6eb6112ff981 Jul 14 14:26:06.637660 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:06.637660 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:06.637660 n-d-767704-28 devstack@n-api.service[119512]: exception: Aggregate -1 could not be found. Jul 14 14:26:06.637660 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '-1'} Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:06.642770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 14 14:26:06.644042 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.645321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e07ae261-3c15-4b3e-bac5-082d41c4ff84 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:06.645321 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e07ae261-3c15-4b3e-bac5-082d41c4ff84 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.037327 Jul 14 14:26:06.645321 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 113/214] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:26:06 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:26:06.647371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9a924f8d-00e7-4cb9-adaf-b898f1fb3070 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:06.649568 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:06.649568 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:06.650597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9a924f8d-00e7-4cb9-adaf-b898f1fb3070 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'de23236b13d344bca4b564295f463f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbb8886230d413fb991c85c5c692a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9a924f8d-00e7-4cb9-adaf-b898f1fb3070 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Request method failure captured: Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdA_ep6yMFYUCVc-Y_NnzGiGlOeM2eeqRRbtz0jTh0L-o8qUmRAEI7Wp2v-B5Vr6hSRCyZHpHSbKqhun8bNPb45GY2mR3IX0mwfeDR13myIW60E_F4qJl5Ql-epK5BjmaxApDyTPnKgVDwfuk1F8kUNuMSANAUscwQsx-V1jfGk53g Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3fbb8886230d413fb991c85c5c692a56 Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:26:06.652146 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:26:06.653521 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3fbb8886230d413fb991c85c5c692a56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3fbb8886230d413fb991c85c5c692a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3fbb8886230d413fb991c85c5c692a56", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3fbb8886230d413fb991c85c5c692a56"}]}] Jul 14 14:26:06.653521 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:06.653521 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3fbb8886230d413fb991c85c5c692a56 Jul 14 14:26:06.653521 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:06.653521 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AggregatesAdminNegativeTestJSON-1239802778-project Jul 14 14:26:06.653521 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:26:06.653521 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:26:06.653521 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: de23236b13d344bca4b564295f463f35 Jul 14 14:26:06.653521 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778-project Jul 14 14:26:06.653521 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:26:06.653521 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 14 14:26:06.653521 n-d-767704-28 devstack@n-api.service[119511]: action_args: {} Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:06.654328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:06.655533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9a924f8d-00e7-4cb9-adaf-b898f1fb3070 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:06.656673 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9a924f8d-00e7-4cb9-adaf-b898f1fb3070 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] 10.222.0.81 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.011941 Jul 14 14:26:06.667478 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 102/215] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:26:06 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:26:06.675649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-630e4cec-eeea-402b-9920-0ca4a72cd006 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2013734961"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:06.678699 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:06.678699 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:06.679766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.aggregate [None req-630e4cec-eeea-402b-9920-0ca4a72cd006 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Generated uuid a3e635c0-1a54-4f6f-ad50-b2f59f122b47 for aggregate {{(pid=119512) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:06.697270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=11,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:06.713479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c10d2035-9528-462e-96ad-ac9e748fee7b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:06.714729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c10d2035-9528-462e-96ad-ac9e748fee7b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:06.736973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c10d2035-9528-462e-96ad-ac9e748fee7b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:06.745369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c10d2035-9528-462e-96ad-ac9e748fee7b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:06.746302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c10d2035-9528-462e-96ad-ac9e748fee7b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:06.746754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c10d2035-9528-462e-96ad-ac9e748fee7b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:06.760690 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-630e4cec-eeea-402b-9920-0ca4a72cd006 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.095842 Jul 14 14:26:06.775106 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 114/216] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:06.786039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c2c80ea6-d0f1-4e65-9983-eaae1d576adb tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-767704-28"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:06.787371 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:06.787371 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:06.828071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2c80ea6-d0f1-4e65-9983-eaae1d576adb tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:06.831544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2c80ea6-d0f1-4e65-9983-eaae1d576adb tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:07.093711 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c2c80ea6-d0f1-4e65-9983-eaae1d576adb tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.316565 Jul 14 14:26:07.094366 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 115/217] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:26:06 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:07.110307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0ac84262-3720-4c5a-a5b9-3484719655d2 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-767704-28"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:07.114225 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:07.114225 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:07.118683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0ac84262-3720-4c5a-a5b9-3484719655d2 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'de23236b13d344bca4b564295f463f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbb8886230d413fb991c85c5c692a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0ac84262-3720-4c5a-a5b9-3484719655d2 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Request method failure captured: Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 43 Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdA_ep6yMFYUCVc-Y_NnzGiGlOeM2eeqRRbtz0jTh0L-o8qUmRAEI7Wp2v-B5Vr6hSRCyZHpHSbKqhun8bNPb45GY2mR3IX0mwfeDR13myIW60E_F4qJl5Ql-epK5BjmaxApDyTPnKgVDwfuk1F8kUNuMSANAUscwQsx-V1jfGk53g Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3fbb8886230d413fb991c85c5c692a56 Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:26:07.122830 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3fbb8886230d413fb991c85c5c692a56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3fbb8886230d413fb991c85c5c692a56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3fbb8886230d413fb991c85c5c692a56", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3fbb8886230d413fb991c85c5c692a56"}]}] Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3fbb8886230d413fb991c85c5c692a56 Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778 Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminNegativeTestJSON-1239802778-project Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: de23236b13d344bca4b564295f463f35 Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1239802778-project Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: {"remove_host": {"host": "n-h2-767704-28"}} Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:07.124284 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-767704-28'}}} Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:07.125168 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 14 14:26:07.126402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:07.127603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0ac84262-3720-4c5a-a5b9-3484719655d2 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:07.127782 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0ac84262-3720-4c5a-a5b9-3484719655d2 tempest-AggregatesAdminNegativeTestJSON-1239802778 tempest-AggregatesAdminNegativeTestJSON-1239802778-project] 10.222.0.81 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.026346 Jul 14 14:26:07.129251 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 116/218] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:26:07 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:07.141314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-04318de9-d720-4de2-aa61-474bd1ccaf8b tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-767704-28"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:07.177885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04318de9-d720-4de2-aa61-474bd1ccaf8b tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:07.180479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04318de9-d720-4de2-aa61-474bd1ccaf8b tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:07.218825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:07.435370 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-04318de9-d720-4de2-aa61-474bd1ccaf8b tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.300185 Jul 14 14:26:07.437891 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 117/219] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:26:07 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:07.459467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37ec27fb-a959-4474-a1af-075be9a09d90 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:07.462893 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:07.462893 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:07.515001 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-37ec27fb-a959-4474-a1af-075be9a09d90 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.067622 Jul 14 14:26:07.516851 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 118/220] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:26:07 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:07.535313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f451cf2-fb2f-4be1-8fe1-75601c6a1637 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-185087413"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:07.537087 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:07.537087 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:07.539180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.aggregate [None req-3f451cf2-fb2f-4be1-8fe1-75601c6a1637 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Generated uuid f000a3cf-2e07-4e3f-b995-e1f31230ee24 for aggregate {{(pid=119512) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:26:07.586460 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f451cf2-fb2f-4be1-8fe1-75601c6a1637 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054836 Jul 14 14:26:07.589313 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 119/221] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:26:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:26:07.600310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a9c9a9fb-dbdd-44ee-8728-ac391f7d0e71 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:07.604603 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:07.604603 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:07.626166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9c9a9fb-dbdd-44ee-8728-ac391f7d0e71 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:07.629611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9c9a9fb-dbdd-44ee-8728-ac391f7d0e71 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:07.652777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9c9a9fb-dbdd-44ee-8728-ac391f7d0e71 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:07.654746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9c9a9fb-dbdd-44ee-8728-ac391f7d0e71 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:07.676551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.compute.aggregates [None req-a9c9a9fb-dbdd-44ee-8728-ac391f7d0e71 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 14 14:26:07.680976 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-a9c9a9fb-dbdd-44ee-8728-ac391f7d0e71 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a9c9a9fb-dbdd-44ee-8728-ac391f7d0e71 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Request method failure captured: Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 42 Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdDMY-EWeEPeZyv7kMHLzhOirtOwkrMQDbd56KqfskRfEacm1Ty68WEOzXKXUBMkcMrh2vT_085m0vcgRHTQ8TMt5RpMrn3O10inNmwLGCwxkC-rjIILJh4Gzw33FMTq2tCHMUhtNlYkZ2blzgkYczy28m4VXVJaoFeIO9UL_48eIk Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:26:07.690001 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9e3720941eec4a67932ed626f180fa1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9e3720941eec4a67932ed626f180fa1e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9e3720941eec4a67932ed626f180fa1e"}]}] Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 9e3720941eec4a67932ed626f180fa1e Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-737636896 Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: b7fb4e8411814741968d6eb6112ff981 Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: {"remove_host": {"host": "nonexist_host"}} Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:07.691563 n-d-767704-28 devstack@n-api.service[119512]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 14 14:26:07.692271 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 14 14:26:07.693355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:07.694429 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:07.696251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:07.696251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:07.696251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:07.696251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:07.696251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 14 14:26:07.696251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:07.696251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a9c9a9fb-dbdd-44ee-8728-ac391f7d0e71 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:07.696656 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a9c9a9fb-dbdd-44ee-8728-ac391f7d0e71 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.102657 Jul 14 14:26:07.702219 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 120/222] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:26:07 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:26:07.709574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0f7c6d04-44a7-4d40-9ec7-099e5f41d850 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:07.718855 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:07.718855 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:07.777710 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0f7c6d04-44a7-4d40-9ec7-099e5f41d850 tempest-AggregatesAdminNegativeTestJSON-737636896 tempest-AggregatesAdminNegativeTestJSON-737636896-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.072608 Jul 14 14:26:07.781372 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 121/223] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:26:07 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:08.269124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c10d2035-9528-462e-96ad-ac9e748fee7b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:08.280225 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c10d2035-9528-462e-96ad-ac9e748fee7b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1311 microversion: 2.1 time: 1.572159 Jul 14 14:26:08.282973 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 103/224] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:06 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1311 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:09.298759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e459b3a0-93fb-4e86-9747-57445d29e9ae tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:09.299513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e459b3a0-93fb-4e86-9747-57445d29e9ae tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:09.313244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e459b3a0-93fb-4e86-9747-57445d29e9ae tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:09.314316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e459b3a0-93fb-4e86-9747-57445d29e9ae tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:09.317166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e459b3a0-93fb-4e86-9747-57445d29e9ae tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:09.318276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e459b3a0-93fb-4e86-9747-57445d29e9ae tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:10.042795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e459b3a0-93fb-4e86-9747-57445d29e9ae tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:10.058939 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e459b3a0-93fb-4e86-9747-57445d29e9ae tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1461 microversion: 2.1 time: 0.763962 Jul 14 14:26:10.059533 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 122/225] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:09 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1461 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:10.627472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-862dffdf-2935-474c-a257-1661d5b44b43 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:10.628379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-862dffdf-2935-474c-a257-1661d5b44b43 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:10.645124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-862dffdf-2935-474c-a257-1661d5b44b43 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:10.645795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-862dffdf-2935-474c-a257-1661d5b44b43 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:10.656171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-862dffdf-2935-474c-a257-1661d5b44b43 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:10.659064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-862dffdf-2935-474c-a257-1661d5b44b43 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:10.659801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-341008735", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:10.740492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:26:12.268126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:26:12.268780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:26:12.269264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:26:12.269761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:26:12.270354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:26:12.304371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:12.316055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:12.317087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:12.317671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:12.401520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Getting quotas for project 5534ff945d6143a7b2ec4abb5634a116. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:26:12.418233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Getting quotas for user 5c749f2fb8634737ba31faeb7442c912 and project 5534ff945d6143a7b2ec4abb5634a116. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:26:12.472460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:26:12.482143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:26:12.667429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-31cf4be3-9840-49ad-a3c0-2801412b8dc7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.399883 Jul 14 14:26:12.670982 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 123/226] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:26:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:26:12.680815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-80daaf06-ab40-4008-ad78-b54680a9f0d2 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:12.687529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-80daaf06-ab40-4008-ad78-b54680a9f0d2 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:12.750380 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-862dffdf-2935-474c-a257-1661d5b44b43 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1614 microversion: 2.1 time: 2.671053 Jul 14 14:26:12.767598 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 104/227] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:10 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1614 bytes in 2689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:12.779401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8c561535-a15a-4593-8776-d2a74fa6233b tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:12.781038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8c561535-a15a-4593-8776-d2a74fa6233b tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:12.796117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c561535-a15a-4593-8776-d2a74fa6233b tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:12.796574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c561535-a15a-4593-8776-d2a74fa6233b tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:12.797388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c561535-a15a-4593-8776-d2a74fa6233b tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:12.800704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c561535-a15a-4593-8776-d2a74fa6233b tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:12.887770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-80daaf06-ab40-4008-ad78-b54680a9f0d2 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:12.916556 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-80daaf06-ab40-4008-ad78-b54680a9f0d2 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1222 microversion: 2.1 time: 0.240055 Jul 14 14:26:12.930961 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 124/228] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:12 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:13.001145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8c561535-a15a-4593-8776-d2a74fa6233b tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3e010174b0434d87862b7ffefa31545a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0626a20cd20e4d1f8e4985dce7bb00df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:13.001807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8c561535-a15a-4593-8776-d2a74fa6233b tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] flavor_id is None. Assuming migration. {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 14 14:26:13.002261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8c561535-a15a-4593-8776-d2a74fa6233b tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 14:26:13.949149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb58dc04-3056-4d79-81b2-aac7563ff46e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:13.950308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bb58dc04-3056-4d79-81b2-aac7563ff46e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:13.986056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb58dc04-3056-4d79-81b2-aac7563ff46e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:13.986056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb58dc04-3056-4d79-81b2-aac7563ff46e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:13.986056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb58dc04-3056-4d79-81b2-aac7563ff46e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:13.990108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb58dc04-3056-4d79-81b2-aac7563ff46e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:14.288134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:14.313833 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8c561535-a15a-4593-8776-d2a74fa6233b tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94/action" status: 202 len: 0 microversion: 2.1 time: 1.544598 Jul 14 14:26:14.314972 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 105/229] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:26:12 2022] POST /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94/action => generated 0 bytes in 1547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:26:14.345002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bb58dc04-3056-4d79-81b2-aac7563ff46e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:14.375804 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bb58dc04-3056-4d79-81b2-aac7563ff46e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1218 microversion: 2.1 time: 0.422174 Jul 14 14:26:14.377686 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 125/230] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:13 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1218 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:14.388054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24027d7d-dff2-49d4-94d4-08fea12155a1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:14.389464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-24027d7d-dff2-49d4-94d4-08fea12155a1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:14.415177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24027d7d-dff2-49d4-94d4-08fea12155a1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:14.415658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24027d7d-dff2-49d4-94d4-08fea12155a1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:14.417213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24027d7d-dff2-49d4-94d4-08fea12155a1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:14.417655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24027d7d-dff2-49d4-94d4-08fea12155a1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:14.582829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:14.685022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-58094542", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:14.835737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:26:14.897062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-24027d7d-dff2-49d4-94d4-08fea12155a1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:14.924086 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-24027d7d-dff2-49d4-94d4-08fea12155a1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1470 microversion: 2.1 time: 0.545214 Jul 14 14:26:14.935435 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 126/231] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:14 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1470 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:15.394780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a61d8804-a5f8-44e6-9946-ee2bf6481d66 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:15.396614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a61d8804-a5f8-44e6-9946-ee2bf6481d66 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:15.410048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:26:15.410543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:26:15.410929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:26:15.412684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:26:15.413867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:26:15.415792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a61d8804-a5f8-44e6-9946-ee2bf6481d66 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:15.420967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a61d8804-a5f8-44e6-9946-ee2bf6481d66 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:15.420967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a61d8804-a5f8-44e6-9946-ee2bf6481d66 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:15.420967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a61d8804-a5f8-44e6-9946-ee2bf6481d66 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:15.448253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:15.448732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:15.452010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:15.452468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:15.537239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Getting quotas for project 6bd1f655183e476da89067fcd0f1756a. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:26:15.543235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Getting quotas for user 2998f23059d446dcbea060ac2115b096 and project 6bd1f655183e476da89067fcd0f1756a. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:26:15.575505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:26:15.585229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:26:15.647220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a61d8804-a5f8-44e6-9946-ee2bf6481d66 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:15.669623 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a61d8804-a5f8-44e6-9946-ee2bf6481d66 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1280 microversion: 2.1 time: 0.278968 Jul 14 14:26:15.671540 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 127/232] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:15 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1280 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:15.682164 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f8bbac6f-aed4-4c89-a8ed-7d44e26d8627 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.361123 Jul 14 14:26:15.690949 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 106/233] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:26:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:26:15.698869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-12c2ff93-9476-461a-8a87-043cc4d46fac tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:15.699611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-12c2ff93-9476-461a-8a87-043cc4d46fac tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:15.931646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-12c2ff93-9476-461a-8a87-043cc4d46fac tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:15.942641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-999cb5d4-2c31-4151-a957-a95267ac4e83 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:15.943273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-999cb5d4-2c31-4151-a957-a95267ac4e83 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:15.943673 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-12c2ff93-9476-461a-8a87-043cc4d46fac tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1218 microversion: 2.1 time: 0.251481 Jul 14 14:26:15.944752 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 128/234] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:15 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1218 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:15.970619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-999cb5d4-2c31-4151-a957-a95267ac4e83 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:15.971077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-999cb5d4-2c31-4151-a957-a95267ac4e83 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:15.971864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-999cb5d4-2c31-4151-a957-a95267ac4e83 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:15.972341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-999cb5d4-2c31-4151-a957-a95267ac4e83 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:16.438962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-999cb5d4-2c31-4151-a957-a95267ac4e83 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:16.452595 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-999cb5d4-2c31-4151-a957-a95267ac4e83 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1470 microversion: 2.1 time: 0.513769 Jul 14 14:26:16.457823 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 107/235] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:15 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1470 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:16.525971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e2840109-e20a-43c0-aad1-1397839fb5af tempest-AZAdminV2TestJSON-195545773 tempest-AZAdminV2TestJSON-195545773-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:16.529132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e2840109-e20a-43c0-aad1-1397839fb5af tempest-AZAdminV2TestJSON-195545773 tempest-AZAdminV2TestJSON-195545773-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:16.529776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e2840109-e20a-43c0-aad1-1397839fb5af tempest-AZAdminV2TestJSON-195545773 tempest-AZAdminV2TestJSON-195545773-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:16.532152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e2840109-e20a-43c0-aad1-1397839fb5af tempest-AZAdminV2TestJSON-195545773 tempest-AZAdminV2TestJSON-195545773-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:16.532842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e2840109-e20a-43c0-aad1-1397839fb5af tempest-AZAdminV2TestJSON-195545773 tempest-AZAdminV2TestJSON-195545773-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:16.613598 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e2840109-e20a-43c0-aad1-1397839fb5af tempest-AZAdminV2TestJSON-195545773 tempest-AZAdminV2TestJSON-195545773-project-admin] 10.222.0.81 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.431512 Jul 14 14:26:16.614323 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 129/236] 10.222.0.81 () {58 vars in 1163 bytes} [Thu Jul 14 14:26:16 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 14:26:16.626066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d436d7cd-40d7-4186-a954-cd285f3264a3 tempest-AZAdminV2TestJSON-195545773 tempest-AZAdminV2TestJSON-195545773-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:16.627070 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:16.627070 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:16.628687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d436d7cd-40d7-4186-a954-cd285f3264a3 tempest-AZAdminV2TestJSON-195545773 tempest-AZAdminV2TestJSON-195545773-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:16.629317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d436d7cd-40d7-4186-a954-cd285f3264a3 tempest-AZAdminV2TestJSON-195545773 tempest-AZAdminV2TestJSON-195545773-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:16.630269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d436d7cd-40d7-4186-a954-cd285f3264a3 tempest-AZAdminV2TestJSON-195545773 tempest-AZAdminV2TestJSON-195545773-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:16.630765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d436d7cd-40d7-4186-a954-cd285f3264a3 tempest-AZAdminV2TestJSON-195545773 tempest-AZAdminV2TestJSON-195545773-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:16.690506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0590050c-40c6-45f4-a268-4ea725a46ab6 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:16.691395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0590050c-40c6-45f4-a268-4ea725a46ab6 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:16.708728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0590050c-40c6-45f4-a268-4ea725a46ab6 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:16.716598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0590050c-40c6-45f4-a268-4ea725a46ab6 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:16.716598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0590050c-40c6-45f4-a268-4ea725a46ab6 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:16.716598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0590050c-40c6-45f4-a268-4ea725a46ab6 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:16.752224 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d436d7cd-40d7-4186-a954-cd285f3264a3 tempest-AZAdminV2TestJSON-195545773 tempest-AZAdminV2TestJSON-195545773-project-admin] 10.222.0.81 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.130089 Jul 14 14:26:16.752852 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 108/237] 10.222.0.81 () {58 vars in 1184 bytes} [Thu Jul 14 14:26:16 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:26:16.939010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0590050c-40c6-45f4-a268-4ea725a46ab6 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:16.954313 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0590050c-40c6-45f4-a268-4ea725a46ab6 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1280 microversion: 2.1 time: 0.269253 Jul 14 14:26:16.956221 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 130/238] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:16 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:16.969641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-366f8379-f11c-4235-b645-ab4923d15ed9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:16.970595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-366f8379-f11c-4235-b645-ab4923d15ed9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:16.978699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-366f8379-f11c-4235-b645-ab4923d15ed9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:16.979392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-366f8379-f11c-4235-b645-ab4923d15ed9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:16.980629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-366f8379-f11c-4235-b645-ab4923d15ed9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:16.981544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-366f8379-f11c-4235-b645-ab4923d15ed9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:17.125230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-366f8379-f11c-4235-b645-ab4923d15ed9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:17.137065 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-366f8379-f11c-4235-b645-ab4923d15ed9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1214 microversion: 2.1 time: 0.179343 Jul 14 14:26:17.139165 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 109/239] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:16 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:17.479936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6d92f346-c6b2-46dc-ab6e-227f15288df6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:17.481697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6d92f346-c6b2-46dc-ab6e-227f15288df6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:17.501792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d92f346-c6b2-46dc-ab6e-227f15288df6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:17.505869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d92f346-c6b2-46dc-ab6e-227f15288df6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:17.510430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d92f346-c6b2-46dc-ab6e-227f15288df6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:17.514155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d92f346-c6b2-46dc-ab6e-227f15288df6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:17.974045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d24c0dad-02c4-43a1-981d-008ea0dc0ba3 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:17.975423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d24c0dad-02c4-43a1-981d-008ea0dc0ba3 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:17.979955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=84,nova_api:DELETE=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:17.998861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d24c0dad-02c4-43a1-981d-008ea0dc0ba3 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:18.001864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d24c0dad-02c4-43a1-981d-008ea0dc0ba3 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:18.003285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d24c0dad-02c4-43a1-981d-008ea0dc0ba3 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:18.004397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d24c0dad-02c4-43a1-981d-008ea0dc0ba3 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:18.203678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d24c0dad-02c4-43a1-981d-008ea0dc0ba3 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:18.218813 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d24c0dad-02c4-43a1-981d-008ea0dc0ba3 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1280 microversion: 2.1 time: 0.246156 Jul 14 14:26:18.219767 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 110/240] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:17 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1280 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:18.466554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6d92f346-c6b2-46dc-ab6e-227f15288df6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:18.492260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e2a755a3-e1cd-4b8c-8edb-ab429a8c0be9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Action: 'create', calling method: .version_select at 0x7fd6c6610820>, body: {"keypair": {"name": "tempest-keypair-323476641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4YWGHtk3F/COGrK98rsF5RjcqSFbkJ/8w4otNykaretoNssRpE0wryJnK8SijGt+zdcNvOX/BAPE3oKyqyJQfvo1Lw+Cjg4PzQxZgx90iSDbmfUglTzp50bhhxtN2iTQ=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:18.506825 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6d92f346-c6b2-46dc-ab6e-227f15288df6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1470 microversion: 2.1 time: 1.031744 Jul 14 14:26:18.512538 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 131/241] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:17 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1470 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:18.540360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-66b18805-8b2a-4cee-82cb-3c8dad14955d tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:18.542613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-66b18805-8b2a-4cee-82cb-3c8dad14955d tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:18.559055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66b18805-8b2a-4cee-82cb-3c8dad14955d tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:18.561089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66b18805-8b2a-4cee-82cb-3c8dad14955d tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:18.562588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66b18805-8b2a-4cee-82cb-3c8dad14955d tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:18.567300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e2a755a3-e1cd-4b8c-8edb-ab429a8c0be9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Getting quotas for project cd30d3b5d4b84104ae34623d3121a080. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:26:18.567776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66b18805-8b2a-4cee-82cb-3c8dad14955d tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:18.583957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e2a755a3-e1cd-4b8c-8edb-ab429a8c0be9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Getting quotas for user 6939fb96384749f9b9358e636845106a and project cd30d3b5d4b84104ae34623d3121a080. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:26:18.648667 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e2a755a3-e1cd-4b8c-8edb-ab429a8c0be9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.411355 Jul 14 14:26:18.655128 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 111/242] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:26:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:18.763699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-66b18805-8b2a-4cee-82cb-3c8dad14955d tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:18.776426 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-66b18805-8b2a-4cee-82cb-3c8dad14955d tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1276 microversion: 2.1 time: 0.259857 Jul 14 14:26:18.779421 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 132/243] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:18 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1276 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:19.236411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ddecbb0e-fb2f-42ea-a5ba-4213a2318f33 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:19.237229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ddecbb0e-fb2f-42ea-a5ba-4213a2318f33 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:19.250745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddecbb0e-fb2f-42ea-a5ba-4213a2318f33 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:19.255659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddecbb0e-fb2f-42ea-a5ba-4213a2318f33 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:19.257681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddecbb0e-fb2f-42ea-a5ba-4213a2318f33 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:19.258226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddecbb0e-fb2f-42ea-a5ba-4213a2318f33 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:19.437521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ddecbb0e-fb2f-42ea-a5ba-4213a2318f33 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:19.447920 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ddecbb0e-fb2f-42ea-a5ba-4213a2318f33 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1280 microversion: 2.1 time: 0.215989 Jul 14 14:26:19.448517 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 112/244] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:19 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1280 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:19.525710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-899c3be7-6f3f-4961-b612-bdc87f696869 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:19.526661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-899c3be7-6f3f-4961-b612-bdc87f696869 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:19.543087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-899c3be7-6f3f-4961-b612-bdc87f696869 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:19.543543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-899c3be7-6f3f-4961-b612-bdc87f696869 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:19.544343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-899c3be7-6f3f-4961-b612-bdc87f696869 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:19.546061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-899c3be7-6f3f-4961-b612-bdc87f696869 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:19.798872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99dacfd3-def7-461a-a067-71394da22b15 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:19.800164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-99dacfd3-def7-461a-a067-71394da22b15 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:19.813341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99dacfd3-def7-461a-a067-71394da22b15 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:19.814419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99dacfd3-def7-461a-a067-71394da22b15 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:19.815714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99dacfd3-def7-461a-a067-71394da22b15 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:19.816366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99dacfd3-def7-461a-a067-71394da22b15 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:20.002131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-899c3be7-6f3f-4961-b612-bdc87f696869 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:20.021120 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-899c3be7-6f3f-4961-b612-bdc87f696869 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1470 microversion: 2.1 time: 0.499895 Jul 14 14:26:20.021734 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 133/245] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:19 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1470 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:20.069142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-99dacfd3-def7-461a-a067-71394da22b15 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:20.088910 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99dacfd3-def7-461a-a067-71394da22b15 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1276 microversion: 2.1 time: 0.296382 Jul 14 14:26:20.090222 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 113/246] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:19 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1276 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:20.466429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fec7c631-bf78-4b08-8d96-4964b3b6c445 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:20.467631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fec7c631-bf78-4b08-8d96-4964b3b6c445 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:20.490323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fec7c631-bf78-4b08-8d96-4964b3b6c445 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:20.491113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fec7c631-bf78-4b08-8d96-4964b3b6c445 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:20.492180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fec7c631-bf78-4b08-8d96-4964b3b6c445 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:20.498071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fec7c631-bf78-4b08-8d96-4964b3b6c445 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:21.039172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f9e83553-2804-4ccd-9805-035ff89bccc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:21.041061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f9e83553-2804-4ccd-9805-035ff89bccc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:21.048091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9e83553-2804-4ccd-9805-035ff89bccc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:21.048829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9e83553-2804-4ccd-9805-035ff89bccc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:21.049813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9e83553-2804-4ccd-9805-035ff89bccc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:21.050865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9e83553-2804-4ccd-9805-035ff89bccc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:21.125610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fec7c631-bf78-4b08-8d96-4964b3b6c445 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:21.151122 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fec7c631-bf78-4b08-8d96-4964b3b6c445 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1322 microversion: 2.1 time: 0.689055 Jul 14 14:26:21.152095 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 134/247] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:20 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1322 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:21.159206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8ee1594-b97f-4e5e-97a0-26b4dc575f8f tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:21.160426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8ee1594-b97f-4e5e-97a0-26b4dc575f8f tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:21.182811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8ee1594-b97f-4e5e-97a0-26b4dc575f8f tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:21.183706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8ee1594-b97f-4e5e-97a0-26b4dc575f8f tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:21.187356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8ee1594-b97f-4e5e-97a0-26b4dc575f8f tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:21.188837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8ee1594-b97f-4e5e-97a0-26b4dc575f8f tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:21.408841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d8ee1594-b97f-4e5e-97a0-26b4dc575f8f tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:21.421040 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8ee1594-b97f-4e5e-97a0-26b4dc575f8f tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1276 microversion: 2.1 time: 0.267228 Jul 14 14:26:21.431504 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 135/248] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:21 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:21.577847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f9e83553-2804-4ccd-9805-035ff89bccc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:21.594196 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f9e83553-2804-4ccd-9805-035ff89bccc3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1470 microversion: 2.1 time: 0.552382 Jul 14 14:26:21.597386 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 114/249] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:21 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1470 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:22.203352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-93d3f9fc-ff09-4685-8652-85952414af4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:22.215661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-93d3f9fc-ff09-4685-8652-85952414af4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:22.240872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93d3f9fc-ff09-4685-8652-85952414af4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:22.242833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93d3f9fc-ff09-4685-8652-85952414af4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:22.244592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93d3f9fc-ff09-4685-8652-85952414af4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:22.246644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93d3f9fc-ff09-4685-8652-85952414af4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:22.441591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3ff5d0fc-2542-4c9f-87c9-fabdd37d7822 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:22.443275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3ff5d0fc-2542-4c9f-87c9-fabdd37d7822 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:22.466362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ff5d0fc-2542-4c9f-87c9-fabdd37d7822 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:22.476883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ff5d0fc-2542-4c9f-87c9-fabdd37d7822 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:22.480176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ff5d0fc-2542-4c9f-87c9-fabdd37d7822 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:22.481771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ff5d0fc-2542-4c9f-87c9-fabdd37d7822 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:22.628920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3ff5d0fc-2542-4c9f-87c9-fabdd37d7822 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:22.639182 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3ff5d0fc-2542-4c9f-87c9-fabdd37d7822 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1276 microversion: 2.1 time: 0.202876 Jul 14 14:26:22.639764 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 115/250] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:22 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:22.654612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-094ec623-b76f-45c9-b6bf-ef9577eb25e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:22.655973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-094ec623-b76f-45c9-b6bf-ef9577eb25e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:22.668202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-094ec623-b76f-45c9-b6bf-ef9577eb25e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:22.668915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-094ec623-b76f-45c9-b6bf-ef9577eb25e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:22.671617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-094ec623-b76f-45c9-b6bf-ef9577eb25e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:22.673226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-094ec623-b76f-45c9-b6bf-ef9577eb25e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:22.722874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-93d3f9fc-ff09-4685-8652-85952414af4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:22.785367 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-93d3f9fc-ff09-4685-8652-85952414af4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1322 microversion: 2.1 time: 0.604902 Jul 14 14:26:22.786803 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 136/251] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:22 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1322 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:23.532645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-094ec623-b76f-45c9-b6bf-ef9577eb25e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:23.549298 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-094ec623-b76f-45c9-b6bf-ef9577eb25e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1470 microversion: 2.1 time: 0.907408 Jul 14 14:26:23.551968 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 116/252] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:22 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1470 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:23.662764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-01db974c-4c75-4edd-98f0-9c4be5624be2 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:23.663735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-01db974c-4c75-4edd-98f0-9c4be5624be2 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:23.671691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01db974c-4c75-4edd-98f0-9c4be5624be2 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:23.676252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01db974c-4c75-4edd-98f0-9c4be5624be2 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:23.677124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01db974c-4c75-4edd-98f0-9c4be5624be2 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:23.677568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01db974c-4c75-4edd-98f0-9c4be5624be2 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:23.810148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-698991dc-df3b-4377-8b87-fe1f7213d4ac tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:23.811275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-698991dc-df3b-4377-8b87-fe1f7213d4ac tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:23.828535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-698991dc-df3b-4377-8b87-fe1f7213d4ac tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:23.829453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-698991dc-df3b-4377-8b87-fe1f7213d4ac tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:23.831120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-698991dc-df3b-4377-8b87-fe1f7213d4ac tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:23.832133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-698991dc-df3b-4377-8b87-fe1f7213d4ac tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:23.926044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-01db974c-4c75-4edd-98f0-9c4be5624be2 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:23.934899 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-01db974c-4c75-4edd-98f0-9c4be5624be2 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1276 microversion: 2.1 time: 0.282663 Jul 14 14:26:23.951057 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 137/253] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:23 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1276 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:24.099303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6d3f57aa-1615-4cd1-af97-f25653bea145 req-c16abcbd-2805-4f2f-b106-43b3eae6ed30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4", "tag": "4cf02839-b4ee-43f7-b471-faa699b11f78"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:24.115953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6d3f57aa-1615-4cd1-af97-f25653bea145 req-c16abcbd-2805-4f2f-b106-43b3eae6ed30 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:24.124032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6d3f57aa-1615-4cd1-af97-f25653bea145 req-c16abcbd-2805-4f2f-b106-43b3eae6ed30 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:24.150751 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6d3f57aa-1615-4cd1-af97-f25653bea145 req-c16abcbd-2805-4f2f-b106-43b3eae6ed30 service nova] Creating event network-changed:4cf02839-b4ee-43f7-b471-faa699b11f78 for instance 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 on n-h2-767704-28 Jul 14 14:26:24.158235 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6d3f57aa-1615-4cd1-af97-f25653bea145 req-c16abcbd-2805-4f2f-b106-43b3eae6ed30 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062894 Jul 14 14:26:24.159499 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 138/254] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:24.344185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-698991dc-df3b-4377-8b87-fe1f7213d4ac tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:24.355646 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-698991dc-df3b-4377-8b87-fe1f7213d4ac tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1322 microversion: 2.1 time: 0.555303 Jul 14 14:26:24.357979 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 117/255] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:23 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:24.568500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1cc0613d-805e-4898-aaa5-f05079981243 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:24.569594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1cc0613d-805e-4898-aaa5-f05079981243 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:24.588461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cc0613d-805e-4898-aaa5-f05079981243 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:24.591778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cc0613d-805e-4898-aaa5-f05079981243 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:24.594268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cc0613d-805e-4898-aaa5-f05079981243 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:24.599566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cc0613d-805e-4898-aaa5-f05079981243 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:24.957530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4ea03c54-a0f4-4a02-bf63-26ad32585177 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:24.958153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4ea03c54-a0f4-4a02-bf63-26ad32585177 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:24.969891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ea03c54-a0f4-4a02-bf63-26ad32585177 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:24.970355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ea03c54-a0f4-4a02-bf63-26ad32585177 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:24.971137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ea03c54-a0f4-4a02-bf63-26ad32585177 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:24.974315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ea03c54-a0f4-4a02-bf63-26ad32585177 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:25.336327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1cc0613d-805e-4898-aaa5-f05079981243 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:25.359463 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1cc0613d-805e-4898-aaa5-f05079981243 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 0.788852 Jul 14 14:26:25.377435 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 139/256] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:24 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:25.402577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-54033250-c3fe-4714-90a2-6091af3358ab tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:25.403198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-54033250-c3fe-4714-90a2-6091af3358ab tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:25.416226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54033250-c3fe-4714-90a2-6091af3358ab tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:25.422402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54033250-c3fe-4714-90a2-6091af3358ab tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:25.425974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54033250-c3fe-4714-90a2-6091af3358ab tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:25.426861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54033250-c3fe-4714-90a2-6091af3358ab tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:25.486523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4ea03c54-a0f4-4a02-bf63-26ad32585177 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:25.501367 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4ea03c54-a0f4-4a02-bf63-26ad32585177 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1318 microversion: 2.1 time: 0.547619 Jul 14 14:26:25.501953 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 118/257] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:24 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:25.791836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-725876481", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "67bd9c0c-b9e0-42cc-9964-6a3ebfb39f9c"}], "security_groups": [{"name": "tempest-securitygroup--1052292661"}], "key_name": "tempest-keypair-323476641", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:25.902392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-54033250-c3fe-4714-90a2-6091af3358ab tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:25.913600 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-54033250-c3fe-4714-90a2-6091af3358ab tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1322 microversion: 2.1 time: 0.533079 Jul 14 14:26:25.918501 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 140/258] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:25 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:26.168056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] validate_networks() for [('67bd9c0c-b9e0-42cc-9964-6a3ebfb39f9c', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:26:26.379527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5ac665de-9b2c-40c1-a35f-4251deb0fbbb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:26.380325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5ac665de-9b2c-40c1-a35f-4251deb0fbbb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:26.382422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=10 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:26.401049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ac665de-9b2c-40c1-a35f-4251deb0fbbb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:26.401576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ac665de-9b2c-40c1-a35f-4251deb0fbbb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:26.402418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ac665de-9b2c-40c1-a35f-4251deb0fbbb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:26.402867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ac665de-9b2c-40c1-a35f-4251deb0fbbb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:26.549675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:26.659070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:26.915005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5ac665de-9b2c-40c1-a35f-4251deb0fbbb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:26.924756 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5ac665de-9b2c-40c1-a35f-4251deb0fbbb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 0.550290 Jul 14 14:26:26.925895 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 141/259] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:26 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:26.935959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6677c230-75bb-470e-a77c-476aa3127bfc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:26.936843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6677c230-75bb-470e-a77c-476aa3127bfc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:26.949011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6677c230-75bb-470e-a77c-476aa3127bfc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:26.953004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6677c230-75bb-470e-a77c-476aa3127bfc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:26.954485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6677c230-75bb-470e-a77c-476aa3127bfc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:26.955413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6677c230-75bb-470e-a77c-476aa3127bfc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:27.003593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:27.473760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6677c230-75bb-470e-a77c-476aa3127bfc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:27.486840 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6677c230-75bb-470e-a77c-476aa3127bfc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1318 microversion: 2.1 time: 0.557952 Jul 14 14:26:27.488449 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 142/260] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:26 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:27.498232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-238a1bb1-b0e3-4cd5-9154-003025a7476b req-f4989a12-0f23-4f21-9e81-7ea035625006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6661f76a-906a-4e9a-b5a6-52cbd26679c7", "tag": "21e35f11-21a6-4afe-aac4-a5beffcecba2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:27.522427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:26:27.523465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:26:27.524367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:26:27.524939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:26:27.525526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:26:27.539387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-238a1bb1-b0e3-4cd5-9154-003025a7476b req-f4989a12-0f23-4f21-9e81-7ea035625006 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:27.542887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-238a1bb1-b0e3-4cd5-9154-003025a7476b req-f4989a12-0f23-4f21-9e81-7ea035625006 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:27.546388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:27.557877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:27.559134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:27.559792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:27.579292 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-238a1bb1-b0e3-4cd5-9154-003025a7476b req-f4989a12-0f23-4f21-9e81-7ea035625006 service nova] Creating event network-changed:21e35f11-21a6-4afe-aac4-a5beffcecba2 for instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 on n-h2-767704-28 Jul 14 14:26:27.598021 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-238a1bb1-b0e3-4cd5-9154-003025a7476b req-f4989a12-0f23-4f21-9e81-7ea035625006 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106285 Jul 14 14:26:27.598991 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 143/261] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:27.601230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Getting quotas for project cd30d3b5d4b84104ae34623d3121a080. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:26:27.608344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Getting quotas for user 6939fb96384749f9b9358e636845106a and project cd30d3b5d4b84104ae34623d3121a080. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:26:27.611339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ddbafd91-e57c-43e3-b9b7-a02a96d8f811 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:27.616553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ddbafd91-e57c-43e3-b9b7-a02a96d8f811 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:27.629364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=89,nova_api:DELETE=5 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:27.637718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddbafd91-e57c-43e3-b9b7-a02a96d8f811 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:27.638333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:26:27.638460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddbafd91-e57c-43e3-b9b7-a02a96d8f811 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:27.639880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddbafd91-e57c-43e3-b9b7-a02a96d8f811 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:27.640914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:26:27.641947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddbafd91-e57c-43e3-b9b7-a02a96d8f811 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:27.738359 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-61930a00-84cd-42dc-806e-3541b58187a0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.949775 Jul 14 14:26:27.744435 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 119/262] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:26:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:26:27.752879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-350dda75-d475-4a03-b578-1932ce466177 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:27.756053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-350dda75-d475-4a03-b578-1932ce466177 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:27.926758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-350dda75-d475-4a03-b578-1932ce466177 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:27.944103 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-350dda75-d475-4a03-b578-1932ce466177 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1240 microversion: 2.1 time: 0.197635 Jul 14 14:26:27.946637 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 120/263] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:27 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1240 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:27.963848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-843aa89a-bb77-42d2-a34b-0d304c5e7adf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:27.969235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-843aa89a-bb77-42d2-a34b-0d304c5e7adf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:27.984911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-843aa89a-bb77-42d2-a34b-0d304c5e7adf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:27.986560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-843aa89a-bb77-42d2-a34b-0d304c5e7adf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:27.987796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-843aa89a-bb77-42d2-a34b-0d304c5e7adf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:27.993510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-843aa89a-bb77-42d2-a34b-0d304c5e7adf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:28.939812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ddbafd91-e57c-43e3-b9b7-a02a96d8f811 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:28.952172 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ddbafd91-e57c-43e3-b9b7-a02a96d8f811 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1322 microversion: 2.1 time: 1.348357 Jul 14 14:26:28.970731 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 144/264] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:27 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1322 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:29.081370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-843aa89a-bb77-42d2-a34b-0d304c5e7adf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:29.097031 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-843aa89a-bb77-42d2-a34b-0d304c5e7adf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 1.148118 Jul 14 14:26:29.098169 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 121/265] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:27 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:29.104675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39329c0b-4e2e-49f6-b7d4-4595f93a91cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:29.107907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-39329c0b-4e2e-49f6-b7d4-4595f93a91cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:29.115147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39329c0b-4e2e-49f6-b7d4-4595f93a91cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:29.116065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39329c0b-4e2e-49f6-b7d4-4595f93a91cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:29.117712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39329c0b-4e2e-49f6-b7d4-4595f93a91cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:29.118520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39329c0b-4e2e-49f6-b7d4-4595f93a91cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:29.399095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-39329c0b-4e2e-49f6-b7d4-4595f93a91cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:29.414572 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-39329c0b-4e2e-49f6-b7d4-4595f93a91cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1318 microversion: 2.1 time: 0.311712 Jul 14 14:26:29.417330 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 122/266] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:29 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:29.432335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5246f16-5a68-401c-8fd8-a8c9a24cd27f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:29.436089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d5246f16-5a68-401c-8fd8-a8c9a24cd27f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:29.451657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5246f16-5a68-401c-8fd8-a8c9a24cd27f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:29.457832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5246f16-5a68-401c-8fd8-a8c9a24cd27f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:29.458876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5246f16-5a68-401c-8fd8-a8c9a24cd27f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:29.459792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5246f16-5a68-401c-8fd8-a8c9a24cd27f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:29.563979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d5246f16-5a68-401c-8fd8-a8c9a24cd27f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:29.576240 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d5246f16-5a68-401c-8fd8-a8c9a24cd27f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1310 microversion: 2.1 time: 0.157765 Jul 14 14:26:29.577361 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 123/267] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:29 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1310 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:29.598106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fe89c79a-0c5a-4404-8e22-131e810db8e0 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1238136474", "id": 1056862597, "os-flavor-access:is_public": "False"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:29.599911 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:29.599911 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:29.618573 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fe89c79a-0c5a-4404-8e22-131e810db8e0 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.646272 Jul 14 14:26:29.619759 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 145/268] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:26:28 2022] POST /compute/v2.1/flavors => generated 439 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:29.630741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9ccf1ca0-28b5-4d95-85fa-4e1c21921681 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "713f619a2b664f2c812d833095b81fc7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:29.632591 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:29.632591 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:29.738855 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9ccf1ca0-28b5-4d95-85fa-4e1c21921681 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/1056862597/action" status: 200 len: 97 microversion: 2.1 time: 0.111847 Jul 14 14:26:29.740044 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 124/269] 10.222.0.81 () {60 vars in 1199 bytes} [Thu Jul 14 14:26:29 2022] POST /compute/v2.1/flavors/1056862597/action => generated 97 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:29.750533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a93c9172-be7a-441e-aa2c-c4ba30e6f1a1 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "713f619a2b664f2c812d833095b81fc7"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:29.752224 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:29.752224 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:29.915501 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-a93c9172-be7a-441e-aa2c-c4ba30e6f1a1 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] HTTP exception thrown: Flavor access already exists for flavor 21 and project 713f619a2b664f2c812d833095b81fc7 combination. Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a93c9172-be7a-441e-aa2c-c4ba30e6f1a1 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Request method failure captured: Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/flavors/1056862597/action HTTP/1.1 Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 67 Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CeTE3kPbSzbtviNBM2fiFzVWHwDLDkkh0JW882-AYtCeUgQ_DrdZ3h6BXJDURv4_HdTDIszFwzWg8O6GnmvFLaQD7eeLjMZgjsiHPdSUGgBsx82LLrPNbKih2il9maH49BgmpVG6MSh5BR_qxXFWiUNA_gH0oXskVE-iLJ7hMh1zt4 Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 6909f4c732a14bb5a69bba1a6b43b96d Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1210342997 Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:26:29.920284 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:26:29.921955 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6909f4c732a14bb5a69bba1a6b43b96d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6909f4c732a14bb5a69bba1a6b43b96d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6909f4c732a14bb5a69bba1a6b43b96d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6909f4c732a14bb5a69bba1a6b43b96d"}]}] Jul 14 14:26:29.921955 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1210342997 Jul 14 14:26:29.921955 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 6909f4c732a14bb5a69bba1a6b43b96d Jul 14 14:26:29.921955 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1210342997 Jul 14 14:26:29.921955 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin Jul 14 14:26:29.921955 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:29.921955 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:29.921955 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 0b35fa70a3a249809010977be18386e5 Jul 14 14:26:29.921955 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin Jul 14 14:26:29.921955 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:26:29.921955 n-d-767704-28 devstack@n-api.service[119512]: {"addTenantAccess": {"tenant": "713f619a2b664f2c812d833095b81fc7"}} Jul 14 14:26:29.921955 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: exception: Flavor access already exists for flavor 21 and project 713f619a2b664f2c812d833095b81fc7 combination. Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '1056862597', 'body': {'addTenantAccess': {'tenant': '713f619a2b664f2c812d833095b81fc7'}}} Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result.read() Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:26:29.922794 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '21-713f619a2b664f2c812d833095b81fc7' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi session.flush() Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 14:26:29.924104 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 14:26:29.925645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:26:29.927067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result.read() Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '21-713f619a2b664f2c812d833095b81fc7' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 14, 14, 26, 29, 897893), 'updated_at': None, 'flavor_id': 21, 'project_id': '713f619a2b664f2c812d833095b81fc7'}] Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:29.929438 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 21 and project 713f619a2b664f2c812d833095b81fc7 combination. Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:29.931017 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 21 and project 713f619a2b664f2c812d833095b81fc7 combination. Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:29.932311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:29.933716 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 21 and project 713f619a2b664f2c812d833095b81fc7 combination. Jul 14 14:26:29.933716 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:29.933716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a93c9172-be7a-441e-aa2c-c4ba30e6f1a1 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Returning 409 to user: Flavor access already exists for flavor 21 and project 713f619a2b664f2c812d833095b81fc7 combination. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:29.934974 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a93c9172-be7a-441e-aa2c-c4ba30e6f1a1 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/1056862597/action" status: 409 len: 152 microversion: 2.1 time: 0.188395 Jul 14 14:26:29.939920 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 146/270] 10.222.0.81 () {60 vars in 1199 bytes} [Thu Jul 14 14:26:29 2022] POST /compute/v2.1/flavors/1056862597/action => generated 152 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:26:29.949908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-326bc34b-79d8-49a6-b930-ee61c4c14b82 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "713f619a2b664f2c812d833095b81fc7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:29.951611 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:29.951611 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:29.986961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-361eb6ac-cb08-4eb1-8466-283a2ba82b09 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:29.987935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-361eb6ac-cb08-4eb1-8466-283a2ba82b09 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:29.996626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-361eb6ac-cb08-4eb1-8466-283a2ba82b09 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:29.997384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-361eb6ac-cb08-4eb1-8466-283a2ba82b09 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:29.998451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-361eb6ac-cb08-4eb1-8466-283a2ba82b09 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:29.999272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-361eb6ac-cb08-4eb1-8466-283a2ba82b09 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:30.120917 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-326bc34b-79d8-49a6-b930-ee61c4c14b82 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/1056862597/action" status: 200 len: 21 microversion: 2.1 time: 0.179781 Jul 14 14:26:30.121539 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 125/271] 10.222.0.81 () {60 vars in 1199 bytes} [Thu Jul 14 14:26:29 2022] POST /compute/v2.1/flavors/1056862597/action => generated 21 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:30.132614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99968bc1-e6c0-432c-9a67-21a6a7d07911 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:30.133327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-99968bc1-e6c0-432c-9a67-21a6a7d07911 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:30.144524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99968bc1-e6c0-432c-9a67-21a6a7d07911 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:30.147092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99968bc1-e6c0-432c-9a67-21a6a7d07911 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:30.154125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99968bc1-e6c0-432c-9a67-21a6a7d07911 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:30.154589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99968bc1-e6c0-432c-9a67-21a6a7d07911 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:30.355001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-361eb6ac-cb08-4eb1-8466-283a2ba82b09 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:30.374386 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-361eb6ac-cb08-4eb1-8466-283a2ba82b09 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1322 microversion: 2.1 time: 0.391611 Jul 14 14:26:30.377118 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 147/272] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:29 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:30.383617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4b0fee00-24f0-4841-8583-8cba18e23627 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:30.394322 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:30.394322 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:30.445984 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4b0fee00-24f0-4841-8583-8cba18e23627 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1056862597" status: 202 len: 0 microversion: 2.1 time: 0.065964 Jul 14 14:26:30.446828 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 148/273] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 14:26:30 2022] DELETE /compute/v2.1/flavors/1056862597 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:26:30.459452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-99968bc1-e6c0-432c-9a67-21a6a7d07911 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:30.470403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-02941a3b-7268-4b5d-ac33-afbbb324d7af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:30.471034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-02941a3b-7268-4b5d-ac33-afbbb324d7af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:30.473505 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99968bc1-e6c0-432c-9a67-21a6a7d07911 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 0.350948 Jul 14 14:26:30.476983 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 126/274] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:30 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:30.487213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-82c5fc9b-e8ed-4e9c-ba59-ebfddc079394 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:30.500224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02941a3b-7268-4b5d-ac33-afbbb324d7af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:30.500679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02941a3b-7268-4b5d-ac33-afbbb324d7af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:30.501496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02941a3b-7268-4b5d-ac33-afbbb324d7af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:30.501938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02941a3b-7268-4b5d-ac33-afbbb324d7af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:30.531889 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-82c5fc9b-e8ed-4e9c-ba59-ebfddc079394 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.053181 Jul 14 14:26:30.533227 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 127/275] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:26:30 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:30.553149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c6df7e3a-90ce-4cf4-99cf-a911634b0191 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1775755913", "id": 1038394928, "os-flavor-access:is_public": "True"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:30.556170 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:30.556170 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:30.578041 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c6df7e3a-90ce-4cf4-99cf-a911634b0191 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.030127 Jul 14 14:26:30.579856 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 128/276] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:26:30 2022] POST /compute/v2.1/flavors => generated 438 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:30.598127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6903a78d-50ac-41b8-8beb-e5dd0f1d427b tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:30.601628 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:30.601628 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:30.616560 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-6903a78d-50ac-41b8-8beb-e5dd0f1d427b tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6903a78d-50ac-41b8-8beb-e5dd0f1d427b tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Request method failure captured: Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/flavors/1038394928/os-flavor-access HTTP/1.1 Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CeTE3kPbSzbtviNBM2fiFzVWHwDLDkkh0JW882-AYtCeUgQ_DrdZ3h6BXJDURv4_HdTDIszFwzWg8O6GnmvFLaQD7eeLjMZgjsiHPdSUGgBsx82LLrPNbKih2il9maH49BgmpVG6MSh5BR_qxXFWiUNA_gH0oXskVE-iLJ7hMh1zt4 Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 6909f4c732a14bb5a69bba1a6b43b96d Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1210342997 Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:26:30.622819 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:26:30.624604 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6909f4c732a14bb5a69bba1a6b43b96d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6909f4c732a14bb5a69bba1a6b43b96d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6909f4c732a14bb5a69bba1a6b43b96d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6909f4c732a14bb5a69bba1a6b43b96d"}]}] Jul 14 14:26:30.624604 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1210342997 Jul 14 14:26:30.624604 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 6909f4c732a14bb5a69bba1a6b43b96d Jul 14 14:26:30.624604 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1210342997 Jul 14 14:26:30.624604 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin Jul 14 14:26:30.624604 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:26:30.624604 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:26:30.624604 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 0b35fa70a3a249809010977be18386e5 Jul 14 14:26:30.624604 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin Jul 14 14:26:30.624604 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:26:30.624604 n-d-767704-28 devstack@n-api.service[119511]: exception: Access list not available for public flavors. Jul 14 14:26:30.624604 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'flavor_id': '1038394928'} Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 14 14:26:30.625510 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:30.629954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6903a78d-50ac-41b8-8beb-e5dd0f1d427b tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:30.637068 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6903a78d-50ac-41b8-8beb-e5dd0f1d427b tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/1038394928/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.045671 Jul 14 14:26:30.638717 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 129/277] 10.222.0.81 () {58 vars in 1208 bytes} [Thu Jul 14 14:26:30 2022] GET /compute/v2.1/flavors/1038394928/os-flavor-access => generated 91 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:26:30.647051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b71e6b52-8d0e-46a8-98cc-4d48e0e809f9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:30.652135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b71e6b52-8d0e-46a8-98cc-4d48e0e809f9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:30.668227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b71e6b52-8d0e-46a8-98cc-4d48e0e809f9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:30.669051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b71e6b52-8d0e-46a8-98cc-4d48e0e809f9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:30.670232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b71e6b52-8d0e-46a8-98cc-4d48e0e809f9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:30.671531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b71e6b52-8d0e-46a8-98cc-4d48e0e809f9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:30.794293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b71e6b52-8d0e-46a8-98cc-4d48e0e809f9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:30.800155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-02941a3b-7268-4b5d-ac33-afbbb324d7af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:30.811148 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b71e6b52-8d0e-46a8-98cc-4d48e0e809f9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1298 microversion: 2.1 time: 0.171035 Jul 14 14:26:30.813886 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-02941a3b-7268-4b5d-ac33-afbbb324d7af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1318 microversion: 2.1 time: 0.362942 Jul 14 14:26:30.817320 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 149/278] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:30 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:30.824895 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 130/279] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:30 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1298 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:30.829935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2ec4658f-095d-45dd-b5a8-61d924b1a566 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:30.831028 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:30.831028 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:30.863226 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2ec4658f-095d-45dd-b5a8-61d924b1a566 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1038394928" status: 202 len: 0 microversion: 2.1 time: 0.036857 Jul 14 14:26:30.864337 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 150/280] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 14:26:30 2022] DELETE /compute/v2.1/flavors/1038394928 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:26:30.874258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-085fa5a7-3d27-478d-a21e-61cac3916c80 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:30.903189 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-085fa5a7-3d27-478d-a21e-61cac3916c80 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.032434 Jul 14 14:26:30.913703 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 131/281] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:26:30 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:30.926805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-50f0a71e-e4e3-4a7f-88a2-2f1425e045af tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1561534117", "id": 1468865248, "os-flavor-access:is_public": "False"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:30.930313 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:30.930313 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:30.959981 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-50f0a71e-e4e3-4a7f-88a2-2f1425e045af tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.042089 Jul 14 14:26:30.961733 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 151/282] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:26:30 2022] POST /compute/v2.1/flavors => generated 439 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:31.361758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-631a5136-af38-4f75-9a30-d54faa817585 tempest-FlavorsAccessNegativeTestJSON-1991596555 tempest-FlavorsAccessNegativeTestJSON-1991596555-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "713f619a2b664f2c812d833095b81fc7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:31.363000 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:31.363000 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:31.363861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-631a5136-af38-4f75-9a30-d54faa817585 tempest-FlavorsAccessNegativeTestJSON-1991596555 tempest-FlavorsAccessNegativeTestJSON-1991596555-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'e2d260cca31e4e05b3024b46edffd1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713f619a2b664f2c812d833095b81fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-631a5136-af38-4f75-9a30-d54faa817585 tempest-FlavorsAccessNegativeTestJSON-1991596555 tempest-FlavorsAccessNegativeTestJSON-1991596555-project] Request method failure captured: Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/flavors/1468865248/action HTTP/1.1 Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 67 Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CeRhLLU2guqSg6FWOnznsXyisQuAC2jIhtXit0YbE5AONOSbYE1G_s9_rpOz2zuyjpTIMhfUvJ5vY0nLn08iamCSTdBsFX8jD795U3WQXb2vvyAa1RbrgLeRsLOTAe25Y8ciFlvyJxbwe4KpLR_zyLCU_hyaNaGOUptJ9kEsHi2e7w Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 713f619a2b664f2c812d833095b81fc7 Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1991596555 Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:26:31.365539 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:26:31.366806 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/713f619a2b664f2c812d833095b81fc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/713f619a2b664f2c812d833095b81fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_713f619a2b664f2c812d833095b81fc7", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/713f619a2b664f2c812d833095b81fc7"}]}] Jul 14 14:26:31.366806 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1991596555 Jul 14 14:26:31.366806 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 713f619a2b664f2c812d833095b81fc7 Jul 14 14:26:31.366806 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1991596555 Jul 14 14:26:31.366806 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FlavorsAccessNegativeTestJSON-1991596555-project Jul 14 14:26:31.366806 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:26:31.366806 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:26:31.366806 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: e2d260cca31e4e05b3024b46edffd1df Jul 14 14:26:31.366806 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1991596555-project Jul 14 14:26:31.366806 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:26:31.366806 n-d-767704-28 devstack@n-api.service[119511]: {"addTenantAccess": {"tenant": "713f619a2b664f2c812d833095b81fc7"}} Jul 14 14:26:31.366806 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '1468865248', 'body': {'addTenantAccess': {'tenant': '713f619a2b664f2c812d833095b81fc7'}}} Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:26:31.368121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 14 14:26:31.370037 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:31.371218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-631a5136-af38-4f75-9a30-d54faa817585 tempest-FlavorsAccessNegativeTestJSON-1991596555 tempest-FlavorsAccessNegativeTestJSON-1991596555-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:31.371218 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-631a5136-af38-4f75-9a30-d54faa817585 tempest-FlavorsAccessNegativeTestJSON-1991596555 tempest-FlavorsAccessNegativeTestJSON-1991596555-project] 10.222.0.81 "POST /compute/v2.1/flavors/1468865248/action" status: 403 len: 130 microversion: 2.1 time: 0.398435 Jul 14 14:26:31.371218 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 132/283] 10.222.0.81 () {60 vars in 1199 bytes} [Thu Jul 14 14:26:30 2022] POST /compute/v2.1/flavors/1468865248/action => generated 130 bytes in 401 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:31.378174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3824266d-c4f2-4a7b-9ca7-c34d8ca4035e tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:31.407667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e0042637-b01a-4c7c-805c-03860acadab7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:31.408938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e0042637-b01a-4c7c-805c-03860acadab7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:31.419231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e0042637-b01a-4c7c-805c-03860acadab7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:31.420415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e0042637-b01a-4c7c-805c-03860acadab7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:31.422181 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3824266d-c4f2-4a7b-9ca7-c34d8ca4035e tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1468865248" status: 202 len: 0 microversion: 2.1 time: 0.048040 Jul 14 14:26:31.424144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e0042637-b01a-4c7c-805c-03860acadab7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:31.424639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e0042637-b01a-4c7c-805c-03860acadab7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:31.429209 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 152/284] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 14:26:31 2022] DELETE /compute/v2.1/flavors/1468865248 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:26:31.436389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5ac5aed1-4e75-465a-adb3-c7f38222117f tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:31.460324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:31.468317 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5ac5aed1-4e75-465a-adb3-c7f38222117f tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.036251 Jul 14 14:26:31.469832 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 153/285] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:26:31 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:31.494904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e906c52-8174-4752-aac5-e08f53502d19 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-595349973", "id": 884432878, "os-flavor-access:is_public": "False"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:31.521640 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0e906c52-8174-4752-aac5-e08f53502d19 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.033987 Jul 14 14:26:31.522866 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 154/286] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:26:31 2022] POST /compute/v2.1/flavors => generated 435 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:31.530385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3deb7c46-cf7b-4886-b53d-c7740ad3087c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:31.531008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3deb7c46-cf7b-4886-b53d-c7740ad3087c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:31.557255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3deb7c46-cf7b-4886-b53d-c7740ad3087c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:31.557886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3deb7c46-cf7b-4886-b53d-c7740ad3087c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:31.558981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3deb7c46-cf7b-4886-b53d-c7740ad3087c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:31.559520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3deb7c46-cf7b-4886-b53d-c7740ad3087c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:31.645118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e0042637-b01a-4c7c-805c-03860acadab7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:31.656531 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e0042637-b01a-4c7c-805c-03860acadab7 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1322 microversion: 2.1 time: 0.267143 Jul 14 14:26:31.658156 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 133/287] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:31 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:31.673693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0ffb7af3-0a0c-430a-b1c0-c54707723350 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "713f619a2b664f2c812d833095b81fc7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:31.675714 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:31.675714 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:31.807720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3deb7c46-cf7b-4886-b53d-c7740ad3087c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:31.817161 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3deb7c46-cf7b-4886-b53d-c7740ad3087c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 0.291551 Jul 14 14:26:31.817975 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 155/288] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:31 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:31.839498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-da18b972-735e-425e-9131-0b470476f716 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:31.840463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-da18b972-735e-425e-9131-0b470476f716 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:31.847783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da18b972-735e-425e-9131-0b470476f716 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:31.848531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da18b972-735e-425e-9131-0b470476f716 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:31.849691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da18b972-735e-425e-9131-0b470476f716 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:31.850385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da18b972-735e-425e-9131-0b470476f716 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:31.958376 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0ffb7af3-0a0c-430a-b1c0-c54707723350 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/884432878/action" status: 200 len: 96 microversion: 2.1 time: 0.298579 Jul 14 14:26:31.959368 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 134/289] 10.222.0.81 () {60 vars in 1196 bytes} [Thu Jul 14 14:26:31 2022] POST /compute/v2.1/flavors/884432878/action => generated 96 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:31.973835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6f5c6e1c-6045-4f15-a3e6-e3b65e5abd96 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:31.979501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6f5c6e1c-6045-4f15-a3e6-e3b65e5abd96 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:31.996228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f5c6e1c-6045-4f15-a3e6-e3b65e5abd96 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:31.998457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f5c6e1c-6045-4f15-a3e6-e3b65e5abd96 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:32.001587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f5c6e1c-6045-4f15-a3e6-e3b65e5abd96 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:32.002240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f5c6e1c-6045-4f15-a3e6-e3b65e5abd96 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:32.149201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6f5c6e1c-6045-4f15-a3e6-e3b65e5abd96 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:32.161516 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6f5c6e1c-6045-4f15-a3e6-e3b65e5abd96 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1298 microversion: 2.1 time: 0.196176 Jul 14 14:26:32.163168 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 135/290] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:31 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1298 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:32.174054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-da18b972-735e-425e-9131-0b470476f716 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:32.176802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bffe225b-d9d2-47b0-8b33-c0f2c8360de6 tempest-FlavorsAccessNegativeTestJSON-1991596555 tempest-FlavorsAccessNegativeTestJSON-1991596555-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "713f619a2b664f2c812d833095b81fc7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:32.178446 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:32.178446 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:32.181874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bffe225b-d9d2-47b0-8b33-c0f2c8360de6 tempest-FlavorsAccessNegativeTestJSON-1991596555 tempest-FlavorsAccessNegativeTestJSON-1991596555-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'e2d260cca31e4e05b3024b46edffd1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713f619a2b664f2c812d833095b81fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bffe225b-d9d2-47b0-8b33-c0f2c8360de6 tempest-FlavorsAccessNegativeTestJSON-1991596555 tempest-FlavorsAccessNegativeTestJSON-1991596555-project] Request method failure captured: Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/flavors/884432878/action HTTP/1.1 Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 70 Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CeRhLLU2guqSg6FWOnznsXyisQuAC2jIhtXit0YbE5AONOSbYE1G_s9_rpOz2zuyjpTIMhfUvJ5vY0nLn08iamCSTdBsFX8jD795U3WQXb2vvyAa1RbrgLeRsLOTAe25Y8ciFlvyJxbwe4KpLR_zyLCU_hyaNaGOUptJ9kEsHi2e7w Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 713f619a2b664f2c812d833095b81fc7 Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1991596555 Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:26:32.186579 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:26:32.188290 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/713f619a2b664f2c812d833095b81fc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/713f619a2b664f2c812d833095b81fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_713f619a2b664f2c812d833095b81fc7", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/713f619a2b664f2c812d833095b81fc7"}]}] Jul 14 14:26:32.188290 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1991596555 Jul 14 14:26:32.188290 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 713f619a2b664f2c812d833095b81fc7 Jul 14 14:26:32.188290 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1991596555 Jul 14 14:26:32.188290 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FlavorsAccessNegativeTestJSON-1991596555-project Jul 14 14:26:32.188290 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:26:32.188290 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:26:32.188290 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: e2d260cca31e4e05b3024b46edffd1df Jul 14 14:26:32.188290 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1991596555-project Jul 14 14:26:32.188290 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:26:32.188290 n-d-767704-28 devstack@n-api.service[119511]: {"removeTenantAccess": {"tenant": "713f619a2b664f2c812d833095b81fc7"}} Jul 14 14:26:32.188290 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '884432878', 'body': {'removeTenantAccess': {'tenant': '713f619a2b664f2c812d833095b81fc7'}}} Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can( Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:32.189253 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 14 14:26:32.190721 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:26:32.191944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bffe225b-d9d2-47b0-8b33-c0f2c8360de6 tempest-FlavorsAccessNegativeTestJSON-1991596555 tempest-FlavorsAccessNegativeTestJSON-1991596555-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:32.193617 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-da18b972-735e-425e-9131-0b470476f716 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1318 microversion: 2.1 time: 0.354081 Jul 14 14:26:32.195512 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bffe225b-d9d2-47b0-8b33-c0f2c8360de6 tempest-FlavorsAccessNegativeTestJSON-1991596555 tempest-FlavorsAccessNegativeTestJSON-1991596555-project] 10.222.0.81 "POST /compute/v2.1/flavors/884432878/action" status: 403 len: 133 microversion: 2.1 time: 0.025646 Jul 14 14:26:32.195761 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 156/291] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:31 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:32.200347 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 136/292] 10.222.0.81 () {60 vars in 1196 bytes} [Thu Jul 14 14:26:32 2022] POST /compute/v2.1/flavors/884432878/action => generated 133 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:32.206267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-897471cd-44f0-4285-9009-c39ba87bff9f tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "713f619a2b664f2c812d833095b81fc7"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:32.207760 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:32.207760 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:32.308917 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-897471cd-44f0-4285-9009-c39ba87bff9f tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/884432878/action" status: 200 len: 21 microversion: 2.1 time: 0.106710 Jul 14 14:26:32.319829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4ec66b62-0300-4103-b6f1-ef7448a47ee7 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:32.321704 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:32.321704 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:32.325490 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 157/293] 10.222.0.81 () {60 vars in 1196 bytes} [Thu Jul 14 14:26:32 2022] POST /compute/v2.1/flavors/884432878/action => generated 21 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:32.347247 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4ec66b62-0300-4103-b6f1-ef7448a47ee7 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/884432878" status: 202 len: 0 microversion: 2.1 time: 0.031238 Jul 14 14:26:32.347693 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 137/294] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:26:32 2022] DELETE /compute/v2.1/flavors/884432878 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:26:32.356562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c430f669-8fa2-4e5f-8f1f-102cc4ea132b tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:32.403555 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c430f669-8fa2-4e5f-8f1f-102cc4ea132b tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.050708 Jul 14 14:26:32.404145 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 158/295] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:26:32 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:32.422333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0e0c18f6-b6ce-4c0f-9a30-c6c54c8ff0ef tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1511285924", "id": 235329383, "os-flavor-access:is_public": "False"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:32.424094 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:32.424094 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:32.431279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:DELETE=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:32.471189 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0e0c18f6-b6ce-4c0f-9a30-c6c54c8ff0ef tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.052657 Jul 14 14:26:32.472875 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 138/296] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:26:32 2022] POST /compute/v2.1/flavors => generated 436 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:32.493683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-06790a1f-f80a-4f37-9416-40e20f938fe3 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cef90d85cf584eb3b2eaf192456440ca"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:32.677662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-84674f73-08dc-416c-be2a-36fad081389b tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:32.681690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-84674f73-08dc-416c-be2a-36fad081389b tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:32.707769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84674f73-08dc-416c-be2a-36fad081389b tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:32.715693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84674f73-08dc-416c-be2a-36fad081389b tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:32.731604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84674f73-08dc-416c-be2a-36fad081389b tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:32.734013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84674f73-08dc-416c-be2a-36fad081389b tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:32.865705 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-06790a1f-f80a-4f37-9416-40e20f938fe3 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] HTTP exception thrown: Flavor access not found for 25 / cef90d85cf584eb3b2eaf192456440ca combination. Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-06790a1f-f80a-4f37-9416-40e20f938fe3 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Request method failure captured: Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/flavors/235329383/action HTTP/1.1 Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 70 Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CeTE3kPbSzbtviNBM2fiFzVWHwDLDkkh0JW882-AYtCeUgQ_DrdZ3h6BXJDURv4_HdTDIszFwzWg8O6GnmvFLaQD7eeLjMZgjsiHPdSUGgBsx82LLrPNbKih2il9maH49BgmpVG6MSh5BR_qxXFWiUNA_gH0oXskVE-iLJ7hMh1zt4 Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 6909f4c732a14bb5a69bba1a6b43b96d Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1210342997 Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:26:32.870480 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:26:32.871828 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6909f4c732a14bb5a69bba1a6b43b96d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6909f4c732a14bb5a69bba1a6b43b96d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6909f4c732a14bb5a69bba1a6b43b96d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6909f4c732a14bb5a69bba1a6b43b96d"}]}] Jul 14 14:26:32.871828 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1210342997 Jul 14 14:26:32.871828 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 6909f4c732a14bb5a69bba1a6b43b96d Jul 14 14:26:32.871828 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1210342997 Jul 14 14:26:32.871828 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin Jul 14 14:26:32.871828 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:32.871828 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:32.871828 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 0b35fa70a3a249809010977be18386e5 Jul 14 14:26:32.871828 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin Jul 14 14:26:32.871828 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:26:32.871828 n-d-767704-28 devstack@n-api.service[119512]: {"removeTenantAccess": {"tenant": "cef90d85cf584eb3b2eaf192456440ca"}} Jul 14 14:26:32.871828 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: exception: Flavor access not found for 25 / cef90d85cf584eb3b2eaf192456440ca combination. Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '235329383', 'body': {'removeTenantAccess': {'tenant': 'cef90d85cf584eb3b2eaf192456440ca'}}} Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 14 14:26:32.872479 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 25 / cef90d85cf584eb3b2eaf192456440ca combination. Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 25 / cef90d85cf584eb3b2eaf192456440ca combination. Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:32.873490 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:32.874542 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:32.874542 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:32.874542 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:32.874542 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:32.874542 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 25 / cef90d85cf584eb3b2eaf192456440ca combination. Jul 14 14:26:32.874542 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:32.880748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-06790a1f-f80a-4f37-9416-40e20f938fe3 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Returning 404 to user: Flavor access not found for 25 / cef90d85cf584eb3b2eaf192456440ca combination. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:32.883530 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-06790a1f-f80a-4f37-9416-40e20f938fe3 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/235329383/action" status: 404 len: 124 microversion: 2.1 time: 0.403222 Jul 14 14:26:32.889428 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 159/297] 10.222.0.81 () {60 vars in 1196 bytes} [Thu Jul 14 14:26:32 2022] POST /compute/v2.1/flavors/235329383/action => generated 124 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:32.914629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aba62b9f-b142-48bb-905d-084fdb27a986 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:32.915674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aba62b9f-b142-48bb-905d-084fdb27a986 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:32.927254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aba62b9f-b142-48bb-905d-084fdb27a986 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:32.927992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aba62b9f-b142-48bb-905d-084fdb27a986 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:32.940590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aba62b9f-b142-48bb-905d-084fdb27a986 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:32.942532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aba62b9f-b142-48bb-905d-084fdb27a986 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:33.132127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-84674f73-08dc-416c-be2a-36fad081389b tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:33.141956 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-84674f73-08dc-416c-be2a-36fad081389b tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1322 microversion: 2.1 time: 0.470945 Jul 14 14:26:33.152821 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 139/298] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:32 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1322 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:33.158301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f0744dcd-ad0c-49d5-a44c-0112c7c85829 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:33.159745 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:33.159745 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:33.189048 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f0744dcd-ad0c-49d5-a44c-0112c7c85829 tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/235329383" status: 202 len: 0 microversion: 2.1 time: 0.034069 Jul 14 14:26:33.189892 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 140/299] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:26:33 2022] DELETE /compute/v2.1/flavors/235329383 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:26:33.195543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d086d4ea-4746-4652-b675-697ffa07664c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:33.196457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d086d4ea-4746-4652-b675-697ffa07664c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:33.205401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d086d4ea-4746-4652-b675-697ffa07664c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:33.207109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d086d4ea-4746-4652-b675-697ffa07664c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:33.208020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d086d4ea-4746-4652-b675-697ffa07664c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:33.208715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d086d4ea-4746-4652-b675-697ffa07664c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:33.339812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-aba62b9f-b142-48bb-905d-084fdb27a986 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:33.349230 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aba62b9f-b142-48bb-905d-084fdb27a986 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 0.458018 Jul 14 14:26:33.359896 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 160/300] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:32 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:33.364542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-163b630b-2d16-49b7-a80c-63dba336bb4a tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:33.385546 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-163b630b-2d16-49b7-a80c-63dba336bb4a tempest-FlavorsAccessNegativeTestJSON-1210342997 tempest-FlavorsAccessNegativeTestJSON-1210342997-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.024324 Jul 14 14:26:33.397418 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 161/301] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:26:33 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:33.403763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-74c3ad5c-7c11-4cf0-800d-30adbf1c16cf tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:33.404568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-74c3ad5c-7c11-4cf0-800d-30adbf1c16cf tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:33.411880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74c3ad5c-7c11-4cf0-800d-30adbf1c16cf tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:33.412578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74c3ad5c-7c11-4cf0-800d-30adbf1c16cf tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:33.413800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74c3ad5c-7c11-4cf0-800d-30adbf1c16cf tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:33.414450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74c3ad5c-7c11-4cf0-800d-30adbf1c16cf tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:33.533455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d086d4ea-4746-4652-b675-697ffa07664c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:33.544619 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d086d4ea-4746-4652-b675-697ffa07664c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1366 microversion: 2.1 time: 0.353428 Jul 14 14:26:33.545711 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 141/302] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:33 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:33.570251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-dd1ab7ed-a296-4d5c-b570-767fe9816f17 req-0ea0c40e-4813-47b2-9f44-a9c6396d8b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4", "name": "network-vif-plugged", "status": "completed", "tag": "4cf02839-b4ee-43f7-b471-faa699b11f78"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:33.591346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-dd1ab7ed-a296-4d5c-b570-767fe9816f17 req-0ea0c40e-4813-47b2-9f44-a9c6396d8b1d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:33.594350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-dd1ab7ed-a296-4d5c-b570-767fe9816f17 req-0ea0c40e-4813-47b2-9f44-a9c6396d8b1d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:33.624468 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-dd1ab7ed-a296-4d5c-b570-767fe9816f17 req-0ea0c40e-4813-47b2-9f44-a9c6396d8b1d service nova] Creating event network-vif-plugged:4cf02839-b4ee-43f7-b471-faa699b11f78 for instance 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 on n-h2-767704-28 Jul 14 14:26:33.636842 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-dd1ab7ed-a296-4d5c-b570-767fe9816f17 req-0ea0c40e-4813-47b2-9f44-a9c6396d8b1d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088513 Jul 14 14:26:33.637496 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 142/303] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:33.684882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-74c3ad5c-7c11-4cf0-800d-30adbf1c16cf tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:33.693014 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-74c3ad5c-7c11-4cf0-800d-30adbf1c16cf tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1318 microversion: 2.1 time: 0.293596 Jul 14 14:26:33.702240 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 162/304] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:33 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:34.162453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8c4dfcdd-eb1e-404b-8a4b-b00a87054b00 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:34.163371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8c4dfcdd-eb1e-404b-8a4b-b00a87054b00 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:34.170747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c4dfcdd-eb1e-404b-8a4b-b00a87054b00 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:34.171378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c4dfcdd-eb1e-404b-8a4b-b00a87054b00 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:34.172381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c4dfcdd-eb1e-404b-8a4b-b00a87054b00 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:34.173018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c4dfcdd-eb1e-404b-8a4b-b00a87054b00 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:34.366213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9dc6a8fd-d34e-4004-8279-2d1c13039e1f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:34.367652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9dc6a8fd-d34e-4004-8279-2d1c13039e1f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:34.373981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dc6a8fd-d34e-4004-8279-2d1c13039e1f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:34.374687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dc6a8fd-d34e-4004-8279-2d1c13039e1f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:34.375464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dc6a8fd-d34e-4004-8279-2d1c13039e1f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:34.375903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dc6a8fd-d34e-4004-8279-2d1c13039e1f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:34.411287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8c4dfcdd-eb1e-404b-8a4b-b00a87054b00 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:34.420896 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8c4dfcdd-eb1e-404b-8a4b-b00a87054b00 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1322 microversion: 2.1 time: 0.264383 Jul 14 14:26:34.421612 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 143/305] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:34 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:34.564008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-68ddc78c-047f-4410-b8fe-ba14233ab091 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:34.565582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-68ddc78c-047f-4410-b8fe-ba14233ab091 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:34.579210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68ddc78c-047f-4410-b8fe-ba14233ab091 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:34.580245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68ddc78c-047f-4410-b8fe-ba14233ab091 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:34.580932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9dc6a8fd-d34e-4004-8279-2d1c13039e1f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:34.581762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68ddc78c-047f-4410-b8fe-ba14233ab091 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:34.582483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68ddc78c-047f-4410-b8fe-ba14233ab091 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:34.593532 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9dc6a8fd-d34e-4004-8279-2d1c13039e1f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 0.230976 Jul 14 14:26:34.611071 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 163/306] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:34 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:34.722379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6924edc2-efe6-4cd0-8410-0e8bbc8e9169 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:34.724853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6924edc2-efe6-4cd0-8410-0e8bbc8e9169 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:34.735827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6924edc2-efe6-4cd0-8410-0e8bbc8e9169 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:34.738133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6924edc2-efe6-4cd0-8410-0e8bbc8e9169 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:34.743755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6924edc2-efe6-4cd0-8410-0e8bbc8e9169 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:34.745119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6924edc2-efe6-4cd0-8410-0e8bbc8e9169 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:34.766324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-68ddc78c-047f-4410-b8fe-ba14233ab091 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:34.777630 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-68ddc78c-047f-4410-b8fe-ba14233ab091 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1366 microversion: 2.1 time: 0.217302 Jul 14 14:26:34.779751 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 144/307] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:34 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:34.949415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6924edc2-efe6-4cd0-8410-0e8bbc8e9169 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:34.965861 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6924edc2-efe6-4cd0-8410-0e8bbc8e9169 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1318 microversion: 2.1 time: 0.241067 Jul 14 14:26:34.967718 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 164/308] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:34 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:35.439936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b1458728-598f-41c4-9abf-c70e72ba6f4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:35.440724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b1458728-598f-41c4-9abf-c70e72ba6f4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:35.459247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1458728-598f-41c4-9abf-c70e72ba6f4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:35.459717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1458728-598f-41c4-9abf-c70e72ba6f4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:35.469395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1458728-598f-41c4-9abf-c70e72ba6f4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:35.471238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1458728-598f-41c4-9abf-c70e72ba6f4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:35.631216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2796849d-4dbd-433e-8f1a-d230de0fe538 req-deacc6d8-ce39-458e-9ab4-4197c49e8f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f1d989-211a-466d-9a7a-a1a9303daf5d", "tag": "e9dab558-a62c-4e16-92a9-8c676e1f2df2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:35.653732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2796849d-4dbd-433e-8f1a-d230de0fe538 req-deacc6d8-ce39-458e-9ab4-4197c49e8f6d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:35.654458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2796849d-4dbd-433e-8f1a-d230de0fe538 req-deacc6d8-ce39-458e-9ab4-4197c49e8f6d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:35.676776 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2796849d-4dbd-433e-8f1a-d230de0fe538 req-deacc6d8-ce39-458e-9ab4-4197c49e8f6d service nova] Creating event network-changed:e9dab558-a62c-4e16-92a9-8c676e1f2df2 for instance 60f1d989-211a-466d-9a7a-a1a9303daf5d on n-h1-767704-28 Jul 14 14:26:35.688999 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2796849d-4dbd-433e-8f1a-d230de0fe538 req-deacc6d8-ce39-458e-9ab4-4197c49e8f6d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077078 Jul 14 14:26:35.692911 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 165/309] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:35.703788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e87aa994-09bd-4612-a27b-7c8e621f10df tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:35.713837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e87aa994-09bd-4612-a27b-7c8e621f10df tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:35.732792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e87aa994-09bd-4612-a27b-7c8e621f10df tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:35.735714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e87aa994-09bd-4612-a27b-7c8e621f10df tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:35.738551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e87aa994-09bd-4612-a27b-7c8e621f10df tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:35.739220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e87aa994-09bd-4612-a27b-7c8e621f10df tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:35.788268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b1458728-598f-41c4-9abf-c70e72ba6f4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:35.800891 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b1458728-598f-41c4-9abf-c70e72ba6f4c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1472 microversion: 2.1 time: 0.366523 Jul 14 14:26:35.801700 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 145/310] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:35 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1472 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:35.808534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-9015f9b8-c630-464f-a7df-06c5727c69fc req-92b3980a-93f5-47d7-848c-c81b58c4d429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6661f76a-906a-4e9a-b5a6-52cbd26679c7", "name": "network-vif-plugged", "status": "completed", "tag": "21e35f11-21a6-4afe-aac4-a5beffcecba2"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:35.832409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9015f9b8-c630-464f-a7df-06c5727c69fc req-92b3980a-93f5-47d7-848c-c81b58c4d429 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:35.834386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9015f9b8-c630-464f-a7df-06c5727c69fc req-92b3980a-93f5-47d7-848c-c81b58c4d429 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:35.865955 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-9015f9b8-c630-464f-a7df-06c5727c69fc req-92b3980a-93f5-47d7-848c-c81b58c4d429 service nova] Creating event network-vif-plugged:21e35f11-21a6-4afe-aac4-a5beffcecba2 for instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 on n-h2-767704-28 Jul 14 14:26:35.882335 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-9015f9b8-c630-464f-a7df-06c5727c69fc req-92b3980a-93f5-47d7-848c-c81b58c4d429 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078359 Jul 14 14:26:35.888008 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 146/311] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:35.906319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2d7207c8-99c6-4da3-9612-c136f229cd97 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:35.907048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2d7207c8-99c6-4da3-9612-c136f229cd97 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:35.921143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d7207c8-99c6-4da3-9612-c136f229cd97 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:35.921884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d7207c8-99c6-4da3-9612-c136f229cd97 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:35.922834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d7207c8-99c6-4da3-9612-c136f229cd97 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:35.923433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d7207c8-99c6-4da3-9612-c136f229cd97 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:36.264875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e87aa994-09bd-4612-a27b-7c8e621f10df tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:36.276076 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e87aa994-09bd-4612-a27b-7c8e621f10df tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 0.580879 Jul 14 14:26:36.277317 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 166/312] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:35 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:36.303921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f4e6991e-1a68-4b4a-829b-f5e5aa9a3a1c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:36.305497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f4e6991e-1a68-4b4a-829b-f5e5aa9a3a1c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:36.318929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4e6991e-1a68-4b4a-829b-f5e5aa9a3a1c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:36.320461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4e6991e-1a68-4b4a-829b-f5e5aa9a3a1c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:36.345856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4e6991e-1a68-4b4a-829b-f5e5aa9a3a1c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:36.347524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2d7207c8-99c6-4da3-9612-c136f229cd97 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:36.357472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4e6991e-1a68-4b4a-829b-f5e5aa9a3a1c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:36.359804 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2d7207c8-99c6-4da3-9612-c136f229cd97 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1366 microversion: 2.1 time: 0.469195 Jul 14 14:26:36.365810 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 147/313] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:35 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1366 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:36.371785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a9249356-cde3-4f26-9089-26b4af292849 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:36.374829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a9249356-cde3-4f26-9089-26b4af292849 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:36.390994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9249356-cde3-4f26-9089-26b4af292849 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:36.391450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9249356-cde3-4f26-9089-26b4af292849 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:36.392265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9249356-cde3-4f26-9089-26b4af292849 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:36.392697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9249356-cde3-4f26-9089-26b4af292849 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:36.446113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f4e6991e-1a68-4b4a-829b-f5e5aa9a3a1c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f4e6991e-1a68-4b4a-829b-f5e5aa9a3a1c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Request method failure captured: Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4/diagnostics HTTP/1.1 Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cd_zefMXz3QqTyXLReVJwXFKzgrAPya-5VTCI4shVC-cAcZ43BV7uNhrgBETuSh7LW7ptFSWQn0mZoeM1aP-_gHvOz8p4lMWU2OA7fncnCv2yQea5drfIh9L3AQzx41-wjUshwWqtW-GwU942SyeKc6T13NbynTDUIW4x138-gGmk8 Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 5534ff945d6143a7b2ec4abb5634a116 Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-662247897 Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:26:36.448376 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:26:36.449952 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5534ff945d6143a7b2ec4abb5634a116"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5534ff945d6143a7b2ec4abb5634a116"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5534ff945d6143a7b2ec4abb5634a116", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5534ff945d6143a7b2ec4abb5634a116"}]}] Jul 14 14:26:36.449952 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-662247897 Jul 14 14:26:36.449952 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 5534ff945d6143a7b2ec4abb5634a116 Jul 14 14:26:36.449952 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-662247897 Jul 14 14:26:36.449952 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerDiagnosticsNegativeTest-662247897-project Jul 14 14:26:36.449952 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:36.449952 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:36.449952 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 5c749f2fb8634737ba31faeb7442c912 Jul 14 14:26:36.449952 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-662247897-project Jul 14 14:26:36.449952 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:36.449952 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'server_id': '8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4'} Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:26:36.450881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 14 14:26:36.452227 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:36.456985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f4e6991e-1a68-4b4a-829b-f5e5aa9a3a1c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:36.461766 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f4e6991e-1a68-4b4a-829b-f5e5aa9a3a1c tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.177269 Jul 14 14:26:36.463182 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 167/314] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:26:36 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4/diagnostics => generated 117 bytes in 185 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:36.486113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5f6d2e54-4180-4bae-ba62-e30d37e6c51e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:36.486726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5f6d2e54-4180-4bae-ba62-e30d37e6c51e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:36.496168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f6d2e54-4180-4bae-ba62-e30d37e6c51e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:36.496686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f6d2e54-4180-4bae-ba62-e30d37e6c51e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:36.497507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f6d2e54-4180-4bae-ba62-e30d37e6c51e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:36.498010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f6d2e54-4180-4bae-ba62-e30d37e6c51e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:36.534317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5f6d2e54-4180-4bae-ba62-e30d37e6c51e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:26:36.776924 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5f6d2e54-4180-4bae-ba62-e30d37e6c51e tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 204 len: 0 microversion: 2.1 time: 0.298575 Jul 14 14:26:36.779970 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 168/315] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:26:36 2022] DELETE /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:26:36.790963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-102dce0c-5667-4c8c-980b-08f3b036fa1a tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:36.791722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-102dce0c-5667-4c8c-980b-08f3b036fa1a tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:36.820728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-102dce0c-5667-4c8c-980b-08f3b036fa1a tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:36.823970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-102dce0c-5667-4c8c-980b-08f3b036fa1a tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:36.825588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-102dce0c-5667-4c8c-980b-08f3b036fa1a tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:36.826201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-102dce0c-5667-4c8c-980b-08f3b036fa1a tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:37.081232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a9249356-cde3-4f26-9089-26b4af292849 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:37.096667 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a9249356-cde3-4f26-9089-26b4af292849 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1318 microversion: 2.1 time: 0.729361 Jul 14 14:26:37.098360 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 148/316] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:36 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1318 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:37.295504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8dc21476-1ba5-4025-95a1-819b3ab6b2e8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:37.296418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8dc21476-1ba5-4025-95a1-819b3ab6b2e8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:37.304985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dc21476-1ba5-4025-95a1-819b3ab6b2e8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:37.307018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dc21476-1ba5-4025-95a1-819b3ab6b2e8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:37.308738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dc21476-1ba5-4025-95a1-819b3ab6b2e8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:37.309405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dc21476-1ba5-4025-95a1-819b3ab6b2e8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:37.478770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-102dce0c-5667-4c8c-980b-08f3b036fa1a tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:37.490230 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-102dce0c-5667-4c8c-980b-08f3b036fa1a tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1478 microversion: 2.1 time: 0.705292 Jul 14 14:26:37.503965 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 169/317] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:36 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1478 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:37.513164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8f1963e1-02ba-4458-b0a0-484a4ba8e2a8 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:37.514034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8f1963e1-02ba-4458-b0a0-484a4ba8e2a8 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:37.521733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f1963e1-02ba-4458-b0a0-484a4ba8e2a8 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:37.522429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f1963e1-02ba-4458-b0a0-484a4ba8e2a8 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:37.523940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f1963e1-02ba-4458-b0a0-484a4ba8e2a8 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:37.524542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f1963e1-02ba-4458-b0a0-484a4ba8e2a8 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:37.580572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:37.908986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8dc21476-1ba5-4025-95a1-819b3ab6b2e8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:37.917451 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8dc21476-1ba5-4025-95a1-819b3ab6b2e8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 0.626764 Jul 14 14:26:37.918801 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 149/318] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:37 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:38.116406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8f1963e1-02ba-4458-b0a0-484a4ba8e2a8 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:38.118950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c8f19518-6733-46d4-9594-65de814a36d3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:38.119650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c8f19518-6733-46d4-9594-65de814a36d3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:38.128682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:38.133819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=18 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:38.137225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8f19518-6733-46d4-9594-65de814a36d3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:38.138279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8f19518-6733-46d4-9594-65de814a36d3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:38.139351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8f19518-6733-46d4-9594-65de814a36d3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:38.139982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8f19518-6733-46d4-9594-65de814a36d3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:38.143686 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8f1963e1-02ba-4458-b0a0-484a4ba8e2a8 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1366 microversion: 2.1 time: 0.638318 Jul 14 14:26:38.144466 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 170/319] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:37 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1366 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:38.456840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c8f19518-6733-46d4-9594-65de814a36d3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:38.466423 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c8f19518-6733-46d4-9594-65de814a36d3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1318 microversion: 2.1 time: 0.351774 Jul 14 14:26:38.469254 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 150/320] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:38 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:38.510182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-68281601-550f-4716-b08b-801c69a26b79 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:38.510970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-68281601-550f-4716-b08b-801c69a26b79 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:38.527844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68281601-550f-4716-b08b-801c69a26b79 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:38.528314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68281601-550f-4716-b08b-801c69a26b79 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:38.529516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68281601-550f-4716-b08b-801c69a26b79 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:38.535925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68281601-550f-4716-b08b-801c69a26b79 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:38.935981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-093ea19c-08bc-4647-b169-d249f63d4b89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:38.936589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-093ea19c-08bc-4647-b169-d249f63d4b89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:38.951027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-093ea19c-08bc-4647-b169-d249f63d4b89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:38.951603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-093ea19c-08bc-4647-b169-d249f63d4b89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:38.952387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-093ea19c-08bc-4647-b169-d249f63d4b89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:38.953068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-093ea19c-08bc-4647-b169-d249f63d4b89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:38.954583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-68281601-550f-4716-b08b-801c69a26b79 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:38.969701 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-68281601-550f-4716-b08b-801c69a26b79 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1478 microversion: 2.1 time: 0.464993 Jul 14 14:26:38.978925 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 171/321] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:38 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1478 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:39.161891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6d093aa2-f32c-46a2-9c19-61397147b607 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:39.162684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6d093aa2-f32c-46a2-9c19-61397147b607 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:39.174518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d093aa2-f32c-46a2-9c19-61397147b607 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:39.174973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d093aa2-f32c-46a2-9c19-61397147b607 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:39.175760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d093aa2-f32c-46a2-9c19-61397147b607 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:39.176204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d093aa2-f32c-46a2-9c19-61397147b607 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:39.369205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-093ea19c-08bc-4647-b169-d249f63d4b89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:39.384904 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-093ea19c-08bc-4647-b169-d249f63d4b89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 0.452667 Jul 14 14:26:39.394433 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 151/322] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:38 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:39.483560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a7b2eb4f-a29c-48ee-9ac7-51dfdb197f95 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:39.484050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a7b2eb4f-a29c-48ee-9ac7-51dfdb197f95 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:39.496636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7b2eb4f-a29c-48ee-9ac7-51dfdb197f95 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:39.497406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7b2eb4f-a29c-48ee-9ac7-51dfdb197f95 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:39.498345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7b2eb4f-a29c-48ee-9ac7-51dfdb197f95 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:39.498927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7b2eb4f-a29c-48ee-9ac7-51dfdb197f95 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:40.182488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6d093aa2-f32c-46a2-9c19-61397147b607 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:40.198151 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6d093aa2-f32c-46a2-9c19-61397147b607 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1366 microversion: 2.1 time: 1.038257 Jul 14 14:26:40.200322 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 172/323] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:39 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1366 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:40.209638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-709ad375-542e-4355-9388-b0880949a786 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:40.212892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-709ad375-542e-4355-9388-b0880949a786 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:40.225298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-709ad375-542e-4355-9388-b0880949a786 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:40.225760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-709ad375-542e-4355-9388-b0880949a786 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:40.227931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-709ad375-542e-4355-9388-b0880949a786 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:40.228383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-709ad375-542e-4355-9388-b0880949a786 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:40.394051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a7b2eb4f-a29c-48ee-9ac7-51dfdb197f95 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:40.435289 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a7b2eb4f-a29c-48ee-9ac7-51dfdb197f95 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1467 microversion: 2.1 time: 0.942662 Jul 14 14:26:40.435289 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 152/324] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:39 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1467 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:40.459977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-81671dfd-069e-49d3-855c-bd49e0b82769 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:40.463952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-81671dfd-069e-49d3-855c-bd49e0b82769 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:40.491355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81671dfd-069e-49d3-855c-bd49e0b82769 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:40.491842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81671dfd-069e-49d3-855c-bd49e0b82769 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:40.495684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81671dfd-069e-49d3-855c-bd49e0b82769 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:40.497640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81671dfd-069e-49d3-855c-bd49e0b82769 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:40.531502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-709ad375-542e-4355-9388-b0880949a786 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:40.541062 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-709ad375-542e-4355-9388-b0880949a786 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1478 microversion: 2.1 time: 0.339008 Jul 14 14:26:40.541665 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 173/325] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:40 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1478 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:40.756736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-81671dfd-069e-49d3-855c-bd49e0b82769 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:40.776445 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-81671dfd-069e-49d3-855c-bd49e0b82769 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 0.343237 Jul 14 14:26:40.777658 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 153/326] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:40 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:40.912458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-901194b7-7ff4-4a76-89ec-10a7280375c4 tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:40.913167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-901194b7-7ff4-4a76-89ec-10a7280375c4 tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:40.928515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-901194b7-7ff4-4a76-89ec-10a7280375c4 tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:40.929865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-901194b7-7ff4-4a76-89ec-10a7280375c4 tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:40.931365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-901194b7-7ff4-4a76-89ec-10a7280375c4 tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:40.934535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-901194b7-7ff4-4a76-89ec-10a7280375c4 tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:41.003581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-901194b7-7ff4-4a76-89ec-10a7280375c4 tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:26:41.081527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4c899a3-8592-470e-b453-2126a327180b tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-384660026", "ram": 512, "vcpus": 1, "disk": 10, "id": 365496973, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:41.084579 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:41.084579 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:41.118286 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d4c899a3-8592-470e-b453-2126a327180b tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.303442 Jul 14 14:26:41.121893 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 154/327] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:26:40 2022] POST /compute/v2.1/flavors => generated 412 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:26:41.138868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f8838d69-0cd4-4749-a32d-43b290b463fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:41.143741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f8838d69-0cd4-4749-a32d-43b290b463fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:41.159782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8838d69-0cd4-4749-a32d-43b290b463fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:41.165841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8838d69-0cd4-4749-a32d-43b290b463fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:41.166862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8838d69-0cd4-4749-a32d-43b290b463fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:41.167594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8838d69-0cd4-4749-a32d-43b290b463fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:41.224771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f8838d69-0cd4-4749-a32d-43b290b463fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:26:41.304546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:41.344641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:DELETE=11,nova_api:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:41.360449 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-901194b7-7ff4-4a76-89ec-10a7280375c4 tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] 10.222.0.81 "DELETE /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 204 len: 0 microversion: 2.1 time: 0.817453 Jul 14 14:26:41.361372 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 174/328] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:26:40 2022] DELETE /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:26:41.364827 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f8838d69-0cd4-4749-a32d-43b290b463fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 204 len: 0 microversion: 2.1 time: 0.239546 Jul 14 14:26:41.364827 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 155/329] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:26:41 2022] DELETE /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:26:41.390916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-7d524d3a-8caa-42ca-97c3-99bf1e1f2264 req-f166b8f1-18a5-4314-87be-f82e7a5b16e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4", "name": "network-vif-deleted", "tag": "4cf02839-b4ee-43f7-b471-faa699b11f78"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:41.410959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7d524d3a-8caa-42ca-97c3-99bf1e1f2264 req-f166b8f1-18a5-4314-87be-f82e7a5b16e3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:41.411553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7d524d3a-8caa-42ca-97c3-99bf1e1f2264 req-f166b8f1-18a5-4314-87be-f82e7a5b16e3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:41.459206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1741231623", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "6bcc5f06-ad6e-40c9-b806-9581f1f929a3"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:41.467801 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-7d524d3a-8caa-42ca-97c3-99bf1e1f2264 req-f166b8f1-18a5-4314-87be-f82e7a5b16e3 service nova] Creating event network-vif-deleted:4cf02839-b4ee-43f7-b471-faa699b11f78 for instance 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 on n-h2-767704-28 Jul 14 14:26:41.489048 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-7d524d3a-8caa-42ca-97c3-99bf1e1f2264 req-f166b8f1-18a5-4314-87be-f82e7a5b16e3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119672 Jul 14 14:26:41.489716 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 156/330] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:41.510979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8751f457-b869-4487-b775-adec31e69f43 tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:41.516219 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:41.516219 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:41.549839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] validate_networks() for [('6bcc5f06-ad6e-40c9-b806-9581f1f929a3', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:26:41.581754 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8751f457-b869-4487-b775-adec31e69f43 tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/365496973/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.087706 Jul 14 14:26:41.587691 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 157/331] 10.222.0.81 () {60 vars in 1220 bytes} [Thu Jul 14 14:26:41 2022] POST /compute/v2.1/flavors/365496973/os-extra_specs => generated 66 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:41.592003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6fe25835-5e48-4372-bdb8-29538244e65f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:41.592824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6fe25835-5e48-4372-bdb8-29538244e65f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:41.599906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fe25835-5e48-4372-bdb8-29538244e65f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:41.600554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fe25835-5e48-4372-bdb8-29538244e65f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:41.602142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fe25835-5e48-4372-bdb8-29538244e65f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:41.602600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fe25835-5e48-4372-bdb8-29538244e65f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:41.970684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6fe25835-5e48-4372-bdb8-29538244e65f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:41.994654 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6fe25835-5e48-4372-bdb8-29538244e65f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1366 microversion: 2.1 time: 0.410246 Jul 14 14:26:42.009814 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 158/332] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:41 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:42.015653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-334533b2-a8a0-4ab7-8cdb-181122e60ed6 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:42.018077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-334533b2-a8a0-4ab7-8cdb-181122e60ed6 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:42.031326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-334533b2-a8a0-4ab7-8cdb-181122e60ed6 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:42.031326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-334533b2-a8a0-4ab7-8cdb-181122e60ed6 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:42.032161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-334533b2-a8a0-4ab7-8cdb-181122e60ed6 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:42.032605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-334533b2-a8a0-4ab7-8cdb-181122e60ed6 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:42.387694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-334533b2-a8a0-4ab7-8cdb-181122e60ed6 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:42.397779 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-334533b2-a8a0-4ab7-8cdb-181122e60ed6 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1473 microversion: 2.1 time: 0.385969 Jul 14 14:26:42.398495 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 159/333] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:42 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1473 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:42.415465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f09cc730-c0b6-4804-b9e2-9b4b334ccc38 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:42.418545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f09cc730-c0b6-4804-b9e2-9b4b334ccc38 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:42.435307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f09cc730-c0b6-4804-b9e2-9b4b334ccc38 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:42.439910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f09cc730-c0b6-4804-b9e2-9b4b334ccc38 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:42.444830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f09cc730-c0b6-4804-b9e2-9b4b334ccc38 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:42.448343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f09cc730-c0b6-4804-b9e2-9b4b334ccc38 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:42.525790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f09cc730-c0b6-4804-b9e2-9b4b334ccc38 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:42.526657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f09cc730-c0b6-4804-b9e2-9b4b334ccc38 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:42.530976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-f09cc730-c0b6-4804-b9e2-9b4b334ccc38 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lazy-loading 'fault' on Instance uuid 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:26:42.635560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f09cc730-c0b6-4804-b9e2-9b4b334ccc38 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c749f2fb8634737ba31faeb7442c912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5534ff945d6143a7b2ec4abb5634a116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:42.653391 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f09cc730-c0b6-4804-b9e2-9b4b334ccc38 tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 200 len: 1312 microversion: 2.1 time: 0.253790 Jul 14 14:26:42.693667 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 160/334] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:42 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 1312 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:42.865602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:26:42.867965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:26:42.868621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:26:42.871769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:26:42.872834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:26:42.889450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:42.890191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:42.891422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:42.892163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:42.910860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-51fdb751-3d6a-43a9-8865-0a61df0734a1 tempest-FlavorsExtraSpecsTestJSON-791468034 tempest-FlavorsExtraSpecsTestJSON-791468034-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:42.925017 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-51fdb751-3d6a-43a9-8865-0a61df0734a1 tempest-FlavorsExtraSpecsTestJSON-791468034 tempest-FlavorsExtraSpecsTestJSON-791468034-project] 10.222.0.81 "GET /compute/v2.1/flavors/365496973/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.225874 Jul 14 14:26:42.927551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Getting quotas for project 4459eedeb8884ffe82ed62e567fb64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:26:42.936849 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 161/335] 10.222.0.81 () {58 vars in 1199 bytes} [Thu Jul 14 14:26:42 2022] GET /compute/v2.1/flavors/365496973/os-extra_specs => generated 66 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:42.938965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Getting quotas for user ef25b01962404bdfa0c2bbb30401ca62 and project 4459eedeb8884ffe82ed62e567fb64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:26:42.947467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1210101633", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "741277973", "adminPass": "***", "networks": [{"uuid": "891c87a7-1e27-454b-b01b-81dd6e00ddeb"}], "security_groups": [{"name": "tempest-securitygroup--1494786813"}], "key_name": "tempest-keypair-1254310316", "user_data": "}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:42.957340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:26:42.960314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:26:43.088928 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b600e12c-77cf-4676-8cde-544e2c2760dc tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.722191 Jul 14 14:26:43.092480 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 175/336] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:26:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:26:43.105332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-96f5daad-ce79-441d-9b01-a51d62a1750c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:43.105966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-96f5daad-ce79-441d-9b01-a51d62a1750c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:43.137392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96f5daad-ce79-441d-9b01-a51d62a1750c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:43.138457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96f5daad-ce79-441d-9b01-a51d62a1750c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:43.139428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96f5daad-ce79-441d-9b01-a51d62a1750c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:43.139720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96f5daad-ce79-441d-9b01-a51d62a1750c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:43.251475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] validate_networks() for [('891c87a7-1e27-454b-b01b-81dd6e00ddeb', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:26:44.418840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-96f5daad-ce79-441d-9b01-a51d62a1750c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:44.430298 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-96f5daad-ce79-441d-9b01-a51d62a1750c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 1.335692 Jul 14 14:26:44.441000 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 176/337] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:43 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:44.455933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-57463ed8-a189-4349-b840-13bfb3467b95 tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:44.460386 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:44.460386 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:44.518484 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-57463ed8-a189-4349-b840-13bfb3467b95 tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/365496973/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.071866 Jul 14 14:26:44.520779 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 177/338] 10.222.0.81 () {60 vars in 1220 bytes} [Thu Jul 14 14:26:44 2022] POST /compute/v2.1/flavors/365496973/os-extra_specs => generated 66 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:44.530707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6f78eed5-017c-4e3e-a37a-87866662d00c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:44.533898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6f78eed5-017c-4e3e-a37a-87866662d00c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:44.552638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f78eed5-017c-4e3e-a37a-87866662d00c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:44.555297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f78eed5-017c-4e3e-a37a-87866662d00c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:44.556587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f78eed5-017c-4e3e-a37a-87866662d00c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:44.557858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f78eed5-017c-4e3e-a37a-87866662d00c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.152356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6f78eed5-017c-4e3e-a37a-87866662d00c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:45.175897 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6f78eed5-017c-4e3e-a37a-87866662d00c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1366 microversion: 2.1 time: 0.653631 Jul 14 14:26:45.186754 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 178/339] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:44 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1366 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:45.193865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0d4f14eb-bf19-4dfc-85be-6de923d24977 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:45.195662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0d4f14eb-bf19-4dfc-85be-6de923d24977 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:45.204509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d4f14eb-bf19-4dfc-85be-6de923d24977 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:45.205322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d4f14eb-bf19-4dfc-85be-6de923d24977 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.206806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d4f14eb-bf19-4dfc-85be-6de923d24977 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:45.207601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d4f14eb-bf19-4dfc-85be-6de923d24977 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.339746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d4f14eb-bf19-4dfc-85be-6de923d24977 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:45.369405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d4f14eb-bf19-4dfc-85be-6de923d24977 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:45.374189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d4f14eb-bf19-4dfc-85be-6de923d24977 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:45.378388 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0d4f14eb-bf19-4dfc-85be-6de923d24977 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1332 microversion: 2.25 time: 0.188782 Jul 14 14:26:45.380764 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 179/340] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:26:45 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1332 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:45.388890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8ef1c6b2-3719-445e-a647-6c60eeda8bd3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:45.389794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8ef1c6b2-3719-445e-a647-6c60eeda8bd3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:45.400577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ef1c6b2-3719-445e-a647-6c60eeda8bd3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:45.404040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ef1c6b2-3719-445e-a647-6c60eeda8bd3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.406677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ef1c6b2-3719-445e-a647-6c60eeda8bd3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:45.408851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ef1c6b2-3719-445e-a647-6c60eeda8bd3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.417067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:26:45.417697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:26:45.417955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:26:45.418366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:26:45.418779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:26:45.447670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:45.448147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.459071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:45.459852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.487471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Getting quotas for project 53cea64d639b4a58ae486bf556526b25. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:26:45.497257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Getting quotas for user 05b7a8b4d7344e5cb2938c8e2f1ab1f7 and project 53cea64d639b4a58ae486bf556526b25. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:26:45.531064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:26:45.533947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:26:45.593201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8ef1c6b2-3719-445e-a647-6c60eeda8bd3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:45.616274 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8ef1c6b2-3719-445e-a647-6c60eeda8bd3 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 200 len: 1431 microversion: 2.1 time: 0.232365 Jul 14 14:26:45.618844 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 180/341] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:45 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 1431 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:45.645657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fe14e2af-2ea3-4d45-b965-e0b975f233fc tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:45.646790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fe14e2af-2ea3-4d45-b965-e0b975f233fc tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] [instance: 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:45.681627 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5e14be17-6262-4888-837d-830899bef03d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.742975 Jul 14 14:26:45.683909 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 162/342] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:26:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:26:45.692368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe14e2af-2ea3-4d45-b965-e0b975f233fc tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:45.693094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe14e2af-2ea3-4d45-b965-e0b975f233fc tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.694230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe14e2af-2ea3-4d45-b965-e0b975f233fc tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:45.716340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b8d1dd29-0c2b-481b-8c3e-c8f108a30d9a req-a017606b-30b9-4e60-89b0-fc84f01ccb21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f1d989-211a-466d-9a7a-a1a9303daf5d", "name": "network-vif-plugged", "status": "completed", "tag": "e9dab558-a62c-4e16-92a9-8c676e1f2df2"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:45.719863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe14e2af-2ea3-4d45-b965-e0b975f233fc tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.764639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b8d1dd29-0c2b-481b-8c3e-c8f108a30d9a req-a017606b-30b9-4e60-89b0-fc84f01ccb21 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:45.766021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b8d1dd29-0c2b-481b-8c3e-c8f108a30d9a req-a017606b-30b9-4e60-89b0-fc84f01ccb21 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.781892 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-fe14e2af-2ea3-4d45-b965-e0b975f233fc tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] HTTP exception thrown: Instance 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 could not be found. Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fe14e2af-2ea3-4d45-b965-e0b975f233fc tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Request method failure captured: Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 HTTP/1.1 Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cd_zefMXz3QqTyXLReVJwXFKzgrAPya-5VTCI4shVC-cAcZ43BV7uNhrgBETuSh7LW7ptFSWQn0mZoeM1aP-_gHvOz8p4lMWU2OA7fncnCv2yQea5drfIh9L3AQzx41-wjUshwWqtW-GwU942SyeKc6T13NbynTDUIW4x138-gGmk8 Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 5534ff945d6143a7b2ec4abb5634a116 Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-662247897 Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:26:45.783736 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:26:45.785272 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5534ff945d6143a7b2ec4abb5634a116"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5534ff945d6143a7b2ec4abb5634a116"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5534ff945d6143a7b2ec4abb5634a116", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5534ff945d6143a7b2ec4abb5634a116"}]}] Jul 14 14:26:45.785272 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-662247897 Jul 14 14:26:45.785272 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 5534ff945d6143a7b2ec4abb5634a116 Jul 14 14:26:45.785272 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-662247897 Jul 14 14:26:45.785272 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerDiagnosticsNegativeTest-662247897-project Jul 14 14:26:45.785272 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:45.785272 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:45.785272 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 5c749f2fb8634737ba31faeb7442c912 Jul 14 14:26:45.785272 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-662247897-project Jul 14 14:26:45.785272 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:45.785272 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 could not be found. Jul 14 14:26:45.785272 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4'} Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 could not be found. Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:45.786026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 could not be found. Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 could not be found. Jul 14 14:26:45.787482 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:45.791127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fe14e2af-2ea3-4d45-b965-e0b975f233fc tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] Returning 404 to user: Instance 8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:45.791127 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fe14e2af-2ea3-4d45-b965-e0b975f233fc tempest-ServerDiagnosticsNegativeTest-662247897 tempest-ServerDiagnosticsNegativeTest-662247897-project] 10.222.0.81 "GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4" status: 404 len: 111 microversion: 2.1 time: 0.167407 Jul 14 14:26:45.791127 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 181/343] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:45 2022] GET /compute/v2.1/servers/8e7f9bce-ce56-4f82-bfa4-7a2daf22bad4 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:45.800471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cff0f5d8-09ce-4a28-9126-58f61ff6673b tempest-FlavorsExtraSpecsTestJSON-791468034 tempest-FlavorsExtraSpecsTestJSON-791468034-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:45.802508 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b8d1dd29-0c2b-481b-8c3e-c8f108a30d9a req-a017606b-30b9-4e60-89b0-fc84f01ccb21 service nova] Creating event network-vif-plugged:e9dab558-a62c-4e16-92a9-8c676e1f2df2 for instance 60f1d989-211a-466d-9a7a-a1a9303daf5d on n-h1-767704-28 Jul 14 14:26:45.817921 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cff0f5d8-09ce-4a28-9126-58f61ff6673b tempest-FlavorsExtraSpecsTestJSON-791468034 tempest-FlavorsExtraSpecsTestJSON-791468034-project] 10.222.0.81 "GET /compute/v2.1/flavors/365496973/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.023036 Jul 14 14:26:45.818638 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 182/344] 10.222.0.81 () {58 vars in 1241 bytes} [Thu Jul 14 14:26:45 2022] GET /compute/v2.1/flavors/365496973/os-extra_specs/hw:numa_nodes => generated 22 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:45.818931 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b8d1dd29-0c2b-481b-8c3e-c8f108a30d9a req-a017606b-30b9-4e60-89b0-fc84f01ccb21 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121262 Jul 14 14:26:45.821708 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 163/345] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:45.849508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ab534747-ebe7-4bea-8bc7-29516f714c18 req-4c3029f4-85ed-4a9f-b7c0-b94ca69ed36c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6661f76a-906a-4e9a-b5a6-52cbd26679c7", "name": "network-vif-deleted", "tag": "21e35f11-21a6-4afe-aac4-a5beffcecba2"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:45.856810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5beec74e-abd4-400a-9699-7a02390436fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:45.861912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5beec74e-abd4-400a-9699-7a02390436fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:45.871299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ab534747-ebe7-4bea-8bc7-29516f714c18 req-4c3029f4-85ed-4a9f-b7c0-b94ca69ed36c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:45.871765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ab534747-ebe7-4bea-8bc7-29516f714c18 req-4c3029f4-85ed-4a9f-b7c0-b94ca69ed36c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.914387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5beec74e-abd4-400a-9699-7a02390436fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:45.919376 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ab534747-ebe7-4bea-8bc7-29516f714c18 req-4c3029f4-85ed-4a9f-b7c0-b94ca69ed36c service nova] Creating event network-vif-deleted:21e35f11-21a6-4afe-aac4-a5beffcecba2 for instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 on n-h2-767704-28 Jul 14 14:26:45.923163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5beec74e-abd4-400a-9699-7a02390436fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.924325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5beec74e-abd4-400a-9699-7a02390436fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:45.924880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5beec74e-abd4-400a-9699-7a02390436fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:45.940696 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ab534747-ebe7-4bea-8bc7-29516f714c18 req-4c3029f4-85ed-4a9f-b7c0-b94ca69ed36c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114460 Jul 14 14:26:45.941351 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 164/346] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:45.970442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d89cb40f-202a-4011-8739-625013a67a7e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:45.974735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d89cb40f-202a-4011-8739-625013a67a7e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:46.524628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d89cb40f-202a-4011-8739-625013a67a7e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:46.533124 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d89cb40f-202a-4011-8739-625013a67a7e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1263 microversion: 2.1 time: 0.580347 Jul 14 14:26:46.539477 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 165/347] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:45 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1263 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:46.553130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eb1737bc-7932-477e-9c25-d2bd613ef12d tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:46.557810 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:46.557810 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:46.562876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=3,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:46.649177 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eb1737bc-7932-477e-9c25-d2bd613ef12d tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/365496973/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.106963 Jul 14 14:26:46.650935 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 166/348] 10.222.0.81 () {60 vars in 1220 bytes} [Thu Jul 14 14:26:46 2022] POST /compute/v2.1/flavors/365496973/os-extra_specs => generated 66 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:46.664180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0bfa24a1-5f20-44cc-b7bc-c49053742710 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:46.665367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0bfa24a1-5f20-44cc-b7bc-c49053742710 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:46.680833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0bfa24a1-5f20-44cc-b7bc-c49053742710 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:46.681972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0bfa24a1-5f20-44cc-b7bc-c49053742710 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:46.683398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0bfa24a1-5f20-44cc-b7bc-c49053742710 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:46.684144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0bfa24a1-5f20-44cc-b7bc-c49053742710 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:46.968283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5beec74e-abd4-400a-9699-7a02390436fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:46.977389 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5beec74e-abd4-400a-9699-7a02390436fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1475 microversion: 2.1 time: 1.138268 Jul 14 14:26:46.989554 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 183/349] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:45 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1475 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:46.994752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e27a5e4c-0217-4e1b-831d-a713f148d6da tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:46.997682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e27a5e4c-0217-4e1b-831d-a713f148d6da tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:47.005328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e27a5e4c-0217-4e1b-831d-a713f148d6da tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:47.006055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e27a5e4c-0217-4e1b-831d-a713f148d6da tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:47.007032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e27a5e4c-0217-4e1b-831d-a713f148d6da tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:47.007817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e27a5e4c-0217-4e1b-831d-a713f148d6da tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:47.257230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e27a5e4c-0217-4e1b-831d-a713f148d6da tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:47.270782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e27a5e4c-0217-4e1b-831d-a713f148d6da tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:47.272358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e27a5e4c-0217-4e1b-831d-a713f148d6da tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:47.278226 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e27a5e4c-0217-4e1b-831d-a713f148d6da tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1320 microversion: 2.25 time: 0.287331 Jul 14 14:26:47.278839 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 184/350] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:26:46 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1320 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:47.293939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-91048d2e-ebf7-4dcd-84df-3b05b57c5e0b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:47.294565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-91048d2e-ebf7-4dcd-84df-3b05b57c5e0b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:47.302718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91048d2e-ebf7-4dcd-84df-3b05b57c5e0b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:47.302890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91048d2e-ebf7-4dcd-84df-3b05b57c5e0b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:47.303551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91048d2e-ebf7-4dcd-84df-3b05b57c5e0b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:47.303994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91048d2e-ebf7-4dcd-84df-3b05b57c5e0b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:47.326088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0bfa24a1-5f20-44cc-b7bc-c49053742710 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:47.335094 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0bfa24a1-5f20-44cc-b7bc-c49053742710 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1366 microversion: 2.1 time: 0.676924 Jul 14 14:26:47.337944 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 167/351] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:46 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1366 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:47.349285 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-91048d2e-ebf7-4dcd-84df-3b05b57c5e0b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] HTTP exception thrown: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-91048d2e-ebf7-4dcd-84df-3b05b57c5e0b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Request method failure captured: Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 HTTP/1.1 Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CeDFkTGDtJCukPJWpXaEZf9q9MGTzuGaRyIuVXxPnmzWy0ehCkiFy2PSYE69E5I85uNYN7MxOgF_zHAmQskqru9J6cQAW_T77VEIMsvmCK2pnCfd90HswVBIqorHMCSBQUhsoNvp_Q7s2T79WL0Rg9peagcgbm85_4AwciXePMOIPc Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 6bd1f655183e476da89067fcd0f1756a Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:26:47.351051 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:26:47.353447 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6bd1f655183e476da89067fcd0f1756a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6bd1f655183e476da89067fcd0f1756a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6bd1f655183e476da89067fcd0f1756a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6bd1f655183e476da89067fcd0f1756a"}]}] Jul 14 14:26:47.353447 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:26:47.353447 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 6bd1f655183e476da89067fcd0f1756a Jul 14 14:26:47.353447 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:26:47.353447 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersAdminTestJSON-659018202-project Jul 14 14:26:47.353447 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:26:47.353447 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:26:47.353447 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 2998f23059d446dcbea060ac2115b096 Jul 14 14:26:47.353447 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersAdminTestJSON-659018202-project Jul 14 14:26:47.353447 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:26:47.353447 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:26:47.353447 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6661f76a-906a-4e9a-b5a6-52cbd26679c7'} Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:47.354895 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:26:47.356083 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:26:47.357084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-91048d2e-ebf7-4dcd-84df-3b05b57c5e0b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Returning 404 to user: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:47.357084 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-91048d2e-ebf7-4dcd-84df-3b05b57c5e0b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 404 len: 111 microversion: 2.1 time: 0.073823 Jul 14 14:26:47.357242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5f2c4475-a3a8-492d-835f-ee85b1f051ad tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:47.365281 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 185/352] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:47 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:26:47.395441 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5f2c4475-a3a8-492d-835f-ee85b1f051ad tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/365496973/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056217 Jul 14 14:26:47.396367 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 168/353] 10.222.0.81 () {58 vars in 1199 bytes} [Thu Jul 14 14:26:47 2022] GET /compute/v2.1/flavors/365496973/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:47.407119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f2fc8a08-972d-47fa-b697-ec004bc1515c tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:47.408720 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:47.408720 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:47.447084 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f2fc8a08-972d-47fa-b697-ec004bc1515c tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] 10.222.0.81 "PUT /compute/v2.1/flavors/365496973/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.042361 Jul 14 14:26:47.448357 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 186/354] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:26:47 2022] PUT /compute/v2.1/flavors/365496973/os-extra_specs/hw:numa_nodes => generated 22 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:47.456662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6bdc5ed4-9f54-405b-b513-2f38041ac36f tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:47.466283 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6bdc5ed4-9f54-405b-b513-2f38041ac36f tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/365496973/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013273 Jul 14 14:26:47.477918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b53b4a6-8d46-41d3-883e-3cf5f7a5c9e9 tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:47.478814 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:47.478814 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:47.481162 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 169/355] 10.222.0.81 () {58 vars in 1199 bytes} [Thu Jul 14 14:26:47 2022] GET /compute/v2.1/flavors/365496973/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:47.554949 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0b53b4a6-8d46-41d3-883e-3cf5f7a5c9e9 tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/365496973/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.081016 Jul 14 14:26:47.555554 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 187/356] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 14:26:47 2022] DELETE /compute/v2.1/flavors/365496973/os-extra_specs/hw:numa_nodes => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:47.560813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-16fa3922-c233-4891-8c1b-fbba30b80d94 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:47.562073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-16fa3922-c233-4891-8c1b-fbba30b80d94 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:47.566724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b12eb9de-64e7-46ad-aea5-fe630581cf5d tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:47.591868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16fa3922-c233-4891-8c1b-fbba30b80d94 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:47.593238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16fa3922-c233-4891-8c1b-fbba30b80d94 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:47.595358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16fa3922-c233-4891-8c1b-fbba30b80d94 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:47.599693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16fa3922-c233-4891-8c1b-fbba30b80d94 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:47.637255 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b12eb9de-64e7-46ad-aea5-fe630581cf5d tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/365496973/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.074078 Jul 14 14:26:47.641693 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 188/357] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 14:26:47 2022] DELETE /compute/v2.1/flavors/365496973/os-extra_specs/hw:cpu_policy => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:26:47.657723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3da73b0b-5f55-44ba-90e1-b38e57b8b32c tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:47.706568 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3da73b0b-5f55-44ba-90e1-b38e57b8b32c tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/365496973/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.062263 Jul 14 14:26:47.709610 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 189/358] 10.222.0.81 () {58 vars in 1199 bytes} [Thu Jul 14 14:26:47 2022] GET /compute/v2.1/flavors/365496973/os-extra_specs => generated 19 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:47.736621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c4424331-8c43-476f-b03d-a59accebd51e tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:47.737997 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:47.737997 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:47.810421 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c4424331-8c43-476f-b03d-a59accebd51e tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/365496973" status: 202 len: 0 microversion: 2.1 time: 0.085700 Jul 14 14:26:47.815642 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 190/359] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:26:47 2022] DELETE /compute/v2.1/flavors/365496973 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:26:47.832641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-365320508", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:47.870909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-16fa3922-c233-4891-8c1b-fbba30b80d94 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:47.884787 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-16fa3922-c233-4891-8c1b-fbba30b80d94 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1315 microversion: 2.1 time: 0.332897 Jul 14 14:26:47.898487 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 170/360] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:47 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:47.910577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a11b23df-9991-4123-83eb-e54522f786c6 tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:47.939434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:26:47.983117 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a11b23df-9991-4123-83eb-e54522f786c6 tempest-FlavorsExtraSpecsTestJSON-2041606932 tempest-FlavorsExtraSpecsTestJSON-2041606932-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.081794 Jul 14 14:26:47.983721 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 171/361] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:26:47 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:48.019281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-14b15fc4-7040-4393-82cb-0d02ed9701d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:48.039846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-14b15fc4-7040-4393-82cb-0d02ed9701d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:48.067430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14b15fc4-7040-4393-82cb-0d02ed9701d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:48.071207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14b15fc4-7040-4393-82cb-0d02ed9701d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:48.072556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14b15fc4-7040-4393-82cb-0d02ed9701d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:48.089878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14b15fc4-7040-4393-82cb-0d02ed9701d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:49.143467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-14b15fc4-7040-4393-82cb-0d02ed9701d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:49.155252 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-14b15fc4-7040-4393-82cb-0d02ed9701d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1474 microversion: 2.1 time: 1.139893 Jul 14 14:26:49.158692 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 172/362] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:48 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1474 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:49.178691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0b77e810-5846-47a7-9a78-072096a78810 req-547b73e7-314d-409e-813a-7457399a980a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f119f8-47c2-4c9b-a800-d16194ab2e49", "name": "network-vif-deleted", "tag": "26034b4d-8bdb-42fb-bdf2-a8ae6c01b5be"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:49.201610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0b77e810-5846-47a7-9a78-072096a78810 req-547b73e7-314d-409e-813a-7457399a980a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:49.204045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0b77e810-5846-47a7-9a78-072096a78810 req-547b73e7-314d-409e-813a-7457399a980a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:49.240368 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0b77e810-5846-47a7-9a78-072096a78810 req-547b73e7-314d-409e-813a-7457399a980a service nova] Creating event network-vif-deleted:26034b4d-8bdb-42fb-bdf2-a8ae6c01b5be for instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 on n-h1-767704-28 Jul 14 14:26:49.256925 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0b77e810-5846-47a7-9a78-072096a78810 req-547b73e7-314d-409e-813a-7457399a980a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095925 Jul 14 14:26:49.257592 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 173/363] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:49.274111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-adffc7d7-483a-4e0e-890b-4a13ad8d78f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:49.276083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-adffc7d7-483a-4e0e-890b-4a13ad8d78f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:49.279121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:26:49.279730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:26:49.280408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:26:49.282135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:26:49.283033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:26:49.313725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adffc7d7-483a-4e0e-890b-4a13ad8d78f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:49.315148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:49.317993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adffc7d7-483a-4e0e-890b-4a13ad8d78f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:49.318863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:49.321643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:49.324382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adffc7d7-483a-4e0e-890b-4a13ad8d78f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:49.325377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adffc7d7-483a-4e0e-890b-4a13ad8d78f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:49.326210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:49.378211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Getting quotas for project 6bd1f655183e476da89067fcd0f1756a. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:26:49.388762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Getting quotas for user 2998f23059d446dcbea060ac2115b096 and project 6bd1f655183e476da89067fcd0f1756a. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:26:49.414567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:26:49.416506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:26:49.505768 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eb8e42bc-8054-41d4-862b-2e47fc0865af tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.687140 Jul 14 14:26:49.514533 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 191/364] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:26:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:26:49.534113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2c7c18bf-073f-4e2b-8fbc-2e92055421bc tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:49.535449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2c7c18bf-073f-4e2b-8fbc-2e92055421bc tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:49.548534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c7c18bf-073f-4e2b-8fbc-2e92055421bc tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:49.549463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c7c18bf-073f-4e2b-8fbc-2e92055421bc tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:49.550474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c7c18bf-073f-4e2b-8fbc-2e92055421bc tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:49.551176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c7c18bf-073f-4e2b-8fbc-2e92055421bc tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:50.782679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2c7c18bf-073f-4e2b-8fbc-2e92055421bc tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:50.792993 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2c7c18bf-073f-4e2b-8fbc-2e92055421bc tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1556 microversion: 2.1 time: 1.275026 Jul 14 14:26:50.825045 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 192/365] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:49 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1556 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:50.837135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-542a196d-b6c7-4d65-9d4a-8ba581972f10 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:50.842929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-542a196d-b6c7-4d65-9d4a-8ba581972f10 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:50.853800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:50.860692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-adffc7d7-483a-4e0e-890b-4a13ad8d78f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:50.872674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-adffc7d7-483a-4e0e-890b-4a13ad8d78f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:50.873858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-542a196d-b6c7-4d65-9d4a-8ba581972f10 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:50.874119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-542a196d-b6c7-4d65-9d4a-8ba581972f10 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:50.876103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-542a196d-b6c7-4d65-9d4a-8ba581972f10 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:50.876395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-542a196d-b6c7-4d65-9d4a-8ba581972f10 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:50.887109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-adffc7d7-483a-4e0e-890b-4a13ad8d78f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:50.889084 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-adffc7d7-483a-4e0e-890b-4a13ad8d78f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1362 microversion: 2.25 time: 1.628267 Jul 14 14:26:50.890574 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 174/366] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:26:49 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1362 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:50.920077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3af7ae3c-f248-41b6-b1c7-13a0850d99cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:50.921196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3af7ae3c-f248-41b6-b1c7-13a0850d99cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:50.949877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3af7ae3c-f248-41b6-b1c7-13a0850d99cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:50.955833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3af7ae3c-f248-41b6-b1c7-13a0850d99cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:50.956692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3af7ae3c-f248-41b6-b1c7-13a0850d99cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:50.957176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3af7ae3c-f248-41b6-b1c7-13a0850d99cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:51.147816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3af7ae3c-f248-41b6-b1c7-13a0850d99cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:51.167768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-542a196d-b6c7-4d65-9d4a-8ba581972f10 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:51.170786 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3af7ae3c-f248-41b6-b1c7-13a0850d99cc tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1271 microversion: 2.1 time: 0.276538 Jul 14 14:26:51.171196 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 175/367] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:50 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1271 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:51.184190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0cc96f1c-0422-4ecc-a105-55ac86f4fb97 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:51.184880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0cc96f1c-0422-4ecc-a105-55ac86f4fb97 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:51.200027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0cc96f1c-0422-4ecc-a105-55ac86f4fb97 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:51.200380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0cc96f1c-0422-4ecc-a105-55ac86f4fb97 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:51.205795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0cc96f1c-0422-4ecc-a105-55ac86f4fb97 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:51.208366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0cc96f1c-0422-4ecc-a105-55ac86f4fb97 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:51.222676 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-542a196d-b6c7-4d65-9d4a-8ba581972f10 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1321 microversion: 2.1 time: 0.395994 Jul 14 14:26:51.233239 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 193/368] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:50 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:51.238545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-48910556-ac5d-4f94-ae50-e5010c00b9f2 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:51.239369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-48910556-ac5d-4f94-ae50-e5010c00b9f2 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:51.252129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48910556-ac5d-4f94-ae50-e5010c00b9f2 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:51.263535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48910556-ac5d-4f94-ae50-e5010c00b9f2 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:51.264493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48910556-ac5d-4f94-ae50-e5010c00b9f2 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:51.265087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48910556-ac5d-4f94-ae50-e5010c00b9f2 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:51.571141 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-48910556-ac5d-4f94-ae50-e5010c00b9f2 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.336522 Jul 14 14:26:51.572038 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 194/369] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:26:51 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-interface => generated 284 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:51.576918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-41a8bf73-4bda-4ca6-a05a-763b9b4b7d0f req-26304e33-6aa3-441d-adc7-53da9242d39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2395da0-b1d7-4882-a1ac-e2029c5fad94", "name": "network-vif-unplugged", "status": "completed", "tag": "b00304cb-9535-4ecd-a778-337437c2dd15"}, {"name": "network-changed", "server_uuid": "f2395da0-b1d7-4882-a1ac-e2029c5fad94", "tag": "b00304cb-9535-4ecd-a778-337437c2dd15"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:51.602398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-41a8bf73-4bda-4ca6-a05a-763b9b4b7d0f req-26304e33-6aa3-441d-adc7-53da9242d39c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:51.603205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-41a8bf73-4bda-4ca6-a05a-763b9b4b7d0f req-26304e33-6aa3-441d-adc7-53da9242d39c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:51.624208 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-41a8bf73-4bda-4ca6-a05a-763b9b4b7d0f req-26304e33-6aa3-441d-adc7-53da9242d39c service nova] Creating event network-vif-unplugged:b00304cb-9535-4ecd-a778-337437c2dd15 for instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 on n-h2-767704-28 Jul 14 14:26:51.625639 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-41a8bf73-4bda-4ca6-a05a-763b9b4b7d0f req-26304e33-6aa3-441d-adc7-53da9242d39c service nova] Creating event network-changed:b00304cb-9535-4ecd-a778-337437c2dd15 for instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 on n-h2-767704-28 Jul 14 14:26:51.645927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-41a8bf73-4bda-4ca6-a05a-763b9b4b7d0f req-26304e33-6aa3-441d-adc7-53da9242d39c service nova] Instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:26:51.668966 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-41a8bf73-4bda-4ca6-a05a-763b9b4b7d0f req-26304e33-6aa3-441d-adc7-53da9242d39c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.095272 Jul 14 14:26:51.670016 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 195/370] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:51.912776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc497e59-637b-4b7c-9459-ab8a4ccd3c1d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:51.914479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc497e59-637b-4b7c-9459-ab8a4ccd3c1d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:51.944346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc497e59-637b-4b7c-9459-ab8a4ccd3c1d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:51.945305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc497e59-637b-4b7c-9459-ab8a4ccd3c1d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:51.946608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc497e59-637b-4b7c-9459-ab8a4ccd3c1d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:51.947255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc497e59-637b-4b7c-9459-ab8a4ccd3c1d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:51.956302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:52.173263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0cc96f1c-0422-4ecc-a105-55ac86f4fb97 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:52.198330 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0cc96f1c-0422-4ecc-a105-55ac86f4fb97 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1474 microversion: 2.1 time: 1.019994 Jul 14 14:26:52.214833 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 176/371] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:51 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1474 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:52.221057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-750fcb61-f98d-4859-a921-433246749a73 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:52.222420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-750fcb61-f98d-4859-a921-433246749a73 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:52.231821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-750fcb61-f98d-4859-a921-433246749a73 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:52.233690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-750fcb61-f98d-4859-a921-433246749a73 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:52.234796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-750fcb61-f98d-4859-a921-433246749a73 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:52.235670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-750fcb61-f98d-4859-a921-433246749a73 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:52.417001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-750fcb61-f98d-4859-a921-433246749a73 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:52.441966 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-750fcb61-f98d-4859-a921-433246749a73 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1277 microversion: 2.1 time: 0.224118 Jul 14 14:26:52.442471 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 177/372] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:52 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:52.462663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc497e59-637b-4b7c-9459-ab8a4ccd3c1d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:52.477426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc497e59-637b-4b7c-9459-ab8a4ccd3c1d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:52.485252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc497e59-637b-4b7c-9459-ab8a4ccd3c1d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:52.486788 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc497e59-637b-4b7c-9459-ab8a4ccd3c1d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1362 microversion: 2.25 time: 0.579872 Jul 14 14:26:52.487588 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 196/373] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:26:51 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:52.488259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0e6b3446-7ff5-4ce9-b15c-868ccbf52f81 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:52.489223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0e6b3446-7ff5-4ce9-b15c-868ccbf52f81 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:52.507506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e6b3446-7ff5-4ce9-b15c-868ccbf52f81 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:52.510485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e6b3446-7ff5-4ce9-b15c-868ccbf52f81 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:52.522155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e6b3446-7ff5-4ce9-b15c-868ccbf52f81 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:52.525657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e6b3446-7ff5-4ce9-b15c-868ccbf52f81 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:53.040054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0e6b3446-7ff5-4ce9-b15c-868ccbf52f81 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:53.053883 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0e6b3446-7ff5-4ce9-b15c-868ccbf52f81 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1389 microversion: 2.1 time: 0.604524 Jul 14 14:26:53.065075 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 178/374] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:52 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1389 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:53.231930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d78d9b1d-6533-4a99-ae43-3201ba8c6033 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:53.233138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d78d9b1d-6533-4a99-ae43-3201ba8c6033 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:53.243359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d78d9b1d-6533-4a99-ae43-3201ba8c6033 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:53.243969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d78d9b1d-6533-4a99-ae43-3201ba8c6033 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:53.246586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d78d9b1d-6533-4a99-ae43-3201ba8c6033 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:53.247313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d78d9b1d-6533-4a99-ae43-3201ba8c6033 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:53.463551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f99e7125-9b70-486c-98cb-bced1cf43e8b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:53.465118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f99e7125-9b70-486c-98cb-bced1cf43e8b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:53.485495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f99e7125-9b70-486c-98cb-bced1cf43e8b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:53.487824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f99e7125-9b70-486c-98cb-bced1cf43e8b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:53.490890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f99e7125-9b70-486c-98cb-bced1cf43e8b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:53.493874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f99e7125-9b70-486c-98cb-bced1cf43e8b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:53.871199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f99e7125-9b70-486c-98cb-bced1cf43e8b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:53.884498 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f99e7125-9b70-486c-98cb-bced1cf43e8b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1277 microversion: 2.1 time: 0.424135 Jul 14 14:26:53.885201 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 179/375] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:53 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1277 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:26:53.906355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cb461263-ece0-40d1-a1d4-8fdd2c5dbba1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:53.908104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cb461263-ece0-40d1-a1d4-8fdd2c5dbba1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:53.924693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb461263-ece0-40d1-a1d4-8fdd2c5dbba1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:53.925918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb461263-ece0-40d1-a1d4-8fdd2c5dbba1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:53.927211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb461263-ece0-40d1-a1d4-8fdd2c5dbba1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:53.927971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb461263-ece0-40d1-a1d4-8fdd2c5dbba1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:53.943851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d78d9b1d-6533-4a99-ae43-3201ba8c6033 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:53.956618 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d78d9b1d-6533-4a99-ae43-3201ba8c6033 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1474 microversion: 2.1 time: 0.729635 Jul 14 14:26:53.986019 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 197/376] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:53 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1474 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:53.998917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ef3228c2-742e-4c37-9466-81bcd7530969 req-b951f58c-8fec-409d-b1e9-695a9d6f130d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88426cdc-557a-4724-9ef2-d84d32b4191d", "tag": "5671e97e-1f32-49f5-aea1-ca6152f537d3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:54.014383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ef3228c2-742e-4c37-9466-81bcd7530969 req-b951f58c-8fec-409d-b1e9-695a9d6f130d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:54.015148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ef3228c2-742e-4c37-9466-81bcd7530969 req-b951f58c-8fec-409d-b1e9-695a9d6f130d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:54.039721 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ef3228c2-742e-4c37-9466-81bcd7530969 req-b951f58c-8fec-409d-b1e9-695a9d6f130d service nova] Creating event network-changed:5671e97e-1f32-49f5-aea1-ca6152f537d3 for instance 88426cdc-557a-4724-9ef2-d84d32b4191d on n-h2-767704-28 Jul 14 14:26:54.047725 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ef3228c2-742e-4c37-9466-81bcd7530969 req-b951f58c-8fec-409d-b1e9-695a9d6f130d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052512 Jul 14 14:26:54.049028 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 198/377] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:54.098012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b7c29878-8d9a-4350-b407-f792bfd28b0a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:54.100759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b7c29878-8d9a-4350-b407-f792bfd28b0a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:54.125788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7c29878-8d9a-4350-b407-f792bfd28b0a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:54.129491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7c29878-8d9a-4350-b407-f792bfd28b0a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:54.130961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7c29878-8d9a-4350-b407-f792bfd28b0a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:54.134789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7c29878-8d9a-4350-b407-f792bfd28b0a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:54.872726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b7c29878-8d9a-4350-b407-f792bfd28b0a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:54.910567 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b7c29878-8d9a-4350-b407-f792bfd28b0a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1389 microversion: 2.1 time: 0.836139 Jul 14 14:26:54.923566 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 199/378] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:54 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1389 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:55.041499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cb461263-ece0-40d1-a1d4-8fdd2c5dbba1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:55.058600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cb461263-ece0-40d1-a1d4-8fdd2c5dbba1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:55.069376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cb461263-ece0-40d1-a1d4-8fdd2c5dbba1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:55.073605 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cb461263-ece0-40d1-a1d4-8fdd2c5dbba1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1362 microversion: 2.25 time: 1.176507 Jul 14 14:26:55.095960 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 180/379] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:26:53 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1362 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:55.115187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c438a59e-a313-4b6c-830e-2fd32af8803e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:55.116022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c438a59e-a313-4b6c-830e-2fd32af8803e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:55.147363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c438a59e-a313-4b6c-830e-2fd32af8803e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:55.148724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c438a59e-a313-4b6c-830e-2fd32af8803e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:55.153943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c438a59e-a313-4b6c-830e-2fd32af8803e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:55.161446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c438a59e-a313-4b6c-830e-2fd32af8803e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:55.434860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9427e503-02d7-49be-8d23-d04667d2099a tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:55.439486 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:55.439486 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:55.441239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9427e503-02d7-49be-8d23-d04667d2099a tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:55.441931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9427e503-02d7-49be-8d23-d04667d2099a tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:55.442903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9427e503-02d7-49be-8d23-d04667d2099a tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:55.443736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9427e503-02d7-49be-8d23-d04667d2099a tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:55.475380 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9427e503-02d7-49be-8d23-d04667d2099a tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.537030 Jul 14 14:26:55.475910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:55.477380 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 200/380] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:26:54 2022] GET /compute/v2.1/os-services => generated 949 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:55.489765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5863e350-0335-44f1-8fc8-d7acd16165a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:55.493346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5863e350-0335-44f1-8fc8-d7acd16165a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:55.500361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5863e350-0335-44f1-8fc8-d7acd16165a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:55.501182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5863e350-0335-44f1-8fc8-d7acd16165a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:55.503138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5863e350-0335-44f1-8fc8-d7acd16165a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:55.503814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5863e350-0335-44f1-8fc8-d7acd16165a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:56.533309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:56.678373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c438a59e-a313-4b6c-830e-2fd32af8803e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:56.709362 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c438a59e-a313-4b6c-830e-2fd32af8803e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1319 microversion: 2.1 time: 1.610470 Jul 14 14:26:56.711285 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 181/381] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:55 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1319 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:56.727668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a2b482e1-dda4-4617-b8c5-d94d35de0c8a tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:56.739418 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:56.739418 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:56.742926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2b482e1-dda4-4617-b8c5-d94d35de0c8a tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:56.743883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2b482e1-dda4-4617-b8c5-d94d35de0c8a tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:56.745206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2b482e1-dda4-4617-b8c5-d94d35de0c8a tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:56.745926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2b482e1-dda4-4617-b8c5-d94d35de0c8a tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:56.853233 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a2b482e1-dda4-4617-b8c5-d94d35de0c8a tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.138811 Jul 14 14:26:56.864656 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 182/382] 10.222.0.81 () {58 vars in 1169 bytes} [Thu Jul 14 14:26:56 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:56.870660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5c3eb410-22d9-4562-8516-29695ae5259a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:56.871282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5c3eb410-22d9-4562-8516-29695ae5259a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:56.888333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c3eb410-22d9-4562-8516-29695ae5259a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:56.891094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c3eb410-22d9-4562-8516-29695ae5259a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:56.892726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c3eb410-22d9-4562-8516-29695ae5259a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:56.893404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c3eb410-22d9-4562-8516-29695ae5259a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:56.897080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:56.932748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5863e350-0335-44f1-8fc8-d7acd16165a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:56.948672 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5863e350-0335-44f1-8fc8-d7acd16165a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1472 microversion: 2.1 time: 1.469734 Jul 14 14:26:56.949885 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 201/383] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:55 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1472 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:56.966883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dfb526fd-1d1b-48a2-8cec-346e60690fcd tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:56.968362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dfb526fd-1d1b-48a2-8cec-346e60690fcd tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:56.980155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfb526fd-1d1b-48a2-8cec-346e60690fcd tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:56.980605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfb526fd-1d1b-48a2-8cec-346e60690fcd tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:56.981422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfb526fd-1d1b-48a2-8cec-346e60690fcd tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:56.981867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfb526fd-1d1b-48a2-8cec-346e60690fcd tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:57.578394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dfb526fd-1d1b-48a2-8cec-346e60690fcd tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:57.595639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dfb526fd-1d1b-48a2-8cec-346e60690fcd tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:57.597307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dfb526fd-1d1b-48a2-8cec-346e60690fcd tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:57.607124 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dfb526fd-1d1b-48a2-8cec-346e60690fcd tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1362 microversion: 2.25 time: 0.654839 Jul 14 14:26:57.610259 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 202/384] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:26:56 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1362 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:57.622770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a7adb98b-4431-425d-ab14-669060b2937d req-ecb3542a-e31e-4023-a5c1-f4a80fde12e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f1d989-211a-466d-9a7a-a1a9303daf5d", "tag": "e9dab558-a62c-4e16-92a9-8c676e1f2df2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:57.637638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a7adb98b-4431-425d-ab14-669060b2937d req-ecb3542a-e31e-4023-a5c1-f4a80fde12e2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:57.638205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a7adb98b-4431-425d-ab14-669060b2937d req-ecb3542a-e31e-4023-a5c1-f4a80fde12e2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:57.659470 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a7adb98b-4431-425d-ab14-669060b2937d req-ecb3542a-e31e-4023-a5c1-f4a80fde12e2 service nova] Creating event network-changed:e9dab558-a62c-4e16-92a9-8c676e1f2df2 for instance 60f1d989-211a-466d-9a7a-a1a9303daf5d on n-h1-767704-28 Jul 14 14:26:57.665481 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a7adb98b-4431-425d-ab14-669060b2937d req-ecb3542a-e31e-4023-a5c1-f4a80fde12e2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053198 Jul 14 14:26:57.666616 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 203/385] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:57.694291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5c3eb410-22d9-4562-8516-29695ae5259a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:57.713284 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5c3eb410-22d9-4562-8516-29695ae5259a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1389 microversion: 2.1 time: 0.857103 Jul 14 14:26:57.713886 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 183/386] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:56 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1389 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:57.725766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3b9363d4-65f7-444b-95d7-eba92b7dfc77 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:57.730697 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:57.730697 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:57.742900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b9363d4-65f7-444b-95d7-eba92b7dfc77 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:57.743712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b9363d4-65f7-444b-95d7-eba92b7dfc77 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:57.744727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b9363d4-65f7-444b-95d7-eba92b7dfc77 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:57.745396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b9363d4-65f7-444b-95d7-eba92b7dfc77 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:57.795629 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3b9363d4-65f7-444b-95d7-eba92b7dfc77 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.075953 Jul 14 14:26:57.796258 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 184/387] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:26:57 2022] GET /compute/v2.1/os-services => generated 949 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:57.806066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f725e818-4c5d-469c-b509-e7d4edc756db tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:57.813078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f725e818-4c5d-469c-b509-e7d4edc756db tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:57.826173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f725e818-4c5d-469c-b509-e7d4edc756db tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:57.826888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f725e818-4c5d-469c-b509-e7d4edc756db tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:57.827836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f725e818-4c5d-469c-b509-e7d4edc756db tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:57.829658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f725e818-4c5d-469c-b509-e7d4edc756db tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:57.952799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-17dd92eb-f235-4022-a8f5-2de6816fd51f tempest-FlavorsV261TestJSON-94081782 tempest-FlavorsV261TestJSON-94081782-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-406804624", "id": 1944443102, "os-flavor-access:is_public": "True"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:57.954471 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:57.954471 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:57.994078 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-17dd92eb-f235-4022-a8f5-2de6816fd51f tempest-FlavorsV261TestJSON-94081782 tempest-FlavorsV261TestJSON-94081782-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.325920 Jul 14 14:26:58.006750 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 204/388] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:26:57 2022] POST /compute/v2.1/flavors => generated 467 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:26:58.016613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6b62d365-d195-4333-8323-ee81ca273685 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:58.018418 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:58.018418 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:58.019871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b62d365-d195-4333-8323-ee81ca273685 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:58.020480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b62d365-d195-4333-8323-ee81ca273685 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:58.021488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b62d365-d195-4333-8323-ee81ca273685 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:58.022086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b62d365-d195-4333-8323-ee81ca273685 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:58.081133 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6b62d365-d195-4333-8323-ee81ca273685 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?host=n-d-767704-28&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.072939 Jul 14 14:26:58.084444 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 205/389] 10.222.0.81 () {58 vars in 1195 bytes} [Thu Jul 14 14:26:58 2022] GET /compute/v2.1/os-services?host=n-d-767704-28&binary=xxx => generated 16 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:58.090053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3afb5e5b-12bf-4540-a945-b1c1bd196008 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:58.099586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3afb5e5b-12bf-4540-a945-b1c1bd196008 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:58.111499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3afb5e5b-12bf-4540-a945-b1c1bd196008 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:58.116572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3afb5e5b-12bf-4540-a945-b1c1bd196008 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:58.118285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3afb5e5b-12bf-4540-a945-b1c1bd196008 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:58.118893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3afb5e5b-12bf-4540-a945-b1c1bd196008 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:58.941267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3afb5e5b-12bf-4540-a945-b1c1bd196008 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:58.951321 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3afb5e5b-12bf-4540-a945-b1c1bd196008 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1469 microversion: 2.1 time: 0.865427 Jul 14 14:26:58.963666 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 206/390] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:58 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1469 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:59.067738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f725e818-4c5d-469c-b509-e7d4edc756db tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:59.079249 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f725e818-4c5d-469c-b509-e7d4edc756db tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1319 microversion: 2.1 time: 1.277796 Jul 14 14:26:59.080657 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 185/391] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:57 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1319 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:59.095769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4fda95fd-558e-46c3-8659-9c91873b34d4 tempest-FlavorsV261TestJSON-29536600 tempest-FlavorsV261TestJSON-29536600-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:59.101567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9190edc5-664d-455a-afbc-8fc8278ea878 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:59.103825 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:59.103825 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:26:59.105807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9190edc5-664d-455a-afbc-8fc8278ea878 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.105957 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4fda95fd-558e-46c3-8659-9c91873b34d4 tempest-FlavorsV261TestJSON-29536600 tempest-FlavorsV261TestJSON-29536600-project] 10.222.0.81 "GET /compute/v2.1/flavors/1944443102" status: 200 len: 467 microversion: 2.61 time: 0.140229 Jul 14 14:26:59.106636 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 207/392] 10.222.0.81 () {60 vars in 1198 bytes} [Thu Jul 14 14:26:58 2022] GET /compute/v2.1/flavors/1944443102 => generated 467 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:26:59.106761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9190edc5-664d-455a-afbc-8fc8278ea878 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:59.108348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9190edc5-664d-455a-afbc-8fc8278ea878 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.108975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9190edc5-664d-455a-afbc-8fc8278ea878 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:59.139865 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9190edc5-664d-455a-afbc-8fc8278ea878 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.058108 Jul 14 14:26:59.141298 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 186/393] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:26:59 2022] GET /compute/v2.1/os-services => generated 949 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:59.149933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aa313d97-d718-47e4-8b60-51aa939a073f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:59.150772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aa313d97-d718-47e4-8b60-51aa939a073f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:59.157030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa313d97-d718-47e4-8b60-51aa939a073f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.157688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa313d97-d718-47e4-8b60-51aa939a073f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:59.158977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa313d97-d718-47e4-8b60-51aa939a073f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.159552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa313d97-d718-47e4-8b60-51aa939a073f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:59.166317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-625b223f-f810-4c67-ace4-bafbb61b59cb req-0c9ed1e3-0c33-4dfe-bc54-d4ff6d6c0e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c5728e-50ec-43f4-bd4e-8d7b9217bb69", "tag": "26efdc8a-13a1-46a1-a04f-f980949a8248"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:59.176173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-625b223f-f810-4c67-ace4-bafbb61b59cb req-0c9ed1e3-0c33-4dfe-bc54-d4ff6d6c0e1c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.176587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-625b223f-f810-4c67-ace4-bafbb61b59cb req-0c9ed1e3-0c33-4dfe-bc54-d4ff6d6c0e1c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:59.191534 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-625b223f-f810-4c67-ace4-bafbb61b59cb req-0c9ed1e3-0c33-4dfe-bc54-d4ff6d6c0e1c service nova] Creating event network-changed:26efdc8a-13a1-46a1-a04f-f980949a8248 for instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 on n-h2-767704-28 Jul 14 14:26:59.199000 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-625b223f-f810-4c67-ace4-bafbb61b59cb req-0c9ed1e3-0c33-4dfe-bc54-d4ff6d6c0e1c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090788 Jul 14 14:26:59.199654 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 208/394] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:59.204895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-86ab3399-7265-4257-8958-1e4855b2cc35 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:59.205705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-86ab3399-7265-4257-8958-1e4855b2cc35 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:59.212651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86ab3399-7265-4257-8958-1e4855b2cc35 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.213280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86ab3399-7265-4257-8958-1e4855b2cc35 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:59.214123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86ab3399-7265-4257-8958-1e4855b2cc35 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.214655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86ab3399-7265-4257-8958-1e4855b2cc35 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:59.408442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=12 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:59.724226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aa313d97-d718-47e4-8b60-51aa939a073f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:59.734437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aa313d97-d718-47e4-8b60-51aa939a073f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:59.736036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-86ab3399-7265-4257-8958-1e4855b2cc35 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:59.736207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aa313d97-d718-47e4-8b60-51aa939a073f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:26:59.738909 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aa313d97-d718-47e4-8b60-51aa939a073f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1362 microversion: 2.25 time: 0.596984 Jul 14 14:26:59.740001 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 187/395] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:26:59 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1362 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:59.745933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8a334849-6f44-40a9-9711-43d858c42d61 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:59.746474 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8a334849-6f44-40a9-9711-43d858c42d61 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:59.756161 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-86ab3399-7265-4257-8958-1e4855b2cc35 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1389 microversion: 2.1 time: 0.555058 Jul 14 14:26:59.758121 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 209/396] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:59 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1389 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:59.762705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a334849-6f44-40a9-9711-43d858c42d61 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.763161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a334849-6f44-40a9-9711-43d858c42d61 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:59.764460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a334849-6f44-40a9-9711-43d858c42d61 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.765141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a334849-6f44-40a9-9711-43d858c42d61 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:59.765438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a56ccb2a-2040-48a9-989f-f46f3d757981 tempest-FlavorsV261TestJSON-94081782 tempest-FlavorsV261TestJSON-94081782-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c88bb430>, body: {"flavor": {"description": "new"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:59.784178 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:59.784178 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:59.827654 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a56ccb2a-2040-48a9-989f-f46f3d757981 tempest-FlavorsV261TestJSON-94081782 tempest-FlavorsV261TestJSON-94081782-project-admin] 10.222.0.81 "PUT /compute/v2.1/flavors/1944443102" status: 200 len: 468 microversion: 2.61 time: 0.067881 Jul 14 14:26:59.835665 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 210/397] 10.222.0.81 () {62 vars in 1218 bytes} [Thu Jul 14 14:26:59 2022] PUT /compute/v2.1/flavors/1944443102 => generated 468 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:26:59.840388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-52a12c68-e18c-467a-8747-2d0fa3485407 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:59.842598 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:26:59.842598 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:26:59.844659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52a12c68-e18c-467a-8747-2d0fa3485407 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.845169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52a12c68-e18c-467a-8747-2d0fa3485407 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:59.845987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52a12c68-e18c-467a-8747-2d0fa3485407 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.846517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52a12c68-e18c-467a-8747-2d0fa3485407 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:59.875295 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8a334849-6f44-40a9-9711-43d858c42d61 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "POST /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94/action" status: 204 len: 0 microversion: 2.1 time: 0.133013 Jul 14 14:26:59.876601 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 188/398] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:26:59 2022] POST /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94/action => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:26:59.884650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba8abd64-43f5-469a-a4d5-7976203205fd tempest-FlavorsV261TestJSON-29536600 tempest-FlavorsV261TestJSON-29536600-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:59.909691 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ba8abd64-43f5-469a-a4d5-7976203205fd tempest-FlavorsV261TestJSON-29536600 tempest-FlavorsV261TestJSON-29536600-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 7153 microversion: 2.61 time: 0.031600 Jul 14 14:26:59.912375 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-52a12c68-e18c-467a-8747-2d0fa3485407 tempest-ServicesAdminNegativeTestJSON-1360613404 tempest-ServicesAdminNegativeTestJSON-1360613404-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.080175 Jul 14 14:26:59.916224 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 189/399] 10.222.0.81 () {60 vars in 1186 bytes} [Thu Jul 14 14:26:59 2022] GET /compute/v2.1/flavors/detail => generated 7153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:59.916619 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 211/400] 10.222.0.81 () {58 vars in 1197 bytes} [Thu Jul 14 14:26:59 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:26:59.930376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f735c4e-b8db-4129-a7da-7bf71b2fb1f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:59.931445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8f735c4e-b8db-4129-a7da-7bf71b2fb1f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:26:59.941028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f735c4e-b8db-4129-a7da-7bf71b2fb1f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.941492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f735c4e-b8db-4129-a7da-7bf71b2fb1f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:26:59.942277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f735c4e-b8db-4129-a7da-7bf71b2fb1f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:26:59.942719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f735c4e-b8db-4129-a7da-7bf71b2fb1f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:00.089969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7208321d-d96b-4cd3-b0d5-0219d3380ad9 tempest-ServicesAdminNegativeTestJSON-397136331 tempest-ServicesAdminNegativeTestJSON-397136331-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:00.091145 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:00.091145 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:00.093270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7208321d-d96b-4cd3-b0d5-0219d3380ad9 tempest-ServicesAdminNegativeTestJSON-397136331 tempest-ServicesAdminNegativeTestJSON-397136331-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c460449075e9408f81af0f65352fa270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee82b98592ef464d82757282e9478286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7208321d-d96b-4cd3-b0d5-0219d3380ad9 tempest-ServicesAdminNegativeTestJSON-397136331 tempest-ServicesAdminNegativeTestJSON-397136331-project] Request method failure captured: Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cete74OOm20ZQjB916sH_MCH6vgOl6ch9xX_wqzK7rrjsobu5bm7xUzVffzi5_Jlil6Ji9snPDG3cVF3F5PT3A1G3_SOvVHduaMnR2x4rFbaVlEPBKwz0-pIzpCOiZrGfMaNl3u6860ow6ZdXxIhMhmOHgnr3lHt28KJlN4qx4QPRI Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ee82b98592ef464d82757282e9478286 Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-397136331 Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:00.095468 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:00.096753 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee82b98592ef464d82757282e9478286"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ee82b98592ef464d82757282e9478286"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ee82b98592ef464d82757282e9478286", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee82b98592ef464d82757282e9478286"}]}] Jul 14 14:27:00.096753 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-397136331 Jul 14 14:27:00.096753 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ee82b98592ef464d82757282e9478286 Jul 14 14:27:00.096753 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-397136331 Jul 14 14:27:00.096753 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServicesAdminNegativeTestJSON-397136331-project Jul 14 14:27:00.096753 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:00.096753 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:00.096753 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: c460449075e9408f81af0f65352fa270 Jul 14 14:27:00.096753 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-397136331-project Jul 14 14:27:00.096753 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:27:00.096753 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 14 14:27:00.096753 n-d-767704-28 devstack@n-api.service[119512]: action_args: {} Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:00.097514 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 14 14:27:00.098611 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:00.101303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7208321d-d96b-4cd3-b0d5-0219d3380ad9 tempest-ServicesAdminNegativeTestJSON-397136331 tempest-ServicesAdminNegativeTestJSON-397136331-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:00.102240 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7208321d-d96b-4cd3-b0d5-0219d3380ad9 tempest-ServicesAdminNegativeTestJSON-397136331 tempest-ServicesAdminNegativeTestJSON-397136331-project] 10.222.0.81 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.179409 Jul 14 14:27:00.103382 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 212/401] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:26:59 2022] GET /compute/v2.1/os-services => generated 112 bytes in 181 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:27:00.113418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-840afa28-1636-42ad-8b25-e2102f7ed79a tempest-FlavorsV261TestJSON-29536600 tempest-FlavorsV261TestJSON-29536600-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:00.161316 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-840afa28-1636-42ad-8b25-e2102f7ed79a tempest-FlavorsV261TestJSON-29536600 tempest-FlavorsV261TestJSON-29536600-project] 10.222.0.81 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.61 time: 0.056461 Jul 14 14:27:00.162556 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 213/402] 10.222.0.81 () {60 vars in 1165 bytes} [Thu Jul 14 14:27:00 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:00.169007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a7e608ff-4805-4a0b-844d-828e0e700527 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:00.169947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a7e608ff-4805-4a0b-844d-828e0e700527 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:00.186184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7e608ff-4805-4a0b-844d-828e0e700527 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:00.187549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7e608ff-4805-4a0b-844d-828e0e700527 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:00.188363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7e608ff-4805-4a0b-844d-828e0e700527 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:00.188806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7e608ff-4805-4a0b-844d-828e0e700527 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:00.558825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f735c4e-b8db-4129-a7da-7bf71b2fb1f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:00.568728 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8f735c4e-b8db-4129-a7da-7bf71b2fb1f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1469 microversion: 2.1 time: 0.650963 Jul 14 14:27:00.572183 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 190/403] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:26:59 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1469 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:00.589847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f993d202-a0cc-41cc-8e09-abb62aa74422 tempest-FlavorsV261TestJSON-94081782 tempest-FlavorsV261TestJSON-94081782-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:00.591295 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:00.591295 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:00.612877 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f993d202-a0cc-41cc-8e09-abb62aa74422 tempest-FlavorsV261TestJSON-94081782 tempest-FlavorsV261TestJSON-94081782-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1944443102" status: 202 len: 0 microversion: 2.61 time: 0.039424 Jul 14 14:27:00.613486 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 191/404] 10.222.0.81 () {60 vars in 1201 bytes} [Thu Jul 14 14:27:00 2022] DELETE /compute/v2.1/flavors/1944443102 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:27:00.622895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e580d5ae-269c-49a4-9aab-94dc6062fedd tempest-FlavorsV261TestJSON-94081782 tempest-FlavorsV261TestJSON-94081782-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:00.648640 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e580d5ae-269c-49a4-9aab-94dc6062fedd tempest-FlavorsV261TestJSON-94081782 tempest-FlavorsV261TestJSON-94081782-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 6695 microversion: 2.61 time: 0.029392 Jul 14 14:27:00.649672 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 192/405] 10.222.0.81 () {60 vars in 1186 bytes} [Thu Jul 14 14:27:00 2022] GET /compute/v2.1/flavors/detail => generated 6695 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:00.756644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aaafcf44-f9cb-4d25-809a-50ce95f740c3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:00.757278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aaafcf44-f9cb-4d25-809a-50ce95f740c3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:00.766980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aaafcf44-f9cb-4d25-809a-50ce95f740c3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:00.769252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aaafcf44-f9cb-4d25-809a-50ce95f740c3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:00.770312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aaafcf44-f9cb-4d25-809a-50ce95f740c3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:00.775731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aaafcf44-f9cb-4d25-809a-50ce95f740c3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:00.853906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a7e608ff-4805-4a0b-844d-828e0e700527 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:00.868898 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a7e608ff-4805-4a0b-844d-828e0e700527 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1319 microversion: 2.1 time: 0.704971 Jul 14 14:27:00.869520 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 214/406] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:00 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1319 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:00.883446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c2a59dfe-8fb9-4f25-be5b-855704e3e006 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:00.891913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c2a59dfe-8fb9-4f25-be5b-855704e3e006 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:00.916566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2a59dfe-8fb9-4f25-be5b-855704e3e006 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:00.917377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2a59dfe-8fb9-4f25-be5b-855704e3e006 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:00.918409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2a59dfe-8fb9-4f25-be5b-855704e3e006 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:00.919018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2a59dfe-8fb9-4f25-be5b-855704e3e006 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:01.603074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c2a59dfe-8fb9-4f25-be5b-855704e3e006 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:01.612719 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c2a59dfe-8fb9-4f25-be5b-855704e3e006 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1389 microversion: 2.1 time: 0.738039 Jul 14 14:27:01.617125 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 215/407] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:00 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1389 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:01.622979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aaafcf44-f9cb-4d25-809a-50ce95f740c3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:01.639969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0ef15607-ef36-47e6-a648-00ceccd99e97 req-be161ba5-d847-4259-aae3-f259db38a3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2395da0-b1d7-4882-a1ac-e2029c5fad94", "name": "network-vif-plugged", "status": "completed", "tag": "b00304cb-9535-4ecd-a778-337437c2dd15"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:01.640743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aaafcf44-f9cb-4d25-809a-50ce95f740c3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:01.642635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aaafcf44-f9cb-4d25-809a-50ce95f740c3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:01.643911 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aaafcf44-f9cb-4d25-809a-50ce95f740c3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1362 microversion: 2.25 time: 0.891108 Jul 14 14:27:01.659590 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 193/408] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:00 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1362 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:27:01.659590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-2767642e-b850-4d95-a5bb-dc9105917106 req-1eb51195-0dc0-4011-a55e-7098524c87a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23efb1d0-4c73-471c-b109-75d53db07d0a", "tag": "86bfaf20-9a4b-4cd6-a410-15a65252105c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:01.670132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0ef15607-ef36-47e6-a648-00ceccd99e97 req-be161ba5-d847-4259-aae3-f259db38a3ab service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:01.678675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0ef15607-ef36-47e6-a648-00ceccd99e97 req-be161ba5-d847-4259-aae3-f259db38a3ab service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:01.688986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2767642e-b850-4d95-a5bb-dc9105917106 req-1eb51195-0dc0-4011-a55e-7098524c87a9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:01.697125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2767642e-b850-4d95-a5bb-dc9105917106 req-1eb51195-0dc0-4011-a55e-7098524c87a9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:01.717031 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0ef15607-ef36-47e6-a648-00ceccd99e97 req-be161ba5-d847-4259-aae3-f259db38a3ab service nova] Creating event network-vif-plugged:b00304cb-9535-4ecd-a778-337437c2dd15 for instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 on n-h2-767704-28 Jul 14 14:27:01.748098 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-2767642e-b850-4d95-a5bb-dc9105917106 req-1eb51195-0dc0-4011-a55e-7098524c87a9 service nova] Creating event network-changed:86bfaf20-9a4b-4cd6-a410-15a65252105c for instance 23efb1d0-4c73-471c-b109-75d53db07d0a on n-h1-767704-28 Jul 14 14:27:01.753318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-0ef15607-ef36-47e6-a648-00ceccd99e97 req-be161ba5-d847-4259-aae3-f259db38a3ab service nova] Instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:27:01.770820 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-2767642e-b850-4d95-a5bb-dc9105917106 req-1eb51195-0dc0-4011-a55e-7098524c87a9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116071 Jul 14 14:27:01.773043 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 194/409] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:01.778664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9b2838ad-5d8b-4d1c-8933-082429409b4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:01.793491 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0ef15607-ef36-47e6-a648-00ceccd99e97 req-be161ba5-d847-4259-aae3-f259db38a3ab service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174505 Jul 14 14:27:01.795018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9b2838ad-5d8b-4d1c-8933-082429409b4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:01.797958 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 216/410] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:01.818279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b2838ad-5d8b-4d1c-8933-082429409b4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:01.818779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b2838ad-5d8b-4d1c-8933-082429409b4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:01.819763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b2838ad-5d8b-4d1c-8933-082429409b4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:01.821152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b2838ad-5d8b-4d1c-8933-082429409b4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:01.890393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7c32df6e-5df0-41ea-8ec9-ee2cc4e508d4 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:01.891801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7c32df6e-5df0-41ea-8ec9-ee2cc4e508d4 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:01.911588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c32df6e-5df0-41ea-8ec9-ee2cc4e508d4 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:01.912396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c32df6e-5df0-41ea-8ec9-ee2cc4e508d4 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:01.913472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c32df6e-5df0-41ea-8ec9-ee2cc4e508d4 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:01.914599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c32df6e-5df0-41ea-8ec9-ee2cc4e508d4 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:02.372566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9b2838ad-5d8b-4d1c-8933-082429409b4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:02.399083 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9b2838ad-5d8b-4d1c-8933-082429409b4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1469 microversion: 2.1 time: 0.623412 Jul 14 14:27:02.400043 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 195/411] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:01 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1469 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:02.459392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7c32df6e-5df0-41ea-8ec9-ee2cc4e508d4 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:02.468286 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7c32df6e-5df0-41ea-8ec9-ee2cc4e508d4 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1319 microversion: 2.1 time: 0.585962 Jul 14 14:27:02.469484 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 217/412] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:01 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1319 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:27:02.637145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f278fdab-fab7-438d-85eb-c912ceaccd5b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:02.637765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f278fdab-fab7-438d-85eb-c912ceaccd5b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:02.651554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f278fdab-fab7-438d-85eb-c912ceaccd5b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:02.651931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f278fdab-fab7-438d-85eb-c912ceaccd5b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:02.668200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-64ffcadf-e2eb-41fc-a66c-6ef408d69b2e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:02.668808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-64ffcadf-e2eb-41fc-a66c-6ef408d69b2e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:02.672546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f278fdab-fab7-438d-85eb-c912ceaccd5b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:02.673063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f278fdab-fab7-438d-85eb-c912ceaccd5b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:02.681167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-64ffcadf-e2eb-41fc-a66c-6ef408d69b2e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:02.681618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-64ffcadf-e2eb-41fc-a66c-6ef408d69b2e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:02.682394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-64ffcadf-e2eb-41fc-a66c-6ef408d69b2e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:02.683032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-64ffcadf-e2eb-41fc-a66c-6ef408d69b2e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:03.180885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f278fdab-fab7-438d-85eb-c912ceaccd5b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:03.198926 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f278fdab-fab7-438d-85eb-c912ceaccd5b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1389 microversion: 2.1 time: 0.568626 Jul 14 14:27:03.199925 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 196/413] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:02 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1389 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:03.214358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-64ffcadf-e2eb-41fc-a66c-6ef408d69b2e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:03.227952 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-64ffcadf-e2eb-41fc-a66c-6ef408d69b2e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:03.234368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-64ffcadf-e2eb-41fc-a66c-6ef408d69b2e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:03.235548 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-64ffcadf-e2eb-41fc-a66c-6ef408d69b2e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1362 microversion: 2.25 time: 0.572296 Jul 14 14:27:03.236102 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 218/414] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:02 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1362 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:27:03.417314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4ce1e2e5-75ab-45c0-b719-7b211a75637f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:03.418286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4ce1e2e5-75ab-45c0-b719-7b211a75637f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:03.427513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ce1e2e5-75ab-45c0-b719-7b211a75637f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:03.437733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ce1e2e5-75ab-45c0-b719-7b211a75637f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:03.439274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ce1e2e5-75ab-45c0-b719-7b211a75637f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:03.439726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ce1e2e5-75ab-45c0-b719-7b211a75637f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:03.488121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8197e2ce-1a03-48c9-935c-76278619bda7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:03.490069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8197e2ce-1a03-48c9-935c-76278619bda7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:03.530085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8197e2ce-1a03-48c9-935c-76278619bda7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:03.533927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8197e2ce-1a03-48c9-935c-76278619bda7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:03.537023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8197e2ce-1a03-48c9-935c-76278619bda7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:03.537807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8197e2ce-1a03-48c9-935c-76278619bda7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:04.206902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4ce1e2e5-75ab-45c0-b719-7b211a75637f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:04.220878 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4ce1e2e5-75ab-45c0-b719-7b211a75637f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1461 microversion: 2.1 time: 0.806693 Jul 14 14:27:04.221544 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 197/415] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:03 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1461 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:04.232858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b11e7e55-6c19-4f4f-b941-d3601bd7bb72 req-885e2aaa-ba4a-45fa-b022-f0c15e564935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88426cdc-557a-4724-9ef2-d84d32b4191d", "name": "network-vif-plugged", "status": "completed", "tag": "5671e97e-1f32-49f5-aea1-ca6152f537d3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:04.249099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8197e2ce-1a03-48c9-935c-76278619bda7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:04.270341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b11e7e55-6c19-4f4f-b941-d3601bd7bb72 req-885e2aaa-ba4a-45fa-b022-f0c15e564935 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:04.271307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b11e7e55-6c19-4f4f-b941-d3601bd7bb72 req-885e2aaa-ba4a-45fa-b022-f0c15e564935 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:04.271778 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8197e2ce-1a03-48c9-935c-76278619bda7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1319 microversion: 2.1 time: 0.787914 Jul 14 14:27:04.281783 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 219/416] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:03 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1319 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:04.292723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-79c84883-6384-4fd7-88c9-5d7be688c4e9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:04.293674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-79c84883-6384-4fd7-88c9-5d7be688c4e9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:04.303018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79c84883-6384-4fd7-88c9-5d7be688c4e9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:04.303424 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b11e7e55-6c19-4f4f-b941-d3601bd7bb72 req-885e2aaa-ba4a-45fa-b022-f0c15e564935 service nova] Creating event network-vif-plugged:5671e97e-1f32-49f5-aea1-ca6152f537d3 for instance 88426cdc-557a-4724-9ef2-d84d32b4191d on n-h2-767704-28 Jul 14 14:27:04.303908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79c84883-6384-4fd7-88c9-5d7be688c4e9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:04.305241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79c84883-6384-4fd7-88c9-5d7be688c4e9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:04.305861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79c84883-6384-4fd7-88c9-5d7be688c4e9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:04.316809 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b11e7e55-6c19-4f4f-b941-d3601bd7bb72 req-885e2aaa-ba4a-45fa-b022-f0c15e564935 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091827 Jul 14 14:27:04.318484 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 198/417] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:04.328823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-beda9fb5-5377-486d-9d58-79f4c710fd1d tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:04.334023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-beda9fb5-5377-486d-9d58-79f4c710fd1d tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:04.347689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-beda9fb5-5377-486d-9d58-79f4c710fd1d tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:04.352291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-beda9fb5-5377-486d-9d58-79f4c710fd1d tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:04.354744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-beda9fb5-5377-486d-9d58-79f4c710fd1d tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:04.357789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-beda9fb5-5377-486d-9d58-79f4c710fd1d tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:04.835263 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-beda9fb5-5377-486d-9d58-79f4c710fd1d tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1614 microversion: 2.1 time: 0.515371 Jul 14 14:27:04.840367 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 199/418] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:04 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1614 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:04.856219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3a2e683e-b44a-405c-b638-4b09c75526e2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:04.862000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3a2e683e-b44a-405c-b638-4b09c75526e2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:04.877049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-79c84883-6384-4fd7-88c9-5d7be688c4e9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:04.917238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a2e683e-b44a-405c-b638-4b09c75526e2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:04.917752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a2e683e-b44a-405c-b638-4b09c75526e2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:04.937839 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-79c84883-6384-4fd7-88c9-5d7be688c4e9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1389 microversion: 2.1 time: 0.613529 Jul 14 14:27:04.939451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a2e683e-b44a-405c-b638-4b09c75526e2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:04.940016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a2e683e-b44a-405c-b638-4b09c75526e2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:04.944134 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 220/419] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:04 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1389 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:05.596371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3a2e683e-b44a-405c-b638-4b09c75526e2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:05.600525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d6293ad6-5d24-4813-a28d-2d71567c1ba0 tempest-FlavorsV2NegativeTest-1995123380 tempest-FlavorsV2NegativeTest-1995123380-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:05.623434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3a2e683e-b44a-405c-b638-4b09c75526e2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:05.628519 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d6293ad6-5d24-4813-a28d-2d71567c1ba0 tempest-FlavorsV2NegativeTest-1995123380 tempest-FlavorsV2NegativeTest-1995123380-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.682604 Jul 14 14:27:05.634267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3a2e683e-b44a-405c-b638-4b09c75526e2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:05.635691 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3a2e683e-b44a-405c-b638-4b09c75526e2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1362 microversion: 2.25 time: 0.791258 Jul 14 14:27:05.636292 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 200/420] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:04 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1362 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:05.639512 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 221/421] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:27:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:05.670095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1a32428c-fb0e-4ce6-8580-995c8c52e313 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:05.670724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1a32428c-fb0e-4ce6-8580-995c8c52e313 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:05.674564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5faaa78-eeee-4c36-88ef-ae6b72a3c060 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Calling method '.version_select at 0x7fd6c62a88b0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:05.677753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5faaa78-eeee-4c36-88ef-ae6b72a3c060 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:05.678303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5faaa78-eeee-4c36-88ef-ae6b72a3c060 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:05.701651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a32428c-fb0e-4ce6-8580-995c8c52e313 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:05.701651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a32428c-fb0e-4ce6-8580-995c8c52e313 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:05.704357 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e5faaa78-eeee-4c36-88ef-ae6b72a3c060 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.066615 Jul 14 14:27:05.705309 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 201/422] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:27:05 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:05.711415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a32428c-fb0e-4ce6-8580-995c8c52e313 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:05.722715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a32428c-fb0e-4ce6-8580-995c8c52e313 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:05.955379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-10d7bae1-a429-48ed-a140-fd45449ee9d0 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:05.955906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-10d7bae1-a429-48ed-a140-fd45449ee9d0 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:05.972502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10d7bae1-a429-48ed-a140-fd45449ee9d0 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:05.973289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10d7bae1-a429-48ed-a140-fd45449ee9d0 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:05.979929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10d7bae1-a429-48ed-a140-fd45449ee9d0 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:05.980373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10d7bae1-a429-48ed-a140-fd45449ee9d0 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:06.280647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a32428c-fb0e-4ce6-8580-995c8c52e313 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:06.292743 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1a32428c-fb0e-4ce6-8580-995c8c52e313 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1319 microversion: 2.1 time: 0.638875 Jul 14 14:27:06.294733 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 222/423] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:05 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1319 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:06.318868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-836060991", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:06.349180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-10d7bae1-a429-48ed-a140-fd45449ee9d0 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:06.379445 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-10d7bae1-a429-48ed-a140-fd45449ee9d0 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1389 microversion: 2.1 time: 0.419771 Jul 14 14:27:06.389540 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 202/424] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:05 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1389 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:27:06.483100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:27:06.655722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-02c94df3-3a99-404f-989a-b2c8a5726e0f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:06.656394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-02c94df3-3a99-404f-989a-b2c8a5726e0f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:06.673654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02c94df3-3a99-404f-989a-b2c8a5726e0f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:06.676739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02c94df3-3a99-404f-989a-b2c8a5726e0f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:06.680760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02c94df3-3a99-404f-989a-b2c8a5726e0f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:06.692358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02c94df3-3a99-404f-989a-b2c8a5726e0f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:07.016649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:27:07.017582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:27:07.018211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:27:07.018736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:27:07.019554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:27:07.050652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:07.052354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:07.055164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:07.055768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:07.087056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=11 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:07.097745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:07.147593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Getting quotas for project c3e95b24eb1b4f9fbc5eb6f4d6f3d308. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:27:07.159839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Getting quotas for user 89894c4d380a4632870ebcb10a2ffe81 and project c3e95b24eb1b4f9fbc5eb6f4d6f3d308. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:27:07.176749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:27:07.179438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:27:07.275947 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-61d68b59-3788-436f-8ebe-81c358f130fc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979815 Jul 14 14:27:07.277055 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 223/425] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:27:07.286549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-02c94df3-3a99-404f-989a-b2c8a5726e0f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:07.307286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-897b34ee-ec48-48db-acca-96f90c535b98 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:07.313061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-897b34ee-ec48-48db-acca-96f90c535b98 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:07.315209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-02c94df3-3a99-404f-989a-b2c8a5726e0f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:07.321143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-02c94df3-3a99-404f-989a-b2c8a5726e0f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:07.327482 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-02c94df3-3a99-404f-989a-b2c8a5726e0f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1559 microversion: 2.25 time: 0.676747 Jul 14 14:27:07.328654 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 203/426] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:06 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1559 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:07.336573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e7108b20-f1e4-4629-9a7f-e2f6d9afa4c7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:07.351067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e7108b20-f1e4-4629-9a7f-e2f6d9afa4c7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:07.362973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7108b20-f1e4-4629-9a7f-e2f6d9afa4c7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:07.363791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7108b20-f1e4-4629-9a7f-e2f6d9afa4c7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:07.371286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7108b20-f1e4-4629-9a7f-e2f6d9afa4c7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:07.372110 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7108b20-f1e4-4629-9a7f-e2f6d9afa4c7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:07.531045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-897b34ee-ec48-48db-acca-96f90c535b98 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:07.548136 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-897b34ee-ec48-48db-acca-96f90c535b98 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1212 microversion: 2.1 time: 0.252063 Jul 14 14:27:07.561219 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 224/427] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:07 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1212 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:07.736617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e7108b20-f1e4-4629-9a7f-e2f6d9afa4c7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:07.741349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:07.751563 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e7108b20-f1e4-4629-9a7f-e2f6d9afa4c7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1319 microversion: 2.1 time: 0.421129 Jul 14 14:27:07.763629 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 204/428] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:07 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:07.769641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c80f1499-c36c-430c-a83a-50cf092ee1ab tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:07.770648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c80f1499-c36c-430c-a83a-50cf092ee1ab tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:07.780718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c80f1499-c36c-430c-a83a-50cf092ee1ab tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:07.781580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c80f1499-c36c-430c-a83a-50cf092ee1ab tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:07.782694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c80f1499-c36c-430c-a83a-50cf092ee1ab tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:07.783412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c80f1499-c36c-430c-a83a-50cf092ee1ab tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:08.064368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c80f1499-c36c-430c-a83a-50cf092ee1ab tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:08.076283 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c80f1499-c36c-430c-a83a-50cf092ee1ab tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1389 microversion: 2.1 time: 0.310758 Jul 14 14:27:08.076892 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 205/429] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:07 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1389 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:08.221319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4b90371e-3c70-4e7f-8e14-1b01f2a9d562 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:08.222784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4b90371e-3c70-4e7f-8e14-1b01f2a9d562 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:08.231658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b90371e-3c70-4e7f-8e14-1b01f2a9d562 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:08.232346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b90371e-3c70-4e7f-8e14-1b01f2a9d562 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:08.233408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b90371e-3c70-4e7f-8e14-1b01f2a9d562 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:08.234058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b90371e-3c70-4e7f-8e14-1b01f2a9d562 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:08.339182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1027733717", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "6831672f-d329-4243-a142-ff7ed2c51723"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:08.454336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] validate_networks() for [('6831672f-d329-4243-a142-ff7ed2c51723', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:27:08.572432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-4b90371e-3c70-4e7f-8e14-1b01f2a9d562 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid 88426cdc-557a-4724-9ef2-d84d32b4191d {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:08.640325 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4b90371e-3c70-4e7f-8e14-1b01f2a9d562 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 2054 microversion: 2.25 time: 1.089174 Jul 14 14:27:08.640582 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 225/430] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:07 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 2054 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:08.658354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3919e914-e7e3-44d7-b5f1-14dd06ffbcb9 tempest-FlavorsV2NegativeTest-1995123380 tempest-FlavorsV2NegativeTest-1995123380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-797921494", "imageRef": "cc608a4a-fb5a-453d-9484-2bcef02c13b4", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:08.718024 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-3919e914-e7e3-44d7-b5f1-14dd06ffbcb9 tempest-FlavorsV2NegativeTest-1995123380 tempest-FlavorsV2NegativeTest-1995123380-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:27:09.066420 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3919e914-e7e3-44d7-b5f1-14dd06ffbcb9 tempest-FlavorsV2NegativeTest-1995123380 tempest-FlavorsV2NegativeTest-1995123380-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3919e914-e7e3-44d7-b5f1-14dd06ffbcb9 tempest-FlavorsV2NegativeTest-1995123380 tempest-FlavorsV2NegativeTest-1995123380-project] Request method failure captured: Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 142 Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce4aNPg5M5CWawHqiYZimJpywOCO8LnPmyC-_ZJFke32VskSKdPnparvQjN0GhndnC7yqPuIR-5NpSAmoUaxQjzKx_hsZ88rKIl29xtMnpKmTXyU2jumbFBmtTZo6jXu8-fnpQO_-EUkMa-KPbdO8pETNdOGvs5QaYfYV423W67Ho0 Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: b0904c1aee8348f8b948fe5ef9a8fe6b Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-FlavorsV2NegativeTest-1995123380 Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:09.070872 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b0904c1aee8348f8b948fe5ef9a8fe6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b0904c1aee8348f8b948fe5ef9a8fe6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b0904c1aee8348f8b948fe5ef9a8fe6b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b0904c1aee8348f8b948fe5ef9a8fe6b"}]}] Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-FlavorsV2NegativeTest-1995123380 Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: b0904c1aee8348f8b948fe5ef9a8fe6b Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1995123380 Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-FlavorsV2NegativeTest-1995123380-project Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 143b1dd877424247acc74feeb6418111 Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-FlavorsV2NegativeTest-1995123380-project Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-797921494", "imageRef": "cc608a4a-fb5a-453d-9484-2bcef02c13b4", "flavorRef": "452"}} Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:27:09.072258 n-d-767704-28 devstack@n-api.service[119512]: exception: Flavor's memory is too small for requested image. Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-797921494', 'imageRef': 'cc608a4a-fb5a-453d-9484-2bcef02c13b4', 'flavorRef': '452'}}} Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:09.073222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 870, in create Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:09.074587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:09.079672 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:09.079672 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:09.079672 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:09.079672 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:09.079672 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 14 14:27:09.079672 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:09.079672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3919e914-e7e3-44d7-b5f1-14dd06ffbcb9 tempest-FlavorsV2NegativeTest-1995123380 tempest-FlavorsV2NegativeTest-1995123380-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:09.086463 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3919e914-e7e3-44d7-b5f1-14dd06ffbcb9 tempest-FlavorsV2NegativeTest-1995123380 tempest-FlavorsV2NegativeTest-1995123380-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.425119 Jul 14 14:27:09.087556 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 226/431] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:08 2022] POST /compute/v2.1/servers => generated 93 bytes in 446 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:27:09.118722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:09.265343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:27:09.266184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:27:09.266865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:27:09.267802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:27:09.268293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:27:09.271567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=93,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:09.293227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:09.293689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:09.294514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:09.294956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:09.341943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a06c638-0947-43d1-9bcd-b97e96745986 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Calling method '.version_select at 0x7fd6c61ed160>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:09.344655 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:09.344655 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:09.346228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a06c638-0947-43d1-9bcd-b97e96745986 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:09.347551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a06c638-0947-43d1-9bcd-b97e96745986 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:09.349737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a06c638-0947-43d1-9bcd-b97e96745986 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:09.350689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a06c638-0947-43d1-9bcd-b97e96745986 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:09.355668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Getting quotas for project eb57648abd7742d9aac69af1744d6bc1. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:27:09.361878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Getting quotas for user 5c688cde0ea44a059b0bca3e020c28b3 and project eb57648abd7742d9aac69af1744d6bc1. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:27:09.381348 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3a06c638-0947-43d1-9bcd-b97e96745986 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.288697 Jul 14 14:27:09.382551 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 227/432] 10.222.0.81 () {58 vars in 1127 bytes} [Thu Jul 14 14:27:09 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:09.384710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:27:09.387450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:27:09.409053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-799f7413-707a-427b-bad1-d26ae9715e6b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:09.409565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-799f7413-707a-427b-bad1-d26ae9715e6b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:09.423999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:09.427147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-799f7413-707a-427b-bad1-d26ae9715e6b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:09.427609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-799f7413-707a-427b-bad1-d26ae9715e6b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:09.431283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-799f7413-707a-427b-bad1-d26ae9715e6b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:09.431981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-799f7413-707a-427b-bad1-d26ae9715e6b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:09.451113 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-49bfbf5e-88c1-4808-a263-d1fd5f78d53f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.372687 Jul 14 14:27:09.452720 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 206/433] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:27:09.474504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-11fff072-d456-4429-84cb-c6573b67cf25 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:09.477295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-11fff072-d456-4429-84cb-c6573b67cf25 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:09.487485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11fff072-d456-4429-84cb-c6573b67cf25 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:09.488276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11fff072-d456-4429-84cb-c6573b67cf25 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:09.489455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11fff072-d456-4429-84cb-c6573b67cf25 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:09.490085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11fff072-d456-4429-84cb-c6573b67cf25 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:09.594337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-799f7413-707a-427b-bad1-d26ae9715e6b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:09.603028 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-799f7413-707a-427b-bad1-d26ae9715e6b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1270 microversion: 2.1 time: 0.207396 Jul 14 14:27:09.623228 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 228/434] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:09 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1270 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:09.629277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0d95501d-0e04-44d6-8ce3-3bf2c3dc02a8 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:09.629914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0d95501d-0e04-44d6-8ce3-3bf2c3dc02a8 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:09.649591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d95501d-0e04-44d6-8ce3-3bf2c3dc02a8 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:09.650059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d95501d-0e04-44d6-8ce3-3bf2c3dc02a8 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:09.650893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d95501d-0e04-44d6-8ce3-3bf2c3dc02a8 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:09.651427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d95501d-0e04-44d6-8ce3-3bf2c3dc02a8 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:09.801825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-11fff072-d456-4429-84cb-c6573b67cf25 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid 88426cdc-557a-4724-9ef2-d84d32b4191d {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:09.925271 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-11fff072-d456-4429-84cb-c6573b67cf25 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 2054 microversion: 2.25 time: 0.471111 Jul 14 14:27:09.928976 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 207/435] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:09 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 2054 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:09.951315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f3873c74-64c9-4716-af07-320910cde96a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:09.954075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f3873c74-64c9-4716-af07-320910cde96a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:09.972808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3873c74-64c9-4716-af07-320910cde96a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:09.980043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3873c74-64c9-4716-af07-320910cde96a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:09.982663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3873c74-64c9-4716-af07-320910cde96a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:09.985972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3873c74-64c9-4716-af07-320910cde96a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:10.235500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d95501d-0e04-44d6-8ce3-3bf2c3dc02a8 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:10.251724 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0d95501d-0e04-44d6-8ce3-3bf2c3dc02a8 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1319 microversion: 2.1 time: 0.634933 Jul 14 14:27:10.262091 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 229/436] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:09 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1319 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:10.262091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e8361c4f-c73e-4de4-b791-357da738849e req-dd99604e-bb98-49ec-9821-fdbe24ef8c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c5728e-50ec-43f4-bd4e-8d7b9217bb69", "name": "network-vif-plugged", "status": "completed", "tag": "26efdc8a-13a1-46a1-a04f-f980949a8248"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:10.270785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e8361c4f-c73e-4de4-b791-357da738849e req-dd99604e-bb98-49ec-9821-fdbe24ef8c1c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:10.271233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e8361c4f-c73e-4de4-b791-357da738849e req-dd99604e-bb98-49ec-9821-fdbe24ef8c1c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:10.284482 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e8361c4f-c73e-4de4-b791-357da738849e req-dd99604e-bb98-49ec-9821-fdbe24ef8c1c service nova] Creating event network-vif-plugged:26efdc8a-13a1-46a1-a04f-f980949a8248 for instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 on n-h2-767704-28 Jul 14 14:27:10.291735 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e8361c4f-c73e-4de4-b791-357da738849e req-dd99604e-bb98-49ec-9821-fdbe24ef8c1c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036238 Jul 14 14:27:10.292889 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 230/437] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:10.318439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f3873c74-64c9-4716-af07-320910cde96a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:10.331636 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f3873c74-64c9-4716-af07-320910cde96a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1389 microversion: 2.1 time: 0.400663 Jul 14 14:27:10.334240 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 208/438] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:09 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1389 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:10.340159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-398b8a67-a2dd-444a-87d6-b49b6cefba29 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:10.341147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-398b8a67-a2dd-444a-87d6-b49b6cefba29 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:10.365590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-398b8a67-a2dd-444a-87d6-b49b6cefba29 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:10.368399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-398b8a67-a2dd-444a-87d6-b49b6cefba29 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:10.369645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-398b8a67-a2dd-444a-87d6-b49b6cefba29 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:10.371600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-398b8a67-a2dd-444a-87d6-b49b6cefba29 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:10.499818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-398b8a67-a2dd-444a-87d6-b49b6cefba29 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:10.514543 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-398b8a67-a2dd-444a-87d6-b49b6cefba29 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1215 microversion: 2.1 time: 0.178754 Jul 14 14:27:10.527833 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 209/439] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:10 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1215 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:10.538064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ce3ad2f6-6c0e-449e-8c25-c8cce1fbd994 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:10.539690 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:10.539690 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:10.541777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce3ad2f6-6c0e-449e-8c25-c8cce1fbd994 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:10.542332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce3ad2f6-6c0e-449e-8c25-c8cce1fbd994 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:10.543243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce3ad2f6-6c0e-449e-8c25-c8cce1fbd994 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:10.543756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce3ad2f6-6c0e-449e-8c25-c8cce1fbd994 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:10.615402 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ce3ad2f6-6c0e-449e-8c25-c8cce1fbd994 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.083220 Jul 14 14:27:10.624408 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 210/440] 10.222.0.81 () {60 vars in 1216 bytes} [Thu Jul 14 14:27:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:27:10.630207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ee697a58-2765-4e53-bf76-cc01238db48f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-767704-28", "block_migration": "auto"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:10.631351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ee697a58-2765-4e53-bf76-cc01238db48f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:10.637087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6216918a-472a-4663-9369-b0747460d7b2 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Calling method '.version_select at 0x7fd6c6555a60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:10.640402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee697a58-2765-4e53-bf76-cc01238db48f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:10.640899 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:10.640899 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:10.641128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee697a58-2765-4e53-bf76-cc01238db48f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:10.641993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee697a58-2765-4e53-bf76-cc01238db48f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:10.642504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee697a58-2765-4e53-bf76-cc01238db48f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:10.643269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6216918a-472a-4663-9369-b0747460d7b2 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '33c988a074f4464ea304fd2c0da76463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aba98812e14a35ba779779522310b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6216918a-472a-4663-9369-b0747460d7b2 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Request method failure captured: Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce6--ihvCNY2lDhxa3Ftyj6aolEfQrjvX8CEihSuQ5teoqZ6iQ-14gjTJYCtqRqbQGSjj4Lsbu5RHHxe4nztD9Mtd9sCgW1P7KcyRFK_PTn4gGnK4ajVd7f92vi3yHUhWJtNf1l_eQ3dPK_qarOEvgTCJUo6Hw05xto0Vor-JcU-z0 Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 91aba98812e14a35ba779779522310b6 Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:10.647289 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/91aba98812e14a35ba779779522310b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/91aba98812e14a35ba779779522310b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_91aba98812e14a35ba779779522310b6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/91aba98812e14a35ba779779522310b6"}]}] Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 91aba98812e14a35ba779779522310b6 Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HostsAdminNegativeTestJSON-1979804162-project Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 33c988a074f4464ea304fd2c0da76463 Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1979804162-project Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: action_args: {} Jul 14 14:27:10.649764 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:10.650734 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 14 14:27:10.651858 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:10.655070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6216918a-472a-4663-9369-b0747460d7b2 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:10.656329 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6216918a-472a-4663-9369-b0747460d7b2 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] 10.222.0.81 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.362298 Jul 14 14:27:10.658150 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 231/441] 10.222.0.81 () {58 vars in 1127 bytes} [Thu Jul 14 14:27:10 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 364 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:10.665343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-836bbe84-0b11-4422-87bf-d25975d0c392 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:10.666735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-836bbe84-0b11-4422-87bf-d25975d0c392 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:10.677927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-836bbe84-0b11-4422-87bf-d25975d0c392 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:10.678747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-836bbe84-0b11-4422-87bf-d25975d0c392 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:10.681126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-836bbe84-0b11-4422-87bf-d25975d0c392 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:10.681788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-836bbe84-0b11-4422-87bf-d25975d0c392 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:10.758495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-ee697a58-2765-4e53-bf76-cc01238db48f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'flavor' on Instance uuid 88426cdc-557a-4724-9ef2-d84d32b4191d {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:10.837423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ee697a58-2765-4e53-bf76-cc01238db48f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Going to try to live migrate instance to n-h1-767704-28 {{(pid=119511) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:27:11.223953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-836bbe84-0b11-4422-87bf-d25975d0c392 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:11.236342 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-836bbe84-0b11-4422-87bf-d25975d0c392 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1312 microversion: 2.1 time: 0.576795 Jul 14 14:27:11.239827 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 232/442] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:10 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1312 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:11.249889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31a878cd-01cc-40ab-9764-269bdb416c2c tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Calling method '.version_select at 0x7fd6c62c3160>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:11.250775 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:11.250775 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:11.265634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-31a878cd-01cc-40ab-9764-269bdb416c2c tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '33c988a074f4464ea304fd2c0da76463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aba98812e14a35ba779779522310b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31a878cd-01cc-40ab-9764-269bdb416c2c tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Request method failure captured: Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hosts/n-d-767704-28/reboot HTTP/1.1 Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce6--ihvCNY2lDhxa3Ftyj6aolEfQrjvX8CEihSuQ5teoqZ6iQ-14gjTJYCtqRqbQGSjj4Lsbu5RHHxe4nztD9Mtd9sCgW1P7KcyRFK_PTn4gGnK4ajVd7f92vi3yHUhWJtNf1l_eQ3dPK_qarOEvgTCJUo6Hw05xto0Vor-JcU-z0 Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 91aba98812e14a35ba779779522310b6 Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:11.267391 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/91aba98812e14a35ba779779522310b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/91aba98812e14a35ba779779522310b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_91aba98812e14a35ba779779522310b6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/91aba98812e14a35ba779779522310b6"}]}] Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 91aba98812e14a35ba779779522310b6 Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HostsAdminNegativeTestJSON-1979804162-project Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 33c988a074f4464ea304fd2c0da76463 Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1979804162-project Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'n-d-767704-28'} Jul 14 14:27:11.268891 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:11.269881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 14 14:27:11.271043 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:11.272066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31a878cd-01cc-40ab-9764-269bdb416c2c tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:11.272066 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-31a878cd-01cc-40ab-9764-269bdb416c2c tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] 10.222.0.81 "GET /compute/v2.1/os-hosts/n-d-767704-28/reboot" status: 403 len: 111 microversion: 2.1 time: 0.029668 Jul 14 14:27:11.272197 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 233/443] 10.222.0.81 () {58 vars in 1190 bytes} [Thu Jul 14 14:27:11 2022] GET /compute/v2.1/os-hosts/n-d-767704-28/reboot => generated 111 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:11.277600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1733b667-ae2b-402a-9280-ca4ff9c79b2e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:11.278314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1733b667-ae2b-402a-9280-ca4ff9c79b2e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:11.291566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1733b667-ae2b-402a-9280-ca4ff9c79b2e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:11.292379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1733b667-ae2b-402a-9280-ca4ff9c79b2e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:11.293793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1733b667-ae2b-402a-9280-ca4ff9c79b2e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:11.294518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1733b667-ae2b-402a-9280-ca4ff9c79b2e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:11.946249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1733b667-ae2b-402a-9280-ca4ff9c79b2e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:11.958459 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1733b667-ae2b-402a-9280-ca4ff9c79b2e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1319 microversion: 2.1 time: 0.684663 Jul 14 14:27:11.960115 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 234/444] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:11 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1319 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:11.979163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c1f1e72-ff64-465b-b6f1-fd770e2c966e tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Calling method '.version_select at 0x7fd6c62c3a60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:11.980374 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:11.980374 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:11.991169 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-1c1f1e72-ff64-465b-b6f1-fd770e2c966e tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c1f1e72-ff64-465b-b6f1-fd770e2c966e tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Request method failure captured: Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce87_XvuceZ_osocLh58wnqNnQJF1tmxiuf3Hoi8Jj5ODMaFyLZ2ejOXdtQvx_NsqRVvdUYmYCk_yVNpeLiVZpSLsO9ND2wJKhv0D2fNW6OqCPp0vXpnjt7qZOdWeROk3ZO3eLoZQqrbtoRlgwEy7mE3U9zSQtpIj_2J_dH2fGtyUg Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:27:11.994156 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/faac8abd2bb443a199553907caa84d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_faac8abd2bb443a199553907caa84d88", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}] Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 39abcf5c8070457d95f5cb120b2fadfd Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'nonexistent_hostname'} Jul 14 14:27:11.995524 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:27:11.996298 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 14 14:27:11.999525 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c1f1e72-ff64-465b-b6f1-fd770e2c966e tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1c1f1e72-ff64-465b-b6f1-fd770e2c966e tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.025133 Jul 14 14:27:12.002014 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 235/445] 10.222.0.81 () {58 vars in 1211 bytes} [Thu Jul 14 14:27:11 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:27:12.003815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e8c268ab-3aa9-4fab-8d36-900b4097da52 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:12.003815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e8c268ab-3aa9-4fab-8d36-900b4097da52 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:12.015402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8c268ab-3aa9-4fab-8d36-900b4097da52 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:12.015882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8c268ab-3aa9-4fab-8d36-900b4097da52 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:12.016694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8c268ab-3aa9-4fab-8d36-900b4097da52 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:12.017213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8c268ab-3aa9-4fab-8d36-900b4097da52 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:12.326626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e8c268ab-3aa9-4fab-8d36-900b4097da52 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:12.350446 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e8c268ab-3aa9-4fab-8d36-900b4097da52 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1389 microversion: 2.1 time: 0.342065 Jul 14 14:27:12.353596 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 236/446] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:11 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1389 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:12.370274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8524a421-7db1-41aa-8703-a34467515add tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:12.371274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8524a421-7db1-41aa-8703-a34467515add tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:12.386208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8524a421-7db1-41aa-8703-a34467515add tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:12.390663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8524a421-7db1-41aa-8703-a34467515add tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:12.394576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8524a421-7db1-41aa-8703-a34467515add tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:12.395442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8524a421-7db1-41aa-8703-a34467515add tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:12.595949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8524a421-7db1-41aa-8703-a34467515add tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:12.615438 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8524a421-7db1-41aa-8703-a34467515add tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1269 microversion: 2.1 time: 0.259395 Jul 14 14:27:12.616572 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 237/447] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:12 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1269 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:12.651359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-522fe272-5258-42af-9b81-27d2f8940cc7 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Calling method '.version_select at 0x7fd6c61edca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:12.653786 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:12.653786 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:12.659298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-522fe272-5258-42af-9b81-27d2f8940cc7 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '33c988a074f4464ea304fd2c0da76463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aba98812e14a35ba779779522310b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-522fe272-5258-42af-9b81-27d2f8940cc7 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Request method failure captured: Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hosts/n-d-767704-28 HTTP/1.1 Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce6--ihvCNY2lDhxa3Ftyj6aolEfQrjvX8CEihSuQ5teoqZ6iQ-14gjTJYCtqRqbQGSjj4Lsbu5RHHxe4nztD9Mtd9sCgW1P7KcyRFK_PTn4gGnK4ajVd7f92vi3yHUhWJtNf1l_eQ3dPK_qarOEvgTCJUo6Hw05xto0Vor-JcU-z0 Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 91aba98812e14a35ba779779522310b6 Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:12.661092 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/91aba98812e14a35ba779779522310b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/91aba98812e14a35ba779779522310b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_91aba98812e14a35ba779779522310b6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/91aba98812e14a35ba779779522310b6"}]}] Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 91aba98812e14a35ba779779522310b6 Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HostsAdminNegativeTestJSON-1979804162-project Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 33c988a074f4464ea304fd2c0da76463 Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1979804162-project Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'n-d-767704-28'} Jul 14 14:27:12.663588 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:12.665787 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 14 14:27:12.669435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:12.670722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-522fe272-5258-42af-9b81-27d2f8940cc7 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:12.677646 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-522fe272-5258-42af-9b81-27d2f8940cc7 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] 10.222.0.81 "GET /compute/v2.1/os-hosts/n-d-767704-28" status: 403 len: 109 microversion: 2.1 time: 0.043704 Jul 14 14:27:12.677646 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 238/448] 10.222.0.81 () {58 vars in 1169 bytes} [Thu Jul 14 14:27:12 2022] GET /compute/v2.1/os-hosts/n-d-767704-28 => generated 109 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:12.694886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-43507aa1-2805-4b0a-ab91-76c4d4679373 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:12.696307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-43507aa1-2805-4b0a-ab91-76c4d4679373 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:12.724210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43507aa1-2805-4b0a-ab91-76c4d4679373 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:12.729206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43507aa1-2805-4b0a-ab91-76c4d4679373 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:12.730157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43507aa1-2805-4b0a-ab91-76c4d4679373 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:12.730633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43507aa1-2805-4b0a-ab91-76c4d4679373 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:13.209109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-43507aa1-2805-4b0a-ab91-76c4d4679373 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:13.225337 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-43507aa1-2805-4b0a-ab91-76c4d4679373 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1312 microversion: 2.1 time: 0.546625 Jul 14 14:27:13.239370 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 239/449] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:12 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1312 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:13.248930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2f6e051d-828f-4945-a4a7-f7498786563d req-d3b15e59-d257-4b08-a16e-83e53584a3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23efb1d0-4c73-471c-b109-75d53db07d0a", "name": "network-vif-plugged", "status": "completed", "tag": "86bfaf20-9a4b-4cd6-a410-15a65252105c"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:13.278725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2f6e051d-828f-4945-a4a7-f7498786563d req-d3b15e59-d257-4b08-a16e-83e53584a3b0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:13.279253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2f6e051d-828f-4945-a4a7-f7498786563d req-d3b15e59-d257-4b08-a16e-83e53584a3b0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:13.301594 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2f6e051d-828f-4945-a4a7-f7498786563d req-d3b15e59-d257-4b08-a16e-83e53584a3b0 service nova] Creating event network-vif-plugged:86bfaf20-9a4b-4cd6-a410-15a65252105c for instance 23efb1d0-4c73-471c-b109-75d53db07d0a on n-h1-767704-28 Jul 14 14:27:13.315288 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2f6e051d-828f-4945-a4a7-f7498786563d req-d3b15e59-d257-4b08-a16e-83e53584a3b0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074330 Jul 14 14:27:13.321354 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 240/450] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:13.334873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f63a1083-064a-497b-9e23-b0ed0088245f tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Calling method '.version_select at 0x7fd6c61ed550>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:13.339012 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:13.339012 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:13.347860 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-f63a1083-064a-497b-9e23-b0ed0088245f tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f63a1083-064a-497b-9e23-b0ed0088245f tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Request method failure captured: Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce87_XvuceZ_osocLh58wnqNnQJF1tmxiuf3Hoi8Jj5ODMaFyLZ2ejOXdtQvx_NsqRVvdUYmYCk_yVNpeLiVZpSLsO9ND2wJKhv0D2fNW6OqCPp0vXpnjt7qZOdWeROk3ZO3eLoZQqrbtoRlgwEy7mE3U9zSQtpIj_2J_dH2fGtyUg Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:27:13.358965 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/faac8abd2bb443a199553907caa84d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_faac8abd2bb443a199553907caa84d88", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}] Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 39abcf5c8070457d95f5cb120b2fadfd Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'nonexistent_hostname'} Jul 14 14:27:13.360696 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:13.361799 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:13.365060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:13.376481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f63a1083-064a-497b-9e23-b0ed0088245f tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:13.382493 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f63a1083-064a-497b-9e23-b0ed0088245f tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.059486 Jul 14 14:27:13.388138 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 241/451] 10.222.0.81 () {58 vars in 1190 bytes} [Thu Jul 14 14:27:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:27:13.400533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-71b494b1-d801-4c5a-8784-bca1191c51b1 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:13.416521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-71b494b1-d801-4c5a-8784-bca1191c51b1 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:13.425708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71b494b1-d801-4c5a-8784-bca1191c51b1 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:13.426611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71b494b1-d801-4c5a-8784-bca1191c51b1 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:13.427722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71b494b1-d801-4c5a-8784-bca1191c51b1 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:13.431377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71b494b1-d801-4c5a-8784-bca1191c51b1 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:13.837037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-71b494b1-d801-4c5a-8784-bca1191c51b1 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:13.848664 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-71b494b1-d801-4c5a-8784-bca1191c51b1 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1319 microversion: 2.1 time: 0.458935 Jul 14 14:27:13.849822 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 242/452] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:13 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:13.856437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9fc3dee6-1522-44a6-853d-bfbc85ecb88d req-62e2d770-ca30-4150-9266-6e5d9f776770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19bb6d1e-7771-41fd-b903-dc300ba97d6f", "tag": "2bef06c0-64d7-4a58-88e7-88f2b49a1dbc"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:13.869189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9fc3dee6-1522-44a6-853d-bfbc85ecb88d req-62e2d770-ca30-4150-9266-6e5d9f776770 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:13.869932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9fc3dee6-1522-44a6-853d-bfbc85ecb88d req-62e2d770-ca30-4150-9266-6e5d9f776770 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:13.895521 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9fc3dee6-1522-44a6-853d-bfbc85ecb88d req-62e2d770-ca30-4150-9266-6e5d9f776770 service nova] Creating event network-changed:2bef06c0-64d7-4a58-88e7-88f2b49a1dbc for instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f on n-h1-767704-28 Jul 14 14:27:13.901624 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9fc3dee6-1522-44a6-853d-bfbc85ecb88d req-62e2d770-ca30-4150-9266-6e5d9f776770 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050315 Jul 14 14:27:13.902702 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 243/453] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:13.909808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-55015aca-6392-417d-8697-d141db6a3b6f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:13.910855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-55015aca-6392-417d-8697-d141db6a3b6f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:13.920417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55015aca-6392-417d-8697-d141db6a3b6f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:13.921207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55015aca-6392-417d-8697-d141db6a3b6f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:13.922262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55015aca-6392-417d-8697-d141db6a3b6f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:13.922887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55015aca-6392-417d-8697-d141db6a3b6f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:14.286774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-55015aca-6392-417d-8697-d141db6a3b6f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:14.304736 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-55015aca-6392-417d-8697-d141db6a3b6f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1588 microversion: 2.1 time: 0.400610 Jul 14 14:27:14.306214 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 244/454] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:13 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1588 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:14.323884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc87076b-103e-403c-884f-c6aebf6feabd tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Calling method '.version_select at 0x7fd6c639f1f0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:14.324822 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:14.324822 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:14.326161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cc87076b-103e-403c-884f-c6aebf6feabd tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '33c988a074f4464ea304fd2c0da76463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aba98812e14a35ba779779522310b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc87076b-103e-403c-884f-c6aebf6feabd tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Request method failure captured: Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hosts/n-d-767704-28/shutdown HTTP/1.1 Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce6--ihvCNY2lDhxa3Ftyj6aolEfQrjvX8CEihSuQ5teoqZ6iQ-14gjTJYCtqRqbQGSjj4Lsbu5RHHxe4nztD9Mtd9sCgW1P7KcyRFK_PTn4gGnK4ajVd7f92vi3yHUhWJtNf1l_eQ3dPK_qarOEvgTCJUo6Hw05xto0Vor-JcU-z0 Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 91aba98812e14a35ba779779522310b6 Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:14.327847 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/91aba98812e14a35ba779779522310b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/91aba98812e14a35ba779779522310b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_91aba98812e14a35ba779779522310b6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/91aba98812e14a35ba779779522310b6"}]}] Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 91aba98812e14a35ba779779522310b6 Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HostsAdminNegativeTestJSON-1979804162-project Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 33c988a074f4464ea304fd2c0da76463 Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1979804162-project Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'n-d-767704-28'} Jul 14 14:27:14.329147 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:14.329944 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 14 14:27:14.331055 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:14.332052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc87076b-103e-403c-884f-c6aebf6feabd tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:14.332052 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc87076b-103e-403c-884f-c6aebf6feabd tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] 10.222.0.81 "GET /compute/v2.1/os-hosts/n-d-767704-28/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.021887 Jul 14 14:27:14.332052 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 245/455] 10.222.0.81 () {58 vars in 1196 bytes} [Thu Jul 14 14:27:14 2022] GET /compute/v2.1/os-hosts/n-d-767704-28/shutdown => generated 113 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:14.342774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b098f82-7740-465e-bdfb-f574f3a802f3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:14.343579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b098f82-7740-465e-bdfb-f574f3a802f3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:14.351182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b098f82-7740-465e-bdfb-f574f3a802f3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:14.351715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b098f82-7740-465e-bdfb-f574f3a802f3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:14.352513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b098f82-7740-465e-bdfb-f574f3a802f3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:14.353021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b098f82-7740-465e-bdfb-f574f3a802f3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:14.631991 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ee697a58-2765-4e53-bf76-cc01238db48f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d/action" status: 202 len: 0 microversion: 2.25 time: 4.006242 Jul 14 14:27:14.633677 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 211/456] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 14:27:10 2022] POST /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d/action => generated 0 bytes in 4009 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:27:14.654655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-53c57359-fdac-4cf0-890d-c66ae3ddbfc7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:14.658342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-53c57359-fdac-4cf0-890d-c66ae3ddbfc7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:14.675955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53c57359-fdac-4cf0-890d-c66ae3ddbfc7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:14.676931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53c57359-fdac-4cf0-890d-c66ae3ddbfc7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:14.678069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53c57359-fdac-4cf0-890d-c66ae3ddbfc7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:14.681215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53c57359-fdac-4cf0-890d-c66ae3ddbfc7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:14.768214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9b098f82-7740-465e-bdfb-f574f3a802f3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:14.777887 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9b098f82-7740-465e-bdfb-f574f3a802f3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1311 microversion: 2.1 time: 0.446871 Jul 14 14:27:14.778720 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 246/457] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:14 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1311 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:14.784299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ebf0637-c018-4b1b-ae3c-53b344fb427f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:14.786131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6ebf0637-c018-4b1b-ae3c-53b344fb427f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:14.794792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ebf0637-c018-4b1b-ae3c-53b344fb427f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:14.795969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ebf0637-c018-4b1b-ae3c-53b344fb427f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:14.797273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ebf0637-c018-4b1b-ae3c-53b344fb427f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:14.798025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ebf0637-c018-4b1b-ae3c-53b344fb427f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.049350 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6ebf0637-c018-4b1b-ae3c-53b344fb427f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.268999 Jul 14 14:27:15.057287 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 247/458] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:27:14 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69/os-interface => generated 284 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:15.064351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-86de9b7a-e39f-4877-8911-c3acef6f4bab tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Calling method '.version_select at 0x7fd6c61ed5e0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:15.065488 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:15.065488 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:15.076352 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-86de9b7a-e39f-4877-8911-c3acef6f4bab tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-86de9b7a-e39f-4877-8911-c3acef6f4bab tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Request method failure captured: Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce87_XvuceZ_osocLh58wnqNnQJF1tmxiuf3Hoi8Jj5ODMaFyLZ2ejOXdtQvx_NsqRVvdUYmYCk_yVNpeLiVZpSLsO9ND2wJKhv0D2fNW6OqCPp0vXpnjt7qZOdWeROk3ZO3eLoZQqrbtoRlgwEy7mE3U9zSQtpIj_2J_dH2fGtyUg Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:27:15.079940 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/faac8abd2bb443a199553907caa84d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_faac8abd2bb443a199553907caa84d88", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}] Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 39abcf5c8070457d95f5cb120b2fadfd Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'nonexistent_hostname'} Jul 14 14:27:15.081551 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:27:15.082519 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 14 14:27:15.083685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:27:15.084775 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:15.084775 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.084775 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:15.084775 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.084775 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.084775 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:15.084775 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:15.084775 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:15.084775 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:15.084775 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:15.084775 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.087141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-53c57359-fdac-4cf0-890d-c66ae3ddbfc7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:15.088630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-86de9b7a-e39f-4877-8911-c3acef6f4bab tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:15.090295 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-86de9b7a-e39f-4877-8911-c3acef6f4bab tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.031085 Jul 14 14:27:15.091057 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 248/459] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jul 14 14:27:15 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:27:15.100192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1677e38f-ef8b-4a06-a3db-ed373776a4e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:15.101374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1677e38f-ef8b-4a06-a3db-ed373776a4e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:15.106133 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-53c57359-fdac-4cf0-890d-c66ae3ddbfc7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1312 microversion: 2.1 time: 0.471132 Jul 14 14:27:15.111602 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 212/460] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:14 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1312 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:15.114155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1677e38f-ef8b-4a06-a3db-ed373776a4e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:15.115160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1677e38f-ef8b-4a06-a3db-ed373776a4e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.116194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1677e38f-ef8b-4a06-a3db-ed373776a4e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:15.116844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1677e38f-ef8b-4a06-a3db-ed373776a4e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.123652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-66819bd0-08b3-402b-b344-c559c428755e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:15.124513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-66819bd0-08b3-402b-b344-c559c428755e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:15.139112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66819bd0-08b3-402b-b344-c559c428755e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:15.141006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66819bd0-08b3-402b-b344-c559c428755e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.145299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66819bd0-08b3-402b-b344-c559c428755e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:15.146058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66819bd0-08b3-402b-b344-c559c428755e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.573903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-66819bd0-08b3-402b-b344-c559c428755e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:15.584200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1677e38f-ef8b-4a06-a3db-ed373776a4e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:15.606317 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-66819bd0-08b3-402b-b344-c559c428755e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1468 microversion: 2.1 time: 0.493377 Jul 14 14:27:15.607096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1677e38f-ef8b-4a06-a3db-ed373776a4e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:15.618734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1677e38f-ef8b-4a06-a3db-ed373776a4e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:15.618734 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1677e38f-ef8b-4a06-a3db-ed373776a4e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1569 microversion: 2.25 time: 0.517496 Jul 14 14:27:15.618734 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 249/461] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:15 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1569 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:15.626878 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 213/462] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:15 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1468 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:15.627799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b40005dd-0c76-4eb8-99a6-ef9fb3c2a381 req-3c97a03c-ed16-4c7a-b8dd-6241708f9845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae081a7-42be-48bc-8677-d0cf09d35d44", "tag": "3f8c3da8-475e-4406-a1d0-02853d840025"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:15.636478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2aa1cd15-2ae3-46a6-b709-5e6fbdbdc5a3 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Calling method '.version_select at 0x7fd6c6310ca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:15.638536 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:15.638536 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:15.640261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2aa1cd15-2ae3-46a6-b709-5e6fbdbdc5a3 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '33c988a074f4464ea304fd2c0da76463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aba98812e14a35ba779779522310b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2aa1cd15-2ae3-46a6-b709-5e6fbdbdc5a3 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Request method failure captured: Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-hosts/n-d-767704-28/startup HTTP/1.1 Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ce6--ihvCNY2lDhxa3Ftyj6aolEfQrjvX8CEihSuQ5teoqZ6iQ-14gjTJYCtqRqbQGSjj4Lsbu5RHHxe4nztD9Mtd9sCgW1P7KcyRFK_PTn4gGnK4ajVd7f92vi3yHUhWJtNf1l_eQ3dPK_qarOEvgTCJUo6Hw05xto0Vor-JcU-z0 Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 91aba98812e14a35ba779779522310b6 Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:27:15.643104 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/91aba98812e14a35ba779779522310b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/91aba98812e14a35ba779779522310b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_91aba98812e14a35ba779779522310b6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/91aba98812e14a35ba779779522310b6"}]}] Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 91aba98812e14a35ba779779522310b6 Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-HostsAdminNegativeTestJSON-1979804162-project Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 33c988a074f4464ea304fd2c0da76463 Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1979804162-project Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'n-d-767704-28'} Jul 14 14:27:15.644437 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:15.645227 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 14 14:27:15.646322 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.647273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b40005dd-0c76-4eb8-99a6-ef9fb3c2a381 req-3c97a03c-ed16-4c7a-b8dd-6241708f9845 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:15.647273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b40005dd-0c76-4eb8-99a6-ef9fb3c2a381 req-3c97a03c-ed16-4c7a-b8dd-6241708f9845 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.650415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2aa1cd15-2ae3-46a6-b709-5e6fbdbdc5a3 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:15.652143 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2aa1cd15-2ae3-46a6-b709-5e6fbdbdc5a3 tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] 10.222.0.81 "GET /compute/v2.1/os-hosts/n-d-767704-28/startup" status: 403 len: 110 microversion: 2.1 time: 0.023497 Jul 14 14:27:15.653949 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 214/463] 10.222.0.81 () {58 vars in 1193 bytes} [Thu Jul 14 14:27:15 2022] GET /compute/v2.1/os-hosts/n-d-767704-28/startup => generated 110 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:15.659947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23d7f123-609b-4808-a8ca-593f0ec03fdc tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:15.662205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-23d7f123-609b-4808-a8ca-593f0ec03fdc tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:15.666520 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b40005dd-0c76-4eb8-99a6-ef9fb3c2a381 req-3c97a03c-ed16-4c7a-b8dd-6241708f9845 service nova] Creating event network-changed:3f8c3da8-475e-4406-a1d0-02853d840025 for instance 6ae081a7-42be-48bc-8677-d0cf09d35d44 on n-h1-767704-28 Jul 14 14:27:15.672149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23d7f123-609b-4808-a8ca-593f0ec03fdc tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:15.673027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23d7f123-609b-4808-a8ca-593f0ec03fdc tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.674149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23d7f123-609b-4808-a8ca-593f0ec03fdc tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:15.674809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23d7f123-609b-4808-a8ca-593f0ec03fdc tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.681301 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b40005dd-0c76-4eb8-99a6-ef9fb3c2a381 req-3c97a03c-ed16-4c7a-b8dd-6241708f9845 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064198 Jul 14 14:27:15.681301 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 250/464] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:15.691449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1e4f0791-081b-4b0e-80a6-3dd67252aa08 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Calling method '.version_select at 0x7fd6c6207820>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:15.693183 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:15.693183 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:15.708587 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-1e4f0791-081b-4b0e-80a6-3dd67252aa08 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1e4f0791-081b-4b0e-80a6-3dd67252aa08 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Request method failure captured: Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce87_XvuceZ_osocLh58wnqNnQJF1tmxiuf3Hoi8Jj5ODMaFyLZ2ejOXdtQvx_NsqRVvdUYmYCk_yVNpeLiVZpSLsO9ND2wJKhv0D2fNW6OqCPp0vXpnjt7qZOdWeROk3ZO3eLoZQqrbtoRlgwEy7mE3U9zSQtpIj_2J_dH2fGtyUg Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:27:15.712116 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/faac8abd2bb443a199553907caa84d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_faac8abd2bb443a199553907caa84d88", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}] Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 39abcf5c8070457d95f5cb120b2fadfd Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'nonexistent_hostname'} Jul 14 14:27:15.713533 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:27:15.714426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 14 14:27:15.715685 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:27:15.716760 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:15.716760 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.716760 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:15.716760 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.716760 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.716760 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:15.716760 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:15.716760 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:15.716760 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:15.716760 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:15.716760 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.719303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1e4f0791-081b-4b0e-80a6-3dd67252aa08 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:15.721974 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1e4f0791-081b-4b0e-80a6-3dd67252aa08 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.035566 Jul 14 14:27:15.725667 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 251/465] 10.222.0.81 () {58 vars in 1214 bytes} [Thu Jul 14 14:27:15 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:27:15.737438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9e5f9c35-436b-454c-adfb-885118538ed7 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c61ed280>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9e5f9c35-436b-454c-adfb-885118538ed7 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Request method failure captured: Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: request: PUT /compute/v2.1/os-hosts/n-d-767704-28 HTTP/1.1 Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 51 Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce87_XvuceZ_osocLh58wnqNnQJF1tmxiuf3Hoi8Jj5ODMaFyLZ2ejOXdtQvx_NsqRVvdUYmYCk_yVNpeLiVZpSLsO9ND2wJKhv0D2fNW6OqCPp0vXpnjt7qZOdWeROk3ZO3eLoZQqrbtoRlgwEy7mE3U9zSQtpIj_2J_dH2fGtyUg Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:27:15.744121 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/faac8abd2bb443a199553907caa84d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_faac8abd2bb443a199553907caa84d88", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}] Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 39abcf5c8070457d95f5cb120b2fadfd Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: {"status": "enable", "maintenance_mode": "invalid"} Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:15.745545 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'n-d-767704-28', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'disable', Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'Enable', Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'Disable', Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance: Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'invalid' Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.746313 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.747737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:15.748911 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:15.748911 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:27:15.748911 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:27:15.748911 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:27:15.748911 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.754551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9e5f9c35-436b-454c-adfb-885118538ed7 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:15.755908 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9e5f9c35-436b-454c-adfb-885118538ed7 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-hosts/n-d-767704-28" status: 400 len: 199 microversion: 2.1 time: 0.024908 Jul 14 14:27:15.757190 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 252/466] 10.222.0.81 () {60 vars in 1189 bytes} [Thu Jul 14 14:27:15 2022] PUT /compute/v2.1/os-hosts/n-d-767704-28 => generated 199 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:27:15.772917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-570c7ac5-7c2c-49a2-8e06-abd62513562a tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c61edee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-570c7ac5-7c2c-49a2-8e06-abd62513562a tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Request method failure captured: Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: request: PUT /compute/v2.1/os-hosts/n-d-767704-28 HTTP/1.1 Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 51 Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce87_XvuceZ_osocLh58wnqNnQJF1tmxiuf3Hoi8Jj5ODMaFyLZ2ejOXdtQvx_NsqRVvdUYmYCk_yVNpeLiVZpSLsO9ND2wJKhv0D2fNW6OqCPp0vXpnjt7qZOdWeROk3ZO3eLoZQqrbtoRlgwEy7mE3U9zSQtpIj_2J_dH2fGtyUg Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:27:15.780579 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/faac8abd2bb443a199553907caa84d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_faac8abd2bb443a199553907caa84d88", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}] Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 39abcf5c8070457d95f5cb120b2fadfd Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: {"status": "invalid", "maintenance_mode": "enable"} Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:15.782023 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'n-d-767704-28', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'disable', Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'Enable', Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'Disable', Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance: Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'invalid' Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.782817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.785900 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:15.791106 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:15.791106 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:27:15.791106 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:27:15.791106 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:27:15.791106 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.791106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-570c7ac5-7c2c-49a2-8e06-abd62513562a tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:15.791106 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-570c7ac5-7c2c-49a2-8e06-abd62513562a tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-hosts/n-d-767704-28" status: 400 len: 189 microversion: 2.1 time: 0.018354 Jul 14 14:27:15.797326 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 253/467] 10.222.0.81 () {60 vars in 1189 bytes} [Thu Jul 14 14:27:15 2022] PUT /compute/v2.1/os-hosts/n-d-767704-28 => generated 189 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:27:15.808753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-959cfad5-7458-426c-9a91-acca575afcbe tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:15.809431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-959cfad5-7458-426c-9a91-acca575afcbe tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:15.818859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-959cfad5-7458-426c-9a91-acca575afcbe tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:15.819691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-959cfad5-7458-426c-9a91-acca575afcbe tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.821351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-959cfad5-7458-426c-9a91-acca575afcbe tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:15.822069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-959cfad5-7458-426c-9a91-acca575afcbe tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.835124 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-23d7f123-609b-4808-a8ca-593f0ec03fdc tempest-DeleteServersAdminTestJSON-2101817397 tempest-DeleteServersAdminTestJSON-2101817397-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.178966 Jul 14 14:27:15.836086 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 215/468] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:27:15 2022] POST /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:15.845701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4dca24cf-2be6-4e1c-a14d-dea8bb6b18cf tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Action: 'update', calling method: .version_select at 0x7fd6c61e2700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:15.847308 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:15.847308 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:15.848624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4dca24cf-2be6-4e1c-a14d-dea8bb6b18cf tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '33c988a074f4464ea304fd2c0da76463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91aba98812e14a35ba779779522310b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4dca24cf-2be6-4e1c-a14d-dea8bb6b18cf tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Request method failure captured: Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: request: PUT /compute/v2.1/os-hosts/n-d-767704-28 HTTP/1.1 Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 50 Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ce6--ihvCNY2lDhxa3Ftyj6aolEfQrjvX8CEihSuQ5teoqZ6iQ-14gjTJYCtqRqbQGSjj4Lsbu5RHHxe4nztD9Mtd9sCgW1P7KcyRFK_PTn4gGnK4ajVd7f92vi3yHUhWJtNf1l_eQ3dPK_qarOEvgTCJUo6Hw05xto0Vor-JcU-z0 Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 91aba98812e14a35ba779779522310b6 Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:27:15.867886 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/91aba98812e14a35ba779779522310b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/91aba98812e14a35ba779779522310b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_91aba98812e14a35ba779779522310b6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/91aba98812e14a35ba779779522310b6"}]}] Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 91aba98812e14a35ba779779522310b6 Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1979804162 Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-HostsAdminNegativeTestJSON-1979804162-project Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 33c988a074f4464ea304fd2c0da76463 Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1979804162-project Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: {"status": "enable", "maintenance_mode": "enable"} Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 14 14:27:15.869348 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'n-d-767704-28', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:15.870242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 14 14:27:15.871381 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:15.872631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4dca24cf-2be6-4e1c-a14d-dea8bb6b18cf tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:15.872631 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4dca24cf-2be6-4e1c-a14d-dea8bb6b18cf tempest-HostsAdminNegativeTestJSON-1979804162 tempest-HostsAdminNegativeTestJSON-1979804162-project] 10.222.0.81 "PUT /compute/v2.1/os-hosts/n-d-767704-28" status: 403 len: 111 microversion: 2.1 time: 0.031156 Jul 14 14:27:15.874657 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 216/469] 10.222.0.81 () {60 vars in 1189 bytes} [Thu Jul 14 14:27:15 2022] PUT /compute/v2.1/os-hosts/n-d-767704-28 => generated 111 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:15.879498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-30fc46f7-fa0c-472c-ab8f-af017981dc80 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:15.880143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-30fc46f7-fa0c-472c-ab8f-af017981dc80 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:15.898115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30fc46f7-fa0c-472c-ab8f-af017981dc80 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:15.899850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30fc46f7-fa0c-472c-ab8f-af017981dc80 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.901034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30fc46f7-fa0c-472c-ab8f-af017981dc80 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:15.901741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30fc46f7-fa0c-472c-ab8f-af017981dc80 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.944914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30fc46f7-fa0c-472c-ab8f-af017981dc80 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:15.944914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30fc46f7-fa0c-472c-ab8f-af017981dc80 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:15.945290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-30fc46f7-fa0c-472c-ab8f-af017981dc80 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lazy-loading 'fault' on Instance uuid 23efb1d0-4c73-471c-b109-75d53db07d0a {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:16.586622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-959cfad5-7458-426c-9a91-acca575afcbe tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:16.600503 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-959cfad5-7458-426c-9a91-acca575afcbe tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1311 microversion: 2.1 time: 0.801991 Jul 14 14:27:16.607347 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 254/470] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:15 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1311 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:16.612330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc0672eb-9ab3-4d54-8a79-a8640b86fdda tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c61d8dc0>, body: {"status": null, "maintenance_mode": null} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc0672eb-9ab3-4d54-8a79-a8640b86fdda tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Request method failure captured: Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: request: PUT /compute/v2.1/os-hosts/n-d-767704-28 HTTP/1.1 Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 42 Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce87_XvuceZ_osocLh58wnqNnQJF1tmxiuf3Hoi8Jj5ODMaFyLZ2ejOXdtQvx_NsqRVvdUYmYCk_yVNpeLiVZpSLsO9ND2wJKhv0D2fNW6OqCPp0vXpnjt7qZOdWeROk3ZO3eLoZQqrbtoRlgwEy7mE3U9zSQtpIj_2J_dH2fGtyUg Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:27:16.621247 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/faac8abd2bb443a199553907caa84d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_faac8abd2bb443a199553907caa84d88", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}] Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 39abcf5c8070457d95f5cb120b2fadfd Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: {"status": null, "maintenance_mode": null} Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 14 14:27:16.622504 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'n-d-767704-28', 'body': {'status': None, 'maintenance_mode': None}} Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'disable', Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'Enable', Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'Disable', Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance: Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi None Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:16.623330 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:16.624894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:16.625991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:27:16.625991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:27:16.625991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 14 14:27:16.625991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:16.637786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc0672eb-9ab3-4d54-8a79-a8640b86fdda tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:16.639039 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dc0672eb-9ab3-4d54-8a79-a8640b86fdda tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-hosts/n-d-767704-28" status: 400 len: 127 microversion: 2.1 time: 0.030376 Jul 14 14:27:16.647470 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 255/471] 10.222.0.81 () {60 vars in 1189 bytes} [Thu Jul 14 14:27:16 2022] PUT /compute/v2.1/os-hosts/n-d-767704-28 => generated 127 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:27:16.653518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d593a112-8734-40f2-b68c-34f0c3d77037 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:16.654448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d593a112-8734-40f2-b68c-34f0c3d77037 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:16.661863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d593a112-8734-40f2-b68c-34f0c3d77037 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:16.667072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d593a112-8734-40f2-b68c-34f0c3d77037 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:16.668604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d593a112-8734-40f2-b68c-34f0c3d77037 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:16.669219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d593a112-8734-40f2-b68c-34f0c3d77037 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:16.749086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-30fc46f7-fa0c-472c-ab8f-af017981dc80 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:16.764350 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-30fc46f7-fa0c-472c-ab8f-af017981dc80 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1451 microversion: 2.1 time: 0.881607 Jul 14 14:27:16.767954 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 217/472] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:15 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1451 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:16.781699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9bbb44ce-8acd-4cf5-adf7-095b83753b93 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:16.782778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9bbb44ce-8acd-4cf5-adf7-095b83753b93 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:16.791286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bbb44ce-8acd-4cf5-adf7-095b83753b93 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:16.792025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bbb44ce-8acd-4cf5-adf7-095b83753b93 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:16.793088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bbb44ce-8acd-4cf5-adf7-095b83753b93 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:16.793815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bbb44ce-8acd-4cf5-adf7-095b83753b93 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:17.266418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d593a112-8734-40f2-b68c-34f0c3d77037 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:17.271437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:17.289136 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d593a112-8734-40f2-b68c-34f0c3d77037 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1312 microversion: 2.1 time: 0.639278 Jul 14 14:27:17.289559 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 256/473] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:16 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1312 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:17.303232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cac303a7-3658-44fd-9881-5f57f7fe97b6 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c61d8af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:17.305068 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:17.305068 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:17.306205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9bbb44ce-8acd-4cf5-adf7-095b83753b93 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:17.306569 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.hosts [None req-cac303a7-3658-44fd-9881-5f57f7fe97b6 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Enabling host nonexistent_hostname. Jul 14 14:27:17.318949 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-cac303a7-3658-44fd-9881-5f57f7fe97b6 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:17.321209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9bbb44ce-8acd-4cf5-adf7-095b83753b93 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cac303a7-3658-44fd-9881-5f57f7fe97b6 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Request method failure captured: Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 50 Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ce87_XvuceZ_osocLh58wnqNnQJF1tmxiuf3Hoi8Jj5ODMaFyLZ2ejOXdtQvx_NsqRVvdUYmYCk_yVNpeLiVZpSLsO9ND2wJKhv0D2fNW6OqCPp0vXpnjt7qZOdWeROk3ZO3eLoZQqrbtoRlgwEy7mE3U9zSQtpIj_2J_dH2fGtyUg Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:27:17.322407 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/faac8abd2bb443a199553907caa84d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_faac8abd2bb443a199553907caa84d88", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/faac8abd2bb443a199553907caa84d88"}]}] Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: faac8abd2bb443a199553907caa84d88 Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-160413098 Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 39abcf5c8070457d95f5cb120b2fadfd Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HostsAdminNegativeTestJSON-160413098-project-admin Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: {"status": "enable", "maintenance_mode": "enable"} Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:17.324195 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:27:17.325263 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:17.326639 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:27:17.328003 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:17.330259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cac303a7-3658-44fd-9881-5f57f7fe97b6 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:17.330928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9bbb44ce-8acd-4cf5-adf7-095b83753b93 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:17.332072 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cac303a7-3658-44fd-9881-5f57f7fe97b6 tempest-HostsAdminNegativeTestJSON-160413098 tempest-HostsAdminNegativeTestJSON-160413098-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.041044 Jul 14 14:27:17.332404 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9bbb44ce-8acd-4cf5-adf7-095b83753b93 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1569 microversion: 2.25 time: 0.562533 Jul 14 14:27:17.335218 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 218/474] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:16 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1569 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:17.341842 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 257/475] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jul 14 14:27:17 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:27:17.345853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e75ce7e1-50bf-4699-b9c3-cfafdc14e325 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:17.347072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e75ce7e1-50bf-4699-b9c3-cfafdc14e325 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:17.354957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e75ce7e1-50bf-4699-b9c3-cfafdc14e325 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:17.355662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e75ce7e1-50bf-4699-b9c3-cfafdc14e325 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:17.357279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e75ce7e1-50bf-4699-b9c3-cfafdc14e325 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:17.358049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e75ce7e1-50bf-4699-b9c3-cfafdc14e325 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:17.397424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e75ce7e1-50bf-4699-b9c3-cfafdc14e325 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:27:17.457466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:17.548878 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e75ce7e1-50bf-4699-b9c3-cfafdc14e325 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "DELETE /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 204 len: 0 microversion: 2.1 time: 0.209522 Jul 14 14:27:17.550218 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 219/476] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:27:17 2022] DELETE /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:27:17.559220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:17.563733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-872ced93-20fb-4cf5-a494-48f1a452b42e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:17.564345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-872ced93-20fb-4cf5-a494-48f1a452b42e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:17.587163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-872ced93-20fb-4cf5-a494-48f1a452b42e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:17.587877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-872ced93-20fb-4cf5-a494-48f1a452b42e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:17.588400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-872ced93-20fb-4cf5-a494-48f1a452b42e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:17.588852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-872ced93-20fb-4cf5-a494-48f1a452b42e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:17.625303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a5fa84db-b209-439b-b400-64872a058d2e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:17.626005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a5fa84db-b209-439b-b400-64872a058d2e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:17.635733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5fa84db-b209-439b-b400-64872a058d2e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:17.636170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5fa84db-b209-439b-b400-64872a058d2e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:17.639608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5fa84db-b209-439b-b400-64872a058d2e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:17.640927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5fa84db-b209-439b-b400-64872a058d2e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:17.675413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-872ced93-20fb-4cf5-a494-48f1a452b42e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:17.675871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-872ced93-20fb-4cf5-a494-48f1a452b42e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:17.676495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-872ced93-20fb-4cf5-a494-48f1a452b42e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lazy-loading 'fault' on Instance uuid 23efb1d0-4c73-471c-b109-75d53db07d0a {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:18.186776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a5fa84db-b209-439b-b400-64872a058d2e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:18.197538 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a5fa84db-b209-439b-b400-64872a058d2e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1311 microversion: 2.1 time: 0.576833 Jul 14 14:27:18.208602 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 220/477] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:17 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1311 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:27:18.214052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-872ced93-20fb-4cf5-a494-48f1a452b42e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:18.215358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-399da9a7-d5a4-4155-aa87-76df49d2437f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:18.216447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-399da9a7-d5a4-4155-aa87-76df49d2437f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:18.226346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-399da9a7-d5a4-4155-aa87-76df49d2437f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:18.227847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-399da9a7-d5a4-4155-aa87-76df49d2437f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:18.229475 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-872ced93-20fb-4cf5-a494-48f1a452b42e tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1457 microversion: 2.1 time: 0.670287 Jul 14 14:27:18.229941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-399da9a7-d5a4-4155-aa87-76df49d2437f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:18.230693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-399da9a7-d5a4-4155-aa87-76df49d2437f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:18.231047 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 258/478] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:17 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1457 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:27:18.241496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2fae0d85-da7f-4bae-87fd-4525ac16cbda req-262b46f8-d2d5-479a-bbd5-e8929fd4d1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c5728e-50ec-43f4-bd4e-8d7b9217bb69", "tag": "26efdc8a-13a1-46a1-a04f-f980949a8248"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:18.252132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2fae0d85-da7f-4bae-87fd-4525ac16cbda req-262b46f8-d2d5-479a-bbd5-e8929fd4d1f7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:18.252977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2fae0d85-da7f-4bae-87fd-4525ac16cbda req-262b46f8-d2d5-479a-bbd5-e8929fd4d1f7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:18.278456 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2fae0d85-da7f-4bae-87fd-4525ac16cbda req-262b46f8-d2d5-479a-bbd5-e8929fd4d1f7 service nova] Creating event network-changed:26efdc8a-13a1-46a1-a04f-f980949a8248 for instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 on n-h2-767704-28 Jul 14 14:27:18.293250 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2fae0d85-da7f-4bae-87fd-4525ac16cbda req-262b46f8-d2d5-479a-bbd5-e8929fd4d1f7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055706 Jul 14 14:27:18.295302 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 259/479] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:18.319127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-60a5b7e4-1034-44ee-aa07-8cd04f7c6d1e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:18.321602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-60a5b7e4-1034-44ee-aa07-8cd04f7c6d1e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:18.340791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60a5b7e4-1034-44ee-aa07-8cd04f7c6d1e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:18.342000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60a5b7e4-1034-44ee-aa07-8cd04f7c6d1e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:18.343758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60a5b7e4-1034-44ee-aa07-8cd04f7c6d1e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:18.344568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60a5b7e4-1034-44ee-aa07-8cd04f7c6d1e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:18.827677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-399da9a7-d5a4-4155-aa87-76df49d2437f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:18.837832 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-399da9a7-d5a4-4155-aa87-76df49d2437f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1588 microversion: 2.1 time: 0.627549 Jul 14 14:27:18.850013 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 221/480] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:18 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1588 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:18.856539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-112b84a2-8f21-42cf-b35d-549c1daf6eb0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:18.857720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-112b84a2-8f21-42cf-b35d-549c1daf6eb0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:18.864250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-112b84a2-8f21-42cf-b35d-549c1daf6eb0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:18.865064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-112b84a2-8f21-42cf-b35d-549c1daf6eb0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:18.866104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-112b84a2-8f21-42cf-b35d-549c1daf6eb0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:18.866758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-112b84a2-8f21-42cf-b35d-549c1daf6eb0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:19.362422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:19.380798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:19.439262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-60a5b7e4-1034-44ee-aa07-8cd04f7c6d1e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:19.449098 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-60a5b7e4-1034-44ee-aa07-8cd04f7c6d1e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1312 microversion: 2.1 time: 1.145116 Jul 14 14:27:19.459667 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 260/481] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:18 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1312 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:19.465576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b14f2676-eb44-46c9-bb66-79782f8aefe8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:19.466688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b14f2676-eb44-46c9-bb66-79782f8aefe8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:19.473672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b14f2676-eb44-46c9-bb66-79782f8aefe8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:19.474709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b14f2676-eb44-46c9-bb66-79782f8aefe8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:19.475941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b14f2676-eb44-46c9-bb66-79782f8aefe8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:19.477300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b14f2676-eb44-46c9-bb66-79782f8aefe8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:19.691407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-112b84a2-8f21-42cf-b35d-549c1daf6eb0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:19.708064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-112b84a2-8f21-42cf-b35d-549c1daf6eb0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:19.712797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-112b84a2-8f21-42cf-b35d-549c1daf6eb0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:19.715960 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-112b84a2-8f21-42cf-b35d-549c1daf6eb0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1569 microversion: 2.25 time: 0.863718 Jul 14 14:27:19.717585 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 222/482] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:18 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1569 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:19.727575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-25a114c1-fdd7-456d-9b56-63b92845acb7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:19.728861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-25a114c1-fdd7-456d-9b56-63b92845acb7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:19.747798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25a114c1-fdd7-456d-9b56-63b92845acb7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:19.751508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25a114c1-fdd7-456d-9b56-63b92845acb7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:19.752790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25a114c1-fdd7-456d-9b56-63b92845acb7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:19.753747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25a114c1-fdd7-456d-9b56-63b92845acb7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:19.822741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25a114c1-fdd7-456d-9b56-63b92845acb7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:19.823582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25a114c1-fdd7-456d-9b56-63b92845acb7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:19.824281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-25a114c1-fdd7-456d-9b56-63b92845acb7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lazy-loading 'fault' on Instance uuid 23efb1d0-4c73-471c-b109-75d53db07d0a {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:19.898773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b14f2676-eb44-46c9-bb66-79782f8aefe8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:19.911956 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b14f2676-eb44-46c9-bb66-79782f8aefe8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1311 microversion: 2.1 time: 0.450900 Jul 14 14:27:19.913163 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 261/483] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:19 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1311 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:19.918273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-979d2905-9c0d-4501-85ba-af6baa6b4a94 req-0e4a6f77-0dc8-4957-856f-b6dc7a9a3a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19bb6d1e-7771-41fd-b903-dc300ba97d6f", "name": "network-vif-plugged", "status": "completed", "tag": "2bef06c0-64d7-4a58-88e7-88f2b49a1dbc"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:19.927300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-979d2905-9c0d-4501-85ba-af6baa6b4a94 req-0e4a6f77-0dc8-4957-856f-b6dc7a9a3a9e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:19.928079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-979d2905-9c0d-4501-85ba-af6baa6b4a94 req-0e4a6f77-0dc8-4957-856f-b6dc7a9a3a9e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:19.943139 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-979d2905-9c0d-4501-85ba-af6baa6b4a94 req-0e4a6f77-0dc8-4957-856f-b6dc7a9a3a9e service nova] Creating event network-vif-plugged:2bef06c0-64d7-4a58-88e7-88f2b49a1dbc for instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f on n-h1-767704-28 Jul 14 14:27:19.949966 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-979d2905-9c0d-4501-85ba-af6baa6b4a94 req-0e4a6f77-0dc8-4957-856f-b6dc7a9a3a9e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035090 Jul 14 14:27:19.954889 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 262/484] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:20.088142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-25a114c1-fdd7-456d-9b56-63b92845acb7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:20.097473 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-25a114c1-fdd7-456d-9b56-63b92845acb7 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1457 microversion: 2.1 time: 0.376416 Jul 14 14:27:20.098184 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 223/485] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:19 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1457 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:20.469142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f4a0fc2-7a8f-49dd-a32c-5bb0f3592ca1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:20.469883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f4a0fc2-7a8f-49dd-a32c-5bb0f3592ca1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:20.489656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f4a0fc2-7a8f-49dd-a32c-5bb0f3592ca1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:20.490991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f4a0fc2-7a8f-49dd-a32c-5bb0f3592ca1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:20.492443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f4a0fc2-7a8f-49dd-a32c-5bb0f3592ca1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:20.493309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f4a0fc2-7a8f-49dd-a32c-5bb0f3592ca1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:20.736250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8bf0948a-3fe5-4077-a2fb-d127997b1067 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:20.736993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8bf0948a-3fe5-4077-a2fb-d127997b1067 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:20.739145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:20.756397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bf0948a-3fe5-4077-a2fb-d127997b1067 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:20.756853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bf0948a-3fe5-4077-a2fb-d127997b1067 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:20.757850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bf0948a-3fe5-4077-a2fb-d127997b1067 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:20.758301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bf0948a-3fe5-4077-a2fb-d127997b1067 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:20.973657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f4a0fc2-7a8f-49dd-a32c-5bb0f3592ca1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:20.988538 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f4a0fc2-7a8f-49dd-a32c-5bb0f3592ca1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1312 microversion: 2.1 time: 0.524647 Jul 14 14:27:20.991717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8bf0948a-3fe5-4077-a2fb-d127997b1067 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:21.000523 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 263/486] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:20 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1312 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:21.008684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5260dfab-bdd1-46c6-ac1a-d0d20817f8d5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:21.009532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8bf0948a-3fe5-4077-a2fb-d127997b1067 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:21.009765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5260dfab-bdd1-46c6-ac1a-d0d20817f8d5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:21.011572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8bf0948a-3fe5-4077-a2fb-d127997b1067 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:21.014342 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8bf0948a-3fe5-4077-a2fb-d127997b1067 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1569 microversion: 2.25 time: 0.282265 Jul 14 14:27:21.015681 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 224/487] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:20 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1569 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:27:21.028553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5260dfab-bdd1-46c6-ac1a-d0d20817f8d5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:21.029401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5260dfab-bdd1-46c6-ac1a-d0d20817f8d5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:21.031324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5260dfab-bdd1-46c6-ac1a-d0d20817f8d5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:21.033155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5260dfab-bdd1-46c6-ac1a-d0d20817f8d5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:21.119094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6e984c6f-be7e-4911-b0c8-4fd47a953968 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:21.120438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6e984c6f-be7e-4911-b0c8-4fd47a953968 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:21.131671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e984c6f-be7e-4911-b0c8-4fd47a953968 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:21.132653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e984c6f-be7e-4911-b0c8-4fd47a953968 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:21.134882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e984c6f-be7e-4911-b0c8-4fd47a953968 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:21.135926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e984c6f-be7e-4911-b0c8-4fd47a953968 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:21.238419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e984c6f-be7e-4911-b0c8-4fd47a953968 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:21.238884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e984c6f-be7e-4911-b0c8-4fd47a953968 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:21.243774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-6e984c6f-be7e-4911-b0c8-4fd47a953968 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lazy-loading 'fault' on Instance uuid 23efb1d0-4c73-471c-b109-75d53db07d0a {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:21.324298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5260dfab-bdd1-46c6-ac1a-d0d20817f8d5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:21.335203 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5260dfab-bdd1-46c6-ac1a-d0d20817f8d5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1311 microversion: 2.1 time: 0.333449 Jul 14 14:27:21.353452 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 264/488] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:21 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1311 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:21.455499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6e984c6f-be7e-4911-b0c8-4fd47a953968 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:21.466952 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6e984c6f-be7e-4911-b0c8-4fd47a953968 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1457 microversion: 2.1 time: 0.355502 Jul 14 14:27:21.467931 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 225/489] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:21 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1457 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:21.643927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3d66c027-a827-41e7-80e5-7d277494bee5 req-ed421f7d-c4fc-4da3-9b13-fbd8d3237ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88426cdc-557a-4724-9ef2-d84d32b4191d", "name": "network-vif-unplugged", "status": "completed", "tag": "5671e97e-1f32-49f5-aea1-ca6152f537d3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:21.668479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3d66c027-a827-41e7-80e5-7d277494bee5 req-ed421f7d-c4fc-4da3-9b13-fbd8d3237ed8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:21.669950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3d66c027-a827-41e7-80e5-7d277494bee5 req-ed421f7d-c4fc-4da3-9b13-fbd8d3237ed8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:21.707588 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3d66c027-a827-41e7-80e5-7d277494bee5 req-ed421f7d-c4fc-4da3-9b13-fbd8d3237ed8 service nova] Creating event network-vif-unplugged:5671e97e-1f32-49f5-aea1-ca6152f537d3 for instance 88426cdc-557a-4724-9ef2-d84d32b4191d on n-h2-767704-28 Jul 14 14:27:21.745712 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3d66c027-a827-41e7-80e5-7d277494bee5 req-ed421f7d-c4fc-4da3-9b13-fbd8d3237ed8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106570 Jul 14 14:27:21.746367 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 265/490] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:22.016656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-026cc74f-488e-40ab-a39a-723268d02fa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:22.020117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-026cc74f-488e-40ab-a39a-723268d02fa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:22.048564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c5354b9a-46f8-4115-a137-b499708f490f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:22.053078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c5354b9a-46f8-4115-a137-b499708f490f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:22.105841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5354b9a-46f8-4115-a137-b499708f490f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:22.106293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5354b9a-46f8-4115-a137-b499708f490f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:22.108591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-026cc74f-488e-40ab-a39a-723268d02fa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:22.109120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-026cc74f-488e-40ab-a39a-723268d02fa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:22.109872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-026cc74f-488e-40ab-a39a-723268d02fa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:22.111556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5354b9a-46f8-4115-a137-b499708f490f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:22.112347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5354b9a-46f8-4115-a137-b499708f490f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:22.115009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-026cc74f-488e-40ab-a39a-723268d02fa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:22.534004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c5354b9a-46f8-4115-a137-b499708f490f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:22.543018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-026cc74f-488e-40ab-a39a-723268d02fa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:22.550149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c5354b9a-46f8-4115-a137-b499708f490f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:22.552490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c5354b9a-46f8-4115-a137-b499708f490f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:22.556775 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c5354b9a-46f8-4115-a137-b499708f490f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1569 microversion: 2.25 time: 0.526115 Jul 14 14:27:22.566720 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-026cc74f-488e-40ab-a39a-723268d02fa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1462 microversion: 2.1 time: 0.558981 Jul 14 14:27:22.572342 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 266/491] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:22 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1569 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:22.577207 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 226/492] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:22 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1462 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:22.582378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fb204686-60ce-43f3-a384-2be9fd394699 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:22.583301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fb204686-60ce-43f3-a384-2be9fd394699 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:22.590318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb204686-60ce-43f3-a384-2be9fd394699 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:22.591080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb204686-60ce-43f3-a384-2be9fd394699 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:22.592153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb204686-60ce-43f3-a384-2be9fd394699 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:22.593890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb204686-60ce-43f3-a384-2be9fd394699 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:22.600121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-efc585fa-fb2a-459a-a2e9-3ab8f38c6fd5 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:22.600754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-efc585fa-fb2a-459a-a2e9-3ab8f38c6fd5 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:22.621333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efc585fa-fb2a-459a-a2e9-3ab8f38c6fd5 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:22.623050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efc585fa-fb2a-459a-a2e9-3ab8f38c6fd5 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:22.631001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efc585fa-fb2a-459a-a2e9-3ab8f38c6fd5 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:22.631719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efc585fa-fb2a-459a-a2e9-3ab8f38c6fd5 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:22.685617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efc585fa-fb2a-459a-a2e9-3ab8f38c6fd5 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:22.686188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efc585fa-fb2a-459a-a2e9-3ab8f38c6fd5 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:22.686714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-efc585fa-fb2a-459a-a2e9-3ab8f38c6fd5 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lazy-loading 'fault' on Instance uuid 23efb1d0-4c73-471c-b109-75d53db07d0a {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:22.814909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-efc585fa-fb2a-459a-a2e9-3ab8f38c6fd5 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2998f23059d446dcbea060ac2115b096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1f655183e476da89067fcd0f1756a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:22.829006 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-efc585fa-fb2a-459a-a2e9-3ab8f38c6fd5 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 200 len: 1309 microversion: 2.1 time: 0.232570 Jul 14 14:27:22.861167 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 227/493] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:22 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 1309 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:22.871469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:22.872934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:22.880562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:22.881309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:22.882611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:22.883981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:22.976324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fb204686-60ce-43f3-a384-2be9fd394699 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:22.986386 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fb204686-60ce-43f3-a384-2be9fd394699 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1311 microversion: 2.1 time: 0.412564 Jul 14 14:27:22.987901 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 267/494] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:22 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1311 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:23.045607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:23.053192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Old instance type m1.heat2, new instance type m1.heat {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 14:27:23.061185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:27:23.062684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:27:23.066919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:27:23.067585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:27:23.068142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:27:23.346983 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-acf16294-4a00-4193-af60-25c302a86ee4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "POST /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f/action" status: 202 len: 0 microversion: 2.1 time: 0.482796 Jul 14 14:27:23.347600 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 228/495] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:27:22 2022] POST /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:23.358883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d2d11da5-5b6d-410d-a14f-60def3226690 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:23.359508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d2d11da5-5b6d-410d-a14f-60def3226690 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:23.387713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2d11da5-5b6d-410d-a14f-60def3226690 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:23.388488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2d11da5-5b6d-410d-a14f-60def3226690 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:23.390985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2d11da5-5b6d-410d-a14f-60def3226690 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:23.394361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2d11da5-5b6d-410d-a14f-60def3226690 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:23.665151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3e40f114-93bb-4833-8eff-01adb302980c tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Calling method '.version_select at 0x7fd6c639f5e0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:23.666344 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:23.666344 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:23.667491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3e40f114-93bb-4833-8eff-01adb302980c tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '81fb0753b413401dadfc12f4759af8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615dd737344c407883afcfbe5f59a67f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3e40f114-93bb-4833-8eff-01adb302980c tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Request method failure captured: Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CfJzSujCXeZ29utyBFQ6poRf7_sHdZyPVQREjUrYw4Vcevm9ixlt7GTkFx3Eu4SwFLSLJSvVnTYIhlhcJaj5Z2yBwS775xFvhYPHYmHI05wsg5vBOO9esl6QppB3aXditkvxhoy9EceMTF3Qg4AyAOgwcXGzkq-j8p2IuGEb6gKzZQ Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 615dd737344c407883afcfbe5f59a67f Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:23.669588 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/615dd737344c407883afcfbe5f59a67f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/615dd737344c407883afcfbe5f59a67f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_615dd737344c407883afcfbe5f59a67f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/615dd737344c407883afcfbe5f59a67f"}]}] Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 615dd737344c407883afcfbe5f59a67f Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HypervisorAdminNegativeTestJSON-619055593-project Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 81fb0753b413401dadfc12f4759af8e9 Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-619055593-project Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: action_args: {} Jul 14 14:27:23.671039 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:23.671805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 14 14:27:23.673885 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:23.675431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3e40f114-93bb-4833-8eff-01adb302980c tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:23.675431 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3e40f114-93bb-4833-8eff-01adb302980c tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.330107 Jul 14 14:27:23.681533 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 268/496] 10.222.0.81 () {58 vars in 1166 bytes} [Thu Jul 14 14:27:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 342 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:27:23.686906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-54d8612f-dd45-42cf-892e-68156600992c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:23.687518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-54d8612f-dd45-42cf-892e-68156600992c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:23.697997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54d8612f-dd45-42cf-892e-68156600992c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:23.698455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54d8612f-dd45-42cf-892e-68156600992c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:23.699277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54d8612f-dd45-42cf-892e-68156600992c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:23.699718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54d8612f-dd45-42cf-892e-68156600992c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:23.837785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d2d11da5-5b6d-410d-a14f-60def3226690 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:23.850545 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d2d11da5-5b6d-410d-a14f-60def3226690 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1471 microversion: 2.1 time: 0.495307 Jul 14 14:27:23.862435 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 229/497] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:23 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1471 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:23.863942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea4e06cd-6b63-4e2e-a5e5-52c80ce1b596 tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Calling method '.version_select at 0x7fd6c6143ee0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:23.864850 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:23.864850 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:23.867487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ea4e06cd-6b63-4e2e-a5e5-52c80ce1b596 tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '81fb0753b413401dadfc12f4759af8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615dd737344c407883afcfbe5f59a67f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea4e06cd-6b63-4e2e-a5e5-52c80ce1b596 tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Request method failure captured: Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CfJzSujCXeZ29utyBFQ6poRf7_sHdZyPVQREjUrYw4Vcevm9ixlt7GTkFx3Eu4SwFLSLJSvVnTYIhlhcJaj5Z2yBwS775xFvhYPHYmHI05wsg5vBOO9esl6QppB3aXditkvxhoy9EceMTF3Qg4AyAOgwcXGzkq-j8p2IuGEb6gKzZQ Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 615dd737344c407883afcfbe5f59a67f Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:27:23.874274 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/615dd737344c407883afcfbe5f59a67f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/615dd737344c407883afcfbe5f59a67f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_615dd737344c407883afcfbe5f59a67f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/615dd737344c407883afcfbe5f59a67f"}]}] Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 615dd737344c407883afcfbe5f59a67f Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-HypervisorAdminNegativeTestJSON-619055593-project Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 81fb0753b413401dadfc12f4759af8e9 Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-619055593-project Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: action_args: {} Jul 14 14:27:23.875577 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:23.876463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 14 14:27:23.877697 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:23.878783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea4e06cd-6b63-4e2e-a5e5-52c80ce1b596 tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:23.878783 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ea4e06cd-6b63-4e2e-a5e5-52c80ce1b596 tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.021823 Jul 14 14:27:23.880492 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 230/498] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:23 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:23.885683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d5af3f49-175b-4da8-ac0c-d9525e0010cf req-c103a4b8-43b6-4eb5-a2df-d26f0b91cafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23efb1d0-4c73-471c-b109-75d53db07d0a", "name": "network-vif-deleted", "tag": "86bfaf20-9a4b-4cd6-a410-15a65252105c"}, {"name": "network-changed", "server_uuid": "88426cdc-557a-4724-9ef2-d84d32b4191d", "tag": "5671e97e-1f32-49f5-aea1-ca6152f537d3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:23.905198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d5af3f49-175b-4da8-ac0c-d9525e0010cf req-c103a4b8-43b6-4eb5-a2df-d26f0b91cafc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:23.905731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d5af3f49-175b-4da8-ac0c-d9525e0010cf req-c103a4b8-43b6-4eb5-a2df-d26f0b91cafc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:23.934285 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d5af3f49-175b-4da8-ac0c-d9525e0010cf req-c103a4b8-43b6-4eb5-a2df-d26f0b91cafc service nova] Creating event network-vif-deleted:86bfaf20-9a4b-4cd6-a410-15a65252105c for instance 23efb1d0-4c73-471c-b109-75d53db07d0a on n-h1-767704-28 Jul 14 14:27:23.934956 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d5af3f49-175b-4da8-ac0c-d9525e0010cf req-c103a4b8-43b6-4eb5-a2df-d26f0b91cafc service nova] Creating event network-changed:5671e97e-1f32-49f5-aea1-ca6152f537d3 for instance 88426cdc-557a-4724-9ef2-d84d32b4191d on n-h2-767704-28 Jul 14 14:27:23.953748 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d5af3f49-175b-4da8-ac0c-d9525e0010cf req-c103a4b8-43b6-4eb5-a2df-d26f0b91cafc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070655 Jul 14 14:27:23.954871 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 231/499] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:23.982520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-68042af9-50c7-4bcf-8276-66d4b36831a9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:23.983397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-68042af9-50c7-4bcf-8276-66d4b36831a9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:23.994786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68042af9-50c7-4bcf-8276-66d4b36831a9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:23.995252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68042af9-50c7-4bcf-8276-66d4b36831a9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:23.996669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68042af9-50c7-4bcf-8276-66d4b36831a9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:23.997451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68042af9-50c7-4bcf-8276-66d4b36831a9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.009951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-54d8612f-dd45-42cf-892e-68156600992c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:24.027153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-54d8612f-dd45-42cf-892e-68156600992c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:24.032892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-54d8612f-dd45-42cf-892e-68156600992c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:24.038576 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-54d8612f-dd45-42cf-892e-68156600992c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1569 microversion: 2.25 time: 0.355655 Jul 14 14:27:24.039858 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 269/500] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:23 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1569 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:24.051479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-71576eba-092c-4cd4-9b62-a5ef1ad38ee2 tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Calling method '.version_select at 0x7fd6c639fa60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.052400 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:24.052400 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:24.053602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-71576eba-092c-4cd4-9b62-a5ef1ad38ee2 tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '81fb0753b413401dadfc12f4759af8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615dd737344c407883afcfbe5f59a67f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:24.056671 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-68042af9-50c7-4bcf-8276-66d4b36831a9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] HTTP exception thrown: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-68042af9-50c7-4bcf-8276-66d4b36831a9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Request method failure captured: Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a HTTP/1.1 Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CeDFkTGDtJCukPJWpXaEZf9q9MGTzuGaRyIuVXxPnmzWy0ehCkiFy2PSYE69E5I85uNYN7MxOgF_zHAmQskqru9J6cQAW_T77VEIMsvmCK2pnCfd90HswVBIqorHMCSBQUhsoNvp_Q7s2T79WL0Rg9peagcgbm85_4AwciXePMOIPc Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 6bd1f655183e476da89067fcd0f1756a Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:27:24.059145 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:27:24.060620 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6bd1f655183e476da89067fcd0f1756a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6bd1f655183e476da89067fcd0f1756a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6bd1f655183e476da89067fcd0f1756a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6bd1f655183e476da89067fcd0f1756a"}]}] Jul 14 14:27:24.060620 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.060620 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 6bd1f655183e476da89067fcd0f1756a Jul 14 14:27:24.060620 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.060620 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-DeleteServersAdminTestJSON-659018202-project Jul 14 14:27:24.060620 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:24.060620 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:24.060620 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 2998f23059d446dcbea060ac2115b096 Jul 14 14:27:24.060620 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-DeleteServersAdminTestJSON-659018202-project Jul 14 14:27:24.060620 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:27:24.060620 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.060620 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '23efb1d0-4c73-471c-b109-75d53db07d0a'} Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:24.061436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.062560 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.065678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-68042af9-50c7-4bcf-8276-66d4b36831a9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Returning 404 to user: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-71576eba-092c-4cd4-9b62-a5ef1ad38ee2 tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Request method failure captured: Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CfJzSujCXeZ29utyBFQ6poRf7_sHdZyPVQREjUrYw4Vcevm9ixlt7GTkFx3Eu4SwFLSLJSvVnTYIhlhcJaj5Z2yBwS775xFvhYPHYmHI05wsg5vBOO9esl6QppB3aXditkvxhoy9EceMTF3Qg4AyAOgwcXGzkq-j8p2IuGEb6gKzZQ Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 615dd737344c407883afcfbe5f59a67f Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:24.065857 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/615dd737344c407883afcfbe5f59a67f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/615dd737344c407883afcfbe5f59a67f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_615dd737344c407883afcfbe5f59a67f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/615dd737344c407883afcfbe5f59a67f"}]}] Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 615dd737344c407883afcfbe5f59a67f Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HypervisorAdminNegativeTestJSON-619055593-project Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 81fb0753b413401dadfc12f4759af8e9 Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-619055593-project Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: action_args: {} Jul 14 14:27:24.067122 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:24.067999 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 14 14:27:24.069180 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.072389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-71576eba-092c-4cd4-9b62-a5ef1ad38ee2 tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:24.073770 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-71576eba-092c-4cd4-9b62-a5ef1ad38ee2 tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.032962 Jul 14 14:27:24.075250 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-68042af9-50c7-4bcf-8276-66d4b36831a9 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 404 len: 111 microversion: 2.1 time: 0.118148 Jul 14 14:27:24.076027 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 232/501] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:23 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:24.082964 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 270/502] 10.222.0.81 () {58 vars in 1178 bytes} [Thu Jul 14 14:27:24 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:24.095604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-641327c2-89a6-40fd-a568-fc4c68855575 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.097914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-641327c2-89a6-40fd-a568-fc4c68855575 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:24.107201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-641327c2-89a6-40fd-a568-fc4c68855575 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.107875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-641327c2-89a6-40fd-a568-fc4c68855575 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.109312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-641327c2-89a6-40fd-a568-fc4c68855575 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.109952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-641327c2-89a6-40fd-a568-fc4c68855575 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.235512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-41b5b491-0337-4fc0-bbbc-09314cd04035 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Calling method '.version_select at 0x7fd6c6555ee0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.236437 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:24.236437 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:24.237817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41b5b491-0337-4fc0-bbbc-09314cd04035 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.238343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41b5b491-0337-4fc0-bbbc-09314cd04035 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.285135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41b5b491-0337-4fc0-bbbc-09314cd04035 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.290058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41b5b491-0337-4fc0-bbbc-09314cd04035 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.320330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41b5b491-0337-4fc0-bbbc-09314cd04035 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.321124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41b5b491-0337-4fc0-bbbc-09314cd04035 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.330724 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-41b5b491-0337-4fc0-bbbc-09314cd04035 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.245078 Jul 14 14:27:24.332200 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 271/503] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:24 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:24.346287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b834e46-9ca6-4c06-af4d-33c6a2a9672c tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.355044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1b834e46-9ca6-4c06-af4d-33c6a2a9672c tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:24.363618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b834e46-9ca6-4c06-af4d-33c6a2a9672c tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.364534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b834e46-9ca6-4c06-af4d-33c6a2a9672c tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.365503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b834e46-9ca6-4c06-af4d-33c6a2a9672c tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.366092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b834e46-9ca6-4c06-af4d-33c6a2a9672c tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.398259 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-1b834e46-9ca6-4c06-af4d-33c6a2a9672c tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] HTTP exception thrown: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b834e46-9ca6-4c06-af4d-33c6a2a9672c tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Request method failure captured: Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a HTTP/1.1 Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CeDFkTGDtJCukPJWpXaEZf9q9MGTzuGaRyIuVXxPnmzWy0ehCkiFy2PSYE69E5I85uNYN7MxOgF_zHAmQskqru9J6cQAW_T77VEIMsvmCK2pnCfd90HswVBIqorHMCSBQUhsoNvp_Q7s2T79WL0Rg9peagcgbm85_4AwciXePMOIPc Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 6bd1f655183e476da89067fcd0f1756a Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:24.401271 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:24.402549 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6bd1f655183e476da89067fcd0f1756a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6bd1f655183e476da89067fcd0f1756a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6bd1f655183e476da89067fcd0f1756a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6bd1f655183e476da89067fcd0f1756a"}]}] Jul 14 14:27:24.402549 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.402549 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 6bd1f655183e476da89067fcd0f1756a Jul 14 14:27:24.402549 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.402549 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersAdminTestJSON-659018202-project Jul 14 14:27:24.402549 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:24.402549 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:24.402549 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 2998f23059d446dcbea060ac2115b096 Jul 14 14:27:24.402549 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersAdminTestJSON-659018202-project Jul 14 14:27:24.402549 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:27:24.402549 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.402549 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '23efb1d0-4c73-471c-b109-75d53db07d0a'} Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:24.403342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.404594 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.407886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b834e46-9ca6-4c06-af4d-33c6a2a9672c tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Returning 404 to user: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:24.409025 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1b834e46-9ca6-4c06-af4d-33c6a2a9672c tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "DELETE /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 404 len: 111 microversion: 2.1 time: 0.067346 Jul 14 14:27:24.409791 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 272/504] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:27:24 2022] DELETE /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:24.418883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-557eb862-080e-4c60-951b-0d8398e98662 req-e49135da-c6e2-47a5-ad16-17f27a8e0e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae081a7-42be-48bc-8677-d0cf09d35d44", "name": "network-vif-plugged", "status": "completed", "tag": "3f8c3da8-475e-4406-a1d0-02853d840025"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:24.433443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-557eb862-080e-4c60-951b-0d8398e98662 req-e49135da-c6e2-47a5-ad16-17f27a8e0e0a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.433973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-557eb862-080e-4c60-951b-0d8398e98662 req-e49135da-c6e2-47a5-ad16-17f27a8e0e0a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.449811 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-557eb862-080e-4c60-951b-0d8398e98662 req-e49135da-c6e2-47a5-ad16-17f27a8e0e0a service nova] Creating event network-vif-plugged:3f8c3da8-475e-4406-a1d0-02853d840025 for instance 6ae081a7-42be-48bc-8677-d0cf09d35d44 on n-h1-767704-28 Jul 14 14:27:24.460394 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-557eb862-080e-4c60-951b-0d8398e98662 req-e49135da-c6e2-47a5-ad16-17f27a8e0e0a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048469 Jul 14 14:27:24.462397 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 273/505] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:24.471300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5134776a-fd94-419e-b592-b75ead4e13bb tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Calling method '.version_select at 0x7fd6c610d550>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.473576 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:24.473576 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:24.476091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5134776a-fd94-419e-b592-b75ead4e13bb tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '81fb0753b413401dadfc12f4759af8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615dd737344c407883afcfbe5f59a67f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5134776a-fd94-419e-b592-b75ead4e13bb tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Request method failure captured: Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CfJzSujCXeZ29utyBFQ6poRf7_sHdZyPVQREjUrYw4Vcevm9ixlt7GTkFx3Eu4SwFLSLJSvVnTYIhlhcJaj5Z2yBwS775xFvhYPHYmHI05wsg5vBOO9esl6QppB3aXditkvxhoy9EceMTF3Qg4AyAOgwcXGzkq-j8p2IuGEb6gKzZQ Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 615dd737344c407883afcfbe5f59a67f Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:24.481199 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/615dd737344c407883afcfbe5f59a67f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/615dd737344c407883afcfbe5f59a67f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_615dd737344c407883afcfbe5f59a67f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/615dd737344c407883afcfbe5f59a67f"}]}] Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 615dd737344c407883afcfbe5f59a67f Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HypervisorAdminNegativeTestJSON-619055593-project Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 81fb0753b413401dadfc12f4759af8e9 Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-619055593-project Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '1'} Jul 14 14:27:24.482448 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:24.483294 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 14 14:27:24.484563 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.494359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5134776a-fd94-419e-b592-b75ead4e13bb tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:24.496192 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5134776a-fd94-419e-b592-b75ead4e13bb tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.031475 Jul 14 14:27:24.502076 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 274/506] 10.222.0.81 () {58 vars in 1172 bytes} [Thu Jul 14 14:27:24 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:24.503141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-925f5122-8799-4787-8210-60e38f67d83a tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.503919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-925f5122-8799-4787-8210-60e38f67d83a tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 23efb1d0-4c73-471c-b109-75d53db07d0a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:24.529387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-925f5122-8799-4787-8210-60e38f67d83a tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.529915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-925f5122-8799-4787-8210-60e38f67d83a tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.530753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-925f5122-8799-4787-8210-60e38f67d83a tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.534184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-925f5122-8799-4787-8210-60e38f67d83a tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.541522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-641327c2-89a6-40fd-a568-fc4c68855575 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:24.553508 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-641327c2-89a6-40fd-a568-fc4c68855575 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1311 microversion: 2.1 time: 0.471100 Jul 14 14:27:24.553618 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-925f5122-8799-4787-8210-60e38f67d83a tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] HTTP exception thrown: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.554109 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 233/507] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:24 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1311 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:24.572035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b23eb012-9aa2-4a1e-8619-b1bf9d1545ce tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Calling method '.version_select at 0x7fd6c61d7670>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.573458 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:24.573458 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-925f5122-8799-4787-8210-60e38f67d83a tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Request method failure captured: Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a HTTP/1.1 Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CeDFkTGDtJCukPJWpXaEZf9q9MGTzuGaRyIuVXxPnmzWy0ehCkiFy2PSYE69E5I85uNYN7MxOgF_zHAmQskqru9J6cQAW_T77VEIMsvmCK2pnCfd90HswVBIqorHMCSBQUhsoNvp_Q7s2T79WL0Rg9peagcgbm85_4AwciXePMOIPc Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 6bd1f655183e476da89067fcd0f1756a Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:24.575010 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:24.576304 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6bd1f655183e476da89067fcd0f1756a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6bd1f655183e476da89067fcd0f1756a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6bd1f655183e476da89067fcd0f1756a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6bd1f655183e476da89067fcd0f1756a"}]}] Jul 14 14:27:24.576304 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.576304 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 6bd1f655183e476da89067fcd0f1756a Jul 14 14:27:24.576304 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.576304 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersAdminTestJSON-659018202-project Jul 14 14:27:24.576304 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:24.576304 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:24.576304 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 2998f23059d446dcbea060ac2115b096 Jul 14 14:27:24.576304 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersAdminTestJSON-659018202-project Jul 14 14:27:24.576304 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:27:24.576304 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.576304 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '23efb1d0-4c73-471c-b109-75d53db07d0a'} Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:24.577194 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. Jul 14 14:27:24.578328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.579341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-925f5122-8799-4787-8210-60e38f67d83a tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Returning 404 to user: Instance 23efb1d0-4c73-471c-b109-75d53db07d0a could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:24.579341 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-925f5122-8799-4787-8210-60e38f67d83a tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a" status: 404 len: 111 microversion: 2.1 time: 0.078475 Jul 14 14:27:24.580919 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b23eb012-9aa2-4a1e-8619-b1bf9d1545ce tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] HTTP exception thrown: Hypervisor with ID '848d032d-78dd-4771-b4df-8315018e7317' could not be found. Jul 14 14:27:24.588067 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 275/508] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:24 2022] GET /compute/v2.1/servers/23efb1d0-4c73-471c-b109-75d53db07d0a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b23eb012-9aa2-4a1e-8619-b1bf9d1545ce tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Request method failure captured: Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-hypervisors/848d032d-78dd-4771-b4df-8315018e7317/uptime HTTP/1.1 Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CfLRDxmecQLYXqr9W62KDZajfgh0S3FcE5J28MnhSy3ieraFp-Pblu7Ri9wF7DsPi3W3j7CrgGwixqpSPNihoaPRXY3BHTWJgQIGrmaL0qvtWtxPmCgNFWgKfotNxawSU6oaMmfh-KdzsZbQmb28lmFJuUpcsRMs6iYH-a-RLffJmE Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 445662b92ca9450883936e12ec0410d5 Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1108654353 Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:27:24.591901 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:27:24.593574 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/445662b92ca9450883936e12ec0410d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/445662b92ca9450883936e12ec0410d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_445662b92ca9450883936e12ec0410d5", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/445662b92ca9450883936e12ec0410d5"}]}] Jul 14 14:27:24.593574 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1108654353 Jul 14 14:27:24.593574 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 445662b92ca9450883936e12ec0410d5 Jul 14 14:27:24.593574 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1108654353 Jul 14 14:27:24.593574 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin Jul 14 14:27:24.593574 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:24.593574 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:24.593574 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: c686327d4da649f581953f55dcdccdab Jul 14 14:27:24.593574 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin Jul 14 14:27:24.593574 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:27:24.593574 n-d-767704-28 devstack@n-api.service[119511]: exception: Hypervisor with ID '848d032d-78dd-4771-b4df-8315018e7317' could not be found. Jul 14 14:27:24.593574 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '848d032d-78dd-4771-b4df-8315018e7317'} Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '848d032d-78dd-4771-b4df-8315018e7317' Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 14 14:27:24.594673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '848d032d-78dd-4771-b4df-8315018e7317' could not be found. Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.596176 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.597436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.597436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.597436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.597436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:24.597436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:24.597436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '848d032d-78dd-4771-b4df-8315018e7317' could not be found. Jul 14 14:27:24.597436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.601029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18fa658e-74f0-4ca1-ac08-7866a66f588b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.601029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-18fa658e-74f0-4ca1-ac08-7866a66f588b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:24.603092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b23eb012-9aa2-4a1e-8619-b1bf9d1545ce tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Returning 404 to user: Hypervisor with ID '848d032d-78dd-4771-b4df-8315018e7317' could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:24.604265 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b23eb012-9aa2-4a1e-8619-b1bf9d1545ce tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/848d032d-78dd-4771-b4df-8315018e7317/uptime" status: 404 len: 123 microversion: 2.1 time: 0.049188 Jul 14 14:27:24.608644 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 234/509] 10.222.0.81 () {58 vars in 1277 bytes} [Thu Jul 14 14:27:24 2022] GET /compute/v2.1/os-hypervisors/848d032d-78dd-4771-b4df-8315018e7317/uptime => generated 123 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:24.614816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18fa658e-74f0-4ca1-ac08-7866a66f588b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.617992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18fa658e-74f0-4ca1-ac08-7866a66f588b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.621752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-481522c6-91e7-4894-959e-b11206e867e0 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Calling method '.version_select at 0x7fd6c61dc940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.622545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18fa658e-74f0-4ca1-ac08-7866a66f588b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.623350 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:24.623350 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:24.624117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18fa658e-74f0-4ca1-ac08-7866a66f588b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.624883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-481522c6-91e7-4894-959e-b11206e867e0 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.625527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-481522c6-91e7-4894-959e-b11206e867e0 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.659800 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-18fa658e-74f0-4ca1-ac08-7866a66f588b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] HTTP exception thrown: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18fa658e-74f0-4ca1-ac08-7866a66f588b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Request method failure captured: Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 HTTP/1.1 Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CeDFkTGDtJCukPJWpXaEZf9q9MGTzuGaRyIuVXxPnmzWy0ehCkiFy2PSYE69E5I85uNYN7MxOgF_zHAmQskqru9J6cQAW_T77VEIMsvmCK2pnCfd90HswVBIqorHMCSBQUhsoNvp_Q7s2T79WL0Rg9peagcgbm85_4AwciXePMOIPc Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 6bd1f655183e476da89067fcd0f1756a Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:24.661621 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:24.663111 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6bd1f655183e476da89067fcd0f1756a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6bd1f655183e476da89067fcd0f1756a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6bd1f655183e476da89067fcd0f1756a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6bd1f655183e476da89067fcd0f1756a"}]}] Jul 14 14:27:24.663111 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.663111 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 6bd1f655183e476da89067fcd0f1756a Jul 14 14:27:24.663111 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.663111 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersAdminTestJSON-659018202-project Jul 14 14:27:24.663111 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:24.663111 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:24.663111 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 2998f23059d446dcbea060ac2115b096 Jul 14 14:27:24.663111 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersAdminTestJSON-659018202-project Jul 14 14:27:24.663111 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:27:24.663111 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:27:24.663111 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6661f76a-906a-4e9a-b5a6-52cbd26679c7'} Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:24.664128 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:27:24.665755 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.673814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18fa658e-74f0-4ca1-ac08-7866a66f588b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Returning 404 to user: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:24.674016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-481522c6-91e7-4894-959e-b11206e867e0 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.675120 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-18fa658e-74f0-4ca1-ac08-7866a66f588b tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 404 len: 111 microversion: 2.1 time: 0.086158 Jul 14 14:27:24.675818 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 276/510] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:27:24 2022] DELETE /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:24.678923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-481522c6-91e7-4894-959e-b11206e867e0 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.684688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b1fb4e2-1c3c-4e3e-81a2-6ac91d5e6035 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.685546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b1fb4e2-1c3c-4e3e-81a2-6ac91d5e6035 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] [instance: 6661f76a-906a-4e9a-b5a6-52cbd26679c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:24.709502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-481522c6-91e7-4894-959e-b11206e867e0 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.713503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-481522c6-91e7-4894-959e-b11206e867e0 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.715474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b1fb4e2-1c3c-4e3e-81a2-6ac91d5e6035 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.716134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b1fb4e2-1c3c-4e3e-81a2-6ac91d5e6035 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.717153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b1fb4e2-1c3c-4e3e-81a2-6ac91d5e6035 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.717800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b1fb4e2-1c3c-4e3e-81a2-6ac91d5e6035 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.731676 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-481522c6-91e7-4894-959e-b11206e867e0 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.116456 Jul 14 14:27:24.734283 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 235/511] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:24 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:24.747056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a3701f53-ef19-4c56-bcc5-2b54e82deb8f tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Calling method '.version_select at 0x7fd6c62a85e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.747924 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:24.747924 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:24.750259 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-9b1fb4e2-1c3c-4e3e-81a2-6ac91d5e6035 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] HTTP exception thrown: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:27:24.751313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a3701f53-ef19-4c56-bcc5-2b54e82deb8f tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '81fb0753b413401dadfc12f4759af8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615dd737344c407883afcfbe5f59a67f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b1fb4e2-1c3c-4e3e-81a2-6ac91d5e6035 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Request method failure captured: Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 HTTP/1.1 Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CeDFkTGDtJCukPJWpXaEZf9q9MGTzuGaRyIuVXxPnmzWy0ehCkiFy2PSYE69E5I85uNYN7MxOgF_zHAmQskqru9J6cQAW_T77VEIMsvmCK2pnCfd90HswVBIqorHMCSBQUhsoNvp_Q7s2T79WL0Rg9peagcgbm85_4AwciXePMOIPc Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 6bd1f655183e476da89067fcd0f1756a Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:24.754363 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:24.755665 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6bd1f655183e476da89067fcd0f1756a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6bd1f655183e476da89067fcd0f1756a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6bd1f655183e476da89067fcd0f1756a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6bd1f655183e476da89067fcd0f1756a"}]}] Jul 14 14:27:24.755665 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.755665 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 6bd1f655183e476da89067fcd0f1756a Jul 14 14:27:24.755665 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-659018202 Jul 14 14:27:24.755665 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersAdminTestJSON-659018202-project Jul 14 14:27:24.755665 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:24.755665 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:24.755665 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 2998f23059d446dcbea060ac2115b096 Jul 14 14:27:24.755665 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersAdminTestJSON-659018202-project Jul 14 14:27:24.755665 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:27:24.755665 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:27:24.755665 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6661f76a-906a-4e9a-b5a6-52cbd26679c7'} Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:24.756343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. Jul 14 14:27:24.759959 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.762349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b1fb4e2-1c3c-4e3e-81a2-6ac91d5e6035 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] Returning 404 to user: Instance 6661f76a-906a-4e9a-b5a6-52cbd26679c7 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:24.762349 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9b1fb4e2-1c3c-4e3e-81a2-6ac91d5e6035 tempest-DeleteServersAdminTestJSON-659018202 tempest-DeleteServersAdminTestJSON-659018202-project] 10.222.0.81 "GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7" status: 404 len: 111 microversion: 2.1 time: 0.075018 Jul 14 14:27:24.763331 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 277/512] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:24 2022] GET /compute/v2.1/servers/6661f76a-906a-4e9a-b5a6-52cbd26679c7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a3701f53-ef19-4c56-bcc5-2b54e82deb8f tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Request method failure captured: Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CfJzSujCXeZ29utyBFQ6poRf7_sHdZyPVQREjUrYw4Vcevm9ixlt7GTkFx3Eu4SwFLSLJSvVnTYIhlhcJaj5Z2yBwS775xFvhYPHYmHI05wsg5vBOO9esl6QppB3aXditkvxhoy9EceMTF3Qg4AyAOgwcXGzkq-j8p2IuGEb6gKzZQ Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 615dd737344c407883afcfbe5f59a67f Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:27:24.765887 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/615dd737344c407883afcfbe5f59a67f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/615dd737344c407883afcfbe5f59a67f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_615dd737344c407883afcfbe5f59a67f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/615dd737344c407883afcfbe5f59a67f"}]}] Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 615dd737344c407883afcfbe5f59a67f Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-619055593 Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-HypervisorAdminNegativeTestJSON-619055593-project Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 81fb0753b413401dadfc12f4759af8e9 Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-619055593-project Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '1'} Jul 14 14:27:24.769096 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:24.770793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 14 14:27:24.776131 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.783969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a3701f53-ef19-4c56-bcc5-2b54e82deb8f tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:24.783969 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a3701f53-ef19-4c56-bcc5-2b54e82deb8f tempest-HypervisorAdminNegativeTestJSON-619055593 tempest-HypervisorAdminNegativeTestJSON-619055593-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.036305 Jul 14 14:27:24.783969 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 236/513] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:27:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:27:24.787045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b24c1e00-5e42-4cf6-8ce6-a6de97b01dd4 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Calling method '.version_select at 0x7fd6c610d550>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.788036 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:24.788036 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:24.789009 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-b24c1e00-5e42-4cf6-8ce6-a6de97b01dd4 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] HTTP exception thrown: Hypervisor with ID 'af44ca65-989c-40ea-a8cf-4cdf5be484af' could not be found. Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b24c1e00-5e42-4cf6-8ce6-a6de97b01dd4 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Request method failure captured: Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hypervisors/af44ca65-989c-40ea-a8cf-4cdf5be484af HTTP/1.1 Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CfLRDxmecQLYXqr9W62KDZajfgh0S3FcE5J28MnhSy3ieraFp-Pblu7Ri9wF7DsPi3W3j7CrgGwixqpSPNihoaPRXY3BHTWJgQIGrmaL0qvtWtxPmCgNFWgKfotNxawSU6oaMmfh-KdzsZbQmb28lmFJuUpcsRMs6iYH-a-RLffJmE Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 445662b92ca9450883936e12ec0410d5 Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1108654353 Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:27:24.791429 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:27:24.792688 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/445662b92ca9450883936e12ec0410d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/445662b92ca9450883936e12ec0410d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_445662b92ca9450883936e12ec0410d5", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/445662b92ca9450883936e12ec0410d5"}]}] Jul 14 14:27:24.792688 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1108654353 Jul 14 14:27:24.792688 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 445662b92ca9450883936e12ec0410d5 Jul 14 14:27:24.792688 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1108654353 Jul 14 14:27:24.792688 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin Jul 14 14:27:24.792688 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:24.792688 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:24.792688 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: c686327d4da649f581953f55dcdccdab Jul 14 14:27:24.792688 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin Jul 14 14:27:24.792688 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:24.792688 n-d-767704-28 devstack@n-api.service[119512]: exception: Hypervisor with ID 'af44ca65-989c-40ea-a8cf-4cdf5be484af' could not be found. Jul 14 14:27:24.792688 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'af44ca65-989c-40ea-a8cf-4cdf5be484af'} Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'af44ca65-989c-40ea-a8cf-4cdf5be484af' Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 14 14:27:24.798958 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:27:24.801380 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'af44ca65-989c-40ea-a8cf-4cdf5be484af' could not be found. Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'af44ca65-989c-40ea-a8cf-4cdf5be484af' could not be found. Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b24c1e00-5e42-4cf6-8ce6-a6de97b01dd4 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] Returning 404 to user: Hypervisor with ID 'af44ca65-989c-40ea-a8cf-4cdf5be484af' could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b24c1e00-5e42-4cf6-8ce6-a6de97b01dd4 tempest-HypervisorAdminNegativeTestJSON-1108654353 tempest-HypervisorAdminNegativeTestJSON-1108654353-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/af44ca65-989c-40ea-a8cf-4cdf5be484af" status: 404 len: 123 microversion: 2.1 time: 0.010717 Jul 14 14:27:24.802638 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 278/514] 10.222.0.81 () {58 vars in 1256 bytes} [Thu Jul 14 14:27:24 2022] GET /compute/v2.1/os-hypervisors/af44ca65-989c-40ea-a8cf-4cdf5be484af => generated 123 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:24.872679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ceebea56-64b7-4d60-a7b2-04f90fa105b7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:24.873325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ceebea56-64b7-4d60-a7b2-04f90fa105b7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:24.883210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ceebea56-64b7-4d60-a7b2-04f90fa105b7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.884076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ceebea56-64b7-4d60-a7b2-04f90fa105b7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:24.885244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ceebea56-64b7-4d60-a7b2-04f90fa105b7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:24.885839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ceebea56-64b7-4d60-a7b2-04f90fa105b7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:25.057960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-54642144-7b8d-4043-9034-75a73f8554fa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:25.059022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-54642144-7b8d-4043-9034-75a73f8554fa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:25.073881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54642144-7b8d-4043-9034-75a73f8554fa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:25.074991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54642144-7b8d-4043-9034-75a73f8554fa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:25.075794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54642144-7b8d-4043-9034-75a73f8554fa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:25.076237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54642144-7b8d-4043-9034-75a73f8554fa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:25.668800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ceebea56-64b7-4d60-a7b2-04f90fa105b7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:25.672361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:25.692371 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ceebea56-64b7-4d60-a7b2-04f90fa105b7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1471 microversion: 2.1 time: 0.826729 Jul 14 14:27:25.697065 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 237/515] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:24 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1471 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:25.708152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-afbb0dc4-c54d-47e8-bbd3-9f41b37bb065 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:25.715251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-afbb0dc4-c54d-47e8-bbd3-9f41b37bb065 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:25.734455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-afbb0dc4-c54d-47e8-bbd3-9f41b37bb065 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:25.740437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-afbb0dc4-c54d-47e8-bbd3-9f41b37bb065 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:25.741943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-afbb0dc4-c54d-47e8-bbd3-9f41b37bb065 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:25.742962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-afbb0dc4-c54d-47e8-bbd3-9f41b37bb065 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:25.866029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-54642144-7b8d-4043-9034-75a73f8554fa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:25.882397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-54642144-7b8d-4043-9034-75a73f8554fa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:25.885259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-54642144-7b8d-4043-9034-75a73f8554fa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:25.888271 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-54642144-7b8d-4043-9034-75a73f8554fa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1569 microversion: 2.25 time: 0.835191 Jul 14 14:27:25.889795 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 279/516] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:25 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1569 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:27:26.091163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1df21f74-b230-4a01-9c21-3a8f330dfe82 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] Calling method '.version_select at 0x7fd6c610d8b0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:26.460705 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1df21f74-b230-4a01-9c21-3a8f330dfe82 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.569539 Jul 14 14:27:26.461850 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 280/517] 10.222.0.81 () {58 vars in 1148 bytes} [Thu Jul 14 14:27:25 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:27:26.474423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9c5f40f8-7b15-4934-a8d5-da6641410403 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] Action: 'create', calling method: .version_select at 0x7fd6c61d89d0>, body: {"pool": "non_exist_pool"} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:26.482233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-afbb0dc4-c54d-47e8-bbd3-9f41b37bb065 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:26.494726 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-afbb0dc4-c54d-47e8-bbd3-9f41b37bb065 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1311 microversion: 2.1 time: 0.795852 Jul 14 14:27:26.495319 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 238/518] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:25 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1311 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:26.541899 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-9c5f40f8-7b15-4934-a8d5-da6641410403 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] HTTP exception thrown: Floating IP pool not found. Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9c5f40f8-7b15-4934-a8d5-da6641410403 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] Request method failure captured: Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 26 Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CfNDF2PW3msWCXK0cozrdDfbOGFFQIktF9dwRjwoH_4MWXcNeZANcb1ZPl76tgGYBsC_olaHzkvrNNd4yikmZZRdsz_JA_KBIboL6XJpY51Z-8znbt382t8nj3YFis0XYmII-jVnUR2XdV80HdzNnXY9yREo0ldfjA9MN61tfBeKe0 Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 70072abf2b0341378dd8e2f01c8527f0 Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1685953476 Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:26.545549 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70072abf2b0341378dd8e2f01c8527f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70072abf2b0341378dd8e2f01c8527f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70072abf2b0341378dd8e2f01c8527f0", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70072abf2b0341378dd8e2f01c8527f0"}]}] Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1685953476 Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 70072abf2b0341378dd8e2f01c8527f0 Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1685953476 Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-FloatingIPsNegativeTestJSON-1685953476-project Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: de703e2a4c914d8fb974d00476875dd7 Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1685953476-project Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: {"pool": "non_exist_pool"} Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: exception: Floating IP pool not found. Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 14 14:27:26.547260 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:26.548343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 14 14:27:26.549522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:26.551495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9c5f40f8-7b15-4934-a8d5-da6641410403 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] Returning 404 to user: Floating IP pool not found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:26.552737 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9c5f40f8-7b15-4934-a8d5-da6641410403 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.082187 Jul 14 14:27:26.553541 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 281/519] 10.222.0.81 () {60 vars in 1169 bytes} [Thu Jul 14 14:27:26 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:27:26.564764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-79328172-4ac3-4afe-b230-eec32e165803 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] Calling method '.version_select at 0x7fd6c61ded30>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:26.693711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-79328172-4ac3-4afe-b230-eec32e165803 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 73fd579e-7a1b-4720-9403-093cd8e80c03 could not be found", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:27:26.697404 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-79328172-4ac3-4afe-b230-eec32e165803 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] HTTP exception thrown: Floating IP not found for ID 73fd579e-7a1b-4720-9403-093cd8e80c03 Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-79328172-4ac3-4afe-b230-eec32e165803 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] Request method failure captured: Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-floating-ips/73fd579e-7a1b-4720-9403-093cd8e80c03 HTTP/1.1 Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CfNDF2PW3msWCXK0cozrdDfbOGFFQIktF9dwRjwoH_4MWXcNeZANcb1ZPl76tgGYBsC_olaHzkvrNNd4yikmZZRdsz_JA_KBIboL6XJpY51Z-8znbt382t8nj3YFis0XYmII-jVnUR2XdV80HdzNnXY9yREo0ldfjA9MN61tfBeKe0 Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 70072abf2b0341378dd8e2f01c8527f0 Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1685953476 Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:27:26.714285 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70072abf2b0341378dd8e2f01c8527f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/70072abf2b0341378dd8e2f01c8527f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_70072abf2b0341378dd8e2f01c8527f0", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/70072abf2b0341378dd8e2f01c8527f0"}]}] Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1685953476 Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 70072abf2b0341378dd8e2f01c8527f0 Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1685953476 Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FloatingIPsNegativeTestJSON-1685953476-project Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: de703e2a4c914d8fb974d00476875dd7 Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1685953476-project Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: exception: Floating IP not found for ID 73fd579e-7a1b-4720-9403-093cd8e80c03 Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '73fd579e-7a1b-4720-9403-093cd8e80c03'} Jul 14 14:27:26.715849 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:27:26.716587 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 73fd579e-7a1b-4720-9403-093cd8e80c03 could not be found Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4ee3248-9ede-4a74-88c7-cc21eb092091'] Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 73fd579e-7a1b-4720-9403-093cd8e80c03. Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:26.717732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 73fd579e-7a1b-4720-9403-093cd8e80c03 Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:26.719180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:26.720364 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 73fd579e-7a1b-4720-9403-093cd8e80c03 Jul 14 14:27:26.720364 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:26.720604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-735824f7-4a1a-4a42-835d-6819a3298156 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:26.720604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-735824f7-4a1a-4a42-835d-6819a3298156 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:26.723622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-79328172-4ac3-4afe-b230-eec32e165803 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] Returning 404 to user: Floating IP not found for ID 73fd579e-7a1b-4720-9403-093cd8e80c03 {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:26.724762 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-79328172-4ac3-4afe-b230-eec32e165803 tempest-FloatingIPsNegativeTestJSON-1685953476 tempest-FloatingIPsNegativeTestJSON-1685953476-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/73fd579e-7a1b-4720-9403-093cd8e80c03" status: 404 len: 111 microversion: 2.1 time: 0.164572 Jul 14 14:27:26.728707 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 239/520] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:27:26 2022] DELETE /compute/v2.1/os-floating-ips/73fd579e-7a1b-4720-9403-093cd8e80c03 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:26.738060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-735824f7-4a1a-4a42-835d-6819a3298156 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:26.739978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-735824f7-4a1a-4a42-835d-6819a3298156 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:26.741940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-735824f7-4a1a-4a42-835d-6819a3298156 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:26.743802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-735824f7-4a1a-4a42-835d-6819a3298156 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:26.912672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-113e8493-1e6f-486a-9c05-de5a760e1c48 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:26.914631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-113e8493-1e6f-486a-9c05-de5a760e1c48 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:26.931238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-113e8493-1e6f-486a-9c05-de5a760e1c48 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:26.935710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-113e8493-1e6f-486a-9c05-de5a760e1c48 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:26.938958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-113e8493-1e6f-486a-9c05-de5a760e1c48 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:26.939706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-113e8493-1e6f-486a-9c05-de5a760e1c48 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:27.163298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-735824f7-4a1a-4a42-835d-6819a3298156 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:27.172995 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-735824f7-4a1a-4a42-835d-6819a3298156 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1471 microversion: 2.1 time: 0.460290 Jul 14 14:27:27.173582 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 282/521] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:26 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1471 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:27:27.356299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-113e8493-1e6f-486a-9c05-de5a760e1c48 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:27.368513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-113e8493-1e6f-486a-9c05-de5a760e1c48 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:27.371718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-113e8493-1e6f-486a-9c05-de5a760e1c48 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:27.378535 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-113e8493-1e6f-486a-9c05-de5a760e1c48 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1569 microversion: 2.25 time: 0.475309 Jul 14 14:27:27.379423 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 240/522] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:26 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1569 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:27:27.514623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5d2d84c2-bb3e-4a45-b5a2-23d006d6928a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:27.515061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5d2d84c2-bb3e-4a45-b5a2-23d006d6928a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:27.521762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d2d84c2-bb3e-4a45-b5a2-23d006d6928a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:27.522222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d2d84c2-bb3e-4a45-b5a2-23d006d6928a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:27.533104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d2d84c2-bb3e-4a45-b5a2-23d006d6928a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:27.533545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d2d84c2-bb3e-4a45-b5a2-23d006d6928a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:27.911159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5d2d84c2-bb3e-4a45-b5a2-23d006d6928a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:27.920454 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5d2d84c2-bb3e-4a45-b5a2-23d006d6928a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1493 microversion: 2.1 time: 0.412499 Jul 14 14:27:27.921074 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 283/523] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:27 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1493 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:28.191428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1df4dc79-3f36-4901-a9e4-c81735300365 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:28.192066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1df4dc79-3f36-4901-a9e4-c81735300365 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:28.202016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1df4dc79-3f36-4901-a9e4-c81735300365 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:28.202516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1df4dc79-3f36-4901-a9e4-c81735300365 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:28.203340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1df4dc79-3f36-4901-a9e4-c81735300365 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:28.203786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1df4dc79-3f36-4901-a9e4-c81735300365 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:28.506564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-62d69ac1-a7ee-47dc-9ceb-2322de6cc528 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:28.508072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-62d69ac1-a7ee-47dc-9ceb-2322de6cc528 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:28.528622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62d69ac1-a7ee-47dc-9ceb-2322de6cc528 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:28.529055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62d69ac1-a7ee-47dc-9ceb-2322de6cc528 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:28.529908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62d69ac1-a7ee-47dc-9ceb-2322de6cc528 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:28.530292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62d69ac1-a7ee-47dc-9ceb-2322de6cc528 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:28.895492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1df4dc79-3f36-4901-a9e4-c81735300365 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:28.909656 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1df4dc79-3f36-4901-a9e4-c81735300365 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1471 microversion: 2.1 time: 0.722136 Jul 14 14:27:28.921315 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 284/524] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:28 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1471 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:28.921315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd0e3454-5e0c-48c2-afcc-489e6090738c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:28.921315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bd0e3454-5e0c-48c2-afcc-489e6090738c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:28.962583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd0e3454-5e0c-48c2-afcc-489e6090738c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:28.963136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd0e3454-5e0c-48c2-afcc-489e6090738c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:28.964757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd0e3454-5e0c-48c2-afcc-489e6090738c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:28.965670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd0e3454-5e0c-48c2-afcc-489e6090738c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:29.002551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:29.010845 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-62d69ac1-a7ee-47dc-9ceb-2322de6cc528 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1646 microversion: 2.1 time: 1.075433 Jul 14 14:27:29.021244 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 241/525] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:27 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1646 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:29.030299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7db78192-32d2-4393-b6cf-1123783fe39e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:29.030912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7db78192-32d2-4393-b6cf-1123783fe39e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:29.049828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7db78192-32d2-4393-b6cf-1123783fe39e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:29.050541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7db78192-32d2-4393-b6cf-1123783fe39e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:29.051479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7db78192-32d2-4393-b6cf-1123783fe39e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:29.052071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7db78192-32d2-4393-b6cf-1123783fe39e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:29.632486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bd0e3454-5e0c-48c2-afcc-489e6090738c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:29.636645 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7db78192-32d2-4393-b6cf-1123783fe39e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1646 microversion: 2.1 time: 0.610242 Jul 14 14:27:29.649499 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 242/526] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:29 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1646 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:27:29.657313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bd0e3454-5e0c-48c2-afcc-489e6090738c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:29.658864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-779ed4cc-e089-455c-905c-c378e8318708 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:29.659499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bd0e3454-5e0c-48c2-afcc-489e6090738c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:29.660225 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:29.660225 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:29.661314 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bd0e3454-5e0c-48c2-afcc-489e6090738c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1569 microversion: 2.25 time: 0.746857 Jul 14 14:27:29.661952 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 285/527] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:28 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1569 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:29.673198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-779ed4cc-e089-455c-905c-c378e8318708 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:29.673198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-779ed4cc-e089-455c-905c-c378e8318708 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:29.673198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-779ed4cc-e089-455c-905c-c378e8318708 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:29.673198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-779ed4cc-e089-455c-905c-c378e8318708 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:29.709717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:29.740439 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-779ed4cc-e089-455c-905c-c378e8318708 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.085922 Jul 14 14:27:29.741885 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 243/528] 10.222.0.81 () {58 vars in 1175 bytes} [Thu Jul 14 14:27:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:29.756990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d3dcb065-41bd-4e28-9ddd-04d08150d8d1 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-767704-28", "block_migration": true, "disk_over_commit": false}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:29.759465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d3dcb065-41bd-4e28-9ddd-04d08150d8d1 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:29.770942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d3dcb065-41bd-4e28-9ddd-04d08150d8d1 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:29.773387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d3dcb065-41bd-4e28-9ddd-04d08150d8d1 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:29.774828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d3dcb065-41bd-4e28-9ddd-04d08150d8d1 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:29.778100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d3dcb065-41bd-4e28-9ddd-04d08150d8d1 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:29.966701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-d3dcb065-41bd-4e28-9ddd-04d08150d8d1 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lazy-loading 'flavor' on Instance uuid 6ae081a7-42be-48bc-8677-d0cf09d35d44 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:30.103449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d3dcb065-41bd-4e28-9ddd-04d08150d8d1 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Going to try to live migrate instance to n-h2-767704-28 {{(pid=119512) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:27:30.481547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-92ec7cc7-6f18-4e40-91ac-f174e9ef8728 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1307310112", "id": 1683848406, "os-flavor-access:is_public": "True"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:30.484666 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:30.484666 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:30.524679 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-92ec7cc7-6f18-4e40-91ac-f174e9ef8728 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.644142 Jul 14 14:27:30.526868 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 244/529] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:29 2022] POST /compute/v2.1/flavors => generated 430 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:27:30.542605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80b7a6e6-0e32-42a0-94ee-0bc6e721eae0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:30.543255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80b7a6e6-0e32-42a0-94ee-0bc6e721eae0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:30.550271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80b7a6e6-0e32-42a0-94ee-0bc6e721eae0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:30.550975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80b7a6e6-0e32-42a0-94ee-0bc6e721eae0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:30.552456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80b7a6e6-0e32-42a0-94ee-0bc6e721eae0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:30.553087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80b7a6e6-0e32-42a0-94ee-0bc6e721eae0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:30.939048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-80b7a6e6-0e32-42a0-94ee-0bc6e721eae0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:30.949593 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80b7a6e6-0e32-42a0-94ee-0bc6e721eae0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.420435 Jul 14 14:27:30.950162 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 245/530] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:30 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:30.976631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f64f8785-a241-44b7-93f3-b12429978b11 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:30.980437 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:30.980437 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:31.042359 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f64f8785-a241-44b7-93f3-b12429978b11 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1683848406" status: 202 len: 0 microversion: 2.1 time: 0.073749 Jul 14 14:27:31.042889 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 246/531] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 14:27:30 2022] DELETE /compute/v2.1/flavors/1683848406 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:31.047992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-874b3684-d4fa-4525-9bbb-b2d52febfa97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:31.048856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-874b3684-d4fa-4525-9bbb-b2d52febfa97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:31.064361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-874b3684-d4fa-4525-9bbb-b2d52febfa97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:31.064813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-874b3684-d4fa-4525-9bbb-b2d52febfa97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:31.067969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-874b3684-d4fa-4525-9bbb-b2d52febfa97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:31.071348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-874b3684-d4fa-4525-9bbb-b2d52febfa97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:31.501099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-874b3684-d4fa-4525-9bbb-b2d52febfa97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:31.513185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-874b3684-d4fa-4525-9bbb-b2d52febfa97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:31.514627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-874b3684-d4fa-4525-9bbb-b2d52febfa97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:31.532235 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-874b3684-d4fa-4525-9bbb-b2d52febfa97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1569 microversion: 2.25 time: 0.488012 Jul 14 14:27:31.533471 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 247/532] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:31 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1569 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:31.538373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ba709eba-56ce-458a-a716-b3ee0d4d5afd req-c1347acb-6497-45ea-a04f-a3b84df56602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88426cdc-557a-4724-9ef2-d84d32b4191d", "name": "network-vif-unplugged", "status": "completed", "tag": "5671e97e-1f32-49f5-aea1-ca6152f537d3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:31.571362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ba709eba-56ce-458a-a716-b3ee0d4d5afd req-c1347acb-6497-45ea-a04f-a3b84df56602 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:31.571751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ba709eba-56ce-458a-a716-b3ee0d4d5afd req-c1347acb-6497-45ea-a04f-a3b84df56602 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:31.632141 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ba709eba-56ce-458a-a716-b3ee0d4d5afd req-c1347acb-6497-45ea-a04f-a3b84df56602 service nova] Creating event network-vif-unplugged:5671e97e-1f32-49f5-aea1-ca6152f537d3 for instance 88426cdc-557a-4724-9ef2-d84d32b4191d on n-h2-767704-28 Jul 14 14:27:31.645097 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ba709eba-56ce-458a-a716-b3ee0d4d5afd req-c1347acb-6497-45ea-a04f-a3b84df56602 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110095 Jul 14 14:27:31.645701 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 248/533] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:31.662033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-32abfbaf-54a9-48f3-aa4f-27c77925bf64 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:31.707668 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-32abfbaf-54a9-48f3-aa4f-27c77925bf64 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.060393 Jul 14 14:27:31.708347 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 249/534] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:31 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:31.973169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-870ed325-f391-4202-9cea-4657599b8dea tempest-QuotaClassesAdminTestJSON-1639399940 tempest-QuotaClassesAdminTestJSON-1639399940-project-admin] Calling method '.version_select at 0x7fd6c5f9a430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:31.974345 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:31.974345 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:31.996211 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-870ed325-f391-4202-9cea-4657599b8dea tempest-QuotaClassesAdminTestJSON-1639399940 tempest-QuotaClassesAdminTestJSON-1639399940-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.286601 Jul 14 14:27:31.997396 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 250/535] 10.222.0.81 () {58 vars in 1184 bytes} [Thu Jul 14 14:27:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:32.002133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4e14595-41d2-421c-a986-593a76215e4c tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1993712317", "id": 1698837897, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:32.004352 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:32.004352 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:32.025720 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b4e14595-41d2-421c-a986-593a76215e4c tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.026736 Jul 14 14:27:32.026570 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 251/536] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:31 2022] POST /compute/v2.1/flavors => generated 417 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:32.031616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-47b89dbd-f768-4f5f-8698-f52c76dbbab3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:32.032571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-47b89dbd-f768-4f5f-8698-f52c76dbbab3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:32.041232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47b89dbd-f768-4f5f-8698-f52c76dbbab3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:32.041965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47b89dbd-f768-4f5f-8698-f52c76dbbab3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:32.042912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47b89dbd-f768-4f5f-8698-f52c76dbbab3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:32.043508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47b89dbd-f768-4f5f-8698-f52c76dbbab3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:32.202184 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d3dcb065-41bd-4e28-9ddd-04d08150d8d1 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44/action" status: 202 len: 0 microversion: 2.1 time: 2.452459 Jul 14 14:27:32.207375 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 286/537] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:27:29 2022] POST /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44/action => generated 0 bytes in 2458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:32.214798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-51bae5d1-51af-404d-a59e-e83d71aa60c8 tempest-QuotaClassesAdminTestJSON-1639399940 tempest-QuotaClassesAdminTestJSON-1639399940-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c638a670>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:32.217287 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:32.217287 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:32.265423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:32.358521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-47b89dbd-f768-4f5f-8698-f52c76dbbab3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:32.369363 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-47b89dbd-f768-4f5f-8698-f52c76dbbab3 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.339632 Jul 14 14:27:32.369999 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 252/538] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:32 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:32.378509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-11c1429f-363b-4ca4-a863-124fe2a1e0b7 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:32.411787 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-11c1429f-363b-4ca4-a863-124fe2a1e0b7 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 6222 microversion: 2.1 time: 0.038239 Jul 14 14:27:32.422956 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 253/539] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:32 2022] GET /compute/v2.1/flavors/detail => generated 6222 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:32.428162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d581d92e-b179-4dda-b100-457f784cc828 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:32.429192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d581d92e-b179-4dda-b100-457f784cc828 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:32.463466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d581d92e-b179-4dda-b100-457f784cc828 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:32.514523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d581d92e-b179-4dda-b100-457f784cc828 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:32.531353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d581d92e-b179-4dda-b100-457f784cc828 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:32.533037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d581d92e-b179-4dda-b100-457f784cc828 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:32.939488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d581d92e-b179-4dda-b100-457f784cc828 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:32.952513 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d581d92e-b179-4dda-b100-457f784cc828 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1503 microversion: 2.1 time: 0.524903 Jul 14 14:27:32.962776 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 254/540] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:32 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1503 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:32.979097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b5bd5f6a-54d6-4e36-966d-2584913bcab5 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:32.979973 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:32.979973 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:33.018546 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b5bd5f6a-54d6-4e36-966d-2584913bcab5 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1698837897" status: 202 len: 0 microversion: 2.1 time: 0.063367 Jul 14 14:27:33.039129 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 255/541] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 14:27:32 2022] DELETE /compute/v2.1/flavors/1698837897 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:33.053957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-12856fdf-3e78-4d92-bd28-fe57e899d370 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:33.061106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-12856fdf-3e78-4d92-bd28-fe57e899d370 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:33.089404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-12856fdf-3e78-4d92-bd28-fe57e899d370 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:33.089942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-12856fdf-3e78-4d92-bd28-fe57e899d370 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:33.090782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-12856fdf-3e78-4d92-bd28-fe57e899d370 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:33.091235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-12856fdf-3e78-4d92-bd28-fe57e899d370 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:33.196671 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-51bae5d1-51af-404d-a59e-e83d71aa60c8 tempest-QuotaClassesAdminTestJSON-1639399940 tempest-QuotaClassesAdminTestJSON-1639399940-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.987328 Jul 14 14:27:33.210516 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 287/542] 10.222.0.81 () {60 vars in 1205 bytes} [Thu Jul 14 14:27:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:33.216540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8cbd181-9253-4b63-a76e-8d43d94612fb tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:33.250362 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8cbd181-9253-4b63-a76e-8d43d94612fb tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.037420 Jul 14 14:27:33.261790 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 288/543] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:33 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:33.268713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c66e1984-5b5e-473b-a6e1-9e5078505c0e tempest-QuotaClassesAdminTestJSON-1639399940 tempest-QuotaClassesAdminTestJSON-1639399940-project-admin] Calling method '.version_select at 0x7fd6c5f67940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:33.269807 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:33.269807 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:33.288310 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c66e1984-5b5e-473b-a6e1-9e5078505c0e tempest-QuotaClassesAdminTestJSON-1639399940 tempest-QuotaClassesAdminTestJSON-1639399940-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.025225 Jul 14 14:27:33.296606 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 289/544] 10.222.0.81 () {58 vars in 1184 bytes} [Thu Jul 14 14:27:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:33.324267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bafce014-e3a6-4c28-9fdf-697e6a7ba508 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-575703972", "id": 25608111, "os-flavor-access:is_public": "True"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:33.326230 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:33.326230 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:33.373959 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bafce014-e3a6-4c28-9fdf-697e6a7ba508 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.073095 Jul 14 14:27:33.385370 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 290/545] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:33 2022] POST /compute/v2.1/flavors => generated 422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:33.400912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7675a61b-0853-4942-926c-68a543c257c4 tempest-QuotaClassesAdminTestJSON-1639399940 tempest-QuotaClassesAdminTestJSON-1639399940-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c5fc41f0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:33.476068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-12856fdf-3e78-4d92-bd28-fe57e899d370 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:33.516165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-12856fdf-3e78-4d92-bd28-fe57e899d370 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:33.518741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-12856fdf-3e78-4d92-bd28-fe57e899d370 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:33.520649 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-12856fdf-3e78-4d92-bd28-fe57e899d370 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1569 microversion: 2.25 time: 0.478494 Jul 14 14:27:33.521691 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 256/546] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:33 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1569 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:33.547004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8c27987-7932-4ce0-be69-f2c27016bf33 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:33.551674 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:33.551674 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:33.597928 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b8c27987-7932-4ce0-be69-f2c27016bf33 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/25608111" status: 202 len: 0 microversion: 2.1 time: 0.070382 Jul 14 14:27:33.602671 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 257/547] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:27:33 2022] DELETE /compute/v2.1/flavors/25608111 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:33.615674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-412821da-8fa2-44c8-b4bc-b3df0500b091 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:33.618675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-412821da-8fa2-44c8-b4bc-b3df0500b091 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:33.638919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-412821da-8fa2-44c8-b4bc-b3df0500b091 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:33.639966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-412821da-8fa2-44c8-b4bc-b3df0500b091 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:33.641073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-412821da-8fa2-44c8-b4bc-b3df0500b091 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:33.645492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-412821da-8fa2-44c8-b4bc-b3df0500b091 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:33.715863 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7675a61b-0853-4942-926c-68a543c257c4 tempest-QuotaClassesAdminTestJSON-1639399940 tempest-QuotaClassesAdminTestJSON-1639399940-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.328490 Jul 14 14:27:33.717334 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 291/548] 10.222.0.81 () {60 vars in 1205 bytes} [Thu Jul 14 14:27:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:33.739222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4e18d1e6-2e35-4821-bee0-6f76edff3a1e tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:33.787941 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4e18d1e6-2e35-4821-bee0-6f76edff3a1e tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.068673 Jul 14 14:27:33.790055 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 292/549] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:33 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:33.816050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-21be4677-2b6f-43be-933d-f71d6dada453 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-830429865", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:33.861914 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-21be4677-2b6f-43be-933d-f71d6dada453 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.054821 Jul 14 14:27:33.873167 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 293/550] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:33 2022] POST /compute/v2.1/flavors => generated 506 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:33.883951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-90b2f0a7-2a51-48a6-b5a5-c042bcaf8123 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:33.886371 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:33.886371 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:33.910195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:INSERT=14,nova_api:SELECT=63,nova_api:UPDATE=23 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:33.919247 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-90b2f0a7-2a51-48a6-b5a5-c042bcaf8123 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/0f5d8534-e1cd-4a39-afad-5590063886d7" status: 202 len: 0 microversion: 2.1 time: 0.043517 Jul 14 14:27:33.923953 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 294/551] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:27:33 2022] DELETE /compute/v2.1/flavors/0f5d8534-e1cd-4a39-afad-5590063886d7 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:27:33.939465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c3e3655e-05f0-443b-b1e4-1fe084919ff8 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:33.995048 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c3e3655e-05f0-443b-b1e4-1fe084919ff8 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.068644 Jul 14 14:27:33.998175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-412821da-8fa2-44c8-b4bc-b3df0500b091 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:34.006754 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 295/552] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:33 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:34.014053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b8c1d2c-2792-412f-af50-710b7cb70d5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:34.015088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3b8c1d2c-2792-412f-af50-710b7cb70d5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:34.016987 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-412821da-8fa2-44c8-b4bc-b3df0500b091 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.411209 Jul 14 14:27:34.026780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b8c1d2c-2792-412f-af50-710b7cb70d5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:34.026780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b8c1d2c-2792-412f-af50-710b7cb70d5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:34.026780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b8c1d2c-2792-412f-af50-710b7cb70d5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:34.026780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b8c1d2c-2792-412f-af50-710b7cb70d5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:34.027688 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 258/553] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:33 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:34.035913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-141972b1-f1e1-4de5-8511-c7bb49ef32be tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-367127864", "id": "01853ebe-c356-4dbf-837d-1c0fa8641325", "os-flavor-access:is_public": "True"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:34.040115 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:34.040115 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:34.078216 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-141972b1-f1e1-4de5-8511-c7bb49ef32be tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.048963 Jul 14 14:27:34.080686 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 259/554] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:34 2022] POST /compute/v2.1/flavors => generated 506 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:34.097480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac5af147-696a-4b21-a7b6-c564f18cc6a8 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:34.098512 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:34.098512 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:34.126123 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ac5af147-696a-4b21-a7b6-c564f18cc6a8 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/01853ebe-c356-4dbf-837d-1c0fa8641325" status: 202 len: 0 microversion: 2.1 time: 0.035355 Jul 14 14:27:34.127509 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 260/555] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:27:34 2022] DELETE /compute/v2.1/flavors/01853ebe-c356-4dbf-837d-1c0fa8641325 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:34.142007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7a957fa7-6b96-4f91-8343-d0a42b909d1d tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae4deee5-d4e8-4438-9796-7e0727037621"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:34.148184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7a957fa7-6b96-4f91-8343-d0a42b909d1d tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:34.165990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a957fa7-6b96-4f91-8343-d0a42b909d1d tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:34.166569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a957fa7-6b96-4f91-8343-d0a42b909d1d tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:34.169473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a957fa7-6b96-4f91-8343-d0a42b909d1d tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:34.172411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a957fa7-6b96-4f91-8343-d0a42b909d1d tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:34.337382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b8c1d2c-2792-412f-af50-710b7cb70d5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:34.348795 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b8c1d2c-2792-412f-af50-710b7cb70d5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1503 microversion: 2.1 time: 0.338671 Jul 14 14:27:34.349417 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 296/556] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:34 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1503 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:34.364025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2ad00d69-e9fa-42b0-9833-2b77e7bc99c8 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:34.404288 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2ad00d69-e9fa-42b0-9833-2b77e7bc99c8 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.053557 Jul 14 14:27:34.405052 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 297/557] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:34 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:34.427116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-89e8dcb0-707c-418e-b48f-9c734a4009ed tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1757497970", "id": 887756470, "os-flavor-access:is_public": "True"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:34.434634 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:34.434634 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:34.472403 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-89e8dcb0-707c-418e-b48f-9c734a4009ed tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.053464 Jul 14 14:27:34.473862 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 298/558] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:34 2022] POST /compute/v2.1/flavors => generated 411 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:34.491483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6157b5fa-300f-4373-89c1-0f80a46a50e4 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:34.526258 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6157b5fa-300f-4373-89c1-0f80a46a50e4 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/887756470" status: 200 len: 411 microversion: 2.1 time: 0.044279 Jul 14 14:27:34.536833 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 299/559] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:27:34 2022] GET /compute/v2.1/flavors/887756470 => generated 411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:34.543885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-483829bb-00f6-46ed-88df-16ddbd85fa90 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:34.544912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-483829bb-00f6-46ed-88df-16ddbd85fa90 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:34.561567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-483829bb-00f6-46ed-88df-16ddbd85fa90 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:34.562740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-483829bb-00f6-46ed-88df-16ddbd85fa90 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:34.563838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-483829bb-00f6-46ed-88df-16ddbd85fa90 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:34.564516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-483829bb-00f6-46ed-88df-16ddbd85fa90 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:34.739861 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7a957fa7-6b96-4f91-8343-d0a42b909d1d tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "POST /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.608067 Jul 14 14:27:34.741148 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 261/560] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:27:34 2022] POST /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments => generated 194 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:34.992628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-483829bb-00f6-46ed-88df-16ddbd85fa90 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:35.012070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-483829bb-00f6-46ed-88df-16ddbd85fa90 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:35.012860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-483829bb-00f6-46ed-88df-16ddbd85fa90 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:35.014114 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-483829bb-00f6-46ed-88df-16ddbd85fa90 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1569 microversion: 2.25 time: 0.475904 Jul 14 14:27:35.025153 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 300/561] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:34 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1569 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:35.031975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6ffeb0de-0694-4ea7-9e21-92ee34604c5b req-4817d22e-902f-443f-a04c-4bf074027f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae081a7-42be-48bc-8677-d0cf09d35d44", "name": "network-vif-unplugged", "status": "completed", "tag": "3f8c3da8-475e-4406-a1d0-02853d840025"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:35.043565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6ffeb0de-0694-4ea7-9e21-92ee34604c5b req-4817d22e-902f-443f-a04c-4bf074027f0d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:35.044016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6ffeb0de-0694-4ea7-9e21-92ee34604c5b req-4817d22e-902f-443f-a04c-4bf074027f0d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:35.071079 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6ffeb0de-0694-4ea7-9e21-92ee34604c5b req-4817d22e-902f-443f-a04c-4bf074027f0d service nova] Creating event network-vif-unplugged:3f8c3da8-475e-4406-a1d0-02853d840025 for instance 6ae081a7-42be-48bc-8677-d0cf09d35d44 on n-h1-767704-28 Jul 14 14:27:35.089693 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6ffeb0de-0694-4ea7-9e21-92ee34604c5b req-4817d22e-902f-443f-a04c-4bf074027f0d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060869 Jul 14 14:27:35.094178 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 301/562] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:35.109548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cdce1171-329c-437a-898b-8e3199fd8e88 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:35.110329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cdce1171-329c-437a-898b-8e3199fd8e88 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:35.128576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdce1171-329c-437a-898b-8e3199fd8e88 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:35.133935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdce1171-329c-437a-898b-8e3199fd8e88 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:35.135030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdce1171-329c-437a-898b-8e3199fd8e88 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:35.138214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdce1171-329c-437a-898b-8e3199fd8e88 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:35.180132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-843aa506-ab00-4e4d-86b4-a73a7c12ac72 tempest-FlavorsAdminTestJSON-974449732 tempest-FlavorsAdminTestJSON-974449732-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:35.214263 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-843aa506-ab00-4e4d-86b4-a73a7c12ac72 tempest-FlavorsAdminTestJSON-974449732 tempest-FlavorsAdminTestJSON-974449732-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 6216 microversion: 2.1 time: 0.471674 Jul 14 14:27:35.215630 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 262/563] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:34 2022] GET /compute/v2.1/flavors/detail => generated 6216 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:35.239630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-73798ca8-9d3e-4698-aa21-aa66ca3b04bb tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:35.244659 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:35.244659 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:35.284391 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-73798ca8-9d3e-4698-aa21-aa66ca3b04bb tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/887756470" status: 202 len: 0 microversion: 2.1 time: 0.056241 Jul 14 14:27:35.286514 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 263/564] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:27:35 2022] DELETE /compute/v2.1/flavors/887756470 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:27:35.307600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-500246ae-6796-4200-a740-202a96db433a tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:35.344721 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-500246ae-6796-4200-a740-202a96db433a tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.052742 Jul 14 14:27:35.358260 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 264/565] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:35 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:35.370683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9de5c3cd-bc72-4c39-af1f-b7f3a81e06a9 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-339659199", "id": 1479556588, "os-flavor-access:is_public": "False"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:35.372586 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:35.372586 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:35.401064 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9de5c3cd-bc72-4c39-af1f-b7f3a81e06a9 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.040662 Jul 14 14:27:35.401873 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 265/566] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:35 2022] POST /compute/v2.1/flavors => generated 429 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:35.421254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fc586807-ea1f-4d3d-85bb-7701c7403714 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:35.422007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fc586807-ea1f-4d3d-85bb-7701c7403714 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:35.432818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fc586807-ea1f-4d3d-85bb-7701c7403714 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:35.434152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fc586807-ea1f-4d3d-85bb-7701c7403714 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:35.435104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fc586807-ea1f-4d3d-85bb-7701c7403714 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:35.435990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fc586807-ea1f-4d3d-85bb-7701c7403714 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:35.644922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cdce1171-329c-437a-898b-8e3199fd8e88 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:35.657764 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cdce1171-329c-437a-898b-8e3199fd8e88 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.562150 Jul 14 14:27:35.669464 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 302/567] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:35 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:35.681627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b8179d2-716d-47ef-9fef-fb6d1c9ad3f5 tempest-FlavorsAdminTestJSON-974449732 tempest-FlavorsAdminTestJSON-974449732-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "1479556588"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:35.702248 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-1b8179d2-716d-47ef-9fef-fb6d1c9ad3f5 tempest-FlavorsAdminTestJSON-974449732 tempest-FlavorsAdminTestJSON-974449732-project] HTTP exception thrown: Flavor 1479556588 could not be found. Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b8179d2-716d-47ef-9fef-fb6d1c9ad3f5 tempest-FlavorsAdminTestJSON-974449732 tempest-FlavorsAdminTestJSON-974449732-project] Request method failure captured: Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 107 Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CfQ-zCiP469enZaUKVomhPmzi2JQZ8RobPWDIMQnbbkRMVUlWw0YkTK5KNOl-V06anevPDB7cwS-PTzS7qH_cJnYQbdgzb_okCWrh-hRRKgLy9DoKqusBkZl664zJxMEnoDA5wifVL86SKSUmBH0q8hwDQOqYtVn-uhjOLVJMbxMRM Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 4ed7d7e796194211a867d3c50ad55001 Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-FlavorsAdminTestJSON-974449732 Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:35.708458 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4ed7d7e796194211a867d3c50ad55001"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4ed7d7e796194211a867d3c50ad55001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4ed7d7e796194211a867d3c50ad55001", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4ed7d7e796194211a867d3c50ad55001"}]}] Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-FlavorsAdminTestJSON-974449732 Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 4ed7d7e796194211a867d3c50ad55001 Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-974449732 Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-FlavorsAdminTestJSON-974449732-project Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 6be1dd684ecd4169a4f358a58d5a3515 Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-FlavorsAdminTestJSON-974449732-project Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "test", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "1479556588"}} Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:27:35.710014 n-d-767704-28 devstack@n-api.service[119512]: exception: Flavor 1479556588 could not be found. Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '1479556588'}}} Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 780, in create Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1479556588 could not be found. Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:35.711477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1479556588 could not be found. Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:35.713202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:35.714512 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:35.714512 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:35.714512 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:35.714512 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1479556588 could not be found. Jul 14 14:27:35.714512 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:35.714512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b8179d2-716d-47ef-9fef-fb6d1c9ad3f5 tempest-FlavorsAdminTestJSON-974449732 tempest-FlavorsAdminTestJSON-974449732-project] Returning 400 to user: Flavor 1479556588 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:35.714512 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1b8179d2-716d-47ef-9fef-fb6d1c9ad3f5 tempest-FlavorsAdminTestJSON-974449732 tempest-FlavorsAdminTestJSON-974449732-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.043562 Jul 14 14:27:35.716359 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 303/568] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:35 2022] POST /compute/v2.1/servers => generated 81 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:27:35.730383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8fde268a-387f-4540-9e50-bd97b184c5ec tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:35.732632 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:35.732632 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:35.774415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fc586807-ea1f-4d3d-85bb-7701c7403714 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:35.785955 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8fde268a-387f-4540-9e50-bd97b184c5ec tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1479556588" status: 202 len: 0 microversion: 2.1 time: 0.063941 Jul 14 14:27:35.791491 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 304/569] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 14:27:35 2022] DELETE /compute/v2.1/flavors/1479556588 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:35.796228 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fc586807-ea1f-4d3d-85bb-7701c7403714 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1503 microversion: 2.1 time: 0.378824 Jul 14 14:27:35.798225 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 266/570] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:35 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1503 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:35.803565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f975d67-c216-4c11-944c-a07a1e572b1d tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:35.858668 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f975d67-c216-4c11-944c-a07a1e572b1d tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.062685 Jul 14 14:27:35.874762 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 305/571] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:35 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:35.880800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5afd88a-a98d-46d4-8dc9-38d47a6d1ee6 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1671087910", "id": 1371435582, "os-flavor-access:is_public": "False"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:35.895272 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:35.895272 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:35.937104 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d5afd88a-a98d-46d4-8dc9-38d47a6d1ee6 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.058433 Jul 14 14:27:35.938250 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 267/572] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:35 2022] POST /compute/v2.1/flavors => generated 415 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:27:35.949399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d23f1f0b-ec2d-4dc2-af69-e922d0a125c9 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2056160941", "id": 1235856454, "os-flavor-access:is_public": "True"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:35.951194 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:35.951194 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:35.992680 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d23f1f0b-ec2d-4dc2-af69-e922d0a125c9 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.047143 Jul 14 14:27:35.996212 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 306/573] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:35 2022] POST /compute/v2.1/flavors => generated 414 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:36.004834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4ca21cb-9c70-478f-aabc-87d8edb134fc tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.039438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-72ad6f69-3c9e-4c6d-b302-912b28ca567e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.040391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-72ad6f69-3c9e-4c6d-b302-912b28ca567e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:36.042290 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d4ca21cb-9c70-478f-aabc-87d8edb134fc tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.041932 Jul 14 14:27:36.042893 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 268/574] 10.222.0.81 () {58 vars in 1168 bytes} [Thu Jul 14 14:27:35 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:36.054287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72ad6f69-3c9e-4c6d-b302-912b28ca567e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:36.055998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72ad6f69-3c9e-4c6d-b302-912b28ca567e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:36.057119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72ad6f69-3c9e-4c6d-b302-912b28ca567e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:36.057940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72ad6f69-3c9e-4c6d-b302-912b28ca567e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:36.065573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-307c4cc4-553c-4e6d-a3a8-2407eb44bb4a tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.154287 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-307c4cc4-553c-4e6d-a3a8-2407eb44bb4a tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.087594 Jul 14 14:27:36.157448 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 269/575] 10.222.0.81 () {58 vars in 1176 bytes} [Thu Jul 14 14:27:36 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:27:36.193866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0aac121d-3411-4fd4-a1be-ea8ce4f2ad03 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.219614 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0aac121d-3411-4fd4-a1be-ea8ce4f2ad03 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.041651 Jul 14 14:27:36.222293 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 270/576] 10.222.0.81 () {58 vars in 1170 bytes} [Thu Jul 14 14:27:36 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:36.239125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d14acb20-5ceb-4da9-9451-fa87618cda51 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.248406 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d14acb20-5ceb-4da9-9451-fa87618cda51 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.017528 Jul 14 14:27:36.249297 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 271/577] 10.222.0.81 () {58 vars in 1168 bytes} [Thu Jul 14 14:27:36 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:36.260984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1558afbe-3a2b-4b17-8a02-5aa22aa1c284 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.295897 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1558afbe-3a2b-4b17-8a02-5aa22aa1c284 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6219 microversion: 2.1 time: 0.038549 Jul 14 14:27:36.296752 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 272/578] 10.222.0.81 () {58 vars in 1168 bytes} [Thu Jul 14 14:27:36 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6219 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:36.322980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8876b029-d54f-44cf-9c7c-ffa90acc9469 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.375203 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8876b029-d54f-44cf-9c7c-ffa90acc9469 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6219 microversion: 2.1 time: 0.061995 Jul 14 14:27:36.376239 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 273/579] 10.222.0.81 () {58 vars in 1174 bytes} [Thu Jul 14 14:27:36 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:36.395746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f763a348-f3e0-48fd-bad9-2e3112e79b22 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.412872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-72ad6f69-3c9e-4c6d-b302-912b28ca567e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:36.428991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-72ad6f69-3c9e-4c6d-b302-912b28ca567e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:36.450125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-72ad6f69-3c9e-4c6d-b302-912b28ca567e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:36.455101 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-72ad6f69-3c9e-4c6d-b302-912b28ca567e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1559 microversion: 2.25 time: 0.418285 Jul 14 14:27:36.459059 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 307/580] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:36 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1559 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:27:36.475862 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f763a348-f3e0-48fd-bad9-2e3112e79b22 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6219 microversion: 2.1 time: 0.086839 Jul 14 14:27:36.480712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-76650dd5-b2c3-4d6d-a440-7e983a204cec tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '.version_select at 0x7fd6c5fcf310>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.486637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-76650dd5-b2c3-4d6d-a440-7e983a204cec tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:36.487106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-76650dd5-b2c3-4d6d-a440-7e983a204cec tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:36.488187 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 274/581] 10.222.0.81 () {58 vars in 1172 bytes} [Thu Jul 14 14:27:36 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:36.513389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6f224ca5-1ad5-40d4-8266-7e9cb5d6b469 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.547119 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-76650dd5-b2c3-4d6d-a440-7e983a204cec tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 1961 microversion: 2.25 time: 0.072419 Jul 14 14:27:36.548484 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 308/582] 10.222.0.81 () {60 vars in 1183 bytes} [Thu Jul 14 14:27:36 2022] GET /compute/v2.1/os-migrations => generated 1961 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:36.562539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9dfe498c-79fc-458b-9633-2beb2ef82f05 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.563398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9dfe498c-79fc-458b-9633-2beb2ef82f05 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:36.578511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dfe498c-79fc-458b-9633-2beb2ef82f05 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:36.581243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dfe498c-79fc-458b-9633-2beb2ef82f05 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:36.581968 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6f224ca5-1ad5-40d4-8266-7e9cb5d6b469 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6219 microversion: 2.1 time: 0.077357 Jul 14 14:27:36.583182 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 275/583] 10.222.0.81 () {58 vars in 1168 bytes} [Thu Jul 14 14:27:36 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:36.599811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dfe498c-79fc-458b-9633-2beb2ef82f05 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:36.600299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dfe498c-79fc-458b-9633-2beb2ef82f05 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:36.613662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4ea68e5c-455e-42d8-9fb9-2552a4b7e944 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.616257 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:36.616257 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:36.621783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:DELETE=15 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:36.647625 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4ea68e5c-455e-42d8-9fb9-2552a4b7e944 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1235856454" status: 202 len: 0 microversion: 2.1 time: 0.041720 Jul 14 14:27:36.649198 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 276/584] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 14:27:36 2022] DELETE /compute/v2.1/flavors/1235856454 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:36.666151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9d6bbf54-62ea-4dd7-9b51-8402174c591f tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.710598 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9d6bbf54-62ea-4dd7-9b51-8402174c591f tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.052169 Jul 14 14:27:36.713231 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 277/585] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:36 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:27:36.726170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fcb1098a-8c61-44f5-b83a-1e7d69f2fbd5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:36.727696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fcb1098a-8c61-44f5-b83a-1e7d69f2fbd5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:36.743265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fcb1098a-8c61-44f5-b83a-1e7d69f2fbd5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:36.744352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fcb1098a-8c61-44f5-b83a-1e7d69f2fbd5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:36.745952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fcb1098a-8c61-44f5-b83a-1e7d69f2fbd5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:36.746788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fcb1098a-8c61-44f5-b83a-1e7d69f2fbd5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:37.021906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-9dfe498c-79fc-458b-9633-2beb2ef82f05 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid 88426cdc-557a-4724-9ef2-d84d32b4191d {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:37.050442 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9dfe498c-79fc-458b-9633-2beb2ef82f05 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 2054 microversion: 2.25 time: 0.480157 Jul 14 14:27:37.053027 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 309/586] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:36 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 2054 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:37.058271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ca3ae3a4-c8e7-41bd-8780-17abd996bd79 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:37.059031 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:37.059031 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:37.114752 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ca3ae3a4-c8e7-41bd-8780-17abd996bd79 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1371435582" status: 202 len: 0 microversion: 2.1 time: 0.056812 Jul 14 14:27:37.121082 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 310/587] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 14:27:37 2022] DELETE /compute/v2.1/flavors/1371435582 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:37.126426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bae2a96c-b1c3-4b19-89bd-de7e85b47563 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:37.134301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bae2a96c-b1c3-4b19-89bd-de7e85b47563 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:37.152172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bae2a96c-b1c3-4b19-89bd-de7e85b47563 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:37.152800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bae2a96c-b1c3-4b19-89bd-de7e85b47563 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:37.153809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bae2a96c-b1c3-4b19-89bd-de7e85b47563 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:37.154408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bae2a96c-b1c3-4b19-89bd-de7e85b47563 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:37.284477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fcb1098a-8c61-44f5-b83a-1e7d69f2fbd5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:37.296694 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fcb1098a-8c61-44f5-b83a-1e7d69f2fbd5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.581344 Jul 14 14:27:37.306678 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 278/588] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:36 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:37.306678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-87f7bd6b-4c7b-4a28-b7f3-3efc570f9da3 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:37.334631 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-87f7bd6b-4c7b-4a28-b7f3-3efc570f9da3 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.035424 Jul 14 14:27:37.336614 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 279/589] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:37 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:37.343410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-33b16a72-af85-4d5c-bb09-15b1123bef3e req-5842b9de-c3ac-411e-8301-860309c20af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae081a7-42be-48bc-8677-d0cf09d35d44", "tag": "3f8c3da8-475e-4406-a1d0-02853d840025"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:37.353471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-33b16a72-af85-4d5c-bb09-15b1123bef3e req-5842b9de-c3ac-411e-8301-860309c20af8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:37.354430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-33b16a72-af85-4d5c-bb09-15b1123bef3e req-5842b9de-c3ac-411e-8301-860309c20af8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:37.373334 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-33b16a72-af85-4d5c-bb09-15b1123bef3e req-5842b9de-c3ac-411e-8301-860309c20af8 service nova] Creating event network-changed:3f8c3da8-475e-4406-a1d0-02853d840025 for instance 6ae081a7-42be-48bc-8677-d0cf09d35d44 on n-h1-767704-28 Jul 14 14:27:37.382889 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-33b16a72-af85-4d5c-bb09-15b1123bef3e req-5842b9de-c3ac-411e-8301-860309c20af8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044607 Jul 14 14:27:37.383912 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 280/590] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:37.392667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1821717540", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "6bcc5f06-ad6e-40c9-b806-9581f1f929a3"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:37.436003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bae2a96c-b1c3-4b19-89bd-de7e85b47563 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:37.444322 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bae2a96c-b1c3-4b19-89bd-de7e85b47563 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1503 microversion: 2.1 time: 0.321938 Jul 14 14:27:37.445202 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 311/591] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:37 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1503 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:37.461812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f010d75d-055e-4959-8918-8183e4b9cd2d tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1491133263", "id": 324795062, "os-flavor-access:is_public": "False"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:37.465332 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:37.465332 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:37.496222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] validate_networks() for [('6bcc5f06-ad6e-40c9-b806-9581f1f929a3', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:27:37.499438 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f010d75d-055e-4959-8918-8183e4b9cd2d tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.052078 Jul 14 14:27:37.500211 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 312/592] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:37 2022] POST /compute/v2.1/flavors => generated 412 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:37.529368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-80b5701b-9754-4810-9351-8e54c84e8d4b tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:37.577545 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-80b5701b-9754-4810-9351-8e54c84e8d4b tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.059719 Jul 14 14:27:37.600694 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 313/593] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:37 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:37.606458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c12b6b07-9565-4a00-aa36-b7a65f2c4a9d tempest-FlavorsAdminTestJSON-974449732 tempest-FlavorsAdminTestJSON-974449732-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:37.653192 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c12b6b07-9565-4a00-aa36-b7a65f2c4a9d tempest-FlavorsAdminTestJSON-974449732 tempest-FlavorsAdminTestJSON-974449732-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.050355 Jul 14 14:27:37.654792 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 314/594] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:37 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:37.674663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2af03d30-b4f4-4860-9317-01de5db00ee6 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:37.675798 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:37.675798 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:37.703769 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2af03d30-b4f4-4860-9317-01de5db00ee6 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/324795062" status: 202 len: 0 microversion: 2.1 time: 0.037103 Jul 14 14:27:37.709349 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 315/595] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:27:37 2022] DELETE /compute/v2.1/flavors/324795062 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:37.723944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a9e7fe8e-b48c-4c02-b121-16c90e3dd5a9 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:37.777086 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a9e7fe8e-b48c-4c02-b121-16c90e3dd5a9 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.046983 Jul 14 14:27:37.777086 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 316/596] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:37 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:37.795237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b7735ae-59f7-4099-875f-849afa36ad29 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-493967015", "id": 2138401526, "os-flavor-access:is_public": "True"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:37.831507 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b7735ae-59f7-4099-875f-849afa36ad29 tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.046161 Jul 14 14:27:37.834067 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 317/597] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:37 2022] POST /compute/v2.1/flavors => generated 413 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:37.844702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7c19f8c8-1d88-4270-8425-c91e03d428c4 tempest-FlavorsAdminTestJSON-974449732 tempest-FlavorsAdminTestJSON-974449732-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:37.886891 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7c19f8c8-1d88-4270-8425-c91e03d428c4 tempest-FlavorsAdminTestJSON-974449732 tempest-FlavorsAdminTestJSON-974449732-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.046264 Jul 14 14:27:37.887502 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 318/598] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:37 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:37.905226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-deca4fdc-4175-4bef-94b3-c28903fec1aa tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:37.980973 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-deca4fdc-4175-4bef-94b3-c28903fec1aa tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/2138401526" status: 202 len: 0 microversion: 2.1 time: 0.079209 Jul 14 14:27:37.981878 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 319/599] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 14:27:37 2022] DELETE /compute/v2.1/flavors/2138401526 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:37.990093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-556e33a7-8aef-4261-a39d-fc0f7280531d tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:38.026605 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-556e33a7-8aef-4261-a39d-fc0f7280531d tempest-FlavorsAdminTestJSON-1692820444 tempest-FlavorsAdminTestJSON-1692820444-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.040076 Jul 14 14:27:38.027202 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 320/600] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:37 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:27:38.319436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cfa1f665-9f95-4c41-bb23-880e0e55febe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:38.325768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cfa1f665-9f95-4c41-bb23-880e0e55febe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:38.355264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cfa1f665-9f95-4c41-bb23-880e0e55febe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:38.356142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cfa1f665-9f95-4c41-bb23-880e0e55febe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:38.357007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cfa1f665-9f95-4c41-bb23-880e0e55febe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:38.357456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cfa1f665-9f95-4c41-bb23-880e0e55febe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:38.362177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:27:38.363003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:27:38.364222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:27:38.364665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:27:38.365578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:27:38.384674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:38.385165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:38.386315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:38.386759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:38.441353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Getting quotas for project 4459eedeb8884ffe82ed62e567fb64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:27:38.452284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Getting quotas for user ef25b01962404bdfa0c2bbb30401ca62 and project 4459eedeb8884ffe82ed62e567fb64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:27:38.483501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:27:38.488018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:27:38.588377 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e850754c-e5b2-4dd6-9ed6-c80050bc66cf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.200239 Jul 14 14:27:38.592559 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 281/601] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:27:38.604415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21fea4ed-8209-4f8f-a53c-e4b0ccfc952c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:38.605347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-21fea4ed-8209-4f8f-a53c-e4b0ccfc952c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:38.614773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21fea4ed-8209-4f8f-a53c-e4b0ccfc952c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:38.615544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21fea4ed-8209-4f8f-a53c-e4b0ccfc952c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:38.616645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21fea4ed-8209-4f8f-a53c-e4b0ccfc952c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:38.617492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21fea4ed-8209-4f8f-a53c-e4b0ccfc952c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:38.648182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cfa1f665-9f95-4c41-bb23-880e0e55febe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:38.669192 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cfa1f665-9f95-4c41-bb23-880e0e55febe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.348326 Jul 14 14:27:38.669680 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 321/602] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:38 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:38.687366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-15e48ff2-7991-41e1-8012-35735c4c519f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:38.693092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-15e48ff2-7991-41e1-8012-35735c4c519f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:38.790476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-15e48ff2-7991-41e1-8012-35735c4c519f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:38.798583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-15e48ff2-7991-41e1-8012-35735c4c519f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:38.803588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-15e48ff2-7991-41e1-8012-35735c4c519f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:38.808645 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-15e48ff2-7991-41e1-8012-35735c4c519f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1262 microversion: 2.25 time: 0.136393 Jul 14 14:27:38.809751 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 322/603] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:38 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1262 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:38.860384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-21fea4ed-8209-4f8f-a53c-e4b0ccfc952c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:38.863056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:38.871014 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21fea4ed-8209-4f8f-a53c-e4b0ccfc952c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1503 microversion: 2.1 time: 0.277055 Jul 14 14:27:38.876167 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 282/604] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:38 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:39.697639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-06f1b669-2381-4133-bc15-e9693c8fa4d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:39.700924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-06f1b669-2381-4133-bc15-e9693c8fa4d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:39.713999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06f1b669-2381-4133-bc15-e9693c8fa4d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:39.716281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06f1b669-2381-4133-bc15-e9693c8fa4d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:39.718641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06f1b669-2381-4133-bc15-e9693c8fa4d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:39.719996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06f1b669-2381-4133-bc15-e9693c8fa4d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:39.830344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fe6c4b5c-81c6-47b5-b102-7eb61e3a83ba tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:39.830962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fe6c4b5c-81c6-47b5-b102-7eb61e3a83ba tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:39.866507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe6c4b5c-81c6-47b5-b102-7eb61e3a83ba tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:39.867069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe6c4b5c-81c6-47b5-b102-7eb61e3a83ba tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:39.869319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe6c4b5c-81c6-47b5-b102-7eb61e3a83ba tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:39.874195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe6c4b5c-81c6-47b5-b102-7eb61e3a83ba tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:40.040733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fe6c4b5c-81c6-47b5-b102-7eb61e3a83ba tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:40.050995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fe6c4b5c-81c6-47b5-b102-7eb61e3a83ba tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:40.063100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fe6c4b5c-81c6-47b5-b102-7eb61e3a83ba tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:40.064786 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fe6c4b5c-81c6-47b5-b102-7eb61e3a83ba tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1314 microversion: 2.25 time: 0.240900 Jul 14 14:27:40.067724 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 283/605] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:39 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:27:40.074443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b9abf9b7-4856-4c21-b4d2-331f48c5d49f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:40.079087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b9abf9b7-4856-4c21-b4d2-331f48c5d49f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:40.095841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9abf9b7-4856-4c21-b4d2-331f48c5d49f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:40.096560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9abf9b7-4856-4c21-b4d2-331f48c5d49f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:40.097653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9abf9b7-4856-4c21-b4d2-331f48c5d49f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:40.098365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9abf9b7-4856-4c21-b4d2-331f48c5d49f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:40.142613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-06f1b669-2381-4133-bc15-e9693c8fa4d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:40.158785 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-06f1b669-2381-4133-bc15-e9693c8fa4d1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.471879 Jul 14 14:27:40.160208 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 323/606] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:39 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:40.618681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b9abf9b7-4856-4c21-b4d2-331f48c5d49f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:40.630789 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b9abf9b7-4856-4c21-b4d2-331f48c5d49f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1503 microversion: 2.1 time: 0.557316 Jul 14 14:27:40.633624 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 284/607] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:40 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1503 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:40.668828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8e8b0fb-7627-4ef3-8c28-e7a44dd14d05 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Calling method '.version_select at 0x7fd6c605b820>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:40.776287 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8e8b0fb-7627-4ef3-8c28-e7a44dd14d05 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502" status: 200 len: 371 microversion: 2.1 time: 0.274810 Jul 14 14:27:40.777741 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 324/608] 10.222.0.81 () {58 vars in 1241 bytes} [Thu Jul 14 14:27:40 2022] GET /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502 => generated 371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:40.787901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23a8f7e9-e333-4265-9387-dac8c0bff4f5 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c60f9160>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:40.878850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23a8f7e9-e333-4265-9387-dac8c0bff4f5 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:40.879466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23a8f7e9-e333-4265-9387-dac8c0bff4f5 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:40.880121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23a8f7e9-e333-4265-9387-dac8c0bff4f5 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:40.880701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23a8f7e9-e333-4265-9387-dac8c0bff4f5 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:40.996382 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-23a8f7e9-e333-4265-9387-dac8c0bff4f5 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502" status: 200 len: 328 microversion: 2.1 time: 0.211897 Jul 14 14:27:41.005635 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 285/609] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:27:40 2022] PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502 => generated 328 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:41.104460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-868bc3d6-0bb0-4bf3-a26c-a9cc0f6799b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:41.105427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-868bc3d6-0bb0-4bf3-a26c-a9cc0f6799b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:41.128982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-868bc3d6-0bb0-4bf3-a26c-a9cc0f6799b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:41.129711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-868bc3d6-0bb0-4bf3-a26c-a9cc0f6799b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:41.130719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-868bc3d6-0bb0-4bf3-a26c-a9cc0f6799b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:41.136107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-868bc3d6-0bb0-4bf3-a26c-a9cc0f6799b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:41.177205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3ae4c63d-acd9-4b02-96e5-78d72ac31247 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:41.177985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3ae4c63d-acd9-4b02-96e5-78d72ac31247 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:41.199757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ae4c63d-acd9-4b02-96e5-78d72ac31247 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:41.204193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ae4c63d-acd9-4b02-96e5-78d72ac31247 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:41.205363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ae4c63d-acd9-4b02-96e5-78d72ac31247 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:41.208341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ae4c63d-acd9-4b02-96e5-78d72ac31247 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:41.645871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-868bc3d6-0bb0-4bf3-a26c-a9cc0f6799b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:41.666627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-868bc3d6-0bb0-4bf3-a26c-a9cc0f6799b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:41.669953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-868bc3d6-0bb0-4bf3-a26c-a9cc0f6799b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:41.676380 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-868bc3d6-0bb0-4bf3-a26c-a9cc0f6799b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1320 microversion: 2.25 time: 0.579960 Jul 14 14:27:41.679071 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 325/610] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:41 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1320 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:41.778892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3ae4c63d-acd9-4b02-96e5-78d72ac31247 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:41.793419 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3ae4c63d-acd9-4b02-96e5-78d72ac31247 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.614309 Jul 14 14:27:41.794095 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 286/611] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:41 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:27:41.811003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-046f5d5e-8dd9-4f7c-94f0-3dd46410307c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:41.815817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-046f5d5e-8dd9-4f7c-94f0-3dd46410307c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:41.835605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-046f5d5e-8dd9-4f7c-94f0-3dd46410307c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:41.841637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-046f5d5e-8dd9-4f7c-94f0-3dd46410307c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:41.846310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-046f5d5e-8dd9-4f7c-94f0-3dd46410307c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:41.847082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-046f5d5e-8dd9-4f7c-94f0-3dd46410307c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:42.144483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1816579356", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:42.256830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-046f5d5e-8dd9-4f7c-94f0-3dd46410307c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:42.269358 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-046f5d5e-8dd9-4f7c-94f0-3dd46410307c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1503 microversion: 2.1 time: 0.472090 Jul 14 14:27:42.270356 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 287/612] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:41 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1503 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:42.297313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:27:42.699826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2d6d9125-7392-4783-bae1-415e5a436afe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:42.701167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2d6d9125-7392-4783-bae1-415e5a436afe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:42.710224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d6d9125-7392-4783-bae1-415e5a436afe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:42.712164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d6d9125-7392-4783-bae1-415e5a436afe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:42.713275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d6d9125-7392-4783-bae1-415e5a436afe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:42.713983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d6d9125-7392-4783-bae1-415e5a436afe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:42.823717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:27:42.824715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:27:42.825525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:27:42.826594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:27:42.827421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:27:42.833127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:DELETE=15,nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:42.857740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:42.862384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:42.865233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:42.866198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:42.898058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Getting quotas for project 95f1a41de5194ccd9d6997b81e920502. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:27:42.907411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Getting quotas for user 60cbbb7a6f0c4044989cf160c6e094da and project 95f1a41de5194ccd9d6997b81e920502. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:27:42.936075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.utils [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] cores quota exceeded for 95f1a41de5194ccd9d6997b81e920502, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119512) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 14 14:27:42.938745 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Request method failure captured: Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 145 Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CfbSypbfeJ8x6ZDbZIe6CdeiaC0HVdmna6FsDXBpuCe8hmDowzT12zLIvpbt6tbCY10lWjcw6Js8pzymuSUrWnZ7ujfStMn2FLqsDhp5m9bvbp7Z84Rx1yWnc44JyHp2HCTKvz2mbpZf753Zg4C4lpmNtc0zIGyNU4yjdwE_Eh5kzE Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 95f1a41de5194ccd9d6997b81e920502 Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-QuotasAdminNegativeTest-557624408 Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:42.943822 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:42.946125 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95f1a41de5194ccd9d6997b81e920502"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/95f1a41de5194ccd9d6997b81e920502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_95f1a41de5194ccd9d6997b81e920502", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95f1a41de5194ccd9d6997b81e920502"}]}] Jul 14 14:27:42.946125 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-QuotasAdminNegativeTest-557624408 Jul 14 14:27:42.946125 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 95f1a41de5194ccd9d6997b81e920502 Jul 14 14:27:42.946125 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-557624408 Jul 14 14:27:42.946125 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-QuotasAdminNegativeTest-557624408-project Jul 14 14:27:42.946125 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:42.946125 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:42.946125 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 60cbbb7a6f0c4044989cf160c6e094da Jul 14 14:27:42.946125 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-QuotasAdminNegativeTest-557624408-project Jul 14 14:27:42.946125 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:27:42.946125 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1816579356", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} Jul 14 14:27:42.946125 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1816579356', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452'}}} Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 14 14:27:42.947309 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:42.949823 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 802, in create Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:42.952839 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:42.955927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:42.955927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:42.955927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:42.955927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:42.955927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 14 14:27:42.955927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:42.955927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:42.955927 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4b43ea21-e73a-48ab-9c04-960fabdcffb0 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.264521 Jul 14 14:27:42.955927 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 326/613] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:41 2022] POST /compute/v2.1/servers => generated 111 bytes in 1269 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:42.958445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-db7764fe-4f2c-4a20-8c4d-67ad237c82f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:42.958445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-db7764fe-4f2c-4a20-8c4d-67ad237c82f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:42.971019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db7764fe-4f2c-4a20-8c4d-67ad237c82f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:42.971468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db7764fe-4f2c-4a20-8c4d-67ad237c82f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:42.972466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db7764fe-4f2c-4a20-8c4d-67ad237c82f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:42.972928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db7764fe-4f2c-4a20-8c4d-67ad237c82f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:43.362533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2d6d9125-7392-4783-bae1-415e5a436afe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:43.384293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2d6d9125-7392-4783-bae1-415e5a436afe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:43.406857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2d6d9125-7392-4783-bae1-415e5a436afe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:43.417092 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2d6d9125-7392-4783-bae1-415e5a436afe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1362 microversion: 2.25 time: 0.724173 Jul 14 14:27:43.419901 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 288/614] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:42 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1362 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:27:43.428139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0db55c32-7818-46df-99d8-6ce2d1a08cb9 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c5e7e310>, body: {"quota_set": {"cores": 20}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:43.647311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-db7764fe-4f2c-4a20-8c4d-67ad237c82f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:43.669328 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-db7764fe-4f2c-4a20-8c4d-67ad237c82f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.718375 Jul 14 14:27:43.688384 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 327/615] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:42 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:43.703529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-18fef1b8-8798-4780-8073-13ad3204c17e req-02637af7-9131-4377-a890-52ebd49f5d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae081a7-42be-48bc-8677-d0cf09d35d44", "name": "network-vif-unplugged", "status": "completed", "tag": "3f8c3da8-475e-4406-a1d0-02853d840025"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:43.721063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-18fef1b8-8798-4780-8073-13ad3204c17e req-02637af7-9131-4377-a890-52ebd49f5d49 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:43.721874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-18fef1b8-8798-4780-8073-13ad3204c17e req-02637af7-9131-4377-a890-52ebd49f5d49 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:43.743478 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-18fef1b8-8798-4780-8073-13ad3204c17e req-02637af7-9131-4377-a890-52ebd49f5d49 service nova] Creating event network-vif-unplugged:3f8c3da8-475e-4406-a1d0-02853d840025 for instance 6ae081a7-42be-48bc-8677-d0cf09d35d44 on n-h1-767704-28 Jul 14 14:27:43.766503 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-18fef1b8-8798-4780-8073-13ad3204c17e req-02637af7-9131-4377-a890-52ebd49f5d49 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075541 Jul 14 14:27:43.777010 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 328/616] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:43.798204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b7c3e7f-1036-4f47-9d78-79e908769d6c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:43.798933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5b7c3e7f-1036-4f47-9d78-79e908769d6c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:43.818982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b7c3e7f-1036-4f47-9d78-79e908769d6c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:43.820127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b7c3e7f-1036-4f47-9d78-79e908769d6c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:43.821352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b7c3e7f-1036-4f47-9d78-79e908769d6c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:43.822145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b7c3e7f-1036-4f47-9d78-79e908769d6c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:44.197024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0db55c32-7818-46df-99d8-6ce2d1a08cb9 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:44.197488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0db55c32-7818-46df-99d8-6ce2d1a08cb9 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:44.200657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0db55c32-7818-46df-99d8-6ce2d1a08cb9 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:44.202563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0db55c32-7818-46df-99d8-6ce2d1a08cb9 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:44.218527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5b7c3e7f-1036-4f47-9d78-79e908769d6c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:44.235660 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b7c3e7f-1036-4f47-9d78-79e908769d6c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1503 microversion: 2.1 time: 0.456985 Jul 14 14:27:44.238396 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 329/617] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:43 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1503 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:44.354719 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0db55c32-7818-46df-99d8-6ce2d1a08cb9 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502" status: 200 len: 329 microversion: 2.1 time: 0.932344 Jul 14 14:27:44.355314 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 289/618] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:27:43 2022] PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502 => generated 329 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:44.374495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a46d8862-57d0-4946-bc3e-6a47ba43ffb8 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Calling method '.version_select at 0x7fd6c5f2ae50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:44.868697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c515b87b-d1a2-4538-8623-79d5f7ca5508 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-718966430", "ram": 512, "vcpus": 1, "disk": 10, "id": 999972265, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:44.870829 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:44.870829 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:44.902084 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c515b87b-d1a2-4538-8623-79d5f7ca5508 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.549370 Jul 14 14:27:44.903606 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 330/619] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:44 2022] POST /compute/v2.1/flavors => generated 412 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:27:44.912088 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a46d8862-57d0-4946-bc3e-6a47ba43ffb8 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502" status: 200 len: 371 microversion: 2.1 time: 0.540601 Jul 14 14:27:44.915065 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 290/620] 10.222.0.81 () {58 vars in 1241 bytes} [Thu Jul 14 14:27:44 2022] GET /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502 => generated 371 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:44.918920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-04ba4c84-7161-4468-9644-a2e50de65fed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:44.920820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-04ba4c84-7161-4468-9644-a2e50de65fed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:44.939656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-26ff9e21-61fa-4c1f-bc4f-6aaf9792152e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:44.941204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-26ff9e21-61fa-4c1f-bc4f-6aaf9792152e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:44.941688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04ba4c84-7161-4468-9644-a2e50de65fed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:44.942314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04ba4c84-7161-4468-9644-a2e50de65fed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:44.943414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04ba4c84-7161-4468-9644-a2e50de65fed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:44.944030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04ba4c84-7161-4468-9644-a2e50de65fed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:44.984411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26ff9e21-61fa-4c1f-bc4f-6aaf9792152e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:44.985332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26ff9e21-61fa-4c1f-bc4f-6aaf9792152e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:44.986365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26ff9e21-61fa-4c1f-bc4f-6aaf9792152e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:44.987171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26ff9e21-61fa-4c1f-bc4f-6aaf9792152e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:45.005644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:45.352064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04ba4c84-7161-4468-9644-a2e50de65fed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:45.361481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04ba4c84-7161-4468-9644-a2e50de65fed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:45.363323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04ba4c84-7161-4468-9644-a2e50de65fed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:45.365609 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-04ba4c84-7161-4468-9644-a2e50de65fed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1362 microversion: 2.25 time: 0.460706 Jul 14 14:27:45.374483 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 331/621] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:44 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1362 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:45.389211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-26ff9e21-61fa-4c1f-bc4f-6aaf9792152e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:45.410756 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-26ff9e21-61fa-4c1f-bc4f-6aaf9792152e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.492198 Jul 14 14:27:45.411363 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 291/622] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:44 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:45.433390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-493549c6-fb5e-408f-9340-d91e620bf13e tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c61de670>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:45.551294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-493549c6-fb5e-408f-9340-d91e620bf13e tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:45.557973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-493549c6-fb5e-408f-9340-d91e620bf13e tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:45.559198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-493549c6-fb5e-408f-9340-d91e620bf13e tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:45.559717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-493549c6-fb5e-408f-9340-d91e620bf13e tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:45.606599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd7d7e21-e952-4271-973b-223286f201db tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:45.626991 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-cd7d7e21-e952-4271-973b-223286f201db tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] HTTP exception thrown: Flavor 999972265 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd7d7e21-e952-4271-973b-223286f201db tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Request method failure captured: Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/flavors/999972265/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CfePVwlBhsWPMg6Y3LW2LMG617fHwo8pbrIvLlUjDOVtW-un6_Ww61C1zgBik078L7uZmodMMAq3OXcmujXJb5sA95QFWYp1XP063aSn4t7MzYusnZsQ8UUu_k2WIiy3F668SNd0UWs_tlB9bYcc_1-0Bozqi55_yVFOkz9D5h2b1w Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 0d68710423cf4004bb1eb20d1f740ee9 Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:45.631530 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:45.634327 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0d68710423cf4004bb1eb20d1f740ee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0d68710423cf4004bb1eb20d1f740ee9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0d68710423cf4004bb1eb20d1f740ee9", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0d68710423cf4004bb1eb20d1f740ee9"}]}] Jul 14 14:27:45.634327 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 Jul 14 14:27:45.634327 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 0d68710423cf4004bb1eb20d1f740ee9 Jul 14 14:27:45.634327 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 Jul 14 14:27:45.634327 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project Jul 14 14:27:45.634327 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:45.634327 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:45.634327 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 49bd5b43a3b44462a6d8141d7a8a803b Jul 14 14:27:45.634327 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project Jul 14 14:27:45.634327 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:27:45.634327 n-d-767704-28 devstack@n-api.service[119512]: exception: Flavor 999972265 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'flavor_id': '999972265', 'id': 'hw:cpu_thread_policy'} Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 999972265 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:45.635302 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:45.636876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:45.636876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:45.636876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:45.636876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:45.636876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:45.636876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 999972265 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:27:45.636876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:45.640453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd7d7e21-e952-4271-973b-223286f201db tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Returning 404 to user: Flavor 999972265 has no extra specs with key hw:cpu_thread_policy. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:45.646429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cd7d7e21-e952-4271-973b-223286f201db tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] 10.222.0.81 "GET /compute/v2.1/flavors/999972265/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.270212 Jul 14 14:27:45.647644 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 332/623] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:27:45 2022] GET /compute/v2.1/flavors/999972265/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 272 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:45.659599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-586ddc6d-1337-4a59-a023-79555cd87b77 req-42d6c785-2206-4a69-ad78-f1aef8ebc1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "037d7f27-c02b-4c2e-8039-2efba995484d", "tag": "f836c7c7-f03f-4d05-a974-793760051e3e"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:45.684212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-586ddc6d-1337-4a59-a023-79555cd87b77 req-42d6c785-2206-4a69-ad78-f1aef8ebc1b6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:45.690314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-586ddc6d-1337-4a59-a023-79555cd87b77 req-42d6c785-2206-4a69-ad78-f1aef8ebc1b6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:45.712082 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-586ddc6d-1337-4a59-a023-79555cd87b77 req-42d6c785-2206-4a69-ad78-f1aef8ebc1b6 service nova] Creating event network-changed:f836c7c7-f03f-4d05-a974-793760051e3e for instance 037d7f27-c02b-4c2e-8039-2efba995484d on n-h2-767704-28 Jul 14 14:27:45.719818 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-493549c6-fb5e-408f-9340-d91e620bf13e tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502" status: 200 len: 328 microversion: 2.1 time: 0.306327 Jul 14 14:27:45.720826 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 292/624] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:27:45 2022] PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502 => generated 328 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:45.725944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aa275882-cb8c-4d6b-8641-117198732a59 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:45.729274 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-586ddc6d-1337-4a59-a023-79555cd87b77 req-42d6c785-2206-4a69-ad78-f1aef8ebc1b6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079742 Jul 14 14:27:45.730370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aa275882-cb8c-4d6b-8641-117198732a59 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:45.737170 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 333/625] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:45.756984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-79ae622a-0343-4366-827e-52fd2e391e00 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:45.762786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa275882-cb8c-4d6b-8641-117198732a59 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:45.764810 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:45.764810 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:45.765683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa275882-cb8c-4d6b-8641-117198732a59 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:45.766371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-79ae622a-0343-4366-827e-52fd2e391e00 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '49bd5b43a3b44462a6d8141d7a8a803b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d68710423cf4004bb1eb20d1f740ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:45.768377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa275882-cb8c-4d6b-8641-117198732a59 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:45.768377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa275882-cb8c-4d6b-8641-117198732a59 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-79ae622a-0343-4366-827e-52fd2e391e00 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Request method failure captured: Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/flavors/999972265/os-extra_specs HTTP/1.1 Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 66 Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CfePVwlBhsWPMg6Y3LW2LMG617fHwo8pbrIvLlUjDOVtW-un6_Ww61C1zgBik078L7uZmodMMAq3OXcmujXJb5sA95QFWYp1XP063aSn4t7MzYusnZsQ8UUu_k2WIiy3F668SNd0UWs_tlB9bYcc_1-0Bozqi55_yVFOkz9D5h2b1w Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 0d68710423cf4004bb1eb20d1f740ee9 Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:45.770406 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:45.771779 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0d68710423cf4004bb1eb20d1f740ee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0d68710423cf4004bb1eb20d1f740ee9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0d68710423cf4004bb1eb20d1f740ee9", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0d68710423cf4004bb1eb20d1f740ee9"}]}] Jul 14 14:27:45.771779 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 Jul 14 14:27:45.771779 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 0d68710423cf4004bb1eb20d1f740ee9 Jul 14 14:27:45.771779 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 Jul 14 14:27:45.771779 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project Jul 14 14:27:45.771779 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:45.771779 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:45.771779 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 49bd5b43a3b44462a6d8141d7a8a803b Jul 14 14:27:45.771779 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project Jul 14 14:27:45.771779 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:27:45.771779 n-d-767704-28 devstack@n-api.service[119512]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 14 14:27:45.771779 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'flavor_id': '999972265', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:45.772505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 14 14:27:45.774905 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:45.778439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-79ae622a-0343-4366-827e-52fd2e391e00 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:45.780296 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-79ae622a-0343-4366-827e-52fd2e391e00 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] 10.222.0.81 "POST /compute/v2.1/flavors/999972265/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.039834 Jul 14 14:27:45.781723 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 334/626] 10.222.0.81 () {60 vars in 1220 bytes} [Thu Jul 14 14:27:45 2022] POST /compute/v2.1/flavors/999972265/os-extra_specs => generated 124 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:45.793613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1da834f9-c24c-4234-88ee-d7e2744b7e78 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:45.839470 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1da834f9-c24c-4234-88ee-d7e2744b7e78 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/999972265/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.052142 Jul 14 14:27:45.842023 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 335/627] 10.222.0.81 () {60 vars in 1220 bytes} [Thu Jul 14 14:27:45 2022] POST /compute/v2.1/flavors/999972265/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:27:45.856865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65112a7c-dad6-4b3b-b626-f7c2de8d6bad tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:45.860061 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:45.860061 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:45.862931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-65112a7c-dad6-4b3b-b626-f7c2de8d6bad tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '49bd5b43a3b44462a6d8141d7a8a803b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d68710423cf4004bb1eb20d1f740ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65112a7c-dad6-4b3b-b626-f7c2de8d6bad tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Request method failure captured: Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/flavors/999972265/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CfePVwlBhsWPMg6Y3LW2LMG617fHwo8pbrIvLlUjDOVtW-un6_Ww61C1zgBik078L7uZmodMMAq3OXcmujXJb5sA95QFWYp1XP063aSn4t7MzYusnZsQ8UUu_k2WIiy3F668SNd0UWs_tlB9bYcc_1-0Bozqi55_yVFOkz9D5h2b1w Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 0d68710423cf4004bb1eb20d1f740ee9 Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:45.868978 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:45.870766 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0d68710423cf4004bb1eb20d1f740ee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0d68710423cf4004bb1eb20d1f740ee9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0d68710423cf4004bb1eb20d1f740ee9", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0d68710423cf4004bb1eb20d1f740ee9"}]}] Jul 14 14:27:45.870766 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 Jul 14 14:27:45.870766 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 0d68710423cf4004bb1eb20d1f740ee9 Jul 14 14:27:45.870766 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 Jul 14 14:27:45.870766 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project Jul 14 14:27:45.870766 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:45.870766 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:45.870766 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 49bd5b43a3b44462a6d8141d7a8a803b Jul 14 14:27:45.870766 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project Jul 14 14:27:45.870766 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:27:45.870766 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'flavor_id': '999972265', 'id': 'hw:numa_nodes'} Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:45.871418 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 14 14:27:45.872602 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:45.877167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65112a7c-dad6-4b3b-b626-f7c2de8d6bad tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:45.878055 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65112a7c-dad6-4b3b-b626-f7c2de8d6bad tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] 10.222.0.81 "DELETE /compute/v2.1/flavors/999972265/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.031609 Jul 14 14:27:45.878626 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 336/628] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 14:27:45 2022] DELETE /compute/v2.1/flavors/999972265/os-extra_specs/hw:numa_nodes => generated 124 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:45.899517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6bd154fb-aec3-40a3-97e8-c831e0b1403e tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:45.928673 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6bd154fb-aec3-40a3-97e8-c831e0b1403e tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors/999972265/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043385 Jul 14 14:27:45.930311 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 337/629] 10.222.0.81 () {60 vars in 1220 bytes} [Thu Jul 14 14:27:45 2022] POST /compute/v2.1/flavors/999972265/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:27:45.936137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-534086887", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:45.993831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aa275882-cb8c-4d6b-8641-117198732a59 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:46.006555 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aa275882-cb8c-4d6b-8641-117198732a59 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1503 microversion: 2.1 time: 0.284257 Jul 14 14:27:46.007111 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 293/630] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:45 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:46.011382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:27:46.021315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9413908b-bd20-4104-8c62-aea4d6634abe tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:46.023045 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:46.023045 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:46.024543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9413908b-bd20-4104-8c62-aea4d6634abe tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '49bd5b43a3b44462a6d8141d7a8a803b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d68710423cf4004bb1eb20d1f740ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9413908b-bd20-4104-8c62-aea4d6634abe tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Request method failure captured: Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: request: PUT /compute/v2.1/flavors/999972265/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 22 Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CfePVwlBhsWPMg6Y3LW2LMG617fHwo8pbrIvLlUjDOVtW-un6_Ww61C1zgBik078L7uZmodMMAq3OXcmujXJb5sA95QFWYp1XP063aSn4t7MzYusnZsQ8UUu_k2WIiy3F668SNd0UWs_tlB9bYcc_1-0Bozqi55_yVFOkz9D5h2b1w Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 0d68710423cf4004bb1eb20d1f740ee9 Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:27:46.029160 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0d68710423cf4004bb1eb20d1f740ee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0d68710423cf4004bb1eb20d1f740ee9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0d68710423cf4004bb1eb20d1f740ee9", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0d68710423cf4004bb1eb20d1f740ee9"}]}] Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 0d68710423cf4004bb1eb20d1f740ee9 Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 49bd5b43a3b44462a6d8141d7a8a803b Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: {"hw:numa_nodes": "1"} Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:27:46.030564 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'flavor_id': '999972265', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:46.031330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 14 14:27:46.032416 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.033668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9413908b-bd20-4104-8c62-aea4d6634abe tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:46.033668 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9413908b-bd20-4104-8c62-aea4d6634abe tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068 tempest-FlavorsExtraSpecsNegativeTestJSON-2067623068-project] 10.222.0.81 "PUT /compute/v2.1/flavors/999972265/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021952 Jul 14 14:27:46.036016 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 294/631] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:27:46 2022] PUT /compute/v2.1/flavors/999972265/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:46.047831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c4343e97-708e-4eba-9745-6c763f11e731 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:46.048822 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:46.048822 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:46.062425 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c4343e97-708e-4eba-9745-6c763f11e731 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] HTTP exception thrown: Flavor 999972265 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c4343e97-708e-4eba-9745-6c763f11e731 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Request method failure captured: Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/flavors/999972265/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cfgu-g2RvvhuPbl56wIrcHH6dir-Kyqe_YVp6M5_HFrVm01pNThomZjeblJrdMRXmxUsg_pigHI6EA9w8UJtYaw-hHFpWGxfas4IBDFSbli_NRJs0dwqciUIPMzPSMRslj3zLoX0Uhue7hDLiOdSWt8Vu_7Y2PblX-Gzy59_Z0CD0g Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 2978b54db08448ea8082a551ab638a29 Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:27:46.063822 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:27:46.065234 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2978b54db08448ea8082a551ab638a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2978b54db08448ea8082a551ab638a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2978b54db08448ea8082a551ab638a29", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2978b54db08448ea8082a551ab638a29"}]}] Jul 14 14:27:46.065234 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 Jul 14 14:27:46.065234 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 2978b54db08448ea8082a551ab638a29 Jul 14 14:27:46.065234 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 Jul 14 14:27:46.065234 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin Jul 14 14:27:46.065234 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:46.065234 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:46.065234 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 819cad9555fc49268708984065fc0faf Jul 14 14:27:46.065234 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin Jul 14 14:27:46.065234 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:27:46.065234 n-d-767704-28 devstack@n-api.service[119511]: exception: Flavor 999972265 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'flavor_id': '999972265', 'id': 'hw:cpu_thread_policy'} Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 999972265 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:46.066048 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.072149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.072149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:46.072149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:46.072149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:46.072149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:46.072149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 999972265 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:27:46.072149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.072149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c4343e97-708e-4eba-9745-6c763f11e731 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Returning 404 to user: Flavor 999972265 has no extra specs with key hw:cpu_thread_policy. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:46.072149 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c4343e97-708e-4eba-9745-6c763f11e731 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/999972265/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.028167 Jul 14 14:27:46.072149 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 295/632] 10.222.0.81 () {58 vars in 1265 bytes} [Thu Jul 14 14:27:46 2022] DELETE /compute/v2.1/flavors/999972265/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:46.077006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af59ff8b-994a-4e3a-9d8c-8fdb96a18f98 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:46.080477 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-af59ff8b-994a-4e3a-9d8c-8fdb96a18f98 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af59ff8b-994a-4e3a-9d8c-8fdb96a18f98 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Request method failure captured: Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: request: PUT /compute/v2.1/flavors/999972265/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 27 Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cfgu-g2RvvhuPbl56wIrcHH6dir-Kyqe_YVp6M5_HFrVm01pNThomZjeblJrdMRXmxUsg_pigHI6EA9w8UJtYaw-hHFpWGxfas4IBDFSbli_NRJs0dwqciUIPMzPSMRslj3zLoX0Uhue7hDLiOdSWt8Vu_7Y2PblX-Gzy59_Z0CD0g Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 2978b54db08448ea8082a551ab638a29 Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:27:46.081907 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2978b54db08448ea8082a551ab638a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2978b54db08448ea8082a551ab638a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2978b54db08448ea8082a551ab638a29", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2978b54db08448ea8082a551ab638a29"}]}] Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 2978b54db08448ea8082a551ab638a29 Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 819cad9555fc49268708984065fc0faf Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: {"hw:cpu_policy": "shared"} Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:27:46.083251 n-d-767704-28 devstack@n-api.service[119511]: exception: Request body and URI mismatch Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'flavor_id': '999972265', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:46.084165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:46.085702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:46.085702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:46.085702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 14 14:27:46.085702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.085702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af59ff8b-994a-4e3a-9d8c-8fdb96a18f98 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:46.085702 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-af59ff8b-994a-4e3a-9d8c-8fdb96a18f98 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] 10.222.0.81 "PUT /compute/v2.1/flavors/999972265/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010973 Jul 14 14:27:46.093179 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 296/633] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:27:46 2022] PUT /compute/v2.1/flavors/999972265/os-extra_specs/hw:numa_nodes => generated 73 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:27:46.100184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e04300aa-c9e4-487b-916f-f24399cead1d tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e04300aa-c9e4-487b-916f-f24399cead1d tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Request method failure captured: Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: request: PUT /compute/v2.1/flavors/999972265/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 49 Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cfgu-g2RvvhuPbl56wIrcHH6dir-Kyqe_YVp6M5_HFrVm01pNThomZjeblJrdMRXmxUsg_pigHI6EA9w8UJtYaw-hHFpWGxfas4IBDFSbli_NRJs0dwqciUIPMzPSMRslj3zLoX0Uhue7hDLiOdSWt8Vu_7Y2PblX-Gzy59_Z0CD0g Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 2978b54db08448ea8082a551ab638a29 Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:27:46.105634 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:27:46.107257 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2978b54db08448ea8082a551ab638a29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2978b54db08448ea8082a551ab638a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2978b54db08448ea8082a551ab638a29", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2978b54db08448ea8082a551ab638a29"}]}] Jul 14 14:27:46.107257 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 Jul 14 14:27:46.107257 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 2978b54db08448ea8082a551ab638a29 Jul 14 14:27:46.107257 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 Jul 14 14:27:46.107257 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin Jul 14 14:27:46.107257 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:46.107257 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:46.107257 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 819cad9555fc49268708984065fc0faf Jul 14 14:27:46.107257 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin Jul 14 14:27:46.107257 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:27:46.107257 n-d-767704-28 devstack@n-api.service[119511]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 14 14:27:46.107257 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'flavor_id': '999972265', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance: Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 14 14:27:46.108233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.109909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.111412 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:46.111412 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:46.111412 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:27:46.111412 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:27:46.111412 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 14 14:27:46.111412 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.113415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e04300aa-c9e4-487b-916f-f24399cead1d tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:46.114665 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e04300aa-c9e4-487b-916f-f24399cead1d tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] 10.222.0.81 "PUT /compute/v2.1/flavors/999972265/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.019326 Jul 14 14:27:46.115424 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 297/634] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:27:46 2022] PUT /compute/v2.1/flavors/999972265/os-extra_specs/hw:numa_nodes => generated 117 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:27:46.127076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b94d273f-5399-4bbb-9818-2cf5086140c8 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:46.127873 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:46.127873 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:46.136367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=5,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:46.153514 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b94d273f-5399-4bbb-9818-2cf5086140c8 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/999972265" status: 202 len: 0 microversion: 2.1 time: 0.029195 Jul 14 14:27:46.158316 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 298/635] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:27:46 2022] DELETE /compute/v2.1/flavors/999972265 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:27:46.166026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-17ccb47d-36e3-4b85-b83e-c43c0144e000 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:46.191745 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-17ccb47d-36e3-4b85-b83e-c43c0144e000 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398 tempest-FlavorsExtraSpecsNegativeTestJSON-1523820398-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.031898 Jul 14 14:27:46.192253 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 299/636] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:46 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:46.291232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:27:46.291768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:27:46.292256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:27:46.292672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:27:46.293273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:27:46.305856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:46.306396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:46.307596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:46.308033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:46.331263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Getting quotas for project 95f1a41de5194ccd9d6997b81e920502. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:27:46.338161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Getting quotas for user 60cbbb7a6f0c4044989cf160c6e094da and project 95f1a41de5194ccd9d6997b81e920502. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:27:46.353058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.utils [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] instances quota exceeded for 95f1a41de5194ccd9d6997b81e920502, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119512) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 14 14:27:46.353850 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Request method failure captured: Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 144 Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CfbSypbfeJ8x6ZDbZIe6CdeiaC0HVdmna6FsDXBpuCe8hmDowzT12zLIvpbt6tbCY10lWjcw6Js8pzymuSUrWnZ7ujfStMn2FLqsDhp5m9bvbp7Z84Rx1yWnc44JyHp2HCTKvz2mbpZf753Zg4C4lpmNtc0zIGyNU4yjdwE_Eh5kzE Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 95f1a41de5194ccd9d6997b81e920502 Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-QuotasAdminNegativeTest-557624408 Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:46.355845 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:46.357197 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95f1a41de5194ccd9d6997b81e920502"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/95f1a41de5194ccd9d6997b81e920502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_95f1a41de5194ccd9d6997b81e920502", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95f1a41de5194ccd9d6997b81e920502"}]}] Jul 14 14:27:46.357197 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-QuotasAdminNegativeTest-557624408 Jul 14 14:27:46.357197 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 95f1a41de5194ccd9d6997b81e920502 Jul 14 14:27:46.357197 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-557624408 Jul 14 14:27:46.357197 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-QuotasAdminNegativeTest-557624408-project Jul 14 14:27:46.357197 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:46.357197 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:46.357197 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 60cbbb7a6f0c4044989cf160c6e094da Jul 14 14:27:46.357197 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-QuotasAdminNegativeTest-557624408-project Jul 14 14:27:46.357197 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:27:46.357197 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-534086887", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} Jul 14 14:27:46.357197 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-534086887', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452'}}} Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 14 14:27:46.357951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:46.362908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 802, in create Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.366352 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:46.369610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:46.369610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:46.369610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:46.369610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:46.369610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 14 14:27:46.369610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:46.369610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:46.369610 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3c2c9aab-74ab-44f6-ae92-9fa1152d46eb tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.425375 Jul 14 14:27:46.369610 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 338/637] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:45 2022] POST /compute/v2.1/servers => generated 119 bytes in 427 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:46.371505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4befcea1-441d-4aa0-a51b-f199f66f035c tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c5f2a280>, body: {"quota_set": {"instances": 10}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:46.387818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-acc662f5-164c-4360-b5a0-65c571f66d7a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:46.390531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-acc662f5-164c-4360-b5a0-65c571f66d7a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:46.410004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-acc662f5-164c-4360-b5a0-65c571f66d7a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:46.412108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-acc662f5-164c-4360-b5a0-65c571f66d7a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:46.415336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-acc662f5-164c-4360-b5a0-65c571f66d7a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:46.415992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-acc662f5-164c-4360-b5a0-65c571f66d7a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:46.628871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4befcea1-441d-4aa0-a51b-f199f66f035c tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:46.629378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4befcea1-441d-4aa0-a51b-f199f66f035c tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:46.630158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4befcea1-441d-4aa0-a51b-f199f66f035c tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:46.636045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4befcea1-441d-4aa0-a51b-f199f66f035c tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:46.686985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-acc662f5-164c-4360-b5a0-65c571f66d7a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:46.697331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-acc662f5-164c-4360-b5a0-65c571f66d7a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:46.699641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-acc662f5-164c-4360-b5a0-65c571f66d7a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:46.702012 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-acc662f5-164c-4360-b5a0-65c571f66d7a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1362 microversion: 2.25 time: 0.320174 Jul 14 14:27:46.703927 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 339/638] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:46 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:46.725396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ee63709d-8bda-47db-bc69-389bc1bd36dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:46.726260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ee63709d-8bda-47db-bc69-389bc1bd36dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:46.735535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee63709d-8bda-47db-bc69-389bc1bd36dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:46.736213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee63709d-8bda-47db-bc69-389bc1bd36dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:46.737443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee63709d-8bda-47db-bc69-389bc1bd36dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:46.738043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee63709d-8bda-47db-bc69-389bc1bd36dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:46.747353 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4befcea1-441d-4aa0-a51b-f199f66f035c tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502" status: 200 len: 329 microversion: 2.1 time: 0.384952 Jul 14 14:27:46.748144 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 300/639] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:27:46 2022] PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502 => generated 329 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:27:46.761397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c4441440-37d0-441f-978f-ce117b4e3281 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Calling method '.version_select at 0x7fd6c5e3e430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:46.988439 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c4441440-37d0-441f-978f-ce117b4e3281 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502" status: 200 len: 371 microversion: 2.1 time: 0.232484 Jul 14 14:27:46.996380 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 301/640] 10.222.0.81 () {58 vars in 1241 bytes} [Thu Jul 14 14:27:46 2022] GET /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502 => generated 371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:27:47.004281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-02934be3-f49e-4134-800f-6abe2426e340 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c5e3e040>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:47.110167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ee63709d-8bda-47db-bc69-389bc1bd36dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:47.125367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02934be3-f49e-4134-800f-6abe2426e340 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:47.126305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02934be3-f49e-4134-800f-6abe2426e340 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:47.127269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02934be3-f49e-4134-800f-6abe2426e340 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:47.129588 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ee63709d-8bda-47db-bc69-389bc1bd36dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.411300 Jul 14 14:27:47.130374 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 340/641] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:46 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:47.134425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02934be3-f49e-4134-800f-6abe2426e340 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:47.154716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-00c583d2-0ba0-4791-89e4-eb969ce8777a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:47.160081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-00c583d2-0ba0-4791-89e4-eb969ce8777a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:47.190718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00c583d2-0ba0-4791-89e4-eb969ce8777a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:47.191995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00c583d2-0ba0-4791-89e4-eb969ce8777a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:47.195625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00c583d2-0ba0-4791-89e4-eb969ce8777a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:47.196837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00c583d2-0ba0-4791-89e4-eb969ce8777a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:47.291970 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-02934be3-f49e-4134-800f-6abe2426e340 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502" status: 200 len: 325 microversion: 2.1 time: 0.293403 Jul 14 14:27:47.292881 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 302/642] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:27:46 2022] PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502 => generated 325 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:47.441164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1389344037", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:47.533043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:27:47.700420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-00c583d2-0ba0-4791-89e4-eb969ce8777a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:47.736724 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-00c583d2-0ba0-4791-89e4-eb969ce8777a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1493 microversion: 2.1 time: 0.589714 Jul 14 14:27:47.738238 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 341/643] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:47 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1493 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:47.750748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-96ccd4e1-812e-4ab8-a1c1-216c7f481894 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:47.751985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-96ccd4e1-812e-4ab8-a1c1-216c7f481894 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:47.769311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96ccd4e1-812e-4ab8-a1c1-216c7f481894 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:47.770112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96ccd4e1-812e-4ab8-a1c1-216c7f481894 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:47.772004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96ccd4e1-812e-4ab8-a1c1-216c7f481894 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:47.772693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96ccd4e1-812e-4ab8-a1c1-216c7f481894 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:48.291816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:27:48.292850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:27:48.293882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:27:48.295126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:27:48.295883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:27:48.310923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:48.311997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:48.312867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:48.313800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:48.323984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-96ccd4e1-812e-4ab8-a1c1-216c7f481894 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:48.340684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Getting quotas for project 95f1a41de5194ccd9d6997b81e920502. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:27:48.341244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-96ccd4e1-812e-4ab8-a1c1-216c7f481894 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:48.343306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-96ccd4e1-812e-4ab8-a1c1-216c7f481894 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:48.347246 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-96ccd4e1-812e-4ab8-a1c1-216c7f481894 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1362 microversion: 2.25 time: 0.603307 Jul 14 14:27:48.349210 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 342/644] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:47 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:48.355551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Getting quotas for user 60cbbb7a6f0c4044989cf160c6e094da and project 95f1a41de5194ccd9d6997b81e920502. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:27:48.360597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d6d26081-ab90-4ebe-bd7a-1e88d66cbd48 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '.version_select at 0x7fd6c605b940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:48.365678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6d26081-ab90-4ebe-bd7a-1e88d66cbd48 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:48.366456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6d26081-ab90-4ebe-bd7a-1e88d66cbd48 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:48.392421 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d6d26081-ab90-4ebe-bd7a-1e88d66cbd48 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 1584 microversion: 2.1 time: 0.037642 Jul 14 14:27:48.392976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.utils [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] ram quota exceeded for 95f1a41de5194ccd9d6997b81e920502, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119511) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 14 14:27:48.393996 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 14 14:27:48.403451 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 343/645] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:27:48 2022] GET /compute/v2.1/os-migrations => generated 1584 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Request method failure captured: Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 145 Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CfbSypbfeJ8x6ZDbZIe6CdeiaC0HVdmna6FsDXBpuCe8hmDowzT12zLIvpbt6tbCY10lWjcw6Js8pzymuSUrWnZ7ujfStMn2FLqsDhp5m9bvbp7Z84Rx1yWnc44JyHp2HCTKvz2mbpZf753Zg4C4lpmNtc0zIGyNU4yjdwE_Eh5kzE Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 95f1a41de5194ccd9d6997b81e920502 Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-QuotasAdminNegativeTest-557624408 Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:27:48.405730 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:27:48.407569 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95f1a41de5194ccd9d6997b81e920502"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/95f1a41de5194ccd9d6997b81e920502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_95f1a41de5194ccd9d6997b81e920502", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95f1a41de5194ccd9d6997b81e920502"}]}] Jul 14 14:27:48.407569 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-QuotasAdminNegativeTest-557624408 Jul 14 14:27:48.407569 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 95f1a41de5194ccd9d6997b81e920502 Jul 14 14:27:48.407569 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-557624408 Jul 14 14:27:48.407569 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-QuotasAdminNegativeTest-557624408-project Jul 14 14:27:48.407569 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:48.407569 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:48.407569 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 60cbbb7a6f0c4044989cf160c6e094da Jul 14 14:27:48.407569 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-QuotasAdminNegativeTest-557624408-project Jul 14 14:27:48.407569 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:27:48.407569 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1389344037", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} Jul 14 14:27:48.407569 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1389344037', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452'}}} Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 14 14:27:48.408484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:48.409780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 802, in create Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:48.412477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:48.418921 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:48.418921 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:48.418921 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:48.418921 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:48.418921 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 14 14:27:48.418921 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:48.418921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:48.418921 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-23b25cfb-4e2c-4ee0-9bdc-75f68b41a615 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.975579 Jul 14 14:27:48.418921 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 303/646] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:47 2022] POST /compute/v2.1/servers => generated 110 bytes in 977 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:48.420823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8ccce2f-4683-444a-9bfd-b9d870bb9aa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:48.420823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8ccce2f-4683-444a-9bfd-b9d870bb9aa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:48.421156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f73181b9-3fd7-4545-ae2b-9bd8703ed27e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:48.421156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f73181b9-3fd7-4545-ae2b-9bd8703ed27e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:48.435777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8ccce2f-4683-444a-9bfd-b9d870bb9aa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:48.436457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8ccce2f-4683-444a-9bfd-b9d870bb9aa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:48.437649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8ccce2f-4683-444a-9bfd-b9d870bb9aa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:48.438277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8ccce2f-4683-444a-9bfd-b9d870bb9aa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:48.493303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f73181b9-3fd7-4545-ae2b-9bd8703ed27e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:48.493973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f73181b9-3fd7-4545-ae2b-9bd8703ed27e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:48.513905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f73181b9-3fd7-4545-ae2b-9bd8703ed27e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:48.520330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f73181b9-3fd7-4545-ae2b-9bd8703ed27e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:49.203008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f8ccce2f-4683-444a-9bfd-b9d870bb9aa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:49.218081 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8ccce2f-4683-444a-9bfd-b9d870bb9aa4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.816027 Jul 14 14:27:49.218707 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 344/647] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:48 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:49.235331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f72199a-f6a3-458c-9b51-40cb7081a006 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c5fcf040>, body: {"quota_set": {"ram": 51200}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:49.402090 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f73181b9-3fd7-4545-ae2b-9bd8703ed27e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1646 microversion: 2.1 time: 0.987412 Jul 14 14:27:49.403313 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 304/648] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:48 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1646 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:49.409782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-79ad5a0c-0ee7-4da6-b4c7-6d0439e1a5e8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:49.410727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-79ad5a0c-0ee7-4da6-b4c7-6d0439e1a5e8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:49.419931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79ad5a0c-0ee7-4da6-b4c7-6d0439e1a5e8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:49.420756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79ad5a0c-0ee7-4da6-b4c7-6d0439e1a5e8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:49.422027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79ad5a0c-0ee7-4da6-b4c7-6d0439e1a5e8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:49.422921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79ad5a0c-0ee7-4da6-b4c7-6d0439e1a5e8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:49.661630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f72199a-f6a3-458c-9b51-40cb7081a006 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:49.662229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f72199a-f6a3-458c-9b51-40cb7081a006 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:49.663275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f72199a-f6a3-458c-9b51-40cb7081a006 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:49.664102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f72199a-f6a3-458c-9b51-40cb7081a006 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:49.703516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-79ad5a0c-0ee7-4da6-b4c7-6d0439e1a5e8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:49.714514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-79ad5a0c-0ee7-4da6-b4c7-6d0439e1a5e8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:49.717321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-79ad5a0c-0ee7-4da6-b4c7-6d0439e1a5e8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:49.718946 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-79ad5a0c-0ee7-4da6-b4c7-6d0439e1a5e8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1362 microversion: 2.25 time: 0.314154 Jul 14 14:27:49.720480 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 305/649] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:49 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:49.778622 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f72199a-f6a3-458c-9b51-40cb7081a006 tempest-QuotasAdminNegativeTest-277017864 tempest-QuotasAdminNegativeTest-277017864-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502" status: 200 len: 329 microversion: 2.1 time: 0.557380 Jul 14 14:27:49.780174 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 345/650] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:27:49 2022] PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502 => generated 329 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:49.791074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-344588022", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "6831672f-d329-4243-a142-ff7ed2c51723"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:49.816198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-155893015", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "f60a03a5-5c69-46c6-a6b0-dc861f1252e4"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:49.889560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] validate_networks() for [('f60a03a5-5c69-46c6-a6b0-dc861f1252e4', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:27:49.901121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] validate_networks() for [('6831672f-d329-4243-a142-ff7ed2c51723', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:27:50.748511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:27:50.749157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:27:50.749937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:27:50.750362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:27:50.750778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:27:50.765157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:27:50.765677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:27:50.766057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:27:50.766468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:27:50.766883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:27:50.778180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:50.778633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:50.779477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:50.781279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:50.783063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:50.785761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:50.786932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:50.787496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:50.793118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=17 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:50.806907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Getting quotas for project 7e2150f294254b548ec58ab159f740db. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:27:50.814066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Getting quotas for user d94f5ca350784e759e5bd3367fec0ac6 and project 7e2150f294254b548ec58ab159f740db. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:27:50.819226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Getting quotas for project eb57648abd7742d9aac69af1744d6bc1. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:27:50.828310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Getting quotas for user 5c688cde0ea44a059b0bca3e020c28b3 and project eb57648abd7742d9aac69af1744d6bc1. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:27:50.831505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:27:50.834495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:27:50.849521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:27:50.854018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:27:50.892265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:50.909348 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4d5b8422-8ba5-4c2c-9d38-2242eb281b69 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187159 Jul 14 14:27:50.910511 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 306/651] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:27:50.917421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44e3f0d2-883c-4f24-9360-6795de4a7729 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Action: 'update', calling method: .version_select at 0x7fd6c5da6040>, body: {"quota_set": {"ram": 0}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:50.922258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-44e3f0d2-883c-4f24-9360-6795de4a7729 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '60cbbb7a6f0c4044989cf160c6e094da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f1a41de5194ccd9d6997b81e920502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44e3f0d2-883c-4f24-9360-6795de4a7729 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Request method failure captured: Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: request: PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502 HTTP/1.1 Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 25 Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CfbSypbfeJ8x6ZDbZIe6CdeiaC0HVdmna6FsDXBpuCe8hmDowzT12zLIvpbt6tbCY10lWjcw6Js8pzymuSUrWnZ7ujfStMn2FLqsDhp5m9bvbp7Z84Rx1yWnc44JyHp2HCTKvz2mbpZf753Zg4C4lpmNtc0zIGyNU4yjdwE_Eh5kzE Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 95f1a41de5194ccd9d6997b81e920502 Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-QuotasAdminNegativeTest-557624408 Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:27:50.925699 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95f1a41de5194ccd9d6997b81e920502"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/95f1a41de5194ccd9d6997b81e920502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_95f1a41de5194ccd9d6997b81e920502", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/95f1a41de5194ccd9d6997b81e920502"}]}] Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-QuotasAdminNegativeTest-557624408 Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 95f1a41de5194ccd9d6997b81e920502 Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-557624408 Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-QuotasAdminNegativeTest-557624408-project Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 60cbbb7a6f0c4044989cf160c6e094da Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-QuotasAdminNegativeTest-557624408-project Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: {"quota_set": {"ram": 0}} Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 14 14:27:50.927037 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '95f1a41de5194ccd9d6997b81e920502', 'body': {'quota_set': {'ram': 0}}} Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:50.928290 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:50.931844 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:50.935395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:50.935395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:50.935395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:50.935395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:50.935395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 14 14:27:50.935395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:50.939547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44e3f0d2-883c-4f24-9360-6795de4a7729 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:50.940969 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-44e3f0d2-883c-4f24-9360-6795de4a7729 tempest-QuotasAdminNegativeTest-557624408 tempest-QuotasAdminNegativeTest-557624408-project] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502" status: 403 len: 116 microversion: 2.1 time: 0.028997 Jul 14 14:27:50.941972 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 307/652] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:27:50 2022] PUT /compute/v2.1/os-quota-sets/95f1a41de5194ccd9d6997b81e920502 => generated 116 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:50.953770 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-56fb35b3-f18e-4b6e-a675-7eaf86ae853f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171887 Jul 14 14:27:50.960881 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 346/653] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:27:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:27:50.984730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5804eeaa-2492-4fbb-9ab7-0ddf270a1fd3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:50.986639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5804eeaa-2492-4fbb-9ab7-0ddf270a1fd3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:50.989326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-241bd672-ae17-4156-8af1-cb53645a8390 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:50.990744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-241bd672-ae17-4156-8af1-cb53645a8390 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:51.014986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5804eeaa-2492-4fbb-9ab7-0ddf270a1fd3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:51.015559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5804eeaa-2492-4fbb-9ab7-0ddf270a1fd3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:51.016458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5804eeaa-2492-4fbb-9ab7-0ddf270a1fd3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:51.016913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5804eeaa-2492-4fbb-9ab7-0ddf270a1fd3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:51.028431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-241bd672-ae17-4156-8af1-cb53645a8390 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:51.030430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-241bd672-ae17-4156-8af1-cb53645a8390 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:51.032118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-241bd672-ae17-4156-8af1-cb53645a8390 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:51.033421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-241bd672-ae17-4156-8af1-cb53645a8390 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:51.745636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5804eeaa-2492-4fbb-9ab7-0ddf270a1fd3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:51.765616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5804eeaa-2492-4fbb-9ab7-0ddf270a1fd3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:51.770069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5804eeaa-2492-4fbb-9ab7-0ddf270a1fd3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:51.775000 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5804eeaa-2492-4fbb-9ab7-0ddf270a1fd3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1362 microversion: 2.25 time: 0.810165 Jul 14 14:27:51.775756 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 347/654] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:50 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1362 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:51.807661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-68eeb197-16f8-4566-b883-22487619b23f tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:51.811865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-68eeb197-16f8-4566-b883-22487619b23f tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:51.862633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-241bd672-ae17-4156-8af1-cb53645a8390 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:51.875253 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-241bd672-ae17-4156-8af1-cb53645a8390 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.930985 Jul 14 14:27:51.876648 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 308/655] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:50 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:51.892559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e781f8fa-ff5d-486f-abbb-c410a375b48e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:51.895735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e781f8fa-ff5d-486f-abbb-c410a375b48e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:51.986505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-68eeb197-16f8-4566-b883-22487619b23f tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:51.998884 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-68eeb197-16f8-4566-b883-22487619b23f tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1215 microversion: 2.1 time: 0.220658 Jul 14 14:27:51.999851 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 348/656] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:51 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:52.019636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c0339820-0e18-4678-9fe3-0a121a20cef1 req-c28b9056-49ff-4d2b-94b1-7817498de1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037d7f27-c02b-4c2e-8039-2efba995484d", "name": "network-vif-plugged", "status": "completed", "tag": "f836c7c7-f03f-4d05-a974-793760051e3e"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:52.049982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c0339820-0e18-4678-9fe3-0a121a20cef1 req-c28b9056-49ff-4d2b-94b1-7817498de1d2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:52.050584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c0339820-0e18-4678-9fe3-0a121a20cef1 req-c28b9056-49ff-4d2b-94b1-7817498de1d2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:52.107171 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c0339820-0e18-4678-9fe3-0a121a20cef1 req-c28b9056-49ff-4d2b-94b1-7817498de1d2 service nova] Creating event network-vif-plugged:f836c7c7-f03f-4d05-a974-793760051e3e for instance 037d7f27-c02b-4c2e-8039-2efba995484d on n-h2-767704-28 Jul 14 14:27:52.108047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e781f8fa-ff5d-486f-abbb-c410a375b48e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:52.122090 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c0339820-0e18-4678-9fe3-0a121a20cef1 req-c28b9056-49ff-4d2b-94b1-7817498de1d2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111535 Jul 14 14:27:52.123430 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e781f8fa-ff5d-486f-abbb-c410a375b48e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1210 microversion: 2.1 time: 0.243769 Jul 14 14:27:52.125359 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 309/657] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:51 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1210 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:52.134184 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 349/658] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:53.034545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd1de0e6-ef40-4d28-b83c-4622e66c0196 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Calling method '.version_select at 0x7fd6c5f10ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:53.037823 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:53.037823 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:53.041530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd1de0e6-ef40-4d28-b83c-4622e66c0196 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.041987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd1de0e6-ef40-4d28-b83c-4622e66c0196 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.064991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd1de0e6-ef40-4d28-b83c-4622e66c0196 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.065449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd1de0e6-ef40-4d28-b83c-4622e66c0196 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.083105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd1de0e6-ef40-4d28-b83c-4622e66c0196 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.083828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd1de0e6-ef40-4d28-b83c-4622e66c0196 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.093900 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bd1de0e6-ef40-4d28-b83c-4622e66c0196 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.430769 Jul 14 14:27:53.095039 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 350/659] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:53.103124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4df8794f-b144-4c07-9ae6-7a3401870f8b tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "658627f4-1fa9-4edf-aeb3-91e09d7cca08"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:53.104318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4df8794f-b144-4c07-9ae6-7a3401870f8b tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:53.109876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3977227b-8792-4bcd-aeb6-1c9876e27510 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:53.110988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3977227b-8792-4bcd-aeb6-1c9876e27510 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:53.112841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4df8794f-b144-4c07-9ae6-7a3401870f8b tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.113349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4df8794f-b144-4c07-9ae6-7a3401870f8b tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.114500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4df8794f-b144-4c07-9ae6-7a3401870f8b tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.115108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4df8794f-b144-4c07-9ae6-7a3401870f8b tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.119103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3977227b-8792-4bcd-aeb6-1c9876e27510 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.119544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3977227b-8792-4bcd-aeb6-1c9876e27510 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.120340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3977227b-8792-4bcd-aeb6-1c9876e27510 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.120997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3977227b-8792-4bcd-aeb6-1c9876e27510 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.373608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3977227b-8792-4bcd-aeb6-1c9876e27510 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:53.383243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3977227b-8792-4bcd-aeb6-1c9876e27510 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:53.385042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3977227b-8792-4bcd-aeb6-1c9876e27510 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:53.386374 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3977227b-8792-4bcd-aeb6-1c9876e27510 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1362 microversion: 2.25 time: 0.290201 Jul 14 14:27:53.396847 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 351/660] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:53 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:53.396847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af0b98db-734c-4481-bd8c-f78ba06a8935 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:53.396847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-af0b98db-734c-4481-bd8c-f78ba06a8935 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:53.408399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af0b98db-734c-4481-bd8c-f78ba06a8935 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.408866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af0b98db-734c-4481-bd8c-f78ba06a8935 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.409720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af0b98db-734c-4481-bd8c-f78ba06a8935 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.410170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af0b98db-734c-4481-bd8c-f78ba06a8935 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.434124 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-4df8794f-b144-4c07-9ae6-7a3401870f8b tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] HTTP exception thrown: Volume 658627f4-1fa9-4edf-aeb3-91e09d7cca08 could not be found. Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4df8794f-b144-4c07-9ae6-7a3401870f8b tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Request method failure captured: Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: request: PUT /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments/ae4deee5-d4e8-4438-9796-7e0727037621 HTTP/1.1 Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 74 Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CeJSpugylLDCKREynaE0a_TMPuxHgcZUgghgcL-JOd-9BZ_P0tBED7OVNwonlYGgmhgCeYDWZ-gBdS7OrZDzTKWV3OdFS0RBQXt1nWe9wCK0gUz_Sf3luKRpmARhOQQ4oJ7holHPbmlo_QeSmxHH7RlhT1ChJ92-4VhNFgd8Iaf6uI Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 28787dd343c2438cabc365053011c945 Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesAdminNegativeTest-582627744 Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:27:53.441649 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/28787dd343c2438cabc365053011c945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/28787dd343c2438cabc365053011c945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_28787dd343c2438cabc365053011c945", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/28787dd343c2438cabc365053011c945"}]}] Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesAdminNegativeTest-582627744 Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 28787dd343c2438cabc365053011c945 Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-582627744 Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesAdminNegativeTest-582627744-project-admin Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 528e4c34cd7f44099558178b22d62bbe Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesAdminNegativeTest-582627744-project-admin Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: {"volumeAttachment": {"volumeId": "658627f4-1fa9-4edf-aeb3-91e09d7cca08"}} Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:27:53.448035 n-d-767704-28 devstack@n-api.service[119511]: exception: Volume 658627f4-1fa9-4edf-aeb3-91e09d7cca08 could not be found. Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'server_id': '60f1d989-211a-466d-9a7a-a1a9303daf5d', 'id': 'ae4deee5-d4e8-4438-9796-7e0727037621', 'body': {'volumeAttachment': {'volumeId': '658627f4-1fa9-4edf-aeb3-91e09d7cca08'}}} Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:27:53.459258 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 658627f4-1fa9-4edf-aeb3-91e09d7cca08 could not be found. (HTTP 404) (Request-ID: req-07b7d7eb-6c43-46fc-ac7d-7fa66599aabc) Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:27:53.464014 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 658627f4-1fa9-4edf-aeb3-91e09d7cca08 could not be found. Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:53.467260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 658627f4-1fa9-4edf-aeb3-91e09d7cca08 could not be found. Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 658627f4-1fa9-4edf-aeb3-91e09d7cca08 could not be found. Jul 14 14:27:53.470849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:53.474088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4df8794f-b144-4c07-9ae6-7a3401870f8b tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Returning 400 to user: Volume 658627f4-1fa9-4edf-aeb3-91e09d7cca08 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:53.474088 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4df8794f-b144-4c07-9ae6-7a3401870f8b tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] 10.222.0.81 "PUT /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments/ae4deee5-d4e8-4438-9796-7e0727037621" status: 400 len: 107 microversion: 2.1 time: 1.327890 Jul 14 14:27:53.474088 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 310/661] 10.222.0.81 () {60 vars in 1432 bytes} [Thu Jul 14 14:27:52 2022] PUT /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments/ae4deee5-d4e8-4438-9796-7e0727037621 => generated 107 bytes in 1330 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:27:53.474088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6b8acb67-b246-4e21-9444-d2b2f89afb7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:53.474088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6b8acb67-b246-4e21-9444-d2b2f89afb7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:53.497427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b8acb67-b246-4e21-9444-d2b2f89afb7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.501533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b8acb67-b246-4e21-9444-d2b2f89afb7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.503223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b8acb67-b246-4e21-9444-d2b2f89afb7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.516652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b8acb67-b246-4e21-9444-d2b2f89afb7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.698015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6b8acb67-b246-4e21-9444-d2b2f89afb7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:53.713146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-af0b98db-734c-4481-bd8c-f78ba06a8935 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:53.723400 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af0b98db-734c-4481-bd8c-f78ba06a8935 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.334853 Jul 14 14:27:53.735262 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 352/662] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:53 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:53.738062 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6b8acb67-b246-4e21-9444-d2b2f89afb7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1267 microversion: 2.1 time: 0.270957 Jul 14 14:27:53.739264 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 311/663] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:53 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1267 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:53.746212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-11f6856d-85d0-49a8-8257-43d56327d549 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:53.747922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-11f6856d-85d0-49a8-8257-43d56327d549 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:53.756004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11f6856d-85d0-49a8-8257-43d56327d549 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.756821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11f6856d-85d0-49a8-8257-43d56327d549 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.758982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11f6856d-85d0-49a8-8257-43d56327d549 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.760150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11f6856d-85d0-49a8-8257-43d56327d549 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.889518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-11f6856d-85d0-49a8-8257-43d56327d549 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:53.900106 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-11f6856d-85d0-49a8-8257-43d56327d549 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1280 microversion: 2.1 time: 0.158283 Jul 14 14:27:53.904991 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 312/664] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:53 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1280 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:53.952655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-73a4efd3-fdfe-443d-96f7-e680d9f40a9f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:53.956163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-73a4efd3-fdfe-443d-96f7-e680d9f40a9f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:53.987288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73a4efd3-fdfe-443d-96f7-e680d9f40a9f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.988351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73a4efd3-fdfe-443d-96f7-e680d9f40a9f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:53.990087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73a4efd3-fdfe-443d-96f7-e680d9f40a9f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:53.994376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73a4efd3-fdfe-443d-96f7-e680d9f40a9f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:54.387006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-73a4efd3-fdfe-443d-96f7-e680d9f40a9f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lazy-loading 'services' on Instance uuid 60f1d989-211a-466d-9a7a-a1a9303daf5d {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:54.818527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb94d321-8adb-4f80-a988-5fa6e3d15bce tempest-HypervisorAdminNegativeUnderV252Test-1432608434 tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project] Calling method '.version_select at 0x7fd6c5eb64c0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:54.820074 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:54.820074 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:27:54.823107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bb94d321-8adb-4f80-a988-5fa6e3d15bce tempest-HypervisorAdminNegativeUnderV252Test-1432608434 tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '9de3aa50ec1c4ec08e7a98d79fcca73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee777d0758c4f32ad7da41020225774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb94d321-8adb-4f80-a988-5fa6e3d15bce tempest-HypervisorAdminNegativeUnderV252Test-1432608434 tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project] Request method failure captured: Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-hypervisors/n-h2-767704-28/search HTTP/1.1 Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CfmWoSXw9yvUhzVBNPnQS83Uc3CrgMtXQTaOKMcxdY56achwSdmuElse6uySZlncMzHPld1TTIEQD8dEXWCRGJNgP71vWlK4EfPkbzidPr12qOmqb7sbYI2Pw1y836G4-LlB4OPHx0tlXvxCaf5m3vpveArHxnqit8zg42auEc1D2A Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 9ee777d0758c4f32ad7da41020225774 Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1432608434 Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:27:54.825682 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:27:54.827740 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9ee777d0758c4f32ad7da41020225774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9ee777d0758c4f32ad7da41020225774"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9ee777d0758c4f32ad7da41020225774", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9ee777d0758c4f32ad7da41020225774"}]}] Jul 14 14:27:54.827740 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1432608434 Jul 14 14:27:54.827740 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 9ee777d0758c4f32ad7da41020225774 Jul 14 14:27:54.827740 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1432608434 Jul 14 14:27:54.827740 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project Jul 14 14:27:54.827740 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:27:54.827740 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:27:54.827740 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9de3aa50ec1c4ec08e7a98d79fcca73d Jul 14 14:27:54.827740 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project Jul 14 14:27:54.827740 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:27:54.827740 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 14 14:27:54.827740 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'n-h2-767704-28'} Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:54.828726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 14 14:27:54.829992 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:27:54.831280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb94d321-8adb-4f80-a988-5fa6e3d15bce tempest-HypervisorAdminNegativeUnderV252Test-1432608434 tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:54.831280 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bb94d321-8adb-4f80-a988-5fa6e3d15bce tempest-HypervisorAdminNegativeUnderV252Test-1432608434 tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/n-h2-767704-28/search" status: 403 len: 117 microversion: 2.1 time: 1.091927 Jul 14 14:27:54.831280 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 353/665] 10.222.0.81 () {58 vars in 1211 bytes} [Thu Jul 14 14:27:53 2022] GET /compute/v2.1/os-hypervisors/n-h2-767704-28/search => generated 117 bytes in 1093 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:54.844582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-063555c6-5697-4db6-a10e-02ed48b685fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:54.848603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-063555c6-5697-4db6-a10e-02ed48b685fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:54.860448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-063555c6-5697-4db6-a10e-02ed48b685fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:54.861236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-063555c6-5697-4db6-a10e-02ed48b685fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:54.862237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-063555c6-5697-4db6-a10e-02ed48b685fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:54.863070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-063555c6-5697-4db6-a10e-02ed48b685fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.089984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:55.113924 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-73a4efd3-fdfe-443d-96f7-e680d9f40a9f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "DELETE /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments/ae4deee5-d4e8-4438-9796-7e0727037621" status: 202 len: 0 microversion: 2.1 time: 1.170110 Jul 14 14:27:55.115073 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 313/666] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 14:27:53 2022] DELETE /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments/ae4deee5-d4e8-4438-9796-7e0727037621 => generated 0 bytes in 1173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:27:55.131403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac059038-fdb7-498f-803d-23feab6b666d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:55.133277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ac059038-fdb7-498f-803d-23feab6b666d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:55.149873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac059038-fdb7-498f-803d-23feab6b666d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.151213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac059038-fdb7-498f-803d-23feab6b666d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.153078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac059038-fdb7-498f-803d-23feab6b666d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.154191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac059038-fdb7-498f-803d-23feab6b666d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.399046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-063555c6-5697-4db6-a10e-02ed48b685fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:55.409887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-063555c6-5697-4db6-a10e-02ed48b685fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:55.413331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-063555c6-5697-4db6-a10e-02ed48b685fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:55.416024 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-063555c6-5697-4db6-a10e-02ed48b685fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1558 microversion: 2.25 time: 0.581899 Jul 14 14:27:55.416970 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 354/667] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:54 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1558 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:55.422599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b8407932-e734-4b1e-8cf9-27df4dba0451 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:55.423758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b8407932-e734-4b1e-8cf9-27df4dba0451 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:55.431257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8407932-e734-4b1e-8cf9-27df4dba0451 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.432007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8407932-e734-4b1e-8cf9-27df4dba0451 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.432820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8407932-e734-4b1e-8cf9-27df4dba0451 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.433296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8407932-e734-4b1e-8cf9-27df4dba0451 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.488819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ac059038-fdb7-498f-803d-23feab6b666d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:55.499202 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ac059038-fdb7-498f-803d-23feab6b666d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.376825 Jul 14 14:27:55.500738 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 314/668] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:55 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:55.506917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6d7e2b9-f2d8-492e-b732-d10c266a4371 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Calling method '.version_select at 0x7fd6c5f1aca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:55.509293 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:55.509293 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:55.510575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6d7e2b9-f2d8-492e-b732-d10c266a4371 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.512029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6d7e2b9-f2d8-492e-b732-d10c266a4371 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.521504 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b6d7e2b9-f2d8-492e-b732-d10c266a4371 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6d7e2b9-f2d8-492e-b732-d10c266a4371 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Request method failure captured: Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CfoC_a5BlEVIQn6i_ZEQ7m6zvQ891GOBk_Y08jPI0j_kQGIyHtLq-TjO-csNcUjNc2X7mJDz8a32lU0Jar4t-4-N2R5EI7JCcLpwa2oXGo8elq1xfk6z9-SVtuDf222fY0iE1HR9qD1MaXONdhEsBk097oXv0-NQpKzpsUX9aM_3oY Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 7ea2daf78e534b20aba94a7dc9851685 Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-71612873 Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:27:55.526620 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:27:55.528328 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ea2daf78e534b20aba94a7dc9851685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7ea2daf78e534b20aba94a7dc9851685"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7ea2daf78e534b20aba94a7dc9851685", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ea2daf78e534b20aba94a7dc9851685"}]}] Jul 14 14:27:55.528328 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-71612873 Jul 14 14:27:55.528328 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 7ea2daf78e534b20aba94a7dc9851685 Jul 14 14:27:55.528328 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-71612873 Jul 14 14:27:55.528328 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin Jul 14 14:27:55.528328 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:55.528328 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:55.528328 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 808b7656b03a4f91a4817528709e1598 Jul 14 14:27:55.528328 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin Jul 14 14:27:55.528328 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:27:55.528328 n-d-767704-28 devstack@n-api.service[119511]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 14 14:27:55.528328 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:55.529312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:55.530744 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:55.530744 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:55.530744 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:55.530744 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 14 14:27:55.530744 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:55.533209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6d7e2b9-f2d8-492e-b732-d10c266a4371 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:55.534687 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b6d7e2b9-f2d8-492e-b732-d10c266a4371 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.032571 Jul 14 14:27:55.535924 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 315/669] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 14:27:55 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:55.547111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ccf9d349-97f7-48da-8e19-dd6f0b525f54 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:55.548018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ccf9d349-97f7-48da-8e19-dd6f0b525f54 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:55.564899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ccf9d349-97f7-48da-8e19-dd6f0b525f54 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.566286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ccf9d349-97f7-48da-8e19-dd6f0b525f54 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.568232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ccf9d349-97f7-48da-8e19-dd6f0b525f54 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.568991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ccf9d349-97f7-48da-8e19-dd6f0b525f54 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.735893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ccf9d349-97f7-48da-8e19-dd6f0b525f54 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:55.764497 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ccf9d349-97f7-48da-8e19-dd6f0b525f54 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1268 microversion: 2.1 time: 0.225763 Jul 14 14:27:55.765677 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 316/670] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:55 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1268 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:55.775572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3468fbf5-d374-4591-b50b-bc35442fdc21 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:55.779055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3468fbf5-d374-4591-b50b-bc35442fdc21 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:55.790939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3468fbf5-d374-4591-b50b-bc35442fdc21 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.791819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3468fbf5-d374-4591-b50b-bc35442fdc21 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.793844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3468fbf5-d374-4591-b50b-bc35442fdc21 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.793844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3468fbf5-d374-4591-b50b-bc35442fdc21 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.840806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b8407932-e734-4b1e-8cf9-27df4dba0451 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:55.863330 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b8407932-e734-4b1e-8cf9-27df4dba0451 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1315 microversion: 2.1 time: 0.444487 Jul 14 14:27:55.877800 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 355/671] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:55 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:55.887044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5c94948f-8c92-4d41-930b-2f04415b9bcd tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:55.888792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5c94948f-8c92-4d41-930b-2f04415b9bcd tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:55.889017 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3468fbf5-d374-4591-b50b-bc35442fdc21 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120556 Jul 14 14:27:55.902664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c94948f-8c92-4d41-930b-2f04415b9bcd tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.903377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c94948f-8c92-4d41-930b-2f04415b9bcd tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.904664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c94948f-8c92-4d41-930b-2f04415b9bcd tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.905421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c94948f-8c92-4d41-930b-2f04415b9bcd tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.917582 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 317/672] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:27:55 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:55.936225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21389b86-afeb-45c8-ba2d-a0b537900c87 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Calling method '.version_select at 0x7fd6c60eb790>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:55.939295 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:55.939295 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:55.952303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21389b86-afeb-45c8-ba2d-a0b537900c87 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.952770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21389b86-afeb-45c8-ba2d-a0b537900c87 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:55.992130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21389b86-afeb-45c8-ba2d-a0b537900c87 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:55.992598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21389b86-afeb-45c8-ba2d-a0b537900c87 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:56.015841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21389b86-afeb-45c8-ba2d-a0b537900c87 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:56.016581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21389b86-afeb-45c8-ba2d-a0b537900c87 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:56.025833 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21389b86-afeb-45c8-ba2d-a0b537900c87 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.103915 Jul 14 14:27:56.027164 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 318/673] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:27:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:56.039315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5e1f09f-53d1-491c-9759-b13a4ea9c2c8 tempest-HypervisorAdminNegativeUnderV252Test-1432608434 tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project] Calling method '.version_select at 0x7fd6c5f9a9d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:56.039934 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:56.039934 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:56.041314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d5e1f09f-53d1-491c-9759-b13a4ea9c2c8 tempest-HypervisorAdminNegativeUnderV252Test-1432608434 tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '9de3aa50ec1c4ec08e7a98d79fcca73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee777d0758c4f32ad7da41020225774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5e1f09f-53d1-491c-9759-b13a4ea9c2c8 tempest-HypervisorAdminNegativeUnderV252Test-1432608434 tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project] Request method failure captured: Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CfmWoSXw9yvUhzVBNPnQS83Uc3CrgMtXQTaOKMcxdY56achwSdmuElse6uySZlncMzHPld1TTIEQD8dEXWCRGJNgP71vWlK4EfPkbzidPr12qOmqb7sbYI2Pw1y836G4-LlB4OPHx0tlXvxCaf5m3vpveArHxnqit8zg42auEc1D2A Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 9ee777d0758c4f32ad7da41020225774 Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1432608434 Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:27:56.043016 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:27:56.044611 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9ee777d0758c4f32ad7da41020225774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9ee777d0758c4f32ad7da41020225774"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9ee777d0758c4f32ad7da41020225774", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9ee777d0758c4f32ad7da41020225774"}]}] Jul 14 14:27:56.044611 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1432608434 Jul 14 14:27:56.044611 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 9ee777d0758c4f32ad7da41020225774 Jul 14 14:27:56.044611 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1432608434 Jul 14 14:27:56.044611 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project Jul 14 14:27:56.044611 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:56.044611 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:56.044611 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9de3aa50ec1c4ec08e7a98d79fcca73d Jul 14 14:27:56.044611 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project Jul 14 14:27:56.044611 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:27:56.044611 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 14 14:27:56.044611 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '1'} Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:27:56.045517 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 14 14:27:56.047001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:56.049627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5e1f09f-53d1-491c-9759-b13a4ea9c2c8 tempest-HypervisorAdminNegativeUnderV252Test-1432608434 tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:56.050674 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d5e1f09f-53d1-491c-9759-b13a4ea9c2c8 tempest-HypervisorAdminNegativeUnderV252Test-1432608434 tempest-HypervisorAdminNegativeUnderV252Test-1432608434-project] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.016601 Jul 14 14:27:56.051740 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 319/674] 10.222.0.81 () {58 vars in 1175 bytes} [Thu Jul 14 14:27:56 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:56.063075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b8c5c0c-a695-45f0-980d-7e50ab745384 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Calling method '.version_select at 0x7fd6c61de940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:56.066719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b8c5c0c-a695-45f0-980d-7e50ab745384 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:56.067375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b8c5c0c-a695-45f0-980d-7e50ab745384 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:56.079958 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-8b8c5c0c-a695-45f0-980d-7e50ab745384 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] HTTP exception thrown: No hypervisor matching 'a1a047b7-5f9a-4f74-9047-8b4c5ab13ec5' could be found. Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b8c5c0c-a695-45f0-980d-7e50ab745384 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Request method failure captured: Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-hypervisors/a1a047b7-5f9a-4f74-9047-8b4c5ab13ec5/servers HTTP/1.1 Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CfoC_a5BlEVIQn6i_ZEQ7m6zvQ891GOBk_Y08jPI0j_kQGIyHtLq-TjO-csNcUjNc2X7mJDz8a32lU0Jar4t-4-N2R5EI7JCcLpwa2oXGo8elq1xfk6z9-SVtuDf222fY0iE1HR9qD1MaXONdhEsBk097oXv0-NQpKzpsUX9aM_3oY Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 7ea2daf78e534b20aba94a7dc9851685 Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-71612873 Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:27:56.081825 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:27:56.083370 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ea2daf78e534b20aba94a7dc9851685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7ea2daf78e534b20aba94a7dc9851685"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7ea2daf78e534b20aba94a7dc9851685", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ea2daf78e534b20aba94a7dc9851685"}]}] Jul 14 14:27:56.083370 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-71612873 Jul 14 14:27:56.083370 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 7ea2daf78e534b20aba94a7dc9851685 Jul 14 14:27:56.083370 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-71612873 Jul 14 14:27:56.083370 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin Jul 14 14:27:56.083370 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:27:56.083370 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:27:56.083370 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 808b7656b03a4f91a4817528709e1598 Jul 14 14:27:56.083370 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin Jul 14 14:27:56.083370 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:27:56.083370 n-d-767704-28 devstack@n-api.service[119511]: exception: No hypervisor matching 'a1a047b7-5f9a-4f74-9047-8b4c5ab13ec5' could be found. Jul 14 14:27:56.083370 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'a1a047b7-5f9a-4f74-9047-8b4c5ab13ec5'} Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'a1a047b7-5f9a-4f74-9047-8b4c5ab13ec5' could be found. Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:56.084255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:27:56.085672 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:27:56.085672 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:27:56.085672 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:27:56.085672 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:27:56.085672 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'a1a047b7-5f9a-4f74-9047-8b4c5ab13ec5' could be found. Jul 14 14:27:56.085672 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:27:56.087645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b8c5c0c-a695-45f0-980d-7e50ab745384 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] Returning 404 to user: No hypervisor matching 'a1a047b7-5f9a-4f74-9047-8b4c5ab13ec5' could be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:27:56.088778 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8b8c5c0c-a695-45f0-980d-7e50ab745384 tempest-HypervisorAdminNegativeUnderV252Test-71612873 tempest-HypervisorAdminNegativeUnderV252Test-71612873-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/a1a047b7-5f9a-4f74-9047-8b4c5ab13ec5/servers" status: 404 len: 123 microversion: 2.1 time: 0.030844 Jul 14 14:27:56.089977 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 320/675] 10.222.0.81 () {58 vars in 1280 bytes} [Thu Jul 14 14:27:56 2022] GET /compute/v2.1/os-hypervisors/a1a047b7-5f9a-4f74-9047-8b4c5ab13ec5/servers => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:27:56.464450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-5c94948f-8c92-4d41-930b-2f04415b9bcd tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid 037d7f27-c02b-4c2e-8039-2efba995484d {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:56.516604 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5c94948f-8c92-4d41-930b-2f04415b9bcd tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 2053 microversion: 2.25 time: 0.636289 Jul 14 14:27:56.519516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2637e992-6b34-49dd-9bbf-08e52bbfffd8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:56.521053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2637e992-6b34-49dd-9bbf-08e52bbfffd8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:56.523066 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 356/676] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:55 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 2053 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:56.537899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2637e992-6b34-49dd-9bbf-08e52bbfffd8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:56.538762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2637e992-6b34-49dd-9bbf-08e52bbfffd8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:56.539843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2637e992-6b34-49dd-9bbf-08e52bbfffd8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:56.540545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2637e992-6b34-49dd-9bbf-08e52bbfffd8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:56.561476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-564604ed-6163-4ba8-98aa-d204d10f0e00 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:56.562351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-564604ed-6163-4ba8-98aa-d204d10f0e00 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:56.592718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-564604ed-6163-4ba8-98aa-d204d10f0e00 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:56.593316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-564604ed-6163-4ba8-98aa-d204d10f0e00 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:56.597759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-564604ed-6163-4ba8-98aa-d204d10f0e00 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:56.600757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-564604ed-6163-4ba8-98aa-d204d10f0e00 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:57.124111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-564604ed-6163-4ba8-98aa-d204d10f0e00 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid 037d7f27-c02b-4c2e-8039-2efba995484d {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:57.158934 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-564604ed-6163-4ba8-98aa-d204d10f0e00 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 2053 microversion: 2.25 time: 0.623094 Jul 14 14:27:57.178651 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 357/677] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:56 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 2053 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:57.185668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a6deda67-83ea-4577-9ae7-8396a9213613 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:57.187925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a6deda67-83ea-4577-9ae7-8396a9213613 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:57.198343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6deda67-83ea-4577-9ae7-8396a9213613 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:57.199462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6deda67-83ea-4577-9ae7-8396a9213613 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:57.200522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6deda67-83ea-4577-9ae7-8396a9213613 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:57.201169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6deda67-83ea-4577-9ae7-8396a9213613 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:57.224277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2637e992-6b34-49dd-9bbf-08e52bbfffd8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:57.237170 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2637e992-6b34-49dd-9bbf-08e52bbfffd8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1476 microversion: 2.1 time: 0.722474 Jul 14 14:27:57.238197 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 321/678] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:56 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1476 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:57.247972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-293f4a2e-bff7-45ce-91a0-0f068b36cbcd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:57.248630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-293f4a2e-bff7-45ce-91a0-0f068b36cbcd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:57.255728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:57.265390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-293f4a2e-bff7-45ce-91a0-0f068b36cbcd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:57.265902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-293f4a2e-bff7-45ce-91a0-0f068b36cbcd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:57.266861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-293f4a2e-bff7-45ce-91a0-0f068b36cbcd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:57.267308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-293f4a2e-bff7-45ce-91a0-0f068b36cbcd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:57.931668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-293f4a2e-bff7-45ce-91a0-0f068b36cbcd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:57.953108 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-293f4a2e-bff7-45ce-91a0-0f068b36cbcd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1315 microversion: 2.1 time: 0.713377 Jul 14 14:27:57.955081 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 322/679] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:57 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:57.964304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-46a22f80-2b74-4928-9eba-5252750d9133 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:57.972298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-46a22f80-2b74-4928-9eba-5252750d9133 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:57.980904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:57.983099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-46a22f80-2b74-4928-9eba-5252750d9133 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:57.983881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-46a22f80-2b74-4928-9eba-5252750d9133 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:57.985891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-46a22f80-2b74-4928-9eba-5252750d9133 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:57.986593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-46a22f80-2b74-4928-9eba-5252750d9133 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:58.032739 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-46a22f80-2b74-4928-9eba-5252750d9133 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076032 Jul 14 14:27:58.033879 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 323/680] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:27:57 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:58.045582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e13f9e04-079a-48a4-b4a4-e391f09d722a tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:58.048778 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:27:58.048778 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:27:58.051167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e13f9e04-079a-48a4-b4a4-e391f09d722a tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:58.052855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e13f9e04-079a-48a4-b4a4-e391f09d722a tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:58.054156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e13f9e04-079a-48a4-b4a4-e391f09d722a tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:58.055901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e13f9e04-079a-48a4-b4a4-e391f09d722a tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:58.059016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a6deda67-83ea-4577-9ae7-8396a9213613 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:58.072115 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a6deda67-83ea-4577-9ae7-8396a9213613 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1310 microversion: 2.1 time: 0.891284 Jul 14 14:27:58.086081 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 358/681] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:57 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1310 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:58.098060 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e13f9e04-079a-48a4-b4a4-e391f09d722a tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.062514 Jul 14 14:27:58.099613 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 324/682] 10.222.0.81 () {60 vars in 1216 bytes} [Thu Jul 14 14:27:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:27:58.114976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b453404e-c46d-480e-bdba-77f2a8de3f93 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:58.115560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b453404e-c46d-480e-bdba-77f2a8de3f93 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:58.129778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b453404e-c46d-480e-bdba-77f2a8de3f93 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:58.130847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b453404e-c46d-480e-bdba-77f2a8de3f93 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:58.131276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b453404e-c46d-480e-bdba-77f2a8de3f93 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:58.134009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b453404e-c46d-480e-bdba-77f2a8de3f93 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:58.226849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3b28c6fe-b631-47da-b73e-17b287ef9d05 req-d919c0d4-ed19-49fd-bb8b-d9bcacaa979a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec366efc-f03e-4022-9d20-aea3951399f2", "tag": "de0ff888-9f89-477e-af2f-da88a54bd7a3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:27:58.250569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3b28c6fe-b631-47da-b73e-17b287ef9d05 req-d919c0d4-ed19-49fd-bb8b-d9bcacaa979a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:58.254846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3b28c6fe-b631-47da-b73e-17b287ef9d05 req-d919c0d4-ed19-49fd-bb8b-d9bcacaa979a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:58.277365 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b453404e-c46d-480e-bdba-77f2a8de3f93 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d/action" status: 202 len: 0 microversion: 2.25 time: 0.166041 Jul 14 14:27:58.283506 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 359/683] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 14:27:58 2022] POST /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:27:58.292678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d532e758-f29d-468d-8c8f-50054e02c64e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:58.293837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d532e758-f29d-468d-8c8f-50054e02c64e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:58.295735 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3b28c6fe-b631-47da-b73e-17b287ef9d05 req-d919c0d4-ed19-49fd-bb8b-d9bcacaa979a service nova] Creating event network-changed:de0ff888-9f89-477e-af2f-da88a54bd7a3 for instance ec366efc-f03e-4022-9d20-aea3951399f2 on n-h1-767704-28 Jul 14 14:27:58.303173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d532e758-f29d-468d-8c8f-50054e02c64e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:58.304016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d532e758-f29d-468d-8c8f-50054e02c64e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:58.306069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d532e758-f29d-468d-8c8f-50054e02c64e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:58.306840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d532e758-f29d-468d-8c8f-50054e02c64e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:58.311812 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3b28c6fe-b631-47da-b73e-17b287ef9d05 req-d919c0d4-ed19-49fd-bb8b-d9bcacaa979a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087690 Jul 14 14:27:58.313641 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 325/684] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:58.330247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dc13d878-5be6-4e5d-b188-37b97259e73f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:58.332181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dc13d878-5be6-4e5d-b188-37b97259e73f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:58.348484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc13d878-5be6-4e5d-b188-37b97259e73f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:58.350363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc13d878-5be6-4e5d-b188-37b97259e73f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:58.356894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc13d878-5be6-4e5d-b188-37b97259e73f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:58.357790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc13d878-5be6-4e5d-b188-37b97259e73f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:59.471492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d532e758-f29d-468d-8c8f-50054e02c64e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:27:59.484796 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d532e758-f29d-468d-8c8f-50054e02c64e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1475 microversion: 2.1 time: 1.199530 Jul 14 14:27:59.486172 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 360/685] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:58 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1475 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:27:59.501327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fce4c759-aa71-46ec-b7ff-1e373fa8dacd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:59.503249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fce4c759-aa71-46ec-b7ff-1e373fa8dacd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:59.510811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fce4c759-aa71-46ec-b7ff-1e373fa8dacd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:59.511695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fce4c759-aa71-46ec-b7ff-1e373fa8dacd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:59.512810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fce4c759-aa71-46ec-b7ff-1e373fa8dacd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:59.513519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fce4c759-aa71-46ec-b7ff-1e373fa8dacd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:59.691246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-dc13d878-5be6-4e5d-b188-37b97259e73f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid 037d7f27-c02b-4c2e-8039-2efba995484d {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:27:59.729954 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dc13d878-5be6-4e5d-b188-37b97259e73f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 2058 microversion: 2.25 time: 1.411864 Jul 14 14:27:59.730983 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 326/686] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:27:58 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 2058 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:59.750675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dc6d1e22-b384-4a8d-92fc-56c1869b6bf9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:59.751991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dc6d1e22-b384-4a8d-92fc-56c1869b6bf9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:59.761334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc6d1e22-b384-4a8d-92fc-56c1869b6bf9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:59.763352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc6d1e22-b384-4a8d-92fc-56c1869b6bf9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:59.765878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc6d1e22-b384-4a8d-92fc-56c1869b6bf9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:59.767423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc6d1e22-b384-4a8d-92fc-56c1869b6bf9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:59.835236 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dc6d1e22-b384-4a8d-92fc-56c1869b6bf9 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103055 Jul 14 14:27:59.836683 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 327/687] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:27:59 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:27:59.849619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d2100763-c93d-4b28-99b8-18bd2485927d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:59.850932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d2100763-c93d-4b28-99b8-18bd2485927d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:27:59.865303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2100763-c93d-4b28-99b8-18bd2485927d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:59.866309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2100763-c93d-4b28-99b8-18bd2485927d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:27:59.868375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2100763-c93d-4b28-99b8-18bd2485927d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:27:59.869173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2100763-c93d-4b28-99b8-18bd2485927d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:00.215386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fce4c759-aa71-46ec-b7ff-1e373fa8dacd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:00.241462 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fce4c759-aa71-46ec-b7ff-1e373fa8dacd tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1315 microversion: 2.1 time: 0.753328 Jul 14 14:28:00.243416 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 361/688] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:59 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1315 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:00.252903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0c123b05-1769-476e-b904-4874a6d0825e req-ade9c774-f8fd-4d4c-91c4-138a4f850503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19bb6d1e-7771-41fd-b903-dc300ba97d6f", "name": "network-vif-unplugged", "status": "completed", "tag": "2bef06c0-64d7-4a58-88e7-88f2b49a1dbc"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:00.269782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0c123b05-1769-476e-b904-4874a6d0825e req-ade9c774-f8fd-4d4c-91c4-138a4f850503 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:00.270948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0c123b05-1769-476e-b904-4874a6d0825e req-ade9c774-f8fd-4d4c-91c4-138a4f850503 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:00.312895 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0c123b05-1769-476e-b904-4874a6d0825e req-ade9c774-f8fd-4d4c-91c4-138a4f850503 service nova] Creating event network-vif-unplugged:2bef06c0-64d7-4a58-88e7-88f2b49a1dbc for instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f on n-h1-767704-28 Jul 14 14:28:00.339337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-0c123b05-1769-476e-b904-4874a6d0825e req-ade9c774-f8fd-4d4c-91c4-138a4f850503 service nova] Instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:28:00.369269 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0c123b05-1769-476e-b904-4874a6d0825e req-ade9c774-f8fd-4d4c-91c4-138a4f850503 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123339 Jul 14 14:28:00.370451 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 362/689] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:00.376527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d2100763-c93d-4b28-99b8-18bd2485927d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:00.391370 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d2100763-c93d-4b28-99b8-18bd2485927d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1310 microversion: 2.1 time: 0.552733 Jul 14 14:28:00.393320 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 328/690] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:27:59 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1310 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:00.399572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eb97010c-f72b-41c0-a3ac-6380a48953fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:00.400742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eb97010c-f72b-41c0-a3ac-6380a48953fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:00.413387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb97010c-f72b-41c0-a3ac-6380a48953fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:00.414648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb97010c-f72b-41c0-a3ac-6380a48953fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:00.416481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb97010c-f72b-41c0-a3ac-6380a48953fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:00.417612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb97010c-f72b-41c0-a3ac-6380a48953fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:00.475396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eb97010c-f72b-41c0-a3ac-6380a48953fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:28:00.507349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fdbf0091-eb5b-477d-9e53-97cd35f49a89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:00.509940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fdbf0091-eb5b-477d-9e53-97cd35f49a89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:00.562553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdbf0091-eb5b-477d-9e53-97cd35f49a89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:00.577323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdbf0091-eb5b-477d-9e53-97cd35f49a89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:00.578667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdbf0091-eb5b-477d-9e53-97cd35f49a89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:00.579089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdbf0091-eb5b-477d-9e53-97cd35f49a89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:00.686775 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eb97010c-f72b-41c0-a3ac-6380a48953fe tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "DELETE /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 204 len: 0 microversion: 2.1 time: 0.313758 Jul 14 14:28:00.687390 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 363/691] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:28:00 2022] DELETE /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:28:00.698180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b5987d88-b0e2-4979-ad73-f44294d8ec69 req-04180455-4f7f-4bf9-b8cc-61a11b7909e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a52556b-56d6-4a9d-9ef3-6cf070d835b6", "tag": "24ffd5b2-4449-44a5-99f9-cf31a744c4c3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:00.722194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b5987d88-b0e2-4979-ad73-f44294d8ec69 req-04180455-4f7f-4bf9-b8cc-61a11b7909e5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:00.728049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b5987d88-b0e2-4979-ad73-f44294d8ec69 req-04180455-4f7f-4bf9-b8cc-61a11b7909e5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:00.760768 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b5987d88-b0e2-4979-ad73-f44294d8ec69 req-04180455-4f7f-4bf9-b8cc-61a11b7909e5 service nova] Creating event network-changed:24ffd5b2-4449-44a5-99f9-cf31a744c4c3 for instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 on n-h1-767704-28 Jul 14 14:28:00.771785 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b5987d88-b0e2-4979-ad73-f44294d8ec69 req-04180455-4f7f-4bf9-b8cc-61a11b7909e5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082806 Jul 14 14:28:00.774598 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 364/692] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:00.786783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3c2fb8db-59e0-49eb-8ecd-481e52a9ef48 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:00.787869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3c2fb8db-59e0-49eb-8ecd-481e52a9ef48 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:00.805355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c2fb8db-59e0-49eb-8ecd-481e52a9ef48 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:00.806051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c2fb8db-59e0-49eb-8ecd-481e52a9ef48 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:00.807828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c2fb8db-59e0-49eb-8ecd-481e52a9ef48 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:00.809186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c2fb8db-59e0-49eb-8ecd-481e52a9ef48 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:00.819351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:00.879403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fdbf0091-eb5b-477d-9e53-97cd35f49a89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:00.904320 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fdbf0091-eb5b-477d-9e53-97cd35f49a89 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1473 microversion: 2.1 time: 0.403920 Jul 14 14:28:00.918053 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 329/693] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:00 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1473 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:28:00.931462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3569be1b-e50f-4739-b151-8b4227833316 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:00.934209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3569be1b-e50f-4739-b151-8b4227833316 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:00.944649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3569be1b-e50f-4739-b151-8b4227833316 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:00.946648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3569be1b-e50f-4739-b151-8b4227833316 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:00.947755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3569be1b-e50f-4739-b151-8b4227833316 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:00.948492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3569be1b-e50f-4739-b151-8b4227833316 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:01.275794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3c2fb8db-59e0-49eb-8ecd-481e52a9ef48 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:01.292527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-3569be1b-e50f-4739-b151-8b4227833316 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid 037d7f27-c02b-4c2e-8039-2efba995484d {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:28:01.297917 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3c2fb8db-59e0-49eb-8ecd-481e52a9ef48 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1712 microversion: 2.1 time: 0.521641 Jul 14 14:28:01.312233 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 365/694] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:00 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1712 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:01.324471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-32f690cb-4a77-4ed0-91e9-aabb1c0c768e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:01.329964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-32f690cb-4a77-4ed0-91e9-aabb1c0c768e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:01.342229 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3569be1b-e50f-4739-b151-8b4227833316 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 2038 microversion: 2.25 time: 0.422446 Jul 14 14:28:01.343446 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 330/695] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:00 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 2038 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:01.346278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32f690cb-4a77-4ed0-91e9-aabb1c0c768e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:01.346895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32f690cb-4a77-4ed0-91e9-aabb1c0c768e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:01.348339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32f690cb-4a77-4ed0-91e9-aabb1c0c768e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:01.348930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32f690cb-4a77-4ed0-91e9-aabb1c0c768e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:01.357175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-48162d80-f0ac-4733-b6f9-ae6f0af7a716 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:01.358039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-48162d80-f0ac-4733-b6f9-ae6f0af7a716 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:01.375026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48162d80-f0ac-4733-b6f9-ae6f0af7a716 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:01.386179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48162d80-f0ac-4733-b6f9-ae6f0af7a716 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:01.387358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48162d80-f0ac-4733-b6f9-ae6f0af7a716 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:01.387983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48162d80-f0ac-4733-b6f9-ae6f0af7a716 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:01.432554 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-32f690cb-4a77-4ed0-91e9-aabb1c0c768e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118822 Jul 14 14:28:01.441032 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 366/696] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:28:01 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:01.451727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4a2cb578-81b2-4546-bc0c-257d711df29f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-767704-28", "block_migration": "auto"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:01.454449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4a2cb578-81b2-4546-bc0c-257d711df29f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:01.463480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a2cb578-81b2-4546-bc0c-257d711df29f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:01.464207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a2cb578-81b2-4546-bc0c-257d711df29f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:01.465225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a2cb578-81b2-4546-bc0c-257d711df29f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:01.465870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a2cb578-81b2-4546-bc0c-257d711df29f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:01.498621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-4a2cb578-81b2-4546-bc0c-257d711df29f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'flavor' on Instance uuid 037d7f27-c02b-4c2e-8039-2efba995484d {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:28:01.525209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4a2cb578-81b2-4546-bc0c-257d711df29f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Going to try to live migrate instance to n-h1-767704-28 {{(pid=119512) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:28:01.702114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-48162d80-f0ac-4733-b6f9-ae6f0af7a716 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:01.732205 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-48162d80-f0ac-4733-b6f9-ae6f0af7a716 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1315 microversion: 2.1 time: 0.387261 Jul 14 14:28:01.735848 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 331/697] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:01 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:01.754766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b9a601d8-ecb8-45e7-b8ba-f3a6084896f8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:01.754766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b9a601d8-ecb8-45e7-b8ba-f3a6084896f8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:01.770772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9a601d8-ecb8-45e7-b8ba-f3a6084896f8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:01.771189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9a601d8-ecb8-45e7-b8ba-f3a6084896f8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:01.772526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9a601d8-ecb8-45e7-b8ba-f3a6084896f8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:01.773229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9a601d8-ecb8-45e7-b8ba-f3a6084896f8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:01.991673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=74,nova_cell0:UPDATE=12 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:02.007004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b9a601d8-ecb8-45e7-b8ba-f3a6084896f8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:02.027053 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b9a601d8-ecb8-45e7-b8ba-f3a6084896f8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1310 microversion: 2.1 time: 0.285717 Jul 14 14:28:02.031256 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 332/698] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:01 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1310 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:02.058627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2fc9b2d4-b59f-4745-80ba-cb981352ccbf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:02.059341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2fc9b2d4-b59f-4745-80ba-cb981352ccbf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:02.082918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fc9b2d4-b59f-4745-80ba-cb981352ccbf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:02.083377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fc9b2d4-b59f-4745-80ba-cb981352ccbf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:02.084838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fc9b2d4-b59f-4745-80ba-cb981352ccbf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:02.085336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fc9b2d4-b59f-4745-80ba-cb981352ccbf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:02.144818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=66 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:02.148797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:02.999808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2fc9b2d4-b59f-4745-80ba-cb981352ccbf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:03.028194 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2fc9b2d4-b59f-4745-80ba-cb981352ccbf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1473 microversion: 2.1 time: 0.988665 Jul 14 14:28:03.028194 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 333/699] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:02 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1473 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:03.041483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e070d42b-90fd-4bfb-8e57-0ccc7ed0e56f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:03.041483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e070d42b-90fd-4bfb-8e57-0ccc7ed0e56f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:03.069694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e070d42b-90fd-4bfb-8e57-0ccc7ed0e56f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:03.070760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e070d42b-90fd-4bfb-8e57-0ccc7ed0e56f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:03.071588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e070d42b-90fd-4bfb-8e57-0ccc7ed0e56f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:03.072035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e070d42b-90fd-4bfb-8e57-0ccc7ed0e56f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:03.712143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e070d42b-90fd-4bfb-8e57-0ccc7ed0e56f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:03.728340 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e070d42b-90fd-4bfb-8e57-0ccc7ed0e56f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1712 microversion: 2.1 time: 0.702390 Jul 14 14:28:03.743067 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 334/700] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:03 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1712 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:03.754158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-14926732-c512-4048-a8c8-6b03b887ec4e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:03.755172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-14926732-c512-4048-a8c8-6b03b887ec4e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:03.775561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14926732-c512-4048-a8c8-6b03b887ec4e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:03.776280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14926732-c512-4048-a8c8-6b03b887ec4e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:03.777266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14926732-c512-4048-a8c8-6b03b887ec4e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:03.781676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14926732-c512-4048-a8c8-6b03b887ec4e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:03.855010 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-14926732-c512-4048-a8c8-6b03b887ec4e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110596 Jul 14 14:28:03.856676 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 335/701] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:28:03 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:03.861913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6a138f71-7a94-4ca6-89fc-b09233fccc64 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:03.869969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6a138f71-7a94-4ca6-89fc-b09233fccc64 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:03.882893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a138f71-7a94-4ca6-89fc-b09233fccc64 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:03.883367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a138f71-7a94-4ca6-89fc-b09233fccc64 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:03.884174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a138f71-7a94-4ca6-89fc-b09233fccc64 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:03.884620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a138f71-7a94-4ca6-89fc-b09233fccc64 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:05.201886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6a138f71-7a94-4ca6-89fc-b09233fccc64 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:05.231326 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6a138f71-7a94-4ca6-89fc-b09233fccc64 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1315 microversion: 2.1 time: 1.373192 Jul 14 14:28:05.232080 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 336/702] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:03 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1315 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:05.240841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6a799598-0835-418f-b224-8250c8965770 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:05.247609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6a799598-0835-418f-b224-8250c8965770 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:05.264653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a799598-0835-418f-b224-8250c8965770 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:05.268546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a799598-0835-418f-b224-8250c8965770 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:05.269604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a799598-0835-418f-b224-8250c8965770 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:05.270259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a799598-0835-418f-b224-8250c8965770 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:05.486329 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4a2cb578-81b2-4546-bc0c-257d711df29f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d/action" status: 202 len: 0 microversion: 2.25 time: 4.043695 Jul 14 14:28:05.488251 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 367/703] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 14:28:01 2022] POST /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d/action => generated 0 bytes in 4047 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:28:05.530450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6a799598-0835-418f-b224-8250c8965770 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:05.542214 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6a799598-0835-418f-b224-8250c8965770 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1310 microversion: 2.1 time: 0.309030 Jul 14 14:28:05.543882 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 337/704] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:05 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1310 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:05.548865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2dd5aad7-58ab-4b6b-a69c-27efd4081d70 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:05.549742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2dd5aad7-58ab-4b6b-a69c-27efd4081d70 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:05.568623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2dd5aad7-58ab-4b6b-a69c-27efd4081d70 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:05.573963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2dd5aad7-58ab-4b6b-a69c-27efd4081d70 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:05.577225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2dd5aad7-58ab-4b6b-a69c-27efd4081d70 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:05.577899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2dd5aad7-58ab-4b6b-a69c-27efd4081d70 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:05.818603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3470df4a-d3d7-4252-a941-8aa89af1f008 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Action: 'create', calling method: .version_select at 0x7fd6c6034820>, body: {"keypair": {"name": "tempest-keypair-1553510216", "type": "ssh", "user_id": "bef9c99edf254cc2b501b40e1ac09260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoTXF4mYoqW7YdOPqTzYzhtrpKrxwPWwg0VDeOzZFczs2ThP+738KNfYWhKGm4NEJ9UfDBnCxUqyBde9Fznn1GKfCSWMlo0mRj/iXr+SAWY3z6tc3tYHZWC5v6me8u78w=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:05.840343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-3470df4a-d3d7-4252-a941-8aa89af1f008 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Getting quotas for project 949ce4bfea33409caee93604a704fa0c. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:05.865121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-3470df4a-d3d7-4252-a941-8aa89af1f008 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Getting quotas for user 34ed44e5dd7a481ba8dd7f33c49d06fd and project 949ce4bfea33409caee93604a704fa0c. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:05.876195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2dd5aad7-58ab-4b6b-a69c-27efd4081d70 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:05.898070 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2dd5aad7-58ab-4b6b-a69c-27efd4081d70 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1470 microversion: 2.1 time: 0.352848 Jul 14 14:28:05.901875 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 338/705] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:05 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1470 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:05.921307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c171a30a-5fd1-4ef9-8725-9249f809db8f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:05.925735 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3470df4a-d3d7-4252-a941-8aa89af1f008 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.433657 Jul 14 14:28:05.926276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c171a30a-5fd1-4ef9-8725-9249f809db8f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:05.927554 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 368/706] 10.222.0.81 () {62 vars in 1199 bytes} [Thu Jul 14 14:28:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 439 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:28:05.945477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ece64fa7-58b9-4bf2-8ef2-3b3e6cf55df5 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:05.946837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ece64fa7-58b9-4bf2-8ef2-3b3e6cf55df5 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:05.948557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c171a30a-5fd1-4ef9-8725-9249f809db8f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:05.949059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c171a30a-5fd1-4ef9-8725-9249f809db8f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:05.949937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c171a30a-5fd1-4ef9-8725-9249f809db8f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:05.950337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c171a30a-5fd1-4ef9-8725-9249f809db8f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:05.966087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ece64fa7-58b9-4bf2-8ef2-3b3e6cf55df5 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:05.968457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ece64fa7-58b9-4bf2-8ef2-3b3e6cf55df5 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:05.969466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ece64fa7-58b9-4bf2-8ef2-3b3e6cf55df5 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:05.970194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ece64fa7-58b9-4bf2-8ef2-3b3e6cf55df5 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:06.045927 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ece64fa7-58b9-4bf2-8ef2-3b3e6cf55df5 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116752 Jul 14 14:28:06.046523 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 369/707] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:28:05 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:06.064392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-73f59293-4c75-4d4d-9b0a-8042062db84e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:06.068373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-73f59293-4c75-4d4d-9b0a-8042062db84e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:06.088441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73f59293-4c75-4d4d-9b0a-8042062db84e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:06.089267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73f59293-4c75-4d4d-9b0a-8042062db84e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:06.090492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73f59293-4c75-4d4d-9b0a-8042062db84e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:06.091170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73f59293-4c75-4d4d-9b0a-8042062db84e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:06.185069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c171a30a-5fd1-4ef9-8725-9249f809db8f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b7a8b4d7344e5cb2938c8e2f1ab1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cea64d639b4a58ae486bf556526b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:06.200121 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c171a30a-5fd1-4ef9-8725-9249f809db8f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 200 len: 1644 microversion: 2.1 time: 0.294607 Jul 14 14:28:06.201279 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 339/708] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:05 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 1644 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:06.209333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-431f7b8e-f747-4439-b597-a298e7ebe5ed tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:06.213779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-431f7b8e-f747-4439-b597-a298e7ebe5ed tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:06.233637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-431f7b8e-f747-4439-b597-a298e7ebe5ed tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:06.234330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-431f7b8e-f747-4439-b597-a298e7ebe5ed tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:06.235341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-431f7b8e-f747-4439-b597-a298e7ebe5ed tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:06.237988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-431f7b8e-f747-4439-b597-a298e7ebe5ed tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:06.379088 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-431f7b8e-f747-4439-b597-a298e7ebe5ed tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "POST /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f/action" status: 204 len: 0 microversion: 2.1 time: 0.176232 Jul 14 14:28:06.379954 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 340/709] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:28:06 2022] POST /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f/action => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:28:06.386358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a9be63dd-1b87-4253-b06b-ea560fc4f7f8 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Action: 'create', calling method: .version_select at 0x7fd6c684f4c0>, body: {"keypair": {"name": "tempest-keypair-597617428", "type": "ssh", "user_id": "bef9c99edf254cc2b501b40e1ac09260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6bnbBaSl0tBe0eCclisBFgGVDeWHjUG2voefh0b4ZR3d3pDuHrluurXYiY4MoEtK7E7I5N6/EEpLfO4iqGpvw6JT5SuTEIa6NuqoJ5+VqxR3aVl0eTqql24eEYPfl78Q=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:06.430777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a9be63dd-1b87-4253-b06b-ea560fc4f7f8 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Getting quotas for project 949ce4bfea33409caee93604a704fa0c. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:06.442991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a9be63dd-1b87-4253-b06b-ea560fc4f7f8 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Getting quotas for user 34ed44e5dd7a481ba8dd7f33c49d06fd and project 949ce4bfea33409caee93604a704fa0c. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:06.531864 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a9be63dd-1b87-4253-b06b-ea560fc4f7f8 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.150222 Jul 14 14:28:06.541291 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 341/710] 10.222.0.81 () {62 vars in 1199 bytes} [Thu Jul 14 14:28:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:28:06.550682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-51c859ee-8df0-42d4-9363-abe3fb8a4b39 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:06.555321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-51c859ee-8df0-42d4-9363-abe3fb8a4b39 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:06.573945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51c859ee-8df0-42d4-9363-abe3fb8a4b39 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:06.574931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51c859ee-8df0-42d4-9363-abe3fb8a4b39 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:06.586317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51c859ee-8df0-42d4-9363-abe3fb8a4b39 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:06.589804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51c859ee-8df0-42d4-9363-abe3fb8a4b39 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:06.886975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-73f59293-4c75-4d4d-9b0a-8042062db84e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:06.903016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-73f59293-4c75-4d4d-9b0a-8042062db84e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:06.928328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-73f59293-4c75-4d4d-9b0a-8042062db84e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:06.937290 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-73f59293-4c75-4d4d-9b0a-8042062db84e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1568 microversion: 2.25 time: 0.879212 Jul 14 14:28:06.941601 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 370/711] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:06 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1568 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:06.958337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ad8d8cbe-f825-4738-a7c6-3d3cab0f02cf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:06.967609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ad8d8cbe-f825-4738-a7c6-3d3cab0f02cf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:06.990997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ad8d8cbe-f825-4738-a7c6-3d3cab0f02cf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:06.991475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ad8d8cbe-f825-4738-a7c6-3d3cab0f02cf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:06.996110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ad8d8cbe-f825-4738-a7c6-3d3cab0f02cf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:06.996915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ad8d8cbe-f825-4738-a7c6-3d3cab0f02cf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.225530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-51c859ee-8df0-42d4-9363-abe3fb8a4b39 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:07.240669 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-51c859ee-8df0-42d4-9363-abe3fb8a4b39 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1315 microversion: 2.1 time: 0.697515 Jul 14 14:28:07.241378 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 342/712] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:06 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:07.263399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-62dbf0b8-d944-4b0f-bb31-3c338a4d61c5 req-1759a5e2-01f7-4a3a-bae0-b354b9211e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c5728e-50ec-43f4-bd4e-8d7b9217bb69", "name": "network-vif-deleted", "tag": "26efdc8a-13a1-46a1-a04f-f980949a8248"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:07.287244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-62dbf0b8-d944-4b0f-bb31-3c338a4d61c5 req-1759a5e2-01f7-4a3a-bae0-b354b9211e78 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.288091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-62dbf0b8-d944-4b0f-bb31-3c338a4d61c5 req-1759a5e2-01f7-4a3a-bae0-b354b9211e78 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.321449 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-62dbf0b8-d944-4b0f-bb31-3c338a4d61c5 req-1759a5e2-01f7-4a3a-bae0-b354b9211e78 service nova] Creating event network-vif-deleted:26efdc8a-13a1-46a1-a04f-f980949a8248 for instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 on n-h2-767704-28 Jul 14 14:28:07.334523 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-62dbf0b8-d944-4b0f-bb31-3c338a4d61c5 req-1759a5e2-01f7-4a3a-bae0-b354b9211e78 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080661 Jul 14 14:28:07.336764 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 343/713] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:07.347989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8e23294b-28c7-442f-a39f-112c8063cf15 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Calling method '.version_select at 0x7fd6c5f3e0d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:07.357194 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8e23294b-28c7-442f-a39f-112c8063cf15 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] 10.222.0.81 "GET /compute/v2.1/os-keypairs/tempest-keypair-1553510216?user_id=bef9c99edf254cc2b501b40e1ac09260" status: 200 len: 512 microversion: 2.10 time: 0.017566 Jul 14 14:28:07.358195 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 344/714] 10.222.0.81 () {60 vars in 1339 bytes} [Thu Jul 14 14:28:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1553510216?user_id=bef9c99edf254cc2b501b40e1ac09260 => generated 512 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:28:07.363959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a0907258-96f3-4794-a64e-bbd587022807 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:07.364721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a0907258-96f3-4794-a64e-bbd587022807 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:07.375042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0907258-96f3-4794-a64e-bbd587022807 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.375504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0907258-96f3-4794-a64e-bbd587022807 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.376326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0907258-96f3-4794-a64e-bbd587022807 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.376768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0907258-96f3-4794-a64e-bbd587022807 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.603401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ad8d8cbe-f825-4738-a7c6-3d3cab0f02cf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:07.618729 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ad8d8cbe-f825-4738-a7c6-3d3cab0f02cf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1470 microversion: 2.1 time: 0.671583 Jul 14 14:28:07.620997 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 371/715] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:06 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1470 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:07.630982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a0929342-2820-49dd-a9d1-d5a01d0b9afc req-6f36cd07-9725-480c-99d7-74885f32f414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19bb6d1e-7771-41fd-b903-dc300ba97d6f", "name": "network-vif-plugged", "status": "completed", "tag": "2bef06c0-64d7-4a58-88e7-88f2b49a1dbc"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:07.657930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a0929342-2820-49dd-a9d1-d5a01d0b9afc req-6f36cd07-9725-480c-99d7-74885f32f414 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.658987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a0929342-2820-49dd-a9d1-d5a01d0b9afc req-6f36cd07-9725-480c-99d7-74885f32f414 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.713166 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a0929342-2820-49dd-a9d1-d5a01d0b9afc req-6f36cd07-9725-480c-99d7-74885f32f414 service nova] Creating event network-vif-plugged:2bef06c0-64d7-4a58-88e7-88f2b49a1dbc for instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f on n-h1-767704-28 Jul 14 14:28:07.730460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:07.735586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-a0929342-2820-49dd-a9d1-d5a01d0b9afc req-6f36cd07-9725-480c-99d7-74885f32f414 service nova] Instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:28:07.746610 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a0929342-2820-49dd-a9d1-d5a01d0b9afc req-6f36cd07-9725-480c-99d7-74885f32f414 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123698 Jul 14 14:28:07.748464 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 372/716] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:07.755677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e942594c-ca9d-49be-8438-f688f22eee57 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:07.756900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e942594c-ca9d-49be-8438-f688f22eee57 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:07.770094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e942594c-ca9d-49be-8438-f688f22eee57 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.770442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a0907258-96f3-4794-a64e-bbd587022807 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:07.770738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e942594c-ca9d-49be-8438-f688f22eee57 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.771779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e942594c-ca9d-49be-8438-f688f22eee57 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.772419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e942594c-ca9d-49be-8438-f688f22eee57 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.784278 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a0907258-96f3-4794-a64e-bbd587022807 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1310 microversion: 2.1 time: 0.424918 Jul 14 14:28:07.785317 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 345/717] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:07 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1310 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:07.805076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-20f73b19-2878-460e-b71a-b7fca31fee6a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:07.805956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-20f73b19-2878-460e-b71a-b7fca31fee6a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:07.812669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20f73b19-2878-460e-b71a-b7fca31fee6a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.813507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20f73b19-2878-460e-b71a-b7fca31fee6a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.814645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20f73b19-2878-460e-b71a-b7fca31fee6a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.815273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20f73b19-2878-460e-b71a-b7fca31fee6a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.832812 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-20f73b19-2878-460e-b71a-b7fca31fee6a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] HTTP exception thrown: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:07.833681 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e942594c-ca9d-49be-8438-f688f22eee57 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079200 Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-20f73b19-2878-460e-b71a-b7fca31fee6a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Request method failure captured: Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 HTTP/1.1 Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdIddzeeFOBuXGDkG7qohZvrhAYkZRc3Y0tL_qXqMEL7HiWe9FKD0rgbYnX3iq27omeJCiv1ZTv6CWInNCSaOjQJqo967Gdzw0ZZw1AdFQFZvCEZrJ3oIyBZZBpMFDAOrlyqW61FdlO_powPr40OnD07ZwtugsnqJlFiSZYiLHpL8I Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:28:07.835607 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:28:07.837751 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53cea64d639b4a58ae486bf556526b25", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}] Jul 14 14:28:07.837751 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:07.837751 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:07.837751 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:07.837751 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:07.837751 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:28:07.837751 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:28:07.837751 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 05b7a8b4d7344e5cb2938c8e2f1ab1f7 Jul 14 14:28:07.837751 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:07.837751 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:28:07.837751 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:07.837751 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '32c5728e-50ec-43f4-bd4e-8d7b9217bb69'} Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:07.838698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:07.840047 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.842713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-20f73b19-2878-460e-b71a-b7fca31fee6a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Returning 404 to user: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:07.843759 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 373/718] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:28:07 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:28:07.845097 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-20f73b19-2878-460e-b71a-b7fca31fee6a tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 404 len: 111 microversion: 2.1 time: 0.045574 Jul 14 14:28:07.845945 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 346/719] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:07 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:07.856804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-33dffecb-e0b1-40e1-80cf-dffb4b806aec tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:07.857538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-33dffecb-e0b1-40e1-80cf-dffb4b806aec tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:07.865536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33dffecb-e0b1-40e1-80cf-dffb4b806aec tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.866621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33dffecb-e0b1-40e1-80cf-dffb4b806aec tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.867658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33dffecb-e0b1-40e1-80cf-dffb4b806aec tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.868277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33dffecb-e0b1-40e1-80cf-dffb4b806aec tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.874218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7082350f-48fc-4174-bdf8-6c5ecfb3a392 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Action: 'create', calling method: .version_select at 0x7fd6c605b1f0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1354246825", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFs2RCAaQL2LJPKNlFtnokzpHZXq3rl9lYBbNoK2kw0oWjFiMjqHEjzwHHPZYXgFHrBH7YcIICGWcLtqfu/yxnX+77LiDWDm1Y+3DHEOX6sy0SyZ4DZlqfrTuYS7/HOTA=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:07.885517 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-33dffecb-e0b1-40e1-80cf-dffb4b806aec tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] HTTP exception thrown: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-33dffecb-e0b1-40e1-80cf-dffb4b806aec tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Request method failure captured: Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 HTTP/1.1 Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdIddzeeFOBuXGDkG7qohZvrhAYkZRc3Y0tL_qXqMEL7HiWe9FKD0rgbYnX3iq27omeJCiv1ZTv6CWInNCSaOjQJqo967Gdzw0ZZw1AdFQFZvCEZrJ3oIyBZZBpMFDAOrlyqW61FdlO_powPr40OnD07ZwtugsnqJlFiSZYiLHpL8I Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:28:07.887413 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:28:07.889014 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53cea64d639b4a58ae486bf556526b25", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}] Jul 14 14:28:07.889014 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:07.889014 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:07.889014 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:07.889014 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:07.889014 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:28:07.889014 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:28:07.889014 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 05b7a8b4d7344e5cb2938c8e2f1ab1f7 Jul 14 14:28:07.889014 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:07.889014 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:28:07.889014 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:07.889014 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'a7f119f8-47c2-4c9b-a800-d16194ab2e49'} Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:07.889881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:07.891044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.894078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-33dffecb-e0b1-40e1-80cf-dffb4b806aec tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Returning 404 to user: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:07.895201 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-33dffecb-e0b1-40e1-80cf-dffb4b806aec tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 404 len: 111 microversion: 2.1 time: 0.044686 Jul 14 14:28:07.900609 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 347/720] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:28:07 2022] DELETE /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:07.907374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8e550714-af8a-4f62-a04e-141371a19c5e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:07.908341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8e550714-af8a-4f62-a04e-141371a19c5e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:07.917787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e550714-af8a-4f62-a04e-141371a19c5e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.918587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e550714-af8a-4f62-a04e-141371a19c5e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.919593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e550714-af8a-4f62-a04e-141371a19c5e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.920333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e550714-af8a-4f62-a04e-141371a19c5e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.931940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-7082350f-48fc-4174-bdf8-6c5ecfb3a392 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Getting quotas for project 949ce4bfea33409caee93604a704fa0c. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:07.942953 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-8e550714-af8a-4f62-a04e-141371a19c5e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] HTTP exception thrown: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8e550714-af8a-4f62-a04e-141371a19c5e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Request method failure captured: Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 HTTP/1.1 Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdIddzeeFOBuXGDkG7qohZvrhAYkZRc3Y0tL_qXqMEL7HiWe9FKD0rgbYnX3iq27omeJCiv1ZTv6CWInNCSaOjQJqo967Gdzw0ZZw1AdFQFZvCEZrJ3oIyBZZBpMFDAOrlyqW61FdlO_powPr40OnD07ZwtugsnqJlFiSZYiLHpL8I Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:28:07.945955 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:28:07.947487 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53cea64d639b4a58ae486bf556526b25", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}] Jul 14 14:28:07.947487 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:07.947487 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:07.947487 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:07.947487 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:07.947487 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:28:07.947487 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:28:07.947487 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 05b7a8b4d7344e5cb2938c8e2f1ab1f7 Jul 14 14:28:07.947487 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:07.947487 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:28:07.947487 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:07.947487 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'a7f119f8-47c2-4c9b-a800-d16194ab2e49'} Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:07.948208 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:07.949468 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:07.950547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-7082350f-48fc-4174-bdf8-6c5ecfb3a392 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Getting quotas for user 34ed44e5dd7a481ba8dd7f33c49d06fd and project 949ce4bfea33409caee93604a704fa0c. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:07.952379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8e550714-af8a-4f62-a04e-141371a19c5e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Returning 404 to user: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:07.956558 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8e550714-af8a-4f62-a04e-141371a19c5e tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 404 len: 111 microversion: 2.1 time: 0.054246 Jul 14 14:28:07.962167 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 348/721] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:07 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:07.968359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5851e71e-7061-45cd-9350-0e72fe669b49 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:07.969490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5851e71e-7061-45cd-9350-0e72fe669b49 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:07.981405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5851e71e-7061-45cd-9350-0e72fe669b49 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.982661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5851e71e-7061-45cd-9350-0e72fe669b49 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:07.984731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5851e71e-7061-45cd-9350-0e72fe669b49 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:07.985761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5851e71e-7061-45cd-9350-0e72fe669b49 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:08.014445 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7082350f-48fc-4174-bdf8-6c5ecfb3a392 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.167310 Jul 14 14:28:08.015380 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 374/722] 10.222.0.81 () {62 vars in 1199 bytes} [Thu Jul 14 14:28:07 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:28:08.021721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b938ea7a-cb6b-4b24-8a11-f743865b909b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '.version_select at 0x7fd6c5f199d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:08.051756 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b938ea7a-cb6b-4b24-8a11-f743865b909b tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254310316" status: 202 len: 0 microversion: 2.1 time: 0.035227 Jul 14 14:28:08.056508 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 375/723] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 14:28:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254310316 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:28:08.069294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:08.074955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-30de4340-c494-450f-a86f-b315b0050194 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Calling method '.version_select at 0x7fd6c5e30dc0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:08.079732 n-d-767704-28 devstack@n-api.service[119512]: WARNING oslo_db.sqlalchemy.utils [None req-30de4340-c494-450f-a86f-b315b0050194 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 14 14:28:08.090720 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-30de4340-c494-450f-a86f-b315b0050194 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] 10.222.0.81 "GET /compute/v2.1/os-keypairs?user_id=bef9c99edf254cc2b501b40e1ac09260" status: 200 len: 725 microversion: 2.10 time: 0.032220 Jul 14 14:28:08.092477 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 376/724] 10.222.0.81 () {60 vars in 1258 bytes} [Thu Jul 14 14:28:08 2022] GET /compute/v2.1/os-keypairs?user_id=bef9c99edf254cc2b501b40e1ac09260 => generated 725 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:28:08.103834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e296f1f2-0f6e-44d4-b04d-fb07c02dde31 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Calling method '.version_select at 0x7fd6c5eb6940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:08.160326 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e296f1f2-0f6e-44d4-b04d-fb07c02dde31 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1354246825" status: 204 len: 0 microversion: 2.10 time: 0.061604 Jul 14 14:28:08.162381 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 377/725] 10.222.0.81 () {60 vars in 1324 bytes} [Thu Jul 14 14:28:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1354246825 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 14:28:08.175907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0297ea8b-198e-49aa-950c-a97599f09dd6 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Calling method '.version_select at 0x7fd6c5e70940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:08.214979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:08.239722 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0297ea8b-198e-49aa-950c-a97599f09dd6 tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-597617428?user_id=bef9c99edf254cc2b501b40e1ac09260" status: 204 len: 0 microversion: 2.10 time: 0.071948 Jul 14 14:28:08.240976 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 378/726] 10.222.0.81 () {60 vars in 1339 bytes} [Thu Jul 14 14:28:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-597617428?user_id=bef9c99edf254cc2b501b40e1ac09260 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 14:28:08.252464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2082681231", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "67bd9c0c-b9e0-42cc-9964-6a3ebfb39f9c"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:08.345710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] validate_networks() for [('67bd9c0c-b9e0-42cc-9964-6a3ebfb39f9c', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:28:08.562575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5851e71e-7061-45cd-9350-0e72fe669b49 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:08.586647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5851e71e-7061-45cd-9350-0e72fe669b49 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:08.588611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5851e71e-7061-45cd-9350-0e72fe669b49 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:08.591454 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5851e71e-7061-45cd-9350-0e72fe669b49 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1568 microversion: 2.25 time: 0.627605 Jul 14 14:28:08.592567 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 349/727] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:07 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1568 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:08.602660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-85bbbf36-30f5-4c9e-a6ee-01d20bd00acd tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] Calling method '.version_select at 0x7fd6c6143e50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:08.651581 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-85bbbf36-30f5-4c9e-a6ee-01d20bd00acd tempest-KeyPairsV210TestJSON-198716694 tempest-KeyPairsV210TestJSON-198716694-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553510216?user_id=bef9c99edf254cc2b501b40e1ac09260" status: 204 len: 0 microversion: 2.10 time: 0.056292 Jul 14 14:28:08.653170 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 350/728] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:28:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553510216?user_id=bef9c99edf254cc2b501b40e1ac09260 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:28:08.672089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e24bcdda-5bec-4acc-9351-d8b644913d7a tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:08.675667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e24bcdda-5bec-4acc-9351-d8b644913d7a tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:08.693556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e24bcdda-5bec-4acc-9351-d8b644913d7a tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:08.694847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e24bcdda-5bec-4acc-9351-d8b644913d7a tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:08.696582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e24bcdda-5bec-4acc-9351-d8b644913d7a tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:08.697348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e24bcdda-5bec-4acc-9351-d8b644913d7a tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:09.318942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:28:09.320094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:28:09.321375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:28:09.322036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:28:09.322531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:28:09.350654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:09.357143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:09.358399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:09.359465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e24bcdda-5bec-4acc-9351-d8b644913d7a tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:09.360211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:09.376523 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e24bcdda-5bec-4acc-9351-d8b644913d7a tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1315 microversion: 2.1 time: 0.721882 Jul 14 14:28:09.377311 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 351/729] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:08 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:09.397960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Getting quotas for project cd30d3b5d4b84104ae34623d3121a080. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:09.404630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Getting quotas for user 6939fb96384749f9b9358e636845106a and project cd30d3b5d4b84104ae34623d3121a080. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:09.414186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c0fd5ee7-7749-4cc6-9f87-913cb8a96675 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:09.415675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c0fd5ee7-7749-4cc6-9f87-913cb8a96675 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:09.425514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:28:09.428283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:28:09.433291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0fd5ee7-7749-4cc6-9f87-913cb8a96675 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:09.433749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0fd5ee7-7749-4cc6-9f87-913cb8a96675 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:09.434547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0fd5ee7-7749-4cc6-9f87-913cb8a96675 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:09.434989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0fd5ee7-7749-4cc6-9f87-913cb8a96675 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:09.507858 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-02cb1364-b2e4-4a1d-9190-43264f15965e tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.265351 Jul 14 14:28:09.508807 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 379/730] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:28:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:28:09.520974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f8704ea-88d5-42f6-9751-9af7a67788f0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:09.521903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f8704ea-88d5-42f6-9751-9af7a67788f0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:09.538885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f8704ea-88d5-42f6-9751-9af7a67788f0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:09.540296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f8704ea-88d5-42f6-9751-9af7a67788f0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:09.541414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f8704ea-88d5-42f6-9751-9af7a67788f0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:09.542085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f8704ea-88d5-42f6-9751-9af7a67788f0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:09.916217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c0fd5ee7-7749-4cc6-9f87-913cb8a96675 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:09.927460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f8704ea-88d5-42f6-9751-9af7a67788f0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:09.930425 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c0fd5ee7-7749-4cc6-9f87-913cb8a96675 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1470 microversion: 2.1 time: 0.551189 Jul 14 14:28:09.931358 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 352/731] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:09 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1470 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:09.936219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-689dd586-487c-40d5-bfe9-7e849102fa7f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:09.936831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-689dd586-487c-40d5-bfe9-7e849102fa7f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:09.946832 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f8704ea-88d5-42f6-9751-9af7a67788f0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1310 microversion: 2.1 time: 0.435013 Jul 14 14:28:09.947407 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 380/732] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:09 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1310 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:09.973796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f19aab8b-77c9-4a5b-9cc1-503c4f088304 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:09.975079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f19aab8b-77c9-4a5b-9cc1-503c4f088304 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:09.986052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f19aab8b-77c9-4a5b-9cc1-503c4f088304 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:09.986352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f19aab8b-77c9-4a5b-9cc1-503c4f088304 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:09.988205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f19aab8b-77c9-4a5b-9cc1-503c4f088304 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:09.989430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f19aab8b-77c9-4a5b-9cc1-503c4f088304 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:10.084337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-689dd586-487c-40d5-bfe9-7e849102fa7f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:10.102780 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-689dd586-487c-40d5-bfe9-7e849102fa7f tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 200 len: 1218 microversion: 2.1 time: 0.167929 Jul 14 14:28:10.105790 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 353/733] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:09 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:10.113469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c6f4a0b6-0df8-43ce-8b32-731b867b1d8e req-f3a357b9-e9d3-4097-9c03-c3e03d333241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec366efc-f03e-4022-9d20-aea3951399f2", "name": "network-vif-plugged", "status": "completed", "tag": "de0ff888-9f89-477e-af2f-da88a54bd7a3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:10.141539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c6f4a0b6-0df8-43ce-8b32-731b867b1d8e req-f3a357b9-e9d3-4097-9c03-c3e03d333241 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:10.143509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c6f4a0b6-0df8-43ce-8b32-731b867b1d8e req-f3a357b9-e9d3-4097-9c03-c3e03d333241 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:10.157581 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c6f4a0b6-0df8-43ce-8b32-731b867b1d8e req-f3a357b9-e9d3-4097-9c03-c3e03d333241 service nova] Creating event network-vif-plugged:de0ff888-9f89-477e-af2f-da88a54bd7a3 for instance ec366efc-f03e-4022-9d20-aea3951399f2 on n-h1-767704-28 Jul 14 14:28:10.165936 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c6f4a0b6-0df8-43ce-8b32-731b867b1d8e req-f3a357b9-e9d3-4097-9c03-c3e03d333241 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057325 Jul 14 14:28:10.166953 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 354/734] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:10.316337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f19aab8b-77c9-4a5b-9cc1-503c4f088304 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:10.329029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f19aab8b-77c9-4a5b-9cc1-503c4f088304 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:10.330680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f19aab8b-77c9-4a5b-9cc1-503c4f088304 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:10.332185 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f19aab8b-77c9-4a5b-9cc1-503c4f088304 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1568 microversion: 2.25 time: 0.372014 Jul 14 14:28:10.332772 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 381/735] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:09 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1568 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:10.396214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3cb3e928-4713-4234-9fc4-a81f70a94274 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:10.397446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3cb3e928-4713-4234-9fc4-a81f70a94274 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:10.406628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3cb3e928-4713-4234-9fc4-a81f70a94274 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:10.407613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3cb3e928-4713-4234-9fc4-a81f70a94274 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:10.408830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3cb3e928-4713-4234-9fc4-a81f70a94274 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:10.409517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3cb3e928-4713-4234-9fc4-a81f70a94274 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:10.675212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3cb3e928-4713-4234-9fc4-a81f70a94274 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:10.688293 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3cb3e928-4713-4234-9fc4-a81f70a94274 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1315 microversion: 2.1 time: 0.296492 Jul 14 14:28:10.689184 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 355/736] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:10 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:28:10.949119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3022a47c-9b3c-4ea0-8de6-0cee463f7a6e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:10.949780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3022a47c-9b3c-4ea0-8de6-0cee463f7a6e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:10.965300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3cc30ce1-e6ff-451b-9250-4d951fd4efc6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:10.965960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3cc30ce1-e6ff-451b-9250-4d951fd4efc6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:10.980440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3cc30ce1-e6ff-451b-9250-4d951fd4efc6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:10.983787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3022a47c-9b3c-4ea0-8de6-0cee463f7a6e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:10.984756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3cc30ce1-e6ff-451b-9250-4d951fd4efc6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:10.986944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3cc30ce1-e6ff-451b-9250-4d951fd4efc6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:10.987645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3022a47c-9b3c-4ea0-8de6-0cee463f7a6e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:10.989172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3cc30ce1-e6ff-451b-9250-4d951fd4efc6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:10.990182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3022a47c-9b3c-4ea0-8de6-0cee463f7a6e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:10.997853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3022a47c-9b3c-4ea0-8de6-0cee463f7a6e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:11.005565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:11.590077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3cc30ce1-e6ff-451b-9250-4d951fd4efc6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:11.606130 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3cc30ce1-e6ff-451b-9250-4d951fd4efc6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1310 microversion: 2.1 time: 0.645766 Jul 14 14:28:11.616997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3022a47c-9b3c-4ea0-8de6-0cee463f7a6e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:11.618989 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 356/737] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:10 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1310 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:11.628392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-da43ebef-9bdd-4b41-af28-c833a970a014 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:11.629139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-da43ebef-9bdd-4b41-af28-c833a970a014 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:11.631088 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3022a47c-9b3c-4ea0-8de6-0cee463f7a6e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1462 microversion: 2.1 time: 0.687605 Jul 14 14:28:11.631885 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 382/738] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:10 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1462 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:11.637273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2619931a-b42e-4083-87e9-f781206a4879 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:11.638408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2619931a-b42e-4083-87e9-f781206a4879 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:11.650478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2619931a-b42e-4083-87e9-f781206a4879 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:11.651275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2619931a-b42e-4083-87e9-f781206a4879 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:11.652624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2619931a-b42e-4083-87e9-f781206a4879 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:11.655941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2619931a-b42e-4083-87e9-f781206a4879 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:11.659298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da43ebef-9bdd-4b41-af28-c833a970a014 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:11.661733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da43ebef-9bdd-4b41-af28-c833a970a014 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:11.663586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da43ebef-9bdd-4b41-af28-c833a970a014 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:11.666910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da43ebef-9bdd-4b41-af28-c833a970a014 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:11.829153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-da43ebef-9bdd-4b41-af28-c833a970a014 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:11.855534 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-da43ebef-9bdd-4b41-af28-c833a970a014 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 200 len: 1276 microversion: 2.1 time: 0.234774 Jul 14 14:28:11.857781 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 357/739] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:11 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 1276 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:11.863736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1849ad23-9076-4989-b205-6ab6645ed197 req-de07b2ea-8726-4ab9-8ad5-2f91b5dcef11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037d7f27-c02b-4c2e-8039-2efba995484d", "name": "network-vif-unplugged", "status": "completed", "tag": "f836c7c7-f03f-4d05-a974-793760051e3e"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:11.874733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1849ad23-9076-4989-b205-6ab6645ed197 req-de07b2ea-8726-4ab9-8ad5-2f91b5dcef11 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:11.875505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1849ad23-9076-4989-b205-6ab6645ed197 req-de07b2ea-8726-4ab9-8ad5-2f91b5dcef11 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:11.894441 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1849ad23-9076-4989-b205-6ab6645ed197 req-de07b2ea-8726-4ab9-8ad5-2f91b5dcef11 service nova] Creating event network-vif-unplugged:f836c7c7-f03f-4d05-a974-793760051e3e for instance 037d7f27-c02b-4c2e-8039-2efba995484d on n-h2-767704-28 Jul 14 14:28:11.907262 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1849ad23-9076-4989-b205-6ab6645ed197 req-de07b2ea-8726-4ab9-8ad5-2f91b5dcef11 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047748 Jul 14 14:28:11.908414 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 358/740] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:11.925588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f9a1aab-dff0-4b39-9548-e98f89ced980 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:11.926742 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:11.926742 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:28:11.960447 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9f9a1aab-dff0-4b39-9548-e98f89ced980 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/1732943815" status: 202 len: 0 microversion: 2.1 time: 0.049881 Jul 14 14:28:11.963124 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 359/741] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 14:28:11 2022] DELETE /compute/v2.1/flavors/1732943815 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:28:11.971005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-36744ae9-0cbe-4a8d-b929-36e033791152 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:11.972584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-36744ae9-0cbe-4a8d-b929-36e033791152 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:12.006168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36744ae9-0cbe-4a8d-b929-36e033791152 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:12.006745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36744ae9-0cbe-4a8d-b929-36e033791152 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:12.011628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36744ae9-0cbe-4a8d-b929-36e033791152 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:12.014197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36744ae9-0cbe-4a8d-b929-36e033791152 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:12.100591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2619931a-b42e-4083-87e9-f781206a4879 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:12.109760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2619931a-b42e-4083-87e9-f781206a4879 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:12.112446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2619931a-b42e-4083-87e9-f781206a4879 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:12.113957 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2619931a-b42e-4083-87e9-f781206a4879 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1568 microversion: 2.25 time: 0.481037 Jul 14 14:28:12.125506 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 383/742] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:11 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1568 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:12.133781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e464407-d9b6-41f9-85b2-70d965652e03 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:12.134626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8e464407-d9b6-41f9-85b2-70d965652e03 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:12.153090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e464407-d9b6-41f9-85b2-70d965652e03 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:12.156017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e464407-d9b6-41f9-85b2-70d965652e03 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:12.156905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e464407-d9b6-41f9-85b2-70d965652e03 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:12.157600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e464407-d9b6-41f9-85b2-70d965652e03 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:12.808676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-36744ae9-0cbe-4a8d-b929-36e033791152 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:12.828462 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-36744ae9-0cbe-4a8d-b929-36e033791152 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1462 microversion: 2.1 time: 0.862649 Jul 14 14:28:12.828666 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 360/743] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:11 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1462 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:12.847444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4a52be76-9f42-457e-ae32-7fbfc11cf039 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:12.870699 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4a52be76-9f42-457e-ae32-7fbfc11cf039 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5401 microversion: 2.1 time: 0.028541 Jul 14 14:28:12.881344 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 361/744] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:28:12 2022] GET /compute/v2.1/flavors/detail => generated 5401 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:12.887282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3609dc16-75da-42e0-8f27-ce357fa5971a req-65ceb26e-e75e-4022-80d5-dc913a9d97fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a52556b-56d6-4a9d-9ef3-6cf070d835b6", "name": "network-vif-plugged", "status": "completed", "tag": "24ffd5b2-4449-44a5-99f9-cf31a744c4c3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:12.895257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:DELETE=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:12.907986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3609dc16-75da-42e0-8f27-ce357fa5971a req-65ceb26e-e75e-4022-80d5-dc913a9d97fe service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:12.908673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3609dc16-75da-42e0-8f27-ce357fa5971a req-65ceb26e-e75e-4022-80d5-dc913a9d97fe service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:12.922686 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3609dc16-75da-42e0-8f27-ce357fa5971a req-65ceb26e-e75e-4022-80d5-dc913a9d97fe service nova] Creating event network-vif-plugged:24ffd5b2-4449-44a5-99f9-cf31a744c4c3 for instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 on n-h1-767704-28 Jul 14 14:28:12.928990 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3609dc16-75da-42e0-8f27-ce357fa5971a req-65ceb26e-e75e-4022-80d5-dc913a9d97fe service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045295 Jul 14 14:28:12.930669 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 362/745] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:12.936612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-89c8e260-31af-48d1-8ba9-c077fc9dee51 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:12.937670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-89c8e260-31af-48d1-8ba9-c077fc9dee51 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:12.945403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89c8e260-31af-48d1-8ba9-c077fc9dee51 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:12.947602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89c8e260-31af-48d1-8ba9-c077fc9dee51 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:12.948884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89c8e260-31af-48d1-8ba9-c077fc9dee51 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:12.949527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89c8e260-31af-48d1-8ba9-c077fc9dee51 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:13.102902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8e464407-d9b6-41f9-85b2-70d965652e03 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:13.116786 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8e464407-d9b6-41f9-85b2-70d965652e03 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1315 microversion: 2.1 time: 0.989926 Jul 14 14:28:13.129154 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 384/746] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:12 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1315 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:13.136598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1690c597-da13-4dc0-bd7c-fbd28c92c3b7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Action: 'create', calling method: .version_select at 0x7fd6c5e70670>, body: {"keypair": {"name": "tempest-keypair-1601871887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+dxxkXgjfVaNGmB6R6inwcNowXabsXyrRzN+F/sbh902aOfO0eZYAjgPIjyGhSZh768Hi1RNEcq1PPU3fXp0kRtKF/vEhN7hqnePGdyUXFi4jYGHfUURh39tqHR2c3Ag=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:13.156543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1690c597-da13-4dc0-bd7c-fbd28c92c3b7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Getting quotas for project c3e95b24eb1b4f9fbc5eb6f4d6f3d308. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:13.166908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1690c597-da13-4dc0-bd7c-fbd28c92c3b7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Getting quotas for user 89894c4d380a4632870ebcb10a2ffe81 and project c3e95b24eb1b4f9fbc5eb6f4d6f3d308. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:13.237964 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1690c597-da13-4dc0-bd7c-fbd28c92c3b7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107225 Jul 14 14:28:13.241104 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 385/747] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:28:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:13.255912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a4e7351-6b87-4710-923c-83ca2ea41087 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:13.256533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2a4e7351-6b87-4710-923c-83ca2ea41087 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:13.285960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a4e7351-6b87-4710-923c-83ca2ea41087 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:13.286923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a4e7351-6b87-4710-923c-83ca2ea41087 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:13.288335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a4e7351-6b87-4710-923c-83ca2ea41087 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:13.290290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a4e7351-6b87-4710-923c-83ca2ea41087 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:13.321258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-89c8e260-31af-48d1-8ba9-c077fc9dee51 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:13.333573 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-89c8e260-31af-48d1-8ba9-c077fc9dee51 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1492 microversion: 2.1 time: 0.397217 Jul 14 14:28:13.334147 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 363/748] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:12 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1492 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:13.346150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-172e04fa-76cf-43ee-82d2-e3b76e1ce3a2 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:13.347055 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:13.347055 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:28:13.401288 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-172e04fa-76cf-43ee-82d2-e3b76e1ce3a2 tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/741277973" status: 202 len: 0 microversion: 2.1 time: 0.064941 Jul 14 14:28:13.405844 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 364/749] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:28:13 2022] DELETE /compute/v2.1/flavors/741277973 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:28:13.503994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2a4e7351-6b87-4710-923c-83ca2ea41087 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:13.520474 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a4e7351-6b87-4710-923c-83ca2ea41087 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 200 len: 1276 microversion: 2.1 time: 0.278189 Jul 14 14:28:13.524418 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 386/750] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:13 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 1276 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:13.539307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-297d81d8-c77f-4808-9eb5-237aa3cdec2c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:13.541337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-297d81d8-c77f-4808-9eb5-237aa3cdec2c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:13.549896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-297d81d8-c77f-4808-9eb5-237aa3cdec2c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:13.549896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-297d81d8-c77f-4808-9eb5-237aa3cdec2c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:13.550217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-297d81d8-c77f-4808-9eb5-237aa3cdec2c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:13.550466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-297d81d8-c77f-4808-9eb5-237aa3cdec2c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:13.730633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1692119979", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "62b0ffd3-9221-4455-a14e-d733e4d9c76a"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:13.781870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-297d81d8-c77f-4808-9eb5-237aa3cdec2c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:13.809679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-297d81d8-c77f-4808-9eb5-237aa3cdec2c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:13.811669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-297d81d8-c77f-4808-9eb5-237aa3cdec2c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:13.813202 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-297d81d8-c77f-4808-9eb5-237aa3cdec2c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1568 microversion: 2.25 time: 0.288019 Jul 14 14:28:13.814058 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 387/751] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:13 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:13.818972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c3c988ae-55c5-49e4-a5be-37eee003d140 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:13.819856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c3c988ae-55c5-49e4-a5be-37eee003d140 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:13.831069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3c988ae-55c5-49e4-a5be-37eee003d140 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:13.831853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3c988ae-55c5-49e4-a5be-37eee003d140 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:13.833595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3c988ae-55c5-49e4-a5be-37eee003d140 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:13.834241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3c988ae-55c5-49e4-a5be-37eee003d140 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:13.909138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] validate_networks() for [('62b0ffd3-9221-4455-a14e-d733e4d9c76a', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:28:14.509324 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c3c988ae-55c5-49e4-a5be-37eee003d140 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1645 microversion: 2.1 time: 0.690968 Jul 14 14:28:14.510857 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 388/752] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:13 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1645 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:14.522407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65c141d0-a887-4d82-a77a-6e8b0da7a59f tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:14.639443 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65c141d0-a887-4d82-a77a-6e8b0da7a59f tempest-ServersWithSpecificFlavorTestJSON-1263382223 tempest-ServersWithSpecificFlavorTestJSON-1263382223-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.123896 Jul 14 14:28:14.669104 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 389/753] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:28:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:14.678828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c499724c-000d-42b4-a729-3f6a04976f59 req-d511934a-eb5a-4dba-8d70-2e1c9fb1a8ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "037d7f27-c02b-4c2e-8039-2efba995484d", "tag": "f836c7c7-f03f-4d05-a974-793760051e3e"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:14.719258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c499724c-000d-42b4-a729-3f6a04976f59 req-d511934a-eb5a-4dba-8d70-2e1c9fb1a8ba service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:14.719761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c499724c-000d-42b4-a729-3f6a04976f59 req-d511934a-eb5a-4dba-8d70-2e1c9fb1a8ba service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:14.749652 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c499724c-000d-42b4-a729-3f6a04976f59 req-d511934a-eb5a-4dba-8d70-2e1c9fb1a8ba service nova] Creating event network-changed:f836c7c7-f03f-4d05-a974-793760051e3e for instance 037d7f27-c02b-4c2e-8039-2efba995484d on n-h2-767704-28 Jul 14 14:28:14.762206 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c499724c-000d-42b4-a729-3f6a04976f59 req-d511934a-eb5a-4dba-8d70-2e1c9fb1a8ba service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090562 Jul 14 14:28:14.764334 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 390/754] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:14.786671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-03a0f3c9-3566-44c1-a57d-36ef90bab750 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:14.788930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-03a0f3c9-3566-44c1-a57d-36ef90bab750 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:14.811469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03a0f3c9-3566-44c1-a57d-36ef90bab750 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:14.816856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03a0f3c9-3566-44c1-a57d-36ef90bab750 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:14.824468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03a0f3c9-3566-44c1-a57d-36ef90bab750 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:14.825314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03a0f3c9-3566-44c1-a57d-36ef90bab750 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:15.519134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-03a0f3c9-3566-44c1-a57d-36ef90bab750 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:15.528045 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-03a0f3c9-3566-44c1-a57d-36ef90bab750 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1315 microversion: 2.1 time: 0.762161 Jul 14 14:28:15.529896 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 391/755] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:14 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:15.531144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:28:15.531598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:28:15.533093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:28:15.533571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:28:15.534076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:28:15.541263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a9f44ebe-e997-4433-866c-cbeb38bf24c3 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:15.542136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a9f44ebe-e997-4433-866c-cbeb38bf24c3 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:15.553460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:15.554093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:15.555295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:15.558460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9f44ebe-e997-4433-866c-cbeb38bf24c3 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:15.558621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:15.559525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9f44ebe-e997-4433-866c-cbeb38bf24c3 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:15.560655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9f44ebe-e997-4433-866c-cbeb38bf24c3 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:15.561342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9f44ebe-e997-4433-866c-cbeb38bf24c3 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:15.608688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Getting quotas for project 8005f93725b7435db246f74917f659cf. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:15.620018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Getting quotas for user a39d4bccdf9c403381a49a6c857d4869 and project 8005f93725b7435db246f74917f659cf. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:15.670832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:28:15.675232 n-d-767704-28 devstack@n-api.service[119511]: WARNING nova.utils [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1692119979 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-169211997 Jul 14 14:28:15.676254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:28:15.800560 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d4bfc4d-56ef-44a0-b2e3-d18646386d3e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.393055 Jul 14 14:28:15.804192 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 365/756] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:28:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:28:15.817667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5abaf468-ccec-4c40-89e7-ece4b8de6564 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:15.820749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5abaf468-ccec-4c40-89e7-ece4b8de6564 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:15.829589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5abaf468-ccec-4c40-89e7-ece4b8de6564 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:15.830121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5abaf468-ccec-4c40-89e7-ece4b8de6564 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:15.831099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5abaf468-ccec-4c40-89e7-ece4b8de6564 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:15.831880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5abaf468-ccec-4c40-89e7-ece4b8de6564 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:16.067467 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a9f44ebe-e997-4433-866c-cbeb38bf24c3 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1645 microversion: 2.1 time: 0.536301 Jul 14 14:28:16.084195 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 392/757] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:15 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1645 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:16.090070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-69ef99ec-cacc-4d67-a6f4-7858fdae2da9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:16.091236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-69ef99ec-cacc-4d67-a6f4-7858fdae2da9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:16.098816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69ef99ec-cacc-4d67-a6f4-7858fdae2da9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:16.112470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69ef99ec-cacc-4d67-a6f4-7858fdae2da9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:16.114059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69ef99ec-cacc-4d67-a6f4-7858fdae2da9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:16.114734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69ef99ec-cacc-4d67-a6f4-7858fdae2da9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:16.145786 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-69ef99ec-cacc-4d67-a6f4-7858fdae2da9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] HTTP exception thrown: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-69ef99ec-cacc-4d67-a6f4-7858fdae2da9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Request method failure captured: Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 HTTP/1.1 Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdIddzeeFOBuXGDkG7qohZvrhAYkZRc3Y0tL_qXqMEL7HiWe9FKD0rgbYnX3iq27omeJCiv1ZTv6CWInNCSaOjQJqo967Gdzw0ZZw1AdFQFZvCEZrJ3oIyBZZBpMFDAOrlyqW61FdlO_powPr40OnD07ZwtugsnqJlFiSZYiLHpL8I Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:28:16.147518 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:28:16.149073 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53cea64d639b4a58ae486bf556526b25", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}] Jul 14 14:28:16.149073 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:16.149073 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:16.149073 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:16.149073 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:16.149073 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:28:16.149073 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:28:16.149073 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 05b7a8b4d7344e5cb2938c8e2f1ab1f7 Jul 14 14:28:16.149073 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:16.149073 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:28:16.149073 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:16.149073 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '32c5728e-50ec-43f4-bd4e-8d7b9217bb69'} Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:16.149817 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:16.151031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:16.152219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-69ef99ec-cacc-4d67-a6f4-7858fdae2da9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Returning 404 to user: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:16.152219 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-69ef99ec-cacc-4d67-a6f4-7858fdae2da9 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "DELETE /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 404 len: 111 microversion: 2.1 time: 0.063733 Jul 14 14:28:16.153482 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 393/758] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:28:16 2022] DELETE /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:16.160656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9354c993-1e20-4e53-b9c8-a71bc63efdce tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:16.161358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9354c993-1e20-4e53-b9c8-a71bc63efdce tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:16.182119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9354c993-1e20-4e53-b9c8-a71bc63efdce tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:16.183047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9354c993-1e20-4e53-b9c8-a71bc63efdce tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:16.184290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9354c993-1e20-4e53-b9c8-a71bc63efdce tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:16.184964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9354c993-1e20-4e53-b9c8-a71bc63efdce tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:16.364600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5abaf468-ccec-4c40-89e7-ece4b8de6564 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:16.383939 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5abaf468-ccec-4c40-89e7-ece4b8de6564 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 200 len: 1318 microversion: 2.1 time: 0.574655 Jul 14 14:28:16.384587 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 366/759] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:15 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:16.401259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-581f7189-ec35-4584-bfb3-cde7e4ce36a4 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:16.404125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-581f7189-ec35-4584-bfb3-cde7e4ce36a4 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:16.677748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-581f7189-ec35-4584-bfb3-cde7e4ce36a4 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39d4bccdf9c403381a49a6c857d4869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8005f93725b7435db246f74917f659cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:16.688495 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-581f7189-ec35-4584-bfb3-cde7e4ce36a4 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 200 len: 1232 microversion: 2.1 time: 0.300206 Jul 14 14:28:16.689454 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 367/760] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:16 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 1232 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:16.697250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ae26631-d07b-4321-b220-b3d761b1e97c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:16.706878 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:16.706878 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:28:16.708733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ae26631-d07b-4321-b220-b3d761b1e97c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:16.709447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ae26631-d07b-4321-b220-b3d761b1e97c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:16.710422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ae26631-d07b-4321-b220-b3d761b1e97c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:16.715289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ae26631-d07b-4321-b220-b3d761b1e97c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:16.771188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9354c993-1e20-4e53-b9c8-a71bc63efdce tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:16.776342 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8ae26631-d07b-4321-b220-b3d761b1e97c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.085801 Jul 14 14:28:16.778836 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 368/761] 10.222.0.81 () {58 vars in 1175 bytes} [Thu Jul 14 14:28:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:16.789378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9354c993-1e20-4e53-b9c8-a71bc63efdce tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:16.796028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9354c993-1e20-4e53-b9c8-a71bc63efdce tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:16.796711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f61d8b25-a0de-4d8c-bbd9-186275108062 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:16.797609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f61d8b25-a0de-4d8c-bbd9-186275108062 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: 32c5728e-50ec-43f4-bd4e-8d7b9217bb69] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:16.805982 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9354c993-1e20-4e53-b9c8-a71bc63efdce tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1568 microversion: 2.25 time: 0.643163 Jul 14 14:28:16.808480 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 394/762] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:16 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1568 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:16.810530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f61d8b25-a0de-4d8c-bbd9-186275108062 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:16.812796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f61d8b25-a0de-4d8c-bbd9-186275108062 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:16.815408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f61d8b25-a0de-4d8c-bbd9-186275108062 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:16.816017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f61d8b25-a0de-4d8c-bbd9-186275108062 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:16.849909 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f61d8b25-a0de-4d8c-bbd9-186275108062 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] HTTP exception thrown: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f61d8b25-a0de-4d8c-bbd9-186275108062 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Request method failure captured: Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 HTTP/1.1 Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdIddzeeFOBuXGDkG7qohZvrhAYkZRc3Y0tL_qXqMEL7HiWe9FKD0rgbYnX3iq27omeJCiv1ZTv6CWInNCSaOjQJqo967Gdzw0ZZw1AdFQFZvCEZrJ3oIyBZZBpMFDAOrlyqW61FdlO_powPr40OnD07ZwtugsnqJlFiSZYiLHpL8I Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:28:16.862710 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:28:16.864558 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53cea64d639b4a58ae486bf556526b25", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}] Jul 14 14:28:16.864558 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:16.864558 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:16.864558 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:16.864558 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:16.864558 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:28:16.864558 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:28:16.864558 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 05b7a8b4d7344e5cb2938c8e2f1ab1f7 Jul 14 14:28:16.864558 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:16.864558 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:28:16.864558 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:16.864558 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '32c5728e-50ec-43f4-bd4e-8d7b9217bb69'} Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:16.868336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. Jul 14 14:28:16.872741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:16.876515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f61d8b25-a0de-4d8c-bbd9-186275108062 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Returning 404 to user: Instance 32c5728e-50ec-43f4-bd4e-8d7b9217bb69 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:16.876515 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f61d8b25-a0de-4d8c-bbd9-186275108062 tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69" status: 404 len: 111 microversion: 2.1 time: 0.079504 Jul 14 14:28:16.876515 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 369/763] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:16 2022] GET /compute/v2.1/servers/32c5728e-50ec-43f4-bd4e-8d7b9217bb69 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:16.876515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4af1e5f8-3818-4fed-9560-ec9339ca21b6 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Calling method '.version_select at 0x7fd6c6143f70>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:16.877076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4af1e5f8-3818-4fed-9560-ec9339ca21b6 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:16.877349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4af1e5f8-3818-4fed-9560-ec9339ca21b6 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:16.896769 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4af1e5f8-3818-4fed-9560-ec9339ca21b6 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 1972 microversion: 2.1 time: 0.029872 Jul 14 14:28:16.914129 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 370/764] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:28:16 2022] GET /compute/v2.1/os-migrations => generated 1972 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:16.923763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ac72ea5-69c9-4ec6-9a85-b377ec08bddc tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:16.924709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8ac72ea5-69c9-4ec6-9a85-b377ec08bddc tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:16.935052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ac72ea5-69c9-4ec6-9a85-b377ec08bddc tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:16.935587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ac72ea5-69c9-4ec6-9a85-b377ec08bddc tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:16.941225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ac72ea5-69c9-4ec6-9a85-b377ec08bddc tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:16.942088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ac72ea5-69c9-4ec6-9a85-b377ec08bddc tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.096325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-19a1278d-2ae2-4ef7-a348-f409a067812e tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c5eb8d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:17.224082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-19a1278d-2ae2-4ef7-a348-f409a067812e tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.224546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-19a1278d-2ae2-4ef7-a348-f409a067812e tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.226822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-19a1278d-2ae2-4ef7-a348-f409a067812e tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.228166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-19a1278d-2ae2-4ef7-a348-f409a067812e tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.311303 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-19a1278d-2ae2-4ef7-a348-f409a067812e tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/4ce7ff2372544506a9d595702a9ef3ab" status: 200 len: 148 microversion: 2.57 time: 0.500740 Jul 14 14:28:17.311932 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 395/765] 10.222.0.81 () {62 vars in 1302 bytes} [Thu Jul 14 14:28:16 2022] PUT /compute/v2.1/os-quota-sets/4ce7ff2372544506a9d595702a9ef3ab => generated 148 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:28:17.316772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a1a4b3e8-000c-4256-8110-38ede86d7e8e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:17.317344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a1a4b3e8-000c-4256-8110-38ede86d7e8e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:17.325951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1a4b3e8-000c-4256-8110-38ede86d7e8e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.326475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1a4b3e8-000c-4256-8110-38ede86d7e8e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.327297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1a4b3e8-000c-4256-8110-38ede86d7e8e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.327768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1a4b3e8-000c-4256-8110-38ede86d7e8e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.343519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8ac72ea5-69c9-4ec6-9a85-b377ec08bddc tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:17.354214 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8ac72ea5-69c9-4ec6-9a85-b377ec08bddc tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1503 microversion: 2.1 time: 0.435347 Jul 14 14:28:17.355350 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 371/766] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:16 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1503 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:17.360176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-906201ef-33de-43a2-b94d-18e5f016878f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:17.365266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-906201ef-33de-43a2-b94d-18e5f016878f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:17.378480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-906201ef-33de-43a2-b94d-18e5f016878f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.378937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-906201ef-33de-43a2-b94d-18e5f016878f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.379944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-906201ef-33de-43a2-b94d-18e5f016878f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.380384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-906201ef-33de-43a2-b94d-18e5f016878f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.397667 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-906201ef-33de-43a2-b94d-18e5f016878f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] HTTP exception thrown: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-906201ef-33de-43a2-b94d-18e5f016878f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Request method failure captured: Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 HTTP/1.1 Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdIddzeeFOBuXGDkG7qohZvrhAYkZRc3Y0tL_qXqMEL7HiWe9FKD0rgbYnX3iq27omeJCiv1ZTv6CWInNCSaOjQJqo967Gdzw0ZZw1AdFQFZvCEZrJ3oIyBZZBpMFDAOrlyqW61FdlO_powPr40OnD07ZwtugsnqJlFiSZYiLHpL8I Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:28:17.400098 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:28:17.401445 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53cea64d639b4a58ae486bf556526b25", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}] Jul 14 14:28:17.401445 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:17.401445 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:17.401445 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:17.401445 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:17.401445 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:28:17.401445 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:28:17.401445 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 05b7a8b4d7344e5cb2938c8e2f1ab1f7 Jul 14 14:28:17.401445 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:17.401445 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:28:17.401445 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:17.401445 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'a7f119f8-47c2-4c9b-a800-d16194ab2e49'} Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:17.402169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:17.403310 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:17.404451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-906201ef-33de-43a2-b94d-18e5f016878f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Returning 404 to user: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:17.404451 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-906201ef-33de-43a2-b94d-18e5f016878f tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 404 len: 111 microversion: 2.1 time: 0.045218 Jul 14 14:28:17.404451 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 372/767] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:28:17 2022] DELETE /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:17.407789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-05caa312-e09f-4b0f-a6eb-f09f3705a346 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:17.417385 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-05caa312-e09f-4b0f-a6eb-f09f3705a346 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014022 Jul 14 14:28:17.419079 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 373/768] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:28:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:17.430105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f74b8d08-fafa-42b0-95ae-d56bcc88aa2d req-2deb7961-0f6b-4990-a4a7-3f6f4a93f97b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab65834e-bbdc-4716-8ae0-f8dbbc461b03", "tag": "2170eaa3-896a-49de-b3fc-99a3f5f155a0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:17.434506 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a1a4b3e8-000c-4256-8110-38ede86d7e8e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2/action" status: 202 len: 0 microversion: 2.1 time: 0.121085 Jul 14 14:28:17.435150 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 396/769] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:28:17 2022] POST /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:28:17.440516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f74b8d08-fafa-42b0-95ae-d56bcc88aa2d req-2deb7961-0f6b-4990-a4a7-3f6f4a93f97b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.441764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f74b8d08-fafa-42b0-95ae-d56bcc88aa2d req-2deb7961-0f6b-4990-a4a7-3f6f4a93f97b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.444226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-cffe5cef-2cd5-4155-9b12-4173b5877d04 req-f85900cc-0552-4140-b284-6f4206d4c3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037d7f27-c02b-4c2e-8039-2efba995484d", "name": "network-vif-unplugged", "status": "completed", "tag": "f836c7c7-f03f-4d05-a974-793760051e3e"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:17.454988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-cffe5cef-2cd5-4155-9b12-4173b5877d04 req-f85900cc-0552-4140-b284-6f4206d4c3cb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.455181 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f74b8d08-fafa-42b0-95ae-d56bcc88aa2d req-2deb7961-0f6b-4990-a4a7-3f6f4a93f97b service nova] Creating event network-changed:2170eaa3-896a-49de-b3fc-99a3f5f155a0 for instance ab65834e-bbdc-4716-8ae0-f8dbbc461b03 on n-h2-767704-28 Jul 14 14:28:17.455426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-cffe5cef-2cd5-4155-9b12-4173b5877d04 req-f85900cc-0552-4140-b284-6f4206d4c3cb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.460459 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f74b8d08-fafa-42b0-95ae-d56bcc88aa2d req-2deb7961-0f6b-4990-a4a7-3f6f4a93f97b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040204 Jul 14 14:28:17.461879 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 374/770] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:17.470914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a6142e66-48b4-4b3b-9da5-8c42d7a41cf1 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Calling method '.version_select at 0x7fd6c63108b0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:17.484130 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-cffe5cef-2cd5-4155-9b12-4173b5877d04 req-f85900cc-0552-4140-b284-6f4206d4c3cb service nova] Creating event network-vif-unplugged:f836c7c7-f03f-4d05-a974-793760051e3e for instance 037d7f27-c02b-4c2e-8039-2efba995484d on n-h2-767704-28 Jul 14 14:28:17.496154 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-cffe5cef-2cd5-4155-9b12-4173b5877d04 req-f85900cc-0552-4140-b284-6f4206d4c3cb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059603 Jul 14 14:28:17.497081 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 397/771] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:17.502796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-819c839c-73ad-4675-922e-7c952ccb1861 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:17.503775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-819c839c-73ad-4675-922e-7c952ccb1861 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:17.511336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-819c839c-73ad-4675-922e-7c952ccb1861 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.512347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-819c839c-73ad-4675-922e-7c952ccb1861 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.515027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-819c839c-73ad-4675-922e-7c952ccb1861 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.515683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-819c839c-73ad-4675-922e-7c952ccb1861 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.545518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6142e66-48b4-4b3b-9da5-8c42d7a41cf1 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.545965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6142e66-48b4-4b3b-9da5-8c42d7a41cf1 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.546952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6142e66-48b4-4b3b-9da5-8c42d7a41cf1 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.547575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6142e66-48b4-4b3b-9da5-8c42d7a41cf1 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.575079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-819c839c-73ad-4675-922e-7c952ccb1861 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:28:17.581320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:17.583515 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a6142e66-48b4-4b3b-9da5-8c42d7a41cf1 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/4ce7ff2372544506a9d595702a9ef3ab/detail" status: 200 len: 463 microversion: 2.57 time: 0.119772 Jul 14 14:28:17.591416 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 375/772] 10.222.0.81 () {60 vars in 1303 bytes} [Thu Jul 14 14:28:17 2022] GET /compute/v2.1/os-quota-sets/4ce7ff2372544506a9d595702a9ef3ab/detail => generated 463 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:28:17.598772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1af1dcd1-cbdc-4316-af24-9d18e5ebe561 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:17.599806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1af1dcd1-cbdc-4316-af24-9d18e5ebe561 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:17.609837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1af1dcd1-cbdc-4316-af24-9d18e5ebe561 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.611098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1af1dcd1-cbdc-4316-af24-9d18e5ebe561 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.612367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1af1dcd1-cbdc-4316-af24-9d18e5ebe561 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.613894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1af1dcd1-cbdc-4316-af24-9d18e5ebe561 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.777349 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-819c839c-73ad-4675-922e-7c952ccb1861 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 204 len: 0 microversion: 2.1 time: 0.278595 Jul 14 14:28:17.779213 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 398/773] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:28:17 2022] DELETE /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:28:17.786316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-60e1339a-6944-4297-89b3-94a46fa88e6d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:17.789432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-60e1339a-6944-4297-89b3-94a46fa88e6d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] [instance: a7f119f8-47c2-4c9b-a800-d16194ab2e49] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:17.802928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60e1339a-6944-4297-89b3-94a46fa88e6d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.809425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60e1339a-6944-4297-89b3-94a46fa88e6d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.810511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60e1339a-6944-4297-89b3-94a46fa88e6d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.811066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60e1339a-6944-4297-89b3-94a46fa88e6d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.842623 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-60e1339a-6944-4297-89b3-94a46fa88e6d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] HTTP exception thrown: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-60e1339a-6944-4297-89b3-94a46fa88e6d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Request method failure captured: Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 HTTP/1.1 Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdIddzeeFOBuXGDkG7qohZvrhAYkZRc3Y0tL_qXqMEL7HiWe9FKD0rgbYnX3iq27omeJCiv1ZTv6CWInNCSaOjQJqo967Gdzw0ZZw1AdFQFZvCEZrJ3oIyBZZBpMFDAOrlyqW61FdlO_powPr40OnD07ZwtugsnqJlFiSZYiLHpL8I Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:28:17.844529 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:28:17.846394 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53cea64d639b4a58ae486bf556526b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53cea64d639b4a58ae486bf556526b25", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53cea64d639b4a58ae486bf556526b25"}]}] Jul 14 14:28:17.846394 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:17.846394 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 53cea64d639b4a58ae486bf556526b25 Jul 14 14:28:17.846394 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462 Jul 14 14:28:17.846394 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:17.846394 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:28:17.846394 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:28:17.846394 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 05b7a8b4d7344e5cb2938c8e2f1ab1f7 Jul 14 14:28:17.846394 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-581611462-project Jul 14 14:28:17.846394 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:28:17.846394 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:17.846394 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'a7f119f8-47c2-4c9b-a800-d16194ab2e49'} Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:17.847291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. Jul 14 14:28:17.848677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:17.850624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-60e1339a-6944-4297-89b3-94a46fa88e6d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] Returning 404 to user: Instance a7f119f8-47c2-4c9b-a800-d16194ab2e49 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:17.854435 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-60e1339a-6944-4297-89b3-94a46fa88e6d tempest-ServersWithSpecificFlavorTestJSON-581611462 tempest-ServersWithSpecificFlavorTestJSON-581611462-project] 10.222.0.81 "GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49" status: 404 len: 111 microversion: 2.1 time: 0.073565 Jul 14 14:28:17.857579 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 399/774] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:17 2022] GET /compute/v2.1/servers/a7f119f8-47c2-4c9b-a800-d16194ab2e49 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:17.869560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9feddd64-cbaf-44d2-9fa3-932e4a52770b tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1569970826", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:17.871685 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:17.871685 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:28:17.894333 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9feddd64-cbaf-44d2-9fa3-932e4a52770b tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.035078 Jul 14 14:28:17.900348 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 400/775] 10.222.0.81 () {60 vars in 1145 bytes} [Thu Jul 14 14:28:17 2022] POST /compute/v2.1/flavors => generated 499 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:17.900348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1acc7bbb-f878-4dde-969d-40dbccf0003c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:17.901375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1acc7bbb-f878-4dde-969d-40dbccf0003c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:17.907982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1acc7bbb-f878-4dde-969d-40dbccf0003c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.908782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1acc7bbb-f878-4dde-969d-40dbccf0003c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:17.909821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1acc7bbb-f878-4dde-969d-40dbccf0003c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:17.910508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1acc7bbb-f878-4dde-969d-40dbccf0003c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:18.059645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1af1dcd1-cbdc-4316-af24-9d18e5ebe561 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:18.067825 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1af1dcd1-cbdc-4316-af24-9d18e5ebe561 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 200 len: 1318 microversion: 2.1 time: 0.474483 Jul 14 14:28:18.068562 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 376/776] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:17 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:18.074595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5fb74f7a-46e2-4fa7-9c30-c7870823700a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:18.075311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5fb74f7a-46e2-4fa7-9c30-c7870823700a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:18.082370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fb74f7a-46e2-4fa7-9c30-c7870823700a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:18.082974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fb74f7a-46e2-4fa7-9c30-c7870823700a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:18.083868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fb74f7a-46e2-4fa7-9c30-c7870823700a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:18.085009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fb74f7a-46e2-4fa7-9c30-c7870823700a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:18.192532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5fb74f7a-46e2-4fa7-9c30-c7870823700a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39d4bccdf9c403381a49a6c857d4869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8005f93725b7435db246f74917f659cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:18.202290 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5fb74f7a-46e2-4fa7-9c30-c7870823700a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 200 len: 1290 microversion: 2.1 time: 0.132073 Jul 14 14:28:18.203205 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 377/777] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:18 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 1290 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:18.213018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0240161f-a809-4c16-b5d4-d4aa4b4c1ff4 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:18.214622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0240161f-a809-4c16-b5d4-d4aa4b4c1ff4 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:18.221308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0240161f-a809-4c16-b5d4-d4aa4b4c1ff4 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:18.221845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0240161f-a809-4c16-b5d4-d4aa4b4c1ff4 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:18.222698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0240161f-a809-4c16-b5d4-d4aa4b4c1ff4 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:18.223192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0240161f-a809-4c16-b5d4-d4aa4b4c1ff4 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:18.349662 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1acc7bbb-f878-4dde-969d-40dbccf0003c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1630 microversion: 2.1 time: 0.453141 Jul 14 14:28:18.350498 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 401/778] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:17 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1630 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:18.356464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0bba3137-702f-462a-b73b-564629b7f345 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:18.357128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0bba3137-702f-462a-b73b-564629b7f345 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:18.363621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bba3137-702f-462a-b73b-564629b7f345 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:18.364130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bba3137-702f-462a-b73b-564629b7f345 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:18.365392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bba3137-702f-462a-b73b-564629b7f345 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:18.365720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bba3137-702f-462a-b73b-564629b7f345 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:18.852012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0240161f-a809-4c16-b5d4-d4aa4b4c1ff4 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:18.861761 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0240161f-a809-4c16-b5d4-d4aa4b4c1ff4 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1509 microversion: 2.1 time: 0.657281 Jul 14 14:28:18.862807 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 378/779] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:18 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1509 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:18.868930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-019ffd2b-0033-4a39-b5db-a2d0be740020 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c63baaf0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:18.911693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0bba3137-702f-462a-b73b-564629b7f345 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:18.931893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0bba3137-702f-462a-b73b-564629b7f345 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:18.935761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0bba3137-702f-462a-b73b-564629b7f345 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:18.937590 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0bba3137-702f-462a-b73b-564629b7f345 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1568 microversion: 2.25 time: 0.585500 Jul 14 14:28:18.948891 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 402/780] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:18 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1568 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:18.955151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b6293cea-da1b-49fd-9e8b-c5dbccc1dee6 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:18.984623 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b6293cea-da1b-49fd-9e8b-c5dbccc1dee6 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034289 Jul 14 14:28:18.988153 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 403/781] 10.222.0.81 () {58 vars in 1181 bytes} [Thu Jul 14 14:28:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:28:18.988373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-019ffd2b-0033-4a39-b5db-a2d0be740020 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:18.989524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-019ffd2b-0033-4a39-b5db-a2d0be740020 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:18.990588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-019ffd2b-0033-4a39-b5db-a2d0be740020 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:18.991234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-019ffd2b-0033-4a39-b5db-a2d0be740020 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:18.993781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc3065f4-f53a-456a-96b3-62a383ed8a50 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-767704-28", "block_migration": true, "disk_over_commit": false}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:18.994988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dc3065f4-f53a-456a-96b3-62a383ed8a50 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:19.009131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc3065f4-f53a-456a-96b3-62a383ed8a50 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:19.009855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc3065f4-f53a-456a-96b3-62a383ed8a50 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:19.010815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc3065f4-f53a-456a-96b3-62a383ed8a50 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:19.011404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc3065f4-f53a-456a-96b3-62a383ed8a50 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:19.047480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-dc3065f4-f53a-456a-96b3-62a383ed8a50 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lazy-loading 'flavor' on Instance uuid ec366efc-f03e-4022-9d20-aea3951399f2 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:28:19.057770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-019ffd2b-0033-4a39-b5db-a2d0be740020 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:19.058220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-019ffd2b-0033-4a39-b5db-a2d0be740020 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:19.059947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-019ffd2b-0033-4a39-b5db-a2d0be740020 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:19.061166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-019ffd2b-0033-4a39-b5db-a2d0be740020 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:19.074789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dc3065f4-f53a-456a-96b3-62a383ed8a50 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Going to try to live migrate instance to n-h2-767704-28 {{(pid=119512) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:28:19.163475 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-019ffd2b-0033-4a39-b5db-a2d0be740020 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/4ce7ff2372544506a9d595702a9ef3ab?user_id=622d7d65d82845fba0c784999f4ab5b2" status: 200 len: 148 microversion: 2.57 time: 0.299380 Jul 14 14:28:19.170668 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 379/782] 10.222.0.81 () {62 vars in 1383 bytes} [Thu Jul 14 14:28:18 2022] PUT /compute/v2.1/os-quota-sets/4ce7ff2372544506a9d595702a9ef3ab?user_id=622d7d65d82845fba0c784999f4ab5b2 => generated 148 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:28:19.179025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-830e4c12-8133-46ac-a594-b4abf4dce135 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:19.181011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-830e4c12-8133-46ac-a594-b4abf4dce135 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:19.188987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-830e4c12-8133-46ac-a594-b4abf4dce135 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:19.189990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-830e4c12-8133-46ac-a594-b4abf4dce135 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:19.191086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-830e4c12-8133-46ac-a594-b4abf4dce135 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:19.191984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-830e4c12-8133-46ac-a594-b4abf4dce135 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:19.450025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-830e4c12-8133-46ac-a594-b4abf4dce135 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:19.458941 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-830e4c12-8133-46ac-a594-b4abf4dce135 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 200 len: 1318 microversion: 2.1 time: 0.288157 Jul 14 14:28:19.472007 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 380/783] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:19 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:19.483790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-03927d61-342c-404b-93cb-a942c30a04d2 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] Calling method '.version_select at 0x7fd6c61a4280>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:19.597612 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-03927d61-342c-404b-93cb-a942c30a04d2 tempest-QuotasAdminTestV257-1725290732 tempest-QuotasAdminTestV257-1725290732-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/4ce7ff2372544506a9d595702a9ef3ab?user_id=622d7d65d82845fba0c784999f4ab5b2" status: 200 len: 190 microversion: 2.57 time: 0.123372 Jul 14 14:28:19.598886 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 381/784] 10.222.0.81 () {60 vars in 1363 bytes} [Thu Jul 14 14:28:19 2022] GET /compute/v2.1/os-quota-sets/4ce7ff2372544506a9d595702a9ef3ab?user_id=622d7d65d82845fba0c784999f4ab5b2 => generated 190 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:28:19.615972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1512276957", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "d213a017-da8e-42b7-a3bc-f3f8383a6e4f"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:19.760168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:28:20.431239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:28:20.436859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:28:20.437692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:28:20.438274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:28:20.438837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:28:20.453768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:20.454609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:20.455779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:20.457580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:20.521040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Getting quotas for project c3e95b24eb1b4f9fbc5eb6f4d6f3d308. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:20.534419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Getting quotas for user 89894c4d380a4632870ebcb10a2ffe81 and project c3e95b24eb1b4f9fbc5eb6f4d6f3d308. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:20.598630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:20.603472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:28:20.606545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:28:20.741470 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-de1fa408-8809-4282-a57e-b7dd413fc985 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141241 Jul 14 14:28:20.743259 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 382/785] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:28:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:28:20.754918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-749c2342-b75e-4c35-9fce-c32684e16ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:20.757454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-749c2342-b75e-4c35-9fce-c32684e16ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:20.778559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-749c2342-b75e-4c35-9fce-c32684e16ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:20.781450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-749c2342-b75e-4c35-9fce-c32684e16ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:20.784800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-749c2342-b75e-4c35-9fce-c32684e16ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:20.785793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-749c2342-b75e-4c35-9fce-c32684e16ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:21.232857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-749c2342-b75e-4c35-9fce-c32684e16ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39d4bccdf9c403381a49a6c857d4869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8005f93725b7435db246f74917f659cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:21.242754 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-749c2342-b75e-4c35-9fce-c32684e16ab3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 200 len: 1332 microversion: 2.1 time: 0.497390 Jul 14 14:28:21.248716 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 383/786] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:20 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 1332 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:21.253948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-8d5d540f-afc5-4b5f-ab21-74ac3f2c8a1d req-7047ed9e-2a89-41a7-bc62-7b8904c05a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428925c9-c52e-4728-ac68-5e6c7a9932c7", "tag": "02b187bb-73fb-44ac-bdb2-7163acbe4d18"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:21.275192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8d5d540f-afc5-4b5f-ab21-74ac3f2c8a1d req-7047ed9e-2a89-41a7-bc62-7b8904c05a9b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:21.275605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8d5d540f-afc5-4b5f-ab21-74ac3f2c8a1d req-7047ed9e-2a89-41a7-bc62-7b8904c05a9b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:21.304147 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8d5d540f-afc5-4b5f-ab21-74ac3f2c8a1d req-7047ed9e-2a89-41a7-bc62-7b8904c05a9b service nova] Creating event network-changed:02b187bb-73fb-44ac-bdb2-7163acbe4d18 for instance 428925c9-c52e-4728-ac68-5e6c7a9932c7 on n-h2-767704-28 Jul 14 14:28:21.321199 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-8d5d540f-afc5-4b5f-ab21-74ac3f2c8a1d req-7047ed9e-2a89-41a7-bc62-7b8904c05a9b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070615 Jul 14 14:28:21.322108 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 384/787] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:21.332217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a1bf628b-2f10-437c-bd49-a944a63a45d1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:21.334151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a1bf628b-2f10-437c-bd49-a944a63a45d1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:21.363180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1bf628b-2f10-437c-bd49-a944a63a45d1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:21.363557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1bf628b-2f10-437c-bd49-a944a63a45d1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:21.364368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1bf628b-2f10-437c-bd49-a944a63a45d1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:21.371204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1bf628b-2f10-437c-bd49-a944a63a45d1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:21.691505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a1bf628b-2f10-437c-bd49-a944a63a45d1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94f5ca350784e759e5bd3367fec0ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2150f294254b548ec58ab159f740db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:21.724647 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a1bf628b-2f10-437c-bd49-a944a63a45d1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 200 len: 1467 microversion: 2.1 time: 0.400989 Jul 14 14:28:21.726696 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 385/788] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:21 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 1467 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:21.755390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f4f4238-28b5-4afe-a9ad-3ab020402e89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:21.763862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1f4f4238-28b5-4afe-a9ad-3ab020402e89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:21.782655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f4f4238-28b5-4afe-a9ad-3ab020402e89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:21.786201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f4f4238-28b5-4afe-a9ad-3ab020402e89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:21.787317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f4f4238-28b5-4afe-a9ad-3ab020402e89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:21.787931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f4f4238-28b5-4afe-a9ad-3ab020402e89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:21.807982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:22.098362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1f4f4238-28b5-4afe-a9ad-3ab020402e89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:22.133529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1f4f4238-28b5-4afe-a9ad-3ab020402e89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:22.157816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1f4f4238-28b5-4afe-a9ad-3ab020402e89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:22.163275 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f4f4238-28b5-4afe-a9ad-3ab020402e89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1543 microversion: 2.25 time: 0.422652 Jul 14 14:28:22.170043 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 386/789] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:21 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1543 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:22.190245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ff09329e-98ae-4b4d-b8f7-f55914d05017 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:22.191253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ff09329e-98ae-4b4d-b8f7-f55914d05017 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:22.247528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff09329e-98ae-4b4d-b8f7-f55914d05017 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:22.248001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff09329e-98ae-4b4d-b8f7-f55914d05017 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:22.255645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff09329e-98ae-4b4d-b8f7-f55914d05017 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:22.256152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff09329e-98ae-4b4d-b8f7-f55914d05017 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:22.317492 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dc3065f4-f53a-456a-96b3-62a383ed8a50 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2/action" status: 202 len: 0 microversion: 2.1 time: 3.328004 Jul 14 14:28:22.318107 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 404/790] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:28:18 2022] POST /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2/action => generated 0 bytes in 3329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:28:22.326715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-14e3070e-4174-4554-8ac9-1a0552c679a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:22.327593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-14e3070e-4174-4554-8ac9-1a0552c679a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:22.342506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:22.344320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14e3070e-4174-4554-8ac9-1a0552c679a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:22.344958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14e3070e-4174-4554-8ac9-1a0552c679a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:22.346207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14e3070e-4174-4554-8ac9-1a0552c679a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:22.346961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14e3070e-4174-4554-8ac9-1a0552c679a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:22.475275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-14e3070e-4174-4554-8ac9-1a0552c679a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:22.483611 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-14e3070e-4174-4554-8ac9-1a0552c679a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1331 microversion: 2.1 time: 0.160717 Jul 14 14:28:22.484193 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 405/791] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:22 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:22.498360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff0bb280-b1d5-49cc-9a1a-ebc3c07d547b tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '.version_select at 0x7fd6c5e608b0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:22.500773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff0bb280-b1d5-49cc-9a1a-ebc3c07d547b tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:22.501258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff0bb280-b1d5-49cc-9a1a-ebc3c07d547b tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:22.507861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ff09329e-98ae-4b4d-b8f7-f55914d05017 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:22.528098 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ff09329e-98ae-4b4d-b8f7-f55914d05017 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 200 len: 1318 microversion: 2.1 time: 0.354580 Jul 14 14:28:22.528995 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 387/792] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:22 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:22.543643 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ff0bb280-b1d5-49cc-9a1a-ebc3c07d547b tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 2808 microversion: 2.25 time: 0.058394 Jul 14 14:28:22.545534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4dba912c-8faa-41ef-8256-211f13527a30 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:22.547864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4dba912c-8faa-41ef-8256-211f13527a30 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:22.551294 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 406/793] 10.222.0.81 () {60 vars in 1183 bytes} [Thu Jul 14 14:28:22 2022] GET /compute/v2.1/os-migrations => generated 2808 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:22.563316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9c37f6e0-9c82-4333-ad6c-030ed5f8e196 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:22.564276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9c37f6e0-9c82-4333-ad6c-030ed5f8e196 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:22.571572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4dba912c-8faa-41ef-8256-211f13527a30 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:22.572031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4dba912c-8faa-41ef-8256-211f13527a30 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:22.572822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4dba912c-8faa-41ef-8256-211f13527a30 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:22.577184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4dba912c-8faa-41ef-8256-211f13527a30 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:22.589979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9c37f6e0-9c82-4333-ad6c-030ed5f8e196 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:22.590976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9c37f6e0-9c82-4333-ad6c-030ed5f8e196 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:22.591921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9c37f6e0-9c82-4333-ad6c-030ed5f8e196 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:22.594445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9c37f6e0-9c82-4333-ad6c-030ed5f8e196 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.123045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4dba912c-8faa-41ef-8256-211f13527a30 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39d4bccdf9c403381a49a6c857d4869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8005f93725b7435db246f74917f659cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:23.140886 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4dba912c-8faa-41ef-8256-211f13527a30 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 200 len: 1332 microversion: 2.1 time: 0.609573 Jul 14 14:28:23.141842 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 388/794] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:22 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 1332 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:23.153033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9c37f6e0-9c82-4333-ad6c-030ed5f8e196 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:23.166434 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9c37f6e0-9c82-4333-ad6c-030ed5f8e196 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1502 microversion: 2.1 time: 0.613685 Jul 14 14:28:23.167111 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 407/795] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:22 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1502 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:23.185884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-644619bb-7c30-421c-824a-0be71f384a9d tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:23.186620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-644619bb-7c30-421c-824a-0be71f384a9d tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:23.189132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e81ce178-881d-4775-bf23-4f012a964243 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:23.190038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e81ce178-881d-4775-bf23-4f012a964243 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:23.196169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-644619bb-7c30-421c-824a-0be71f384a9d tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.196879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-644619bb-7c30-421c-824a-0be71f384a9d tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.197730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e81ce178-881d-4775-bf23-4f012a964243 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.197915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-644619bb-7c30-421c-824a-0be71f384a9d tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.198454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-644619bb-7c30-421c-824a-0be71f384a9d tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.198581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e81ce178-881d-4775-bf23-4f012a964243 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.199370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e81ce178-881d-4775-bf23-4f012a964243 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.199921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e81ce178-881d-4775-bf23-4f012a964243 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.215386 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-e81ce178-881d-4775-bf23-4f012a964243 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] HTTP exception thrown: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e81ce178-881d-4775-bf23-4f012a964243 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Request method failure captured: Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 HTTP/1.1 Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cfljha0yS3Re8fi2Wd2Pcph2wkhd_T_aNrmg-WjLY6CMDfJ4DEcg8McbdhdBnR2Uc8DRpJFP7JGX17BOr-av6Qsu_YV3HpgEl2_108Ym4P5FwjXCFMebxviYUWc8T6kIgyiKKiB4_K__SSaJAghR5YoHGAQal34aop-D1gKP-xL-8w Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:28:23.217335 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:28:23.218822 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e2150f294254b548ec58ab159f740db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e2150f294254b548ec58ab159f740db", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}] Jul 14 14:28:23.218822 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.218822 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.218822 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.218822 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.218822 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:28:23.218822 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:28:23.218822 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d94f5ca350784e759e5bd3367fec0ac6 Jul 14 14:28:23.218822 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.218822 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:28:23.218822 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.218822 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '4a52556b-56d6-4a9d-9ef3-6cf070d835b6'} Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:23.219767 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.221783 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.223063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e81ce178-881d-4775-bf23-4f012a964243 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Returning 404 to user: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:23.223699 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e81ce178-881d-4775-bf23-4f012a964243 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 404 len: 111 microversion: 2.1 time: 0.038703 Jul 14 14:28:23.224491 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 408/796] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:23 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:23.233398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3590bf71-70f4-48f3-b900-5604b7e8057e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1782839316", "metadata": {"image_type": "test"}}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:23.234966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3590bf71-70f4-48f3-b900-5604b7e8057e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:23.241742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3590bf71-70f4-48f3-b900-5604b7e8057e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.243956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3590bf71-70f4-48f3-b900-5604b7e8057e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.244494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3590bf71-70f4-48f3-b900-5604b7e8057e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.244980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3590bf71-70f4-48f3-b900-5604b7e8057e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.269510 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3590bf71-70f4-48f3-b900-5604b7e8057e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] HTTP exception thrown: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3590bf71-70f4-48f3-b900-5604b7e8057e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Request method failure captured: Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6/action HTTP/1.1 Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 112 Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cfljha0yS3Re8fi2Wd2Pcph2wkhd_T_aNrmg-WjLY6CMDfJ4DEcg8McbdhdBnR2Uc8DRpJFP7JGX17BOr-av6Qsu_YV3HpgEl2_108Ym4P5FwjXCFMebxviYUWc8T6kIgyiKKiB4_K__SSaJAghR5YoHGAQal34aop-D1gKP-xL-8w Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:28:23.272171 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:28:23.274685 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e2150f294254b548ec58ab159f740db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e2150f294254b548ec58ab159f740db", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}] Jul 14 14:28:23.274685 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.274685 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.274685 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.274685 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.274685 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:28:23.274685 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:28:23.274685 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d94f5ca350784e759e5bd3367fec0ac6 Jul 14 14:28:23.274685 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.274685 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:28:23.274685 n-d-767704-28 devstack@n-api.service[119512]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1782839316", "metadata": {"image_type": "test"}}} Jul 14 14:28:23.274685 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '4a52556b-56d6-4a9d-9ef3-6cf070d835b6', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1782839316', 'metadata': {'image_type': 'test'}}}} Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.275784 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1318, in _action_create_image Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.277204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.278667 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.278667 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:23.278667 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:23.278667 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.278667 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.278667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3590bf71-70f4-48f3-b900-5604b7e8057e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Returning 404 to user: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:23.278667 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3590bf71-70f4-48f3-b900-5604b7e8057e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "POST /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6/action" status: 404 len: 111 microversion: 2.1 time: 0.044531 Jul 14 14:28:23.278667 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 409/797] 10.222.0.81 () {60 vars in 1278 bytes} [Thu Jul 14 14:28:23 2022] POST /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:28:23.300279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-19f9ab79-68c8-4b41-8f82-a41bd10bce4e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2034218489", "metadata": {"image_type": "test"}}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:23.302268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-19f9ab79-68c8-4b41-8f82-a41bd10bce4e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Failed to fetch instance by id tempest-invalid-2077419766 {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 14:28:23.303024 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-19f9ab79-68c8-4b41-8f82-a41bd10bce4e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] HTTP exception thrown: Instance tempest-invalid-2077419766 could not be found. Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-19f9ab79-68c8-4b41-8f82-a41bd10bce4e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Request method failure captured: Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/tempest-invalid-2077419766/action HTTP/1.1 Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 112 Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cfljha0yS3Re8fi2Wd2Pcph2wkhd_T_aNrmg-WjLY6CMDfJ4DEcg8McbdhdBnR2Uc8DRpJFP7JGX17BOr-av6Qsu_YV3HpgEl2_108Ym4P5FwjXCFMebxviYUWc8T6kIgyiKKiB4_K__SSaJAghR5YoHGAQal34aop-D1gKP-xL-8w Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:28:23.304842 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e2150f294254b548ec58ab159f740db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e2150f294254b548ec58ab159f740db", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}] Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d94f5ca350784e759e5bd3367fec0ac6 Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2034218489", "metadata": {"image_type": "test"}}} Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:28:23.306998 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance tempest-invalid-2077419766 could not be found. Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'tempest-invalid-2077419766', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2034218489', 'metadata': {'image_type': 'test'}}}} Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-2077419766 could not be found. Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:23.307932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1318, in _action_create_image Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-2077419766 could not be found. Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-2077419766 could not be found. Jul 14 14:28:23.309454 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.318245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-19f9ab79-68c8-4b41-8f82-a41bd10bce4e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Returning 404 to user: Instance tempest-invalid-2077419766 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:23.318245 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-19f9ab79-68c8-4b41-8f82-a41bd10bce4e tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "POST /compute/v2.1/servers/tempest-invalid-2077419766/action" status: 404 len: 101 microversion: 2.1 time: 0.028558 Jul 14 14:28:23.319219 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 410/798] 10.222.0.81 () {60 vars in 1248 bytes} [Thu Jul 14 14:28:23 2022] POST /compute/v2.1/servers/tempest-invalid-2077419766/action => generated 101 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:23.325102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36f653ea-3ba4-4271-9354-c25be1fff1a1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-79372018"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:23.326405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-36f653ea-3ba4-4271-9354-c25be1fff1a1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 14:28:23.327077 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-36f653ea-3ba4-4271-9354-c25be1fff1a1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36f653ea-3ba4-4271-9354-c25be1fff1a1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Request method failure captured: Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 55 Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cfljha0yS3Re8fi2Wd2Pcph2wkhd_T_aNrmg-WjLY6CMDfJ4DEcg8McbdhdBnR2Uc8DRpJFP7JGX17BOr-av6Qsu_YV3HpgEl2_108Ym4P5FwjXCFMebxviYUWc8T6kIgyiKKiB4_K__SSaJAghR5YoHGAQal34aop-D1gKP-xL-8w Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:28:23.328634 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e2150f294254b548ec58ab159f740db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e2150f294254b548ec58ab159f740db", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}] Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d94f5ca350784e759e5bd3367fec0ac6 Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: {"createImage": {"name": "tempest-test-snap-79372018"}} Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:28:23.330408 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-79372018'}}} Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:23.331546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1318, in _action_create_image Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:28:23.333179 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.337756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36f653ea-3ba4-4271-9354-c25be1fff1a1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:23.337756 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-36f653ea-3ba4-4271-9354-c25be1fff1a1 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009664 Jul 14 14:28:23.337756 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 411/799] 10.222.0.81 () {60 vars in 1274 bytes} [Thu Jul 14 14:28:23 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:23.343853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0ca0ff85-61f8-4797-ad76-f365822f2f7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-74204701"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:23.346011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0ca0ff85-61f8-4797-ad76-f365822f2f7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 14:28:23.346523 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-0ca0ff85-61f8-4797-ad76-f365822f2f7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0ca0ff85-61f8-4797-ad76-f365822f2f7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Request method failure captured: Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 55 Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cfljha0yS3Re8fi2Wd2Pcph2wkhd_T_aNrmg-WjLY6CMDfJ4DEcg8McbdhdBnR2Uc8DRpJFP7JGX17BOr-av6Qsu_YV3HpgEl2_108Ym4P5FwjXCFMebxviYUWc8T6kIgyiKKiB4_K__SSaJAghR5YoHGAQal34aop-D1gKP-xL-8w Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:28:23.348237 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e2150f294254b548ec58ab159f740db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e2150f294254b548ec58ab159f740db", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}] Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d94f5ca350784e759e5bd3367fec0ac6 Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: {"createImage": {"name": "tempest-test-snap-74204701"}} Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:28:23.349875 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-74204701'}}} Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:23.351193 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1318, in _action_create_image Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:28:23.353213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.355098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0ca0ff85-61f8-4797-ad76-f365822f2f7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:23.355098 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0ca0ff85-61f8-4797-ad76-f365822f2f7d tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011210 Jul 14 14:28:23.355098 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 412/800] 10.222.0.81 () {60 vars in 1280 bytes} [Thu Jul 14 14:28:23 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:23.363791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b61530a5-2648-4a2c-bce7-00cad6471150 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:23.364518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b61530a5-2648-4a2c-bce7-00cad6471150 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:23.372554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b61530a5-2648-4a2c-bce7-00cad6471150 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.373892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b61530a5-2648-4a2c-bce7-00cad6471150 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.375272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b61530a5-2648-4a2c-bce7-00cad6471150 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.376607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b61530a5-2648-4a2c-bce7-00cad6471150 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.399308 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-b61530a5-2648-4a2c-bce7-00cad6471150 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] HTTP exception thrown: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b61530a5-2648-4a2c-bce7-00cad6471150 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Request method failure captured: Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 HTTP/1.1 Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cfljha0yS3Re8fi2Wd2Pcph2wkhd_T_aNrmg-WjLY6CMDfJ4DEcg8McbdhdBnR2Uc8DRpJFP7JGX17BOr-av6Qsu_YV3HpgEl2_108Ym4P5FwjXCFMebxviYUWc8T6kIgyiKKiB4_K__SSaJAghR5YoHGAQal34aop-D1gKP-xL-8w Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:28:23.401094 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:28:23.402391 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e2150f294254b548ec58ab159f740db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e2150f294254b548ec58ab159f740db", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}] Jul 14 14:28:23.402391 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.402391 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.402391 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.402391 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.402391 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:28:23.402391 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:28:23.402391 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d94f5ca350784e759e5bd3367fec0ac6 Jul 14 14:28:23.402391 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.402391 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:28:23.402391 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.402391 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '4a52556b-56d6-4a9d-9ef3-6cf070d835b6'} Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:23.403107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.404467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.405775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b61530a5-2648-4a2c-bce7-00cad6471150 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Returning 404 to user: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:23.405775 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b61530a5-2648-4a2c-bce7-00cad6471150 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 404 len: 111 microversion: 2.1 time: 0.044459 Jul 14 14:28:23.405775 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 413/801] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:28:23 2022] DELETE /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:23.411304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b0e8ca68-771a-4e6e-bd1a-a74e5e90ab28 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:23.413674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b0e8ca68-771a-4e6e-bd1a-a74e5e90ab28 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] [instance: 4a52556b-56d6-4a9d-9ef3-6cf070d835b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:23.428673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0e8ca68-771a-4e6e-bd1a-a74e5e90ab28 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.429485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0e8ca68-771a-4e6e-bd1a-a74e5e90ab28 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.430951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0e8ca68-771a-4e6e-bd1a-a74e5e90ab28 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.431469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0e8ca68-771a-4e6e-bd1a-a74e5e90ab28 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.474070 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-b0e8ca68-771a-4e6e-bd1a-a74e5e90ab28 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] HTTP exception thrown: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b0e8ca68-771a-4e6e-bd1a-a74e5e90ab28 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Request method failure captured: Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 HTTP/1.1 Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cfljha0yS3Re8fi2Wd2Pcph2wkhd_T_aNrmg-WjLY6CMDfJ4DEcg8McbdhdBnR2Uc8DRpJFP7JGX17BOr-av6Qsu_YV3HpgEl2_108Ym4P5FwjXCFMebxviYUWc8T6kIgyiKKiB4_K__SSaJAghR5YoHGAQal34aop-D1gKP-xL-8w Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:28:23.477467 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:28:23.478823 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e2150f294254b548ec58ab159f740db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e2150f294254b548ec58ab159f740db", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e2150f294254b548ec58ab159f740db"}]}] Jul 14 14:28:23.478823 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.478823 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 7e2150f294254b548ec58ab159f740db Jul 14 14:28:23.478823 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1295787427 Jul 14 14:28:23.478823 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.478823 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:28:23.478823 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:28:23.478823 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d94f5ca350784e759e5bd3367fec0ac6 Jul 14 14:28:23.478823 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesNegativeTestJSON-1295787427-project Jul 14 14:28:23.478823 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:28:23.478823 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.478823 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '4a52556b-56d6-4a9d-9ef3-6cf070d835b6'} Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:23.479691 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. Jul 14 14:28:23.480878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:23.481962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b0e8ca68-771a-4e6e-bd1a-a74e5e90ab28 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] Returning 404 to user: Instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:23.481962 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b0e8ca68-771a-4e6e-bd1a-a74e5e90ab28 tempest-ImagesNegativeTestJSON-1295787427 tempest-ImagesNegativeTestJSON-1295787427-project] 10.222.0.81 "GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6" status: 404 len: 111 microversion: 2.1 time: 0.071774 Jul 14 14:28:23.483259 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 414/802] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:23 2022] GET /compute/v2.1/servers/4a52556b-56d6-4a9d-9ef3-6cf070d835b6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:23.486964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-644619bb-7c30-421c-824a-0be71f384a9d tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid 037d7f27-c02b-4c2e-8039-2efba995484d {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:28:23.490641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4ed5b497-0334-4515-9518-e2f20bc1ec6c req-1d4d6ed3-4288-4399-b238-911f5366ebb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a52556b-56d6-4a9d-9ef3-6cf070d835b6", "name": "network-vif-deleted", "tag": "24ffd5b2-4449-44a5-99f9-cf31a744c4c3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:23.501173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4ed5b497-0334-4515-9518-e2f20bc1ec6c req-1d4d6ed3-4288-4399-b238-911f5366ebb5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.501621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4ed5b497-0334-4515-9518-e2f20bc1ec6c req-1d4d6ed3-4288-4399-b238-911f5366ebb5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.519385 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4ed5b497-0334-4515-9518-e2f20bc1ec6c req-1d4d6ed3-4288-4399-b238-911f5366ebb5 service nova] Creating event network-vif-deleted:24ffd5b2-4449-44a5-99f9-cf31a744c4c3 for instance 4a52556b-56d6-4a9d-9ef3-6cf070d835b6 on n-h1-767704-28 Jul 14 14:28:23.523291 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-644619bb-7c30-421c-824a-0be71f384a9d tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 2038 microversion: 2.25 time: 0.379977 Jul 14 14:28:23.524525 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 389/803] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:23 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 2038 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:23.531401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8373f76c-bd38-4a53-9bea-0077fb1d4e4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:23.532232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8373f76c-bd38-4a53-9bea-0077fb1d4e4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:23.540862 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4ed5b497-0334-4515-9518-e2f20bc1ec6c req-1d4d6ed3-4288-4399-b238-911f5366ebb5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055904 Jul 14 14:28:23.542146 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 415/804] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:23.549617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8373f76c-bd38-4a53-9bea-0077fb1d4e4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.560673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-81e251ac-b514-4411-804a-77aa250ac291 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:23.561746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8373f76c-bd38-4a53-9bea-0077fb1d4e4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.562621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8373f76c-bd38-4a53-9bea-0077fb1d4e4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.563078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8373f76c-bd38-4a53-9bea-0077fb1d4e4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.564845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-81e251ac-b514-4411-804a-77aa250ac291 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:23.577043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81e251ac-b514-4411-804a-77aa250ac291 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.582717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81e251ac-b514-4411-804a-77aa250ac291 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.588384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81e251ac-b514-4411-804a-77aa250ac291 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.589191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81e251ac-b514-4411-804a-77aa250ac291 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.689050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8373f76c-bd38-4a53-9bea-0077fb1d4e4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:23.705772 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8373f76c-bd38-4a53-9bea-0077fb1d4e4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1337 microversion: 2.1 time: 0.179112 Jul 14 14:28:23.706648 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 390/805] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:23 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1337 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:23.712391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c4658150-e751-426c-ae8f-e4ea6a4cc46b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Action: 'create', calling method: .version_select at 0x7fd6c6143af0>, body: {"keypair": {"name": "tempest-keypair-1784821049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRWbLIdlOu6S79KSCcatKzLTDvbTZQ5CO2HkcriLcxB+RwlD1QqeKA3SV4R4zkktKCFzepnvORkaroRHC5JkntbmskdgBe68TwRZL/7HBY4OTUK+rKX+3DEKFFEPF7CpA=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:23.733886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-c4658150-e751-426c-ae8f-e4ea6a4cc46b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Getting quotas for project 4459eedeb8884ffe82ed62e567fb64c3. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:23.739231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-c4658150-e751-426c-ae8f-e4ea6a4cc46b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Getting quotas for user ef25b01962404bdfa0c2bbb30401ca62 and project 4459eedeb8884ffe82ed62e567fb64c3. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:23.765914 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c4658150-e751-426c-ae8f-e4ea6a4cc46b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.057999 Jul 14 14:28:23.766893 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 391/806] 10.222.0.81 () {62 vars in 1199 bytes} [Thu Jul 14 14:28:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:28:23.779981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-2e8c19a2-efd5-42b9-8423-e8449833391f req-d1268d74-363a-4fa4-adcb-5b48ab74ef34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab65834e-bbdc-4716-8ae0-f8dbbc461b03", "name": "network-vif-plugged", "status": "completed", "tag": "2170eaa3-896a-49de-b3fc-99a3f5f155a0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:23.790204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2e8c19a2-efd5-42b9-8423-e8449833391f req-d1268d74-363a-4fa4-adcb-5b48ab74ef34 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:23.791000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2e8c19a2-efd5-42b9-8423-e8449833391f req-d1268d74-363a-4fa4-adcb-5b48ab74ef34 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:23.805342 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-2e8c19a2-efd5-42b9-8423-e8449833391f req-d1268d74-363a-4fa4-adcb-5b48ab74ef34 service nova] Creating event network-vif-plugged:2170eaa3-896a-49de-b3fc-99a3f5f155a0 for instance ab65834e-bbdc-4716-8ae0-f8dbbc461b03 on n-h2-767704-28 Jul 14 14:28:23.812153 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-2e8c19a2-efd5-42b9-8423-e8449833391f req-d1268d74-363a-4fa4-adcb-5b48ab74ef34 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037085 Jul 14 14:28:23.813989 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 392/807] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:24.160711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-03b1cb30-183b-4b76-ba8e-9888433e1b26 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:24.161782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-03b1cb30-183b-4b76-ba8e-9888433e1b26 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:24.172112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03b1cb30-183b-4b76-ba8e-9888433e1b26 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:24.173604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03b1cb30-183b-4b76-ba8e-9888433e1b26 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:24.175302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03b1cb30-183b-4b76-ba8e-9888433e1b26 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:24.176184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03b1cb30-183b-4b76-ba8e-9888433e1b26 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:24.211600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-81e251ac-b514-4411-804a-77aa250ac291 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:24.219174 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-81e251ac-b514-4411-804a-77aa250ac291 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 200 len: 1318 microversion: 2.1 time: 0.675669 Jul 14 14:28:24.220025 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 416/808] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:23 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 1318 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:24.225329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18767e16-db7e-44a1-9b49-166b24e645ec tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:24.226156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-18767e16-db7e-44a1-9b49-166b24e645ec tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:24.238567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18767e16-db7e-44a1-9b49-166b24e645ec tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:24.241370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18767e16-db7e-44a1-9b49-166b24e645ec tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:24.243013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18767e16-db7e-44a1-9b49-166b24e645ec tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:24.243638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18767e16-db7e-44a1-9b49-166b24e645ec tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:24.555906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-03b1cb30-183b-4b76-ba8e-9888433e1b26 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39d4bccdf9c403381a49a6c857d4869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8005f93725b7435db246f74917f659cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:24.565247 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-03b1cb30-183b-4b76-ba8e-9888433e1b26 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 200 len: 1332 microversion: 2.1 time: 0.410801 Jul 14 14:28:24.569271 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 393/809] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:24 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 1332 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:24.598035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18767e16-db7e-44a1-9b49-166b24e645ec tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:24.630798 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-18767e16-db7e-44a1-9b49-166b24e645ec tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1502 microversion: 2.1 time: 0.409114 Jul 14 14:28:24.632673 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 417/810] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:24 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1502 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:24.726676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9ade8f46-6ddb-4c87-b4b7-13a7cfdab535 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:24.728043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9ade8f46-6ddb-4c87-b4b7-13a7cfdab535 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:24.738817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ade8f46-6ddb-4c87-b4b7-13a7cfdab535 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:24.738817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ade8f46-6ddb-4c87-b4b7-13a7cfdab535 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:24.739714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ade8f46-6ddb-4c87-b4b7-13a7cfdab535 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:24.740907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ade8f46-6ddb-4c87-b4b7-13a7cfdab535 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:24.849731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9ade8f46-6ddb-4c87-b4b7-13a7cfdab535 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:24.857871 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9ade8f46-6ddb-4c87-b4b7-13a7cfdab535 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1337 microversion: 2.1 time: 0.136447 Jul 14 14:28:24.859051 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 394/811] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:24 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1337 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:25.243685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c8ca76e5-adfa-465f-9eff-c7a3c84fa5d7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:25.244344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c8ca76e5-adfa-465f-9eff-c7a3c84fa5d7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:25.251836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8ca76e5-adfa-465f-9eff-c7a3c84fa5d7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:25.252292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8ca76e5-adfa-465f-9eff-c7a3c84fa5d7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:25.253301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8ca76e5-adfa-465f-9eff-c7a3c84fa5d7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:25.253901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8ca76e5-adfa-465f-9eff-c7a3c84fa5d7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:25.584655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1da13ea7-8c95-49de-a39f-58a9cdd44d89 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:25.594408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1da13ea7-8c95-49de-a39f-58a9cdd44d89 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:25.614829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1da13ea7-8c95-49de-a39f-58a9cdd44d89 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:25.619534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1da13ea7-8c95-49de-a39f-58a9cdd44d89 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:25.623350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1da13ea7-8c95-49de-a39f-58a9cdd44d89 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:25.624888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1da13ea7-8c95-49de-a39f-58a9cdd44d89 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:25.831458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c8ca76e5-adfa-465f-9eff-c7a3c84fa5d7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:25.841992 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c8ca76e5-adfa-465f-9eff-c7a3c84fa5d7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 200 len: 1318 microversion: 2.1 time: 0.607374 Jul 14 14:28:25.849413 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 418/812] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:25 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 1318 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:25.862952 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9665c870-58f5-48c4-b4e2-89806a9ca6bd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:25.863830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9665c870-58f5-48c4-b4e2-89806a9ca6bd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:25.884160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9665c870-58f5-48c4-b4e2-89806a9ca6bd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:25.884849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9665c870-58f5-48c4-b4e2-89806a9ca6bd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:25.886236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9665c870-58f5-48c4-b4e2-89806a9ca6bd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:25.887216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9665c870-58f5-48c4-b4e2-89806a9ca6bd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:26.314990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1da13ea7-8c95-49de-a39f-58a9cdd44d89 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39d4bccdf9c403381a49a6c857d4869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8005f93725b7435db246f74917f659cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:26.329946 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1da13ea7-8c95-49de-a39f-58a9cdd44d89 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 200 len: 1332 microversion: 2.1 time: 0.751865 Jul 14 14:28:26.336372 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 395/813] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:25 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 1332 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:28:26.350164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2bba5c06-5e54-463c-b782-759907614304 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:26.351074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2bba5c06-5e54-463c-b782-759907614304 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:26.371565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2bba5c06-5e54-463c-b782-759907614304 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:26.372658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2bba5c06-5e54-463c-b782-759907614304 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:26.373837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2bba5c06-5e54-463c-b782-759907614304 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:26.374470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2bba5c06-5e54-463c-b782-759907614304 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:26.482492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9665c870-58f5-48c4-b4e2-89806a9ca6bd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:26.492843 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9665c870-58f5-48c4-b4e2-89806a9ca6bd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1502 microversion: 2.1 time: 0.641925 Jul 14 14:28:26.496552 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 419/814] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:25 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1502 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:26.844442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2bba5c06-5e54-463c-b782-759907614304 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:26.862052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31c8b4fe-ba12-4ba7-ab4d-aa75c660231c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:26.863225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-31c8b4fe-ba12-4ba7-ab4d-aa75c660231c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:26.879670 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2bba5c06-5e54-463c-b782-759907614304 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1379 microversion: 2.1 time: 0.533313 Jul 14 14:28:26.882098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31c8b4fe-ba12-4ba7-ab4d-aa75c660231c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:26.886307 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 396/815] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:26 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1379 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:26.890174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31c8b4fe-ba12-4ba7-ab4d-aa75c660231c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:26.891560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31c8b4fe-ba12-4ba7-ab4d-aa75c660231c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:26.893781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31c8b4fe-ba12-4ba7-ab4d-aa75c660231c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:27.241420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:27.300794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=26 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:27.362008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f17f2409-d7bf-48a9-b246-f40546e0948e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:27.364997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f17f2409-d7bf-48a9-b246-f40546e0948e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:27.380497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f17f2409-d7bf-48a9-b246-f40546e0948e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:27.381504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f17f2409-d7bf-48a9-b246-f40546e0948e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:27.382551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f17f2409-d7bf-48a9-b246-f40546e0948e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:27.384876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f17f2409-d7bf-48a9-b246-f40546e0948e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:27.387825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-31c8b4fe-ba12-4ba7-ab4d-aa75c660231c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:27.401150 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-31c8b4fe-ba12-4ba7-ab4d-aa75c660231c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 200 len: 1508 microversion: 2.1 time: 0.540457 Jul 14 14:28:27.402034 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 420/816] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:26 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 1508 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:28:27.517199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4f336cdd-5a00-42b9-b32a-c8e5b4f0e715 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:27.518511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4f336cdd-5a00-42b9-b32a-c8e5b4f0e715 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:27.530519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f336cdd-5a00-42b9-b32a-c8e5b4f0e715 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:27.531364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f336cdd-5a00-42b9-b32a-c8e5b4f0e715 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:27.533814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f336cdd-5a00-42b9-b32a-c8e5b4f0e715 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:27.534751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f336cdd-5a00-42b9-b32a-c8e5b4f0e715 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:27.568555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:28.011691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f17f2409-d7bf-48a9-b246-f40546e0948e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39d4bccdf9c403381a49a6c857d4869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8005f93725b7435db246f74917f659cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:28.024066 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f17f2409-d7bf-48a9-b246-f40546e0948e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 200 len: 1332 microversion: 2.1 time: 0.675083 Jul 14 14:28:28.041436 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 397/817] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:27 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 1332 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:28.058291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1472993138", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "6bcc5f06-ad6e-40c9-b806-9581f1f929a3"}], "security_groups": [{"name": "tempest-securitygroup--1332431980"}], "key_name": "tempest-keypair-1784821049", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:28.079300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4f336cdd-5a00-42b9-b32a-c8e5b4f0e715 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:28.096619 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4f336cdd-5a00-42b9-b32a-c8e5b4f0e715 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1502 microversion: 2.1 time: 0.585185 Jul 14 14:28:28.097973 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 421/818] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:27 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1502 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:28:28.105693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2b87fd92-6ca7-4b8a-b279-6eb21ea99699 req-0290e7b1-148b-47bb-8cdb-24d4b902a886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428925c9-c52e-4728-ac68-5e6c7a9932c7", "name": "network-vif-plugged", "status": "completed", "tag": "02b187bb-73fb-44ac-bdb2-7163acbe4d18"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:28.127158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2b87fd92-6ca7-4b8a-b279-6eb21ea99699 req-0290e7b1-148b-47bb-8cdb-24d4b902a886 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:28.127609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2b87fd92-6ca7-4b8a-b279-6eb21ea99699 req-0290e7b1-148b-47bb-8cdb-24d4b902a886 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:28.173269 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2b87fd92-6ca7-4b8a-b279-6eb21ea99699 req-0290e7b1-148b-47bb-8cdb-24d4b902a886 service nova] Creating event network-vif-plugged:02b187bb-73fb-44ac-bdb2-7163acbe4d18 for instance 428925c9-c52e-4728-ac68-5e6c7a9932c7 on n-h2-767704-28 Jul 14 14:28:28.190405 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2b87fd92-6ca7-4b8a-b279-6eb21ea99699 req-0290e7b1-148b-47bb-8cdb-24d4b902a886 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085393 Jul 14 14:28:28.191991 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 422/819] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:28.224233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f744ae12-9571-46c9-a855-d4d11f990c4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:28.226076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f744ae12-9571-46c9-a855-d4d11f990c4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:28.233785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f744ae12-9571-46c9-a855-d4d11f990c4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:28.234587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f744ae12-9571-46c9-a855-d4d11f990c4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:28.235989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f744ae12-9571-46c9-a855-d4d11f990c4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:28.236669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f744ae12-9571-46c9-a855-d4d11f990c4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:28.872508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] validate_networks() for [('6bcc5f06-ad6e-40c9-b806-9581f1f929a3', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:28:29.283204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f744ae12-9571-46c9-a855-d4d11f990c4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:29.298659 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f744ae12-9571-46c9-a855-d4d11f990c4b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1379 microversion: 2.1 time: 1.104545 Jul 14 14:28:29.299258 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 423/820] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:28 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1379 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:29.304338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-68efa6be-8d85-48e9-b0c5-78bdf2111308 req-6b160bb2-efa2-4ae7-9019-c2825d2d5ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec366efc-f03e-4022-9d20-aea3951399f2", "name": "network-vif-unplugged", "status": "completed", "tag": "de0ff888-9f89-477e-af2f-da88a54bd7a3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:29.334581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-68efa6be-8d85-48e9-b0c5-78bdf2111308 req-6b160bb2-efa2-4ae7-9019-c2825d2d5ccb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:29.335036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-68efa6be-8d85-48e9-b0c5-78bdf2111308 req-6b160bb2-efa2-4ae7-9019-c2825d2d5ccb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:29.384071 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-68efa6be-8d85-48e9-b0c5-78bdf2111308 req-6b160bb2-efa2-4ae7-9019-c2825d2d5ccb service nova] Creating event network-vif-unplugged:de0ff888-9f89-477e-af2f-da88a54bd7a3 for instance ec366efc-f03e-4022-9d20-aea3951399f2 on n-h1-767704-28 Jul 14 14:28:29.410009 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-68efa6be-8d85-48e9-b0c5-78bdf2111308 req-6b160bb2-efa2-4ae7-9019-c2825d2d5ccb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108420 Jul 14 14:28:29.417369 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 424/821] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:29.436181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8501b871-4ef4-4bd6-b9ce-e6a462a180e5 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:29.437164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8501b871-4ef4-4bd6-b9ce-e6a462a180e5 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:29.451648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8501b871-4ef4-4bd6-b9ce-e6a462a180e5 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:29.452999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8501b871-4ef4-4bd6-b9ce-e6a462a180e5 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:29.454031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8501b871-4ef4-4bd6-b9ce-e6a462a180e5 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:29.454544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8501b871-4ef4-4bd6-b9ce-e6a462a180e5 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:29.700922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8501b871-4ef4-4bd6-b9ce-e6a462a180e5 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39d4bccdf9c403381a49a6c857d4869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8005f93725b7435db246f74917f659cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:29.710330 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8501b871-4ef4-4bd6-b9ce-e6a462a180e5 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 200 len: 1332 microversion: 2.1 time: 0.291011 Jul 14 14:28:29.714573 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 425/822] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:29 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 1332 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:29.728604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b862f630-f269-40ea-9f3b-fc2dd8dd6ae1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:29.729347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b862f630-f269-40ea-9f3b-fc2dd8dd6ae1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:29.741141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b862f630-f269-40ea-9f3b-fc2dd8dd6ae1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:29.741616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b862f630-f269-40ea-9f3b-fc2dd8dd6ae1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:29.743036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b862f630-f269-40ea-9f3b-fc2dd8dd6ae1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:29.745550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b862f630-f269-40ea-9f3b-fc2dd8dd6ae1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:29.868272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:28:29.870686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:28:29.871207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:28:29.871851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:28:29.873282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:28:29.905900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:29.907338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:29.908413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:29.909284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:29.930653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Getting quotas for project 4459eedeb8884ffe82ed62e567fb64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:29.936761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Getting quotas for user ef25b01962404bdfa0c2bbb30401ca62 and project 4459eedeb8884ffe82ed62e567fb64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:29.954573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:28:29.957924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:28:30.038252 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bd085574-7b51-4e68-8788-e2f743d258b4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.993447 Jul 14 14:28:30.045689 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 398/823] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:28:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 2002 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:28:30.054373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4058540-2b6b-4e04-9c6c-73938fc7fb7a tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "864679a2-b258-4fe3-a70a-c876a4c88f65"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:30.057343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d4058540-2b6b-4e04-9c6c-73938fc7fb7a tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:30.066336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4058540-2b6b-4e04-9c6c-73938fc7fb7a tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:30.067090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4058540-2b6b-4e04-9c6c-73938fc7fb7a tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:30.068195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4058540-2b6b-4e04-9c6c-73938fc7fb7a tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:30.068789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4058540-2b6b-4e04-9c6c-73938fc7fb7a tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:30.168146 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-d4058540-2b6b-4e04-9c6c-73938fc7fb7a tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] HTTP exception thrown: Volume cbb64154-6ae0-4a48-abe5-ee062f8bdcda could not be found. Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4058540-2b6b-4e04-9c6c-73938fc7fb7a tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Request method failure captured: Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: request: PUT /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03/os-volume_attachments/cbb64154-6ae0-4a48-abe5-ee062f8bdcda HTTP/1.1 Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 74 Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CeJSpugylLDCKREynaE0a_TMPuxHgcZUgghgcL-JOd-9BZ_P0tBED7OVNwonlYGgmhgCeYDWZ-gBdS7OrZDzTKWV3OdFS0RBQXt1nWe9wCK0gUz_Sf3luKRpmARhOQQ4oJ7holHPbmlo_QeSmxHH7RlhT1ChJ92-4VhNFgd8Iaf6uI Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 28787dd343c2438cabc365053011c945 Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesAdminNegativeTest-582627744 Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:28:30.171583 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/28787dd343c2438cabc365053011c945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/28787dd343c2438cabc365053011c945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_28787dd343c2438cabc365053011c945", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/28787dd343c2438cabc365053011c945"}]}] Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesAdminNegativeTest-582627744 Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 28787dd343c2438cabc365053011c945 Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-582627744 Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesAdminNegativeTest-582627744-project-admin Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 528e4c34cd7f44099558178b22d62bbe Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesAdminNegativeTest-582627744-project-admin Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: {"volumeAttachment": {"volumeId": "864679a2-b258-4fe3-a70a-c876a4c88f65"}} Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:28:30.173054 n-d-767704-28 devstack@n-api.service[119511]: exception: Volume cbb64154-6ae0-4a48-abe5-ee062f8bdcda could not be found. Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'server_id': 'ab65834e-bbdc-4716-8ae0-f8dbbc461b03', 'id': 'cbb64154-6ae0-4a48-abe5-ee062f8bdcda', 'body': {'volumeAttachment': {'volumeId': '864679a2-b258-4fe3-a70a-c876a4c88f65'}}} Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:28:30.173879 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cbb64154-6ae0-4a48-abe5-ee062f8bdcda could not be found. (HTTP 404) (Request-ID: req-4fe2554d-c626-4357-88fc-c1db1d5cf227) Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:28:30.175504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cbb64154-6ae0-4a48-abe5-ee062f8bdcda could not be found. Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:30.176680 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cbb64154-6ae0-4a48-abe5-ee062f8bdcda could not be found. Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cbb64154-6ae0-4a48-abe5-ee062f8bdcda could not be found. Jul 14 14:28:30.177861 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:30.182024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4058540-2b6b-4e04-9c6c-73938fc7fb7a tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] Returning 404 to user: Volume cbb64154-6ae0-4a48-abe5-ee062f8bdcda could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:30.182024 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d4058540-2b6b-4e04-9c6c-73938fc7fb7a tempest-VolumesAdminNegativeTest-582627744 tempest-VolumesAdminNegativeTest-582627744-project-admin] 10.222.0.81 "PUT /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03/os-volume_attachments/cbb64154-6ae0-4a48-abe5-ee062f8bdcda" status: 404 len: 109 microversion: 2.1 time: 0.125478 Jul 14 14:28:30.182024 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 399/824] 10.222.0.81 () {60 vars in 1432 bytes} [Thu Jul 14 14:28:30 2022] PUT /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03/os-volume_attachments/cbb64154-6ae0-4a48-abe5-ee062f8bdcda => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:30.182024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-540bb528-fcb0-4285-a1b0-6ec2cece732d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:30.182024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-540bb528-fcb0-4285-a1b0-6ec2cece732d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:30.378359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-540bb528-fcb0-4285-a1b0-6ec2cece732d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:30.411389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-540bb528-fcb0-4285-a1b0-6ec2cece732d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:30.414646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-540bb528-fcb0-4285-a1b0-6ec2cece732d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:30.417465 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-540bb528-fcb0-4285-a1b0-6ec2cece732d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1286 microversion: 2.25 time: 0.241362 Jul 14 14:28:30.430669 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 400/825] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:30 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1286 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:30.436226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d37a23ec-d664-4e48-806c-ce873087f9fa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:30.436988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d37a23ec-d664-4e48-806c-ce873087f9fa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:30.445211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d37a23ec-d664-4e48-806c-ce873087f9fa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:30.447623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d37a23ec-d664-4e48-806c-ce873087f9fa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:30.448519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d37a23ec-d664-4e48-806c-ce873087f9fa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:30.449290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d37a23ec-d664-4e48-806c-ce873087f9fa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:30.599592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b862f630-f269-40ea-9f3b-fc2dd8dd6ae1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:30.619703 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b862f630-f269-40ea-9f3b-fc2dd8dd6ae1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1502 microversion: 2.1 time: 0.903506 Jul 14 14:28:30.628884 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 426/826] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:29 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1502 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:30.733710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-871828d2-46c7-4cf8-b9e6-ccdbfd34da5a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:30.735467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-871828d2-46c7-4cf8-b9e6-ccdbfd34da5a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:30.750758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-871828d2-46c7-4cf8-b9e6-ccdbfd34da5a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:30.751643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-871828d2-46c7-4cf8-b9e6-ccdbfd34da5a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:30.752682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-871828d2-46c7-4cf8-b9e6-ccdbfd34da5a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:30.753362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-871828d2-46c7-4cf8-b9e6-ccdbfd34da5a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:30.978815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d37a23ec-d664-4e48-806c-ce873087f9fa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:30.993561 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d37a23ec-d664-4e48-806c-ce873087f9fa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1379 microversion: 2.1 time: 0.561059 Jul 14 14:28:31.003654 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 401/827] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:30 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1379 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:31.057536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-871828d2-46c7-4cf8-b9e6-ccdbfd34da5a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39d4bccdf9c403381a49a6c857d4869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8005f93725b7435db246f74917f659cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:31.068001 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-871828d2-46c7-4cf8-b9e6-ccdbfd34da5a tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 200 len: 1536 microversion: 2.1 time: 0.338825 Jul 14 14:28:31.070552 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 427/828] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:30 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 1536 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:28:31.096772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5673e93f-2b76-4612-b4a8-5ede44d66ed0 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Action: 'create', calling method: .version_select at 0x7fd6c5e7d1f0>, body: {"pool": "dbf616c8-e7bc-4fbe-bb65-7c29f219160a"} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:31.437270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac9555af-78c7-4c20-8ba2-9226552ff20c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:31.439394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac9555af-78c7-4c20-8ba2-9226552ff20c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:31.457498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac9555af-78c7-4c20-8ba2-9226552ff20c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:31.471468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac9555af-78c7-4c20-8ba2-9226552ff20c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:31.475187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac9555af-78c7-4c20-8ba2-9226552ff20c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:31.478078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac9555af-78c7-4c20-8ba2-9226552ff20c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:31.702384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac9555af-78c7-4c20-8ba2-9226552ff20c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:31.731911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac9555af-78c7-4c20-8ba2-9226552ff20c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:31.739171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac9555af-78c7-4c20-8ba2-9226552ff20c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:31.745479 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac9555af-78c7-4c20-8ba2-9226552ff20c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1338 microversion: 2.25 time: 0.311754 Jul 14 14:28:31.747805 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 428/829] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:31 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1338 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:31.803722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d6ca6247-22ad-48a2-9e1a-abed34dcdb35 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:31.809656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d6ca6247-22ad-48a2-9e1a-abed34dcdb35 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:31.825359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6ca6247-22ad-48a2-9e1a-abed34dcdb35 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:31.826108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6ca6247-22ad-48a2-9e1a-abed34dcdb35 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:31.827112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6ca6247-22ad-48a2-9e1a-abed34dcdb35 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:31.827702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6ca6247-22ad-48a2-9e1a-abed34dcdb35 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:32.335945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d6ca6247-22ad-48a2-9e1a-abed34dcdb35 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:32.343954 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d6ca6247-22ad-48a2-9e1a-abed34dcdb35 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1502 microversion: 2.1 time: 0.592239 Jul 14 14:28:32.344518 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 429/830] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:31 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1502 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:32.358451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ebc858b0-8a8b-499d-a935-40c3e176a29d req-64213ec7-4cdc-42dc-89f6-190836267dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec366efc-f03e-4022-9d20-aea3951399f2", "tag": "de0ff888-9f89-477e-af2f-da88a54bd7a3"}, {"name": "network-changed", "server_uuid": "486f72c1-03cd-4401-862c-1e02ca398e46", "tag": "a5283818-bbd0-45aa-b71a-689a812a086b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:32.376593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ebc858b0-8a8b-499d-a935-40c3e176a29d req-64213ec7-4cdc-42dc-89f6-190836267dcc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:32.377070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ebc858b0-8a8b-499d-a935-40c3e176a29d req-64213ec7-4cdc-42dc-89f6-190836267dcc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:32.404732 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ebc858b0-8a8b-499d-a935-40c3e176a29d req-64213ec7-4cdc-42dc-89f6-190836267dcc service nova] Creating event network-changed:de0ff888-9f89-477e-af2f-da88a54bd7a3 for instance ec366efc-f03e-4022-9d20-aea3951399f2 on n-h1-767704-28 Jul 14 14:28:32.405310 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ebc858b0-8a8b-499d-a935-40c3e176a29d req-64213ec7-4cdc-42dc-89f6-190836267dcc service nova] Creating event network-changed:a5283818-bbd0-45aa-b71a-689a812a086b for instance 486f72c1-03cd-4401-862c-1e02ca398e46 on n-h1-767704-28 Jul 14 14:28:32.428836 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ebc858b0-8a8b-499d-a935-40c3e176a29d req-64213ec7-4cdc-42dc-89f6-190836267dcc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077315 Jul 14 14:28:32.429494 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 430/831] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:32.435308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8270ff87-6c67-4f77-ba92-aa325cf2312a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:32.438014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8270ff87-6c67-4f77-ba92-aa325cf2312a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:32.462458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8270ff87-6c67-4f77-ba92-aa325cf2312a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:32.463363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8270ff87-6c67-4f77-ba92-aa325cf2312a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:32.465478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8270ff87-6c67-4f77-ba92-aa325cf2312a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:32.468350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8270ff87-6c67-4f77-ba92-aa325cf2312a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:33.033612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8270ff87-6c67-4f77-ba92-aa325cf2312a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:33.041606 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8270ff87-6c67-4f77-ba92-aa325cf2312a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1379 microversion: 2.1 time: 0.610266 Jul 14 14:28:33.056810 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 431/832] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:32 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1379 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:33.068017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-17ddf4ab-1a04-4add-9dd3-09c329427572 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:33.072065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-17ddf4ab-1a04-4add-9dd3-09c329427572 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:33.090699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-17ddf4ab-1a04-4add-9dd3-09c329427572 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:33.091637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-17ddf4ab-1a04-4add-9dd3-09c329427572 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:33.093481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-17ddf4ab-1a04-4add-9dd3-09c329427572 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:33.094200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-17ddf4ab-1a04-4add-9dd3-09c329427572 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:33.256044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-17ddf4ab-1a04-4add-9dd3-09c329427572 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:33.267260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-17ddf4ab-1a04-4add-9dd3-09c329427572 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:33.275130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-17ddf4ab-1a04-4add-9dd3-09c329427572 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:33.276502 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-17ddf4ab-1a04-4add-9dd3-09c329427572 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1344 microversion: 2.25 time: 0.216691 Jul 14 14:28:33.278942 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 432/833] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:33 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1344 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:33.364932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b634220d-ae83-482d-9c1d-bd16e530edcf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:33.365885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b634220d-ae83-482d-9c1d-bd16e530edcf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:33.384503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b634220d-ae83-482d-9c1d-bd16e530edcf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:33.385032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b634220d-ae83-482d-9c1d-bd16e530edcf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:33.386016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b634220d-ae83-482d-9c1d-bd16e530edcf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:33.386455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b634220d-ae83-482d-9c1d-bd16e530edcf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:34.688066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b634220d-ae83-482d-9c1d-bd16e530edcf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:34.702228 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b634220d-ae83-482d-9c1d-bd16e530edcf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1502 microversion: 2.1 time: 1.343538 Jul 14 14:28:34.703278 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 433/834] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:33 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1502 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:34.715043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-543d3d90-4620-4c29-9b67-b62640c6683b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:34.719180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-543d3d90-4620-4c29-9b67-b62640c6683b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:34.728187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-543d3d90-4620-4c29-9b67-b62640c6683b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:34.728991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-543d3d90-4620-4c29-9b67-b62640c6683b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:34.730695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-543d3d90-4620-4c29-9b67-b62640c6683b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:34.731803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-543d3d90-4620-4c29-9b67-b62640c6683b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:35.328170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-543d3d90-4620-4c29-9b67-b62640c6683b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:35.336368 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-543d3d90-4620-4c29-9b67-b62640c6683b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1379 microversion: 2.1 time: 0.631515 Jul 14 14:28:35.337140 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 434/835] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:34 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1379 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:35.350335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1f4843b6-c10e-4a8e-9077-ee8143833a83 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:35.351194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f4843b6-c10e-4a8e-9077-ee8143833a83 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:35.366883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f4843b6-c10e-4a8e-9077-ee8143833a83 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:35.367736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f4843b6-c10e-4a8e-9077-ee8143833a83 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:35.368711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f4843b6-c10e-4a8e-9077-ee8143833a83 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:35.371442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f4843b6-c10e-4a8e-9077-ee8143833a83 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:35.903090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f4843b6-c10e-4a8e-9077-ee8143833a83 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:35.916904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f4843b6-c10e-4a8e-9077-ee8143833a83 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:35.918871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f4843b6-c10e-4a8e-9077-ee8143833a83 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:35.920478 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1f4843b6-c10e-4a8e-9077-ee8143833a83 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1412 microversion: 2.25 time: 0.577226 Jul 14 14:28:35.921301 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 435/836] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:35 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1412 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:36.197749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-841286698", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": "none"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:36.315115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:28:36.315894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:28:36.316800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:28:36.317302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:28:36.317816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:28:36.329545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:36.330460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:36.331984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:36.332794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:36.375759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Getting quotas for project efc9b7b4c8134876bc4b3842ff839b0e. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:36.406990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Getting quotas for user ffe94302ac1c43a9aa6310296e61e668 and project efc9b7b4c8134876bc4b3842ff839b0e. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:36.444295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:28:36.450769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:28:36.580281 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-561091fc-fcaa-4380-867e-12c8cb3f02fa tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.641572 Jul 14 14:28:36.582817 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 436/837] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:28:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:28:36.598508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-30f45f4e-5e34-413a-8ede-0947b04a5a0c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:36.599016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-30f45f4e-5e34-413a-8ede-0947b04a5a0c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:36.634894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30f45f4e-5e34-413a-8ede-0947b04a5a0c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:36.639128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30f45f4e-5e34-413a-8ede-0947b04a5a0c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:36.642542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30f45f4e-5e34-413a-8ede-0947b04a5a0c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:36.643790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30f45f4e-5e34-413a-8ede-0947b04a5a0c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:36.723697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-30f45f4e-5e34-413a-8ede-0947b04a5a0c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:28:36.724483 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5673e93f-2b76-4612-b4a8-5ede44d66ed0 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.633100 Jul 14 14:28:36.725852 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 402/838] 10.222.0.81 () {60 vars in 1169 bytes} [Thu Jul 14 14:28:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:36.732931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-42f3d1f7-ea23-42d2-a907-5889b33b1cbd req-a10779b7-6e1b-4efd-b7e1-23bf5b4efb99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec366efc-f03e-4022-9d20-aea3951399f2", "name": "network-vif-unplugged", "status": "completed", "tag": "de0ff888-9f89-477e-af2f-da88a54bd7a3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:36.756886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-42f3d1f7-ea23-42d2-a907-5889b33b1cbd req-a10779b7-6e1b-4efd-b7e1-23bf5b4efb99 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:36.759123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-42f3d1f7-ea23-42d2-a907-5889b33b1cbd req-a10779b7-6e1b-4efd-b7e1-23bf5b4efb99 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:36.804198 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-42f3d1f7-ea23-42d2-a907-5889b33b1cbd req-a10779b7-6e1b-4efd-b7e1-23bf5b4efb99 service nova] Creating event network-vif-unplugged:de0ff888-9f89-477e-af2f-da88a54bd7a3 for instance ec366efc-f03e-4022-9d20-aea3951399f2 on n-h1-767704-28 Jul 14 14:28:36.818005 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-42f3d1f7-ea23-42d2-a907-5889b33b1cbd req-a10779b7-6e1b-4efd-b7e1-23bf5b4efb99 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086231 Jul 14 14:28:36.819769 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 403/839] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:36.830013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bdb3304a-42c4-41a0-a439-5f3e279fb52d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:36.831314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bdb3304a-42c4-41a0-a439-5f3e279fb52d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:36.843013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdb3304a-42c4-41a0-a439-5f3e279fb52d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:36.844190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdb3304a-42c4-41a0-a439-5f3e279fb52d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:36.846693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdb3304a-42c4-41a0-a439-5f3e279fb52d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:36.847629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdb3304a-42c4-41a0-a439-5f3e279fb52d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:36.918658 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-30f45f4e-5e34-413a-8ede-0947b04a5a0c tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 204 len: 0 microversion: 2.1 time: 0.333868 Jul 14 14:28:36.920914 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 437/840] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:28:36 2022] DELETE /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:28:36.935461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-79de372a-0b37-4dd1-a9c6-d96a95a63129 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:36.939692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-79de372a-0b37-4dd1-a9c6-d96a95a63129 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:36.956082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79de372a-0b37-4dd1-a9c6-d96a95a63129 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:36.956533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79de372a-0b37-4dd1-a9c6-d96a95a63129 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:36.957355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79de372a-0b37-4dd1-a9c6-d96a95a63129 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:36.957971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79de372a-0b37-4dd1-a9c6-d96a95a63129 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:37.293000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-79de372a-0b37-4dd1-a9c6-d96a95a63129 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:37.300655 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-79de372a-0b37-4dd1-a9c6-d96a95a63129 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1379 microversion: 2.1 time: 0.378510 Jul 14 14:28:37.305961 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 438/841] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:36 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1379 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:37.315157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d39e7c4a-e9ba-4b43-baa4-38ddb9ce699b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:37.317734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d39e7c4a-e9ba-4b43-baa4-38ddb9ce699b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:37.514031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d39e7c4a-e9ba-4b43-baa4-38ddb9ce699b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:37.533612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d39e7c4a-e9ba-4b43-baa4-38ddb9ce699b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:37.535347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d39e7c4a-e9ba-4b43-baa4-38ddb9ce699b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:37.550491 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d39e7c4a-e9ba-4b43-baa4-38ddb9ce699b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "PUT /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1358 microversion: 2.75 time: 0.242712 Jul 14 14:28:37.564975 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 439/842] 10.222.0.81 () {62 vars in 1296 bytes} [Thu Jul 14 14:28:37 2022] PUT /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:37.570508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9e3e0d6e-d8b2-4d1e-b893-623e0e34cb6e req-db81e8b9-7122-42b6-9068-e94dd340f006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07717385-1942-4235-9479-e46016827db8", "tag": "a3c7a75e-482a-45ff-810c-3fd5b8e4c273"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:37.590331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9e3e0d6e-d8b2-4d1e-b893-623e0e34cb6e req-db81e8b9-7122-42b6-9068-e94dd340f006 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:37.590790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9e3e0d6e-d8b2-4d1e-b893-623e0e34cb6e req-db81e8b9-7122-42b6-9068-e94dd340f006 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:37.590931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bdb3304a-42c4-41a0-a439-5f3e279fb52d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:37.599383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:37.604170 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bdb3304a-42c4-41a0-a439-5f3e279fb52d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1502 microversion: 2.1 time: 0.781678 Jul 14 14:28:37.606151 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 404/843] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:36 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1502 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:37.614117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a5212449-b2dd-40ec-8513-8fafd88084c2 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Action: 'action', calling method: .version_select at 0x7fd6c8782040>, body: {"addFloatingIp": {"address": "172.25.8.228"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:37.616965 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9e3e0d6e-d8b2-4d1e-b893-623e0e34cb6e req-db81e8b9-7122-42b6-9068-e94dd340f006 service nova] Creating event network-changed:a3c7a75e-482a-45ff-810c-3fd5b8e4c273 for instance 07717385-1942-4235-9479-e46016827db8 on n-h1-767704-28 Jul 14 14:28:37.625793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a5212449-b2dd-40ec-8513-8fafd88084c2 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:37.637120 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9e3e0d6e-d8b2-4d1e-b893-623e0e34cb6e req-db81e8b9-7122-42b6-9068-e94dd340f006 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084312 Jul 14 14:28:37.637811 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 440/844] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:37.652792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5212449-b2dd-40ec-8513-8fafd88084c2 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:37.653607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5212449-b2dd-40ec-8513-8fafd88084c2 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:37.655234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4314de21-4821-4530-9083-7857a0e535a7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:37.656133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4314de21-4821-4530-9083-7857a0e535a7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:37.656562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5212449-b2dd-40ec-8513-8fafd88084c2 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:37.657346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5212449-b2dd-40ec-8513-8fafd88084c2 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:37.683324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4314de21-4821-4530-9083-7857a0e535a7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:37.683789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4314de21-4821-4530-9083-7857a0e535a7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:37.685751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4314de21-4821-4530-9083-7857a0e535a7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:37.686410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4314de21-4821-4530-9083-7857a0e535a7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:37.788850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5212449-b2dd-40ec-8513-8fafd88084c2 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Acquired lock "refresh_cache-428925c9-c52e-4728-ac68-5e6c7a9932c7" {{(pid=119511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:28:38.081715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4314de21-4821-4530-9083-7857a0e535a7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:38.092789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4314de21-4821-4530-9083-7857a0e535a7 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 200 len: 1514 microversion: 2.1 time: 0.446567 Jul 14 14:28:38.094567 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 441/845] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:37 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 1514 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:38.108170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-331a4c3a-43e1-4d22-8755-f38c8efba69a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:38.110195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-331a4c3a-43e1-4d22-8755-f38c8efba69a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:38.119235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-331a4c3a-43e1-4d22-8755-f38c8efba69a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:38.119851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-331a4c3a-43e1-4d22-8755-f38c8efba69a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:38.125168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-331a4c3a-43e1-4d22-8755-f38c8efba69a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:38.126541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-331a4c3a-43e1-4d22-8755-f38c8efba69a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:38.754615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-331a4c3a-43e1-4d22-8755-f38c8efba69a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:38.774395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-331a4c3a-43e1-4d22-8755-f38c8efba69a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:38.785724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-331a4c3a-43e1-4d22-8755-f38c8efba69a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:38.787253 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-331a4c3a-43e1-4d22-8755-f38c8efba69a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1412 microversion: 2.25 time: 0.691551 Jul 14 14:28:38.800464 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 442/846] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:38 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1412 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:38.818026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1f21d1af-7a43-4284-a020-517d75cffac5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:38.818934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f21d1af-7a43-4284-a020-517d75cffac5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:38.841657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f21d1af-7a43-4284-a020-517d75cffac5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:38.842546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f21d1af-7a43-4284-a020-517d75cffac5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:38.846634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f21d1af-7a43-4284-a020-517d75cffac5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:38.847380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f21d1af-7a43-4284-a020-517d75cffac5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:39.371876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f21d1af-7a43-4284-a020-517d75cffac5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:39.386100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f21d1af-7a43-4284-a020-517d75cffac5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:39.388738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f21d1af-7a43-4284-a020-517d75cffac5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:39.396727 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1f21d1af-7a43-4284-a020-517d75cffac5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1410 microversion: 2.75 time: 0.594153 Jul 14 14:28:39.399358 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 443/847] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:38 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1410 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:39.404420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a3c56f5d-6868-4531-9d2f-aed3ccd128b8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:39.405950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a3c56f5d-6868-4531-9d2f-aed3ccd128b8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:39.409664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:39.415442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3c56f5d-6868-4531-9d2f-aed3ccd128b8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:39.416161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3c56f5d-6868-4531-9d2f-aed3ccd128b8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:39.417763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3c56f5d-6868-4531-9d2f-aed3ccd128b8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:39.418360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3c56f5d-6868-4531-9d2f-aed3ccd128b8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:39.921985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=15 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:40.047492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a3c56f5d-6868-4531-9d2f-aed3ccd128b8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:40.057465 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a3c56f5d-6868-4531-9d2f-aed3ccd128b8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1379 microversion: 2.1 time: 0.656737 Jul 14 14:28:40.068518 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 444/848] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:39 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1379 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:40.074663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-44b33118-8498-4f1f-8174-ff06536f738f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:40.075473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-44b33118-8498-4f1f-8174-ff06536f738f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:40.083441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44b33118-8498-4f1f-8174-ff06536f738f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:40.084202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44b33118-8498-4f1f-8174-ff06536f738f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:40.085227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44b33118-8498-4f1f-8174-ff06536f738f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:40.085832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44b33118-8498-4f1f-8174-ff06536f738f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:40.398646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=50 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:40.456277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-44b33118-8498-4f1f-8174-ff06536f738f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:40.465623 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-44b33118-8498-4f1f-8174-ff06536f738f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1502 microversion: 2.1 time: 0.395314 Jul 14 14:28:40.475088 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 445/849] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:40 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1502 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:40.475088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1a966988-45d8-4886-8e1b-a9a7030de31b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:40.475088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1a966988-45d8-4886-8e1b-a9a7030de31b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:40.479030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a966988-45d8-4886-8e1b-a9a7030de31b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:40.479490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a966988-45d8-4886-8e1b-a9a7030de31b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:40.480271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a966988-45d8-4886-8e1b-a9a7030de31b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:40.480714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a966988-45d8-4886-8e1b-a9a7030de31b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:40.611237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a966988-45d8-4886-8e1b-a9a7030de31b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:40.623324 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1a966988-45d8-4886-8e1b-a9a7030de31b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 200 len: 1472 microversion: 2.1 time: 0.155837 Jul 14 14:28:40.626305 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 446/850] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:40 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 1472 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:40.632059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-42a0d2c4-59ed-4f5b-966b-fa179666461c req-0a18017d-2385-413e-ba29-cbea8e81c3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486f72c1-03cd-4401-862c-1e02ca398e46", "name": "network-vif-plugged", "status": "completed", "tag": "a5283818-bbd0-45aa-b71a-689a812a086b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:40.646260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-42a0d2c4-59ed-4f5b-966b-fa179666461c req-0a18017d-2385-413e-ba29-cbea8e81c3b0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:40.646861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-42a0d2c4-59ed-4f5b-966b-fa179666461c req-0a18017d-2385-413e-ba29-cbea8e81c3b0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:40.666749 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-42a0d2c4-59ed-4f5b-966b-fa179666461c req-0a18017d-2385-413e-ba29-cbea8e81c3b0 service nova] Creating event network-vif-plugged:a5283818-bbd0-45aa-b71a-689a812a086b for instance 486f72c1-03cd-4401-862c-1e02ca398e46 on n-h1-767704-28 Jul 14 14:28:40.673811 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-42a0d2c4-59ed-4f5b-966b-fa179666461c req-0a18017d-2385-413e-ba29-cbea8e81c3b0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045346 Jul 14 14:28:40.674632 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 447/851] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:40.929077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2031191836", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:41.003657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:28:41.047955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a5212449-b2dd-40ec-8513-8fafd88084c2 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Building network info cache for instance {{(pid=119511) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:28:41.763657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:28:41.764145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:28:41.764550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:28:41.764983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:28:41.765405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:28:41.776114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:41.776844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:41.777859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:41.778302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:41.804828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Getting quotas for project 52d830f4fd184c54a15647e148c3590e. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:41.810766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Getting quotas for user 4bfee07cac2b472a9f8ba7d0e4a67580 and project 52d830f4fd184c54a15647e148c3590e. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:41.826858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:28:41.829364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:28:41.910461 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-560961e1-7c98-4da3-a5d6-9cf73e445b78 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.234585 Jul 14 14:28:41.912140 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 448/852] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:28:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:28:41.918984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d12a9676-ee3d-4f8d-a852-9a9b4c7e0ced tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:41.920653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d12a9676-ee3d-4f8d-a852-9a9b4c7e0ced tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:41.931894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d12a9676-ee3d-4f8d-a852-9a9b4c7e0ced tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:41.932887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d12a9676-ee3d-4f8d-a852-9a9b4c7e0ced tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:41.933958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d12a9676-ee3d-4f8d-a852-9a9b4c7e0ced tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:41.934497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d12a9676-ee3d-4f8d-a852-9a9b4c7e0ced tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:42.394471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d12a9676-ee3d-4f8d-a852-9a9b4c7e0ced tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:42.410406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d12a9676-ee3d-4f8d-a852-9a9b4c7e0ced tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:42.413201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d12a9676-ee3d-4f8d-a852-9a9b4c7e0ced tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:42.417325 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d12a9676-ee3d-4f8d-a852-9a9b4c7e0ced tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1412 microversion: 2.25 time: 0.502968 Jul 14 14:28:42.418771 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 449/853] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:41 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1412 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:42.424207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c25d460c-cf45-4828-88d2-8d4aef800fa7 req-2d538e69-49e8-460b-92db-6fe9a7e44437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab65834e-bbdc-4716-8ae0-f8dbbc461b03", "name": "network-vif-deleted", "tag": "2170eaa3-896a-49de-b3fc-99a3f5f155a0"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:42.459602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c25d460c-cf45-4828-88d2-8d4aef800fa7 req-2d538e69-49e8-460b-92db-6fe9a7e44437 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:42.461950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c25d460c-cf45-4828-88d2-8d4aef800fa7 req-2d538e69-49e8-460b-92db-6fe9a7e44437 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:42.494349 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c25d460c-cf45-4828-88d2-8d4aef800fa7 req-2d538e69-49e8-460b-92db-6fe9a7e44437 service nova] Creating event network-vif-deleted:2170eaa3-896a-49de-b3fc-99a3f5f155a0 for instance ab65834e-bbdc-4716-8ae0-f8dbbc461b03 on n-h2-767704-28 Jul 14 14:28:42.504065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a5212449-b2dd-40ec-8513-8fafd88084c2 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Updating instance_info_cache with network_info: [{"id": "02b187bb-73fb-44ac-bdb2-7163acbe4d18", "address": "fa:16:3e:d8:ed:4f", "network": {"id": "62b0ffd3-9221-4455-a14e-d733e4d9c76a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1649950194-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8005f93725b7435db246f74917f659cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap02b187bb-73", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119511) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:28:42.512514 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c25d460c-cf45-4828-88d2-8d4aef800fa7 req-2d538e69-49e8-460b-92db-6fe9a7e44437 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092252 Jul 14 14:28:42.518411 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 450/854] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:42.526505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0d2a51d2-dadb-42c1-85fe-cffc25329cbd tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:42.527268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0d2a51d2-dadb-42c1-85fe-cffc25329cbd tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:42.531475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5212449-b2dd-40ec-8513-8fafd88084c2 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Releasing lock "refresh_cache-428925c9-c52e-4728-ac68-5e6c7a9932c7" {{(pid=119511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:28:42.532666 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a5212449-b2dd-40ec-8513-8fafd88084c2 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action" status: 202 len: 0 microversion: 2.1 time: 4.925211 Jul 14 14:28:42.533352 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 405/855] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:28:37 2022] POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action => generated 0 bytes in 4926 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:28:42.546291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d6ab358-ab7c-4f81-ad5c-20aa0f558d6f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:42.546611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d6ab358-ab7c-4f81-ad5c-20aa0f558d6f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:42.551550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d2a51d2-dadb-42c1-85fe-cffc25329cbd tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:42.552483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d2a51d2-dadb-42c1-85fe-cffc25329cbd tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:42.553786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d2a51d2-dadb-42c1-85fe-cffc25329cbd tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:42.555827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d2a51d2-dadb-42c1-85fe-cffc25329cbd tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:42.570987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d6ab358-ab7c-4f81-ad5c-20aa0f558d6f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:42.572335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d6ab358-ab7c-4f81-ad5c-20aa0f558d6f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:42.573759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d6ab358-ab7c-4f81-ad5c-20aa0f558d6f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:42.582551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d6ab358-ab7c-4f81-ad5c-20aa0f558d6f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:42.735249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d2a51d2-dadb-42c1-85fe-cffc25329cbd tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:42.749382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d2a51d2-dadb-42c1-85fe-cffc25329cbd tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:42.754299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d2a51d2-dadb-42c1-85fe-cffc25329cbd tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:42.793303 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0d2a51d2-dadb-42c1-85fe-cffc25329cbd tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1437 microversion: 2.75 time: 0.273483 Jul 14 14:28:42.804644 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 451/856] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:42 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1437 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:42.818124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-8ded8b21-cd9f-4c92-acd6-3bdb0a44fa5f req-323e56b7-5c64-4f57-bd4c-73fc088a681c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428925c9-c52e-4728-ac68-5e6c7a9932c7", "tag": "02b187bb-73fb-44ac-bdb2-7163acbe4d18"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:42.838300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8ded8b21-cd9f-4c92-acd6-3bdb0a44fa5f req-323e56b7-5c64-4f57-bd4c-73fc088a681c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:42.843727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8ded8b21-cd9f-4c92-acd6-3bdb0a44fa5f req-323e56b7-5c64-4f57-bd4c-73fc088a681c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:42.858342 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-8ded8b21-cd9f-4c92-acd6-3bdb0a44fa5f req-323e56b7-5c64-4f57-bd4c-73fc088a681c service nova] Creating event network-changed:02b187bb-73fb-44ac-bdb2-7163acbe4d18 for instance 428925c9-c52e-4728-ac68-5e6c7a9932c7 on n-h2-767704-28 Jul 14 14:28:42.863581 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-8ded8b21-cd9f-4c92-acd6-3bdb0a44fa5f req-323e56b7-5c64-4f57-bd4c-73fc088a681c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057128 Jul 14 14:28:42.864639 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 452/857] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:42.870164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eca7dad9-43bc-4311-a0f2-f01d2e745b25 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:42.871292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eca7dad9-43bc-4311-a0f2-f01d2e745b25 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:42.880686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eca7dad9-43bc-4311-a0f2-f01d2e745b25 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:42.882476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eca7dad9-43bc-4311-a0f2-f01d2e745b25 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:42.884138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eca7dad9-43bc-4311-a0f2-f01d2e745b25 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:42.885097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eca7dad9-43bc-4311-a0f2-f01d2e745b25 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:42.925411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7d6ab358-ab7c-4f81-ad5c-20aa0f558d6f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:42.938095 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d6ab358-ab7c-4f81-ad5c-20aa0f558d6f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1529 microversion: 2.1 time: 0.400743 Jul 14 14:28:42.939339 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 406/858] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:42 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1529 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:42.948514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7361a0bd-3fc1-4cc0-81ba-704355b755b0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:42.951897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7361a0bd-3fc1-4cc0-81ba-704355b755b0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: ab65834e-bbdc-4716-8ae0-f8dbbc461b03] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:42.969097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7361a0bd-3fc1-4cc0-81ba-704355b755b0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:42.974814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7361a0bd-3fc1-4cc0-81ba-704355b755b0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:42.975955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7361a0bd-3fc1-4cc0-81ba-704355b755b0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:42.976640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7361a0bd-3fc1-4cc0-81ba-704355b755b0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:43.010596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:43.012461 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-7361a0bd-3fc1-4cc0-81ba-704355b755b0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] HTTP exception thrown: Instance ab65834e-bbdc-4716-8ae0-f8dbbc461b03 could not be found. Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7361a0bd-3fc1-4cc0-81ba-704355b755b0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Request method failure captured: Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 HTTP/1.1 Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cd1SkQ3774z2NU9IKVkRiLSzWzmrn8aZ3vi8NdZpcOVXpEOLMkuG1fjTVGokxs_Muib9GBNrb0_e2ks0cRnnlY6Mr0Ar_sJhUqdY0wJ7tNphXwkOqpF0RaSdmBWIcWVv25CWbXS2rpn2WTTz9oEUsP8mfDqVPgB5tcqtQHgliZzvTk Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: cd30d3b5d4b84104ae34623d3121a080 Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesAdminNegativeTest-1566531022 Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:28:43.014654 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:28:43.016301 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cd30d3b5d4b84104ae34623d3121a080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cd30d3b5d4b84104ae34623d3121a080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cd30d3b5d4b84104ae34623d3121a080", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cd30d3b5d4b84104ae34623d3121a080"}]}] Jul 14 14:28:43.016301 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesAdminNegativeTest-1566531022 Jul 14 14:28:43.016301 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: cd30d3b5d4b84104ae34623d3121a080 Jul 14 14:28:43.016301 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1566531022 Jul 14 14:28:43.016301 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesAdminNegativeTest-1566531022-project Jul 14 14:28:43.016301 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:28:43.016301 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:28:43.016301 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 6939fb96384749f9b9358e636845106a Jul 14 14:28:43.016301 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesAdminNegativeTest-1566531022-project Jul 14 14:28:43.016301 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:28:43.016301 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance ab65834e-bbdc-4716-8ae0-f8dbbc461b03 could not be found. Jul 14 14:28:43.016301 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'ab65834e-bbdc-4716-8ae0-f8dbbc461b03'} Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab65834e-bbdc-4716-8ae0-f8dbbc461b03 could not be found. Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:43.017288 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab65834e-bbdc-4716-8ae0-f8dbbc461b03 could not be found. Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab65834e-bbdc-4716-8ae0-f8dbbc461b03 could not be found. Jul 14 14:28:43.018792 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:43.022295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7361a0bd-3fc1-4cc0-81ba-704355b755b0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Returning 404 to user: Instance ab65834e-bbdc-4716-8ae0-f8dbbc461b03 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:43.029775 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7361a0bd-3fc1-4cc0-81ba-704355b755b0 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03" status: 404 len: 111 microversion: 2.1 time: 0.089211 Jul 14 14:28:43.031407 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 407/859] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:42 2022] GET /compute/v2.1/servers/ab65834e-bbdc-4716-8ae0-f8dbbc461b03 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:43.042645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2b958a2d-53f4-43e8-91d5-dfa563027c86 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:43.045390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2b958a2d-53f4-43e8-91d5-dfa563027c86 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:43.064755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b958a2d-53f4-43e8-91d5-dfa563027c86 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:43.072667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b958a2d-53f4-43e8-91d5-dfa563027c86 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:43.073732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b958a2d-53f4-43e8-91d5-dfa563027c86 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:43.075664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b958a2d-53f4-43e8-91d5-dfa563027c86 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:43.122728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eca7dad9-43bc-4311-a0f2-f01d2e745b25 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:43.131166 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eca7dad9-43bc-4311-a0f2-f01d2e745b25 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1477 microversion: 2.1 time: 0.265164 Jul 14 14:28:43.136370 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 453/860] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:42 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1477 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:43.160444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3cde1d6e-ac02-4fe5-8f81-9d2df0f818ec tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Action: 'create', calling method: .version_select at 0x7fd6c605b160>, body: {"pool": "dbf616c8-e7bc-4fbe-bb65-7c29f219160a"} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:43.278475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2b958a2d-53f4-43e8-91d5-dfa563027c86 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:43.297612 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2b958a2d-53f4-43e8-91d5-dfa563027c86 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1213 microversion: 2.1 time: 0.264628 Jul 14 14:28:43.311167 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 408/861] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:43 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1213 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:43.320922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:43.322667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:43.334987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:43.335596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:43.337189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:43.337478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:43.432506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:28:43.433251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:28:43.434039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:28:43.434782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:28:43.435356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:28:43.566528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:43.574386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:43.575282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:43.576739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:43.577615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:43.926365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:43.936476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:43.938586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:43.948276 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-acfe8bb8-7596-44cc-9c44-bed5287dc4a1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "POST /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30/action" status: 202 len: 1494 microversion: 2.75 time: 0.635789 Jul 14 14:28:43.949382 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 409/862] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 14:28:43 2022] POST /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30/action => generated 1494 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 14 14:28:43.954759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-88ddcbc3-0949-4f2d-a356-47507836ccce tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:43.955730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-88ddcbc3-0949-4f2d-a356-47507836ccce tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:43.963193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88ddcbc3-0949-4f2d-a356-47507836ccce tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:43.963978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88ddcbc3-0949-4f2d-a356-47507836ccce tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:43.964930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88ddcbc3-0949-4f2d-a356-47507836ccce tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:43.965557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88ddcbc3-0949-4f2d-a356-47507836ccce tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:44.252802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-88ddcbc3-0949-4f2d-a356-47507836ccce tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:44.264339 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-88ddcbc3-0949-4f2d-a356-47507836ccce tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1529 microversion: 2.1 time: 0.313572 Jul 14 14:28:44.265676 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 410/863] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:43 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1529 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:44.280209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-392bf596-c41b-4795-b650-99267b747335 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '.version_select at 0x7fd6c5e3e310>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:44.287490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-392bf596-c41b-4795-b650-99267b747335 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:44.287864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-392bf596-c41b-4795-b650-99267b747335 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:44.333930 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-392bf596-c41b-4795-b650-99267b747335 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 2362 microversion: 2.1 time: 0.065141 Jul 14 14:28:44.344712 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 411/864] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:28:44 2022] GET /compute/v2.1/os-migrations => generated 2362 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:44.355716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6a8fc6b-1427-4993-a96c-bda3f113e9ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:44.358542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b6a8fc6b-1427-4993-a96c-bda3f113e9ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:44.373340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6a8fc6b-1427-4993-a96c-bda3f113e9ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:44.373807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6a8fc6b-1427-4993-a96c-bda3f113e9ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:44.376151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6a8fc6b-1427-4993-a96c-bda3f113e9ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:44.378875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6a8fc6b-1427-4993-a96c-bda3f113e9ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:44.764482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b6a8fc6b-1427-4993-a96c-bda3f113e9ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:44.779244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b6a8fc6b-1427-4993-a96c-bda3f113e9ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:44.780784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b6a8fc6b-1427-4993-a96c-bda3f113e9ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:44.782097 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b6a8fc6b-1427-4993-a96c-bda3f113e9ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1412 microversion: 2.25 time: 0.435761 Jul 14 14:28:44.782586 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 412/865] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:44 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1412 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:44.794145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f8b3839a-0715-41c2-880d-6033f4026ec1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:44.803076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f8b3839a-0715-41c2-880d-6033f4026ec1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:44.823796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8b3839a-0715-41c2-880d-6033f4026ec1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:44.824261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8b3839a-0715-41c2-880d-6033f4026ec1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:44.825101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8b3839a-0715-41c2-880d-6033f4026ec1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:44.825544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8b3839a-0715-41c2-880d-6033f4026ec1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:45.030748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f8b3839a-0715-41c2-880d-6033f4026ec1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:45.045686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f8b3839a-0715-41c2-880d-6033f4026ec1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:45.050134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f8b3839a-0715-41c2-880d-6033f4026ec1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:45.068822 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f8b3839a-0715-41c2-880d-6033f4026ec1 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.278906 Jul 14 14:28:45.069788 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 413/866] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:44 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:45.074792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8e08bfc5-2f61-4244-a06a-5c44092e98e8 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:45.075639 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:45.075639 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:28:45.116148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:45.124705 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8e08bfc5-2f61-4244-a06a-5c44092e98e8 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/d213a017-da8e-42b7-a3bc-f3f8383a6e4f" status: 202 len: 0 microversion: 2.1 time: 0.053728 Jul 14 14:28:45.126150 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 414/867] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:28:45 2022] DELETE /compute/v2.1/flavors/d213a017-da8e-42b7-a3bc-f3f8383a6e4f => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:28:45.133191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-29382504-0c18-4329-be3a-2a9c86562394 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:45.134095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-29382504-0c18-4329-be3a-2a9c86562394 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:45.141331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29382504-0c18-4329-be3a-2a9c86562394 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:45.142196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29382504-0c18-4329-be3a-2a9c86562394 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:45.143148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29382504-0c18-4329-be3a-2a9c86562394 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:45.143778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29382504-0c18-4329-be3a-2a9c86562394 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:45.247374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-29382504-0c18-4329-be3a-2a9c86562394 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:45.257757 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-29382504-0c18-4329-be3a-2a9c86562394 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1275 microversion: 2.1 time: 0.129766 Jul 14 14:28:45.268373 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 415/868] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:45 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:45.274668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c859187a-c580-462c-aca6-ea90b9999aec tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:45.275309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c859187a-c580-462c-aca6-ea90b9999aec tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:45.283455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c859187a-c580-462c-aca6-ea90b9999aec tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:45.283839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c859187a-c580-462c-aca6-ea90b9999aec tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:45.284641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c859187a-c580-462c-aca6-ea90b9999aec tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:45.285514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c859187a-c580-462c-aca6-ea90b9999aec tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:45.643652 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c859187a-c580-462c-aca6-ea90b9999aec tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1630 microversion: 2.1 time: 0.373254 Jul 14 14:28:45.644718 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 416/869] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:45 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1630 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:45.683483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-44e58e0f-00c3-4664-a903-9478483160e4 req-72ed3dbe-d2a0-468c-a1f5-23d3440f2d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07717385-1942-4235-9479-e46016827db8", "name": "network-vif-plugged", "status": "completed", "tag": "a3c7a75e-482a-45ff-810c-3fd5b8e4c273"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:45.700962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-44e58e0f-00c3-4664-a903-9478483160e4 req-72ed3dbe-d2a0-468c-a1f5-23d3440f2d0d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:45.701640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-44e58e0f-00c3-4664-a903-9478483160e4 req-72ed3dbe-d2a0-468c-a1f5-23d3440f2d0d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:45.721573 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-44e58e0f-00c3-4664-a903-9478483160e4 req-72ed3dbe-d2a0-468c-a1f5-23d3440f2d0d service nova] Creating event network-vif-plugged:a3c7a75e-482a-45ff-810c-3fd5b8e4c273 for instance 07717385-1942-4235-9479-e46016827db8 on n-h1-767704-28 Jul 14 14:28:45.728516 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-44e58e0f-00c3-4664-a903-9478483160e4 req-72ed3dbe-d2a0-468c-a1f5-23d3440f2d0d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081684 Jul 14 14:28:45.729728 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 417/870] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:45.980963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-84671fa1-4651-482e-9774-bec74632f69a tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] Calling method '.version_select at 0x7fd6c6545430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:45.982676 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:45.982676 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:28:45.984537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84671fa1-4651-482e-9774-bec74632f69a tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:45.985730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84671fa1-4651-482e-9774-bec74632f69a tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.003243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84671fa1-4651-482e-9774-bec74632f69a tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.004699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84671fa1-4651-482e-9774-bec74632f69a tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.018583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84671fa1-4651-482e-9774-bec74632f69a tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.020001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84671fa1-4651-482e-9774-bec74632f69a tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.032351 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-84671fa1-4651-482e-9774-bec74632f69a tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.301259 Jul 14 14:28:46.038004 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 418/871] 10.222.0.81 () {60 vars in 1186 bytes} [Thu Jul 14 14:28:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:28:46.045160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b683bdaf-275f-4dd1-b990-02e8448fa7a9 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:46.046424 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3cde1d6e-ac02-4fe5-8f81-9d2df0f818ec tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.908467 Jul 14 14:28:46.047220 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 454/872] 10.222.0.81 () {60 vars in 1169 bytes} [Thu Jul 14 14:28:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:46.056493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1709f69-4f6e-4499-992d-685547c72c8a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Action: 'create', calling method: .version_select at 0x7fd6c5d71b80>, body: {"keypair": {"name": "tempest-keypair-1116421153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC9/ZO8TqBwuVn1VEkHRWdXaLfnO/hCHWKkYTn1y/YTh+ZrmQTQ0mtwExtUc0fJG2vuQinRbai0xgoL7eS2GNhZwJWyB8yql9rax76NuOPZQMmi9MvahhM8wok4P1+0qw=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:46.072134 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b683bdaf-275f-4dd1-b990-02e8448fa7a9 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032398 Jul 14 14:28:46.081698 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 419/873] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:28:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:46.081698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e6095b9b-fc68-46c1-92f0-b6483b5aba5c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:46.081698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e6095b9b-fc68-46c1-92f0-b6483b5aba5c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:46.086500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6095b9b-fc68-46c1-92f0-b6483b5aba5c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.087087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6095b9b-fc68-46c1-92f0-b6483b5aba5c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.087981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6095b9b-fc68-46c1-92f0-b6483b5aba5c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.088594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6095b9b-fc68-46c1-92f0-b6483b5aba5c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.090116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f1709f69-4f6e-4499-992d-685547c72c8a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Getting quotas for project eb57648abd7742d9aac69af1744d6bc1. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:46.099751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f1709f69-4f6e-4499-992d-685547c72c8a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Getting quotas for user 5c688cde0ea44a059b0bca3e020c28b3 and project eb57648abd7742d9aac69af1744d6bc1. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:46.143195 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f1709f69-4f6e-4499-992d-685547c72c8a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.093605 Jul 14 14:28:46.144208 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 455/874] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:28:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:46.155197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ef5920b1-a2bf-4190-a12a-169f528086cf tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] Calling method '.version_select at 0x7fd6c5d71ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:46.156713 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:46.156713 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:28:46.159245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef5920b1-a2bf-4190-a12a-169f528086cf tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.159995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef5920b1-a2bf-4190-a12a-169f528086cf tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.176534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef5920b1-a2bf-4190-a12a-169f528086cf tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.177522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef5920b1-a2bf-4190-a12a-169f528086cf tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.185518 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ef5920b1-a2bf-4190-a12a-169f528086cf tempest-HypervisorAdminV228Test-418647520 tempest-HypervisorAdminV228Test-418647520-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 719 microversion: 2.28 time: 0.039687 Jul 14 14:28:46.186471 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 456/875] 10.222.0.81 () {60 vars in 1192 bytes} [Thu Jul 14 14:28:46 2022] GET /compute/v2.1/os-hypervisors/1 => generated 719 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:28:46.192015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Action: 'action', calling method: .version_select at 0x7fd6c8731c10>, body: {"addFloatingIp": {"address": "172.25.8.204"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:46.194339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:46.204540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.205485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.206528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.207258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.308416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Acquired lock "refresh_cache-428925c9-c52e-4728-ac68-5e6c7a9932c7" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:28:46.326903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e6095b9b-fc68-46c1-92f0-b6483b5aba5c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:46.336223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e6095b9b-fc68-46c1-92f0-b6483b5aba5c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:46.338293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e6095b9b-fc68-46c1-92f0-b6483b5aba5c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:46.339588 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e6095b9b-fc68-46c1-92f0-b6483b5aba5c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1412 microversion: 2.25 time: 0.265523 Jul 14 14:28:46.365121 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 420/876] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:46 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1412 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:46.370908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0cec7e7e-87b6-441e-84e1-c5b95fe17154 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:46.371775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0cec7e7e-87b6-441e-84e1-c5b95fe17154 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:46.384643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0cec7e7e-87b6-441e-84e1-c5b95fe17154 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.385415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0cec7e7e-87b6-441e-84e1-c5b95fe17154 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.386466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0cec7e7e-87b6-441e-84e1-c5b95fe17154 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.387678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0cec7e7e-87b6-441e-84e1-c5b95fe17154 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.534835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0cec7e7e-87b6-441e-84e1-c5b95fe17154 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:46.544790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0cec7e7e-87b6-441e-84e1-c5b95fe17154 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:46.562860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0cec7e7e-87b6-441e-84e1-c5b95fe17154 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:46.571009 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0cec7e7e-87b6-441e-84e1-c5b95fe17154 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.203675 Jul 14 14:28:46.575379 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 421/877] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:46 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:46.588701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:46.590719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:46.607157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.607612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.608393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.608834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.654139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:46.662286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Old instance type tempest-test_resize_flavor_-1569970826, new instance type m1.heat {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 14:28:46.671089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:28:46.671880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:28:46.672583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:28:46.673236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:28:46.674125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:28:46.787202 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b7d2f212-74c3-4213-a29d-2e8a46694bcf tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "POST /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46/action" status: 202 len: 0 microversion: 2.1 time: 0.208635 Jul 14 14:28:46.787841 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 422/878] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:28:46 2022] POST /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:28:46.798249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ff07cb36-ff02-4839-b251-823e928bc487 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:46.805625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ff07cb36-ff02-4839-b251-823e928bc487 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:46.835391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff07cb36-ff02-4839-b251-823e928bc487 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.838962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff07cb36-ff02-4839-b251-823e928bc487 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:46.843813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff07cb36-ff02-4839-b251-823e928bc487 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:46.846054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff07cb36-ff02-4839-b251-823e928bc487 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:47.045387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG neutronclient.v2_0.client [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.8.204 (2fd71871-df0b-4ad9-bb5c-f891b3f1b66f) with port 02b187bb-73fb-44ac-bdb2-7163acbe4d18 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network dbf616c8-e7bc-4fbe-bb65-7c29f219160a.", "detail": ""}} {{(pid=119512) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:28:47.046639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Releasing lock "refresh_cache-428925c9-c52e-4728-ac68-5e6c7a9932c7" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:28:47.047663 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] HTTP exception thrown: Cannot associate floating IP 172.25.8.204 (2fd71871-df0b-4ad9-bb5c-f891b3f1b66f) with port 02b187bb-73fb-44ac-bdb2-7163acbe4d18 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network dbf616c8-e7bc-4fbe-bb65-7c29f219160a. Jul 14 14:28:47.047663 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-69eca733-2e9b-4797-83ca-2b97783036b8'] Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Request method failure captured: Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action HTTP/1.1 Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 46 Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cf8B8Y1Od0QfNZ2hmYqY3jQJKhoBjVlyNY_jv2XMAo74Pz-74dZmVajCNd_MF7QERQLzLmpILILb9wUJKjsFttsaMfKYFvXebXdFXTZh-USYkoiXfXE1HFrBPbznkbG_oPLKMYzBrYAo81YgGAL9qMsL9XfjdCiqHdbbTu3obkpMvA Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 8005f93725b7435db246f74917f659cf Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:28:47.059607 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:28:47.062354 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8005f93725b7435db246f74917f659cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8005f93725b7435db246f74917f659cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8005f93725b7435db246f74917f659cf", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8005f93725b7435db246f74917f659cf"}]}] Jul 14 14:28:47.062354 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:28:47.062354 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 8005f93725b7435db246f74917f659cf Jul 14 14:28:47.062354 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:28:47.062354 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project Jul 14 14:28:47.062354 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:28:47.062354 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:28:47.062354 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: a39d4bccdf9c403381a49a6c857d4869 Jul 14 14:28:47.062354 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project Jul 14 14:28:47.062354 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:28:47.062354 n-d-767704-28 devstack@n-api.service[119512]: {"addFloatingIp": {"address": "172.25.8.204"}} Jul 14 14:28:47.062354 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: exception: Cannot associate floating IP 172.25.8.204 (2fd71871-df0b-4ad9-bb5c-f891b3f1b66f) with port 02b187bb-73fb-44ac-bdb2-7163acbe4d18 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network dbf616c8-e7bc-4fbe-bb65-7c29f219160a. Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-69eca733-2e9b-4797-83ca-2b97783036b8'] Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '428925c9-c52e-4728-ac68-5e6c7a9932c7', 'body': {'addFloatingIp': {'address': '172.25.8.204'}}} Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:28:47.066157 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:28:47.071587 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.8.204 (2fd71871-df0b-4ad9-bb5c-f891b3f1b66f) with port 02b187bb-73fb-44ac-bdb2-7163acbe4d18 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network dbf616c8-e7bc-4fbe-bb65-7c29f219160a. Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69eca733-2e9b-4797-83ca-2b97783036b8'] Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.8.204 (2fd71871-df0b-4ad9-bb5c-f891b3f1b66f) with port 02b187bb-73fb-44ac-bdb2-7163acbe4d18 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network dbf616c8-e7bc-4fbe-bb65-7c29f219160a. Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69eca733-2e9b-4797-83ca-2b97783036b8'] Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:47.077668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.8.204 (2fd71871-df0b-4ad9-bb5c-f891b3f1b66f) with port 02b187bb-73fb-44ac-bdb2-7163acbe4d18 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network dbf616c8-e7bc-4fbe-bb65-7c29f219160a. Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69eca733-2e9b-4797-83ca-2b97783036b8'] Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:47.081816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:47.085955 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:47.085955 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:47.085955 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:47.085955 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:47.085955 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:47.085955 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:47.085955 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.8.204 (2fd71871-df0b-4ad9-bb5c-f891b3f1b66f) with port 02b187bb-73fb-44ac-bdb2-7163acbe4d18 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network dbf616c8-e7bc-4fbe-bb65-7c29f219160a. Jul 14 14:28:47.085955 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69eca733-2e9b-4797-83ca-2b97783036b8'] Jul 14 14:28:47.085955 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:28:47.085955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Returning 400 to user: Cannot associate floating IP 172.25.8.204 (2fd71871-df0b-4ad9-bb5c-f891b3f1b66f) with port 02b187bb-73fb-44ac-bdb2-7163acbe4d18 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network dbf616c8-e7bc-4fbe-bb65-7c29f219160a. Jul 14 14:28:47.085955 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-69eca733-2e9b-4797-83ca-2b97783036b8'] {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:47.090610 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1ff703dc-2176-432d-8495-f4024f69df8f tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action" status: 400 len: 381 microversion: 2.1 time: 0.883054 Jul 14 14:28:47.090610 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 457/879] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:28:46 2022] POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action => generated 381 bytes in 890 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:28:47.091481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-17136aaa-6cc0-47fc-9969-16718190b7f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:47.095221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-17136aaa-6cc0-47fc-9969-16718190b7f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:47.125671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-17136aaa-6cc0-47fc-9969-16718190b7f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:47.126951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-17136aaa-6cc0-47fc-9969-16718190b7f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:47.126951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-17136aaa-6cc0-47fc-9969-16718190b7f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:47.127460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-17136aaa-6cc0-47fc-9969-16718190b7f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:47.247008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ff07cb36-ff02-4839-b251-823e928bc487 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:47.262546 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ff07cb36-ff02-4839-b251-823e928bc487 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1317 microversion: 2.1 time: 0.471029 Jul 14 14:28:47.263649 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 423/880] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:46 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:47.276064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a87ba85f-0dc8-4cd8-9bfe-db0ee8b561e6 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '.version_select at 0x7fd6c5da6e50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:47.966385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-17136aaa-6cc0-47fc-9969-16718190b7f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:47.975220 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-17136aaa-6cc0-47fc-9969-16718190b7f6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1538 microversion: 2.1 time: 0.896036 Jul 14 14:28:47.978199 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 458/881] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:47 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1538 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:47.990605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9bb8c95c-1159-4c98-8316-6128c42f237a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:47.991523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9bb8c95c-1159-4c98-8316-6128c42f237a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:48.003378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9bb8c95c-1159-4c98-8316-6128c42f237a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:48.005795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9bb8c95c-1159-4c98-8316-6128c42f237a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:48.007012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9bb8c95c-1159-4c98-8316-6128c42f237a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:48.008434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9bb8c95c-1159-4c98-8316-6128c42f237a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:48.362774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9bb8c95c-1159-4c98-8316-6128c42f237a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:48.377867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9bb8c95c-1159-4c98-8316-6128c42f237a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:48.379813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9bb8c95c-1159-4c98-8316-6128c42f237a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:48.381316 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9bb8c95c-1159-4c98-8316-6128c42f237a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1608 microversion: 2.25 time: 0.401845 Jul 14 14:28:48.395934 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 459/882] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:47 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1608 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:48.403931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-829c07b2-e70d-4a48-89cb-f7004e4bdb81 req-c54b5bd6-f33e-49ff-8742-fbc4bf342b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90a1b7fb-df82-435c-bf4d-261decd2db5f", "tag": "2f439b9e-ad79-44c1-9bf1-810c6d5786f9"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:48.419340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-829c07b2-e70d-4a48-89cb-f7004e4bdb81 req-c54b5bd6-f33e-49ff-8742-fbc4bf342b78 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:48.419790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-829c07b2-e70d-4a48-89cb-f7004e4bdb81 req-c54b5bd6-f33e-49ff-8742-fbc4bf342b78 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:48.438443 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-829c07b2-e70d-4a48-89cb-f7004e4bdb81 req-c54b5bd6-f33e-49ff-8742-fbc4bf342b78 service nova] Creating event network-changed:2f439b9e-ad79-44c1-9bf1-810c6d5786f9 for instance 90a1b7fb-df82-435c-bf4d-261decd2db5f on n-h2-767704-28 Jul 14 14:28:48.444320 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-829c07b2-e70d-4a48-89cb-f7004e4bdb81 req-c54b5bd6-f33e-49ff-8742-fbc4bf342b78 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044868 Jul 14 14:28:48.447347 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 460/883] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:48.453658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-afc5315a-cd09-4d90-af62-164efa88646b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:48.454347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-afc5315a-cd09-4d90-af62-164efa88646b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:48.464159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afc5315a-cd09-4d90-af62-164efa88646b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:48.464660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afc5315a-cd09-4d90-af62-164efa88646b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:48.465897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afc5315a-cd09-4d90-af62-164efa88646b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:48.467958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afc5315a-cd09-4d90-af62-164efa88646b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:48.695117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-afc5315a-cd09-4d90-af62-164efa88646b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:48.715769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-afc5315a-cd09-4d90-af62-164efa88646b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:48.724922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-afc5315a-cd09-4d90-af62-164efa88646b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:48.733538 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-afc5315a-cd09-4d90-af62-164efa88646b tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.284198 Jul 14 14:28:48.736514 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 461/884] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:48 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:48.749036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6384cc09-35a6-4570-a9a3-4ded1fd3a886 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:48.760468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6384cc09-35a6-4570-a9a3-4ded1fd3a886 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:48.768363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6384cc09-35a6-4570-a9a3-4ded1fd3a886 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:48.768363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6384cc09-35a6-4570-a9a3-4ded1fd3a886 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:48.769075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6384cc09-35a6-4570-a9a3-4ded1fd3a886 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:48.769526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6384cc09-35a6-4570-a9a3-4ded1fd3a886 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:49.121355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6384cc09-35a6-4570-a9a3-4ded1fd3a886 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:49.130815 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6384cc09-35a6-4570-a9a3-4ded1fd3a886 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1317 microversion: 2.1 time: 0.387573 Jul 14 14:28:49.134156 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 462/885] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:48 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:49.149414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f3ee696c-6035-49cf-b4a1-b749c42a163c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:49.153524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f3ee696c-6035-49cf-b4a1-b749c42a163c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:49.170481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3ee696c-6035-49cf-b4a1-b749c42a163c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:49.170936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3ee696c-6035-49cf-b4a1-b749c42a163c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:49.171792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3ee696c-6035-49cf-b4a1-b749c42a163c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:49.172301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3ee696c-6035-49cf-b4a1-b749c42a163c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:49.207612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:49.632845 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f3ee696c-6035-49cf-b4a1-b749c42a163c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.490824 Jul 14 14:28:49.632845 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 463/886] 10.222.0.81 () {60 vars in 1315 bytes} [Thu Jul 14 14:28:49 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-interface => generated 284 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:28:49.635104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bcf565e4-2c34-41fc-b106-02b44b51d401 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:49.635910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bcf565e4-2c34-41fc-b106-02b44b51d401 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:49.650630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcf565e4-2c34-41fc-b106-02b44b51d401 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:49.651318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcf565e4-2c34-41fc-b106-02b44b51d401 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:49.653482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcf565e4-2c34-41fc-b106-02b44b51d401 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:49.654060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcf565e4-2c34-41fc-b106-02b44b51d401 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:49.693655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bcf565e4-2c34-41fc-b106-02b44b51d401 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:28:49.817716 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bcf565e4-2c34-41fc-b106-02b44b51d401 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "DELETE /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 204 len: 0 microversion: 2.1 time: 0.187709 Jul 14 14:28:49.818682 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 464/887] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:28:49 2022] DELETE /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:28:49.827313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-68fb70f6-7fd3-4dca-9b01-8b13ac378fd4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:49.829883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-68fb70f6-7fd3-4dca-9b01-8b13ac378fd4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:49.835960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68fb70f6-7fd3-4dca-9b01-8b13ac378fd4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:49.836838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68fb70f6-7fd3-4dca-9b01-8b13ac378fd4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:49.838345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68fb70f6-7fd3-4dca-9b01-8b13ac378fd4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:49.838811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68fb70f6-7fd3-4dca-9b01-8b13ac378fd4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:49.853105 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a87ba85f-0dc8-4cd8-9bfe-db0ee8b561e6 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/2fd71871-df0b-4ad9-bb5c-f891b3f1b66f" status: 202 len: 0 microversion: 2.1 time: 2.584686 Jul 14 14:28:49.855782 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 424/888] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:28:47 2022] DELETE /compute/v2.1/os-floating-ips/2fd71871-df0b-4ad9-bb5c-f891b3f1b66f => generated 0 bytes in 2590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:28:49.868711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a68f8ad2-449a-4244-932e-3d15e2d33fe9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:49.874376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a68f8ad2-449a-4244-932e-3d15e2d33fe9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:49.886518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a68f8ad2-449a-4244-932e-3d15e2d33fe9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:49.889452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a68f8ad2-449a-4244-932e-3d15e2d33fe9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:49.892513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a68f8ad2-449a-4244-932e-3d15e2d33fe9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:49.893144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a68f8ad2-449a-4244-932e-3d15e2d33fe9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:49.921307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:50.037338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a68f8ad2-449a-4244-932e-3d15e2d33fe9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:50.068935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a68f8ad2-449a-4244-932e-3d15e2d33fe9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:50.071222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a68f8ad2-449a-4244-932e-3d15e2d33fe9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:50.077630 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a68f8ad2-449a-4244-932e-3d15e2d33fe9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.220404 Jul 14 14:28:50.078331 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 425/889] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:49 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:50.083271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1837585280", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "6831672f-d329-4243-a142-ff7ed2c51723"}], "security_groups": [{"name": "tempest-securitygroup--2129716249"}], "key_name": "tempest-keypair-1116421153", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:50.160272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-68fb70f6-7fd3-4dca-9b01-8b13ac378fd4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:50.171333 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-68fb70f6-7fd3-4dca-9b01-8b13ac378fd4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1538 microversion: 2.1 time: 0.351059 Jul 14 14:28:50.172346 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 465/890] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:49 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1538 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:50.189903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0526c0e8-4282-4af9-8295-5818d3af0ad6 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:50.191145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0526c0e8-4282-4af9-8295-5818d3af0ad6 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:50.204008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0526c0e8-4282-4af9-8295-5818d3af0ad6 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:50.204905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0526c0e8-4282-4af9-8295-5818d3af0ad6 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:50.206041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0526c0e8-4282-4af9-8295-5818d3af0ad6 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:50.206736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0526c0e8-4282-4af9-8295-5818d3af0ad6 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:50.357687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] validate_networks() for [('6831672f-d329-4243-a142-ff7ed2c51723', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:28:50.541217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0526c0e8-4282-4af9-8295-5818d3af0ad6 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:50.550460 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0526c0e8-4282-4af9-8295-5818d3af0ad6 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1680 microversion: 2.1 time: 0.366642 Jul 14 14:28:50.552011 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 466/891] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:50 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1680 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:50.558544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3746eafd-533c-43a9-a3a5-a34ff9e686b3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Action: 'action', calling method: .version_select at 0x7fd6c88b4280>, body: {"removeFloatingIp": {"address": "172.25.8.228"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:50.874234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3746eafd-533c-43a9-a3a5-a34ff9e686b3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:50.881064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3746eafd-533c-43a9-a3a5-a34ff9e686b3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:50.881617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3746eafd-533c-43a9-a3a5-a34ff9e686b3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:50.882444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3746eafd-533c-43a9-a3a5-a34ff9e686b3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:50.883398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3746eafd-533c-43a9-a3a5-a34ff9e686b3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:51.443194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3746eafd-533c-43a9-a3a5-a34ff9e686b3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Acquired lock "refresh_cache-428925c9-c52e-4728-ac68-5e6c7a9932c7" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:28:51.519286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:28:51.519873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:28:51.520192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:28:51.520602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:28:51.521403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:28:51.544396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:51.548348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:51.551225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:51.552149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:51.605584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Getting quotas for project eb57648abd7742d9aac69af1744d6bc1. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:51.617190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Getting quotas for user 5c688cde0ea44a059b0bca3e020c28b3 and project eb57648abd7742d9aac69af1744d6bc1. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:51.663177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:28:51.666954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:28:51.781635 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5e1fe58d-359f-4604-a4a3-abc219273adc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.701838 Jul 14 14:28:51.790485 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 426/892] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:28:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:28:51.795152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:51.798115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-79fe597e-68fc-49a0-acb9-fdd69b97308a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:51.799120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-79fe597e-68fc-49a0-acb9-fdd69b97308a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:51.826032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79fe597e-68fc-49a0-acb9-fdd69b97308a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:51.830202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79fe597e-68fc-49a0-acb9-fdd69b97308a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:51.833948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79fe597e-68fc-49a0-acb9-fdd69b97308a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:51.834872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79fe597e-68fc-49a0-acb9-fdd69b97308a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:52.475109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-79fe597e-68fc-49a0-acb9-fdd69b97308a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:52.489866 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-79fe597e-68fc-49a0-acb9-fdd69b97308a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1317 microversion: 2.1 time: 0.697793 Jul 14 14:28:52.490480 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 427/893] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:51 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1317 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:52.496270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-66987424-379b-4ef8-929e-21cf50b35bd9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:52.496885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-66987424-379b-4ef8-929e-21cf50b35bd9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:52.527017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66987424-379b-4ef8-929e-21cf50b35bd9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:52.527807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66987424-379b-4ef8-929e-21cf50b35bd9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:52.528351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66987424-379b-4ef8-929e-21cf50b35bd9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:52.528809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66987424-379b-4ef8-929e-21cf50b35bd9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:52.679309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-66987424-379b-4ef8-929e-21cf50b35bd9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:52.714026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-66987424-379b-4ef8-929e-21cf50b35bd9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:52.720291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-66987424-379b-4ef8-929e-21cf50b35bd9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:52.738015 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-66987424-379b-4ef8-929e-21cf50b35bd9 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.244463 Jul 14 14:28:52.745104 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 428/894] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:52 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:52.750863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-058006be-f98e-4e79-9783-11c5b0c25e5b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:52.751642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-058006be-f98e-4e79-9783-11c5b0c25e5b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:52.775003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-058006be-f98e-4e79-9783-11c5b0c25e5b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:52.779249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-058006be-f98e-4e79-9783-11c5b0c25e5b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:52.780683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-058006be-f98e-4e79-9783-11c5b0c25e5b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:52.781241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-058006be-f98e-4e79-9783-11c5b0c25e5b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:53.159865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-058006be-f98e-4e79-9783-11c5b0c25e5b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:53.173150 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-058006be-f98e-4e79-9783-11c5b0c25e5b tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1543 microversion: 2.1 time: 0.426672 Jul 14 14:28:53.177008 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 429/895] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:52 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1543 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:53.189158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-03fae89f-8534-4083-98ac-80f56d06707a tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:53.190192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-03fae89f-8534-4083-98ac-80f56d06707a tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:53.212663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03fae89f-8534-4083-98ac-80f56d06707a tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:53.213475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03fae89f-8534-4083-98ac-80f56d06707a tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:53.214579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03fae89f-8534-4083-98ac-80f56d06707a tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:53.215291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03fae89f-8534-4083-98ac-80f56d06707a tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:53.316425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-3746eafd-533c-43a9-a3a5-a34ff9e686b3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Building network info cache for instance {{(pid=119512) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:28:53.407515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-03fae89f-8534-4083-98ac-80f56d06707a tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6939fb96384749f9b9358e636845106a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd30d3b5d4b84104ae34623d3121a080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:53.419364 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-03fae89f-8534-4083-98ac-80f56d06707a tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 200 len: 1612 microversion: 2.1 time: 0.240763 Jul 14 14:28:53.425321 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 430/896] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:53 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 1612 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:53.436685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1b01f5f4-05b5-444e-a206-3726d8a39ba7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:53.443581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1b01f5f4-05b5-444e-a206-3726d8a39ba7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:53.458764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b01f5f4-05b5-444e-a206-3726d8a39ba7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:53.459834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b01f5f4-05b5-444e-a206-3726d8a39ba7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:53.463262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b01f5f4-05b5-444e-a206-3726d8a39ba7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:53.464700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b01f5f4-05b5-444e-a206-3726d8a39ba7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:53.586822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1b01f5f4-05b5-444e-a206-3726d8a39ba7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:53.594801 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1b01f5f4-05b5-444e-a206-3726d8a39ba7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1295 microversion: 2.1 time: 0.167786 Jul 14 14:28:53.602852 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 431/897] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:53 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1295 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:53.984383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-50bc2e62-3476-41be-927c-d7b37f4130a2 tempest-InstanceUsageAuditLogTestJSON-572857917 tempest-InstanceUsageAuditLogTestJSON-572857917-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:53.985488 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:53.985488 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:28:54.047266 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-50bc2e62-3476-41be-927c-d7b37f4130a2 tempest-InstanceUsageAuditLogTestJSON-572857917 tempest-InstanceUsageAuditLogTestJSON-572857917-project-admin] 10.222.0.81 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-14 14:28:52" status: 200 len: 318 microversion: 2.1 time: 0.442745 Jul 14 14:28:54.067136 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 432/898] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 14:28:53 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-14%2014%3A28%3A52 => generated 318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:54.073064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-5297ae39-190e-4176-b7be-d98b1488e107 req-33939960-a3ac-4b51-a4b8-c2288cb24e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07717385-1942-4235-9479-e46016827db8", "tag": "a3c7a75e-482a-45ff-810c-3fd5b8e4c273"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:54.110314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5297ae39-190e-4176-b7be-d98b1488e107 req-33939960-a3ac-4b51-a4b8-c2288cb24e45 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:54.113614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5297ae39-190e-4176-b7be-d98b1488e107 req-33939960-a3ac-4b51-a4b8-c2288cb24e45 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:54.145002 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-5297ae39-190e-4176-b7be-d98b1488e107 req-33939960-a3ac-4b51-a4b8-c2288cb24e45 service nova] Creating event network-changed:a3c7a75e-482a-45ff-810c-3fd5b8e4c273 for instance 07717385-1942-4235-9479-e46016827db8 on n-h1-767704-28 Jul 14 14:28:54.157093 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-5297ae39-190e-4176-b7be-d98b1488e107 req-33939960-a3ac-4b51-a4b8-c2288cb24e45 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088278 Jul 14 14:28:54.163728 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 433/899] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:54.176541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-4a143fbb-ec5c-4655-8daf-7ba574e4f391 req-879ba334-8d18-4ea7-8615-0ff933e3984d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f1d989-211a-466d-9a7a-a1a9303daf5d", "name": "network-vif-deleted", "tag": "e9dab558-a62c-4e16-92a9-8c676e1f2df2"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:54.196463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4a143fbb-ec5c-4655-8daf-7ba574e4f391 req-879ba334-8d18-4ea7-8615-0ff933e3984d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:54.197393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4a143fbb-ec5c-4655-8daf-7ba574e4f391 req-879ba334-8d18-4ea7-8615-0ff933e3984d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:54.216099 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-4a143fbb-ec5c-4655-8daf-7ba574e4f391 req-879ba334-8d18-4ea7-8615-0ff933e3984d service nova] Creating event network-vif-deleted:e9dab558-a62c-4e16-92a9-8c676e1f2df2 for instance 60f1d989-211a-466d-9a7a-a1a9303daf5d on n-h1-767704-28 Jul 14 14:28:54.225436 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-4a143fbb-ec5c-4655-8daf-7ba574e4f391 req-879ba334-8d18-4ea7-8615-0ff933e3984d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059111 Jul 14 14:28:54.226424 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 434/900] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:54.234674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-195fd1a5-f8cf-4808-8cb4-92ec95fc6e0b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:54.235763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-195fd1a5-f8cf-4808-8cb4-92ec95fc6e0b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:54.243511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-195fd1a5-f8cf-4808-8cb4-92ec95fc6e0b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:54.244389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-195fd1a5-f8cf-4808-8cb4-92ec95fc6e0b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:54.245599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-195fd1a5-f8cf-4808-8cb4-92ec95fc6e0b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:54.246292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-195fd1a5-f8cf-4808-8cb4-92ec95fc6e0b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:54.584961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-3746eafd-533c-43a9-a3a5-a34ff9e686b3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Updating instance_info_cache with network_info: [{"id": "02b187bb-73fb-44ac-bdb2-7163acbe4d18", "address": "fa:16:3e:d8:ed:4f", "network": {"id": "62b0ffd3-9221-4455-a14e-d733e4d9c76a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1649950194-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8005f93725b7435db246f74917f659cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap02b187bb-73", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119512) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:28:54.587175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-195fd1a5-f8cf-4808-8cb4-92ec95fc6e0b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:54.596273 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-195fd1a5-f8cf-4808-8cb4-92ec95fc6e0b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1317 microversion: 2.1 time: 0.368265 Jul 14 14:28:54.597180 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 435/901] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:54 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:54.603282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-03453499-259d-40a2-85b0-9ee09b3c9536 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:54.604138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-03453499-259d-40a2-85b0-9ee09b3c9536 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:54.614617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03453499-259d-40a2-85b0-9ee09b3c9536 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:54.615303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03453499-259d-40a2-85b0-9ee09b3c9536 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:54.616365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03453499-259d-40a2-85b0-9ee09b3c9536 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:54.617006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03453499-259d-40a2-85b0-9ee09b3c9536 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:54.619636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3746eafd-533c-43a9-a3a5-a34ff9e686b3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Releasing lock "refresh_cache-428925c9-c52e-4728-ac68-5e6c7a9932c7" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:28:54.620538 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3746eafd-533c-43a9-a3a5-a34ff9e686b3 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action" status: 202 len: 0 microversion: 2.1 time: 4.067383 Jul 14 14:28:54.621432 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 467/902] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:28:50 2022] POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action => generated 0 bytes in 4068 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:28:54.627921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3ccd44e5-5c49-4ec6-8e2a-87645ddd07c3 tempest-InstanceUsageAuditLogTestJSON-572857917 tempest-InstanceUsageAuditLogTestJSON-572857917-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:54.629530 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:54.629530 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:28:54.653470 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3ccd44e5-5c49-4ec6-8e2a-87645ddd07c3 tempest-InstanceUsageAuditLogTestJSON-572857917 tempest-InstanceUsageAuditLogTestJSON-572857917-project-admin] 10.222.0.81 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.029965 Jul 14 14:28:54.654690 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 468/903] 10.222.0.81 () {58 vars in 1184 bytes} [Thu Jul 14 14:28:54 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:54.661902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2759fed6-fae6-440a-9ab6-ab8407dbc41b req-ea30cd53-97db-4e1b-b201-69edabb4213e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a1b7fb-df82-435c-bf4d-261decd2db5f", "name": "network-vif-plugged", "status": "completed", "tag": "2f439b9e-ad79-44c1-9bf1-810c6d5786f9"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:54.672578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2759fed6-fae6-440a-9ab6-ab8407dbc41b req-ea30cd53-97db-4e1b-b201-69edabb4213e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:54.673475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2759fed6-fae6-440a-9ab6-ab8407dbc41b req-ea30cd53-97db-4e1b-b201-69edabb4213e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:54.689323 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2759fed6-fae6-440a-9ab6-ab8407dbc41b req-ea30cd53-97db-4e1b-b201-69edabb4213e service nova] Creating event network-vif-plugged:2f439b9e-ad79-44c1-9bf1-810c6d5786f9 for instance 90a1b7fb-df82-435c-bf4d-261decd2db5f on n-h2-767704-28 Jul 14 14:28:54.697247 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2759fed6-fae6-440a-9ab6-ab8407dbc41b req-ea30cd53-97db-4e1b-b201-69edabb4213e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040155 Jul 14 14:28:54.698551 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 469/904] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:54.705431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2945be13-e763-4d32-901d-65c155ffc169 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:54.706595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2945be13-e763-4d32-901d-65c155ffc169 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:54.718368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2945be13-e763-4d32-901d-65c155ffc169 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:54.719384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2945be13-e763-4d32-901d-65c155ffc169 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:54.722379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2945be13-e763-4d32-901d-65c155ffc169 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:54.723132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2945be13-e763-4d32-901d-65c155ffc169 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:54.843734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-03453499-259d-40a2-85b0-9ee09b3c9536 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:54.857566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-03453499-259d-40a2-85b0-9ee09b3c9536 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:54.861134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-03453499-259d-40a2-85b0-9ee09b3c9536 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:54.873876 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-03453499-259d-40a2-85b0-9ee09b3c9536 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.275214 Jul 14 14:28:54.884068 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 436/905] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:54 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:54.911535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9515eda0-ad12-4d0e-ac9b-83ae589d9a7b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:54.913533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9515eda0-ad12-4d0e-ac9b-83ae589d9a7b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] [instance: 60f1d989-211a-466d-9a7a-a1a9303daf5d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:54.934615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9515eda0-ad12-4d0e-ac9b-83ae589d9a7b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:54.944007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9515eda0-ad12-4d0e-ac9b-83ae589d9a7b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:54.951398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9515eda0-ad12-4d0e-ac9b-83ae589d9a7b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:54.952066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9515eda0-ad12-4d0e-ac9b-83ae589d9a7b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:55.001156 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-9515eda0-ad12-4d0e-ac9b-83ae589d9a7b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] HTTP exception thrown: Instance 60f1d989-211a-466d-9a7a-a1a9303daf5d could not be found. Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9515eda0-ad12-4d0e-ac9b-83ae589d9a7b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Request method failure captured: Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d HTTP/1.1 Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cd1SkQ3774z2NU9IKVkRiLSzWzmrn8aZ3vi8NdZpcOVXpEOLMkuG1fjTVGokxs_Muib9GBNrb0_e2ks0cRnnlY6Mr0Ar_sJhUqdY0wJ7tNphXwkOqpF0RaSdmBWIcWVv25CWbXS2rpn2WTTz9oEUsP8mfDqVPgB5tcqtQHgliZzvTk Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: cd30d3b5d4b84104ae34623d3121a080 Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesAdminNegativeTest-1566531022 Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:28:55.003717 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:28:55.006336 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cd30d3b5d4b84104ae34623d3121a080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cd30d3b5d4b84104ae34623d3121a080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cd30d3b5d4b84104ae34623d3121a080", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cd30d3b5d4b84104ae34623d3121a080"}]}] Jul 14 14:28:55.006336 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesAdminNegativeTest-1566531022 Jul 14 14:28:55.006336 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: cd30d3b5d4b84104ae34623d3121a080 Jul 14 14:28:55.006336 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1566531022 Jul 14 14:28:55.006336 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesAdminNegativeTest-1566531022-project Jul 14 14:28:55.006336 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:28:55.006336 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:28:55.006336 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 6939fb96384749f9b9358e636845106a Jul 14 14:28:55.006336 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesAdminNegativeTest-1566531022-project Jul 14 14:28:55.006336 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:28:55.006336 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 60f1d989-211a-466d-9a7a-a1a9303daf5d could not be found. Jul 14 14:28:55.006336 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '60f1d989-211a-466d-9a7a-a1a9303daf5d'} Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60f1d989-211a-466d-9a7a-a1a9303daf5d could not be found. Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:55.008810 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60f1d989-211a-466d-9a7a-a1a9303daf5d could not be found. Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60f1d989-211a-466d-9a7a-a1a9303daf5d could not be found. Jul 14 14:28:55.011870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:55.015762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2945be13-e763-4d32-901d-65c155ffc169 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:55.020059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9515eda0-ad12-4d0e-ac9b-83ae589d9a7b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Returning 404 to user: Instance 60f1d989-211a-466d-9a7a-a1a9303daf5d could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:55.022948 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9515eda0-ad12-4d0e-ac9b-83ae589d9a7b tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d" status: 404 len: 111 microversion: 2.1 time: 0.133436 Jul 14 14:28:55.023560 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 437/906] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:54 2022] GET /compute/v2.1/servers/60f1d989-211a-466d-9a7a-a1a9303daf5d => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:28:55.026370 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2945be13-e763-4d32-901d-65c155ffc169 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1543 microversion: 2.1 time: 0.326267 Jul 14 14:28:55.033380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7881e188-0111-48db-ab4b-cbc7b029fc78 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:55.034002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7881e188-0111-48db-ab4b-cbc7b029fc78 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:55.039252 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 470/907] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:54 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1543 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:55.044675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff59bb6f-5f67-4160-92cb-6db8cad1c11b tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '.version_select at 0x7fd6c5df9d30>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:55.054638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7881e188-0111-48db-ab4b-cbc7b029fc78 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:55.056433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7881e188-0111-48db-ab4b-cbc7b029fc78 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:55.062471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7881e188-0111-48db-ab4b-cbc7b029fc78 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:55.064125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7881e188-0111-48db-ab4b-cbc7b029fc78 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:55.234496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7881e188-0111-48db-ab4b-cbc7b029fc78 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:55.243544 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7881e188-0111-48db-ab4b-cbc7b029fc78 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1293 microversion: 2.1 time: 0.218825 Jul 14 14:28:55.261405 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 438/908] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:55 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1293 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:55.269562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-01644940-da73-4ed8-8475-d5291b7ca034 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] Calling method '.version_select at 0x7fd6c5e340d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:55.300354 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-01644940-da73-4ed8-8475-d5291b7ca034 tempest-VolumesAdminNegativeTest-1566531022 tempest-VolumesAdminNegativeTest-1566531022-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-323476641" status: 202 len: 0 microversion: 2.1 time: 0.037290 Jul 14 14:28:55.301590 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 439/909] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jul 14 14:28:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-323476641 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:28:55.614290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c0aaaa79-5178-465f-8943-8358d79312ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:55.614968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c0aaaa79-5178-465f-8943-8358d79312ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:55.625301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0aaaa79-5178-465f-8943-8358d79312ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:55.626257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0aaaa79-5178-465f-8943-8358d79312ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:55.627709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0aaaa79-5178-465f-8943-8358d79312ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:55.628333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0aaaa79-5178-465f-8943-8358d79312ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:56.184899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c0aaaa79-5178-465f-8943-8358d79312ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:56.193105 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c0aaaa79-5178-465f-8943-8358d79312ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1317 microversion: 2.1 time: 0.582693 Jul 14 14:28:56.194176 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 440/910] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:55 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:28:56.201983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-36ac75c7-f445-432e-bf83-106b845aed35 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:56.203621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-36ac75c7-f445-432e-bf83-106b845aed35 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:56.214806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36ac75c7-f445-432e-bf83-106b845aed35 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:56.215603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36ac75c7-f445-432e-bf83-106b845aed35 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:56.216997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36ac75c7-f445-432e-bf83-106b845aed35 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:56.217858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36ac75c7-f445-432e-bf83-106b845aed35 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:56.359436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-36ac75c7-f445-432e-bf83-106b845aed35 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:56.379268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-36ac75c7-f445-432e-bf83-106b845aed35 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:56.381321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-36ac75c7-f445-432e-bf83-106b845aed35 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:56.389575 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-36ac75c7-f445-432e-bf83-106b845aed35 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.194097 Jul 14 14:28:56.390814 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 441/911] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:56 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:56.395941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c58c0213-ef16-4e1d-afa4-583338cb61cc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:56.396938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c58c0213-ef16-4e1d-afa4-583338cb61cc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:56.410113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c58c0213-ef16-4e1d-afa4-583338cb61cc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:56.410559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c58c0213-ef16-4e1d-afa4-583338cb61cc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:56.411590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c58c0213-ef16-4e1d-afa4-583338cb61cc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:56.412270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c58c0213-ef16-4e1d-afa4-583338cb61cc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:56.677672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c58c0213-ef16-4e1d-afa4-583338cb61cc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:56.689195 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c58c0213-ef16-4e1d-afa4-583338cb61cc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1543 microversion: 2.1 time: 0.296880 Jul 14 14:28:56.693363 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 442/912] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:56 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1543 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:56.704682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-9e072c00-616d-4b79-a968-df58424e193c req-cbfc43fe-6ac7-45b9-b7a2-8e5e6a80170c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428925c9-c52e-4728-ac68-5e6c7a9932c7", "tag": "02b187bb-73fb-44ac-bdb2-7163acbe4d18"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:56.724329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9e072c00-616d-4b79-a968-df58424e193c req-cbfc43fe-6ac7-45b9-b7a2-8e5e6a80170c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:56.725283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9e072c00-616d-4b79-a968-df58424e193c req-cbfc43fe-6ac7-45b9-b7a2-8e5e6a80170c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:56.741075 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ff59bb6f-5f67-4160-92cb-6db8cad1c11b tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/1b5af56b-b8f0-459e-aea7-a4e4a7a0d23b" status: 202 len: 0 microversion: 2.1 time: 1.700518 Jul 14 14:28:56.746509 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 471/913] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:28:55 2022] DELETE /compute/v2.1/os-floating-ips/1b5af56b-b8f0-459e-aea7-a4e4a7a0d23b => generated 0 bytes in 1702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:28:56.748505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ff67740-2602-44e9-8db5-4621a589bd72 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:56.749212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ff67740-2602-44e9-8db5-4621a589bd72 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:56.749339 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-9e072c00-616d-4b79-a968-df58424e193c req-cbfc43fe-6ac7-45b9-b7a2-8e5e6a80170c service nova] Creating event network-changed:02b187bb-73fb-44ac-bdb2-7163acbe4d18 for instance 428925c9-c52e-4728-ac68-5e6c7a9932c7 on n-h2-767704-28 Jul 14 14:28:56.754972 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-9e072c00-616d-4b79-a968-df58424e193c req-cbfc43fe-6ac7-45b9-b7a2-8e5e6a80170c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059359 Jul 14 14:28:56.755790 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 443/914] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:56.764662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac1cde80-d722-49cb-b5e0-d8ce640cc835 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac1cde80-d722-49cb-b5e0-d8ce640cc835 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Request method failure captured: Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action HTTP/1.1 Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 34 Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cf8B8Y1Od0QfNZ2hmYqY3jQJKhoBjVlyNY_jv2XMAo74Pz-74dZmVajCNd_MF7QERQLzLmpILILb9wUJKjsFttsaMfKYFvXebXdFXTZh-USYkoiXfXE1HFrBPbznkbG_oPLKMYzBrYAo81YgGAL9qMsL9XfjdCiqHdbbTu3obkpMvA Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 8005f93725b7435db246f74917f659cf Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:28:56.770250 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8005f93725b7435db246f74917f659cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8005f93725b7435db246f74917f659cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8005f93725b7435db246f74917f659cf", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8005f93725b7435db246f74917f659cf"}]}] Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 8005f93725b7435db246f74917f659cf Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: a39d4bccdf9c403381a49a6c857d4869 Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: {"addFloatingIp": {"address": ""}} Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:28:56.771716 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '428925c9-c52e-4728-ac68-5e6c7a9932c7', 'body': {'addFloatingIp': {'address': ''}}} Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi '' Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:56.772527 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:28:56.774001 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:28:56.777788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 14 14:28:56.777788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:56.780133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac1cde80-d722-49cb-b5e0-d8ce640cc835 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:56.781520 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ac1cde80-d722-49cb-b5e0-d8ce640cc835 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action" status: 400 len: 142 microversion: 2.1 time: 0.024221 Jul 14 14:28:56.782382 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 444/915] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:28:56 2022] POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action => generated 142 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:28:56.784817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ff67740-2602-44e9-8db5-4621a589bd72 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:56.791646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ff67740-2602-44e9-8db5-4621a589bd72 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:56.794484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ff67740-2602-44e9-8db5-4621a589bd72 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:56.795279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ff67740-2602-44e9-8db5-4621a589bd72 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:56.798399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-74b7812a-6f74-49ee-8a27-396f456901d9 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:56.799788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-74b7812a-6f74-49ee-8a27-396f456901d9 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:56.810593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74b7812a-6f74-49ee-8a27-396f456901d9 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:56.811865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74b7812a-6f74-49ee-8a27-396f456901d9 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:56.814439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74b7812a-6f74-49ee-8a27-396f456901d9 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:56.815251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74b7812a-6f74-49ee-8a27-396f456901d9 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:56.871791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74b7812a-6f74-49ee-8a27-396f456901d9 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Acquired lock "refresh_cache-428925c9-c52e-4728-ac68-5e6c7a9932c7" {{(pid=119511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:28:57.031468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74b7812a-6f74-49ee-8a27-396f456901d9 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Releasing lock "refresh_cache-428925c9-c52e-4728-ac68-5e6c7a9932c7" {{(pid=119511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:28:57.032638 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-74b7812a-6f74-49ee-8a27-396f456901d9 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] HTTP exception thrown: floating IP not found Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-74b7812a-6f74-49ee-8a27-396f456901d9 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Request method failure captured: Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action HTTP/1.1 Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 41 Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cf8B8Y1Od0QfNZ2hmYqY3jQJKhoBjVlyNY_jv2XMAo74Pz-74dZmVajCNd_MF7QERQLzLmpILILb9wUJKjsFttsaMfKYFvXebXdFXTZh-USYkoiXfXE1HFrBPbznkbG_oPLKMYzBrYAo81YgGAL9qMsL9XfjdCiqHdbbTu3obkpMvA Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 8005f93725b7435db246f74917f659cf Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:28:57.036614 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8005f93725b7435db246f74917f659cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8005f93725b7435db246f74917f659cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8005f93725b7435db246f74917f659cf", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8005f93725b7435db246f74917f659cf"}]}] Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 8005f93725b7435db246f74917f659cf Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: a39d4bccdf9c403381a49a6c857d4869 Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:28:57.038309 n-d-767704-28 devstack@n-api.service[119511]: exception: floating IP not found Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '428925c9-c52e-4728-ac68-5e6c7a9932c7', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:57.039793 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 14 14:28:57.041614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:57.044669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-74b7812a-6f74-49ee-8a27-396f456901d9 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Returning 404 to user: floating IP not found {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:57.044669 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-74b7812a-6f74-49ee-8a27-396f456901d9 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action" status: 404 len: 67 microversion: 2.1 time: 0.253633 Jul 14 14:28:57.047036 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 445/916] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:28:56 2022] POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action => generated 67 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:28:57.061498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5eeee159-458d-4e12-957c-377cd3cbcaed tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Action: 'action', calling method: .version_select at 0x7fd6c88b4d30>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:57.132848 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-5eeee159-458d-4e12-957c-377cd3cbcaed tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 14 14:28:57.143644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ff67740-2602-44e9-8db5-4621a589bd72 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5eeee159-458d-4e12-957c-377cd3cbcaed tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Request method failure captured: Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action HTTP/1.1 Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 44 Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cf8B8Y1Od0QfNZ2hmYqY3jQJKhoBjVlyNY_jv2XMAo74Pz-74dZmVajCNd_MF7QERQLzLmpILILb9wUJKjsFttsaMfKYFvXebXdFXTZh-USYkoiXfXE1HFrBPbznkbG_oPLKMYzBrYAo81YgGAL9qMsL9XfjdCiqHdbbTu3obkpMvA Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 8005f93725b7435db246f74917f659cf Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:28:57.145279 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8005f93725b7435db246f74917f659cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8005f93725b7435db246f74917f659cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8005f93725b7435db246f74917f659cf", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8005f93725b7435db246f74917f659cf"}]}] Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 8005f93725b7435db246f74917f659cf Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: a39d4bccdf9c403381a49a6c857d4869 Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:28:57.147260 n-d-767704-28 devstack@n-api.service[119511]: exception: Floating IP not found for address 0.0.0.0. Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '428925c9-c52e-4728-ac68-5e6c7a9932c7', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:28:57.148179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 14 14:28:57.149872 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:28:57.151362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5eeee159-458d-4e12-957c-377cd3cbcaed tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:28:57.152473 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5eeee159-458d-4e12-957c-377cd3cbcaed tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action" status: 404 len: 88 microversion: 2.1 time: 0.098845 Jul 14 14:28:57.157950 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 446/917] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:28:57 2022] POST /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7/action => generated 88 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:28:57.167129 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ff67740-2602-44e9-8db5-4621a589bd72 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1361 microversion: 2.1 time: 0.422839 Jul 14 14:28:57.169431 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 472/918] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:56 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1361 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:57.172501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4293ff09-bf6c-4c65-b0ca-67b292620a3d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:57.173103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4293ff09-bf6c-4c65-b0ca-67b292620a3d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:57.182386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4293ff09-bf6c-4c65-b0ca-67b292620a3d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:57.183103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4293ff09-bf6c-4c65-b0ca-67b292620a3d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:57.184153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4293ff09-bf6c-4c65-b0ca-67b292620a3d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:57.184782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4293ff09-bf6c-4c65-b0ca-67b292620a3d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:57.217674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a6f3e17-9292-487e-bf79-16b894934fa4 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:57.218331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3a6f3e17-9292-487e-bf79-16b894934fa4 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:57.232101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a6f3e17-9292-487e-bf79-16b894934fa4 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:57.233191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a6f3e17-9292-487e-bf79-16b894934fa4 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:57.234297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a6f3e17-9292-487e-bf79-16b894934fa4 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:57.235335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a6f3e17-9292-487e-bf79-16b894934fa4 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:57.240141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4293ff09-bf6c-4c65-b0ca-67b292620a3d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:28:57.343981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:57.387781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:57.407848 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4293ff09-bf6c-4c65-b0ca-67b292620a3d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "DELETE /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 204 len: 0 microversion: 2.1 time: 0.240778 Jul 14 14:28:57.419619 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 447/919] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:28:57 2022] DELETE /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:28:57.425884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8189a698-2816-4f2e-8d06-ec2af47b9c65 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:57.427788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8189a698-2816-4f2e-8d06-ec2af47b9c65 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:57.440633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8189a698-2816-4f2e-8d06-ec2af47b9c65 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:57.441446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8189a698-2816-4f2e-8d06-ec2af47b9c65 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:57.442442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8189a698-2816-4f2e-8d06-ec2af47b9c65 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:57.442828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8189a698-2816-4f2e-8d06-ec2af47b9c65 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:57.451118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3a6f3e17-9292-487e-bf79-16b894934fa4 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:57.462675 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3a6f3e17-9292-487e-bf79-16b894934fa4 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1467 microversion: 2.1 time: 0.248804 Jul 14 14:28:57.464280 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 473/920] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:57 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1467 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:28:57.470965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-007cae07-385b-499a-95b1-6061aab1af2e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:57.472387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-007cae07-385b-499a-95b1-6061aab1af2e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:57.484617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-007cae07-385b-499a-95b1-6061aab1af2e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:57.485470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-007cae07-385b-499a-95b1-6061aab1af2e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:57.486667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-007cae07-385b-499a-95b1-6061aab1af2e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:57.487347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-007cae07-385b-499a-95b1-6061aab1af2e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:57.532612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8189a698-2816-4f2e-8d06-ec2af47b9c65 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:57.543838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8189a698-2816-4f2e-8d06-ec2af47b9c65 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:57.545662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8189a698-2816-4f2e-8d06-ec2af47b9c65 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:57.551602 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8189a698-2816-4f2e-8d06-ec2af47b9c65 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.130617 Jul 14 14:28:57.552388 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 448/921] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:57 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:57.565318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f9b2b035-45ab-46d4-beba-a90677353759 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1919360809", "metadata": {"image_type": "test"}}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:57.567203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f9b2b035-45ab-46d4-beba-a90677353759 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:57.575245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9b2b035-45ab-46d4-beba-a90677353759 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:57.575748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9b2b035-45ab-46d4-beba-a90677353759 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:57.576729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9b2b035-45ab-46d4-beba-a90677353759 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:57.577442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9b2b035-45ab-46d4-beba-a90677353759 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:57.624174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f9b2b035-45ab-46d4-beba-a90677353759 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Getting quotas for project 52d830f4fd184c54a15647e148c3590e. Resources: dict_keys(['metadata_items']) {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:28:57.630843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f9b2b035-45ab-46d4-beba-a90677353759 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Getting quotas for user 4bfee07cac2b472a9f8ba7d0e4a67580 and project 52d830f4fd184c54a15647e148c3590e. Resources: dict_keys(['metadata_items']) {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:28:57.723156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-007cae07-385b-499a-95b1-6061aab1af2e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39d4bccdf9c403381a49a6c857d4869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8005f93725b7435db246f74917f659cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:57.733006 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-007cae07-385b-499a-95b1-6061aab1af2e tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 200 len: 1542 microversion: 2.1 time: 0.266726 Jul 14 14:28:57.734453 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 474/922] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:57 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 1542 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:57.748284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b684969e-8172-4123-9a79-9832417e49c2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:57.749152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b684969e-8172-4123-9a79-9832417e49c2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:57.762213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b684969e-8172-4123-9a79-9832417e49c2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:57.763120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b684969e-8172-4123-9a79-9832417e49c2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:57.764195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b684969e-8172-4123-9a79-9832417e49c2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:57.765177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b684969e-8172-4123-9a79-9832417e49c2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:58.006878 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f9b2b035-45ab-46d4-beba-a90677353759 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "POST /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f/action" status: 202 len: 0 microversion: 2.1 time: 0.452485 Jul 14 14:28:58.007950 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 449/923] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:28:57 2022] POST /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:28:58.024829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d1891684-f3f3-4f79-abb3-ee692bd4fdc7 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5e72700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:58.095921 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d1891684-f3f3-4f79-abb3-ee692bd4fdc7 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.077867 Jul 14 14:28:58.097219 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 450/924] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:28:58 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:58.194740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ffbd8f6-a342-4a0f-a6de-c1a5e8980a57 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:58.195565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ffbd8f6-a342-4a0f-a6de-c1a5e8980a57 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:58.210712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ffbd8f6-a342-4a0f-a6de-c1a5e8980a57 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:58.211065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ffbd8f6-a342-4a0f-a6de-c1a5e8980a57 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:58.212120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ffbd8f6-a342-4a0f-a6de-c1a5e8980a57 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:58.212412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ffbd8f6-a342-4a0f-a6de-c1a5e8980a57 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:58.706562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b684969e-8172-4123-9a79-9832417e49c2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:58.727744 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b684969e-8172-4123-9a79-9832417e49c2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1543 microversion: 2.1 time: 0.991047 Jul 14 14:28:58.729014 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 475/925] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:57 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1543 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:58.736219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-101f6c38-9630-4f7e-83b7-c153ce078f6a req-fd65da6b-71b7-4085-a59d-c9fefeca0298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10e43da-f4f0-41c8-99db-efd48a91831a", "tag": "bed3679e-8d64-4a5b-8ef3-bdcc56c88383"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:28:58.754359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-101f6c38-9630-4f7e-83b7-c153ce078f6a req-fd65da6b-71b7-4085-a59d-c9fefeca0298 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:58.756404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-101f6c38-9630-4f7e-83b7-c153ce078f6a req-fd65da6b-71b7-4085-a59d-c9fefeca0298 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:58.785356 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-101f6c38-9630-4f7e-83b7-c153ce078f6a req-fd65da6b-71b7-4085-a59d-c9fefeca0298 service nova] Creating event network-changed:bed3679e-8d64-4a5b-8ef3-bdcc56c88383 for instance e10e43da-f4f0-41c8-99db-efd48a91831a on n-h1-767704-28 Jul 14 14:28:58.794768 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-101f6c38-9630-4f7e-83b7-c153ce078f6a req-fd65da6b-71b7-4085-a59d-c9fefeca0298 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063034 Jul 14 14:28:58.796264 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 476/926] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:58.808359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-780d2ab6-344b-473f-a006-478eccc78974 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:58.810564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-780d2ab6-344b-473f-a006-478eccc78974 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:58.824785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-780d2ab6-344b-473f-a006-478eccc78974 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:58.826151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-780d2ab6-344b-473f-a006-478eccc78974 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:58.827475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ffbd8f6-a342-4a0f-a6de-c1a5e8980a57 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:58.828900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-780d2ab6-344b-473f-a006-478eccc78974 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:58.828900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-780d2ab6-344b-473f-a006-478eccc78974 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:58.885067 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ffbd8f6-a342-4a0f-a6de-c1a5e8980a57 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1361 microversion: 2.1 time: 0.700339 Jul 14 14:28:58.890031 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 451/927] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:58 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1361 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:28:58.922195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1e690712-4aad-4191-8ae5-0cdcdf26a984 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:58.924224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1e690712-4aad-4191-8ae5-0cdcdf26a984 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:58.938394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e690712-4aad-4191-8ae5-0cdcdf26a984 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:58.939635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e690712-4aad-4191-8ae5-0cdcdf26a984 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:58.941389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e690712-4aad-4191-8ae5-0cdcdf26a984 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:58.942427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e690712-4aad-4191-8ae5-0cdcdf26a984 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:59.090464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-780d2ab6-344b-473f-a006-478eccc78974 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:59.101932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-780d2ab6-344b-473f-a006-478eccc78974 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:59.106484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-780d2ab6-344b-473f-a006-478eccc78974 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:59.113624 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-780d2ab6-344b-473f-a006-478eccc78974 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.314999 Jul 14 14:28:59.114547 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 477/928] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:28:58 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:59.120899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f706e9ba-acc5-4430-9cf5-bded14eb9811 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5e70430>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:59.179020 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f706e9ba-acc5-4430-9cf5-bded14eb9811 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.061798 Jul 14 14:28:59.179935 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 478/929] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:28:59 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:59.549207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1e690712-4aad-4191-8ae5-0cdcdf26a984 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39d4bccdf9c403381a49a6c857d4869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8005f93725b7435db246f74917f659cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:28:59.568558 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1e690712-4aad-4191-8ae5-0cdcdf26a984 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 200 len: 1542 microversion: 2.1 time: 0.673841 Jul 14 14:28:59.569684 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 452/930] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:58 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 1542 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:59.748206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b257624-ff68-444d-a650-6234a9ce9183 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:59.749533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5b257624-ff68-444d-a650-6234a9ce9183 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:59.757334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b257624-ff68-444d-a650-6234a9ce9183 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:59.759327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b257624-ff68-444d-a650-6234a9ce9183 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:59.760415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b257624-ff68-444d-a650-6234a9ce9183 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:59.761126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b257624-ff68-444d-a650-6234a9ce9183 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:59.919722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c7d87570-869e-44f7-9dbd-ead05a37c51d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:59.920930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c7d87570-869e-44f7-9dbd-ead05a37c51d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:28:59.934953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7d87570-869e-44f7-9dbd-ead05a37c51d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:59.935408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7d87570-869e-44f7-9dbd-ead05a37c51d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:59.936218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7d87570-869e-44f7-9dbd-ead05a37c51d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:59.936663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7d87570-869e-44f7-9dbd-ead05a37c51d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:00.368566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5b257624-ff68-444d-a650-6234a9ce9183 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:00.380603 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b257624-ff68-444d-a650-6234a9ce9183 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1543 microversion: 2.1 time: 0.638961 Jul 14 14:29:00.381704 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 479/931] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:59 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1543 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:00.390422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7d31aea7-6c9d-4293-a5b2-c571ac17c9e3 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:00.391424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7d31aea7-6c9d-4293-a5b2-c571ac17c9e3 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:00.398527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:00.401899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d31aea7-6c9d-4293-a5b2-c571ac17c9e3 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:00.403477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d31aea7-6c9d-4293-a5b2-c571ac17c9e3 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:00.406078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d31aea7-6c9d-4293-a5b2-c571ac17c9e3 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:00.406856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d31aea7-6c9d-4293-a5b2-c571ac17c9e3 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:00.443260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c7d87570-869e-44f7-9dbd-ead05a37c51d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:00.453279 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c7d87570-869e-44f7-9dbd-ead05a37c51d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1361 microversion: 2.1 time: 0.539176 Jul 14 14:29:00.454490 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 453/932] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:28:59 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1361 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:00.462829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d2a7680f-443d-44ce-b916-f349df530de2 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5d48ee0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:00.514961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7d31aea7-6c9d-4293-a5b2-c571ac17c9e3 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:00.537562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7d31aea7-6c9d-4293-a5b2-c571ac17c9e3 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:00.546706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7d31aea7-6c9d-4293-a5b2-c571ac17c9e3 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:00.554715 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7d31aea7-6c9d-4293-a5b2-c571ac17c9e3 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.171202 Jul 14 14:29:00.565229 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d2a7680f-443d-44ce-b916-f349df530de2 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.108165 Jul 14 14:29:00.566805 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 454/933] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:00 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:00.571073 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 480/934] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:00 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:00.589782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-504c0d4b-8fd9-47d4-b510-d8a3cede349d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:00.590751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-504c0d4b-8fd9-47d4-b510-d8a3cede349d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:00.601097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-504c0d4b-8fd9-47d4-b510-d8a3cede349d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:00.602978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-504c0d4b-8fd9-47d4-b510-d8a3cede349d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:00.605091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-504c0d4b-8fd9-47d4-b510-d8a3cede349d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:00.607121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-504c0d4b-8fd9-47d4-b510-d8a3cede349d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:00.803428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-504c0d4b-8fd9-47d4-b510-d8a3cede349d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39d4bccdf9c403381a49a6c857d4869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8005f93725b7435db246f74917f659cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:00.823425 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-504c0d4b-8fd9-47d4-b510-d8a3cede349d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 200 len: 1500 microversion: 2.1 time: 0.238781 Jul 14 14:29:00.824307 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 455/935] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:00 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 1500 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:00.873213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9ade78f8-cf86-483a-bbef-7ae478a2e346 req-33de1b1e-0923-4aa4-a3fa-4032bfc9c366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428925c9-c52e-4728-ac68-5e6c7a9932c7", "name": "network-vif-deleted", "tag": "02b187bb-73fb-44ac-bdb2-7163acbe4d18"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:00.895651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9ade78f8-cf86-483a-bbef-7ae478a2e346 req-33de1b1e-0923-4aa4-a3fa-4032bfc9c366 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:00.896105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9ade78f8-cf86-483a-bbef-7ae478a2e346 req-33de1b1e-0923-4aa4-a3fa-4032bfc9c366 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:00.922041 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9ade78f8-cf86-483a-bbef-7ae478a2e346 req-33de1b1e-0923-4aa4-a3fa-4032bfc9c366 service nova] Creating event network-vif-deleted:02b187bb-73fb-44ac-bdb2-7163acbe4d18 for instance 428925c9-c52e-4728-ac68-5e6c7a9932c7 on n-h2-767704-28 Jul 14 14:29:00.935263 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9ade78f8-cf86-483a-bbef-7ae478a2e346 req-33de1b1e-0923-4aa4-a3fa-4032bfc9c366 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070295 Jul 14 14:29:00.937341 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 481/936] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:29:01.407597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a614d898-1e7d-4280-83bf-a0b981bf20f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:01.408219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a614d898-1e7d-4280-83bf-a0b981bf20f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:01.420214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a614d898-1e7d-4280-83bf-a0b981bf20f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:01.421607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a614d898-1e7d-4280-83bf-a0b981bf20f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:01.425717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a614d898-1e7d-4280-83bf-a0b981bf20f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:01.426406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a614d898-1e7d-4280-83bf-a0b981bf20f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:01.472852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-95f1157f-ac50-4d16-bf83-8590d8b2143c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:01.473591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-95f1157f-ac50-4d16-bf83-8590d8b2143c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:01.490168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95f1157f-ac50-4d16-bf83-8590d8b2143c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:01.490883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95f1157f-ac50-4d16-bf83-8590d8b2143c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:01.491829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95f1157f-ac50-4d16-bf83-8590d8b2143c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:01.492528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95f1157f-ac50-4d16-bf83-8590d8b2143c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:01.568500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:01.751430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-95f1157f-ac50-4d16-bf83-8590d8b2143c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:01.761281 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-95f1157f-ac50-4d16-bf83-8590d8b2143c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1361 microversion: 2.1 time: 0.293428 Jul 14 14:29:01.769209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a614d898-1e7d-4280-83bf-a0b981bf20f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:01.771569 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 482/937] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:01 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1361 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:01.777269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0811e6d8-f12e-4902-a980-4c3e5b7bfba9 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5eb8ee0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:01.789918 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a614d898-1e7d-4280-83bf-a0b981bf20f2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1543 microversion: 2.1 time: 0.386494 Jul 14 14:29:01.803925 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 456/938] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:01 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1543 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:01.811392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b8b9b27-57d8-443c-9804-e532dbffbe0d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:01.812505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8b8b9b27-57d8-443c-9804-e532dbffbe0d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:01.822360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b8b9b27-57d8-443c-9804-e532dbffbe0d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:01.823119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b8b9b27-57d8-443c-9804-e532dbffbe0d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:01.824100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b8b9b27-57d8-443c-9804-e532dbffbe0d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:01.824699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b8b9b27-57d8-443c-9804-e532dbffbe0d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:01.851606 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0811e6d8-f12e-4902-a980-4c3e5b7bfba9 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.076577 Jul 14 14:29:01.863623 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 483/939] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:01 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:01.940982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8b8b9b27-57d8-443c-9804-e532dbffbe0d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:01.957436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8b8b9b27-57d8-443c-9804-e532dbffbe0d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:01.970396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8b8b9b27-57d8-443c-9804-e532dbffbe0d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:01.980755 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8b8b9b27-57d8-443c-9804-e532dbffbe0d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.177696 Jul 14 14:29:01.982009 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 457/940] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:01 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:01.989832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1cf9fcef-37cf-4e4f-ab6b-7d875bcf311d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:01.991938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1cf9fcef-37cf-4e4f-ab6b-7d875bcf311d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] [instance: 428925c9-c52e-4728-ac68-5e6c7a9932c7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:02.002071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1cf9fcef-37cf-4e4f-ab6b-7d875bcf311d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:02.003080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1cf9fcef-37cf-4e4f-ab6b-7d875bcf311d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:02.004518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1cf9fcef-37cf-4e4f-ab6b-7d875bcf311d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:02.005168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1cf9fcef-37cf-4e4f-ab6b-7d875bcf311d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:02.033999 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-1cf9fcef-37cf-4e4f-ab6b-7d875bcf311d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] HTTP exception thrown: Instance 428925c9-c52e-4728-ac68-5e6c7a9932c7 could not be found. Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1cf9fcef-37cf-4e4f-ab6b-7d875bcf311d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Request method failure captured: Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 HTTP/1.1 Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cf8B8Y1Od0QfNZ2hmYqY3jQJKhoBjVlyNY_jv2XMAo74Pz-74dZmVajCNd_MF7QERQLzLmpILILb9wUJKjsFttsaMfKYFvXebXdFXTZh-USYkoiXfXE1HFrBPbznkbG_oPLKMYzBrYAo81YgGAL9qMsL9XfjdCiqHdbbTu3obkpMvA Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 8005f93725b7435db246f74917f659cf Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:29:02.035953 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:29:02.037565 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8005f93725b7435db246f74917f659cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8005f93725b7435db246f74917f659cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8005f93725b7435db246f74917f659cf", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8005f93725b7435db246f74917f659cf"}]}] Jul 14 14:29:02.037565 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:29:02.037565 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 8005f93725b7435db246f74917f659cf Jul 14 14:29:02.037565 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 Jul 14 14:29:02.037565 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project Jul 14 14:29:02.037565 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:29:02.037565 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:29:02.037565 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: a39d4bccdf9c403381a49a6c857d4869 Jul 14 14:29:02.037565 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project Jul 14 14:29:02.037565 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:29:02.037565 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 428925c9-c52e-4728-ac68-5e6c7a9932c7 could not be found. Jul 14 14:29:02.037565 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '428925c9-c52e-4728-ac68-5e6c7a9932c7'} Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 428925c9-c52e-4728-ac68-5e6c7a9932c7 could not be found. Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:02.038463 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 428925c9-c52e-4728-ac68-5e6c7a9932c7 could not be found. Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 428925c9-c52e-4728-ac68-5e6c7a9932c7 could not be found. Jul 14 14:29:02.040644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.043720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1cf9fcef-37cf-4e4f-ab6b-7d875bcf311d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] Returning 404 to user: Instance 428925c9-c52e-4728-ac68-5e6c7a9932c7 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:02.044770 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1cf9fcef-37cf-4e4f-ab6b-7d875bcf311d tempest-FloatingIPsAssociationNegativeTestJSON-1809704794 tempest-FloatingIPsAssociationNegativeTestJSON-1809704794-project] 10.222.0.81 "GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7" status: 404 len: 111 microversion: 2.1 time: 0.061299 Jul 14 14:29:02.045961 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 458/941] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:01 2022] GET /compute/v2.1/servers/428925c9-c52e-4728-ac68-5e6c7a9932c7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:29:02.118442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31c7b21f-9f5c-4a2b-8d89-e366843e8ab4 tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991 tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:02.126973 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:02.126973 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:29:02.134227 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-31c7b21f-9f5c-4a2b-8d89-e366843e8ab4 tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991 tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31c7b21f-9f5c-4a2b-8d89-e366843e8ab4 tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991 tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991-project-admin] Request method failure captured: Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CgtXw5G_4Y5OswqiQKfDHj6AXnCbDDoMdbZ--JH3zx9Jd4JVG8JaHHN3Y1W6kVAiziLQDIewO5jB26AzY7mbD1yyn3B-a24oQhqy4J3x4VBEVku30T1MEWoBfXb8RmDPYeVsa6y2jRE0bMxrKPFN6oRUIOSPxTbBncrNwscvX5-xEQ Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 15f369e680884c6ba1df70688779103e Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991 Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:29:02.160817 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:29:02.162771 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/15f369e680884c6ba1df70688779103e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/15f369e680884c6ba1df70688779103e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_15f369e680884c6ba1df70688779103e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/15f369e680884c6ba1df70688779103e"}]}] Jul 14 14:29:02.162771 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991 Jul 14 14:29:02.162771 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 15f369e680884c6ba1df70688779103e Jul 14 14:29:02.162771 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991 Jul 14 14:29:02.162771 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991-project-admin Jul 14 14:29:02.162771 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:29:02.162771 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:29:02.162771 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d344800e823945ffaa5cc9660e7afbc4 Jul 14 14:29:02.162771 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991-project-admin Jul 14 14:29:02.162771 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:29:02.162771 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid timestamp for date invalid_time Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'invalid_time'} Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:02.163661 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 14 14:29:02.165982 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.168280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31c7b21f-9f5c-4a2b-8d89-e366843e8ab4 tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991 tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:02.169522 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-31c7b21f-9f5c-4a2b-8d89-e366843e8ab4 tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991 tempest-InstanceUsageAuditLogNegativeTestJSON-1155476991-project-admin] 10.222.0.81 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.304218 Jul 14 14:29:02.181100 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 484/942] 10.222.0.81 () {58 vars in 1223 bytes} [Thu Jul 14 14:29:01 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 312 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:29:02.399810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3231a816-8ffd-4151-a195-ab8f6b5d1987 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:02.401175 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:02.401175 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:29:02.402777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3231a816-8ffd-4151-a195-ab8f6b5d1987 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '3581030a769e410b81f241d30c375f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e4cbe70a0a48d3bfb9cd7a76921d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3231a816-8ffd-4151-a195-ab8f6b5d1987 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project] Request method failure captured: Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CgsaOnAiuSVvNwsVKpcWeIuzR6vLgpA35k8P2b2O-wvWH-z9bhlsWInVHGum4Q_rXbW4nCfNN89ZM-LK-UCITlYguuJrplX8OVdKg-6q-WwZgLI_0BF72WzhWHcJyDFxCeVY9VNsbkEteusneRQyXkgLl-1DOdGV0uXcPuPUHGx4s4 Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a9e4cbe70a0a48d3bfb9cd7a76921d8c Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:29:02.405244 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:29:02.406858 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a9e4cbe70a0a48d3bfb9cd7a76921d8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a9e4cbe70a0a48d3bfb9cd7a76921d8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a9e4cbe70a0a48d3bfb9cd7a76921d8c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a9e4cbe70a0a48d3bfb9cd7a76921d8c"}]}] Jul 14 14:29:02.406858 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 Jul 14 14:29:02.406858 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a9e4cbe70a0a48d3bfb9cd7a76921d8c Jul 14 14:29:02.406858 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 Jul 14 14:29:02.406858 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project Jul 14 14:29:02.406858 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:29:02.406858 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:29:02.406858 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 3581030a769e410b81f241d30c375f1f Jul 14 14:29:02.406858 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project Jul 14 14:29:02.406858 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:29:02.406858 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: action_args: {} Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:29:02.407616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 14 14:29:02.408856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.412265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3231a816-8ffd-4151-a195-ab8f6b5d1987 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:02.413618 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3231a816-8ffd-4151-a195-ab8f6b5d1987 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project] 10.222.0.81 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.235980 Jul 14 14:29:02.415284 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 459/943] 10.222.0.81 () {58 vars in 1184 bytes} [Thu Jul 14 14:29:02 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 239 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:29:02.429034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-53c1ff52-bab2-4d5b-adf4-d114d4f8bfc9 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:02.434081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-53c1ff52-bab2-4d5b-adf4-d114d4f8bfc9 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '3581030a769e410b81f241d30c375f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e4cbe70a0a48d3bfb9cd7a76921d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-53c1ff52-bab2-4d5b-adf4-d114d4f8bfc9 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project] Request method failure captured: Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-14%2014:29:02 HTTP/1.1 Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CgsaOnAiuSVvNwsVKpcWeIuzR6vLgpA35k8P2b2O-wvWH-z9bhlsWInVHGum4Q_rXbW4nCfNN89ZM-LK-UCITlYguuJrplX8OVdKg-6q-WwZgLI_0BF72WzhWHcJyDFxCeVY9VNsbkEteusneRQyXkgLl-1DOdGV0uXcPuPUHGx4s4 Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a9e4cbe70a0a48d3bfb9cd7a76921d8c Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:29:02.436391 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:29:02.437914 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a9e4cbe70a0a48d3bfb9cd7a76921d8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a9e4cbe70a0a48d3bfb9cd7a76921d8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a9e4cbe70a0a48d3bfb9cd7a76921d8c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a9e4cbe70a0a48d3bfb9cd7a76921d8c"}]}] Jul 14 14:29:02.437914 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 Jul 14 14:29:02.437914 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a9e4cbe70a0a48d3bfb9cd7a76921d8c Jul 14 14:29:02.437914 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 Jul 14 14:29:02.437914 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project Jul 14 14:29:02.437914 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:29:02.437914 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:29:02.437914 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 3581030a769e410b81f241d30c375f1f Jul 14 14:29:02.437914 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project Jul 14 14:29:02.437914 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:29:02.437914 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '2022-07-14 14:29:02'} Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:29:02.438881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 14 14:29:02.440143 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:02.444705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-53c1ff52-bab2-4d5b-adf4-d114d4f8bfc9 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:02.446871 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-53c1ff52-bab2-4d5b-adf4-d114d4f8bfc9 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030 tempest-InstanceUsageAuditLogNegativeTestJSON-1253953030-project] 10.222.0.81 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-14 14:29:02" status: 403 len: 128 microversion: 2.1 time: 0.025681 Jul 14 14:29:02.448097 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 485/944] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 14:29:02 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-14%2014%3A29%3A02 => generated 128 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:29:02.797133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-665e7ebc-e205-47f1-96f8-4327e8fce15b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:02.801339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-665e7ebc-e205-47f1-96f8-4327e8fce15b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:02.819110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a8352f70-49fa-4950-98f2-1bf8b82db512 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:02.819806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a8352f70-49fa-4950-98f2-1bf8b82db512 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:02.822259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-665e7ebc-e205-47f1-96f8-4327e8fce15b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:02.826885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-665e7ebc-e205-47f1-96f8-4327e8fce15b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:02.829432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-665e7ebc-e205-47f1-96f8-4327e8fce15b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:02.832664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-665e7ebc-e205-47f1-96f8-4327e8fce15b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:02.858296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8352f70-49fa-4950-98f2-1bf8b82db512 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:02.858766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8352f70-49fa-4950-98f2-1bf8b82db512 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:02.859579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8352f70-49fa-4950-98f2-1bf8b82db512 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:02.866146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8352f70-49fa-4950-98f2-1bf8b82db512 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:02.933302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:03.672325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-665e7ebc-e205-47f1-96f8-4327e8fce15b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:03.685630 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-665e7ebc-e205-47f1-96f8-4327e8fce15b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1361 microversion: 2.1 time: 0.910188 Jul 14 14:29:03.686657 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 460/945] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:02 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1361 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:03.699409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2c2d0ebc-fae6-47e1-ae63-c1a9737c28df tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5d819d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:03.805925 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2c2d0ebc-fae6-47e1-ae63-c1a9737c28df tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.117196 Jul 14 14:29:03.817901 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 461/946] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:03 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:03.834233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fb851379-1701-4ba9-9443-7aa1888bea91 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:03.838244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fb851379-1701-4ba9-9443-7aa1888bea91 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:03.859148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb851379-1701-4ba9-9443-7aa1888bea91 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:03.863485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb851379-1701-4ba9-9443-7aa1888bea91 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:03.866415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb851379-1701-4ba9-9443-7aa1888bea91 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:03.869546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb851379-1701-4ba9-9443-7aa1888bea91 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:04.047676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=10 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:04.623553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a8352f70-49fa-4950-98f2-1bf8b82db512 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:04.667384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=22 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:04.679343 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a8352f70-49fa-4950-98f2-1bf8b82db512 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1543 microversion: 2.1 time: 1.864991 Jul 14 14:29:04.691956 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 486/947] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:02 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1543 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:04.725053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-025a82d7-bdf8-498d-a7a3-b05203607d18 req-9042f15e-b2de-4cf7-89ea-3c351e653197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a1b7fb-df82-435c-bf4d-261decd2db5f", "name": "network-vif-plugged", "status": "completed", "tag": "2f439b9e-ad79-44c1-9bf1-810c6d5786f9"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:04.727095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fb851379-1701-4ba9-9443-7aa1888bea91 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:04.738323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fb851379-1701-4ba9-9443-7aa1888bea91 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:04.747736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fb851379-1701-4ba9-9443-7aa1888bea91 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:04.759803 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fb851379-1701-4ba9-9443-7aa1888bea91 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.939254 Jul 14 14:29:04.767365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-025a82d7-bdf8-498d-a7a3-b05203607d18 req-9042f15e-b2de-4cf7-89ea-3c351e653197 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:04.770086 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 462/948] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:03 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:04.772094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-025a82d7-bdf8-498d-a7a3-b05203607d18 req-9042f15e-b2de-4cf7-89ea-3c351e653197 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:04.790141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9fd15868-0866-42d5-9850-e5f52db89d0a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:04.804057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9fd15868-0866-42d5-9850-e5f52db89d0a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:04.804340 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-025a82d7-bdf8-498d-a7a3-b05203607d18 req-9042f15e-b2de-4cf7-89ea-3c351e653197 service nova] Creating event network-vif-plugged:2f439b9e-ad79-44c1-9bf1-810c6d5786f9 for instance 90a1b7fb-df82-435c-bf4d-261decd2db5f on n-h2-767704-28 Jul 14 14:29:04.814583 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-025a82d7-bdf8-498d-a7a3-b05203607d18 req-9042f15e-b2de-4cf7-89ea-3c351e653197 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120542 Jul 14 14:29:04.815488 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 487/949] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:04.826077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-03632021-f32f-4d62-ab67-81ab640ee4a5 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5eb8310>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:04.843078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9fd15868-0866-42d5-9850-e5f52db89d0a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:04.843873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9fd15868-0866-42d5-9850-e5f52db89d0a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:04.852995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9fd15868-0866-42d5-9850-e5f52db89d0a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:04.853849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9fd15868-0866-42d5-9850-e5f52db89d0a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:05.034449 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-03632021-f32f-4d62-ab67-81ab640ee4a5 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.214141 Jul 14 14:29:05.042066 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 488/950] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:04 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:05.345078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9fd15868-0866-42d5-9850-e5f52db89d0a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:05.361404 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9fd15868-0866-42d5-9850-e5f52db89d0a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1361 microversion: 2.1 time: 0.585364 Jul 14 14:29:05.377780 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 463/951] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:04 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1361 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:05.699202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b135579-c23a-4c10-b11b-9f6d6fcd9da1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:05.707218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1b135579-c23a-4c10-b11b-9f6d6fcd9da1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:05.728503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b135579-c23a-4c10-b11b-9f6d6fcd9da1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:05.734356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b135579-c23a-4c10-b11b-9f6d6fcd9da1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:05.735797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b135579-c23a-4c10-b11b-9f6d6fcd9da1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:05.736453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b135579-c23a-4c10-b11b-9f6d6fcd9da1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:05.803842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-067ba6b1-5f62-4420-9b6c-6251cbbe988d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:05.804470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-067ba6b1-5f62-4420-9b6c-6251cbbe988d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:05.831929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-067ba6b1-5f62-4420-9b6c-6251cbbe988d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:05.832803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-067ba6b1-5f62-4420-9b6c-6251cbbe988d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:05.835856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-067ba6b1-5f62-4420-9b6c-6251cbbe988d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:05.838326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-067ba6b1-5f62-4420-9b6c-6251cbbe988d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:06.140299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-067ba6b1-5f62-4420-9b6c-6251cbbe988d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:06.158540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-067ba6b1-5f62-4420-9b6c-6251cbbe988d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:06.168815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-067ba6b1-5f62-4420-9b6c-6251cbbe988d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:06.188436 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-067ba6b1-5f62-4420-9b6c-6251cbbe988d tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.400996 Jul 14 14:29:06.198369 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 464/952] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:05 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:06.213648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2d6e1acd-8d3f-4ab4-bac6-220034f29e2b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5d81430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:06.319512 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2d6e1acd-8d3f-4ab4-bac6-220034f29e2b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.115672 Jul 14 14:29:06.322141 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 465/953] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:06 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:06.373807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1b135579-c23a-4c10-b11b-9f6d6fcd9da1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:06.384727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e7bff757-5828-4909-b77f-3ca900023461 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:06.385791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e7bff757-5828-4909-b77f-3ca900023461 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:06.393010 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1b135579-c23a-4c10-b11b-9f6d6fcd9da1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1543 microversion: 2.1 time: 0.697492 Jul 14 14:29:06.394699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7bff757-5828-4909-b77f-3ca900023461 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:06.395153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7bff757-5828-4909-b77f-3ca900023461 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:06.401437 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 489/954] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:05 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1543 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:06.402687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7bff757-5828-4909-b77f-3ca900023461 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:06.404188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7bff757-5828-4909-b77f-3ca900023461 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:06.849889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-977ffa92-ce90-4bdc-8c2f-4d987c5b27bf req-414bad4b-6357-406d-82f7-094326c0b7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10e43da-f4f0-41c8-99db-efd48a91831a", "name": "network-vif-plugged", "status": "completed", "tag": "bed3679e-8d64-4a5b-8ef3-bdcc56c88383"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:06.875042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-977ffa92-ce90-4bdc-8c2f-4d987c5b27bf req-414bad4b-6357-406d-82f7-094326c0b7e2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:06.877327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-977ffa92-ce90-4bdc-8c2f-4d987c5b27bf req-414bad4b-6357-406d-82f7-094326c0b7e2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:06.909459 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-977ffa92-ce90-4bdc-8c2f-4d987c5b27bf req-414bad4b-6357-406d-82f7-094326c0b7e2 service nova] Creating event network-vif-plugged:bed3679e-8d64-4a5b-8ef3-bdcc56c88383 for instance e10e43da-f4f0-41c8-99db-efd48a91831a on n-h1-767704-28 Jul 14 14:29:06.918050 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-977ffa92-ce90-4bdc-8c2f-4d987c5b27bf req-414bad4b-6357-406d-82f7-094326c0b7e2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074308 Jul 14 14:29:06.937392 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 490/955] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:07.062080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e7bff757-5828-4909-b77f-3ca900023461 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:07.074391 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e7bff757-5828-4909-b77f-3ca900023461 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1361 microversion: 2.1 time: 0.693390 Jul 14 14:29:07.079090 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 466/956] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:06 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1361 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:07.221591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7b14835b-54fe-47d0-a4da-a5789c7eb24e tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:07.222568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7b14835b-54fe-47d0-a4da-a5789c7eb24e tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:07.236890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b14835b-54fe-47d0-a4da-a5789c7eb24e tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:07.237623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b14835b-54fe-47d0-a4da-a5789c7eb24e tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:07.238562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b14835b-54fe-47d0-a4da-a5789c7eb24e tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:07.239159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b14835b-54fe-47d0-a4da-a5789c7eb24e tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:07.334527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5d9b8a55-8c71-4033-9058-f06c26dfe1c3 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b989d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:07.423959 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5d9b8a55-8c71-4033-9058-f06c26dfe1c3 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.093267 Jul 14 14:29:07.424816 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 467/957] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:07 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:07.433976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6ce2fcfc-90d3-4aa2-a15e-038be64ecbb1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:07.441646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6ce2fcfc-90d3-4aa2-a15e-038be64ecbb1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:07.452664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ce2fcfc-90d3-4aa2-a15e-038be64ecbb1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:07.455320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ce2fcfc-90d3-4aa2-a15e-038be64ecbb1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:07.456434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ce2fcfc-90d3-4aa2-a15e-038be64ecbb1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:07.459226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ce2fcfc-90d3-4aa2-a15e-038be64ecbb1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:07.662294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7b14835b-54fe-47d0-a4da-a5789c7eb24e tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:07.693007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7b14835b-54fe-47d0-a4da-a5789c7eb24e tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:07.699258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7b14835b-54fe-47d0-a4da-a5789c7eb24e tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:07.730153 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7b14835b-54fe-47d0-a4da-a5789c7eb24e tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.509567 Jul 14 14:29:07.731655 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 491/958] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:07 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:08.102460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6b1b0823-0626-415d-9609-d5ce43b02b62 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:08.105468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6b1b0823-0626-415d-9609-d5ce43b02b62 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:08.158794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b1b0823-0626-415d-9609-d5ce43b02b62 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:08.159463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b1b0823-0626-415d-9609-d5ce43b02b62 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:08.160741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b1b0823-0626-415d-9609-d5ce43b02b62 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:08.172934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b1b0823-0626-415d-9609-d5ce43b02b62 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:08.282227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6ce2fcfc-90d3-4aa2-a15e-038be64ecbb1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:08.305351 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6ce2fcfc-90d3-4aa2-a15e-038be64ecbb1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1543 microversion: 2.1 time: 0.878741 Jul 14 14:29:08.306312 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 468/959] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:07 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1543 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:08.438709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8854090b-ddbf-4861-ac94-999dd23ae9d4 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b3c160>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:08.501188 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8854090b-ddbf-4861-ac94-999dd23ae9d4 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.067403 Jul 14 14:29:08.501793 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 469/960] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:08 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:08.626921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6b1b0823-0626-415d-9609-d5ce43b02b62 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:08.647612 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6b1b0823-0626-415d-9609-d5ce43b02b62 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1361 microversion: 2.1 time: 0.552656 Jul 14 14:29:08.650724 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 492/961] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:08 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1361 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:08.761039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c14c7525-c141-4a65-a4b5-21d11db47211 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:08.762618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c14c7525-c141-4a65-a4b5-21d11db47211 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:08.782493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c14c7525-c141-4a65-a4b5-21d11db47211 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:08.783903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c14c7525-c141-4a65-a4b5-21d11db47211 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:08.784829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c14c7525-c141-4a65-a4b5-21d11db47211 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:08.788702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c14c7525-c141-4a65-a4b5-21d11db47211 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:08.822974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:08.945184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c14c7525-c141-4a65-a4b5-21d11db47211 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:08.980305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c14c7525-c141-4a65-a4b5-21d11db47211 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:08.983468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c14c7525-c141-4a65-a4b5-21d11db47211 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:09.004646 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c14c7525-c141-4a65-a4b5-21d11db47211 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.254377 Jul 14 14:29:09.014433 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 470/962] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:08 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:09.325577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e0a341e-ce81-4b4c-b511-0c2a1fa758a6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:09.326518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8e0a341e-ce81-4b4c-b511-0c2a1fa758a6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:09.341418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e0a341e-ce81-4b4c-b511-0c2a1fa758a6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:09.343848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e0a341e-ce81-4b4c-b511-0c2a1fa758a6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:09.347311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e0a341e-ce81-4b4c-b511-0c2a1fa758a6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:09.348097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e0a341e-ce81-4b4c-b511-0c2a1fa758a6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:09.516167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e90aba1c-ee03-497c-a4d1-66502c6cee11 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b3c700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:09.607360 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e90aba1c-ee03-497c-a4d1-66502c6cee11 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.095936 Jul 14 14:29:09.608869 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 471/963] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:09 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:09.671653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4f6dde82-79ea-45cd-9bcb-a86c30bd7a45 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:09.672592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4f6dde82-79ea-45cd-9bcb-a86c30bd7a45 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:09.686453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f6dde82-79ea-45cd-9bcb-a86c30bd7a45 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:09.687312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f6dde82-79ea-45cd-9bcb-a86c30bd7a45 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:09.689787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f6dde82-79ea-45cd-9bcb-a86c30bd7a45 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:09.691596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f6dde82-79ea-45cd-9bcb-a86c30bd7a45 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:10.167488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8e0a341e-ce81-4b4c-b511-0c2a1fa758a6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:10.181235 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8e0a341e-ce81-4b4c-b511-0c2a1fa758a6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1543 microversion: 2.1 time: 0.860262 Jul 14 14:29:10.181928 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 493/964] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:09 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1543 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:10.193896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-33ebef1c-8db5-4254-af54-7e62536a60d7 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:10.195098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-33ebef1c-8db5-4254-af54-7e62536a60d7 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:10.203242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33ebef1c-8db5-4254-af54-7e62536a60d7 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:10.204086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33ebef1c-8db5-4254-af54-7e62536a60d7 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:10.206263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33ebef1c-8db5-4254-af54-7e62536a60d7 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:10.207041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33ebef1c-8db5-4254-af54-7e62536a60d7 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:10.394133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4f6dde82-79ea-45cd-9bcb-a86c30bd7a45 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:10.427275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-33ebef1c-8db5-4254-af54-7e62536a60d7 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:10.452020 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4f6dde82-79ea-45cd-9bcb-a86c30bd7a45 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1543 microversion: 2.1 time: 0.786409 Jul 14 14:29:10.452991 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 472/965] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:09 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1543 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:10.454376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-33ebef1c-8db5-4254-af54-7e62536a60d7 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:10.456820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-33ebef1c-8db5-4254-af54-7e62536a60d7 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:10.463665 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-33ebef1c-8db5-4254-af54-7e62536a60d7 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.276723 Jul 14 14:29:10.481654 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 494/966] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:10 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:10.482310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-242d1e54-aef1-4435-98f2-cad3bc5ae2df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:10.482824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-242d1e54-aef1-4435-98f2-cad3bc5ae2df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:10.490443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-242d1e54-aef1-4435-98f2-cad3bc5ae2df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:10.490876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-242d1e54-aef1-4435-98f2-cad3bc5ae2df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:10.491739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-242d1e54-aef1-4435-98f2-cad3bc5ae2df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:10.492271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-242d1e54-aef1-4435-98f2-cad3bc5ae2df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:10.622623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e62510cc-8468-4603-8584-2a438df65ed0 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5d71940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:10.656846 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-242d1e54-aef1-4435-98f2-cad3bc5ae2df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181209 Jul 14 14:29:10.658768 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 473/967] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:29:10 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:10.738034 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e62510cc-8468-4603-8584-2a438df65ed0 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.119276 Jul 14 14:29:10.738989 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 495/968] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:10 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:11.200397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4b36e46-706c-43a0-bdef-bb5bfa874fb8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:11.201074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d4b36e46-706c-43a0-bdef-bb5bfa874fb8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:11.212031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4b36e46-706c-43a0-bdef-bb5bfa874fb8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:11.212494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4b36e46-706c-43a0-bdef-bb5bfa874fb8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:11.213306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4b36e46-706c-43a0-bdef-bb5bfa874fb8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:11.213748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4b36e46-706c-43a0-bdef-bb5bfa874fb8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:11.484079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c28b3f12-e426-46c2-b999-87dbb586db55 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:11.485379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c28b3f12-e426-46c2-b999-87dbb586db55 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:11.495970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c28b3f12-e426-46c2-b999-87dbb586db55 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:11.502018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c28b3f12-e426-46c2-b999-87dbb586db55 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:11.505185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c28b3f12-e426-46c2-b999-87dbb586db55 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:11.511475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c28b3f12-e426-46c2-b999-87dbb586db55 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:12.128018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c28b3f12-e426-46c2-b999-87dbb586db55 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:12.150178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c28b3f12-e426-46c2-b999-87dbb586db55 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:12.152032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c28b3f12-e426-46c2-b999-87dbb586db55 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:12.171687 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c28b3f12-e426-46c2-b999-87dbb586db55 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.691448 Jul 14 14:29:12.191590 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 496/969] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:11 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:29:12.209014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-355fc197-27b0-4db6-8ece-0fabd570dcba tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5f1ab80>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:12.271873 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-355fc197-27b0-4db6-8ece-0fabd570dcba tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.078098 Jul 14 14:29:12.280557 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 497/970] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:12 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:12.326978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d4b36e46-706c-43a0-bdef-bb5bfa874fb8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:12.349741 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d4b36e46-706c-43a0-bdef-bb5bfa874fb8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1543 microversion: 2.1 time: 1.154774 Jul 14 14:29:12.352464 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 474/971] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:11 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1543 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:12.967139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-85f65255-fbbd-4c16-81e8-dfd12d9af280 req-9bb4ca93-e25f-498f-9b79-506182cc43af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10e43da-f4f0-41c8-99db-efd48a91831a", "tag": "bed3679e-8d64-4a5b-8ef3-bdcc56c88383"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:12.999262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-318327100", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:13.005767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-85f65255-fbbd-4c16-81e8-dfd12d9af280 req-9bb4ca93-e25f-498f-9b79-506182cc43af service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:13.006236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-85f65255-fbbd-4c16-81e8-dfd12d9af280 req-9bb4ca93-e25f-498f-9b79-506182cc43af service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:13.058724 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-85f65255-fbbd-4c16-81e8-dfd12d9af280 req-9bb4ca93-e25f-498f-9b79-506182cc43af service nova] Creating event network-changed:bed3679e-8d64-4a5b-8ef3-bdcc56c88383 for instance e10e43da-f4f0-41c8-99db-efd48a91831a on n-h1-767704-28 Jul 14 14:29:13.077442 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-85f65255-fbbd-4c16-81e8-dfd12d9af280 req-9bb4ca93-e25f-498f-9b79-506182cc43af service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110678 Jul 14 14:29:13.085433 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 475/972] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:13.107765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:29:13.213869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b50fc0e6-6357-4641-98e4-17c4fb6c3d75 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:13.214598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b50fc0e6-6357-4641-98e4-17c4fb6c3d75 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:13.241965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b50fc0e6-6357-4641-98e4-17c4fb6c3d75 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:13.242499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b50fc0e6-6357-4641-98e4-17c4fb6c3d75 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:13.244059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b50fc0e6-6357-4641-98e4-17c4fb6c3d75 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:13.244515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b50fc0e6-6357-4641-98e4-17c4fb6c3d75 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:13.576504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b50fc0e6-6357-4641-98e4-17c4fb6c3d75 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:13.585955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b50fc0e6-6357-4641-98e4-17c4fb6c3d75 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:13.588209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b50fc0e6-6357-4641-98e4-17c4fb6c3d75 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:13.603819 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b50fc0e6-6357-4641-98e4-17c4fb6c3d75 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.398682 Jul 14 14:29:13.604824 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 476/973] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:13 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:13.619873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-552dd76a-1015-4de7-a0cc-9547078965f2 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b49d30>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:13.725006 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-552dd76a-1015-4de7-a0cc-9547078965f2 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.114888 Jul 14 14:29:13.726745 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 477/974] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:13 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:13.743585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-50879232-9b95-4c0f-874f-75c629b4bf58 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:13.744820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-50879232-9b95-4c0f-874f-75c629b4bf58 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:13.761012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50879232-9b95-4c0f-874f-75c629b4bf58 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:13.761926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50879232-9b95-4c0f-874f-75c629b4bf58 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:13.769347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50879232-9b95-4c0f-874f-75c629b4bf58 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:13.770710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50879232-9b95-4c0f-874f-75c629b4bf58 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:14.397391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:29:14.398154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:29:14.398950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:29:14.399493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:29:14.400313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:29:14.418522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:14.420441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:14.421874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:14.427269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:14.496847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Getting quotas for project 8baaf403ad6a44919ea2e5bec2df5f2b. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:29:14.510758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Getting quotas for user 9ec43300027a4fd2b63886f9d04f5c99 and project 8baaf403ad6a44919ea2e5bec2df5f2b. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:29:14.579586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:29:14.582969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:29:14.730918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-50879232-9b95-4c0f-874f-75c629b4bf58 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:14.739997 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-50879232-9b95-4c0f-874f-75c629b4bf58 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1543 microversion: 2.1 time: 1.005067 Jul 14 14:29:14.745477 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 478/975] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:13 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1543 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:14.751903 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a4e9fc8a-87fb-4ba1-8b5d-7851a61ef051 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.059188 Jul 14 14:29:14.754005 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 498/976] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:29:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:29:14.763280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-87569c74-70a4-42d7-a2ca-2bb726ceb81b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5f1a040>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:14.775409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d3042653-1ead-49e2-bf81-76137cec9af8 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:14.778538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d3042653-1ead-49e2-bf81-76137cec9af8 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:14.806768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d3042653-1ead-49e2-bf81-76137cec9af8 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:14.808042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d3042653-1ead-49e2-bf81-76137cec9af8 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:14.809061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d3042653-1ead-49e2-bf81-76137cec9af8 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:14.809658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d3042653-1ead-49e2-bf81-76137cec9af8 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:14.825567 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-87569c74-70a4-42d7-a2ca-2bb726ceb81b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.069674 Jul 14 14:29:14.827082 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 499/977] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:14 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:14.834957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-474ab100-b89f-497f-aa28-9155c4d5bc8b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:14.835811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-474ab100-b89f-497f-aa28-9155c4d5bc8b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:15.066190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-474ab100-b89f-497f-aa28-9155c4d5bc8b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:15.073940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d3042653-1ead-49e2-bf81-76137cec9af8 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:15.074969 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-474ab100-b89f-497f-aa28-9155c4d5bc8b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1218 microversion: 2.1 time: 0.246487 Jul 14 14:29:15.079447 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 500/978] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:14 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1218 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:15.109921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d3042653-1ead-49e2-bf81-76137cec9af8 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:15.113299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d3042653-1ead-49e2-bf81-76137cec9af8 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:15.137304 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d3042653-1ead-49e2-bf81-76137cec9af8 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.386854 Jul 14 14:29:15.141275 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 479/979] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:14 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:15.771150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0448da24-37f6-4a60-a7e3-ad0431d17ae5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:15.771905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0448da24-37f6-4a60-a7e3-ad0431d17ae5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:15.790245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0448da24-37f6-4a60-a7e3-ad0431d17ae5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:15.797798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0448da24-37f6-4a60-a7e3-ad0431d17ae5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:15.798789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0448da24-37f6-4a60-a7e3-ad0431d17ae5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:15.799321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0448da24-37f6-4a60-a7e3-ad0431d17ae5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:15.845567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-10756b92-635a-4fb6-8dfe-8ee570e13d67 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5bc20d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:16.009097 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-10756b92-635a-4fb6-8dfe-8ee570e13d67 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.169212 Jul 14 14:29:16.009871 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 480/980] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:15 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:16.093148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-56a339ce-af5a-4521-8b35-7215ceeb6f38 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:16.094035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-56a339ce-af5a-4521-8b35-7215ceeb6f38 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:16.119430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56a339ce-af5a-4521-8b35-7215ceeb6f38 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:16.124499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56a339ce-af5a-4521-8b35-7215ceeb6f38 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:16.129817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56a339ce-af5a-4521-8b35-7215ceeb6f38 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:16.129817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56a339ce-af5a-4521-8b35-7215ceeb6f38 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:16.304245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0448da24-37f6-4a60-a7e3-ad0431d17ae5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:16.318548 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0448da24-37f6-4a60-a7e3-ad0431d17ae5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1542 microversion: 2.1 time: 0.552908 Jul 14 14:29:16.321111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-56a339ce-af5a-4521-8b35-7215ceeb6f38 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:16.331593 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 501/981] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:15 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1542 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:16.338318 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-56a339ce-af5a-4521-8b35-7215ceeb6f38 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1222 microversion: 2.1 time: 0.249647 Jul 14 14:29:16.338909 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 481/982] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:16 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1222 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:16.339040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b75623d8-defa-4a6f-8ccd-3e4a11b6b06a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:16.339549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b75623d8-defa-4a6f-8ccd-3e4a11b6b06a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:16.359605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b75623d8-defa-4a6f-8ccd-3e4a11b6b06a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:16.360076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b75623d8-defa-4a6f-8ccd-3e4a11b6b06a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:16.360887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b75623d8-defa-4a6f-8ccd-3e4a11b6b06a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:16.361414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b75623d8-defa-4a6f-8ccd-3e4a11b6b06a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:16.611725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b75623d8-defa-4a6f-8ccd-3e4a11b6b06a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:16.628560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b75623d8-defa-4a6f-8ccd-3e4a11b6b06a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:16.644192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b75623d8-defa-4a6f-8ccd-3e4a11b6b06a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:16.657336 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b75623d8-defa-4a6f-8ccd-3e4a11b6b06a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1446 microversion: 2.75 time: 0.324515 Jul 14 14:29:16.666437 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 502/983] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:16 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1446 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:17.034793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ee29efba-137a-4a66-9d84-2237ed214f07 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b4aa60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:17.156047 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ee29efba-137a-4a66-9d84-2237ed214f07 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.131505 Jul 14 14:29:17.159889 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 482/984] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:17 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:17.345335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-85de7f7c-a04b-4c09-833c-8a3600fadec2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:17.349761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-85de7f7c-a04b-4c09-833c-8a3600fadec2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:17.361594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ec7370b-9312-4210-a276-5ea7d7e73cb9 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:17.367359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8ec7370b-9312-4210-a276-5ea7d7e73cb9 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:17.409418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-85de7f7c-a04b-4c09-833c-8a3600fadec2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:17.412103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ec7370b-9312-4210-a276-5ea7d7e73cb9 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:17.413210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-85de7f7c-a04b-4c09-833c-8a3600fadec2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:17.417318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-85de7f7c-a04b-4c09-833c-8a3600fadec2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:17.420130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-85de7f7c-a04b-4c09-833c-8a3600fadec2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:17.420461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ec7370b-9312-4210-a276-5ea7d7e73cb9 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:17.424109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ec7370b-9312-4210-a276-5ea7d7e73cb9 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:17.429410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ec7370b-9312-4210-a276-5ea7d7e73cb9 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:17.832591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8ec7370b-9312-4210-a276-5ea7d7e73cb9 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:17.842029 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8ec7370b-9312-4210-a276-5ea7d7e73cb9 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1278 microversion: 2.1 time: 0.488778 Jul 14 14:29:17.847921 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 483/985] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:17 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1278 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:17.861019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15dc6a7c-0a49-4470-936c-cee9f10e04cf tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:17.862071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-15dc6a7c-0a49-4470-936c-cee9f10e04cf tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:17.890730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15dc6a7c-0a49-4470-936c-cee9f10e04cf tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:17.891767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15dc6a7c-0a49-4470-936c-cee9f10e04cf tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:17.892849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15dc6a7c-0a49-4470-936c-cee9f10e04cf tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:17.893560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15dc6a7c-0a49-4470-936c-cee9f10e04cf tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:18.100150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-15dc6a7c-0a49-4470-936c-cee9f10e04cf tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:18.115013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-15dc6a7c-0a49-4470-936c-cee9f10e04cf tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:18.122360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-15dc6a7c-0a49-4470-936c-cee9f10e04cf tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:18.136293 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-15dc6a7c-0a49-4470-936c-cee9f10e04cf tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1452 microversion: 2.75 time: 0.286662 Jul 14 14:29:18.139255 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 484/986] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:17 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1452 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:18.179627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-915cbdfa-3ef3-4d46-8b61-3e52cf507e3f tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b90c10>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:18.245325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-85de7f7c-a04b-4c09-833c-8a3600fadec2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:18.265961 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-85de7f7c-a04b-4c09-833c-8a3600fadec2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1474 microversion: 2.1 time: 0.925544 Jul 14 14:29:18.267334 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 503/987] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:17 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1474 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:18.327172 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-915cbdfa-3ef3-4d46-8b61-3e52cf507e3f tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.149917 Jul 14 14:29:18.329870 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 485/988] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:18 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:18.864676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-02f254b0-4b32-47dc-a641-a301f06d811f tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:18.866152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-02f254b0-4b32-47dc-a641-a301f06d811f tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:18.879684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02f254b0-4b32-47dc-a641-a301f06d811f tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:18.882262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02f254b0-4b32-47dc-a641-a301f06d811f tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:18.885975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02f254b0-4b32-47dc-a641-a301f06d811f tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:18.887529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02f254b0-4b32-47dc-a641-a301f06d811f tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:19.097218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1ee13346-3697-44ef-bd63-9459eea63368 req-8e1c1203-726e-426d-b148-0474db988c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486f72c1-03cd-4401-862c-1e02ca398e46", "name": "network-vif-unplugged", "status": "completed", "tag": "a5283818-bbd0-45aa-b71a-689a812a086b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:19.121289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1ee13346-3697-44ef-bd63-9459eea63368 req-8e1c1203-726e-426d-b148-0474db988c07 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:19.128156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1ee13346-3697-44ef-bd63-9459eea63368 req-8e1c1203-726e-426d-b148-0474db988c07 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:19.158474 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1ee13346-3697-44ef-bd63-9459eea63368 req-8e1c1203-726e-426d-b148-0474db988c07 service nova] Creating event network-vif-unplugged:a5283818-bbd0-45aa-b71a-689a812a086b for instance 486f72c1-03cd-4401-862c-1e02ca398e46 on n-h1-767704-28 Jul 14 14:29:19.176437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-1ee13346-3697-44ef-bd63-9459eea63368 req-8e1c1203-726e-426d-b148-0474db988c07 service nova] Instance 486f72c1-03cd-4401-862c-1e02ca398e46 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:29:19.195089 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1ee13346-3697-44ef-bd63-9459eea63368 req-8e1c1203-726e-426d-b148-0474db988c07 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104602 Jul 14 14:29:19.198714 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 486/989] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:19.216154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f294e4f9-324e-4df9-a890-5cf8c3bd50a4 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:19.217089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f294e4f9-324e-4df9-a890-5cf8c3bd50a4 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:19.222054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-02f254b0-4b32-47dc-a641-a301f06d811f tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:19.233520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f294e4f9-324e-4df9-a890-5cf8c3bd50a4 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:19.234000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f294e4f9-324e-4df9-a890-5cf8c3bd50a4 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:19.237636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f294e4f9-324e-4df9-a890-5cf8c3bd50a4 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:19.238100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f294e4f9-324e-4df9-a890-5cf8c3bd50a4 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:19.239307 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-02f254b0-4b32-47dc-a641-a301f06d811f tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1276 microversion: 2.1 time: 0.379449 Jul 14 14:29:19.240697 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 504/990] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:18 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1276 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:19.295878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-23039580-63c3-4457-8ae9-de3b5928ea4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:19.297162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-23039580-63c3-4457-8ae9-de3b5928ea4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:19.308818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23039580-63c3-4457-8ae9-de3b5928ea4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:19.310949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23039580-63c3-4457-8ae9-de3b5928ea4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:19.311992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23039580-63c3-4457-8ae9-de3b5928ea4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:19.314823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23039580-63c3-4457-8ae9-de3b5928ea4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:19.476187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f294e4f9-324e-4df9-a890-5cf8c3bd50a4 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:19.485886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f294e4f9-324e-4df9-a890-5cf8c3bd50a4 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:19.488746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f294e4f9-324e-4df9-a890-5cf8c3bd50a4 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:19.499140 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f294e4f9-324e-4df9-a890-5cf8c3bd50a4 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1452 microversion: 2.75 time: 0.297091 Jul 14 14:29:19.499475 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 487/991] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:19 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1452 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:19.516007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2e2b2521-0058-4b7f-95a8-a9ccb901855e tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5e34a60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:19.592395 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2e2b2521-0058-4b7f-95a8-a9ccb901855e tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.091421 Jul 14 14:29:19.593344 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 488/992] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:19 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:19.766744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-23039580-63c3-4457-8ae9-de3b5928ea4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:19.783252 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-23039580-63c3-4457-8ae9-de3b5928ea4c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1471 microversion: 2.1 time: 0.494480 Jul 14 14:29:19.785393 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 505/993] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:19 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1471 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:19.802108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:19.802654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:19.816123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:19.816740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:19.829301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:19.834441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:19.942741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:19.944046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:19.946603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:19.947524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:20.063951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Getting quotas for project c3e95b24eb1b4f9fbc5eb6f4d6f3d308. Resources: {'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:29:20.075447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Getting quotas for user 89894c4d380a4632870ebcb10a2ffe81 and project c3e95b24eb1b4f9fbc5eb6f4d6f3d308. Resources: {'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:29:20.122710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:20.259041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e7be6a0c-7b28-41a4-9d24-a7c9540f7fbd tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:20.260116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e7be6a0c-7b28-41a4-9d24-a7c9540f7fbd tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:20.271037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7be6a0c-7b28-41a4-9d24-a7c9540f7fbd tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:20.271496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7be6a0c-7b28-41a4-9d24-a7c9540f7fbd tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:20.275921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7be6a0c-7b28-41a4-9d24-a7c9540f7fbd tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:20.276387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7be6a0c-7b28-41a4-9d24-a7c9540f7fbd tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:20.294601 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-adde7046-81bb-4f11-b344-8ea029e70737 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "POST /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46/action" status: 202 len: 0 microversion: 2.1 time: 0.496942 Jul 14 14:29:20.297389 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 489/994] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:29:19 2022] POST /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:29:20.317514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8a162bc0-211d-4bdb-8cbb-06e2f6d042dc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:20.318523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8a162bc0-211d-4bdb-8cbb-06e2f6d042dc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:20.336762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a162bc0-211d-4bdb-8cbb-06e2f6d042dc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:20.348686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a162bc0-211d-4bdb-8cbb-06e2f6d042dc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:20.349878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a162bc0-211d-4bdb-8cbb-06e2f6d042dc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:20.350482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a162bc0-211d-4bdb-8cbb-06e2f6d042dc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:20.922861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e7be6a0c-7b28-41a4-9d24-a7c9540f7fbd tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:20.932260 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e7be6a0c-7b28-41a4-9d24-a7c9540f7fbd tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1276 microversion: 2.1 time: 0.678038 Jul 14 14:29:20.937797 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 506/995] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:20 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1276 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:20.942966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8a282ef0-0d36-4737-a6b3-a95099a3e69f tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:20.947741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8a282ef0-0d36-4737-a6b3-a95099a3e69f tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:20.968641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a282ef0-0d36-4737-a6b3-a95099a3e69f tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:20.969547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a282ef0-0d36-4737-a6b3-a95099a3e69f tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:20.970549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a282ef0-0d36-4737-a6b3-a95099a3e69f tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:20.971150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a282ef0-0d36-4737-a6b3-a95099a3e69f tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:21.259809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8a282ef0-0d36-4737-a6b3-a95099a3e69f tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:21.280238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8a282ef0-0d36-4737-a6b3-a95099a3e69f tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:21.282076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8a282ef0-0d36-4737-a6b3-a95099a3e69f tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:21.295698 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8a282ef0-0d36-4737-a6b3-a95099a3e69f tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1437 microversion: 2.75 time: 0.356491 Jul 14 14:29:21.296583 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 507/996] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:20 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1437 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:21.301420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2bc03182-e48c-4e53-b8f5-b3bf79a9082b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5eb6ee0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:21.388119 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2bc03182-e48c-4e53-b8f5-b3bf79a9082b tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.090174 Jul 14 14:29:21.388900 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 508/997] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:21 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:21.671800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8a162bc0-211d-4bdb-8cbb-06e2f6d042dc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:21.681548 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8a162bc0-211d-4bdb-8cbb-06e2f6d042dc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1470 microversion: 2.1 time: 1.377442 Jul 14 14:29:21.682143 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 490/998] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:20 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1470 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:21.833870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:21.835842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:21.847682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:21.848705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:21.849767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:21.850516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:21.954435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf281e52-3d1e-43b1-b8a4-556777916a4d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:21.955050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bf281e52-3d1e-43b1-b8a4-556777916a4d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:21.980736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf281e52-3d1e-43b1-b8a4-556777916a4d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:21.981253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf281e52-3d1e-43b1-b8a4-556777916a4d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:21.981722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:29:21.982035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf281e52-3d1e-43b1-b8a4-556777916a4d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:21.982473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf281e52-3d1e-43b1-b8a4-556777916a4d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:21.982656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:29:21.983285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:29:21.993786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:29:21.994513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:29:22.010294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:22.058877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:22.133921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:22.145708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:22.147151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:22.150622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:22.151140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:22.156402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bf281e52-3d1e-43b1-b8a4-556777916a4d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:22.171959 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf281e52-3d1e-43b1-b8a4-556777916a4d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1276 microversion: 2.1 time: 0.220606 Jul 14 14:29:22.174003 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 491/999] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:21 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1276 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:22.402375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fc706469-dfb8-4413-a3a7-c97347dc0cb2 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b4a430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:22.446835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:22.511170 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-47da80f9-77eb-4eab-8654-8dba14f83889 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30/action" status: 202 len: 1942 microversion: 2.75 time: 1.117566 Jul 14 14:29:22.523995 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 509/1000] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 14:29:21 2022] POST /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30/action => generated 1942 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 14 14:29:22.538799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e62757b-4826-4aa0-a9c0-7aa30baf1e87 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:22.540304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8e62757b-4826-4aa0-a9c0-7aa30baf1e87 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:22.569081 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fc706469-dfb8-4413-a3a7-c97347dc0cb2 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.170647 Jul 14 14:29:22.573951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e62757b-4826-4aa0-a9c0-7aa30baf1e87 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:22.574360 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 492/1001] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:22 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:22.575178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e62757b-4826-4aa0-a9c0-7aa30baf1e87 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:22.583393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e62757b-4826-4aa0-a9c0-7aa30baf1e87 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:22.584095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e62757b-4826-4aa0-a9c0-7aa30baf1e87 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:22.699541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1edc8d4a-38fe-4ecb-81a7-78afebf855bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:22.701775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1edc8d4a-38fe-4ecb-81a7-78afebf855bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:22.722803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1edc8d4a-38fe-4ecb-81a7-78afebf855bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:22.723371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1edc8d4a-38fe-4ecb-81a7-78afebf855bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:22.724182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1edc8d4a-38fe-4ecb-81a7-78afebf855bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:22.724567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1edc8d4a-38fe-4ecb-81a7-78afebf855bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:22.829142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-8e62757b-4826-4aa0-a9c0-7aa30baf1e87 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:22.871417 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8e62757b-4826-4aa0-a9c0-7aa30baf1e87 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.338318 Jul 14 14:29:22.877478 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 510/1002] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:22 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:29:23.191342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-afe6bdb6-219c-4f01-96b0-8e214bb6713b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:23.192513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-afe6bdb6-219c-4f01-96b0-8e214bb6713b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:23.207488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afe6bdb6-219c-4f01-96b0-8e214bb6713b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:23.210439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afe6bdb6-219c-4f01-96b0-8e214bb6713b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:23.212996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afe6bdb6-219c-4f01-96b0-8e214bb6713b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:23.214574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afe6bdb6-219c-4f01-96b0-8e214bb6713b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:23.733197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1edc8d4a-38fe-4ecb-81a7-78afebf855bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:23.748833 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1edc8d4a-38fe-4ecb-81a7-78afebf855bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1470 microversion: 2.1 time: 1.053036 Jul 14 14:29:23.753308 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 493/1003] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:22 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1470 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:23.769084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d1526d88-00d4-4368-990d-430b9a037241 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b79700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:23.850291 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d1526d88-00d4-4368-990d-430b9a037241 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.095462 Jul 14 14:29:23.850987 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 494/1004] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:23 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:23.893174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b9713f3-0863-430c-bd9d-4d963d91853a tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:23.894451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8b9713f3-0863-430c-bd9d-4d963d91853a tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:23.957955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b9713f3-0863-430c-bd9d-4d963d91853a tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:23.958795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b9713f3-0863-430c-bd9d-4d963d91853a tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:23.959619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b9713f3-0863-430c-bd9d-4d963d91853a tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:23.960049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b9713f3-0863-430c-bd9d-4d963d91853a tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:24.187880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-afe6bdb6-219c-4f01-96b0-8e214bb6713b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:24.199268 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-afe6bdb6-219c-4f01-96b0-8e214bb6713b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1318 microversion: 2.1 time: 1.011845 Jul 14 14:29:24.215206 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 511/1005] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:23 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1318 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:24.298870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-8b9713f3-0863-430c-bd9d-4d963d91853a tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:24.343808 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8b9713f3-0863-430c-bd9d-4d963d91853a tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.453772 Jul 14 14:29:24.348410 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 495/1006] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:23 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:24.744531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c247d61d-0288-45d0-9400-11bda3dfdc31 req-75c6e6f4-a39e-4a91-a325-25c73772fbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35fe2440-1aaf-4806-aa06-c1433e0b86c1", "tag": "ff8a672d-3bc1-448c-ac12-3d26f3c436d9"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:24.767440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-36651898-3093-459f-a2a5-66734fb688d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:24.768886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-36651898-3093-459f-a2a5-66734fb688d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:24.782208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36651898-3093-459f-a2a5-66734fb688d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:24.784141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:24.784604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36651898-3093-459f-a2a5-66734fb688d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:24.787364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36651898-3093-459f-a2a5-66734fb688d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:24.790169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36651898-3093-459f-a2a5-66734fb688d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:24.790461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c247d61d-0288-45d0-9400-11bda3dfdc31 req-75c6e6f4-a39e-4a91-a325-25c73772fbc0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:24.800193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c247d61d-0288-45d0-9400-11bda3dfdc31 req-75c6e6f4-a39e-4a91-a325-25c73772fbc0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:24.868378 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c247d61d-0288-45d0-9400-11bda3dfdc31 req-75c6e6f4-a39e-4a91-a325-25c73772fbc0 service nova] Creating event network-changed:ff8a672d-3bc1-448c-ac12-3d26f3c436d9 for instance 35fe2440-1aaf-4806-aa06-c1433e0b86c1 on n-h2-767704-28 Jul 14 14:29:24.893801 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c247d61d-0288-45d0-9400-11bda3dfdc31 req-75c6e6f4-a39e-4a91-a325-25c73772fbc0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155306 Jul 14 14:29:24.896565 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 512/1007] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:24.917639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-89798655-71f8-4b6a-a2f8-906534579725 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c6034820>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:25.062366 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-89798655-71f8-4b6a-a2f8-906534579725 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1422 microversion: 2.1 time: 0.160797 Jul 14 14:29:25.063998 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 513/1008] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:24 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1422 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:25.215105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:25.220557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a27f7415-f8e8-4b8b-9185-3d609e7068dc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:25.221637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a27f7415-f8e8-4b8b-9185-3d609e7068dc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:25.242517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a27f7415-f8e8-4b8b-9185-3d609e7068dc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:25.243456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a27f7415-f8e8-4b8b-9185-3d609e7068dc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:25.244525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a27f7415-f8e8-4b8b-9185-3d609e7068dc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:25.245250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a27f7415-f8e8-4b8b-9185-3d609e7068dc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:25.407398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-36651898-3093-459f-a2a5-66734fb688d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:25.422060 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-36651898-3093-459f-a2a5-66734fb688d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1470 microversion: 2.1 time: 0.659156 Jul 14 14:29:25.432155 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 496/1009] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:24 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1470 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:25.437425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aed563e2-8507-4222-8030-8ccf7fc670d8 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:25.443665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aed563e2-8507-4222-8030-8ccf7fc670d8 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:25.456180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aed563e2-8507-4222-8030-8ccf7fc670d8 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:25.459807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aed563e2-8507-4222-8030-8ccf7fc670d8 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:25.460969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aed563e2-8507-4222-8030-8ccf7fc670d8 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:25.463758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aed563e2-8507-4222-8030-8ccf7fc670d8 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:25.649391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-aed563e2-8507-4222-8030-8ccf7fc670d8 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:25.683843 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aed563e2-8507-4222-8030-8ccf7fc670d8 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.250012 Jul 14 14:29:25.690248 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 497/1010] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:25 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:25.777863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a27f7415-f8e8-4b8b-9185-3d609e7068dc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:25.786675 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a27f7415-f8e8-4b8b-9185-3d609e7068dc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1318 microversion: 2.1 time: 0.572309 Jul 14 14:29:25.797639 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 514/1011] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:25 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:26.077487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2d8293e7-ccd8-47fb-bd1e-f785f3c03ac0 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b79ca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:26.212611 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2d8293e7-ccd8-47fb-bd1e-f785f3c03ac0 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1431 microversion: 2.1 time: 0.139475 Jul 14 14:29:26.213997 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 498/1012] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:26 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1431 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:26.230311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-848da04f-4b31-4832-8f79-5103b25c5451 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5eb6550>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:26.329340 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-848da04f-4b31-4832-8f79-5103b25c5451 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 200 len: 1431 microversion: 2.1 time: 0.100347 Jul 14 14:29:26.330264 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 515/1013] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:26 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 1431 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:26.344234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8087aab6-209c-4d30-b8d3-d0d9d6c48893 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:26.344779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8087aab6-209c-4d30-b8d3-d0d9d6c48893 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:26.359118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8087aab6-209c-4d30-b8d3-d0d9d6c48893 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:26.359849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8087aab6-209c-4d30-b8d3-d0d9d6c48893 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:26.362176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8087aab6-209c-4d30-b8d3-d0d9d6c48893 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:26.362650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8087aab6-209c-4d30-b8d3-d0d9d6c48893 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:26.444228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-377d9fa0-58ee-49a3-8e53-5f3aa969dc51 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:26.446891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-377d9fa0-58ee-49a3-8e53-5f3aa969dc51 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:26.462588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-377d9fa0-58ee-49a3-8e53-5f3aa969dc51 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:26.463320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-377d9fa0-58ee-49a3-8e53-5f3aa969dc51 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:26.466917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-377d9fa0-58ee-49a3-8e53-5f3aa969dc51 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:26.468506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-377d9fa0-58ee-49a3-8e53-5f3aa969dc51 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:26.884319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8087aab6-209c-4d30-b8d3-d0d9d6c48893 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:26.913756 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8087aab6-209c-4d30-b8d3-d0d9d6c48893 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1480 microversion: 2.1 time: 0.574410 Jul 14 14:29:26.932624 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 499/1014] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:26 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1480 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:26.970185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d940f344-9432-4d6f-8292-d7004732d178 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:26.971297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d940f344-9432-4d6f-8292-d7004732d178 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:26.994839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d940f344-9432-4d6f-8292-d7004732d178 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:26.995600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d940f344-9432-4d6f-8292-d7004732d178 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:26.996807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d940f344-9432-4d6f-8292-d7004732d178 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:26.997438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d940f344-9432-4d6f-8292-d7004732d178 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:27.181142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-377d9fa0-58ee-49a3-8e53-5f3aa969dc51 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:27.195851 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-377d9fa0-58ee-49a3-8e53-5f3aa969dc51 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1536 microversion: 2.1 time: 0.755260 Jul 14 14:29:27.196541 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 516/1015] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:26 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1536 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:27.205372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f603e359-9825-48ce-be27-196b7c6f1d30 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:27.213431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f603e359-9825-48ce-be27-196b7c6f1d30 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:27.233777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f603e359-9825-48ce-be27-196b7c6f1d30 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:27.235088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f603e359-9825-48ce-be27-196b7c6f1d30 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:27.238124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f603e359-9825-48ce-be27-196b7c6f1d30 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:27.243624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f603e359-9825-48ce-be27-196b7c6f1d30 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:27.326784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-d940f344-9432-4d6f-8292-d7004732d178 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:27.395048 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d940f344-9432-4d6f-8292-d7004732d178 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.457785 Jul 14 14:29:27.396983 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 500/1016] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:26 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:27.415956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8c745d72-c8df-4db7-893b-b2ace8a20abf tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:27.416978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8c745d72-c8df-4db7-893b-b2ace8a20abf tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:27.432287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c745d72-c8df-4db7-893b-b2ace8a20abf tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:27.435254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c745d72-c8df-4db7-893b-b2ace8a20abf tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:27.441214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c745d72-c8df-4db7-893b-b2ace8a20abf tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:27.445862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c745d72-c8df-4db7-893b-b2ace8a20abf tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:27.843620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-8c745d72-c8df-4db7-893b-b2ace8a20abf tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid 07717385-1942-4235-9479-e46016827db8 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:27.882123 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8c745d72-c8df-4db7-893b-b2ace8a20abf tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 2348 microversion: 2.25 time: 0.483778 Jul 14 14:29:27.886064 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 501/1017] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:27 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 2348 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:27.903272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80b97515-a2d8-404a-9f25-b8033a4c6f41 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:27.905257 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:27.905257 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:29:27.907206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80b97515-a2d8-404a-9f25-b8033a4c6f41 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:27.907967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80b97515-a2d8-404a-9f25-b8033a4c6f41 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:27.908997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80b97515-a2d8-404a-9f25-b8033a4c6f41 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:27.911901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80b97515-a2d8-404a-9f25-b8033a4c6f41 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:27.920056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f603e359-9825-48ce-be27-196b7c6f1d30 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:27.936222 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f603e359-9825-48ce-be27-196b7c6f1d30 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1318 microversion: 2.1 time: 0.738221 Jul 14 14:29:27.937728 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 517/1018] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:27 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:27.952825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1051fcdc-45d7-4044-b0f4-cbc149a72392 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:27.953742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1051fcdc-45d7-4044-b0f4-cbc149a72392 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:27.962511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1051fcdc-45d7-4044-b0f4-cbc149a72392 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:27.963216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1051fcdc-45d7-4044-b0f4-cbc149a72392 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:27.964780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1051fcdc-45d7-4044-b0f4-cbc149a72392 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:27.965419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1051fcdc-45d7-4044-b0f4-cbc149a72392 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:27.986926 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80b97515-a2d8-404a-9f25-b8033a4c6f41 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.088012 Jul 14 14:29:27.990332 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 502/1019] 10.222.0.81 () {60 vars in 1216 bytes} [Thu Jul 14 14:29:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:29:28.213395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-da3eb88c-8a5b-423f-937b-3de75f003dba tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:28.214644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-da3eb88c-8a5b-423f-937b-3de75f003dba tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:28.230073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da3eb88c-8a5b-423f-937b-3de75f003dba tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:28.234785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da3eb88c-8a5b-423f-937b-3de75f003dba tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:28.238222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da3eb88c-8a5b-423f-937b-3de75f003dba tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:28.239750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da3eb88c-8a5b-423f-937b-3de75f003dba tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:28.937183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1051fcdc-45d7-4044-b0f4-cbc149a72392 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:28.958302 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1051fcdc-45d7-4044-b0f4-cbc149a72392 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1467 microversion: 2.1 time: 0.999663 Jul 14 14:29:28.977993 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 518/1020] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:27 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1467 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:28.983011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-99f09c59-0042-45cc-a029-6439d3d4c15f tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:28.987363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-99f09c59-0042-45cc-a029-6439d3d4c15f tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:29.001934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99f09c59-0042-45cc-a029-6439d3d4c15f tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:29.002659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99f09c59-0042-45cc-a029-6439d3d4c15f tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:29.007880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99f09c59-0042-45cc-a029-6439d3d4c15f tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:29.009392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99f09c59-0042-45cc-a029-6439d3d4c15f tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:29.101276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-da3eb88c-8a5b-423f-937b-3de75f003dba tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:29.110141 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-da3eb88c-8a5b-423f-937b-3de75f003dba tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1536 microversion: 2.1 time: 0.901581 Jul 14 14:29:29.125413 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 503/1021] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:28 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1536 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:29.131792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80b293d0-f9ee-43d5-9259-333fd2f64821 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:29.132402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80b293d0-f9ee-43d5-9259-333fd2f64821 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:29.141837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80b293d0-f9ee-43d5-9259-333fd2f64821 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:29.142304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80b293d0-f9ee-43d5-9259-333fd2f64821 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:29.143094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80b293d0-f9ee-43d5-9259-333fd2f64821 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:29.143532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80b293d0-f9ee-43d5-9259-333fd2f64821 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:29.393993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-99f09c59-0042-45cc-a029-6439d3d4c15f tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:29.464446 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-99f09c59-0042-45cc-a029-6439d3d4c15f tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.485014 Jul 14 14:29:29.466334 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 519/1022] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:28 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:29.478985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8cc0976-55e8-4130-a0ec-d008df962fac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c639f040>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:29.575235 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8cc0976-55e8-4130-a0ec-d008df962fac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/4f5e5af0-d72c-4006-a62b-d41e489facb7" status: 200 len: 784 microversion: 2.1 time: 0.107611 Jul 14 14:29:29.582480 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 520/1023] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:29 2022] GET /compute/v2.1/images/4f5e5af0-d72c-4006-a62b-d41e489facb7 => generated 784 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:29.594596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff48bc84-d00b-412e-b7e2-e38ab138cc57 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:29.612049 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ff48bc84-d00b-412e-b7e2-e38ab138cc57 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020829 Jul 14 14:29:29.613166 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 521/1024] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:29:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:29.623269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0eebc559-0a05-433c-a55b-980e59ed1d91 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5e9bdc0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:30.064574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-80b293d0-f9ee-43d5-9259-333fd2f64821 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:30.074799 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80b293d0-f9ee-43d5-9259-333fd2f64821 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1318 microversion: 2.1 time: 0.946882 Jul 14 14:29:30.097962 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 504/1025] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:29 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1318 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:30.127494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d43f87b9-ca32-4fe6-b02b-edd5f09ab55f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:30.128093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d43f87b9-ca32-4fe6-b02b-edd5f09ab55f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:30.142078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d43f87b9-ca32-4fe6-b02b-edd5f09ab55f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:30.142606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d43f87b9-ca32-4fe6-b02b-edd5f09ab55f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:30.143402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d43f87b9-ca32-4fe6-b02b-edd5f09ab55f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:30.143858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d43f87b9-ca32-4fe6-b02b-edd5f09ab55f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:30.810648 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0eebc559-0a05-433c-a55b-980e59ed1d91 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "DELETE /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 204 len: 0 microversion: 2.1 time: 1.190678 Jul 14 14:29:30.814527 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 522/1026] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:29 2022] DELETE /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 0 bytes in 1193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:29:30.834177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d43f87b9-ca32-4fe6-b02b-edd5f09ab55f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:30.834618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-8ddaa6de-f5b9-4528-b764-7687af5eb36a req-2215fc34-48f9-4f44-b733-df63708af8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a1b7fb-df82-435c-bf4d-261decd2db5f", "name": "network-vif-unplugged", "status": "completed", "tag": "2f439b9e-ad79-44c1-9bf1-810c6d5786f9"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:30.845439 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d43f87b9-ca32-4fe6-b02b-edd5f09ab55f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1536 microversion: 2.1 time: 0.721837 Jul 14 14:29:30.846241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:30.857090 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 505/1027] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:30 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1536 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:30.868717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8ddaa6de-f5b9-4528-b764-7687af5eb36a req-2215fc34-48f9-4f44-b733-df63708af8c9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:30.869331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77b69baa-7b30-41f9-ac8a-363aebcec800 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:30.869577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8ddaa6de-f5b9-4528-b764-7687af5eb36a req-2215fc34-48f9-4f44-b733-df63708af8c9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:30.870718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-77b69baa-7b30-41f9-ac8a-363aebcec800 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:30.879606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77b69baa-7b30-41f9-ac8a-363aebcec800 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:30.880304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77b69baa-7b30-41f9-ac8a-363aebcec800 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:30.881316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77b69baa-7b30-41f9-ac8a-363aebcec800 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:30.881913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77b69baa-7b30-41f9-ac8a-363aebcec800 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:30.882660 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-8ddaa6de-f5b9-4528-b764-7687af5eb36a req-2215fc34-48f9-4f44-b733-df63708af8c9 service nova] Creating event network-vif-unplugged:2f439b9e-ad79-44c1-9bf1-810c6d5786f9 for instance 90a1b7fb-df82-435c-bf4d-261decd2db5f on n-h2-767704-28 Jul 14 14:29:30.896011 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-8ddaa6de-f5b9-4528-b764-7687af5eb36a req-2215fc34-48f9-4f44-b733-df63708af8c9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082894 Jul 14 14:29:30.896786 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 523/1028] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:30.997469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-16d2220f-8deb-4976-98e9-5a8dad1cc6b6 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Action: 'create', calling method: .version_select at 0x7fd6c5eb8310>, body: {"pool": null} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:31.009088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-77b69baa-7b30-41f9-ac8a-363aebcec800 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:31.031595 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-77b69baa-7b30-41f9-ac8a-363aebcec800 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.172707 Jul 14 14:29:31.041147 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 506/1029] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:30 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:31.049386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b90698b7-8397-4fd4-ad68-3cf5330f90ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b98940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:31.075488 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b90698b7-8397-4fd4-ad68-3cf5330f90ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] HTTP exception thrown: Image not found. Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b90698b7-8397-4fd4-ad68-3cf5330f90ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Request method failure captured: Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 HTTP/1.1 Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CgXvQPA87KbGZwv1pQKsJkOub-iLzvOLXuxsxg2gEJHLX6KaXzQPNx77EP84HeAbxjgm_3rdZOEKdXszeJP5W6hWUEjV8m771crkuM2-XL9p2A6o2j9erPb2oDC3Rph-V6QfZLW4WLgDb-iMOg-C__0K8lIJcJK6Dpxg_fN1sthfNU Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 52d830f4fd184c54a15647e148c3590e Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesOneServerTestJSON-629675890 Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:29:31.104562 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d830f4fd184c54a15647e148c3590e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d830f4fd184c54a15647e148c3590e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d830f4fd184c54a15647e148c3590e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d830f4fd184c54a15647e148c3590e"}]}] Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesOneServerTestJSON-629675890 Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 52d830f4fd184c54a15647e148c3590e Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-629675890 Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesOneServerTestJSON-629675890-project Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4bfee07cac2b472a9f8ba7d0e4a67580 Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesOneServerTestJSON-629675890-project Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'ac4283cb-3a9f-426c-8494-2cdfda85cee4'} Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:31.106433 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ac4283cb-3a9f-426c-8494-2cdfda85cee4 Jul 14 14:29:31.107562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:31.109165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac4283cb-3a9f-426c-8494-2cdfda85cee4 could not be found. Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:29:31.110805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:31.112353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b90698b7-8397-4fd4-ad68-3cf5330f90ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:31.116307 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b90698b7-8397-4fd4-ad68-3cf5330f90ac tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 404 len: 62 microversion: 2.1 time: 0.072551 Jul 14 14:29:31.121560 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 507/1030] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:31 2022] GET /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:29:31.128686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-64922be2-155d-4921-93ec-c308f69a51f6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d7be5d2-eb8f-416d-b5fa-2b2fc55c498b", "device": "/dev/xvdb"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:31.132131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-64922be2-155d-4921-93ec-c308f69a51f6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:31.142407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64922be2-155d-4921-93ec-c308f69a51f6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:31.142873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64922be2-155d-4921-93ec-c308f69a51f6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:31.143806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64922be2-155d-4921-93ec-c308f69a51f6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:31.144265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64922be2-155d-4921-93ec-c308f69a51f6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:31.634466 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-64922be2-155d-4921-93ec-c308f69a51f6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "POST /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.511176 Jul 14 14:29:31.635094 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 508/1031] 10.222.0.81 () {62 vars in 1363 bytes} [Thu Jul 14 14:29:31 2022] POST /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:29:31.833326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8369171f-40d0-413f-ad66-0a5a7e885a40 tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] Action: 'create', calling method: .version_select at 0x7fd6c5a27310>, body: {"pool": null} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:33.740653 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-16d2220f-8deb-4976-98e9-5a8dad1cc6b6 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.841383 Jul 14 14:29:33.742905 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 524/1032] 10.222.0.81 () {60 vars in 1169 bytes} [Thu Jul 14 14:29:30 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:33.755570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e6ff859a-d0a4-48ea-96db-657102d8f84d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:33.770706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e6ff859a-d0a4-48ea-96db-657102d8f84d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:33.790813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6ff859a-d0a4-48ea-96db-657102d8f84d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:33.791128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6ff859a-d0a4-48ea-96db-657102d8f84d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:33.796922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6ff859a-d0a4-48ea-96db-657102d8f84d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:33.797436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6ff859a-d0a4-48ea-96db-657102d8f84d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:34.075219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e6ff859a-d0a4-48ea-96db-657102d8f84d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:34.088831 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e6ff859a-d0a4-48ea-96db-657102d8f84d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1318 microversion: 2.1 time: 0.344107 Jul 14 14:29:34.090082 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 525/1033] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:33 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:34.095727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2087288c-fb26-4252-985b-09b72bf296f3 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1724084780"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:34.097314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2087288c-fb26-4252-985b-09b72bf296f3 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:34.111386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2087288c-fb26-4252-985b-09b72bf296f3 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:34.113686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2087288c-fb26-4252-985b-09b72bf296f3 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:34.114541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2087288c-fb26-4252-985b-09b72bf296f3 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:34.114983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2087288c-fb26-4252-985b-09b72bf296f3 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:34.679235 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2087288c-fb26-4252-985b-09b72bf296f3 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "POST /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f/action" status: 202 len: 0 microversion: 2.1 time: 0.587523 Jul 14 14:29:34.686196 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 526/1034] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:29:34 2022] POST /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:29:34.705444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0f8cb2d4-b56b-4671-886a-d3916e59bf3f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:34.728310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0f8cb2d4-b56b-4671-886a-d3916e59bf3f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:34.763217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f8cb2d4-b56b-4671-886a-d3916e59bf3f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:34.763752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f8cb2d4-b56b-4671-886a-d3916e59bf3f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:34.764471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f8cb2d4-b56b-4671-886a-d3916e59bf3f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:34.764916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f8cb2d4-b56b-4671-886a-d3916e59bf3f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:35.130028 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8369171f-40d0-413f-ad66-0a5a7e885a40 tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.487075 Jul 14 14:29:35.130763 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 509/1035] 10.222.0.81 () {60 vars in 1169 bytes} [Thu Jul 14 14:29:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:35.137317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-974ab323-efa9-4fef-b53b-7ab39da0a00d tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:35.144193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-974ab323-efa9-4fef-b53b-7ab39da0a00d tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:35.157134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-974ab323-efa9-4fef-b53b-7ab39da0a00d tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:35.166019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-974ab323-efa9-4fef-b53b-7ab39da0a00d tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:35.172625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-974ab323-efa9-4fef-b53b-7ab39da0a00d tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:35.173383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-974ab323-efa9-4fef-b53b-7ab39da0a00d tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:35.176554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0f8cb2d4-b56b-4671-886a-d3916e59bf3f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:35.190054 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0f8cb2d4-b56b-4671-886a-d3916e59bf3f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1529 microversion: 2.1 time: 0.502460 Jul 14 14:29:35.190656 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 527/1036] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:34 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1529 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:35.208159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:35.210484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77bf1fa6-bf39-4c81-99b8-d34d72f5e1a6 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Calling method '.version_select at 0x7fd6c67d1dc0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:35.336767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-974ab323-efa9-4fef-b53b-7ab39da0a00d tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:35.384689 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-974ab323-efa9-4fef-b53b-7ab39da0a00d tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.252752 Jul 14 14:29:35.390775 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 510/1037] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:35 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:35.401293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5081fb8e-7189-414f-a41b-9a8abb846111 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b58310>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:35.476815 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5081fb8e-7189-414f-a41b-9a8abb846111 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be" status: 200 len: 1427 microversion: 2.1 time: 0.084476 Jul 14 14:29:35.477768 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 511/1038] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:35 2022] GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:35.482975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d1a5ed49-1060-4584-b24a-5b54ef172c07 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:35.483874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d1a5ed49-1060-4584-b24a-5b54ef172c07 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:35.492428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1a5ed49-1060-4584-b24a-5b54ef172c07 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:35.493803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1a5ed49-1060-4584-b24a-5b54ef172c07 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:35.494799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1a5ed49-1060-4584-b24a-5b54ef172c07 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:35.495409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1a5ed49-1060-4584-b24a-5b54ef172c07 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:35.701007 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-77bf1fa6-bf39-4c81-99b8-d34d72f5e1a6 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips/7378402f-5fbe-4afe-bb18-cc68d7a8294f" status: 200 len: 140 microversion: 2.1 time: 0.509223 Jul 14 14:29:35.702578 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 528/1039] 10.222.0.81 () {58 vars in 1259 bytes} [Thu Jul 14 14:29:35 2022] GET /compute/v2.1/os-floating-ips/7378402f-5fbe-4afe-bb18-cc68d7a8294f => generated 140 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:35.708730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e3d54316-6672-482f-9877-507a9a4ecd23 tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] Action: 'create', calling method: .version_select at 0x7fd6c61d85e0>, body: {"pool": null} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:35.753868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d1a5ed49-1060-4584-b24a-5b54ef172c07 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:35.767145 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d1a5ed49-1060-4584-b24a-5b54ef172c07 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1318 microversion: 2.1 time: 0.287458 Jul 14 14:29:35.768824 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 512/1040] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:35 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:35.775827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2af0fd1d-bdb4-4d3d-9a4e-eab4c6706dc1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:35.777464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2af0fd1d-bdb4-4d3d-9a4e-eab4c6706dc1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:35.786375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2af0fd1d-bdb4-4d3d-9a4e-eab4c6706dc1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:35.786977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2af0fd1d-bdb4-4d3d-9a4e-eab4c6706dc1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:35.787926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2af0fd1d-bdb4-4d3d-9a4e-eab4c6706dc1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:35.788467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2af0fd1d-bdb4-4d3d-9a4e-eab4c6706dc1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:36.046355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2af0fd1d-bdb4-4d3d-9a4e-eab4c6706dc1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:36.058373 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2af0fd1d-bdb4-4d3d-9a4e-eab4c6706dc1 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1529 microversion: 2.1 time: 0.288202 Jul 14 14:29:36.060287 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 513/1041] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:35 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1529 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:36.065877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c3587b3b-5aa5-445b-bbd0-10835789ad2c req-e0121eb4-9b3e-4182-95d3-7a54c90c4c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35fe2440-1aaf-4806-aa06-c1433e0b86c1", "name": "network-vif-plugged", "status": "completed", "tag": "ff8a672d-3bc1-448c-ac12-3d26f3c436d9"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:36.079529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c3587b3b-5aa5-445b-bbd0-10835789ad2c req-e0121eb4-9b3e-4182-95d3-7a54c90c4c5f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:36.080408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c3587b3b-5aa5-445b-bbd0-10835789ad2c req-e0121eb4-9b3e-4182-95d3-7a54c90c4c5f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:36.095039 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c3587b3b-5aa5-445b-bbd0-10835789ad2c req-e0121eb4-9b3e-4182-95d3-7a54c90c4c5f service nova] Creating event network-vif-plugged:ff8a672d-3bc1-448c-ac12-3d26f3c436d9 for instance 35fe2440-1aaf-4806-aa06-c1433e0b86c1 on n-h2-767704-28 Jul 14 14:29:36.101521 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c3587b3b-5aa5-445b-bbd0-10835789ad2c req-e0121eb4-9b3e-4182-95d3-7a54c90c4c5f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038937 Jul 14 14:29:36.103680 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 514/1042] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:36.110090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1ae7f322-695e-4611-af99-caa3687240a1 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Calling method '.version_select at 0x7fd6c5b13790>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:36.536279 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1ae7f322-695e-4611-af99-caa3687240a1 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips" status: 200 len: 143 microversion: 2.1 time: 0.431141 Jul 14 14:29:36.536863 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 515/1043] 10.222.0.81 () {58 vars in 1148 bytes} [Thu Jul 14 14:29:36 2022] GET /compute/v2.1/os-floating-ips => generated 143 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:36.542785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c743d75a-8d8a-45e3-bf13-664c02ea876e tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:36.544698 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:36.544698 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:29:36.550620 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c743d75a-8d8a-45e3-bf13-664c02ea876e tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] HTTP exception thrown: Flavor d213a017-da8e-42b7-a3bc-f3f8383a6e4f could not be found. Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c743d75a-8d8a-45e3-bf13-664c02ea876e tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Request method failure captured: Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/flavors/d213a017-da8e-42b7-a3bc-f3f8383a6e4f HTTP/1.1 Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdnGbuTH9f7j9jp81KL3jXgztVIVS_5mt10JUA531N85GlSqdOU2STrWRC5YvqQA6CsfNeZTIV-pzxHLQ5Z-Q4Dk22x7Ua2TUXCmo4MksvLO_aLLyrb5NFvHKGYk3EDxvTdtsa5O6OuXhGX1T8g7pVnURdwBjX98ll976A62sAt49U Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 0626a20cd20e4d1f8e4985dce7bb00df Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-MigrationsAdminTest-682614377 Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:29:36.553241 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:29:36.554881 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0626a20cd20e4d1f8e4985dce7bb00df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0626a20cd20e4d1f8e4985dce7bb00df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0626a20cd20e4d1f8e4985dce7bb00df", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0626a20cd20e4d1f8e4985dce7bb00df"}]}] Jul 14 14:29:36.554881 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-MigrationsAdminTest-682614377 Jul 14 14:29:36.554881 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 0626a20cd20e4d1f8e4985dce7bb00df Jul 14 14:29:36.554881 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-MigrationsAdminTest-682614377 Jul 14 14:29:36.554881 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-MigrationsAdminTest-682614377-project-admin Jul 14 14:29:36.554881 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:29:36.554881 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:29:36.554881 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 3e010174b0434d87862b7ffefa31545a Jul 14 14:29:36.554881 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-MigrationsAdminTest-682614377-project-admin Jul 14 14:29:36.554881 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:29:36.554881 n-d-767704-28 devstack@n-api.service[119511]: exception: Flavor d213a017-da8e-42b7-a3bc-f3f8383a6e4f could not be found. Jul 14 14:29:36.554881 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'd213a017-da8e-42b7-a3bc-f3f8383a6e4f'} Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d213a017-da8e-42b7-a3bc-f3f8383a6e4f could not be found. Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:36.556570 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor d213a017-da8e-42b7-a3bc-f3f8383a6e4f could not be found. Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d213a017-da8e-42b7-a3bc-f3f8383a6e4f could not be found. Jul 14 14:29:36.557867 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:36.560302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c743d75a-8d8a-45e3-bf13-664c02ea876e tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Returning 404 to user: Flavor d213a017-da8e-42b7-a3bc-f3f8383a6e4f could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:36.561399 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c743d75a-8d8a-45e3-bf13-664c02ea876e tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/d213a017-da8e-42b7-a3bc-f3f8383a6e4f" status: 404 len: 109 microversion: 2.1 time: 0.023557 Jul 14 14:29:36.562224 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 516/1044] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:29:36 2022] DELETE /compute/v2.1/flavors/d213a017-da8e-42b7-a3bc-f3f8383a6e4f => generated 109 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:29:36.567858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98cd3cd2-f988-40f8-807b-02ec61bee2ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:36.569432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-98cd3cd2-f988-40f8-807b-02ec61bee2ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:36.581550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98cd3cd2-f988-40f8-807b-02ec61bee2ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:36.582314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98cd3cd2-f988-40f8-807b-02ec61bee2ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:36.583344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98cd3cd2-f988-40f8-807b-02ec61bee2ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:36.584002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98cd3cd2-f988-40f8-807b-02ec61bee2ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:36.722098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-98cd3cd2-f988-40f8-807b-02ec61bee2ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:36.758974 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98cd3cd2-f988-40f8-807b-02ec61bee2ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.195391 Jul 14 14:29:36.759687 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 517/1045] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:36 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:36.771289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1bc74ad6-e7f9-4e26-b42b-74bb4dfd5656 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5e343a0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:36.858031 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1bc74ad6-e7f9-4e26-b42b-74bb4dfd5656 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be" status: 200 len: 1427 microversion: 2.1 time: 0.097130 Jul 14 14:29:36.869041 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 518/1046] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:36 2022] GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:36.875198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d93a28d4-49eb-48e9-86bf-ee214cfad9db tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Calling method '.version_select at 0x7fd6c5b49790>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:37.933605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=5 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:38.107467 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e3d54316-6672-482f-9877-507a9a4ecd23 tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.403514 Jul 14 14:29:38.109377 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 529/1047] 10.222.0.81 () {60 vars in 1169 bytes} [Thu Jul 14 14:29:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:38.115992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-47316200", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:38.183728 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d93a28d4-49eb-48e9-86bf-ee214cfad9db tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/7378402f-5fbe-4afe-bb18-cc68d7a8294f" status: 202 len: 0 microversion: 2.1 time: 1.311824 Jul 14 14:29:38.190288 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 519/1048] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:29:36 2022] DELETE /compute/v2.1/os-floating-ips/7378402f-5fbe-4afe-bb18-cc68d7a8294f => generated 0 bytes in 1321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:29:38.195391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aed53d4b-6569-426f-9b36-b8030015869c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:38.197056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aed53d4b-6569-426f-9b36-b8030015869c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:38.206187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aed53d4b-6569-426f-9b36-b8030015869c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:38.206870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aed53d4b-6569-426f-9b36-b8030015869c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:38.207814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aed53d4b-6569-426f-9b36-b8030015869c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:38.208325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:29:38.209213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aed53d4b-6569-426f-9b36-b8030015869c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:38.467728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aed53d4b-6569-426f-9b36-b8030015869c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:38.483321 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aed53d4b-6569-426f-9b36-b8030015869c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1468 microversion: 2.1 time: 0.291623 Jul 14 14:29:38.483905 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 520/1049] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:38 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:38.488836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-30c2e5f4-df00-4712-8c34-3516706e88dc tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:38.490274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-30c2e5f4-df00-4712-8c34-3516706e88dc tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:38.501604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30c2e5f4-df00-4712-8c34-3516706e88dc tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:38.503413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30c2e5f4-df00-4712-8c34-3516706e88dc tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:38.504307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30c2e5f4-df00-4712-8c34-3516706e88dc tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:38.504798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30c2e5f4-df00-4712-8c34-3516706e88dc tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:38.584542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:29:38.584996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:29:38.585710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:29:38.586123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:29:38.587169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:29:38.597732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-30c2e5f4-df00-4712-8c34-3516706e88dc tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:38.613911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:38.614384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:38.615245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:38.615692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:38.623996 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-30c2e5f4-df00-4712-8c34-3516706e88dc tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.138814 Jul 14 14:29:38.624931 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 521/1050] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:38 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:38.629468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-53239aed-9474-4996-a894-9a530c7bfbcc tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5e7eaf0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:38.654749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Getting quotas for project c3e95b24eb1b4f9fbc5eb6f4d6f3d308. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:29:38.662396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Getting quotas for user 89894c4d380a4632870ebcb10a2ffe81 and project c3e95b24eb1b4f9fbc5eb6f4d6f3d308. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:29:38.682951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:29:38.685875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:29:38.686060 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-53239aed-9474-4996-a894-9a530c7bfbcc tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be" status: 200 len: 1427 microversion: 2.1 time: 0.059841 Jul 14 14:29:38.686484 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 522/1051] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:38 2022] GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:38.691271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99c3eb13-79b5-4f51-a79d-226d78d21c6d tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] Action: 'create', calling method: .version_select at 0x7fd6c5b03430>, body: {"pool": null} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:38.760248 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d12ba1f8-ee11-4a8d-9f6b-900aeb4c6901 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649368 Jul 14 14:29:38.761245 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 530/1052] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:29:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:29:38.766378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0f9dc18e-cabe-4338-8069-a1b0e8047a60 req-f6311eed-0559-4847-a66c-147342f631f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486f72c1-03cd-4401-862c-1e02ca398e46", "name": "network-vif-plugged", "status": "completed", "tag": "a5283818-bbd0-45aa-b71a-689a812a086b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:38.779440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0f9dc18e-cabe-4338-8069-a1b0e8047a60 req-f6311eed-0559-4847-a66c-147342f631f1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:38.780188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0f9dc18e-cabe-4338-8069-a1b0e8047a60 req-f6311eed-0559-4847-a66c-147342f631f1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:38.799536 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0f9dc18e-cabe-4338-8069-a1b0e8047a60 req-f6311eed-0559-4847-a66c-147342f631f1 service nova] Creating event network-vif-plugged:a5283818-bbd0-45aa-b71a-689a812a086b for instance 486f72c1-03cd-4401-862c-1e02ca398e46 on n-h1-767704-28 Jul 14 14:29:38.809469 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0f9dc18e-cabe-4338-8069-a1b0e8047a60 req-f6311eed-0559-4847-a66c-147342f631f1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045686 Jul 14 14:29:38.810645 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 531/1053] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:38.822785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f59f4081-2502-4e7c-973a-cc4d6c257223 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Action: 'create', calling method: .version_select at 0x7fd6c610d550>, body: {"pool": null} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:41.344227 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99c3eb13-79b5-4f51-a79d-226d78d21c6d tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.655768 Jul 14 14:29:41.346018 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 523/1054] 10.222.0.81 () {60 vars in 1169 bytes} [Thu Jul 14 14:29:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:41.695164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39565035-8c99-468c-9491-e33b9e3a4938 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1867137843", "block_migration": true, "disk_over_commit": false}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:41.698429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-39565035-8c99-468c-9491-e33b9e3a4938 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:41.706215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39565035-8c99-468c-9491-e33b9e3a4938 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:41.707346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39565035-8c99-468c-9491-e33b9e3a4938 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:41.708803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39565035-8c99-468c-9491-e33b9e3a4938 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:41.709452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39565035-8c99-468c-9491-e33b9e3a4938 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:41.755214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-39565035-8c99-468c-9491-e33b9e3a4938 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lazy-loading 'flavor' on Instance uuid 35fe2440-1aaf-4806-aa06-c1433e0b86c1 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:41.783568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-39565035-8c99-468c-9491-e33b9e3a4938 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Going to try to live migrate instance to tempest-host-1867137843 {{(pid=119511) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:29:41.795512 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-39565035-8c99-468c-9491-e33b9e3a4938 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] HTTP exception thrown: Compute host tempest-host-1867137843 could not be found. Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39565035-8c99-468c-9491-e33b9e3a4938 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Request method failure captured: Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1/action HTTP/1.1 Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 107 Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cg4fKELPH79e1jCXtR29ip_qAjSw4KJ5HQQWVKhwBpdgiJcbQN-CkRJU4-9qVMZhR0t1w7d7lTVvSigyYhWfyeqnxp6AvnsUohm_POJJgc9AIOk6YGHG7doMhDDK-Bsv7uIBHDqMwfVvRHkMDLcafFvMC1k8KUwsg4blmfmu-lxxFw Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 4bc932f30efc4bec824c83686ac2e9e5 Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-LiveMigrationNegativeTest-676473078 Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:29:41.802592 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:29:41.805771 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4bc932f30efc4bec824c83686ac2e9e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4bc932f30efc4bec824c83686ac2e9e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4bc932f30efc4bec824c83686ac2e9e5", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4bc932f30efc4bec824c83686ac2e9e5"}]}] Jul 14 14:29:41.805771 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-LiveMigrationNegativeTest-676473078 Jul 14 14:29:41.805771 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 4bc932f30efc4bec824c83686ac2e9e5 Jul 14 14:29:41.805771 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-676473078 Jul 14 14:29:41.805771 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-LiveMigrationNegativeTest-676473078-project-admin Jul 14 14:29:41.805771 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:29:41.805771 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:29:41.805771 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: bed183e3117f409892c54dc065b53eac Jul 14 14:29:41.805771 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-LiveMigrationNegativeTest-676473078-project-admin Jul 14 14:29:41.805771 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:29:41.805771 n-d-767704-28 devstack@n-api.service[119511]: {"os-migrateLive": {"host": "tempest-host-1867137843", "block_migration": true, "disk_over_commit": false}} Jul 14 14:29:41.805771 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: exception: Compute host tempest-host-1867137843 could not be found. Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '35fe2440-1aaf-4806-aa06-c1433e0b86c1', 'body': {'os-migrateLive': {'host': 'tempest-host-1867137843', 'block_migration': True, 'disk_over_commit': False}}} Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:29:41.806811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1867137843 could not be found. Jul 14 14:29:41.808213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1867137843 could not be found. Jul 14 14:29:41.811052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:41.812960 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:41.812960 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:41.812960 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:41.812960 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:41.812960 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:41.812960 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:41.812960 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:41.812960 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1867137843 could not be found. Jul 14 14:29:41.812960 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:41.816080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39565035-8c99-468c-9491-e33b9e3a4938 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Returning 400 to user: Compute host tempest-host-1867137843 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:41.816080 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-39565035-8c99-468c-9491-e33b9e3a4938 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1/action" status: 400 len: 100 microversion: 2.1 time: 0.468113 Jul 14 14:29:41.816792 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 524/1055] 10.222.0.81 () {60 vars in 1278 bytes} [Thu Jul 14 14:29:41 2022] POST /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1/action => generated 100 bytes in 470 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:29:41.823385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-432097bb-3c38-44e9-bd6e-7f67129bf26c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:41.825745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-432097bb-3c38-44e9-bd6e-7f67129bf26c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:41.835333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-432097bb-3c38-44e9-bd6e-7f67129bf26c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:41.836086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-432097bb-3c38-44e9-bd6e-7f67129bf26c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:41.837863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-432097bb-3c38-44e9-bd6e-7f67129bf26c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:41.838509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-432097bb-3c38-44e9-bd6e-7f67129bf26c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:41.953974 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f59f4081-2502-4e7c-973a-cc4d6c257223 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.138035 Jul 14 14:29:41.955494 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 532/1056] 10.222.0.81 () {60 vars in 1169 bytes} [Thu Jul 14 14:29:38 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:41.963051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2e911cff-e464-414d-89ed-a3cbde89b133 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:41.970392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2e911cff-e464-414d-89ed-a3cbde89b133 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:41.987896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e911cff-e464-414d-89ed-a3cbde89b133 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:41.990202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e911cff-e464-414d-89ed-a3cbde89b133 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:41.996928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e911cff-e464-414d-89ed-a3cbde89b133 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:41.998420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e911cff-e464-414d-89ed-a3cbde89b133 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:42.109915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-2e911cff-e464-414d-89ed-a3cbde89b133 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:42.140585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-432097bb-3c38-44e9-bd6e-7f67129bf26c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:42.147516 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2e911cff-e464-414d-89ed-a3cbde89b133 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.190792 Jul 14 14:29:42.148328 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 533/1057] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:41 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:42.161110 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-432097bb-3c38-44e9-bd6e-7f67129bf26c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1311 microversion: 2.1 time: 0.332311 Jul 14 14:29:42.169957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b7c4daeb-14a6-46fa-8eb7-173609403b86 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5e9ba60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:42.171544 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 525/1058] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:41 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1311 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:42.184939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c3b98252-7bfe-4a75-a6f1-a3a7b7ad7916 req-70a90102-e4d4-474e-b33c-fa80bcdf8f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a1b7fb-df82-435c-bf4d-261decd2db5f", "name": "network-vif-plugged", "status": "completed", "tag": "2f439b9e-ad79-44c1-9bf1-810c6d5786f9"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:42.209124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c3b98252-7bfe-4a75-a6f1-a3a7b7ad7916 req-70a90102-e4d4-474e-b33c-fa80bcdf8f4e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:42.209971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c3b98252-7bfe-4a75-a6f1-a3a7b7ad7916 req-70a90102-e4d4-474e-b33c-fa80bcdf8f4e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:42.284873 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b7c4daeb-14a6-46fa-8eb7-173609403b86 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be" status: 200 len: 1427 microversion: 2.1 time: 0.117184 Jul 14 14:29:42.288210 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 534/1059] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:42 2022] GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:42.313181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7c03175e-95e8-433c-b0ae-b1203d02ad4b tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] Action: 'create', calling method: .version_select at 0x7fd6c5e9be50>, body: {"pool": null} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:42.349489 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c3b98252-7bfe-4a75-a6f1-a3a7b7ad7916 req-70a90102-e4d4-474e-b33c-fa80bcdf8f4e service nova] Creating event network-vif-plugged:2f439b9e-ad79-44c1-9bf1-810c6d5786f9 for instance 90a1b7fb-df82-435c-bf4d-261decd2db5f on n-h2-767704-28 Jul 14 14:29:42.367384 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c3b98252-7bfe-4a75-a6f1-a3a7b7ad7916 req-70a90102-e4d4-474e-b33c-fa80bcdf8f4e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190582 Jul 14 14:29:42.368557 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 526/1060] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:42.375463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1d599617-bc78-4270-818a-cf902d568b28 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:42.376549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1d599617-bc78-4270-818a-cf902d568b28 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:42.385161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d599617-bc78-4270-818a-cf902d568b28 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:42.385899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d599617-bc78-4270-818a-cf902d568b28 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:42.387505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d599617-bc78-4270-818a-cf902d568b28 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:42.388146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d599617-bc78-4270-818a-cf902d568b28 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:42.629525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1d599617-bc78-4270-818a-cf902d568b28 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:42.637950 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1d599617-bc78-4270-818a-cf902d568b28 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1468 microversion: 2.1 time: 0.267620 Jul 14 14:29:42.642361 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 527/1061] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:42 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1468 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:42.650515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-92661ee1-fec5-4410-a252-adc41aa1e11c tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Calling method '.version_select at 0x7fd6c59ced30>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:43.968764 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-92661ee1-fec5-4410-a252-adc41aa1e11c tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/078e5014-652a-4386-bcf2-22ebada2850c" status: 202 len: 0 microversion: 2.1 time: 1.324344 Jul 14 14:29:43.969981 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 528/1062] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:29:42 2022] DELETE /compute/v2.1/os-floating-ips/078e5014-652a-4386-bcf2-22ebada2850c => generated 0 bytes in 1327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:29:43.975671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0c39cbf5-cc2d-4d9a-aa5b-2bf1cda7ec02 req-d83f7d55-278e-47fc-8592-7c99a587fe1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a0d92d-ba81-48f5-aa28-a62a0026c47a", "tag": "dfbfc888-8b45-4b44-b669-8df623f935de"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:43.987450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0c39cbf5-cc2d-4d9a-aa5b-2bf1cda7ec02 req-d83f7d55-278e-47fc-8592-7c99a587fe1f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:43.987992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0c39cbf5-cc2d-4d9a-aa5b-2bf1cda7ec02 req-d83f7d55-278e-47fc-8592-7c99a587fe1f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:44.000033 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0c39cbf5-cc2d-4d9a-aa5b-2bf1cda7ec02 req-d83f7d55-278e-47fc-8592-7c99a587fe1f service nova] Creating event network-changed:dfbfc888-8b45-4b44-b669-8df623f935de for instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a on n-h1-767704-28 Jul 14 14:29:44.005522 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0c39cbf5-cc2d-4d9a-aa5b-2bf1cda7ec02 req-d83f7d55-278e-47fc-8592-7c99a587fe1f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033875 Jul 14 14:29:44.006226 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 529/1063] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:44.016665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1228673867", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:44.084981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:29:44.538268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:29:44.540175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:29:44.540906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:29:44.541370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:29:44.541793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:29:44.562933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:44.563710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:44.564525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:44.564974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:44.591511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Getting quotas for project 8baaf403ad6a44919ea2e5bec2df5f2b. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:29:44.605621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Getting quotas for user 9ec43300027a4fd2b63886f9d04f5c99 and project 8baaf403ad6a44919ea2e5bec2df5f2b. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:29:44.621815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:29:44.625021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:29:44.682580 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1de181b2-a9d8-4443-96ec-3719b30b5f0e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674878 Jul 14 14:29:44.689269 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 530/1064] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:29:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:29:44.695517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e9dd8102-05c9-4659-afe1-1ca0ed613718 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:44.696843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e9dd8102-05c9-4659-afe1-1ca0ed613718 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:44.704985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e9dd8102-05c9-4659-afe1-1ca0ed613718 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:44.706368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e9dd8102-05c9-4659-afe1-1ca0ed613718 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:44.706816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e9dd8102-05c9-4659-afe1-1ca0ed613718 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:44.707353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e9dd8102-05c9-4659-afe1-1ca0ed613718 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:44.860014 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7c03175e-95e8-433c-b0ae-b1203d02ad4b tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.570526 Jul 14 14:29:44.860724 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 535/1065] 10.222.0.81 () {60 vars in 1169 bytes} [Thu Jul 14 14:29:42 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:44.871078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-51e4504e-14fd-437b-85b2-a0ab434252ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:44.877316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-51e4504e-14fd-437b-85b2-a0ab434252ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:44.902747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51e4504e-14fd-437b-85b2-a0ab434252ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:44.905984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51e4504e-14fd-437b-85b2-a0ab434252ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:44.909241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51e4504e-14fd-437b-85b2-a0ab434252ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:44.913619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51e4504e-14fd-437b-85b2-a0ab434252ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:44.927629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:45.028682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e9dd8102-05c9-4659-afe1-1ca0ed613718 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:45.037839 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e9dd8102-05c9-4659-afe1-1ca0ed613718 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1311 microversion: 2.1 time: 0.347008 Jul 14 14:29:45.041784 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 531/1066] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:44 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1311 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:45.056765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5b371e7a-332a-4707-897b-b8859ec82ccf tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c59cc790>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:45.077049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-51e4504e-14fd-437b-85b2-a0ab434252ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:45.152136 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-51e4504e-14fd-437b-85b2-a0ab434252ae tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.290210 Jul 14 14:29:45.173139 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5b371e7a-332a-4707-897b-b8859ec82ccf tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be" status: 200 len: 1427 microversion: 2.1 time: 0.128677 Jul 14 14:29:45.174337 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 536/1067] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:44 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:45.185835 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 532/1068] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:45 2022] GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be => generated 1427 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:45.204170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6129942e-9603-44ed-baaf-6e978b5d8315 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Calling method '.version_select at 0x7fd6c5f19160>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:45.206761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cc960c32-308d-4346-a7ff-f427a9cecbe5 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:45.212676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cc960c32-308d-4346-a7ff-f427a9cecbe5 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:45.365363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG neutronclient.v2_0.client [None req-6129942e-9603-44ed-baaf-6e978b5d8315 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 078e5014-652a-4386-bcf2-22ebada2850c could not be found", "detail": ""}} {{(pid=119512) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:29:45.366531 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-6129942e-9603-44ed-baaf-6e978b5d8315 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] HTTP exception thrown: Floating IP not found for ID 078e5014-652a-4386-bcf2-22ebada2850c Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6129942e-9603-44ed-baaf-6e978b5d8315 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Request method failure captured: Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-floating-ips/078e5014-652a-4386-bcf2-22ebada2850c HTTP/1.1 Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0ChKYNmngGNtOVjiA2Bu9lPa1VoGKRF9fY4CYaX5kpcn31XUbBGBXkhvkCl5lpFHylXTqhhDutZ9Ol5QjdK-lvhCtUuHpVRxG-E-9yLQTXO9ZouZybcP-JqP1-31AeYc-yPu8CoN1cSKaFC3TvGCcqf6BwSh4M37ho6xgqevhtLCyoo Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d0b99837719f45b4b88b55f21a08b9a9 Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-FloatingIPsTestJSON-936211301 Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:29:45.369527 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d0b99837719f45b4b88b55f21a08b9a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d0b99837719f45b4b88b55f21a08b9a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d0b99837719f45b4b88b55f21a08b9a9", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d0b99837719f45b4b88b55f21a08b9a9"}]}] Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-FloatingIPsTestJSON-936211301 Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d0b99837719f45b4b88b55f21a08b9a9 Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-FloatingIPsTestJSON-936211301 Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-FloatingIPsTestJSON-936211301-project Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 01e60dfc0f984239a6bd6601b8290c18 Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-FloatingIPsTestJSON-936211301-project Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: exception: Floating IP not found for ID 078e5014-652a-4386-bcf2-22ebada2850c Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '078e5014-652a-4386-bcf2-22ebada2850c'} Jul 14 14:29:45.371006 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:29:45.371942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 078e5014-652a-4386-bcf2-22ebada2850c could not be found Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-628d0f6e-afd3-4f21-b189-7d51c6179926'] Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 078e5014-652a-4386-bcf2-22ebada2850c. Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:45.373842 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 078e5014-652a-4386-bcf2-22ebada2850c Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:45.376687 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:45.379469 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 078e5014-652a-4386-bcf2-22ebada2850c Jul 14 14:29:45.379469 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.381343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6129942e-9603-44ed-baaf-6e978b5d8315 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Returning 404 to user: Floating IP not found for ID 078e5014-652a-4386-bcf2-22ebada2850c {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:45.382480 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6129942e-9603-44ed-baaf-6e978b5d8315 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips/078e5014-652a-4386-bcf2-22ebada2850c" status: 404 len: 111 microversion: 2.1 time: 0.194410 Jul 14 14:29:45.383334 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 537/1069] 10.222.0.81 () {58 vars in 1259 bytes} [Thu Jul 14 14:29:45 2022] GET /compute/v2.1/os-floating-ips/078e5014-652a-4386-bcf2-22ebada2850c => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:29:45.388612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a91704f-3375-477c-8e22-cc6274c26135 tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] Calling method '.version_select at 0x7fd6c5e9ba60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:45.404587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cc960c32-308d-4346-a7ff-f427a9cecbe5 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:45.433758 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cc960c32-308d-4346-a7ff-f427a9cecbe5 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1219 microversion: 2.1 time: 0.242793 Jul 14 14:29:45.468603 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 533/1070] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:45 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1219 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:45.487246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8acd6c2-812e-41a9-b665-f64bb3bf7200 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Calling method '.version_select at 0x7fd6c59cc430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:45.631536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-b8acd6c2-812e-41a9-b665-f64bb3bf7200 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 078e5014-652a-4386-bcf2-22ebada2850c could not be found", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:29:45.633970 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b8acd6c2-812e-41a9-b665-f64bb3bf7200 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] HTTP exception thrown: Floating IP not found for ID 078e5014-652a-4386-bcf2-22ebada2850c Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8acd6c2-812e-41a9-b665-f64bb3bf7200 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Request method failure captured: Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-floating-ips/078e5014-652a-4386-bcf2-22ebada2850c HTTP/1.1 Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0ChKYNmngGNtOVjiA2Bu9lPa1VoGKRF9fY4CYaX5kpcn31XUbBGBXkhvkCl5lpFHylXTqhhDutZ9Ol5QjdK-lvhCtUuHpVRxG-E-9yLQTXO9ZouZybcP-JqP1-31AeYc-yPu8CoN1cSKaFC3TvGCcqf6BwSh4M37ho6xgqevhtLCyoo Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d0b99837719f45b4b88b55f21a08b9a9 Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FloatingIPsTestJSON-936211301 Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:29:45.637428 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d0b99837719f45b4b88b55f21a08b9a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d0b99837719f45b4b88b55f21a08b9a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d0b99837719f45b4b88b55f21a08b9a9", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d0b99837719f45b4b88b55f21a08b9a9"}]}] Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FloatingIPsTestJSON-936211301 Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d0b99837719f45b4b88b55f21a08b9a9 Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FloatingIPsTestJSON-936211301 Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FloatingIPsTestJSON-936211301-project Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 01e60dfc0f984239a6bd6601b8290c18 Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FloatingIPsTestJSON-936211301-project Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: exception: Floating IP not found for ID 078e5014-652a-4386-bcf2-22ebada2850c Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '078e5014-652a-4386-bcf2-22ebada2850c'} Jul 14 14:29:45.639785 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:29:45.641413 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 078e5014-652a-4386-bcf2-22ebada2850c could not be found Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8b8bf97-863e-494f-91aa-909b4a2f0d6b'] Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 078e5014-652a-4386-bcf2-22ebada2850c. Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:45.643382 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 078e5014-652a-4386-bcf2-22ebada2850c Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:45.645488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:45.647826 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 078e5014-652a-4386-bcf2-22ebada2850c Jul 14 14:29:45.647826 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:45.651316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8acd6c2-812e-41a9-b665-f64bb3bf7200 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] Returning 404 to user: Floating IP not found for ID 078e5014-652a-4386-bcf2-22ebada2850c {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:45.653030 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b8acd6c2-812e-41a9-b665-f64bb3bf7200 tempest-FloatingIPsTestJSON-936211301 tempest-FloatingIPsTestJSON-936211301-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/078e5014-652a-4386-bcf2-22ebada2850c" status: 404 len: 111 microversion: 2.1 time: 0.182139 Jul 14 14:29:45.661187 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 534/1071] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:29:45 2022] DELETE /compute/v2.1/os-floating-ips/078e5014-652a-4386-bcf2-22ebada2850c => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:29:45.788372 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a91704f-3375-477c-8e22-cc6274c26135 tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips/1e5080f5-ceeb-42e0-8119-9367afbdc886" status: 200 len: 141 microversion: 2.1 time: 0.402319 Jul 14 14:29:45.791996 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 538/1072] 10.222.0.81 () {58 vars in 1259 bytes} [Thu Jul 14 14:29:45 2022] GET /compute/v2.1/os-floating-ips/1e5080f5-ceeb-42e0-8119-9367afbdc886 => generated 141 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:45.806094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eb9ba448-64e3-4fa2-a561-0cb4c7a20840 tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] Calling method '.version_select at 0x7fd6c5b98e50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:46.061351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-21775a4d-dd90-4c65-ac91-2bbec0c4e2f5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:46.062719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-21775a4d-dd90-4c65-ac91-2bbec0c4e2f5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:46.073958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21775a4d-dd90-4c65-ac91-2bbec0c4e2f5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:46.077793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21775a4d-dd90-4c65-ac91-2bbec0c4e2f5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:46.080936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21775a4d-dd90-4c65-ac91-2bbec0c4e2f5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:46.082497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21775a4d-dd90-4c65-ac91-2bbec0c4e2f5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:46.902399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-21775a4d-dd90-4c65-ac91-2bbec0c4e2f5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:46.920367 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-21775a4d-dd90-4c65-ac91-2bbec0c4e2f5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1311 microversion: 2.1 time: 0.863747 Jul 14 14:29:46.921773 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 539/1073] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:46 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1311 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:29:46.926648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b00d2e62-af68-4a0c-b009-805fb58b7c55 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5df99d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:46.996205 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b00d2e62-af68-4a0c-b009-805fb58b7c55 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be" status: 200 len: 1427 microversion: 2.1 time: 0.073107 Jul 14 14:29:46.997615 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 540/1074] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:46 2022] GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:47.003974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9871d124-55a1-466d-939b-27417a7dc5b5 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:47.004991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9871d124-55a1-466d-939b-27417a7dc5b5 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:47.013784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9871d124-55a1-466d-939b-27417a7dc5b5 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:47.014614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9871d124-55a1-466d-939b-27417a7dc5b5 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:47.015631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9871d124-55a1-466d-939b-27417a7dc5b5 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:47.016286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9871d124-55a1-466d-939b-27417a7dc5b5 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:47.181380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-9871d124-55a1-466d-939b-27417a7dc5b5 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:47.244378 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9871d124-55a1-466d-939b-27417a7dc5b5 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.245406 Jul 14 14:29:47.256167 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 541/1075] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:46 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:47.258702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-782d2855-d031-45b6-9fcb-925d96d270ac tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:47.259822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-782d2855-d031-45b6-9fcb-925d96d270ac tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:47.273282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-782d2855-d031-45b6-9fcb-925d96d270ac tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:47.273412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-782d2855-d031-45b6-9fcb-925d96d270ac tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:47.275070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-782d2855-d031-45b6-9fcb-925d96d270ac tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:47.275685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-782d2855-d031-45b6-9fcb-925d96d270ac tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:47.732170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-782d2855-d031-45b6-9fcb-925d96d270ac tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid 07717385-1942-4235-9479-e46016827db8 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:47.754098 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-782d2855-d031-45b6-9fcb-925d96d270ac tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 2426 microversion: 2.25 time: 0.504338 Jul 14 14:29:47.766318 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 542/1076] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:47 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 2426 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:47.775102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-49a1f30d-65b1-45aa-b336-e11df8a2d0e7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:47.776534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-49a1f30d-65b1-45aa-b336-e11df8a2d0e7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:47.783340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49a1f30d-65b1-45aa-b336-e11df8a2d0e7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:47.784064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49a1f30d-65b1-45aa-b336-e11df8a2d0e7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:47.785143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49a1f30d-65b1-45aa-b336-e11df8a2d0e7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:47.786506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49a1f30d-65b1-45aa-b336-e11df8a2d0e7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:47.966987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-49a1f30d-65b1-45aa-b336-e11df8a2d0e7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:47.977944 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-49a1f30d-65b1-45aa-b336-e11df8a2d0e7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1277 microversion: 2.1 time: 0.206808 Jul 14 14:29:48.002542 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 543/1077] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:47 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:48.007816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-736650c9-1c29-4281-be9e-72f17b5da03f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-767704-28", "block_migration": "auto"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:48.011780 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eb9ba448-64e3-4fa2-a561-0cb4c7a20840 tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/1e5080f5-ceeb-42e0-8119-9367afbdc886" status: 202 len: 0 microversion: 2.1 time: 2.212334 Jul 14 14:29:48.018418 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 535/1078] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:29:45 2022] DELETE /compute/v2.1/os-floating-ips/1e5080f5-ceeb-42e0-8119-9367afbdc886 => generated 0 bytes in 2220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:29:48.020203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-736650c9-1c29-4281-be9e-72f17b5da03f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:48.029053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-de017bc3-d14f-4955-96cb-309320e33697 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:48.030416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-de017bc3-d14f-4955-96cb-309320e33697 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:48.048487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-736650c9-1c29-4281-be9e-72f17b5da03f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:48.048981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-736650c9-1c29-4281-be9e-72f17b5da03f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:48.049897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de017bc3-d14f-4955-96cb-309320e33697 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:48.050772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de017bc3-d14f-4955-96cb-309320e33697 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:48.051826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-736650c9-1c29-4281-be9e-72f17b5da03f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:48.052284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-736650c9-1c29-4281-be9e-72f17b5da03f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:48.053354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de017bc3-d14f-4955-96cb-309320e33697 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:48.054041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de017bc3-d14f-4955-96cb-309320e33697 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:48.109586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-736650c9-1c29-4281-be9e-72f17b5da03f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'flavor' on Instance uuid 07717385-1942-4235-9479-e46016827db8 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:48.136234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-736650c9-1c29-4281-be9e-72f17b5da03f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 07717385-1942-4235-9479-e46016827db8] Going to try to live migrate instance to n-h2-767704-28 {{(pid=119512) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:29:48.311695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-de017bc3-d14f-4955-96cb-309320e33697 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:48.339695 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-de017bc3-d14f-4955-96cb-309320e33697 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1311 microversion: 2.1 time: 0.316830 Jul 14 14:29:48.346046 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 536/1079] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:48 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1311 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:48.365172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c4cd0c05-0c68-492e-9907-02ad1d737e40 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b983a0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:48.483524 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c4cd0c05-0c68-492e-9907-02ad1d737e40 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be" status: 200 len: 1427 microversion: 2.1 time: 0.134250 Jul 14 14:29:48.490500 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 537/1080] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:48 2022] GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be => generated 1427 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:48.511316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-52e4095e-a5c3-4dfa-af47-54d734e6831b tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] Calling method '.version_select at 0x7fd6c59cc3a0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:48.643240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:48.672849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:49.096148 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-52e4095e-a5c3-4dfa-af47-54d734e6831b tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.603607 Jul 14 14:29:49.098156 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 538/1081] 10.222.0.81 () {58 vars in 1163 bytes} [Thu Jul 14 14:29:48 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:29:49.108357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aea9e2a0-e666-4f06-8d51-f291604a7167 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:49.109536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aea9e2a0-e666-4f06-8d51-f291604a7167 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:49.116670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:49.132986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aea9e2a0-e666-4f06-8d51-f291604a7167 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:49.137321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aea9e2a0-e666-4f06-8d51-f291604a7167 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:49.140285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aea9e2a0-e666-4f06-8d51-f291604a7167 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:49.142637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aea9e2a0-e666-4f06-8d51-f291604a7167 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:49.310588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-aea9e2a0-e666-4f06-8d51-f291604a7167 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:49.389419 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aea9e2a0-e666-4f06-8d51-f291604a7167 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.288888 Jul 14 14:29:49.390168 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 539/1082] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:49 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:49.401812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-57fbea55-9a81-4418-8afb-7707b2a01bde tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:49.405586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-57fbea55-9a81-4418-8afb-7707b2a01bde tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:49.432297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57fbea55-9a81-4418-8afb-7707b2a01bde tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:49.438685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57fbea55-9a81-4418-8afb-7707b2a01bde tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:49.442946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57fbea55-9a81-4418-8afb-7707b2a01bde tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:49.446480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57fbea55-9a81-4418-8afb-7707b2a01bde tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:49.870001 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-57fbea55-9a81-4418-8afb-7707b2a01bde tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1815 microversion: 2.1 time: 0.474868 Jul 14 14:29:49.874925 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 540/1083] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:49 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1815 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:49.890776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-da79064d-79b3-4bd8-94a6-01bfa8ec2670 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:49.898561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-da79064d-79b3-4bd8-94a6-01bfa8ec2670 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:49.910138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da79064d-79b3-4bd8-94a6-01bfa8ec2670 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:49.910975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da79064d-79b3-4bd8-94a6-01bfa8ec2670 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:49.911945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da79064d-79b3-4bd8-94a6-01bfa8ec2670 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:49.913360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da79064d-79b3-4bd8-94a6-01bfa8ec2670 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:50.240710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-da79064d-79b3-4bd8-94a6-01bfa8ec2670 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:50.252581 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-da79064d-79b3-4bd8-94a6-01bfa8ec2670 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1319 microversion: 2.1 time: 0.376246 Jul 14 14:29:50.265957 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 541/1084] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:49 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:50.273446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b2d65c4a-5637-4d5d-996d-40e75edfbb7e tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] Calling method '.version_select at 0x7fd6c59ce040>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:50.857019 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b2d65c4a-5637-4d5d-996d-40e75edfbb7e tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.589386 Jul 14 14:29:50.857616 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 542/1085] 10.222.0.81 () {58 vars in 1148 bytes} [Thu Jul 14 14:29:50 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:50.862396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f02f65b4-fc2b-45cf-98f4-a58555a7b6e0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:50.863207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f02f65b4-fc2b-45cf-98f4-a58555a7b6e0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:50.880765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f02f65b4-fc2b-45cf-98f4-a58555a7b6e0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:50.881519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f02f65b4-fc2b-45cf-98f4-a58555a7b6e0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:50.882497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f02f65b4-fc2b-45cf-98f4-a58555a7b6e0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:50.883195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f02f65b4-fc2b-45cf-98f4-a58555a7b6e0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:50.929527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:51.191499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f02f65b4-fc2b-45cf-98f4-a58555a7b6e0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:51.214039 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-736650c9-1c29-4281-be9e-72f17b5da03f tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/action" status: 202 len: 0 microversion: 2.25 time: 3.209952 Jul 14 14:29:51.215618 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 544/1086] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 14:29:48 2022] POST /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/action => generated 0 bytes in 3212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:29:51.220939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-92b2cae5-c232-4f5f-ac21-bfc6d6b33917 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5f108b0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:51.234717 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f02f65b4-fc2b-45cf-98f4-a58555a7b6e0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1311 microversion: 2.1 time: 0.375699 Jul 14 14:29:51.264003 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 543/1087] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:50 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1311 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:51.280675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5eec9ab7-ae8a-402e-b6d7-f61ef9a0ef94 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:51.307229 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:29:51.307229 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:29:51.309678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5eec9ab7-ae8a-402e-b6d7-f61ef9a0ef94 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:51.317624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5eec9ab7-ae8a-402e-b6d7-f61ef9a0ef94 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:51.318560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5eec9ab7-ae8a-402e-b6d7-f61ef9a0ef94 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:51.319015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5eec9ab7-ae8a-402e-b6d7-f61ef9a0ef94 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:51.327880 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-92b2cae5-c232-4f5f-ac21-bfc6d6b33917 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be" status: 200 len: 1427 microversion: 2.1 time: 0.110936 Jul 14 14:29:51.328635 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 545/1088] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:51 2022] GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:51.344679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-52b76e11-ddbc-4837-a348-8a0632ced859 req-c0dd10a2-e08b-4c10-814c-7cea602b8ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a0d92d-ba81-48f5-aa28-a62a0026c47a", "name": "network-vif-plugged", "status": "completed", "tag": "dfbfc888-8b45-4b44-b669-8df623f935de"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:51.363887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-52b76e11-ddbc-4837-a348-8a0632ced859 req-c0dd10a2-e08b-4c10-814c-7cea602b8ccc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:51.364625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-52b76e11-ddbc-4837-a348-8a0632ced859 req-c0dd10a2-e08b-4c10-814c-7cea602b8ccc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:51.385112 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5eec9ab7-ae8a-402e-b6d7-f61ef9a0ef94 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.118931 Jul 14 14:29:51.386150 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 544/1089] 10.222.0.81 () {58 vars in 1175 bytes} [Thu Jul 14 14:29:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:51.388585 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-52b76e11-ddbc-4837-a348-8a0632ced859 req-c0dd10a2-e08b-4c10-814c-7cea602b8ccc service nova] Creating event network-vif-plugged:dfbfc888-8b45-4b44-b669-8df623f935de for instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a on n-h1-767704-28 Jul 14 14:29:51.391117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9d3718e2-1019-49a2-8de1-dd82bffde072 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:51.392102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9d3718e2-1019-49a2-8de1-dd82bffde072 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:51.401743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d3718e2-1019-49a2-8de1-dd82bffde072 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:51.402519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d3718e2-1019-49a2-8de1-dd82bffde072 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:51.403546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d3718e2-1019-49a2-8de1-dd82bffde072 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:51.404356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d3718e2-1019-49a2-8de1-dd82bffde072 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:51.414020 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-52b76e11-ddbc-4837-a348-8a0632ced859 req-c0dd10a2-e08b-4c10-814c-7cea602b8ccc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080281 Jul 14 14:29:51.418417 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 546/1090] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:51.428402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-84530656-1989-4548-b830-ceff88f2795d tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] Calling method '.version_select at 0x7fd6c5fcf0d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:51.751654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-9d3718e2-1019-49a2-8de1-dd82bffde072 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:51.810193 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9d3718e2-1019-49a2-8de1-dd82bffde072 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.422635 Jul 14 14:29:51.811060 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 545/1091] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:51 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:51.824327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e4d6bce4-e880-460f-b0d8-925ebaa84901 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:51.826560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e4d6bce4-e880-460f-b0d8-925ebaa84901 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:51.839814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4d6bce4-e880-460f-b0d8-925ebaa84901 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:51.855442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4d6bce4-e880-460f-b0d8-925ebaa84901 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:51.856573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4d6bce4-e880-460f-b0d8-925ebaa84901 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:51.859155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4d6bce4-e880-460f-b0d8-925ebaa84901 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:52.705301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e4d6bce4-e880-460f-b0d8-925ebaa84901 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:52.716623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e4d6bce4-e880-460f-b0d8-925ebaa84901 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:52.739470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e4d6bce4-e880-460f-b0d8-925ebaa84901 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:52.742363 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e4d6bce4-e880-460f-b0d8-925ebaa84901 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.930006 Jul 14 14:29:52.747880 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 546/1092] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:51 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:52.753231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0d1def46-da4d-4667-83da-3cb1aee888b2 req-5c736632-e1fe-4ca1-b347-d5b59e50d5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9502c4d-a29b-45e0-9f2c-394c7661113c", "tag": "3235c8eb-35a1-462b-ab85-9b68b3253f75"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:52.776187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0d1def46-da4d-4667-83da-3cb1aee888b2 req-5c736632-e1fe-4ca1-b347-d5b59e50d5e9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:52.776858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0d1def46-da4d-4667-83da-3cb1aee888b2 req-5c736632-e1fe-4ca1-b347-d5b59e50d5e9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:52.806261 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0d1def46-da4d-4667-83da-3cb1aee888b2 req-5c736632-e1fe-4ca1-b347-d5b59e50d5e9 service nova] Creating event network-changed:3235c8eb-35a1-462b-ab85-9b68b3253f75 for instance f9502c4d-a29b-45e0-9f2c-394c7661113c on n-h2-767704-28 Jul 14 14:29:52.813508 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0d1def46-da4d-4667-83da-3cb1aee888b2 req-5c736632-e1fe-4ca1-b347-d5b59e50d5e9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064012 Jul 14 14:29:52.836834 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 547/1093] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:52.843167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b5158e0-c2a9-4349-8f5b-531628aa0bc5 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:52.856077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0b5158e0-c2a9-4349-8f5b-531628aa0bc5 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:52.869686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b5158e0-c2a9-4349-8f5b-531628aa0bc5 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:52.870297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b5158e0-c2a9-4349-8f5b-531628aa0bc5 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:52.871238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b5158e0-c2a9-4349-8f5b-531628aa0bc5 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:52.871683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b5158e0-c2a9-4349-8f5b-531628aa0bc5 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:53.304628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0b5158e0-c2a9-4349-8f5b-531628aa0bc5 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:53.324529 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0b5158e0-c2a9-4349-8f5b-531628aa0bc5 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1319 microversion: 2.1 time: 0.485909 Jul 14 14:29:53.328387 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 548/1094] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:52 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:53.348341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bab8ecbd-f357-4295-9c01-aec74705368e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:53.348341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bab8ecbd-f357-4295-9c01-aec74705368e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:53.368252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bab8ecbd-f357-4295-9c01-aec74705368e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:53.368933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bab8ecbd-f357-4295-9c01-aec74705368e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:53.378929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bab8ecbd-f357-4295-9c01-aec74705368e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:53.380589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bab8ecbd-f357-4295-9c01-aec74705368e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:53.865320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bab8ecbd-f357-4295-9c01-aec74705368e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:53.881556 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bab8ecbd-f357-4295-9c01-aec74705368e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1311 microversion: 2.1 time: 0.548887 Jul 14 14:29:53.882153 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 549/1095] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:53 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1311 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:53.890236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-967606fa-82f7-4c37-b64f-a3bb82ce0a7d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c59d9e50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:53.965670 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-967606fa-82f7-4c37-b64f-a3bb82ce0a7d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be" status: 200 len: 1427 microversion: 2.1 time: 0.079186 Jul 14 14:29:53.967536 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 550/1096] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:53 2022] GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:53.978136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b3b40ef6-c7a7-445f-bb12-1fa8f5972ecd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:53.980740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b3b40ef6-c7a7-445f-bb12-1fa8f5972ecd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:53.997879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3b40ef6-c7a7-445f-bb12-1fa8f5972ecd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:53.998488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3b40ef6-c7a7-445f-bb12-1fa8f5972ecd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:53.999701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3b40ef6-c7a7-445f-bb12-1fa8f5972ecd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:54.000837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3b40ef6-c7a7-445f-bb12-1fa8f5972ecd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:54.131381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-b3b40ef6-c7a7-445f-bb12-1fa8f5972ecd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:54.138780 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-84530656-1989-4548-b830-ceff88f2795d tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/bc4b8791-96c7-43b9-98e4-9a2eef876fa0" status: 202 len: 0 microversion: 2.1 time: 2.718926 Jul 14 14:29:54.140440 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 547/1097] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:29:51 2022] DELETE /compute/v2.1/os-floating-ips/bc4b8791-96c7-43b9-98e4-9a2eef876fa0 => generated 0 bytes in 2721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:29:54.146366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fc5c99ce-6e34-497c-9ed0-5f1033f81019 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:54.147120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fc5c99ce-6e34-497c-9ed0-5f1033f81019 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:54.161436 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b3b40ef6-c7a7-445f-bb12-1fa8f5972ecd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1929 microversion: 2.75 time: 0.192380 Jul 14 14:29:54.162082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc5c99ce-6e34-497c-9ed0-5f1033f81019 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:54.162851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc5c99ce-6e34-497c-9ed0-5f1033f81019 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:54.164094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc5c99ce-6e34-497c-9ed0-5f1033f81019 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:54.165128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc5c99ce-6e34-497c-9ed0-5f1033f81019 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:54.172500 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 551/1098] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:53 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1929 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:54.185591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d0c29c8c-3c89-40da-b2c4-18460a91cf14 tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] Calling method '.version_select at 0x7fd6c5b98160>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:54.816850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fc5c99ce-6e34-497c-9ed0-5f1033f81019 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:54.829555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fc5c99ce-6e34-497c-9ed0-5f1033f81019 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:54.831587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fc5c99ce-6e34-497c-9ed0-5f1033f81019 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:54.839765 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fc5c99ce-6e34-497c-9ed0-5f1033f81019 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.698122 Jul 14 14:29:54.841668 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 548/1099] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:54 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:54.847839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4484e498-eefa-4acc-a41b-49fcfcef5439 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:54.848994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4484e498-eefa-4acc-a41b-49fcfcef5439 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:54.876520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4484e498-eefa-4acc-a41b-49fcfcef5439 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:54.882348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4484e498-eefa-4acc-a41b-49fcfcef5439 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:54.884054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4484e498-eefa-4acc-a41b-49fcfcef5439 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:54.888549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4484e498-eefa-4acc-a41b-49fcfcef5439 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:55.335372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4484e498-eefa-4acc-a41b-49fcfcef5439 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:55.347524 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4484e498-eefa-4acc-a41b-49fcfcef5439 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1319 microversion: 2.1 time: 0.504537 Jul 14 14:29:55.357682 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 549/1100] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:54 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:55.364999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3290a2c3-182b-449f-8f36-67002afddfe4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9791977-2e40-4bfc-bd25-0b0244b36b02", "device": "/dev/xvdb"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:55.367020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3290a2c3-182b-449f-8f36-67002afddfe4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:55.373639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3290a2c3-182b-449f-8f36-67002afddfe4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:55.374408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3290a2c3-182b-449f-8f36-67002afddfe4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:55.375428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3290a2c3-182b-449f-8f36-67002afddfe4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:55.376089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3290a2c3-182b-449f-8f36-67002afddfe4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:55.428557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:55.797914 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3290a2c3-182b-449f-8f36-67002afddfe4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "POST /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438530 Jul 14 14:29:55.799052 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 550/1101] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:29:55 2022] POST /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:29:55.806823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-13e07f69-790e-43c8-a134-224e287df70c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:55.807835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-13e07f69-790e-43c8-a134-224e287df70c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:55.815977 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d0c29c8c-3c89-40da-b2c4-18460a91cf14 tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/a7da214f-0b28-4306-bd21-ff486dbe5f55" status: 202 len: 0 microversion: 2.1 time: 1.641204 Jul 14 14:29:55.818501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13e07f69-790e-43c8-a134-224e287df70c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:55.819186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13e07f69-790e-43c8-a134-224e287df70c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:55.819638 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 552/1102] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:29:54 2022] DELETE /compute/v2.1/os-floating-ips/a7da214f-0b28-4306-bd21-ff486dbe5f55 => generated 0 bytes in 1646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:29:55.820657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13e07f69-790e-43c8-a134-224e287df70c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:55.822493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13e07f69-790e-43c8-a134-224e287df70c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:55.825337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af58aba6-b538-43e8-9969-15f605c1643d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c59d9790>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:55.893450 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-af58aba6-b538-43e8-9969-15f605c1643d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be" status: 200 len: 1436 microversion: 2.1 time: 0.072464 Jul 14 14:29:55.894576 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 553/1103] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:55 2022] GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be => generated 1436 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:56.027509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-13e07f69-790e-43c8-a134-224e287df70c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:56.036134 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-13e07f69-790e-43c8-a134-224e287df70c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1461 microversion: 2.1 time: 0.235703 Jul 14 14:29:56.037022 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 551/1104] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:55 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1461 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:56.045093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a8a29090-c8c6-449e-9679-2eee90a5e959 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:56.045093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a8a29090-c8c6-449e-9679-2eee90a5e959 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:56.049998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8a29090-c8c6-449e-9679-2eee90a5e959 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:56.050458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8a29090-c8c6-449e-9679-2eee90a5e959 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:56.051507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8a29090-c8c6-449e-9679-2eee90a5e959 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:56.051957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8a29090-c8c6-449e-9679-2eee90a5e959 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:56.077812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f496cf8d-4af0-4aed-b33f-ee008b8a18c8 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Calling method '.version_select at 0x7fd6c5b6eee0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:56.109650 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f496cf8d-4af0-4aed-b33f-ee008b8a18c8 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] HTTP exception thrown: Image not found. Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f496cf8d-4af0-4aed-b33f-ee008b8a18c8 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Request method failure captured: Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/images/8af58a4d-d4c5-4ddd-9fd7-70981959ee61/metadata/os_distro HTTP/1.1 Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0ChiL0cYSQky5i4-CtffUnFGKLxl5mHfhUL4fOMCQPLzWIlQ48TwoJY_DuDd6HarqLxhfergiCET45z0K8m4zufo_OdRB_RkFnTD8E4jQO1FFmwQL56IeGIajEDiUbMAWkvdqk5mIcN9FXfFO1Z6UkpCA03BV0TUhHX7ryhK9Y6ZWdU Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 39efdf5662c443ca8d0211cf88664e0f Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:29:56.116372 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/39efdf5662c443ca8d0211cf88664e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/39efdf5662c443ca8d0211cf88664e0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_39efdf5662c443ca8d0211cf88664e0f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/39efdf5662c443ca8d0211cf88664e0f"}]}] Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 39efdf5662c443ca8d0211cf88664e0f Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesMetadataNegativeTestJSON-920995616-project Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 419f1e9ba477445db4783022fcfbbe95 Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-920995616-project Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'image_id': '8af58a4d-d4c5-4ddd-9fd7-70981959ee61', 'id': 'os_distro'} Jul 14 14:29:56.118752 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:56.119714 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8af58a4d-d4c5-4ddd-9fd7-70981959ee61 Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:56.120940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8af58a4d-d4c5-4ddd-9fd7-70981959ee61 could not be found. Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:29:56.124595 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:56.130703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f496cf8d-4af0-4aed-b33f-ee008b8a18c8 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:56.133956 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f496cf8d-4af0-4aed-b33f-ee008b8a18c8 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] 10.222.0.81 "DELETE /compute/v2.1/images/8af58a4d-d4c5-4ddd-9fd7-70981959ee61/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.232294 Jul 14 14:29:56.133956 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 554/1105] 10.222.0.81 () {58 vars in 1292 bytes} [Thu Jul 14 14:29:55 2022] DELETE /compute/v2.1/images/8af58a4d-d4c5-4ddd-9fd7-70981959ee61/metadata/os_distro => generated 62 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:29:56.142843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e95c13a-b5e0-4837-9431-c0f87c22e8c0 tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] Calling method '.version_select at 0x7fd6c5a2ab80>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:56.163086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-a8a29090-c8c6-449e-9679-2eee90a5e959 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:56.203726 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a8a29090-c8c6-449e-9679-2eee90a5e959 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1935 microversion: 2.75 time: 0.165437 Jul 14 14:29:56.205111 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 552/1106] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:56 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1935 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:56.211010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-14fd2ac2-0588-4107-a357-cd226aff2b50 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:56.211956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-14fd2ac2-0588-4107-a357-cd226aff2b50 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:56.219142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14fd2ac2-0588-4107-a357-cd226aff2b50 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:56.219851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14fd2ac2-0588-4107-a357-cd226aff2b50 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:56.220850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14fd2ac2-0588-4107-a357-cd226aff2b50 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:56.221488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14fd2ac2-0588-4107-a357-cd226aff2b50 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:56.601601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-14fd2ac2-0588-4107-a357-cd226aff2b50 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:56.624072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:29:56.632301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-14fd2ac2-0588-4107-a357-cd226aff2b50 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:56.636938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-14fd2ac2-0588-4107-a357-cd226aff2b50 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:56.640217 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-14fd2ac2-0588-4107-a357-cd226aff2b50 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.433798 Jul 14 14:29:56.641327 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 553/1107] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:56 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:56.655568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-040ce685-97dd-42ff-8190-288e2ca4df39 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5c323a0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:56.708644 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-040ce685-97dd-42ff-8190-288e2ca4df39 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be" status: 200 len: 1436 microversion: 2.1 time: 0.065115 Jul 14 14:29:56.709896 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 554/1108] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:29:56 2022] GET /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be => generated 1436 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:56.718977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0790ea58-683a-4361-8505-7053f680be45 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:56.719950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0790ea58-683a-4361-8505-7053f680be45 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:56.731970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0790ea58-683a-4361-8505-7053f680be45 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:56.732560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0790ea58-683a-4361-8505-7053f680be45 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:56.733556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0790ea58-683a-4361-8505-7053f680be45 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:56.736601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0790ea58-683a-4361-8505-7053f680be45 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:57.074803 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0790ea58-683a-4361-8505-7053f680be45 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1614 microversion: 2.1 time: 0.363557 Jul 14 14:29:57.075570 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 555/1109] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:56 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1614 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:57.081192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8a4c1ac-742c-4371-b9ca-8b649f20ad96 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Calling method '.version_select at 0x7fd6c5c32160>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:57.112143 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-d8a4c1ac-742c-4371-b9ca-8b649f20ad96 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] HTTP exception thrown: Image not found. Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8a4c1ac-742c-4371-b9ca-8b649f20ad96 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Request method failure captured: Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/images/c432d319-0c66-4ab1-b57a-01c3712b1e69/metadata/os_version HTTP/1.1 Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0ChiL0cYSQky5i4-CtffUnFGKLxl5mHfhUL4fOMCQPLzWIlQ48TwoJY_DuDd6HarqLxhfergiCET45z0K8m4zufo_OdRB_RkFnTD8E4jQO1FFmwQL56IeGIajEDiUbMAWkvdqk5mIcN9FXfFO1Z6UkpCA03BV0TUhHX7ryhK9Y6ZWdU Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 39efdf5662c443ca8d0211cf88664e0f Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:29:57.121995 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/39efdf5662c443ca8d0211cf88664e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/39efdf5662c443ca8d0211cf88664e0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_39efdf5662c443ca8d0211cf88664e0f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/39efdf5662c443ca8d0211cf88664e0f"}]}] Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 39efdf5662c443ca8d0211cf88664e0f Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesMetadataNegativeTestJSON-920995616-project Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 419f1e9ba477445db4783022fcfbbe95 Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-920995616-project Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: exception: Image not found. Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'image_id': 'c432d319-0c66-4ab1-b57a-01c3712b1e69', 'id': 'os_version'} Jul 14 14:29:57.124882 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:57.126671 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c432d319-0c66-4ab1-b57a-01c3712b1e69 Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:57.128752 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c432d319-0c66-4ab1-b57a-01c3712b1e69 could not be found. Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:29:57.135355 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.137927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8a4c1ac-742c-4371-b9ca-8b649f20ad96 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Returning 404 to user: Image not found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:57.140464 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8a4c1ac-742c-4371-b9ca-8b649f20ad96 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] 10.222.0.81 "GET /compute/v2.1/images/c432d319-0c66-4ab1-b57a-01c3712b1e69/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.050423 Jul 14 14:29:57.140464 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 556/1110] 10.222.0.81 () {58 vars in 1292 bytes} [Thu Jul 14 14:29:57 2022] GET /compute/v2.1/images/c432d319-0c66-4ab1-b57a-01c3712b1e69/metadata/os_version => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:29:57.147356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bce0db62-14f1-4e1f-b20a-461a55a5587a tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:57.148175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bce0db62-14f1-4e1f-b20a-461a55a5587a tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:57.156818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bce0db62-14f1-4e1f-b20a-461a55a5587a tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:57.157405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bce0db62-14f1-4e1f-b20a-461a55a5587a tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:57.158353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bce0db62-14f1-4e1f-b20a-461a55a5587a tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:57.158821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bce0db62-14f1-4e1f-b20a-461a55a5587a tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:57.376824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bce0db62-14f1-4e1f-b20a-461a55a5587a tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:57.389077 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bce0db62-14f1-4e1f-b20a-461a55a5587a tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1319 microversion: 2.1 time: 0.251627 Jul 14 14:29:57.389647 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 557/1111] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:57 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:57.395896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-081b9e63-9f84-4bb2-a5bd-fe3b9536a33a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:57.396935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-081b9e63-9f84-4bb2-a5bd-fe3b9536a33a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:57.405772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-081b9e63-9f84-4bb2-a5bd-fe3b9536a33a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:57.406236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-081b9e63-9f84-4bb2-a5bd-fe3b9536a33a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:57.407039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-081b9e63-9f84-4bb2-a5bd-fe3b9536a33a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:57.407489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-081b9e63-9f84-4bb2-a5bd-fe3b9536a33a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:57.615734 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5e95c13a-b5e0-4837-9431-c0f87c22e8c0 tempest-FloatingIPDetailsTestJSON-1826692354 tempest-FloatingIPDetailsTestJSON-1826692354-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/4e4d2c6c-f956-468c-808f-797a404f82b4" status: 202 len: 0 microversion: 2.1 time: 1.477081 Jul 14 14:29:57.620016 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 555/1112] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:29:56 2022] DELETE /compute/v2.1/os-floating-ips/4e4d2c6c-f956-468c-808f-797a404f82b4 => generated 0 bytes in 1488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:29:57.626188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dc726ed6-19f7-40be-a6bb-c7a692c1d2d8 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:57.626981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dc726ed6-19f7-40be-a6bb-c7a692c1d2d8 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:57.637391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc726ed6-19f7-40be-a6bb-c7a692c1d2d8 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:57.638743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc726ed6-19f7-40be-a6bb-c7a692c1d2d8 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:57.639815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc726ed6-19f7-40be-a6bb-c7a692c1d2d8 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:57.642305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc726ed6-19f7-40be-a6bb-c7a692c1d2d8 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:57.662986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-081b9e63-9f84-4bb2-a5bd-fe3b9536a33a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:57.673348 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-081b9e63-9f84-4bb2-a5bd-fe3b9536a33a tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1480 microversion: 2.1 time: 0.282345 Jul 14 14:29:57.674095 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 558/1113] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:57 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1480 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:57.681599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2cc39976-7e20-444d-9f29-aa204df98cfe tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Calling method '.version_select at 0x7fd6c5c8b8b0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:57.703440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dc726ed6-19f7-40be-a6bb-c7a692c1d2d8 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3e010174b0434d87862b7ffefa31545a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0626a20cd20e4d1f8e4985dce7bb00df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:57.704296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dc726ed6-19f7-40be-a6bb-c7a692c1d2d8 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] flavor_id is None. Assuming migration. {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 14 14:29:57.705489 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-2cc39976-7e20-444d-9f29-aa204df98cfe tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] HTTP exception thrown: Image not found. Jul 14 14:29:57.707168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dc726ed6-19f7-40be-a6bb-c7a692c1d2d8 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2cc39976-7e20-444d-9f29-aa204df98cfe tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Request method failure captured: Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/images/e0876bd8-906c-43b6-8356-5178e70e0135/metadata HTTP/1.1 Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0ChiL0cYSQky5i4-CtffUnFGKLxl5mHfhUL4fOMCQPLzWIlQ48TwoJY_DuDd6HarqLxhfergiCET45z0K8m4zufo_OdRB_RkFnTD8E4jQO1FFmwQL56IeGIajEDiUbMAWkvdqk5mIcN9FXfFO1Z6UkpCA03BV0TUhHX7ryhK9Y6ZWdU Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 39efdf5662c443ca8d0211cf88664e0f Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:29:57.708070 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/39efdf5662c443ca8d0211cf88664e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/39efdf5662c443ca8d0211cf88664e0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_39efdf5662c443ca8d0211cf88664e0f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/39efdf5662c443ca8d0211cf88664e0f"}]}] Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 39efdf5662c443ca8d0211cf88664e0f Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesMetadataNegativeTestJSON-920995616-project Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 419f1e9ba477445db4783022fcfbbe95 Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-920995616-project Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: exception: Image not found. Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'image_id': 'e0876bd8-906c-43b6-8356-5178e70e0135'} Jul 14 14:29:57.709806 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:57.710811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e0876bd8-906c-43b6-8356-5178e70e0135 Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:57.712261 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e0876bd8-906c-43b6-8356-5178e70e0135 could not be found. Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:29:57.713776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.715173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2cc39976-7e20-444d-9f29-aa204df98cfe tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Returning 404 to user: Image not found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:57.722020 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2cc39976-7e20-444d-9f29-aa204df98cfe tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] 10.222.0.81 "GET /compute/v2.1/images/e0876bd8-906c-43b6-8356-5178e70e0135/metadata" status: 404 len: 62 microversion: 2.1 time: 0.040326 Jul 14 14:29:57.722020 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 559/1114] 10.222.0.81 () {58 vars in 1259 bytes} [Thu Jul 14 14:29:57 2022] GET /compute/v2.1/images/e0876bd8-906c-43b6-8356-5178e70e0135/metadata => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:29:57.724979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-933cf6bf-af84-4157-933c-8135ed07f9a7 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:57.724979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-933cf6bf-af84-4157-933c-8135ed07f9a7 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:57.733080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-933cf6bf-af84-4157-933c-8135ed07f9a7 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:57.733643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-933cf6bf-af84-4157-933c-8135ed07f9a7 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:57.734706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-933cf6bf-af84-4157-933c-8135ed07f9a7 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:57.735251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-933cf6bf-af84-4157-933c-8135ed07f9a7 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:57.819449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-933cf6bf-af84-4157-933c-8135ed07f9a7 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:57.843565 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-933cf6bf-af84-4157-933c-8135ed07f9a7 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1935 microversion: 2.75 time: 0.124979 Jul 14 14:29:57.844537 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 560/1115] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:57 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1935 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:57.850397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c40d4e75-4acb-4ec8-864e-95e69f25e0a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:57.851283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c40d4e75-4acb-4ec8-864e-95e69f25e0a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:57.858724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c40d4e75-4acb-4ec8-864e-95e69f25e0a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:57.859573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c40d4e75-4acb-4ec8-864e-95e69f25e0a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:57.860768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c40d4e75-4acb-4ec8-864e-95e69f25e0a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:57.861300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c40d4e75-4acb-4ec8-864e-95e69f25e0a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:57.918602 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dc726ed6-19f7-40be-a6bb-c7a692c1d2d8 tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a/action" status: 202 len: 0 microversion: 2.1 time: 0.300156 Jul 14 14:29:57.920014 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 556/1116] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:29:57 2022] POST /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:29:57.927833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-83034591-ea20-4944-8af5-bd93bc929547 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Action: 'update_all', calling method: .version_select at 0x7fd6c5b98160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:57.964396 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-83034591-ea20-4944-8af5-bd93bc929547 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] HTTP exception thrown: Image not found. Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-83034591-ea20-4944-8af5-bd93bc929547 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Request method failure captured: Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: request: PUT /compute/v2.1/images/99d40f0c-c76e-4d56-8546-f538f1416130/metadata HTTP/1.1 Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 57 Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0ChiL0cYSQky5i4-CtffUnFGKLxl5mHfhUL4fOMCQPLzWIlQ48TwoJY_DuDd6HarqLxhfergiCET45z0K8m4zufo_OdRB_RkFnTD8E4jQO1FFmwQL56IeGIajEDiUbMAWkvdqk5mIcN9FXfFO1Z6UkpCA03BV0TUhHX7ryhK9Y6ZWdU Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 39efdf5662c443ca8d0211cf88664e0f Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:29:57.968803 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/39efdf5662c443ca8d0211cf88664e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/39efdf5662c443ca8d0211cf88664e0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_39efdf5662c443ca8d0211cf88664e0f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/39efdf5662c443ca8d0211cf88664e0f"}]}] Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 39efdf5662c443ca8d0211cf88664e0f Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesMetadataNegativeTestJSON-920995616-project Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 419f1e9ba477445db4783022fcfbbe95 Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-920995616-project Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:29:57.970495 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'image_id': '99d40f0c-c76e-4d56-8546-f538f1416130', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:57.971558 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 99d40f0c-c76e-4d56-8546-f538f1416130 Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:57.972859 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 99d40f0c-c76e-4d56-8546-f538f1416130 could not be found. Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:57.975532 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:29:57.979005 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:57.981582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-83034591-ea20-4944-8af5-bd93bc929547 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:57.987870 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-83034591-ea20-4944-8af5-bd93bc929547 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] 10.222.0.81 "PUT /compute/v2.1/images/99d40f0c-c76e-4d56-8546-f538f1416130/metadata" status: 404 len: 62 microversion: 2.1 time: 0.066436 Jul 14 14:29:57.995829 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 557/1117] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:29:57 2022] PUT /compute/v2.1/images/99d40f0c-c76e-4d56-8546-f538f1416130/metadata => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:29:58.012650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2c39914f-ffad-4784-8118-f212449ef506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:58.015656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2c39914f-ffad-4784-8118-f212449ef506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:58.053617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c39914f-ffad-4784-8118-f212449ef506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:58.055476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c39914f-ffad-4784-8118-f212449ef506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:58.060237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c39914f-ffad-4784-8118-f212449ef506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:58.063614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c39914f-ffad-4784-8118-f212449ef506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:58.362924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c40d4e75-4acb-4ec8-864e-95e69f25e0a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:58.375105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c40d4e75-4acb-4ec8-864e-95e69f25e0a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:58.379102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c40d4e75-4acb-4ec8-864e-95e69f25e0a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:58.393928 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c40d4e75-4acb-4ec8-864e-95e69f25e0a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.548079 Jul 14 14:29:58.394875 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 561/1118] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:57 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:58.409099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-93f17500-f259-41e2-8861-98c55f1c8568 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Action: 'update', calling method: .version_select at 0x7fd6c5c32a60>, body: {"meta": {"os_distro": "alt"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:58.440930 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-93f17500-f259-41e2-8861-98c55f1c8568 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] HTTP exception thrown: Image not found. Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-93f17500-f259-41e2-8861-98c55f1c8568 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Request method failure captured: Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: request: PUT /compute/v2.1/images/8a9f26d2-cede-4ade-ba70-3d5999c3005c/metadata/os_distro HTTP/1.1 Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 30 Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0ChiL0cYSQky5i4-CtffUnFGKLxl5mHfhUL4fOMCQPLzWIlQ48TwoJY_DuDd6HarqLxhfergiCET45z0K8m4zufo_OdRB_RkFnTD8E4jQO1FFmwQL56IeGIajEDiUbMAWkvdqk5mIcN9FXfFO1Z6UkpCA03BV0TUhHX7ryhK9Y6ZWdU Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 39efdf5662c443ca8d0211cf88664e0f Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:29:58.443132 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/39efdf5662c443ca8d0211cf88664e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/39efdf5662c443ca8d0211cf88664e0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_39efdf5662c443ca8d0211cf88664e0f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/39efdf5662c443ca8d0211cf88664e0f"}]}] Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 39efdf5662c443ca8d0211cf88664e0f Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesMetadataNegativeTestJSON-920995616-project Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 419f1e9ba477445db4783022fcfbbe95 Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-920995616-project Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: {"meta": {"os_distro": "alt"}} Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: exception: Image not found. Jul 14 14:29:58.444843 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'image_id': '8a9f26d2-cede-4ade-ba70-3d5999c3005c', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:58.446711 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8a9f26d2-cede-4ade-ba70-3d5999c3005c Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:58.447975 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8a9f26d2-cede-4ade-ba70-3d5999c3005c could not be found. Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:58.449411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:29:58.450879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.457231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-93f17500-f259-41e2-8861-98c55f1c8568 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Returning 404 to user: Image not found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:58.457231 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-93f17500-f259-41e2-8861-98c55f1c8568 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] 10.222.0.81 "PUT /compute/v2.1/images/8a9f26d2-cede-4ade-ba70-3d5999c3005c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.058993 Jul 14 14:29:58.457231 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 562/1119] 10.222.0.81 () {60 vars in 1309 bytes} [Thu Jul 14 14:29:58 2022] PUT /compute/v2.1/images/8a9f26d2-cede-4ade-ba70-3d5999c3005c/metadata/os_distro => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:29:58.460800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cccf169e-b13d-4a7d-b20f-52dbcc1b7da7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:58.465911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cccf169e-b13d-4a7d-b20f-52dbcc1b7da7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:58.484028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cccf169e-b13d-4a7d-b20f-52dbcc1b7da7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:58.484493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cccf169e-b13d-4a7d-b20f-52dbcc1b7da7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:58.485495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cccf169e-b13d-4a7d-b20f-52dbcc1b7da7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:58.485832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cccf169e-b13d-4a7d-b20f-52dbcc1b7da7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:58.561692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2c39914f-ffad-4784-8118-f212449ef506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:58.573539 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2c39914f-ffad-4784-8118-f212449ef506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1470 microversion: 2.1 time: 0.577761 Jul 14 14:29:58.574440 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 558/1120] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:57 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1470 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:58.587490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-773a329e-abe2-4783-a89e-112c6d3e9de7 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Action: 'create', calling method: .version_select at 0x7fd6c59ceee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:29:58.622867 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-773a329e-abe2-4783-a89e-112c6d3e9de7 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] HTTP exception thrown: Image not found. Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-773a329e-abe2-4783-a89e-112c6d3e9de7 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Request method failure captured: Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/images/3945302d-6710-4d0d-9881-42f15f53ca09/metadata HTTP/1.1 Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 57 Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0ChiL0cYSQky5i4-CtffUnFGKLxl5mHfhUL4fOMCQPLzWIlQ48TwoJY_DuDd6HarqLxhfergiCET45z0K8m4zufo_OdRB_RkFnTD8E4jQO1FFmwQL56IeGIajEDiUbMAWkvdqk5mIcN9FXfFO1Z6UkpCA03BV0TUhHX7ryhK9Y6ZWdU Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 39efdf5662c443ca8d0211cf88664e0f Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:29:58.625980 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/39efdf5662c443ca8d0211cf88664e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/39efdf5662c443ca8d0211cf88664e0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_39efdf5662c443ca8d0211cf88664e0f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/39efdf5662c443ca8d0211cf88664e0f"}]}] Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 39efdf5662c443ca8d0211cf88664e0f Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-920995616 Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesMetadataNegativeTestJSON-920995616-project Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 419f1e9ba477445db4783022fcfbbe95 Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-920995616-project Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:29:58.627633 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'image_id': '3945302d-6710-4d0d-9881-42f15f53ca09', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:58.629079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3945302d-6710-4d0d-9881-42f15f53ca09 Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:29:58.630411 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3945302d-6710-4d0d-9881-42f15f53ca09 could not be found. Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:29:58.631790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:29:58.634027 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:29:58.637416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-773a329e-abe2-4783-a89e-112c6d3e9de7 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:29:58.638281 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-773a329e-abe2-4783-a89e-112c6d3e9de7 tempest-ImagesMetadataNegativeTestJSON-920995616 tempest-ImagesMetadataNegativeTestJSON-920995616-project] 10.222.0.81 "POST /compute/v2.1/images/3945302d-6710-4d0d-9881-42f15f53ca09/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062869 Jul 14 14:29:58.638866 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 559/1121] 10.222.0.81 () {60 vars in 1280 bytes} [Thu Jul 14 14:29:58 2022] POST /compute/v2.1/images/3945302d-6710-4d0d-9881-42f15f53ca09/metadata => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:29:58.696821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b86d291e-183c-44fa-b35f-1e8111d71b2c tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:58.700117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b86d291e-183c-44fa-b35f-1e8111d71b2c tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:58.727597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b86d291e-183c-44fa-b35f-1e8111d71b2c tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:58.728816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b86d291e-183c-44fa-b35f-1e8111d71b2c tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:58.729705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b86d291e-183c-44fa-b35f-1e8111d71b2c tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:58.730157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b86d291e-183c-44fa-b35f-1e8111d71b2c tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:59.241729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cccf169e-b13d-4a7d-b20f-52dbcc1b7da7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:59.257739 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cccf169e-b13d-4a7d-b20f-52dbcc1b7da7 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1319 microversion: 2.1 time: 0.801192 Jul 14 14:29:59.268045 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 563/1122] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:58 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1319 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:59.274351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6cb944fb-0c4f-4290-99a2-6f8e3da038e0 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:59.276614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6cb944fb-0c4f-4290-99a2-6f8e3da038e0 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:59.285108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6cb944fb-0c4f-4290-99a2-6f8e3da038e0 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:59.285890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6cb944fb-0c4f-4290-99a2-6f8e3da038e0 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:59.286999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6cb944fb-0c4f-4290-99a2-6f8e3da038e0 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:59.287671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6cb944fb-0c4f-4290-99a2-6f8e3da038e0 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:59.340746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b86d291e-183c-44fa-b35f-1e8111d71b2c tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:59.354653 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b86d291e-183c-44fa-b35f-1e8111d71b2c tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1467 microversion: 2.1 time: 0.666161 Jul 14 14:29:59.358202 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 560/1123] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:58 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1467 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:29:59.378594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-94a9e359-a947-4291-9c9f-0245f8ce407c tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c59cee50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:59.496195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-6cb944fb-0c4f-4290-99a2-6f8e3da038e0 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:29:59.541107 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6cb944fb-0c4f-4290-99a2-6f8e3da038e0 tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1935 microversion: 2.75 time: 0.271561 Jul 14 14:29:59.553613 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 564/1124] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:59 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1935 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:59.559998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cb4e09e6-df77-478a-94da-02b50cfc294e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:59.560911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cb4e09e6-df77-478a-94da-02b50cfc294e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:59.580241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb4e09e6-df77-478a-94da-02b50cfc294e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:59.582249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb4e09e6-df77-478a-94da-02b50cfc294e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:59.587849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb4e09e6-df77-478a-94da-02b50cfc294e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:59.589018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb4e09e6-df77-478a-94da-02b50cfc294e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:59.890227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cb4e09e6-df77-478a-94da-02b50cfc294e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:59.915172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cb4e09e6-df77-478a-94da-02b50cfc294e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:59.919842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cb4e09e6-df77-478a-94da-02b50cfc294e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:29:59.921430 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cb4e09e6-df77-478a-94da-02b50cfc294e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.366741 Jul 14 14:29:59.922738 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 565/1125] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:29:59 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:29:59.928895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-088de8cb-c8ed-4948-b80a-b6a6e829a04f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:29:59.929959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-088de8cb-c8ed-4948-b80a-b6a6e829a04f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:29:59.940662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-088de8cb-c8ed-4948-b80a-b6a6e829a04f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:59.941533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-088de8cb-c8ed-4948-b80a-b6a6e829a04f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:59.942760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-088de8cb-c8ed-4948-b80a-b6a6e829a04f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:59.944798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-088de8cb-c8ed-4948-b80a-b6a6e829a04f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:00.282148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-088de8cb-c8ed-4948-b80a-b6a6e829a04f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:00.300311 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-088de8cb-c8ed-4948-b80a-b6a6e829a04f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1470 microversion: 2.1 time: 0.375558 Jul 14 14:30:00.310636 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 566/1126] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:59 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1470 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:00.324757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e38d288c-dc70-441b-9a63-63cceaeed76b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:00.326454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e38d288c-dc70-441b-9a63-63cceaeed76b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:00.364727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e38d288c-dc70-441b-9a63-63cceaeed76b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:00.365239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e38d288c-dc70-441b-9a63-63cceaeed76b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:00.366695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e38d288c-dc70-441b-9a63-63cceaeed76b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:00.367308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e38d288c-dc70-441b-9a63-63cceaeed76b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:00.473653 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-94a9e359-a947-4291-9c9f-0245f8ce407c tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "DELETE /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be" status: 204 len: 0 microversion: 2.1 time: 1.100181 Jul 14 14:30:00.478911 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 561/1127] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:29:59 2022] DELETE /compute/v2.1/images/88c182a6-89e1-48b1-b5f1-b28ec4fb35be => generated 0 bytes in 1102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:30:00.485798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ef88c2e6-cb11-4f3f-b2eb-55f3783ff171 req-22cdc07d-3423-49f6-8f0f-0d811101e46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9502c4d-a29b-45e0-9f2c-394c7661113c", "name": "network-vif-plugged", "status": "completed", "tag": "3235c8eb-35a1-462b-ab85-9b68b3253f75"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:00.506760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ef88c2e6-cb11-4f3f-b2eb-55f3783ff171 req-22cdc07d-3423-49f6-8f0f-0d811101e46b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:00.507735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ef88c2e6-cb11-4f3f-b2eb-55f3783ff171 req-22cdc07d-3423-49f6-8f0f-0d811101e46b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:00.570481 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ef88c2e6-cb11-4f3f-b2eb-55f3783ff171 req-22cdc07d-3423-49f6-8f0f-0d811101e46b service nova] Creating event network-vif-plugged:3235c8eb-35a1-462b-ab85-9b68b3253f75 for instance f9502c4d-a29b-45e0-9f2c-394c7661113c on n-h2-767704-28 Jul 14 14:30:00.587680 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ef88c2e6-cb11-4f3f-b2eb-55f3783ff171 req-22cdc07d-3423-49f6-8f0f-0d811101e46b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103392 Jul 14 14:30:00.588910 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 562/1128] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:00.627812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6aef8d10-f0ce-4b36-9e00-468677cb19e2 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '.version_select at 0x7fd6c5b58ca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:00.720633 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-6aef8d10-f0ce-4b36-9e00-468677cb19e2 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] HTTP exception thrown: Image not found. Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6aef8d10-f0ce-4b36-9e00-468677cb19e2 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Request method failure captured: Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 HTTP/1.1 Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CgXvQPA87KbGZwv1pQKsJkOub-iLzvOLXuxsxg2gEJHLX6KaXzQPNx77EP84HeAbxjgm_3rdZOEKdXszeJP5W6hWUEjV8m771crkuM2-XL9p2A6o2j9erPb2oDC3Rph-V6QfZLW4WLgDb-iMOg-C__0K8lIJcJK6Dpxg_fN1sthfNU Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 52d830f4fd184c54a15647e148c3590e Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesOneServerTestJSON-629675890 Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:30:00.722792 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d830f4fd184c54a15647e148c3590e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d830f4fd184c54a15647e148c3590e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d830f4fd184c54a15647e148c3590e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d830f4fd184c54a15647e148c3590e"}]}] Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesOneServerTestJSON-629675890 Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 52d830f4fd184c54a15647e148c3590e Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-629675890 Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesOneServerTestJSON-629675890-project Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4bfee07cac2b472a9f8ba7d0e4a67580 Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesOneServerTestJSON-629675890-project Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'ac4283cb-3a9f-426c-8494-2cdfda85cee4'} Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:00.724727 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ac4283cb-3a9f-426c-8494-2cdfda85cee4 to delete Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:00.725812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac4283cb-3a9f-426c-8494-2cdfda85cee4 could not be found. Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:00.727219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:30:00.728836 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:30:00.728836 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:30:00.728836 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:00.728836 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:00.728836 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:00.728836 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:00.728836 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:00.728836 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:00.728836 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:00.728836 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:00.728836 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:30:00.728836 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:00.734082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e38d288c-dc70-441b-9a63-63cceaeed76b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:00.735134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6aef8d10-f0ce-4b36-9e00-468677cb19e2 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:00.736194 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6aef8d10-f0ce-4b36-9e00-468677cb19e2 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "DELETE /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4" status: 404 len: 62 microversion: 2.1 time: 0.145956 Jul 14 14:30:00.738265 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 563/1129] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:00 2022] DELETE /compute/v2.1/images/ac4283cb-3a9f-426c-8494-2cdfda85cee4 => generated 62 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:30:00.749863 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e38d288c-dc70-441b-9a63-63cceaeed76b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1319 microversion: 2.1 time: 0.437529 Jul 14 14:30:00.753498 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 567/1130] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:00 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:00.754629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c1e3badf-3799-4599-8634-7ec233901dbd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:00.756070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c1e3badf-3799-4599-8634-7ec233901dbd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:00.771748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-28da72a9-fc6e-4765-9c69-44a44104feb8 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:00.771748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-28da72a9-fc6e-4765-9c69-44a44104feb8 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:00.775300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1e3badf-3799-4599-8634-7ec233901dbd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:00.775947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1e3badf-3799-4599-8634-7ec233901dbd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:00.776916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1e3badf-3799-4599-8634-7ec233901dbd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:00.777749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1e3badf-3799-4599-8634-7ec233901dbd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:00.778254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28da72a9-fc6e-4765-9c69-44a44104feb8 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:00.778811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28da72a9-fc6e-4765-9c69-44a44104feb8 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:00.779698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28da72a9-fc6e-4765-9c69-44a44104feb8 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:00.780263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28da72a9-fc6e-4765-9c69-44a44104feb8 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:00.841007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-28da72a9-fc6e-4765-9c69-44a44104feb8 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:30:00.950060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:00.963264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-c1e3badf-3799-4599-8634-7ec233901dbd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] Lazy-loading 'services' on Instance uuid 7139fba6-dada-4dd5-8378-04feab6a2d30 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:30:01.001398 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-28da72a9-fc6e-4765-9c69-44a44104feb8 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "DELETE /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 204 len: 0 microversion: 2.1 time: 0.243918 Jul 14 14:30:01.002896 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 568/1131] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:30:00 2022] DELETE /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:30:01.021465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ac049b6-3354-4bb9-87a9-4eecc7510b53 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:01.022572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6ac049b6-3354-4bb9-87a9-4eecc7510b53 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:01.030664 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c1e3badf-3799-4599-8634-7ec233901dbd tempest-ServersAdmin275Test-1360557006 tempest-ServersAdmin275Test-1360557006-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1920 microversion: 2.75 time: 0.287006 Jul 14 14:30:01.033890 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 564/1132] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:00 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1920 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:01.037834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ac049b6-3354-4bb9-87a9-4eecc7510b53 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:01.038962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ac049b6-3354-4bb9-87a9-4eecc7510b53 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:01.044373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3bb1ee21-133a-49c5-9a8f-bea02a342ebb tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:01.045471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ac049b6-3354-4bb9-87a9-4eecc7510b53 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:01.046019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ac049b6-3354-4bb9-87a9-4eecc7510b53 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:01.049538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3bb1ee21-133a-49c5-9a8f-bea02a342ebb tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:01.058752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bb1ee21-133a-49c5-9a8f-bea02a342ebb tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:01.059646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bb1ee21-133a-49c5-9a8f-bea02a342ebb tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:01.060609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bb1ee21-133a-49c5-9a8f-bea02a342ebb tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:01.061257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bb1ee21-133a-49c5-9a8f-bea02a342ebb tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:01.304786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3bb1ee21-133a-49c5-9a8f-bea02a342ebb tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:01.314659 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3bb1ee21-133a-49c5-9a8f-bea02a342ebb tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1473 microversion: 2.1 time: 0.278980 Jul 14 14:30:01.323088 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 565/1133] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:01 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1473 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:01.328198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-079544ca-5b0e-4ff6-996e-5f6ca5574c49 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:01.333385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-079544ca-5b0e-4ff6-996e-5f6ca5574c49 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:01.341843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6ac049b6-3354-4bb9-87a9-4eecc7510b53 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:01.346441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-079544ca-5b0e-4ff6-996e-5f6ca5574c49 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:01.347362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-079544ca-5b0e-4ff6-996e-5f6ca5574c49 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:01.348328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-079544ca-5b0e-4ff6-996e-5f6ca5574c49 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:01.355672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6ac049b6-3354-4bb9-87a9-4eecc7510b53 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:01.358129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6ac049b6-3354-4bb9-87a9-4eecc7510b53 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:01.359714 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6ac049b6-3354-4bb9-87a9-4eecc7510b53 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.353147 Jul 14 14:30:01.361134 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 569/1134] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:01 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:01.361660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-079544ca-5b0e-4ff6-996e-5f6ca5574c49 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:01.362291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:01.367536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5032be88-03d9-4e2a-bdf0-07614300e01c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:01.368455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5032be88-03d9-4e2a-bdf0-07614300e01c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:01.383138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5032be88-03d9-4e2a-bdf0-07614300e01c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:01.386983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5032be88-03d9-4e2a-bdf0-07614300e01c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:01.388189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5032be88-03d9-4e2a-bdf0-07614300e01c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:01.390292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5032be88-03d9-4e2a-bdf0-07614300e01c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:01.428364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-079544ca-5b0e-4ff6-996e-5f6ca5574c49 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:30:01.516496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:01.577741 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-079544ca-5b0e-4ff6-996e-5f6ca5574c49 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 204 len: 0 microversion: 2.75 time: 0.252356 Jul 14 14:30:01.580066 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 566/1135] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:30:01 2022] DELETE /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:30:01.591819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0a6e4ca8-4a4a-4286-a991-90eda832a7e0 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:01.593116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0a6e4ca8-4a4a-4286-a991-90eda832a7e0 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:01.608800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a6e4ca8-4a4a-4286-a991-90eda832a7e0 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:01.610163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a6e4ca8-4a4a-4286-a991-90eda832a7e0 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:01.613573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a6e4ca8-4a4a-4286-a991-90eda832a7e0 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:01.615571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a6e4ca8-4a4a-4286-a991-90eda832a7e0 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:01.922280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0a6e4ca8-4a4a-4286-a991-90eda832a7e0 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:01.938462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0a6e4ca8-4a4a-4286-a991-90eda832a7e0 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:01.941551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0a6e4ca8-4a4a-4286-a991-90eda832a7e0 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:01.957628 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0a6e4ca8-4a4a-4286-a991-90eda832a7e0 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1443 microversion: 2.75 time: 0.372961 Jul 14 14:30:01.961583 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 567/1136] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:01 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1443 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:30:01.970464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9ad0d61-20c3-47d9-8db1-cf4f45c6773c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:01.972988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c9ad0d61-20c3-47d9-8db1-cf4f45c6773c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:01.988967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9ad0d61-20c3-47d9-8db1-cf4f45c6773c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:01.989687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9ad0d61-20c3-47d9-8db1-cf4f45c6773c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:01.990676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9ad0d61-20c3-47d9-8db1-cf4f45c6773c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:01.993721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9ad0d61-20c3-47d9-8db1-cf4f45c6773c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:02.244117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c9ad0d61-20c3-47d9-8db1-cf4f45c6773c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:02.253565 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c9ad0d61-20c3-47d9-8db1-cf4f45c6773c tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1319 microversion: 2.1 time: 0.290530 Jul 14 14:30:02.257282 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 568/1137] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:01 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:02.340064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a0c56c72-c731-47f3-9bf7-a720f45f8497 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:02.341150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a0c56c72-c731-47f3-9bf7-a720f45f8497 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:02.357243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0c56c72-c731-47f3-9bf7-a720f45f8497 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:02.358232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0c56c72-c731-47f3-9bf7-a720f45f8497 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:02.358464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0c56c72-c731-47f3-9bf7-a720f45f8497 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:02.358862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0c56c72-c731-47f3-9bf7-a720f45f8497 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:02.419013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5032be88-03d9-4e2a-bdf0-07614300e01c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:02.438546 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5032be88-03d9-4e2a-bdf0-07614300e01c tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1470 microversion: 2.1 time: 1.073094 Jul 14 14:30:02.440297 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 570/1138] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:01 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1470 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:02.458019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1a7ca35a-541f-4e52-91b4-5d9a28c902d2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:02.461261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1a7ca35a-541f-4e52-91b4-5d9a28c902d2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:02.488837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a7ca35a-541f-4e52-91b4-5d9a28c902d2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:02.489788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a7ca35a-541f-4e52-91b4-5d9a28c902d2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:02.493820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a7ca35a-541f-4e52-91b4-5d9a28c902d2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:02.494533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a7ca35a-541f-4e52-91b4-5d9a28c902d2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:02.827307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a0c56c72-c731-47f3-9bf7-a720f45f8497 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:02.840015 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a0c56c72-c731-47f3-9bf7-a720f45f8497 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1473 microversion: 2.1 time: 0.504322 Jul 14 14:30:02.840635 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 569/1139] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:02 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1473 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:30:02.854846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-5873d1bd-c5cf-4e59-9f08-a4d3d57324ed req-fcf8dc8a-3646-428f-acc2-4fdeb28b663a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a1b7fb-df82-435c-bf4d-261decd2db5f", "name": "network-vif-unplugged", "status": "completed", "tag": "2f439b9e-ad79-44c1-9bf1-810c6d5786f9"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:02.874476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5873d1bd-c5cf-4e59-9f08-a4d3d57324ed req-fcf8dc8a-3646-428f-acc2-4fdeb28b663a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:02.875271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5873d1bd-c5cf-4e59-9f08-a4d3d57324ed req-fcf8dc8a-3646-428f-acc2-4fdeb28b663a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:02.894419 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-5873d1bd-c5cf-4e59-9f08-a4d3d57324ed req-fcf8dc8a-3646-428f-acc2-4fdeb28b663a service nova] Creating event network-vif-unplugged:2f439b9e-ad79-44c1-9bf1-810c6d5786f9 for instance 90a1b7fb-df82-435c-bf4d-261decd2db5f on n-h2-767704-28 Jul 14 14:30:02.903760 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-5873d1bd-c5cf-4e59-9f08-a4d3d57324ed req-fcf8dc8a-3646-428f-acc2-4fdeb28b663a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060352 Jul 14 14:30:02.906166 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 570/1140] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:02.987093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f46daa49-eade-490f-a0b1-a101e0da54fe tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:02.990368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f46daa49-eade-490f-a0b1-a101e0da54fe tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:03.002071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f46daa49-eade-490f-a0b1-a101e0da54fe tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:03.002581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f46daa49-eade-490f-a0b1-a101e0da54fe tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:03.003498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f46daa49-eade-490f-a0b1-a101e0da54fe tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:03.003946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f46daa49-eade-490f-a0b1-a101e0da54fe tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:03.076529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a7ca35a-541f-4e52-91b4-5d9a28c902d2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:03.087618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a7ca35a-541f-4e52-91b4-5d9a28c902d2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:03.089705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a7ca35a-541f-4e52-91b4-5d9a28c902d2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:03.091981 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1a7ca35a-541f-4e52-91b4-5d9a28c902d2 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.648442 Jul 14 14:30:03.101005 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 571/1141] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:02 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:03.133840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f46daa49-eade-490f-a0b1-a101e0da54fe tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:03.154346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f46daa49-eade-490f-a0b1-a101e0da54fe tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:03.158185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f46daa49-eade-490f-a0b1-a101e0da54fe tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:03.172999 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f46daa49-eade-490f-a0b1-a101e0da54fe tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1443 microversion: 2.75 time: 0.191293 Jul 14 14:30:03.193682 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 571/1142] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:02 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1443 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:30:03.273169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e8c24f37-3e93-4740-ba42-63fbb7c8249d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:03.274997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e8c24f37-3e93-4740-ba42-63fbb7c8249d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:03.295148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8c24f37-3e93-4740-ba42-63fbb7c8249d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:03.296023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8c24f37-3e93-4740-ba42-63fbb7c8249d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:03.297162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8c24f37-3e93-4740-ba42-63fbb7c8249d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:03.298062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8c24f37-3e93-4740-ba42-63fbb7c8249d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:03.350997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:03.478717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f60e98de-f9bd-4e2c-bc4f-596de98f24e6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:03.479519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f60e98de-f9bd-4e2c-bc4f-596de98f24e6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:03.487892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f60e98de-f9bd-4e2c-bc4f-596de98f24e6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:03.488688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f60e98de-f9bd-4e2c-bc4f-596de98f24e6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:03.489816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f60e98de-f9bd-4e2c-bc4f-596de98f24e6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:03.490885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f60e98de-f9bd-4e2c-bc4f-596de98f24e6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:03.793717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e8c24f37-3e93-4740-ba42-63fbb7c8249d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:03.805659 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e8c24f37-3e93-4740-ba42-63fbb7c8249d tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1319 microversion: 2.1 time: 0.536263 Jul 14 14:30:03.807713 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 572/1143] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:03 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:03.859240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d024e9f6-c7f8-4cca-b69b-4664926fa484 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:03.860689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d024e9f6-c7f8-4cca-b69b-4664926fa484 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:03.868482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d024e9f6-c7f8-4cca-b69b-4664926fa484 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:03.869289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d024e9f6-c7f8-4cca-b69b-4664926fa484 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:03.871803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d024e9f6-c7f8-4cca-b69b-4664926fa484 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:03.872529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d024e9f6-c7f8-4cca-b69b-4664926fa484 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:03.950822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f60e98de-f9bd-4e2c-bc4f-596de98f24e6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:03.969533 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f60e98de-f9bd-4e2c-bc4f-596de98f24e6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1475 microversion: 2.1 time: 0.510203 Jul 14 14:30:03.970590 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 572/1144] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:03 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1475 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:04.112371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3a71938e-2380-4aab-a443-b204fc64664c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:04.113045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3a71938e-2380-4aab-a443-b204fc64664c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:04.125279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a71938e-2380-4aab-a443-b204fc64664c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:04.126022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a71938e-2380-4aab-a443-b204fc64664c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:04.127048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a71938e-2380-4aab-a443-b204fc64664c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:04.129195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a71938e-2380-4aab-a443-b204fc64664c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:04.476861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d024e9f6-c7f8-4cca-b69b-4664926fa484 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:04.496119 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d024e9f6-c7f8-4cca-b69b-4664926fa484 tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1473 microversion: 2.1 time: 0.641923 Jul 14 14:30:04.497364 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 573/1145] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:03 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1473 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:04.505490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2e6bd1b9-e4ba-482f-9aaf-7eae03dc8dd5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:04.513717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2e6bd1b9-e4ba-482f-9aaf-7eae03dc8dd5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:04.529080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e6bd1b9-e4ba-482f-9aaf-7eae03dc8dd5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:04.529972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e6bd1b9-e4ba-482f-9aaf-7eae03dc8dd5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:04.531010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e6bd1b9-e4ba-482f-9aaf-7eae03dc8dd5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:04.536206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e6bd1b9-e4ba-482f-9aaf-7eae03dc8dd5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:04.841428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2e6bd1b9-e4ba-482f-9aaf-7eae03dc8dd5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:04.908857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2e6bd1b9-e4ba-482f-9aaf-7eae03dc8dd5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:04.911150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2e6bd1b9-e4ba-482f-9aaf-7eae03dc8dd5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:04.939881 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2e6bd1b9-e4ba-482f-9aaf-7eae03dc8dd5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1443 microversion: 2.75 time: 0.440265 Jul 14 14:30:04.940258 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 574/1146] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:04 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1443 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:04.968771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-156d8209-6f05-4119-88d7-44e0a353d4cf req-00455bdc-e8dc-4572-b2dc-e5c2adade58d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a1b7fb-df82-435c-bf4d-261decd2db5f", "name": "network-vif-deleted", "tag": "2f439b9e-ad79-44c1-9bf1-810c6d5786f9"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:04.994342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-156d8209-6f05-4119-88d7-44e0a353d4cf req-00455bdc-e8dc-4572-b2dc-e5c2adade58d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:04.995089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-156d8209-6f05-4119-88d7-44e0a353d4cf req-00455bdc-e8dc-4572-b2dc-e5c2adade58d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:05.034293 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-156d8209-6f05-4119-88d7-44e0a353d4cf req-00455bdc-e8dc-4572-b2dc-e5c2adade58d service nova] Creating event network-vif-deleted:2f439b9e-ad79-44c1-9bf1-810c6d5786f9 for instance 90a1b7fb-df82-435c-bf4d-261decd2db5f on n-h2-767704-28 Jul 14 14:30:05.057249 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-156d8209-6f05-4119-88d7-44e0a353d4cf req-00455bdc-e8dc-4572-b2dc-e5c2adade58d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100769 Jul 14 14:30:05.058225 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 575/1147] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:05.065009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3a71938e-2380-4aab-a443-b204fc64664c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:05.070768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24b341ee-1548-451a-acba-6cd548d4da70 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:05.072015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-24b341ee-1548-451a-acba-6cd548d4da70 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:05.077588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3a71938e-2380-4aab-a443-b204fc64664c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:05.084786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3a71938e-2380-4aab-a443-b204fc64664c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:05.090708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24b341ee-1548-451a-acba-6cd548d4da70 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:05.091434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24b341ee-1548-451a-acba-6cd548d4da70 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:05.092684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24b341ee-1548-451a-acba-6cd548d4da70 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:05.093398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24b341ee-1548-451a-acba-6cd548d4da70 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:05.108554 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3a71938e-2380-4aab-a443-b204fc64664c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 1.000431 Jul 14 14:30:05.109540 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 573/1148] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:04 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:05.121521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c243e504-8a67-4f48-9a95-e3aa7efb4877 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:05.122421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c243e504-8a67-4f48-9a95-e3aa7efb4877 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:05.138054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c243e504-8a67-4f48-9a95-e3aa7efb4877 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:05.138929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c243e504-8a67-4f48-9a95-e3aa7efb4877 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:05.140020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c243e504-8a67-4f48-9a95-e3aa7efb4877 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:05.140736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c243e504-8a67-4f48-9a95-e3aa7efb4877 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:05.548665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-24b341ee-1548-451a-acba-6cd548d4da70 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:05.566690 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-24b341ee-1548-451a-acba-6cd548d4da70 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1468 microversion: 2.1 time: 0.506947 Jul 14 14:30:05.573697 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 576/1149] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:05 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1468 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:05.589193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1e1a7558-6ed7-446b-8b15-159540a484cd tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:05.592806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1e1a7558-6ed7-446b-8b15-159540a484cd tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:05.616149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e1a7558-6ed7-446b-8b15-159540a484cd tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:05.618536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e1a7558-6ed7-446b-8b15-159540a484cd tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:05.625983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e1a7558-6ed7-446b-8b15-159540a484cd tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:05.627045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e1a7558-6ed7-446b-8b15-159540a484cd tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:05.685872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c243e504-8a67-4f48-9a95-e3aa7efb4877 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:05.703054 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c243e504-8a67-4f48-9a95-e3aa7efb4877 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1475 microversion: 2.1 time: 0.591793 Jul 14 14:30:05.711300 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 574/1150] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:05 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1475 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:05.732555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-028cf4c8-6ea3-486d-81c7-900f22cdc425 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:05.734528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-028cf4c8-6ea3-486d-81c7-900f22cdc425 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:05.757583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-028cf4c8-6ea3-486d-81c7-900f22cdc425 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:05.759580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-028cf4c8-6ea3-486d-81c7-900f22cdc425 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:05.762687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-028cf4c8-6ea3-486d-81c7-900f22cdc425 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:05.763476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-028cf4c8-6ea3-486d-81c7-900f22cdc425 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:05.802815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-028cf4c8-6ea3-486d-81c7-900f22cdc425 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lazy-loading 'flavor' on Instance uuid f9502c4d-a29b-45e0-9f2c-394c7661113c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:30:05.968253 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-028cf4c8-6ea3-486d-81c7-900f22cdc425 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c/action" status: 202 len: 0 microversion: 2.1 time: 0.255001 Jul 14 14:30:05.990556 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 575/1151] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:30:05 2022] POST /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:30:06.002123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f872a220-5d77-403e-bf7b-941707cf018a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:06.002905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f872a220-5d77-403e-bf7b-941707cf018a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:06.013600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f872a220-5d77-403e-bf7b-941707cf018a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:06.014186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f872a220-5d77-403e-bf7b-941707cf018a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:06.014786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f872a220-5d77-403e-bf7b-941707cf018a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:06.017868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f872a220-5d77-403e-bf7b-941707cf018a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:06.330594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f872a220-5d77-403e-bf7b-941707cf018a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:06.349853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f872a220-5d77-403e-bf7b-941707cf018a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:06.355373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f872a220-5d77-403e-bf7b-941707cf018a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffe94302ac1c43a9aa6310296e61e668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc9b7b4c8134876bc4b3842ff839b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:06.368750 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f872a220-5d77-403e-bf7b-941707cf018a tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 200 len: 1443 microversion: 2.75 time: 0.375714 Jul 14 14:30:06.383044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1e1a7558-6ed7-446b-8b15-159540a484cd tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bfee07cac2b472a9f8ba7d0e4a67580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d830f4fd184c54a15647e148c3590e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:06.393535 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 576/1152] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:05 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 1443 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:06.396422 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1e1a7558-6ed7-446b-8b15-159540a484cd tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 200 len: 1431 microversion: 2.1 time: 0.818307 Jul 14 14:30:06.400042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-19375d55-2473-4fe2-b489-966157a5d270 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:06.400920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-19375d55-2473-4fe2-b489-966157a5d270 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:06.407877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19375d55-2473-4fe2-b489-966157a5d270 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:06.408126 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 577/1153] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:05 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 1431 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:06.408613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19375d55-2473-4fe2-b489-966157a5d270 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:06.409597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19375d55-2473-4fe2-b489-966157a5d270 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:06.410063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19375d55-2473-4fe2-b489-966157a5d270 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:06.416375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5f783748-8039-4ade-98e5-7fdaeacb16ca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:06.417077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5f783748-8039-4ade-98e5-7fdaeacb16ca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:06.425243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f783748-8039-4ade-98e5-7fdaeacb16ca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:06.425705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f783748-8039-4ade-98e5-7fdaeacb16ca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:06.426500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f783748-8039-4ade-98e5-7fdaeacb16ca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:06.426943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f783748-8039-4ade-98e5-7fdaeacb16ca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:06.918807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-19375d55-2473-4fe2-b489-966157a5d270 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:06.937841 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-19375d55-2473-4fe2-b489-966157a5d270 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1476 microversion: 2.1 time: 0.538424 Jul 14 14:30:06.945222 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 577/1154] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:06 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1476 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:06.951708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2e52e8bf-cc77-4b6d-8dbb-7667f78777b6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:06.956671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2e52e8bf-cc77-4b6d-8dbb-7667f78777b6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:06.979546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e52e8bf-cc77-4b6d-8dbb-7667f78777b6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:06.980302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e52e8bf-cc77-4b6d-8dbb-7667f78777b6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:06.981354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e52e8bf-cc77-4b6d-8dbb-7667f78777b6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:06.982011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e52e8bf-cc77-4b6d-8dbb-7667f78777b6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:07.065948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5f783748-8039-4ade-98e5-7fdaeacb16ca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:07.081918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5f783748-8039-4ade-98e5-7fdaeacb16ca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:07.083521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5f783748-8039-4ade-98e5-7fdaeacb16ca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:07.084843 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5f783748-8039-4ade-98e5-7fdaeacb16ca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.675167 Jul 14 14:30:07.098168 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 578/1155] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:06 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:07.406382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c58ec3ef-1627-4a48-885b-23b9dad39cf5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:07.408518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c58ec3ef-1627-4a48-885b-23b9dad39cf5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] [instance: 7139fba6-dada-4dd5-8378-04feab6a2d30] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:07.426941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c58ec3ef-1627-4a48-885b-23b9dad39cf5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:07.427448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c58ec3ef-1627-4a48-885b-23b9dad39cf5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:07.428299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c58ec3ef-1627-4a48-885b-23b9dad39cf5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:07.428713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c58ec3ef-1627-4a48-885b-23b9dad39cf5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:07.505792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2e52e8bf-cc77-4b6d-8dbb-7667f78777b6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:07.518176 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2e52e8bf-cc77-4b6d-8dbb-7667f78777b6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1475 microversion: 2.1 time: 0.571593 Jul 14 14:30:07.519282 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 578/1156] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:06 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1475 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:07.528780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4b2ff20-c204-4cc7-b2f9-e3e9a3ece49d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:07.531256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d4b2ff20-c204-4cc7-b2f9-e3e9a3ece49d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] [instance: 90a1b7fb-df82-435c-bf4d-261decd2db5f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:07.534807 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-c58ec3ef-1627-4a48-885b-23b9dad39cf5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] HTTP exception thrown: Instance 7139fba6-dada-4dd5-8378-04feab6a2d30 could not be found. Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c58ec3ef-1627-4a48-885b-23b9dad39cf5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Request method failure captured: Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 HTTP/1.1 Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CgQ3jLXP0KUeB3pC7-sMMfXc1IwMYYChJQpAiCpBcWKDpMWN-JrsCukXC6byrRXie9tVelldtSMgfgCqbeTYm1QAw1dYJpuOWftR86cDjnBfCoAscZScALad7TAy5lxUBnMp8020s7UPZpLjSVZjupxzOQHTfjfBzy91zRn5JBiC5E Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.75 Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: efc9b7b4c8134876bc4b3842ff839b0e Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersAdmin275Test-154581973 Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:30:07.536847 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:30:07.538851 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/efc9b7b4c8134876bc4b3842ff839b0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/efc9b7b4c8134876bc4b3842ff839b0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_efc9b7b4c8134876bc4b3842ff839b0e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/efc9b7b4c8134876bc4b3842ff839b0e"}]}] Jul 14 14:30:07.538851 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersAdmin275Test-154581973 Jul 14 14:30:07.538851 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: efc9b7b4c8134876bc4b3842ff839b0e Jul 14 14:30:07.538851 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersAdmin275Test-154581973 Jul 14 14:30:07.538851 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersAdmin275Test-154581973-project Jul 14 14:30:07.538851 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:30:07.538851 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:30:07.538851 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: ffe94302ac1c43a9aa6310296e61e668 Jul 14 14:30:07.538851 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersAdmin275Test-154581973-project Jul 14 14:30:07.538851 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:30:07.538851 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 7139fba6-dada-4dd5-8378-04feab6a2d30 could not be found. Jul 14 14:30:07.538851 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '7139fba6-dada-4dd5-8378-04feab6a2d30'} Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7139fba6-dada-4dd5-8378-04feab6a2d30 could not be found. Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:07.540320 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7139fba6-dada-4dd5-8378-04feab6a2d30 could not be found. Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7139fba6-dada-4dd5-8378-04feab6a2d30 could not be found. Jul 14 14:30:07.542021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:07.548576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c58ec3ef-1627-4a48-885b-23b9dad39cf5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] Returning 404 to user: Instance 7139fba6-dada-4dd5-8378-04feab6a2d30 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:07.549842 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c58ec3ef-1627-4a48-885b-23b9dad39cf5 tempest-ServersAdmin275Test-154581973 tempest-ServersAdmin275Test-154581973-project] 10.222.0.81 "GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30" status: 404 len: 111 microversion: 2.75 time: 0.147864 Jul 14 14:30:07.551245 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 579/1157] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:07 2022] GET /compute/v2.1/servers/7139fba6-dada-4dd5-8378-04feab6a2d30 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:30:07.558548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4b2ff20-c204-4cc7-b2f9-e3e9a3ece49d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:07.559134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4b2ff20-c204-4cc7-b2f9-e3e9a3ece49d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:07.560204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4b2ff20-c204-4cc7-b2f9-e3e9a3ece49d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:07.560713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4b2ff20-c204-4cc7-b2f9-e3e9a3ece49d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:07.585844 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-d4b2ff20-c204-4cc7-b2f9-e3e9a3ece49d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] HTTP exception thrown: Instance 90a1b7fb-df82-435c-bf4d-261decd2db5f could not be found. Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4b2ff20-c204-4cc7-b2f9-e3e9a3ece49d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Request method failure captured: Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f HTTP/1.1 Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CgXvQPA87KbGZwv1pQKsJkOub-iLzvOLXuxsxg2gEJHLX6KaXzQPNx77EP84HeAbxjgm_3rdZOEKdXszeJP5W6hWUEjV8m771crkuM2-XL9p2A6o2j9erPb2oDC3Rph-V6QfZLW4WLgDb-iMOg-C__0K8lIJcJK6Dpxg_fN1sthfNU Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 52d830f4fd184c54a15647e148c3590e Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesOneServerTestJSON-629675890 Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:30:07.589006 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:30:07.590639 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d830f4fd184c54a15647e148c3590e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/52d830f4fd184c54a15647e148c3590e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_52d830f4fd184c54a15647e148c3590e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/52d830f4fd184c54a15647e148c3590e"}]}] Jul 14 14:30:07.590639 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesOneServerTestJSON-629675890 Jul 14 14:30:07.590639 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 52d830f4fd184c54a15647e148c3590e Jul 14 14:30:07.590639 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-629675890 Jul 14 14:30:07.590639 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesOneServerTestJSON-629675890-project Jul 14 14:30:07.590639 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:30:07.590639 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:30:07.590639 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4bfee07cac2b472a9f8ba7d0e4a67580 Jul 14 14:30:07.590639 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesOneServerTestJSON-629675890-project Jul 14 14:30:07.590639 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:30:07.590639 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 90a1b7fb-df82-435c-bf4d-261decd2db5f could not be found. Jul 14 14:30:07.590639 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '90a1b7fb-df82-435c-bf4d-261decd2db5f'} Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a1b7fb-df82-435c-bf4d-261decd2db5f could not be found. Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:07.591557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a1b7fb-df82-435c-bf4d-261decd2db5f could not be found. Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a1b7fb-df82-435c-bf4d-261decd2db5f could not be found. Jul 14 14:30:07.593137 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:07.600805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4b2ff20-c204-4cc7-b2f9-e3e9a3ece49d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] Returning 404 to user: Instance 90a1b7fb-df82-435c-bf4d-261decd2db5f could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:07.603093 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d4b2ff20-c204-4cc7-b2f9-e3e9a3ece49d tempest-ImagesOneServerTestJSON-629675890 tempest-ImagesOneServerTestJSON-629675890-project] 10.222.0.81 "GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f" status: 404 len: 111 microversion: 2.1 time: 0.081422 Jul 14 14:30:07.604756 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 579/1158] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:07 2022] GET /compute/v2.1/servers/90a1b7fb-df82-435c-bf4d-261decd2db5f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:30:07.975455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9e7ad8a4-9058-41f5-8fe0-4cef499a5723 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:07.976163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9e7ad8a4-9058-41f5-8fe0-4cef499a5723 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:07.986365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e7ad8a4-9058-41f5-8fe0-4cef499a5723 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:07.986820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e7ad8a4-9058-41f5-8fe0-4cef499a5723 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:07.987607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e7ad8a4-9058-41f5-8fe0-4cef499a5723 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:07.988062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e7ad8a4-9058-41f5-8fe0-4cef499a5723 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:08.122724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4f168c5-193d-4778-b93b-35f25c1cd2d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:08.123711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d4f168c5-193d-4778-b93b-35f25c1cd2d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:08.136937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4f168c5-193d-4778-b93b-35f25c1cd2d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:08.138847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4f168c5-193d-4778-b93b-35f25c1cd2d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:08.141776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4f168c5-193d-4778-b93b-35f25c1cd2d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:08.142481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4f168c5-193d-4778-b93b-35f25c1cd2d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:08.569306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d4f168c5-193d-4778-b93b-35f25c1cd2d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:08.586358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d4f168c5-193d-4778-b93b-35f25c1cd2d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:08.588606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d4f168c5-193d-4778-b93b-35f25c1cd2d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:08.589863 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d4f168c5-193d-4778-b93b-35f25c1cd2d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.472776 Jul 14 14:30:08.596387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9e7ad8a4-9058-41f5-8fe0-4cef499a5723 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:08.612182 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9e7ad8a4-9058-41f5-8fe0-4cef499a5723 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1459 microversion: 2.1 time: 0.646331 Jul 14 14:30:08.612765 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 580/1159] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:07 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1459 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:08.625055 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 580/1160] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:08 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:30:08.629296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6eefd33a-d359-4658-ac0c-14504074feff tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:08.632415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6eefd33a-d359-4658-ac0c-14504074feff tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:08.638691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0db444fb-a736-46c8-9759-326e821024f0 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:08.639400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0db444fb-a736-46c8-9759-326e821024f0 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:08.654809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0db444fb-a736-46c8-9759-326e821024f0 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:08.656000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0db444fb-a736-46c8-9759-326e821024f0 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:08.660687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0db444fb-a736-46c8-9759-326e821024f0 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:08.665332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0db444fb-a736-46c8-9759-326e821024f0 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:08.667053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6eefd33a-d359-4658-ac0c-14504074feff tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:08.671668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6eefd33a-d359-4658-ac0c-14504074feff tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:08.672855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6eefd33a-d359-4658-ac0c-14504074feff tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:08.673545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6eefd33a-d359-4658-ac0c-14504074feff tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:09.156703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6eefd33a-d359-4658-ac0c-14504074feff tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:09.165628 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6eefd33a-d359-4658-ac0c-14504074feff tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1475 microversion: 2.1 time: 0.551771 Jul 14 14:30:09.174058 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 581/1161] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:08 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1475 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:09.562423 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0db444fb-a736-46c8-9759-326e821024f0 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1612 microversion: 2.1 time: 0.927631 Jul 14 14:30:09.567974 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 581/1162] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:08 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1612 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:30:09.583618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-862b2605-3595-4b62-9151-13a725ec3587 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:09.586543 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:30:09.586543 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:30:09.589416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-862b2605-3595-4b62-9151-13a725ec3587 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:09.590388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-862b2605-3595-4b62-9151-13a725ec3587 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:09.591478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-862b2605-3595-4b62-9151-13a725ec3587 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:09.592276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-862b2605-3595-4b62-9151-13a725ec3587 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:09.628780 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-862b2605-3595-4b62-9151-13a725ec3587 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.049651 Jul 14 14:30:09.642229 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 582/1163] 10.222.0.81 () {58 vars in 1175 bytes} [Thu Jul 14 14:30:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:09.645205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-96c4ade6-bae1-48bb-a69b-0502512ffa10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:09.646125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-96c4ade6-bae1-48bb-a69b-0502512ffa10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:09.652117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-72758cd2-1766-4728-a333-959f7daddc89 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-767704-28", "block_migration": true, "disk_over_commit": false}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:09.654577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-72758cd2-1766-4728-a333-959f7daddc89 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:09.665114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72758cd2-1766-4728-a333-959f7daddc89 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:09.666964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72758cd2-1766-4728-a333-959f7daddc89 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:09.668406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72758cd2-1766-4728-a333-959f7daddc89 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:09.668543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96c4ade6-bae1-48bb-a69b-0502512ffa10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:09.668908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96c4ade6-bae1-48bb-a69b-0502512ffa10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:09.669767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96c4ade6-bae1-48bb-a69b-0502512ffa10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:09.670221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96c4ade6-bae1-48bb-a69b-0502512ffa10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:09.670563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72758cd2-1766-4728-a333-959f7daddc89 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:09.718123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-72758cd2-1766-4728-a333-959f7daddc89 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Lazy-loading 'flavor' on Instance uuid f9502c4d-a29b-45e0-9f2c-394c7661113c {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:30:09.737704 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-72758cd2-1766-4728-a333-959f7daddc89 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance f9502c4d-a29b-45e0-9f2c-394c7661113c while it is in vm_state suspended Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-72758cd2-1766-4728-a333-959f7daddc89 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Request method failure captured: Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c/action HTTP/1.1 Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 98 Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cg4fKELPH79e1jCXtR29ip_qAjSw4KJ5HQQWVKhwBpdgiJcbQN-CkRJU4-9qVMZhR0t1w7d7lTVvSigyYhWfyeqnxp6AvnsUohm_POJJgc9AIOk6YGHG7doMhDDK-Bsv7uIBHDqMwfVvRHkMDLcafFvMC1k8KUwsg4blmfmu-lxxFw Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 4bc932f30efc4bec824c83686ac2e9e5 Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-LiveMigrationNegativeTest-676473078 Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:30:09.746914 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:30:09.749181 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4bc932f30efc4bec824c83686ac2e9e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4bc932f30efc4bec824c83686ac2e9e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4bc932f30efc4bec824c83686ac2e9e5", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4bc932f30efc4bec824c83686ac2e9e5"}]}] Jul 14 14:30:09.749181 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-LiveMigrationNegativeTest-676473078 Jul 14 14:30:09.749181 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 4bc932f30efc4bec824c83686ac2e9e5 Jul 14 14:30:09.749181 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-676473078 Jul 14 14:30:09.749181 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-LiveMigrationNegativeTest-676473078-project-admin Jul 14 14:30:09.749181 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:30:09.749181 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:30:09.749181 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: bed183e3117f409892c54dc065b53eac Jul 14 14:30:09.749181 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-LiveMigrationNegativeTest-676473078-project-admin Jul 14 14:30:09.749181 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:30:09.749181 n-d-767704-28 devstack@n-api.service[119512]: {"os-migrateLive": {"host": "n-h1-767704-28", "block_migration": true, "disk_over_commit": false}} Jul 14 14:30:09.749181 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: exception: Cannot 'os-migrateLive' instance f9502c4d-a29b-45e0-9f2c-394c7661113c while it is in vm_state suspended Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'f9502c4d-a29b-45e0-9f2c-394c7661113c', 'body': {'os-migrateLive': {'host': 'n-h1-767704-28', 'block_migration': True, 'disk_over_commit': False}}} Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 14 14:30:09.750114 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f9502c4d-a29b-45e0-9f2c-394c7661113c in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:09.751623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance f9502c4d-a29b-45e0-9f2c-394c7661113c while it is in vm_state suspended Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance f9502c4d-a29b-45e0-9f2c-394c7661113c while it is in vm_state suspended Jul 14 14:30:09.754458 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:09.756737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-72758cd2-1766-4728-a333-959f7daddc89 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance f9502c4d-a29b-45e0-9f2c-394c7661113c while it is in vm_state suspended {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:09.756737 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-72758cd2-1766-4728-a333-959f7daddc89 tempest-LiveMigrationNegativeTest-676473078 tempest-LiveMigrationNegativeTest-676473078-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c/action" status: 409 len: 155 microversion: 2.1 time: 0.107897 Jul 14 14:30:09.756737 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 583/1164] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:30:09 2022] POST /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c/action => generated 155 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:30:09.766550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-302883ff-a46e-42ae-9b9d-0255ba8b288e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:09.768120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-302883ff-a46e-42ae-9b9d-0255ba8b288e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:09.780272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-302883ff-a46e-42ae-9b9d-0255ba8b288e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:09.781519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-302883ff-a46e-42ae-9b9d-0255ba8b288e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:09.783164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-302883ff-a46e-42ae-9b9d-0255ba8b288e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:09.785513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-302883ff-a46e-42ae-9b9d-0255ba8b288e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:09.830952 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-302883ff-a46e-42ae-9b9d-0255ba8b288e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:30:09.993923 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-302883ff-a46e-42ae-9b9d-0255ba8b288e tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 204 len: 0 microversion: 2.1 time: 0.233424 Jul 14 14:30:10.001515 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 584/1165] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:30:09 2022] DELETE /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:30:10.008871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a74ea2fa-2ee4-44c6-beaa-730efb546011 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:10.011571 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a74ea2fa-2ee4-44c6-beaa-730efb546011 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:10.023444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-96c4ade6-bae1-48bb-a69b-0502512ffa10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:10.033936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:10.038090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a74ea2fa-2ee4-44c6-beaa-730efb546011 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:10.038538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a74ea2fa-2ee4-44c6-beaa-730efb546011 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:10.042931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a74ea2fa-2ee4-44c6-beaa-730efb546011 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:10.043414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a74ea2fa-2ee4-44c6-beaa-730efb546011 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:10.046455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-96c4ade6-bae1-48bb-a69b-0502512ffa10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:10.057569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-96c4ade6-bae1-48bb-a69b-0502512ffa10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:10.060895 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-96c4ade6-bae1-48bb-a69b-0502512ffa10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.423474 Jul 14 14:30:10.061990 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 582/1166] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:09 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:10.200059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-793d71b9-9910-410d-bab8-04383539327d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:10.201759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-793d71b9-9910-410d-bab8-04383539327d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:10.225275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-793d71b9-9910-410d-bab8-04383539327d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:10.226008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-793d71b9-9910-410d-bab8-04383539327d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:10.230819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-793d71b9-9910-410d-bab8-04383539327d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:10.231492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-793d71b9-9910-410d-bab8-04383539327d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:10.791070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a74ea2fa-2ee4-44c6-beaa-730efb546011 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:10.815863 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a74ea2fa-2ee4-44c6-beaa-730efb546011 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1465 microversion: 2.1 time: 0.811218 Jul 14 14:30:10.817672 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 585/1167] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:10 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1465 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:10.950049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-793d71b9-9910-410d-bab8-04383539327d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:10.961114 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-793d71b9-9910-410d-bab8-04383539327d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1475 microversion: 2.1 time: 0.771564 Jul 14 14:30:10.972177 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 583/1168] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:10 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1475 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:11.087610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e14bdc91-b675-4bb4-aa3f-bddf41324eca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:11.091718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e14bdc91-b675-4bb4-aa3f-bddf41324eca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:11.135763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e14bdc91-b675-4bb4-aa3f-bddf41324eca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:11.136894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e14bdc91-b675-4bb4-aa3f-bddf41324eca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:11.142920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e14bdc91-b675-4bb4-aa3f-bddf41324eca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:11.144456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e14bdc91-b675-4bb4-aa3f-bddf41324eca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:11.435131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e14bdc91-b675-4bb4-aa3f-bddf41324eca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:11.451299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e14bdc91-b675-4bb4-aa3f-bddf41324eca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:11.452840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e14bdc91-b675-4bb4-aa3f-bddf41324eca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:11.459393 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e14bdc91-b675-4bb4-aa3f-bddf41324eca tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.379554 Jul 14 14:30:11.462242 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 586/1169] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:11 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:11.761446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f202e303-1c3a-485d-9cb5-ffb8418885fe tempest-AZV2TestJSON-1804636874 tempest-AZV2TestJSON-1804636874-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:11.763628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f202e303-1c3a-485d-9cb5-ffb8418885fe tempest-AZV2TestJSON-1804636874 tempest-AZV2TestJSON-1804636874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:11.765115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f202e303-1c3a-485d-9cb5-ffb8418885fe tempest-AZV2TestJSON-1804636874 tempest-AZV2TestJSON-1804636874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:11.766801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f202e303-1c3a-485d-9cb5-ffb8418885fe tempest-AZV2TestJSON-1804636874 tempest-AZV2TestJSON-1804636874-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:11.767714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f202e303-1c3a-485d-9cb5-ffb8418885fe tempest-AZV2TestJSON-1804636874 tempest-AZV2TestJSON-1804636874-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:11.818515 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f202e303-1c3a-485d-9cb5-ffb8418885fe tempest-AZV2TestJSON-1804636874 tempest-AZV2TestJSON-1804636874-project] 10.222.0.81 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.651473 Jul 14 14:30:11.820897 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 584/1170] 10.222.0.81 () {58 vars in 1163 bytes} [Thu Jul 14 14:30:11 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:30:11.835555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a55f9b49-2d28-4923-89c4-b54c2beadc18 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:11.842373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a55f9b49-2d28-4923-89c4-b54c2beadc18 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:11.854289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a55f9b49-2d28-4923-89c4-b54c2beadc18 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:11.856629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a55f9b49-2d28-4923-89c4-b54c2beadc18 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:11.857764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a55f9b49-2d28-4923-89c4-b54c2beadc18 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:11.859602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a55f9b49-2d28-4923-89c4-b54c2beadc18 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:11.866657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9db18ccf-c8e6-4dbc-8268-31c8b39bcba8 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Action: 'create', calling method: .version_select at 0x7fd6c5be2820>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWIDg5W/ORFzpU1P1FAwODfcyRxjfpbGhtbZ5nrDjxLT7jfARs4eQIAXaeGftY9B8HMO4Q6RPtsrLa3S6x0miMvFQSeOZsTOdh0WEIiuW6J+CF/QWNkSSy04L3+Pekj/g=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:11.872913 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-9db18ccf-c8e6-4dbc-8268-31c8b39bcba8 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9db18ccf-c8e6-4dbc-8268-31c8b39bcba8 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Request method failure captured: Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 257 Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0ChzVKgp7LSfDdEio5jdtzITX-44my6A0ZRzDMMHI5w0giVtUXZB3WIeey57RlhuIymo4Mj7vSSv8rIrRRJT89hFim39w-ZPSHvu7_3YeikHHEgPm8kygw2Tj3WhhIYEFcxaiIzxvVmmWk1h8syv4uhKBCVLAlm3kt2wj90mbL5YxNo Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:30:11.880105 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:30:11.882030 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a59acfba78834bd29a38cd65d460b676", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}] Jul 14 14:30:11.882030 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:11.882030 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:11.882030 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:11.882030 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:11.882030 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:30:11.882030 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:30:11.882030 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:11.882030 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:11.882030 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:30:11.882030 n-d-767704-28 devstack@n-api.service[119512]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWIDg5W/ORFzpU1P1FAwODfcyRxjfpbGhtbZ5nrDjxLT7jfARs4eQIAXaeGftY9B8HMO4Q6RPtsrLa3S6x0miMvFQSeOZsTOdh0WEIiuW6J+CF/QWNkSSy04L3+Pekj/g=="}} Jul 14 14:30:11.882030 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWIDg5W/ORFzpU1P1FAwODfcyRxjfpbGhtbZ5nrDjxLT7jfARs4eQIAXaeGftY9B8HMO4Q6RPtsrLa3S6x0miMvFQSeOZsTOdh0WEIiuW6J+CF/QWNkSSy04L3+Pekj/g=='}}} Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 14 14:30:11.882991 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 14 14:30:11.884345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 14 14:30:11.886558 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 14 14:30:11.886558 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 14 14:30:11.886558 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:11.886558 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:11.886558 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:11.886558 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:11.886558 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:11.886558 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:11.886558 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:11.886558 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:11.886558 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 14 14:30:11.886558 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:11.889776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9db18ccf-c8e6-4dbc-8268-31c8b39bcba8 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:11.891180 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9db18ccf-c8e6-4dbc-8268-31c8b39bcba8 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.427622 Jul 14 14:30:11.893126 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 587/1171] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:30:11 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 430 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:30:11.920473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f28be5c2-2d36-4ac0-84d4-9d97704df7e1 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Action: 'create', calling method: .version_select at 0x7fd6c5bdfdc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1070411252", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:11.961885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f28be5c2-2d36-4ac0-84d4-9d97704df7e1 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Getting quotas for project a59acfba78834bd29a38cd65d460b676. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:11.973800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f28be5c2-2d36-4ac0-84d4-9d97704df7e1 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Getting quotas for user 39f9998d45bb4f9fbdec39c46910db8b and project a59acfba78834bd29a38cd65d460b676. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:12.004059 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-f28be5c2-2d36-4ac0-84d4-9d97704df7e1 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f28be5c2-2d36-4ac0-84d4-9d97704df7e1 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Request method failure captured: Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 2167 Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0ChzVKgp7LSfDdEio5jdtzITX-44my6A0ZRzDMMHI5w0giVtUXZB3WIeey57RlhuIymo4Mj7vSSv8rIrRRJT89hFim39w-ZPSHvu7_3YeikHHEgPm8kygw2Tj3WhhIYEFcxaiIzxvVmmWk1h8syv4uhKBCVLAlm3kt2wj90mbL5YxNo Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a59acfba78834bd29a38cd65d460b676", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}] Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1070411252", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:30:12.013005 n-d-767704-28 devstack@n-api.service[119512]: exception: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1070411252', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:12.015876 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f28be5c2-2d36-4ac0-84d4-9d97704df7e1 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f28be5c2-2d36-4ac0-84d4-9d97704df7e1 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.111433 Jul 14 14:30:12.027196 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 588/1172] 10.222.0.81 () {60 vars in 1159 bytes} [Thu Jul 14 14:30:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:12.040499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1f66edde-21aa-4bbc-b9f6-d626a4015758 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:12.041312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f66edde-21aa-4bbc-b9f6-d626a4015758 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:12.054884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f66edde-21aa-4bbc-b9f6-d626a4015758 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:12.056788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f66edde-21aa-4bbc-b9f6-d626a4015758 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:12.060196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f66edde-21aa-4bbc-b9f6-d626a4015758 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:12.060893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f66edde-21aa-4bbc-b9f6-d626a4015758 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:12.244290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a55f9b49-2d28-4923-89c4-b54c2beadc18 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:12.258077 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a55f9b49-2d28-4923-89c4-b54c2beadc18 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1465 microversion: 2.1 time: 0.426255 Jul 14 14:30:12.262151 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 585/1173] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:11 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1465 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:12.272553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-df104673-c0cc-478f-917d-6ba052689b5a tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Action: 'create', calling method: .version_select at 0x7fd6c59a0820>, body: {"keypair": {"name": "tempest-keypair-898616166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+3DLnXHkftFQXLlxJGKaps9bV8tW5GsrM4lfTbJBhnRB+wOIqrm+ulUOnvY7Q/NtRqg+vE5OqFsZH6ZivaW1my+QKiRB0jHCsYAeSYbBH+MQiYxEF7DZvCVmwUu9ogIQ=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:12.296497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:12.325261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-df104673-c0cc-478f-917d-6ba052689b5a tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Getting quotas for project a59acfba78834bd29a38cd65d460b676. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:12.340054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-df104673-c0cc-478f-917d-6ba052689b5a tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Getting quotas for user 39f9998d45bb4f9fbdec39c46910db8b and project a59acfba78834bd29a38cd65d460b676. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:12.388499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f66edde-21aa-4bbc-b9f6-d626a4015758 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:12.389017 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-df104673-c0cc-478f-917d-6ba052689b5a tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125162 Jul 14 14:30:12.390066 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 586/1174] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:30:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:12.405785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f73c649-dabc-4199-a67b-cae0a60b27f7 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Action: 'create', calling method: .version_select at 0x7fd6c59a1dc0>, body: {"keypair": {"name": "tempest-keypair-898616166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxzxnBT3CXAwxhSXw9Y2k78x04MX202ivjD6FBnA1/7Lnh4owH9/6TGl2/L3cbor18Cn6fnGS4JW745NTpSAc/GMYe707l/CPsC6eA62iQvdACIZYI+Mp5SXpf9HsSArg=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:12.406745 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1f66edde-21aa-4bbc-b9f6-d626a4015758 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1475 microversion: 2.1 time: 0.385085 Jul 14 14:30:12.409348 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 589/1175] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:12 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1475 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:12.432539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-8f73c649-dabc-4199-a67b-cae0a60b27f7 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Getting quotas for project a59acfba78834bd29a38cd65d460b676. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:12.439080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-8f73c649-dabc-4199-a67b-cae0a60b27f7 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Getting quotas for user 39f9998d45bb4f9fbdec39c46910db8b and project a59acfba78834bd29a38cd65d460b676. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:12.474570 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-8f73c649-dabc-4199-a67b-cae0a60b27f7 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] HTTP exception thrown: Key pair 'tempest-keypair-898616166' already exists. Jul 14 14:30:12.485007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-db30258f-bf76-4fca-ac8a-e78aaadcaac7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:12.486224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-db30258f-bf76-4fca-ac8a-e78aaadcaac7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:12.497225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db30258f-bf76-4fca-ac8a-e78aaadcaac7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:12.497720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db30258f-bf76-4fca-ac8a-e78aaadcaac7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:12.498558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db30258f-bf76-4fca-ac8a-e78aaadcaac7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:12.499005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db30258f-bf76-4fca-ac8a-e78aaadcaac7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f73c649-dabc-4199-a67b-cae0a60b27f7 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Request method failure captured: Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 272 Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0ChzVKgp7LSfDdEio5jdtzITX-44my6A0ZRzDMMHI5w0giVtUXZB3WIeey57RlhuIymo4Mj7vSSv8rIrRRJT89hFim39w-ZPSHvu7_3YeikHHEgPm8kygw2Tj3WhhIYEFcxaiIzxvVmmWk1h8syv4uhKBCVLAlm3kt2wj90mbL5YxNo Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a59acfba78834bd29a38cd65d460b676", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}] Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: {"keypair": {"name": "tempest-keypair-898616166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxzxnBT3CXAwxhSXw9Y2k78x04MX202ivjD6FBnA1/7Lnh4owH9/6TGl2/L3cbor18Cn6fnGS4JW745NTpSAc/GMYe707l/CPsC6eA62iQvdACIZYI+Mp5SXpf9HsSArg=="}} Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: exception: Key pair 'tempest-keypair-898616166' already exists. Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-898616166', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxzxnBT3CXAwxhSXw9Y2k78x04MX202ivjD6FBnA1/7Lnh4owH9/6TGl2/L3cbor18Cn6fnGS4JW745NTpSAc/GMYe707l/CPsC6eA62iQvdACIZYI+Mp5SXpf9HsSArg=='}}} Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result.read() Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '39f9998d45bb4f9fbdec39c46910db8b-tempest-keypair-898616166' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 14 14:30:12.513226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi session.flush() Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result.read() Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 14 14:30:12.517096 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '39f9998d45bb4f9fbdec39c46910db8b-tempest-keypair-898616166' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 14, 14, 30, 12, 458120), 'updated_at': None, 'name': 'tempest-keypair-898616166', 'user_id': '39f9998d45bb4f9fbdec39c46910db8b', 'fingerprint': 'ff:86:46:a8:a3:2b:b0:b3:6a:4e:3c:a5:17:a3:f2:d7', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxzxnBT3CXAwxhSXw9Y2k78x04MX202ivjD6FBnA1/7Lnh4owH9/6TGl2/L3cbor18Cn6fnGS4JW745NTpSAc/GMYe707l/CPsC6eA62iQvdACIZYI+Mp5SXpf9HsSArg==', 'type': 'ssh'}] Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi keypair.create() Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._create() Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-898616166' already exists. Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 14 14:30:12.521794 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-898616166' already exists. Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-898616166' already exists. Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f73c649-dabc-4199-a67b-cae0a60b27f7 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Returning 409 to user: Key pair 'tempest-keypair-898616166' already exists. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8f73c649-dabc-4199-a67b-cae0a60b27f7 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.118475 Jul 14 14:30:12.528958 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 587/1176] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:30:12 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:30:12.541064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f22fb408-c337-4b39-b814-bd78dd827fc0 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Calling method '.version_select at 0x7fd6c57e3820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:12.580497 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f22fb408-c337-4b39-b814-bd78dd827fc0 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-898616166" status: 202 len: 0 microversion: 2.1 time: 0.054156 Jul 14 14:30:12.583355 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 588/1177] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jul 14 14:30:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-898616166 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:30:12.598431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ccbfcc91-5a93-48fd-870c-f659209428e2 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Action: 'create', calling method: .version_select at 0x7fd6c57e39d0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL7H3gvgF+SheSn6JPfwwRmTaY4XDH1pwFGZcxERqDohsOW3Gd/HKQ6b+/FKRXfFBn5dY9eJjQ9GhrUnHYayKWFtmcrNVrVrvEy47IfDYH3ywtdGxkKdgJCFtQODJ7f5g=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ccbfcc91-5a93-48fd-870c-f659209428e2 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Request method failure captured: Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 247 Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0ChzVKgp7LSfDdEio5jdtzITX-44my6A0ZRzDMMHI5w0giVtUXZB3WIeey57RlhuIymo4Mj7vSSv8rIrRRJT89hFim39w-ZPSHvu7_3YeikHHEgPm8kygw2Tj3WhhIYEFcxaiIzxvVmmWk1h8syv4uhKBCVLAlm3kt2wj90mbL5YxNo Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a59acfba78834bd29a38cd65d460b676", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}] Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL7H3gvgF+SheSn6JPfwwRmTaY4XDH1pwFGZcxERqDohsOW3Gd/HKQ6b+/FKRXfFBn5dY9eJjQ9GhrUnHYayKWFtmcrNVrVrvEy47IfDYH3ywtdGxkKdgJCFtQODJ7f5g=="}} Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL7H3gvgF+SheSn6JPfwwRmTaY4XDH1pwFGZcxERqDohsOW3Gd/HKQ6b+/FKRXfFBn5dY9eJjQ9GhrUnHYayKWFtmcrNVrVrvEy47IfDYH3ywtdGxkKdgJCFtQODJ7f5g=='}}} Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi '' Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:30:12.615289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ccbfcc91-5a93-48fd-870c-f659209428e2 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:12.623367 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ccbfcc91-5a93-48fd-870c-f659209428e2 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.030505 Jul 14 14:30:12.628596 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 589/1178] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:30:12 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:30:12.646754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-551c9d68-f5c1-4df6-947d-2144daa24cef tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Action: 'create', calling method: .version_select at 0x7fd6c59d9790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1762703626", "public_key": " "}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:12.722853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-551c9d68-f5c1-4df6-947d-2144daa24cef tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Getting quotas for project a59acfba78834bd29a38cd65d460b676. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:12.731039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-551c9d68-f5c1-4df6-947d-2144daa24cef tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Getting quotas for user 39f9998d45bb4f9fbdec39c46910db8b and project a59acfba78834bd29a38cd65d460b676. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:12.776380 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-551c9d68-f5c1-4df6-947d-2144daa24cef tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-551c9d68-f5c1-4df6-947d-2144daa24cef tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Request method failure captured: Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 95 Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0ChzVKgp7LSfDdEio5jdtzITX-44my6A0ZRzDMMHI5w0giVtUXZB3WIeey57RlhuIymo4Mj7vSSv8rIrRRJT89hFim39w-ZPSHvu7_3YeikHHEgPm8kygw2Tj3WhhIYEFcxaiIzxvVmmWk1h8syv4uhKBCVLAlm3kt2wj90mbL5YxNo Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a59acfba78834bd29a38cd65d460b676", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}] Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1762703626", "public_key": " "}} Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: exception: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1762703626', 'public_key': ' '}}} Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.780072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-551c9d68-f5c1-4df6-947d-2144daa24cef tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-551c9d68-f5c1-4df6-947d-2144daa24cef tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.142678 Jul 14 14:30:12.784612 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 590/1179] 10.222.0.81 () {60 vars in 1157 bytes} [Thu Jul 14 14:30:12 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:30:12.799934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2c2aaa6d-47bf-4d7a-9eb3-7f57fcba40fc tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Action: 'create', calling method: .version_select at 0x7fd6c59cc5e0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxhO+kKpxRMzpMG50Zw8wHy82QVmLYwlc33qAEWVHnKnRAUca21pQW6dgj8em/c18egqmn0dfwTT6Zy98WXjYMlfuXaB5n3bck+GiWKBUSKKqE4ckz0UZaLOz3CR7b5AA=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2c2aaa6d-47bf-4d7a-9eb3-7f57fcba40fc tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Request method failure captured: Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 507 Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0ChzVKgp7LSfDdEio5jdtzITX-44my6A0ZRzDMMHI5w0giVtUXZB3WIeey57RlhuIymo4Mj7vSSv8rIrRRJT89hFim39w-ZPSHvu7_3YeikHHEgPm8kygw2Tj3WhhIYEFcxaiIzxvVmmWk1h8syv4uhKBCVLAlm3kt2wj90mbL5YxNo Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a59acfba78834bd29a38cd65d460b676", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}] Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxhO+kKpxRMzpMG50Zw8wHy82QVmLYwlc33qAEWVHnKnRAUca21pQW6dgj8em/c18egqmn0dfwTT6Zy98WXjYMlfuXaB5n3bck+GiWKBUSKKqE4ckz0UZaLOz3CR7b5AA=="}} Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxhO+kKpxRMzpMG50Zw8wHy82QVmLYwlc33qAEWVHnKnRAUca21pQW6dgj8em/c18egqmn0dfwTT6Zy98WXjYMlfuXaB5n3bck+GiWKBUSKKqE4ckz0UZaLOz3CR7b5AA=='}}} Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 14 14:30:12.802505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2c2aaa6d-47bf-4d7a-9eb3-7f57fcba40fc tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2c2aaa6d-47bf-4d7a-9eb3-7f57fcba40fc tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.008919 Jul 14 14:30:12.813092 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 591/1180] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:30:12 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:30:12.817394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a2ec9150-7d39-4ae9-a3da-b3558743ebbe tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Action: 'create', calling method: .version_select at 0x7fd6c57e3ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1664477282", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:12.851643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a2ec9150-7d39-4ae9-a3da-b3558743ebbe tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Getting quotas for project a59acfba78834bd29a38cd65d460b676. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:12.866028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a2ec9150-7d39-4ae9-a3da-b3558743ebbe tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Getting quotas for user 39f9998d45bb4f9fbdec39c46910db8b and project a59acfba78834bd29a38cd65d460b676. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:12.907715 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-a2ec9150-7d39-4ae9-a3da-b3558743ebbe tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a2ec9150-7d39-4ae9-a3da-b3558743ebbe tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Request method failure captured: Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 118 Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0ChzVKgp7LSfDdEio5jdtzITX-44my6A0ZRzDMMHI5w0giVtUXZB3WIeey57RlhuIymo4Mj7vSSv8rIrRRJT89hFim39w-ZPSHvu7_3YeikHHEgPm8kygw2Tj3WhhIYEFcxaiIzxvVmmWk1h8syv4uhKBCVLAlm3kt2wj90mbL5YxNo Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a59acfba78834bd29a38cd65d460b676", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}] Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1664477282", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: exception: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1664477282', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 14 14:30:12.914473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.922503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a2ec9150-7d39-4ae9-a3da-b3558743ebbe tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:12.936068 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a2ec9150-7d39-4ae9-a3da-b3558743ebbe tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.110579 Jul 14 14:30:12.936068 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 592/1181] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:30:12 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 14 14:30:12.936526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-db30258f-bf76-4fca-ac8a-e78aaadcaac7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:12.937142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed1f6fa5-efc7-44fa-b95a-ecb791032772 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Calling method '.version_select at 0x7fd6c57e3e50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:12.950157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-db30258f-bf76-4fca-ac8a-e78aaadcaac7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:12.951686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-db30258f-bf76-4fca-ac8a-e78aaadcaac7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:12.952891 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-db30258f-bf76-4fca-ac8a-e78aaadcaac7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.473943 Jul 14 14:30:12.956467 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 590/1182] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:12 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:12.967430 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-ed1f6fa5-efc7-44fa-b95a-ecb791032772 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-184375794 not found for user 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed1f6fa5-efc7-44fa-b95a-ecb791032772 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Request method failure captured: Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-184375794 HTTP/1.1 Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0ChzVKgp7LSfDdEio5jdtzITX-44my6A0ZRzDMMHI5w0giVtUXZB3WIeey57RlhuIymo4Mj7vSSv8rIrRRJT89hFim39w-ZPSHvu7_3YeikHHEgPm8kygw2Tj3WhhIYEFcxaiIzxvVmmWk1h8syv4uhKBCVLAlm3kt2wj90mbL5YxNo Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a59acfba78834bd29a38cd65d460b676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a59acfba78834bd29a38cd65d460b676", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a59acfba78834bd29a38cd65d460b676"}]}] Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a59acfba78834bd29a38cd65d460b676 Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986258090 Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986258090-project Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: exception: Keypair tempest-keypair-non-existent-184375794 not found for user 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'tempest-keypair-non-existent-184375794'} Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-184375794 not found for user 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.969312 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-184375794 not found for user 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-184375794 not found for user 39f9998d45bb4f9fbdec39c46910db8b Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed1f6fa5-efc7-44fa-b95a-ecb791032772 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] Returning 404 to user: Keypair tempest-keypair-non-existent-184375794 not found for user 39f9998d45bb4f9fbdec39c46910db8b {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed1f6fa5-efc7-44fa-b95a-ecb791032772 tempest-KeyPairsNegativeTestJSON-1986258090 tempest-KeyPairsNegativeTestJSON-1986258090-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-184375794" status: 404 len: 144 microversion: 2.1 time: 0.041983 Jul 14 14:30:12.979607 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 593/1183] 10.222.0.81 () {58 vars in 1256 bytes} [Thu Jul 14 14:30:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-184375794 => generated 144 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:30:13.277034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aea978be-b0d8-4a41-a2e3-101df5f1f8df tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:13.277728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aea978be-b0d8-4a41-a2e3-101df5f1f8df tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:13.298073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aea978be-b0d8-4a41-a2e3-101df5f1f8df tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:13.298544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aea978be-b0d8-4a41-a2e3-101df5f1f8df tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:13.299347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aea978be-b0d8-4a41-a2e3-101df5f1f8df tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:13.299803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aea978be-b0d8-4a41-a2e3-101df5f1f8df tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:13.319070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:13.428685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af472d29-7230-4779-9451-3e0aadc939aa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:13.429736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-af472d29-7230-4779-9451-3e0aadc939aa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:13.443632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af472d29-7230-4779-9451-3e0aadc939aa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:13.444094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af472d29-7230-4779-9451-3e0aadc939aa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:13.444888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af472d29-7230-4779-9451-3e0aadc939aa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:13.454270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af472d29-7230-4779-9451-3e0aadc939aa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:13.538783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-aea978be-b0d8-4a41-a2e3-101df5f1f8df tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:13.552515 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aea978be-b0d8-4a41-a2e3-101df5f1f8df tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1423 microversion: 2.1 time: 0.280539 Jul 14 14:30:13.575772 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 591/1184] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:13 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1423 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:13.713037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e5f77101-0448-4512-be08-18bb84a32330 req-3cea7003-ffaa-4671-8714-9c3b2aec86e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9502c4d-a29b-45e0-9f2c-394c7661113c", "name": "network-vif-deleted", "tag": "3235c8eb-35a1-462b-ab85-9b68b3253f75"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:13.736240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e5f77101-0448-4512-be08-18bb84a32330 req-3cea7003-ffaa-4671-8714-9c3b2aec86e6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:13.738639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e5f77101-0448-4512-be08-18bb84a32330 req-3cea7003-ffaa-4671-8714-9c3b2aec86e6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:13.785290 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e5f77101-0448-4512-be08-18bb84a32330 req-3cea7003-ffaa-4671-8714-9c3b2aec86e6 service nova] Creating event network-vif-deleted:3235c8eb-35a1-462b-ab85-9b68b3253f75 for instance f9502c4d-a29b-45e0-9f2c-394c7661113c on n-h2-767704-28 Jul 14 14:30:13.811102 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e5f77101-0448-4512-be08-18bb84a32330 req-3cea7003-ffaa-4671-8714-9c3b2aec86e6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107759 Jul 14 14:30:13.812417 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 592/1185] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:13.895762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-af472d29-7230-4779-9451-3e0aadc939aa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:13.908854 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-af472d29-7230-4779-9451-3e0aadc939aa tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1475 microversion: 2.1 time: 0.485429 Jul 14 14:30:13.918626 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 594/1186] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:13 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1475 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:13.979799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6983f8e4-ac24-4b4b-90ba-b70b003e585a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:13.982556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6983f8e4-ac24-4b4b-90ba-b70b003e585a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:14.005045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6983f8e4-ac24-4b4b-90ba-b70b003e585a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:14.005045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6983f8e4-ac24-4b4b-90ba-b70b003e585a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:14.005045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6983f8e4-ac24-4b4b-90ba-b70b003e585a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:14.005045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6983f8e4-ac24-4b4b-90ba-b70b003e585a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:14.273609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6983f8e4-ac24-4b4b-90ba-b70b003e585a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:14.298390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6983f8e4-ac24-4b4b-90ba-b70b003e585a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:14.300029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6983f8e4-ac24-4b4b-90ba-b70b003e585a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:14.307469 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6983f8e4-ac24-4b4b-90ba-b70b003e585a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.330635 Jul 14 14:30:14.320005 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 593/1187] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:13 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:14.571996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-46d30054-aaed-4557-ad1b-bb9316266e1b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:14.572757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-46d30054-aaed-4557-ad1b-bb9316266e1b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:14.580350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46d30054-aaed-4557-ad1b-bb9316266e1b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:14.581789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46d30054-aaed-4557-ad1b-bb9316266e1b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:14.582689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46d30054-aaed-4557-ad1b-bb9316266e1b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:14.583488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46d30054-aaed-4557-ad1b-bb9316266e1b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:14.679261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-46d30054-aaed-4557-ad1b-bb9316266e1b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:14.694691 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-46d30054-aaed-4557-ad1b-bb9316266e1b tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 200 len: 1295 microversion: 2.1 time: 0.127273 Jul 14 14:30:14.695572 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 594/1188] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:14 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:30:14.927518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dea0272f-efc6-4cbb-8e91-437d76091a29 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:14.928055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dea0272f-efc6-4cbb-8e91-437d76091a29 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:14.951712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2020723196", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "6b253de3-a05b-4108-8629-b3ed951903ff"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:14.973933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dea0272f-efc6-4cbb-8e91-437d76091a29 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:14.974635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dea0272f-efc6-4cbb-8e91-437d76091a29 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:14.983203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dea0272f-efc6-4cbb-8e91-437d76091a29 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:14.985176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dea0272f-efc6-4cbb-8e91-437d76091a29 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:15.087754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] validate_networks() for [('6b253de3-a05b-4108-8629-b3ed951903ff', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:30:15.465566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dea0272f-efc6-4cbb-8e91-437d76091a29 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:15.491138 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dea0272f-efc6-4cbb-8e91-437d76091a29 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1475 microversion: 2.1 time: 0.557172 Jul 14 14:30:15.495357 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 595/1189] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:14 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1475 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:30:15.523202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-42dc5f15-417b-49bf-9f40-0e780e31fe65 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:15.525873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-42dc5f15-417b-49bf-9f40-0e780e31fe65 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:15.543396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42dc5f15-417b-49bf-9f40-0e780e31fe65 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:15.544637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42dc5f15-417b-49bf-9f40-0e780e31fe65 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:15.548669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42dc5f15-417b-49bf-9f40-0e780e31fe65 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:15.549445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42dc5f15-417b-49bf-9f40-0e780e31fe65 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:16.201713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:30:16.202463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:30:16.202938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:30:16.203358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:30:16.204524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:30:16.218382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:16.219248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:16.220363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:16.221092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:16.258462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Getting quotas for project 3755ed287bff4882ac3ead9acadfa731. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:16.272485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Getting quotas for user 31ab545bcb3a47b38c53fbfa6b11a432 and project 3755ed287bff4882ac3ead9acadfa731. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:16.292129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:30:16.296207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:30:16.425223 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1bd0aeb0-5ab4-4604-9045-6af935be300a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.990491 Jul 14 14:30:16.439102 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 595/1190] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:30:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:30:16.573333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-42dc5f15-417b-49bf-9f40-0e780e31fe65 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:16.595512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-42dc5f15-417b-49bf-9f40-0e780e31fe65 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:16.597612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-42dc5f15-417b-49bf-9f40-0e780e31fe65 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:16.599160 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-42dc5f15-417b-49bf-9f40-0e780e31fe65 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 1.092135 Jul 14 14:30:16.602028 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 596/1191] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:15 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:16.645313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b762586-d076-4764-a101-83e13024bd59 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:16.646470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0b762586-d076-4764-a101-83e13024bd59 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: f9502c4d-a29b-45e0-9f2c-394c7661113c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:16.690586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b762586-d076-4764-a101-83e13024bd59 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:16.694873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b762586-d076-4764-a101-83e13024bd59 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:16.702382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b762586-d076-4764-a101-83e13024bd59 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:16.703754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b762586-d076-4764-a101-83e13024bd59 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:16.767116 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-0b762586-d076-4764-a101-83e13024bd59 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] HTTP exception thrown: Instance f9502c4d-a29b-45e0-9f2c-394c7661113c could not be found. Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b762586-d076-4764-a101-83e13024bd59 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Request method failure captured: Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c HTTP/1.1 Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cg2xFY4Wcp46oVQ_i8UGMIT1qqum7pvipYqjXiwdlLPfX5ilJgqw5Jc4PsebBX63kCvQqs8XuP8GT5fQMkrDZ1Ao0NGLEJlI9s7e0X7aExqNkrkqI6kDFv20h9zzaJ_ChV0HMmTfoSq0eb2bwLvj4I79LLXo-eS1dL98OPC_8k0-t8 Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 8baaf403ad6a44919ea2e5bec2df5f2b Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-LiveMigrationNegativeTest-964438354 Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8baaf403ad6a44919ea2e5bec2df5f2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8baaf403ad6a44919ea2e5bec2df5f2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8baaf403ad6a44919ea2e5bec2df5f2b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8baaf403ad6a44919ea2e5bec2df5f2b"}]}] Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-LiveMigrationNegativeTest-964438354 Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 8baaf403ad6a44919ea2e5bec2df5f2b Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-964438354 Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-LiveMigrationNegativeTest-964438354-project Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9ec43300027a4fd2b63886f9d04f5c99 Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-LiveMigrationNegativeTest-964438354-project Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance f9502c4d-a29b-45e0-9f2c-394c7661113c could not be found. Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'f9502c4d-a29b-45e0-9f2c-394c7661113c'} Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9502c4d-a29b-45e0-9f2c-394c7661113c could not be found. Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9502c4d-a29b-45e0-9f2c-394c7661113c could not be found. Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:16.794559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:16.798984 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:16.798984 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:16.798984 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:16.798984 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:16.798984 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:16.798984 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9502c4d-a29b-45e0-9f2c-394c7661113c could not be found. Jul 14 14:30:16.798984 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:30:16.798984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b762586-d076-4764-a101-83e13024bd59 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Returning 404 to user: Instance f9502c4d-a29b-45e0-9f2c-394c7661113c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:16.821814 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0b762586-d076-4764-a101-83e13024bd59 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c" status: 404 len: 111 microversion: 2.1 time: 0.206176 Jul 14 14:30:16.826613 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 597/1192] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:16 2022] GET /compute/v2.1/servers/f9502c4d-a29b-45e0-9f2c-394c7661113c => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:30:16.875619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ea7ef1bc-346d-4708-92dc-2bf6cd0d204d tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:16.877834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ea7ef1bc-346d-4708-92dc-2bf6cd0d204d tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:16.934678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea7ef1bc-346d-4708-92dc-2bf6cd0d204d tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:16.935144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea7ef1bc-346d-4708-92dc-2bf6cd0d204d tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:16.935947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea7ef1bc-346d-4708-92dc-2bf6cd0d204d tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:16.951453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea7ef1bc-346d-4708-92dc-2bf6cd0d204d tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:17.604475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-363589733", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:17.693007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:30:17.991853 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ea7ef1bc-346d-4708-92dc-2bf6cd0d204d tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1861 microversion: 2.1 time: 1.163706 Jul 14 14:30:17.995692 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 598/1193] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:16 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1861 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:18.002348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5bf719c4-35c9-45da-9bae-6739fbbff3d7 req-c4f16a65-61dd-417d-989b-287935a8022b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07717385-1942-4235-9479-e46016827db8", "name": "network-vif-unplugged", "status": "completed", "tag": "a3c7a75e-482a-45ff-810c-3fd5b8e4c273"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:18.013806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5bf719c4-35c9-45da-9bae-6739fbbff3d7 req-c4f16a65-61dd-417d-989b-287935a8022b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:18.015048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5bf719c4-35c9-45da-9bae-6739fbbff3d7 req-c4f16a65-61dd-417d-989b-287935a8022b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:18.027318 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5bf719c4-35c9-45da-9bae-6739fbbff3d7 req-c4f16a65-61dd-417d-989b-287935a8022b service nova] Creating event network-vif-unplugged:a3c7a75e-482a-45ff-810c-3fd5b8e4c273 for instance 07717385-1942-4235-9479-e46016827db8 on n-h1-767704-28 Jul 14 14:30:18.033587 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5bf719c4-35c9-45da-9bae-6739fbbff3d7 req-c4f16a65-61dd-417d-989b-287935a8022b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036191 Jul 14 14:30:18.039174 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 599/1194] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:18.047082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5c913570-b404-45fe-be8b-5182b6433bca tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:18.048075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5c913570-b404-45fe-be8b-5182b6433bca tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:18.056272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c913570-b404-45fe-be8b-5182b6433bca tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:18.057262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c913570-b404-45fe-be8b-5182b6433bca tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:18.060366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c913570-b404-45fe-be8b-5182b6433bca tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:18.061075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c913570-b404-45fe-be8b-5182b6433bca tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:18.392088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5c913570-b404-45fe-be8b-5182b6433bca tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:18.401156 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5c913570-b404-45fe-be8b-5182b6433bca tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 200 len: 1204 microversion: 2.1 time: 0.358850 Jul 14 14:30:18.401751 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 600/1195] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:18 2022] GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 1204 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:18.416726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:30:18.417297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:30:18.418058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:30:18.418781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:30:18.419428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:30:18.425954 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e1db9b76-7d62-41af-a485-65dcc49d34e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:18.426566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e1db9b76-7d62-41af-a485-65dcc49d34e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:18.438879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1db9b76-7d62-41af-a485-65dcc49d34e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:18.440520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1db9b76-7d62-41af-a485-65dcc49d34e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:18.443336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1db9b76-7d62-41af-a485-65dcc49d34e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:18.444699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:18.444857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1db9b76-7d62-41af-a485-65dcc49d34e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:18.447389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:18.448548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:18.450338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:18.513362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Getting quotas for project d3b24d9de5fc49eaaf9c05e31c1489e4. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:18.556764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Getting quotas for user 1a660ea88d644d57a49d4afc09433796 and project d3b24d9de5fc49eaaf9c05e31c1489e4. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:18.609709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:30:18.611781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:30:18.715107 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-da301ef5-923f-499d-82f1-fc2fadc60303 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.274466 Jul 14 14:30:18.723346 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 596/1196] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:30:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:30:18.779874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-27cbf002-1f2a-4de9-a82e-4a9f090d29fc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:18.780701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-27cbf002-1f2a-4de9-a82e-4a9f090d29fc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:18.801325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e1db9b76-7d62-41af-a485-65dcc49d34e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:18.811816 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e1db9b76-7d62-41af-a485-65dcc49d34e2 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1475 microversion: 2.1 time: 0.389563 Jul 14 14:30:18.817351 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 601/1197] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:18 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1475 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:18.820505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27cbf002-1f2a-4de9-a82e-4a9f090d29fc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:18.823976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27cbf002-1f2a-4de9-a82e-4a9f090d29fc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:18.824655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-98b9a2c5-4756-43d9-af3e-81f8880bf5fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:18.825411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27cbf002-1f2a-4de9-a82e-4a9f090d29fc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:18.825666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-98b9a2c5-4756-43d9-af3e-81f8880bf5fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:18.826153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27cbf002-1f2a-4de9-a82e-4a9f090d29fc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:18.850423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-98b9a2c5-4756-43d9-af3e-81f8880bf5fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:18.855415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-98b9a2c5-4756-43d9-af3e-81f8880bf5fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:18.858253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-98b9a2c5-4756-43d9-af3e-81f8880bf5fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:18.866522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-98b9a2c5-4756-43d9-af3e-81f8880bf5fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:18.951911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-27cbf002-1f2a-4de9-a82e-4a9f090d29fc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:30:19.187884 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-27cbf002-1f2a-4de9-a82e-4a9f090d29fc tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "DELETE /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 204 len: 0 microversion: 2.1 time: 0.461577 Jul 14 14:30:19.187884 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 597/1198] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:30:18 2022] DELETE /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:30:19.199878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b32ce120-d4ca-4f41-9259-3efe888a320e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-767704-28", "block_migration": true, "disk_over_commit": false}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:19.213836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b32ce120-d4ca-4f41-9259-3efe888a320e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:19.226714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b32ce120-d4ca-4f41-9259-3efe888a320e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:19.227205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b32ce120-d4ca-4f41-9259-3efe888a320e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:19.235692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b32ce120-d4ca-4f41-9259-3efe888a320e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:19.237079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b32ce120-d4ca-4f41-9259-3efe888a320e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:19.307628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-b32ce120-d4ca-4f41-9259-3efe888a320e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lazy-loading 'flavor' on Instance uuid e10e43da-f4f0-41c8-99db-efd48a91831a {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:30:19.348581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b32ce120-d4ca-4f41-9259-3efe888a320e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Going to try to live migrate instance to n-h2-767704-28 {{(pid=119511) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:30:19.464931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-98b9a2c5-4756-43d9-af3e-81f8880bf5fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:19.480019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-98b9a2c5-4756-43d9-af3e-81f8880bf5fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:19.495016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-98b9a2c5-4756-43d9-af3e-81f8880bf5fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:19.498092 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-98b9a2c5-4756-43d9-af3e-81f8880bf5fe tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.678971 Jul 14 14:30:19.525335 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 602/1199] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:18 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:19.546216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-df2346f4-0483-47a8-bd58-6a8d75e2bc20 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:19.547584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-df2346f4-0483-47a8-bd58-6a8d75e2bc20 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:19.623917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:19.913130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-df2346f4-0483-47a8-bd58-6a8d75e2bc20 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:19.925995 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-df2346f4-0483-47a8-bd58-6a8d75e2bc20 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1221 microversion: 2.1 time: 0.396940 Jul 14 14:30:19.926756 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 603/1200] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:19 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1221 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:19.940656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a08cbbe-851a-4291-b40c-c7d13eefb650 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:19.941712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3a08cbbe-851a-4291-b40c-c7d13eefb650 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:19.980456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a08cbbe-851a-4291-b40c-c7d13eefb650 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:19.980936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a08cbbe-851a-4291-b40c-c7d13eefb650 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:19.981853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a08cbbe-851a-4291-b40c-c7d13eefb650 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:19.982304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a08cbbe-851a-4291-b40c-c7d13eefb650 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:20.844423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3a08cbbe-851a-4291-b40c-c7d13eefb650 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:20.861234 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3a08cbbe-851a-4291-b40c-c7d13eefb650 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1474 microversion: 2.1 time: 0.933003 Jul 14 14:30:20.862554 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 604/1201] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:19 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1474 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:20.881563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a5e5345d-84df-48a1-82e6-231a51125436 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:20.882190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a5e5345d-84df-48a1-82e6-231a51125436 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:20.903978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5e5345d-84df-48a1-82e6-231a51125436 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:20.903978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5e5345d-84df-48a1-82e6-231a51125436 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:20.904340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5e5345d-84df-48a1-82e6-231a51125436 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:20.904806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5e5345d-84df-48a1-82e6-231a51125436 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:21.201853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a5e5345d-84df-48a1-82e6-231a51125436 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:21.215461 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a5e5345d-84df-48a1-82e6-231a51125436 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 200 len: 1266 microversion: 2.1 time: 0.351418 Jul 14 14:30:21.218731 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 605/1202] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:20 2022] GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:21.234483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1a7bcb60-c228-4594-b28a-e21195fd7e36 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:21.235714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1a7bcb60-c228-4594-b28a-e21195fd7e36 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:21.269935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a7bcb60-c228-4594-b28a-e21195fd7e36 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:21.270462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a7bcb60-c228-4594-b28a-e21195fd7e36 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:21.276280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a7bcb60-c228-4594-b28a-e21195fd7e36 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:21.277574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a7bcb60-c228-4594-b28a-e21195fd7e36 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:22.033717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a7bcb60-c228-4594-b28a-e21195fd7e36 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:22.055413 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1a7bcb60-c228-4594-b28a-e21195fd7e36 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1475 microversion: 2.1 time: 0.830606 Jul 14 14:30:22.058750 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 606/1203] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:21 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1475 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:22.080814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-feadd629-e7bc-4ccc-8c7f-d8b0193e287d req-a92d1b6c-b588-4db6-8c3f-c6a78ca6ed6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07717385-1942-4235-9479-e46016827db8", "tag": "a3c7a75e-482a-45ff-810c-3fd5b8e4c273"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:22.103910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:22.106264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-feadd629-e7bc-4ccc-8c7f-d8b0193e287d req-a92d1b6c-b588-4db6-8c3f-c6a78ca6ed6a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:22.106722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-feadd629-e7bc-4ccc-8c7f-d8b0193e287d req-a92d1b6c-b588-4db6-8c3f-c6a78ca6ed6a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:22.125413 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-feadd629-e7bc-4ccc-8c7f-d8b0193e287d req-a92d1b6c-b588-4db6-8c3f-c6a78ca6ed6a service nova] Creating event network-changed:a3c7a75e-482a-45ff-810c-3fd5b8e4c273 for instance 07717385-1942-4235-9479-e46016827db8 on n-h1-767704-28 Jul 14 14:30:22.135312 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-feadd629-e7bc-4ccc-8c7f-d8b0193e287d req-a92d1b6c-b588-4db6-8c3f-c6a78ca6ed6a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072659 Jul 14 14:30:22.139017 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 607/1204] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:22.153231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f02facb-9330-484d-ae4e-d51c55c0e61d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:22.154562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3f02facb-9330-484d-ae4e-d51c55c0e61d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:22.162889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f02facb-9330-484d-ae4e-d51c55c0e61d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:22.163599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f02facb-9330-484d-ae4e-d51c55c0e61d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:22.166163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f02facb-9330-484d-ae4e-d51c55c0e61d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:22.167170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f02facb-9330-484d-ae4e-d51c55c0e61d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:22.690736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3f02facb-9330-484d-ae4e-d51c55c0e61d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:22.707933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3f02facb-9330-484d-ae4e-d51c55c0e61d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:22.718593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3f02facb-9330-484d-ae4e-d51c55c0e61d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:22.721276 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f02facb-9330-484d-ae4e-d51c55c0e61d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.579742 Jul 14 14:30:22.723124 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 608/1205] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:22 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:22.742228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-237ca46c-94fa-423f-8d33-ee16382455d4 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:22.747371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-237ca46c-94fa-423f-8d33-ee16382455d4 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:22.755474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-237ca46c-94fa-423f-8d33-ee16382455d4 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:22.757324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-237ca46c-94fa-423f-8d33-ee16382455d4 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:22.761657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-237ca46c-94fa-423f-8d33-ee16382455d4 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:22.762198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-237ca46c-94fa-423f-8d33-ee16382455d4 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:22.913876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-237ca46c-94fa-423f-8d33-ee16382455d4 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:22.938952 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-237ca46c-94fa-423f-8d33-ee16382455d4 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1279 microversion: 2.1 time: 0.206149 Jul 14 14:30:22.940640 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 609/1206] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:22 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:22.946874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7fb9abc5-57c0-4974-9a4c-70b6d40f1135 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:22.949860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7fb9abc5-57c0-4974-9a4c-70b6d40f1135 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:22.971320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7fb9abc5-57c0-4974-9a4c-70b6d40f1135 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:22.971795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7fb9abc5-57c0-4974-9a4c-70b6d40f1135 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:22.975396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7fb9abc5-57c0-4974-9a4c-70b6d40f1135 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:22.978136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7fb9abc5-57c0-4974-9a4c-70b6d40f1135 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:23.235611 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b32ce120-d4ca-4f41-9259-3efe888a320e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/action" status: 202 len: 0 microversion: 2.1 time: 4.046438 Jul 14 14:30:23.241741 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 598/1207] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:30:19 2022] POST /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/action => generated 0 bytes in 4053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:30:23.259309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-308755b5-4eca-4acb-b174-87c68323cc2d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:23.260744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-308755b5-4eca-4acb-b174-87c68323cc2d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:23.279696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-308755b5-4eca-4acb-b174-87c68323cc2d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:23.280483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-308755b5-4eca-4acb-b174-87c68323cc2d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:23.281570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-308755b5-4eca-4acb-b174-87c68323cc2d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:23.282699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-308755b5-4eca-4acb-b174-87c68323cc2d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:23.334405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7fb9abc5-57c0-4974-9a4c-70b6d40f1135 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec43300027a4fd2b63886f9d04f5c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8baaf403ad6a44919ea2e5bec2df5f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:23.361463 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7fb9abc5-57c0-4974-9a4c-70b6d40f1135 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 200 len: 1432 microversion: 2.1 time: 0.419008 Jul 14 14:30:23.362704 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 610/1208] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:22 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 1432 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:23.371857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2487a0da-00b6-4730-bd0f-22d25700afa6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:23.372903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2487a0da-00b6-4730-bd0f-22d25700afa6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:23.389033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2487a0da-00b6-4730-bd0f-22d25700afa6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:23.396380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2487a0da-00b6-4730-bd0f-22d25700afa6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:23.397768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2487a0da-00b6-4730-bd0f-22d25700afa6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:23.400921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2487a0da-00b6-4730-bd0f-22d25700afa6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:23.441499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:24.000249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2487a0da-00b6-4730-bd0f-22d25700afa6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:24.018363 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2487a0da-00b6-4730-bd0f-22d25700afa6 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1475 microversion: 2.1 time: 0.654457 Jul 14 14:30:24.019552 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 611/1209] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:23 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1475 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:24.039341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-682372c0-3c99-4b5d-aee0-2f358080f841 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:24.042788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-682372c0-3c99-4b5d-aee0-2f358080f841 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:24.062132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-682372c0-3c99-4b5d-aee0-2f358080f841 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:24.062836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-682372c0-3c99-4b5d-aee0-2f358080f841 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:24.067524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-682372c0-3c99-4b5d-aee0-2f358080f841 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:24.068706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-682372c0-3c99-4b5d-aee0-2f358080f841 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:24.138782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-308755b5-4eca-4acb-b174-87c68323cc2d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:24.158878 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-308755b5-4eca-4acb-b174-87c68323cc2d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 200 len: 1308 microversion: 2.1 time: 0.904607 Jul 14 14:30:24.159650 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 599/1210] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:23 2022] GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 1308 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:24.173246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f7a45569-b3d6-44f8-aeac-ccea092e1480 req-ab8bc42b-43d2-4a95-90c1-1c842a5830cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35fe2440-1aaf-4806-aa06-c1433e0b86c1", "name": "network-vif-deleted", "tag": "ff8a672d-3bc1-448c-ac12-3d26f3c436d9"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:24.198919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f7a45569-b3d6-44f8-aeac-ccea092e1480 req-ab8bc42b-43d2-4a95-90c1-1c842a5830cd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:24.199633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f7a45569-b3d6-44f8-aeac-ccea092e1480 req-ab8bc42b-43d2-4a95-90c1-1c842a5830cd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:24.223591 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f7a45569-b3d6-44f8-aeac-ccea092e1480 req-ab8bc42b-43d2-4a95-90c1-1c842a5830cd service nova] Creating event network-vif-deleted:ff8a672d-3bc1-448c-ac12-3d26f3c436d9 for instance 35fe2440-1aaf-4806-aa06-c1433e0b86c1 on n-h2-767704-28 Jul 14 14:30:24.235013 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f7a45569-b3d6-44f8-aeac-ccea092e1480 req-ab8bc42b-43d2-4a95-90c1-1c842a5830cd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073040 Jul 14 14:30:24.235638 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 600/1211] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:24.247435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f541e10c-53f4-4351-9f53-3875513b737b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:24.259249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f541e10c-53f4-4351-9f53-3875513b737b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:24.263154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:24.271576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f541e10c-53f4-4351-9f53-3875513b737b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:24.272180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f541e10c-53f4-4351-9f53-3875513b737b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:24.273362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f541e10c-53f4-4351-9f53-3875513b737b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:24.274064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f541e10c-53f4-4351-9f53-3875513b737b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:24.714770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-682372c0-3c99-4b5d-aee0-2f358080f841 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:24.738918 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-682372c0-3c99-4b5d-aee0-2f358080f841 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.717845 Jul 14 14:30:24.746759 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 612/1212] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:24 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:24.766262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-78959457-dad1-485d-b9cf-ae70c943468f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:24.769875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-78959457-dad1-485d-b9cf-ae70c943468f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:24.782892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78959457-dad1-485d-b9cf-ae70c943468f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:24.784120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78959457-dad1-485d-b9cf-ae70c943468f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:24.786187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78959457-dad1-485d-b9cf-ae70c943468f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:24.792186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78959457-dad1-485d-b9cf-ae70c943468f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:24.882238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f541e10c-53f4-4351-9f53-3875513b737b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:24.899407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f541e10c-53f4-4351-9f53-3875513b737b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:24.910763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f541e10c-53f4-4351-9f53-3875513b737b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:24.913568 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f541e10c-53f4-4351-9f53-3875513b737b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.672414 Jul 14 14:30:24.916263 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 601/1213] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:24 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:24.935260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-678dcbe5-3ae9-4e07-b1b6-82701038ea74 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:24.936530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-678dcbe5-3ae9-4e07-b1b6-82701038ea74 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] [instance: 35fe2440-1aaf-4806-aa06-c1433e0b86c1] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:24.959255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-678dcbe5-3ae9-4e07-b1b6-82701038ea74 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:24.960645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-678dcbe5-3ae9-4e07-b1b6-82701038ea74 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:24.962562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-678dcbe5-3ae9-4e07-b1b6-82701038ea74 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:24.963395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-678dcbe5-3ae9-4e07-b1b6-82701038ea74 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:24.985328 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-678dcbe5-3ae9-4e07-b1b6-82701038ea74 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] HTTP exception thrown: Instance 35fe2440-1aaf-4806-aa06-c1433e0b86c1 could not be found. Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-678dcbe5-3ae9-4e07-b1b6-82701038ea74 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Request method failure captured: Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 HTTP/1.1 Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cg2xFY4Wcp46oVQ_i8UGMIT1qqum7pvipYqjXiwdlLPfX5ilJgqw5Jc4PsebBX63kCvQqs8XuP8GT5fQMkrDZ1Ao0NGLEJlI9s7e0X7aExqNkrkqI6kDFv20h9zzaJ_ChV0HMmTfoSq0eb2bwLvj4I79LLXo-eS1dL98OPC_8k0-t8 Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 8baaf403ad6a44919ea2e5bec2df5f2b Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-LiveMigrationNegativeTest-964438354 Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8baaf403ad6a44919ea2e5bec2df5f2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8baaf403ad6a44919ea2e5bec2df5f2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8baaf403ad6a44919ea2e5bec2df5f2b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8baaf403ad6a44919ea2e5bec2df5f2b"}]}] Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-LiveMigrationNegativeTest-964438354 Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 8baaf403ad6a44919ea2e5bec2df5f2b Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-964438354 Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-LiveMigrationNegativeTest-964438354-project Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9ec43300027a4fd2b63886f9d04f5c99 Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-LiveMigrationNegativeTest-964438354-project Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 35fe2440-1aaf-4806-aa06-c1433e0b86c1 could not be found. Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '35fe2440-1aaf-4806-aa06-c1433e0b86c1'} Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35fe2440-1aaf-4806-aa06-c1433e0b86c1 could not be found. Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35fe2440-1aaf-4806-aa06-c1433e0b86c1 could not be found. Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:24.987435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:24.994931 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:24.994931 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:24.994931 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:24.994931 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:24.994931 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:24.994931 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35fe2440-1aaf-4806-aa06-c1433e0b86c1 could not be found. Jul 14 14:30:24.994931 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:25.000241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-78959457-dad1-485d-b9cf-ae70c943468f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:25.008686 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-78959457-dad1-485d-b9cf-ae70c943468f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1279 microversion: 2.1 time: 0.258290 Jul 14 14:30:25.009757 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 613/1214] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:24 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1279 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:25.028098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-678dcbe5-3ae9-4e07-b1b6-82701038ea74 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] Returning 404 to user: Instance 35fe2440-1aaf-4806-aa06-c1433e0b86c1 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:25.029578 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-678dcbe5-3ae9-4e07-b1b6-82701038ea74 tempest-LiveMigrationNegativeTest-964438354 tempest-LiveMigrationNegativeTest-964438354-project] 10.222.0.81 "GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1" status: 404 len: 111 microversion: 2.1 time: 0.110113 Jul 14 14:30:25.030541 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 602/1215] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:24 2022] GET /compute/v2.1/servers/35fe2440-1aaf-4806-aa06-c1433e0b86c1 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:30:25.072794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-79a9517d-c46c-4262-a72c-2905f26fe458 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:25.076542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-79a9517d-c46c-4262-a72c-2905f26fe458 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:25.106715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79a9517d-c46c-4262-a72c-2905f26fe458 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:25.107347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79a9517d-c46c-4262-a72c-2905f26fe458 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:25.108208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79a9517d-c46c-4262-a72c-2905f26fe458 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:25.108657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79a9517d-c46c-4262-a72c-2905f26fe458 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:25.181301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cbb77b50-6cf4-4715-a5a4-4a0470f95b3c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:25.182644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cbb77b50-6cf4-4715-a5a4-4a0470f95b3c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:25.210690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cbb77b50-6cf4-4715-a5a4-4a0470f95b3c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:25.212558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cbb77b50-6cf4-4715-a5a4-4a0470f95b3c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:25.214402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cbb77b50-6cf4-4715-a5a4-4a0470f95b3c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:25.220191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cbb77b50-6cf4-4715-a5a4-4a0470f95b3c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:25.785143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cbb77b50-6cf4-4715-a5a4-4a0470f95b3c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:25.807649 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cbb77b50-6cf4-4715-a5a4-4a0470f95b3c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 200 len: 1308 microversion: 2.1 time: 0.632232 Jul 14 14:30:25.822851 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 603/1216] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:25 2022] GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 1308 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:25.829946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-72cee69d-8844-45f2-8832-91eab9488e06 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:25.837470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-72cee69d-8844-45f2-8832-91eab9488e06 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:25.862332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72cee69d-8844-45f2-8832-91eab9488e06 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:25.863208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72cee69d-8844-45f2-8832-91eab9488e06 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:25.864292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72cee69d-8844-45f2-8832-91eab9488e06 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:25.865265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72cee69d-8844-45f2-8832-91eab9488e06 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:26.502543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-79a9517d-c46c-4262-a72c-2905f26fe458 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:26.511734 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-79a9517d-c46c-4262-a72c-2905f26fe458 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1475 microversion: 2.1 time: 1.467403 Jul 14 14:30:26.524817 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 614/1217] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:25 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1475 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:26.529234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5675e058-44e4-49a1-9108-a7cb306b1c5b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:26.530088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5675e058-44e4-49a1-9108-a7cb306b1c5b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:26.539263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5675e058-44e4-49a1-9108-a7cb306b1c5b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:26.541724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5675e058-44e4-49a1-9108-a7cb306b1c5b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:26.543079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5675e058-44e4-49a1-9108-a7cb306b1c5b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:26.544578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5675e058-44e4-49a1-9108-a7cb306b1c5b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:26.994994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-72cee69d-8844-45f2-8832-91eab9488e06 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:27.011858 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-72cee69d-8844-45f2-8832-91eab9488e06 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 1.184308 Jul 14 14:30:27.023465 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 604/1218] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:25 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:27.035578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1d37b174-c2c8-410e-9afc-35b2d2a31885 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:27.036932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1d37b174-c2c8-410e-9afc-35b2d2a31885 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:27.053957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d37b174-c2c8-410e-9afc-35b2d2a31885 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:27.054416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d37b174-c2c8-410e-9afc-35b2d2a31885 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:27.057721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d37b174-c2c8-410e-9afc-35b2d2a31885 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:27.058444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d37b174-c2c8-410e-9afc-35b2d2a31885 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:27.637107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5675e058-44e4-49a1-9108-a7cb306b1c5b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:27.647636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5675e058-44e4-49a1-9108-a7cb306b1c5b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:27.653962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5675e058-44e4-49a1-9108-a7cb306b1c5b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:27.655449 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5675e058-44e4-49a1-9108-a7cb306b1c5b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 1.138768 Jul 14 14:30:27.656582 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 615/1219] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:26 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:27.661613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aa345769-9059-4d0d-b417-6bd975d38afb tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:27.665919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aa345769-9059-4d0d-b417-6bd975d38afb tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:27.690019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa345769-9059-4d0d-b417-6bd975d38afb tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:27.690674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa345769-9059-4d0d-b417-6bd975d38afb tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:27.691606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa345769-9059-4d0d-b417-6bd975d38afb tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:27.692159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa345769-9059-4d0d-b417-6bd975d38afb tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:28.353768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1d37b174-c2c8-410e-9afc-35b2d2a31885 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:28.370005 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1d37b174-c2c8-410e-9afc-35b2d2a31885 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1321 microversion: 2.1 time: 1.344599 Jul 14 14:30:28.370520 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 605/1220] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:27 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1321 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:28.378886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-176e61bf-ca8b-4cae-9983-c156245d7116 req-db3b132a-952d-429d-9a8b-f0bafbcd9367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc69728d-ad31-4750-a7e2-ef09d6dd3686", "tag": "4b7a1348-79bc-4d4e-8c50-0bfe89eac4b1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:28.401098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-176e61bf-ca8b-4cae-9983-c156245d7116 req-db3b132a-952d-429d-9a8b-f0bafbcd9367 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:28.401545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-176e61bf-ca8b-4cae-9983-c156245d7116 req-db3b132a-952d-429d-9a8b-f0bafbcd9367 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:28.428283 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-176e61bf-ca8b-4cae-9983-c156245d7116 req-db3b132a-952d-429d-9a8b-f0bafbcd9367 service nova] Creating event network-changed:4b7a1348-79bc-4d4e-8c50-0bfe89eac4b1 for instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 on n-h2-767704-28 Jul 14 14:30:28.436978 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-176e61bf-ca8b-4cae-9983-c156245d7116 req-db3b132a-952d-429d-9a8b-f0bafbcd9367 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065165 Jul 14 14:30:28.437615 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 606/1221] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:28.459650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2dc89587-a964-418b-943d-a2c726ba04d8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:28.460368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2dc89587-a964-418b-943d-a2c726ba04d8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:28.470247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:28.472463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2dc89587-a964-418b-943d-a2c726ba04d8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:28.472922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2dc89587-a964-418b-943d-a2c726ba04d8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:28.473850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2dc89587-a964-418b-943d-a2c726ba04d8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:28.474282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2dc89587-a964-418b-943d-a2c726ba04d8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:28.585619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=28 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:28.910998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-aa345769-9059-4d0d-b417-6bd975d38afb tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:28.941568 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aa345769-9059-4d0d-b417-6bd975d38afb tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 200 len: 1308 microversion: 2.1 time: 1.269788 Jul 14 14:30:28.947211 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 616/1222] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:27 2022] GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 1308 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:28.986424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-67f4adde-6170-418c-8ab5-87a8a5afb35d req-ee2129e8-da14-4d4b-a770-9daf6a71fd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07717385-1942-4235-9479-e46016827db8", "name": "network-vif-unplugged", "status": "completed", "tag": "a3c7a75e-482a-45ff-810c-3fd5b8e4c273"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:28.995366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-67f4adde-6170-418c-8ab5-87a8a5afb35d req-ee2129e8-da14-4d4b-a770-9daf6a71fd25 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:28.995812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-67f4adde-6170-418c-8ab5-87a8a5afb35d req-ee2129e8-da14-4d4b-a770-9daf6a71fd25 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:29.038163 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-67f4adde-6170-418c-8ab5-87a8a5afb35d req-ee2129e8-da14-4d4b-a770-9daf6a71fd25 service nova] Creating event network-vif-unplugged:a3c7a75e-482a-45ff-810c-3fd5b8e4c273 for instance 07717385-1942-4235-9479-e46016827db8 on n-h1-767704-28 Jul 14 14:30:29.049995 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-67f4adde-6170-418c-8ab5-87a8a5afb35d req-ee2129e8-da14-4d4b-a770-9daf6a71fd25 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097711 Jul 14 14:30:29.055226 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 617/1223] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:29.069816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-50d5f9a6-c65a-4a03-a317-fa96dc6cf84c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:29.070799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-50d5f9a6-c65a-4a03-a317-fa96dc6cf84c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:29.098280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50d5f9a6-c65a-4a03-a317-fa96dc6cf84c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:29.099047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50d5f9a6-c65a-4a03-a317-fa96dc6cf84c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:29.100490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50d5f9a6-c65a-4a03-a317-fa96dc6cf84c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:29.101152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50d5f9a6-c65a-4a03-a317-fa96dc6cf84c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:29.922641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:29.932479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2dc89587-a964-418b-943d-a2c726ba04d8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:29.939915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:29.948157 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2dc89587-a964-418b-943d-a2c726ba04d8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1474 microversion: 2.1 time: 1.509320 Jul 14 14:30:29.959574 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 607/1224] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:28 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1474 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:29.975494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-129486d9-46fa-4b78-a209-57b3369c3b1b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:29.977062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-129486d9-46fa-4b78-a209-57b3369c3b1b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:30.008140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-129486d9-46fa-4b78-a209-57b3369c3b1b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:30.013107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-129486d9-46fa-4b78-a209-57b3369c3b1b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:30.014969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-129486d9-46fa-4b78-a209-57b3369c3b1b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:30.015829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-129486d9-46fa-4b78-a209-57b3369c3b1b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:30.544364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-50d5f9a6-c65a-4a03-a317-fa96dc6cf84c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:30.561744 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-50d5f9a6-c65a-4a03-a317-fa96dc6cf84c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 1.504832 Jul 14 14:30:30.575989 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 618/1225] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:29 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:30.598161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f4b145b4-7daf-451f-851a-eb8539f04a06 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:30.599481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f4b145b4-7daf-451f-851a-eb8539f04a06 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:30.630723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4b145b4-7daf-451f-851a-eb8539f04a06 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:30.642176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4b145b4-7daf-451f-851a-eb8539f04a06 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:30.644681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4b145b4-7daf-451f-851a-eb8539f04a06 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:30.645918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4b145b4-7daf-451f-851a-eb8539f04a06 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:31.214295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-129486d9-46fa-4b78-a209-57b3369c3b1b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:31.230287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-129486d9-46fa-4b78-a209-57b3369c3b1b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:31.231831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-129486d9-46fa-4b78-a209-57b3369c3b1b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:31.239206 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-129486d9-46fa-4b78-a209-57b3369c3b1b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 1.277653 Jul 14 14:30:31.239825 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 608/1226] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:29 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:31.246591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4595c959-0a45-4a31-88d1-a686a3c201bc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:31.256365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4595c959-0a45-4a31-88d1-a686a3c201bc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:31.292216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4595c959-0a45-4a31-88d1-a686a3c201bc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:31.295025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4595c959-0a45-4a31-88d1-a686a3c201bc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:31.296121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4595c959-0a45-4a31-88d1-a686a3c201bc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:31.297288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4595c959-0a45-4a31-88d1-a686a3c201bc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:31.597944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f4b145b4-7daf-451f-851a-eb8539f04a06 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:31.629124 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f4b145b4-7daf-451f-851a-eb8539f04a06 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1321 microversion: 2.1 time: 1.051308 Jul 14 14:30:31.656284 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 619/1227] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:30 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1321 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:31.672057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4cb63032-e8b4-4791-9ba7-fd90d6aa08d1 req-c00f4c1a-df75-425d-8b38-b94c1e578557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a0d92d-ba81-48f5-aa28-a62a0026c47a", "name": "network-vif-unplugged", "status": "completed", "tag": "dfbfc888-8b45-4b44-b669-8df623f935de"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:31.689143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4cb63032-e8b4-4791-9ba7-fd90d6aa08d1 req-c00f4c1a-df75-425d-8b38-b94c1e578557 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:31.690065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4cb63032-e8b4-4791-9ba7-fd90d6aa08d1 req-c00f4c1a-df75-425d-8b38-b94c1e578557 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:31.732670 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4cb63032-e8b4-4791-9ba7-fd90d6aa08d1 req-c00f4c1a-df75-425d-8b38-b94c1e578557 service nova] Creating event network-vif-unplugged:dfbfc888-8b45-4b44-b669-8df623f935de for instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a on n-h2-767704-28 Jul 14 14:30:31.747045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-4cb63032-e8b4-4791-9ba7-fd90d6aa08d1 req-c00f4c1a-df75-425d-8b38-b94c1e578557 service nova] Instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:30:31.772834 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4cb63032-e8b4-4791-9ba7-fd90d6aa08d1 req-c00f4c1a-df75-425d-8b38-b94c1e578557 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115051 Jul 14 14:30:31.773847 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 620/1228] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:31.783527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8640a04e-6f46-438b-8bc5-b4f9d3ae38ee tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:31.784875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8640a04e-6f46-438b-8bc5-b4f9d3ae38ee tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:31.795542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8640a04e-6f46-438b-8bc5-b4f9d3ae38ee tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:31.796442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8640a04e-6f46-438b-8bc5-b4f9d3ae38ee tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:31.799440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8640a04e-6f46-438b-8bc5-b4f9d3ae38ee tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:31.802276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8640a04e-6f46-438b-8bc5-b4f9d3ae38ee tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:32.060266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4595c959-0a45-4a31-88d1-a686a3c201bc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:32.080241 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4595c959-0a45-4a31-88d1-a686a3c201bc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 200 len: 1308 microversion: 2.1 time: 0.837906 Jul 14 14:30:32.080712 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 609/1229] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:31 2022] GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 1308 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:32.483273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-469d7745-b6eb-4efe-bea0-73268bb1931e req-e1679a58-59f4-4183-90db-efd379281798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343f561f-285d-4c5f-a036-3506d7898783", "tag": "3af4cbd4-d5a2-4836-ac77-0b9cc9b71d43"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:32.497137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-469d7745-b6eb-4efe-bea0-73268bb1931e req-e1679a58-59f4-4183-90db-efd379281798 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:32.501995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-469d7745-b6eb-4efe-bea0-73268bb1931e req-e1679a58-59f4-4183-90db-efd379281798 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:32.532811 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-469d7745-b6eb-4efe-bea0-73268bb1931e req-e1679a58-59f4-4183-90db-efd379281798 service nova] Creating event network-changed:3af4cbd4-d5a2-4836-ac77-0b9cc9b71d43 for instance 343f561f-285d-4c5f-a036-3506d7898783 on n-h1-767704-28 Jul 14 14:30:32.538965 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-469d7745-b6eb-4efe-bea0-73268bb1931e req-e1679a58-59f4-4183-90db-efd379281798 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.455920 Jul 14 14:30:32.540628 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 610/1230] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:32.551668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e566996-8d9b-4171-aaa7-f101ccd1b98a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:32.553056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4e566996-8d9b-4171-aaa7-f101ccd1b98a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:32.565365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e566996-8d9b-4171-aaa7-f101ccd1b98a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:32.565796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e566996-8d9b-4171-aaa7-f101ccd1b98a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:32.566795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e566996-8d9b-4171-aaa7-f101ccd1b98a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:32.567942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e566996-8d9b-4171-aaa7-f101ccd1b98a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:33.369654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8640a04e-6f46-438b-8bc5-b4f9d3ae38ee tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:33.394500 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8640a04e-6f46-438b-8bc5-b4f9d3ae38ee tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1474 microversion: 2.1 time: 1.609212 Jul 14 14:30:33.398007 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 621/1231] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:31 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1474 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:33.426541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8da3b17d-867b-4a0d-a0ad-b720c9a1eac1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:33.427630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8da3b17d-867b-4a0d-a0ad-b720c9a1eac1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:33.458456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8da3b17d-867b-4a0d-a0ad-b720c9a1eac1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:33.463342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8da3b17d-867b-4a0d-a0ad-b720c9a1eac1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:33.467657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8da3b17d-867b-4a0d-a0ad-b720c9a1eac1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:33.477993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8da3b17d-867b-4a0d-a0ad-b720c9a1eac1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:33.844896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4e566996-8d9b-4171-aaa7-f101ccd1b98a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:33.869232 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e566996-8d9b-4171-aaa7-f101ccd1b98a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 1.324015 Jul 14 14:30:33.871210 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 611/1232] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:32 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:33.884583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-00e04ccf-7ae0-4281-9b73-0010c0bf1ef8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:33.885476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-00e04ccf-7ae0-4281-9b73-0010c0bf1ef8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:33.893303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00e04ccf-7ae0-4281-9b73-0010c0bf1ef8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:33.894293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00e04ccf-7ae0-4281-9b73-0010c0bf1ef8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:33.895341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00e04ccf-7ae0-4281-9b73-0010c0bf1ef8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:33.896034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00e04ccf-7ae0-4281-9b73-0010c0bf1ef8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:34.117426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8da3b17d-867b-4a0d-a0ad-b720c9a1eac1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:34.139231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8da3b17d-867b-4a0d-a0ad-b720c9a1eac1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:34.142231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8da3b17d-867b-4a0d-a0ad-b720c9a1eac1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:34.143675 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8da3b17d-867b-4a0d-a0ad-b720c9a1eac1 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1815 microversion: 2.25 time: 0.734696 Jul 14 14:30:34.155996 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 622/1233] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:33 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1815 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:34.162117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-58c4c2f6-57ba-4afb-b964-00a4fe50eea4 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:34.163007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-58c4c2f6-57ba-4afb-b964-00a4fe50eea4 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:34.170584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58c4c2f6-57ba-4afb-b964-00a4fe50eea4 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:34.171379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58c4c2f6-57ba-4afb-b964-00a4fe50eea4 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:34.172838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58c4c2f6-57ba-4afb-b964-00a4fe50eea4 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:34.173518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58c4c2f6-57ba-4afb-b964-00a4fe50eea4 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:34.695774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-00e04ccf-7ae0-4281-9b73-0010c0bf1ef8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:34.713298 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-00e04ccf-7ae0-4281-9b73-0010c0bf1ef8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1321 microversion: 2.1 time: 0.840633 Jul 14 14:30:34.716697 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 612/1234] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:33 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1321 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:34.719210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-58c4c2f6-57ba-4afb-b964-00a4fe50eea4 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:34.733249 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-58c4c2f6-57ba-4afb-b964-00a4fe50eea4 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 200 len: 1308 microversion: 2.1 time: 0.575596 Jul 14 14:30:34.748718 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 623/1235] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:34 2022] GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 1308 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:34.755706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-921cde05-909f-4752-8fd4-84015bbc1955 req-34f28373-a212-41fd-aac4-5267a06841b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a0d92d-ba81-48f5-aa28-a62a0026c47a", "tag": "dfbfc888-8b45-4b44-b669-8df623f935de"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:34.774294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-921cde05-909f-4752-8fd4-84015bbc1955 req-34f28373-a212-41fd-aac4-5267a06841b0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:34.774754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-921cde05-909f-4752-8fd4-84015bbc1955 req-34f28373-a212-41fd-aac4-5267a06841b0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:34.795284 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-921cde05-909f-4752-8fd4-84015bbc1955 req-34f28373-a212-41fd-aac4-5267a06841b0 service nova] Creating event network-changed:dfbfc888-8b45-4b44-b669-8df623f935de for instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a on n-h2-767704-28 Jul 14 14:30:34.805130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-921cde05-909f-4752-8fd4-84015bbc1955 req-34f28373-a212-41fd-aac4-5267a06841b0 service nova] Instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:30:34.837353 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-921cde05-909f-4752-8fd4-84015bbc1955 req-34f28373-a212-41fd-aac4-5267a06841b0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089114 Jul 14 14:30:34.838194 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 624/1236] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:34.849930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-716b58ad-4889-42e7-8005-ddf88b03ab34 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:34.851196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-716b58ad-4889-42e7-8005-ddf88b03ab34 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:34.858842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-716b58ad-4889-42e7-8005-ddf88b03ab34 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:34.859703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-716b58ad-4889-42e7-8005-ddf88b03ab34 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:34.861414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-716b58ad-4889-42e7-8005-ddf88b03ab34 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:34.862137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-716b58ad-4889-42e7-8005-ddf88b03ab34 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:35.068688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-00cdf6c3-5eed-4e4f-8964-4f1bb9593d57 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:35.096875 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-00cdf6c3-5eed-4e4f-8964-4f1bb9593d57 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.375313 Jul 14 14:30:35.100682 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 613/1237] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:30:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:35.107059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ac16c57a-c3c9-4360-bfeb-b2398456ad5f req-1cf5f40a-af4b-47ec-93ca-d90283c8a608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc69728d-ad31-4750-a7e2-ef09d6dd3686", "name": "network-vif-plugged", "status": "completed", "tag": "4b7a1348-79bc-4d4e-8c50-0bfe89eac4b1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:35.124614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ac16c57a-c3c9-4360-bfeb-b2398456ad5f req-1cf5f40a-af4b-47ec-93ca-d90283c8a608 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:35.125798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ac16c57a-c3c9-4360-bfeb-b2398456ad5f req-1cf5f40a-af4b-47ec-93ca-d90283c8a608 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:35.140701 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ac16c57a-c3c9-4360-bfeb-b2398456ad5f req-1cf5f40a-af4b-47ec-93ca-d90283c8a608 service nova] Creating event network-vif-plugged:4b7a1348-79bc-4d4e-8c50-0bfe89eac4b1 for instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 on n-h2-767704-28 Jul 14 14:30:35.148524 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ac16c57a-c3c9-4360-bfeb-b2398456ad5f req-1cf5f40a-af4b-47ec-93ca-d90283c8a608 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045238 Jul 14 14:30:35.152648 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 614/1238] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:35.163763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9d66a8d3-8a58-457d-9600-110ceea1dc5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:35.166666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9d66a8d3-8a58-457d-9600-110ceea1dc5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:35.192296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d66a8d3-8a58-457d-9600-110ceea1dc5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:35.193271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d66a8d3-8a58-457d-9600-110ceea1dc5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:35.195210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d66a8d3-8a58-457d-9600-110ceea1dc5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:35.198695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d66a8d3-8a58-457d-9600-110ceea1dc5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:36.064580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-716b58ad-4889-42e7-8005-ddf88b03ab34 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:36.081544 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-716b58ad-4889-42e7-8005-ddf88b03ab34 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1474 microversion: 2.1 time: 1.239784 Jul 14 14:30:36.082404 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 625/1239] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:34 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1474 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:36.092057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4ba928e1-8d7c-4738-9ce1-f2218ff0b9e3 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:36.118953 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4ba928e1-8d7c-4738-9ce1-f2218ff0b9e3 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.033891 Jul 14 14:30:36.120066 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 626/1240] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 14:30:36 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:36.125760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d47eb73f-6f1a-42ef-bc2f-878239fbfe76 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:36.126719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d47eb73f-6f1a-42ef-bc2f-878239fbfe76 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:36.134235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d47eb73f-6f1a-42ef-bc2f-878239fbfe76 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:36.135315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d47eb73f-6f1a-42ef-bc2f-878239fbfe76 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:36.136308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d47eb73f-6f1a-42ef-bc2f-878239fbfe76 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:36.136928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d47eb73f-6f1a-42ef-bc2f-878239fbfe76 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:36.271520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9d66a8d3-8a58-457d-9600-110ceea1dc5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:36.284017 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9d66a8d3-8a58-457d-9600-110ceea1dc5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 1.127571 Jul 14 14:30:36.298052 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 615/1241] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:35 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:36.304693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3422973b-55a4-4703-b14e-db3319a70316 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:36.306187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3422973b-55a4-4703-b14e-db3319a70316 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:36.317106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3422973b-55a4-4703-b14e-db3319a70316 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:36.317780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3422973b-55a4-4703-b14e-db3319a70316 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:36.318993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3422973b-55a4-4703-b14e-db3319a70316 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:36.320255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3422973b-55a4-4703-b14e-db3319a70316 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:36.714831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d47eb73f-6f1a-42ef-bc2f-878239fbfe76 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:36.726987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d47eb73f-6f1a-42ef-bc2f-878239fbfe76 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:36.730032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d47eb73f-6f1a-42ef-bc2f-878239fbfe76 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:36.731674 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d47eb73f-6f1a-42ef-bc2f-878239fbfe76 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1805 microversion: 2.25 time: 0.610360 Jul 14 14:30:36.737162 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 627/1242] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:36 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1805 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:36.746525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eea81dd2-26af-4bbe-9f9f-56a70aad11aa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:36.749558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eea81dd2-26af-4bbe-9f9f-56a70aad11aa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:36.756407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3422973b-55a4-4703-b14e-db3319a70316 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:36.762278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eea81dd2-26af-4bbe-9f9f-56a70aad11aa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:36.763732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eea81dd2-26af-4bbe-9f9f-56a70aad11aa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:36.766023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eea81dd2-26af-4bbe-9f9f-56a70aad11aa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:36.766882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eea81dd2-26af-4bbe-9f9f-56a70aad11aa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:36.769140 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3422973b-55a4-4703-b14e-db3319a70316 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1321 microversion: 2.1 time: 0.469480 Jul 14 14:30:36.770264 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 616/1243] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:36 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:36.776174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0ab452b3-fc2f-42d3-919e-ef2162b18fde tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:36.789108 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0ab452b3-fc2f-42d3-919e-ef2162b18fde tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017401 Jul 14 14:30:36.791986 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 617/1244] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:30:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:36.802710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-adcd36a2-abcf-4026-9c45-0be5bb483f52 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '.version_select at 0x7fd6c5747040>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:36.808407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adcd36a2-abcf-4026-9c45-0be5bb483f52 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:36.809191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adcd36a2-abcf-4026-9c45-0be5bb483f52 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:36.828816 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-adcd36a2-abcf-4026-9c45-0be5bb483f52 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 4760 microversion: 2.25 time: 0.034294 Jul 14 14:30:36.838841 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 618/1245] 10.222.0.81 () {60 vars in 1183 bytes} [Thu Jul 14 14:30:36 2022] GET /compute/v2.1/os-migrations => generated 4760 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:36.853233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-349a92c8-4677-4c43-bb13-60e4f2ed2eca tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:36.870249 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-349a92c8-4677-4c43-bb13-60e4f2ed2eca tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029908 Jul 14 14:30:36.876440 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 619/1246] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:30:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:36.881182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6a107bf1-43b5-4f77-b2d8-14f96597e3e8 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:36.882000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6a107bf1-43b5-4f77-b2d8-14f96597e3e8 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:36.890721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a107bf1-43b5-4f77-b2d8-14f96597e3e8 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:36.891659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a107bf1-43b5-4f77-b2d8-14f96597e3e8 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:36.893300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a107bf1-43b5-4f77-b2d8-14f96597e3e8 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:36.898571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a107bf1-43b5-4f77-b2d8-14f96597e3e8 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:37.404568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eea81dd2-26af-4bbe-9f9f-56a70aad11aa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:37.430262 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eea81dd2-26af-4bbe-9f9f-56a70aad11aa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 200 len: 1308 microversion: 2.1 time: 0.695879 Jul 14 14:30:37.432332 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 628/1247] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:36 2022] GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 1308 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:37.436438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-6a107bf1-43b5-4f77-b2d8-14f96597e3e8 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid 07717385-1942-4235-9479-e46016827db8 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:30:37.438642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e3929b1f-eb5a-4095-bfa0-a0682025c7b4 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:37.474756 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e3929b1f-eb5a-4095-bfa0-a0682025c7b4 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.040967 Jul 14 14:30:37.480178 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 629/1248] 10.222.0.81 () {58 vars in 1164 bytes} [Thu Jul 14 14:30:37 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:37.489475 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6a107bf1-43b5-4f77-b2d8-14f96597e3e8 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 2426 microversion: 2.25 time: 0.611654 Jul 14 14:30:37.490122 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 620/1249] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:36 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 2426 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:37.497010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5d805502-617d-4de7-8e05-f3957a649e8d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:37.498078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5d805502-617d-4de7-8e05-f3957a649e8d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:37.510115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d805502-617d-4de7-8e05-f3957a649e8d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:37.510727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d805502-617d-4de7-8e05-f3957a649e8d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:37.511631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d805502-617d-4de7-8e05-f3957a649e8d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:37.512090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d805502-617d-4de7-8e05-f3957a649e8d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:37.518122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b1c71bc5-d0b5-45c1-be31-c73792f3e01f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:37.522556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b1c71bc5-d0b5-45c1-be31-c73792f3e01f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:37.541632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1c71bc5-d0b5-45c1-be31-c73792f3e01f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:37.542104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1c71bc5-d0b5-45c1-be31-c73792f3e01f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:37.542916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1c71bc5-d0b5-45c1-be31-c73792f3e01f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:37.543363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1c71bc5-d0b5-45c1-be31-c73792f3e01f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:37.981172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5d805502-617d-4de7-8e05-f3957a649e8d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:37.999663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b1c71bc5-d0b5-45c1-be31-c73792f3e01f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:38.009645 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5d805502-617d-4de7-8e05-f3957a649e8d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.514876 Jul 14 14:30:38.012410 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 621/1250] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:37 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:38.018575 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b1c71bc5-d0b5-45c1-be31-c73792f3e01f tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1472 microversion: 2.1 time: 0.536485 Jul 14 14:30:38.023765 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 630/1251] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:37 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1472 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:38.026966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e8de0b0c-15a1-4e4e-a19a-cd38869d3690 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:38.037166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5a833d4f-743f-4feb-bfe1-92a910aee987 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:38.039003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5a833d4f-743f-4feb-bfe1-92a910aee987 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:38.047031 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e8de0b0c-15a1-4e4e-a19a-cd38869d3690 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032947 Jul 14 14:30:38.051437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a833d4f-743f-4feb-bfe1-92a910aee987 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:38.052137 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 622/1252] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:30:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:38.054542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a833d4f-743f-4feb-bfe1-92a910aee987 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:38.059355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c1afe0b9-d389-4752-b556-0712a8c0b5ff req-ef821c3a-e055-4963-95be-e75ac663ac51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343f561f-285d-4c5f-a036-3506d7898783", "name": "network-vif-plugged", "status": "completed", "tag": "3af4cbd4-d5a2-4836-ac77-0b9cc9b71d43"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:38.061168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a833d4f-743f-4feb-bfe1-92a910aee987 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:38.061877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a833d4f-743f-4feb-bfe1-92a910aee987 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:38.080612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c1afe0b9-d389-4752-b556-0712a8c0b5ff req-ef821c3a-e055-4963-95be-e75ac663ac51 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:38.081405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c1afe0b9-d389-4752-b556-0712a8c0b5ff req-ef821c3a-e055-4963-95be-e75ac663ac51 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:38.115929 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c1afe0b9-d389-4752-b556-0712a8c0b5ff req-ef821c3a-e055-4963-95be-e75ac663ac51 service nova] Creating event network-vif-plugged:3af4cbd4-d5a2-4836-ac77-0b9cc9b71d43 for instance 343f561f-285d-4c5f-a036-3506d7898783 on n-h1-767704-28 Jul 14 14:30:38.125645 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c1afe0b9-d389-4752-b556-0712a8c0b5ff req-ef821c3a-e055-4963-95be-e75ac663ac51 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071218 Jul 14 14:30:38.126955 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 623/1253] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:38.132483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2f82060c-3c29-4856-a097-0c87374fe268 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:38.135774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2f82060c-3c29-4856-a097-0c87374fe268 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:38.143559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:38.144071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f82060c-3c29-4856-a097-0c87374fe268 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:38.144647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f82060c-3c29-4856-a097-0c87374fe268 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:38.146182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f82060c-3c29-4856-a097-0c87374fe268 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:38.147014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f82060c-3c29-4856-a097-0c87374fe268 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:38.705818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2f82060c-3c29-4856-a097-0c87374fe268 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:38.719829 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2f82060c-3c29-4856-a097-0c87374fe268 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1321 microversion: 2.1 time: 0.591248 Jul 14 14:30:38.725159 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 624/1254] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:38 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1321 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:38.736290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-5a833d4f-743f-4feb-bfe1-92a910aee987 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid 07717385-1942-4235-9479-e46016827db8 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:30:38.781874 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5a833d4f-743f-4feb-bfe1-92a910aee987 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 2426 microversion: 2.25 time: 0.755672 Jul 14 14:30:38.787929 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 631/1255] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:30:38 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 2426 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:30:38.798374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d312e1c7-02c3-46b6-9987-c3df9d65dd51 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:38.882174 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d312e1c7-02c3-46b6-9987-c3df9d65dd51 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.096174 Jul 14 14:30:38.883629 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 632/1256] 10.222.0.81 () {58 vars in 1168 bytes} [Thu Jul 14 14:30:38 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:38.888784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8db4f10a-be3f-4571-b5d8-1e1c6f946cf0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:38.889510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8db4f10a-be3f-4571-b5d8-1e1c6f946cf0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:38.896552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1280002916", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "5b51c073-71ed-4b23-adf3-80ddcdf5db42"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:38.899168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8db4f10a-be3f-4571-b5d8-1e1c6f946cf0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:38.900194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8db4f10a-be3f-4571-b5d8-1e1c6f946cf0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:38.902296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8db4f10a-be3f-4571-b5d8-1e1c6f946cf0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:38.903490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8db4f10a-be3f-4571-b5d8-1e1c6f946cf0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:39.035821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] validate_networks() for [('5b51c073-71ed-4b23-adf3-80ddcdf5db42', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:30:39.317038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8db4f10a-be3f-4571-b5d8-1e1c6f946cf0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:39.335042 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8db4f10a-be3f-4571-b5d8-1e1c6f946cf0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 200 len: 1487 microversion: 2.1 time: 0.447937 Jul 14 14:30:39.336132 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 633/1257] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:38 2022] GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 1487 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:39.466198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-949994331", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "e15a1c98-dd72-4729-94f4-9ad8a53d679a"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:39.587897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] validate_networks() for [('e15a1c98-dd72-4729-94f4-9ad8a53d679a', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:30:40.119490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:30:40.121232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:30:40.122267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:30:40.124411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:30:40.125317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:30:40.156683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:40.157381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:40.158255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:40.158938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:40.207362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Getting quotas for project c3748377903c4d1a8af40152f327af4d. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:40.219631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Getting quotas for user ce309d94cf624a82aff58ba17a8c81eb and project c3748377903c4d1a8af40152f327af4d. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:40.255378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:30:40.263746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:30:40.401149 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bfa88fa6-bfd9-4b41-9fd5-b084a8e2c06a tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.664681 Jul 14 14:30:40.406559 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 625/1258] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:30:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:30:40.413416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-37cf2155-3015-4d0f-aba6-aed43d2c62c4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:40.420092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-37cf2155-3015-4d0f-aba6-aed43d2c62c4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:40.444005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37cf2155-3015-4d0f-aba6-aed43d2c62c4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:40.444476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37cf2155-3015-4d0f-aba6-aed43d2c62c4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:40.445320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37cf2155-3015-4d0f-aba6-aed43d2c62c4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:40.445765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37cf2155-3015-4d0f-aba6-aed43d2c62c4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:40.702021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-37cf2155-3015-4d0f-aba6-aed43d2c62c4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lazy-loading 'services' on Instance uuid 07717385-1942-4235-9479-e46016827db8 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:30:40.895698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:30:40.896267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:30:40.896936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:30:40.897113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:30:40.897556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:30:40.937051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:40.944632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:40.952603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:40.956183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:40.976385 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-37cf2155-3015-4d0f-aba6-aed43d2c62c4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "DELETE /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments/3d7be5d2-eb8f-416d-b5fa-2b2fc55c498b" status: 202 len: 0 microversion: 2.25 time: 0.570549 Jul 14 14:30:40.996000 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 626/1259] 10.222.0.81 () {60 vars in 1456 bytes} [Thu Jul 14 14:30:40 2022] DELETE /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments/3d7be5d2-eb8f-416d-b5fa-2b2fc55c498b => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:30:41.009668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:41.023708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for user d56c219e943b4398bea8add8299df84f and project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:41.027748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-46a9f06a-e6dc-49da-ab9e-6eedce6fb86b tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:41.063996 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-46a9f06a-e6dc-49da-ab9e-6eedce6fb86b tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.062522 Jul 14 14:30:41.064602 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 627/1260] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 14:30:40 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:41.080575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5994aa89-3c70-44ee-bfbf-b42a1e04c8e7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:41.088823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5994aa89-3c70-44ee-bfbf-b42a1e04c8e7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:41.101864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5994aa89-3c70-44ee-bfbf-b42a1e04c8e7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:41.106813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5994aa89-3c70-44ee-bfbf-b42a1e04c8e7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:41.114781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5994aa89-3c70-44ee-bfbf-b42a1e04c8e7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:41.115373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5994aa89-3c70-44ee-bfbf-b42a1e04c8e7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:41.121510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:30:41.133705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:30:41.275157 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c36e6c83-16af-405c-81d8-0785a984422a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.926397 Jul 14 14:30:41.306318 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 634/1261] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:30:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:30:41.312059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c33982d7-0ad7-4215-8ee1-ea8e482ff73d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:41.314866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c33982d7-0ad7-4215-8ee1-ea8e482ff73d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:41.336590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c33982d7-0ad7-4215-8ee1-ea8e482ff73d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:41.338110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c33982d7-0ad7-4215-8ee1-ea8e482ff73d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:41.344295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c33982d7-0ad7-4215-8ee1-ea8e482ff73d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:41.348799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c33982d7-0ad7-4215-8ee1-ea8e482ff73d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:41.488882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5994aa89-3c70-44ee-bfbf-b42a1e04c8e7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:41.503014 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5994aa89-3c70-44ee-bfbf-b42a1e04c8e7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.430941 Jul 14 14:30:41.504134 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 628/1262] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:41 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:41.519466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-25099b4b-2fc5-4e70-a385-d5d31a5cb447 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:41.520048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-25099b4b-2fc5-4e70-a385-d5d31a5cb447 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:41.534874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25099b4b-2fc5-4e70-a385-d5d31a5cb447 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:41.535337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25099b4b-2fc5-4e70-a385-d5d31a5cb447 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:41.536143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25099b4b-2fc5-4e70-a385-d5d31a5cb447 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:41.536602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25099b4b-2fc5-4e70-a385-d5d31a5cb447 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:41.757246 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-25099b4b-2fc5-4e70-a385-d5d31a5cb447 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "POST /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686/action" status: 202 len: 0 microversion: 2.1 time: 0.247966 Jul 14 14:30:41.777407 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 629/1263] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:30:41 2022] POST /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:30:41.819611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-821a643b-2803-4ca4-9db9-8e0d9cd586af tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:41.822360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-821a643b-2803-4ca4-9db9-8e0d9cd586af tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:41.850066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c33982d7-0ad7-4215-8ee1-ea8e482ff73d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:41.859516 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c33982d7-0ad7-4215-8ee1-ea8e482ff73d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1469 microversion: 2.1 time: 0.551304 Jul 14 14:30:41.860114 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 635/1264] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:41 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1469 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:41.878034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-821a643b-2803-4ca4-9db9-8e0d9cd586af tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:41.886400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-821a643b-2803-4ca4-9db9-8e0d9cd586af tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:41.888445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-821a643b-2803-4ca4-9db9-8e0d9cd586af tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:41.893913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-821a643b-2803-4ca4-9db9-8e0d9cd586af tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:41.912678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8d292361-b0f0-4581-b86e-b51fe7b940f4 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:41.916152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8d292361-b0f0-4581-b86e-b51fe7b940f4 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:41.933700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d292361-b0f0-4581-b86e-b51fe7b940f4 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:41.934439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d292361-b0f0-4581-b86e-b51fe7b940f4 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:41.935436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d292361-b0f0-4581-b86e-b51fe7b940f4 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:41.936105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d292361-b0f0-4581-b86e-b51fe7b940f4 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:42.488770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8d292361-b0f0-4581-b86e-b51fe7b940f4 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:42.506108 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8d292361-b0f0-4581-b86e-b51fe7b940f4 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1229 microversion: 2.1 time: 0.622813 Jul 14 14:30:42.510396 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 636/1265] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:41 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1229 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:42.526302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a00824ca-b01a-4acc-944b-11ac0e1a093f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:42.535338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a00824ca-b01a-4acc-944b-11ac0e1a093f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:42.558857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a00824ca-b01a-4acc-944b-11ac0e1a093f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:42.559309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a00824ca-b01a-4acc-944b-11ac0e1a093f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:42.560753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a00824ca-b01a-4acc-944b-11ac0e1a093f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:42.562035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-821a643b-2803-4ca4-9db9-8e0d9cd586af tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:42.567744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:42.569686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a00824ca-b01a-4acc-944b-11ac0e1a093f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:42.580559 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-821a643b-2803-4ca4-9db9-8e0d9cd586af tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1469 microversion: 2.1 time: 0.797096 Jul 14 14:30:42.584732 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 630/1266] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:41 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1469 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:42.590914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5d3942d9-c7a7-465c-8817-5c009112ff0e tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:42.611397 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5d3942d9-c7a7-465c-8817-5c009112ff0e tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025130 Jul 14 14:30:42.613855 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 631/1267] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:30:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:42.625669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c5e39072-9db2-4655-8894-09c6208480e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:42.626876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c5e39072-9db2-4655-8894-09c6208480e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:42.688104 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a00824ca-b01a-4acc-944b-11ac0e1a093f tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.175841 Jul 14 14:30:42.707211 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 637/1268] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:30:42 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:30:42.738783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-efa33ace-5bf9-4b83-a83c-25868438cce2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:42.742576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-efa33ace-5bf9-4b83-a83c-25868438cce2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:42.760849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c5e39072-9db2-4655-8894-09c6208480e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:42.790932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efa33ace-5bf9-4b83-a83c-25868438cce2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:42.793995 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c5e39072-9db2-4655-8894-09c6208480e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 200 len: 1214 microversion: 2.1 time: 0.175213 Jul 14 14:30:42.797319 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 632/1269] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:42 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:42.799309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efa33ace-5bf9-4b83-a83c-25868438cce2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:42.802052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efa33ace-5bf9-4b83-a83c-25868438cce2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:42.816371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efa33ace-5bf9-4b83-a83c-25868438cce2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:42.838004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-78fbb7d3-ee48-4dc1-9a89-f9a4b23e1234 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:42.841907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-78fbb7d3-ee48-4dc1-9a89-f9a4b23e1234 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:42.872138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78fbb7d3-ee48-4dc1-9a89-f9a4b23e1234 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:42.873412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78fbb7d3-ee48-4dc1-9a89-f9a4b23e1234 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:42.877738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78fbb7d3-ee48-4dc1-9a89-f9a4b23e1234 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:42.879451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78fbb7d3-ee48-4dc1-9a89-f9a4b23e1234 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:43.438289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-efa33ace-5bf9-4b83-a83c-25868438cce2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:43.456679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-efa33ace-5bf9-4b83-a83c-25868438cce2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 200 len: 1472 microversion: 2.1 time: 0.748202 Jul 14 14:30:43.471658 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 638/1270] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:42 2022] GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 1472 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:43.512251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2e0bbce5-d049-46d7-9c2e-877762c16083 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:43.514939 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-78fbb7d3-ee48-4dc1-9a89-f9a4b23e1234 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "POST /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a/action" status: 202 len: 0 microversion: 2.1 time: 0.714158 Jul 14 14:30:43.517478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2e0bbce5-d049-46d7-9c2e-877762c16083 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:43.518240 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 633/1271] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:30:42 2022] POST /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a/action => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:30:43.575469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e0bbce5-d049-46d7-9c2e-877762c16083 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:43.576635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e0bbce5-d049-46d7-9c2e-877762c16083 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:43.578089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e0bbce5-d049-46d7-9c2e-877762c16083 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:43.578735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e0bbce5-d049-46d7-9c2e-877762c16083 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:44.211207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15ae4d17-ac55-4f03-a1d4-6b4427f618f1 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:44.214376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-15ae4d17-ac55-4f03-a1d4-6b4427f618f1 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] [instance: 13c415df-3f2a-4e9d-91ae-23c6257c8dd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:44.243433 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-15ae4d17-ac55-4f03-a1d4-6b4427f618f1 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] HTTP exception thrown: Instance 13c415df-3f2a-4e9d-91ae-23c6257c8dd4 could not be found. Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15ae4d17-ac55-4f03-a1d4-6b4427f618f1 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Request method failure captured: Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/13c415df-3f2a-4e9d-91ae-23c6257c8dd4/action HTTP/1.1 Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 15 Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch36jowuSiMbYmQQiQ3rZa3pCC0vI0CE8syh3MelmwOtWFTAfkIjK1IX-NtXBWzr42SRgQ4Ch2Iv4ppUTnoePgZWTfMh-2tXNGKc1A6skb3uOEBWK5GdLmg4Ne9dbs38-mSaOXHXjRshfS2R3DaJS-DP-dj7aM94ZvaJrYQvQ4Dlw0 Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 05639a0fb04b4e65b3f03d9335424149 Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/05639a0fb04b4e65b3f03d9335424149"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/05639a0fb04b4e65b3f03d9335424149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_05639a0fb04b4e65b3f03d9335424149", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/05639a0fb04b4e65b3f03d9335424149"}]}] Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 05639a0fb04b4e65b3f03d9335424149 Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersAdminNegativeTestJSON-538382369-project-admin Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4a9afae9525e42abada4a3f1b38b2034 Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersAdminNegativeTestJSON-538382369-project-admin Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: {"migrate": {}} Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 13c415df-3f2a-4e9d-91ae-23c6257c8dd4 could not be found. Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '13c415df-3f2a-4e9d-91ae-23c6257c8dd4', 'body': {'migrate': {}}} Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c415df-3f2a-4e9d-91ae-23c6257c8dd4 could not be found. Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c415df-3f2a-4e9d-91ae-23c6257c8dd4 could not be found. Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:44.255275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:44.261881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:44.261881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:44.261881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:44.261881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:44.261881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c415df-3f2a-4e9d-91ae-23c6257c8dd4 could not be found. Jul 14 14:30:44.261881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:30:44.261881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15ae4d17-ac55-4f03-a1d4-6b4427f618f1 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Returning 404 to user: Instance 13c415df-3f2a-4e9d-91ae-23c6257c8dd4 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:44.261881 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-15ae4d17-ac55-4f03-a1d4-6b4427f618f1 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/13c415df-3f2a-4e9d-91ae-23c6257c8dd4/action" status: 404 len: 111 microversion: 2.1 time: 0.735951 Jul 14 14:30:44.267971 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 634/1272] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:30:43 2022] POST /compute/v2.1/servers/13c415df-3f2a-4e9d-91ae-23c6257c8dd4/action => generated 111 bytes in 749 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:30:44.277282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-71945fc2-fdd7-4268-9f9f-7b64c99f2d08 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:44.326611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2e0bbce5-d049-46d7-9c2e-877762c16083 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:44.398369 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2e0bbce5-d049-46d7-9c2e-877762c16083 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.920944 Jul 14 14:30:44.411944 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 639/1273] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:43 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:44.421951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6f567507-d280-489f-ace5-042b7458a574 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1161976434"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:44.423631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6f567507-d280-489f-ace5-042b7458a574 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:44.446368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f567507-d280-489f-ace5-042b7458a574 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:44.449860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f567507-d280-489f-ace5-042b7458a574 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:44.454278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f567507-d280-489f-ace5-042b7458a574 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:44.454991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f567507-d280-489f-ace5-042b7458a574 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:44.483170 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-71945fc2-fdd7-4268-9f9f-7b64c99f2d08 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.209458 Jul 14 14:30:44.492439 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 635/1274] 10.222.0.81 () {58 vars in 1166 bytes} [Thu Jul 14 14:30:44 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:44.545092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80fca6b7-ca59-4a52-ac77-ff4664f3d523 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:44.553512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80fca6b7-ca59-4a52-ac77-ff4664f3d523 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:44.627132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80fca6b7-ca59-4a52-ac77-ff4664f3d523 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:44.637854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80fca6b7-ca59-4a52-ac77-ff4664f3d523 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:44.660533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80fca6b7-ca59-4a52-ac77-ff4664f3d523 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:44.661691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80fca6b7-ca59-4a52-ac77-ff4664f3d523 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:45.577861 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6f567507-d280-489f-ace5-042b7458a574 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "POST /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686/action" status: 202 len: 0 microversion: 2.1 time: 1.163893 Jul 14 14:30:45.578578 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 640/1275] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:30:44 2022] POST /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686/action => generated 0 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:30:45.598346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-367e8e8a-ff7d-4e21-8810-c9d360297885 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:45.599118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-367e8e8a-ff7d-4e21-8810-c9d360297885 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:45.635605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-367e8e8a-ff7d-4e21-8810-c9d360297885 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:45.645241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-367e8e8a-ff7d-4e21-8810-c9d360297885 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:45.646292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-367e8e8a-ff7d-4e21-8810-c9d360297885 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:45.646757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-367e8e8a-ff7d-4e21-8810-c9d360297885 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:45.733287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-80fca6b7-ca59-4a52-ac77-ff4664f3d523 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:45.741492 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80fca6b7-ca59-4a52-ac77-ff4664f3d523 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1468 microversion: 2.1 time: 1.243612 Jul 14 14:30:45.751914 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 636/1276] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:44 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1468 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:45.773551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f9cb87d-0009-4e9f-b50a-36d1d813efb6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:45.775296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9f9cb87d-0009-4e9f-b50a-36d1d813efb6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:45.801720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f9cb87d-0009-4e9f-b50a-36d1d813efb6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:45.803098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f9cb87d-0009-4e9f-b50a-36d1d813efb6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:45.806197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f9cb87d-0009-4e9f-b50a-36d1d813efb6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:45.808055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f9cb87d-0009-4e9f-b50a-36d1d813efb6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:45.891893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-367e8e8a-ff7d-4e21-8810-c9d360297885 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:45.906274 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-367e8e8a-ff7d-4e21-8810-c9d360297885 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1283 microversion: 2.1 time: 0.326205 Jul 14 14:30:45.908026 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 641/1277] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:45 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1283 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:45.914499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e2090770-a652-428d-87c6-30e7b7033ff7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:45.915907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e2090770-a652-428d-87c6-30e7b7033ff7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:45.918054 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9f9cb87d-0009-4e9f-b50a-36d1d813efb6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.164595 Jul 14 14:30:45.920104 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 637/1278] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:30:45 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:30:45.931756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7a6bc068-ab62-4678-af25-62d36db2d556 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:45.951831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e2090770-a652-428d-87c6-30e7b7033ff7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:45.952680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e2090770-a652-428d-87c6-30e7b7033ff7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:45.953721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e2090770-a652-428d-87c6-30e7b7033ff7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:45.956149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e2090770-a652-428d-87c6-30e7b7033ff7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:45.967332 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7a6bc068-ab62-4678-af25-62d36db2d556 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039703 Jul 14 14:30:45.981994 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 638/1279] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:30:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:45.995259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2078888361", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:46.070272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:30:46.741830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e2090770-a652-428d-87c6-30e7b7033ff7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:46.768514 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e2090770-a652-428d-87c6-30e7b7033ff7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 200 len: 1272 microversion: 2.1 time: 0.857259 Jul 14 14:30:46.769493 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 642/1280] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:45 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 1272 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:46.799368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fc281b62-a502-4181-abd4-1e458c05133c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:46.801060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fc281b62-a502-4181-abd4-1e458c05133c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:46.837488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc281b62-a502-4181-abd4-1e458c05133c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:46.839554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc281b62-a502-4181-abd4-1e458c05133c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:46.841336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc281b62-a502-4181-abd4-1e458c05133c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:46.842376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc281b62-a502-4181-abd4-1e458c05133c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:47.532554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fc281b62-a502-4181-abd4-1e458c05133c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:47.570672 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fc281b62-a502-4181-abd4-1e458c05133c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.799717 Jul 14 14:30:47.572630 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 643/1281] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:46 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:47.578193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a205f3ed-322c-493f-a5c1-20f1fccc9727 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5c32f70>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:47.592688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:30:47.596784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:30:47.600059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:30:47.601046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:30:47.604632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:30:47.625047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:47.627177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:47.630079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:47.630966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:47.656518 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a205f3ed-322c-493f-a5c1-20f1fccc9727 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a" status: 200 len: 1414 microversion: 2.1 time: 0.082362 Jul 14 14:30:47.666520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Getting quotas for project d3b24d9de5fc49eaaf9c05e31c1489e4. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:47.668910 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 644/1282] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:30:47 2022] GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:47.672830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:47.674507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Getting quotas for user 1a660ea88d644d57a49d4afc09433796 and project d3b24d9de5fc49eaaf9c05e31c1489e4. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:47.676779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9df922c8-0608-4af0-a301-b999f5f4dd29 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:47.691847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:30:47.695943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:30:47.716984 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9df922c8-0608-4af0-a301-b999f5f4dd29 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.046772 Jul 14 14:30:47.719102 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 645/1283] 10.222.0.81 () {58 vars in 1143 bytes} [Thu Jul 14 14:30:47 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:47.745687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4606a1b1-d38b-44f1-a1d0-67f167118284 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:47.749167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4606a1b1-d38b-44f1-a1d0-67f167118284 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:47.767055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4606a1b1-d38b-44f1-a1d0-67f167118284 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:47.769598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4606a1b1-d38b-44f1-a1d0-67f167118284 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:47.770325 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b1a0df91-c349-4fab-86c8-bc9a1a80a103 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.784849 Jul 14 14:30:47.772478 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 639/1284] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:30:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:30:47.775235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4606a1b1-d38b-44f1-a1d0-67f167118284 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:47.777039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4606a1b1-d38b-44f1-a1d0-67f167118284 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:47.926585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-552ad323-317b-4e1a-9f63-c84a8f47df63 req-0cbd0a64-1c98-4000-ae11-e64887129657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a0d92d-ba81-48f5-aa28-a62a0026c47a", "name": "network-vif-plugged", "status": "completed", "tag": "dfbfc888-8b45-4b44-b669-8df623f935de"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:47.949116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-552ad323-317b-4e1a-9f63-c84a8f47df63 req-0cbd0a64-1c98-4000-ae11-e64887129657 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:47.950151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-552ad323-317b-4e1a-9f63-c84a8f47df63 req-0cbd0a64-1c98-4000-ae11-e64887129657 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:47.980392 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-552ad323-317b-4e1a-9f63-c84a8f47df63 req-0cbd0a64-1c98-4000-ae11-e64887129657 service nova] Creating event network-vif-plugged:dfbfc888-8b45-4b44-b669-8df623f935de for instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a on n-h2-767704-28 Jul 14 14:30:48.012766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-552ad323-317b-4e1a-9f63-c84a8f47df63 req-0cbd0a64-1c98-4000-ae11-e64887129657 service nova] Instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:30:48.041661 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-552ad323-317b-4e1a-9f63-c84a8f47df63 req-0cbd0a64-1c98-4000-ae11-e64887129657 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267069 Jul 14 14:30:48.055504 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 640/1285] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:48.070685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-58fdc358-9da9-48d1-a9e0-ef663f96f545 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:48.075063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-58fdc358-9da9-48d1-a9e0-ef663f96f545 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:48.105200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58fdc358-9da9-48d1-a9e0-ef663f96f545 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:48.105665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58fdc358-9da9-48d1-a9e0-ef663f96f545 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:48.106671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58fdc358-9da9-48d1-a9e0-ef663f96f545 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:48.106893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58fdc358-9da9-48d1-a9e0-ef663f96f545 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:48.178960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4606a1b1-d38b-44f1-a1d0-67f167118284 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:48.205584 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4606a1b1-d38b-44f1-a1d0-67f167118284 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1468 microversion: 2.1 time: 0.470765 Jul 14 14:30:48.206154 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 646/1286] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:47 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1468 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:48.226932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5e88de61-ff48-4181-bcee-46e5475855d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:48.229406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5e88de61-ff48-4181-bcee-46e5475855d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:48.271461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e88de61-ff48-4181-bcee-46e5475855d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:48.272772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e88de61-ff48-4181-bcee-46e5475855d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:48.280331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e88de61-ff48-4181-bcee-46e5475855d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:48.281166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e88de61-ff48-4181-bcee-46e5475855d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:48.362181 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5e88de61-ff48-4181-bcee-46e5475855d6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.154187 Jul 14 14:30:48.364098 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 647/1287] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:30:48 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:30:48.380489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eba8552a-800a-4dc9-9c69-0f3552426f1b tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:48.401885 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eba8552a-800a-4dc9-9c69-0f3552426f1b tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028219 Jul 14 14:30:48.403514 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 648/1288] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:30:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:48.416021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6b4964e8-f9e8-4ffc-8bb6-a8643017d758 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:48.418573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6b4964e8-f9e8-4ffc-8bb6-a8643017d758 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:48.600095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6b4964e8-f9e8-4ffc-8bb6-a8643017d758 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:48.643084 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6b4964e8-f9e8-4ffc-8bb6-a8643017d758 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1222 microversion: 2.1 time: 0.236794 Jul 14 14:30:48.643969 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 649/1289] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:48 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1222 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:48.666572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-75d1fd17-3313-4ac2-9d3c-f94d89cd826a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:48.667535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-75d1fd17-3313-4ac2-9d3c-f94d89cd826a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:48.684555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-58fdc358-9da9-48d1-a9e0-ef663f96f545 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:48.714351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:48.725585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75d1fd17-3313-4ac2-9d3c-f94d89cd826a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:48.730452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75d1fd17-3313-4ac2-9d3c-f94d89cd826a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:48.731766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75d1fd17-3313-4ac2-9d3c-f94d89cd826a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:48.732486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75d1fd17-3313-4ac2-9d3c-f94d89cd826a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:48.734548 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-58fdc358-9da9-48d1-a9e0-ef663f96f545 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1325 microversion: 2.1 time: 0.670571 Jul 14 14:30:48.750616 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 641/1290] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:48 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1325 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:48.766233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-33866379-c885-454a-a6a1-9f5f1b24a0cc tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:48.920872 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-33866379-c885-454a-a6a1-9f5f1b24a0cc tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.173794 Jul 14 14:30:48.922012 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 642/1291] 10.222.0.81 () {58 vars in 1147 bytes} [Thu Jul 14 14:30:48 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:48.933095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e87c9579-f20b-4292-830e-9bdba36d384c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:48.934434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e87c9579-f20b-4292-830e-9bdba36d384c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:48.984127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e87c9579-f20b-4292-830e-9bdba36d384c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:48.985302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e87c9579-f20b-4292-830e-9bdba36d384c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:48.987686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e87c9579-f20b-4292-830e-9bdba36d384c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:48.988460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e87c9579-f20b-4292-830e-9bdba36d384c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:49.392478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-75d1fd17-3313-4ac2-9d3c-f94d89cd826a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:49.397858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e87c9579-f20b-4292-830e-9bdba36d384c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:49.404192 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-75d1fd17-3313-4ac2-9d3c-f94d89cd826a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 200 len: 1314 microversion: 2.1 time: 0.755828 Jul 14 14:30:49.405291 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 650/1292] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:48 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 1314 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:49.417146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a941018c-30cc-478b-adb5-9b5c0d1365d7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5bc0ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:49.424863 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e87c9579-f20b-4292-830e-9bdba36d384c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.500284 Jul 14 14:30:49.426356 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 643/1293] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:48 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:49.434150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-36e4fb6f-1d0c-49b9-9995-3f23304d7557 req-0c1ad45a-d489-4aa9-b4be-3a5996dc0d80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4826f2be-ba35-4d31-8ea1-73d42b530dd4", "tag": "6ab54fdc-3cc1-4bb7-a515-a30086bd57f4"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:49.445062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-36e4fb6f-1d0c-49b9-9995-3f23304d7557 req-0c1ad45a-d489-4aa9-b4be-3a5996dc0d80 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:49.445927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-36e4fb6f-1d0c-49b9-9995-3f23304d7557 req-0c1ad45a-d489-4aa9-b4be-3a5996dc0d80 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:49.464006 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-36e4fb6f-1d0c-49b9-9995-3f23304d7557 req-0c1ad45a-d489-4aa9-b4be-3a5996dc0d80 service nova] Creating event network-changed:6ab54fdc-3cc1-4bb7-a515-a30086bd57f4 for instance 4826f2be-ba35-4d31-8ea1-73d42b530dd4 on n-h2-767704-28 Jul 14 14:30:49.470919 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-36e4fb6f-1d0c-49b9-9995-3f23304d7557 req-0c1ad45a-d489-4aa9-b4be-3a5996dc0d80 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043071 Jul 14 14:30:49.474439 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 644/1294] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:49.484668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cf07226e-9add-48ac-a57d-2f9546220eb6 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:49.489496 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a941018c-30cc-478b-adb5-9b5c0d1365d7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a" status: 200 len: 1414 microversion: 2.1 time: 0.081283 Jul 14 14:30:49.490566 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 651/1295] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:30:49 2022] GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:49.498542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a831fc10-7665-44c0-8e95-373d9be0a6a7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:49.499647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a831fc10-7665-44c0-8e95-373d9be0a6a7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:49.506976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a831fc10-7665-44c0-8e95-373d9be0a6a7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:49.507542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a831fc10-7665-44c0-8e95-373d9be0a6a7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:49.508405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a831fc10-7665-44c0-8e95-373d9be0a6a7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:49.509741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a831fc10-7665-44c0-8e95-373d9be0a6a7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:49.510928 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cf07226e-9add-48ac-a57d-2f9546220eb6 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.034991 Jul 14 14:30:49.511531 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 645/1296] 10.222.0.81 () {58 vars in 1139 bytes} [Thu Jul 14 14:30:49 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:49.519135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7b9a7a36-3efe-42cd-9e05-faf36c9104e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:49.529307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7b9a7a36-3efe-42cd-9e05-faf36c9104e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:49.542347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b9a7a36-3efe-42cd-9e05-faf36c9104e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:49.543240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b9a7a36-3efe-42cd-9e05-faf36c9104e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:49.544694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b9a7a36-3efe-42cd-9e05-faf36c9104e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:49.546148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b9a7a36-3efe-42cd-9e05-faf36c9104e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:49.588715 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7b9a7a36-3efe-42cd-9e05-faf36c9104e0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075962 Jul 14 14:30:49.589775 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 646/1297] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:30:49 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:30:49.601423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b18deb66-cab1-4d86-8069-c10b5a0799d7 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:49.612879 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b18deb66-cab1-4d86-8069-c10b5a0799d7 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018797 Jul 14 14:30:49.614235 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 647/1298] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:30:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:49.634856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9d4b229c-4f3e-4614-ab1b-ff2a2f7c6da9 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:49.666235 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9d4b229c-4f3e-4614-ab1b-ff2a2f7c6da9 tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.040742 Jul 14 14:30:49.667346 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 648/1299] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:30:49 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:49.673035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21cb4b86-1c79-4b7e-88dc-0d1195f8e6e8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:49.673633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-21cb4b86-1c79-4b7e-88dc-0d1195f8e6e8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:49.684791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21cb4b86-1c79-4b7e-88dc-0d1195f8e6e8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:49.685480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21cb4b86-1c79-4b7e-88dc-0d1195f8e6e8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:49.686099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21cb4b86-1c79-4b7e-88dc-0d1195f8e6e8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:49.686550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21cb4b86-1c79-4b7e-88dc-0d1195f8e6e8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:49.809506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-21cb4b86-1c79-4b7e-88dc-0d1195f8e6e8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:49.818214 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21cb4b86-1c79-4b7e-88dc-0d1195f8e6e8 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1274 microversion: 2.1 time: 0.149642 Jul 14 14:30:49.818980 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 649/1300] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:49 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:49.825104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-60a11cae-9651-4d86-9f07-80bab0bf6e9d tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:49.867246 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-60a11cae-9651-4d86-9f07-80bab0bf6e9d tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046576 Jul 14 14:30:49.868746 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 650/1301] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:30:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:49.882165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-72f30e15-ef1c-462b-a06c-c7926625d9e7 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:49.883143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-72f30e15-ef1c-462b-a06c-c7926625d9e7 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:49.893937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72f30e15-ef1c-462b-a06c-c7926625d9e7 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:49.894682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72f30e15-ef1c-462b-a06c-c7926625d9e7 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:49.895832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72f30e15-ef1c-462b-a06c-c7926625d9e7 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:49.896498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72f30e15-ef1c-462b-a06c-c7926625d9e7 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:50.011293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a831fc10-7665-44c0-8e95-373d9be0a6a7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:50.030750 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a831fc10-7665-44c0-8e95-373d9be0a6a7 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1468 microversion: 2.1 time: 0.538325 Jul 14 14:30:50.043327 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 652/1302] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:49 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1468 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:50.049789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-530532c0-bbbf-483a-93ef-fb6754844e8c tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:50.061563 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-530532c0-bbbf-483a-93ef-fb6754844e8c tempest-FlavorsV2TestJSON-137730175 tempest-FlavorsV2TestJSON-137730175-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015870 Jul 14 14:30:50.062505 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 653/1303] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:30:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:50.434322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aa381cbf-bc9a-43c5-b033-2a7fb9f2d358 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:50.434971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aa381cbf-bc9a-43c5-b033-2a7fb9f2d358 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:50.452449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa381cbf-bc9a-43c5-b033-2a7fb9f2d358 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:50.458293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa381cbf-bc9a-43c5-b033-2a7fb9f2d358 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:50.460540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa381cbf-bc9a-43c5-b033-2a7fb9f2d358 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:50.463269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa381cbf-bc9a-43c5-b033-2a7fb9f2d358 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:50.464410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-72f30e15-ef1c-462b-a06c-c7926625d9e7 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:50.475178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:50.480123 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-72f30e15-ef1c-462b-a06c-c7926625d9e7 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1325 microversion: 2.1 time: 0.597961 Jul 14 14:30:50.481182 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 651/1304] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:49 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1325 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:50.499123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-bfcde2f7-ce3a-4eae-b7d5-9d93c2c8a7f4 req-ef7cadae-a168-407d-bde4-c65948845419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc9d46f-240b-4266-9cbe-5cf98e6378cb", "tag": "74982656-6d85-4d02-8e85-f8c748be1f2a"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:50.534192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-bfcde2f7-ce3a-4eae-b7d5-9d93c2c8a7f4 req-ef7cadae-a168-407d-bde4-c65948845419 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:50.534842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-bfcde2f7-ce3a-4eae-b7d5-9d93c2c8a7f4 req-ef7cadae-a168-407d-bde4-c65948845419 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:50.560099 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-bfcde2f7-ce3a-4eae-b7d5-9d93c2c8a7f4 req-ef7cadae-a168-407d-bde4-c65948845419 service nova] Creating event network-changed:74982656-6d85-4d02-8e85-f8c748be1f2a for instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb on n-h2-767704-28 Jul 14 14:30:50.578684 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-bfcde2f7-ce3a-4eae-b7d5-9d93c2c8a7f4 req-ef7cadae-a168-407d-bde4-c65948845419 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095965 Jul 14 14:30:50.579887 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 652/1305] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:50.601075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2070bc05-b004-446b-9d5e-7391f720a2cb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:50.601965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2070bc05-b004-446b-9d5e-7391f720a2cb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:50.612724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2070bc05-b004-446b-9d5e-7391f720a2cb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:50.617174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2070bc05-b004-446b-9d5e-7391f720a2cb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:50.618799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2070bc05-b004-446b-9d5e-7391f720a2cb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:50.619428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2070bc05-b004-446b-9d5e-7391f720a2cb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:50.992375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:51.354863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-aa381cbf-bc9a-43c5-b033-2a7fb9f2d358 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:51.363331 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aa381cbf-bc9a-43c5-b033-2a7fb9f2d358 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 200 len: 1314 microversion: 2.1 time: 0.934765 Jul 14 14:30:51.363934 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 654/1306] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:50 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 1314 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:51.375138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-94544f92-b04a-4cc3-8c5f-0fe79f82fbe7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5b8a790>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:51.474260 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-94544f92-b04a-4cc3-8c5f-0fe79f82fbe7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a" status: 200 len: 1414 microversion: 2.1 time: 0.102923 Jul 14 14:30:51.475308 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 655/1307] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:30:51 2022] GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:51.487603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5e04d741-d2fb-49b4-9e91-bc1fcd7954ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:51.488772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5e04d741-d2fb-49b4-9e91-bc1fcd7954ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:51.504299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e04d741-d2fb-49b4-9e91-bc1fcd7954ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:51.504919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e04d741-d2fb-49b4-9e91-bc1fcd7954ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:51.505851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e04d741-d2fb-49b4-9e91-bc1fcd7954ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:51.506425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e04d741-d2fb-49b4-9e91-bc1fcd7954ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:51.540751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2070bc05-b004-446b-9d5e-7391f720a2cb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:51.557104 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2070bc05-b004-446b-9d5e-7391f720a2cb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.971785 Jul 14 14:30:51.560869 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 653/1308] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:50 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:51.566118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c53a8122-e37d-4cf5-b147-184d490fc63e tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:51.569709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c53a8122-e37d-4cf5-b147-184d490fc63e tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:51.599240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c53a8122-e37d-4cf5-b147-184d490fc63e tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:51.600386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c53a8122-e37d-4cf5-b147-184d490fc63e tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:51.603761 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5e04d741-d2fb-49b4-9e91-bc1fcd7954ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127555 Jul 14 14:30:51.604887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c53a8122-e37d-4cf5-b147-184d490fc63e tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:51.605489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c53a8122-e37d-4cf5-b147-184d490fc63e tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:51.608479 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 656/1309] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:30:51 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:30:51.625828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-54deece0-c6f4-4e39-9c82-1a9f574fffa9 req-c82fa94b-6404-43b2-a63b-166c8b7ce17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc69728d-ad31-4750-a7e2-ef09d6dd3686", "name": "network-vif-plugged", "status": "completed", "tag": "4b7a1348-79bc-4d4e-8c50-0bfe89eac4b1"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:51.653297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-54deece0-c6f4-4e39-9c82-1a9f574fffa9 req-c82fa94b-6404-43b2-a63b-166c8b7ce17d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:51.654183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-54deece0-c6f4-4e39-9c82-1a9f574fffa9 req-c82fa94b-6404-43b2-a63b-166c8b7ce17d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:51.681086 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-54deece0-c6f4-4e39-9c82-1a9f574fffa9 req-c82fa94b-6404-43b2-a63b-166c8b7ce17d service nova] Creating event network-vif-plugged:4b7a1348-79bc-4d4e-8c50-0bfe89eac4b1 for instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 on n-h2-767704-28 Jul 14 14:30:51.690948 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-54deece0-c6f4-4e39-9c82-1a9f574fffa9 req-c82fa94b-6404-43b2-a63b-166c8b7ce17d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080830 Jul 14 14:30:51.691973 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 657/1310] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:51.700707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e18c73ee-9c69-43d0-89cd-1a3fd11451d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:51.701824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e18c73ee-9c69-43d0-89cd-1a3fd11451d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:51.710776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e18c73ee-9c69-43d0-89cd-1a3fd11451d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:51.711591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e18c73ee-9c69-43d0-89cd-1a3fd11451d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:51.713491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e18c73ee-9c69-43d0-89cd-1a3fd11451d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:51.714209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e18c73ee-9c69-43d0-89cd-1a3fd11451d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:51.917164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c53a8122-e37d-4cf5-b147-184d490fc63e tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:51.928425 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c53a8122-e37d-4cf5-b147-184d490fc63e tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1280 microversion: 2.1 time: 0.366112 Jul 14 14:30:51.944040 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 654/1311] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:51 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1280 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:51.951905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-df53eeb0-84bf-4b5e-9e35-f0b62583d800 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:51.953129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-df53eeb0-84bf-4b5e-9e35-f0b62583d800 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:51.966943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df53eeb0-84bf-4b5e-9e35-f0b62583d800 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:51.968730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df53eeb0-84bf-4b5e-9e35-f0b62583d800 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:51.971541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df53eeb0-84bf-4b5e-9e35-f0b62583d800 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:51.982340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df53eeb0-84bf-4b5e-9e35-f0b62583d800 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:52.284004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e18c73ee-9c69-43d0-89cd-1a3fd11451d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:52.301725 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e18c73ee-9c69-43d0-89cd-1a3fd11451d9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1468 microversion: 2.1 time: 0.604533 Jul 14 14:30:52.302922 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 658/1312] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:51 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1468 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:52.385739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ccbab14f-3eb5-4c8f-ba14-1391b1a7adaa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:52.386642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ccbab14f-3eb5-4c8f-ba14-1391b1a7adaa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:52.387082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-df53eeb0-84bf-4b5e-9e35-f0b62583d800 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:52.401463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ccbab14f-3eb5-4c8f-ba14-1391b1a7adaa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:52.402169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ccbab14f-3eb5-4c8f-ba14-1391b1a7adaa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:52.403240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ccbab14f-3eb5-4c8f-ba14-1391b1a7adaa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:52.403860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ccbab14f-3eb5-4c8f-ba14-1391b1a7adaa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:52.418927 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-df53eeb0-84bf-4b5e-9e35-f0b62583d800 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1325 microversion: 2.1 time: 0.472774 Jul 14 14:30:52.419545 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 655/1313] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:51 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1325 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:52.491612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-37cd595a-52e5-496e-bed4-248ca6f0748f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c57440d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:52.580734 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-37cd595a-52e5-496e-bed4-248ca6f0748f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a" status: 200 len: 1414 microversion: 2.1 time: 0.093519 Jul 14 14:30:52.581678 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 656/1314] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:30:52 2022] GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:30:52.602191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6ff75c9d-1417-49d0-b527-b057d596e36e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:52.603623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6ff75c9d-1417-49d0-b527-b057d596e36e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:52.631276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ff75c9d-1417-49d0-b527-b057d596e36e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:52.633955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ff75c9d-1417-49d0-b527-b057d596e36e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:52.639966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ff75c9d-1417-49d0-b527-b057d596e36e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:52.641381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ff75c9d-1417-49d0-b527-b057d596e36e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:52.863265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ccbab14f-3eb5-4c8f-ba14-1391b1a7adaa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:52.911795 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ccbab14f-3eb5-4c8f-ba14-1391b1a7adaa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 200 len: 1314 microversion: 2.1 time: 0.529472 Jul 14 14:30:52.925597 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 659/1315] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:52 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:30:52.931298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cf5b9472-c295-4120-a8f9-c51dea784b89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:52.932448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cf5b9472-c295-4120-a8f9-c51dea784b89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:52.939882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf5b9472-c295-4120-a8f9-c51dea784b89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:52.940609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf5b9472-c295-4120-a8f9-c51dea784b89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:52.941640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf5b9472-c295-4120-a8f9-c51dea784b89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:52.942258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf5b9472-c295-4120-a8f9-c51dea784b89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:53.011812 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cf5b9472-c295-4120-a8f9-c51dea784b89 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.084753 Jul 14 14:30:53.012759 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 660/1316] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:30:52 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:53.022097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4df825dc-095c-49a8-93b7-58534988de14 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:53.023113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4df825dc-095c-49a8-93b7-58534988de14 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:53.041891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4df825dc-095c-49a8-93b7-58534988de14 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:53.042651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4df825dc-095c-49a8-93b7-58534988de14 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:53.043637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4df825dc-095c-49a8-93b7-58534988de14 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:53.044250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4df825dc-095c-49a8-93b7-58534988de14 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:53.372517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6ff75c9d-1417-49d0-b527-b057d596e36e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:53.385884 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6ff75c9d-1417-49d0-b527-b057d596e36e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.800197 Jul 14 14:30:53.392807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4df825dc-095c-49a8-93b7-58534988de14 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:53.399803 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 657/1317] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:52 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:53.403216 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4df825dc-095c-49a8-93b7-58534988de14 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1322 microversion: 2.1 time: 0.389263 Jul 14 14:30:53.406607 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 661/1318] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:53 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:53.407756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b175785d-31a8-4301-85c1-73959da6c506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:53.408396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b175785d-31a8-4301-85c1-73959da6c506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:53.439874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-44927549-2abd-4464-be82-03e97ff49f4d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:53.443139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b175785d-31a8-4301-85c1-73959da6c506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:53.444337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-44927549-2abd-4464-be82-03e97ff49f4d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:53.445641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b175785d-31a8-4301-85c1-73959da6c506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:53.448706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b175785d-31a8-4301-85c1-73959da6c506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:53.450040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b175785d-31a8-4301-85c1-73959da6c506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:53.482973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44927549-2abd-4464-be82-03e97ff49f4d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:53.486641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44927549-2abd-4464-be82-03e97ff49f4d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:53.488509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44927549-2abd-4464-be82-03e97ff49f4d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:53.491753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44927549-2abd-4464-be82-03e97ff49f4d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:53.933955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b175785d-31a8-4301-85c1-73959da6c506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:53.946089 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b175785d-31a8-4301-85c1-73959da6c506 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1468 microversion: 2.1 time: 0.542874 Jul 14 14:30:53.958698 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 658/1319] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:53 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1468 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:53.972404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e63bbef9-7184-49eb-9b7a-806c43189758 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c56ad8b0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:54.054890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-44927549-2abd-4464-be82-03e97ff49f4d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:54.062763 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e63bbef9-7184-49eb-9b7a-806c43189758 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a" status: 200 len: 1414 microversion: 2.1 time: 0.102683 Jul 14 14:30:54.065671 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-44927549-2abd-4464-be82-03e97ff49f4d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1325 microversion: 2.1 time: 0.633180 Jul 14 14:30:54.072733 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 659/1320] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:30:53 2022] GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:54.086480 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 662/1321] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:53 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1325 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:30:54.089499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dd55e720-9c86-49d9-8e5a-cde58465c339 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:54.090372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dd55e720-9c86-49d9-8e5a-cde58465c339 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:54.168804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd55e720-9c86-49d9-8e5a-cde58465c339 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:54.169748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd55e720-9c86-49d9-8e5a-cde58465c339 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:54.174284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd55e720-9c86-49d9-8e5a-cde58465c339 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:54.175092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd55e720-9c86-49d9-8e5a-cde58465c339 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:54.199150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:54.408054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18f701d1-0a99-45eb-ba00-543dfc18bb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:54.409288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-18f701d1-0a99-45eb-ba00-543dfc18bb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:54.421805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18f701d1-0a99-45eb-ba00-543dfc18bb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:54.423773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18f701d1-0a99-45eb-ba00-543dfc18bb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:54.426758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18f701d1-0a99-45eb-ba00-543dfc18bb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:54.428924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18f701d1-0a99-45eb-ba00-543dfc18bb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:54.997335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dd55e720-9c86-49d9-8e5a-cde58465c339 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:55.012469 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dd55e720-9c86-49d9-8e5a-cde58465c339 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 200 len: 1314 microversion: 2.1 time: 0.938201 Jul 14 14:30:55.022372 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 660/1322] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:54 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:55.028146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9a72bd2b-20a9-4fb8-88b7-f5682bb48c9b tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:55.043942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9a72bd2b-20a9-4fb8-88b7-f5682bb48c9b tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:55.060297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a72bd2b-20a9-4fb8-88b7-f5682bb48c9b tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:55.061111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a72bd2b-20a9-4fb8-88b7-f5682bb48c9b tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:55.064503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a72bd2b-20a9-4fb8-88b7-f5682bb48c9b tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:55.065250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a72bd2b-20a9-4fb8-88b7-f5682bb48c9b tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:55.111497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18f701d1-0a99-45eb-ba00-543dfc18bb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:55.122970 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-18f701d1-0a99-45eb-ba00-543dfc18bb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.719021 Jul 14 14:30:55.128918 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 663/1323] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:54 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:30:55.135079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-391f60eb-fd36-4c28-8f5c-bcdeacee91f0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:55.145922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-391f60eb-fd36-4c28-8f5c-bcdeacee91f0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:55.168728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-391f60eb-fd36-4c28-8f5c-bcdeacee91f0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:55.171031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-391f60eb-fd36-4c28-8f5c-bcdeacee91f0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:55.172103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-391f60eb-fd36-4c28-8f5c-bcdeacee91f0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:55.172717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-391f60eb-fd36-4c28-8f5c-bcdeacee91f0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:55.549973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9a72bd2b-20a9-4fb8-88b7-f5682bb48c9b tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:55.569685 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9a72bd2b-20a9-4fb8-88b7-f5682bb48c9b tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1322 microversion: 2.1 time: 0.545919 Jul 14 14:30:55.572614 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 661/1324] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:55 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:55.583122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0976bfbc-9272-44cf-ba5c-b47fa3308018 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c56f5b80>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:55.667616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-391f60eb-fd36-4c28-8f5c-bcdeacee91f0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:55.681637 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-391f60eb-fd36-4c28-8f5c-bcdeacee91f0 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1468 microversion: 2.1 time: 0.549662 Jul 14 14:30:55.684540 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 664/1325] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:55 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1468 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:55.699478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36f7980c-e1fa-4014-88a7-24c00fc7c853 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:55.700701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-36f7980c-e1fa-4014-88a7-24c00fc7c853 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:55.709215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36f7980c-e1fa-4014-88a7-24c00fc7c853 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:55.710052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36f7980c-e1fa-4014-88a7-24c00fc7c853 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:55.711151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36f7980c-e1fa-4014-88a7-24c00fc7c853 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:55.714212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36f7980c-e1fa-4014-88a7-24c00fc7c853 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:56.203428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-36f7980c-e1fa-4014-88a7-24c00fc7c853 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:56.236421 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-36f7980c-e1fa-4014-88a7-24c00fc7c853 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1325 microversion: 2.1 time: 0.548370 Jul 14 14:30:56.258272 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 665/1326] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:55 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1325 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:56.285192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-30a7392f-2cf8-42e9-be8f-dfb139e854cf req-b81bc32f-398b-4631-b6c9-0a7a2ccd5254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a0d92d-ba81-48f5-aa28-a62a0026c47a", "name": "network-vif-unplugged", "status": "completed", "tag": "dfbfc888-8b45-4b44-b669-8df623f935de"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:56.315660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-30a7392f-2cf8-42e9-be8f-dfb139e854cf req-b81bc32f-398b-4631-b6c9-0a7a2ccd5254 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:56.318512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-30a7392f-2cf8-42e9-be8f-dfb139e854cf req-b81bc32f-398b-4631-b6c9-0a7a2ccd5254 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:56.364903 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-30a7392f-2cf8-42e9-be8f-dfb139e854cf req-b81bc32f-398b-4631-b6c9-0a7a2ccd5254 service nova] Creating event network-vif-unplugged:dfbfc888-8b45-4b44-b669-8df623f935de for instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a on n-h1-767704-28 Jul 14 14:30:56.381522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-30a7392f-2cf8-42e9-be8f-dfb139e854cf req-b81bc32f-398b-4631-b6c9-0a7a2ccd5254 service nova] Instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:30:56.432209 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-30a7392f-2cf8-42e9-be8f-dfb139e854cf req-b81bc32f-398b-4631-b6c9-0a7a2ccd5254 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.170589 Jul 14 14:30:56.432870 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 666/1327] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:56.445192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ea23c770-27a3-43c1-be65-490fa1b3082d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:56.454845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ea23c770-27a3-43c1-be65-490fa1b3082d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:56.468204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea23c770-27a3-43c1-be65-490fa1b3082d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:56.471844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea23c770-27a3-43c1-be65-490fa1b3082d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:56.474151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea23c770-27a3-43c1-be65-490fa1b3082d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:56.474868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea23c770-27a3-43c1-be65-490fa1b3082d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:56.897292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ea23c770-27a3-43c1-be65-490fa1b3082d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:56.916904 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ea23c770-27a3-43c1-be65-490fa1b3082d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 200 len: 1314 microversion: 2.1 time: 0.478445 Jul 14 14:30:56.934344 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 667/1328] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:56 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:56.948265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e06e7f1a-69cf-44b0-b542-f51f2577f13c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:56.949288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e06e7f1a-69cf-44b0-b542-f51f2577f13c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:56.961915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e06e7f1a-69cf-44b0-b542-f51f2577f13c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:56.964896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e06e7f1a-69cf-44b0-b542-f51f2577f13c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:56.967479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e06e7f1a-69cf-44b0-b542-f51f2577f13c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:56.968271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e06e7f1a-69cf-44b0-b542-f51f2577f13c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:57.490691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e06e7f1a-69cf-44b0-b542-f51f2577f13c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:57.516676 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e06e7f1a-69cf-44b0-b542-f51f2577f13c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.580460 Jul 14 14:30:57.521260 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 668/1329] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:56 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:57.547787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e0fc3f52-15fc-40f3-a66c-ccd34a65f65a tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:57.551197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e0fc3f52-15fc-40f3-a66c-ccd34a65f65a tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:57.562408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e0fc3f52-15fc-40f3-a66c-ccd34a65f65a tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:57.563292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e0fc3f52-15fc-40f3-a66c-ccd34a65f65a tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:57.565292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e0fc3f52-15fc-40f3-a66c-ccd34a65f65a tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:57.566117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e0fc3f52-15fc-40f3-a66c-ccd34a65f65a tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:57.657136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:57.685375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=14 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:58.049100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e0fc3f52-15fc-40f3-a66c-ccd34a65f65a tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:58.067572 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e0fc3f52-15fc-40f3-a66c-ccd34a65f65a tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1322 microversion: 2.1 time: 0.539424 Jul 14 14:30:58.070450 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 669/1330] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:57 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1322 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:58.091705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2627147c-6b5e-468f-9011-7eca68a02ff5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:58.098922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2627147c-6b5e-468f-9011-7eca68a02ff5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:58.124848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2627147c-6b5e-468f-9011-7eca68a02ff5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:58.124848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2627147c-6b5e-468f-9011-7eca68a02ff5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:58.128215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2627147c-6b5e-468f-9011-7eca68a02ff5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:58.128215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2627147c-6b5e-468f-9011-7eca68a02ff5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:58.471353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2627147c-6b5e-468f-9011-7eca68a02ff5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:58.484472 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2627147c-6b5e-468f-9011-7eca68a02ff5 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1468 microversion: 2.1 time: 0.411904 Jul 14 14:30:58.486341 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 670/1331] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:58 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1468 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:58.494981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-818a4e6b-bb2f-48a9-a4d9-68a4dab64a41 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:58.496641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-818a4e6b-bb2f-48a9-a4d9-68a4dab64a41 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:58.521715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-818a4e6b-bb2f-48a9-a4d9-68a4dab64a41 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:58.522489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-818a4e6b-bb2f-48a9-a4d9-68a4dab64a41 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:58.523559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-818a4e6b-bb2f-48a9-a4d9-68a4dab64a41 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:58.524237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-818a4e6b-bb2f-48a9-a4d9-68a4dab64a41 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:58.615119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:58.925667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-818a4e6b-bb2f-48a9-a4d9-68a4dab64a41 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:58.962326 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-818a4e6b-bb2f-48a9-a4d9-68a4dab64a41 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1325 microversion: 2.1 time: 0.467294 Jul 14 14:30:58.966116 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 671/1332] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:58 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1325 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:58.985327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-772fedc6-26c2-40bd-a658-e7973f8f2d95 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:58.988338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-772fedc6-26c2-40bd-a658-e7973f8f2d95 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:59.034588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-772fedc6-26c2-40bd-a658-e7973f8f2d95 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:59.041037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-772fedc6-26c2-40bd-a658-e7973f8f2d95 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:59.043255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-772fedc6-26c2-40bd-a658-e7973f8f2d95 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:59.047180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-772fedc6-26c2-40bd-a658-e7973f8f2d95 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:59.553313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-772fedc6-26c2-40bd-a658-e7973f8f2d95 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:59.557334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:59.572650 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-772fedc6-26c2-40bd-a658-e7973f8f2d95 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 200 len: 1314 microversion: 2.1 time: 0.593401 Jul 14 14:30:59.576320 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 672/1333] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:58 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:59.598606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9fb5db6-f33e-4e33-b07d-c34f15263bb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:59.600106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b9fb5db6-f33e-4e33-b07d-c34f15263bb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:59.632684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9fb5db6-f33e-4e33-b07d-c34f15263bb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:59.634858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9fb5db6-f33e-4e33-b07d-c34f15263bb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:59.641597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9fb5db6-f33e-4e33-b07d-c34f15263bb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:59.643672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9fb5db6-f33e-4e33-b07d-c34f15263bb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:59.963647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b9fb5db6-f33e-4e33-b07d-c34f15263bb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:59.981312 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b9fb5db6-f33e-4e33-b07d-c34f15263bb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.401021 Jul 14 14:30:59.992642 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 673/1334] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:59 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:00.002766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c6641338-e25a-4e65-9043-03d229072bb1 req-394038e5-3c05-4959-b0bb-cf50b2defa37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d38095f-a9b7-4c8a-9f17-242929a4f872", "tag": "84ab7c56-5f6b-40e0-a91a-728137d82fba"}, {"name": "network-changed", "server_uuid": "25a0d92d-ba81-48f5-aa28-a62a0026c47a", "tag": "dfbfc888-8b45-4b44-b669-8df623f935de"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:00.018950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c6641338-e25a-4e65-9043-03d229072bb1 req-394038e5-3c05-4959-b0bb-cf50b2defa37 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:00.019697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c6641338-e25a-4e65-9043-03d229072bb1 req-394038e5-3c05-4959-b0bb-cf50b2defa37 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:00.053940 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c6641338-e25a-4e65-9043-03d229072bb1 req-394038e5-3c05-4959-b0bb-cf50b2defa37 service nova] Creating event network-changed:84ab7c56-5f6b-40e0-a91a-728137d82fba for instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 on n-h1-767704-28 Jul 14 14:31:00.055262 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c6641338-e25a-4e65-9043-03d229072bb1 req-394038e5-3c05-4959-b0bb-cf50b2defa37 service nova] Creating event network-changed:dfbfc888-8b45-4b44-b669-8df623f935de for instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a on n-h1-767704-28 Jul 14 14:31:00.085320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-c6641338-e25a-4e65-9043-03d229072bb1 req-394038e5-3c05-4959-b0bb-cf50b2defa37 service nova] Instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:31:00.144181 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c6641338-e25a-4e65-9043-03d229072bb1 req-394038e5-3c05-4959-b0bb-cf50b2defa37 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.148628 Jul 14 14:31:00.148965 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 674/1335] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:00.170605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b885e607-a80b-49c9-95fe-a7e729dd1754 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:00.171496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b885e607-a80b-49c9-95fe-a7e729dd1754 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:00.199464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b885e607-a80b-49c9-95fe-a7e729dd1754 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:00.200269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b885e607-a80b-49c9-95fe-a7e729dd1754 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:00.200721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b885e607-a80b-49c9-95fe-a7e729dd1754 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:00.201185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b885e607-a80b-49c9-95fe-a7e729dd1754 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:00.555241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b885e607-a80b-49c9-95fe-a7e729dd1754 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:00.570815 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b885e607-a80b-49c9-95fe-a7e729dd1754 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1322 microversion: 2.1 time: 0.418661 Jul 14 14:31:00.586050 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 675/1336] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:00 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:00.597386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1835e798-80b9-4206-bef7-64299b8b8c85 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:00.598757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1835e798-80b9-4206-bef7-64299b8b8c85 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:00.651190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1835e798-80b9-4206-bef7-64299b8b8c85 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:00.651190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1835e798-80b9-4206-bef7-64299b8b8c85 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:00.653404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1835e798-80b9-4206-bef7-64299b8b8c85 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:00.654302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1835e798-80b9-4206-bef7-64299b8b8c85 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:01.000111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1835e798-80b9-4206-bef7-64299b8b8c85 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:01.044341 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1835e798-80b9-4206-bef7-64299b8b8c85 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1468 microversion: 2.1 time: 0.455425 Jul 14 14:31:01.069125 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 676/1337] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:00 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1468 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:01.069125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a283dfa8-7a5d-41b7-95e7-d838a8b2d83d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:01.069125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a283dfa8-7a5d-41b7-95e7-d838a8b2d83d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:01.107106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a283dfa8-7a5d-41b7-95e7-d838a8b2d83d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:01.107555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a283dfa8-7a5d-41b7-95e7-d838a8b2d83d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:01.108375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a283dfa8-7a5d-41b7-95e7-d838a8b2d83d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:01.109149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a283dfa8-7a5d-41b7-95e7-d838a8b2d83d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:01.487730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a283dfa8-7a5d-41b7-95e7-d838a8b2d83d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:01.523659 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a283dfa8-7a5d-41b7-95e7-d838a8b2d83d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1325 microversion: 2.1 time: 0.463131 Jul 14 14:31:01.525354 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 677/1338] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:01 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1325 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:01.546551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-64552f2d-20bd-4489-9689-f6312979ae26 req-e94dc93b-41ea-44cf-892e-6361a0dae694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc9d46f-240b-4266-9cbe-5cf98e6378cb", "name": "network-vif-plugged", "status": "completed", "tag": "74982656-6d85-4d02-8e85-f8c748be1f2a"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:01.597282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-64552f2d-20bd-4489-9689-f6312979ae26 req-e94dc93b-41ea-44cf-892e-6361a0dae694 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:01.598133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-64552f2d-20bd-4489-9689-f6312979ae26 req-e94dc93b-41ea-44cf-892e-6361a0dae694 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:01.661703 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-64552f2d-20bd-4489-9689-f6312979ae26 req-e94dc93b-41ea-44cf-892e-6361a0dae694 service nova] Creating event network-vif-plugged:74982656-6d85-4d02-8e85-f8c748be1f2a for instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb on n-h2-767704-28 Jul 14 14:31:01.691029 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-64552f2d-20bd-4489-9689-f6312979ae26 req-e94dc93b-41ea-44cf-892e-6361a0dae694 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154762 Jul 14 14:31:01.695351 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 678/1339] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:01.712565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-55940f32-7864-4876-84ee-5c007ecf11c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:01.727147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-55940f32-7864-4876-84ee-5c007ecf11c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:01.744775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55940f32-7864-4876-84ee-5c007ecf11c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:01.745643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55940f32-7864-4876-84ee-5c007ecf11c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:01.747419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55940f32-7864-4876-84ee-5c007ecf11c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:01.753689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55940f32-7864-4876-84ee-5c007ecf11c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:02.901046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-55940f32-7864-4876-84ee-5c007ecf11c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:02.913231 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-55940f32-7864-4876-84ee-5c007ecf11c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 200 len: 1314 microversion: 2.1 time: 1.216306 Jul 14 14:31:02.919427 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 679/1340] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:01 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 1314 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:02.933650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b10bf3fe-85f0-4172-9f8f-3fd4df3cc0fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:02.940972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b10bf3fe-85f0-4172-9f8f-3fd4df3cc0fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:02.956112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b10bf3fe-85f0-4172-9f8f-3fd4df3cc0fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:02.959281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b10bf3fe-85f0-4172-9f8f-3fd4df3cc0fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:02.960779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b10bf3fe-85f0-4172-9f8f-3fd4df3cc0fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:02.962635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b10bf3fe-85f0-4172-9f8f-3fd4df3cc0fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:03.250404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b10bf3fe-85f0-4172-9f8f-3fd4df3cc0fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:03.268827 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b10bf3fe-85f0-4172-9f8f-3fd4df3cc0fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.345934 Jul 14 14:31:03.273407 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 680/1341] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:02 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:03.300788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c5f557a3-8ca3-40e2-83e5-5537029666e3 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:03.304784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c5f557a3-8ca3-40e2-83e5-5537029666e3 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:03.348853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5f557a3-8ca3-40e2-83e5-5537029666e3 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:03.349674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5f557a3-8ca3-40e2-83e5-5537029666e3 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:03.355124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5f557a3-8ca3-40e2-83e5-5537029666e3 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:03.355980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5f557a3-8ca3-40e2-83e5-5537029666e3 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:03.824684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c5f557a3-8ca3-40e2-83e5-5537029666e3 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:03.838785 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c5f557a3-8ca3-40e2-83e5-5537029666e3 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1322 microversion: 2.1 time: 0.561507 Jul 14 14:31:03.841421 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 681/1342] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:03 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:03.862709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-80a9ea61-5d1d-45a9-be67-45187af32d46 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:03.869150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-80a9ea61-5d1d-45a9-be67-45187af32d46 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:03.881722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80a9ea61-5d1d-45a9-be67-45187af32d46 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:03.882774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80a9ea61-5d1d-45a9-be67-45187af32d46 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:03.885821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80a9ea61-5d1d-45a9-be67-45187af32d46 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:03.889923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80a9ea61-5d1d-45a9-be67-45187af32d46 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:04.268527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-80a9ea61-5d1d-45a9-be67-45187af32d46 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:04.297146 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-80a9ea61-5d1d-45a9-be67-45187af32d46 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1468 microversion: 2.1 time: 0.450235 Jul 14 14:31:04.299063 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 682/1343] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:03 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1468 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:04.318973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-976fd95a-04d8-469d-a2e1-5bafe5a6a5fa tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:04.319995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-976fd95a-04d8-469d-a2e1-5bafe5a6a5fa tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:04.342668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-976fd95a-04d8-469d-a2e1-5bafe5a6a5fa tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:04.343049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-976fd95a-04d8-469d-a2e1-5bafe5a6a5fa tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:04.352201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-976fd95a-04d8-469d-a2e1-5bafe5a6a5fa tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:04.353517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-976fd95a-04d8-469d-a2e1-5bafe5a6a5fa tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:04.848168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-976fd95a-04d8-469d-a2e1-5bafe5a6a5fa tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:04.875620 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-976fd95a-04d8-469d-a2e1-5bafe5a6a5fa tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1325 microversion: 2.1 time: 0.575732 Jul 14 14:31:04.876240 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 683/1344] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:04 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1325 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:04.888071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4366389e-c12c-497f-b4bd-706d24510057 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:04.888697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4366389e-c12c-497f-b4bd-706d24510057 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:04.942034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4366389e-c12c-497f-b4bd-706d24510057 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:04.942508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4366389e-c12c-497f-b4bd-706d24510057 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:04.943324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4366389e-c12c-497f-b4bd-706d24510057 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:04.943781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4366389e-c12c-497f-b4bd-706d24510057 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:05.059653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:05.342034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4366389e-c12c-497f-b4bd-706d24510057 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:05.354710 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4366389e-c12c-497f-b4bd-706d24510057 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 200 len: 1502 microversion: 2.1 time: 0.477365 Jul 14 14:31:05.355925 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 684/1345] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:04 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 1502 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:05.361007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0f7634d4-7a1f-471e-b7c7-f75be8f2288e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:05.361891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0f7634d4-7a1f-471e-b7c7-f75be8f2288e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:05.375246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f7634d4-7a1f-471e-b7c7-f75be8f2288e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:05.376165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f7634d4-7a1f-471e-b7c7-f75be8f2288e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:05.381242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f7634d4-7a1f-471e-b7c7-f75be8f2288e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:05.382247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f7634d4-7a1f-471e-b7c7-f75be8f2288e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:05.569002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=11 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:05.639363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0f7634d4-7a1f-471e-b7c7-f75be8f2288e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:05.652732 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0f7634d4-7a1f-471e-b7c7-f75be8f2288e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.295429 Jul 14 14:31:05.654691 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 685/1346] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:05 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:05.662136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dada739f-a997-4969-a1bb-dbc779ff5af9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:05.664083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dada739f-a997-4969-a1bb-dbc779ff5af9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:05.702087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dada739f-a997-4969-a1bb-dbc779ff5af9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:05.708870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dada739f-a997-4969-a1bb-dbc779ff5af9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:05.713057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dada739f-a997-4969-a1bb-dbc779ff5af9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:05.713931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dada739f-a997-4969-a1bb-dbc779ff5af9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:06.113504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dada739f-a997-4969-a1bb-dbc779ff5af9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:06.127802 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dada739f-a997-4969-a1bb-dbc779ff5af9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1322 microversion: 2.1 time: 0.471825 Jul 14 14:31:06.130372 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 686/1347] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:05 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:06.137371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-00c85871-d533-4ad4-b923-d130a15406d2 req-adbd2d42-ae71-4111-8e3f-1b99711bc2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4826f2be-ba35-4d31-8ea1-73d42b530dd4", "name": "network-vif-plugged", "status": "completed", "tag": "6ab54fdc-3cc1-4bb7-a515-a30086bd57f4"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:06.152122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-00c85871-d533-4ad4-b923-d130a15406d2 req-adbd2d42-ae71-4111-8e3f-1b99711bc2e6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:06.154898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-00c85871-d533-4ad4-b923-d130a15406d2 req-adbd2d42-ae71-4111-8e3f-1b99711bc2e6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:06.170412 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-00c85871-d533-4ad4-b923-d130a15406d2 req-adbd2d42-ae71-4111-8e3f-1b99711bc2e6 service nova] Creating event network-vif-plugged:6ab54fdc-3cc1-4bb7-a515-a30086bd57f4 for instance 4826f2be-ba35-4d31-8ea1-73d42b530dd4 on n-h2-767704-28 Jul 14 14:31:06.177160 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-00c85871-d533-4ad4-b923-d130a15406d2 req-adbd2d42-ae71-4111-8e3f-1b99711bc2e6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045112 Jul 14 14:31:06.179290 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 687/1348] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:06.200149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0de7409a-9a29-4277-8ce1-a80a9069be39 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:06.205397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0de7409a-9a29-4277-8ce1-a80a9069be39 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:06.222480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0de7409a-9a29-4277-8ce1-a80a9069be39 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:06.222900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0de7409a-9a29-4277-8ce1-a80a9069be39 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:06.224342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0de7409a-9a29-4277-8ce1-a80a9069be39 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:06.225012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0de7409a-9a29-4277-8ce1-a80a9069be39 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:06.656039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0de7409a-9a29-4277-8ce1-a80a9069be39 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:06.675602 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0de7409a-9a29-4277-8ce1-a80a9069be39 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1461 microversion: 2.1 time: 0.494430 Jul 14 14:31:06.689044 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 688/1349] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:06 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1461 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:06.689044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b4e57ce-0e41-4ae7-bf97-ec5764aca9ea tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:06.700266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b4e57ce-0e41-4ae7-bf97-ec5764aca9ea tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:06.715956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b4e57ce-0e41-4ae7-bf97-ec5764aca9ea tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:06.716427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b4e57ce-0e41-4ae7-bf97-ec5764aca9ea tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:06.729287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b4e57ce-0e41-4ae7-bf97-ec5764aca9ea tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:06.730689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b4e57ce-0e41-4ae7-bf97-ec5764aca9ea tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:06.807588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b4e57ce-0e41-4ae7-bf97-ec5764aca9ea tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:31:06.993894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:07.111423 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b4e57ce-0e41-4ae7-bf97-ec5764aca9ea tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 204 len: 0 microversion: 2.1 time: 0.428634 Jul 14 14:31:07.120136 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 689/1350] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:31:06 2022] DELETE /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:31:07.141336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-259d7010-9d1b-4b8a-b763-862fc1485824 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:07.145098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-259d7010-9d1b-4b8a-b763-862fc1485824 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:07.157383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-259d7010-9d1b-4b8a-b763-862fc1485824 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:07.158368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-259d7010-9d1b-4b8a-b763-862fc1485824 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:07.159412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-259d7010-9d1b-4b8a-b763-862fc1485824 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:07.160075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-259d7010-9d1b-4b8a-b763-862fc1485824 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:07.457437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-259d7010-9d1b-4b8a-b763-862fc1485824 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:07.471674 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-259d7010-9d1b-4b8a-b763-862fc1485824 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1325 microversion: 2.1 time: 0.341985 Jul 14 14:31:07.473853 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 690/1351] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:07 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1325 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:07.483536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3dd9b226-a4f2-4b0a-b75d-71d67786e09d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:07.485902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3dd9b226-a4f2-4b0a-b75d-71d67786e09d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:07.497976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3dd9b226-a4f2-4b0a-b75d-71d67786e09d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:07.498998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3dd9b226-a4f2-4b0a-b75d-71d67786e09d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:07.500427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3dd9b226-a4f2-4b0a-b75d-71d67786e09d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:07.501601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3dd9b226-a4f2-4b0a-b75d-71d67786e09d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:07.796020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3dd9b226-a4f2-4b0a-b75d-71d67786e09d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:07.824605 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3dd9b226-a4f2-4b0a-b75d-71d67786e09d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.348153 Jul 14 14:31:07.827601 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 691/1352] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:07 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:07.848880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ea7c6645-ef2e-4445-b689-0fca442b7b0c tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:07.853567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ea7c6645-ef2e-4445-b689-0fca442b7b0c tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:07.872974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea7c6645-ef2e-4445-b689-0fca442b7b0c tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:07.874822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea7c6645-ef2e-4445-b689-0fca442b7b0c tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:07.877161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea7c6645-ef2e-4445-b689-0fca442b7b0c tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:07.881741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea7c6645-ef2e-4445-b689-0fca442b7b0c tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:08.283608 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ea7c6645-ef2e-4445-b689-0fca442b7b0c tempest-MigrationsAdminTest-682614377 tempest-MigrationsAdminTest-682614377-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1614 microversion: 2.1 time: 0.450479 Jul 14 14:31:08.284211 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 692/1353] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:07 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1614 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:08.297440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-28357069-d370-4fba-8903-746f9fdfbfb8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:08.298332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-28357069-d370-4fba-8903-746f9fdfbfb8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:08.311340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28357069-d370-4fba-8903-746f9fdfbfb8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:08.315012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28357069-d370-4fba-8903-746f9fdfbfb8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:08.316102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28357069-d370-4fba-8903-746f9fdfbfb8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:08.316696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28357069-d370-4fba-8903-746f9fdfbfb8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:08.880992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-28357069-d370-4fba-8903-746f9fdfbfb8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:08.892250 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-28357069-d370-4fba-8903-746f9fdfbfb8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 200 len: 1508 microversion: 2.1 time: 0.606920 Jul 14 14:31:08.913122 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 693/1354] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:08 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 1508 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:08.921155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-76dffaf4-d720-4de0-a2b9-77532906c00f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:08.929630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-76dffaf4-d720-4de0-a2b9-77532906c00f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:08.948633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-76dffaf4-d720-4de0-a2b9-77532906c00f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:08.953192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-76dffaf4-d720-4de0-a2b9-77532906c00f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:08.955767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-76dffaf4-d720-4de0-a2b9-77532906c00f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:08.956783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-76dffaf4-d720-4de0-a2b9-77532906c00f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:09.606817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-76dffaf4-d720-4de0-a2b9-77532906c00f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:09.621679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-76dffaf4-d720-4de0-a2b9-77532906c00f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1322 microversion: 2.1 time: 0.707021 Jul 14 14:31:09.626003 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 694/1355] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:08 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1322 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:09.640452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-d3859cf3-bb7d-4e0e-a667-5ba94dcc95a7 req-b97a76c8-8c21-4230-8ad8-b184587d568d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d38095f-a9b7-4c8a-9f17-242929a4f872", "name": "network-vif-plugged", "status": "completed", "tag": "84ab7c56-5f6b-40e0-a91a-728137d82fba"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:09.668903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d3859cf3-bb7d-4e0e-a667-5ba94dcc95a7 req-b97a76c8-8c21-4230-8ad8-b184587d568d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:09.674303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d3859cf3-bb7d-4e0e-a667-5ba94dcc95a7 req-b97a76c8-8c21-4230-8ad8-b184587d568d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:09.711574 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-d3859cf3-bb7d-4e0e-a667-5ba94dcc95a7 req-b97a76c8-8c21-4230-8ad8-b184587d568d service nova] Creating event network-vif-plugged:84ab7c56-5f6b-40e0-a91a-728137d82fba for instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 on n-h1-767704-28 Jul 14 14:31:09.728654 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-d3859cf3-bb7d-4e0e-a667-5ba94dcc95a7 req-b97a76c8-8c21-4230-8ad8-b184587d568d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096243 Jul 14 14:31:09.729889 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 695/1356] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:09.735394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-83c409c3-7fb8-4b90-9f1c-fee08088c9eb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:09.741064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-83c409c3-7fb8-4b90-9f1c-fee08088c9eb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:09.757465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83c409c3-7fb8-4b90-9f1c-fee08088c9eb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:09.762209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83c409c3-7fb8-4b90-9f1c-fee08088c9eb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:09.780224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83c409c3-7fb8-4b90-9f1c-fee08088c9eb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:09.780705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83c409c3-7fb8-4b90-9f1c-fee08088c9eb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:09.847645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-83c409c3-7fb8-4b90-9f1c-fee08088c9eb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:31:09.985617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:10.000578 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-83c409c3-7fb8-4b90-9f1c-fee08088c9eb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "DELETE /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 204 len: 0 microversion: 2.1 time: 0.269011 Jul 14 14:31:10.001541 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 696/1357] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:31:09 2022] DELETE /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:31:10.009043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e093c56-6e06-48be-af14-b406a1fff31f tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:10.010389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0e093c56-6e06-48be-af14-b406a1fff31f tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:10.018699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e093c56-6e06-48be-af14-b406a1fff31f tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:10.019541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e093c56-6e06-48be-af14-b406a1fff31f tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:10.020806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e093c56-6e06-48be-af14-b406a1fff31f tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:10.021774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e093c56-6e06-48be-af14-b406a1fff31f tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:10.278450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0e093c56-6e06-48be-af14-b406a1fff31f tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:10.287426 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0e093c56-6e06-48be-af14-b406a1fff31f tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1325 microversion: 2.1 time: 0.284156 Jul 14 14:31:10.292215 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 697/1358] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:10 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1325 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:10.303813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5c5efe12-9c43-4ac8-a5db-d9bc2b9ae2ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:10.304341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5c5efe12-9c43-4ac8-a5db-d9bc2b9ae2ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:10.323550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c5efe12-9c43-4ac8-a5db-d9bc2b9ae2ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:10.324029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c5efe12-9c43-4ac8-a5db-d9bc2b9ae2ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:10.324838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c5efe12-9c43-4ac8-a5db-d9bc2b9ae2ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:10.325327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c5efe12-9c43-4ac8-a5db-d9bc2b9ae2ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:10.819134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5c5efe12-9c43-4ac8-a5db-d9bc2b9ae2ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:10.842933 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5c5efe12-9c43-4ac8-a5db-d9bc2b9ae2ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.549047 Jul 14 14:31:10.855704 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 698/1359] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:10 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:10.864122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-25d315ab-4243-4b37-a2fc-90362c4845e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:10.865261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-25d315ab-4243-4b37-a2fc-90362c4845e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:10.872159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25d315ab-4243-4b37-a2fc-90362c4845e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:10.872629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25d315ab-4243-4b37-a2fc-90362c4845e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:10.873462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25d315ab-4243-4b37-a2fc-90362c4845e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:10.874116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25d315ab-4243-4b37-a2fc-90362c4845e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:11.081861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-25d315ab-4243-4b37-a2fc-90362c4845e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:11.092207 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-25d315ab-4243-4b37-a2fc-90362c4845e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 200 len: 1299 microversion: 2.1 time: 0.235274 Jul 14 14:31:11.101814 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 699/1360] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:10 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 1299 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:11.131653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-43a12f1e-f358-49c7-b60e-764c94b33dfe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:11.132322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-43a12f1e-f358-49c7-b60e-764c94b33dfe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:11.151929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43a12f1e-f358-49c7-b60e-764c94b33dfe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:11.157985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43a12f1e-f358-49c7-b60e-764c94b33dfe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:11.161898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43a12f1e-f358-49c7-b60e-764c94b33dfe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:11.168447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43a12f1e-f358-49c7-b60e-764c94b33dfe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:12.122491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-43a12f1e-f358-49c7-b60e-764c94b33dfe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:12.135710 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-43a12f1e-f358-49c7-b60e-764c94b33dfe tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1467 microversion: 2.1 time: 1.030032 Jul 14 14:31:12.140419 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 700/1361] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:11 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1467 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:12.154570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9c29e934-02a7-4d84-b0ee-d54b2d9ccbf9 req-aa236c8c-5b6d-46c8-8bdd-2f3d8e951ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc9d46f-240b-4266-9cbe-5cf98e6378cb", "name": "network-vif-deleted", "tag": "74982656-6d85-4d02-8e85-f8c748be1f2a"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:12.188192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9c29e934-02a7-4d84-b0ee-d54b2d9ccbf9 req-aa236c8c-5b6d-46c8-8bdd-2f3d8e951ae7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:12.189134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9c29e934-02a7-4d84-b0ee-d54b2d9ccbf9 req-aa236c8c-5b6d-46c8-8bdd-2f3d8e951ae7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:12.219881 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9c29e934-02a7-4d84-b0ee-d54b2d9ccbf9 req-aa236c8c-5b6d-46c8-8bdd-2f3d8e951ae7 service nova] Creating event network-vif-deleted:74982656-6d85-4d02-8e85-f8c748be1f2a for instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb on n-h2-767704-28 Jul 14 14:31:12.234624 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9c29e934-02a7-4d84-b0ee-d54b2d9ccbf9 req-aa236c8c-5b6d-46c8-8bdd-2f3d8e951ae7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091384 Jul 14 14:31:12.240432 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 701/1362] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:12.253334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9ce412ca-9280-43c3-9ca8-fb946ecd0e33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:12.254065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9ce412ca-9280-43c3-9ca8-fb946ecd0e33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:12.274026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ce412ca-9280-43c3-9ca8-fb946ecd0e33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:12.275277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ce412ca-9280-43c3-9ca8-fb946ecd0e33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:12.276199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ce412ca-9280-43c3-9ca8-fb946ecd0e33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:12.276664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ce412ca-9280-43c3-9ca8-fb946ecd0e33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:13.116898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9ce412ca-9280-43c3-9ca8-fb946ecd0e33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:13.129913 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9ce412ca-9280-43c3-9ca8-fb946ecd0e33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1322 microversion: 2.1 time: 0.887824 Jul 14 14:31:13.137285 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 702/1363] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:12 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1322 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:13.145152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9e0784d6-c43d-4ecb-97cc-dcdf4604d449 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:13.154363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9e0784d6-c43d-4ecb-97cc-dcdf4604d449 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:13.169598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e0784d6-c43d-4ecb-97cc-dcdf4604d449 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:13.169979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e0784d6-c43d-4ecb-97cc-dcdf4604d449 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:13.181507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e0784d6-c43d-4ecb-97cc-dcdf4604d449 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:13.182382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e0784d6-c43d-4ecb-97cc-dcdf4604d449 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:13.488529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9e0784d6-c43d-4ecb-97cc-dcdf4604d449 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:13.497482 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9e0784d6-c43d-4ecb-97cc-dcdf4604d449 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1522 microversion: 2.1 time: 0.358762 Jul 14 14:31:13.518437 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 703/1364] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:13 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:13.524211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-321bbf60-35f2-4348-8d17-33c1109a7d41 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:13.530114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-321bbf60-35f2-4348-8d17-33c1109a7d41 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:13.550335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-321bbf60-35f2-4348-8d17-33c1109a7d41 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:13.551356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-321bbf60-35f2-4348-8d17-33c1109a7d41 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:13.552331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-321bbf60-35f2-4348-8d17-33c1109a7d41 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:13.559403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-321bbf60-35f2-4348-8d17-33c1109a7d41 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:13.987604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-321bbf60-35f2-4348-8d17-33c1109a7d41 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:13.997841 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-321bbf60-35f2-4348-8d17-33c1109a7d41 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.477869 Jul 14 14:31:14.009041 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 704/1365] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:13 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:14.025414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37459290-0358-47da-84ee-7506afc817c1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:14.039708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-37459290-0358-47da-84ee-7506afc817c1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:14.075075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37459290-0358-47da-84ee-7506afc817c1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.075858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37459290-0358-47da-84ee-7506afc817c1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.076928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37459290-0358-47da-84ee-7506afc817c1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.077635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37459290-0358-47da-84ee-7506afc817c1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.116340 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-37459290-0358-47da-84ee-7506afc817c1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37459290-0358-47da-84ee-7506afc817c1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb HTTP/1.1 Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'dcc9d46f-240b-4266-9cbe-5cf98e6378cb'} Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:14.118669 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:14.123338 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:14.123338 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:14.123338 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:14.123338 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:14.123338 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:14.123338 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:31:14.123338 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:14.125091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37459290-0358-47da-84ee-7506afc817c1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:14.127341 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-37459290-0358-47da-84ee-7506afc817c1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 404 len: 111 microversion: 2.1 time: 0.116623 Jul 14 14:31:14.128473 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 705/1366] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:14 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:31:14.133522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e1879fc7-ac3f-4db7-9296-3f2bcaa1b7dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:14.135553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e1879fc7-ac3f-4db7-9296-3f2bcaa1b7dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:14.142219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1879fc7-ac3f-4db7-9296-3f2bcaa1b7dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.142940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1879fc7-ac3f-4db7-9296-3f2bcaa1b7dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.143899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1879fc7-ac3f-4db7-9296-3f2bcaa1b7dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.144488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1879fc7-ac3f-4db7-9296-3f2bcaa1b7dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.279141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:14.775484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e1879fc7-ac3f-4db7-9296-3f2bcaa1b7dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:14.826750 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e1879fc7-ac3f-4db7-9296-3f2bcaa1b7dd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 200 len: 1467 microversion: 2.1 time: 0.696696 Jul 14 14:31:14.853464 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 706/1367] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:14 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 1467 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:14.893060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d1a0e058-cfb1-4903-a1dc-2664d87fb82b tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:14.894189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d1a0e058-cfb1-4903-a1dc-2664d87fb82b tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:14.908195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1a0e058-cfb1-4903-a1dc-2664d87fb82b tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.908875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1a0e058-cfb1-4903-a1dc-2664d87fb82b tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.909844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1a0e058-cfb1-4903-a1dc-2664d87fb82b tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.912591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1a0e058-cfb1-4903-a1dc-2664d87fb82b tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.984684 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-d1a0e058-cfb1-4903-a1dc-2664d87fb82b tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] HTTP exception thrown: Instance is not a member of specified network Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d1a0e058-cfb1-4903-a1dc-2664d87fb82b tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Request method failure captured: Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4/ips/invalid HTTP/1.1 Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiNYFL-Li72t9m0QvOo37lKxUkS7fdw8T6l7cj-pWKr_V9H-hJbUKwJ-nSjp6ty-TY-vXTxhcJ20b33C6r-V9l3socY-Pr3iaCs-QZdyUvie3rptWIRoeTqt1igj0k1w2lMGfVp1NPZC9berFih254C8IsqPFwU_0aVaWBClZkp3vM Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: c3748377903c4d1a8af40152f327af4d Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1855844241 Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3748377903c4d1a8af40152f327af4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c3748377903c4d1a8af40152f327af4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c3748377903c4d1a8af40152f327af4d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3748377903c4d1a8af40152f327af4d"}]}] Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1855844241 Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: c3748377903c4d1a8af40152f327af4d Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1855844241 Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerAddressesNegativeTestJSON-1855844241-project Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: ce309d94cf624a82aff58ba17a8c81eb Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1855844241-project Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance is not a member of specified network Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'server_id': '4826f2be-ba35-4d31-8ea1-73d42b530dd4', 'id': 'invalid'} Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 14 14:31:14.989481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:14.997215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d1a0e058-cfb1-4903-a1dc-2664d87fb82b tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:14.998279 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d1a0e058-cfb1-4903-a1dc-2664d87fb82b tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.132517 Jul 14 14:31:15.000932 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 707/1368] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:31:14 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4/ips/invalid => generated 91 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:31:15.023129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2c7bb5d4-42b7-4c4c-a932-84aa92e490c9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:15.024155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2c7bb5d4-42b7-4c4c-a932-84aa92e490c9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:15.036356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c7bb5d4-42b7-4c4c-a932-84aa92e490c9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:15.037979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c7bb5d4-42b7-4c4c-a932-84aa92e490c9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:15.039403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c7bb5d4-42b7-4c4c-a932-84aa92e490c9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:15.040183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c7bb5d4-42b7-4c4c-a932-84aa92e490c9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:15.345873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2c7bb5d4-42b7-4c4c-a932-84aa92e490c9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:15.361427 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2c7bb5d4-42b7-4c4c-a932-84aa92e490c9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1472 microversion: 2.1 time: 0.356816 Jul 14 14:31:15.362038 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 708/1369] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:15 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:15.643551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-796601586", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "ae04b1c7-9ca7-4252-9de9-6ca895e5f620"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:17.734118 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0976bfbc-9272-44cf-ba5c-b47fa3308018 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a" status: 200 len: 1423 microversion: 2.1 time: 22.160212 Jul 14 14:31:17.734715 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 662/1370] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:30:55 2022] GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a => generated 1423 bytes in 22161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:17.741778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-596b90f9-af67-4460-9da1-2f1fac044692 req-554c1bbc-5d2d-4873-813d-02d836f8eedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10e43da-f4f0-41c8-99db-efd48a91831a", "name": "network-vif-unplugged", "status": "completed", "tag": "bed3679e-8d64-4a5b-8ef3-bdcc56c88383"}, {"name": "network-changed", "server_uuid": "e10e43da-f4f0-41c8-99db-efd48a91831a", "tag": "bed3679e-8d64-4a5b-8ef3-bdcc56c88383"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:17.744802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] validate_networks() for [('ae04b1c7-9ca7-4252-9de9-6ca895e5f620', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:31:17.749562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-596b90f9-af67-4460-9da1-2f1fac044692 req-554c1bbc-5d2d-4873-813d-02d836f8eedd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:17.750015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-596b90f9-af67-4460-9da1-2f1fac044692 req-554c1bbc-5d2d-4873-813d-02d836f8eedd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:17.762561 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-596b90f9-af67-4460-9da1-2f1fac044692 req-554c1bbc-5d2d-4873-813d-02d836f8eedd service nova] Creating event network-vif-unplugged:bed3679e-8d64-4a5b-8ef3-bdcc56c88383 for instance e10e43da-f4f0-41c8-99db-efd48a91831a on n-h1-767704-28 Jul 14 14:31:17.763066 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-596b90f9-af67-4460-9da1-2f1fac044692 req-554c1bbc-5d2d-4873-813d-02d836f8eedd service nova] Creating event network-changed:bed3679e-8d64-4a5b-8ef3-bdcc56c88383 for instance e10e43da-f4f0-41c8-99db-efd48a91831a on n-h1-767704-28 Jul 14 14:31:17.768380 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-596b90f9-af67-4460-9da1-2f1fac044692 req-554c1bbc-5d2d-4873-813d-02d836f8eedd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.032466 Jul 14 14:31:17.769362 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 663/1371] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:17.775798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1086226857", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "e15a1c98-dd72-4729-94f4-9ad8a53d679a"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:17.833116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] validate_networks() for [('e15a1c98-dd72-4729-94f4-9ad8a53d679a', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:31:18.580339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:31:18.580983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:31:18.581791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:31:18.582496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:31:18.583216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:31:18.616469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:18.617270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:18.619163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:18.619890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:18.641532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:31:18.642195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:31:18.643021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:31:18.643677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:31:18.644356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:31:18.678920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:18.679605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:18.685641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:18.686453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:18.701746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Getting quotas for project 613f5ab64c38455dad4973c1c974e87f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:31:18.725270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Getting quotas for user 30626a18f38d467da445eaa2b56faf5e and project 613f5ab64c38455dad4973c1c974e87f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:31:18.756395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:31:18.759437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:31:18.761361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:31:18.771588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for user d56c219e943b4398bea8add8299df84f and project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:31:18.813450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:31:18.818793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:31:18.895586 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-326f9c33-7fdc-4747-aec4-b700c514e3e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.532421 Jul 14 14:31:18.906438 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 709/1372] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:31:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:31:18.911427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f08d3cc1-dfcc-433d-814d-0e124cca1db3 req-55aee4ff-ae63-4aca-a02f-e23e851036a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a0d92d-ba81-48f5-aa28-a62a0026c47a", "name": "network-vif-deleted", "tag": "dfbfc888-8b45-4b44-b669-8df623f935de"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:18.942269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f08d3cc1-dfcc-433d-814d-0e124cca1db3 req-55aee4ff-ae63-4aca-a02f-e23e851036a0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:18.943448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f08d3cc1-dfcc-433d-814d-0e124cca1db3 req-55aee4ff-ae63-4aca-a02f-e23e851036a0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:18.951377 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-71a3d367-1b9e-4231-ab6a-f9afb9e40da8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.180467 Jul 14 14:31:18.954090 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 664/1373] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:31:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:31:18.972769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-14109342-cbb3-4d2c-a7a2-d5cd0a1f89d6 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:18.974439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-14109342-cbb3-4d2c-a7a2-d5cd0a1f89d6 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Failed to fetch instance by id 999 {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 14:31:18.975790 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-14109342-cbb3-4d2c-a7a2-d5cd0a1f89d6 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] HTTP exception thrown: Instance 999 could not be found. Jul 14 14:31:18.976081 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f08d3cc1-dfcc-433d-814d-0e124cca1db3 req-55aee4ff-ae63-4aca-a02f-e23e851036a0 service nova] Creating event network-vif-deleted:dfbfc888-8b45-4b44-b669-8df623f935de for instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a on n-h1-767704-28 Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-14109342-cbb3-4d2c-a7a2-d5cd0a1f89d6 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Request method failure captured: Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CiNYFL-Li72t9m0QvOo37lKxUkS7fdw8T6l7cj-pWKr_V9H-hJbUKwJ-nSjp6ty-TY-vXTxhcJ20b33C6r-V9l3socY-Pr3iaCs-QZdyUvie3rptWIRoeTqt1igj0k1w2lMGfVp1NPZC9berFih254C8IsqPFwU_0aVaWBClZkp3vM Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: c3748377903c4d1a8af40152f327af4d Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1855844241 Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3748377903c4d1a8af40152f327af4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c3748377903c4d1a8af40152f327af4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c3748377903c4d1a8af40152f327af4d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3748377903c4d1a8af40152f327af4d"}]}] Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1855844241 Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: c3748377903c4d1a8af40152f327af4d Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1855844241 Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerAddressesNegativeTestJSON-1855844241-project Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: ce309d94cf624a82aff58ba17a8c81eb Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1855844241-project Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 999 could not be found. Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'server_id': '999'} Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 14 14:31:18.980734 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:18.988294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-14109342-cbb3-4d2c-a7a2-d5cd0a1f89d6 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:18.989300 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-14109342-cbb3-4d2c-a7a2-d5cd0a1f89d6 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.033438 Jul 14 14:31:18.990432 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 665/1374] 10.222.0.81 () {58 vars in 1148 bytes} [Thu Jul 14 14:31:18 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:31:18.996458 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f08d3cc1-dfcc-433d-814d-0e124cca1db3 req-55aee4ff-ae63-4aca-a02f-e23e851036a0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088367 Jul 14 14:31:18.996884 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 710/1375] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:18.997475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-13f9d454-c9c0-4367-96b8-cfc94d504155 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:18.998346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-13f9d454-c9c0-4367-96b8-cfc94d504155 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:19.012403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13f9d454-c9c0-4367-96b8-cfc94d504155 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.012893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c8f9e61e-c212-4a99-936e-62c7b531277c tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:19.013534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13f9d454-c9c0-4367-96b8-cfc94d504155 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.014541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13f9d454-c9c0-4367-96b8-cfc94d504155 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.015147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13f9d454-c9c0-4367-96b8-cfc94d504155 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.034772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c8f9e61e-c212-4a99-936e-62c7b531277c tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:19.056885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8f9e61e-c212-4a99-936e-62c7b531277c tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.057979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8f9e61e-c212-4a99-936e-62c7b531277c tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.059138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8f9e61e-c212-4a99-936e-62c7b531277c tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.059832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8f9e61e-c212-4a99-936e-62c7b531277c tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.151365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-c8f9e61e-c212-4a99-936e-62c7b531277c tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lazy-loading 'flavor' on Instance uuid 7d38095f-a9b7-4c8a-9f17-242929a4f872 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:31:19.336036 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c8f9e61e-c212-4a99-936e-62c7b531277c tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872/action" status: 202 len: 0 microversion: 2.1 time: 0.335396 Jul 14 14:31:19.336910 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 711/1376] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:31:18 2022] POST /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:31:19.345403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-13f9d454-c9c0-4367-96b8-cfc94d504155 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:19.347459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-edf929fd-4fa4-4dbe-93bb-118d935c7024 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:19.350925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-edf929fd-4fa4-4dbe-93bb-118d935c7024 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 25a0d92d-ba81-48f5-aa28-a62a0026c47a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:19.359730 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-13f9d454-c9c0-4367-96b8-cfc94d504155 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.366035 Jul 14 14:31:19.360884 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 666/1377] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:18 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:19.365628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-edf929fd-4fa4-4dbe-93bb-118d935c7024 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.366866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-077acbd1-c0cc-4659-85c3-be78a673f539 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c56ad5e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:19.367384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-edf929fd-4fa4-4dbe-93bb-118d935c7024 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.372696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-edf929fd-4fa4-4dbe-93bb-118d935c7024 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.372696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-edf929fd-4fa4-4dbe-93bb-118d935c7024 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.407195 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-edf929fd-4fa4-4dbe-93bb-118d935c7024 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] HTTP exception thrown: Instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a could not be found. Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-edf929fd-4fa4-4dbe-93bb-118d935c7024 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Request method failure captured: Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a HTTP/1.1 Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdllXQ_Xcz2pbg_E7L4-lZMrYp8Wk2QAfMsXdraRMi4Lq0jHqZcZm-5BFT0INS67I8K3S7HyFA6b1NwSw8Y4qR7uTG195XUOYYtvGzCEpptrAKNggIQdEZ7N0OqXBO7tSbOh0b0SWjNTiBhAiyUgZP9ePsuXkpOSXvTBUk7ZdR8hnM Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: c3e95b24eb1b4f9fbc5eb6f4d6f3d308 Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-MigrationsAdminTest-219629006 Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3e95b24eb1b4f9fbc5eb6f4d6f3d308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c3e95b24eb1b4f9fbc5eb6f4d6f3d308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c3e95b24eb1b4f9fbc5eb6f4d6f3d308", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3e95b24eb1b4f9fbc5eb6f4d6f3d308"}]}] Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-MigrationsAdminTest-219629006 Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: c3e95b24eb1b4f9fbc5eb6f4d6f3d308 Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-MigrationsAdminTest-219629006 Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-MigrationsAdminTest-219629006-project Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 89894c4d380a4632870ebcb10a2ffe81 Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-MigrationsAdminTest-219629006-project Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a could not be found. Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '25a0d92d-ba81-48f5-aa28-a62a0026c47a'} Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a could not be found. Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a could not be found. Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:19.409013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:19.414066 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:19.414066 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:19.414066 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:19.414066 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:19.414066 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:19.414066 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a could not be found. Jul 14 14:31:19.414066 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:19.416160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-edf929fd-4fa4-4dbe-93bb-118d935c7024 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Returning 404 to user: Instance 25a0d92d-ba81-48f5-aa28-a62a0026c47a could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:19.417480 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-edf929fd-4fa4-4dbe-93bb-118d935c7024 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a" status: 404 len: 111 microversion: 2.1 time: 0.077863 Jul 14 14:31:19.418629 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 712/1378] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:19 2022] GET /compute/v2.1/servers/25a0d92d-ba81-48f5-aa28-a62a0026c47a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:31:19.424109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3315c41d-2c16-48a2-bb9e-660181a6d32e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:19.425037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3315c41d-2c16-48a2-bb9e-660181a6d32e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:19.492831 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-077acbd1-c0cc-4659-85c3-be78a673f539 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a" status: 200 len: 1423 microversion: 2.1 time: 0.129120 Jul 14 14:31:19.501549 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 667/1379] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:31:19 2022] GET /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a => generated 1423 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:19.506428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-64d1ed12-e9ba-40d3-a6f9-c30a4c9393d1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:19.507396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-64d1ed12-e9ba-40d3-a6f9-c30a4c9393d1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:19.512680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3315c41d-2c16-48a2-bb9e-660181a6d32e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:19.521918 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3315c41d-2c16-48a2-bb9e-660181a6d32e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1223 microversion: 2.1 time: 0.101716 Jul 14 14:31:19.523588 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 713/1380] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:19 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:19.528736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8afb063-2f15-4e56-a909-d27b792afb0e tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:19.529501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8afb063-2f15-4e56-a909-d27b792afb0e tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:19.537660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8afb063-2f15-4e56-a909-d27b792afb0e tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.538109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8afb063-2f15-4e56-a909-d27b792afb0e tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.538985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8afb063-2f15-4e56-a909-d27b792afb0e tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.539535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8afb063-2f15-4e56-a909-d27b792afb0e tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.572024 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8afb063-2f15-4e56-a909-d27b792afb0e tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:31:19.632843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-64d1ed12-e9ba-40d3-a6f9-c30a4c9393d1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:19.648743 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-64d1ed12-e9ba-40d3-a6f9-c30a4c9393d1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1215 microversion: 2.1 time: 0.151024 Jul 14 14:31:19.652307 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 668/1381] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:19 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:19.667807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8c879b7a-c93a-48dd-9979-496279151077 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:19.669514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8c879b7a-c93a-48dd-9979-496279151077 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:19.686286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c879b7a-c93a-48dd-9979-496279151077 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.686792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c879b7a-c93a-48dd-9979-496279151077 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.687699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c879b7a-c93a-48dd-9979-496279151077 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.688151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c879b7a-c93a-48dd-9979-496279151077 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.777677 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8afb063-2f15-4e56-a909-d27b792afb0e tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 204 len: 0 microversion: 2.1 time: 0.251492 Jul 14 14:31:19.780343 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 714/1382] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:31:19 2022] DELETE /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:31:19.791078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-687aac97-bf52-44ca-9dc3-bea66a89b9e9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:19.791687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-687aac97-bf52-44ca-9dc3-bea66a89b9e9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:19.808452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-687aac97-bf52-44ca-9dc3-bea66a89b9e9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.809285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-687aac97-bf52-44ca-9dc3-bea66a89b9e9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.811717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-687aac97-bf52-44ca-9dc3-bea66a89b9e9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.812731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-687aac97-bf52-44ca-9dc3-bea66a89b9e9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.929485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-687aac97-bf52-44ca-9dc3-bea66a89b9e9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:31:20.086298 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-687aac97-bf52-44ca-9dc3-bea66a89b9e9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "DELETE /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 204 len: 0 microversion: 2.1 time: 0.303777 Jul 14 14:31:20.086971 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 715/1383] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:31:19 2022] DELETE /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:31:20.093199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9b1fcf4-abbb-4e40-998c-d30c1208d8d9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5a67ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:20.193740 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8c879b7a-c93a-48dd-9979-496279151077 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1633 microversion: 2.1 time: 0.540206 Jul 14 14:31:20.197306 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 669/1384] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:19 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1633 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:20.202553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a1e57dd2-a08b-452a-b32b-615e3716ed2c tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:20.203171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a1e57dd2-a08b-452a-b32b-615e3716ed2c tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:20.213575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1e57dd2-a08b-452a-b32b-615e3716ed2c tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:20.214319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1e57dd2-a08b-452a-b32b-615e3716ed2c tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:20.215369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1e57dd2-a08b-452a-b32b-615e3716ed2c tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:20.216906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1e57dd2-a08b-452a-b32b-615e3716ed2c tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:20.402568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a1e57dd2-a08b-452a-b32b-615e3716ed2c tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:20.413032 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a1e57dd2-a08b-452a-b32b-615e3716ed2c tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1528 microversion: 2.1 time: 0.214350 Jul 14 14:31:20.420045 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 670/1385] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:20 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1528 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:20.436355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2097807b-32fe-47a5-b077-0ebe24411bdc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:20.438997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2097807b-32fe-47a5-b077-0ebe24411bdc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:20.464055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2097807b-32fe-47a5-b077-0ebe24411bdc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:20.464867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2097807b-32fe-47a5-b077-0ebe24411bdc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:20.470215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2097807b-32fe-47a5-b077-0ebe24411bdc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:20.470966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2097807b-32fe-47a5-b077-0ebe24411bdc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:20.750548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2097807b-32fe-47a5-b077-0ebe24411bdc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:20.766553 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2097807b-32fe-47a5-b077-0ebe24411bdc tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1535 microversion: 2.1 time: 0.336285 Jul 14 14:31:20.767154 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 671/1386] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:20 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1535 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:20.775803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-221f6e99-bc04-4848-9f8d-ee40bfdf60ca tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:20.776423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-221f6e99-bc04-4848-9f8d-ee40bfdf60ca tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:20.807197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-221f6e99-bc04-4848-9f8d-ee40bfdf60ca tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:20.807662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-221f6e99-bc04-4848-9f8d-ee40bfdf60ca tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:20.810587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-221f6e99-bc04-4848-9f8d-ee40bfdf60ca tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:20.811040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-221f6e99-bc04-4848-9f8d-ee40bfdf60ca tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.075288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-221f6e99-bc04-4848-9f8d-ee40bfdf60ca tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:21.088635 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-221f6e99-bc04-4848-9f8d-ee40bfdf60ca tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.320123 Jul 14 14:31:21.090788 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 672/1387] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:20 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:21.096074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-487f71c7-4831-499a-b3b2-8367fa055ff6 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:21.097088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-487f71c7-4831-499a-b3b2-8367fa055ff6 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:21.110396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-487f71c7-4831-499a-b3b2-8367fa055ff6 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.111067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-487f71c7-4831-499a-b3b2-8367fa055ff6 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.111945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-487f71c7-4831-499a-b3b2-8367fa055ff6 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.112496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-487f71c7-4831-499a-b3b2-8367fa055ff6 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.136844 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b9b1fcf4-abbb-4e40-998c-d30c1208d8d9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a" status: 204 len: 0 microversion: 2.1 time: 1.048301 Jul 14 14:31:21.138364 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 716/1388] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:20 2022] DELETE /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:31:21.143828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7e49de6d-b265-4a5e-91ba-9ccf3071270a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:21.145132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7e49de6d-b265-4a5e-91ba-9ccf3071270a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:21.155822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e49de6d-b265-4a5e-91ba-9ccf3071270a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.156281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e49de6d-b265-4a5e-91ba-9ccf3071270a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.157127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e49de6d-b265-4a5e-91ba-9ccf3071270a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.157573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e49de6d-b265-4a5e-91ba-9ccf3071270a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.191054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-487f71c7-4831-499a-b3b2-8367fa055ff6 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:21.203126 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-487f71c7-4831-499a-b3b2-8367fa055ff6 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1227 microversion: 2.1 time: 0.109980 Jul 14 14:31:21.205535 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 673/1389] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:21 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1227 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:21.212180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-38ac2d6e-d53f-413f-a7d7-248ef7c0ed2c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:21.213915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-38ac2d6e-d53f-413f-a7d7-248ef7c0ed2c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:21.221005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38ac2d6e-d53f-413f-a7d7-248ef7c0ed2c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.224009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38ac2d6e-d53f-413f-a7d7-248ef7c0ed2c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.229127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38ac2d6e-d53f-413f-a7d7-248ef7c0ed2c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.231204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38ac2d6e-d53f-413f-a7d7-248ef7c0ed2c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.247472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7e49de6d-b265-4a5e-91ba-9ccf3071270a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:21.258331 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7e49de6d-b265-4a5e-91ba-9ccf3071270a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1211 microversion: 2.1 time: 0.118692 Jul 14 14:31:21.259690 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 717/1390] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:21 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:21.265596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cdc3043f-3855-4431-ac9b-b021c5fa9b9e tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:21.266467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cdc3043f-3855-4431-ac9b-b021c5fa9b9e tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:21.276543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdc3043f-3855-4431-ac9b-b021c5fa9b9e tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.277350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdc3043f-3855-4431-ac9b-b021c5fa9b9e tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.278771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdc3043f-3855-4431-ac9b-b021c5fa9b9e tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.279512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdc3043f-3855-4431-ac9b-b021c5fa9b9e tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.293335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-38ac2d6e-d53f-413f-a7d7-248ef7c0ed2c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:31:21.409158 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-38ac2d6e-d53f-413f-a7d7-248ef7c0ed2c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 204 len: 0 microversion: 2.1 time: 0.201869 Jul 14 14:31:21.410798 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 674/1391] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:31:21 2022] DELETE /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:31:21.437138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b1aff1a1-39c0-4df2-88d7-e0d36b41bf19 req-5a7ac5cb-df8e-4abb-b4a2-d943da57ed04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc69728d-ad31-4750-a7e2-ef09d6dd3686", "name": "network-vif-unplugged", "status": "completed", "tag": "4b7a1348-79bc-4d4e-8c50-0bfe89eac4b1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:21.462871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b1aff1a1-39c0-4df2-88d7-e0d36b41bf19 req-5a7ac5cb-df8e-4abb-b4a2-d943da57ed04 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.463380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b1aff1a1-39c0-4df2-88d7-e0d36b41bf19 req-5a7ac5cb-df8e-4abb-b4a2-d943da57ed04 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.502739 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b1aff1a1-39c0-4df2-88d7-e0d36b41bf19 req-5a7ac5cb-df8e-4abb-b4a2-d943da57ed04 service nova] Creating event network-vif-unplugged:4b7a1348-79bc-4d4e-8c50-0bfe89eac4b1 for instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 on n-h2-767704-28 Jul 14 14:31:21.510500 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b1aff1a1-39c0-4df2-88d7-e0d36b41bf19 req-5a7ac5cb-df8e-4abb-b4a2-d943da57ed04 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097974 Jul 14 14:31:21.528452 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 675/1392] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:21.535340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6885b26-6d5a-4b55-b136-4305321530b1 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:21.536040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b6885b26-6d5a-4b55-b136-4305321530b1 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:21.543497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6885b26-6d5a-4b55-b136-4305321530b1 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.544044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6885b26-6d5a-4b55-b136-4305321530b1 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.544845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6885b26-6d5a-4b55-b136-4305321530b1 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.545503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6885b26-6d5a-4b55-b136-4305321530b1 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.659870 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cdc3043f-3855-4431-ac9b-b021c5fa9b9e tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1616 microversion: 2.1 time: 0.398650 Jul 14 14:31:21.661224 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 718/1393] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:21 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1616 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:21.667845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-249920265", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "6b253de3-a05b-4108-8629-b3ed951903ff"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:21.753110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] validate_networks() for [('6b253de3-a05b-4108-8629-b3ed951903ff', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:31:21.778418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b6885b26-6d5a-4b55-b136-4305321530b1 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:21.787215 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b6885b26-6d5a-4b55-b136-4305321530b1 tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1528 microversion: 2.1 time: 0.257239 Jul 14 14:31:21.790777 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 676/1394] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:21 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1528 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:21.813640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98e98b6f-dfbe-4210-a060-f75dd3eb7c08 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:21.814517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-98e98b6f-dfbe-4210-a060-f75dd3eb7c08 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:21.834052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98e98b6f-dfbe-4210-a060-f75dd3eb7c08 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.834775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98e98b6f-dfbe-4210-a060-f75dd3eb7c08 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.835811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98e98b6f-dfbe-4210-a060-f75dd3eb7c08 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.836461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98e98b6f-dfbe-4210-a060-f75dd3eb7c08 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.884858 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-98e98b6f-dfbe-4210-a060-f75dd3eb7c08 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] HTTP exception thrown: Cannot 'migrate' instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 while it is in vm_state suspended Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98e98b6f-dfbe-4210-a060-f75dd3eb7c08 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Request method failure captured: Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872/action HTTP/1.1 Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 15 Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch36jowuSiMbYmQQiQ3rZa3pCC0vI0CE8syh3MelmwOtWFTAfkIjK1IX-NtXBWzr42SRgQ4Ch2Iv4ppUTnoePgZWTfMh-2tXNGKc1A6skb3uOEBWK5GdLmg4Ne9dbs38-mSaOXHXjRshfS2R3DaJS-DP-dj7aM94ZvaJrYQvQ4Dlw0 Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 05639a0fb04b4e65b3f03d9335424149 Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/05639a0fb04b4e65b3f03d9335424149"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/05639a0fb04b4e65b3f03d9335424149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_05639a0fb04b4e65b3f03d9335424149", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/05639a0fb04b4e65b3f03d9335424149"}]}] Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 05639a0fb04b4e65b3f03d9335424149 Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersAdminNegativeTestJSON-538382369-project-admin Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4a9afae9525e42abada4a3f1b38b2034 Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersAdminNegativeTestJSON-538382369-project-admin Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: {"migrate": {}} Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: exception: Cannot 'migrate' instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 while it is in vm_state suspended Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '7d38095f-a9b7-4c8a-9f17-242929a4f872', 'body': {'migrate': {}}} Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 in vm_state suspended. Cannot resize while the instance is in this state. Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:21.888526 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 while it is in vm_state suspended Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 while it is in vm_state suspended Jul 14 14:31:21.893044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:21.905674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98e98b6f-dfbe-4210-a060-f75dd3eb7c08 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Returning 409 to user: Cannot 'migrate' instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 while it is in vm_state suspended {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:21.917587 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98e98b6f-dfbe-4210-a060-f75dd3eb7c08 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872/action" status: 409 len: 148 microversion: 2.1 time: 0.114573 Jul 14 14:31:21.918482 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 677/1395] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:31:21 2022] POST /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872/action => generated 148 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:31:21.929098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-74cd702f-0841-4f9e-ae34-b138212fcd7e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:21.930041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-74cd702f-0841-4f9e-ae34-b138212fcd7e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:21.945521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74cd702f-0841-4f9e-ae34-b138212fcd7e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.946374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74cd702f-0841-4f9e-ae34-b138212fcd7e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.947352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74cd702f-0841-4f9e-ae34-b138212fcd7e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.947956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74cd702f-0841-4f9e-ae34-b138212fcd7e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:22.257996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-74cd702f-0841-4f9e-ae34-b138212fcd7e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:22.267012 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-74cd702f-0841-4f9e-ae34-b138212fcd7e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1535 microversion: 2.1 time: 0.341863 Jul 14 14:31:22.280211 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 678/1396] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:21 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1535 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:22.310969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d2c7824-a9aa-4709-afca-08cbf181a83e tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d2c7824-a9aa-4709-afca-08cbf181a83e tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Request method failure captured: Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783/action HTTP/1.1 Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 39 Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch36jowuSiMbYmQQiQ3rZa3pCC0vI0CE8syh3MelmwOtWFTAfkIjK1IX-NtXBWzr42SRgQ4Ch2Iv4ppUTnoePgZWTfMh-2tXNGKc1A6skb3uOEBWK5GdLmg4Ne9dbs38-mSaOXHXjRshfS2R3DaJS-DP-dj7aM94ZvaJrYQvQ4Dlw0 Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 05639a0fb04b4e65b3f03d9335424149 Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/05639a0fb04b4e65b3f03d9335424149"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/05639a0fb04b4e65b3f03d9335424149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_05639a0fb04b4e65b3f03d9335424149", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/05639a0fb04b4e65b3f03d9335424149"}]}] Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 05639a0fb04b4e65b3f03d9335424149 Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersAdminNegativeTestJSON-538382369-project-admin Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4a9afae9525e42abada4a3f1b38b2034 Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersAdminNegativeTestJSON-538382369-project-admin Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: {"os-resetState": {"state": "invalid"}} Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '343f561f-285d-4c5f-a036-3506d7898783', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'invalid' Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:31:22.314213 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:31:22.318968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 14 14:31:22.318968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:22.318968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:22.318968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:22.318968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:22.318968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:22.318968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:22.318968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:31:22.318968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:31:22.318968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 14 14:31:22.318968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:22.327141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d2c7824-a9aa-4709-afca-08cbf181a83e tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:22.333162 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0d2c7824-a9aa-4709-afca-08cbf181a83e tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783/action" status: 400 len: 144 microversion: 2.1 time: 0.050107 Jul 14 14:31:22.336125 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 679/1397] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:31:22 2022] POST /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783/action => generated 144 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:31:22.349492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b2b7245e-0b88-47f2-9822-b0a58e44e8d9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:22.357408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b2b7245e-0b88-47f2-9822-b0a58e44e8d9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:22.398465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2b7245e-0b88-47f2-9822-b0a58e44e8d9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:22.400966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2b7245e-0b88-47f2-9822-b0a58e44e8d9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:22.402054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2b7245e-0b88-47f2-9822-b0a58e44e8d9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:22.402452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2b7245e-0b88-47f2-9822-b0a58e44e8d9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:22.662652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:31:22.663186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:31:22.664857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:31:22.665730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:31:22.666389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:31:22.707816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:22.708760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:22.709829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:22.714188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:22.792292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Getting quotas for project 3755ed287bff4882ac3ead9acadfa731. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:31:22.829656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Getting quotas for user 31ab545bcb3a47b38c53fbfa6b11a432 and project 3755ed287bff4882ac3ead9acadfa731. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:31:22.927662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:31:22.942621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:31:23.109995 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fba3cca9-5b15-47dc-a945-c1bb236b3145 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.447353 Jul 14 14:31:23.125548 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 719/1398] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:31:23.150996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e923796a-6853-4092-bd0e-7001ee13c318 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:23.151662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e923796a-6853-4092-bd0e-7001ee13c318 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:23.168710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e923796a-6853-4092-bd0e-7001ee13c318 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:23.178079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e923796a-6853-4092-bd0e-7001ee13c318 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:23.179223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e923796a-6853-4092-bd0e-7001ee13c318 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:23.179850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e923796a-6853-4092-bd0e-7001ee13c318 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:23.863238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e923796a-6853-4092-bd0e-7001ee13c318 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:23.892810 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e923796a-6853-4092-bd0e-7001ee13c318 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1281 microversion: 2.1 time: 0.764503 Jul 14 14:31:23.893460 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 720/1399] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:23 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1281 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:23.908483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-16ca33c6-3f9b-4ded-b61f-f4a1880e48ba tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:23.909394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-16ca33c6-3f9b-4ded-b61f-f4a1880e48ba tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:23.928513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16ca33c6-3f9b-4ded-b61f-f4a1880e48ba tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:23.929340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16ca33c6-3f9b-4ded-b61f-f4a1880e48ba tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:23.930319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16ca33c6-3f9b-4ded-b61f-f4a1880e48ba tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:23.931495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16ca33c6-3f9b-4ded-b61f-f4a1880e48ba tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:24.527350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b2b7245e-0b88-47f2-9822-b0a58e44e8d9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:24.544129 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b2b7245e-0b88-47f2-9822-b0a58e44e8d9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 2.202673 Jul 14 14:31:24.547802 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 680/1400] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:22 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:24.560709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d6ab9799-cf42-4c53-bd88-db441b7268cc tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d6ab9799-cf42-4c53-bd88-db441b7268cc tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Request method failure captured: Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783/action HTTP/1.1 Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 31 Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch36jowuSiMbYmQQiQ3rZa3pCC0vI0CE8syh3MelmwOtWFTAfkIjK1IX-NtXBWzr42SRgQ4Ch2Iv4ppUTnoePgZWTfMh-2tXNGKc1A6skb3uOEBWK5GdLmg4Ne9dbs38-mSaOXHXjRshfS2R3DaJS-DP-dj7aM94ZvaJrYQvQ4Dlw0 Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 05639a0fb04b4e65b3f03d9335424149 Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/05639a0fb04b4e65b3f03d9335424149"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/05639a0fb04b4e65b3f03d9335424149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_05639a0fb04b4e65b3f03d9335424149", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/05639a0fb04b4e65b3f03d9335424149"}]}] Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 05639a0fb04b4e65b3f03d9335424149 Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersAdminNegativeTestJSON-538382369-project-admin Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4a9afae9525e42abada4a3f1b38b2034 Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersAdminNegativeTestJSON-538382369-project-admin Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: {"os-resetState": {"state": 1}} Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '343f561f-285d-4c5f-a036-3506d7898783', 'body': {'os-resetState': {'state': 1}}} Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 1 Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 14 14:31:24.568541 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:24.575118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:24.575118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:24.575118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:24.575118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:24.575118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:24.575118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:31:24.575118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:31:24.575118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 14 14:31:24.575118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:24.577579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d6ab9799-cf42-4c53-bd88-db441b7268cc tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:24.578720 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d6ab9799-cf42-4c53-bd88-db441b7268cc tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783/action" status: 400 len: 120 microversion: 2.1 time: 0.028496 Jul 14 14:31:24.579901 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 681/1401] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:31:24 2022] POST /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783/action => generated 120 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:31:24.585495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-861bc95b-9548-4a1a-8a99-3d27abc1e0af tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:24.586827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-861bc95b-9548-4a1a-8a99-3d27abc1e0af tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:24.614963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-861bc95b-9548-4a1a-8a99-3d27abc1e0af tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:24.616704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-861bc95b-9548-4a1a-8a99-3d27abc1e0af tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:24.618378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-861bc95b-9548-4a1a-8a99-3d27abc1e0af tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:24.619038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-861bc95b-9548-4a1a-8a99-3d27abc1e0af tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:24.771638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-16ca33c6-3f9b-4ded-b61f-f4a1880e48ba tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:24.787859 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-16ca33c6-3f9b-4ded-b61f-f4a1880e48ba tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1273 microversion: 2.1 time: 0.885428 Jul 14 14:31:24.792475 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 721/1402] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:23 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1273 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:24.797764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f25589b-6503-4afe-a4fe-4a7f0f402b01 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:24.807180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3f25589b-6503-4afe-a4fe-4a7f0f402b01 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:24.833690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f25589b-6503-4afe-a4fe-4a7f0f402b01 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:24.834151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f25589b-6503-4afe-a4fe-4a7f0f402b01 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:24.841313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f25589b-6503-4afe-a4fe-4a7f0f402b01 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:24.842055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f25589b-6503-4afe-a4fe-4a7f0f402b01 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.014293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-861bc95b-9548-4a1a-8a99-3d27abc1e0af tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce309d94cf624a82aff58ba17a8c81eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3748377903c4d1a8af40152f327af4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:25.031368 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-861bc95b-9548-4a1a-8a99-3d27abc1e0af tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 200 len: 1486 microversion: 2.1 time: 0.449910 Jul 14 14:31:25.044987 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 682/1403] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:24 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 1486 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:25.052994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6860be11-df7b-4098-a8ba-4974598a04bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:25.052994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6860be11-df7b-4098-a8ba-4974598a04bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:25.065500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6860be11-df7b-4098-a8ba-4974598a04bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.070963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6860be11-df7b-4098-a8ba-4974598a04bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.073933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6860be11-df7b-4098-a8ba-4974598a04bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.074402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6860be11-df7b-4098-a8ba-4974598a04bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.388244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3f25589b-6503-4afe-a4fe-4a7f0f402b01 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:25.403144 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f25589b-6503-4afe-a4fe-4a7f0f402b01 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1259 microversion: 2.1 time: 0.609202 Jul 14 14:31:25.405818 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 722/1404] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:24 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1259 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:25.415080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b2907e66-8d29-445a-9f4d-35ec31f5544f req-291c9568-dbc5-4b04-8ccb-f109055ee515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10e43da-f4f0-41c8-99db-efd48a91831a", "name": "network-vif-unplugged", "status": "completed", "tag": "bed3679e-8d64-4a5b-8ef3-bdcc56c88383"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:25.441370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b2907e66-8d29-445a-9f4d-35ec31f5544f req-291c9568-dbc5-4b04-8ccb-f109055ee515 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.442196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b2907e66-8d29-445a-9f4d-35ec31f5544f req-291c9568-dbc5-4b04-8ccb-f109055ee515 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.466936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:25.471999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6860be11-df7b-4098-a8ba-4974598a04bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:25.491923 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b2907e66-8d29-445a-9f4d-35ec31f5544f req-291c9568-dbc5-4b04-8ccb-f109055ee515 service nova] Creating event network-vif-unplugged:bed3679e-8d64-4a5b-8ef3-bdcc56c88383 for instance e10e43da-f4f0-41c8-99db-efd48a91831a on n-h1-767704-28 Jul 14 14:31:25.495615 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6860be11-df7b-4098-a8ba-4974598a04bb tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1493 microversion: 2.1 time: 0.454754 Jul 14 14:31:25.499351 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 683/1405] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:25 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1493 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:25.511954 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b2907e66-8d29-445a-9f4d-35ec31f5544f req-291c9568-dbc5-4b04-8ccb-f109055ee515 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104826 Jul 14 14:31:25.512657 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 723/1406] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:25.522967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bd27c759-480d-422e-b321-763aafc60da7 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:25.529864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bd27c759-480d-422e-b321-763aafc60da7 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Failed to fetch instance by id 999 {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 14:31:25.531320 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-bd27c759-480d-422e-b321-763aafc60da7 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bd27c759-480d-422e-b321-763aafc60da7 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Request method failure captured: Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 37 Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch36jowuSiMbYmQQiQ3rZa3pCC0vI0CE8syh3MelmwOtWFTAfkIjK1IX-NtXBWzr42SRgQ4Ch2Iv4ppUTnoePgZWTfMh-2tXNGKc1A6skb3uOEBWK5GdLmg4Ne9dbs38-mSaOXHXjRshfS2R3DaJS-DP-dj7aM94ZvaJrYQvQ4Dlw0 Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 05639a0fb04b4e65b3f03d9335424149 Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/05639a0fb04b4e65b3f03d9335424149"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/05639a0fb04b4e65b3f03d9335424149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_05639a0fb04b4e65b3f03d9335424149", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/05639a0fb04b4e65b3f03d9335424149"}]}] Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 05639a0fb04b4e65b3f03d9335424149 Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-538382369 Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersAdminNegativeTestJSON-538382369-project-admin Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4a9afae9525e42abada4a3f1b38b2034 Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersAdminNegativeTestJSON-538382369-project-admin Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: {"os-resetState": {"state": "error"}} Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 999 could not be found. Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:25.537930 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:25.550753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:25.550753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 14 14:31:25.550753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:25.550753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bd27c759-480d-422e-b321-763aafc60da7 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:25.550753 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bd27c759-480d-422e-b321-763aafc60da7 tempest-ServersAdminNegativeTestJSON-538382369 tempest-ServersAdminNegativeTestJSON-538382369-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.038898 Jul 14 14:31:25.550753 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 684/1407] 10.222.0.81 () {60 vars in 1178 bytes} [Thu Jul 14 14:31:25 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:31:25.551686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d5642e37-df17-4ebf-93eb-53b7959f4f50 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:25.565773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d5642e37-df17-4ebf-93eb-53b7959f4f50 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:25.575773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-757446bc-035b-491a-acb8-3e33fa9bf8d4 req-0697ecdc-158a-4550-942a-9db35cd37d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4826f2be-ba35-4d31-8ea1-73d42b530dd4", "name": "network-vif-deleted", "tag": "6ab54fdc-3cc1-4bb7-a515-a30086bd57f4"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:25.587464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d5642e37-df17-4ebf-93eb-53b7959f4f50 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.591047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d5642e37-df17-4ebf-93eb-53b7959f4f50 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.592227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d5642e37-df17-4ebf-93eb-53b7959f4f50 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.593027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d5642e37-df17-4ebf-93eb-53b7959f4f50 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.619068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-757446bc-035b-491a-acb8-3e33fa9bf8d4 req-0697ecdc-158a-4550-942a-9db35cd37d66 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.619588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-757446bc-035b-491a-acb8-3e33fa9bf8d4 req-0697ecdc-158a-4550-942a-9db35cd37d66 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.665712 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-757446bc-035b-491a-acb8-3e33fa9bf8d4 req-0697ecdc-158a-4550-942a-9db35cd37d66 service nova] Creating event network-vif-deleted:6ab54fdc-3cc1-4bb7-a515-a30086bd57f4 for instance 4826f2be-ba35-4d31-8ea1-73d42b530dd4 on n-h2-767704-28 Jul 14 14:31:25.679340 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-757446bc-035b-491a-acb8-3e33fa9bf8d4 req-0697ecdc-158a-4550-942a-9db35cd37d66 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125473 Jul 14 14:31:25.690129 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 685/1408] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:25.705671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ade891a5-aa76-4da1-bfcb-a831c0276dbe tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:25.706798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ade891a5-aa76-4da1-bfcb-a831c0276dbe tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:25.725823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ade891a5-aa76-4da1-bfcb-a831c0276dbe tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.726603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ade891a5-aa76-4da1-bfcb-a831c0276dbe tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.728669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ade891a5-aa76-4da1-bfcb-a831c0276dbe tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.729323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ade891a5-aa76-4da1-bfcb-a831c0276dbe tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.797610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d5642e37-df17-4ebf-93eb-53b7959f4f50 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:25.816967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ade891a5-aa76-4da1-bfcb-a831c0276dbe tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:31:25.823685 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d5642e37-df17-4ebf-93eb-53b7959f4f50 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1281 microversion: 2.1 time: 0.282875 Jul 14 14:31:25.824995 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 724/1409] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:25 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1281 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:25.830903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:25.838104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2225c869-6257-462a-8819-8a02ff52d86a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:25.839213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2225c869-6257-462a-8819-8a02ff52d86a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:25.868913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2225c869-6257-462a-8819-8a02ff52d86a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.869736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2225c869-6257-462a-8819-8a02ff52d86a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.871915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2225c869-6257-462a-8819-8a02ff52d86a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.872663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2225c869-6257-462a-8819-8a02ff52d86a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.035731 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ade891a5-aa76-4da1-bfcb-a831c0276dbe tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 204 len: 0 microversion: 2.1 time: 0.336667 Jul 14 14:31:26.039569 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 686/1410] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:31:25 2022] DELETE /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:31:26.047741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-88e45040-2ba5-4cff-b2c4-a0c1adc052d1 req-ab89d42f-65ac-46fe-857d-f764d53dd96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486f72c1-03cd-4401-862c-1e02ca398e46", "name": "network-vif-deleted", "tag": "a5283818-bbd0-45aa-b71a-689a812a086b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:26.058055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-88e45040-2ba5-4cff-b2c4-a0c1adc052d1 req-ab89d42f-65ac-46fe-857d-f764d53dd96a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.059887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-88e45040-2ba5-4cff-b2c4-a0c1adc052d1 req-ab89d42f-65ac-46fe-857d-f764d53dd96a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.074958 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-88e45040-2ba5-4cff-b2c4-a0c1adc052d1 req-ab89d42f-65ac-46fe-857d-f764d53dd96a service nova] Creating event network-vif-deleted:a5283818-bbd0-45aa-b71a-689a812a086b for instance 486f72c1-03cd-4401-862c-1e02ca398e46 on n-h1-767704-28 Jul 14 14:31:26.080999 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-88e45040-2ba5-4cff-b2c4-a0c1adc052d1 req-ab89d42f-65ac-46fe-857d-f764d53dd96a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038695 Jul 14 14:31:26.082828 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 687/1411] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:26.089957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1826e451-10cb-4cb8-a84e-88b76a4afa64 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:26.090988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1826e451-10cb-4cb8-a84e-88b76a4afa64 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:26.100863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1826e451-10cb-4cb8-a84e-88b76a4afa64 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.101711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1826e451-10cb-4cb8-a84e-88b76a4afa64 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.103959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1826e451-10cb-4cb8-a84e-88b76a4afa64 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.104585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1826e451-10cb-4cb8-a84e-88b76a4afa64 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.233669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1826e451-10cb-4cb8-a84e-88b76a4afa64 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:26.242757 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1826e451-10cb-4cb8-a84e-88b76a4afa64 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1273 microversion: 2.1 time: 0.158397 Jul 14 14:31:26.248117 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 688/1412] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:26 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:26.262859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-02365690-5965-4221-b235-717fed3d1d34 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:26.268378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-02365690-5965-4221-b235-717fed3d1d34 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:26.289595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02365690-5965-4221-b235-717fed3d1d34 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.290283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02365690-5965-4221-b235-717fed3d1d34 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.291585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02365690-5965-4221-b235-717fed3d1d34 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.292161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02365690-5965-4221-b235-717fed3d1d34 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.546535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2225c869-6257-462a-8819-8a02ff52d86a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:26.560818 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2225c869-6257-462a-8819-8a02ff52d86a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.733548 Jul 14 14:31:26.573237 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 725/1413] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:25 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:26.578861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2226fdc1-336e-4496-84e4-25645d6b971d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:26.579473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2226fdc1-336e-4496-84e4-25645d6b971d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] [instance: 4826f2be-ba35-4d31-8ea1-73d42b530dd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:26.585431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:26.587566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2226fdc1-336e-4496-84e4-25645d6b971d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.588319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2226fdc1-336e-4496-84e4-25645d6b971d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.593459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2226fdc1-336e-4496-84e4-25645d6b971d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.601754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-02365690-5965-4221-b235-717fed3d1d34 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:26.603544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2226fdc1-336e-4496-84e4-25645d6b971d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.613675 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-02365690-5965-4221-b235-717fed3d1d34 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1469 microversion: 2.1 time: 0.354989 Jul 14 14:31:26.624578 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 689/1414] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:26 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1469 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:26.637226 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-2226fdc1-336e-4496-84e4-25645d6b971d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] HTTP exception thrown: Instance 4826f2be-ba35-4d31-8ea1-73d42b530dd4 could not be found. Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2226fdc1-336e-4496-84e4-25645d6b971d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Request method failure captured: Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 HTTP/1.1 Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiNYFL-Li72t9m0QvOo37lKxUkS7fdw8T6l7cj-pWKr_V9H-hJbUKwJ-nSjp6ty-TY-vXTxhcJ20b33C6r-V9l3socY-Pr3iaCs-QZdyUvie3rptWIRoeTqt1igj0k1w2lMGfVp1NPZC9berFih254C8IsqPFwU_0aVaWBClZkp3vM Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: c3748377903c4d1a8af40152f327af4d Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1855844241 Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3748377903c4d1a8af40152f327af4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c3748377903c4d1a8af40152f327af4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c3748377903c4d1a8af40152f327af4d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3748377903c4d1a8af40152f327af4d"}]}] Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1855844241 Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: c3748377903c4d1a8af40152f327af4d Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1855844241 Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerAddressesNegativeTestJSON-1855844241-project Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: ce309d94cf624a82aff58ba17a8c81eb Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1855844241-project Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 4826f2be-ba35-4d31-8ea1-73d42b530dd4 could not be found. Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '4826f2be-ba35-4d31-8ea1-73d42b530dd4'} Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4826f2be-ba35-4d31-8ea1-73d42b530dd4 could not be found. Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4826f2be-ba35-4d31-8ea1-73d42b530dd4 could not be found. Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:26.639110 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:26.643403 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:26.643403 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:26.643403 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:26.643403 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:26.643403 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:26.643403 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:26.643403 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4826f2be-ba35-4d31-8ea1-73d42b530dd4 could not be found. Jul 14 14:31:26.643403 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:26.645515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d1aab8d0-66ab-4ba2-a620-97367937a1d6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:26.645515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d1aab8d0-66ab-4ba2-a620-97367937a1d6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:26.653828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2226fdc1-336e-4496-84e4-25645d6b971d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] Returning 404 to user: Instance 4826f2be-ba35-4d31-8ea1-73d42b530dd4 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:26.654554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1aab8d0-66ab-4ba2-a620-97367937a1d6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.655017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1aab8d0-66ab-4ba2-a620-97367937a1d6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.655455 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2226fdc1-336e-4496-84e4-25645d6b971d tempest-ServerAddressesNegativeTestJSON-1855844241 tempest-ServerAddressesNegativeTestJSON-1855844241-project] 10.222.0.81 "GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4" status: 404 len: 111 microversion: 2.1 time: 0.080922 Jul 14 14:31:26.655805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1aab8d0-66ab-4ba2-a620-97367937a1d6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.656247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1aab8d0-66ab-4ba2-a620-97367937a1d6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.666613 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 726/1415] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:26 2022] GET /compute/v2.1/servers/4826f2be-ba35-4d31-8ea1-73d42b530dd4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:31:26.674294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-398203db-b146-4705-9ac9-c55887d6d25d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:26.674922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-398203db-b146-4705-9ac9-c55887d6d25d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:26.696304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-398203db-b146-4705-9ac9-c55887d6d25d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.696860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-398203db-b146-4705-9ac9-c55887d6d25d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.702408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-398203db-b146-4705-9ac9-c55887d6d25d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.703422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-398203db-b146-4705-9ac9-c55887d6d25d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.810260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d1aab8d0-66ab-4ba2-a620-97367937a1d6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:26.819305 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d1aab8d0-66ab-4ba2-a620-97367937a1d6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1265 microversion: 2.1 time: 0.193400 Jul 14 14:31:26.830145 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 690/1416] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:26 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:26.842306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f616245f-ed97-4d58-9df8-653c04308fca tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:26.843290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f616245f-ed97-4d58-9df8-653c04308fca tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:26.845702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-398203db-b146-4705-9ac9-c55887d6d25d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.846701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-398203db-b146-4705-9ac9-c55887d6d25d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.847333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-398203db-b146-4705-9ac9-c55887d6d25d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lazy-loading 'fault' on Instance uuid 486f72c1-03cd-4401-862c-1e02ca398e46 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:31:26.860890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f616245f-ed97-4d58-9df8-653c04308fca tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.861557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f616245f-ed97-4d58-9df8-653c04308fca tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.862427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f616245f-ed97-4d58-9df8-653c04308fca tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.862954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f616245f-ed97-4d58-9df8-653c04308fca tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:27.094625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-398203db-b146-4705-9ac9-c55887d6d25d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:27.111016 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-398203db-b146-4705-9ac9-c55887d6d25d tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 200 len: 1369 microversion: 2.1 time: 0.442224 Jul 14 14:31:27.112873 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 727/1417] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:26 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 1369 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:27.264827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f491707c-efc5-4fa5-ac11-b2b06d6831a8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:27.266380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f491707c-efc5-4fa5-ac11-b2b06d6831a8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:27.279542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f491707c-efc5-4fa5-ac11-b2b06d6831a8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:27.280000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f491707c-efc5-4fa5-ac11-b2b06d6831a8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:27.285859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f491707c-efc5-4fa5-ac11-b2b06d6831a8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:27.286372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f491707c-efc5-4fa5-ac11-b2b06d6831a8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:27.609472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f491707c-efc5-4fa5-ac11-b2b06d6831a8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:27.620439 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f491707c-efc5-4fa5-ac11-b2b06d6831a8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1315 microversion: 2.1 time: 0.359677 Jul 14 14:31:27.632998 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 728/1418] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:27 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:27.640911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb7300ce-c7e5-4f07-abbb-c5ced0cf1f8f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:27.641551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bb7300ce-c7e5-4f07-abbb-c5ced0cf1f8f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:27.684559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb7300ce-c7e5-4f07-abbb-c5ced0cf1f8f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:27.685046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb7300ce-c7e5-4f07-abbb-c5ced0cf1f8f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:27.685831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb7300ce-c7e5-4f07-abbb-c5ced0cf1f8f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:27.686264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb7300ce-c7e5-4f07-abbb-c5ced0cf1f8f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:27.786754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f616245f-ed97-4d58-9df8-653c04308fca tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:27.797839 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f616245f-ed97-4d58-9df8-653c04308fca tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1323 microversion: 2.1 time: 0.960323 Jul 14 14:31:27.798968 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 691/1419] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:26 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1323 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:27.804576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7e66e069-9bef-4c1d-8160-e4faa8b6b2b9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:27.805227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7e66e069-9bef-4c1d-8160-e4faa8b6b2b9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:27.816138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e66e069-9bef-4c1d-8160-e4faa8b6b2b9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:27.816630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e66e069-9bef-4c1d-8160-e4faa8b6b2b9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:27.817684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e66e069-9bef-4c1d-8160-e4faa8b6b2b9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:27.818288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e66e069-9bef-4c1d-8160-e4faa8b6b2b9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:28.523842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bb7300ce-c7e5-4f07-abbb-c5ced0cf1f8f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:28.534174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7e66e069-9bef-4c1d-8160-e4faa8b6b2b9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:28.547505 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7e66e069-9bef-4c1d-8160-e4faa8b6b2b9 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1469 microversion: 2.1 time: 0.747236 Jul 14 14:31:28.553236 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bb7300ce-c7e5-4f07-abbb-c5ced0cf1f8f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.915893 Jul 14 14:31:28.555410 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 729/1420] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:27 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:28.557945 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 692/1421] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:27 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1469 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:28.562858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f44a6e28-99a4-4827-ade4-9041978fcd26 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:28.563501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f44a6e28-99a4-4827-ade4-9041978fcd26 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 486f72c1-03cd-4401-862c-1e02ca398e46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:28.563799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-099b0ba0-c3da-4135-9454-73db0f9673fe tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:28.564682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-099b0ba0-c3da-4135-9454-73db0f9673fe tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:28.574929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-099b0ba0-c3da-4135-9454-73db0f9673fe tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.575666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-099b0ba0-c3da-4135-9454-73db0f9673fe tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:28.578412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-099b0ba0-c3da-4135-9454-73db0f9673fe tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.579570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-099b0ba0-c3da-4135-9454-73db0f9673fe tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:28.584011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f44a6e28-99a4-4827-ade4-9041978fcd26 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.584483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f44a6e28-99a4-4827-ade4-9041978fcd26 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:28.585697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f44a6e28-99a4-4827-ade4-9041978fcd26 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.586156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f44a6e28-99a4-4827-ade4-9041978fcd26 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:28.615377 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f44a6e28-99a4-4827-ade4-9041978fcd26 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] HTTP exception thrown: Instance 486f72c1-03cd-4401-862c-1e02ca398e46 could not be found. Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f44a6e28-99a4-4827-ade4-9041978fcd26 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Request method failure captured: Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 HTTP/1.1 Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdllXQ_Xcz2pbg_E7L4-lZMrYp8Wk2QAfMsXdraRMi4Lq0jHqZcZm-5BFT0INS67I8K3S7HyFA6b1NwSw8Y4qR7uTG195XUOYYtvGzCEpptrAKNggIQdEZ7N0OqXBO7tSbOh0b0SWjNTiBhAiyUgZP9ePsuXkpOSXvTBUk7ZdR8hnM Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: c3e95b24eb1b4f9fbc5eb6f4d6f3d308 Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-MigrationsAdminTest-219629006 Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3e95b24eb1b4f9fbc5eb6f4d6f3d308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c3e95b24eb1b4f9fbc5eb6f4d6f3d308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c3e95b24eb1b4f9fbc5eb6f4d6f3d308", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3e95b24eb1b4f9fbc5eb6f4d6f3d308"}]}] Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-MigrationsAdminTest-219629006 Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: c3e95b24eb1b4f9fbc5eb6f4d6f3d308 Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-MigrationsAdminTest-219629006 Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-MigrationsAdminTest-219629006-project Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 89894c4d380a4632870ebcb10a2ffe81 Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-MigrationsAdminTest-219629006-project Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 486f72c1-03cd-4401-862c-1e02ca398e46 could not be found. Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '486f72c1-03cd-4401-862c-1e02ca398e46'} Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 486f72c1-03cd-4401-862c-1e02ca398e46 could not be found. Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 486f72c1-03cd-4401-862c-1e02ca398e46 could not be found. Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:28.617817 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:28.623644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:28.623644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:28.623644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:28.623644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:28.623644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:28.623644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 486f72c1-03cd-4401-862c-1e02ca398e46 could not be found. Jul 14 14:31:28.623644 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:28.626350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f44a6e28-99a4-4827-ade4-9041978fcd26 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Returning 404 to user: Instance 486f72c1-03cd-4401-862c-1e02ca398e46 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:28.627593 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f44a6e28-99a4-4827-ade4-9041978fcd26 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46" status: 404 len: 111 microversion: 2.1 time: 0.068544 Jul 14 14:31:28.628795 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 693/1422] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:28 2022] GET /compute/v2.1/servers/486f72c1-03cd-4401-862c-1e02ca398e46 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:31:28.635138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-bcb9e497-18fb-4d56-a23e-1b2388d155e6 req-de86d2a6-ca5b-4441-93bc-c4af574b216e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc69728d-ad31-4750-a7e2-ef09d6dd3686", "name": "network-vif-deleted", "tag": "4b7a1348-79bc-4d4e-8c50-0bfe89eac4b1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:28.647308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-bcb9e497-18fb-4d56-a23e-1b2388d155e6 req-de86d2a6-ca5b-4441-93bc-c4af574b216e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.648166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-bcb9e497-18fb-4d56-a23e-1b2388d155e6 req-de86d2a6-ca5b-4441-93bc-c4af574b216e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:28.686223 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-bcb9e497-18fb-4d56-a23e-1b2388d155e6 req-de86d2a6-ca5b-4441-93bc-c4af574b216e service nova] Creating event network-vif-deleted:4b7a1348-79bc-4d4e-8c50-0bfe89eac4b1 for instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 on n-h2-767704-28 Jul 14 14:31:28.691746 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-bcb9e497-18fb-4d56-a23e-1b2388d155e6 req-de86d2a6-ca5b-4441-93bc-c4af574b216e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060939 Jul 14 14:31:28.693225 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 694/1423] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:28.700729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4b812985-d6f7-4e8f-a8d4-4c0431ba4b91 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '.version_select at 0x7fd6c56e09d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:28.735985 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4b812985-d6f7-4e8f-a8d4-4c0431ba4b91 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601871887" status: 202 len: 0 microversion: 2.1 time: 0.040925 Jul 14 14:31:28.737455 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 695/1424] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 14:31:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601871887 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:31:28.748916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6ebc36ad-d51b-4be6-8af6-d7ede1c27ca2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:28.750043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6ebc36ad-d51b-4be6-8af6-d7ede1c27ca2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:28.756431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:28.774063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ebc36ad-d51b-4be6-8af6-d7ede1c27ca2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.775450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ebc36ad-d51b-4be6-8af6-d7ede1c27ca2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:28.777751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ebc36ad-d51b-4be6-8af6-d7ede1c27ca2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.787939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ebc36ad-d51b-4be6-8af6-d7ede1c27ca2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:29.648197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:29.667490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-099b0ba0-c3da-4135-9454-73db0f9673fe tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:29.687797 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-099b0ba0-c3da-4135-9454-73db0f9673fe tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1307 microversion: 2.1 time: 1.128211 Jul 14 14:31:29.690781 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 730/1425] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:28 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1307 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:29.704189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-934f09ce-4672-4713-ae47-77e94c41146b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:29.705196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-934f09ce-4672-4713-ae47-77e94c41146b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:29.714557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-934f09ce-4672-4713-ae47-77e94c41146b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:29.715375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-934f09ce-4672-4713-ae47-77e94c41146b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:29.717305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-934f09ce-4672-4713-ae47-77e94c41146b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:29.718029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-934f09ce-4672-4713-ae47-77e94c41146b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:29.891580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6ebc36ad-d51b-4be6-8af6-d7ede1c27ca2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:29.905859 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6ebc36ad-d51b-4be6-8af6-d7ede1c27ca2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1315 microversion: 2.1 time: 1.166763 Jul 14 14:31:29.906729 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 696/1426] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:28 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1315 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:29.938433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-64d4bb4a-a434-4da9-b21b-0830a827390d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:29.939488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-64d4bb4a-a434-4da9-b21b-0830a827390d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:29.959679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64d4bb4a-a434-4da9-b21b-0830a827390d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:29.960780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64d4bb4a-a434-4da9-b21b-0830a827390d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:29.962779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64d4bb4a-a434-4da9-b21b-0830a827390d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:29.963495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64d4bb4a-a434-4da9-b21b-0830a827390d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:30.263272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-934f09ce-4672-4713-ae47-77e94c41146b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:30.279877 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-934f09ce-4672-4713-ae47-77e94c41146b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1323 microversion: 2.1 time: 0.584278 Jul 14 14:31:30.281520 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 731/1427] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:29 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1323 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:30.296324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-306fbb2c-ec53-4148-a804-0c3f92381632 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:30.297509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-306fbb2c-ec53-4148-a804-0c3f92381632 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:30.313041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-306fbb2c-ec53-4148-a804-0c3f92381632 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:30.313699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-306fbb2c-ec53-4148-a804-0c3f92381632 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:30.314507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-306fbb2c-ec53-4148-a804-0c3f92381632 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:30.314953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-306fbb2c-ec53-4148-a804-0c3f92381632 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:30.870599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-306fbb2c-ec53-4148-a804-0c3f92381632 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:30.899900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-64d4bb4a-a434-4da9-b21b-0830a827390d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:30.920633 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-306fbb2c-ec53-4148-a804-0c3f92381632 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 200 len: 1298 microversion: 2.1 time: 0.636915 Jul 14 14:31:30.933686 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 732/1428] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:30 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 1298 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:30.936518 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-64d4bb4a-a434-4da9-b21b-0830a827390d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 1.021997 Jul 14 14:31:30.937212 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 697/1429] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:29 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:30.943084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9d065b0a-21a2-43f4-9d94-d271465c279b req-a1567d7b-edd9-43cb-bb04-8e00c508310b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d38095f-a9b7-4c8a-9f17-242929a4f872", "name": "network-vif-deleted", "tag": "84ab7c56-5f6b-40e0-a91a-728137d82fba"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:30.953367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9d065b0a-21a2-43f4-9d94-d271465c279b req-a1567d7b-edd9-43cb-bb04-8e00c508310b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:30.954170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9d065b0a-21a2-43f4-9d94-d271465c279b req-a1567d7b-edd9-43cb-bb04-8e00c508310b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:30.955564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ec6485a-14c2-45dd-b091-a155c82855b6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:30.956193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ec6485a-14c2-45dd-b091-a155c82855b6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:30.971749 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9d065b0a-21a2-43f4-9d94-d271465c279b req-a1567d7b-edd9-43cb-bb04-8e00c508310b service nova] Creating event network-vif-deleted:84ab7c56-5f6b-40e0-a91a-728137d82fba for instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 on n-h1-767704-28 Jul 14 14:31:30.990499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ec6485a-14c2-45dd-b091-a155c82855b6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:30.991054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ec6485a-14c2-45dd-b091-a155c82855b6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:30.993222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ec6485a-14c2-45dd-b091-a155c82855b6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:30.995114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ec6485a-14c2-45dd-b091-a155c82855b6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:30.999110 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9d065b0a-21a2-43f4-9d94-d271465c279b req-a1567d7b-edd9-43cb-bb04-8e00c508310b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060726 Jul 14 14:31:31.005127 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 733/1430] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:31.018487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-07b968a5-438a-4bb4-b8cc-c72a105205b7 req-c580ab9b-fa56-49ed-b450-f3b35f6377bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c850b90e-27fa-4f9a-bd80-6704843cb1a0", "tag": "b97d1e15-3c4f-492e-8519-79383a6b7f04"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:31.042820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-07b968a5-438a-4bb4-b8cc-c72a105205b7 req-c580ab9b-fa56-49ed-b450-f3b35f6377bc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:31.043597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-07b968a5-438a-4bb4-b8cc-c72a105205b7 req-c580ab9b-fa56-49ed-b450-f3b35f6377bc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:31.073238 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-07b968a5-438a-4bb4-b8cc-c72a105205b7 req-c580ab9b-fa56-49ed-b450-f3b35f6377bc service nova] Creating event network-changed:b97d1e15-3c4f-492e-8519-79383a6b7f04 for instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 on n-h2-767704-28 Jul 14 14:31:31.098842 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-07b968a5-438a-4bb4-b8cc-c72a105205b7 req-c580ab9b-fa56-49ed-b450-f3b35f6377bc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091753 Jul 14 14:31:31.106216 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 734/1431] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:31.115809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af98139c-0ae8-4bb5-8d0b-fed43bca3b2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:31.117482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-af98139c-0ae8-4bb5-8d0b-fed43bca3b2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:31.148774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af98139c-0ae8-4bb5-8d0b-fed43bca3b2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:31.154929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af98139c-0ae8-4bb5-8d0b-fed43bca3b2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:31.156347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af98139c-0ae8-4bb5-8d0b-fed43bca3b2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:31.157484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af98139c-0ae8-4bb5-8d0b-fed43bca3b2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:31.490331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ec6485a-14c2-45dd-b091-a155c82855b6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:31.499657 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ec6485a-14c2-45dd-b091-a155c82855b6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1307 microversion: 2.1 time: 0.552009 Jul 14 14:31:31.510417 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 698/1432] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:30 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1307 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:31.515635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2003886864", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "6bcc5f06-ad6e-40c9-b806-9581f1f929a3"}], "block_device_mapping_v2": [{"uuid": "aa9049c5-fe8f-4135-af73-baf5c6d5f669", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:31.589554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] validate_networks() for [('6bcc5f06-ad6e-40c9-b806-9581f1f929a3', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:31:31.673809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-af98139c-0ae8-4bb5-8d0b-fed43bca3b2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:31.686107 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af98139c-0ae8-4bb5-8d0b-fed43bca3b2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1315 microversion: 2.1 time: 0.577111 Jul 14 14:31:31.686804 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 735/1433] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:31 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:31.693247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e1edf255-18c6-44ca-8ad0-e9fe864fd6ad tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:31.694333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e1edf255-18c6-44ca-8ad0-e9fe864fd6ad tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:31.702147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1edf255-18c6-44ca-8ad0-e9fe864fd6ad tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:31.702713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1edf255-18c6-44ca-8ad0-e9fe864fd6ad tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:31.703565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1edf255-18c6-44ca-8ad0-e9fe864fd6ad tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:31.704142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1edf255-18c6-44ca-8ad0-e9fe864fd6ad tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.177847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e1edf255-18c6-44ca-8ad0-e9fe864fd6ad tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:32.195710 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e1edf255-18c6-44ca-8ad0-e9fe864fd6ad tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1323 microversion: 2.1 time: 0.507443 Jul 14 14:31:32.206653 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 736/1434] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:31 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1323 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:32.212901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc4243f4-4a83-4901-8c4f-176f3b9063f6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:32.214111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cc4243f4-4a83-4901-8c4f-176f3b9063f6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 7d38095f-a9b7-4c8a-9f17-242929a4f872] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:32.223483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc4243f4-4a83-4901-8c4f-176f3b9063f6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.225067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc4243f4-4a83-4901-8c4f-176f3b9063f6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.226098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc4243f4-4a83-4901-8c4f-176f3b9063f6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.226815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc4243f4-4a83-4901-8c4f-176f3b9063f6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.247587 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-cc4243f4-4a83-4901-8c4f-176f3b9063f6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] HTTP exception thrown: Instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 could not be found. Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc4243f4-4a83-4901-8c4f-176f3b9063f6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Request method failure captured: Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 HTTP/1.1 Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ch0qRv8gUH2HZppC-61bKA0-UOdi-ISiABevv1-mNDou3h9M6YR9vVEpLG2tNKcEwk-wU2jag0yvY-lX8Aes53M2JAxwPtNc-PU7brfZyiPfJT09h_jnSbrM4-YCQsWiKAil4V0WDmmnNYSj8ArGuD3zqUZr6kFYSTsy1ckjkvR6Vs Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d3b24d9de5fc49eaaf9c05e31c1489e4 Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1391306673 Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d3b24d9de5fc49eaaf9c05e31c1489e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d3b24d9de5fc49eaaf9c05e31c1489e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d3b24d9de5fc49eaaf9c05e31c1489e4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d3b24d9de5fc49eaaf9c05e31c1489e4"}]}] Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1391306673 Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d3b24d9de5fc49eaaf9c05e31c1489e4 Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1391306673 Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersAdminNegativeTestJSON-1391306673-project Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1a660ea88d644d57a49d4afc09433796 Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1391306673-project Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 could not be found. Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '7d38095f-a9b7-4c8a-9f17-242929a4f872'} Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 could not be found. Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 could not be found. Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:32.251207 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 could not be found. Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc4243f4-4a83-4901-8c4f-176f3b9063f6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Returning 404 to user: Instance 7d38095f-a9b7-4c8a-9f17-242929a4f872 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc4243f4-4a83-4901-8c4f-176f3b9063f6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872" status: 404 len: 111 microversion: 2.1 time: 0.042782 Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 737/1435] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:32 2022] GET /compute/v2.1/servers/7d38095f-a9b7-4c8a-9f17-242929a4f872 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b8c856a2-e9a5-4def-ac9f-0c0be8de4eaf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:32.257053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b8c856a2-e9a5-4def-ac9f-0c0be8de4eaf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:32.263333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8c856a2-e9a5-4def-ac9f-0c0be8de4eaf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.263792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8c856a2-e9a5-4def-ac9f-0c0be8de4eaf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.264620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8c856a2-e9a5-4def-ac9f-0c0be8de4eaf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.265047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8c856a2-e9a5-4def-ac9f-0c0be8de4eaf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.642064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b8c856a2-e9a5-4def-ac9f-0c0be8de4eaf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:32.654238 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b8c856a2-e9a5-4def-ac9f-0c0be8de4eaf tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.401879 Jul 14 14:31:32.655111 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 738/1436] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:32 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:32.660386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4a6f0373-4378-49ab-8c21-9a77db3501b4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:32.660891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4a6f0373-4378-49ab-8c21-9a77db3501b4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:32.669188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a6f0373-4378-49ab-8c21-9a77db3501b4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.670289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a6f0373-4378-49ab-8c21-9a77db3501b4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.671096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a6f0373-4378-49ab-8c21-9a77db3501b4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.671716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a6f0373-4378-49ab-8c21-9a77db3501b4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.711228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4a6f0373-4378-49ab-8c21-9a77db3501b4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:31:32.722620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:31:32.724487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:31:32.725570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:31:32.727921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:31:32.729390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:31:32.742744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.745297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.747112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.748515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.752777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:32.815557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Getting quotas for project 4459eedeb8884ffe82ed62e567fb64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:31:32.818715 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4a6f0373-4378-49ab-8c21-9a77db3501b4 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "DELETE /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 204 len: 0 microversion: 2.1 time: 0.161616 Jul 14 14:31:32.823571 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 739/1437] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:31:32 2022] DELETE /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:31:32.826194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:32.828125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Getting quotas for user ef25b01962404bdfa0c2bbb30401ca62 and project 4459eedeb8884ffe82ed62e567fb64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:31:32.831219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3e2e668d-325b-45ef-96d2-a88ee15775d6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:32.832149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3e2e668d-325b-45ef-96d2-a88ee15775d6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:32.840879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e2e668d-325b-45ef-96d2-a88ee15775d6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.841640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e2e668d-325b-45ef-96d2-a88ee15775d6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.842649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e2e668d-325b-45ef-96d2-a88ee15775d6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.843339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e2e668d-325b-45ef-96d2-a88ee15775d6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.880713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3e2e668d-325b-45ef-96d2-a88ee15775d6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:31:32.883178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=14 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:32.899331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:32.928115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:31:32.930538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa9049c5-fe8f-4135-af73-baf5c6d5f669',volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:31:33.001353 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3e2e668d-325b-45ef-96d2-a88ee15775d6 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "DELETE /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 204 len: 0 microversion: 2.1 time: 0.175814 Jul 14 14:31:33.002300 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 740/1438] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:31:32 2022] DELETE /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:31:33.008985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4ca231d9-7d62-48b2-81ce-3a58fc0e8753 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:33.010781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4ca231d9-7d62-48b2-81ce-3a58fc0e8753 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:33.018977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ca231d9-7d62-48b2-81ce-3a58fc0e8753 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.019912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ca231d9-7d62-48b2-81ce-3a58fc0e8753 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.021146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ca231d9-7d62-48b2-81ce-3a58fc0e8753 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.022333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ca231d9-7d62-48b2-81ce-3a58fc0e8753 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.147111 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-95846f92-c38a-4fc5-a3ed-f4e03f7cff3e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.635213 Jul 14 14:31:33.153678 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 699/1439] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:31:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:31:33.165094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0066ade0-e938-4fd5-875e-020f89687a13 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:33.166875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0066ade0-e938-4fd5-875e-020f89687a13 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:33.188801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0066ade0-e938-4fd5-875e-020f89687a13 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.189754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0066ade0-e938-4fd5-875e-020f89687a13 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.190688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0066ade0-e938-4fd5-875e-020f89687a13 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.191141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0066ade0-e938-4fd5-875e-020f89687a13 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.230312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4ca231d9-7d62-48b2-81ce-3a58fc0e8753 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:33.238422 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4ca231d9-7d62-48b2-81ce-3a58fc0e8753 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1307 microversion: 2.1 time: 0.234607 Jul 14 14:31:33.243065 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 741/1440] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:33 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1307 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:33.255277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b6376abd-451c-4a06-aa66-3cbf08fe682e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:33.257745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b6376abd-451c-4a06-aa66-3cbf08fe682e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:33.271957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6376abd-451c-4a06-aa66-3cbf08fe682e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.274569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6376abd-451c-4a06-aa66-3cbf08fe682e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.276830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6376abd-451c-4a06-aa66-3cbf08fe682e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.277412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6376abd-451c-4a06-aa66-3cbf08fe682e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.470560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0066ade0-e938-4fd5-875e-020f89687a13 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:33.498969 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0066ade0-e938-4fd5-875e-020f89687a13 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1315 microversion: 2.1 time: 0.342253 Jul 14 14:31:33.502596 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 700/1441] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:33 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:33.512303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-68b2d7ee-2ccf-49b9-9ec3-d90a2a9a1b33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:33.522657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-68b2d7ee-2ccf-49b9-9ec3-d90a2a9a1b33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:33.541230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68b2d7ee-2ccf-49b9-9ec3-d90a2a9a1b33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.544300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68b2d7ee-2ccf-49b9-9ec3-d90a2a9a1b33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.546281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68b2d7ee-2ccf-49b9-9ec3-d90a2a9a1b33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.548584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68b2d7ee-2ccf-49b9-9ec3-d90a2a9a1b33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.597841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b6376abd-451c-4a06-aa66-3cbf08fe682e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:33.615945 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b6376abd-451c-4a06-aa66-3cbf08fe682e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1468 microversion: 2.1 time: 0.370036 Jul 14 14:31:33.617184 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 742/1442] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:33 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1468 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:33.630931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b639c0f2-2318-4e16-828a-a27e1f041d9d req-9938e3bd-3e0a-425f-a116-d995be29d9fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7767fb3d-af95-439d-8bf7-385758969bce", "tag": "43c170a0-942c-45eb-a087-8588c42c2aaf"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:33.667573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b639c0f2-2318-4e16-828a-a27e1f041d9d req-9938e3bd-3e0a-425f-a116-d995be29d9fc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.668200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b639c0f2-2318-4e16-828a-a27e1f041d9d req-9938e3bd-3e0a-425f-a116-d995be29d9fc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.689986 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b639c0f2-2318-4e16-828a-a27e1f041d9d req-9938e3bd-3e0a-425f-a116-d995be29d9fc service nova] Creating event network-changed:43c170a0-942c-45eb-a087-8588c42c2aaf for instance 7767fb3d-af95-439d-8bf7-385758969bce on n-h1-767704-28 Jul 14 14:31:33.703067 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b639c0f2-2318-4e16-828a-a27e1f041d9d req-9938e3bd-3e0a-425f-a116-d995be29d9fc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081381 Jul 14 14:31:33.705221 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 743/1443] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:33.718377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cfecb28c-d758-498c-923d-6503e00e68f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:33.723138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cfecb28c-d758-498c-923d-6503e00e68f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:33.810787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-68b2d7ee-2ccf-49b9-9ec3-d90a2a9a1b33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:33.830617 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-68b2d7ee-2ccf-49b9-9ec3-d90a2a9a1b33 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1475 microversion: 2.1 time: 0.325323 Jul 14 14:31:33.831414 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 701/1444] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:33 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1475 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:33.835902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-acf87e6b-329a-4fb2-88a7-f2dd3003552b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:33.836520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-acf87e6b-329a-4fb2-88a7-f2dd3003552b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:33.841827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cfecb28c-d758-498c-923d-6503e00e68f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:33.850629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf87e6b-329a-4fb2-88a7-f2dd3003552b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.851091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf87e6b-329a-4fb2-88a7-f2dd3003552b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.851570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cfecb28c-d758-498c-923d-6503e00e68f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:33.851887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf87e6b-329a-4fb2-88a7-f2dd3003552b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.852577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf87e6b-329a-4fb2-88a7-f2dd3003552b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.854628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cfecb28c-d758-498c-923d-6503e00e68f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:33.856468 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cfecb28c-d758-498c-923d-6503e00e68f3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1104 microversion: 2.25 time: 0.150100 Jul 14 14:31:33.859200 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 744/1445] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:33 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1104 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:33.876918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-175e4f96-8ef5-4a96-9729-edc24d2ef385 req-2365d786-f316-4f91-bc2d-8feacdd9391f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435cc8e8-78b1-4af2-8cba-a8f23344e4d2", "tag": "b2bcf02b-437a-4cb3-924e-770f54b60aec"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:33.919515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-175e4f96-8ef5-4a96-9729-edc24d2ef385 req-2365d786-f316-4f91-bc2d-8feacdd9391f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.920602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-175e4f96-8ef5-4a96-9729-edc24d2ef385 req-2365d786-f316-4f91-bc2d-8feacdd9391f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.935253 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-175e4f96-8ef5-4a96-9729-edc24d2ef385 req-2365d786-f316-4f91-bc2d-8feacdd9391f service nova] Creating event network-changed:b2bcf02b-437a-4cb3-924e-770f54b60aec for instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 on n-h1-767704-28 Jul 14 14:31:33.941833 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-175e4f96-8ef5-4a96-9729-edc24d2ef385 req-2365d786-f316-4f91-bc2d-8feacdd9391f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080889 Jul 14 14:31:33.942916 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 745/1446] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:33.949381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-20fc4d2e-134d-4daa-a86e-b0b9cc26b55b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:33.950922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-20fc4d2e-134d-4daa-a86e-b0b9cc26b55b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:33.982488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20fc4d2e-134d-4daa-a86e-b0b9cc26b55b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.988892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20fc4d2e-134d-4daa-a86e-b0b9cc26b55b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.990474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20fc4d2e-134d-4daa-a86e-b0b9cc26b55b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.991520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20fc4d2e-134d-4daa-a86e-b0b9cc26b55b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.300171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-20fc4d2e-134d-4daa-a86e-b0b9cc26b55b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:34.311688 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-20fc4d2e-134d-4daa-a86e-b0b9cc26b55b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1718 microversion: 2.1 time: 0.366995 Jul 14 14:31:34.312856 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 746/1447] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:33 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1718 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:34.320528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4a3a93b0-4bd0-4c3e-8f55-2365ed06f517 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:34.321558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4a3a93b0-4bd0-4c3e-8f55-2365ed06f517 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:34.329752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a3a93b0-4bd0-4c3e-8f55-2365ed06f517 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.331142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a3a93b0-4bd0-4c3e-8f55-2365ed06f517 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.331571 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a3a93b0-4bd0-4c3e-8f55-2365ed06f517 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.332436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a3a93b0-4bd0-4c3e-8f55-2365ed06f517 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.338942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-acf87e6b-329a-4fb2-88a7-f2dd3003552b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:34.348514 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-acf87e6b-329a-4fb2-88a7-f2dd3003552b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1323 microversion: 2.1 time: 0.516145 Jul 14 14:31:34.349150 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 702/1448] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:33 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1323 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:34.511345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4a3a93b0-4bd0-4c3e-8f55-2365ed06f517 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:34.519397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ef4b50ba-2f77-48df-b074-0deed335ed62 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:34.520023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ef4b50ba-2f77-48df-b074-0deed335ed62 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:34.528650 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4a3a93b0-4bd0-4c3e-8f55-2365ed06f517 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1307 microversion: 2.1 time: 0.214425 Jul 14 14:31:34.530132 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 747/1449] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:34 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1307 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:34.542168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef4b50ba-2f77-48df-b074-0deed335ed62 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.542911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef4b50ba-2f77-48df-b074-0deed335ed62 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.544441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef4b50ba-2f77-48df-b074-0deed335ed62 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.544768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef4b50ba-2f77-48df-b074-0deed335ed62 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.643945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3cd972d8-54c6-4dd8-ad78-904580ea8b2e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:34.644449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3cd972d8-54c6-4dd8-ad78-904580ea8b2e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:34.652745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cd972d8-54c6-4dd8-ad78-904580ea8b2e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.653359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cd972d8-54c6-4dd8-ad78-904580ea8b2e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.654031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cd972d8-54c6-4dd8-ad78-904580ea8b2e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.654476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cd972d8-54c6-4dd8-ad78-904580ea8b2e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.720304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ef4b50ba-2f77-48df-b074-0deed335ed62 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:34.732236 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ef4b50ba-2f77-48df-b074-0deed335ed62 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1315 microversion: 2.1 time: 0.217362 Jul 14 14:31:34.752182 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 703/1450] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:34 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:34.848705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c583024e-4102-4736-bb5f-d629ceb77836 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:34.849478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c583024e-4102-4736-bb5f-d629ceb77836 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:34.859521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c583024e-4102-4736-bb5f-d629ceb77836 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.865701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c583024e-4102-4736-bb5f-d629ceb77836 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.868752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c583024e-4102-4736-bb5f-d629ceb77836 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.869240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c583024e-4102-4736-bb5f-d629ceb77836 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.920788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3cd972d8-54c6-4dd8-ad78-904580ea8b2e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:34.939624 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3cd972d8-54c6-4dd8-ad78-904580ea8b2e tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1468 microversion: 2.1 time: 0.300016 Jul 14 14:31:34.940773 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 748/1451] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:34 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1468 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:34.946420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3c12a77f-3b5a-4646-93bd-e25713004134 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:34.947577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3c12a77f-3b5a-4646-93bd-e25713004134 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:34.958731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c12a77f-3b5a-4646-93bd-e25713004134 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.959311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c12a77f-3b5a-4646-93bd-e25713004134 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.960211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c12a77f-3b5a-4646-93bd-e25713004134 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.961060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c12a77f-3b5a-4646-93bd-e25713004134 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:35.148458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3c12a77f-3b5a-4646-93bd-e25713004134 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:35.249047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3c12a77f-3b5a-4646-93bd-e25713004134 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:35.256540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3c12a77f-3b5a-4646-93bd-e25713004134 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:35.262088 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3c12a77f-3b5a-4646-93bd-e25713004134 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1251 microversion: 2.25 time: 0.318952 Jul 14 14:31:35.264018 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 749/1452] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:34 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1251 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:35.320635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c583024e-4102-4736-bb5f-d629ceb77836 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:35.329847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-39ced9bb-3d7d-4808-8e52-580c9b5c46ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:35.330630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-39ced9bb-3d7d-4808-8e52-580c9b5c46ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:35.332975 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c583024e-4102-4736-bb5f-d629ceb77836 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1475 microversion: 2.1 time: 0.487927 Jul 14 14:31:35.342205 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 704/1453] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:34 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1475 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:35.342426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39ced9bb-3d7d-4808-8e52-580c9b5c46ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:35.343617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39ced9bb-3d7d-4808-8e52-580c9b5c46ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:35.345861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39ced9bb-3d7d-4808-8e52-580c9b5c46ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:35.346649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39ced9bb-3d7d-4808-8e52-580c9b5c46ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:35.366021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-519413ca-46b3-4103-ba1d-6383a9c17c4b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:35.366645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-519413ca-46b3-4103-ba1d-6383a9c17c4b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:35.379894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-519413ca-46b3-4103-ba1d-6383a9c17c4b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:35.385360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-519413ca-46b3-4103-ba1d-6383a9c17c4b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:35.389173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-519413ca-46b3-4103-ba1d-6383a9c17c4b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:35.393631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-519413ca-46b3-4103-ba1d-6383a9c17c4b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:35.429177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:35.736162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-39ced9bb-3d7d-4808-8e52-580c9b5c46ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:35.779635 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-39ced9bb-3d7d-4808-8e52-580c9b5c46ce tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1708 microversion: 2.1 time: 0.453545 Jul 14 14:31:35.793625 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 750/1454] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:35 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1708 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:35.800918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0fec1d96-885b-4f70-b1b0-1ad7c2d9bb8f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:35.801933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0fec1d96-885b-4f70-b1b0-1ad7c2d9bb8f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:35.809942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0fec1d96-885b-4f70-b1b0-1ad7c2d9bb8f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:35.810630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0fec1d96-885b-4f70-b1b0-1ad7c2d9bb8f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:35.811623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0fec1d96-885b-4f70-b1b0-1ad7c2d9bb8f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:35.812226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0fec1d96-885b-4f70-b1b0-1ad7c2d9bb8f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:35.857959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-519413ca-46b3-4103-ba1d-6383a9c17c4b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:35.875573 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-519413ca-46b3-4103-ba1d-6383a9c17c4b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1323 microversion: 2.1 time: 0.513189 Jul 14 14:31:35.877412 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 705/1455] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:35 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1323 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:35.888743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d6aaa351-6258-438b-ac37-28123ba723ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:35.890059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d6aaa351-6258-438b-ac37-28123ba723ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:35.926219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6aaa351-6258-438b-ac37-28123ba723ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:35.927849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6aaa351-6258-438b-ac37-28123ba723ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:35.928692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6aaa351-6258-438b-ac37-28123ba723ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:35.929170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6aaa351-6258-438b-ac37-28123ba723ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.120667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0fec1d96-885b-4f70-b1b0-1ad7c2d9bb8f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:36.133332 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0fec1d96-885b-4f70-b1b0-1ad7c2d9bb8f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1307 microversion: 2.1 time: 0.333498 Jul 14 14:31:36.135943 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 751/1456] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:35 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:36.140890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-01101575-e9b5-4e14-9a66-9f39bb84c168 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '.version_select at 0x7fd6c5ba3af0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:36.151795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01101575-e9b5-4e14-9a66-9f39bb84c168 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.155593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01101575-e9b5-4e14-9a66-9f39bb84c168 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.183641 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-01101575-e9b5-4e14-9a66-9f39bb84c168 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 3137 microversion: 2.1 time: 0.046212 Jul 14 14:31:36.184286 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 752/1457] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:31:36 2022] GET /compute/v2.1/os-migrations => generated 3137 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:36.190344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6e8f090c-8877-4946-8746-c804d1c4c8cd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:36.197492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6e8f090c-8877-4946-8746-c804d1c4c8cd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:36.213203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e8f090c-8877-4946-8746-c804d1c4c8cd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.213866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e8f090c-8877-4946-8746-c804d1c4c8cd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.215051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e8f090c-8877-4946-8746-c804d1c4c8cd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.215689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e8f090c-8877-4946-8746-c804d1c4c8cd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.449973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d6aaa351-6258-438b-ac37-28123ba723ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:36.474485 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d6aaa351-6258-438b-ac37-28123ba723ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1315 microversion: 2.1 time: 0.594751 Jul 14 14:31:36.487994 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 706/1458] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:35 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:36.498780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0da1a69e-0521-486a-9117-418747048003 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:36.499431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0da1a69e-0521-486a-9117-418747048003 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:36.510058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0da1a69e-0521-486a-9117-418747048003 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.510530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0da1a69e-0521-486a-9117-418747048003 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.511324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0da1a69e-0521-486a-9117-418747048003 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.519266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0da1a69e-0521-486a-9117-418747048003 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.594427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6e8f090c-8877-4946-8746-c804d1c4c8cd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:36.606589 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6e8f090c-8877-4946-8746-c804d1c4c8cd tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1468 microversion: 2.1 time: 0.420622 Jul 14 14:31:36.607253 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 753/1459] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:36 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1468 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:36.617896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-69d0688d-c43c-4a38-88f7-96377a2fcb97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:36.617896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-69d0688d-c43c-4a38-88f7-96377a2fcb97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:36.640613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69d0688d-c43c-4a38-88f7-96377a2fcb97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.641038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69d0688d-c43c-4a38-88f7-96377a2fcb97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.641960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69d0688d-c43c-4a38-88f7-96377a2fcb97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.642527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69d0688d-c43c-4a38-88f7-96377a2fcb97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:37.438847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-69d0688d-c43c-4a38-88f7-96377a2fcb97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:37.440130 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0da1a69e-0521-486a-9117-418747048003 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1861 microversion: 2.1 time: 0.949008 Jul 14 14:31:37.445661 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 707/1460] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:36 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1861 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:37.460665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-69d0688d-c43c-4a38-88f7-96377a2fcb97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:37.466051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-69d0688d-c43c-4a38-88f7-96377a2fcb97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:37.470031 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-69d0688d-c43c-4a38-88f7-96377a2fcb97 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1293 microversion: 2.25 time: 0.860210 Jul 14 14:31:37.471935 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 754/1461] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:36 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1293 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:37.475710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7a43f288-5d45-419e-ace4-8232495bd37f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:37.479033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7a43f288-5d45-419e-ace4-8232495bd37f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:37.484693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c795a33a-a657-4396-ae0c-1b88fd22c55b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:37.486098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c795a33a-a657-4396-ae0c-1b88fd22c55b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:37.503377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c795a33a-a657-4396-ae0c-1b88fd22c55b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:37.506630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a43f288-5d45-419e-ace4-8232495bd37f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:37.507541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c795a33a-a657-4396-ae0c-1b88fd22c55b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:37.508457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a43f288-5d45-419e-ace4-8232495bd37f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:37.510611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c795a33a-a657-4396-ae0c-1b88fd22c55b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:37.512151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a43f288-5d45-419e-ace4-8232495bd37f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:37.513081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c795a33a-a657-4396-ae0c-1b88fd22c55b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:37.513969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a43f288-5d45-419e-ace4-8232495bd37f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:38.001332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c795a33a-a657-4396-ae0c-1b88fd22c55b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:38.030557 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c795a33a-a657-4396-ae0c-1b88fd22c55b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1323 microversion: 2.1 time: 0.556670 Jul 14 14:31:38.044237 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 755/1462] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:37 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1323 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:38.063692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2d6c70ab-e7e5-4838-a9ac-cf62b21821a7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:38.067601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2d6c70ab-e7e5-4838-a9ac-cf62b21821a7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:38.089646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d6c70ab-e7e5-4838-a9ac-cf62b21821a7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:38.095818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d6c70ab-e7e5-4838-a9ac-cf62b21821a7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:38.097447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d6c70ab-e7e5-4838-a9ac-cf62b21821a7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:38.098028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d6c70ab-e7e5-4838-a9ac-cf62b21821a7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:38.726260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7a43f288-5d45-419e-ace4-8232495bd37f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:38.761084 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7a43f288-5d45-419e-ace4-8232495bd37f tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1475 microversion: 2.1 time: 1.308495 Jul 14 14:31:38.762397 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 708/1463] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:37 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1475 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:38.768591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3cea7ed5-6d34-4e09-a79f-4898a7481082 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:38.771688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3cea7ed5-6d34-4e09-a79f-4898a7481082 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:38.786019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3cea7ed5-6d34-4e09-a79f-4898a7481082 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:38.793347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3cea7ed5-6d34-4e09-a79f-4898a7481082 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:38.794235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3cea7ed5-6d34-4e09-a79f-4898a7481082 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:38.794683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3cea7ed5-6d34-4e09-a79f-4898a7481082 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:39.058905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2d6c70ab-e7e5-4838-a9ac-cf62b21821a7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:39.074915 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2d6c70ab-e7e5-4838-a9ac-cf62b21821a7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1307 microversion: 2.1 time: 1.029395 Jul 14 14:31:39.075784 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 756/1464] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:38 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1307 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:39.080783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4aa89879-3d69-4090-87d6-132747236473 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:39.092585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4aa89879-3d69-4090-87d6-132747236473 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:39.110606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aa89879-3d69-4090-87d6-132747236473 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:39.111484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aa89879-3d69-4090-87d6-132747236473 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:39.120636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aa89879-3d69-4090-87d6-132747236473 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:39.121756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aa89879-3d69-4090-87d6-132747236473 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:39.777606 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3cea7ed5-6d34-4e09-a79f-4898a7481082 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1861 microversion: 2.1 time: 1.013334 Jul 14 14:31:39.793451 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 709/1465] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:38 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1861 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:39.799277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f0ecd0f9-6814-48dd-90a9-f726b58e1394 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:39.800498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f0ecd0f9-6814-48dd-90a9-f726b58e1394 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:39.809576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0ecd0f9-6814-48dd-90a9-f726b58e1394 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:39.810433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0ecd0f9-6814-48dd-90a9-f726b58e1394 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:39.811818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0ecd0f9-6814-48dd-90a9-f726b58e1394 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:39.812496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0ecd0f9-6814-48dd-90a9-f726b58e1394 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:39.886530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4aa89879-3d69-4090-87d6-132747236473 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:39.895521 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4aa89879-3d69-4090-87d6-132747236473 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1315 microversion: 2.1 time: 0.818358 Jul 14 14:31:39.901713 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 757/1466] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:39 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:39.946660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-fb7c2be6-5be7-4113-a78a-157e0896b4fb req-52887008-6099-42fc-a6b2-d838a20b068d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435cc8e8-78b1-4af2-8cba-a8f23344e4d2", "name": "network-vif-plugged", "status": "completed", "tag": "b2bcf02b-437a-4cb3-924e-770f54b60aec"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:39.976432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-fb7c2be6-5be7-4113-a78a-157e0896b4fb req-52887008-6099-42fc-a6b2-d838a20b068d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:39.977994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-fb7c2be6-5be7-4113-a78a-157e0896b4fb req-52887008-6099-42fc-a6b2-d838a20b068d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:39.998600 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-fb7c2be6-5be7-4113-a78a-157e0896b4fb req-52887008-6099-42fc-a6b2-d838a20b068d service nova] Creating event network-vif-plugged:b2bcf02b-437a-4cb3-924e-770f54b60aec for instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 on n-h1-767704-28 Jul 14 14:31:40.011308 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-fb7c2be6-5be7-4113-a78a-157e0896b4fb req-52887008-6099-42fc-a6b2-d838a20b068d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107422 Jul 14 14:31:40.017071 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 758/1467] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:40.030045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2689d539-80d0-4d62-9354-d4ece61ebb36 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:40.032365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2689d539-80d0-4d62-9354-d4ece61ebb36 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:40.048795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2689d539-80d0-4d62-9354-d4ece61ebb36 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.049759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2689d539-80d0-4d62-9354-d4ece61ebb36 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.049942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f0ecd0f9-6814-48dd-90a9-f726b58e1394 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:40.051900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2689d539-80d0-4d62-9354-d4ece61ebb36 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.053362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2689d539-80d0-4d62-9354-d4ece61ebb36 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.063431 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f0ecd0f9-6814-48dd-90a9-f726b58e1394 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1426 microversion: 2.1 time: 0.268544 Jul 14 14:31:40.064135 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 710/1468] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:39 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1426 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:40.092555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-86ae25d6-4a20-48c8-8119-9f6a2cbd381a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:40.093220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-86ae25d6-4a20-48c8-8119-9f6a2cbd381a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:40.121943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-86ae25d6-4a20-48c8-8119-9f6a2cbd381a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.122631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-86ae25d6-4a20-48c8-8119-9f6a2cbd381a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.124015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-86ae25d6-4a20-48c8-8119-9f6a2cbd381a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.124459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-86ae25d6-4a20-48c8-8119-9f6a2cbd381a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.482588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-86ae25d6-4a20-48c8-8119-9f6a2cbd381a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:40.495246 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-86ae25d6-4a20-48c8-8119-9f6a2cbd381a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1323 microversion: 2.1 time: 0.426803 Jul 14 14:31:40.506555 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 711/1469] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:40 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1323 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:40.516885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-02b6f571-8e1e-4f58-8107-31b5b8f82dfd req-0c0b1c66-b499-44b0-b0b3-10ee2fa1ac27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19bb6d1e-7771-41fd-b903-dc300ba97d6f", "name": "network-vif-deleted", "tag": "2bef06c0-64d7-4a58-88e7-88f2b49a1dbc"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:40.537371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-02b6f571-8e1e-4f58-8107-31b5b8f82dfd req-0c0b1c66-b499-44b0-b0b3-10ee2fa1ac27 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.538164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-02b6f571-8e1e-4f58-8107-31b5b8f82dfd req-0c0b1c66-b499-44b0-b0b3-10ee2fa1ac27 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.562776 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-02b6f571-8e1e-4f58-8107-31b5b8f82dfd req-0c0b1c66-b499-44b0-b0b3-10ee2fa1ac27 service nova] Creating event network-vif-deleted:2bef06c0-64d7-4a58-88e7-88f2b49a1dbc for instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f on n-h1-767704-28 Jul 14 14:31:40.575884 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-02b6f571-8e1e-4f58-8107-31b5b8f82dfd req-0c0b1c66-b499-44b0-b0b3-10ee2fa1ac27 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066139 Jul 14 14:31:40.579755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2689d539-80d0-4d62-9354-d4ece61ebb36 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:40.585640 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 712/1470] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:40.589888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aba14134-7c45-492b-a21d-1d39c082f3f2 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:40.590614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aba14134-7c45-492b-a21d-1d39c082f3f2 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:40.598930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aba14134-7c45-492b-a21d-1d39c082f3f2 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.599697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aba14134-7c45-492b-a21d-1d39c082f3f2 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.600834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aba14134-7c45-492b-a21d-1d39c082f3f2 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.601488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aba14134-7c45-492b-a21d-1d39c082f3f2 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.614891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:40.623995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2689d539-80d0-4d62-9354-d4ece61ebb36 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:40.628562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2689d539-80d0-4d62-9354-d4ece61ebb36 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:40.630131 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2689d539-80d0-4d62-9354-d4ece61ebb36 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1293 microversion: 2.25 time: 0.610915 Jul 14 14:31:40.637151 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 759/1471] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:40 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1293 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:40.645619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6eac4ff6-e0df-4076-b478-c9a95c9f1192 req-d2a21c14-2c71-44f0-b87f-db97581438d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343f561f-285d-4c5f-a036-3506d7898783", "name": "network-vif-deleted", "tag": "3af4cbd4-d5a2-4836-ac77-0b9cc9b71d43"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:40.653854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aba14134-7c45-492b-a21d-1d39c082f3f2 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.654461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aba14134-7c45-492b-a21d-1d39c082f3f2 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.655173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-aba14134-7c45-492b-a21d-1d39c082f3f2 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lazy-loading 'fault' on Instance uuid 343f561f-285d-4c5f-a036-3506d7898783 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:31:40.663806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6eac4ff6-e0df-4076-b478-c9a95c9f1192 req-d2a21c14-2c71-44f0-b87f-db97581438d6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.665861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6eac4ff6-e0df-4076-b478-c9a95c9f1192 req-d2a21c14-2c71-44f0-b87f-db97581438d6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.686453 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6eac4ff6-e0df-4076-b478-c9a95c9f1192 req-d2a21c14-2c71-44f0-b87f-db97581438d6 service nova] Creating event network-vif-deleted:3af4cbd4-d5a2-4836-ac77-0b9cc9b71d43 for instance 343f561f-285d-4c5f-a036-3506d7898783 on n-h1-767704-28 Jul 14 14:31:40.692438 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6eac4ff6-e0df-4076-b478-c9a95c9f1192 req-d2a21c14-2c71-44f0-b87f-db97581438d6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053938 Jul 14 14:31:40.693849 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 760/1472] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:40.701009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5dea38e7-3216-4916-8c6f-5c02c3ce1106 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:40.701843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5dea38e7-3216-4916-8c6f-5c02c3ce1106 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:40.713729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5dea38e7-3216-4916-8c6f-5c02c3ce1106 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.714461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5dea38e7-3216-4916-8c6f-5c02c3ce1106 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.716614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5dea38e7-3216-4916-8c6f-5c02c3ce1106 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.717552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5dea38e7-3216-4916-8c6f-5c02c3ce1106 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.734201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aba14134-7c45-492b-a21d-1d39c082f3f2 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:40.745127 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aba14134-7c45-492b-a21d-1d39c082f3f2 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1311 microversion: 2.1 time: 0.160237 Jul 14 14:31:40.746311 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 713/1473] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:40 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1311 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:40.751652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-48b4f3d4-6966-400c-9589-d83297c0a98c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:40.752273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-48b4f3d4-6966-400c-9589-d83297c0a98c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:40.759116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48b4f3d4-6966-400c-9589-d83297c0a98c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.759701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48b4f3d4-6966-400c-9589-d83297c0a98c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.760564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48b4f3d4-6966-400c-9589-d83297c0a98c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.761011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48b4f3d4-6966-400c-9589-d83297c0a98c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.889920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-5dea38e7-3216-4916-8c6f-5c02c3ce1106 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lazy-loading 'services' on Instance uuid e10e43da-f4f0-41c8-99db-efd48a91831a {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:31:41.041174 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5dea38e7-3216-4916-8c6f-5c02c3ce1106 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments/f9791977-2e40-4bfc-bd25-0b0244b36b02" status: 202 len: 0 microversion: 2.1 time: 0.345105 Jul 14 14:31:41.042384 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 761/1474] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 14:31:40 2022] DELETE /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments/f9791977-2e40-4bfc-bd25-0b0244b36b02 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:31:41.051473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f12b52dc-09b5-4779-a413-7e448c0f74ae tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:41.052706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f12b52dc-09b5-4779-a413-7e448c0f74ae tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:41.060877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f12b52dc-09b5-4779-a413-7e448c0f74ae tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.061676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f12b52dc-09b5-4779-a413-7e448c0f74ae tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.063074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f12b52dc-09b5-4779-a413-7e448c0f74ae tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.063689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f12b52dc-09b5-4779-a413-7e448c0f74ae tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.168115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-48b4f3d4-6966-400c-9589-d83297c0a98c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:41.181557 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-48b4f3d4-6966-400c-9589-d83297c0a98c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1307 microversion: 2.1 time: 0.430194 Jul 14 14:31:41.182987 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 714/1475] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:40 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1307 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:41.198432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-25346578-2012-425c-8d14-7e77a7cac599 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:41.200180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-25346578-2012-425c-8d14-7e77a7cac599 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:41.207972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25346578-2012-425c-8d14-7e77a7cac599 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.208785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25346578-2012-425c-8d14-7e77a7cac599 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.210305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25346578-2012-425c-8d14-7e77a7cac599 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.211249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25346578-2012-425c-8d14-7e77a7cac599 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.282857 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-25346578-2012-425c-8d14-7e77a7cac599 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098530 Jul 14 14:31:41.283912 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 715/1476] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:31:41 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:41.291665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-efa855a9-5b47-4f98-9f52-6fcd537c9db8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:41.292684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-efa855a9-5b47-4f98-9f52-6fcd537c9db8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:41.300091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efa855a9-5b47-4f98-9f52-6fcd537c9db8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.300660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efa855a9-5b47-4f98-9f52-6fcd537c9db8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.301768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efa855a9-5b47-4f98-9f52-6fcd537c9db8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.302250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efa855a9-5b47-4f98-9f52-6fcd537c9db8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.345362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efa855a9-5b47-4f98-9f52-6fcd537c9db8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.345825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efa855a9-5b47-4f98-9f52-6fcd537c9db8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.346288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-efa855a9-5b47-4f98-9f52-6fcd537c9db8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lazy-loading 'fault' on Instance uuid 19bb6d1e-7771-41fd-b903-dc300ba97d6f {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:31:41.366177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f12b52dc-09b5-4779-a413-7e448c0f74ae tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:41.375709 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f12b52dc-09b5-4779-a413-7e448c0f74ae tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1315 microversion: 2.1 time: 0.331779 Jul 14 14:31:41.377969 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 762/1477] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:41 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:41.507233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-efa855a9-5b47-4f98-9f52-6fcd537c9db8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:41.524533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7d0ba680-0014-4659-818b-8ce3ecee6f00 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:41.525245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7d0ba680-0014-4659-818b-8ce3ecee6f00 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:41.534993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d0ba680-0014-4659-818b-8ce3ecee6f00 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.535742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d0ba680-0014-4659-818b-8ce3ecee6f00 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.538476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d0ba680-0014-4659-818b-8ce3ecee6f00 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.539196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d0ba680-0014-4659-818b-8ce3ecee6f00 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.542313 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-efa855a9-5b47-4f98-9f52-6fcd537c9db8 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 200 len: 1302 microversion: 2.1 time: 0.255656 Jul 14 14:31:41.556614 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 716/1478] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:41 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 1302 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:41.721849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7d0ba680-0014-4659-818b-8ce3ecee6f00 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:41.731809 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7d0ba680-0014-4659-818b-8ce3ecee6f00 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1323 microversion: 2.1 time: 0.220558 Jul 14 14:31:41.744856 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 763/1479] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:41 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1323 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:41.764244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac85423f-6737-4efc-afb2-09b7e0aed528 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:41.765006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac85423f-6737-4efc-afb2-09b7e0aed528 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:41.771473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac85423f-6737-4efc-afb2-09b7e0aed528 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.772027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac85423f-6737-4efc-afb2-09b7e0aed528 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.772912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac85423f-6737-4efc-afb2-09b7e0aed528 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.773476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac85423f-6737-4efc-afb2-09b7e0aed528 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.810824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac85423f-6737-4efc-afb2-09b7e0aed528 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.811543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac85423f-6737-4efc-afb2-09b7e0aed528 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.812101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-ac85423f-6737-4efc-afb2-09b7e0aed528 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lazy-loading 'fault' on Instance uuid 343f561f-285d-4c5f-a036-3506d7898783 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:31:41.869213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac85423f-6737-4efc-afb2-09b7e0aed528 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a660ea88d644d57a49d4afc09433796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b24d9de5fc49eaaf9c05e31c1489e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:41.877934 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac85423f-6737-4efc-afb2-09b7e0aed528 tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 200 len: 1311 microversion: 2.1 time: 0.117560 Jul 14 14:31:41.879889 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 764/1480] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:41 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:42.042146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-cfc7f9eb-63ec-44fa-a342-990b80185ae8 req-426385f9-47ad-47df-95b0-69f0c71cc8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c850b90e-27fa-4f9a-bd80-6704843cb1a0", "name": "network-vif-plugged", "status": "completed", "tag": "b97d1e15-3c4f-492e-8519-79383a6b7f04"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:42.067024 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-cfc7f9eb-63ec-44fa-a342-990b80185ae8 req-426385f9-47ad-47df-95b0-69f0c71cc8a3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.067592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-cfc7f9eb-63ec-44fa-a342-990b80185ae8 req-426385f9-47ad-47df-95b0-69f0c71cc8a3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.098297 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-cfc7f9eb-63ec-44fa-a342-990b80185ae8 req-426385f9-47ad-47df-95b0-69f0c71cc8a3 service nova] Creating event network-vif-plugged:b97d1e15-3c4f-492e-8519-79383a6b7f04 for instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 on n-h2-767704-28 Jul 14 14:31:42.109470 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-cfc7f9eb-63ec-44fa-a342-990b80185ae8 req-426385f9-47ad-47df-95b0-69f0c71cc8a3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070903 Jul 14 14:31:42.110241 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 765/1481] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:42.188675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0111377c-1e1b-49ee-ba16-3efd65fc612e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:42.189960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0111377c-1e1b-49ee-ba16-3efd65fc612e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.201869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7d670816-b3da-46ef-b213-59dcef276ae0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:42.203100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7d670816-b3da-46ef-b213-59dcef276ae0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.206785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0111377c-1e1b-49ee-ba16-3efd65fc612e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.210935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0111377c-1e1b-49ee-ba16-3efd65fc612e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.212690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0111377c-1e1b-49ee-ba16-3efd65fc612e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.213468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d670816-b3da-46ef-b213-59dcef276ae0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.213933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d670816-b3da-46ef-b213-59dcef276ae0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.215097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d670816-b3da-46ef-b213-59dcef276ae0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.215552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d670816-b3da-46ef-b213-59dcef276ae0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.215682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0111377c-1e1b-49ee-ba16-3efd65fc612e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.507024 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7d670816-b3da-46ef-b213-59dcef276ae0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:42.517393 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7d670816-b3da-46ef-b213-59dcef276ae0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1307 microversion: 2.1 time: 0.321013 Jul 14 14:31:42.531755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0111377c-1e1b-49ee-ba16-3efd65fc612e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:42.535389 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 766/1482] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:42 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1307 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:42.543544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5333423a-1314-451d-9fa8-bde9f12d7840 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:42.544572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5333423a-1314-451d-9fa8-bde9f12d7840 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.550907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0111377c-1e1b-49ee-ba16-3efd65fc612e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:42.552347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5333423a-1314-451d-9fa8-bde9f12d7840 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.552900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0111377c-1e1b-49ee-ba16-3efd65fc612e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:42.553551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5333423a-1314-451d-9fa8-bde9f12d7840 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.554489 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0111377c-1e1b-49ee-ba16-3efd65fc612e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1293 microversion: 2.25 time: 0.907573 Jul 14 14:31:42.555072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5333423a-1314-451d-9fa8-bde9f12d7840 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.555525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5333423a-1314-451d-9fa8-bde9f12d7840 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.555961 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 717/1483] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:41 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1293 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:31:42.570168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dd19e4ab-dfce-4aee-8110-4229f0b7b17b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:42.571181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dd19e4ab-dfce-4aee-8110-4229f0b7b17b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.594495 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5333423a-1314-451d-9fa8-bde9f12d7840 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055634 Jul 14 14:31:42.598271 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 767/1484] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:31:42 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:42.600767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b04f0c83-8b9c-41c9-8b17-29c68a5415a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:42.601422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b04f0c83-8b9c-41c9-8b17-29c68a5415a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: 19bb6d1e-7771-41fd-b903-dc300ba97d6f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.602310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd19e4ab-dfce-4aee-8110-4229f0b7b17b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.603663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd19e4ab-dfce-4aee-8110-4229f0b7b17b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.605753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd19e4ab-dfce-4aee-8110-4229f0b7b17b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.607541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:42.607711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd19e4ab-dfce-4aee-8110-4229f0b7b17b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.609410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b04f0c83-8b9c-41c9-8b17-29c68a5415a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.609866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b04f0c83-8b9c-41c9-8b17-29c68a5415a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.610667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b04f0c83-8b9c-41c9-8b17-29c68a5415a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.611091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b04f0c83-8b9c-41c9-8b17-29c68a5415a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.635090 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-b04f0c83-8b9c-41c9-8b17-29c68a5415a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] HTTP exception thrown: Instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f could not be found. Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b04f0c83-8b9c-41c9-8b17-29c68a5415a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Request method failure captured: Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f HTTP/1.1 Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CdllXQ_Xcz2pbg_E7L4-lZMrYp8Wk2QAfMsXdraRMi4Lq0jHqZcZm-5BFT0INS67I8K3S7HyFA6b1NwSw8Y4qR7uTG195XUOYYtvGzCEpptrAKNggIQdEZ7N0OqXBO7tSbOh0b0SWjNTiBhAiyUgZP9ePsuXkpOSXvTBUk7ZdR8hnM Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: c3e95b24eb1b4f9fbc5eb6f4d6f3d308 Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-MigrationsAdminTest-219629006 Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3e95b24eb1b4f9fbc5eb6f4d6f3d308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c3e95b24eb1b4f9fbc5eb6f4d6f3d308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c3e95b24eb1b4f9fbc5eb6f4d6f3d308", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3e95b24eb1b4f9fbc5eb6f4d6f3d308"}]}] Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-MigrationsAdminTest-219629006 Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: c3e95b24eb1b4f9fbc5eb6f4d6f3d308 Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-MigrationsAdminTest-219629006 Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-MigrationsAdminTest-219629006-project Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 89894c4d380a4632870ebcb10a2ffe81 Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-MigrationsAdminTest-219629006-project Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f could not be found. Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '19bb6d1e-7771-41fd-b903-dc300ba97d6f'} Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f could not be found. Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f could not be found. Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:42.637906 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:42.642489 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:42.642489 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:42.642489 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:42.642489 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:42.642489 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:42.642489 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f could not be found. Jul 14 14:31:42.642489 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:42.643700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b04f0c83-8b9c-41c9-8b17-29c68a5415a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Returning 404 to user: Instance 19bb6d1e-7771-41fd-b903-dc300ba97d6f could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:42.644877 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b04f0c83-8b9c-41c9-8b17-29c68a5415a9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f" status: 404 len: 111 microversion: 2.1 time: 0.048140 Jul 14 14:31:42.645829 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 768/1485] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:42 2022] GET /compute/v2.1/servers/19bb6d1e-7771-41fd-b903-dc300ba97d6f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:31:42.654261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4e032fa4-3ccf-4f8d-bfbb-2053da47c499 req-81a76b33-d3a1-4880-84bf-edb76e849bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6d06d9-90ef-4a73-843a-778f0c146dff", "tag": "15eb7230-5af2-414b-bcce-a51e734e2507"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:42.675312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4e032fa4-3ccf-4f8d-bfbb-2053da47c499 req-81a76b33-d3a1-4880-84bf-edb76e849bfc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.685663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4e032fa4-3ccf-4f8d-bfbb-2053da47c499 req-81a76b33-d3a1-4880-84bf-edb76e849bfc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.702799 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4e032fa4-3ccf-4f8d-bfbb-2053da47c499 req-81a76b33-d3a1-4880-84bf-edb76e849bfc service nova] Creating event network-changed:15eb7230-5af2-414b-bcce-a51e734e2507 for instance de6d06d9-90ef-4a73-843a-778f0c146dff on n-h2-767704-28 Jul 14 14:31:42.710025 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4e032fa4-3ccf-4f8d-bfbb-2053da47c499 req-81a76b33-d3a1-4880-84bf-edb76e849bfc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059929 Jul 14 14:31:42.711125 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 769/1486] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:42.717654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a9ad125e-3ad9-4ac5-9aff-5fc29ff56741 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:42.718553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a9ad125e-3ad9-4ac5-9aff-5fc29ff56741 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.725837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9ad125e-3ad9-4ac5-9aff-5fc29ff56741 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.726476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9ad125e-3ad9-4ac5-9aff-5fc29ff56741 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.727298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9ad125e-3ad9-4ac5-9aff-5fc29ff56741 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.728323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9ad125e-3ad9-4ac5-9aff-5fc29ff56741 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.763128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a9ad125e-3ad9-4ac5-9aff-5fc29ff56741 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:31:42.768220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:42.843660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dd19e4ab-dfce-4aee-8110-4229f0b7b17b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:42.846567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:42.856854 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dd19e4ab-dfce-4aee-8110-4229f0b7b17b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1315 microversion: 2.1 time: 0.298305 Jul 14 14:31:42.857894 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 718/1487] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:42 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:42.863497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-310b4c7b-5ab9-4ff9-9d45-6cc3de892e71 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:42.865054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-310b4c7b-5ab9-4ff9-9d45-6cc3de892e71 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.872398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-310b4c7b-5ab9-4ff9-9d45-6cc3de892e71 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.872855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-310b4c7b-5ab9-4ff9-9d45-6cc3de892e71 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.873664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-310b4c7b-5ab9-4ff9-9d45-6cc3de892e71 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.874108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-310b4c7b-5ab9-4ff9-9d45-6cc3de892e71 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.912712 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a9ad125e-3ad9-4ac5-9aff-5fc29ff56741 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 204 len: 0 microversion: 2.1 time: 0.200044 Jul 14 14:31:42.913785 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 770/1488] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:31:42 2022] DELETE /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:31:42.920693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b084f82-e7d7-4f73-a68e-400f547647fb tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:42.922133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0b084f82-e7d7-4f73-a68e-400f547647fb tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] [instance: 343f561f-285d-4c5f-a036-3506d7898783] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.934160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b084f82-e7d7-4f73-a68e-400f547647fb tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.935308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b084f82-e7d7-4f73-a68e-400f547647fb tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.936484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b084f82-e7d7-4f73-a68e-400f547647fb tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.937205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b084f82-e7d7-4f73-a68e-400f547647fb tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.954929 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-0b084f82-e7d7-4f73-a68e-400f547647fb tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] HTTP exception thrown: Instance 343f561f-285d-4c5f-a036-3506d7898783 could not be found. Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b084f82-e7d7-4f73-a68e-400f547647fb tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Request method failure captured: Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 HTTP/1.1 Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ch0qRv8gUH2HZppC-61bKA0-UOdi-ISiABevv1-mNDou3h9M6YR9vVEpLG2tNKcEwk-wU2jag0yvY-lX8Aes53M2JAxwPtNc-PU7brfZyiPfJT09h_jnSbrM4-YCQsWiKAil4V0WDmmnNYSj8ArGuD3zqUZr6kFYSTsy1ckjkvR6Vs Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d3b24d9de5fc49eaaf9c05e31c1489e4 Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1391306673 Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d3b24d9de5fc49eaaf9c05e31c1489e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d3b24d9de5fc49eaaf9c05e31c1489e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d3b24d9de5fc49eaaf9c05e31c1489e4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d3b24d9de5fc49eaaf9c05e31c1489e4"}]}] Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1391306673 Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d3b24d9de5fc49eaaf9c05e31c1489e4 Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1391306673 Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersAdminNegativeTestJSON-1391306673-project Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1a660ea88d644d57a49d4afc09433796 Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1391306673-project Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 343f561f-285d-4c5f-a036-3506d7898783 could not be found. Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '343f561f-285d-4c5f-a036-3506d7898783'} Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343f561f-285d-4c5f-a036-3506d7898783 could not be found. Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343f561f-285d-4c5f-a036-3506d7898783 could not be found. Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:42.956761 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:42.961686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:42.961686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:42.961686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:42.961686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:42.961686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:42.961686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:42.961686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343f561f-285d-4c5f-a036-3506d7898783 could not be found. Jul 14 14:31:42.961686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:42.961686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b084f82-e7d7-4f73-a68e-400f547647fb tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] Returning 404 to user: Instance 343f561f-285d-4c5f-a036-3506d7898783 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:42.961686 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0b084f82-e7d7-4f73-a68e-400f547647fb tempest-ServersAdminNegativeTestJSON-1391306673 tempest-ServersAdminNegativeTestJSON-1391306673-project] 10.222.0.81 "GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783" status: 404 len: 111 microversion: 2.1 time: 0.043012 Jul 14 14:31:42.963267 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 771/1489] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:42 2022] GET /compute/v2.1/servers/343f561f-285d-4c5f-a036-3506d7898783 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:31:42.967952 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc4b1f1b-9e8c-450f-aab0-a4a3d45f2db9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:42.968575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cc4b1f1b-9e8c-450f-aab0-a4a3d45f2db9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.975619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc4b1f1b-9e8c-450f-aab0-a4a3d45f2db9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.976227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc4b1f1b-9e8c-450f-aab0-a4a3d45f2db9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.977051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc4b1f1b-9e8c-450f-aab0-a4a3d45f2db9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.977500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc4b1f1b-9e8c-450f-aab0-a4a3d45f2db9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:43.250284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-310b4c7b-5ab9-4ff9-9d45-6cc3de892e71 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:43.264292 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-310b4c7b-5ab9-4ff9-9d45-6cc3de892e71 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1519 microversion: 2.1 time: 0.404878 Jul 14 14:31:43.275767 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 719/1490] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:42 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1519 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:43.284330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-30fa3a8f-08be-45a1-ad29-0c798157db45 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Action: 'create', calling method: .version_select at 0x7fd6c56c5ca0>, body: {"pool": null} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:43.378820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cc4b1f1b-9e8c-450f-aab0-a4a3d45f2db9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:43.388984 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc4b1f1b-9e8c-450f-aab0-a4a3d45f2db9 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1467 microversion: 2.1 time: 0.425147 Jul 14 14:31:43.405490 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 772/1491] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:42 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1467 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:43.538737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6a07b223-8c0d-4abd-9e71-fd0df37d9671 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:43.539818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6a07b223-8c0d-4abd-9e71-fd0df37d9671 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:43.560707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a07b223-8c0d-4abd-9e71-fd0df37d9671 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:43.561459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a07b223-8c0d-4abd-9e71-fd0df37d9671 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:43.562653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a07b223-8c0d-4abd-9e71-fd0df37d9671 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:43.563647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a07b223-8c0d-4abd-9e71-fd0df37d9671 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:43.848088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:43.934942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6a07b223-8c0d-4abd-9e71-fd0df37d9671 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:43.950840 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6a07b223-8c0d-4abd-9e71-fd0df37d9671 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1307 microversion: 2.1 time: 0.419739 Jul 14 14:31:43.960438 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 773/1492] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:43 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1307 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:43.965692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-93dee05b-3714-45f1-99ba-251f594bb7a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:43.966317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-93dee05b-3714-45f1-99ba-251f594bb7a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:43.982613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93dee05b-3714-45f1-99ba-251f594bb7a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:43.983086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93dee05b-3714-45f1-99ba-251f594bb7a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:43.983893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93dee05b-3714-45f1-99ba-251f594bb7a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:43.984353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93dee05b-3714-45f1-99ba-251f594bb7a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:44.322298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-93dee05b-3714-45f1-99ba-251f594bb7a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:44.337636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-93dee05b-3714-45f1-99ba-251f594bb7a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:44.341965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-93dee05b-3714-45f1-99ba-251f594bb7a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:44.343132 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-93dee05b-3714-45f1-99ba-251f594bb7a8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1293 microversion: 2.25 time: 0.381437 Jul 14 14:31:44.349063 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 774/1493] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:43 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1293 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:44.362956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4c14def4-8c49-485e-b0e2-44bc89a65c90 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:44.365188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4c14def4-8c49-485e-b0e2-44bc89a65c90 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:44.378281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c14def4-8c49-485e-b0e2-44bc89a65c90 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:44.379716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c14def4-8c49-485e-b0e2-44bc89a65c90 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:44.380756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c14def4-8c49-485e-b0e2-44bc89a65c90 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:44.381456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c14def4-8c49-485e-b0e2-44bc89a65c90 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:44.420411 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4c14def4-8c49-485e-b0e2-44bc89a65c90 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075624 Jul 14 14:31:44.421494 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 775/1494] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:31:44 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:44.426947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9dfd872a-5037-4d10-abb7-03b15ec00ccc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:44.428732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9dfd872a-5037-4d10-abb7-03b15ec00ccc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:44.437208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dfd872a-5037-4d10-abb7-03b15ec00ccc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:44.437938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dfd872a-5037-4d10-abb7-03b15ec00ccc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:44.439609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dfd872a-5037-4d10-abb7-03b15ec00ccc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:44.440286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dfd872a-5037-4d10-abb7-03b15ec00ccc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:44.788926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9dfd872a-5037-4d10-abb7-03b15ec00ccc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:44.802398 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9dfd872a-5037-4d10-abb7-03b15ec00ccc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1315 microversion: 2.1 time: 0.379570 Jul 14 14:31:44.803750 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 776/1495] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:44 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:44.809085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c4097cf5-08f8-4446-98fb-087f816e2725 req-f981b390-cfd8-44da-8c65-ba868a59d43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7767fb3d-af95-439d-8bf7-385758969bce", "name": "network-vif-plugged", "status": "completed", "tag": "43c170a0-942c-45eb-a087-8588c42c2aaf"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:44.835159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c4097cf5-08f8-4446-98fb-087f816e2725 req-f981b390-cfd8-44da-8c65-ba868a59d43d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:44.835636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c4097cf5-08f8-4446-98fb-087f816e2725 req-f981b390-cfd8-44da-8c65-ba868a59d43d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:44.847955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:44.868065 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c4097cf5-08f8-4446-98fb-087f816e2725 req-f981b390-cfd8-44da-8c65-ba868a59d43d service nova] Creating event network-vif-plugged:43c170a0-942c-45eb-a087-8588c42c2aaf for instance 7767fb3d-af95-439d-8bf7-385758969bce on n-h1-767704-28 Jul 14 14:31:44.889128 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c4097cf5-08f8-4446-98fb-087f816e2725 req-f981b390-cfd8-44da-8c65-ba868a59d43d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080100 Jul 14 14:31:44.889910 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 777/1496] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:44.895754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5c6d8160-658a-4be9-987c-793b19a7ef2a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:44.896721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5c6d8160-658a-4be9-987c-793b19a7ef2a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:44.904214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c6d8160-658a-4be9-987c-793b19a7ef2a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:44.904684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c6d8160-658a-4be9-987c-793b19a7ef2a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:44.905552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c6d8160-658a-4be9-987c-793b19a7ef2a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:44.906566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c6d8160-658a-4be9-987c-793b19a7ef2a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:45.309984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5c6d8160-658a-4be9-987c-793b19a7ef2a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:45.326750 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5c6d8160-658a-4be9-987c-793b19a7ef2a tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1467 microversion: 2.1 time: 0.435292 Jul 14 14:31:45.327354 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 778/1497] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:44 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1467 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:45.341726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-38d718c2-05ed-4a3d-84b6-cac533dd518a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:45.342760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-38d718c2-05ed-4a3d-84b6-cac533dd518a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:45.362036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38d718c2-05ed-4a3d-84b6-cac533dd518a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:45.362730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38d718c2-05ed-4a3d-84b6-cac533dd518a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:45.363772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38d718c2-05ed-4a3d-84b6-cac533dd518a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:45.364435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38d718c2-05ed-4a3d-84b6-cac533dd518a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:45.735761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-38d718c2-05ed-4a3d-84b6-cac533dd518a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:45.745956 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-38d718c2-05ed-4a3d-84b6-cac533dd518a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1486 microversion: 2.1 time: 0.417306 Jul 14 14:31:45.758530 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 779/1498] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:45 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1486 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:45.767947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-767dd01e-6227-44bf-a270-e06341791081 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:45.769278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-767dd01e-6227-44bf-a270-e06341791081 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:45.779627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-767dd01e-6227-44bf-a270-e06341791081 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:45.781137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-767dd01e-6227-44bf-a270-e06341791081 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:45.782175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-767dd01e-6227-44bf-a270-e06341791081 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:45.782766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-767dd01e-6227-44bf-a270-e06341791081 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:46.059194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-767dd01e-6227-44bf-a270-e06341791081 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:46.070658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-767dd01e-6227-44bf-a270-e06341791081 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:46.077686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-767dd01e-6227-44bf-a270-e06341791081 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:46.079020 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-767dd01e-6227-44bf-a270-e06341791081 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1281 microversion: 2.25 time: 0.318171 Jul 14 14:31:46.094677 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-30fa3a8f-08be-45a1-ad29-0c798157db45 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.814359 Jul 14 14:31:46.095605 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 720/1499] 10.222.0.81 () {60 vars in 1169 bytes} [Thu Jul 14 14:31:43 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:46.097276 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 780/1500] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:45 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1281 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:46.104296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6dbc4d49-0e0e-4784-959e-103e455b9ae6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:46.109393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3d4c5a0a-2e3d-44bb-8daa-80e2d0c23efc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:46.111162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3d4c5a0a-2e3d-44bb-8daa-80e2d0c23efc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:46.123931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3d4c5a0a-2e3d-44bb-8daa-80e2d0c23efc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:46.126568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3d4c5a0a-2e3d-44bb-8daa-80e2d0c23efc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:46.128314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3d4c5a0a-2e3d-44bb-8daa-80e2d0c23efc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:46.130211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6dbc4d49-0e0e-4784-959e-103e455b9ae6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:46.130913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3d4c5a0a-2e3d-44bb-8daa-80e2d0c23efc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:46.133866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6dbc4d49-0e0e-4784-959e-103e455b9ae6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:46.208558 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3d4c5a0a-2e3d-44bb-8daa-80e2d0c23efc tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108374 Jul 14 14:31:46.209893 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 721/1501] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:31:46 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:46.216792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-08ff281f-a968-407d-ac53-4b7412e4f762 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:46.222379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-08ff281f-a968-407d-ac53-4b7412e4f762 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:46.235867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08ff281f-a968-407d-ac53-4b7412e4f762 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:46.238144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08ff281f-a968-407d-ac53-4b7412e4f762 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:46.244639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08ff281f-a968-407d-ac53-4b7412e4f762 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:46.245735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08ff281f-a968-407d-ac53-4b7412e4f762 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:46.288453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6dbc4d49-0e0e-4784-959e-103e455b9ae6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Going to try to stop instance {{(pid=119512) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:31:46.369399 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6dbc4d49-0e0e-4784-959e-103e455b9ae6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "POST /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0/action" status: 202 len: 0 microversion: 2.1 time: 0.269219 Jul 14 14:31:46.377666 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 781/1502] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:31:46 2022] POST /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:31:46.395570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1366634382", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "ae04b1c7-9ca7-4252-9de9-6ca895e5f620"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:46.487732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] validate_networks() for [('ae04b1c7-9ca7-4252-9de9-6ca895e5f620', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:31:46.580023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-08ff281f-a968-407d-ac53-4b7412e4f762 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:46.588884 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-08ff281f-a968-407d-ac53-4b7412e4f762 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1315 microversion: 2.1 time: 0.377654 Jul 14 14:31:46.594497 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 722/1503] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:46 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:46.620089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-00bb0455-0480-4a8c-b443-63e9765567da tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:46.621365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-00bb0455-0480-4a8c-b443-63e9765567da tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:46.629646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00bb0455-0480-4a8c-b443-63e9765567da tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:46.630554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00bb0455-0480-4a8c-b443-63e9765567da tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:46.633619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00bb0455-0480-4a8c-b443-63e9765567da tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:46.634498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00bb0455-0480-4a8c-b443-63e9765567da tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:46.642937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:47.200733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-00bb0455-0480-4a8c-b443-63e9765567da tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:47.212519 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-00bb0455-0480-4a8c-b443-63e9765567da tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1467 microversion: 2.1 time: 0.608244 Jul 14 14:31:47.217214 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 723/1504] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:46 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1467 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:47.236868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4df623ca-21fb-4cc1-90e0-b4f89e319c18 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:47.240441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4df623ca-21fb-4cc1-90e0-b4f89e319c18 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:47.258755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4df623ca-21fb-4cc1-90e0-b4f89e319c18 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:47.261525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4df623ca-21fb-4cc1-90e0-b4f89e319c18 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:47.264586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4df623ca-21fb-4cc1-90e0-b4f89e319c18 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:47.265450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4df623ca-21fb-4cc1-90e0-b4f89e319c18 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:47.629204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4df623ca-21fb-4cc1-90e0-b4f89e319c18 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:47.642956 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4df623ca-21fb-4cc1-90e0-b4f89e319c18 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 0.415438 Jul 14 14:31:47.643552 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 724/1505] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:47 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:47.658462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-909021b8-ab11-43d1-bf0f-1d140b49a70a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:47.659080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-909021b8-ab11-43d1-bf0f-1d140b49a70a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:47.673017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-909021b8-ab11-43d1-bf0f-1d140b49a70a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:47.673487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-909021b8-ab11-43d1-bf0f-1d140b49a70a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:47.674284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-909021b8-ab11-43d1-bf0f-1d140b49a70a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:47.674727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-909021b8-ab11-43d1-bf0f-1d140b49a70a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:47.704339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:31:47.704823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:31:47.705680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:31:47.706285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:31:47.709241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:31:47.720513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:47.720984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:47.721817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:47.722286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:47.800149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Getting quotas for project 613f5ab64c38455dad4973c1c974e87f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:31:47.813849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Getting quotas for user 30626a18f38d467da445eaa2b56faf5e and project 613f5ab64c38455dad4973c1c974e87f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:31:47.845960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:31:47.850086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:31:47.907210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-909021b8-ab11-43d1-bf0f-1d140b49a70a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:47.915707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-909021b8-ab11-43d1-bf0f-1d140b49a70a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:47.919446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-909021b8-ab11-43d1-bf0f-1d140b49a70a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:47.920813 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-909021b8-ab11-43d1-bf0f-1d140b49a70a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1281 microversion: 2.25 time: 0.276339 Jul 14 14:31:47.922018 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 725/1506] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:47 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1281 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:47.927287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b9010a00-1481-43b5-88ae-e580f0cb09c3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:47.928462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b9010a00-1481-43b5-88ae-e580f0cb09c3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:47.935932 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3bfb6db6-7454-495e-a66d-44d30f45d558 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554626 Jul 14 14:31:47.942361 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 782/1507] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:31:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:31:47.950268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9010a00-1481-43b5-88ae-e580f0cb09c3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:47.950832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-11a8e6b9-b8de-48fb-bf78-9f69314b3651 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:47.951250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9010a00-1481-43b5-88ae-e580f0cb09c3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:47.951967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-11a8e6b9-b8de-48fb-bf78-9f69314b3651 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:47.952433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9010a00-1481-43b5-88ae-e580f0cb09c3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:47.953172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9010a00-1481-43b5-88ae-e580f0cb09c3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:47.959800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11a8e6b9-b8de-48fb-bf78-9f69314b3651 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:47.960401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11a8e6b9-b8de-48fb-bf78-9f69314b3651 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:47.962047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11a8e6b9-b8de-48fb-bf78-9f69314b3651 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:47.967264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11a8e6b9-b8de-48fb-bf78-9f69314b3651 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:48.093463 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b9010a00-1481-43b5-88ae-e580f0cb09c3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169808 Jul 14 14:31:48.094797 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 726/1508] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:31:47 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:48.105669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-880ff162-37bf-4932-8ab3-e9c89c964177 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:48.106756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-880ff162-37bf-4932-8ab3-e9c89c964177 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:48.412427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-880ff162-37bf-4932-8ab3-e9c89c964177 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:48.421202 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-880ff162-37bf-4932-8ab3-e9c89c964177 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 200 len: 1224 microversion: 2.1 time: 0.324419 Jul 14 14:31:48.432597 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 727/1509] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:48 2022] GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 1224 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:48.471397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6a5c572b-3c85-4762-b13b-38ae961a3a85 req-bc285302-6324-49cd-b482-1fd853076cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2395da0-b1d7-4882-a1ac-e2029c5fad94", "name": "network-vif-deleted", "tag": "b00304cb-9535-4ecd-a778-337437c2dd15"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:48.496627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6a5c572b-3c85-4762-b13b-38ae961a3a85 req-bc285302-6324-49cd-b482-1fd853076cc9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:48.498970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6a5c572b-3c85-4762-b13b-38ae961a3a85 req-bc285302-6324-49cd-b482-1fd853076cc9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:48.567657 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6a5c572b-3c85-4762-b13b-38ae961a3a85 req-bc285302-6324-49cd-b482-1fd853076cc9 service nova] Creating event network-vif-deleted:b00304cb-9535-4ecd-a778-337437c2dd15 for instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 on n-h2-767704-28 Jul 14 14:31:48.591982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-11a8e6b9-b8de-48fb-bf78-9f69314b3651 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:48.594445 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6a5c572b-3c85-4762-b13b-38ae961a3a85 req-bc285302-6324-49cd-b482-1fd853076cc9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131500 Jul 14 14:31:48.601825 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 728/1510] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:48.616334 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-11a8e6b9-b8de-48fb-bf78-9f69314b3651 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1502 microversion: 2.1 time: 0.672480 Jul 14 14:31:48.619595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-73561c03-8daa-4536-a0d7-6b23937edf71 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:48.620359 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 783/1511] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:47 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1502 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:48.625972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-73561c03-8daa-4536-a0d7-6b23937edf71 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:48.651377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73561c03-8daa-4536-a0d7-6b23937edf71 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:48.651846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73561c03-8daa-4536-a0d7-6b23937edf71 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:48.652650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73561c03-8daa-4536-a0d7-6b23937edf71 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:48.661864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8acaf60d-6c2b-4d83-8dbb-f8f4a13b4f31 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:48.663817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8acaf60d-6c2b-4d83-8dbb-f8f4a13b4f31 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:48.670758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73561c03-8daa-4536-a0d7-6b23937edf71 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:48.679331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8acaf60d-6c2b-4d83-8dbb-f8f4a13b4f31 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:48.679797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8acaf60d-6c2b-4d83-8dbb-f8f4a13b4f31 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:48.680597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8acaf60d-6c2b-4d83-8dbb-f8f4a13b4f31 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:48.681115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8acaf60d-6c2b-4d83-8dbb-f8f4a13b4f31 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:48.792800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73561c03-8daa-4536-a0d7-6b23937edf71 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:48.798505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73561c03-8daa-4536-a0d7-6b23937edf71 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:48.799696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-73561c03-8daa-4536-a0d7-6b23937edf71 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lazy-loading 'fault' on Instance uuid f2395da0-b1d7-4882-a1ac-e2029c5fad94 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:31:49.083986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-73561c03-8daa-4536-a0d7-6b23937edf71 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89894c4d380a4632870ebcb10a2ffe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e95b24eb1b4f9fbc5eb6f4d6f3d308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:49.092775 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-73561c03-8daa-4536-a0d7-6b23937edf71 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 200 len: 1301 microversion: 2.1 time: 0.487546 Jul 14 14:31:49.096070 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 729/1512] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:48 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 1301 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:49.115781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21b58975-f706-4132-9be7-444b174ba685 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:49.116402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-21b58975-f706-4132-9be7-444b174ba685 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:49.145341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21b58975-f706-4132-9be7-444b174ba685 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:49.150755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21b58975-f706-4132-9be7-444b174ba685 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:49.152037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21b58975-f706-4132-9be7-444b174ba685 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:49.152745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21b58975-f706-4132-9be7-444b174ba685 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:49.743183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8acaf60d-6c2b-4d83-8dbb-f8f4a13b4f31 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:49.759364 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8acaf60d-6c2b-4d83-8dbb-f8f4a13b4f31 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 1.101184 Jul 14 14:31:49.781554 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 784/1513] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:48 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:49.803272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f4758edb-9fdf-4848-88f1-00ad61af63cd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:49.818550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f4758edb-9fdf-4848-88f1-00ad61af63cd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:49.844778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4758edb-9fdf-4848-88f1-00ad61af63cd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:49.845570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4758edb-9fdf-4848-88f1-00ad61af63cd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:49.846731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4758edb-9fdf-4848-88f1-00ad61af63cd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:49.848856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4758edb-9fdf-4848-88f1-00ad61af63cd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:49.877395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-21b58975-f706-4132-9be7-444b174ba685 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:49.885479 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f4758edb-9fdf-4848-88f1-00ad61af63cd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102611 Jul 14 14:31:49.886759 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 785/1514] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:31:49 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:49.893795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-21b58975-f706-4132-9be7-444b174ba685 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:49.899089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-21b58975-f706-4132-9be7-444b174ba685 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:49.901563 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21b58975-f706-4132-9be7-444b174ba685 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1281 microversion: 2.25 time: 0.789999 Jul 14 14:31:49.902666 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 730/1515] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:49 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1281 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:49.908431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-86e36a69-288b-4d6f-8986-dcef8dc67c52 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:49.909308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-86e36a69-288b-4d6f-8986-dcef8dc67c52 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:49.916490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-86e36a69-288b-4d6f-8986-dcef8dc67c52 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:49.917281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-86e36a69-288b-4d6f-8986-dcef8dc67c52 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:49.918402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-86e36a69-288b-4d6f-8986-dcef8dc67c52 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:49.919017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-86e36a69-288b-4d6f-8986-dcef8dc67c52 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:50.057029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-86e36a69-288b-4d6f-8986-dcef8dc67c52 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:50.069357 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-86e36a69-288b-4d6f-8986-dcef8dc67c52 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 200 len: 1284 microversion: 2.1 time: 0.165100 Jul 14 14:31:50.070343 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 731/1516] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:49 2022] GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 1284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:50.115497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24158b15-3dc5-457f-ab05-886467a9be10 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:50.116593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-24158b15-3dc5-457f-ab05-886467a9be10 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] [instance: f2395da0-b1d7-4882-a1ac-e2029c5fad94] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:50.129607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24158b15-3dc5-457f-ab05-886467a9be10 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:50.131375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24158b15-3dc5-457f-ab05-886467a9be10 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:50.133538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24158b15-3dc5-457f-ab05-886467a9be10 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:50.136492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24158b15-3dc5-457f-ab05-886467a9be10 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:50.176527 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-24158b15-3dc5-457f-ab05-886467a9be10 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] HTTP exception thrown: Instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 could not be found. Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24158b15-3dc5-457f-ab05-886467a9be10 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Request method failure captured: Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 HTTP/1.1 Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CdllXQ_Xcz2pbg_E7L4-lZMrYp8Wk2QAfMsXdraRMi4Lq0jHqZcZm-5BFT0INS67I8K3S7HyFA6b1NwSw8Y4qR7uTG195XUOYYtvGzCEpptrAKNggIQdEZ7N0OqXBO7tSbOh0b0SWjNTiBhAiyUgZP9ePsuXkpOSXvTBUk7ZdR8hnM Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: c3e95b24eb1b4f9fbc5eb6f4d6f3d308 Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-MigrationsAdminTest-219629006 Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3e95b24eb1b4f9fbc5eb6f4d6f3d308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c3e95b24eb1b4f9fbc5eb6f4d6f3d308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c3e95b24eb1b4f9fbc5eb6f4d6f3d308", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c3e95b24eb1b4f9fbc5eb6f4d6f3d308"}]}] Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-MigrationsAdminTest-219629006 Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: c3e95b24eb1b4f9fbc5eb6f4d6f3d308 Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-MigrationsAdminTest-219629006 Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-MigrationsAdminTest-219629006-project Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 89894c4d380a4632870ebcb10a2ffe81 Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-MigrationsAdminTest-219629006-project Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 could not be found. Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'f2395da0-b1d7-4882-a1ac-e2029c5fad94'} Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 could not be found. Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 could not be found. Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:50.178815 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:50.185022 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:50.185022 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:50.185022 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:50.185022 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:50.185022 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:50.185022 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 could not be found. Jul 14 14:31:50.185022 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:31:50.190548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24158b15-3dc5-457f-ab05-886467a9be10 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] Returning 404 to user: Instance f2395da0-b1d7-4882-a1ac-e2029c5fad94 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:50.191831 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-24158b15-3dc5-457f-ab05-886467a9be10 tempest-MigrationsAdminTest-219629006 tempest-MigrationsAdminTest-219629006-project] 10.222.0.81 "GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94" status: 404 len: 111 microversion: 2.1 time: 0.081567 Jul 14 14:31:50.197984 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 732/1517] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:50 2022] GET /compute/v2.1/servers/f2395da0-b1d7-4882-a1ac-e2029c5fad94 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:31:50.223979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-540914710", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:50.321256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:31:50.864448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5bfdf15c-7087-4b98-93fb-23219bdac736 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:50.864448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5bfdf15c-7087-4b98-93fb-23219bdac736 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:50.873502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bfdf15c-7087-4b98-93fb-23219bdac736 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:50.873995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bfdf15c-7087-4b98-93fb-23219bdac736 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:50.879776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bfdf15c-7087-4b98-93fb-23219bdac736 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:50.881591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bfdf15c-7087-4b98-93fb-23219bdac736 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:51.013828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:31:51.015541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:31:51.018517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:31:51.019526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:31:51.020762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:31:51.039946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:51.041542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:51.042624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:51.043199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:51.066029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:31:51.078748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:31:51.112519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:31:51.116926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:31:51.178231 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-894b8576-6396-41dd-85e0-3b40ee067170 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.289984 Jul 14 14:31:51.186297 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 786/1518] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:31:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:31:51.194029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-baf9c73f-9d79-4475-ac8a-34c7d777925d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:51.197387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-baf9c73f-9d79-4475-ac8a-34c7d777925d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:51.207989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-baf9c73f-9d79-4475-ac8a-34c7d777925d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:51.208853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-baf9c73f-9d79-4475-ac8a-34c7d777925d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:51.210849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-baf9c73f-9d79-4475-ac8a-34c7d777925d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:51.211561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-baf9c73f-9d79-4475-ac8a-34c7d777925d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:51.262577 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-baf9c73f-9d79-4475-ac8a-34c7d777925d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073082 Jul 14 14:31:51.264147 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 787/1519] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:31:51 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:51.272731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-83b4fe1c-ba3f-4fce-961c-4c7555e8f4d9 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:51.273792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-83b4fe1c-ba3f-4fce-961c-4c7555e8f4d9 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:51.284099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83b4fe1c-ba3f-4fce-961c-4c7555e8f4d9 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:51.284981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83b4fe1c-ba3f-4fce-961c-4c7555e8f4d9 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:51.286066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83b4fe1c-ba3f-4fce-961c-4c7555e8f4d9 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:51.287003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83b4fe1c-ba3f-4fce-961c-4c7555e8f4d9 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:51.955029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5bfdf15c-7087-4b98-93fb-23219bdac736 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:51.965984 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5bfdf15c-7087-4b98-93fb-23219bdac736 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 1.109732 Jul 14 14:31:51.968686 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 733/1520] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:50 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:51.981670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21191baa-4e6d-4142-804e-72b5ba239010 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:51.982667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-21191baa-4e6d-4142-804e-72b5ba239010 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:51.996899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21191baa-4e6d-4142-804e-72b5ba239010 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:52.001019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21191baa-4e6d-4142-804e-72b5ba239010 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:52.003253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21191baa-4e6d-4142-804e-72b5ba239010 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:52.004243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21191baa-4e6d-4142-804e-72b5ba239010 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:52.075894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-83b4fe1c-ba3f-4fce-961c-4c7555e8f4d9 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:52.085925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-83b4fe1c-ba3f-4fce-961c-4c7555e8f4d9 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:52.087979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-83b4fe1c-ba3f-4fce-961c-4c7555e8f4d9 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:52.090801 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-83b4fe1c-ba3f-4fce-961c-4c7555e8f4d9 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1281 microversion: 2.25 time: 0.823768 Jul 14 14:31:52.108406 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 788/1521] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:51 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1281 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:52.113426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5fc4eb2f-9869-4713-9eb0-7a883156c498 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:52.114090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5fc4eb2f-9869-4713-9eb0-7a883156c498 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:52.136738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fc4eb2f-9869-4713-9eb0-7a883156c498 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:52.138081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fc4eb2f-9869-4713-9eb0-7a883156c498 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:52.139146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fc4eb2f-9869-4713-9eb0-7a883156c498 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:52.139763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fc4eb2f-9869-4713-9eb0-7a883156c498 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:52.280241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5fc4eb2f-9869-4713-9eb0-7a883156c498 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:52.288028 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5fc4eb2f-9869-4713-9eb0-7a883156c498 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1220 microversion: 2.1 time: 0.178217 Jul 14 14:31:52.289217 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 789/1522] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:52 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1220 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:52.298426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1931bd77-7ab7-47bd-9097-2bcb0f455544 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "313457a8-7a4a-434f-8f4a-ae23220e1725"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:52.299871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1931bd77-7ab7-47bd-9097-2bcb0f455544 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:52.312982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1931bd77-7ab7-47bd-9097-2bcb0f455544 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:52.313459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1931bd77-7ab7-47bd-9097-2bcb0f455544 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:52.315651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1931bd77-7ab7-47bd-9097-2bcb0f455544 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:52.316120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1931bd77-7ab7-47bd-9097-2bcb0f455544 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:52.426800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-21191baa-4e6d-4142-804e-72b5ba239010 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:52.436350 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21191baa-4e6d-4142-804e-72b5ba239010 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 200 len: 1324 microversion: 2.1 time: 0.465281 Jul 14 14:31:52.440287 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 734/1523] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:51 2022] GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 1324 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:52.457562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be051844-f579-4ac3-a311-16d6db4536b0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:52.459268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-be051844-f579-4ac3-a311-16d6db4536b0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:52.472270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be051844-f579-4ac3-a311-16d6db4536b0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:52.474271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be051844-f579-4ac3-a311-16d6db4536b0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:52.475494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be051844-f579-4ac3-a311-16d6db4536b0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:52.480349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be051844-f579-4ac3-a311-16d6db4536b0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:52.528306 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-be051844-f579-4ac3-a311-16d6db4536b0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086423 Jul 14 14:31:52.529920 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 735/1524] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:31:52 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:31:52.773211 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1931bd77-7ab7-47bd-9097-2bcb0f455544 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "POST /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482371 Jul 14 14:31:52.775545 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 790/1525] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:31:52 2022] POST /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:52.987661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7325d681-6a77-47df-a0c3-d5156e7eebe6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:52.988287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7325d681-6a77-47df-a0c3-d5156e7eebe6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:53.005525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7325d681-6a77-47df-a0c3-d5156e7eebe6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.006253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7325d681-6a77-47df-a0c3-d5156e7eebe6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:53.008746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7325d681-6a77-47df-a0c3-d5156e7eebe6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.013226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7325d681-6a77-47df-a0c3-d5156e7eebe6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:53.113049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1313ca5d-8e05-4a90-bf26-b1cdfe6483ad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:53.114099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1313ca5d-8e05-4a90-bf26-b1cdfe6483ad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:53.146018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1313ca5d-8e05-4a90-bf26-b1cdfe6483ad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.146779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1313ca5d-8e05-4a90-bf26-b1cdfe6483ad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:53.153411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1313ca5d-8e05-4a90-bf26-b1cdfe6483ad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.153991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1313ca5d-8e05-4a90-bf26-b1cdfe6483ad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:53.508103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7325d681-6a77-47df-a0c3-d5156e7eebe6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:53.517616 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7325d681-6a77-47df-a0c3-d5156e7eebe6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 0.535343 Jul 14 14:31:53.549290 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 736/1526] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:52 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:53.554465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-79f42648-ecf4-4948-8cd0-51c2d3d78c47 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:53.569255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-79f42648-ecf4-4948-8cd0-51c2d3d78c47 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:53.599425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79f42648-ecf4-4948-8cd0-51c2d3d78c47 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.600421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79f42648-ecf4-4948-8cd0-51c2d3d78c47 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:53.601542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79f42648-ecf4-4948-8cd0-51c2d3d78c47 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.604162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79f42648-ecf4-4948-8cd0-51c2d3d78c47 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:53.818960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-79f42648-ecf4-4948-8cd0-51c2d3d78c47 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:53.834341 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-79f42648-ecf4-4948-8cd0-51c2d3d78c47 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1274 microversion: 2.1 time: 0.277938 Jul 14 14:31:53.834532 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 737/1527] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:53 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1274 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:53.847024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-9aea41eb-ab56-47d8-8a15-288f9a097b45 req-20e62477-62be-4f52-aeba-15066afd6b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b300ae9d-bf6b-4bc5-bd30-d88db00a9f11", "tag": "23b65fb5-ae6d-47eb-8c0d-db4e65375aa5"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:53.876980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9aea41eb-ab56-47d8-8a15-288f9a097b45 req-20e62477-62be-4f52-aeba-15066afd6b65 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.877589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9aea41eb-ab56-47d8-8a15-288f9a097b45 req-20e62477-62be-4f52-aeba-15066afd6b65 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:53.914236 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-9aea41eb-ab56-47d8-8a15-288f9a097b45 req-20e62477-62be-4f52-aeba-15066afd6b65 service nova] Creating event network-changed:23b65fb5-ae6d-47eb-8c0d-db4e65375aa5 for instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 on n-h1-767704-28 Jul 14 14:31:53.928273 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-9aea41eb-ab56-47d8-8a15-288f9a097b45 req-20e62477-62be-4f52-aeba-15066afd6b65 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091976 Jul 14 14:31:53.930604 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 738/1528] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:53.944968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5b6f4c6b-969a-44f1-ad75-7f278b180185 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:53.950014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5b6f4c6b-969a-44f1-ad75-7f278b180185 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:53.967070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b6f4c6b-969a-44f1-ad75-7f278b180185 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.972017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b6f4c6b-969a-44f1-ad75-7f278b180185 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:53.975360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b6f4c6b-969a-44f1-ad75-7f278b180185 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.977105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b6f4c6b-969a-44f1-ad75-7f278b180185 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:54.029813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1313ca5d-8e05-4a90-bf26-b1cdfe6483ad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:54.049918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1313ca5d-8e05-4a90-bf26-b1cdfe6483ad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:54.058705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1313ca5d-8e05-4a90-bf26-b1cdfe6483ad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:54.063912 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1313ca5d-8e05-4a90-bf26-b1cdfe6483ad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1281 microversion: 2.25 time: 0.953962 Jul 14 14:31:54.066589 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 791/1529] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:53 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1281 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:54.332786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5b6f4c6b-969a-44f1-ad75-7f278b180185 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:54.344225 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5b6f4c6b-969a-44f1-ad75-7f278b180185 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 200 len: 1324 microversion: 2.1 time: 0.408532 Jul 14 14:31:54.350455 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 739/1530] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:53 2022] GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 1324 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:54.553442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6b2f6c90-7c29-4934-82d0-bf0c9e1b0df2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:54.554437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6b2f6c90-7c29-4934-82d0-bf0c9e1b0df2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:54.575086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b2f6c90-7c29-4934-82d0-bf0c9e1b0df2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:54.577283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b2f6c90-7c29-4934-82d0-bf0c9e1b0df2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:54.578245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b2f6c90-7c29-4934-82d0-bf0c9e1b0df2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:54.578601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b2f6c90-7c29-4934-82d0-bf0c9e1b0df2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:54.963130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6b2f6c90-7c29-4934-82d0-bf0c9e1b0df2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:54.971912 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6b2f6c90-7c29-4934-82d0-bf0c9e1b0df2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 0.423815 Jul 14 14:31:54.983511 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 740/1531] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:54 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:54.997536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-11107f83-695e-42e9-9c0a-bd41d6f2c83f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:55.001725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-11107f83-695e-42e9-9c0a-bd41d6f2c83f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:55.033421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11107f83-695e-42e9-9c0a-bd41d6f2c83f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:55.036923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11107f83-695e-42e9-9c0a-bd41d6f2c83f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:55.041456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11107f83-695e-42e9-9c0a-bd41d6f2c83f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:55.042194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11107f83-695e-42e9-9c0a-bd41d6f2c83f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:55.042937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-84733328-089b-4079-aec8-4a3a276da809 tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] Action: 'create', calling method: .version_select at 0x7fd6c5945670>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:55.094540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-84733328-089b-4079-aec8-4a3a276da809 tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] Getting quotas for project 1d3ef1f8d984427d88b13758fa63941a. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:31:55.113152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-84733328-089b-4079-aec8-4a3a276da809 tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] Getting quotas for user 9f9f32d33d984d06bff7d675c210a48b and project 1d3ef1f8d984427d88b13758fa63941a. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:31:55.227013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:55.227496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-11107f83-695e-42e9-9c0a-bd41d6f2c83f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:55.237926 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-11107f83-695e-42e9-9c0a-bd41d6f2c83f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1274 microversion: 2.1 time: 0.252874 Jul 14 14:31:55.239478 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 741/1532] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:54 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1274 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:55.246135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba8d1883-18c3-4905-a7dc-305373f07c45 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:55.252465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ba8d1883-18c3-4905-a7dc-305373f07c45 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:55.258652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:55.272803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba8d1883-18c3-4905-a7dc-305373f07c45 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:55.273361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba8d1883-18c3-4905-a7dc-305373f07c45 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:55.275197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba8d1883-18c3-4905-a7dc-305373f07c45 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:55.277315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba8d1883-18c3-4905-a7dc-305373f07c45 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:55.297589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-84733328-089b-4079-aec8-4a3a276da809 tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] Getting quotas for project 1d3ef1f8d984427d88b13758fa63941a. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:31:55.309130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:55.313651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-84733328-089b-4079-aec8-4a3a276da809 tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] Getting quotas for user 9f9f32d33d984d06bff7d675c210a48b and project 1d3ef1f8d984427d88b13758fa63941a. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:31:55.345697 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-84733328-089b-4079-aec8-4a3a276da809 tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.868065 Jul 14 14:31:55.351488 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 792/1533] 10.222.0.81 () {62 vars in 1213 bytes} [Thu Jul 14 14:31:54 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:31:55.358560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4f356215-419e-4c99-8bde-4ce883048136 tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:55.382042 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4f356215-419e-4c99-8bde-4ce883048136 tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.028932 Jul 14 14:31:55.391050 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 793/1534] 10.222.0.81 () {60 vars in 1192 bytes} [Thu Jul 14 14:31:55 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:31:55.397927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ea3c247c-21af-41fc-b339-177ca13d2a1f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:55.398857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ea3c247c-21af-41fc-b339-177ca13d2a1f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:55.407389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea3c247c-21af-41fc-b339-177ca13d2a1f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:55.408181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea3c247c-21af-41fc-b339-177ca13d2a1f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:55.410298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea3c247c-21af-41fc-b339-177ca13d2a1f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:55.411372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea3c247c-21af-41fc-b339-177ca13d2a1f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:55.564754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ba8d1883-18c3-4905-a7dc-305373f07c45 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:55.579599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ba8d1883-18c3-4905-a7dc-305373f07c45 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:55.581385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ba8d1883-18c3-4905-a7dc-305373f07c45 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:55.586682 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ba8d1883-18c3-4905-a7dc-305373f07c45 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1281 microversion: 2.25 time: 0.345758 Jul 14 14:31:55.589762 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 742/1535] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:55 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1281 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:55.607548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9d234e20-8450-4b4a-92aa-9f66b378d5aa tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:55.657896 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9d234e20-8450-4b4a-92aa-9f66b378d5aa tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups/a85947c4-d41a-4c47-b536-f1a911e58b71" status: 200 len: 235 microversion: 2.64 time: 0.066507 Jul 14 14:31:55.662171 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 743/1536] 10.222.0.81 () {60 vars in 1303 bytes} [Thu Jul 14 14:31:55 2022] GET /compute/v2.1/os-server-groups/a85947c4-d41a-4c47-b536-f1a911e58b71 => generated 235 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:31:55.677987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-41c294d1-e09b-4fda-a593-3a3ff3698eed tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:55.696767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ea3c247c-21af-41fc-b339-177ca13d2a1f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:55.708558 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ea3c247c-21af-41fc-b339-177ca13d2a1f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 200 len: 1324 microversion: 2.1 time: 0.315146 Jul 14 14:31:55.710606 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 794/1537] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:55 2022] GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 1324 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:55.781840 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-41c294d1-e09b-4fda-a593-3a3ff3698eed tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/a85947c4-d41a-4c47-b536-f1a911e58b71" status: 204 len: 0 microversion: 2.64 time: 0.111895 Jul 14 14:31:55.783688 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 744/1538] 10.222.0.81 () {60 vars in 1306 bytes} [Thu Jul 14 14:31:55 2022] DELETE /compute/v2.1/os-server-groups/a85947c4-d41a-4c47-b536-f1a911e58b71 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 14:31:55.799250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1bd8b5c-7c98-4881-a751-0637ec2c70ce tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:55.822976 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-f1bd8b5c-7c98-4881-a751-0637ec2c70ce tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] HTTP exception thrown: Instance group a85947c4-d41a-4c47-b536-f1a911e58b71 could not be found. Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1bd8b5c-7c98-4881-a751-0637ec2c70ce tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] Request method failure captured: Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-server-groups/a85947c4-d41a-4c47-b536-f1a911e58b71 HTTP/1.1 Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cja0JlJI0M6Ox1rbqTd2tP6A6EgyMt1JgJ_nBUvoFJTPyo5AZQMolLhHTVIjkamsS8Eckb-jNtpjqTX53IrlexavZtKR2dj1WP0_WI0Fzis2ePridah_vFiQJFX-VF8_lgCbAv52TbURigz5_dtEYAUhSN_NOTZE2f4WS94uIxOxWE Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.64 Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 1d3ef1f8d984427d88b13758fa63941a Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerGroup264TestJSON-2022084475 Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1d3ef1f8d984427d88b13758fa63941a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1d3ef1f8d984427d88b13758fa63941a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1d3ef1f8d984427d88b13758fa63941a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1d3ef1f8d984427d88b13758fa63941a"}]}] Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerGroup264TestJSON-2022084475 Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 1d3ef1f8d984427d88b13758fa63941a Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2022084475 Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerGroup264TestJSON-2022084475-project Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9f9f32d33d984d06bff7d675c210a48b Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerGroup264TestJSON-2022084475-project Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance group a85947c4-d41a-4c47-b536-f1a911e58b71 could not be found. Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'a85947c4-d41a-4c47-b536-f1a911e58b71'} Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a85947c4-d41a-4c47-b536-f1a911e58b71 could not be found. Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a85947c4-d41a-4c47-b536-f1a911e58b71 could not be found. Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:55.830879 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:55.835592 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:55.835592 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:55.835592 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:55.835592 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:55.835592 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a85947c4-d41a-4c47-b536-f1a911e58b71 could not be found. Jul 14 14:31:55.835592 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:31:55.837962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1bd8b5c-7c98-4881-a751-0637ec2c70ce tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] Returning 404 to user: Instance group a85947c4-d41a-4c47-b536-f1a911e58b71 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:55.842008 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f1bd8b5c-7c98-4881-a751-0637ec2c70ce tempest-ServerGroup264TestJSON-2022084475 tempest-ServerGroup264TestJSON-2022084475-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/a85947c4-d41a-4c47-b536-f1a911e58b71" status: 404 len: 117 microversion: 2.64 time: 0.053668 Jul 14 14:31:55.843062 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 795/1539] 10.222.0.81 () {60 vars in 1306 bytes} [Thu Jul 14 14:31:55 2022] DELETE /compute/v2.1/os-server-groups/a85947c4-d41a-4c47-b536-f1a911e58b71 => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:31:56.000282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a62de2a4-ca59-4cfa-a6b9-a2783734ef2b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:56.001174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a62de2a4-ca59-4cfa-a6b9-a2783734ef2b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:56.020282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a62de2a4-ca59-4cfa-a6b9-a2783734ef2b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.020962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a62de2a4-ca59-4cfa-a6b9-a2783734ef2b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:56.026626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a62de2a4-ca59-4cfa-a6b9-a2783734ef2b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.030619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a62de2a4-ca59-4cfa-a6b9-a2783734ef2b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:56.256850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1344ea78-42fb-44ae-8df6-c06d45610650 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:56.262739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1344ea78-42fb-44ae-8df6-c06d45610650 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:56.285418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1344ea78-42fb-44ae-8df6-c06d45610650 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.287066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1344ea78-42fb-44ae-8df6-c06d45610650 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:56.295566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1344ea78-42fb-44ae-8df6-c06d45610650 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.296034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1344ea78-42fb-44ae-8df6-c06d45610650 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:56.339692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:56.789817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a62de2a4-ca59-4cfa-a6b9-a2783734ef2b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:56.801157 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a62de2a4-ca59-4cfa-a6b9-a2783734ef2b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 0.804655 Jul 14 14:31:56.805730 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 745/1540] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:55 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:56.822632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6266bdb8-7989-4754-85d5-bcb4d7502827 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:56.823398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6266bdb8-7989-4754-85d5-bcb4d7502827 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:56.826734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1344ea78-42fb-44ae-8df6-c06d45610650 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:56.841575 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1344ea78-42fb-44ae-8df6-c06d45610650 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1316 microversion: 2.1 time: 0.588453 Jul 14 14:31:56.842190 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 796/1541] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:56 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:56.861049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6266bdb8-7989-4754-85d5-bcb4d7502827 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.861519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6266bdb8-7989-4754-85d5-bcb4d7502827 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:56.862336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6266bdb8-7989-4754-85d5-bcb4d7502827 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.862780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6266bdb8-7989-4754-85d5-bcb4d7502827 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:56.871097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bf1c7227-5cc3-4916-ac84-3e77fcaf909e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:56.872646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bf1c7227-5cc3-4916-ac84-3e77fcaf909e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:56.913088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf1c7227-5cc3-4916-ac84-3e77fcaf909e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.919461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf1c7227-5cc3-4916-ac84-3e77fcaf909e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:56.922048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf1c7227-5cc3-4916-ac84-3e77fcaf909e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.922518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf1c7227-5cc3-4916-ac84-3e77fcaf909e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:57.547566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bf1c7227-5cc3-4916-ac84-3e77fcaf909e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:57.560060 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bf1c7227-5cc3-4916-ac84-3e77fcaf909e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 200 len: 1324 microversion: 2.1 time: 0.716781 Jul 14 14:31:57.565992 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 797/1542] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:56 2022] GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 1324 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:57.644442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6266bdb8-7989-4754-85d5-bcb4d7502827 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:57.662687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6266bdb8-7989-4754-85d5-bcb4d7502827 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:57.670046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6266bdb8-7989-4754-85d5-bcb4d7502827 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:57.674223 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6266bdb8-7989-4754-85d5-bcb4d7502827 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1281 microversion: 2.25 time: 0.866148 Jul 14 14:31:57.677096 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 746/1543] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:56 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1281 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:57.827481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f157bfbd-f5b4-4a92-bb34-83e70c7346b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:57.829147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f157bfbd-f5b4-4a92-bb34-83e70c7346b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:57.849006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f157bfbd-f5b4-4a92-bb34-83e70c7346b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:57.850976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f157bfbd-f5b4-4a92-bb34-83e70c7346b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:57.852041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f157bfbd-f5b4-4a92-bb34-83e70c7346b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:57.853914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f157bfbd-f5b4-4a92-bb34-83e70c7346b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:57.943950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-35ba36ff-6a27-4a94-9511-e97df4d57e7a tempest-QuotaClassesAdmin257Test-1802943435 tempest-QuotaClassesAdmin257Test-1802943435-project-admin] Calling method '.version_select at 0x7fd6c58a9a60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:57.946226 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:31:57.946226 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:31:57.986481 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-35ba36ff-6a27-4a94-9511-e97df4d57e7a tempest-QuotaClassesAdmin257Test-1802943435 tempest-QuotaClassesAdmin257Test-1802943435-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.418876 Jul 14 14:31:57.987382 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 798/1544] 10.222.0.81 () {60 vars in 1225 bytes} [Thu Jul 14 14:31:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:31:58.041240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f0a554ed-0107-415d-a48f-130e92ee9b03 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:58.051874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f0a554ed-0107-415d-a48f-130e92ee9b03 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:58.067003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f0a554ed-0107-415d-a48f-130e92ee9b03 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:58.067568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f0a554ed-0107-415d-a48f-130e92ee9b03 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:58.068239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f0a554ed-0107-415d-a48f-130e92ee9b03 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:58.070840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f0a554ed-0107-415d-a48f-130e92ee9b03 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:58.284661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f157bfbd-f5b4-4a92-bb34-83e70c7346b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:58.300560 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f157bfbd-f5b4-4a92-bb34-83e70c7346b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 0.477508 Jul 14 14:31:58.305069 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 747/1545] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:57 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:58.319899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4c679841-adfe-4a1c-a53b-8f5adcc999aa tempest-QuotaClassesAdmin257Test-1802943435 tempest-QuotaClassesAdmin257Test-1802943435-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c5b580d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:58.325045 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:31:58.325045 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:31:58.422220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:58.558814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f0a554ed-0107-415d-a48f-130e92ee9b03 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:58.578349 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f0a554ed-0107-415d-a48f-130e92ee9b03 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1316 microversion: 2.1 time: 0.579355 Jul 14 14:31:58.580438 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 799/1546] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:57 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:58.592564 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4c679841-adfe-4a1c-a53b-8f5adcc999aa tempest-QuotaClassesAdmin257Test-1802943435 tempest-QuotaClassesAdmin257Test-1802943435-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.284276 Jul 14 14:31:58.593010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-96091929-9621-4021-a8ec-2e21c139f77e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:58.595172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-96091929-9621-4021-a8ec-2e21c139f77e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:58.605240 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 748/1547] 10.222.0.81 () {62 vars in 1246 bytes} [Thu Jul 14 14:31:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:31:58.611696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96091929-9621-4021-a8ec-2e21c139f77e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:58.612367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-86b87eec-1adf-4ce2-b1c8-815407d537d8 tempest-QuotaClassesAdmin257Test-1802943435 tempest-QuotaClassesAdmin257Test-1802943435-project-admin] Calling method '.version_select at 0x7fd6c579db80>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:58.613308 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:31:58.613308 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:31:58.614199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96091929-9621-4021-a8ec-2e21c139f77e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:58.617203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96091929-9621-4021-a8ec-2e21c139f77e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:58.618208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96091929-9621-4021-a8ec-2e21c139f77e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:58.651914 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-86b87eec-1adf-4ce2-b1c8-815407d537d8 tempest-QuotaClassesAdmin257Test-1802943435 tempest-QuotaClassesAdmin257Test-1802943435-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.044237 Jul 14 14:31:58.661749 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 749/1548] 10.222.0.81 () {60 vars in 1225 bytes} [Thu Jul 14 14:31:58 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:31:58.668772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-03133e12-b68e-40b1-a2b8-666d224afea2 tempest-QuotaClassesAdmin257Test-1802943435 tempest-QuotaClassesAdmin257Test-1802943435-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c5b58c10>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:58.821074 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-03133e12-b68e-40b1-a2b8-666d224afea2 tempest-QuotaClassesAdmin257Test-1802943435 tempest-QuotaClassesAdmin257Test-1802943435-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.158032 Jul 14 14:31:58.824041 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 750/1549] 10.222.0.81 () {62 vars in 1246 bytes} [Thu Jul 14 14:31:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:31:58.847586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c81ea919-0243-454d-a4a8-29617f99268c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:58.855400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c81ea919-0243-454d-a4a8-29617f99268c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:58.874733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c81ea919-0243-454d-a4a8-29617f99268c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:58.875552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c81ea919-0243-454d-a4a8-29617f99268c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:58.879571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c81ea919-0243-454d-a4a8-29617f99268c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:58.883041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c81ea919-0243-454d-a4a8-29617f99268c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:59.115769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-96091929-9621-4021-a8ec-2e21c139f77e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:59.132132 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-96091929-9621-4021-a8ec-2e21c139f77e tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 200 len: 1324 microversion: 2.1 time: 0.545009 Jul 14 14:31:59.148600 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 800/1550] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:58 2022] GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 1324 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:59.162190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-aa931383-ff59-4630-ac4b-a61efea04628 req-f6d41697-a12b-4f8c-926c-eec612bc0839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6d06d9-90ef-4a73-843a-778f0c146dff", "name": "network-vif-plugged", "status": "completed", "tag": "15eb7230-5af2-414b-bcce-a51e734e2507"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:59.197335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-aa931383-ff59-4630-ac4b-a61efea04628 req-f6d41697-a12b-4f8c-926c-eec612bc0839 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:59.198114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-aa931383-ff59-4630-ac4b-a61efea04628 req-f6d41697-a12b-4f8c-926c-eec612bc0839 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:59.237268 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-aa931383-ff59-4630-ac4b-a61efea04628 req-f6d41697-a12b-4f8c-926c-eec612bc0839 service nova] Creating event network-vif-plugged:15eb7230-5af2-414b-bcce-a51e734e2507 for instance de6d06d9-90ef-4a73-843a-778f0c146dff on n-h2-767704-28 Jul 14 14:31:59.246252 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-aa931383-ff59-4630-ac4b-a61efea04628 req-f6d41697-a12b-4f8c-926c-eec612bc0839 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094954 Jul 14 14:31:59.247121 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 801/1551] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:59.317783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c81ea919-0243-454d-a4a8-29617f99268c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:59.323618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fd96232e-8eae-4351-8bf6-bf1a896c5533 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:59.327306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fd96232e-8eae-4351-8bf6-bf1a896c5533 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:59.332534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c81ea919-0243-454d-a4a8-29617f99268c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:59.334109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c81ea919-0243-454d-a4a8-29617f99268c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:59.335750 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c81ea919-0243-454d-a4a8-29617f99268c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1281 microversion: 2.25 time: 0.503796 Jul 14 14:31:59.349575 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 751/1552] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:31:58 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1281 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:31:59.363495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fd96232e-8eae-4351-8bf6-bf1a896c5533 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:59.366215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fd96232e-8eae-4351-8bf6-bf1a896c5533 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:59.367892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fd96232e-8eae-4351-8bf6-bf1a896c5533 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:59.375757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fd96232e-8eae-4351-8bf6-bf1a896c5533 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:59.437884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-2574db15-dde9-4550-8273-1773a52a647c req-33f30a17-5f6c-4488-b37a-39e3f95f532a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea89554c-b395-4813-8c65-81afc2ae89ec", "tag": "7a6cfe65-45f8-4c9e-9bea-76a19c294b1f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:59.472407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2574db15-dde9-4550-8273-1773a52a647c req-33f30a17-5f6c-4488-b37a-39e3f95f532a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:59.473204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2574db15-dde9-4550-8273-1773a52a647c req-33f30a17-5f6c-4488-b37a-39e3f95f532a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:59.519054 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-2574db15-dde9-4550-8273-1773a52a647c req-33f30a17-5f6c-4488-b37a-39e3f95f532a service nova] Creating event network-changed:7a6cfe65-45f8-4c9e-9bea-76a19c294b1f for instance ea89554c-b395-4813-8c65-81afc2ae89ec on n-h2-767704-28 Jul 14 14:31:59.560553 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-2574db15-dde9-4550-8273-1773a52a647c req-33f30a17-5f6c-4488-b37a-39e3f95f532a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118942 Jul 14 14:31:59.563821 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 752/1553] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:59.597437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4b2a2434-9d41-484e-88f0-ef8fc2baaa35 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:59.598184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4b2a2434-9d41-484e-88f0-ef8fc2baaa35 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:59.611666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b2a2434-9d41-484e-88f0-ef8fc2baaa35 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:59.619561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b2a2434-9d41-484e-88f0-ef8fc2baaa35 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:59.621861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b2a2434-9d41-484e-88f0-ef8fc2baaa35 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:59.624647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b2a2434-9d41-484e-88f0-ef8fc2baaa35 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:00.426134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fd96232e-8eae-4351-8bf6-bf1a896c5533 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:00.440358 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fd96232e-8eae-4351-8bf6-bf1a896c5533 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 1.122954 Jul 14 14:32:00.441087 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 802/1554] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:59 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:00.457015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4028df73-cb45-4bf6-b82b-a3d9bb562c1a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:00.457618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4028df73-cb45-4bf6-b82b-a3d9bb562c1a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:00.464882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4028df73-cb45-4bf6-b82b-a3d9bb562c1a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:00.465635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4028df73-cb45-4bf6-b82b-a3d9bb562c1a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:00.467106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4028df73-cb45-4bf6-b82b-a3d9bb562c1a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:00.467760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4028df73-cb45-4bf6-b82b-a3d9bb562c1a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:00.494318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4b2a2434-9d41-484e-88f0-ef8fc2baaa35 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:00.512435 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4b2a2434-9d41-484e-88f0-ef8fc2baaa35 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1316 microversion: 2.1 time: 0.920373 Jul 14 14:32:00.516079 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 753/1555] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:59 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1316 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:00.535698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0eacaf19-6b20-4e17-9300-27ab29c2e253 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:00.536326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0eacaf19-6b20-4e17-9300-27ab29c2e253 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:00.597295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0eacaf19-6b20-4e17-9300-27ab29c2e253 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:00.597647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0eacaf19-6b20-4e17-9300-27ab29c2e253 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:00.598444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0eacaf19-6b20-4e17-9300-27ab29c2e253 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:00.598906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0eacaf19-6b20-4e17-9300-27ab29c2e253 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:01.056085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:01.610219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0eacaf19-6b20-4e17-9300-27ab29c2e253 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:01.624693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0eacaf19-6b20-4e17-9300-27ab29c2e253 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:01.626498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0eacaf19-6b20-4e17-9300-27ab29c2e253 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:01.628045 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0eacaf19-6b20-4e17-9300-27ab29c2e253 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1281 microversion: 2.25 time: 1.107919 Jul 14 14:32:01.629826 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 754/1556] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:00 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1281 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:01.635373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-007562e9-fdf6-4679-910d-f2fb7164e317 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:01.641836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-007562e9-fdf6-4679-910d-f2fb7164e317 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:01.656873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-007562e9-fdf6-4679-910d-f2fb7164e317 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:01.659144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-007562e9-fdf6-4679-910d-f2fb7164e317 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:01.666195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-007562e9-fdf6-4679-910d-f2fb7164e317 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:01.667665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-007562e9-fdf6-4679-910d-f2fb7164e317 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:01.810450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4028df73-cb45-4bf6-b82b-a3d9bb562c1a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:01.820698 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4028df73-cb45-4bf6-b82b-a3d9bb562c1a tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 200 len: 1324 microversion: 2.1 time: 1.368215 Jul 14 14:32:01.826755 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 803/1557] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:00 2022] GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 1324 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:01.840806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-35d87dbe-43b3-48fb-96e1-657e2b215c81 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:01.842028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-35d87dbe-43b3-48fb-96e1-657e2b215c81 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:01.857726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-35d87dbe-43b3-48fb-96e1-657e2b215c81 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:01.858249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-35d87dbe-43b3-48fb-96e1-657e2b215c81 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:01.859146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-35d87dbe-43b3-48fb-96e1-657e2b215c81 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:01.859725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-35d87dbe-43b3-48fb-96e1-657e2b215c81 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:02.144993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-007562e9-fdf6-4679-910d-f2fb7164e317 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:02.161535 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-007562e9-fdf6-4679-910d-f2fb7164e317 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 0.530110 Jul 14 14:32:02.173155 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 755/1558] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:01 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:02.180084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f6f6159a-fa87-449f-8f7a-b1d72b348889 req-9772fafa-0bd3-4d68-a93c-c573d4cd7e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b300ae9d-bf6b-4bc5-bd30-d88db00a9f11", "name": "network-vif-plugged", "status": "completed", "tag": "23b65fb5-ae6d-47eb-8c0d-db4e65375aa5"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:02.191390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f6f6159a-fa87-449f-8f7a-b1d72b348889 req-9772fafa-0bd3-4d68-a93c-c573d4cd7e64 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:02.192240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f6f6159a-fa87-449f-8f7a-b1d72b348889 req-9772fafa-0bd3-4d68-a93c-c573d4cd7e64 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:02.216063 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f6f6159a-fa87-449f-8f7a-b1d72b348889 req-9772fafa-0bd3-4d68-a93c-c573d4cd7e64 service nova] Creating event network-vif-plugged:23b65fb5-ae6d-47eb-8c0d-db4e65375aa5 for instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 on n-h1-767704-28 Jul 14 14:32:02.236216 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f6f6159a-fa87-449f-8f7a-b1d72b348889 req-9772fafa-0bd3-4d68-a93c-c573d4cd7e64 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060646 Jul 14 14:32:02.237467 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 756/1559] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:02.270234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-35d87dbe-43b3-48fb-96e1-657e2b215c81 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:02.284393 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-35d87dbe-43b3-48fb-96e1-657e2b215c81 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1316 microversion: 2.1 time: 0.452622 Jul 14 14:32:02.288413 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 804/1560] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:01 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:02.647072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2149e025-342f-4f70-b876-ad59c577a71a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:02.648605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2149e025-342f-4f70-b876-ad59c577a71a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:02.663402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2149e025-342f-4f70-b876-ad59c577a71a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:02.668717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2149e025-342f-4f70-b876-ad59c577a71a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:02.672186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2149e025-342f-4f70-b876-ad59c577a71a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:02.678446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2149e025-342f-4f70-b876-ad59c577a71a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:02.843524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c3835970-ecae-4b9f-962e-09d7372de4b9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:02.844220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c3835970-ecae-4b9f-962e-09d7372de4b9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:02.864658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3835970-ecae-4b9f-962e-09d7372de4b9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:02.866803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3835970-ecae-4b9f-962e-09d7372de4b9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:02.867962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3835970-ecae-4b9f-962e-09d7372de4b9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:02.868586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3835970-ecae-4b9f-962e-09d7372de4b9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:03.566971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2149e025-342f-4f70-b876-ad59c577a71a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:03.580252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2149e025-342f-4f70-b876-ad59c577a71a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:03.582657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2149e025-342f-4f70-b876-ad59c577a71a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:03.583912 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2149e025-342f-4f70-b876-ad59c577a71a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1281 microversion: 2.25 time: 0.941142 Jul 14 14:32:03.615290 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 757/1561] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:02 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1281 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:03.631782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9fc48426-8cb0-4b7b-95dd-66f787e6aba3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:03.633292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9fc48426-8cb0-4b7b-95dd-66f787e6aba3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:03.653388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9fc48426-8cb0-4b7b-95dd-66f787e6aba3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:03.653998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9fc48426-8cb0-4b7b-95dd-66f787e6aba3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:03.667348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9fc48426-8cb0-4b7b-95dd-66f787e6aba3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:03.671440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9fc48426-8cb0-4b7b-95dd-66f787e6aba3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:03.713434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c3835970-ecae-4b9f-962e-09d7372de4b9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:03.725236 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c3835970-ecae-4b9f-962e-09d7372de4b9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 200 len: 1324 microversion: 2.1 time: 0.884584 Jul 14 14:32:03.725844 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 805/1562] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:02 2022] GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 1324 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:03.749458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc62c676-d8f6-4e6f-b940-04d350cfbadd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:03.752024 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dc62c676-d8f6-4e6f-b940-04d350cfbadd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:03.776555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc62c676-d8f6-4e6f-b940-04d350cfbadd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:03.779636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc62c676-d8f6-4e6f-b940-04d350cfbadd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:03.782017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc62c676-d8f6-4e6f-b940-04d350cfbadd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:03.784178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc62c676-d8f6-4e6f-b940-04d350cfbadd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:04.356576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9fc48426-8cb0-4b7b-95dd-66f787e6aba3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:04.368561 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9fc48426-8cb0-4b7b-95dd-66f787e6aba3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 0.751282 Jul 14 14:32:04.369743 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 758/1563] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:03 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:04.605038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c31f355e-8dd0-4d19-9435-d0bc51353506 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:04.607042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c31f355e-8dd0-4d19-9435-d0bc51353506 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:04.619628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c31f355e-8dd0-4d19-9435-d0bc51353506 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:04.629122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c31f355e-8dd0-4d19-9435-d0bc51353506 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:04.629955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c31f355e-8dd0-4d19-9435-d0bc51353506 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:04.630750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c31f355e-8dd0-4d19-9435-d0bc51353506 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:04.832358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dc62c676-d8f6-4e6f-b940-04d350cfbadd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:04.845084 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dc62c676-d8f6-4e6f-b940-04d350cfbadd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1316 microversion: 2.1 time: 1.118106 Jul 14 14:32:04.847305 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 806/1564] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:03 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1316 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:04.859001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9970c585-5e39-4063-8308-334e30267f79 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:04.859624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9970c585-5e39-4063-8308-334e30267f79 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:04.866047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9970c585-5e39-4063-8308-334e30267f79 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:04.867084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9970c585-5e39-4063-8308-334e30267f79 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:04.867895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9970c585-5e39-4063-8308-334e30267f79 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:04.868598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9970c585-5e39-4063-8308-334e30267f79 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:05.064086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c31f355e-8dd0-4d19-9435-d0bc51353506 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:05.079297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c31f355e-8dd0-4d19-9435-d0bc51353506 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:05.082490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c31f355e-8dd0-4d19-9435-d0bc51353506 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:05.084109 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c31f355e-8dd0-4d19-9435-d0bc51353506 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1477 microversion: 2.25 time: 0.483983 Jul 14 14:32:05.085298 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 759/1565] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:04 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1477 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:32:05.227254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9970c585-5e39-4063-8308-334e30267f79 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:05.237487 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9970c585-5e39-4063-8308-334e30267f79 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 200 len: 1520 microversion: 2.1 time: 0.385704 Jul 14 14:32:05.242966 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 807/1566] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:04 2022] GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:05.248529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6f57fdb3-cfe8-422a-b794-589aca02f5f7 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:05.249186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6f57fdb3-cfe8-422a-b794-589aca02f5f7 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:05.256230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f57fdb3-cfe8-422a-b794-589aca02f5f7 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:05.256992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f57fdb3-cfe8-422a-b794-589aca02f5f7 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:05.257969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f57fdb3-cfe8-422a-b794-589aca02f5f7 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:05.258590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f57fdb3-cfe8-422a-b794-589aca02f5f7 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:05.434582 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-79fd3c37-b24b-4c98-8da3-33e7efc4e521 tempest-TenantUsagesNegativeTestJSON-1780240468 tempest-TenantUsagesNegativeTestJSON-1780240468-project-admin] 10.222.0.81 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-13T14%3A32%3A05.024082&end=2022-07-15T14%3A32%3A05.024082" status: 404 len: 112 microversion: - time: 0.347933 Jul 14 14:32:05.439533 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 760/1567] 10.222.0.81 () {58 vars in 1315 bytes} [Thu Jul 14 14:32:05 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-13T14%3A32%3A05.024082&end=2022-07-15T14%3A32%3A05.024082 => generated 112 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 14:32:05.447834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8651c590-7904-40cc-a005-4830a648afee tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.81"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:05.450318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8651c590-7904-40cc-a005-4830a648afee tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:05.471085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8651c590-7904-40cc-a005-4830a648afee tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:05.471558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8651c590-7904-40cc-a005-4830a648afee tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:05.473249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8651c590-7904-40cc-a005-4830a648afee tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:05.474025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8651c590-7904-40cc-a005-4830a648afee tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:05.475303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-6f57fdb3-cfe8-422a-b794-589aca02f5f7 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid de6d06d9-90ef-4a73-843a-778f0c146dff {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:32:05.498765 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6f57fdb3-cfe8-422a-b794-589aca02f5f7 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1972 microversion: 2.25 time: 0.253929 Jul 14 14:32:05.499708 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 808/1568] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:05 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1972 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:05.505124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-28f50542-5741-44a7-9fc9-0b43296c9160 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:05.506131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-28f50542-5741-44a7-9fc9-0b43296c9160 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:05.515462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28f50542-5741-44a7-9fc9-0b43296c9160 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:05.516922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28f50542-5741-44a7-9fc9-0b43296c9160 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:05.519099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28f50542-5741-44a7-9fc9-0b43296c9160 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:05.519757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28f50542-5741-44a7-9fc9-0b43296c9160 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:05.539381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8651c590-7904-40cc-a005-4830a648afee tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Acquired lock "refresh_cache-435cc8e8-78b1-4af2-8cba-a8f23344e4d2" {{(pid=119511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:32:05.943237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-28f50542-5741-44a7-9fc9-0b43296c9160 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:05.956009 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-28f50542-5741-44a7-9fc9-0b43296c9160 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 0.454620 Jul 14 14:32:05.967500 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 809/1569] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:05 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:05.973702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6747f692-855f-4c52-bcb4-0c67080b0c2f tempest-TenantUsagesNegativeTestJSON-1780240468 tempest-TenantUsagesNegativeTestJSON-1780240468-project-admin] Calling method '.version_select at 0x7fd6c5881a60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:05.980195 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-6747f692-855f-4c52-bcb4-0c67080b0c2f tempest-TenantUsagesNegativeTestJSON-1780240468 tempest-TenantUsagesNegativeTestJSON-1780240468-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6747f692-855f-4c52-bcb4-0c67080b0c2f tempest-TenantUsagesNegativeTestJSON-1780240468 tempest-TenantUsagesNegativeTestJSON-1780240468-project-admin] Request method failure captured: Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-simple-tenant-usage/45976f9946504c80890918a45f20787e?start=2022-07-15T14%3A32%3A05.024082&end=2022-07-13T14%3A32%3A05.024082 HTTP/1.1 Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cjk3_D1Ze7wydZBYizsIAcnw-aNpKvwl8Qq5_Iw--vn2hDTno7pgiopJTaTWa1ISgq7jzO9TWOMvpqwQrCjbEAT0C4kn4Izyk_ffISY_Fp4o9yK74utBbHnbRSdM1vJ7zeqtuvEgRX0PdfWQ9Tk1963nomAYEg9qUFHTk_O2mZzh-A Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a7bef2fccae64ca5a50a87c74e713b8a Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1780240468 Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a7bef2fccae64ca5a50a87c74e713b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a7bef2fccae64ca5a50a87c74e713b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a7bef2fccae64ca5a50a87c74e713b8a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a7bef2fccae64ca5a50a87c74e713b8a"}]}] Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1780240468 Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a7bef2fccae64ca5a50a87c74e713b8a Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1780240468 Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TenantUsagesNegativeTestJSON-1780240468-project-admin Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: e98e2264c725429fbc5a3736d1c6b523 Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1780240468-project-admin Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid start time. The start time cannot occur after the end time. Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '45976f9946504c80890918a45f20787e'} Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 14 14:32:05.982791 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:32:05.992098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6747f692-855f-4c52-bcb4-0c67080b0c2f tempest-TenantUsagesNegativeTestJSON-1780240468 tempest-TenantUsagesNegativeTestJSON-1780240468-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:32:05.994650 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6747f692-855f-4c52-bcb4-0c67080b0c2f tempest-TenantUsagesNegativeTestJSON-1780240468 tempest-TenantUsagesNegativeTestJSON-1780240468-project-admin] 10.222.0.81 "GET /compute/v2.1/os-simple-tenant-usage/45976f9946504c80890918a45f20787e?start=2022-07-15T14%3A32%3A05.024082&end=2022-07-13T14%3A32%3A05.024082" status: 400 len: 111 microversion: 2.1 time: 0.024523 Jul 14 14:32:05.995976 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 810/1570] 10.222.0.81 () {58 vars in 1411 bytes} [Thu Jul 14 14:32:05 2022] GET /compute/v2.1/os-simple-tenant-usage/45976f9946504c80890918a45f20787e?start=2022-07-15T14%3A32%3A05.024082&end=2022-07-13T14%3A32%3A05.024082 => generated 111 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:32:06.001568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-79d03063-b86a-421d-a735-7ad4e666b9f2 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:06.002932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-79d03063-b86a-421d-a735-7ad4e666b9f2 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:06.013394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79d03063-b86a-421d-a735-7ad4e666b9f2 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:06.014455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79d03063-b86a-421d-a735-7ad4e666b9f2 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:06.015593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79d03063-b86a-421d-a735-7ad4e666b9f2 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:06.016313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79d03063-b86a-421d-a735-7ad4e666b9f2 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:06.317723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-79d03063-b86a-421d-a735-7ad4e666b9f2 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid de6d06d9-90ef-4a73-843a-778f0c146dff {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:32:06.366652 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-79d03063-b86a-421d-a735-7ad4e666b9f2 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1972 microversion: 2.25 time: 0.369367 Jul 14 14:32:06.373801 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 811/1571] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:05 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1972 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:06.378868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-03894dd3-9d2d-41f7-b65a-90b0837c406f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:06.379618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-03894dd3-9d2d-41f7-b65a-90b0837c406f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:06.388277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03894dd3-9d2d-41f7-b65a-90b0837c406f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:06.399318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03894dd3-9d2d-41f7-b65a-90b0837c406f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:06.401016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03894dd3-9d2d-41f7-b65a-90b0837c406f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:06.401711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03894dd3-9d2d-41f7-b65a-90b0837c406f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:06.840001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-03894dd3-9d2d-41f7-b65a-90b0837c406f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:06.851520 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-03894dd3-9d2d-41f7-b65a-90b0837c406f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1316 microversion: 2.1 time: 0.475477 Jul 14 14:32:06.853535 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 812/1572] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:06 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:07.098102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab811c86-5d1b-4545-b36b-2df8b2835b03 tempest-TenantUsagesNegativeTestJSON-811390281 tempest-TenantUsagesNegativeTestJSON-811390281-project] Calling method '.version_select at 0x7fd6c5a30670>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:07.100325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab811c86-5d1b-4545-b36b-2df8b2835b03 tempest-TenantUsagesNegativeTestJSON-811390281 tempest-TenantUsagesNegativeTestJSON-811390281-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '00bb8fde2a774ca6822b1248f84e368d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45976f9946504c80890918a45f20787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab811c86-5d1b-4545-b36b-2df8b2835b03 tempest-TenantUsagesNegativeTestJSON-811390281 tempest-TenantUsagesNegativeTestJSON-811390281-project] Request method failure captured: Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-13T14%3A32%3A05.024082&end=2022-07-15T14%3A32%3A05.024082&detailed=1 HTTP/1.1 Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CjjngFHc4geRINtR_RpsedlXUdMjy2gcPqFu4LUdRdN-rj4Bz6i4gJlNiEn-MR0y4UWAo_eBU-9jt5EeyxZA5bLYAuqAcMQCXuXdZrcbeA7-GfLgXpllUnXdyvWzQwXhewH1CnJC85wheJeG-O_epfbOqg1qp-nTMMzudqnAS37xWM Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 45976f9946504c80890918a45f20787e Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-811390281 Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/45976f9946504c80890918a45f20787e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/45976f9946504c80890918a45f20787e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_45976f9946504c80890918a45f20787e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/45976f9946504c80890918a45f20787e"}]}] Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-811390281 Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 45976f9946504c80890918a45f20787e Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-811390281 Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TenantUsagesNegativeTestJSON-811390281-project Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 00bb8fde2a774ca6822b1248f84e368d Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-811390281-project Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: action_args: {} Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:32:07.101997 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab811c86-5d1b-4545-b36b-2df8b2835b03 tempest-TenantUsagesNegativeTestJSON-811390281 tempest-TenantUsagesNegativeTestJSON-811390281-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ab811c86-5d1b-4545-b36b-2df8b2835b03 tempest-TenantUsagesNegativeTestJSON-811390281 tempest-TenantUsagesNegativeTestJSON-811390281-project] 10.222.0.81 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-13T14%3A32%3A05.024082&end=2022-07-15T14%3A32%3A05.024082&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.248466 Jul 14 14:32:07.110606 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 813/1573] 10.222.0.81 () {58 vars in 1334 bytes} [Thu Jul 14 14:32:06 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-13T14%3A32%3A05.024082&end=2022-07-15T14%3A32%3A05.024082&detailed=1 => generated 123 bytes in 255 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:32:07.115745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b931d6b-a812-4088-88ee-6efc4e980b57 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:07.116262 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:32:07.116262 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:32:07.117638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b931d6b-a812-4088-88ee-6efc4e980b57 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:07.118096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b931d6b-a812-4088-88ee-6efc4e980b57 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:07.119550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b931d6b-a812-4088-88ee-6efc4e980b57 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:07.119997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b931d6b-a812-4088-88ee-6efc4e980b57 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:07.150286 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0b931d6b-a812-4088-88ee-6efc4e980b57 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.039324 Jul 14 14:32:07.151385 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 814/1574] 10.222.0.81 () {60 vars in 1216 bytes} [Thu Jul 14 14:32:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:32:07.156435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e6693b7c-86fb-4bb7-a944-82d59434c4db tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:07.157440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e6693b7c-86fb-4bb7-a944-82d59434c4db tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:07.164371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6693b7c-86fb-4bb7-a944-82d59434c4db tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:07.165261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6693b7c-86fb-4bb7-a944-82d59434c4db tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:07.166454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6693b7c-86fb-4bb7-a944-82d59434c4db tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:07.167265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6693b7c-86fb-4bb7-a944-82d59434c4db tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:07.443121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-8651c590-7904-40cc-a005-4830a648afee tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Building network info cache for instance {{(pid=119511) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:32:07.472119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e6693b7c-86fb-4bb7-a944-82d59434c4db tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:07.486468 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e6693b7c-86fb-4bb7-a944-82d59434c4db tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 0.333981 Jul 14 14:32:07.489243 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 815/1575] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:07 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:07.502069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-075e6d56-4bea-4687-b05f-0bbe1045bc0c tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-767704-28", "block_migration": "auto"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:07.503474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-075e6d56-4bea-4687-b05f-0bbe1045bc0c tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:07.519244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-075e6d56-4bea-4687-b05f-0bbe1045bc0c tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:07.519711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-075e6d56-4bea-4687-b05f-0bbe1045bc0c tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:07.520510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-075e6d56-4bea-4687-b05f-0bbe1045bc0c tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:07.523829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-075e6d56-4bea-4687-b05f-0bbe1045bc0c tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:07.600086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-075e6d56-4bea-4687-b05f-0bbe1045bc0c tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'flavor' on Instance uuid de6d06d9-90ef-4a73-843a-778f0c146dff {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:32:07.612315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:07.638098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-075e6d56-4bea-4687-b05f-0bbe1045bc0c tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Going to try to live migrate instance to n-h1-767704-28 {{(pid=119512) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:32:07.974339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=22 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:08.683614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-8651c590-7904-40cc-a005-4830a648afee tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Updating instance_info_cache with network_info: [{"id": "b2bcf02b-437a-4cb3-924e-770f54b60aec", "address": "fa:16:3e:a6:95:2b", "network": {"id": "ae04b1c7-9ca7-4252-9de9-6ca895e5f620", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1453524383-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "613f5ab64c38455dad4973c1c974e87f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb2bcf02b-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119511) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:32:08.702251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8651c590-7904-40cc-a005-4830a648afee tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Releasing lock "refresh_cache-435cc8e8-78b1-4af2-8cba-a8f23344e4d2" {{(pid=119511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:32:08.703692 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8651c590-7904-40cc-a005-4830a648afee tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "POST /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2/action" status: 202 len: 0 microversion: 2.1 time: 3.267262 Jul 14 14:32:08.706589 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 761/1576] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:32:05 2022] POST /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2/action => generated 0 bytes in 3270 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:32:08.818568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:09.142357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-16beac4b-860f-4f63-bc28-62b5701de947 req-84321ad9-8bb4-454e-8fdc-72ee13c787fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435cc8e8-78b1-4af2-8cba-a8f23344e4d2", "tag": "b2bcf02b-437a-4cb3-924e-770f54b60aec"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:09.157977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-16beac4b-860f-4f63-bc28-62b5701de947 req-84321ad9-8bb4-454e-8fdc-72ee13c787fe service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:09.159613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-16beac4b-860f-4f63-bc28-62b5701de947 req-84321ad9-8bb4-454e-8fdc-72ee13c787fe service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:09.186270 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-16beac4b-860f-4f63-bc28-62b5701de947 req-84321ad9-8bb4-454e-8fdc-72ee13c787fe service nova] Creating event network-changed:b2bcf02b-437a-4cb3-924e-770f54b60aec for instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 on n-h1-767704-28 Jul 14 14:32:09.199037 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-16beac4b-860f-4f63-bc28-62b5701de947 req-84321ad9-8bb4-454e-8fdc-72ee13c787fe service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490672 Jul 14 14:32:09.200166 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 762/1577] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:09.207267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5aba175-fb6c-475f-9c0c-7f78640d0a01 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:09.208426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e5aba175-fb6c-475f-9c0c-7f78640d0a01 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:09.216796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5aba175-fb6c-475f-9c0c-7f78640d0a01 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:09.217300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5aba175-fb6c-475f-9c0c-7f78640d0a01 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:09.218251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5aba175-fb6c-475f-9c0c-7f78640d0a01 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:09.218702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5aba175-fb6c-475f-9c0c-7f78640d0a01 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:09.944755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e5aba175-fb6c-475f-9c0c-7f78640d0a01 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:09.953525 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e5aba175-fb6c-475f-9c0c-7f78640d0a01 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1316 microversion: 2.1 time: 0.751833 Jul 14 14:32:09.954132 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 763/1578] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:09 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1316 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:09.968900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-697693ce-9eb1-4000-b0e9-d5bcefddd80f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:09.969556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-697693ce-9eb1-4000-b0e9-d5bcefddd80f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:09.975805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-697693ce-9eb1-4000-b0e9-d5bcefddd80f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:09.976273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-697693ce-9eb1-4000-b0e9-d5bcefddd80f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:09.977107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-697693ce-9eb1-4000-b0e9-d5bcefddd80f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:09.979733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-697693ce-9eb1-4000-b0e9-d5bcefddd80f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:10.341943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-697693ce-9eb1-4000-b0e9-d5bcefddd80f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:10.351947 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-697693ce-9eb1-4000-b0e9-d5bcefddd80f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 0.386912 Jul 14 14:32:10.356990 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 764/1579] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:09 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:10.362245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.81"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:10.365925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:10.408560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:10.410276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:10.413118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:10.417490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:10.458555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Acquired lock "refresh_cache-b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" {{(pid=119511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:32:10.891776 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-075e6d56-4bea-4687-b05f-0bbe1045bc0c tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff/action" status: 202 len: 0 microversion: 2.25 time: 3.401142 Jul 14 14:32:10.892543 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 816/1580] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 14:32:07 2022] POST /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff/action => generated 0 bytes in 3403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:32:10.916461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-d53a65db-26e8-44a9-9257-13a579a2dab1 req-702474e0-cc17-4c0f-96e2-056133f73bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea89554c-b395-4813-8c65-81afc2ae89ec", "name": "network-vif-plugged", "status": "completed", "tag": "7a6cfe65-45f8-4c9e-9bea-76a19c294b1f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:10.952887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d53a65db-26e8-44a9-9257-13a579a2dab1 req-702474e0-cc17-4c0f-96e2-056133f73bcb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:10.954543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d53a65db-26e8-44a9-9257-13a579a2dab1 req-702474e0-cc17-4c0f-96e2-056133f73bcb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:11.007687 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-d53a65db-26e8-44a9-9257-13a579a2dab1 req-702474e0-cc17-4c0f-96e2-056133f73bcb service nova] Creating event network-vif-plugged:7a6cfe65-45f8-4c9e-9bea-76a19c294b1f for instance ea89554c-b395-4813-8c65-81afc2ae89ec on n-h2-767704-28 Jul 14 14:32:11.030243 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-d53a65db-26e8-44a9-9257-13a579a2dab1 req-702474e0-cc17-4c0f-96e2-056133f73bcb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128262 Jul 14 14:32:11.033078 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 817/1581] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:11.045331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18a65835-6793-42fd-a7c2-1a80b3a56e6a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:11.049390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-18a65835-6793-42fd-a7c2-1a80b3a56e6a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:11.072137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18a65835-6793-42fd-a7c2-1a80b3a56e6a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:11.073495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18a65835-6793-42fd-a7c2-1a80b3a56e6a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:11.074846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18a65835-6793-42fd-a7c2-1a80b3a56e6a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:11.076065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18a65835-6793-42fd-a7c2-1a80b3a56e6a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:11.494851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18a65835-6793-42fd-a7c2-1a80b3a56e6a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:11.503729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18a65835-6793-42fd-a7c2-1a80b3a56e6a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:11.508484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18a65835-6793-42fd-a7c2-1a80b3a56e6a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:11.513550 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-18a65835-6793-42fd-a7c2-1a80b3a56e6a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 0.477314 Jul 14 14:32:11.517074 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 818/1582] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:11 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:11.521922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9fb9577c-022d-4910-a7b2-c01fd4c3dfb1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:11.525671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9fb9577c-022d-4910-a7b2-c01fd4c3dfb1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:11.539949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9fb9577c-022d-4910-a7b2-c01fd4c3dfb1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:11.543558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9fb9577c-022d-4910-a7b2-c01fd4c3dfb1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:11.544481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9fb9577c-022d-4910-a7b2-c01fd4c3dfb1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:11.544969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9fb9577c-022d-4910-a7b2-c01fd4c3dfb1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:11.771699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9fb9577c-022d-4910-a7b2-c01fd4c3dfb1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:11.782752 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9fb9577c-022d-4910-a7b2-c01fd4c3dfb1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1316 microversion: 2.1 time: 0.264471 Jul 14 14:32:11.785348 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 819/1583] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:11 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:11.803711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b563df4e-e928-4c9a-a5da-e52c441e3957 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:11.804300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b563df4e-e928-4c9a-a5da-e52c441e3957 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:11.823751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b563df4e-e928-4c9a-a5da-e52c441e3957 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:11.824205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b563df4e-e928-4c9a-a5da-e52c441e3957 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:11.825143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b563df4e-e928-4c9a-a5da-e52c441e3957 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:11.833349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b563df4e-e928-4c9a-a5da-e52c441e3957 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:11.880877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b563df4e-e928-4c9a-a5da-e52c441e3957 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:32:12.003423 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b563df4e-e928-4c9a-a5da-e52c441e3957 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 204 len: 0 microversion: 2.1 time: 0.214777 Jul 14 14:32:12.010405 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 820/1584] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:32:11 2022] DELETE /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:32:12.020831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2ede04d4-04d1-4f70-90c3-5a21ebb0153d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:12.022227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2ede04d4-04d1-4f70-90c3-5a21ebb0153d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:12.029928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ede04d4-04d1-4f70-90c3-5a21ebb0153d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:12.030887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ede04d4-04d1-4f70-90c3-5a21ebb0153d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:12.032075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ede04d4-04d1-4f70-90c3-5a21ebb0153d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:12.032763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ede04d4-04d1-4f70-90c3-5a21ebb0153d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:12.341596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2ede04d4-04d1-4f70-90c3-5a21ebb0153d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:12.349922 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2ede04d4-04d1-4f70-90c3-5a21ebb0153d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 0.337546 Jul 14 14:32:12.352780 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 821/1585] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:12 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:12.363936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd479676-e7af-47a2-b79b-99eea26abfc0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:12.365596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bd479676-e7af-47a2-b79b-99eea26abfc0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:12.385780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd479676-e7af-47a2-b79b-99eea26abfc0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:12.392181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd479676-e7af-47a2-b79b-99eea26abfc0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:12.393666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd479676-e7af-47a2-b79b-99eea26abfc0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:12.394723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd479676-e7af-47a2-b79b-99eea26abfc0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:12.718757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bd479676-e7af-47a2-b79b-99eea26abfc0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:12.731588 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bd479676-e7af-47a2-b79b-99eea26abfc0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1554 microversion: 2.1 time: 0.377621 Jul 14 14:32:12.732173 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 822/1586] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:12 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1554 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:12.748933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1a10ce5d-1e21-442d-bae4-1b7e730d9727 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:12.754075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1a10ce5d-1e21-442d-bae4-1b7e730d9727 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:12.772337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a10ce5d-1e21-442d-bae4-1b7e730d9727 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:12.791301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a10ce5d-1e21-442d-bae4-1b7e730d9727 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:12.793053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a10ce5d-1e21-442d-bae4-1b7e730d9727 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:12.796478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a10ce5d-1e21-442d-bae4-1b7e730d9727 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:13.246987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a10ce5d-1e21-442d-bae4-1b7e730d9727 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:13.258165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a10ce5d-1e21-442d-bae4-1b7e730d9727 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:13.263922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a10ce5d-1e21-442d-bae4-1b7e730d9727 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:13.270459 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1a10ce5d-1e21-442d-bae4-1b7e730d9727 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 0.532502 Jul 14 14:32:13.272907 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 823/1587] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:12 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:13.283981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9036a9ea-3811-4826-b5e1-891e1a354721 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:13.285610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9036a9ea-3811-4826-b5e1-891e1a354721 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:13.304577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9036a9ea-3811-4826-b5e1-891e1a354721 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:13.305215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9036a9ea-3811-4826-b5e1-891e1a354721 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:13.306355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9036a9ea-3811-4826-b5e1-891e1a354721 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:13.306939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9036a9ea-3811-4826-b5e1-891e1a354721 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:14.236922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9036a9ea-3811-4826-b5e1-891e1a354721 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:14.254513 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9036a9ea-3811-4826-b5e1-891e1a354721 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1466 microversion: 2.1 time: 0.978285 Jul 14 14:32:14.257531 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 824/1588] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:13 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1466 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:14.276300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1983f021-3495-4e5a-8363-18b6f85656fa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:14.277547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1983f021-3495-4e5a-8363-18b6f85656fa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:14.302453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1983f021-3495-4e5a-8363-18b6f85656fa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:14.304920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1983f021-3495-4e5a-8363-18b6f85656fa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:14.312117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1983f021-3495-4e5a-8363-18b6f85656fa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:14.312906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1983f021-3495-4e5a-8363-18b6f85656fa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:14.898017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1983f021-3495-4e5a-8363-18b6f85656fa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:14.914434 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1983f021-3495-4e5a-8363-18b6f85656fa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1496 microversion: 2.1 time: 0.653650 Jul 14 14:32:14.915957 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 825/1589] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:14 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1496 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:14.961884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1ad81af6-3bea-4aef-b136-9b570f1a9d53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:14.962578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1ad81af6-3bea-4aef-b136-9b570f1a9d53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:14.979797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ad81af6-3bea-4aef-b136-9b570f1a9d53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:14.980254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ad81af6-3bea-4aef-b136-9b570f1a9d53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:14.981076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ad81af6-3bea-4aef-b136-9b570f1a9d53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:14.981526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ad81af6-3bea-4aef-b136-9b570f1a9d53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:15.292785 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.network.neutron [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] re-assign floating IP 172.25.8.81 from instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 Jul 14 14:32:15.397490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1ad81af6-3bea-4aef-b136-9b570f1a9d53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:15.406674 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1ad81af6-3bea-4aef-b136-9b570f1a9d53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1554 microversion: 2.1 time: 0.482603 Jul 14 14:32:15.417477 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 826/1590] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:14 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1554 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:15.464606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Building network info cache for instance {{(pid=119511) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:32:15.910695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c7ac9f19-40cf-466d-af22-e74da19fb837 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:15.911275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c7ac9f19-40cf-466d-af22-e74da19fb837 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:15.923720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7ac9f19-40cf-466d-af22-e74da19fb837 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:15.924175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7ac9f19-40cf-466d-af22-e74da19fb837 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:15.927231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7ac9f19-40cf-466d-af22-e74da19fb837 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:15.927903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7ac9f19-40cf-466d-af22-e74da19fb837 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:16.569802 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c7ac9f19-40cf-466d-af22-e74da19fb837 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1619 microversion: 2.1 time: 1.151083 Jul 14 14:32:16.577869 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 827/1591] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:15 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1619 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:16.590610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ae3cd525-e74a-4f92-bc87-25d5df7be3ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:16.593866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ae3cd525-e74a-4f92-bc87-25d5df7be3ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:16.623788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae3cd525-e74a-4f92-bc87-25d5df7be3ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:16.624283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae3cd525-e74a-4f92-bc87-25d5df7be3ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:16.628161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae3cd525-e74a-4f92-bc87-25d5df7be3ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:16.628668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae3cd525-e74a-4f92-bc87-25d5df7be3ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:16.866246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Updating instance_info_cache with network_info: [{"id": "b2bcf02b-437a-4cb3-924e-770f54b60aec", "address": "fa:16:3e:a6:95:2b", "network": {"id": "ae04b1c7-9ca7-4252-9de9-6ca895e5f620", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1453524383-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "613f5ab64c38455dad4973c1c974e87f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb2bcf02b-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119511) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:32:16.868935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:16.899530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Building network info cache for instance {{(pid=119511) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:32:17.130524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:18.094736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ae3cd525-e74a-4f92-bc87-25d5df7be3ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:18.115210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ae3cd525-e74a-4f92-bc87-25d5df7be3ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:18.126182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ae3cd525-e74a-4f92-bc87-25d5df7be3ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:18.134215 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ae3cd525-e74a-4f92-bc87-25d5df7be3ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 1.554071 Jul 14 14:32:18.147505 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 828/1592] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:16 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:18.165547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e75f8dbe-e231-440e-9ed0-b440026437e8 req-5d72ac45-f04d-4e45-8d73-4e1d650d9a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435cc8e8-78b1-4af2-8cba-a8f23344e4d2", "tag": "b2bcf02b-437a-4cb3-924e-770f54b60aec"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:18.201020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e75f8dbe-e231-440e-9ed0-b440026437e8 req-5d72ac45-f04d-4e45-8d73-4e1d650d9a41 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:18.209576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e75f8dbe-e231-440e-9ed0-b440026437e8 req-5d72ac45-f04d-4e45-8d73-4e1d650d9a41 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:18.236658 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e75f8dbe-e231-440e-9ed0-b440026437e8 req-5d72ac45-f04d-4e45-8d73-4e1d650d9a41 service nova] Creating event network-changed:b2bcf02b-437a-4cb3-924e-770f54b60aec for instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 on n-h1-767704-28 Jul 14 14:32:18.250696 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e75f8dbe-e231-440e-9ed0-b440026437e8 req-5d72ac45-f04d-4e45-8d73-4e1d650d9a41 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096019 Jul 14 14:32:18.251915 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 829/1593] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:18.263981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1d7f5f8e-3126-4ebd-8593-4c5dc4806dc6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:18.270543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1d7f5f8e-3126-4ebd-8593-4c5dc4806dc6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:18.284246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d7f5f8e-3126-4ebd-8593-4c5dc4806dc6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:18.285179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d7f5f8e-3126-4ebd-8593-4c5dc4806dc6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:18.286183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d7f5f8e-3126-4ebd-8593-4c5dc4806dc6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:18.286808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d7f5f8e-3126-4ebd-8593-4c5dc4806dc6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:18.730921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1d7f5f8e-3126-4ebd-8593-4c5dc4806dc6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:18.749781 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1d7f5f8e-3126-4ebd-8593-4c5dc4806dc6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 200 len: 1473 microversion: 2.1 time: 0.492064 Jul 14 14:32:18.751775 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 830/1594] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:18 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 1473 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:18.769315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4cd692e6-386e-4689-9e3d-e5f57435f0cf tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:18.775435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4cd692e6-386e-4689-9e3d-e5f57435f0cf tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:18.786036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cd692e6-386e-4689-9e3d-e5f57435f0cf tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:18.787830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cd692e6-386e-4689-9e3d-e5f57435f0cf tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:18.791791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cd692e6-386e-4689-9e3d-e5f57435f0cf tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:18.792482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cd692e6-386e-4689-9e3d-e5f57435f0cf tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:18.803324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:19.152770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4cd692e6-386e-4689-9e3d-e5f57435f0cf tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:19.168004 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4cd692e6-386e-4689-9e3d-e5f57435f0cf tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1346 microversion: 2.1 time: 0.415044 Jul 14 14:32:19.182797 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 831/1595] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:18 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1346 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:19.195386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-56f6b42e-f3cf-40cf-be39-ecc954ccdfed tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Action: 'create', calling method: .version_select at 0x7fd6c5af6c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-118656095", "policies": ["affinity"]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:19.245902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-56f6b42e-f3cf-40cf-be39-ecc954ccdfed tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:19.265364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-56f6b42e-f3cf-40cf-be39-ecc954ccdfed tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:19.273747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:19.340981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Updating instance_info_cache with network_info: [{"id": "23b65fb5-ae6d-47eb-8c0d-db4e65375aa5", "address": "fa:16:3e:ff:90:cd", "network": {"id": "ae04b1c7-9ca7-4252-9de9-6ca895e5f620", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1453524383-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "613f5ab64c38455dad4973c1c974e87f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap23b65fb5-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119511) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:32:19.359845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Releasing lock "refresh_cache-b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" {{(pid=119511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:32:19.361735 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a4a7734d-89fd-4654-94d3-45c069bdebd9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "POST /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11/action" status: 202 len: 0 microversion: 2.1 time: 9.002938 Jul 14 14:32:19.363003 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 765/1596] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:32:10 2022] POST /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11/action => generated 0 bytes in 9005 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:32:19.372679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-5ad90dee-acab-4885-9fb0-a70c8b37cbe2 req-b486de35-b564-4370-bc0b-7ef784424dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7767fb3d-af95-439d-8bf7-385758969bce", "name": "network-vif-deleted", "tag": "43c170a0-942c-45eb-a087-8588c42c2aaf"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:19.380144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-56f6b42e-f3cf-40cf-be39-ecc954ccdfed tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:19.393939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5ad90dee-acab-4885-9fb0-a70c8b37cbe2 req-b486de35-b564-4370-bc0b-7ef784424dbd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:19.395594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5ad90dee-acab-4885-9fb0-a70c8b37cbe2 req-b486de35-b564-4370-bc0b-7ef784424dbd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:19.396867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-56f6b42e-f3cf-40cf-be39-ecc954ccdfed tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:19.428597 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-5ad90dee-acab-4885-9fb0-a70c8b37cbe2 req-b486de35-b564-4370-bc0b-7ef784424dbd service nova] Creating event network-vif-deleted:43c170a0-942c-45eb-a087-8588c42c2aaf for instance 7767fb3d-af95-439d-8bf7-385758969bce on n-h1-767704-28 Jul 14 14:32:19.440056 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-5ad90dee-acab-4885-9fb0-a70c8b37cbe2 req-b486de35-b564-4370-bc0b-7ef784424dbd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075454 Jul 14 14:32:19.442864 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-56f6b42e-f3cf-40cf-be39-ecc954ccdfed tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.258494 Jul 14 14:32:19.443481 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 766/1597] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:19.444036 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 832/1598] 10.222.0.81 () {60 vars in 1173 bytes} [Thu Jul 14 14:32:19 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:19.455355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-05cdce22-7eff-4b79-9af5-1fe373e27433 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1145926913"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:19.461978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8fc6034c-a2d1-48e6-aed9-06f22e10dd9c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:19.466163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8fc6034c-a2d1-48e6-aed9-06f22e10dd9c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:19.472670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-05cdce22-7eff-4b79-9af5-1fe373e27433 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:19.482247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8fc6034c-a2d1-48e6-aed9-06f22e10dd9c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:19.485699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8fc6034c-a2d1-48e6-aed9-06f22e10dd9c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:19.486875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8fc6034c-a2d1-48e6-aed9-06f22e10dd9c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:19.490077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8fc6034c-a2d1-48e6-aed9-06f22e10dd9c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:19.520297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05cdce22-7eff-4b79-9af5-1fe373e27433 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:19.521324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05cdce22-7eff-4b79-9af5-1fe373e27433 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:19.522771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05cdce22-7eff-4b79-9af5-1fe373e27433 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:19.523553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05cdce22-7eff-4b79-9af5-1fe373e27433 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:19.827093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8fc6034c-a2d1-48e6-aed9-06f22e10dd9c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:19.841575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8fc6034c-a2d1-48e6-aed9-06f22e10dd9c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:19.843481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8fc6034c-a2d1-48e6-aed9-06f22e10dd9c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:19.848689 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8fc6034c-a2d1-48e6-aed9-06f22e10dd9c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 0.391952 Jul 14 14:32:19.849557 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 833/1599] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:19 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:19.870377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af19ec15-fadd-4654-859b-b501ce693db7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.81"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:20.204714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-af19ec15-fadd-4654-859b-b501ce693db7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:20.214551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af19ec15-fadd-4654-859b-b501ce693db7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:20.216664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af19ec15-fadd-4654-859b-b501ce693db7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:20.218164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af19ec15-fadd-4654-859b-b501ce693db7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:20.219099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af19ec15-fadd-4654-859b-b501ce693db7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:20.375907 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-05cdce22-7eff-4b79-9af5-1fe373e27433 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "POST /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0/action" status: 202 len: 0 microversion: 2.1 time: 0.930473 Jul 14 14:32:20.378953 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 767/1600] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:32:19 2022] POST /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0/action => generated 0 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:32:20.391778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1033056486", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8f903015-f899-4c1c-a569-d0d95fdea4a2"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:20.500764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:32:20.805970 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-af19ec15-fadd-4654-859b-b501ce693db7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] HTTP exception thrown: Floating IP 172.25.8.81 is not associated with instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2. Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af19ec15-fadd-4654-859b-b501ce693db7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Request method failure captured: Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2/action HTTP/1.1 Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 48 Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CixTc2__vuWJwPanxRtaForuX8PQXcNoKTZrSOn8PappAuYSakIgirbSLFUFRKNlDaHVkQw15YIYJo0NxyEqVF6AdMawgehRamUVY9_6WlsfoAxJrCL5gZHtHL_q0odGFoWWO_8yILI57v_Kxx22301GD_audS_eQ5UO5-WCOCQSqk Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 613f5ab64c38455dad4973c1c974e87f Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1223940907 Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/613f5ab64c38455dad4973c1c974e87f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/613f5ab64c38455dad4973c1c974e87f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_613f5ab64c38455dad4973c1c974e87f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/613f5ab64c38455dad4973c1c974e87f"}]}] Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1223940907 Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 613f5ab64c38455dad4973c1c974e87f Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1223940907 Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-FloatingIPsAssociationTestJSON-1223940907-project Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 30626a18f38d467da445eaa2b56faf5e Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1223940907-project Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: {"removeFloatingIp": {"address": "172.25.8.81"}} Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: exception: Floating IP 172.25.8.81 is not associated with instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2. Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '435cc8e8-78b1-4af2-8cba-a8f23344e4d2', 'body': {'removeFloatingIp': {'address': '172.25.8.81'}}} Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.8.81 is not associated with instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2. Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.8.81 is not associated with instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2. Jul 14 14:32:20.808099 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:32:20.815507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af19ec15-fadd-4654-859b-b501ce693db7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Returning 409 to user: Floating IP 172.25.8.81 is not associated with instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:32:20.816565 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af19ec15-fadd-4654-859b-b501ce693db7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "POST /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2/action" status: 409 len: 145 microversion: 2.1 time: 0.963898 Jul 14 14:32:20.817736 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 834/1601] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:32:19 2022] POST /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2/action => generated 145 bytes in 967 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:32:20.823788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b59c9d8f-516b-4dc6-b605-a8fc38045317 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:20.832327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b59c9d8f-516b-4dc6-b605-a8fc38045317 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:20.843851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b59c9d8f-516b-4dc6-b605-a8fc38045317 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:20.845603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b59c9d8f-516b-4dc6-b605-a8fc38045317 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:20.847207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b59c9d8f-516b-4dc6-b605-a8fc38045317 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:20.851554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b59c9d8f-516b-4dc6-b605-a8fc38045317 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:21.090861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b59c9d8f-516b-4dc6-b605-a8fc38045317 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:21.119438 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b59c9d8f-516b-4dc6-b605-a8fc38045317 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1346 microversion: 2.1 time: 0.300320 Jul 14 14:32:21.126065 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 835/1602] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:20 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1346 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:21.147688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f3673d96-e63a-4085-b805-7bc805c1a2ed req-bc34d034-78de-4a29-99a7-0d0919b76e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b300ae9d-bf6b-4bc5-bd30-d88db00a9f11", "tag": "23b65fb5-ae6d-47eb-8c0d-db4e65375aa5"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:21.163834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:32:21.164259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:32:21.164801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:32:21.165843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:32:21.166276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:32:21.195524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f3673d96-e63a-4085-b805-7bc805c1a2ed req-bc34d034-78de-4a29-99a7-0d0919b76e4a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:21.196681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f3673d96-e63a-4085-b805-7bc805c1a2ed req-bc34d034-78de-4a29-99a7-0d0919b76e4a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:21.207692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:21.213404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:21.214479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:21.214939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:21.246777 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f3673d96-e63a-4085-b805-7bc805c1a2ed req-bc34d034-78de-4a29-99a7-0d0919b76e4a service nova] Creating event network-changed:23b65fb5-ae6d-47eb-8c0d-db4e65375aa5 for instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 on n-h1-767704-28 Jul 14 14:32:21.278463 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f3673d96-e63a-4085-b805-7bc805c1a2ed req-bc34d034-78de-4a29-99a7-0d0919b76e4a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150698 Jul 14 14:32:21.290417 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 836/1603] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:21.303674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b6553d6d-2c1e-4bdc-b190-f01b349d5c2e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5ad4c10>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:21.317213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:21.327971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:21.335073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=3,nova_api:UPDATE=14,nova_api:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:21.386620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Going to run 2 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:32:21.392283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ae5e79cc-1b63-403c-b5ed-83db2b2f1b98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:32:21.431931 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b6553d6d-2c1e-4bdc-b190-f01b349d5c2e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae" status: 200 len: 1414 microversion: 2.1 time: 0.137142 Jul 14 14:32:21.439713 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 837/1604] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:32:21 2022] GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae => generated 1414 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:21.462095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1e61d54e-e3cd-497f-848e-e6b4c3d589c5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.81"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:21.488256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119511) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 14 14:32:21.576541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:21.592219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:21.811901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:21.853722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:21.895357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: c13590db-1680-4b10-b598-cc2eb89d8b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=ae5e79cc-1b63-403c-b5ed-83db2b2f1b98,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:32:22.045306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:22.062604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:22.080838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1e61d54e-e3cd-497f-848e-e6b4c3d589c5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:22.094570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e61d54e-e3cd-497f-848e-e6b4c3d589c5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:22.096243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e61d54e-e3cd-497f-848e-e6b4c3d589c5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:22.098484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e61d54e-e3cd-497f-848e-e6b4c3d589c5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:22.106082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e61d54e-e3cd-497f-848e-e6b4c3d589c5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:22.217851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:22.235176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:22.350086 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e09b486c-c247-4d88-9a71-44932db9e08e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.968490 Jul 14 14:32:22.357311 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 768/1605] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:32:20 2022] POST /compute/v2.1/servers => generated 32 bytes in 1976 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:32:22.378009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4a975073-faa2-4966-8320-624b3e68bc2d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:22.378676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4a975073-faa2-4966-8320-624b3e68bc2d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:22.406727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4a975073-faa2-4966-8320-624b3e68bc2d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:22.412476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4a975073-faa2-4966-8320-624b3e68bc2d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:22.414055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4a975073-faa2-4966-8320-624b3e68bc2d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:22.422289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4a975073-faa2-4966-8320-624b3e68bc2d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:23.062629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4a975073-faa2-4966-8320-624b3e68bc2d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:23.075956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4a975073-faa2-4966-8320-624b3e68bc2d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:23.082237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4a975073-faa2-4966-8320-624b3e68bc2d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:23.083798 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4a975073-faa2-4966-8320-624b3e68bc2d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 0.725401 Jul 14 14:32:23.088778 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 769/1606] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:22 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:23.098748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e2e2ec6-bcc8-4124-b43d-78a9730cfd24 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:23.102728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5e2e2ec6-bcc8-4124-b43d-78a9730cfd24 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:23.113045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e61d54e-e3cd-497f-848e-e6b4c3d589c5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Acquired lock "refresh_cache-b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:32:23.121480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e2e2ec6-bcc8-4124-b43d-78a9730cfd24 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:23.122345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e2e2ec6-bcc8-4124-b43d-78a9730cfd24 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:23.127357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e2e2ec6-bcc8-4124-b43d-78a9730cfd24 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:23.129590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e2e2ec6-bcc8-4124-b43d-78a9730cfd24 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:23.437861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5e2e2ec6-bcc8-4124-b43d-78a9730cfd24 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:23.495119 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5e2e2ec6-bcc8-4124-b43d-78a9730cfd24 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1346 microversion: 2.1 time: 0.399349 Jul 14 14:32:23.499310 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 770/1607] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:23 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1346 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:23.536696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f8c93ee6-d6ad-44bf-9d7b-f904a665b8c6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:23.562625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f8c93ee6-d6ad-44bf-9d7b-f904a665b8c6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:23.566693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f8c93ee6-d6ad-44bf-9d7b-f904a665b8c6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Searching by: {'deleted': False, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:32:23.646779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8c93ee6-d6ad-44bf-9d7b-f904a665b8c6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:23.648202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8c93ee6-d6ad-44bf-9d7b-f904a665b8c6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:23.651838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8c93ee6-d6ad-44bf-9d7b-f904a665b8c6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:23.653258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8c93ee6-d6ad-44bf-9d7b-f904a665b8c6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:23.941260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-f8c93ee6-d6ad-44bf-9d7b-f904a665b8c6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:32:24.365750 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f8c93ee6-d6ad-44bf-9d7b-f904a665b8c6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.863194 Jul 14 14:32:24.387978 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 771/1608] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 14:32:23 2022] GET /compute/v2.1/servers => generated 1003 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:24.402959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-660b669d-d65e-4e25-9bed-28837648d551 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5b6e430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:24.518278 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-660b669d-d65e-4e25-9bed-28837648d551 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae" status: 200 len: 1414 microversion: 2.1 time: 0.127406 Jul 14 14:32:24.519596 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 772/1609] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:32:24 2022] GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:24.529111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9b37d367-90ae-417e-9364-13ef58a953ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:24.530114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9b37d367-90ae-417e-9364-13ef58a953ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:24.537753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b37d367-90ae-417e-9364-13ef58a953ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:24.538653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b37d367-90ae-417e-9364-13ef58a953ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:24.540355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b37d367-90ae-417e-9364-13ef58a953ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:24.541082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b37d367-90ae-417e-9364-13ef58a953ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:25.965016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9b37d367-90ae-417e-9364-13ef58a953ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:25.982729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9b37d367-90ae-417e-9364-13ef58a953ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:25.994162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9b37d367-90ae-417e-9364-13ef58a953ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:25.998633 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9b37d367-90ae-417e-9364-13ef58a953ff tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 1.477375 Jul 14 14:32:26.002394 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 773/1610] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:24 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:26.030675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dad261d0-b6ee-49ec-ab77-6db876d894ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:26.052021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dad261d0-b6ee-49ec-ab77-6db876d894ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: c13590db-1680-4b10-b598-cc2eb89d8b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:26.074590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dad261d0-b6ee-49ec-ab77-6db876d894ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:26.076664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dad261d0-b6ee-49ec-ab77-6db876d894ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:26.077921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dad261d0-b6ee-49ec-ab77-6db876d894ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:26.093174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dad261d0-b6ee-49ec-ab77-6db876d894ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:26.473424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dad261d0-b6ee-49ec-ab77-6db876d894ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:26.494759 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dad261d0-b6ee-49ec-ab77-6db876d894ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32" status: 200 len: 1279 microversion: 2.1 time: 0.467808 Jul 14 14:32:26.499510 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 774/1611] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:26 2022] GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32 => generated 1279 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:26.506011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e19b05de-5e70-4645-84e2-766d4d30181a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:26.523794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e19b05de-5e70-4645-84e2-766d4d30181a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:26.549499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e19b05de-5e70-4645-84e2-766d4d30181a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:26.550158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e19b05de-5e70-4645-84e2-766d4d30181a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:26.557721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e19b05de-5e70-4645-84e2-766d4d30181a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:26.560201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e19b05de-5e70-4645-84e2-766d4d30181a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:26.916004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e19b05de-5e70-4645-84e2-766d4d30181a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:26.942474 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e19b05de-5e70-4645-84e2-766d4d30181a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1346 microversion: 2.1 time: 0.441480 Jul 14 14:32:26.945892 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 775/1612] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:26 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1346 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:26.957016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cd2f7e47-361e-4fad-85bb-25af3627aa06 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5b70a60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:27.074134 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cd2f7e47-361e-4fad-85bb-25af3627aa06 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae" status: 200 len: 1414 microversion: 2.1 time: 0.120915 Jul 14 14:32:27.076193 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 776/1613] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:32:26 2022] GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:27.241682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-36329171", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "97aae583-0c00-438b-9ac0-cc1bedf25ead"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:27.354941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] validate_networks() for [('97aae583-0c00-438b-9ac0-cc1bedf25ead', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:32:29.422888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:29.716204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:32:29.717395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:32:29.718366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:32:29.719028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:32:29.719926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:32:29.755383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:29.757050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:29.759684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:29.768845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:29.830439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-1e61d54e-e3cd-497f-848e-e6b4c3d589c5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Building network info cache for instance {{(pid=119512) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:32:29.843807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Getting quotas for project 5079370e8fc54d589eb69e64bad2b577. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:29.859620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Getting quotas for user 28c076b33cd448cbbe1072c832055540 and project 5079370e8fc54d589eb69e64bad2b577. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:29.956310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:32:29.964126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] [instance: c41e883f-f0f0-4ac0-82c6-11bde64c33de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:32:30.167169 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-90795f6f-272e-4a92-9897-d037b0a73ee2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.088964 Jul 14 14:32:30.172696 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 777/1614] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:32:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:32:30.188931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-744abe27-f995-4562-92a6-9df57b41fbf8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:30.195258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-744abe27-f995-4562-92a6-9df57b41fbf8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:30.229737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-744abe27-f995-4562-92a6-9df57b41fbf8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:30.233446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-744abe27-f995-4562-92a6-9df57b41fbf8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:30.238997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-744abe27-f995-4562-92a6-9df57b41fbf8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:30.239961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-744abe27-f995-4562-92a6-9df57b41fbf8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:32.086480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:32.448800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-744abe27-f995-4562-92a6-9df57b41fbf8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:32.484669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-744abe27-f995-4562-92a6-9df57b41fbf8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:32.491162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-744abe27-f995-4562-92a6-9df57b41fbf8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:32.502583 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-744abe27-f995-4562-92a6-9df57b41fbf8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 2.325574 Jul 14 14:32:32.512399 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 778/1615] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:30 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 2338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:32.535394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6eee7000-a986-40f0-ab7c-4f2dd72e45a0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:32.536032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6eee7000-a986-40f0-ab7c-4f2dd72e45a0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: c13590db-1680-4b10-b598-cc2eb89d8b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:32.565705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6eee7000-a986-40f0-ab7c-4f2dd72e45a0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:32.570878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6eee7000-a986-40f0-ab7c-4f2dd72e45a0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:32.571937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6eee7000-a986-40f0-ab7c-4f2dd72e45a0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:32.573862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6eee7000-a986-40f0-ab7c-4f2dd72e45a0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:33.879007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6eee7000-a986-40f0-ab7c-4f2dd72e45a0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:33.893752 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6eee7000-a986-40f0-ab7c-4f2dd72e45a0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32" status: 200 len: 1319 microversion: 2.1 time: 1.380079 Jul 14 14:32:33.910064 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 779/1616] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:32 2022] GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32 => generated 1319 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:33.919934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-577beb3b-cb90-4740-9799-25a1654b8e40 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:33.923562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-577beb3b-cb90-4740-9799-25a1654b8e40 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:33.950153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-577beb3b-cb90-4740-9799-25a1654b8e40 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:33.950624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-577beb3b-cb90-4740-9799-25a1654b8e40 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:33.951420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-577beb3b-cb90-4740-9799-25a1654b8e40 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:33.956874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-577beb3b-cb90-4740-9799-25a1654b8e40 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:34.603882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-577beb3b-cb90-4740-9799-25a1654b8e40 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:34.640015 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-577beb3b-cb90-4740-9799-25a1654b8e40 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1346 microversion: 2.1 time: 0.727269 Jul 14 14:32:34.644422 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 780/1617] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:33 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1346 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:34.659642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-555be261-0c29-440b-9b69-16e3b297229b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c63f3af0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:34.800519 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-555be261-0c29-440b-9b69-16e3b297229b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae" status: 200 len: 1414 microversion: 2.1 time: 0.153522 Jul 14 14:32:34.801909 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 781/1618] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:32:34 2022] GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae => generated 1414 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:34.821658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4b164e40-8dbb-446a-aa4d-58c2cae81980 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:34.825125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4b164e40-8dbb-446a-aa4d-58c2cae81980 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] [instance: c41e883f-f0f0-4ac0-82c6-11bde64c33de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:34.845608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b164e40-8dbb-446a-aa4d-58c2cae81980 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:34.846451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b164e40-8dbb-446a-aa4d-58c2cae81980 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:34.848351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b164e40-8dbb-446a-aa4d-58c2cae81980 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:34.849066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b164e40-8dbb-446a-aa4d-58c2cae81980 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:35.091245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-1e61d54e-e3cd-497f-848e-e6b4c3d589c5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Updating instance_info_cache with network_info: [{"id": "23b65fb5-ae6d-47eb-8c0d-db4e65375aa5", "address": "fa:16:3e:ff:90:cd", "network": {"id": "ae04b1c7-9ca7-4252-9de9-6ca895e5f620", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1453524383-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "613f5ab64c38455dad4973c1c974e87f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap23b65fb5-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119512) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:32:35.104454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4b164e40-8dbb-446a-aa4d-58c2cae81980 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c076b33cd448cbbe1072c832055540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5079370e8fc54d589eb69e64bad2b577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:35.119923 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4b164e40-8dbb-446a-aa4d-58c2cae81980 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] 10.222.0.81 "GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de" status: 200 len: 1272 microversion: 2.1 time: 0.316478 Jul 14 14:32:35.122796 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 782/1619] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:34 2022] GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de => generated 1272 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:35.123103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e61d54e-e3cd-497f-848e-e6b4c3d589c5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Releasing lock "refresh_cache-b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:32:35.124640 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1e61d54e-e3cd-497f-848e-e6b4c3d589c5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "POST /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11/action" status: 202 len: 0 microversion: 2.1 time: 13.683059 Jul 14 14:32:35.126784 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 838/1620] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:32:21 2022] POST /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11/action => generated 0 bytes in 13686 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:32:35.150137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-8c015d7d-1fa2-44c0-b5d5-2b6b79259c04 req-c3330d7c-704e-4ec8-a806-12cfa1b36fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c850b90e-27fa-4f9a-bd80-6704843cb1a0", "name": "network-vif-plugged", "status": "completed", "tag": "b97d1e15-3c4f-492e-8519-79383a6b7f04"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:35.155813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-187049a0-2cb5-488f-add8-53efc0547b11 req-3aa38528-f4f6-4a44-b73e-89ecf0014e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b300ae9d-bf6b-4bc5-bd30-d88db00a9f11", "tag": "23b65fb5-ae6d-47eb-8c0d-db4e65375aa5"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:35.180564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8c015d7d-1fa2-44c0-b5d5-2b6b79259c04 req-c3330d7c-704e-4ec8-a806-12cfa1b36fd7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:35.185151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8c015d7d-1fa2-44c0-b5d5-2b6b79259c04 req-c3330d7c-704e-4ec8-a806-12cfa1b36fd7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:35.201137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-187049a0-2cb5-488f-add8-53efc0547b11 req-3aa38528-f4f6-4a44-b73e-89ecf0014e28 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:35.202507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-187049a0-2cb5-488f-add8-53efc0547b11 req-3aa38528-f4f6-4a44-b73e-89ecf0014e28 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:35.236484 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-8c015d7d-1fa2-44c0-b5d5-2b6b79259c04 req-c3330d7c-704e-4ec8-a806-12cfa1b36fd7 service nova] Creating event network-vif-plugged:b97d1e15-3c4f-492e-8519-79383a6b7f04 for instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 on n-h2-767704-28 Jul 14 14:32:35.256435 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-8c015d7d-1fa2-44c0-b5d5-2b6b79259c04 req-c3330d7c-704e-4ec8-a806-12cfa1b36fd7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120849 Jul 14 14:32:35.257448 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-187049a0-2cb5-488f-add8-53efc0547b11 req-3aa38528-f4f6-4a44-b73e-89ecf0014e28 service nova] Creating event network-changed:23b65fb5-ae6d-47eb-8c0d-db4e65375aa5 for instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 on n-h1-767704-28 Jul 14 14:32:35.261269 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 839/1621] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:35.277579 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-187049a0-2cb5-488f-add8-53efc0547b11 req-3aa38528-f4f6-4a44-b73e-89ecf0014e28 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148741 Jul 14 14:32:35.285585 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 783/1622] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:35.289442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6329284c-5a9a-47a0-92ff-8da402f4f553 req-aac31f51-40ab-4370-bf1b-6364a99faea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13590db-1680-4b10-b598-cc2eb89d8b32", "tag": "cf68efb1-cc06-4e24-864e-f40811e389f0"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:35.305885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-327270a3-e066-48f5-ad46-1947a4568ec4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:35.315297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-327270a3-e066-48f5-ad46-1947a4568ec4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:35.331766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6329284c-5a9a-47a0-92ff-8da402f4f553 req-aac31f51-40ab-4370-bf1b-6364a99faea2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:35.332587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:35.335052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6329284c-5a9a-47a0-92ff-8da402f4f553 req-aac31f51-40ab-4370-bf1b-6364a99faea2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:35.340802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-327270a3-e066-48f5-ad46-1947a4568ec4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:35.344496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-327270a3-e066-48f5-ad46-1947a4568ec4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:35.345787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-327270a3-e066-48f5-ad46-1947a4568ec4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:35.350488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-327270a3-e066-48f5-ad46-1947a4568ec4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:35.368414 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6329284c-5a9a-47a0-92ff-8da402f4f553 req-aac31f51-40ab-4370-bf1b-6364a99faea2 service nova] Creating event network-changed:cf68efb1-cc06-4e24-864e-f40811e389f0 for instance c13590db-1680-4b10-b598-cc2eb89d8b32 on n-h1-767704-28 Jul 14 14:32:35.398341 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6329284c-5a9a-47a0-92ff-8da402f4f553 req-aac31f51-40ab-4370-bf1b-6364a99faea2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135202 Jul 14 14:32:35.404986 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 840/1623] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:35.428474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-faf9ecdc-a805-4a64-9b0d-938d95a38914 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:35.430301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-faf9ecdc-a805-4a64-9b0d-938d95a38914 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: c13590db-1680-4b10-b598-cc2eb89d8b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:35.473410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-faf9ecdc-a805-4a64-9b0d-938d95a38914 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:35.474374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-faf9ecdc-a805-4a64-9b0d-938d95a38914 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:35.475517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-faf9ecdc-a805-4a64-9b0d-938d95a38914 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:35.476501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-faf9ecdc-a805-4a64-9b0d-938d95a38914 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:36.071120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-327270a3-e066-48f5-ad46-1947a4568ec4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:36.074320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:36.090754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-327270a3-e066-48f5-ad46-1947a4568ec4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:36.092414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-327270a3-e066-48f5-ad46-1947a4568ec4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:36.118658 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-327270a3-e066-48f5-ad46-1947a4568ec4 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 0.829805 Jul 14 14:32:36.129834 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 784/1624] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:35 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:36.144299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-095bfa4e-29be-4212-aeac-dae29ac6b5d9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:36.144763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-095bfa4e-29be-4212-aeac-dae29ac6b5d9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:36.181045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-095bfa4e-29be-4212-aeac-dae29ac6b5d9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:36.201096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-095bfa4e-29be-4212-aeac-dae29ac6b5d9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:36.204883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-095bfa4e-29be-4212-aeac-dae29ac6b5d9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:36.209145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-095bfa4e-29be-4212-aeac-dae29ac6b5d9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:36.388276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-095bfa4e-29be-4212-aeac-dae29ac6b5d9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:32:36.795365 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-095bfa4e-29be-4212-aeac-dae29ac6b5d9 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 204 len: 0 microversion: 2.1 time: 0.664035 Jul 14 14:32:36.803636 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 785/1625] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:32:36 2022] DELETE /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:32:36.829526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6a802726-3065-4689-a8b8-82bbe84a70e0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:36.830264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6a802726-3065-4689-a8b8-82bbe84a70e0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:36.861951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a802726-3065-4689-a8b8-82bbe84a70e0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:36.862411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a802726-3065-4689-a8b8-82bbe84a70e0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:36.863310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a802726-3065-4689-a8b8-82bbe84a70e0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:36.877503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a802726-3065-4689-a8b8-82bbe84a70e0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:36.985617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a802726-3065-4689-a8b8-82bbe84a70e0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:36.986087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a802726-3065-4689-a8b8-82bbe84a70e0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:36.986551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-6a802726-3065-4689-a8b8-82bbe84a70e0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lazy-loading 'fault' on Instance uuid 7767fb3d-af95-439d-8bf7-385758969bce {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:32:37.205720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-faf9ecdc-a805-4a64-9b0d-938d95a38914 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:37.220378 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-faf9ecdc-a805-4a64-9b0d-938d95a38914 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32" status: 200 len: 1319 microversion: 2.1 time: 1.807700 Jul 14 14:32:37.226954 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 841/1626] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:35 2022] GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32 => generated 1319 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:37.243986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e16c6250-a09e-4f50-aff0-e153882e0daa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5b5c430>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:37.343049 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e16c6250-a09e-4f50-aff0-e153882e0daa tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae" status: 200 len: 1414 microversion: 2.1 time: 0.110576 Jul 14 14:32:37.343759 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 842/1627] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:32:37 2022] GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:37.354392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9689bd1c-12c3-4ba3-873c-4ef459c9f0d2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:37.355581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9689bd1c-12c3-4ba3-873c-4ef459c9f0d2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] [instance: c41e883f-f0f0-4ac0-82c6-11bde64c33de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:37.364639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9689bd1c-12c3-4ba3-873c-4ef459c9f0d2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:37.365571 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9689bd1c-12c3-4ba3-873c-4ef459c9f0d2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:37.366659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9689bd1c-12c3-4ba3-873c-4ef459c9f0d2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:37.367869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9689bd1c-12c3-4ba3-873c-4ef459c9f0d2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:37.581858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6a802726-3065-4689-a8b8-82bbe84a70e0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:37.618686 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6a802726-3065-4689-a8b8-82bbe84a70e0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 200 len: 1351 microversion: 2.1 time: 0.805842 Jul 14 14:32:37.621267 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 786/1628] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:36 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 1351 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:37.627510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-492742772", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "6831672f-d329-4243-a142-ff7ed2c51723"}], "block_device_mapping_v2": [{"uuid": "ce43d2b3-3861-430e-b87e-ebf624f05c37", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:37.763393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] validate_networks() for [('6831672f-d329-4243-a142-ff7ed2c51723', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:32:38.634889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9689bd1c-12c3-4ba3-873c-4ef459c9f0d2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c076b33cd448cbbe1072c832055540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5079370e8fc54d589eb69e64bad2b577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:38.654815 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9689bd1c-12c3-4ba3-873c-4ef459c9f0d2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] 10.222.0.81 "GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de" status: 200 len: 1314 microversion: 2.1 time: 1.309589 Jul 14 14:32:38.657260 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 843/1629] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:37 2022] GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de => generated 1314 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:38.669761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2647f85e-1c5d-420e-a6c6-cabdaad70b5b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.81"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:38.675026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2647f85e-1c5d-420e-a6c6-cabdaad70b5b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:38.694542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2647f85e-1c5d-420e-a6c6-cabdaad70b5b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:38.699319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2647f85e-1c5d-420e-a6c6-cabdaad70b5b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:38.703420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2647f85e-1c5d-420e-a6c6-cabdaad70b5b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:38.705318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2647f85e-1c5d-420e-a6c6-cabdaad70b5b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:38.779798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2647f85e-1c5d-420e-a6c6-cabdaad70b5b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Acquired lock "refresh_cache-435cc8e8-78b1-4af2-8cba-a8f23344e4d2" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:32:39.811904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:39.927380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=28 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:40.939515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:32:40.940214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:32:40.940416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:32:40.941100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:32:40.941740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:32:40.967804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:40.970125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:40.972322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:40.976274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:41.018292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Getting quotas for project eb57648abd7742d9aac69af1744d6bc1. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:41.027338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Getting quotas for user 5c688cde0ea44a059b0bca3e020c28b3 and project eb57648abd7742d9aac69af1744d6bc1. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:41.110390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:32:41.113142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce43d2b3-3861-430e-b87e-ebf624f05c37',volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:32:41.371913 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fe38d90a-89f5-4f5c-a1ee-fcc8a254551b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.749299 Jul 14 14:32:41.373397 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 787/1630] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:32:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:32:41.381835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-988d67ba-e0e8-4638-8fce-9e6ec3e51de6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:41.383590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-988d67ba-e0e8-4638-8fce-9e6ec3e51de6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:41.404649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-988d67ba-e0e8-4638-8fce-9e6ec3e51de6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:41.414725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-988d67ba-e0e8-4638-8fce-9e6ec3e51de6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:41.421996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-988d67ba-e0e8-4638-8fce-9e6ec3e51de6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:41.428484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-988d67ba-e0e8-4638-8fce-9e6ec3e51de6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:42.409587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-988d67ba-e0e8-4638-8fce-9e6ec3e51de6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:42.421529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-988d67ba-e0e8-4638-8fce-9e6ec3e51de6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:42.423135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-988d67ba-e0e8-4638-8fce-9e6ec3e51de6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:42.426754 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-988d67ba-e0e8-4638-8fce-9e6ec3e51de6 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 1.051446 Jul 14 14:32:42.432201 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 788/1631] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:41 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:42.445745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-45263792-8675-4d1a-8284-05216ebfced2 req-5a9d8ad8-b957-49fe-9858-81835edf4f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c41e883f-f0f0-4ac0-82c6-11bde64c33de", "tag": "d4849642-ca0b-4042-b8c0-edd1efd02f8a"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:42.470515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-45263792-8675-4d1a-8284-05216ebfced2 req-5a9d8ad8-b957-49fe-9858-81835edf4f06 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:42.471330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-45263792-8675-4d1a-8284-05216ebfced2 req-5a9d8ad8-b957-49fe-9858-81835edf4f06 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:42.498560 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-45263792-8675-4d1a-8284-05216ebfced2 req-5a9d8ad8-b957-49fe-9858-81835edf4f06 service nova] Creating event network-changed:d4849642-ca0b-4042-b8c0-edd1efd02f8a for instance c41e883f-f0f0-4ac0-82c6-11bde64c33de on n-h1-767704-28 Jul 14 14:32:42.515864 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-45263792-8675-4d1a-8284-05216ebfced2 req-5a9d8ad8-b957-49fe-9858-81835edf4f06 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082261 Jul 14 14:32:42.517284 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 789/1632] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:42.529137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a3463a93-2a7a-4174-ade9-16426b6dcde3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:42.532781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a3463a93-2a7a-4174-ade9-16426b6dcde3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: c13590db-1680-4b10-b598-cc2eb89d8b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:42.549997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3463a93-2a7a-4174-ade9-16426b6dcde3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:42.550920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3463a93-2a7a-4174-ade9-16426b6dcde3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:42.551959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3463a93-2a7a-4174-ade9-16426b6dcde3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:42.556691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3463a93-2a7a-4174-ade9-16426b6dcde3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:42.946420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a3463a93-2a7a-4174-ade9-16426b6dcde3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:42.963708 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a3463a93-2a7a-4174-ade9-16426b6dcde3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32" status: 200 len: 1319 microversion: 2.1 time: 0.444893 Jul 14 14:32:42.967022 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 790/1633] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:42 2022] GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:42.997422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-01c6b632-5fb4-4426-b8e4-c84cdbeb081a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5b6e160>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:43.075096 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-01c6b632-5fb4-4426-b8e4-c84cdbeb081a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae" status: 200 len: 1414 microversion: 2.1 time: 0.093601 Jul 14 14:32:43.087865 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 791/1634] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:32:42 2022] GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:43.095293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a3c13d94-75f7-42bd-9452-5ab75f3c8df9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:43.108458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a3c13d94-75f7-42bd-9452-5ab75f3c8df9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:43.117974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3c13d94-75f7-42bd-9452-5ab75f3c8df9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:43.127876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3c13d94-75f7-42bd-9452-5ab75f3c8df9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:43.128918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3c13d94-75f7-42bd-9452-5ab75f3c8df9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:43.129579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3c13d94-75f7-42bd-9452-5ab75f3c8df9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:43.168714 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-a3c13d94-75f7-42bd-9452-5ab75f3c8df9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a3c13d94-75f7-42bd-9452-5ab75f3c8df9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce HTTP/1.1 Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '7767fb3d-af95-439d-8bf7-385758969bce'} Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:43.171102 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:43.178173 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:43.178173 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:43.178173 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:43.178173 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:32:43.178173 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:32:43.178173 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:32:43.178173 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:43.180688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a3c13d94-75f7-42bd-9452-5ab75f3c8df9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:32:43.182424 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a3c13d94-75f7-42bd-9452-5ab75f3c8df9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 404 len: 111 microversion: 2.1 time: 0.093029 Jul 14 14:32:43.184406 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 792/1635] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:43 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:32:43.199155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-26458dc5-3d23-450e-b9ee-e698b9da4fb2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:43.199712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-26458dc5-3d23-450e-b9ee-e698b9da4fb2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] [instance: c41e883f-f0f0-4ac0-82c6-11bde64c33de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:43.222938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26458dc5-3d23-450e-b9ee-e698b9da4fb2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:43.223417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26458dc5-3d23-450e-b9ee-e698b9da4fb2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:43.224271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26458dc5-3d23-450e-b9ee-e698b9da4fb2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:43.224719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26458dc5-3d23-450e-b9ee-e698b9da4fb2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:43.536397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-2647f85e-1c5d-420e-a6c6-cabdaad70b5b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Building network info cache for instance {{(pid=119512) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:32:44.350349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-26458dc5-3d23-450e-b9ee-e698b9da4fb2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c076b33cd448cbbe1072c832055540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5079370e8fc54d589eb69e64bad2b577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:44.366933 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-26458dc5-3d23-450e-b9ee-e698b9da4fb2 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] 10.222.0.81 "GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de" status: 200 len: 1314 microversion: 2.1 time: 1.176176 Jul 14 14:32:44.368678 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 793/1636] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:43 2022] GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de => generated 1314 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:44.395369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-7a8dbe52-96ea-41d8-b24a-b81d4cac3302 req-498f23b3-f23f-400c-ac86-1d1bcadf6696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae5e79cc-1b63-403c-b5ed-83db2b2f1b98", "tag": "b84c6666-dca9-49d7-a2ae-d3c4b1247ecb"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:44.418889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7a8dbe52-96ea-41d8-b24a-b81d4cac3302 req-498f23b3-f23f-400c-ac86-1d1bcadf6696 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:44.433757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7a8dbe52-96ea-41d8-b24a-b81d4cac3302 req-498f23b3-f23f-400c-ac86-1d1bcadf6696 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:44.454392 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-7a8dbe52-96ea-41d8-b24a-b81d4cac3302 req-498f23b3-f23f-400c-ac86-1d1bcadf6696 service nova] Creating event network-changed:b84c6666-dca9-49d7-a2ae-d3c4b1247ecb for instance ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 on n-h1-767704-28 Jul 14 14:32:44.471084 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-7a8dbe52-96ea-41d8-b24a-b81d4cac3302 req-498f23b3-f23f-400c-ac86-1d1bcadf6696 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099387 Jul 14 14:32:44.472108 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 794/1637] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:44.477963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d24650b3-6816-40fe-83f8-3a664e160195 req-29290293-e952-414e-9589-51b5692e3d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13590db-1680-4b10-b598-cc2eb89d8b32", "name": "network-vif-plugged", "status": "completed", "tag": "cf68efb1-cc06-4e24-864e-f40811e389f0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:44.515178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d24650b3-6816-40fe-83f8-3a664e160195 req-29290293-e952-414e-9589-51b5692e3d38 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:44.518559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d24650b3-6816-40fe-83f8-3a664e160195 req-29290293-e952-414e-9589-51b5692e3d38 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:44.586450 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d24650b3-6816-40fe-83f8-3a664e160195 req-29290293-e952-414e-9589-51b5692e3d38 service nova] Creating event network-vif-plugged:cf68efb1-cc06-4e24-864e-f40811e389f0 for instance c13590db-1680-4b10-b598-cc2eb89d8b32 on n-h1-767704-28 Jul 14 14:32:44.593674 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d24650b3-6816-40fe-83f8-3a664e160195 req-29290293-e952-414e-9589-51b5692e3d38 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119734 Jul 14 14:32:44.595470 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 795/1638] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:44.610586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-79727f09-03de-4f2a-a736-6c1d3539544b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:44.611948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-79727f09-03de-4f2a-a736-6c1d3539544b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:44.634434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79727f09-03de-4f2a-a736-6c1d3539544b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:44.650485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79727f09-03de-4f2a-a736-6c1d3539544b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:44.666291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79727f09-03de-4f2a-a736-6c1d3539544b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:44.667809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79727f09-03de-4f2a-a736-6c1d3539544b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:45.567627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-79727f09-03de-4f2a-a736-6c1d3539544b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:45.580543 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-79727f09-03de-4f2a-a736-6c1d3539544b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1168 microversion: 2.1 time: 0.982593 Jul 14 14:32:45.583787 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 796/1639] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:44 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1168 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:45.721929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-59664550-00c7-4945-822e-0e1f8a745006 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Calling method '.version_select at 0x7fd6c5ec4a60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:46.024939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-59664550-00c7-4945-822e-0e1f8a745006 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0c57f41c-a839-41d5-b750-2bd9ac65a111 does not exist", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:32:46.026507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.security_group_api [None req-59664550-00c7-4945-822e-0e1f8a745006 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Neutron security group 0c57f41c-a839-41d5-b750-2bd9ac65a111 not found {{(pid=119511) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:32:46.027883 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-59664550-00c7-4945-822e-0e1f8a745006 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] HTTP exception thrown: Security group 0c57f41c-a839-41d5-b750-2bd9ac65a111 does not exist Jul 14 14:32:46.027883 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-18421e63-74d9-4fe8-a3d3-d417595b8be4'] Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-59664550-00c7-4945-822e-0e1f8a745006 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Request method failure captured: Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-security-groups/0c57f41c-a839-41d5-b750-2bd9ac65a111 HTTP/1.1 Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CkJxJUA93zNfLHI4LbsTP-I0VC70oZ1FR8KgDhAJQLb9oAuzRT34bcdxcVbLVC7uKvTkbEoIS3-Ji_4gjdpXilrixQfl9XjW5-gigxMXr9hXeqA-QMzcGiIvHXAz2gytrPkQVklghKEsTXS-q-d53-zS6BsLOLgRVWCKiyRBjYI8yY Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 6ad36bd911694aa1ab506b2c50fee7e4 Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1254353761 Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ad36bd911694aa1ab506b2c50fee7e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6ad36bd911694aa1ab506b2c50fee7e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6ad36bd911694aa1ab506b2c50fee7e4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ad36bd911694aa1ab506b2c50fee7e4"}]}] Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1254353761 Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 6ad36bd911694aa1ab506b2c50fee7e4 Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1254353761 Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupsNegativeTestJSON-1254353761-project Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 83515185b7854a10a55d9686e37f66f3 Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1254353761-project Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: exception: Security group 0c57f41c-a839-41d5-b750-2bd9ac65a111 does not exist Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-18421e63-74d9-4fe8-a3d3-d417595b8be4'] Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0c57f41c-a839-41d5-b750-2bd9ac65a111'} Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:32:46.033719 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0c57f41c-a839-41d5-b750-2bd9ac65a111 does not exist Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18421e63-74d9-4fe8-a3d3-d417595b8be4'] Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0c57f41c-a839-41d5-b750-2bd9ac65a111 does not exist Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18421e63-74d9-4fe8-a3d3-d417595b8be4'] Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0c57f41c-a839-41d5-b750-2bd9ac65a111 does not exist Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18421e63-74d9-4fe8-a3d3-d417595b8be4'] Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0c57f41c-a839-41d5-b750-2bd9ac65a111 does not exist Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18421e63-74d9-4fe8-a3d3-d417595b8be4'] Jul 14 14:32:46.050125 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:46.060202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-59664550-00c7-4945-822e-0e1f8a745006 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Returning 404 to user: Security group 0c57f41c-a839-41d5-b750-2bd9ac65a111 does not exist Jul 14 14:32:46.060202 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-18421e63-74d9-4fe8-a3d3-d417595b8be4'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:32:46.064719 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-59664550-00c7-4945-822e-0e1f8a745006 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/0c57f41c-a839-41d5-b750-2bd9ac65a111" status: 404 len: 194 microversion: 2.1 time: 0.475842 Jul 14 14:32:46.069245 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 797/1640] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:32:45 2022] DELETE /compute/v2.1/os-security-groups/0c57f41c-a839-41d5-b750-2bd9ac65a111 => generated 194 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:32:46.082875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b1da2f62-b1a3-4bd6-a57c-de4484b380aa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:46.089599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b1da2f62-b1a3-4bd6-a57c-de4484b380aa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:46.104791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1da2f62-b1a3-4bd6-a57c-de4484b380aa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:46.106381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1da2f62-b1a3-4bd6-a57c-de4484b380aa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:46.110462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1da2f62-b1a3-4bd6-a57c-de4484b380aa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:46.112316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1da2f62-b1a3-4bd6-a57c-de4484b380aa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:46.156293 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b1da2f62-b1a3-4bd6-a57c-de4484b380aa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b1da2f62-b1a3-4bd6-a57c-de4484b380aa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce/os-volume_attachments HTTP/1.1 Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'server_id': '7767fb3d-af95-439d-8bf7-385758969bce'} Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:32:46.165601 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:32:46.178182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:32:46.178182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:46.178182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:46.178182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:46.178182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:46.178182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:46.178182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:46.178182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:32:46.178182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:32:46.178182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:32:46.178182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:46.184820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b1da2f62-b1a3-4bd6-a57c-de4484b380aa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:32:46.189782 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b1da2f62-b1a3-4bd6-a57c-de4484b380aa tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.117587 Jul 14 14:32:46.195758 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 798/1641] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:32:46 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce/os-volume_attachments => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:32:46.231973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-735ad78a-3567-4122-be4d-884f65a9f5ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:46.234261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-735ad78a-3567-4122-be4d-884f65a9f5ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:46.248186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-735ad78a-3567-4122-be4d-884f65a9f5ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:46.249567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-735ad78a-3567-4122-be4d-884f65a9f5ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:46.250899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-735ad78a-3567-4122-be4d-884f65a9f5ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:46.253089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-735ad78a-3567-4122-be4d-884f65a9f5ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:47.353553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-735ad78a-3567-4122-be4d-884f65a9f5ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:47.375067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-735ad78a-3567-4122-be4d-884f65a9f5ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:47.380101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-735ad78a-3567-4122-be4d-884f65a9f5ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:47.383585 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-735ad78a-3567-4122-be4d-884f65a9f5ed tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 1.168757 Jul 14 14:32:47.398367 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 799/1642] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:46 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:47.403626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-444d7396-3c7e-4469-95b2-c1db2fa677d7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:47.404553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-444d7396-3c7e-4469-95b2-c1db2fa677d7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: c13590db-1680-4b10-b598-cc2eb89d8b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:47.415226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-444d7396-3c7e-4469-95b2-c1db2fa677d7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:47.415985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-444d7396-3c7e-4469-95b2-c1db2fa677d7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:47.417094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-444d7396-3c7e-4469-95b2-c1db2fa677d7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:47.419123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-444d7396-3c7e-4469-95b2-c1db2fa677d7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:47.801296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-444d7396-3c7e-4469-95b2-c1db2fa677d7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:47.814850 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-444d7396-3c7e-4469-95b2-c1db2fa677d7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32" status: 200 len: 1319 microversion: 2.1 time: 0.414821 Jul 14 14:32:47.829252 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 800/1643] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:47 2022] GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:47.829252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5cad7598-369b-44e2-b705-91faa94d7578 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5b3c0d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:47.952299 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5cad7598-369b-44e2-b705-91faa94d7578 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae" status: 200 len: 1414 microversion: 2.1 time: 0.135308 Jul 14 14:32:47.957820 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 801/1644] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:32:47 2022] GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:47.969741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-83f26d93-7957-45de-90f8-60facb7d1d7c req-52501cac-47c7-43a4-a14b-eae64ca86e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b300ae9d-bf6b-4bc5-bd30-d88db00a9f11", "name": "network-vif-deleted", "tag": "23b65fb5-ae6d-47eb-8c0d-db4e65375aa5"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:48.004264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-83f26d93-7957-45de-90f8-60facb7d1d7c req-52501cac-47c7-43a4-a14b-eae64ca86e74 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:48.005327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-83f26d93-7957-45de-90f8-60facb7d1d7c req-52501cac-47c7-43a4-a14b-eae64ca86e74 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:48.038977 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-83f26d93-7957-45de-90f8-60facb7d1d7c req-52501cac-47c7-43a4-a14b-eae64ca86e74 service nova] Creating event network-vif-deleted:23b65fb5-ae6d-47eb-8c0d-db4e65375aa5 for instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 on n-h1-767704-28 Jul 14 14:32:48.057763 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-83f26d93-7957-45de-90f8-60facb7d1d7c req-52501cac-47c7-43a4-a14b-eae64ca86e74 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094518 Jul 14 14:32:48.064330 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 802/1645] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:48.087407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b5afee3f-08fe-47ad-9d23-0e10474bade8 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:48.089323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5afee3f-08fe-47ad-9d23-0e10474bade8 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] [instance: c41e883f-f0f0-4ac0-82c6-11bde64c33de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:48.098668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5afee3f-08fe-47ad-9d23-0e10474bade8 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:48.099565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5afee3f-08fe-47ad-9d23-0e10474bade8 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:48.101360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5afee3f-08fe-47ad-9d23-0e10474bade8 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:48.102052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5afee3f-08fe-47ad-9d23-0e10474bade8 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:48.687681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=10 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:48.805589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-2647f85e-1c5d-420e-a6c6-cabdaad70b5b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Updating instance_info_cache with network_info: [{"id": "b2bcf02b-437a-4cb3-924e-770f54b60aec", "address": "fa:16:3e:a6:95:2b", "network": {"id": "ae04b1c7-9ca7-4252-9de9-6ca895e5f620", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1453524383-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "613f5ab64c38455dad4973c1c974e87f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb2bcf02b-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119512) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:32:48.829838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2647f85e-1c5d-420e-a6c6-cabdaad70b5b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Releasing lock "refresh_cache-435cc8e8-78b1-4af2-8cba-a8f23344e4d2" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:32:48.833845 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2647f85e-1c5d-420e-a6c6-cabdaad70b5b tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "POST /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2/action" status: 202 len: 0 microversion: 2.1 time: 10.173459 Jul 14 14:32:48.834725 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 844/1646] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:32:38 2022] POST /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2/action => generated 0 bytes in 10177 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:32:48.852069 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aae26858-5918-48ef-a1a2-1770c03300d8 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.014655 Jul 14 14:32:48.860370 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 845/1647] 10.222.0.81 () {58 vars in 1163 bytes} [Thu Jul 14 14:32:48 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 14:32:48.878268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-572825866", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "e15a1c98-dd72-4729-94f4-9ad8a53d679a"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:48.974860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] validate_networks() for [('e15a1c98-dd72-4729-94f4-9ad8a53d679a', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:32:49.329647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b5afee3f-08fe-47ad-9d23-0e10474bade8 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c076b33cd448cbbe1072c832055540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5079370e8fc54d589eb69e64bad2b577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:49.349182 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b5afee3f-08fe-47ad-9d23-0e10474bade8 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] 10.222.0.81 "GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de" status: 200 len: 1314 microversion: 2.1 time: 1.282708 Jul 14 14:32:49.350665 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 803/1648] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:48 2022] GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de => generated 1314 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:49.365463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0c5b3d96-c826-4429-adb0-8634e8768704 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:49.369190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0c5b3d96-c826-4429-adb0-8634e8768704 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:49.376907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c5b3d96-c826-4429-adb0-8634e8768704 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:49.377399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c5b3d96-c826-4429-adb0-8634e8768704 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:49.378204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c5b3d96-c826-4429-adb0-8634e8768704 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:49.378644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c5b3d96-c826-4429-adb0-8634e8768704 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:49.880807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0c5b3d96-c826-4429-adb0-8634e8768704 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:49.898781 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0c5b3d96-c826-4429-adb0-8634e8768704 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1210 microversion: 2.1 time: 0.545365 Jul 14 14:32:49.899407 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 804/1649] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:49 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1210 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:49.904201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-59176565-c5fd-4db1-a4db-605ada212b5c req-455689e7-a1c9-4240-898e-aef418d6660e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435cc8e8-78b1-4af2-8cba-a8f23344e4d2", "tag": "b2bcf02b-437a-4cb3-924e-770f54b60aec"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:49.930760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-59176565-c5fd-4db1-a4db-605ada212b5c req-455689e7-a1c9-4240-898e-aef418d6660e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:49.930760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-59176565-c5fd-4db1-a4db-605ada212b5c req-455689e7-a1c9-4240-898e-aef418d6660e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:49.952605 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-59176565-c5fd-4db1-a4db-605ada212b5c req-455689e7-a1c9-4240-898e-aef418d6660e service nova] Creating event network-changed:b2bcf02b-437a-4cb3-924e-770f54b60aec for instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 on n-h1-767704-28 Jul 14 14:32:49.959361 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-59176565-c5fd-4db1-a4db-605ada212b5c req-455689e7-a1c9-4240-898e-aef418d6660e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058681 Jul 14 14:32:49.961377 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 805/1650] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:49.974765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-bf01e796-8fe6-4209-9d15-9dff912c1322 req-b7b026c0-35b7-4e1b-a5d7-330bf9846c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c41e883f-f0f0-4ac0-82c6-11bde64c33de", "name": "network-vif-plugged", "status": "completed", "tag": "d4849642-ca0b-4042-b8c0-edd1efd02f8a"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:49.995953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-bf01e796-8fe6-4209-9d15-9dff912c1322 req-b7b026c0-35b7-4e1b-a5d7-330bf9846c64 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:49.996441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-bf01e796-8fe6-4209-9d15-9dff912c1322 req-b7b026c0-35b7-4e1b-a5d7-330bf9846c64 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:50.017598 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-bf01e796-8fe6-4209-9d15-9dff912c1322 req-b7b026c0-35b7-4e1b-a5d7-330bf9846c64 service nova] Creating event network-vif-plugged:d4849642-ca0b-4042-b8c0-edd1efd02f8a for instance c41e883f-f0f0-4ac0-82c6-11bde64c33de on n-h1-767704-28 Jul 14 14:32:50.039531 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-bf01e796-8fe6-4209-9d15-9dff912c1322 req-b7b026c0-35b7-4e1b-a5d7-330bf9846c64 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076406 Jul 14 14:32:50.040918 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 806/1651] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:50.046514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7c73d1bd-e9a1-44ef-ac78-db5349409b26 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:50.047241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7c73d1bd-e9a1-44ef-ac78-db5349409b26 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:50.069641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c73d1bd-e9a1-44ef-ac78-db5349409b26 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:50.070320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c73d1bd-e9a1-44ef-ac78-db5349409b26 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:50.086789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c73d1bd-e9a1-44ef-ac78-db5349409b26 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:50.086789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c73d1bd-e9a1-44ef-ac78-db5349409b26 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:50.973821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c73d1bd-e9a1-44ef-ac78-db5349409b26 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:50.990311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c73d1bd-e9a1-44ef-ac78-db5349409b26 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:50.992393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c73d1bd-e9a1-44ef-ac78-db5349409b26 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:51.000050 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7c73d1bd-e9a1-44ef-ac78-db5349409b26 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 0.951658 Jul 14 14:32:51.001086 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 807/1652] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:50 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:51.013379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5469a6c7-15c7-409f-9887-a0e78163925f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:51.014160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5469a6c7-15c7-409f-9887-a0e78163925f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: c13590db-1680-4b10-b598-cc2eb89d8b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:51.029602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:51.042498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:51.055880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5469a6c7-15c7-409f-9887-a0e78163925f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:51.064999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5469a6c7-15c7-409f-9887-a0e78163925f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:51.066177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5469a6c7-15c7-409f-9887-a0e78163925f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:51.069956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5469a6c7-15c7-409f-9887-a0e78163925f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:51.128741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:51.345949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:32:51.346520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:32:51.346849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:32:51.347260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:32:51.347689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:32:51.371225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:51.372300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:51.372598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:51.372931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:51.399798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=56,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:51.435497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:51.451520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for user d56c219e943b4398bea8add8299df84f and project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:51.474169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:32:51.478931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:32:51.607183 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-82fb5b9f-2518-475f-96cc-5c7f1da905b3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.744401 Jul 14 14:32:51.613479 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 846/1653] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:32:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:32:51.620004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c5b34b15-54aa-4761-ba4c-9e688ced4257 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '.version_select at 0x7fd6c5a64940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:52.240266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5469a6c7-15c7-409f-9887-a0e78163925f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:52.282542 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5469a6c7-15c7-409f-9887-a0e78163925f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32" status: 200 len: 1469 microversion: 2.1 time: 1.280259 Jul 14 14:32:52.286279 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 808/1654] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:51 2022] GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32 => generated 1469 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:52.295935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f29ee6a9-3aa6-4ced-9866-f3c2f4f29218 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Calling method '.version_select at 0x7fd6c65c0820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:52.426594 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c5b34b15-54aa-4761-ba4c-9e688ced4257 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips/e4ac816b-ae90-4cd9-9e98-cdadd4d259fb" status: 200 len: 183 microversion: 2.1 time: 0.811322 Jul 14 14:32:52.434650 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 847/1655] 10.222.0.81 () {58 vars in 1259 bytes} [Thu Jul 14 14:32:51 2022] GET /compute/v2.1/os-floating-ips/e4ac816b-ae90-4cd9-9e98-cdadd4d259fb => generated 183 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:52.436230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd7f931e-17cb-4e78-a1c1-4d5ab8ba381f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5c644c0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:52.555266 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cd7f931e-17cb-4e78-a1c1-4d5ab8ba381f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae" status: 200 len: 1414 microversion: 2.1 time: 0.124366 Jul 14 14:32:52.561535 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 848/1656] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:32:52 2022] GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:52.561954 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-49324a90-636e-4dec-998e-f4b2efdf5036 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:52.562663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-49324a90-636e-4dec-998e-f4b2efdf5036 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] [instance: c41e883f-f0f0-4ac0-82c6-11bde64c33de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:52.571009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49324a90-636e-4dec-998e-f4b2efdf5036 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:52.571537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49324a90-636e-4dec-998e-f4b2efdf5036 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:52.572452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49324a90-636e-4dec-998e-f4b2efdf5036 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:52.572930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49324a90-636e-4dec-998e-f4b2efdf5036 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:53.358958 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f29ee6a9-3aa6-4ced-9866-f3c2f4f29218 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.070633 Jul 14 14:32:53.361581 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 809/1657] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:32:52 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:53.367592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-49324a90-636e-4dec-998e-f4b2efdf5036 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c076b33cd448cbbe1072c832055540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5079370e8fc54d589eb69e64bad2b577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:53.371183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b499f283-3c7c-41ff-9ff1-69d9a0b0b97a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:53.373190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b499f283-3c7c-41ff-9ff1-69d9a0b0b97a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:53.376123 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-49324a90-636e-4dec-998e-f4b2efdf5036 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] 10.222.0.81 "GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de" status: 200 len: 1502 microversion: 2.1 time: 0.818326 Jul 14 14:32:53.381050 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 849/1658] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:52 2022] GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de => generated 1502 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:53.394528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e9058105-ff63-4992-b6f4-88f7d29c6097 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:53.395548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e9058105-ff63-4992-b6f4-88f7d29c6097 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:53.414290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b499f283-3c7c-41ff-9ff1-69d9a0b0b97a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:53.415183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9058105-ff63-4992-b6f4-88f7d29c6097 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:53.416390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9058105-ff63-4992-b6f4-88f7d29c6097 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:53.419059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9058105-ff63-4992-b6f4-88f7d29c6097 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:53.422815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b499f283-3c7c-41ff-9ff1-69d9a0b0b97a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:53.425335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b499f283-3c7c-41ff-9ff1-69d9a0b0b97a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:53.426437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9058105-ff63-4992-b6f4-88f7d29c6097 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:53.427844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b499f283-3c7c-41ff-9ff1-69d9a0b0b97a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:53.805472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e9058105-ff63-4992-b6f4-88f7d29c6097 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:53.827783 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e9058105-ff63-4992-b6f4-88f7d29c6097 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 200 len: 1266 microversion: 2.1 time: 0.440068 Jul 14 14:32:53.829360 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 850/1659] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:53 2022] GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 1266 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:53.838210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61c9a988-8272-4fbe-b6d9-435bb87d88ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:53.839486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-61c9a988-8272-4fbe-b6d9-435bb87d88ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:53.867341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61c9a988-8272-4fbe-b6d9-435bb87d88ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:53.870926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61c9a988-8272-4fbe-b6d9-435bb87d88ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:53.872797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61c9a988-8272-4fbe-b6d9-435bb87d88ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:53.875038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61c9a988-8272-4fbe-b6d9-435bb87d88ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:54.041893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b499f283-3c7c-41ff-9ff1-69d9a0b0b97a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:54.056561 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b499f283-3c7c-41ff-9ff1-69d9a0b0b97a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1210 microversion: 2.1 time: 0.692972 Jul 14 14:32:54.058023 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 810/1660] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:53 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1210 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:54.065216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-82bf915b-0878-4fe8-8b15-d228c59bddbd req-30949f0a-6939-46ba-9c59-a0f7f3175914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5e79cc-1b63-403c-b5ed-83db2b2f1b98", "name": "network-vif-plugged", "status": "completed", "tag": "b84c6666-dca9-49d7-a2ae-d3c4b1247ecb"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:54.091405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-82bf915b-0878-4fe8-8b15-d228c59bddbd req-30949f0a-6939-46ba-9c59-a0f7f3175914 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:54.092479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-82bf915b-0878-4fe8-8b15-d228c59bddbd req-30949f0a-6939-46ba-9c59-a0f7f3175914 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:54.164804 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-82bf915b-0878-4fe8-8b15-d228c59bddbd req-30949f0a-6939-46ba-9c59-a0f7f3175914 service nova] Creating event network-vif-plugged:b84c6666-dca9-49d7-a2ae-d3c4b1247ecb for instance ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 on n-h1-767704-28 Jul 14 14:32:54.182142 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-82bf915b-0878-4fe8-8b15-d228c59bddbd req-30949f0a-6939-46ba-9c59-a0f7f3175914 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122239 Jul 14 14:32:54.183824 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 811/1661] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:54.209164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-58a3b56a-6cd8-45e4-b434-54ee7280b3b3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:54.211049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-58a3b56a-6cd8-45e4-b434-54ee7280b3b3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ae5e79cc-1b63-403c-b5ed-83db2b2f1b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:54.258532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58a3b56a-6cd8-45e4-b434-54ee7280b3b3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:54.258991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58a3b56a-6cd8-45e4-b434-54ee7280b3b3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:54.264478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58a3b56a-6cd8-45e4-b434-54ee7280b3b3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:54.265160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58a3b56a-6cd8-45e4-b434-54ee7280b3b3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:54.509469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-61c9a988-8272-4fbe-b6d9-435bb87d88ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:54.527858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-61c9a988-8272-4fbe-b6d9-435bb87d88ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:54.530785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-61c9a988-8272-4fbe-b6d9-435bb87d88ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:54.532693 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-61c9a988-8272-4fbe-b6d9-435bb87d88ae tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 0.701945 Jul 14 14:32:54.534066 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 851/1662] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:53 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:54.545428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ee908370-631b-4859-ad54-d419b9b9e2e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.81"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:54.682842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-58a3b56a-6cd8-45e4-b434-54ee7280b3b3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:54.691966 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-58a3b56a-6cd8-45e4-b434-54ee7280b3b3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98" status: 200 len: 1319 microversion: 2.1 time: 0.499469 Jul 14 14:32:54.692926 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 812/1663] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:54 2022] GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 => generated 1319 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:54.699099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-27ec28b9-056a-4b52-a4f1-571276e184f9 req-155992e7-736d-4b51-a90b-6d2f83e615c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6d06d9-90ef-4a73-843a-778f0c146dff", "name": "network-vif-unplugged", "status": "completed", "tag": "15eb7230-5af2-414b-bcce-a51e734e2507"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:54.718776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-27ec28b9-056a-4b52-a4f1-571276e184f9 req-155992e7-736d-4b51-a90b-6d2f83e615c6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:54.720213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-27ec28b9-056a-4b52-a4f1-571276e184f9 req-155992e7-736d-4b51-a90b-6d2f83e615c6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:54.739416 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-27ec28b9-056a-4b52-a4f1-571276e184f9 req-155992e7-736d-4b51-a90b-6d2f83e615c6 service nova] Creating event network-vif-unplugged:15eb7230-5af2-414b-bcce-a51e734e2507 for instance de6d06d9-90ef-4a73-843a-778f0c146dff on n-h2-767704-28 Jul 14 14:32:54.747067 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-27ec28b9-056a-4b52-a4f1-571276e184f9 req-155992e7-736d-4b51-a90b-6d2f83e615c6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051926 Jul 14 14:32:54.749988 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 813/1664] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:54.760569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f8b2453f-1672-43d3-a106-bd65dc2459d5 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Calling method '.version_select at 0x7fd6c635d3a0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:54.806824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ee908370-631b-4859-ad54-d419b9b9e2e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:54.820221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee908370-631b-4859-ad54-d419b9b9e2e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:54.825297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee908370-631b-4859-ad54-d419b9b9e2e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:54.829810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee908370-631b-4859-ad54-d419b9b9e2e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:54.830928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee908370-631b-4859-ad54-d419b9b9e2e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:55.290319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-f8b2453f-1672-43d3-a106-bd65dc2459d5 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:32:55.291527 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f8b2453f-1672-43d3-a106-bd65dc2459d5 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 14 14:32:55.291527 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-87bf0bac-5d31-4c96-aab2-f26db1f2f406'] Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f8b2453f-1672-43d3-a106-bd65dc2459d5 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Request method failure captured: Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-security-groups/32d00180-bd8d-4ccb-9286-b8eb0d9eb4fb HTTP/1.1 Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CkJxJUA93zNfLHI4LbsTP-I0VC70oZ1FR8KgDhAJQLb9oAuzRT34bcdxcVbLVC7uKvTkbEoIS3-Ji_4gjdpXilrixQfl9XjW5-gigxMXr9hXeqA-QMzcGiIvHXAz2gytrPkQVklghKEsTXS-q-d53-zS6BsLOLgRVWCKiyRBjYI8yY Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 6ad36bd911694aa1ab506b2c50fee7e4 Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1254353761 Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ad36bd911694aa1ab506b2c50fee7e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6ad36bd911694aa1ab506b2c50fee7e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6ad36bd911694aa1ab506b2c50fee7e4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ad36bd911694aa1ab506b2c50fee7e4"}]}] Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1254353761 Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 6ad36bd911694aa1ab506b2c50fee7e4 Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1254353761 Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupsNegativeTestJSON-1254353761-project Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 83515185b7854a10a55d9686e37f66f3 Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1254353761-project Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: exception: Insufficient rights for removing default security group. Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-87bf0bac-5d31-4c96-aab2-f26db1f2f406'] Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '32d00180-bd8d-4ccb-9286-b8eb0d9eb4fb'} Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:32:55.293550 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87bf0bac-5d31-4c96-aab2-f26db1f2f406'] Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87bf0bac-5d31-4c96-aab2-f26db1f2f406'] Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87bf0bac-5d31-4c96-aab2-f26db1f2f406'] Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87bf0bac-5d31-4c96-aab2-f26db1f2f406'] Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f8b2453f-1672-43d3-a106-bd65dc2459d5 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-87bf0bac-5d31-4c96-aab2-f26db1f2f406'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f8b2453f-1672-43d3-a106-bd65dc2459d5 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/32d00180-bd8d-4ccb-9286-b8eb0d9eb4fb" status: 400 len: 182 microversion: 2.1 time: 0.542930 Jul 14 14:32:55.307613 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 814/1665] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:32:54 2022] DELETE /compute/v2.1/os-security-groups/32d00180-bd8d-4ccb-9286-b8eb0d9eb4fb => generated 182 bytes in 544 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:32:55.318323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ff3dab3e-bd00-4966-9e03-c484e1242245 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:55.318323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ff3dab3e-bd00-4966-9e03-c484e1242245 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] [instance: c41e883f-f0f0-4ac0-82c6-11bde64c33de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:55.324086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff3dab3e-bd00-4966-9e03-c484e1242245 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:55.324537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff3dab3e-bd00-4966-9e03-c484e1242245 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:55.325730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff3dab3e-bd00-4966-9e03-c484e1242245 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:55.326396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff3dab3e-bd00-4966-9e03-c484e1242245 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:55.339120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee908370-631b-4859-ad54-d419b9b9e2e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Acquired lock "refresh_cache-435cc8e8-78b1-4af2-8cba-a8f23344e4d2" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:32:55.419638 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ff3dab3e-bd00-4966-9e03-c484e1242245 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.110330 Jul 14 14:32:55.420859 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 815/1666] 10.222.0.81 () {58 vars in 1295 bytes} [Thu Jul 14 14:32:55 2022] DELETE /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de/os-server-password => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:32:55.427160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-28f1001d-1884-4ba8-9782-1c6e1a85cbf5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c635ddc0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:55.485775 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-28f1001d-1884-4ba8-9782-1c6e1a85cbf5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae" status: 200 len: 1423 microversion: 2.1 time: 0.062301 Jul 14 14:32:55.486235 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 816/1667] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:32:55 2022] GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae => generated 1423 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:55.492465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ec680eb7-fabf-41fd-8959-b0027f4c50f0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:55.493038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ec680eb7-fabf-41fd-8959-b0027f4c50f0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:55.501977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ec680eb7-fabf-41fd-8959-b0027f4c50f0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:55.502654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ec680eb7-fabf-41fd-8959-b0027f4c50f0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:55.504115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ec680eb7-fabf-41fd-8959-b0027f4c50f0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:55.504502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ec680eb7-fabf-41fd-8959-b0027f4c50f0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:55.539599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ec680eb7-fabf-41fd-8959-b0027f4c50f0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:32:55.649380 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ec680eb7-fabf-41fd-8959-b0027f4c50f0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 204 len: 0 microversion: 2.1 time: 0.157100 Jul 14 14:32:55.651518 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 817/1668] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:32:55 2022] DELETE /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:32:55.672688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fce22ba6-cf17-4101-ae37-7e78e0cec01f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:55.677433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fce22ba6-cf17-4101-ae37-7e78e0cec01f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:55.697707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fce22ba6-cf17-4101-ae37-7e78e0cec01f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:55.700250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fce22ba6-cf17-4101-ae37-7e78e0cec01f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:55.702411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fce22ba6-cf17-4101-ae37-7e78e0cec01f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:55.703311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fce22ba6-cf17-4101-ae37-7e78e0cec01f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:56.494875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fce22ba6-cf17-4101-ae37-7e78e0cec01f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:56.505859 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fce22ba6-cf17-4101-ae37-7e78e0cec01f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1198 microversion: 2.1 time: 0.851702 Jul 14 14:32:56.508971 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 818/1669] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:55 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1198 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:56.522506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f2f406ad-858a-4123-87c5-a951273220d0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Calling method '.version_select at 0x7fd6c5b4a9d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:56.553175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-f2f406ad-858a-4123-87c5-a951273220d0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7cb9129-caa6-4046-bb8c-e359535b64c1 does not exist", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:32:56.555392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.security_group_api [None req-f2f406ad-858a-4123-87c5-a951273220d0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Neutron security group a7cb9129-caa6-4046-bb8c-e359535b64c1 not found {{(pid=119511) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:32:56.555956 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f2f406ad-858a-4123-87c5-a951273220d0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] HTTP exception thrown: Security group a7cb9129-caa6-4046-bb8c-e359535b64c1 does not exist Jul 14 14:32:56.555956 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-1efcec0f-cf54-450a-8e70-4f132b970e74'] Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f2f406ad-858a-4123-87c5-a951273220d0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Request method failure captured: Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-security-groups/a7cb9129-caa6-4046-bb8c-e359535b64c1 HTTP/1.1 Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CkJxJUA93zNfLHI4LbsTP-I0VC70oZ1FR8KgDhAJQLb9oAuzRT34bcdxcVbLVC7uKvTkbEoIS3-Ji_4gjdpXilrixQfl9XjW5-gigxMXr9hXeqA-QMzcGiIvHXAz2gytrPkQVklghKEsTXS-q-d53-zS6BsLOLgRVWCKiyRBjYI8yY Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 6ad36bd911694aa1ab506b2c50fee7e4 Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1254353761 Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ad36bd911694aa1ab506b2c50fee7e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6ad36bd911694aa1ab506b2c50fee7e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6ad36bd911694aa1ab506b2c50fee7e4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ad36bd911694aa1ab506b2c50fee7e4"}]}] Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1254353761 Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 6ad36bd911694aa1ab506b2c50fee7e4 Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1254353761 Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupsNegativeTestJSON-1254353761-project Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 83515185b7854a10a55d9686e37f66f3 Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1254353761-project Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: exception: Security group a7cb9129-caa6-4046-bb8c-e359535b64c1 does not exist Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-1efcec0f-cf54-450a-8e70-4f132b970e74'] Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'a7cb9129-caa6-4046-bb8c-e359535b64c1'} Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:32:56.557957 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7cb9129-caa6-4046-bb8c-e359535b64c1 does not exist Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1efcec0f-cf54-450a-8e70-4f132b970e74'] Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7cb9129-caa6-4046-bb8c-e359535b64c1 does not exist Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1efcec0f-cf54-450a-8e70-4f132b970e74'] Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7cb9129-caa6-4046-bb8c-e359535b64c1 does not exist Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1efcec0f-cf54-450a-8e70-4f132b970e74'] Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7cb9129-caa6-4046-bb8c-e359535b64c1 does not exist Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1efcec0f-cf54-450a-8e70-4f132b970e74'] Jul 14 14:32:56.563443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:56.569323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f2f406ad-858a-4123-87c5-a951273220d0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Returning 404 to user: Security group a7cb9129-caa6-4046-bb8c-e359535b64c1 does not exist Jul 14 14:32:56.569323 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-1efcec0f-cf54-450a-8e70-4f132b970e74'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:32:56.570624 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f2f406ad-858a-4123-87c5-a951273220d0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/a7cb9129-caa6-4046-bb8c-e359535b64c1" status: 404 len: 194 microversion: 2.1 time: 0.059072 Jul 14 14:32:56.572647 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 819/1670] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:32:56 2022] GET /compute/v2.1/os-security-groups/a7cb9129-caa6-4046-bb8c-e359535b64c1 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:32:56.578739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9e1100ad-4676-419d-87fc-833e7193158d tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:56.580087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9e1100ad-4676-419d-87fc-833e7193158d tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] [instance: c41e883f-f0f0-4ac0-82c6-11bde64c33de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:56.594115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e1100ad-4676-419d-87fc-833e7193158d tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:56.594872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e1100ad-4676-419d-87fc-833e7193158d tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:56.595913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e1100ad-4676-419d-87fc-833e7193158d tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:56.597249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e1100ad-4676-419d-87fc-833e7193158d tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:56.651254 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9e1100ad-4676-419d-87fc-833e7193158d tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] 10.222.0.81 "GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.077148 Jul 14 14:32:56.652532 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 820/1671] 10.222.0.81 () {58 vars in 1292 bytes} [Thu Jul 14 14:32:56 2022] GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de/os-server-password => generated 16 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:32:56.658054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6e0655c8-aaf9-42f8-8ca8-8d3c262a0ba4 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c6416670>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:56.716151 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6e0655c8-aaf9-42f8-8ca8-8d3c262a0ba4 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae" status: 200 len: 1423 microversion: 2.1 time: 0.062137 Jul 14 14:32:56.716837 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 821/1672] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:32:56 2022] GET /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae => generated 1423 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:56.724682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-730dfc9e-7174-45e1-8fa6-77f2f024af10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:56.724682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-730dfc9e-7174-45e1-8fa6-77f2f024af10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:56.734616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-730dfc9e-7174-45e1-8fa6-77f2f024af10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:56.735145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-730dfc9e-7174-45e1-8fa6-77f2f024af10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:56.736100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-730dfc9e-7174-45e1-8fa6-77f2f024af10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:56.736491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-730dfc9e-7174-45e1-8fa6-77f2f024af10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:56.952414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-ee908370-631b-4859-ad54-d419b9b9e2e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Building network info cache for instance {{(pid=119512) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:32:57.064414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-730dfc9e-7174-45e1-8fa6-77f2f024af10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:57.074629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-730dfc9e-7174-45e1-8fa6-77f2f024af10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:57.076917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-730dfc9e-7174-45e1-8fa6-77f2f024af10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:57.078523 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-730dfc9e-7174-45e1-8fa6-77f2f024af10 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 0.360694 Jul 14 14:32:57.087028 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 822/1673] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:56 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:32:57.096301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e7fa3937-a9e9-478d-946a-bb841183d82e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:57.097391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e7fa3937-a9e9-478d-946a-bb841183d82e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:57.127004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7fa3937-a9e9-478d-946a-bb841183d82e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:57.128011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7fa3937-a9e9-478d-946a-bb841183d82e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:57.132271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7fa3937-a9e9-478d-946a-bb841183d82e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:57.133239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7fa3937-a9e9-478d-946a-bb841183d82e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:57.508480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e7fa3937-a9e9-478d-946a-bb841183d82e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:57.518719 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e7fa3937-a9e9-478d-946a-bb841183d82e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 200 len: 1314 microversion: 2.1 time: 0.429778 Jul 14 14:32:57.519309 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 823/1674] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:57 2022] GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:57.526223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a05c7ab5-5d03-4b2b-a037-bf1100567ed9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:57.527002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a05c7ab5-5d03-4b2b-a037-bf1100567ed9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ae5e79cc-1b63-403c-b5ed-83db2b2f1b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:57.533481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a05c7ab5-5d03-4b2b-a037-bf1100567ed9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:57.534202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a05c7ab5-5d03-4b2b-a037-bf1100567ed9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:57.534991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a05c7ab5-5d03-4b2b-a037-bf1100567ed9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:57.535435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a05c7ab5-5d03-4b2b-a037-bf1100567ed9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:57.900922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a05c7ab5-5d03-4b2b-a037-bf1100567ed9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:57.944892 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a05c7ab5-5d03-4b2b-a037-bf1100567ed9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98" status: 200 len: 1468 microversion: 2.1 time: 0.417856 Jul 14 14:32:57.947567 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 824/1675] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:57 2022] GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 => generated 1468 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:57.965346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b88920aa-66ca-4eb9-bccf-ac1b7acf437e req-d1058e9c-6a01-422a-b42b-28165b45142d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78cbc19a-1538-43b8-8e70-91d438069caf", "tag": "3b828d42-f8f3-4b22-b64f-6283074dc67c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:57.995365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b88920aa-66ca-4eb9-bccf-ac1b7acf437e req-d1058e9c-6a01-422a-b42b-28165b45142d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:57.996458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b88920aa-66ca-4eb9-bccf-ac1b7acf437e req-d1058e9c-6a01-422a-b42b-28165b45142d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:58.020817 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b88920aa-66ca-4eb9-bccf-ac1b7acf437e req-d1058e9c-6a01-422a-b42b-28165b45142d service nova] Creating event network-changed:3b828d42-f8f3-4b22-b64f-6283074dc67c for instance 78cbc19a-1538-43b8-8e70-91d438069caf on n-h1-767704-28 Jul 14 14:32:58.034366 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b88920aa-66ca-4eb9-bccf-ac1b7acf437e req-d1058e9c-6a01-422a-b42b-28165b45142d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077177 Jul 14 14:32:58.040682 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 825/1676] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:58.047330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cca810a2-18a1-44f6-8f5d-a768327df9f0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Action: 'update', calling method: .version_select at 0x7fd6c6362dc0>, body: {"security_group": {"name": "tempest-sg-483885006", "description": "tempest-description-980541007"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:58.159440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-cca810a2-18a1-44f6-8f5d-a768327df9f0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f293381f-c955-48c9-b86e-745779cad4da does not exist", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:32:58.160511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.security_group_api [None req-cca810a2-18a1-44f6-8f5d-a768327df9f0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Neutron security group f293381f-c955-48c9-b86e-745779cad4da not found {{(pid=119511) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:32:58.161635 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-cca810a2-18a1-44f6-8f5d-a768327df9f0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] HTTP exception thrown: Security group f293381f-c955-48c9-b86e-745779cad4da does not exist Jul 14 14:32:58.161635 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-629be3cb-6686-494d-ac88-138620a3d0e7'] Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cca810a2-18a1-44f6-8f5d-a768327df9f0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Request method failure captured: Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: request: PUT /compute/v2.1/os-security-groups/f293381f-c955-48c9-b86e-745779cad4da HTTP/1.1 Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 100 Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CkJxJUA93zNfLHI4LbsTP-I0VC70oZ1FR8KgDhAJQLb9oAuzRT34bcdxcVbLVC7uKvTkbEoIS3-Ji_4gjdpXilrixQfl9XjW5-gigxMXr9hXeqA-QMzcGiIvHXAz2gytrPkQVklghKEsTXS-q-d53-zS6BsLOLgRVWCKiyRBjYI8yY Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 6ad36bd911694aa1ab506b2c50fee7e4 Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1254353761 Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ad36bd911694aa1ab506b2c50fee7e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6ad36bd911694aa1ab506b2c50fee7e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6ad36bd911694aa1ab506b2c50fee7e4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6ad36bd911694aa1ab506b2c50fee7e4"}]}] Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1254353761 Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 6ad36bd911694aa1ab506b2c50fee7e4 Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1254353761 Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupsNegativeTestJSON-1254353761-project Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 83515185b7854a10a55d9686e37f66f3 Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1254353761-project Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: {"security_group": {"name": "tempest-sg-483885006", "description": "tempest-description-980541007"}} Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: exception: Security group f293381f-c955-48c9-b86e-745779cad4da does not exist Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-629be3cb-6686-494d-ac88-138620a3d0e7'] Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'f293381f-c955-48c9-b86e-745779cad4da', 'body': {'security_group': {'name': 'tempest-sg-483885006', 'description': 'tempest-description-980541007'}}} Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:32:58.166220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f293381f-c955-48c9-b86e-745779cad4da does not exist Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-629be3cb-6686-494d-ac88-138620a3d0e7'] Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f293381f-c955-48c9-b86e-745779cad4da does not exist Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-629be3cb-6686-494d-ac88-138620a3d0e7'] Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f293381f-c955-48c9-b86e-745779cad4da does not exist Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-629be3cb-6686-494d-ac88-138620a3d0e7'] Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f293381f-c955-48c9-b86e-745779cad4da does not exist Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-629be3cb-6686-494d-ac88-138620a3d0e7'] Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cca810a2-18a1-44f6-8f5d-a768327df9f0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] Returning 404 to user: Security group f293381f-c955-48c9-b86e-745779cad4da does not exist Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-629be3cb-6686-494d-ac88-138620a3d0e7'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cca810a2-18a1-44f6-8f5d-a768327df9f0 tempest-SecurityGroupsNegativeTestJSON-1254353761 tempest-SecurityGroupsNegativeTestJSON-1254353761-project] 10.222.0.81 "PUT /compute/v2.1/os-security-groups/f293381f-c955-48c9-b86e-745779cad4da" status: 404 len: 194 microversion: 2.1 time: 0.126966 Jul 14 14:32:58.172937 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 826/1677] 10.222.0.81 () {60 vars in 1289 bytes} [Thu Jul 14 14:32:58 2022] PUT /compute/v2.1/os-security-groups/f293381f-c955-48c9-b86e-745779cad4da => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:32:58.183888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4fba6f7f-979b-497d-b8e9-c2501266e705 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:58.183888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4fba6f7f-979b-497d-b8e9-c2501266e705 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] [instance: c41e883f-f0f0-4ac0-82c6-11bde64c33de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:58.214995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fba6f7f-979b-497d-b8e9-c2501266e705 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:58.215836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fba6f7f-979b-497d-b8e9-c2501266e705 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:58.217017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fba6f7f-979b-497d-b8e9-c2501266e705 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:58.217673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fba6f7f-979b-497d-b8e9-c2501266e705 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:58.279389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4fba6f7f-979b-497d-b8e9-c2501266e705 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] [instance: c41e883f-f0f0-4ac0-82c6-11bde64c33de] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:32:58.314868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-ee908370-631b-4859-ad54-d419b9b9e2e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Updating instance_info_cache with network_info: [{"id": "b2bcf02b-437a-4cb3-924e-770f54b60aec", "address": "fa:16:3e:a6:95:2b", "network": {"id": "ae04b1c7-9ca7-4252-9de9-6ca895e5f620", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1453524383-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "613f5ab64c38455dad4973c1c974e87f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb2bcf02b-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119512) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:32:58.333956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee908370-631b-4859-ad54-d419b9b9e2e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Releasing lock "refresh_cache-435cc8e8-78b1-4af2-8cba-a8f23344e4d2" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:32:58.337964 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ee908370-631b-4859-ad54-d419b9b9e2e4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "POST /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2/action" status: 202 len: 0 microversion: 2.1 time: 3.799872 Jul 14 14:32:58.341150 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 852/1678] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:32:54 2022] POST /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2/action => generated 0 bytes in 3806 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:32:58.355437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5f20749f-c012-42eb-9c0e-fea70fe98acc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5aa9670>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:58.474393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:58.517422 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4fba6f7f-979b-497d-b8e9-c2501266e705 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de" status: 204 len: 0 microversion: 2.1 time: 0.345780 Jul 14 14:32:58.518147 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 827/1679] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:32:58 2022] DELETE /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:32:58.530575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e6da405e-f0c1-4c89-b725-76d0c335f72c req-cae418fa-618b-4eb2-9424-d14588710b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3", "tag": "d847f251-9224-4c9f-b335-7f0f58afd9ef"}, {"name": "network-changed", "server_uuid": "de6d06d9-90ef-4a73-843a-778f0c146dff", "tag": "15eb7230-5af2-414b-bcce-a51e734e2507"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:58.555189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e6da405e-f0c1-4c89-b725-76d0c335f72c req-cae418fa-618b-4eb2-9424-d14588710b40 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:58.564155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e6da405e-f0c1-4c89-b725-76d0c335f72c req-cae418fa-618b-4eb2-9424-d14588710b40 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:58.604756 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e6da405e-f0c1-4c89-b725-76d0c335f72c req-cae418fa-618b-4eb2-9424-d14588710b40 service nova] Creating event network-changed:d847f251-9224-4c9f-b335-7f0f58afd9ef for instance dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 on n-h2-767704-28 Jul 14 14:32:58.606140 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e6da405e-f0c1-4c89-b725-76d0c335f72c req-cae418fa-618b-4eb2-9424-d14588710b40 service nova] Creating event network-changed:15eb7230-5af2-414b-bcce-a51e734e2507 for instance de6d06d9-90ef-4a73-843a-778f0c146dff on n-h2-767704-28 Jul 14 14:32:58.619725 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e6da405e-f0c1-4c89-b725-76d0c335f72c req-cae418fa-618b-4eb2-9424-d14588710b40 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096138 Jul 14 14:32:58.625731 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 828/1680] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:58.633033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-06613414-af16-4839-a945-ccb631fe0c5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:58.634861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-06613414-af16-4839-a945-ccb631fe0c5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:58.642597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06613414-af16-4839-a945-ccb631fe0c5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:58.643755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06613414-af16-4839-a945-ccb631fe0c5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:58.645239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06613414-af16-4839-a945-ccb631fe0c5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:58.646314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06613414-af16-4839-a945-ccb631fe0c5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:58.674300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:58.950151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-06613414-af16-4839-a945-ccb631fe0c5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:58.981747 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-06613414-af16-4839-a945-ccb631fe0c5f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1198 microversion: 2.1 time: 0.346623 Jul 14 14:32:58.985257 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 829/1681] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:58 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1198 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:59.011721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4dd8868-9e45-4645-9f54-d02d5b935543 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:59.030167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d4dd8868-9e45-4645-9f54-d02d5b935543 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:59.039406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d4dd8868-9e45-4645-9f54-d02d5b935543 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Searching by: {'reservation_id': 'r-59yg8nud', 'deleted': False, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:32:59.066121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4dd8868-9e45-4645-9f54-d02d5b935543 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:59.066575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4dd8868-9e45-4645-9f54-d02d5b935543 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:59.072305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4dd8868-9e45-4645-9f54-d02d5b935543 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:59.079249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4dd8868-9e45-4645-9f54-d02d5b935543 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:59.382042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-d4dd8868-9e45-4645-9f54-d02d5b935543 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:32:59.499318 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5f20749f-c012-42eb-9c0e-fea70fe98acc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae" status: 204 len: 0 microversion: 2.1 time: 1.154112 Jul 14 14:32:59.500562 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 853/1682] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:58 2022] DELETE /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae => generated 0 bytes in 1158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:32:59.508205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-20b8fc5e-5864-4b2f-a2f5-f3ee6a3b2ca5 req-102086ff-8a2f-4da0-bc6d-c35223053110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c850b90e-27fa-4f9a-bd80-6704843cb1a0", "name": "network-vif-unplugged", "status": "completed", "tag": "b97d1e15-3c4f-492e-8519-79383a6b7f04"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:59.533694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-20b8fc5e-5864-4b2f-a2f5-f3ee6a3b2ca5 req-102086ff-8a2f-4da0-bc6d-c35223053110 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:59.534642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-20b8fc5e-5864-4b2f-a2f5-f3ee6a3b2ca5 req-102086ff-8a2f-4da0-bc6d-c35223053110 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:59.554364 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-20b8fc5e-5864-4b2f-a2f5-f3ee6a3b2ca5 req-102086ff-8a2f-4da0-bc6d-c35223053110 service nova] Creating event network-vif-unplugged:b97d1e15-3c4f-492e-8519-79383a6b7f04 for instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 on n-h2-767704-28 Jul 14 14:32:59.561445 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-20b8fc5e-5864-4b2f-a2f5-f3ee6a3b2ca5 req-102086ff-8a2f-4da0-bc6d-c35223053110 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059122 Jul 14 14:32:59.563421 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 854/1683] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:59.570969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9cbb1bd5-778a-4c46-a6f9-416caca7e21c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:59.573185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9cbb1bd5-778a-4c46-a6f9-416caca7e21c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:59.574506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d4dd8868-9e45-4645-9f54-d02d5b935543 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:59.581241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9cbb1bd5-778a-4c46-a6f9-416caca7e21c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:59.581763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9cbb1bd5-778a-4c46-a6f9-416caca7e21c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:59.584522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9cbb1bd5-778a-4c46-a6f9-416caca7e21c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:59.585158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9cbb1bd5-778a-4c46-a6f9-416caca7e21c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:59.597312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4dd8868-9e45-4645-9f54-d02d5b935543 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:59.597780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4dd8868-9e45-4645-9f54-d02d5b935543 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:59.981125 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d4dd8868-9e45-4645-9f54-d02d5b935543 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/detail?reservation_id=r-59yg8nud" status: 200 len: 2930 microversion: 2.1 time: 0.994146 Jul 14 14:32:59.981756 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 830/1684] 10.222.0.81 () {58 vars in 1196 bytes} [Thu Jul 14 14:32:58 2022] GET /compute/v2.1/servers/detail?reservation_id=r-59yg8nud => generated 2930 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:59.988674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9cbb1bd5-778a-4c46-a6f9-416caca7e21c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:00.001636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9cbb1bd5-778a-4c46-a6f9-416caca7e21c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:00.001831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c78e340a-d264-4020-a323-993c3e7150c4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:00.002152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c78e340a-d264-4020-a323-993c3e7150c4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:00.003847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9cbb1bd5-778a-4c46-a6f9-416caca7e21c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:00.006053 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9cbb1bd5-778a-4c46-a6f9-416caca7e21c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 0.440776 Jul 14 14:33:00.008158 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 855/1685] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:32:59 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:00.013457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-db147d81-645e-43e6-9daa-f084aba0231c tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:00.014488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-db147d81-645e-43e6-9daa-f084aba0231c tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] [instance: c41e883f-f0f0-4ac0-82c6-11bde64c33de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:00.024431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db147d81-645e-43e6-9daa-f084aba0231c tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.025360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db147d81-645e-43e6-9daa-f084aba0231c tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.026736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db147d81-645e-43e6-9daa-f084aba0231c tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.027490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db147d81-645e-43e6-9daa-f084aba0231c tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.045864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c78e340a-d264-4020-a323-993c3e7150c4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.047255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c78e340a-d264-4020-a323-993c3e7150c4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.048571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c78e340a-d264-4020-a323-993c3e7150c4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.050535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c78e340a-d264-4020-a323-993c3e7150c4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.087015 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c78e340a-d264-4020-a323-993c3e7150c4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] HTTP exception thrown: Instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 could not be found. Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c78e340a-d264-4020-a323-993c3e7150c4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Request method failure captured: Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 HTTP/1.1 Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CixTc2__vuWJwPanxRtaForuX8PQXcNoKTZrSOn8PappAuYSakIgirbSLFUFRKNlDaHVkQw15YIYJo0NxyEqVF6AdMawgehRamUVY9_6WlsfoAxJrCL5gZHtHL_q0odGFoWWO_8yILI57v_Kxx22301GD_audS_eQ5UO5-WCOCQSqk Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 613f5ab64c38455dad4973c1c974e87f Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1223940907 Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/613f5ab64c38455dad4973c1c974e87f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/613f5ab64c38455dad4973c1c974e87f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_613f5ab64c38455dad4973c1c974e87f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/613f5ab64c38455dad4973c1c974e87f"}]}] Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1223940907 Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 613f5ab64c38455dad4973c1c974e87f Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1223940907 Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FloatingIPsAssociationTestJSON-1223940907-project Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 30626a18f38d467da445eaa2b56faf5e Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1223940907-project Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 could not be found. Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'b300ae9d-bf6b-4bc5-bd30-d88db00a9f11'} Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 could not be found. Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:33:00.093136 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:33:00.098737 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 could not be found. Jul 14 14:33:00.098737 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:00.098737 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:00.098737 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:00.098737 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:00.098737 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:00.098737 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:00.098737 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:33:00.098737 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:33:00.098737 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 could not be found. Jul 14 14:33:00.098737 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:00.105167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c78e340a-d264-4020-a323-993c3e7150c4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Returning 404 to user: Instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:33:00.106420 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c78e340a-d264-4020-a323-993c3e7150c4 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 404 len: 111 microversion: 2.1 time: 0.112176 Jul 14 14:33:00.114165 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 831/1686] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:32:59 2022] DELETE /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:33:00.125705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d2b1c3a-5b88-4268-b90b-7a8112cee7ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:00.126632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0d2b1c3a-5b88-4268-b90b-7a8112cee7ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:00.141227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d2b1c3a-5b88-4268-b90b-7a8112cee7ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.141960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d2b1c3a-5b88-4268-b90b-7a8112cee7ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.143115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d2b1c3a-5b88-4268-b90b-7a8112cee7ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.145505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d2b1c3a-5b88-4268-b90b-7a8112cee7ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.574146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0d2b1c3a-5b88-4268-b90b-7a8112cee7ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:00.589386 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0d2b1c3a-5b88-4268-b90b-7a8112cee7ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 200 len: 1314 microversion: 2.1 time: 0.472922 Jul 14 14:33:00.590915 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 832/1687] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:00 2022] GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:00.601617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4985f55d-bfbe-49e5-8c65-5f8c834d99a9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:00.602823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4985f55d-bfbe-49e5-8c65-5f8c834d99a9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:00.614376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4985f55d-bfbe-49e5-8c65-5f8c834d99a9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.617336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4985f55d-bfbe-49e5-8c65-5f8c834d99a9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.619367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4985f55d-bfbe-49e5-8c65-5f8c834d99a9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.620761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4985f55d-bfbe-49e5-8c65-5f8c834d99a9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.667021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4985f55d-bfbe-49e5-8c65-5f8c834d99a9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:33:00.776116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-db147d81-645e-43e6-9daa-f084aba0231c tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c076b33cd448cbbe1072c832055540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5079370e8fc54d589eb69e64bad2b577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:00.782025 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4985f55d-bfbe-49e5-8c65-5f8c834d99a9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 204 len: 0 microversion: 2.1 time: 0.188681 Jul 14 14:33:00.788969 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 833/1688] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:33:00 2022] DELETE /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:33:00.795204 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-db147d81-645e-43e6-9daa-f084aba0231c tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] 10.222.0.81 "GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de" status: 200 len: 1508 microversion: 2.1 time: 0.783280 Jul 14 14:33:00.796152 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 856/1689] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:00 2022] GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de => generated 1508 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:00.797988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9809e068-aafa-4eb9-a345-a48cf6dc5cbd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:00.807892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-690d6b93-eb9b-4196-9594-8832b8db7983 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:00.809825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-690d6b93-eb9b-4196-9594-8832b8db7983 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:00.824476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.compute.server_groups [None req-9809e068-aafa-4eb9-a345-a48cf6dc5cbd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Querying cell e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) for 2 instances {{(pid=119511) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 14 14:33:00.825677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9809e068-aafa-4eb9-a345-a48cf6dc5cbd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.826426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9809e068-aafa-4eb9-a345-a48cf6dc5cbd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.839893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-690d6b93-eb9b-4196-9594-8832b8db7983 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.840680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-690d6b93-eb9b-4196-9594-8832b8db7983 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.843757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-690d6b93-eb9b-4196-9594-8832b8db7983 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.845374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-690d6b93-eb9b-4196-9594-8832b8db7983 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.882969 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9809e068-aafa-4eb9-a345-a48cf6dc5cbd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups/8f903015-f899-4c1c-a569-d0d95fdea4a2" status: 200 len: 265 microversion: 2.1 time: 0.096305 Jul 14 14:33:00.884564 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 834/1690] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:33:00 2022] GET /compute/v2.1/os-server-groups/8f903015-f899-4c1c-a569-d0d95fdea4a2 => generated 265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:00.893923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1573a6c1-22ff-4354-91bc-fa8b492b96f8 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:00.895507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1573a6c1-22ff-4354-91bc-fa8b492b96f8 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: b300ae9d-bf6b-4bc5-bd30-d88db00a9f11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:00.920009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1573a6c1-22ff-4354-91bc-fa8b492b96f8 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.920694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1573a6c1-22ff-4354-91bc-fa8b492b96f8 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.921812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1573a6c1-22ff-4354-91bc-fa8b492b96f8 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.922425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1573a6c1-22ff-4354-91bc-fa8b492b96f8 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.940408 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-1573a6c1-22ff-4354-91bc-fa8b492b96f8 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] HTTP exception thrown: Instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 could not be found. Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1573a6c1-22ff-4354-91bc-fa8b492b96f8 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Request method failure captured: Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 HTTP/1.1 Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CixTc2__vuWJwPanxRtaForuX8PQXcNoKTZrSOn8PappAuYSakIgirbSLFUFRKNlDaHVkQw15YIYJo0NxyEqVF6AdMawgehRamUVY9_6WlsfoAxJrCL5gZHtHL_q0odGFoWWO_8yILI57v_Kxx22301GD_audS_eQ5UO5-WCOCQSqk Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 613f5ab64c38455dad4973c1c974e87f Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1223940907 Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/613f5ab64c38455dad4973c1c974e87f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/613f5ab64c38455dad4973c1c974e87f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_613f5ab64c38455dad4973c1c974e87f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/613f5ab64c38455dad4973c1c974e87f"}]}] Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1223940907 Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 613f5ab64c38455dad4973c1c974e87f Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1223940907 Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FloatingIPsAssociationTestJSON-1223940907-project Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 30626a18f38d467da445eaa2b56faf5e Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1223940907-project Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 could not be found. Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'b300ae9d-bf6b-4bc5-bd30-d88db00a9f11'} Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 could not be found. Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 could not be found. Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:00.942812 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:00.948765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:00.948765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:00.948765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:00.948765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:00.948765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:33:00.948765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:33:00.948765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 could not be found. Jul 14 14:33:00.948765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:00.950921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1573a6c1-22ff-4354-91bc-fa8b492b96f8 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Returning 404 to user: Instance b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:33:00.951982 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1573a6c1-22ff-4354-91bc-fa8b492b96f8 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11" status: 404 len: 111 microversion: 2.1 time: 0.065262 Jul 14 14:33:00.952788 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 835/1691] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:00 2022] GET /compute/v2.1/servers/b300ae9d-bf6b-4bc5-bd30-d88db00a9f11 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:33:00.966103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e1f80c29-772b-4cc9-94a2-b8dbba2ba8f5 req-930e566a-b05c-4847-a779-e619a24e2e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435cc8e8-78b1-4af2-8cba-a8f23344e4d2", "tag": "b2bcf02b-437a-4cb3-924e-770f54b60aec"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:00.999649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e1f80c29-772b-4cc9-94a2-b8dbba2ba8f5 req-930e566a-b05c-4847-a779-e619a24e2e95 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:01.000332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e1f80c29-772b-4cc9-94a2-b8dbba2ba8f5 req-930e566a-b05c-4847-a779-e619a24e2e95 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:01.031325 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e1f80c29-772b-4cc9-94a2-b8dbba2ba8f5 req-930e566a-b05c-4847-a779-e619a24e2e95 service nova] Creating event network-changed:b2bcf02b-437a-4cb3-924e-770f54b60aec for instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 on n-h1-767704-28 Jul 14 14:33:01.037385 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e1f80c29-772b-4cc9-94a2-b8dbba2ba8f5 req-930e566a-b05c-4847-a779-e619a24e2e95 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082499 Jul 14 14:33:01.038325 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 836/1692] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:01.043426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c09b9931-0d0f-4533-855b-eba859033a07 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:01.044138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c09b9931-0d0f-4533-855b-eba859033a07 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] [instance: ae5e79cc-1b63-403c-b5ed-83db2b2f1b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:01.051924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c09b9931-0d0f-4533-855b-eba859033a07 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:01.052380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c09b9931-0d0f-4533-855b-eba859033a07 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:01.053321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c09b9931-0d0f-4533-855b-eba859033a07 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:01.053771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c09b9931-0d0f-4533-855b-eba859033a07 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:01.400905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:01.408644 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c09b9931-0d0f-4533-855b-eba859033a07 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98" status: 200 len: 1621 microversion: 2.1 time: 0.368967 Jul 14 14:33:01.421301 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 837/1693] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:01 2022] GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 => generated 1621 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:01.426420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24b74dce-082b-4f47-95aa-2fc4cb0cf8d7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '.version_select at 0x7fd6c63a5b80>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:01.465402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:01.922935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-690d6b93-eb9b-4196-9594-8832b8db7983 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:01.939057 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-690d6b93-eb9b-4196-9594-8832b8db7983 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1198 microversion: 2.1 time: 1.141309 Jul 14 14:33:01.955226 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 857/1694] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:00 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1198 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:01.976314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-294886375", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "6b253de3-a05b-4108-8629-b3ed951903ff"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:02.047738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] validate_networks() for [('6b253de3-a05b-4108-8629-b3ed951903ff', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:33:04.770634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:33:04.772488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:33:04.773382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:33:04.774030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:33:04.774672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:33:04.795949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:04.797956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:04.799214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:04.799848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:04.844348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Getting quotas for project 3755ed287bff4882ac3ead9acadfa731. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:04.856528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Getting quotas for user 31ab545bcb3a47b38c53fbfa6b11a432 and project 3755ed287bff4882ac3ead9acadfa731. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:04.913691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:33:04.929515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:33:05.029210 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-accd1762-c99f-4ec4-8355-668708042689 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.071600 Jul 14 14:33:05.049018 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 858/1695] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:33:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:33:05.063266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-231db1e7-5ae5-4a1e-9291-2fefc62bdb98 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:05.092315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-231db1e7-5ae5-4a1e-9291-2fefc62bdb98 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:05.123172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-231db1e7-5ae5-4a1e-9291-2fefc62bdb98 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.123640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-231db1e7-5ae5-4a1e-9291-2fefc62bdb98 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.124675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-231db1e7-5ae5-4a1e-9291-2fefc62bdb98 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.125423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-231db1e7-5ae5-4a1e-9291-2fefc62bdb98 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.571794 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-24b74dce-082b-4f47-95aa-2fc4cb0cf8d7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/e4ac816b-ae90-4cd9-9e98-cdadd4d259fb" status: 202 len: 0 microversion: 2.1 time: 4.150059 Jul 14 14:33:05.574815 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 838/1696] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:33:01 2022] DELETE /compute/v2.1/os-floating-ips/e4ac816b-ae90-4cd9-9e98-cdadd4d259fb => generated 0 bytes in 4154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:33:05.581621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5f9ebac4-1428-4ff1-a161-53d470af594f tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:05.583551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5f9ebac4-1428-4ff1-a161-53d470af594f tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] [instance: c13590db-1680-4b10-b598-cc2eb89d8b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:05.604684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f9ebac4-1428-4ff1-a161-53d470af594f tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.606407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f9ebac4-1428-4ff1-a161-53d470af594f tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.607423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f9ebac4-1428-4ff1-a161-53d470af594f tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.607831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f9ebac4-1428-4ff1-a161-53d470af594f tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.758143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-231db1e7-5ae5-4a1e-9291-2fefc62bdb98 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:05.777039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-231db1e7-5ae5-4a1e-9291-2fefc62bdb98 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:05.778831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-231db1e7-5ae5-4a1e-9291-2fefc62bdb98 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:05.780294 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-231db1e7-5ae5-4a1e-9291-2fefc62bdb98 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 0.723905 Jul 14 14:33:05.786363 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 859/1697] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:05 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:05.797215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1ab69876-8900-44a7-93ab-e8051e263c16 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:05.797849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1ab69876-8900-44a7-93ab-e8051e263c16 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:05.815087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ab69876-8900-44a7-93ab-e8051e263c16 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.815965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ab69876-8900-44a7-93ab-e8051e263c16 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.817388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ab69876-8900-44a7-93ab-e8051e263c16 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.820785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ab69876-8900-44a7-93ab-e8051e263c16 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.851223 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5f9ebac4-1428-4ff1-a161-53d470af594f tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32" status: 200 len: 1622 microversion: 2.1 time: 0.274963 Jul 14 14:33:05.852747 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 839/1698] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:05 2022] GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32 => generated 1622 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:05.860223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-900654d0-4bb6-45ea-b042-a42768716982 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:05.861346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-900654d0-4bb6-45ea-b042-a42768716982 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] [instance: c41e883f-f0f0-4ac0-82c6-11bde64c33de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:05.871321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-900654d0-4bb6-45ea-b042-a42768716982 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.872222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-900654d0-4bb6-45ea-b042-a42768716982 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.873294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-900654d0-4bb6-45ea-b042-a42768716982 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.874030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-900654d0-4bb6-45ea-b042-a42768716982 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.897025 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-900654d0-4bb6-45ea-b042-a42768716982 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] HTTP exception thrown: Instance c41e883f-f0f0-4ac0-82c6-11bde64c33de could not be found. Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-900654d0-4bb6-45ea-b042-a42768716982 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Request method failure captured: Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de HTTP/1.1 Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cj5vjvRQeGBwdOGdP73K9cA6cciTSRBujcqcESoWX_iarasOFPdR9rUNb15SRfDk2OrKCxwiCJLDcd5XYb96dElI99rETpf6RcKOJyq13uSm9A9mnp3AgJRx1ZXqcHpbStwclwVdQKpE8-YZIClsu6Dl5rZOmxQLt-kRuyqLnCCCRM Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 5079370e8fc54d589eb69e64bad2b577 Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerPasswordTestJSON-1958049358 Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5079370e8fc54d589eb69e64bad2b577"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5079370e8fc54d589eb69e64bad2b577"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5079370e8fc54d589eb69e64bad2b577", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5079370e8fc54d589eb69e64bad2b577"}]}] Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerPasswordTestJSON-1958049358 Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 5079370e8fc54d589eb69e64bad2b577 Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1958049358 Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerPasswordTestJSON-1958049358-project Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 28c076b33cd448cbbe1072c832055540 Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerPasswordTestJSON-1958049358-project Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance c41e883f-f0f0-4ac0-82c6-11bde64c33de could not be found. Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'c41e883f-f0f0-4ac0-82c6-11bde64c33de'} Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41e883f-f0f0-4ac0-82c6-11bde64c33de could not be found. Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41e883f-f0f0-4ac0-82c6-11bde64c33de could not be found. Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:05.900334 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:05.905289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:05.905289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:05.905289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:05.905289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:33:05.905289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:33:05.905289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41e883f-f0f0-4ac0-82c6-11bde64c33de could not be found. Jul 14 14:33:05.905289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:05.908274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-900654d0-4bb6-45ea-b042-a42768716982 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] Returning 404 to user: Instance c41e883f-f0f0-4ac0-82c6-11bde64c33de could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:33:05.909415 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-900654d0-4bb6-45ea-b042-a42768716982 tempest-ServerPasswordTestJSON-1958049358 tempest-ServerPasswordTestJSON-1958049358-project] 10.222.0.81 "GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de" status: 404 len: 111 microversion: 2.1 time: 0.055429 Jul 14 14:33:05.911133 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 840/1699] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:05 2022] GET /compute/v2.1/servers/c41e883f-f0f0-4ac0-82c6-11bde64c33de => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:33:05.917297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-20318670-5c27-4978-aac1-f21832a532f6 req-354468cb-3472-4394-80df-d78c65d4c1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6d06d9-90ef-4a73-843a-778f0c146dff", "name": "network-vif-unplugged", "status": "completed", "tag": "15eb7230-5af2-414b-bcce-a51e734e2507"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:05.926153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-20318670-5c27-4978-aac1-f21832a532f6 req-354468cb-3472-4394-80df-d78c65d4c1fc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.926927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-20318670-5c27-4978-aac1-f21832a532f6 req-354468cb-3472-4394-80df-d78c65d4c1fc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.940108 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-20318670-5c27-4978-aac1-f21832a532f6 req-354468cb-3472-4394-80df-d78c65d4c1fc service nova] Creating event network-vif-unplugged:15eb7230-5af2-414b-bcce-a51e734e2507 for instance de6d06d9-90ef-4a73-843a-778f0c146dff on n-h2-767704-28 Jul 14 14:33:05.946622 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-20318670-5c27-4978-aac1-f21832a532f6 req-354468cb-3472-4394-80df-d78c65d4c1fc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033746 Jul 14 14:33:05.947978 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 841/1700] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:05.955025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e2876cfe-8715-4633-a389-1466653f07ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:05.956082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e2876cfe-8715-4633-a389-1466653f07ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:05.966414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2876cfe-8715-4633-a389-1466653f07ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.967485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2876cfe-8715-4633-a389-1466653f07ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.968626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2876cfe-8715-4633-a389-1466653f07ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.969353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2876cfe-8715-4633-a389-1466653f07ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.273855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1ab69876-8900-44a7-93ab-e8051e263c16 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:06.292358 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1ab69876-8900-44a7-93ab-e8051e263c16 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 200 len: 1314 microversion: 2.1 time: 0.502571 Jul 14 14:33:06.311229 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 860/1701] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:05 2022] GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:06.323555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6129d957-b235-4146-8062-e6a2b5c6a4a6 req-7f6d538e-4685-434a-b6d1-23a1e717998a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c41e883f-f0f0-4ac0-82c6-11bde64c33de", "name": "network-vif-deleted", "tag": "d4849642-ca0b-4042-b8c0-edd1efd02f8a"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:06.347045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6129d957-b235-4146-8062-e6a2b5c6a4a6 req-7f6d538e-4685-434a-b6d1-23a1e717998a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.347765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6129d957-b235-4146-8062-e6a2b5c6a4a6 req-7f6d538e-4685-434a-b6d1-23a1e717998a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.379514 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6129d957-b235-4146-8062-e6a2b5c6a4a6 req-7f6d538e-4685-434a-b6d1-23a1e717998a service nova] Creating event network-vif-deleted:d4849642-ca0b-4042-b8c0-edd1efd02f8a for instance c41e883f-f0f0-4ac0-82c6-11bde64c33de on n-h1-767704-28 Jul 14 14:33:06.397648 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6129d957-b235-4146-8062-e6a2b5c6a4a6 req-7f6d538e-4685-434a-b6d1-23a1e717998a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083475 Jul 14 14:33:06.399484 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 861/1702] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:06.413543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-01925533-7984-467f-a48d-770473be8309 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:06.414796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-01925533-7984-467f-a48d-770473be8309 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:06.428752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01925533-7984-467f-a48d-770473be8309 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.430180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01925533-7984-467f-a48d-770473be8309 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.434857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01925533-7984-467f-a48d-770473be8309 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.439995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01925533-7984-467f-a48d-770473be8309 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.444247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e2876cfe-8715-4633-a389-1466653f07ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:06.454637 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e2876cfe-8715-4633-a389-1466653f07ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1198 microversion: 2.1 time: 0.504990 Jul 14 14:33:06.468032 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 842/1703] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:05 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1198 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:06.473798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-2917a33f-25fb-4479-907a-936e470aa4d1 req-f9f05842-d28a-44a9-9df6-058008c348ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c850b90e-27fa-4f9a-bd80-6704843cb1a0", "name": "network-vif-deleted", "tag": "b97d1e15-3c4f-492e-8519-79383a6b7f04"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:06.489078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2917a33f-25fb-4479-907a-936e470aa4d1 req-f9f05842-d28a-44a9-9df6-058008c348ca service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.491043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2917a33f-25fb-4479-907a-936e470aa4d1 req-f9f05842-d28a-44a9-9df6-058008c348ca service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.514493 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-2917a33f-25fb-4479-907a-936e470aa4d1 req-f9f05842-d28a-44a9-9df6-058008c348ca service nova] Creating event network-vif-deleted:b97d1e15-3c4f-492e-8519-79383a6b7f04 for instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 on n-h2-767704-28 Jul 14 14:33:06.520382 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-2917a33f-25fb-4479-907a-936e470aa4d1 req-f9f05842-d28a-44a9-9df6-058008c348ca service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050706 Jul 14 14:33:06.521584 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 843/1704] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:06.527587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9ad3daf0-1696-4baa-aa1f-12cd46ca52e5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:06.528538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9ad3daf0-1696-4baa-aa1f-12cd46ca52e5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:06.538253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ad3daf0-1696-4baa-aa1f-12cd46ca52e5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.539285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ad3daf0-1696-4baa-aa1f-12cd46ca52e5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.541190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ad3daf0-1696-4baa-aa1f-12cd46ca52e5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.542315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ad3daf0-1696-4baa-aa1f-12cd46ca52e5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.578501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9ad3daf0-1696-4baa-aa1f-12cd46ca52e5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:33:06.604022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-01925533-7984-467f-a48d-770473be8309 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:06.619227 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-01925533-7984-467f-a48d-770473be8309 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 200 len: 1259 microversion: 2.1 time: 0.214947 Jul 14 14:33:06.621983 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 862/1705] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:06 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:06.636268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-28328606-8afc-46cb-aa03-86e6a136d2c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Action: 'create', calling method: .version_select at 0x7fd6c59a8550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-528244370", "policies": ["anti-affinity"]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:06.661370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-28328606-8afc-46cb-aa03-86e6a136d2c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:06.670556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-28328606-8afc-46cb-aa03-86e6a136d2c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:06.723455 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9ad3daf0-1696-4baa-aa1f-12cd46ca52e5 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "DELETE /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 204 len: 0 microversion: 2.1 time: 0.200260 Jul 14 14:33:06.724063 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 844/1706] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:33:06 2022] DELETE /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:33:06.740568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-59e05c9f-9d49-4dd2-b428-6e49ab62aae7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:06.746093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-59e05c9f-9d49-4dd2-b428-6e49ab62aae7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:06.755119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-28328606-8afc-46cb-aa03-86e6a136d2c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:06.759753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59e05c9f-9d49-4dd2-b428-6e49ab62aae7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.760404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59e05c9f-9d49-4dd2-b428-6e49ab62aae7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.761269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59e05c9f-9d49-4dd2-b428-6e49ab62aae7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.761725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59e05c9f-9d49-4dd2-b428-6e49ab62aae7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.776311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-28328606-8afc-46cb-aa03-86e6a136d2c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:06.809234 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-28328606-8afc-46cb-aa03-86e6a136d2c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.185376 Jul 14 14:33:06.810956 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 863/1707] 10.222.0.81 () {60 vars in 1173 bytes} [Thu Jul 14 14:33:06 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:06.817053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4c75e4f3-417d-4373-908f-b898e300f900 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:06.818157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4c75e4f3-417d-4373-908f-b898e300f900 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:06.831916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c75e4f3-417d-4373-908f-b898e300f900 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.832793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c75e4f3-417d-4373-908f-b898e300f900 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.833910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c75e4f3-417d-4373-908f-b898e300f900 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.834677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c75e4f3-417d-4373-908f-b898e300f900 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.198538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-59e05c9f-9d49-4dd2-b428-6e49ab62aae7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:07.206305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4c75e4f3-417d-4373-908f-b898e300f900 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:07.221763 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-59e05c9f-9d49-4dd2-b428-6e49ab62aae7 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1525 microversion: 2.1 time: 0.490994 Jul 14 14:33:07.232062 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 845/1708] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:06 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1525 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:07.233704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4c75e4f3-417d-4373-908f-b898e300f900 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:07.238154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4c75e4f3-417d-4373-908f-b898e300f900 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:07.239520 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4c75e4f3-417d-4373-908f-b898e300f900 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 0.427115 Jul 14 14:33:07.240453 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 864/1709] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:06 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:07.244818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1515597283", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d294f556-b8c6-437e-a82d-e0f4994a1030"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:07.323270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-de86dbb8-bd1e-4ab7-85ab-dd8ead15143a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:07.327044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-de86dbb8-bd1e-4ab7-85ab-dd8ead15143a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:07.337717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:33:07.343920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de86dbb8-bd1e-4ab7-85ab-dd8ead15143a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.344411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de86dbb8-bd1e-4ab7-85ab-dd8ead15143a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.345248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de86dbb8-bd1e-4ab7-85ab-dd8ead15143a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.347056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de86dbb8-bd1e-4ab7-85ab-dd8ead15143a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.650604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-de86dbb8-bd1e-4ab7-85ab-dd8ead15143a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:07.667461 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-de86dbb8-bd1e-4ab7-85ab-dd8ead15143a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 200 len: 1314 microversion: 2.1 time: 0.348106 Jul 14 14:33:07.668159 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 865/1710] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:07 2022] GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:07.675279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b666803e-7286-4723-b785-269b7d0a8136 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:07.676213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b666803e-7286-4723-b785-269b7d0a8136 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:07.686445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b666803e-7286-4723-b785-269b7d0a8136 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.687257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b666803e-7286-4723-b785-269b7d0a8136 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.688638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b666803e-7286-4723-b785-269b7d0a8136 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.689610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b666803e-7286-4723-b785-269b7d0a8136 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.798140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:33:07.802004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:33:07.803517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:33:07.804568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:33:07.805192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:33:07.829484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.830360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.832078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.833035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.864070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:07.874805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:07.886801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b666803e-7286-4723-b785-269b7d0a8136 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:07.894010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Going to run 2 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:33:07.896068 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b666803e-7286-4723-b785-269b7d0a8136 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1198 microversion: 2.1 time: 0.225425 Jul 14 14:33:07.897036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 2bad1987-d086-4152-bb13-99ccbd92bb8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:33:07.898763 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 866/1711] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:07 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1198 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:07.905937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8350ce26-bc94-44f1-8ab7-aca65e6a807e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:07.906828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8350ce26-bc94-44f1-8ab7-aca65e6a807e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:07.930503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8350ce26-bc94-44f1-8ab7-aca65e6a807e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.931402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8350ce26-bc94-44f1-8ab7-aca65e6a807e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.936870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8350ce26-bc94-44f1-8ab7-aca65e6a807e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.937755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8350ce26-bc94-44f1-8ab7-aca65e6a807e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.997466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:08.007856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:08.091080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:08.108844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:08.149612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=2bad1987-d086-4152-bb13-99ccbd92bb8c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:33:08.206994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8350ce26-bc94-44f1-8ab7-aca65e6a807e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:08.220170 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8350ce26-bc94-44f1-8ab7-aca65e6a807e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 200 len: 1265 microversion: 2.1 time: 0.319547 Jul 14 14:33:08.225845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:08.233992 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 867/1712] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:07 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:08.241431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4573e6e0-203a-4a87-84a8-40f4c47d142e req-8ee5f65c-1f38-4653-8aa8-3cb2513ee55f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cbc19a-1538-43b8-8e70-91d438069caf", "name": "network-vif-plugged", "status": "completed", "tag": "3b828d42-f8f3-4b22-b64f-6283074dc67c"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:08.251655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:08.259064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4573e6e0-203a-4a87-84a8-40f4c47d142e req-8ee5f65c-1f38-4653-8aa8-3cb2513ee55f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:08.260798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4573e6e0-203a-4a87-84a8-40f4c47d142e req-8ee5f65c-1f38-4653-8aa8-3cb2513ee55f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:08.274273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:08.288625 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4573e6e0-203a-4a87-84a8-40f4c47d142e req-8ee5f65c-1f38-4653-8aa8-3cb2513ee55f service nova] Creating event network-vif-plugged:3b828d42-f8f3-4b22-b64f-6283074dc67c for instance 78cbc19a-1538-43b8-8e70-91d438069caf on n-h1-767704-28 Jul 14 14:33:08.304682 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4573e6e0-203a-4a87-84a8-40f4c47d142e req-8ee5f65c-1f38-4653-8aa8-3cb2513ee55f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068162 Jul 14 14:33:08.307897 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 868/1713] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:08.321299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-745af035-6f32-4291-87b8-afcfebf0aa10 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:08.324434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-745af035-6f32-4291-87b8-afcfebf0aa10 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:08.338457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-745af035-6f32-4291-87b8-afcfebf0aa10 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:08.338986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-745af035-6f32-4291-87b8-afcfebf0aa10 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:08.339808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-745af035-6f32-4291-87b8-afcfebf0aa10 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:08.340259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-745af035-6f32-4291-87b8-afcfebf0aa10 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:08.346447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:08.362470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:08.376213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'server_group_members'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:08.437893 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-24aa4eab-2743-4c62-8c81-87e0fe2827a1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.201281 Jul 14 14:33:08.444026 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 846/1714] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:33:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 1204 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:33:08.450149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3b18f614-f433-4e3a-aacf-95bbdf761209 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:08.453598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3b18f614-f433-4e3a-aacf-95bbdf761209 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:08.472074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b18f614-f433-4e3a-aacf-95bbdf761209 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:08.473452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b18f614-f433-4e3a-aacf-95bbdf761209 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:08.473935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b18f614-f433-4e3a-aacf-95bbdf761209 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:08.474676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b18f614-f433-4e3a-aacf-95bbdf761209 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:08.890956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-745af035-6f32-4291-87b8-afcfebf0aa10 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:08.926095 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-745af035-6f32-4291-87b8-afcfebf0aa10 tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1525 microversion: 2.1 time: 0.616734 Jul 14 14:33:08.949615 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 869/1715] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:08 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1525 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:08.977667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36b5eb80-af83-4b77-b383-fa7065e1c21e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:08.996541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-36b5eb80-af83-4b77-b383-fa7065e1c21e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:09.002363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-36b5eb80-af83-4b77-b383-fa7065e1c21e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Searching by: {'deleted': False, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:33:09.109824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36b5eb80-af83-4b77-b383-fa7065e1c21e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.110416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36b5eb80-af83-4b77-b383-fa7065e1c21e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.111583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36b5eb80-af83-4b77-b383-fa7065e1c21e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.112307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36b5eb80-af83-4b77-b383-fa7065e1c21e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.209773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3b18f614-f433-4e3a-aacf-95bbdf761209 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:09.249999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3b18f614-f433-4e3a-aacf-95bbdf761209 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:09.256404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3b18f614-f433-4e3a-aacf-95bbdf761209 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:09.268887 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3b18f614-f433-4e3a-aacf-95bbdf761209 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1487 microversion: 2.25 time: 0.826271 Jul 14 14:33:09.269594 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 847/1716] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:08 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1487 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:09.276298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-755c3477-ffcb-4fde-a9eb-f9f141b78c87 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:09.277927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-755c3477-ffcb-4fde-a9eb-f9f141b78c87 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:09.286407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-755c3477-ffcb-4fde-a9eb-f9f141b78c87 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.287765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-755c3477-ffcb-4fde-a9eb-f9f141b78c87 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.288715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-755c3477-ffcb-4fde-a9eb-f9f141b78c87 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.289280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-755c3477-ffcb-4fde-a9eb-f9f141b78c87 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.292606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:09.338450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-36b5eb80-af83-4b77-b383-fa7065e1c21e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:33:09.620905 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-36b5eb80-af83-4b77-b383-fa7065e1c21e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.667028 Jul 14 14:33:09.633553 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 870/1717] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 14:33:08 2022] GET /compute/v2.1/servers => generated 1665 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:09.655824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-792c9104-343a-4e98-aff5-6a0ab42710c6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:09.670154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-792c9104-343a-4e98-aff5-6a0ab42710c6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:09.694342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-792c9104-343a-4e98-aff5-6a0ab42710c6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.696315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-792c9104-343a-4e98-aff5-6a0ab42710c6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.699613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-792c9104-343a-4e98-aff5-6a0ab42710c6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.701113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-792c9104-343a-4e98-aff5-6a0ab42710c6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.804477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-755c3477-ffcb-4fde-a9eb-f9f141b78c87 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:09.829235 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-755c3477-ffcb-4fde-a9eb-f9f141b78c87 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 200 len: 1314 microversion: 2.1 time: 0.557595 Jul 14 14:33:09.831990 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 848/1718] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:09 2022] GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:09.844989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-63663f6b-a3dc-44c4-9bd9-0c67b7eb4b1c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:09.848024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-63663f6b-a3dc-44c4-9bd9-0c67b7eb4b1c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:09.871275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-63663f6b-a3dc-44c4-9bd9-0c67b7eb4b1c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.872860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-63663f6b-a3dc-44c4-9bd9-0c67b7eb4b1c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.875410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-63663f6b-a3dc-44c4-9bd9-0c67b7eb4b1c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.876237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-63663f6b-a3dc-44c4-9bd9-0c67b7eb4b1c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:10.633639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-792c9104-343a-4e98-aff5-6a0ab42710c6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:10.690008 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-792c9104-343a-4e98-aff5-6a0ab42710c6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1198 microversion: 2.1 time: 1.022894 Jul 14 14:33:10.691538 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 871/1719] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:09 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1198 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:10.698857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-63663f6b-a3dc-44c4-9bd9-0c67b7eb4b1c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:10.702393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4c067130-1c18-4282-a532-2b50b9f6703c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:10.703548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4c067130-1c18-4282-a532-2b50b9f6703c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:10.710106 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-63663f6b-a3dc-44c4-9bd9-0c67b7eb4b1c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 200 len: 1307 microversion: 2.1 time: 0.876109 Jul 14 14:33:10.720309 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 849/1720] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:09 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 1307 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:10.721352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:10.727877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-64b9c246-ac05-42b3-9c1c-4a2b97005a0c tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:10.729003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-64b9c246-ac05-42b3-9c1c-4a2b97005a0c tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:10.732143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c067130-1c18-4282-a532-2b50b9f6703c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:10.732965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c067130-1c18-4282-a532-2b50b9f6703c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:10.734404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c067130-1c18-4282-a532-2b50b9f6703c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:10.735239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c067130-1c18-4282-a532-2b50b9f6703c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:10.742748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64b9c246-ac05-42b3-9c1c-4a2b97005a0c tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:10.743624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64b9c246-ac05-42b3-9c1c-4a2b97005a0c tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:10.744696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64b9c246-ac05-42b3-9c1c-4a2b97005a0c tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:10.745510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64b9c246-ac05-42b3-9c1c-4a2b97005a0c tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:11.715055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4c067130-1c18-4282-a532-2b50b9f6703c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:11.723997 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4c067130-1c18-4282-a532-2b50b9f6703c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1215 microversion: 2.1 time: 1.030595 Jul 14 14:33:11.731674 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 872/1721] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:10 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1215 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:11.742430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f933bd0-f4f1-4a57-996c-e3a6fc0f9992 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:11.742430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f933bd0-f4f1-4a57-996c-e3a6fc0f9992 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:11.761734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f933bd0-f4f1-4a57-996c-e3a6fc0f9992 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:11.762548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f933bd0-f4f1-4a57-996c-e3a6fc0f9992 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:11.767405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f933bd0-f4f1-4a57-996c-e3a6fc0f9992 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:11.768038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f933bd0-f4f1-4a57-996c-e3a6fc0f9992 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:11.849221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-64b9c246-ac05-42b3-9c1c-4a2b97005a0c tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30626a18f38d467da445eaa2b56faf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f5ab64c38455dad4973c1c974e87f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:11.860455 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-64b9c246-ac05-42b3-9c1c-4a2b97005a0c tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 200 len: 1525 microversion: 2.1 time: 1.138510 Jul 14 14:33:11.863358 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 850/1722] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:10 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 1525 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:11.894062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-519ed782-a78b-495e-9b3f-7cb1db021bed req-05f2d078-8cf8-4294-a358-2f16331e1e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3", "name": "network-vif-plugged", "status": "completed", "tag": "d847f251-9224-4c9f-b335-7f0f58afd9ef"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:11.923622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-519ed782-a78b-495e-9b3f-7cb1db021bed req-05f2d078-8cf8-4294-a358-2f16331e1e90 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:11.924344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-519ed782-a78b-495e-9b3f-7cb1db021bed req-05f2d078-8cf8-4294-a358-2f16331e1e90 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:11.965257 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-519ed782-a78b-495e-9b3f-7cb1db021bed req-05f2d078-8cf8-4294-a358-2f16331e1e90 service nova] Creating event network-vif-plugged:d847f251-9224-4c9f-b335-7f0f58afd9ef for instance dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 on n-h2-767704-28 Jul 14 14:33:11.976799 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-519ed782-a78b-495e-9b3f-7cb1db021bed req-05f2d078-8cf8-4294-a358-2f16331e1e90 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109321 Jul 14 14:33:11.981739 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 851/1723] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:11.993904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-53f4a9a2-1fc7-4a1c-9ce8-21c01a26b383 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:11.994986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-53f4a9a2-1fc7-4a1c-9ce8-21c01a26b383 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:12.022167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53f4a9a2-1fc7-4a1c-9ce8-21c01a26b383 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:12.024650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53f4a9a2-1fc7-4a1c-9ce8-21c01a26b383 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:12.026824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53f4a9a2-1fc7-4a1c-9ce8-21c01a26b383 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:12.029205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53f4a9a2-1fc7-4a1c-9ce8-21c01a26b383 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.168392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-53f4a9a2-1fc7-4a1c-9ce8-21c01a26b383 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:13.178204 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-53f4a9a2-1fc7-4a1c-9ce8-21c01a26b383 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 200 len: 1314 microversion: 2.1 time: 1.193106 Jul 14 14:33:13.178828 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 852/1724] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:11 2022] GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 1314 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:13.184773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f933bd0-f4f1-4a57-996c-e3a6fc0f9992 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:13.186855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b7a94525-7a0f-48bf-947c-b178e506d52e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:13.187683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b7a94525-7a0f-48bf-947c-b178e506d52e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:13.195148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7a94525-7a0f-48bf-947c-b178e506d52e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.195658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7a94525-7a0f-48bf-947c-b178e506d52e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.196544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7a94525-7a0f-48bf-947c-b178e506d52e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.197089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7a94525-7a0f-48bf-947c-b178e506d52e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.200472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f933bd0-f4f1-4a57-996c-e3a6fc0f9992 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:13.202483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f933bd0-f4f1-4a57-996c-e3a6fc0f9992 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:13.214926 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f933bd0-f4f1-4a57-996c-e3a6fc0f9992 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1477 microversion: 2.25 time: 1.481866 Jul 14 14:33:13.215922 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 873/1725] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:11 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1477 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:13.221311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b1cb3a21-cd2a-47b2-ad9c-a00642d2cdaf tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:13.222456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b1cb3a21-cd2a-47b2-ad9c-a00642d2cdaf tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:13.245982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1cb3a21-cd2a-47b2-ad9c-a00642d2cdaf tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.247638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1cb3a21-cd2a-47b2-ad9c-a00642d2cdaf tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.248492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1cb3a21-cd2a-47b2-ad9c-a00642d2cdaf tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.249274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1cb3a21-cd2a-47b2-ad9c-a00642d2cdaf tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.662500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b7a94525-7a0f-48bf-947c-b178e506d52e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:13.681496 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b7a94525-7a0f-48bf-947c-b178e506d52e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1198 microversion: 2.1 time: 0.500116 Jul 14 14:33:13.683078 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 853/1726] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:13 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1198 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:13.686035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b1cb3a21-cd2a-47b2-ad9c-a00642d2cdaf tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:13.699281 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b1cb3a21-cd2a-47b2-ad9c-a00642d2cdaf tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 200 len: 1307 microversion: 2.1 time: 0.481974 Jul 14 14:33:13.700746 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 874/1727] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:13 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 1307 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:13.706146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-5db8a424-0f3b-4d8f-bb96-01963491d9ca req-0042bf86-4e58-419f-b79c-6cb4a33b0a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdad3a0f-8ff2-44ed-9523-482791b158be", "tag": "f9885081-82f8-4100-b4c6-c3a33d97dc81"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:13.706800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5e126ad7-67e5-4166-a8d6-77f060066404 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:13.707584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5e126ad7-67e5-4166-a8d6-77f060066404 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:13.727826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5db8a424-0f3b-4d8f-bb96-01963491d9ca req-0042bf86-4e58-419f-b79c-6cb4a33b0a74 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.728370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5db8a424-0f3b-4d8f-bb96-01963491d9ca req-0042bf86-4e58-419f-b79c-6cb4a33b0a74 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.730862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e126ad7-67e5-4166-a8d6-77f060066404 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.737535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e126ad7-67e5-4166-a8d6-77f060066404 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.739009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e126ad7-67e5-4166-a8d6-77f060066404 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.743588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e126ad7-67e5-4166-a8d6-77f060066404 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.753280 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-5db8a424-0f3b-4d8f-bb96-01963491d9ca req-0042bf86-4e58-419f-b79c-6cb4a33b0a74 service nova] Creating event network-changed:f9885081-82f8-4100-b4c6-c3a33d97dc81 for instance cdad3a0f-8ff2-44ed-9523-482791b158be on n-h2-767704-28 Jul 14 14:33:13.760808 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-5db8a424-0f3b-4d8f-bb96-01963491d9ca req-0042bf86-4e58-419f-b79c-6cb4a33b0a74 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072150 Jul 14 14:33:13.767317 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 854/1728] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:13.789153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-8194c2fd-b6d7-45a5-a6d9-52a38e2bdbb2 req-8df3bcdd-e4e6-4951-8c71-68d6a82b1ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435cc8e8-78b1-4af2-8cba-a8f23344e4d2", "name": "network-vif-deleted", "tag": "b2bcf02b-437a-4cb3-924e-770f54b60aec"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:13.807967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8194c2fd-b6d7-45a5-a6d9-52a38e2bdbb2 req-8df3bcdd-e4e6-4951-8c71-68d6a82b1ddc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.818358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8194c2fd-b6d7-45a5-a6d9-52a38e2bdbb2 req-8df3bcdd-e4e6-4951-8c71-68d6a82b1ddc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.855524 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8194c2fd-b6d7-45a5-a6d9-52a38e2bdbb2 req-8df3bcdd-e4e6-4951-8c71-68d6a82b1ddc service nova] Creating event network-vif-deleted:b2bcf02b-437a-4cb3-924e-770f54b60aec for instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 on n-h1-767704-28 Jul 14 14:33:13.873277 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-8194c2fd-b6d7-45a5-a6d9-52a38e2bdbb2 req-8df3bcdd-e4e6-4951-8c71-68d6a82b1ddc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102697 Jul 14 14:33:13.874394 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 855/1729] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:13.880923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c1d176f2-ceda-4af4-9002-b2cef3fec45f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:13.891675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c1d176f2-ceda-4af4-9002-b2cef3fec45f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] [instance: 435cc8e8-78b1-4af2-8cba-a8f23344e4d2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:13.920571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1d176f2-ceda-4af4-9002-b2cef3fec45f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.921207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1d176f2-ceda-4af4-9002-b2cef3fec45f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.922228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1d176f2-ceda-4af4-9002-b2cef3fec45f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.923629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1d176f2-ceda-4af4-9002-b2cef3fec45f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.982226 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c1d176f2-ceda-4af4-9002-b2cef3fec45f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] HTTP exception thrown: Instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 could not be found. Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c1d176f2-ceda-4af4-9002-b2cef3fec45f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Request method failure captured: Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 HTTP/1.1 Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CixTc2__vuWJwPanxRtaForuX8PQXcNoKTZrSOn8PappAuYSakIgirbSLFUFRKNlDaHVkQw15YIYJo0NxyEqVF6AdMawgehRamUVY9_6WlsfoAxJrCL5gZHtHL_q0odGFoWWO_8yILI57v_Kxx22301GD_audS_eQ5UO5-WCOCQSqk Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 613f5ab64c38455dad4973c1c974e87f Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1223940907 Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/613f5ab64c38455dad4973c1c974e87f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/613f5ab64c38455dad4973c1c974e87f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_613f5ab64c38455dad4973c1c974e87f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/613f5ab64c38455dad4973c1c974e87f"}]}] Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1223940907 Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 613f5ab64c38455dad4973c1c974e87f Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1223940907 Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-FloatingIPsAssociationTestJSON-1223940907-project Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 30626a18f38d467da445eaa2b56faf5e Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1223940907-project Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 could not be found. Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '435cc8e8-78b1-4af2-8cba-a8f23344e4d2'} Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 could not be found. Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 could not be found. Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:13.985642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:13.992761 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:13.992761 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:13.992761 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:13.992761 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:13.992761 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:33:13.992761 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:33:13.992761 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 could not be found. Jul 14 14:33:13.992761 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:13.992761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c1d176f2-ceda-4af4-9002-b2cef3fec45f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] Returning 404 to user: Instance 435cc8e8-78b1-4af2-8cba-a8f23344e4d2 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:33:13.992761 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c1d176f2-ceda-4af4-9002-b2cef3fec45f tempest-FloatingIPsAssociationTestJSON-1223940907 tempest-FloatingIPsAssociationTestJSON-1223940907-project] 10.222.0.81 "GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2" status: 404 len: 111 microversion: 2.1 time: 0.116287 Jul 14 14:33:13.994381 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 856/1730] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:13 2022] GET /compute/v2.1/servers/435cc8e8-78b1-4af2-8cba-a8f23344e4d2 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:33:14.001341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2f27a230-f9a8-4e50-9c4c-e41e73c6ae27 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '.version_select at 0x7fd6c5f2aa60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:14.006762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f27a230-f9a8-4e50-9c4c-e41e73c6ae27 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.008395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f27a230-f9a8-4e50-9c4c-e41e73c6ae27 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.026946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5e126ad7-67e5-4166-a8d6-77f060066404 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:14.035639 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5e126ad7-67e5-4166-a8d6-77f060066404 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1277 microversion: 2.1 time: 0.333481 Jul 14 14:33:14.036254 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 875/1731] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:13 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1277 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:14.052866 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2f27a230-f9a8-4e50-9c4c-e41e73c6ae27 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 2986 microversion: 2.25 time: 0.058511 Jul 14 14:33:14.053542 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 857/1732] 10.222.0.81 () {60 vars in 1183 bytes} [Thu Jul 14 14:33:13 2022] GET /compute/v2.1/os-migrations => generated 2986 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:14.069563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c7fe88d-e983-42e7-bb9c-7d22590d9162 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:14.070898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1c7fe88d-e983-42e7-bb9c-7d22590d9162 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:14.093422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c7fe88d-e983-42e7-bb9c-7d22590d9162 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.094320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c7fe88d-e983-42e7-bb9c-7d22590d9162 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.102481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c7fe88d-e983-42e7-bb9c-7d22590d9162 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.103588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c7fe88d-e983-42e7-bb9c-7d22590d9162 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.197050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-558d09e4-3424-4987-81c1-b2134b101643 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:14.197863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-558d09e4-3424-4987-81c1-b2134b101643 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:14.211987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-558d09e4-3424-4987-81c1-b2134b101643 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.213137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-558d09e4-3424-4987-81c1-b2134b101643 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.214482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-558d09e4-3424-4987-81c1-b2134b101643 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.218900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-558d09e4-3424-4987-81c1-b2134b101643 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.379566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-558d09e4-3424-4987-81c1-b2134b101643 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:14.395853 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-558d09e4-3424-4987-81c1-b2134b101643 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 200 len: 1272 microversion: 2.1 time: 0.203108 Jul 14 14:33:14.411095 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 858/1733] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:14 2022] GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:33:14.702622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ef239a69-d154-4e3c-a249-4017ef5d5eb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:14.703619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ef239a69-d154-4e3c-a249-4017ef5d5eb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:14.712728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef239a69-d154-4e3c-a249-4017ef5d5eb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.713916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef239a69-d154-4e3c-a249-4017ef5d5eb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.715198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef239a69-d154-4e3c-a249-4017ef5d5eb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.716495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef239a69-d154-4e3c-a249-4017ef5d5eb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.769244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-1c7fe88d-e983-42e7-bb9c-7d22590d9162 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] Lazy-loading 'services' on Instance uuid de6d06d9-90ef-4a73-843a-778f0c146dff {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:33:14.806020 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1c7fe88d-e983-42e7-bb9c-7d22590d9162 tempest-LiveAutoBlockMigrationV225Test-1949643396 tempest-LiveAutoBlockMigrationV225Test-1949643396-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1972 microversion: 2.25 time: 0.741527 Jul 14 14:33:14.820523 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 876/1734] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:14 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1972 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:14.826272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-344f8fb9-b528-4c81-82df-1f9193543a8b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:14.827195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-344f8fb9-b528-4c81-82df-1f9193543a8b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:14.850080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-344f8fb9-b528-4c81-82df-1f9193543a8b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.850994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-344f8fb9-b528-4c81-82df-1f9193543a8b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.853152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-344f8fb9-b528-4c81-82df-1f9193543a8b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.853855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-344f8fb9-b528-4c81-82df-1f9193543a8b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.371921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ef239a69-d154-4e3c-a249-4017ef5d5eb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:15.387707 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ef239a69-d154-4e3c-a249-4017ef5d5eb8 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1381 microversion: 2.1 time: 0.689741 Jul 14 14:33:15.400008 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 859/1735] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:14 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1381 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:15.406849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d84befa-d4ac-44a6-b610-1c9aa726f306 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:15.407639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8d84befa-d4ac-44a6-b610-1c9aa726f306 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:15.434617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d84befa-d4ac-44a6-b610-1c9aa726f306 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:15.437034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-344f8fb9-b528-4c81-82df-1f9193543a8b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:15.437212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d84befa-d4ac-44a6-b610-1c9aa726f306 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.440259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d84befa-d4ac-44a6-b610-1c9aa726f306 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:15.441014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d84befa-d4ac-44a6-b610-1c9aa726f306 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.459836 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-344f8fb9-b528-4c81-82df-1f9193543a8b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 200 len: 1307 microversion: 2.1 time: 0.637212 Jul 14 14:33:15.467547 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 877/1736] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:14 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 1307 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:15.495867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8d84befa-d4ac-44a6-b610-1c9aa726f306 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:33:15.496212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e8935e2d-abdd-48e5-9291-fbe7df519ce9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:15.507868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e8935e2d-abdd-48e5-9291-fbe7df519ce9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:15.533104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8935e2d-abdd-48e5-9291-fbe7df519ce9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:15.533964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8935e2d-abdd-48e5-9291-fbe7df519ce9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.535435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8935e2d-abdd-48e5-9291-fbe7df519ce9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:15.536261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8935e2d-abdd-48e5-9291-fbe7df519ce9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.646699 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8d84befa-d4ac-44a6-b610-1c9aa726f306 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "DELETE /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 204 len: 0 microversion: 2.25 time: 0.241104 Jul 14 14:33:15.652898 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 860/1737] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:33:15 2022] DELETE /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:33:15.746217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e8935e2d-abdd-48e5-9291-fbe7df519ce9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:15.760865 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e8935e2d-abdd-48e5-9291-fbe7df519ce9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1277 microversion: 2.1 time: 0.291374 Jul 14 14:33:15.762478 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 878/1738] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:15 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1277 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:15.773129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fad474ef-402e-4f78-922c-2ed84f682086 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:15.775080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fad474ef-402e-4f78-922c-2ed84f682086 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:15.784116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fad474ef-402e-4f78-922c-2ed84f682086 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:15.784971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fad474ef-402e-4f78-922c-2ed84f682086 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.786009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fad474ef-402e-4f78-922c-2ed84f682086 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:15.787309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fad474ef-402e-4f78-922c-2ed84f682086 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.964200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fad474ef-402e-4f78-922c-2ed84f682086 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:15.987178 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fad474ef-402e-4f78-922c-2ed84f682086 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 200 len: 1293 microversion: 2.1 time: 0.219843 Jul 14 14:33:15.993204 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 879/1739] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:15 2022] GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 1293 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:16.007966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5a02a926-9ee5-4699-b9b1-0e8cce03bc77 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:16.012220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5a02a926-9ee5-4699-b9b1-0e8cce03bc77 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:16.027813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a02a926-9ee5-4699-b9b1-0e8cce03bc77 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:16.028276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a02a926-9ee5-4699-b9b1-0e8cce03bc77 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:16.030820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a02a926-9ee5-4699-b9b1-0e8cce03bc77 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:16.033716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a02a926-9ee5-4699-b9b1-0e8cce03bc77 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:16.152733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-abc0a2e9-fa79-4b4e-970b-9658809d700e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:16.155036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-abc0a2e9-fa79-4b4e-970b-9658809d700e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:16.178271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abc0a2e9-fa79-4b4e-970b-9658809d700e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:16.178271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abc0a2e9-fa79-4b4e-970b-9658809d700e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:16.199249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abc0a2e9-fa79-4b4e-970b-9658809d700e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:16.200086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abc0a2e9-fa79-4b4e-970b-9658809d700e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:16.474413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5a02a926-9ee5-4699-b9b1-0e8cce03bc77 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:16.500350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5a02a926-9ee5-4699-b9b1-0e8cce03bc77 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:16.504397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5a02a926-9ee5-4699-b9b1-0e8cce03bc77 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:16.506512 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5a02a926-9ee5-4699-b9b1-0e8cce03bc77 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1483 microversion: 2.25 time: 0.507461 Jul 14 14:33:16.544838 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 880/1740] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:15 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1483 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:16.560085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-d4380536-0964-4232-9c39-c4678b06d989 req-f5b1347d-c8a4-47fd-992f-e128660ab238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cbc19a-1538-43b8-8e70-91d438069caf", "name": "network-vif-deleted", "tag": "3b828d42-f8f3-4b22-b64f-6283074dc67c"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:16.584630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d4380536-0964-4232-9c39-c4678b06d989 req-f5b1347d-c8a4-47fd-992f-e128660ab238 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:16.587331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d4380536-0964-4232-9c39-c4678b06d989 req-f5b1347d-c8a4-47fd-992f-e128660ab238 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:16.620445 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-d4380536-0964-4232-9c39-c4678b06d989 req-f5b1347d-c8a4-47fd-992f-e128660ab238 service nova] Creating event network-vif-deleted:3b828d42-f8f3-4b22-b64f-6283074dc67c for instance 78cbc19a-1538-43b8-8e70-91d438069caf on n-h1-767704-28 Jul 14 14:33:16.636290 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-d4380536-0964-4232-9c39-c4678b06d989 req-f5b1347d-c8a4-47fd-992f-e128660ab238 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089521 Jul 14 14:33:16.640762 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 881/1741] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:16.660022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4af676e4-3064-487b-9f25-3cebd34dd709 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:16.660871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4af676e4-3064-487b-9f25-3cebd34dd709 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:16.686175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4af676e4-3064-487b-9f25-3cebd34dd709 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:16.686650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4af676e4-3064-487b-9f25-3cebd34dd709 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:16.687481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4af676e4-3064-487b-9f25-3cebd34dd709 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:16.688128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4af676e4-3064-487b-9f25-3cebd34dd709 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:16.792457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=14 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:16.970224 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-abc0a2e9-fa79-4b4e-970b-9658809d700e tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1534 microversion: 2.1 time: 1.315739 Jul 14 14:33:16.971624 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 861/1742] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:15 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1534 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:16.983856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a41f5e50-bd05-4204-a3b1-c60f963fee2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:16.986564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a41f5e50-bd05-4204-a3b1-c60f963fee2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:17.005131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a41f5e50-bd05-4204-a3b1-c60f963fee2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:17.008186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a41f5e50-bd05-4204-a3b1-c60f963fee2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:17.009407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a41f5e50-bd05-4204-a3b1-c60f963fee2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:17.012044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a41f5e50-bd05-4204-a3b1-c60f963fee2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:17.274797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a41f5e50-bd05-4204-a3b1-c60f963fee2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:17.287109 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a41f5e50-bd05-4204-a3b1-c60f963fee2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1277 microversion: 2.1 time: 0.313593 Jul 14 14:33:17.290915 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 862/1743] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:16 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1277 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:17.304259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f9919d94-274e-411c-8099-58be3db0170c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:17.305268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f9919d94-274e-411c-8099-58be3db0170c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:17.332121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9919d94-274e-411c-8099-58be3db0170c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:17.332813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9919d94-274e-411c-8099-58be3db0170c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:17.335451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9919d94-274e-411c-8099-58be3db0170c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:17.336109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9919d94-274e-411c-8099-58be3db0170c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:17.849818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:18.125863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4af676e4-3064-487b-9f25-3cebd34dd709 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:18.143993 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4af676e4-3064-487b-9f25-3cebd34dd709 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 200 len: 1307 microversion: 2.1 time: 1.501357 Jul 14 14:33:18.144872 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 882/1744] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:16 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 1307 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:18.156726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0d833973-03a4-4062-821c-44fe95a8ab17 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:18.161099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0d833973-03a4-4062-821c-44fe95a8ab17 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:18.186754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d833973-03a4-4062-821c-44fe95a8ab17 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:18.188153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d833973-03a4-4062-821c-44fe95a8ab17 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:18.190111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d833973-03a4-4062-821c-44fe95a8ab17 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:18.190918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d833973-03a4-4062-821c-44fe95a8ab17 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:18.300684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d833973-03a4-4062-821c-44fe95a8ab17 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:18.301169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d833973-03a4-4062-821c-44fe95a8ab17 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:18.303799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-0d833973-03a4-4062-821c-44fe95a8ab17 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lazy-loading 'fault' on Instance uuid 78cbc19a-1538-43b8-8e70-91d438069caf {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:33:18.383726 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f9919d94-274e-411c-8099-58be3db0170c tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1534 microversion: 2.1 time: 1.091322 Jul 14 14:33:18.385596 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 863/1745] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:17 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1534 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:18.403920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c24281e5-e97d-4736-a116-85e57294316a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:18.405568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c24281e5-e97d-4736-a116-85e57294316a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:18.414281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=24 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:18.417931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c24281e5-e97d-4736-a116-85e57294316a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:18.418396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c24281e5-e97d-4736-a116-85e57294316a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:18.419442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c24281e5-e97d-4736-a116-85e57294316a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:18.420074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c24281e5-e97d-4736-a116-85e57294316a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:18.455250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d833973-03a4-4062-821c-44fe95a8ab17 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:18.469582 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0d833973-03a4-4062-821c-44fe95a8ab17 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 200 len: 1304 microversion: 2.1 time: 0.323085 Jul 14 14:33:18.472168 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 883/1746] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:18 2022] GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 1304 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:18.478322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a6b89071-2331-4a0c-8940-ec07c19fb883 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:18.478953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a6b89071-2331-4a0c-8940-ec07c19fb883 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:18.512158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6b89071-2331-4a0c-8940-ec07c19fb883 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:18.512963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6b89071-2331-4a0c-8940-ec07c19fb883 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:18.513960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6b89071-2331-4a0c-8940-ec07c19fb883 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:18.514588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6b89071-2331-4a0c-8940-ec07c19fb883 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.041782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c24281e5-e97d-4736-a116-85e57294316a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:19.055545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c24281e5-e97d-4736-a116-85e57294316a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:19.057113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c24281e5-e97d-4736-a116-85e57294316a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:19.069675 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c24281e5-e97d-4736-a116-85e57294316a tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1483 microversion: 2.25 time: 0.670737 Jul 14 14:33:19.077703 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 864/1747] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:18 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1483 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:19.092332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-28af32b3-5eb5-4262-8123-9775a2202f77 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:19.102141 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:33:19.102141 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:33:19.105655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28af32b3-5eb5-4262-8123-9775a2202f77 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.110360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28af32b3-5eb5-4262-8123-9775a2202f77 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.115054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28af32b3-5eb5-4262-8123-9775a2202f77 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.116613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28af32b3-5eb5-4262-8123-9775a2202f77 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.207972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:19.225060 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-28af32b3-5eb5-4262-8123-9775a2202f77 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.145051 Jul 14 14:33:19.227538 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 865/1748] 10.222.0.81 () {58 vars in 1175 bytes} [Thu Jul 14 14:33:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:19.237470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e8dbdbfe-e2e0-455a-90b5-3e9efe855f93 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:19.238256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e8dbdbfe-e2e0-455a-90b5-3e9efe855f93 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:19.252316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8dbdbfe-e2e0-455a-90b5-3e9efe855f93 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.253219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8dbdbfe-e2e0-455a-90b5-3e9efe855f93 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.254085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8dbdbfe-e2e0-455a-90b5-3e9efe855f93 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.254598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8dbdbfe-e2e0-455a-90b5-3e9efe855f93 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.373917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a6b89071-2331-4a0c-8940-ec07c19fb883 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:19.389702 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a6b89071-2331-4a0c-8940-ec07c19fb883 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1319 microversion: 2.1 time: 0.912885 Jul 14 14:33:19.395203 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 884/1749] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:18 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1319 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:19.404278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-20ec9778-8a90-451d-b82d-9733a300a2c4 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-767704-28", "block_migration": false, "disk_over_commit": false}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:19.416705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-20ec9778-8a90-451d-b82d-9733a300a2c4 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:19.432856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20ec9778-8a90-451d-b82d-9733a300a2c4 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.433549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20ec9778-8a90-451d-b82d-9733a300a2c4 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.434652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20ec9778-8a90-451d-b82d-9733a300a2c4 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.435373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20ec9778-8a90-451d-b82d-9733a300a2c4 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.474925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:19.493033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-20ec9778-8a90-451d-b82d-9733a300a2c4 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lazy-loading 'flavor' on Instance uuid dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:33:19.547317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-20ec9778-8a90-451d-b82d-9733a300a2c4 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Going to try to live migrate instance to n-h1-767704-28 {{(pid=119512) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:33:19.674887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e8dbdbfe-e2e0-455a-90b5-3e9efe855f93 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:19.702748 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e8dbdbfe-e2e0-455a-90b5-3e9efe855f93 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 200 len: 1307 microversion: 2.1 time: 0.473067 Jul 14 14:33:19.712290 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 866/1750] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:19 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 1307 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:19.727648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6e42177a-d74f-40c6-b970-e2c4aacf01e8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:19.728627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6e42177a-d74f-40c6-b970-e2c4aacf01e8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:19.741723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e42177a-d74f-40c6-b970-e2c4aacf01e8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.742339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e42177a-d74f-40c6-b970-e2c4aacf01e8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.744502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e42177a-d74f-40c6-b970-e2c4aacf01e8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.745224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e42177a-d74f-40c6-b970-e2c4aacf01e8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.772207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:19.775466 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-6e42177a-d74f-40c6-b970-e2c4aacf01e8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6e42177a-d74f-40c6-b970-e2c4aacf01e8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf HTTP/1.1 Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '78cbc19a-1538-43b8-8e70-91d438069caf'} Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:19.777432 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:19.783383 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:19.783383 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:19.783383 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:19.783383 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:33:19.783383 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:33:19.783383 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:33:19.783383 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:19.783383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6e42177a-d74f-40c6-b970-e2c4aacf01e8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:33:19.783383 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6e42177a-d74f-40c6-b970-e2c4aacf01e8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 404 len: 111 microversion: 2.1 time: 0.067151 Jul 14 14:33:19.784545 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 867/1751] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:19 2022] GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:33:19.945712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1461029212", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "e15a1c98-dd72-4729-94f4-9ad8a53d679a"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:20.031243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] validate_networks() for [('e15a1c98-dd72-4729-94f4-9ad8a53d679a', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:33:21.511190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:33:21.512294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:33:21.513224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:33:21.513940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:33:21.514615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:33:21.533077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:21.536259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:21.540653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:21.546119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:21.600745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:21.622540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for user d56c219e943b4398bea8add8299df84f and project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:21.659605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:33:21.663795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:33:21.842562 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-19d24d47-e064-4ab9-9225-2f22f93d6955 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.900817 Jul 14 14:33:21.847979 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 868/1752] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:33:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:33:21.862455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a194fc75-36db-4168-b0e0-e3382455d8b7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:21.862713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a194fc75-36db-4168-b0e0-e3382455d8b7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:21.871902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a194fc75-36db-4168-b0e0-e3382455d8b7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:21.872781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a194fc75-36db-4168-b0e0-e3382455d8b7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:21.874164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a194fc75-36db-4168-b0e0-e3382455d8b7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:21.874781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a194fc75-36db-4168-b0e0-e3382455d8b7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:22.586965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a194fc75-36db-4168-b0e0-e3382455d8b7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:22.603443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a194fc75-36db-4168-b0e0-e3382455d8b7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:22.607495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a194fc75-36db-4168-b0e0-e3382455d8b7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:22.611682 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a194fc75-36db-4168-b0e0-e3382455d8b7 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1266 microversion: 2.25 time: 0.760974 Jul 14 14:33:22.613882 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 869/1753] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:21 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1266 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:22.627785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-9715253b-2598-494e-b264-c9b5f4335e95 req-2be048ae-39bf-4121-afa6-0d5eea6ca5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6d06d9-90ef-4a73-843a-778f0c146dff", "name": "network-vif-deleted", "tag": "15eb7230-5af2-414b-bcce-a51e734e2507"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:22.654566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9715253b-2598-494e-b264-c9b5f4335e95 req-2be048ae-39bf-4121-afa6-0d5eea6ca5f0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:22.655637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9715253b-2598-494e-b264-c9b5f4335e95 req-2be048ae-39bf-4121-afa6-0d5eea6ca5f0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:22.681533 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-9715253b-2598-494e-b264-c9b5f4335e95 req-2be048ae-39bf-4121-afa6-0d5eea6ca5f0 service nova] Creating event network-vif-deleted:15eb7230-5af2-414b-bcce-a51e734e2507 for instance de6d06d9-90ef-4a73-843a-778f0c146dff on n-h1-767704-28 Jul 14 14:33:22.699468 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-9715253b-2598-494e-b264-c9b5f4335e95 req-2be048ae-39bf-4121-afa6-0d5eea6ca5f0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080843 Jul 14 14:33:22.700114 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 870/1754] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:22.716129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed0b5357-f764-4718-959a-c6c7fb878a68 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:22.716909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ed0b5357-f764-4718-959a-c6c7fb878a68 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:22.735338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed0b5357-f764-4718-959a-c6c7fb878a68 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:22.735802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed0b5357-f764-4718-959a-c6c7fb878a68 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:22.736607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed0b5357-f764-4718-959a-c6c7fb878a68 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:22.737086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed0b5357-f764-4718-959a-c6c7fb878a68 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:24.251435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ed0b5357-f764-4718-959a-c6c7fb878a68 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:24.266250 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed0b5357-f764-4718-959a-c6c7fb878a68 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1319 microversion: 2.1 time: 1.564629 Jul 14 14:33:24.276180 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 871/1755] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:22 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1319 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:24.281303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0618f931-da1f-4c79-9954-23ab80154ad5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:24.282188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0618f931-da1f-4c79-9954-23ab80154ad5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:24.289802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0618f931-da1f-4c79-9954-23ab80154ad5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:24.290665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0618f931-da1f-4c79-9954-23ab80154ad5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:24.291643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0618f931-da1f-4c79-9954-23ab80154ad5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:24.292254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0618f931-da1f-4c79-9954-23ab80154ad5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:24.721700 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-20ec9778-8a90-451d-b82d-9733a300a2c4 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3/action" status: 202 len: 0 microversion: 2.1 time: 5.325114 Jul 14 14:33:24.723007 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 885/1756] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:33:19 2022] POST /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3/action => generated 0 bytes in 5327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:33:24.730094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b4eefca8-cfe5-4598-b1fd-31f7ccb3f65b req-c188de9a-7b13-4332-b9ad-0a0606d2df2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bad1987-d086-4152-bb13-99ccbd92bb8c", "tag": "fe774887-d248-4bf3-bb6b-abe60ece7908"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:24.772607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b4eefca8-cfe5-4598-b1fd-31f7ccb3f65b req-c188de9a-7b13-4332-b9ad-0a0606d2df2e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:24.778365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b4eefca8-cfe5-4598-b1fd-31f7ccb3f65b req-c188de9a-7b13-4332-b9ad-0a0606d2df2e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:24.812770 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b4eefca8-cfe5-4598-b1fd-31f7ccb3f65b req-c188de9a-7b13-4332-b9ad-0a0606d2df2e service nova] Creating event network-changed:fe774887-d248-4bf3-bb6b-abe60ece7908 for instance 2bad1987-d086-4152-bb13-99ccbd92bb8c on n-h2-767704-28 Jul 14 14:33:24.820642 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b4eefca8-cfe5-4598-b1fd-31f7ccb3f65b req-c188de9a-7b13-4332-b9ad-0a0606d2df2e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095705 Jul 14 14:33:24.825228 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 886/1757] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:24.845704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2c510eb6-d801-4d50-aaac-815d213c9b2f req-83070b8e-48e8-43a6-9f51-b33412678095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdad3a0f-8ff2-44ed-9523-482791b158be", "name": "network-vif-plugged", "status": "completed", "tag": "f9885081-82f8-4100-b4c6-c3a33d97dc81"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:24.865285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2c510eb6-d801-4d50-aaac-815d213c9b2f req-83070b8e-48e8-43a6-9f51-b33412678095 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:24.866076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2c510eb6-d801-4d50-aaac-815d213c9b2f req-83070b8e-48e8-43a6-9f51-b33412678095 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:24.883255 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2c510eb6-d801-4d50-aaac-815d213c9b2f req-83070b8e-48e8-43a6-9f51-b33412678095 service nova] Creating event network-vif-plugged:f9885081-82f8-4100-b4c6-c3a33d97dc81 for instance cdad3a0f-8ff2-44ed-9523-482791b158be on n-h2-767704-28 Jul 14 14:33:24.889702 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2c510eb6-d801-4d50-aaac-815d213c9b2f req-83070b8e-48e8-43a6-9f51-b33412678095 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059615 Jul 14 14:33:24.893007 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 887/1758] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:24.909819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4d5bf730-4a29-4a71-9f44-480fe99e6c53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:24.910780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4d5bf730-4a29-4a71-9f44-480fe99e6c53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:24.919986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d5bf730-4a29-4a71-9f44-480fe99e6c53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:24.920771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d5bf730-4a29-4a71-9f44-480fe99e6c53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:24.922390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d5bf730-4a29-4a71-9f44-480fe99e6c53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:24.923068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d5bf730-4a29-4a71-9f44-480fe99e6c53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:25.220004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0618f931-da1f-4c79-9954-23ab80154ad5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:25.245929 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0618f931-da1f-4c79-9954-23ab80154ad5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 200 len: 1307 microversion: 2.1 time: 0.968390 Jul 14 14:33:25.246554 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 872/1759] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:24 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 1307 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:25.263520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b65fd0ab-a47a-415a-b944-04125da2d01e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:25.263520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b65fd0ab-a47a-415a-b944-04125da2d01e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:25.282956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b65fd0ab-a47a-415a-b944-04125da2d01e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:25.283555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b65fd0ab-a47a-415a-b944-04125da2d01e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:25.284364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b65fd0ab-a47a-415a-b944-04125da2d01e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:25.284805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b65fd0ab-a47a-415a-b944-04125da2d01e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:25.371446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4d5bf730-4a29-4a71-9f44-480fe99e6c53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:25.391348 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4d5bf730-4a29-4a71-9f44-480fe99e6c53 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1285 microversion: 2.1 time: 0.494689 Jul 14 14:33:25.393930 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 888/1760] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:24 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1285 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:25.410306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0facbd01-d567-40c7-9f5f-d82e397eaac3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:25.413531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0facbd01-d567-40c7-9f5f-d82e397eaac3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:25.432519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0facbd01-d567-40c7-9f5f-d82e397eaac3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:25.433515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0facbd01-d567-40c7-9f5f-d82e397eaac3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:25.434584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0facbd01-d567-40c7-9f5f-d82e397eaac3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:25.440273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0facbd01-d567-40c7-9f5f-d82e397eaac3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:25.474502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b65fd0ab-a47a-415a-b944-04125da2d01e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:25.487797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b65fd0ab-a47a-415a-b944-04125da2d01e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:25.508884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b65fd0ab-a47a-415a-b944-04125da2d01e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:25.510761 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b65fd0ab-a47a-415a-b944-04125da2d01e tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1266 microversion: 2.25 time: 0.263144 Jul 14 14:33:25.518418 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 873/1761] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:25 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:25.524430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d71cb3ca-5328-4b54-b538-a5a07198ee9c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:25.525510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d71cb3ca-5328-4b54-b538-a5a07198ee9c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:25.537679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d71cb3ca-5328-4b54-b538-a5a07198ee9c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:25.538138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d71cb3ca-5328-4b54-b538-a5a07198ee9c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:25.539042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d71cb3ca-5328-4b54-b538-a5a07198ee9c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:25.539539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d71cb3ca-5328-4b54-b538-a5a07198ee9c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:26.393592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0facbd01-d567-40c7-9f5f-d82e397eaac3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:26.403205 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0facbd01-d567-40c7-9f5f-d82e397eaac3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 1.007802 Jul 14 14:33:26.407634 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 889/1762] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:25 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:26.418088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8bfc2c1-bb2f-4de6-8545-44d093c446b9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:26.420986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8bfc2c1-bb2f-4de6-8545-44d093c446b9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:26.433835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d71cb3ca-5328-4b54-b538-a5a07198ee9c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:26.451162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8bfc2c1-bb2f-4de6-8545-44d093c446b9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:26.452080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8bfc2c1-bb2f-4de6-8545-44d093c446b9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:26.452213 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d71cb3ca-5328-4b54-b538-a5a07198ee9c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1319 microversion: 2.1 time: 0.926030 Jul 14 14:33:26.457180 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 874/1763] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:25 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1319 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:26.459485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8bfc2c1-bb2f-4de6-8545-44d093c446b9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:26.459947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8bfc2c1-bb2f-4de6-8545-44d093c446b9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:26.468418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-29eff15b-1d12-45b7-b8a4-d67253b67f94 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:26.469081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-29eff15b-1d12-45b7-b8a4-d67253b67f94 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:26.495158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:26.499742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29eff15b-1d12-45b7-b8a4-d67253b67f94 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:26.503890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29eff15b-1d12-45b7-b8a4-d67253b67f94 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:26.508637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29eff15b-1d12-45b7-b8a4-d67253b67f94 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:26.511003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29eff15b-1d12-45b7-b8a4-d67253b67f94 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:26.758477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-29eff15b-1d12-45b7-b8a4-d67253b67f94 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:26.776981 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-29eff15b-1d12-45b7-b8a4-d67253b67f94 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1273 microversion: 2.1 time: 0.318004 Jul 14 14:33:26.795890 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 875/1764] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:26 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1273 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:26.807773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-097a3dc9-016c-4f5c-8129-de98dda552aa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:26.810201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-097a3dc9-016c-4f5c-8129-de98dda552aa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:26.834010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-097a3dc9-016c-4f5c-8129-de98dda552aa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:26.835100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-097a3dc9-016c-4f5c-8129-de98dda552aa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:26.835970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-097a3dc9-016c-4f5c-8129-de98dda552aa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:26.836407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-097a3dc9-016c-4f5c-8129-de98dda552aa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:27.217500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-097a3dc9-016c-4f5c-8129-de98dda552aa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:27.234503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-097a3dc9-016c-4f5c-8129-de98dda552aa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:27.243390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-097a3dc9-016c-4f5c-8129-de98dda552aa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:27.249693 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-097a3dc9-016c-4f5c-8129-de98dda552aa tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1266 microversion: 2.25 time: 0.451510 Jul 14 14:33:27.267803 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 876/1765] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:26 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1266 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:27.277185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6e34d47e-373a-4883-bf6f-dd1e8d05992f req-8096b843-8c8a-4498-a8dc-2f4f5e967fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c46f722-10e5-4303-a3fa-716190afe6b0", "tag": "d148890b-4fb9-4562-bf79-cbf8e06f2a18"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:27.306341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6e34d47e-373a-4883-bf6f-dd1e8d05992f req-8096b843-8c8a-4498-a8dc-2f4f5e967fdd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:27.311315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6e34d47e-373a-4883-bf6f-dd1e8d05992f req-8096b843-8c8a-4498-a8dc-2f4f5e967fdd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:27.352787 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6e34d47e-373a-4883-bf6f-dd1e8d05992f req-8096b843-8c8a-4498-a8dc-2f4f5e967fdd service nova] Creating event network-changed:d148890b-4fb9-4562-bf79-cbf8e06f2a18 for instance 6c46f722-10e5-4303-a3fa-716190afe6b0 on n-h1-767704-28 Jul 14 14:33:27.384477 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6e34d47e-373a-4883-bf6f-dd1e8d05992f req-8096b843-8c8a-4498-a8dc-2f4f5e967fdd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115357 Jul 14 14:33:27.385545 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 877/1766] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:27.427016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bcf6e909-ac2b-4963-86da-e958a26be3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:27.427917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bcf6e909-ac2b-4963-86da-e958a26be3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:27.438645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bcf6e909-ac2b-4963-86da-e958a26be3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:27.441360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bcf6e909-ac2b-4963-86da-e958a26be3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:27.443649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bcf6e909-ac2b-4963-86da-e958a26be3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:27.445554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bcf6e909-ac2b-4963-86da-e958a26be3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:27.993109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d8bfc2c1-bb2f-4de6-8545-44d093c446b9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:28.002520 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8bfc2c1-bb2f-4de6-8545-44d093c446b9 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 200 len: 1307 microversion: 2.1 time: 1.593600 Jul 14 14:33:28.015650 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 890/1767] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:26 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 1307 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:28.021345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0addcd7d-e829-4278-b650-33fc0a0ab63d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:28.029368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0addcd7d-e829-4278-b650-33fc0a0ab63d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:28.048638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0addcd7d-e829-4278-b650-33fc0a0ab63d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:28.049214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0addcd7d-e829-4278-b650-33fc0a0ab63d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:28.050260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0addcd7d-e829-4278-b650-33fc0a0ab63d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:28.057770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0addcd7d-e829-4278-b650-33fc0a0ab63d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:28.246645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bcf6e909-ac2b-4963-86da-e958a26be3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:28.255899 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bcf6e909-ac2b-4963-86da-e958a26be3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.838352 Jul 14 14:33:28.261022 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 878/1768] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:27 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:28.277694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b98918f-907a-481a-a4e8-7c149fb35f5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:28.278670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0b98918f-907a-481a-a4e8-7c149fb35f5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:28.314307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b98918f-907a-481a-a4e8-7c149fb35f5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:28.314843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b98918f-907a-481a-a4e8-7c149fb35f5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:28.316056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b98918f-907a-481a-a4e8-7c149fb35f5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:28.316588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b98918f-907a-481a-a4e8-7c149fb35f5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:29.480134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0addcd7d-e829-4278-b650-33fc0a0ab63d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:29.492105 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0addcd7d-e829-4278-b650-33fc0a0ab63d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1319 microversion: 2.1 time: 1.474877 Jul 14 14:33:29.506523 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 891/1769] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:28 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1319 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:29.518795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-51c6cf30-f027-43ff-bedc-d637118b3905 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:29.522908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-51c6cf30-f027-43ff-bedc-d637118b3905 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:29.532154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51c6cf30-f027-43ff-bedc-d637118b3905 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:29.534950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51c6cf30-f027-43ff-bedc-d637118b3905 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:29.537983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51c6cf30-f027-43ff-bedc-d637118b3905 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:29.538929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51c6cf30-f027-43ff-bedc-d637118b3905 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:29.609494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0b98918f-907a-481a-a4e8-7c149fb35f5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:29.620411 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0b98918f-907a-481a-a4e8-7c149fb35f5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1315 microversion: 2.1 time: 1.358011 Jul 14 14:33:29.633997 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 879/1770] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:28 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1315 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:29.639564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eb556669-ce3c-4bea-b10a-bf52fcb64a49 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:29.640436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eb556669-ce3c-4bea-b10a-bf52fcb64a49 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:29.647696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb556669-ce3c-4bea-b10a-bf52fcb64a49 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:29.648453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb556669-ce3c-4bea-b10a-bf52fcb64a49 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:29.649448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb556669-ce3c-4bea-b10a-bf52fcb64a49 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:29.650060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb556669-ce3c-4bea-b10a-bf52fcb64a49 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:30.023425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-51c6cf30-f027-43ff-bedc-d637118b3905 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:30.039042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-51c6cf30-f027-43ff-bedc-d637118b3905 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:30.049049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-51c6cf30-f027-43ff-bedc-d637118b3905 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:30.050713 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-51c6cf30-f027-43ff-bedc-d637118b3905 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 200 len: 1189 microversion: 2.25 time: 0.540087 Jul 14 14:33:30.054175 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 892/1771] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:29 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 1189 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:30.064707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-99a36c3a-6c36-4250-9e84-2140ee581d02 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:30.070829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-99a36c3a-6c36-4250-9e84-2140ee581d02 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:30.086011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99a36c3a-6c36-4250-9e84-2140ee581d02 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:30.086826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99a36c3a-6c36-4250-9e84-2140ee581d02 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:30.087899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99a36c3a-6c36-4250-9e84-2140ee581d02 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:30.089551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99a36c3a-6c36-4250-9e84-2140ee581d02 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:30.756115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eb556669-ce3c-4bea-b10a-bf52fcb64a49 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:30.767079 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eb556669-ce3c-4bea-b10a-bf52fcb64a49 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 200 len: 1486 microversion: 2.1 time: 1.131421 Jul 14 14:33:30.774758 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 880/1772] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:29 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 1486 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:30.782441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-99a36c3a-6c36-4250-9e84-2140ee581d02 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:30.789512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b4d5053f-b055-45ba-9916-60f3d4709a0d req-72ad9554-b9b1-4047-8a5e-8343a28bd0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bad1987-d086-4152-bb13-99ccbd92bb8c", "name": "network-vif-plugged", "status": "completed", "tag": "fe774887-d248-4bf3-bb6b-abe60ece7908"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:30.801945 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-99a36c3a-6c36-4250-9e84-2140ee581d02 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.745995 Jul 14 14:33:30.804317 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 893/1773] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:30 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:30.825539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b4d5053f-b055-45ba-9916-60f3d4709a0d req-72ad9554-b9b1-4047-8a5e-8343a28bd0a4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:30.826333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b4d5053f-b055-45ba-9916-60f3d4709a0d req-72ad9554-b9b1-4047-8a5e-8343a28bd0a4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:30.836824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8ad2c7f6-fe56-468a-b76c-cd25b02d570f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:30.837838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8ad2c7f6-fe56-468a-b76c-cd25b02d570f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:30.860685 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b4d5053f-b055-45ba-9916-60f3d4709a0d req-72ad9554-b9b1-4047-8a5e-8343a28bd0a4 service nova] Creating event network-vif-plugged:fe774887-d248-4bf3-bb6b-abe60ece7908 for instance 2bad1987-d086-4152-bb13-99ccbd92bb8c on n-h2-767704-28 Jul 14 14:33:30.867741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ad2c7f6-fe56-468a-b76c-cd25b02d570f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:30.873097 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b4d5053f-b055-45ba-9916-60f3d4709a0d req-72ad9554-b9b1-4047-8a5e-8343a28bd0a4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096838 Jul 14 14:33:30.874027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ad2c7f6-fe56-468a-b76c-cd25b02d570f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:30.874977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ad2c7f6-fe56-468a-b76c-cd25b02d570f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:30.876627 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 881/1774] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:30.877270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ad2c7f6-fe56-468a-b76c-cd25b02d570f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:30.890356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ab579cc9-1edf-4af3-b084-0d3c736a32ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:30.899884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ab579cc9-1edf-4af3-b084-0d3c736a32ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:30.913836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab579cc9-1edf-4af3-b084-0d3c736a32ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:30.915512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab579cc9-1edf-4af3-b084-0d3c736a32ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:30.918236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab579cc9-1edf-4af3-b084-0d3c736a32ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:30.922274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab579cc9-1edf-4af3-b084-0d3c736a32ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:31.530277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8ad2c7f6-fe56-468a-b76c-cd25b02d570f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:31.548079 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8ad2c7f6-fe56-468a-b76c-cd25b02d570f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1319 microversion: 2.1 time: 0.737238 Jul 14 14:33:31.549215 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 894/1775] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:30 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1319 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:31.556343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a5bf0abf-1365-4226-951a-3ef776273685 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:31.556889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a5bf0abf-1365-4226-951a-3ef776273685 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:31.575824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5bf0abf-1365-4226-951a-3ef776273685 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:31.578035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:31.578585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5bf0abf-1365-4226-951a-3ef776273685 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:31.579661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5bf0abf-1365-4226-951a-3ef776273685 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:31.581494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5bf0abf-1365-4226-951a-3ef776273685 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:31.636186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-a5bf0abf-1365-4226-951a-3ef776273685 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lazy-loading 'flavor' on Instance uuid cdad3a0f-8ff2-44ed-9523-482791b158be {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:33:31.642060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:31.728401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ab579cc9-1edf-4af3-b084-0d3c736a32ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:31.736761 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ab579cc9-1edf-4af3-b084-0d3c736a32ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1315 microversion: 2.1 time: 0.858447 Jul 14 14:33:31.742076 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 882/1776] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:30 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1315 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:31.761184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9a699cd3-646b-4828-8076-b7838a47fdb8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:31.762343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9a699cd3-646b-4828-8076-b7838a47fdb8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: de6d06d9-90ef-4a73-843a-778f0c146dff] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:31.777414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a699cd3-646b-4828-8076-b7838a47fdb8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:31.781549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a699cd3-646b-4828-8076-b7838a47fdb8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:31.783010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a699cd3-646b-4828-8076-b7838a47fdb8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:31.783681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a699cd3-646b-4828-8076-b7838a47fdb8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:31.823053 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-9a699cd3-646b-4828-8076-b7838a47fdb8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] HTTP exception thrown: Instance de6d06d9-90ef-4a73-843a-778f0c146dff could not be found. Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9a699cd3-646b-4828-8076-b7838a47fdb8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Request method failure captured: Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff HTTP/1.1 Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CeRYQkBsHWRZzeg3gM75BtPmbMeWbC_fASh1Cxn3K4J33bHdQBDrWEc-RP6z8mW148RnKRxxABuudvGohrHZcKKUffRQ35hVrElxs4rTDbe8wB_DlavvbnZi6Mv8Da8z1Wa3gC8zoHyhYe-xb2QlqPzcUuvwkWmdUZyZBja-MFG1ME Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.25 Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 4459eedeb8884ffe82ed62e567fb64c3 Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-653795149 Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4459eedeb8884ffe82ed62e567fb64c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4459eedeb8884ffe82ed62e567fb64c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4459eedeb8884ffe82ed62e567fb64c3", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4459eedeb8884ffe82ed62e567fb64c3"}]}] Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-653795149 Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 4459eedeb8884ffe82ed62e567fb64c3 Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-653795149 Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-LiveAutoBlockMigrationV225Test-653795149-project Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: ef25b01962404bdfa0c2bbb30401ca62 Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-653795149-project Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance de6d06d9-90ef-4a73-843a-778f0c146dff could not be found. Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'de6d06d9-90ef-4a73-843a-778f0c146dff'} Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de6d06d9-90ef-4a73-843a-778f0c146dff could not be found. Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de6d06d9-90ef-4a73-843a-778f0c146dff could not be found. Jul 14 14:33:31.825289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:31.830100 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:31.830100 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:31.830100 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:31.830100 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:31.830100 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:31.830100 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:33:31.830100 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:33:31.830100 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de6d06d9-90ef-4a73-843a-778f0c146dff could not be found. Jul 14 14:33:31.830100 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:33:31.832462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9a699cd3-646b-4828-8076-b7838a47fdb8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Returning 404 to user: Instance de6d06d9-90ef-4a73-843a-778f0c146dff could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:33:31.834580 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9a699cd3-646b-4828-8076-b7838a47fdb8 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff" status: 404 len: 111 microversion: 2.25 time: 0.081919 Jul 14 14:33:31.839332 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 883/1777] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:31 2022] GET /compute/v2.1/servers/de6d06d9-90ef-4a73-843a-778f0c146dff => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:33:31.858640 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a5bf0abf-1365-4226-951a-3ef776273685 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "POST /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be/action" status: 202 len: 0 microversion: 2.1 time: 0.308085 Jul 14 14:33:31.876981 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 895/1778] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:33:31 2022] POST /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:33:31.903122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3acdafc8-775b-4173-9eaf-145440a2d22b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:31.904667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3acdafc8-775b-4173-9eaf-145440a2d22b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:31.920254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3acdafc8-775b-4173-9eaf-145440a2d22b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:31.920707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3acdafc8-775b-4173-9eaf-145440a2d22b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:31.921524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3acdafc8-775b-4173-9eaf-145440a2d22b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:31.922036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3acdafc8-775b-4173-9eaf-145440a2d22b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:32.343864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3acdafc8-775b-4173-9eaf-145440a2d22b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:32.361276 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3acdafc8-775b-4173-9eaf-145440a2d22b tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.482378 Jul 14 14:33:32.361997 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 896/1779] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:31 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:32.372158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c68a7c70-7ae6-4b11-84ce-d8a57f26f184 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:32.378042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c68a7c70-7ae6-4b11-84ce-d8a57f26f184 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:32.414316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c68a7c70-7ae6-4b11-84ce-d8a57f26f184 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:32.421213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c68a7c70-7ae6-4b11-84ce-d8a57f26f184 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:32.425417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c68a7c70-7ae6-4b11-84ce-d8a57f26f184 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:32.426883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c68a7c70-7ae6-4b11-84ce-d8a57f26f184 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:32.633930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5bedae1-2409-4e47-a1b5-10d5ae00023b tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Action: 'create', calling method: .version_select at 0x7fd6c5e7edc0>, body: {"keypair": {"name": "tempest-keypair-374576126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUZiARRVycJWayWZ321YAbI8p1PKW4Kacw5qgzpIovbDkZ6z0Hafn1GEXHmFIStIgXt2xS13ghqaNvxNG5Q+f1mnlbjunOXh1ic/wc2HGbQ1/ZvLESdlc6l02OsfAHQXQ=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:32.673546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d5bedae1-2409-4e47-a1b5-10d5ae00023b tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Getting quotas for project 058b0841c5944cfdb9fa3c15cf63d395. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:32.695584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d5bedae1-2409-4e47-a1b5-10d5ae00023b tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Getting quotas for user 4cf4359ec8544e118d266ef97e131398 and project 058b0841c5944cfdb9fa3c15cf63d395. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:32.773927 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d5bedae1-2409-4e47-a1b5-10d5ae00023b tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.932977 Jul 14 14:33:32.774542 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 884/1780] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:33:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:32.787578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-dff6454c-62b3-4765-9f89-daf4cb74b25c req-12b7aaad-07a4-41dc-941f-f727fcd9e69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70651b9-4d75-42ad-9463-eb29e92c4356", "tag": "68e92357-37f2-4a04-b0ba-f5883afdb349"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:32.840471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-dff6454c-62b3-4765-9f89-daf4cb74b25c req-12b7aaad-07a4-41dc-941f-f727fcd9e69c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:32.841323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-dff6454c-62b3-4765-9f89-daf4cb74b25c req-12b7aaad-07a4-41dc-941f-f727fcd9e69c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:32.879269 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-dff6454c-62b3-4765-9f89-daf4cb74b25c req-12b7aaad-07a4-41dc-941f-f727fcd9e69c service nova] Creating event network-changed:68e92357-37f2-4a04-b0ba-f5883afdb349 for instance c70651b9-4d75-42ad-9463-eb29e92c4356 on n-h2-767704-28 Jul 14 14:33:32.894271 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-dff6454c-62b3-4765-9f89-daf4cb74b25c req-12b7aaad-07a4-41dc-941f-f727fcd9e69c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112281 Jul 14 14:33:32.895897 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 885/1781] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:32.939335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-83876a4c-aa90-473d-b0fb-779673b3b26f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:32.951899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-83876a4c-aa90-473d-b0fb-779673b3b26f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:32.983603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83876a4c-aa90-473d-b0fb-779673b3b26f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:32.986722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83876a4c-aa90-473d-b0fb-779673b3b26f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:32.992524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83876a4c-aa90-473d-b0fb-779673b3b26f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:32.993997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83876a4c-aa90-473d-b0fb-779673b3b26f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:33.049389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c68a7c70-7ae6-4b11-84ce-d8a57f26f184 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:33.061996 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c68a7c70-7ae6-4b11-84ce-d8a57f26f184 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 200 len: 1494 microversion: 2.1 time: 0.698040 Jul 14 14:33:33.077405 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 897/1782] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:32 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 1494 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:33.110743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f57ff651-4524-4da8-b6e2-eb4df5a06b91 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:33.111386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f57ff651-4524-4da8-b6e2-eb4df5a06b91 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:33.137082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f57ff651-4524-4da8-b6e2-eb4df5a06b91 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:33.140812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f57ff651-4524-4da8-b6e2-eb4df5a06b91 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:33.145892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f57ff651-4524-4da8-b6e2-eb4df5a06b91 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:33.149286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f57ff651-4524-4da8-b6e2-eb4df5a06b91 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:33.762920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-83876a4c-aa90-473d-b0fb-779673b3b26f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:33.774364 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-83876a4c-aa90-473d-b0fb-779673b3b26f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1319 microversion: 2.1 time: 0.855948 Jul 14 14:33:33.776121 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 886/1783] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:32 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1319 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:33.790362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-4c7a5704-319a-4563-9377-ad7fb7796715 req-28f58a3b-b7fb-4625-91ab-5360f7a92c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c46f722-10e5-4303-a3fa-716190afe6b0", "name": "network-vif-plugged", "status": "completed", "tag": "d148890b-4fb9-4562-bf79-cbf8e06f2a18"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:33.815670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4c7a5704-319a-4563-9377-ad7fb7796715 req-28f58a3b-b7fb-4625-91ab-5360f7a92c05 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:33.821550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4c7a5704-319a-4563-9377-ad7fb7796715 req-28f58a3b-b7fb-4625-91ab-5360f7a92c05 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:33.850565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f57ff651-4524-4da8-b6e2-eb4df5a06b91 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:33.859870 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-4c7a5704-319a-4563-9377-ad7fb7796715 req-28f58a3b-b7fb-4625-91ab-5360f7a92c05 service nova] Creating event network-vif-plugged:d148890b-4fb9-4562-bf79-cbf8e06f2a18 for instance 6c46f722-10e5-4303-a3fa-716190afe6b0 on n-h1-767704-28 Jul 14 14:33:33.867795 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f57ff651-4524-4da8-b6e2-eb4df5a06b91 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1315 microversion: 2.1 time: 0.787808 Jul 14 14:33:33.883527 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-4c7a5704-319a-4563-9377-ad7fb7796715 req-28f58a3b-b7fb-4625-91ab-5360f7a92c05 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104041 Jul 14 14:33:33.886178 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 887/1784] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:33.886607 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 898/1785] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:33 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1315 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:33.898813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6aa8272f-d267-4fe9-92b6-1b7860e5937d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:33.899526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6aa8272f-d267-4fe9-92b6-1b7860e5937d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:33.947744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6aa8272f-d267-4fe9-92b6-1b7860e5937d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:33.950190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6aa8272f-d267-4fe9-92b6-1b7860e5937d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:33.955646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6aa8272f-d267-4fe9-92b6-1b7860e5937d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:33.956698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6aa8272f-d267-4fe9-92b6-1b7860e5937d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:34.094888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3106f1b0-b81b-4438-ae4d-ffe0d16aa86f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:34.096615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3106f1b0-b81b-4438-ae4d-ffe0d16aa86f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:34.115002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3106f1b0-b81b-4438-ae4d-ffe0d16aa86f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:34.122519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3106f1b0-b81b-4438-ae4d-ffe0d16aa86f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:34.130827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3106f1b0-b81b-4438-ae4d-ffe0d16aa86f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:34.134544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3106f1b0-b81b-4438-ae4d-ffe0d16aa86f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:34.877812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6aa8272f-d267-4fe9-92b6-1b7860e5937d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:34.894658 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6aa8272f-d267-4fe9-92b6-1b7860e5937d tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 1.007111 Jul 14 14:33:34.908328 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 888/1786] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:33 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:34.922397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-189b64b5-4770-4c4f-b170-2e7e0c12c24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:34.929592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-189b64b5-4770-4c4f-b170-2e7e0c12c24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:34.947819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-189b64b5-4770-4c4f-b170-2e7e0c12c24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:34.952777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-189b64b5-4770-4c4f-b170-2e7e0c12c24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:34.954051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-189b64b5-4770-4c4f-b170-2e7e0c12c24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:34.956514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-189b64b5-4770-4c4f-b170-2e7e0c12c24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:35.080569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3106f1b0-b81b-4438-ae4d-ffe0d16aa86f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:35.091017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:35.110453 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3106f1b0-b81b-4438-ae4d-ffe0d16aa86f tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 200 len: 1477 microversion: 2.1 time: 1.024309 Jul 14 14:33:35.112494 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 899/1787] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:34 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 1477 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:33:35.156796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f08be75-e2f3-4785-bdc4-f39b15e1e271 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:35.158565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f08be75-e2f3-4785-bdc4-f39b15e1e271 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:35.182400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f08be75-e2f3-4785-bdc4-f39b15e1e271 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:35.182873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f08be75-e2f3-4785-bdc4-f39b15e1e271 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:35.186320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f08be75-e2f3-4785-bdc4-f39b15e1e271 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:35.187016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f08be75-e2f3-4785-bdc4-f39b15e1e271 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:35.768727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-189b64b5-4770-4c4f-b170-2e7e0c12c24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:35.795295 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-189b64b5-4770-4c4f-b170-2e7e0c12c24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1319 microversion: 2.1 time: 0.877292 Jul 14 14:33:35.796555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f08be75-e2f3-4785-bdc4-f39b15e1e271 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:35.805946 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 889/1788] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:34 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1319 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:35.806698 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f08be75-e2f3-4785-bdc4-f39b15e1e271 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1315 microversion: 2.1 time: 0.677309 Jul 14 14:33:35.812090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4941738f-afc2-4c20-a781-3d57e318e755 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1927704877"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:35.813478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4941738f-afc2-4c20-a781-3d57e318e755 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:35.822986 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 900/1789] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:35 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:35.829269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4941738f-afc2-4c20-a781-3d57e318e755 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:35.830343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4941738f-afc2-4c20-a781-3d57e318e755 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:35.832004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4941738f-afc2-4c20-a781-3d57e318e755 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:35.834400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4941738f-afc2-4c20-a781-3d57e318e755 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:35.840386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:35.843365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2660d2a4-d0e8-46c9-b560-e96e9e1bea4b tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Calling method '.version_select at 0x7fd6c5a64e50>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:35.923231 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2660d2a4-d0e8-46c9-b560-e96e9e1bea4b tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d" status: 200 len: 636 microversion: 2.1 time: 0.099028 Jul 14 14:33:35.924148 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 901/1790] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:33:35 2022] GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d => generated 636 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:35.935416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ce1a2603-c2a3-4787-a35b-207a35a9a1a1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:35.935774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ce1a2603-c2a3-4787-a35b-207a35a9a1a1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:35.950316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce1a2603-c2a3-4787-a35b-207a35a9a1a1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:35.951675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce1a2603-c2a3-4787-a35b-207a35a9a1a1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:35.953214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce1a2603-c2a3-4787-a35b-207a35a9a1a1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:35.971216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce1a2603-c2a3-4787-a35b-207a35a9a1a1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:36.192266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ce1a2603-c2a3-4787-a35b-207a35a9a1a1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:36.203007 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ce1a2603-c2a3-4787-a35b-207a35a9a1a1 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.277719 Jul 14 14:33:36.203608 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 902/1791] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:35 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:36.211957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-47a7ce94-ff5c-432b-bd6e-e55cbcf06998 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Action: 'update_all', calling method: .version_select at 0x7fd6c5aa88b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:36.334153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-47a7ce94-ff5c-432b-bd6e-e55cbcf06998 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:36.347939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-47a7ce94-ff5c-432b-bd6e-e55cbcf06998 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for user ad00b04ce9354c5ea6ac2d6aba961cf2 and project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:36.577463 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4941738f-afc2-4c20-a781-3d57e318e755 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "POST /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be/action" status: 202 len: 0 microversion: 2.1 time: 0.769650 Jul 14 14:33:36.581835 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 890/1792] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:33:35 2022] POST /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:33:36.595951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2bcace8f-ce78-49c1-854b-8c00ee11eca1 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c65c0e50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:36.715618 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2bcace8f-ce78-49c1-854b-8c00ee11eca1 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.124034 Jul 14 14:33:36.716221 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 891/1793] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:33:36 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:36.826972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9769d70b-7f02-445b-a5d9-4249b0517a3d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:36.828851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9769d70b-7f02-445b-a5d9-4249b0517a3d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:36.867585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9769d70b-7f02-445b-a5d9-4249b0517a3d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:36.867585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9769d70b-7f02-445b-a5d9-4249b0517a3d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:36.868011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9769d70b-7f02-445b-a5d9-4249b0517a3d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:36.880144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9769d70b-7f02-445b-a5d9-4249b0517a3d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:37.040769 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-47a7ce94-ff5c-432b-bd6e-e55cbcf06998 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.832524 Jul 14 14:33:37.042130 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 903/1794] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:33:36 2022] PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 61 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:37.050116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bf7ec9bd-6001-43c4-9865-952d1e06520f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:37.051852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bf7ec9bd-6001-43c4-9865-952d1e06520f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:37.069102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf7ec9bd-6001-43c4-9865-952d1e06520f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:37.077348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf7ec9bd-6001-43c4-9865-952d1e06520f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:37.078723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf7ec9bd-6001-43c4-9865-952d1e06520f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:37.079565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf7ec9bd-6001-43c4-9865-952d1e06520f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:37.683636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9769d70b-7f02-445b-a5d9-4249b0517a3d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:37.700551 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9769d70b-7f02-445b-a5d9-4249b0517a3d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1469 microversion: 2.1 time: 0.881360 Jul 14 14:33:37.702461 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 892/1795] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:36 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1469 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:37.717483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-666d666e-a0ed-47e7-b228-8cc24bb3662c tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Calling method '.version_select at 0x7fd6c65c05e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:37.783936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bf7ec9bd-6001-43c4-9865-952d1e06520f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:37.794264 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bf7ec9bd-6001-43c4-9865-952d1e06520f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1315 microversion: 2.1 time: 0.750690 Jul 14 14:33:37.795446 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 904/1796] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:37 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:37.800543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fb2ad11e-6584-47a7-8556-5616ba07fb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:37.801557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fb2ad11e-6584-47a7-8556-5616ba07fb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:37.808506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb2ad11e-6584-47a7-8556-5616ba07fb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:37.809360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb2ad11e-6584-47a7-8556-5616ba07fb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:37.810401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb2ad11e-6584-47a7-8556-5616ba07fb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:37.811084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb2ad11e-6584-47a7-8556-5616ba07fb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:38.088759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fb2ad11e-6584-47a7-8556-5616ba07fb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:38.099495 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fb2ad11e-6584-47a7-8556-5616ba07fb46 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.302746 Jul 14 14:33:38.110523 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 905/1797] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:37 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:38.116428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-258407d6-0218-4e90-ab20-79956dfe3c2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:38.121865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-258407d6-0218-4e90-ab20-79956dfe3c2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 2bad1987-d086-4152-bb13-99ccbd92bb8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:38.138698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-258407d6-0218-4e90-ab20-79956dfe3c2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:38.139513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-258407d6-0218-4e90-ab20-79956dfe3c2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:38.142263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-258407d6-0218-4e90-ab20-79956dfe3c2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:38.146285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-258407d6-0218-4e90-ab20-79956dfe3c2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:38.344586 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-666d666e-a0ed-47e7-b228-8cc24bb3662c tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "DELETE /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.640580 Jul 14 14:33:38.350144 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 893/1798] 10.222.0.81 () {58 vars in 1295 bytes} [Thu Jul 14 14:33:37 2022] DELETE /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata/os_version => generated 0 bytes in 643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:33:38.356604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aeeab77e-1620-478b-9849-2aefba5596a8 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5e72a60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:38.387589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-258407d6-0218-4e90-ab20-79956dfe3c2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:38.408756 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-258407d6-0218-4e90-ab20-79956dfe3c2d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c" status: 200 len: 1469 microversion: 2.1 time: 0.293937 Jul 14 14:33:38.410113 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 906/1799] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:38 2022] GET /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c => generated 1469 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:38.421148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-7497400", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5591ef57-9401-4b26-a1fe-5812cdbb914b"}], "security_groups": [{"name": "tempest-securitygroup--1073692311"}], "key_name": "tempest-keypair-374576126", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:38.445745 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aeeab77e-1620-478b-9849-2aefba5596a8 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.093821 Jul 14 14:33:38.446963 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 894/1800] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:33:38 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:38.453379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6bd61798-4bb9-4d62-afbd-2eae53aaece0 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Calling method '.version_select at 0x7fd6c596c430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:38.570716 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6bd61798-4bb9-4d62-afbd-2eae53aaece0 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 37 microversion: 2.1 time: 0.122270 Jul 14 14:33:38.571307 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 895/1801] 10.222.0.81 () {58 vars in 1259 bytes} [Thu Jul 14 14:33:38 2022] GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 37 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:38.576843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-26127f49-a147-4264-b2cf-5e581ff1ff58 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:38.599252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-26127f49-a147-4264-b2cf-5e581ff1ff58 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:38.603413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-26127f49-a147-4264-b2cf-5e581ff1ff58 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Searching by: {'reservation_id': 'r-m9y3hw8c', 'deleted': False, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:33:38.632757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26127f49-a147-4264-b2cf-5e581ff1ff58 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:38.634925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26127f49-a147-4264-b2cf-5e581ff1ff58 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:38.639848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26127f49-a147-4264-b2cf-5e581ff1ff58 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:38.641173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26127f49-a147-4264-b2cf-5e581ff1ff58 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:38.654748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] validate_networks() for [('5591ef57-9401-4b26-a1fe-5812cdbb914b', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:33:38.882333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-26127f49-a147-4264-b2cf-5e581ff1ff58 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:33:39.103375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-26127f49-a147-4264-b2cf-5e581ff1ff58 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:39.132115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26127f49-a147-4264-b2cf-5e581ff1ff58 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:39.132626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26127f49-a147-4264-b2cf-5e581ff1ff58 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:39.495180 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-26127f49-a147-4264-b2cf-5e581ff1ff58 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/detail?reservation_id=r-m9y3hw8c" status: 200 len: 2931 microversion: 2.1 time: 0.922457 Jul 14 14:33:39.496526 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 896/1802] 10.222.0.81 () {58 vars in 1196 bytes} [Thu Jul 14 14:33:38 2022] GET /compute/v2.1/servers/detail?reservation_id=r-m9y3hw8c => generated 2931 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:39.501858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9ce889a6-0a1d-413b-8747-4ddd98260fa7 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Action: 'update_all', calling method: .version_select at 0x7fd6c60f9820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:39.604869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-9ce889a6-0a1d-413b-8747-4ddd98260fa7 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:39.620903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-9ce889a6-0a1d-413b-8747-4ddd98260fa7 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for user ad00b04ce9354c5ea6ac2d6aba961cf2 and project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:39.660798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Getting quotas for project 058b0841c5944cfdb9fa3c15cf63d395. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:39.679456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Getting quotas for user 4cf4359ec8544e118d266ef97e131398 and project 058b0841c5944cfdb9fa3c15cf63d395. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:39.739371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:33:39.742322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:33:39.743042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:33:39.746066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:33:39.748841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:33:39.787130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:39.791286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:39.794384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:39.799845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:39.884415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Getting quotas for project 058b0841c5944cfdb9fa3c15cf63d395. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:39.908012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Getting quotas for user 4cf4359ec8544e118d266ef97e131398 and project 058b0841c5944cfdb9fa3c15cf63d395. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:39.956573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:33:39.960130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:33:40.070945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:40.117778 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2546e21d-e5f0-4625-a8e4-1c5f035be19c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.705353 Jul 14 14:33:40.121935 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 907/1803] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:33:38 2022] POST /compute/v2.1/servers => generated 407 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:33:40.134236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-996668fc-dbb2-4618-a552-ac260c3cabfc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:40.138048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-996668fc-dbb2-4618-a552-ac260c3cabfc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:40.152336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-996668fc-dbb2-4618-a552-ac260c3cabfc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:40.152819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-996668fc-dbb2-4618-a552-ac260c3cabfc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:40.157867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-996668fc-dbb2-4618-a552-ac260c3cabfc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:40.158679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-996668fc-dbb2-4618-a552-ac260c3cabfc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:40.686806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-996668fc-dbb2-4618-a552-ac260c3cabfc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:40.703463 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-996668fc-dbb2-4618-a552-ac260c3cabfc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1315 microversion: 2.1 time: 0.572098 Jul 14 14:33:40.716260 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 908/1804] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:40 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:40.722705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a672bc05-5cfb-48c8-a679-45f0dd6c388e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:40.726236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a672bc05-5cfb-48c8-a679-45f0dd6c388e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:40.736599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a672bc05-5cfb-48c8-a679-45f0dd6c388e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:40.737814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a672bc05-5cfb-48c8-a679-45f0dd6c388e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:40.740233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a672bc05-5cfb-48c8-a679-45f0dd6c388e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:40.741190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a672bc05-5cfb-48c8-a679-45f0dd6c388e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:40.748632 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9ce889a6-0a1d-413b-8747-4ddd98260fa7 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 61 microversion: 2.1 time: 1.250645 Jul 14 14:33:40.749559 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 897/1805] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:33:39 2022] PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 61 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:40.756070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4fa03854-39a8-481a-9b68-110ec8ca24f3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c65c0820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:40.857628 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4fa03854-39a8-481a-9b68-110ec8ca24f3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.106724 Jul 14 14:33:40.859819 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 898/1806] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:33:40 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:40.871590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8939ea9c-63c7-41f7-a3f9-d58becf92c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:40.902872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.compute.server_groups [None req-8939ea9c-63c7-41f7-a3f9-d58becf92c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Querying cell e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) for 2 instances {{(pid=119511) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 14 14:33:40.909725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8939ea9c-63c7-41f7-a3f9-d58becf92c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:40.912575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8939ea9c-63c7-41f7-a3f9-d58becf92c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:41.051975 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8939ea9c-63c7-41f7-a3f9-d58becf92c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups/d294f556-b8c6-437e-a82d-e0f4994a1030" status: 200 len: 270 microversion: 2.1 time: 0.185768 Jul 14 14:33:41.054759 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 899/1807] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:33:40 2022] GET /compute/v2.1/os-server-groups/d294f556-b8c6-437e-a82d-e0f4994a1030 => generated 270 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:41.073559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2fa4ce04-482f-463f-9a38-4cac3c1ea4c9 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:41.079546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a672bc05-5cfb-48c8-a679-45f0dd6c388e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:41.080385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2fa4ce04-482f-463f-9a38-4cac3c1ea4c9 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:41.096484 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a672bc05-5cfb-48c8-a679-45f0dd6c388e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.378376 Jul 14 14:33:41.111775 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 909/1808] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:40 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:41.137059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c686c0a2-2a12-4f6d-ac55-f8001aec67ec req-8f9e986c-369e-4b6d-86c2-9d7640f88a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70651b9-4d75-42ad-9463-eb29e92c4356", "name": "network-vif-plugged", "status": "completed", "tag": "68e92357-37f2-4a04-b0ba-f5883afdb349"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:41.167209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2fa4ce04-482f-463f-9a38-4cac3c1ea4c9 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:41.176794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c686c0a2-2a12-4f6d-ac55-f8001aec67ec req-8f9e986c-369e-4b6d-86c2-9d7640f88a8a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:41.179609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c686c0a2-2a12-4f6d-ac55-f8001aec67ec req-8f9e986c-369e-4b6d-86c2-9d7640f88a8a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:41.183731 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2fa4ce04-482f-463f-9a38-4cac3c1ea4c9 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1266 microversion: 2.1 time: 0.122753 Jul 14 14:33:41.184870 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 900/1809] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:41 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:41.244440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-024ff8ec-0b8e-460b-94b6-46068fc1767f tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Calling method '.version_select at 0x7fd6c63a54c0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:41.263289 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c686c0a2-2a12-4f6d-ac55-f8001aec67ec req-8f9e986c-369e-4b6d-86c2-9d7640f88a8a service nova] Creating event network-vif-plugged:68e92357-37f2-4a04-b0ba-f5883afdb349 for instance c70651b9-4d75-42ad-9463-eb29e92c4356 on n-h2-767704-28 Jul 14 14:33:41.299407 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c686c0a2-2a12-4f6d-ac55-f8001aec67ec req-8f9e986c-369e-4b6d-86c2-9d7640f88a8a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181298 Jul 14 14:33:41.304169 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 910/1810] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:41.349056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a98afe7c-72c0-4141-9946-d6560eaa8bb9 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:41.354655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a98afe7c-72c0-4141-9946-d6560eaa8bb9 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:41.384454 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-024ff8ec-0b8e-460b-94b6-46068fc1767f tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.188106 Jul 14 14:33:41.388259 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 901/1811] 10.222.0.81 () {58 vars in 1289 bytes} [Thu Jul 14 14:33:41 2022] GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata/os_distro => generated 33 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:41.399852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a98afe7c-72c0-4141-9946-d6560eaa8bb9 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:41.400347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a98afe7c-72c0-4141-9946-d6560eaa8bb9 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:41.401192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a98afe7c-72c0-4141-9946-d6560eaa8bb9 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:41.401638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a98afe7c-72c0-4141-9946-d6560eaa8bb9 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:41.418350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f96afffa-7a8c-4feb-bf6c-5a8654176676 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Action: 'update_all', calling method: .version_select at 0x7fd6c60f9af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:41.531816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f96afffa-7a8c-4feb-bf6c-5a8654176676 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:41.559024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f96afffa-7a8c-4feb-bf6c-5a8654176676 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for user ad00b04ce9354c5ea6ac2d6aba961cf2 and project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:42.011820 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a98afe7c-72c0-4141-9946-d6560eaa8bb9 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1622 microversion: 2.1 time: 0.705580 Jul 14 14:33:42.015612 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 911/1812] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:41 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1622 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:42.022868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4cea3dc-0bb5-4b55-814f-f89e040619f7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:42.024149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d4cea3dc-0bb5-4b55-814f-f89e040619f7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:42.034411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4cea3dc-0bb5-4b55-814f-f89e040619f7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:42.036266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4cea3dc-0bb5-4b55-814f-f89e040619f7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:42.039750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4cea3dc-0bb5-4b55-814f-f89e040619f7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:42.040673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4cea3dc-0bb5-4b55-814f-f89e040619f7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:42.438389 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f96afffa-7a8c-4feb-bf6c-5a8654176676 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 61 microversion: 2.1 time: 1.040109 Jul 14 14:33:42.440230 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 902/1813] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:33:41 2022] PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 61 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:42.450897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-69f5a304-9925-4858-a894-bd11235723ba tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5747ca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:42.557088 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-69f5a304-9925-4858-a894-bd11235723ba tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.113849 Jul 14 14:33:42.558456 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 903/1814] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:33:42 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:42.571968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b7a732ae-ca72-4095-aaa6-953e9fcd1ab3 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:42.574388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b7a732ae-ca72-4095-aaa6-953e9fcd1ab3 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] [instance: 2bad1987-d086-4152-bb13-99ccbd92bb8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:42.606869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7a732ae-ca72-4095-aaa6-953e9fcd1ab3 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:42.608698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7a732ae-ca72-4095-aaa6-953e9fcd1ab3 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:42.611197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7a732ae-ca72-4095-aaa6-953e9fcd1ab3 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:42.622379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d4cea3dc-0bb5-4b55-814f-f89e040619f7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:42.630646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7a732ae-ca72-4095-aaa6-953e9fcd1ab3 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:42.637606 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d4cea3dc-0bb5-4b55-814f-f89e040619f7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1315 microversion: 2.1 time: 0.620551 Jul 14 14:33:42.653039 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 912/1815] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:42 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:42.674325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cb05feeb-42f5-41b8-8d70-ccd3f46c305f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:42.675841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cb05feeb-42f5-41b8-8d70-ccd3f46c305f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:42.699191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb05feeb-42f5-41b8-8d70-ccd3f46c305f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:42.700547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb05feeb-42f5-41b8-8d70-ccd3f46c305f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:42.705021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb05feeb-42f5-41b8-8d70-ccd3f46c305f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:42.705930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb05feeb-42f5-41b8-8d70-ccd3f46c305f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:43.193885 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b7a732ae-ca72-4095-aaa6-953e9fcd1ab3 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c" status: 200 len: 1622 microversion: 2.1 time: 0.631688 Jul 14 14:33:43.201749 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 904/1816] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:42 2022] GET /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c => generated 1622 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:43.213974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e116e3d1-3638-4305-88eb-5817a065ce8d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:43.217462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e116e3d1-3638-4305-88eb-5817a065ce8d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:43.237181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e116e3d1-3638-4305-88eb-5817a065ce8d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:43.241633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e116e3d1-3638-4305-88eb-5817a065ce8d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:43.245948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e116e3d1-3638-4305-88eb-5817a065ce8d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:43.246683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e116e3d1-3638-4305-88eb-5817a065ce8d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:43.337895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e116e3d1-3638-4305-88eb-5817a065ce8d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:33:43.624352 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e116e3d1-3638-4305-88eb-5817a065ce8d tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "DELETE /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 204 len: 0 microversion: 2.25 time: 0.414016 Jul 14 14:33:43.626319 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 905/1817] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:33:43 2022] DELETE /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:33:43.637726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-abbc941c-2ea3-4ea7-b56a-ca6a2d201d4c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:43.640785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-abbc941c-2ea3-4ea7-b56a-ca6a2d201d4c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:43.652026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abbc941c-2ea3-4ea7-b56a-ca6a2d201d4c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:43.659544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abbc941c-2ea3-4ea7-b56a-ca6a2d201d4c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:43.662468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abbc941c-2ea3-4ea7-b56a-ca6a2d201d4c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:43.663221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abbc941c-2ea3-4ea7-b56a-ca6a2d201d4c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:44.689385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-abbc941c-2ea3-4ea7-b56a-ca6a2d201d4c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:44.700020 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-abbc941c-2ea3-4ea7-b56a-ca6a2d201d4c tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1326 microversion: 2.1 time: 1.071664 Jul 14 14:33:44.711840 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 906/1818] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:43 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1326 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:44.725137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c7f87e51-849f-4d78-8e06-b460eff8c61c tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Calling method '.version_select at 0x7fd6c5971ee0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:44.847531 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c7f87e51-849f-4d78-8e06-b460eff8c61c tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.133947 Jul 14 14:33:44.849734 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 907/1819] 10.222.0.81 () {58 vars in 1259 bytes} [Thu Jul 14 14:33:44 2022] GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 61 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:44.858448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-139f3f3c-ac56-4980-a167-caa998f954de tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c596caf0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:45.020363 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-139f3f3c-ac56-4980-a167-caa998f954de tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.169072 Jul 14 14:33:45.045367 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 908/1820] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:33:44 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:45.095006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0217644d-5a1f-4747-b2a2-a2b3c58d99b0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:45.104790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0217644d-5a1f-4747-b2a2-a2b3c58d99b0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:45.146000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0217644d-5a1f-4747-b2a2-a2b3c58d99b0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:45.153169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0217644d-5a1f-4747-b2a2-a2b3c58d99b0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:45.160670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0217644d-5a1f-4747-b2a2-a2b3c58d99b0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:45.162316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cb05feeb-42f5-41b8-8d70-ccd3f46c305f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:45.165641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0217644d-5a1f-4747-b2a2-a2b3c58d99b0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:45.193306 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cb05feeb-42f5-41b8-8d70-ccd3f46c305f tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 2.533006 Jul 14 14:33:45.195902 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 913/1821] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:42 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 2542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:45.232209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-02981f58-620f-4472-a605-1d9a3f402a03 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:45.232882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-02981f58-620f-4472-a605-1d9a3f402a03 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:45.261164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02981f58-620f-4472-a605-1d9a3f402a03 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:45.263030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02981f58-620f-4472-a605-1d9a3f402a03 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:45.263915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02981f58-620f-4472-a605-1d9a3f402a03 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:45.272003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02981f58-620f-4472-a605-1d9a3f402a03 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:46.024780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0217644d-5a1f-4747-b2a2-a2b3c58d99b0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:46.038137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0217644d-5a1f-4747-b2a2-a2b3c58d99b0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:46.054662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0217644d-5a1f-4747-b2a2-a2b3c58d99b0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:46.056135 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0217644d-5a1f-4747-b2a2-a2b3c58d99b0 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1733 microversion: 2.25 time: 1.001179 Jul 14 14:33:46.059833 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 909/1822] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:45 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1733 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:46.073038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1539695940", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "ea89554c-b395-4813-8c65-81afc2ae89ec"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:46.224787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:33:46.352012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-02981f58-620f-4472-a605-1d9a3f402a03 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:46.364536 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-02981f58-620f-4472-a605-1d9a3f402a03 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1502 microversion: 2.1 time: 1.152915 Jul 14 14:33:46.369706 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 914/1823] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:45 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1502 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:46.390259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c0904be7-02a4-4ce0-9441-5e8268f9cdd1 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Action: 'update_all', calling method: .version_select at 0x7fd6c610d670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:46.577439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-c0904be7-02a4-4ce0-9441-5e8268f9cdd1 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:46.610891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-c0904be7-02a4-4ce0-9441-5e8268f9cdd1 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for user ad00b04ce9354c5ea6ac2d6aba961cf2 and project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:47.297029 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c0904be7-02a4-4ce0-9441-5e8268f9cdd1 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.924112 Jul 14 14:33:47.301930 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 915/1824] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:33:46 2022] PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 61 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:47.303658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-151ae4a9-5fd0-4125-ab76-38e0affbd35f tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:47.306773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-151ae4a9-5fd0-4125-ab76-38e0affbd35f tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:47.327573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-151ae4a9-5fd0-4125-ab76-38e0affbd35f tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:47.329263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-151ae4a9-5fd0-4125-ab76-38e0affbd35f tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:47.331246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-151ae4a9-5fd0-4125-ab76-38e0affbd35f tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:47.333158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-151ae4a9-5fd0-4125-ab76-38e0affbd35f tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:47.837500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:33:47.838715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:33:47.839796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:33:47.840639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:33:47.841763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:33:47.864749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:47.878078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:47.880303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:47.881598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:47.948587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:47.979967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:48.020714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:33:48.023243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:33:48.074340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-151ae4a9-5fd0-4125-ab76-38e0affbd35f tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:48.089543 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-151ae4a9-5fd0-4125-ab76-38e0affbd35f tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1392 microversion: 2.1 time: 0.790096 Jul 14 14:33:48.100619 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 916/1825] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:47 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1392 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:48.105481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:48.113454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9c4069ae-1aa5-4182-b35e-ffc32acc71f8 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c6034940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:48.145648 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a0321dec-12db-44c2-98b1-1619bbc5a65c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.083935 Jul 14 14:33:48.149857 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 910/1826] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:33:48.164658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-609a59cf-a369-4823-a250-6c7867349559 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:48.165667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-609a59cf-a369-4823-a250-6c7867349559 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:48.188046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-609a59cf-a369-4823-a250-6c7867349559 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:48.188520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-609a59cf-a369-4823-a250-6c7867349559 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:48.189378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-609a59cf-a369-4823-a250-6c7867349559 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:48.189828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-609a59cf-a369-4823-a250-6c7867349559 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:48.203043 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9c4069ae-1aa5-4182-b35e-ffc32acc71f8 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.107082 Jul 14 14:33:48.203808 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 917/1827] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:33:48 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:48.218393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9cafc44b-2cd5-42e4-8039-cfee0680d463 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:48.220315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9cafc44b-2cd5-42e4-8039-cfee0680d463 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:48.237994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9cafc44b-2cd5-42e4-8039-cfee0680d463 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:48.239587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9cafc44b-2cd5-42e4-8039-cfee0680d463 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:48.243786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9cafc44b-2cd5-42e4-8039-cfee0680d463 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:48.247533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9cafc44b-2cd5-42e4-8039-cfee0680d463 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:48.437796 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9cafc44b-2cd5-42e4-8039-cfee0680d463 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "POST /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356/action" status: 202 len: 0 microversion: 2.1 time: 0.232333 Jul 14 14:33:48.448755 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 918/1828] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:33:48 2022] POST /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:33:48.461422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-147a7dbf-0948-44a5-968e-9cdb351f8b90 req-e55acb4e-7753-44d7-8fb9-478b7862d3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdad3a0f-8ff2-44ed-9523-482791b158be", "name": "network-vif-plugged", "status": "completed", "tag": "f9885081-82f8-4100-b4c6-c3a33d97dc81"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:48.492758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-147a7dbf-0948-44a5-968e-9cdb351f8b90 req-e55acb4e-7753-44d7-8fb9-478b7862d3e3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:48.493547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-147a7dbf-0948-44a5-968e-9cdb351f8b90 req-e55acb4e-7753-44d7-8fb9-478b7862d3e3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:48.535916 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-147a7dbf-0948-44a5-968e-9cdb351f8b90 req-e55acb4e-7753-44d7-8fb9-478b7862d3e3 service nova] Creating event network-vif-plugged:f9885081-82f8-4100-b4c6-c3a33d97dc81 for instance cdad3a0f-8ff2-44ed-9523-482791b158be on n-h2-767704-28 Jul 14 14:33:48.550027 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-147a7dbf-0948-44a5-968e-9cdb351f8b90 req-e55acb4e-7753-44d7-8fb9-478b7862d3e3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098040 Jul 14 14:33:48.552823 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 919/1829] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:48.564242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-484f4b26-c26f-4afa-8fa9-0a225a8c4399 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:48.567488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-484f4b26-c26f-4afa-8fa9-0a225a8c4399 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:48.586749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-484f4b26-c26f-4afa-8fa9-0a225a8c4399 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:48.590250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-484f4b26-c26f-4afa-8fa9-0a225a8c4399 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:48.593046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-484f4b26-c26f-4afa-8fa9-0a225a8c4399 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:48.594982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-484f4b26-c26f-4afa-8fa9-0a225a8c4399 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:48.756846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-484f4b26-c26f-4afa-8fa9-0a225a8c4399 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:48.776435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-484f4b26-c26f-4afa-8fa9-0a225a8c4399 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:48.784195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-484f4b26-c26f-4afa-8fa9-0a225a8c4399 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:48.789281 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-484f4b26-c26f-4afa-8fa9-0a225a8c4399 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1665 microversion: 2.25 time: 0.234706 Jul 14 14:33:48.804895 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 920/1830] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:48 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1665 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:48.826424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4c43d185-318c-4306-9de4-6cf250aec205 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Action: 'update_all', calling method: .version_select at 0x7fd6c5f10280>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:48.984197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4c43d185-318c-4306-9de4-6cf250aec205 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:49.018065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4c43d185-318c-4306-9de4-6cf250aec205 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for user ad00b04ce9354c5ea6ac2d6aba961cf2 and project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:49.023961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-609a59cf-a369-4823-a250-6c7867349559 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:49.041230 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-609a59cf-a369-4823-a250-6c7867349559 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.888641 Jul 14 14:33:49.074162 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 911/1831] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:48 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:49.098480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ef990adf-cca8-45de-9c72-18e902df4c7e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:49.104924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ef990adf-cca8-45de-9c72-18e902df4c7e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:49.336061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ef990adf-cca8-45de-9c72-18e902df4c7e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:49.348875 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ef990adf-cca8-45de-9c72-18e902df4c7e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1217 microversion: 2.1 time: 0.269991 Jul 14 14:33:49.351109 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 912/1832] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:49 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1217 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:49.364258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f3d586c4-accb-47a7-b85e-1c5de55db763 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:49.365734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f3d586c4-accb-47a7-b85e-1c5de55db763 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:49.383279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3d586c4-accb-47a7-b85e-1c5de55db763 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:49.386747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3d586c4-accb-47a7-b85e-1c5de55db763 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:49.390248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3d586c4-accb-47a7-b85e-1c5de55db763 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:49.392405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3d586c4-accb-47a7-b85e-1c5de55db763 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:49.833362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:49.946238 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4c43d185-318c-4306-9de4-6cf250aec205 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 64 microversion: 2.1 time: 1.136083 Jul 14 14:33:49.951102 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 921/1833] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:33:48 2022] PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 64 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:49.961644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-055c64cf-39dc-44fd-b53a-3bfba734aee7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:49.962378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-055c64cf-39dc-44fd-b53a-3bfba734aee7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:49.981434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f3d586c4-accb-47a7-b85e-1c5de55db763 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:49.986730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-055c64cf-39dc-44fd-b53a-3bfba734aee7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:49.987310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-055c64cf-39dc-44fd-b53a-3bfba734aee7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:49.989390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-055c64cf-39dc-44fd-b53a-3bfba734aee7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:49.989858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-055c64cf-39dc-44fd-b53a-3bfba734aee7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:50.001548 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f3d586c4-accb-47a7-b85e-1c5de55db763 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1487 microversion: 2.1 time: 0.644648 Jul 14 14:33:50.002685 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 913/1834] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:49 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1487 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:50.041147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-249481b1-f33c-4f83-b2e8-c47b10555589 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5f9a820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:50.088013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:50.136980 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-249481b1-f33c-4f83-b2e8-c47b10555589 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.109775 Jul 14 14:33:50.143797 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 914/1835] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:33:50 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:50.152393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-832e0c2a-3f8e-413b-88fc-4cafbe198be1 req-23a4a80e-61f0-4af0-88d3-cfc27afb77d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07717385-1942-4235-9479-e46016827db8", "name": "network-vif-deleted", "tag": "a3c7a75e-482a-45ff-810c-3fd5b8e4c273"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:50.177089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-832e0c2a-3f8e-413b-88fc-4cafbe198be1 req-23a4a80e-61f0-4af0-88d3-cfc27afb77d8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:50.180095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-832e0c2a-3f8e-413b-88fc-4cafbe198be1 req-23a4a80e-61f0-4af0-88d3-cfc27afb77d8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:50.212154 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-832e0c2a-3f8e-413b-88fc-4cafbe198be1 req-23a4a80e-61f0-4af0-88d3-cfc27afb77d8 service nova] Creating event network-vif-deleted:a3c7a75e-482a-45ff-810c-3fd5b8e4c273 for instance 07717385-1942-4235-9479-e46016827db8 on n-h2-767704-28 Jul 14 14:33:50.226816 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-832e0c2a-3f8e-413b-88fc-4cafbe198be1 req-23a4a80e-61f0-4af0-88d3-cfc27afb77d8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084100 Jul 14 14:33:50.227946 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 915/1836] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:50.241789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:50.242779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:50.251061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:50.251776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:50.253016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:50.254765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:50.310694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:50.311489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:50.313753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lazy-loading 'fault' on Instance uuid 07717385-1942-4235-9479-e46016827db8 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:33:50.528722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:50.540347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:50.542558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:50.543842 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e546de11-76e0-4419-9d3b-bf8ae669dfad tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 200 len: 1376 microversion: 2.25 time: 0.313489 Jul 14 14:33:50.563258 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 916/1837] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:50 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 1376 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:50.575851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e24294bd-d830-4301-bd0e-309100a3c395 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Calling method '.version_select at 0x7fd6c5747f70>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:50.619430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-055c64cf-39dc-44fd-b53a-3bfba734aee7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:50.647629 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-055c64cf-39dc-44fd-b53a-3bfba734aee7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1392 microversion: 2.1 time: 0.679147 Jul 14 14:33:50.650075 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 922/1838] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:49 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1392 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:50.665698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36d64e43-6c89-4433-9b2b-47e2226fa8b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:50.666623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-36d64e43-6c89-4433-9b2b-47e2226fa8b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:50.669111 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e24294bd-d830-4301-bd0e-309100a3c395 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 64 microversion: 2.1 time: 0.104254 Jul 14 14:33:50.669855 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 917/1839] 10.222.0.81 () {58 vars in 1259 bytes} [Thu Jul 14 14:33:50 2022] GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 64 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:50.681251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1fed60d0-493d-4309-b9de-69fa8382980a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:50.682303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1fed60d0-493d-4309-b9de-69fa8382980a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:50.700355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36d64e43-6c89-4433-9b2b-47e2226fa8b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:50.702514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36d64e43-6c89-4433-9b2b-47e2226fa8b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:50.703740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36d64e43-6c89-4433-9b2b-47e2226fa8b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:50.704485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36d64e43-6c89-4433-9b2b-47e2226fa8b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:50.705427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1fed60d0-493d-4309-b9de-69fa8382980a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:50.705899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1fed60d0-493d-4309-b9de-69fa8382980a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:50.707148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1fed60d0-493d-4309-b9de-69fa8382980a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:50.707648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1fed60d0-493d-4309-b9de-69fa8382980a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:50.799742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-36d64e43-6c89-4433-9b2b-47e2226fa8b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:33:51.042578 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-36d64e43-6c89-4433-9b2b-47e2226fa8b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 204 len: 0 microversion: 2.1 time: 0.388284 Jul 14 14:33:51.044339 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 923/1840] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:33:50 2022] DELETE /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:33:51.054533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eb94c6fe-4da7-4652-a909-99475e275448 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:51.059168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eb94c6fe-4da7-4652-a909-99475e275448 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:51.076221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb94c6fe-4da7-4652-a909-99475e275448 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:51.077199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb94c6fe-4da7-4652-a909-99475e275448 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:51.078252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb94c6fe-4da7-4652-a909-99475e275448 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:51.081174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb94c6fe-4da7-4652-a909-99475e275448 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:51.213254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eb94c6fe-4da7-4652-a909-99475e275448 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:51.230344 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eb94c6fe-4da7-4652-a909-99475e275448 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1275 microversion: 2.1 time: 0.184299 Jul 14 14:33:51.231217 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 924/1841] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:51 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1275 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:51.236333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4ff7aae7-5518-4a3a-9304-c1a6f184ae97 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Action: 'update_all', calling method: .version_select at 0x7fd6c5aae8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:51.311685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1fed60d0-493d-4309-b9de-69fa8382980a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:51.333391 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1fed60d0-493d-4309-b9de-69fa8382980a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.662361 Jul 14 14:33:51.338528 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 918/1842] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:50 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:51.350622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ade7a3f6-8fb9-4fb1-a7e3-02e7eaea75b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:51.356882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ade7a3f6-8fb9-4fb1-a7e3-02e7eaea75b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:51.364128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4ff7aae7-5518-4a3a-9304-c1a6f184ae97 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:51.381655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ade7a3f6-8fb9-4fb1-a7e3-02e7eaea75b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:51.387159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4ff7aae7-5518-4a3a-9304-c1a6f184ae97 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for user ad00b04ce9354c5ea6ac2d6aba961cf2 and project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:51.388168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ade7a3f6-8fb9-4fb1-a7e3-02e7eaea75b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:51.396143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ade7a3f6-8fb9-4fb1-a7e3-02e7eaea75b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:51.396928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ade7a3f6-8fb9-4fb1-a7e3-02e7eaea75b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:51.479144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:51.815584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ade7a3f6-8fb9-4fb1-a7e3-02e7eaea75b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:51.826156 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ade7a3f6-8fb9-4fb1-a7e3-02e7eaea75b8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1493 microversion: 2.1 time: 0.486229 Jul 14 14:33:51.840816 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 919/1843] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:51 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1493 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:51.856561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4954c067-6190-46bb-b38b-646614ea77f2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c56ad280>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:52.108917 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4ff7aae7-5518-4a3a-9304-c1a6f184ae97 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.876328 Jul 14 14:33:52.109542 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 925/1844] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:33:51 2022] PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 61 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:52.114645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e3899606-101d-416c-b18e-669bc21133e3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:52.117757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e3899606-101d-416c-b18e-669bc21133e3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 07717385-1942-4235-9479-e46016827db8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:52.129756 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4954c067-6190-46bb-b38b-646614ea77f2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.287329 Jul 14 14:33:52.130867 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 920/1845] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:33:51 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:52.143080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-29e2522c-90ae-491a-9a54-967c8313ffee tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:52.145328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-29e2522c-90ae-491a-9a54-967c8313ffee tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:52.153115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3899606-101d-416c-b18e-669bc21133e3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:52.155363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3899606-101d-416c-b18e-669bc21133e3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:52.157976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3899606-101d-416c-b18e-669bc21133e3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:52.159045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3899606-101d-416c-b18e-669bc21133e3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:52.167761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29e2522c-90ae-491a-9a54-967c8313ffee tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:52.168588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29e2522c-90ae-491a-9a54-967c8313ffee tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:52.171184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29e2522c-90ae-491a-9a54-967c8313ffee tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:52.172423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29e2522c-90ae-491a-9a54-967c8313ffee tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:52.203098 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-e3899606-101d-416c-b18e-669bc21133e3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] HTTP exception thrown: Instance 07717385-1942-4235-9479-e46016827db8 could not be found. Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e3899606-101d-416c-b18e-669bc21133e3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Request method failure captured: Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 HTTP/1.1 Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CeRYQkBsHWRZzeg3gM75BtPmbMeWbC_fASh1Cxn3K4J33bHdQBDrWEc-RP6z8mW148RnKRxxABuudvGohrHZcKKUffRQ35hVrElxs4rTDbe8wB_DlavvbnZi6Mv8Da8z1Wa3gC8zoHyhYe-xb2QlqPzcUuvwkWmdUZyZBja-MFG1ME Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.25 Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 4459eedeb8884ffe82ed62e567fb64c3 Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-653795149 Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4459eedeb8884ffe82ed62e567fb64c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4459eedeb8884ffe82ed62e567fb64c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4459eedeb8884ffe82ed62e567fb64c3", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4459eedeb8884ffe82ed62e567fb64c3"}]}] Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-653795149 Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 4459eedeb8884ffe82ed62e567fb64c3 Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-653795149 Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-LiveAutoBlockMigrationV225Test-653795149-project Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: ef25b01962404bdfa0c2bbb30401ca62 Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-653795149-project Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 07717385-1942-4235-9479-e46016827db8 could not be found. Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '07717385-1942-4235-9479-e46016827db8'} Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07717385-1942-4235-9479-e46016827db8 could not be found. Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07717385-1942-4235-9479-e46016827db8 could not be found. Jul 14 14:33:52.208578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:33:52.214679 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:52.214679 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:33:52.214679 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:52.214679 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:52.214679 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:52.214679 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:33:52.214679 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:33:52.214679 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07717385-1942-4235-9479-e46016827db8 could not be found. Jul 14 14:33:52.214679 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:33:52.221309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e3899606-101d-416c-b18e-669bc21133e3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Returning 404 to user: Instance 07717385-1942-4235-9479-e46016827db8 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:33:52.224663 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e3899606-101d-416c-b18e-669bc21133e3 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8" status: 404 len: 111 microversion: 2.25 time: 0.114130 Jul 14 14:33:52.225482 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 926/1846] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:52 2022] GET /compute/v2.1/servers/07717385-1942-4235-9479-e46016827db8 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:33:52.244140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6836f250-d303-499c-8f9a-59be809c46ec tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Action: 'update', calling method: .version_select at 0x7fd6c5c320d0>, body: {"meta": {"os_version": "alt"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:52.354780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-6836f250-d303-499c-8f9a-59be809c46ec tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:52.379243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-6836f250-d303-499c-8f9a-59be809c46ec tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for user ad00b04ce9354c5ea6ac2d6aba961cf2 and project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:52.898948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-29e2522c-90ae-491a-9a54-967c8313ffee tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:52.907775 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-29e2522c-90ae-491a-9a54-967c8313ffee tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1392 microversion: 2.1 time: 0.775340 Jul 14 14:33:52.908073 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 921/1847] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:52 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1392 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:52.921622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4d0a4465-d719-415c-839e-fec11d7726fd tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '.version_select at 0x7fd6c56ad430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:52.998048 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4d0a4465-d719-415c-839e-fec11d7726fd tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784821049" status: 204 len: 0 microversion: 2.25 time: 0.081506 Jul 14 14:33:53.008892 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 922/1848] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:33:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784821049 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:33:53.014267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24647c1d-bf59-441a-9ace-8b00cd9b4572 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:53.017639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-24647c1d-bf59-441a-9ace-8b00cd9b4572 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:53.035864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24647c1d-bf59-441a-9ace-8b00cd9b4572 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:53.036595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24647c1d-bf59-441a-9ace-8b00cd9b4572 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:53.037937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24647c1d-bf59-441a-9ace-8b00cd9b4572 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:53.038839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24647c1d-bf59-441a-9ace-8b00cd9b4572 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:53.325639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-24647c1d-bf59-441a-9ace-8b00cd9b4572 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:53.342339 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-24647c1d-bf59-441a-9ace-8b00cd9b4572 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1317 microversion: 2.1 time: 0.331934 Jul 14 14:33:53.360759 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6836f250-d303-499c-8f9a-59be809c46ec tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.127786 Jul 14 14:33:53.361590 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 923/1849] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:53 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:53.366626 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 927/1850] 10.222.0.81 () {60 vars in 1312 bytes} [Thu Jul 14 14:33:52 2022] PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata/os_version => generated 31 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:53.370895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c0895fa0-16ac-4353-9495-11a25ebf64e8 req-cbee1d7e-753c-4d83-a7d0-c7758bec1302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311addf3-6349-4923-8f5b-89f80e649e21", "tag": "8c7f6fa5-ec9a-4d3e-ab0f-bb398a38696c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:53.372016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-20510f2f-3a13-4488-ab3f-95a205847fd0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:53.372653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-20510f2f-3a13-4488-ab3f-95a205847fd0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:53.391777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c0895fa0-16ac-4353-9495-11a25ebf64e8 req-cbee1d7e-753c-4d83-a7d0-c7758bec1302 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:53.392344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c0895fa0-16ac-4353-9495-11a25ebf64e8 req-cbee1d7e-753c-4d83-a7d0-c7758bec1302 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:53.404776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20510f2f-3a13-4488-ab3f-95a205847fd0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:53.405341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20510f2f-3a13-4488-ab3f-95a205847fd0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:53.410545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20510f2f-3a13-4488-ab3f-95a205847fd0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:53.411044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20510f2f-3a13-4488-ab3f-95a205847fd0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:53.424465 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c0895fa0-16ac-4353-9495-11a25ebf64e8 req-cbee1d7e-753c-4d83-a7d0-c7758bec1302 service nova] Creating event network-changed:8c7f6fa5-ec9a-4d3e-ab0f-bb398a38696c for instance 311addf3-6349-4923-8f5b-89f80e649e21 on n-h2-767704-28 Jul 14 14:33:53.435053 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c0895fa0-16ac-4353-9495-11a25ebf64e8 req-cbee1d7e-753c-4d83-a7d0-c7758bec1302 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071810 Jul 14 14:33:53.436139 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 924/1851] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:53.442173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1dd53a11-9a0e-4614-baa6-905bf2336849 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:53.449955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1dd53a11-9a0e-4614-baa6-905bf2336849 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:53.461815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1dd53a11-9a0e-4614-baa6-905bf2336849 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:53.468363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1dd53a11-9a0e-4614-baa6-905bf2336849 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:53.469661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1dd53a11-9a0e-4614-baa6-905bf2336849 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:53.474442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1dd53a11-9a0e-4614-baa6-905bf2336849 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:54.806453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-20510f2f-3a13-4488-ab3f-95a205847fd0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:54.814880 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-20510f2f-3a13-4488-ab3f-95a205847fd0 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 1.446962 Jul 14 14:33:54.815317 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 928/1852] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:53 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:54.830274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7a83da82-c67b-41a8-8fc4-2d23ccf55d77 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5e153a0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:54.919420 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7a83da82-c67b-41a8-8fc4-2d23ccf55d77 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.096806 Jul 14 14:33:54.920018 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 929/1853] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:33:54 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:54.929297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8af31aa4-44d8-4b5a-9b6f-de2b0efd45c3 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Calling method '.version_select at 0x7fd6c5bbc4c0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:55.000989 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8af31aa4-44d8-4b5a-9b6f-de2b0efd45c3 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 58 microversion: 2.1 time: 0.079862 Jul 14 14:33:55.008572 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 930/1854] 10.222.0.81 () {58 vars in 1259 bytes} [Thu Jul 14 14:33:54 2022] GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 58 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:55.017586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7f4c7ac1-885d-4316-94ff-f34abe9a02a4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:55.018219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7f4c7ac1-885d-4316-94ff-f34abe9a02a4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:55.063138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f4c7ac1-885d-4316-94ff-f34abe9a02a4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:55.063452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f4c7ac1-885d-4316-94ff-f34abe9a02a4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:55.064256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f4c7ac1-885d-4316-94ff-f34abe9a02a4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:55.064771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f4c7ac1-885d-4316-94ff-f34abe9a02a4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:55.367464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1dd53a11-9a0e-4614-baa6-905bf2336849 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:55.385865 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1dd53a11-9a0e-4614-baa6-905bf2336849 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 200 len: 1493 microversion: 2.1 time: 1.948398 Jul 14 14:33:55.395440 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 925/1855] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:53 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 1493 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:55.406586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9957cecd-1bb3-425f-a911-3c779c7d3220 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:55.407283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9957cecd-1bb3-425f-a911-3c779c7d3220 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:55.429315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9957cecd-1bb3-425f-a911-3c779c7d3220 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:55.429773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9957cecd-1bb3-425f-a911-3c779c7d3220 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:55.438060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9957cecd-1bb3-425f-a911-3c779c7d3220 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:55.438921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9957cecd-1bb3-425f-a911-3c779c7d3220 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:56.178606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7f4c7ac1-885d-4316-94ff-f34abe9a02a4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:56.191307 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7f4c7ac1-885d-4316-94ff-f34abe9a02a4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1392 microversion: 2.1 time: 1.187686 Jul 14 14:33:56.193594 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 931/1856] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:55 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1392 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:56.203296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1d3a072c-13d2-427d-acb9-dcd2d3d5c7c1 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Action: 'update_all', calling method: .version_select at 0x7fd6c5f100d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:56.327949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9957cecd-1bb3-425f-a911-3c779c7d3220 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:56.339074 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9957cecd-1bb3-425f-a911-3c779c7d3220 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1317 microversion: 2.1 time: 0.951185 Jul 14 14:33:56.345068 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 926/1857] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:55 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1317 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:56.349718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1d3a072c-13d2-427d-acb9-dcd2d3d5c7c1 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:56.356720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-616678ef-4adf-4d58-8e28-30609953d0d5 req-ecbb0a70-39a4-483f-9a82-7138b7a7f9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70651b9-4d75-42ad-9463-eb29e92c4356", "name": "network-vif-deleted", "tag": "68e92357-37f2-4a04-b0ba-f5883afdb349"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:56.367581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-616678ef-4adf-4d58-8e28-30609953d0d5 req-ecbb0a70-39a4-483f-9a82-7138b7a7f9a1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:56.368931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-616678ef-4adf-4d58-8e28-30609953d0d5 req-ecbb0a70-39a4-483f-9a82-7138b7a7f9a1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:56.373894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1d3a072c-13d2-427d-acb9-dcd2d3d5c7c1 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for user ad00b04ce9354c5ea6ac2d6aba961cf2 and project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:56.389137 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-616678ef-4adf-4d58-8e28-30609953d0d5 req-ecbb0a70-39a4-483f-9a82-7138b7a7f9a1 service nova] Creating event network-vif-deleted:68e92357-37f2-4a04-b0ba-f5883afdb349 for instance c70651b9-4d75-42ad-9463-eb29e92c4356 on n-h2-767704-28 Jul 14 14:33:56.399438 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-616678ef-4adf-4d58-8e28-30609953d0d5 req-ecbb0a70-39a4-483f-9a82-7138b7a7f9a1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050219 Jul 14 14:33:56.400346 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 927/1858] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:56.406442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b36c6a1d-2374-4e54-9973-b47159c3f56c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:56.409815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b36c6a1d-2374-4e54-9973-b47159c3f56c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:56.438727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b36c6a1d-2374-4e54-9973-b47159c3f56c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:56.442524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b36c6a1d-2374-4e54-9973-b47159c3f56c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:56.443708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b36c6a1d-2374-4e54-9973-b47159c3f56c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:56.445644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b36c6a1d-2374-4e54-9973-b47159c3f56c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:57.165633 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1d3a072c-13d2-427d-acb9-dcd2d3d5c7c1 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.969960 Jul 14 14:33:57.170328 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 932/1859] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:33:56 2022] PUT /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 61 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:57.171493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-1c5dd106-7a57-43be-ad52-5f0be596d1bb req-4d3b2e70-4f57-4ebd-95cd-9a3d3b09a914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3", "name": "network-vif-unplugged", "status": "completed", "tag": "d847f251-9224-4c9f-b335-7f0f58afd9ef"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:57.198493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1c5dd106-7a57-43be-ad52-5f0be596d1bb req-4d3b2e70-4f57-4ebd-95cd-9a3d3b09a914 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:57.199187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1c5dd106-7a57-43be-ad52-5f0be596d1bb req-4d3b2e70-4f57-4ebd-95cd-9a3d3b09a914 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:57.230106 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-1c5dd106-7a57-43be-ad52-5f0be596d1bb req-4d3b2e70-4f57-4ebd-95cd-9a3d3b09a914 service nova] Creating event network-vif-unplugged:d847f251-9224-4c9f-b335-7f0f58afd9ef for instance dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 on n-h2-767704-28 Jul 14 14:33:57.241996 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-1c5dd106-7a57-43be-ad52-5f0be596d1bb req-4d3b2e70-4f57-4ebd-95cd-9a3d3b09a914 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074043 Jul 14 14:33:57.242952 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 933/1860] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:57.255877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-03ec940b-4a0c-454c-98af-e9bf4b33c53a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5bbcc10>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:57.361635 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-03ec940b-4a0c-454c-98af-e9bf4b33c53a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.117248 Jul 14 14:33:57.369240 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 934/1861] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:33:57 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:57.380555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff50bec9-200a-43ab-8071-76efeeb41491 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:57.381839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ff50bec9-200a-43ab-8071-76efeeb41491 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:57.401505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff50bec9-200a-43ab-8071-76efeeb41491 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:57.401979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff50bec9-200a-43ab-8071-76efeeb41491 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:57.402809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff50bec9-200a-43ab-8071-76efeeb41491 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:57.403274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff50bec9-200a-43ab-8071-76efeeb41491 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:57.446509 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-ff50bec9-200a-43ab-8071-76efeeb41491 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff50bec9-200a-43ab-8071-76efeeb41491 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 HTTP/1.1 Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'c70651b9-4d75-42ad-9463-eb29e92c4356'} Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:33:57.448723 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:33:57.457705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:33:57.457705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:33:57.457705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:33:57.457705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:33:57.457705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:33:57.457705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:33:57.457705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:33:57.459669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff50bec9-200a-43ab-8071-76efeeb41491 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:33:57.460735 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ff50bec9-200a-43ab-8071-76efeeb41491 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 404 len: 111 microversion: 2.1 time: 0.090444 Jul 14 14:33:57.461925 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 935/1862] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:57 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:33:57.466909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-351053df-fd2b-4ad3-9f14-b5870dc399e5 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Action: 'create', calling method: .version_select at 0x7fd6c5df71f0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:57.507078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b36c6a1d-2374-4e54-9973-b47159c3f56c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:57.517986 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b36c6a1d-2374-4e54-9973-b47159c3f56c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 1.116109 Jul 14 14:33:57.522426 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 928/1863] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:56 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:57.527490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=35 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:57.530757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e4062ca2-7c08-4f18-a836-a9623efc77a8 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:57.531382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e4062ca2-7c08-4f18-a836-a9623efc77a8 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:57.535923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-351053df-fd2b-4ad3-9f14-b5870dc399e5 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:57.544168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-351053df-fd2b-4ad3-9f14-b5870dc399e5 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Getting quotas for user ad00b04ce9354c5ea6ac2d6aba961cf2 and project 62a74d3abab64229b5530d02be1fea27. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:57.548192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4062ca2-7c08-4f18-a836-a9623efc77a8 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:57.548657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4062ca2-7c08-4f18-a836-a9623efc77a8 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:57.549472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4062ca2-7c08-4f18-a836-a9623efc77a8 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:57.550476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4062ca2-7c08-4f18-a836-a9623efc77a8 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:57.920987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:57.952452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e4062ca2-7c08-4f18-a836-a9623efc77a8 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:57.969511 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e4062ca2-7c08-4f18-a836-a9623efc77a8 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1392 microversion: 2.1 time: 0.445532 Jul 14 14:33:57.980734 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 929/1864] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:57 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1392 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:57.986354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7cf83d71-842f-425e-a509-c6c149754378 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:57.987403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7cf83d71-842f-425e-a509-c6c149754378 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:58.013990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7cf83d71-842f-425e-a509-c6c149754378 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:58.014226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7cf83d71-842f-425e-a509-c6c149754378 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:58.015360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7cf83d71-842f-425e-a509-c6c149754378 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:58.016061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7cf83d71-842f-425e-a509-c6c149754378 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:58.070898 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-351053df-fd2b-4ad3-9f14-b5870dc399e5 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "POST /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.607327 Jul 14 14:33:58.072238 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 936/1865] 10.222.0.81 () {60 vars in 1280 bytes} [Thu Jul 14 14:33:57 2022] POST /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 85 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:58.078036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-57e855cf-47b9-4347-a717-9e9e2aa35d1c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:58.079278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-57e855cf-47b9-4347-a717-9e9e2aa35d1c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:58.086788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57e855cf-47b9-4347-a717-9e9e2aa35d1c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:58.087462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57e855cf-47b9-4347-a717-9e9e2aa35d1c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:58.088454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57e855cf-47b9-4347-a717-9e9e2aa35d1c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:58.089156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57e855cf-47b9-4347-a717-9e9e2aa35d1c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:58.161731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-57e855cf-47b9-4347-a717-9e9e2aa35d1c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:33:58.311312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:58.329100 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-57e855cf-47b9-4347-a717-9e9e2aa35d1c tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "DELETE /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 204 len: 0 microversion: 2.25 time: 0.254809 Jul 14 14:33:58.330072 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 937/1866] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:33:58 2022] DELETE /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:33:58.339217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-25660192", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "e15a1c98-dd72-4729-94f4-9ad8a53d679a"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:58.406025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7cf83d71-842f-425e-a509-c6c149754378 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:58.417542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] validate_networks() for [('e15a1c98-dd72-4729-94f4-9ad8a53d679a', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:33:58.422462 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7cf83d71-842f-425e-a509-c6c149754378 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1317 microversion: 2.1 time: 0.439623 Jul 14 14:33:58.434054 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 930/1867] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:57 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:58.441637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cb3f3132-a9bb-4b03-b9b0-554e2743cb52 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] Calling method '.version_select at 0x7fd6c596c700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:58.503726 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cb3f3132-a9bb-4b03-b9b0-554e2743cb52 tempest-ImagesMetadataTestJSON-1007090288 tempest-ImagesMetadataTestJSON-1007090288-project] 10.222.0.81 "GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.067248 Jul 14 14:33:58.505839 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 931/1868] 10.222.0.81 () {58 vars in 1259 bytes} [Thu Jul 14 14:33:58 2022] GET /compute/v2.1/images/7be52632-428c-4ecf-bece-19c63b515d9d/metadata => generated 85 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:33:58.515034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-749e0839-40e5-44a1-a417-8b05f3f44cdf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:58.517726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-749e0839-40e5-44a1-a417-8b05f3f44cdf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:58.525905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-749e0839-40e5-44a1-a417-8b05f3f44cdf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:58.527252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-749e0839-40e5-44a1-a417-8b05f3f44cdf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:58.528370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-749e0839-40e5-44a1-a417-8b05f3f44cdf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:58.529065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-749e0839-40e5-44a1-a417-8b05f3f44cdf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:59.342184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=24 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:59.423067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-749e0839-40e5-44a1-a417-8b05f3f44cdf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:59.438837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-749e0839-40e5-44a1-a417-8b05f3f44cdf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:59.441803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-749e0839-40e5-44a1-a417-8b05f3f44cdf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:59.449933 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-749e0839-40e5-44a1-a417-8b05f3f44cdf tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1549 microversion: 2.25 time: 0.940418 Jul 14 14:33:59.450649 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 932/1869] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:33:58 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1549 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:59.465371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f2d22aee-1a02-4bb7-be66-17a8a4a15b46 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5395280>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:59.533961 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f2d22aee-1a02-4bb7-be66-17a8a4a15b46 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.081947 Jul 14 14:33:59.535578 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 933/1870] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:33:59 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:59.540650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b0af8680-ba98-422a-824c-b9a83127a1f1 req-9b732679-fd23-4588-8554-852b0e9bb398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0", "tag": "bef791a8-fac8-4dbf-b4bd-89eb84bb40fb"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:59.549470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b0af8680-ba98-422a-824c-b9a83127a1f1 req-9b732679-fd23-4588-8554-852b0e9bb398 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:59.550367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b0af8680-ba98-422a-824c-b9a83127a1f1 req-9b732679-fd23-4588-8554-852b0e9bb398 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:59.568088 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b0af8680-ba98-422a-824c-b9a83127a1f1 req-9b732679-fd23-4588-8554-852b0e9bb398 service nova] Creating event network-changed:bef791a8-fac8-4dbf-b4bd-89eb84bb40fb for instance 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 on n-h1-767704-28 Jul 14 14:33:59.576036 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b0af8680-ba98-422a-824c-b9a83127a1f1 req-9b732679-fd23-4588-8554-852b0e9bb398 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037911 Jul 14 14:33:59.577396 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 934/1871] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:59.585964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-38cb9b48-8e40-463b-8d7a-b93c18158552 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:59.586804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-38cb9b48-8e40-463b-8d7a-b93c18158552 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:59.599553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38cb9b48-8e40-463b-8d7a-b93c18158552 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:59.600288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38cb9b48-8e40-463b-8d7a-b93c18158552 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:59.602158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38cb9b48-8e40-463b-8d7a-b93c18158552 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:59.605929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38cb9b48-8e40-463b-8d7a-b93c18158552 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:00.104691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:34:00.106330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:34:00.106899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:34:00.107258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:34:00.107712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:34:00.130119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:00.131007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:00.132938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:00.133632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:00.169955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:34:00.189434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for user d56c219e943b4398bea8add8299df84f and project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:34:00.222801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:34:00.232762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:34:00.290080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-38cb9b48-8e40-463b-8d7a-b93c18158552 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:00.301390 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-38cb9b48-8e40-463b-8d7a-b93c18158552 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.720516 Jul 14 14:34:00.304014 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 935/1872] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:59 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:00.314831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-17280e71-d380-4cbf-bc6e-0e5e431abcbc tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:00.317733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-17280e71-d380-4cbf-bc6e-0e5e431abcbc tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:00.329734 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ba6c8cdb-db36-4585-ae67-947966950777 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.997536 Jul 14 14:34:00.335789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17280e71-d380-4cbf-bc6e-0e5e431abcbc tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:00.336548 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 938/1873] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:33:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:34:00.336729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17280e71-d380-4cbf-bc6e-0e5e431abcbc tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:00.337865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17280e71-d380-4cbf-bc6e-0e5e431abcbc tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:00.338233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17280e71-d380-4cbf-bc6e-0e5e431abcbc tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:00.343910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-87659e9f-29f0-432d-b56a-bb366f1108d6 req-ed192939-6072-4e0c-9b58-e9ef35508ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3", "tag": "d847f251-9224-4c9f-b335-7f0f58afd9ef"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:00.375627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-87659e9f-29f0-432d-b56a-bb366f1108d6 req-ed192939-6072-4e0c-9b58-e9ef35508ede service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:00.376396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-87659e9f-29f0-432d-b56a-bb366f1108d6 req-ed192939-6072-4e0c-9b58-e9ef35508ede service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:00.393566 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-87659e9f-29f0-432d-b56a-bb366f1108d6 req-ed192939-6072-4e0c-9b58-e9ef35508ede service nova] Creating event network-changed:d847f251-9224-4c9f-b335-7f0f58afd9ef for instance dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 on n-h2-767704-28 Jul 14 14:34:00.399797 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-87659e9f-29f0-432d-b56a-bb366f1108d6 req-ed192939-6072-4e0c-9b58-e9ef35508ede service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061534 Jul 14 14:34:00.401560 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 939/1874] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:00.410923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b47c6501-5ed2-407c-bc23-0fbb1aab777a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:00.412052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b47c6501-5ed2-407c-bc23-0fbb1aab777a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:00.422238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b47c6501-5ed2-407c-bc23-0fbb1aab777a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:00.422949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b47c6501-5ed2-407c-bc23-0fbb1aab777a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:00.423967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b47c6501-5ed2-407c-bc23-0fbb1aab777a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:00.424583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b47c6501-5ed2-407c-bc23-0fbb1aab777a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:01.295049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-17280e71-d380-4cbf-bc6e-0e5e431abcbc tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:01.303849 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-17280e71-d380-4cbf-bc6e-0e5e431abcbc tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1392 microversion: 2.1 time: 0.998219 Jul 14 14:34:01.309063 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 936/1875] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:00 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1392 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:01.323614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dc725312-5a38-43a6-82fe-bec4ed419f84 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:01.325928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dc725312-5a38-43a6-82fe-bec4ed419f84 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:01.360425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc725312-5a38-43a6-82fe-bec4ed419f84 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:01.363128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc725312-5a38-43a6-82fe-bec4ed419f84 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:01.364149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc725312-5a38-43a6-82fe-bec4ed419f84 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:01.366876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc725312-5a38-43a6-82fe-bec4ed419f84 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:01.460178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b47c6501-5ed2-407c-bc23-0fbb1aab777a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:01.478764 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b47c6501-5ed2-407c-bc23-0fbb1aab777a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1317 microversion: 2.1 time: 1.066216 Jul 14 14:34:01.480600 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 940/1876] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:00 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1317 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:01.493725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9fd8f50c-d9b8-4447-a149-ab51707cce67 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:01.495198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9fd8f50c-d9b8-4447-a149-ab51707cce67 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:01.530313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9fd8f50c-d9b8-4447-a149-ab51707cce67 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:01.531088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9fd8f50c-d9b8-4447-a149-ab51707cce67 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:01.535170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9fd8f50c-d9b8-4447-a149-ab51707cce67 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:01.535891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9fd8f50c-d9b8-4447-a149-ab51707cce67 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:01.858915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dc725312-5a38-43a6-82fe-bec4ed419f84 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:01.881538 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dc725312-5a38-43a6-82fe-bec4ed419f84 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1217 microversion: 2.1 time: 0.570910 Jul 14 14:34:01.884894 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 937/1877] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:01 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1217 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:01.891112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9fd8f50c-d9b8-4447-a149-ab51707cce67 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:01.932996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5175317-d00f-4812-9d7f-22f3b0580a2b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c567eee0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:01.934077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9fd8f50c-d9b8-4447-a149-ab51707cce67 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:01.944341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9fd8f50c-d9b8-4447-a149-ab51707cce67 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:01.960541 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9fd8f50c-d9b8-4447-a149-ab51707cce67 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 200 len: 1507 microversion: 2.25 time: 0.473922 Jul 14 14:34:01.975736 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 941/1878] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:34:01 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 1507 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:34:01.992816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7b28c4b5-6f8b-46c0-ac3f-67e28cdfe09a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:01.995459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7b28c4b5-6f8b-46c0-ac3f-67e28cdfe09a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:02.022615 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e5175317-d00f-4812-9d7f-22f3b0580a2b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.116292 Jul 14 14:34:02.023200 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 938/1879] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:34:01 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:02.031511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b28c4b5-6f8b-46c0-ac3f-67e28cdfe09a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:02.032755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b28c4b5-6f8b-46c0-ac3f-67e28cdfe09a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:02.035632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b28c4b5-6f8b-46c0-ac3f-67e28cdfe09a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:02.037220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b28c4b5-6f8b-46c0-ac3f-67e28cdfe09a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:02.041924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-91c716b5-d40a-4481-9076-8fe814dbdfb6 req-c9ac4331-2a0c-4cb4-b168-71fa16b0567f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311addf3-6349-4923-8f5b-89f80e649e21", "name": "network-vif-plugged", "status": "completed", "tag": "8c7f6fa5-ec9a-4d3e-ab0f-bb398a38696c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:02.062253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-91c716b5-d40a-4481-9076-8fe814dbdfb6 req-c9ac4331-2a0c-4cb4-b168-71fa16b0567f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:02.063025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-91c716b5-d40a-4481-9076-8fe814dbdfb6 req-c9ac4331-2a0c-4cb4-b168-71fa16b0567f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:02.098631 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-91c716b5-d40a-4481-9076-8fe814dbdfb6 req-c9ac4331-2a0c-4cb4-b168-71fa16b0567f service nova] Creating event network-vif-plugged:8c7f6fa5-ec9a-4d3e-ab0f-bb398a38696c for instance 311addf3-6349-4923-8f5b-89f80e649e21 on n-h2-767704-28 Jul 14 14:34:02.110148 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-91c716b5-d40a-4481-9076-8fe814dbdfb6 req-c9ac4331-2a0c-4cb4-b168-71fa16b0567f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082218 Jul 14 14:34:02.114834 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 939/1880] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:02.328729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ed06c22-b60a-4f24-a942-7a51e9f42c34 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:02.329729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ed06c22-b60a-4f24-a942-7a51e9f42c34 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:02.370083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ed06c22-b60a-4f24-a942-7a51e9f42c34 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:02.374679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ed06c22-b60a-4f24-a942-7a51e9f42c34 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:02.375939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ed06c22-b60a-4f24-a942-7a51e9f42c34 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:02.381671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ed06c22-b60a-4f24-a942-7a51e9f42c34 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:02.542248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7b28c4b5-6f8b-46c0-ac3f-67e28cdfe09a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:02.562559 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7b28c4b5-6f8b-46c0-ac3f-67e28cdfe09a tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.581902 Jul 14 14:34:02.563638 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 942/1881] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:01 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:02.575361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2da4ede5-8dd9-44ba-8abf-6e7f9b233910 req-37b2919c-c975-4cae-8eb3-e0cc63e4f925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037d7f27-c02b-4c2e-8039-2efba995484d", "name": "network-vif-deleted", "tag": "f836c7c7-f03f-4d05-a974-793760051e3e"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:02.598726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2da4ede5-8dd9-44ba-8abf-6e7f9b233910 req-37b2919c-c975-4cae-8eb3-e0cc63e4f925 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:02.600714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2da4ede5-8dd9-44ba-8abf-6e7f9b233910 req-37b2919c-c975-4cae-8eb3-e0cc63e4f925 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:02.628535 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2da4ede5-8dd9-44ba-8abf-6e7f9b233910 req-37b2919c-c975-4cae-8eb3-e0cc63e4f925 service nova] Creating event network-vif-deleted:f836c7c7-f03f-4d05-a974-793760051e3e for instance 037d7f27-c02b-4c2e-8039-2efba995484d on n-h1-767704-28 Jul 14 14:34:02.638716 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2da4ede5-8dd9-44ba-8abf-6e7f9b233910 req-37b2919c-c975-4cae-8eb3-e0cc63e4f925 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073400 Jul 14 14:34:02.639338 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 943/1882] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:02.655211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc18fd06-e3f5-4e92-a722-1a252776a212 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:02.655862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cc18fd06-e3f5-4e92-a722-1a252776a212 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:02.672134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc18fd06-e3f5-4e92-a722-1a252776a212 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:02.672596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc18fd06-e3f5-4e92-a722-1a252776a212 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:02.675450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc18fd06-e3f5-4e92-a722-1a252776a212 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:02.675921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc18fd06-e3f5-4e92-a722-1a252776a212 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:03.269616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ed06c22-b60a-4f24-a942-7a51e9f42c34 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:03.279516 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ed06c22-b60a-4f24-a942-7a51e9f42c34 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1392 microversion: 2.1 time: 0.956372 Jul 14 14:34:03.285291 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 940/1883] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:02 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1392 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:03.302416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8985c6f-d641-4baf-addb-264e31ed7c3b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:03.306203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b8985c6f-d641-4baf-addb-264e31ed7c3b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:03.334517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8985c6f-d641-4baf-addb-264e31ed7c3b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:03.336041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8985c6f-d641-4baf-addb-264e31ed7c3b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:03.339042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8985c6f-d641-4baf-addb-264e31ed7c3b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:03.340013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8985c6f-d641-4baf-addb-264e31ed7c3b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:03.535926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b8985c6f-d641-4baf-addb-264e31ed7c3b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:03.570125 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b8985c6f-d641-4baf-addb-264e31ed7c3b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1271 microversion: 2.1 time: 0.263698 Jul 14 14:34:03.573531 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 941/1884] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:03 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1271 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:03.590309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cc18fd06-e3f5-4e92-a722-1a252776a212 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:03.590921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-109fab3e-5638-4a54-bacb-9bd39212e06b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:03.601611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-109fab3e-5638-4a54-bacb-9bd39212e06b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 037d7f27-c02b-4c2e-8039-2efba995484d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:03.614866 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc18fd06-e3f5-4e92-a722-1a252776a212 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1317 microversion: 2.1 time: 0.969943 Jul 14 14:34:03.621598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-109fab3e-5638-4a54-bacb-9bd39212e06b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:03.622964 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 944/1885] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:02 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1317 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:03.632352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-109fab3e-5638-4a54-bacb-9bd39212e06b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:03.633309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-109fab3e-5638-4a54-bacb-9bd39212e06b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:03.633777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-109fab3e-5638-4a54-bacb-9bd39212e06b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:03.642208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2042cbe5-91fb-491a-ad35-8ebbfbf5a5e6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5fdb820>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:03.694153 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-109fab3e-5638-4a54-bacb-9bd39212e06b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] HTTP exception thrown: Instance 037d7f27-c02b-4c2e-8039-2efba995484d could not be found. Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-109fab3e-5638-4a54-bacb-9bd39212e06b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Request method failure captured: Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d HTTP/1.1 Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CeRYQkBsHWRZzeg3gM75BtPmbMeWbC_fASh1Cxn3K4J33bHdQBDrWEc-RP6z8mW148RnKRxxABuudvGohrHZcKKUffRQ35hVrElxs4rTDbe8wB_DlavvbnZi6Mv8Da8z1Wa3gC8zoHyhYe-xb2QlqPzcUuvwkWmdUZyZBja-MFG1ME Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.25 Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 4459eedeb8884ffe82ed62e567fb64c3 Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-653795149 Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4459eedeb8884ffe82ed62e567fb64c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4459eedeb8884ffe82ed62e567fb64c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4459eedeb8884ffe82ed62e567fb64c3", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4459eedeb8884ffe82ed62e567fb64c3"}]}] Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-653795149 Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 4459eedeb8884ffe82ed62e567fb64c3 Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-653795149 Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-LiveAutoBlockMigrationV225Test-653795149-project Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: ef25b01962404bdfa0c2bbb30401ca62 Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-653795149-project Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 037d7f27-c02b-4c2e-8039-2efba995484d could not be found. Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '037d7f27-c02b-4c2e-8039-2efba995484d'} Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 037d7f27-c02b-4c2e-8039-2efba995484d could not be found. Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 037d7f27-c02b-4c2e-8039-2efba995484d could not be found. Jul 14 14:34:03.698326 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:03.702966 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:03.702966 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:03.702966 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:03.702966 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:03.702966 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:03.702966 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:03.702966 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:03.702966 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 037d7f27-c02b-4c2e-8039-2efba995484d could not be found. Jul 14 14:34:03.702966 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:03.705554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-109fab3e-5638-4a54-bacb-9bd39212e06b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Returning 404 to user: Instance 037d7f27-c02b-4c2e-8039-2efba995484d could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:03.707523 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-109fab3e-5638-4a54-bacb-9bd39212e06b tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d" status: 404 len: 111 microversion: 2.25 time: 0.132594 Jul 14 14:34:03.708551 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 942/1886] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:34:03 2022] GET /compute/v2.1/servers/037d7f27-c02b-4c2e-8039-2efba995484d => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:34:03.714246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8cad3add-8758-4112-94b1-da9fb8f43742 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:03.715623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8cad3add-8758-4112-94b1-da9fb8f43742 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:03.724036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8cad3add-8758-4112-94b1-da9fb8f43742 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:03.725720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8cad3add-8758-4112-94b1-da9fb8f43742 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:03.729266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8cad3add-8758-4112-94b1-da9fb8f43742 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:03.730166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8cad3add-8758-4112-94b1-da9fb8f43742 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:03.786800 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2042cbe5-91fb-491a-ad35-8ebbfbf5a5e6 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.162142 Jul 14 14:34:03.793280 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 945/1887] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:34:03 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:03.809796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-116c6454-5015-49d4-afb8-d91f13990b71 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:03.810297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-116c6454-5015-49d4-afb8-d91f13990b71 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:03.860632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-116c6454-5015-49d4-afb8-d91f13990b71 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:03.861878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-116c6454-5015-49d4-afb8-d91f13990b71 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:03.866104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-116c6454-5015-49d4-afb8-d91f13990b71 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:03.877130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-116c6454-5015-49d4-afb8-d91f13990b71 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:03.998753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-116c6454-5015-49d4-afb8-d91f13990b71 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:04.160517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:04.167292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8cad3add-8758-4112-94b1-da9fb8f43742 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:04.189901 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8cad3add-8758-4112-94b1-da9fb8f43742 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.479620 Jul 14 14:34:04.193815 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 943/1888] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:03 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:04.208293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-4089c7cc-96c1-4be8-b63c-2521af8a9b29 req-56c2aa3b-e68a-4d79-b75e-5988067ddc40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0", "name": "network-vif-plugged", "status": "completed", "tag": "bef791a8-fac8-4dbf-b4bd-89eb84bb40fb"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:04.239451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4089c7cc-96c1-4be8-b63c-2521af8a9b29 req-56c2aa3b-e68a-4d79-b75e-5988067ddc40 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:04.245606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4089c7cc-96c1-4be8-b63c-2521af8a9b29 req-56c2aa3b-e68a-4d79-b75e-5988067ddc40 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:04.315263 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-4089c7cc-96c1-4be8-b63c-2521af8a9b29 req-56c2aa3b-e68a-4d79-b75e-5988067ddc40 service nova] Creating event network-vif-plugged:bef791a8-fac8-4dbf-b4bd-89eb84bb40fb for instance 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 on n-h1-767704-28 Jul 14 14:34:04.336825 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-4089c7cc-96c1-4be8-b63c-2521af8a9b29 req-56c2aa3b-e68a-4d79-b75e-5988067ddc40 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141461 Jul 14 14:34:04.344295 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 944/1889] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:04.346608 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-116c6454-5015-49d4-afb8-d91f13990b71 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "DELETE /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 204 len: 0 microversion: 2.25 time: 0.551772 Jul 14 14:34:04.355842 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 946/1890] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:34:03 2022] DELETE /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:34:04.366987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f28ee09c-ea2a-4da8-8d22-0a0148f08670 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:04.374716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f28ee09c-ea2a-4da8-8d22-0a0148f08670 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:04.397861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f28ee09c-ea2a-4da8-8d22-0a0148f08670 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:04.400689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f28ee09c-ea2a-4da8-8d22-0a0148f08670 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:04.426061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f28ee09c-ea2a-4da8-8d22-0a0148f08670 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:04.431557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f28ee09c-ea2a-4da8-8d22-0a0148f08670 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:04.825313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1539940208", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "59e7d415-3757-4950-87b7-03515b33d4d5"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:04.983809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] validate_networks() for [('59e7d415-3757-4950-87b7-03515b33d4d5', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:34:05.684136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f28ee09c-ea2a-4da8-8d22-0a0148f08670 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:05.698125 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f28ee09c-ea2a-4da8-8d22-0a0148f08670 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1392 microversion: 2.1 time: 1.337715 Jul 14 14:34:05.699109 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 947/1891] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:04 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1392 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:05.714815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3af108e4-631e-46bd-81ef-91338c8d3f80 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:05.715927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3af108e4-631e-46bd-81ef-91338c8d3f80 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:05.731735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3af108e4-631e-46bd-81ef-91338c8d3f80 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:05.732603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3af108e4-631e-46bd-81ef-91338c8d3f80 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:05.734824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3af108e4-631e-46bd-81ef-91338c8d3f80 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:05.736281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3af108e4-631e-46bd-81ef-91338c8d3f80 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:06.317950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3af108e4-631e-46bd-81ef-91338c8d3f80 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:06.330071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3af108e4-631e-46bd-81ef-91338c8d3f80 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:06.332468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3af108e4-631e-46bd-81ef-91338c8d3f80 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:06.347092 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3af108e4-631e-46bd-81ef-91338c8d3f80 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1565 microversion: 2.25 time: 0.644783 Jul 14 14:34:06.359106 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 948/1892] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:34:05 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1565 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:34:06.364885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac56dc8b-132e-4375-9e89-1c275f41595a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:06.366155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac56dc8b-132e-4375-9e89-1c275f41595a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:06.385379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac56dc8b-132e-4375-9e89-1c275f41595a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:06.386275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac56dc8b-132e-4375-9e89-1c275f41595a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:06.387370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac56dc8b-132e-4375-9e89-1c275f41595a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:06.388023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac56dc8b-132e-4375-9e89-1c275f41595a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:07.320431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac56dc8b-132e-4375-9e89-1c275f41595a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:07.347650 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac56dc8b-132e-4375-9e89-1c275f41595a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1313 microversion: 2.1 time: 0.981765 Jul 14 14:34:07.348318 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 949/1893] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:06 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1313 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:07.375415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-905bfa8f-52cc-4640-b4c3-2eae4c7725bc tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:07.387046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-905bfa8f-52cc-4640-b4c3-2eae4c7725bc tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:07.412189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-905bfa8f-52cc-4640-b4c3-2eae4c7725bc tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:07.413384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-905bfa8f-52cc-4640-b4c3-2eae4c7725bc tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:07.414938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-905bfa8f-52cc-4640-b4c3-2eae4c7725bc tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:07.417729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-905bfa8f-52cc-4640-b4c3-2eae4c7725bc tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:07.483216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:34:07.484077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:34:07.484193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:34:07.484797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:34:07.485257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:34:07.515845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:07.517691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:07.519831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:07.520285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:07.578081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:07.625364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Getting quotas for project 59a84509190c46db86a63fd33bd984a9. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:34:07.654488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Getting quotas for user c76419eaed7b49c0adffd3300cdb55ed and project 59a84509190c46db86a63fd33bd984a9. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:34:07.736547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:34:07.750282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:34:07.901283 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f56fe297-6810-4820-baef-80b99b5485d8 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.549727 Jul 14 14:34:07.920097 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 945/1894] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:34:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:34:07.926938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4a9afea2-941f-4025-880b-39c9042e8816 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c538a310>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:08.041807 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4a9afea2-941f-4025-880b-39c9042e8816 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.128427 Jul 14 14:34:08.047555 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 946/1895] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:34:07 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:08.061560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d65a85f-ee6a-42d9-94dd-e2989642fb4e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:08.065938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6d65a85f-ee6a-42d9-94dd-e2989642fb4e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:08.095073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d65a85f-ee6a-42d9-94dd-e2989642fb4e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:08.096478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d65a85f-ee6a-42d9-94dd-e2989642fb4e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:08.099823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d65a85f-ee6a-42d9-94dd-e2989642fb4e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:08.102249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d65a85f-ee6a-42d9-94dd-e2989642fb4e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:08.307532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-905bfa8f-52cc-4640-b4c3-2eae4c7725bc tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:08.319066 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-905bfa8f-52cc-4640-b4c3-2eae4c7725bc tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1317 microversion: 2.1 time: 0.961328 Jul 14 14:34:08.323555 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 950/1896] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:07 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1317 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:08.336274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-24da1269-4104-44f8-9c15-67acdd0e94f1 req-0f45f817-6a05-4de1-b789-a0fdf039564a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3", "name": "network-vif-unplugged", "status": "completed", "tag": "d847f251-9224-4c9f-b335-7f0f58afd9ef"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:08.364760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-24da1269-4104-44f8-9c15-67acdd0e94f1 req-0f45f817-6a05-4de1-b789-a0fdf039564a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:08.365237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-24da1269-4104-44f8-9c15-67acdd0e94f1 req-0f45f817-6a05-4de1-b789-a0fdf039564a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:08.399043 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-24da1269-4104-44f8-9c15-67acdd0e94f1 req-0f45f817-6a05-4de1-b789-a0fdf039564a service nova] Creating event network-vif-unplugged:d847f251-9224-4c9f-b335-7f0f58afd9ef for instance dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 on n-h2-767704-28 Jul 14 14:34:08.409444 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-24da1269-4104-44f8-9c15-67acdd0e94f1 req-0f45f817-6a05-4de1-b789-a0fdf039564a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083905 Jul 14 14:34:08.413257 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 951/1897] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:08.418488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e18524d3-ed93-4002-8635-39101d9e618d tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:08.419198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e18524d3-ed93-4002-8635-39101d9e618d tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:08.436347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e18524d3-ed93-4002-8635-39101d9e618d tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:08.436720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e18524d3-ed93-4002-8635-39101d9e618d tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:08.442115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e18524d3-ed93-4002-8635-39101d9e618d tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:08.442817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e18524d3-ed93-4002-8635-39101d9e618d tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:08.809663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6d65a85f-ee6a-42d9-94dd-e2989642fb4e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:08.818780 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6d65a85f-ee6a-42d9-94dd-e2989642fb4e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.766581 Jul 14 14:34:08.829356 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 947/1898] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:08 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:08.834967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-799032cf-2169-44e3-a5ac-1c147247f252 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:08.835635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-799032cf-2169-44e3-a5ac-1c147247f252 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:08.875036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-799032cf-2169-44e3-a5ac-1c147247f252 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:08.875905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-799032cf-2169-44e3-a5ac-1c147247f252 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:08.879226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-799032cf-2169-44e3-a5ac-1c147247f252 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:08.879918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-799032cf-2169-44e3-a5ac-1c147247f252 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:09.008821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e18524d3-ed93-4002-8635-39101d9e618d tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:09.022221 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e18524d3-ed93-4002-8635-39101d9e618d tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1574 microversion: 2.1 time: 0.607674 Jul 14 14:34:09.022873 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 952/1899] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:08 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1574 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:09.027526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6f90df6d-f138-451d-816f-bd8aa841f9a4 req-a3fae9d8-5cc0-49ae-b9b0-f2375f686ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131fc2d4-00c2-462b-b7e2-4fbb53234749", "tag": "8f81fa18-1ee0-41c0-a4e5-0c0a8bc1111a"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:09.053244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6f90df6d-f138-451d-816f-bd8aa841f9a4 req-a3fae9d8-5cc0-49ae-b9b0-f2375f686ef8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:09.053916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6f90df6d-f138-451d-816f-bd8aa841f9a4 req-a3fae9d8-5cc0-49ae-b9b0-f2375f686ef8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:09.098222 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6f90df6d-f138-451d-816f-bd8aa841f9a4 req-a3fae9d8-5cc0-49ae-b9b0-f2375f686ef8 service nova] Creating event network-changed:8f81fa18-1ee0-41c0-a4e5-0c0a8bc1111a for instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 on n-h2-767704-28 Jul 14 14:34:09.116697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-799032cf-2169-44e3-a5ac-1c147247f252 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:09.125568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-799032cf-2169-44e3-a5ac-1c147247f252 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:09.130115 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6f90df6d-f138-451d-816f-bd8aa841f9a4 req-a3fae9d8-5cc0-49ae-b9b0-f2375f686ef8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103749 Jul 14 14:34:09.131764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-799032cf-2169-44e3-a5ac-1c147247f252 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:09.132733 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 953/1900] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:09.137690 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-799032cf-2169-44e3-a5ac-1c147247f252 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1523 microversion: 2.25 time: 0.307117 Jul 14 14:34:09.138281 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 948/1901] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:34:08 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:34:09.152504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ddcbde6c-1911-437e-be77-49d2b9fee226 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:09.153303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ddcbde6c-1911-437e-be77-49d2b9fee226 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:09.166492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b5564793-e0fd-4f36-8b5c-db742363308d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:09.167124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5564793-e0fd-4f36-8b5c-db742363308d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:09.183381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5564793-e0fd-4f36-8b5c-db742363308d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:09.183846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5564793-e0fd-4f36-8b5c-db742363308d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:09.184656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5564793-e0fd-4f36-8b5c-db742363308d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:09.192409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddcbde6c-1911-437e-be77-49d2b9fee226 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:09.192913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddcbde6c-1911-437e-be77-49d2b9fee226 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:09.194851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddcbde6c-1911-437e-be77-49d2b9fee226 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:09.195310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddcbde6c-1911-437e-be77-49d2b9fee226 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:09.198664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5564793-e0fd-4f36-8b5c-db742363308d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:09.397797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ddcbde6c-1911-437e-be77-49d2b9fee226 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:09.406351 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ddcbde6c-1911-437e-be77-49d2b9fee226 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1232 microversion: 2.1 time: 0.270363 Jul 14 14:34:09.406939 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 954/1902] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:09 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1232 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:09.428193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-72113e55-427f-4c03-91c0-22351c3b40ef tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:09.429111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-72113e55-427f-4c03-91c0-22351c3b40ef tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:09.454839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72113e55-427f-4c03-91c0-22351c3b40ef tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:09.455306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72113e55-427f-4c03-91c0-22351c3b40ef tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:09.456420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72113e55-427f-4c03-91c0-22351c3b40ef tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:09.456765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72113e55-427f-4c03-91c0-22351c3b40ef tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:09.860432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b5564793-e0fd-4f36-8b5c-db742363308d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:09.870999 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b5564793-e0fd-4f36-8b5c-db742363308d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1313 microversion: 2.1 time: 0.731655 Jul 14 14:34:09.878747 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 949/1903] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:09 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1313 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:09.891432 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-72113e55-427f-4c03-91c0-22351c3b40ef tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.477984 Jul 14 14:34:09.892338 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 955/1904] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:34:09 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21/os-interface => generated 285 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:09.904269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d02cfe4c-3022-4b17-93f7-d84edcdfd3cd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:09.905151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d02cfe4c-3022-4b17-93f7-d84edcdfd3cd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:09.906933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a5cd059a-6691-43dc-878d-bb423eeb260d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c53738b0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:09.929329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d02cfe4c-3022-4b17-93f7-d84edcdfd3cd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:09.930100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d02cfe4c-3022-4b17-93f7-d84edcdfd3cd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:09.931073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d02cfe4c-3022-4b17-93f7-d84edcdfd3cd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:09.933723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d02cfe4c-3022-4b17-93f7-d84edcdfd3cd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:10.014754 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a5cd059a-6691-43dc-878d-bb423eeb260d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.134673 Jul 14 14:34:10.015339 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 950/1905] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:34:09 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:10.025807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c751121c-afab-46bf-9d66-7b28c3c8b371 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:10.026432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c751121c-afab-46bf-9d66-7b28c3c8b371 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:10.075291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c751121c-afab-46bf-9d66-7b28c3c8b371 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:10.079964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c751121c-afab-46bf-9d66-7b28c3c8b371 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:10.087291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c751121c-afab-46bf-9d66-7b28c3c8b371 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:10.089469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c751121c-afab-46bf-9d66-7b28c3c8b371 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:10.160066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:10.204553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=9 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:10.345223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d02cfe4c-3022-4b17-93f7-d84edcdfd3cd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:10.365345 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d02cfe4c-3022-4b17-93f7-d84edcdfd3cd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1466 microversion: 2.1 time: 0.471369 Jul 14 14:34:10.392489 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 956/1906] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:09 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1466 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:10.407062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:10.407723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:10.431867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:10.451428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:10.452441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:10.452739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:10.546773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:10.547120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:10.547788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lazy-loading 'fault' on Instance uuid 88426cdc-557a-4724-9ef2-d84d32b4191d {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:34:10.693480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:10.706700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:10.708395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef25b01962404bdfa0c2bbb30401ca62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4459eedeb8884ffe82ed62e567fb64c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:10.709638 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fdeda76f-50a9-4bb1-b816-f6795376fc52 tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 200 len: 1352 microversion: 2.25 time: 0.315762 Jul 14 14:34:10.721890 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 957/1907] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:34:10 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 1352 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:34:10.728713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-00c8fbf1-8e47-45ea-9ec9-93607d93684c tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:10.729369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-00c8fbf1-8e47-45ea-9ec9-93607d93684c tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:10.748090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c751121c-afab-46bf-9d66-7b28c3c8b371 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:10.750177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00c8fbf1-8e47-45ea-9ec9-93607d93684c tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:10.755572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00c8fbf1-8e47-45ea-9ec9-93607d93684c tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:10.756681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00c8fbf1-8e47-45ea-9ec9-93607d93684c tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:10.757296 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c751121c-afab-46bf-9d66-7b28c3c8b371 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.740891 Jul 14 14:34:10.757950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00c8fbf1-8e47-45ea-9ec9-93607d93684c tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:10.760533 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 951/1908] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:10 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:10.780924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-09213748-3779-49a7-92ce-70db3ceef716 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:10.781960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-09213748-3779-49a7-92ce-70db3ceef716 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:10.806760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09213748-3779-49a7-92ce-70db3ceef716 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:10.809454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09213748-3779-49a7-92ce-70db3ceef716 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:10.810587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09213748-3779-49a7-92ce-70db3ceef716 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:10.812145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09213748-3779-49a7-92ce-70db3ceef716 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:11.102990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-09213748-3779-49a7-92ce-70db3ceef716 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:11.112370 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-09213748-3779-49a7-92ce-70db3ceef716 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1280 microversion: 2.1 time: 0.350372 Jul 14 14:34:11.127299 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 952/1909] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:10 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1280 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:11.137301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b20dbc34-b7a5-4614-8881-a569ac2c9aff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:11.138024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b20dbc34-b7a5-4614-8881-a569ac2c9aff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:11.146231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b20dbc34-b7a5-4614-8881-a569ac2c9aff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:11.147022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b20dbc34-b7a5-4614-8881-a569ac2c9aff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:11.155664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b20dbc34-b7a5-4614-8881-a569ac2c9aff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:11.156536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b20dbc34-b7a5-4614-8881-a569ac2c9aff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:11.372380 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-00c8fbf1-8e47-45ea-9ec9-93607d93684c tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1619 microversion: 2.1 time: 0.640059 Jul 14 14:34:11.373857 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 958/1910] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:10 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1619 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:11.395309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c68c55d2-7346-4b38-9b69-10106efc73c3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5a5aca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:11.516901 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c68c55d2-7346-4b38-9b69-10106efc73c3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1440 microversion: 2.1 time: 0.141712 Jul 14 14:34:11.544814 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 959/1911] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:34:11 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1440 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:11.730742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-756c3942-447f-4e50-8907-5952de1f41ac tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:11.731619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-756c3942-447f-4e50-8907-5952de1f41ac tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] [instance: 88426cdc-557a-4724-9ef2-d84d32b4191d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:11.743222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-756c3942-447f-4e50-8907-5952de1f41ac tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:11.744062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-756c3942-447f-4e50-8907-5952de1f41ac tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:11.745298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-756c3942-447f-4e50-8907-5952de1f41ac tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:11.746032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-756c3942-447f-4e50-8907-5952de1f41ac tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:11.787441 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-756c3942-447f-4e50-8907-5952de1f41ac tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] HTTP exception thrown: Instance 88426cdc-557a-4724-9ef2-d84d32b4191d could not be found. Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-756c3942-447f-4e50-8907-5952de1f41ac tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Request method failure captured: Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d HTTP/1.1 Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CeRYQkBsHWRZzeg3gM75BtPmbMeWbC_fASh1Cxn3K4J33bHdQBDrWEc-RP6z8mW148RnKRxxABuudvGohrHZcKKUffRQ35hVrElxs4rTDbe8wB_DlavvbnZi6Mv8Da8z1Wa3gC8zoHyhYe-xb2QlqPzcUuvwkWmdUZyZBja-MFG1ME Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.25 Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 4459eedeb8884ffe82ed62e567fb64c3 Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-653795149 Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4459eedeb8884ffe82ed62e567fb64c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4459eedeb8884ffe82ed62e567fb64c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4459eedeb8884ffe82ed62e567fb64c3", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4459eedeb8884ffe82ed62e567fb64c3"}]}] Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-653795149 Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 4459eedeb8884ffe82ed62e567fb64c3 Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-653795149 Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-LiveAutoBlockMigrationV225Test-653795149-project Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: ef25b01962404bdfa0c2bbb30401ca62 Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-653795149-project Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 88426cdc-557a-4724-9ef2-d84d32b4191d could not be found. Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '88426cdc-557a-4724-9ef2-d84d32b4191d'} Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88426cdc-557a-4724-9ef2-d84d32b4191d could not be found. Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88426cdc-557a-4724-9ef2-d84d32b4191d could not be found. Jul 14 14:34:11.789726 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:11.808141 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:11.808141 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:11.808141 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:11.808141 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:11.808141 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:11.808141 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:11.808141 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:11.808141 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88426cdc-557a-4724-9ef2-d84d32b4191d could not be found. Jul 14 14:34:11.808141 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:11.808141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-756c3942-447f-4e50-8907-5952de1f41ac tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] Returning 404 to user: Instance 88426cdc-557a-4724-9ef2-d84d32b4191d could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:11.808141 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-756c3942-447f-4e50-8907-5952de1f41ac tempest-LiveAutoBlockMigrationV225Test-653795149 tempest-LiveAutoBlockMigrationV225Test-653795149-project] 10.222.0.81 "GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d" status: 404 len: 111 microversion: 2.25 time: 0.077094 Jul 14 14:34:11.817334 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 960/1912] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:34:11 2022] GET /compute/v2.1/servers/88426cdc-557a-4724-9ef2-d84d32b4191d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:34:11.822442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1883080854", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["ea89554c-b395-4813-8c65-81afc2ae89ec"]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:11.848317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b20dbc34-b7a5-4614-8881-a569ac2c9aff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:11.862699 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b20dbc34-b7a5-4614-8881-a569ac2c9aff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1313 microversion: 2.1 time: 0.734074 Jul 14 14:34:11.869627 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 953/1913] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:11 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1313 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:11.880987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-65397f35-5f4b-49cc-8b3b-dc5adfad43d4 req-38f079ef-a489-4b0d-a973-872f4d547a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88426cdc-557a-4724-9ef2-d84d32b4191d", "name": "network-vif-deleted", "tag": "5671e97e-1f32-49f5-aea1-ca6152f537d3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:11.919304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-65397f35-5f4b-49cc-8b3b-dc5adfad43d4 req-38f079ef-a489-4b0d-a973-872f4d547a38 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:11.919496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-65397f35-5f4b-49cc-8b3b-dc5adfad43d4 req-38f079ef-a489-4b0d-a973-872f4d547a38 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:11.954684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:34:11.954925 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-65397f35-5f4b-49cc-8b3b-dc5adfad43d4 req-38f079ef-a489-4b0d-a973-872f4d547a38 service nova] Creating event network-vif-deleted:5671e97e-1f32-49f5-aea1-ca6152f537d3 for instance 88426cdc-557a-4724-9ef2-d84d32b4191d on n-h1-767704-28 Jul 14 14:34:11.967520 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-65397f35-5f4b-49cc-8b3b-dc5adfad43d4 req-38f079ef-a489-4b0d-a973-872f4d547a38 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095673 Jul 14 14:34:11.968972 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 954/1914] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:11.975101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b55205b0-7f2b-4ab8-9c1b-b7b043947e5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:11.977309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b55205b0-7f2b-4ab8-9c1b-b7b043947e5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:11.989308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b55205b0-7f2b-4ab8-9c1b-b7b043947e5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:11.992510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b55205b0-7f2b-4ab8-9c1b-b7b043947e5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:11.995184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b55205b0-7f2b-4ab8-9c1b-b7b043947e5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:11.997847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b55205b0-7f2b-4ab8-9c1b-b7b043947e5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:13.166878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b55205b0-7f2b-4ab8-9c1b-b7b043947e5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:13.179556 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b55205b0-7f2b-4ab8-9c1b-b7b043947e5e tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 1.209168 Jul 14 14:34:13.194724 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 955/1915] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:11 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:13.201943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-348866ad-de1d-489e-a0a1-90ce006632c9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:13.202873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-348866ad-de1d-489e-a0a1-90ce006632c9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:13.216850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-348866ad-de1d-489e-a0a1-90ce006632c9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:13.218809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-348866ad-de1d-489e-a0a1-90ce006632c9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:13.220408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-348866ad-de1d-489e-a0a1-90ce006632c9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:13.221721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-348866ad-de1d-489e-a0a1-90ce006632c9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:13.395750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-348866ad-de1d-489e-a0a1-90ce006632c9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:13.406624 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-348866ad-de1d-489e-a0a1-90ce006632c9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1286 microversion: 2.1 time: 0.209261 Jul 14 14:34:13.411515 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 956/1916] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:13 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:13.419824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-40fc753e-956d-4e08-96e1-65280b6c8e6d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c53a49d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:13.500881 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-40fc753e-956d-4e08-96e1-65280b6c8e6d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1449 microversion: 2.1 time: 0.088084 Jul 14 14:34:13.512066 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 957/1917] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:34:13 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1449 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:13.527401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-43e28c07-a46b-48c5-b4b2-6c8b07d73128 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:13.528278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-43e28c07-a46b-48c5-b4b2-6c8b07d73128 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:13.541588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43e28c07-a46b-48c5-b4b2-6c8b07d73128 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:13.542342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43e28c07-a46b-48c5-b4b2-6c8b07d73128 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:13.579364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43e28c07-a46b-48c5-b4b2-6c8b07d73128 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:13.583083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43e28c07-a46b-48c5-b4b2-6c8b07d73128 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:13.645438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:34:13.645910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:34:13.646626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:34:13.647326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:34:13.648391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:34:13.694568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:13.695086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:13.695916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:13.696385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:13.760015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:34:13.770543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:34:13.798349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:34:13.802294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:34:13.887191 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-809d6cda-4409-4a07-bc2f-cfbb067a46e5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.068623 Jul 14 14:34:13.894042 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 961/1918] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:34:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:34:13.902610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cb49354e-90a3-4fb0-befd-a6fb261172d3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5e15c10>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:14.007367 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cb49354e-90a3-4fb0-befd-a6fb261172d3 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 200 len: 1449 microversion: 2.1 time: 0.112029 Jul 14 14:34:14.018953 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 962/1919] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:34:13 2022] GET /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 1449 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:14.024262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c15c4580-06f5-4b8d-9c8c-1dfa3f389f43 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:14.035127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c15c4580-06f5-4b8d-9c8c-1dfa3f389f43 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:14.053689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c15c4580-06f5-4b8d-9c8c-1dfa3f389f43 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:14.054414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c15c4580-06f5-4b8d-9c8c-1dfa3f389f43 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:14.056147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c15c4580-06f5-4b8d-9c8c-1dfa3f389f43 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:14.057208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c15c4580-06f5-4b8d-9c8c-1dfa3f389f43 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:14.663698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-43e28c07-a46b-48c5-b4b2-6c8b07d73128 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:14.678207 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-43e28c07-a46b-48c5-b4b2-6c8b07d73128 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1313 microversion: 2.1 time: 1.164124 Jul 14 14:34:14.679650 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 958/1920] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:13 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1313 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:14.687397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3b0289f4-1cd5-4255-9214-dbbe238b7a04 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:14.688734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3b0289f4-1cd5-4255-9214-dbbe238b7a04 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:14.699639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:14.702687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b0289f4-1cd5-4255-9214-dbbe238b7a04 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:14.703664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b0289f4-1cd5-4255-9214-dbbe238b7a04 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:14.706345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b0289f4-1cd5-4255-9214-dbbe238b7a04 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:14.707168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b0289f4-1cd5-4255-9214-dbbe238b7a04 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:15.012665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3b0289f4-1cd5-4255-9214-dbbe238b7a04 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:15.021643 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3b0289f4-1cd5-4255-9214-dbbe238b7a04 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1213 microversion: 2.1 time: 0.339055 Jul 14 14:34:15.022387 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 959/1921] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:14 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1213 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:15.037580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-4ff8134f-8e31-41ba-baf9-58dadd53e21e req-6ee57b2e-614c-4476-92b6-303d625e8cef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311addf3-6349-4923-8f5b-89f80e649e21", "tag": "8c7f6fa5-ec9a-4d3e-ab0f-bb398a38696c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:15.052371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c15c4580-06f5-4b8d-9c8c-1dfa3f389f43 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:15.060372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4ff8134f-8e31-41ba-baf9-58dadd53e21e req-6ee57b2e-614c-4476-92b6-303d625e8cef service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:15.060848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4ff8134f-8e31-41ba-baf9-58dadd53e21e req-6ee57b2e-614c-4476-92b6-303d625e8cef service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:15.066481 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c15c4580-06f5-4b8d-9c8c-1dfa3f389f43 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1574 microversion: 2.1 time: 1.044147 Jul 14 14:34:15.077391 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 963/1922] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:14 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1574 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:15.082523 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-4ff8134f-8e31-41ba-baf9-58dadd53e21e req-6ee57b2e-614c-4476-92b6-303d625e8cef service nova] Creating event network-changed:8c7f6fa5-ec9a-4d3e-ab0f-bb398a38696c for instance 311addf3-6349-4923-8f5b-89f80e649e21 on n-h2-767704-28 Jul 14 14:34:15.092067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a298c74b-4801-48f0-8763-d4b6aa194475 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5f19ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:15.094441 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-4ff8134f-8e31-41ba-baf9-58dadd53e21e req-6ee57b2e-614c-4476-92b6-303d625e8cef service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069988 Jul 14 14:34:15.099647 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 960/1923] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:15.106857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fe529440-e81e-4f10-b22f-2cafacfd6154 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:15.107664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fe529440-e81e-4f10-b22f-2cafacfd6154 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:15.115394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe529440-e81e-4f10-b22f-2cafacfd6154 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:15.116871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe529440-e81e-4f10-b22f-2cafacfd6154 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:15.117728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe529440-e81e-4f10-b22f-2cafacfd6154 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:15.118231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe529440-e81e-4f10-b22f-2cafacfd6154 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:16.153695 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a298c74b-4801-48f0-8763-d4b6aa194475 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 204 len: 0 microversion: 2.1 time: 1.074882 Jul 14 14:34:16.158237 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 964/1924] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:15 2022] DELETE /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:16.164161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7221660c-dc8c-4687-84c1-b14839fb00f6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:16.165389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7221660c-dc8c-4687-84c1-b14839fb00f6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:16.173474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7221660c-dc8c-4687-84c1-b14839fb00f6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:16.174326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7221660c-dc8c-4687-84c1-b14839fb00f6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:16.175767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7221660c-dc8c-4687-84c1-b14839fb00f6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:16.176391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7221660c-dc8c-4687-84c1-b14839fb00f6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:16.546485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fe529440-e81e-4f10-b22f-2cafacfd6154 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:16.558719 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fe529440-e81e-4f10-b22f-2cafacfd6154 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 1.457882 Jul 14 14:34:16.564108 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 961/1925] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:15 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:16.571998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d99094dd-cc81-4ccb-b61a-609c39249866 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:16.573331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d99094dd-cc81-4ccb-b61a-609c39249866 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:16.582828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d99094dd-cc81-4ccb-b61a-609c39249866 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:16.583529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d99094dd-cc81-4ccb-b61a-609c39249866 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:16.584580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d99094dd-cc81-4ccb-b61a-609c39249866 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:16.585374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d99094dd-cc81-4ccb-b61a-609c39249866 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:16.904321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7221660c-dc8c-4687-84c1-b14839fb00f6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:16.918575 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7221660c-dc8c-4687-84c1-b14839fb00f6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1328 microversion: 2.1 time: 0.757980 Jul 14 14:34:16.934174 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 965/1926] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:16 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1328 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:16.934174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2a8e1c8f-5039-4170-ba0d-5afe54035be1 req-41f58459-5529-4424-ab95-2ebf4d8697ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131fc2d4-00c2-462b-b7e2-4fbb53234749", "name": "network-vif-plugged", "status": "completed", "tag": "8f81fa18-1ee0-41c0-a4e5-0c0a8bc1111a"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:16.955117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2a8e1c8f-5039-4170-ba0d-5afe54035be1 req-41f58459-5529-4424-ab95-2ebf4d8697ba service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:16.955585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2a8e1c8f-5039-4170-ba0d-5afe54035be1 req-41f58459-5529-4424-ab95-2ebf4d8697ba service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:16.968385 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2a8e1c8f-5039-4170-ba0d-5afe54035be1 req-41f58459-5529-4424-ab95-2ebf4d8697ba service nova] Creating event network-vif-plugged:8f81fa18-1ee0-41c0-a4e5-0c0a8bc1111a for instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 on n-h2-767704-28 Jul 14 14:34:16.974044 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2a8e1c8f-5039-4170-ba0d-5afe54035be1 req-41f58459-5529-4424-ab95-2ebf4d8697ba service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051462 Jul 14 14:34:16.975085 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 966/1927] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:16.982513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f134cb1b-3b1c-4cde-a247-aef238f20751 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:16.983404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f134cb1b-3b1c-4cde-a247-aef238f20751 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:16.991956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f134cb1b-3b1c-4cde-a247-aef238f20751 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:16.992745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f134cb1b-3b1c-4cde-a247-aef238f20751 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:16.995568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f134cb1b-3b1c-4cde-a247-aef238f20751 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:16.995815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f134cb1b-3b1c-4cde-a247-aef238f20751 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:17.014000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d99094dd-cc81-4ccb-b61a-609c39249866 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:17.025203 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d99094dd-cc81-4ccb-b61a-609c39249866 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1313 microversion: 2.1 time: 0.464066 Jul 14 14:34:17.026108 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 962/1928] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:16 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:17.032343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c6d901c5-c56a-458f-aa5c-8adce79bbba7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:17.034156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c6d901c5-c56a-458f-aa5c-8adce79bbba7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:17.043347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6d901c5-c56a-458f-aa5c-8adce79bbba7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:17.044131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6d901c5-c56a-458f-aa5c-8adce79bbba7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:17.045119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6d901c5-c56a-458f-aa5c-8adce79bbba7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:17.045581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6d901c5-c56a-458f-aa5c-8adce79bbba7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:17.076631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c6d901c5-c56a-458f-aa5c-8adce79bbba7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:17.084094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f134cb1b-3b1c-4cde-a247-aef238f20751 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:17.095572 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f134cb1b-3b1c-4cde-a247-aef238f20751 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1275 microversion: 2.1 time: 0.118322 Jul 14 14:34:17.104147 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 967/1929] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:16 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:17.109471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3c5e5cfc-eac9-433c-9c35-437aa2204b5d req-e2000961-f88e-48c9-a86b-591edf38e4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf4b924-7b9d-46ea-8474-4e525c133b0d", "tag": "701bc8a3-b05e-4e46-a9a6-7d2354021ffa"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:17.120976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3c5e5cfc-eac9-433c-9c35-437aa2204b5d req-e2000961-f88e-48c9-a86b-591edf38e4a2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:17.121421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3c5e5cfc-eac9-433c-9c35-437aa2204b5d req-e2000961-f88e-48c9-a86b-591edf38e4a2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:17.133823 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3c5e5cfc-eac9-433c-9c35-437aa2204b5d req-e2000961-f88e-48c9-a86b-591edf38e4a2 service nova] Creating event network-changed:701bc8a3-b05e-4e46-a9a6-7d2354021ffa for instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d on n-h1-767704-28 Jul 14 14:34:17.139692 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3c5e5cfc-eac9-433c-9c35-437aa2204b5d req-e2000961-f88e-48c9-a86b-591edf38e4a2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034229 Jul 14 14:34:17.140843 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 968/1930] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:34:17.189047 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c6d901c5-c56a-458f-aa5c-8adce79bbba7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 204 len: 0 microversion: 2.1 time: 0.161456 Jul 14 14:34:17.190688 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 963/1931] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:17 2022] DELETE /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:17.309361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1983286366", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "6b253de3-a05b-4108-8629-b3ed951903ff"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:17.379449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] validate_networks() for [('6b253de3-a05b-4108-8629-b3ed951903ff', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:34:17.580038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5371f181-e8d1-4e80-b609-7400d4e8167c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:17.581829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5371f181-e8d1-4e80-b609-7400d4e8167c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:17.584282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:17.591256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5371f181-e8d1-4e80-b609-7400d4e8167c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:17.591849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5371f181-e8d1-4e80-b609-7400d4e8167c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:17.592745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5371f181-e8d1-4e80-b609-7400d4e8167c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:17.593433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5371f181-e8d1-4e80-b609-7400d4e8167c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:17.711462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:18.134637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5371f181-e8d1-4e80-b609-7400d4e8167c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:18.147547 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5371f181-e8d1-4e80-b609-7400d4e8167c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1391 microversion: 2.1 time: 0.573126 Jul 14 14:34:18.149689 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 964/1932] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:17 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1391 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:18.156115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-095f4210-d0b6-4c7d-a8c5-1a35c1b58649 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:18.157141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-095f4210-d0b6-4c7d-a8c5-1a35c1b58649 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:18.167380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-095f4210-d0b6-4c7d-a8c5-1a35c1b58649 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:18.169184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-095f4210-d0b6-4c7d-a8c5-1a35c1b58649 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:18.171694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-095f4210-d0b6-4c7d-a8c5-1a35c1b58649 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:18.172395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-095f4210-d0b6-4c7d-a8c5-1a35c1b58649 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:18.179143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:19.234950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-095f4210-d0b6-4c7d-a8c5-1a35c1b58649 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:19.243992 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-095f4210-d0b6-4c7d-a8c5-1a35c1b58649 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1328 microversion: 2.1 time: 1.092156 Jul 14 14:34:19.244590 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 965/1933] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:18 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1328 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:19.251019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d0206a4-0633-47cf-a937-44428b4b68d1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:19.251714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d0206a4-0633-47cf-a937-44428b4b68d1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:19.258355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d0206a4-0633-47cf-a937-44428b4b68d1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:19.258816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d0206a4-0633-47cf-a937-44428b4b68d1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:19.259625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d0206a4-0633-47cf-a937-44428b4b68d1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:19.260368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d0206a4-0633-47cf-a937-44428b4b68d1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:19.488816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:34:19.490238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:34:19.490968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:34:19.493045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:34:19.493752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:34:19.505576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:19.506427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:19.507364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:19.507904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:19.539953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Getting quotas for project 3755ed287bff4882ac3ead9acadfa731. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:34:19.548037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:19.550634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Getting quotas for user 31ab545bcb3a47b38c53fbfa6b11a432 and project 3755ed287bff4882ac3ead9acadfa731. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:34:19.573966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:34:19.576383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:34:19.634270 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a279067f-a37a-48f6-9a47-6c69a5161112 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.329053 Jul 14 14:34:19.635650 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 969/1934] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:34:19.646889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b81c2747-341a-4805-827a-275f0fae0489 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:19.647517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b81c2747-341a-4805-827a-275f0fae0489 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:19.656059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b81c2747-341a-4805-827a-275f0fae0489 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:19.656516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b81c2747-341a-4805-827a-275f0fae0489 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:19.661603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b81c2747-341a-4805-827a-275f0fae0489 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:19.662275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b81c2747-341a-4805-827a-275f0fae0489 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:19.701432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:19.827829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b81c2747-341a-4805-827a-275f0fae0489 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:19.846789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b81c2747-341a-4805-827a-275f0fae0489 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1275 microversion: 2.1 time: 0.209382 Jul 14 14:34:19.850044 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 970/1935] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:19 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1275 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:19.880919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-d56855ae-3ba4-4d15-bed8-d7ea9000b183 req-3babf1a5-61f1-49d7-aebc-5b649e67aca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdad3a0f-8ff2-44ed-9523-482791b158be", "name": "network-vif-unplugged", "status": "completed", "tag": "f9885081-82f8-4100-b4c6-c3a33d97dc81"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:19.884084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7d0206a4-0633-47cf-a937-44428b4b68d1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:19.891868 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d0206a4-0633-47cf-a937-44428b4b68d1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1313 microversion: 2.1 time: 0.645986 Jul 14 14:34:19.893163 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 966/1936] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:19 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:19.914376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d56855ae-3ba4-4d15-bed8-d7ea9000b183 req-3babf1a5-61f1-49d7-aebc-5b649e67aca1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:19.914961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aeb86239-7177-41cd-a0a3-25432926a486 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:19.920229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aeb86239-7177-41cd-a0a3-25432926a486 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:19.920984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d56855ae-3ba4-4d15-bed8-d7ea9000b183 req-3babf1a5-61f1-49d7-aebc-5b649e67aca1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:19.936645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aeb86239-7177-41cd-a0a3-25432926a486 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:19.937236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aeb86239-7177-41cd-a0a3-25432926a486 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:19.937929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aeb86239-7177-41cd-a0a3-25432926a486 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:19.938376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aeb86239-7177-41cd-a0a3-25432926a486 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:19.976165 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-d56855ae-3ba4-4d15-bed8-d7ea9000b183 req-3babf1a5-61f1-49d7-aebc-5b649e67aca1 service nova] Creating event network-vif-unplugged:f9885081-82f8-4100-b4c6-c3a33d97dc81 for instance cdad3a0f-8ff2-44ed-9523-482791b158be on n-h2-767704-28 Jul 14 14:34:19.983003 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-d56855ae-3ba4-4d15-bed8-d7ea9000b183 req-3babf1a5-61f1-49d7-aebc-5b649e67aca1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116876 Jul 14 14:34:19.984417 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 971/1937] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:19.991769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2d47ad1b-df45-445d-878b-6f55fda282f7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:19.992505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2d47ad1b-df45-445d-878b-6f55fda282f7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:20.311493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2d47ad1b-df45-445d-878b-6f55fda282f7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:20.325870 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2d47ad1b-df45-445d-878b-6f55fda282f7 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1208 microversion: 2.1 time: 0.340157 Jul 14 14:34:20.327022 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 972/1938] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:19 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1208 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:20.333132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-99fe23f1-4702-46ae-bfb7-994a2b3054a5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:20.345902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-99fe23f1-4702-46ae-bfb7-994a2b3054a5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:20.354090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99fe23f1-4702-46ae-bfb7-994a2b3054a5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:20.354547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99fe23f1-4702-46ae-bfb7-994a2b3054a5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:20.355348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99fe23f1-4702-46ae-bfb7-994a2b3054a5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:20.355795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99fe23f1-4702-46ae-bfb7-994a2b3054a5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:20.685273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aeb86239-7177-41cd-a0a3-25432926a486 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:20.696893 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aeb86239-7177-41cd-a0a3-25432926a486 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1381 microversion: 2.1 time: 0.785664 Jul 14 14:34:20.721397 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 967/1939] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:19 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1381 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:20.741903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0dc16871-a780-4168-9c84-5e54687ddcbd tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '.version_select at 0x7fd6c5e72670>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:20.745125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0dc16871-a780-4168-9c84-5e54687ddcbd tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:20.745918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0dc16871-a780-4168-9c84-5e54687ddcbd tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:20.757298 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0dc16871-a780-4168-9c84-5e54687ddcbd tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.034410 Jul 14 14:34:20.762190 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 968/1940] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:34:20 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:20.786347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c30cedf2-487f-4a35-85e2-3370d71a0749 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:20.792803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c30cedf2-487f-4a35-85e2-3370d71a0749 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:20.820669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c30cedf2-487f-4a35-85e2-3370d71a0749 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:20.821163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c30cedf2-487f-4a35-85e2-3370d71a0749 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:20.822173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c30cedf2-487f-4a35-85e2-3370d71a0749 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:20.822803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c30cedf2-487f-4a35-85e2-3370d71a0749 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:21.000680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-99fe23f1-4702-46ae-bfb7-994a2b3054a5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:21.010282 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-99fe23f1-4702-46ae-bfb7-994a2b3054a5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1328 microversion: 2.1 time: 0.682012 Jul 14 14:34:21.014851 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 973/1941] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:20 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1328 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:21.024627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e096177c-1f7f-48b0-bdf3-a208ee96d9d8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:21.026357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e096177c-1f7f-48b0-bdf3-a208ee96d9d8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:21.038365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e096177c-1f7f-48b0-bdf3-a208ee96d9d8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:21.041981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e096177c-1f7f-48b0-bdf3-a208ee96d9d8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:21.050726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e096177c-1f7f-48b0-bdf3-a208ee96d9d8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:21.051722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e096177c-1f7f-48b0-bdf3-a208ee96d9d8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:21.683382 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c30cedf2-487f-4a35-85e2-3370d71a0749 tempest-LiveMigrationTest-1152526832 tempest-LiveMigrationTest-1152526832-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1534 microversion: 2.1 time: 0.908971 Jul 14 14:34:21.685044 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 969/1942] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:20 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1534 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:21.704308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fe19f5b5-c4cc-40f9-8e62-53cac175cc8a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:21.705716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fe19f5b5-c4cc-40f9-8e62-53cac175cc8a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:21.719458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe19f5b5-c4cc-40f9-8e62-53cac175cc8a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:21.721590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe19f5b5-c4cc-40f9-8e62-53cac175cc8a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:21.723481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe19f5b5-c4cc-40f9-8e62-53cac175cc8a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:21.727325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe19f5b5-c4cc-40f9-8e62-53cac175cc8a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:21.829670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e096177c-1f7f-48b0-bdf3-a208ee96d9d8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:21.844037 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e096177c-1f7f-48b0-bdf3-a208ee96d9d8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1317 microversion: 2.1 time: 0.822618 Jul 14 14:34:21.846855 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 974/1943] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:21 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1317 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:21.857025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-57c7c855-3039-4baa-86e9-bce367985dd1 req-39d5a3f5-3d98-444a-92f1-305d0b45bb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdad3a0f-8ff2-44ed-9523-482791b158be", "name": "network-vif-deleted", "tag": "f9885081-82f8-4100-b4c6-c3a33d97dc81"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:21.868109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-57c7c855-3039-4baa-86e9-bce367985dd1 req-39d5a3f5-3d98-444a-92f1-305d0b45bb3d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:21.868557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-57c7c855-3039-4baa-86e9-bce367985dd1 req-39d5a3f5-3d98-444a-92f1-305d0b45bb3d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:21.884912 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-57c7c855-3039-4baa-86e9-bce367985dd1 req-39d5a3f5-3d98-444a-92f1-305d0b45bb3d service nova] Creating event network-vif-deleted:f9885081-82f8-4100-b4c6-c3a33d97dc81 for instance cdad3a0f-8ff2-44ed-9523-482791b158be on n-h2-767704-28 Jul 14 14:34:21.889932 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-57c7c855-3039-4baa-86e9-bce367985dd1 req-39d5a3f5-3d98-444a-92f1-305d0b45bb3d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041489 Jul 14 14:34:21.890565 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 975/1944] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:21.896030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-16419638-af73-4c15-bdf8-6827a3568dba tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:21.896732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-16419638-af73-4c15-bdf8-6827a3568dba tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:21.910557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16419638-af73-4c15-bdf8-6827a3568dba tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:21.911249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16419638-af73-4c15-bdf8-6827a3568dba tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:21.912205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16419638-af73-4c15-bdf8-6827a3568dba tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:21.912824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16419638-af73-4c15-bdf8-6827a3568dba tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:22.161750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-16419638-af73-4c15-bdf8-6827a3568dba tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:22.170485 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-16419638-af73-4c15-bdf8-6827a3568dba tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1266 microversion: 2.1 time: 0.278476 Jul 14 14:34:22.171863 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 976/1945] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:21 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:22.178141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f36c142-f41a-4c23-9b47-7c1f17bdafb3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:22.178970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f36c142-f41a-4c23-9b47-7c1f17bdafb3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:22.193405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f36c142-f41a-4c23-9b47-7c1f17bdafb3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:22.201147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f36c142-f41a-4c23-9b47-7c1f17bdafb3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:22.202309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f36c142-f41a-4c23-9b47-7c1f17bdafb3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:22.203572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f36c142-f41a-4c23-9b47-7c1f17bdafb3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:22.248532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f36c142-f41a-4c23-9b47-7c1f17bdafb3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:22.393176 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f36c142-f41a-4c23-9b47-7c1f17bdafb3 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 204 len: 0 microversion: 2.1 time: 0.218998 Jul 14 14:34:22.396731 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 977/1946] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:22 2022] DELETE /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:22.410542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c3f14cfc-c717-4aef-9873-2e04b8b92f7e req-98565430-94e0-428b-ad7b-ee65f742b3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf4b924-7b9d-46ea-8474-4e525c133b0d", "name": "network-vif-plugged", "status": "completed", "tag": "701bc8a3-b05e-4e46-a9a6-7d2354021ffa"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:22.422852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c3f14cfc-c717-4aef-9873-2e04b8b92f7e req-98565430-94e0-428b-ad7b-ee65f742b3d9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:22.423609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c3f14cfc-c717-4aef-9873-2e04b8b92f7e req-98565430-94e0-428b-ad7b-ee65f742b3d9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:22.442774 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c3f14cfc-c717-4aef-9873-2e04b8b92f7e req-98565430-94e0-428b-ad7b-ee65f742b3d9 service nova] Creating event network-vif-plugged:701bc8a3-b05e-4e46-a9a6-7d2354021ffa for instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d on n-h1-767704-28 Jul 14 14:34:22.451403 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c3f14cfc-c717-4aef-9873-2e04b8b92f7e req-98565430-94e0-428b-ad7b-ee65f742b3d9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054987 Jul 14 14:34:22.452626 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 978/1947] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:22.458193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c40ec23e-4e07-4968-aa0f-261128deafa7 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:22.459160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c40ec23e-4e07-4968-aa0f-261128deafa7 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:22.475335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c40ec23e-4e07-4968-aa0f-261128deafa7 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:22.476328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c40ec23e-4e07-4968-aa0f-261128deafa7 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:22.477103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c40ec23e-4e07-4968-aa0f-261128deafa7 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:22.477546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c40ec23e-4e07-4968-aa0f-261128deafa7 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:22.502961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fe19f5b5-c4cc-40f9-8e62-53cac175cc8a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:22.517888 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fe19f5b5-c4cc-40f9-8e62-53cac175cc8a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1500 microversion: 2.1 time: 0.831502 Jul 14 14:34:22.518497 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 970/1948] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:21 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1500 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:22.533975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5113d2f9-a616-411e-9eaa-e0137d1ed0c5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:22.534160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5113d2f9-a616-411e-9eaa-e0137d1ed0c5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:22.540592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5113d2f9-a616-411e-9eaa-e0137d1ed0c5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:22.541118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5113d2f9-a616-411e-9eaa-e0137d1ed0c5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:22.541913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5113d2f9-a616-411e-9eaa-e0137d1ed0c5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:22.542365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5113d2f9-a616-411e-9eaa-e0137d1ed0c5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.426769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c40ec23e-4e07-4968-aa0f-261128deafa7 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:23.438333 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c40ec23e-4e07-4968-aa0f-261128deafa7 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1328 microversion: 2.1 time: 0.983770 Jul 14 14:34:23.439683 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 979/1949] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:22 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1328 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:23.445667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9a7f079d-dd38-469e-b8f2-325ddaf7bd5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:23.446204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9a7f079d-dd38-469e-b8f2-325ddaf7bd5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:23.449144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5113d2f9-a616-411e-9eaa-e0137d1ed0c5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:23.453327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9a7f079d-dd38-469e-b8f2-325ddaf7bd5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.453775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9a7f079d-dd38-469e-b8f2-325ddaf7bd5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.455044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9a7f079d-dd38-469e-b8f2-325ddaf7bd5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.455767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9a7f079d-dd38-469e-b8f2-325ddaf7bd5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.457726 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5113d2f9-a616-411e-9eaa-e0137d1ed0c5 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1387 microversion: 2.1 time: 0.938200 Jul 14 14:34:23.459776 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 971/1950] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:22 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1387 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:23.466174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-59be82b1-2f5f-4b67-8b7a-c3c7256d5bce tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:23.467047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-59be82b1-2f5f-4b67-8b7a-c3c7256d5bce tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:23.479203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59be82b1-2f5f-4b67-8b7a-c3c7256d5bce tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.480840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59be82b1-2f5f-4b67-8b7a-c3c7256d5bce tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.482466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59be82b1-2f5f-4b67-8b7a-c3c7256d5bce tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.484032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59be82b1-2f5f-4b67-8b7a-c3c7256d5bce tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.492690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-9a7f079d-dd38-469e-b8f2-325ddaf7bd5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lazy-loading 'flavor' on Instance uuid 131fc2d4-00c2-462b-b7e2-4fbb53234749 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:34:23.803139 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9a7f079d-dd38-469e-b8f2-325ddaf7bd5e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "POST /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749/action" status: 202 len: 0 microversion: 2.1 time: 0.361526 Jul 14 14:34:23.804755 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 980/1951] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:34:23 2022] POST /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:34:23.811284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4f06556e-4f0e-44cb-afed-e4cf1fb3538b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:23.813638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4f06556e-4f0e-44cb-afed-e4cf1fb3538b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:23.827814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f06556e-4f0e-44cb-afed-e4cf1fb3538b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.828753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f06556e-4f0e-44cb-afed-e4cf1fb3538b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.830587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f06556e-4f0e-44cb-afed-e4cf1fb3538b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.831274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f06556e-4f0e-44cb-afed-e4cf1fb3538b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.974326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-59be82b1-2f5f-4b67-8b7a-c3c7256d5bce tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:23.996211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4f06556e-4f0e-44cb-afed-e4cf1fb3538b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:24.007181 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4f06556e-4f0e-44cb-afed-e4cf1fb3538b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1266 microversion: 2.1 time: 0.200990 Jul 14 14:34:24.009541 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 981/1952] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:23 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:24.015330 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-59be82b1-2f5f-4b67-8b7a-c3c7256d5bce tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1317 microversion: 2.1 time: 0.543891 Jul 14 14:34:24.016858 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 972/1953] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:23 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:24.022462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fede8f12-6224-43ae-848b-0f994d41aaf1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:24.023253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fede8f12-6224-43ae-848b-0f994d41aaf1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:24.035754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fede8f12-6224-43ae-848b-0f994d41aaf1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:24.036078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fede8f12-6224-43ae-848b-0f994d41aaf1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:24.036885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fede8f12-6224-43ae-848b-0f994d41aaf1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:24.037560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fede8f12-6224-43ae-848b-0f994d41aaf1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:24.456017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-00dbdfa7-686c-4b95-b618-da78f6c1eb0d tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:24.456639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-00dbdfa7-686c-4b95-b618-da78f6c1eb0d tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:24.462917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00dbdfa7-686c-4b95-b618-da78f6c1eb0d tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:24.463439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00dbdfa7-686c-4b95-b618-da78f6c1eb0d tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:24.464434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00dbdfa7-686c-4b95-b618-da78f6c1eb0d tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:24.464874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00dbdfa7-686c-4b95-b618-da78f6c1eb0d tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:24.522445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fede8f12-6224-43ae-848b-0f994d41aaf1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:24.530196 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fede8f12-6224-43ae-848b-0f994d41aaf1 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.521031 Jul 14 14:34:24.540905 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 982/1954] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:24 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:24.543676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4e99648-31d9-4b6c-9c90-5d0705238815 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:24.544304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d4e99648-31d9-4b6c-9c90-5d0705238815 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:24.567569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4e99648-31d9-4b6c-9c90-5d0705238815 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:24.568032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4e99648-31d9-4b6c-9c90-5d0705238815 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:24.570601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4e99648-31d9-4b6c-9c90-5d0705238815 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:24.571058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4e99648-31d9-4b6c-9c90-5d0705238815 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.122772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-00dbdfa7-686c-4b95-b618-da78f6c1eb0d tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:25.141369 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-00dbdfa7-686c-4b95-b618-da78f6c1eb0d tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1328 microversion: 2.1 time: 0.689220 Jul 14 14:34:25.145534 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 973/1955] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:24 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1328 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:25.154076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ab3f6f87-6e87-4370-a025-8467ddf261e5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:25.154980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ab3f6f87-6e87-4370-a025-8467ddf261e5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:25.175319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab3f6f87-6e87-4370-a025-8467ddf261e5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.179537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab3f6f87-6e87-4370-a025-8467ddf261e5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.180906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab3f6f87-6e87-4370-a025-8467ddf261e5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.181976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab3f6f87-6e87-4370-a025-8467ddf261e5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.258895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d4e99648-31d9-4b6c-9c90-5d0705238815 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:25.283818 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d4e99648-31d9-4b6c-9c90-5d0705238815 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1387 microversion: 2.1 time: 0.744252 Jul 14 14:34:25.284535 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 983/1956] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:24 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1387 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:25.292427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eac0ad0a-3154-46e5-be70-2106784ebf17 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:25.293136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eac0ad0a-3154-46e5-be70-2106784ebf17 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:25.305724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eac0ad0a-3154-46e5-be70-2106784ebf17 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.306185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eac0ad0a-3154-46e5-be70-2106784ebf17 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.311008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eac0ad0a-3154-46e5-be70-2106784ebf17 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.311560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eac0ad0a-3154-46e5-be70-2106784ebf17 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.815164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ab3f6f87-6e87-4370-a025-8467ddf261e5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:25.825447 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ab3f6f87-6e87-4370-a025-8467ddf261e5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1308 microversion: 2.1 time: 0.678364 Jul 14 14:34:25.826900 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 974/1957] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:25 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1308 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:25.833510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f47dd5ff-02c1-43c6-8ec7-2a0fe2a6a7b3 req-b93965da-ea0e-42e2-9193-dda4f5aeb722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c103298-2487-41d2-b3b7-abc71539b1b0", "tag": "b7259213-7036-4454-a50f-4a60ff04dba9"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:25.846459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f47dd5ff-02c1-43c6-8ec7-2a0fe2a6a7b3 req-b93965da-ea0e-42e2-9193-dda4f5aeb722 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.847404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f47dd5ff-02c1-43c6-8ec7-2a0fe2a6a7b3 req-b93965da-ea0e-42e2-9193-dda4f5aeb722 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.866127 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f47dd5ff-02c1-43c6-8ec7-2a0fe2a6a7b3 req-b93965da-ea0e-42e2-9193-dda4f5aeb722 service nova] Creating event network-changed:b7259213-7036-4454-a50f-4a60ff04dba9 for instance 1c103298-2487-41d2-b3b7-abc71539b1b0 on n-h1-767704-28 Jul 14 14:34:25.871579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eac0ad0a-3154-46e5-be70-2106784ebf17 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:25.890106 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eac0ad0a-3154-46e5-be70-2106784ebf17 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1317 microversion: 2.1 time: 0.602190 Jul 14 14:34:25.893271 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 984/1958] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:25 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1317 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:25.898279 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f47dd5ff-02c1-43c6-8ec7-2a0fe2a6a7b3 req-b93965da-ea0e-42e2-9193-dda4f5aeb722 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067759 Jul 14 14:34:25.899372 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 975/1959] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:25.902204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-aa59427a-8415-4f17-990e-b6c39876df21 req-8c2e0a80-94a1-4a15-b95e-f1cdb11828bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3", "name": "network-vif-deleted", "tag": "d847f251-9224-4c9f-b335-7f0f58afd9ef"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:25.919199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ab16a6cb-794b-45b4-9f1b-3e86d5ffeab4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:25.921583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ab16a6cb-794b-45b4-9f1b-3e86d5ffeab4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:25.933193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-aa59427a-8415-4f17-990e-b6c39876df21 req-8c2e0a80-94a1-4a15-b95e-f1cdb11828bf service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.936607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-aa59427a-8415-4f17-990e-b6c39876df21 req-8c2e0a80-94a1-4a15-b95e-f1cdb11828bf service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.943401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab16a6cb-794b-45b4-9f1b-3e86d5ffeab4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.944175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab16a6cb-794b-45b4-9f1b-3e86d5ffeab4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.947464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab16a6cb-794b-45b4-9f1b-3e86d5ffeab4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.948277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab16a6cb-794b-45b4-9f1b-3e86d5ffeab4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.963800 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-aa59427a-8415-4f17-990e-b6c39876df21 req-8c2e0a80-94a1-4a15-b95e-f1cdb11828bf service nova] Creating event network-vif-deleted:d847f251-9224-4c9f-b335-7f0f58afd9ef for instance dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 on n-h1-767704-28 Jul 14 14:34:25.982300 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-aa59427a-8415-4f17-990e-b6c39876df21 req-8c2e0a80-94a1-4a15-b95e-f1cdb11828bf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087319 Jul 14 14:34:25.983221 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 985/1960] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:26.165360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e26f93a8-ecfd-48a6-8e92-a293e4d0d371 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:26.166712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e26f93a8-ecfd-48a6-8e92-a293e4d0d371 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:26.179379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e26f93a8-ecfd-48a6-8e92-a293e4d0d371 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.180286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e26f93a8-ecfd-48a6-8e92-a293e4d0d371 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:26.181929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e26f93a8-ecfd-48a6-8e92-a293e4d0d371 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.182713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e26f93a8-ecfd-48a6-8e92-a293e4d0d371 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:26.853368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ab16a6cb-794b-45b4-9f1b-3e86d5ffeab4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:26.861165 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ab16a6cb-794b-45b4-9f1b-3e86d5ffeab4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.957391 Jul 14 14:34:26.861774 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 976/1961] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:25 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:26.877359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-339296e7-1008-4ba3-947e-f3799c4a7da6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:26.878186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-339296e7-1008-4ba3-947e-f3799c4a7da6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:26.889995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-339296e7-1008-4ba3-947e-f3799c4a7da6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.890451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-339296e7-1008-4ba3-947e-f3799c4a7da6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:26.891240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-339296e7-1008-4ba3-947e-f3799c4a7da6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.891682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-339296e7-1008-4ba3-947e-f3799c4a7da6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:26.943485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e26f93a8-ecfd-48a6-8e92-a293e4d0d371 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:26.959202 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e26f93a8-ecfd-48a6-8e92-a293e4d0d371 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1529 microversion: 2.1 time: 0.801741 Jul 14 14:34:26.969362 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 986/1962] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:26 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1529 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:26.979147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4fc4d8a8-10e9-4a4f-9f7a-28960050aac8 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:26.981663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4fc4d8a8-10e9-4a4f-9f7a-28960050aac8 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:26.996731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fc4d8a8-10e9-4a4f-9f7a-28960050aac8 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.997482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fc4d8a8-10e9-4a4f-9f7a-28960050aac8 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:27.003355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fc4d8a8-10e9-4a4f-9f7a-28960050aac8 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:27.004121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fc4d8a8-10e9-4a4f-9f7a-28960050aac8 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:27.021423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:27.114674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-339296e7-1008-4ba3-947e-f3799c4a7da6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:27.131166 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-339296e7-1008-4ba3-947e-f3799c4a7da6 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1183 microversion: 2.1 time: 0.268318 Jul 14 14:34:27.143742 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 977/1963] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:26 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:27.154310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98672e59-25ad-40bb-88fb-1478f8df4241 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:27.154930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-98672e59-25ad-40bb-88fb-1478f8df4241 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:27.172739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98672e59-25ad-40bb-88fb-1478f8df4241 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:27.173301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98672e59-25ad-40bb-88fb-1478f8df4241 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:27.174217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98672e59-25ad-40bb-88fb-1478f8df4241 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:27.174702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98672e59-25ad-40bb-88fb-1478f8df4241 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:27.377999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4fc4d8a8-10e9-4a4f-9f7a-28960050aac8 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:27.390067 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4fc4d8a8-10e9-4a4f-9f7a-28960050aac8 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1308 microversion: 2.1 time: 0.419446 Jul 14 14:34:27.390795 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 987/1964] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:26 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:27.536899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-817398590", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "7c43dfbf-9695-44fa-8557-60f7b955d643"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:27.558329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-98672e59-25ad-40bb-88fb-1478f8df4241 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:27.568550 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98672e59-25ad-40bb-88fb-1478f8df4241 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1317 microversion: 2.1 time: 0.418205 Jul 14 14:34:27.572633 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 978/1965] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:27 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:27.580546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-67f7da86-2ccc-4ca8-92e1-7c58eff356d6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:27.581202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-67f7da86-2ccc-4ca8-92e1-7c58eff356d6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:27.610219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-67f7da86-2ccc-4ca8-92e1-7c58eff356d6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:27.610677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-67f7da86-2ccc-4ca8-92e1-7c58eff356d6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:27.611583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-67f7da86-2ccc-4ca8-92e1-7c58eff356d6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:27.612029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-67f7da86-2ccc-4ca8-92e1-7c58eff356d6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:27.664452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] validate_networks() for [('7c43dfbf-9695-44fa-8557-60f7b955d643', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:34:28.171038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-67f7da86-2ccc-4ca8-92e1-7c58eff356d6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:28.196146 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-67f7da86-2ccc-4ca8-92e1-7c58eff356d6 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1529 microversion: 2.1 time: 0.621038 Jul 14 14:34:28.196794 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 979/1966] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:27 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1529 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:28.214574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-34fcd385-6ffb-48d2-aabf-436ab167fd6d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:28.214857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-34fcd385-6ffb-48d2-aabf-436ab167fd6d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:28.228212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-34fcd385-6ffb-48d2-aabf-436ab167fd6d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:28.230944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-34fcd385-6ffb-48d2-aabf-436ab167fd6d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:28.232559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-34fcd385-6ffb-48d2-aabf-436ab167fd6d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:28.234702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-34fcd385-6ffb-48d2-aabf-436ab167fd6d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.351617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:34:29.352666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:34:29.353460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:34:29.354578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:34:29.355373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:34:29.357764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-34fcd385-6ffb-48d2-aabf-436ab167fd6d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:29.371139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.372196 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-34fcd385-6ffb-48d2-aabf-436ab167fd6d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 1.161805 Jul 14 14:34:29.373273 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 980/1967] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:28 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:29.373999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.375146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.376123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.379296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1290180c-5575-41d7-baf9-a091288ee530 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:29.382076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1290180c-5575-41d7-baf9-a091288ee530 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:29.399520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1290180c-5575-41d7-baf9-a091288ee530 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.399929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1290180c-5575-41d7-baf9-a091288ee530 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.400823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1290180c-5575-41d7-baf9-a091288ee530 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.401533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1290180c-5575-41d7-baf9-a091288ee530 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.455925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Getting quotas for project ad9c7d3620e34c95bb8a772e532fc660. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:34:29.496237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Getting quotas for user 935bde481e9c41a1951bcdab5af71211 and project ad9c7d3620e34c95bb8a772e532fc660. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:34:29.532112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:34:29.537975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:34:29.595864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1290180c-5575-41d7-baf9-a091288ee530 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:29.608225 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1290180c-5575-41d7-baf9-a091288ee530 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1183 microversion: 2.1 time: 0.233751 Jul 14 14:34:29.612773 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 981/1968] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:29 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:29.691392 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-833ab5ce-81c4-466b-b1f1-3e43aed7e94a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.298519 Jul 14 14:34:29.697222 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 988/1969] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:34:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:34:29.706083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-01677a1c-b4c3-4bca-9d2a-cb402a3c0fea tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:29.706521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-01677a1c-b4c3-4bca-9d2a-cb402a3c0fea tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:29.743362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01677a1c-b4c3-4bca-9d2a-cb402a3c0fea tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.743823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01677a1c-b4c3-4bca-9d2a-cb402a3c0fea tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.745086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01677a1c-b4c3-4bca-9d2a-cb402a3c0fea tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.750448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-30d0f1e0-235d-4b06-bdd6-76305825be3f tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:29.751188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-30d0f1e0-235d-4b06-bdd6-76305825be3f tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:29.756045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01677a1c-b4c3-4bca-9d2a-cb402a3c0fea tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.759828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30d0f1e0-235d-4b06-bdd6-76305825be3f tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.760481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30d0f1e0-235d-4b06-bdd6-76305825be3f tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.762377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30d0f1e0-235d-4b06-bdd6-76305825be3f tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.764640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30d0f1e0-235d-4b06-bdd6-76305825be3f tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.783252 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-30d0f1e0-235d-4b06-bdd6-76305825be3f tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] HTTP exception thrown: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-30d0f1e0-235d-4b06-bdd6-76305825be3f tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Request method failure captured: Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d HTTP/1.1 Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0ClbkV-VD9Uh8f_pyHbuyWKlfCXGPGPOIBqgbdRIFpZ9ipWeTf0NQOEnV29p0tYmBjg9FXOagEnFQEMCunQ4cB5gFDqIBkn_3hjiYHbpuEUROI-GDCtB4V-J7xH3l6duyJb06WxKwkuxbdewFlkKlAF70JVyxJaLGBQj5Di50JVB9bs Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1a8a00d93fc5431ebdffd85cb41e906e Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1549256730 Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8a00d93fc5431ebdffd85cb41e906e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1a8a00d93fc5431ebdffd85cb41e906e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1a8a00d93fc5431ebdffd85cb41e906e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8a00d93fc5431ebdffd85cb41e906e"}]}] Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1549256730 Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1a8a00d93fc5431ebdffd85cb41e906e Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1549256730 Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1549256730-project Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: a457ccb337ea4c56af9671cd900cbc8c Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1549256730-project Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '2bf4b924-7b9d-46ea-8474-4e525c133b0d'} Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:29.785569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:29.791753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:29.791753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:29.791753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:29.791753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:29.791753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:29.791753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:29.791753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:29.791753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:29.791753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:29.791753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:29.791753 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:29.793824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-30d0f1e0-235d-4b06-bdd6-76305825be3f tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Returning 404 to user: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:29.794874 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-30d0f1e0-235d-4b06-bdd6-76305825be3f tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 404 len: 111 microversion: 2.1 time: 0.179507 Jul 14 14:34:29.795622 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 982/1970] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:29 2022] DELETE /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:29.805807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-dbb3b024-3115-45a8-aad4-c8fe50f16d1d req-3faf3a97-87a5-4a3a-9598-7a0edd235f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df45cbe-095e-4ee6-84e9-281a0a16bf0c", "tag": "7e15b7ab-8d72-45fb-b41d-7042219db600"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:29.826377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-dbb3b024-3115-45a8-aad4-c8fe50f16d1d req-3faf3a97-87a5-4a3a-9598-7a0edd235f8c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.827089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-dbb3b024-3115-45a8-aad4-c8fe50f16d1d req-3faf3a97-87a5-4a3a-9598-7a0edd235f8c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.858476 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-dbb3b024-3115-45a8-aad4-c8fe50f16d1d req-3faf3a97-87a5-4a3a-9598-7a0edd235f8c service nova] Creating event network-changed:7e15b7ab-8d72-45fb-b41d-7042219db600 for instance 9df45cbe-095e-4ee6-84e9-281a0a16bf0c on n-h1-767704-28 Jul 14 14:34:29.878449 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-dbb3b024-3115-45a8-aad4-c8fe50f16d1d req-3faf3a97-87a5-4a3a-9598-7a0edd235f8c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076387 Jul 14 14:34:29.879370 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 983/1971] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:29.904425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-73b4c002-422e-4d11-af74-20cdaba7d30c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:29.905493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-73b4c002-422e-4d11-af74-20cdaba7d30c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:29.925173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73b4c002-422e-4d11-af74-20cdaba7d30c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.926137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73b4c002-422e-4d11-af74-20cdaba7d30c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.927544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73b4c002-422e-4d11-af74-20cdaba7d30c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.928157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73b4c002-422e-4d11-af74-20cdaba7d30c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.973838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:30.836687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-01677a1c-b4c3-4bca-9d2a-cb402a3c0fea tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:30.856456 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-01677a1c-b4c3-4bca-9d2a-cb402a3c0fea tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1308 microversion: 2.1 time: 1.163010 Jul 14 14:34:30.874672 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 989/1972] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:29 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1308 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:30.898040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-131d945b-8c6b-4cdb-89e5-7d8369fcae18 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:30.898688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-131d945b-8c6b-4cdb-89e5-7d8369fcae18 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:30.908870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-73b4c002-422e-4d11-af74-20cdaba7d30c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:30.917719 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-73b4c002-422e-4d11-af74-20cdaba7d30c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1317 microversion: 2.1 time: 1.036897 Jul 14 14:34:30.920064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-131d945b-8c6b-4cdb-89e5-7d8369fcae18 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:30.920535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-131d945b-8c6b-4cdb-89e5-7d8369fcae18 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:30.921385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-131d945b-8c6b-4cdb-89e5-7d8369fcae18 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:30.921832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-131d945b-8c6b-4cdb-89e5-7d8369fcae18 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:30.922441 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 984/1973] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:29 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1317 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:30.976018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8aa484fc-952d-472f-bbba-4d3bea5ebfc0 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:30.976660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8aa484fc-952d-472f-bbba-4d3bea5ebfc0 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:30.996353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8aa484fc-952d-472f-bbba-4d3bea5ebfc0 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:30.996723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8aa484fc-952d-472f-bbba-4d3bea5ebfc0 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:30.997575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8aa484fc-952d-472f-bbba-4d3bea5ebfc0 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:30.998478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8aa484fc-952d-472f-bbba-4d3bea5ebfc0 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.050191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-131d945b-8c6b-4cdb-89e5-7d8369fcae18 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:31.066029 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-131d945b-8c6b-4cdb-89e5-7d8369fcae18 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1220 microversion: 2.1 time: 0.189868 Jul 14 14:34:31.066642 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 990/1974] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:30 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1220 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:31.090426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-21cb29bc-15f6-4996-9664-95bdd8458797 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:31.097263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-21cb29bc-15f6-4996-9664-95bdd8458797 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:31.112683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21cb29bc-15f6-4996-9664-95bdd8458797 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.113388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21cb29bc-15f6-4996-9664-95bdd8458797 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.114981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21cb29bc-15f6-4996-9664-95bdd8458797 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.115905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21cb29bc-15f6-4996-9664-95bdd8458797 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.352517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8aa484fc-952d-472f-bbba-4d3bea5ebfc0 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:31.361466 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8aa484fc-952d-472f-bbba-4d3bea5ebfc0 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1529 microversion: 2.1 time: 0.437811 Jul 14 14:34:31.373576 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 985/1975] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:30 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1529 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:31.381012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2c488e13-0962-4b04-89d3-576736af3c66 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:31.381833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2c488e13-0962-4b04-89d3-576736af3c66 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:31.389216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c488e13-0962-4b04-89d3-576736af3c66 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.390039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c488e13-0962-4b04-89d3-576736af3c66 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.391149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c488e13-0962-4b04-89d3-576736af3c66 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.391882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c488e13-0962-4b04-89d3-576736af3c66 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.397457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-21cb29bc-15f6-4996-9664-95bdd8458797 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:31.407052 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-21cb29bc-15f6-4996-9664-95bdd8458797 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.328410 Jul 14 14:34:31.411733 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 991/1976] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:31 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:31.417096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2202f2a9-3a9e-48e0-bba9-7201e0083227 tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Action: 'update', calling method: >, body: {"server": {"name": "2bf4b924-7b9d-46ea-8474-4e525c133b0d_new"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:31.422506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2202f2a9-3a9e-48e0-bba9-7201e0083227 tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:31.429189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2202f2a9-3a9e-48e0-bba9-7201e0083227 tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.432022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2202f2a9-3a9e-48e0-bba9-7201e0083227 tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.433064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2202f2a9-3a9e-48e0-bba9-7201e0083227 tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.433649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2202f2a9-3a9e-48e0-bba9-7201e0083227 tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.478104 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-2202f2a9-3a9e-48e0-bba9-7201e0083227 tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] HTTP exception thrown: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2202f2a9-3a9e-48e0-bba9-7201e0083227 tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Request method failure captured: Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: request: PUT /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d HTTP/1.1 Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 64 Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0ClbkV-VD9Uh8f_pyHbuyWKlfCXGPGPOIBqgbdRIFpZ9ipWeTf0NQOEnV29p0tYmBjg9FXOagEnFQEMCunQ4cB5gFDqIBkn_3hjiYHbpuEUROI-GDCtB4V-J7xH3l6duyJb06WxKwkuxbdewFlkKlAF70JVyxJaLGBQj5Di50JVB9bs Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 1a8a00d93fc5431ebdffd85cb41e906e Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1549256730 Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8a00d93fc5431ebdffd85cb41e906e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1a8a00d93fc5431ebdffd85cb41e906e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1a8a00d93fc5431ebdffd85cb41e906e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1a8a00d93fc5431ebdffd85cb41e906e"}]}] Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1549256730 Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 1a8a00d93fc5431ebdffd85cb41e906e Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1549256730 Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1549256730-project Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: a457ccb337ea4c56af9671cd900cbc8c Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1549256730-project Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "2bf4b924-7b9d-46ea-8474-4e525c133b0d_new"}} Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '2bf4b924-7b9d-46ea-8474-4e525c133b0d', 'body': {'server': {'name': '2bf4b924-7b9d-46ea-8474-4e525c133b0d_new'}}} Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 14 14:34:31.479894 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 917, in update Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:31.482874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2202f2a9-3a9e-48e0-bba9-7201e0083227 tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] Returning 404 to user: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:31.486790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2c488e13-0962-4b04-89d3-576736af3c66 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:31.493565 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2202f2a9-3a9e-48e0-bba9-7201e0083227 tempest-ServersNegativeTestMultiTenantJSON-1549256730 tempest-ServersNegativeTestMultiTenantJSON-1549256730-project] 10.222.0.81 "PUT /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 404 len: 111 microversion: 2.1 time: 0.068224 Jul 14 14:34:31.499096 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 992/1977] 10.222.0.81 () {60 vars in 1255 bytes} [Thu Jul 14 14:34:31 2022] PUT /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:31.505052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d213763d-4475-46e1-9f40-7017e9c526ea tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:31.505489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d213763d-4475-46e1-9f40-7017e9c526ea tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:31.511951 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2c488e13-0962-4b04-89d3-576736af3c66 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1183 microversion: 2.1 time: 0.135947 Jul 14 14:34:31.514067 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 986/1978] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:31 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:31.524537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d213763d-4475-46e1-9f40-7017e9c526ea tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.525001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d213763d-4475-46e1-9f40-7017e9c526ea tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.541774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d213763d-4475-46e1-9f40-7017e9c526ea tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.545579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d213763d-4475-46e1-9f40-7017e9c526ea tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.630102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d213763d-4475-46e1-9f40-7017e9c526ea tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:31.809546 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d213763d-4475-46e1-9f40-7017e9c526ea tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 204 len: 0 microversion: 2.1 time: 0.307986 Jul 14 14:34:31.810368 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 993/1979] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:31 2022] DELETE /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:34:31.819651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-190b7dbc-1f01-4d79-b908-c37865c64815 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:31.820292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-190b7dbc-1f01-4d79-b908-c37865c64815 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:31.834101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-190b7dbc-1f01-4d79-b908-c37865c64815 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.835413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-190b7dbc-1f01-4d79-b908-c37865c64815 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.836379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-190b7dbc-1f01-4d79-b908-c37865c64815 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.837012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-190b7dbc-1f01-4d79-b908-c37865c64815 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.877594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-97c21146-8f7e-4778-a8ed-ebc92b8e5a08 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:31.878394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-97c21146-8f7e-4778-a8ed-ebc92b8e5a08 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:31.890874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97c21146-8f7e-4778-a8ed-ebc92b8e5a08 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.891336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97c21146-8f7e-4778-a8ed-ebc92b8e5a08 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.892261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97c21146-8f7e-4778-a8ed-ebc92b8e5a08 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.903719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97c21146-8f7e-4778-a8ed-ebc92b8e5a08 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.417303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-190b7dbc-1f01-4d79-b908-c37865c64815 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:32.432584 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-190b7dbc-1f01-4d79-b908-c37865c64815 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1535 microversion: 2.1 time: 0.617213 Jul 14 14:34:32.435433 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 987/1980] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:31 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1535 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:32.437143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-97c21146-8f7e-4778-a8ed-ebc92b8e5a08 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:32.445993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-afc64002-9070-49df-a5b6-486bc65cfc9d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:32.449986 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-97c21146-8f7e-4778-a8ed-ebc92b8e5a08 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1308 microversion: 2.1 time: 0.576693 Jul 14 14:34:32.450745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-afc64002-9070-49df-a5b6-486bc65cfc9d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:32.454023 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 994/1981] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:31 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1308 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:32.465858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-afc64002-9070-49df-a5b6-486bc65cfc9d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.466400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-afc64002-9070-49df-a5b6-486bc65cfc9d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.468439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-afc64002-9070-49df-a5b6-486bc65cfc9d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.468551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d7d1e142-1038-4b25-aefe-df01d18f39ca tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:32.469399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d7d1e142-1038-4b25-aefe-df01d18f39ca tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:32.477900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-afc64002-9070-49df-a5b6-486bc65cfc9d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.485133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d7d1e142-1038-4b25-aefe-df01d18f39ca tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.486911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d7d1e142-1038-4b25-aefe-df01d18f39ca tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.488063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d7d1e142-1038-4b25-aefe-df01d18f39ca tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.490184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d7d1e142-1038-4b25-aefe-df01d18f39ca tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.612014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d7d1e142-1038-4b25-aefe-df01d18f39ca tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:32.628590 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d7d1e142-1038-4b25-aefe-df01d18f39ca tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1282 microversion: 2.1 time: 0.163691 Jul 14 14:34:32.629670 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 995/1982] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:32 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:32.644032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1adc94d5-0395-46e4-9c63-cd667a32d423 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:32.645084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1adc94d5-0395-46e4-9c63-cd667a32d423 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:32.659133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1adc94d5-0395-46e4-9c63-cd667a32d423 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.662526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1adc94d5-0395-46e4-9c63-cd667a32d423 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.664457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1adc94d5-0395-46e4-9c63-cd667a32d423 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.665742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1adc94d5-0395-46e4-9c63-cd667a32d423 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.915517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-afc64002-9070-49df-a5b6-486bc65cfc9d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:32.928614 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-afc64002-9070-49df-a5b6-486bc65cfc9d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1317 microversion: 2.1 time: 0.490373 Jul 14 14:34:32.929470 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 988/1983] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:32 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:32.963137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-37e71d02-ac85-462f-9335-9ed24f2876ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:32.963699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-37e71d02-ac85-462f-9335-9ed24f2876ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:32.983498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1adc94d5-0395-46e4-9c63-cd667a32d423 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:32.991385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37e71d02-ac85-462f-9335-9ed24f2876ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.992346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37e71d02-ac85-462f-9335-9ed24f2876ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.993433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37e71d02-ac85-462f-9335-9ed24f2876ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.994047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37e71d02-ac85-462f-9335-9ed24f2876ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.998313 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1adc94d5-0395-46e4-9c63-cd667a32d423 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.366769 Jul 14 14:34:32.999656 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 996/1984] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:32 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:33.077703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-37e71d02-ac85-462f-9335-9ed24f2876ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:33.087880 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-37e71d02-ac85-462f-9335-9ed24f2876ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 200 len: 1183 microversion: 2.1 time: 0.155920 Jul 14 14:34:33.093022 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 989/1985] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:32 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 1183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:33.455454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-396ac2ed-e607-4176-b3f3-ee6f64ac84fb tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:33.456931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-396ac2ed-e607-4176-b3f3-ee6f64ac84fb tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:33.466928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-396ac2ed-e607-4176-b3f3-ee6f64ac84fb tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:33.468217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-396ac2ed-e607-4176-b3f3-ee6f64ac84fb tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:33.470535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7fcd58c2-6ba5-4da5-92b2-756de29626e2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:33.471928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7fcd58c2-6ba5-4da5-92b2-756de29626e2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:33.476762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-396ac2ed-e607-4176-b3f3-ee6f64ac84fb tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:33.479459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-396ac2ed-e607-4176-b3f3-ee6f64ac84fb tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:33.502974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fcd58c2-6ba5-4da5-92b2-756de29626e2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:33.503802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fcd58c2-6ba5-4da5-92b2-756de29626e2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:33.504918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fcd58c2-6ba5-4da5-92b2-756de29626e2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:33.505607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fcd58c2-6ba5-4da5-92b2-756de29626e2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:34.088931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7fcd58c2-6ba5-4da5-92b2-756de29626e2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:34.103725 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7fcd58c2-6ba5-4da5-92b2-756de29626e2 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1308 microversion: 2.1 time: 0.637297 Jul 14 14:34:34.119911 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 990/1986] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:33 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1308 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:34.139430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-73a68ff6-edcc-4708-af8c-e11fc66e463e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:34.140120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-73a68ff6-edcc-4708-af8c-e11fc66e463e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:34.159268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-396ac2ed-e607-4176-b3f3-ee6f64ac84fb tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:34.164696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73a68ff6-edcc-4708-af8c-e11fc66e463e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:34.165194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73a68ff6-edcc-4708-af8c-e11fc66e463e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:34.169635 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-396ac2ed-e607-4176-b3f3-ee6f64ac84fb tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1535 microversion: 2.1 time: 0.720739 Jul 14 14:34:34.174438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73a68ff6-edcc-4708-af8c-e11fc66e463e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:34.175317 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 997/1987] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:33 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1535 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:34.183560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73a68ff6-edcc-4708-af8c-e11fc66e463e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:34.189169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-100b94fd-12d5-432e-b4cf-e17d7b9691d4 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:34.189809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-100b94fd-12d5-432e-b4cf-e17d7b9691d4 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:34.241956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-100b94fd-12d5-432e-b4cf-e17d7b9691d4 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:34.242848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-100b94fd-12d5-432e-b4cf-e17d7b9691d4 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:34.243994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-100b94fd-12d5-432e-b4cf-e17d7b9691d4 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:34.244489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-100b94fd-12d5-432e-b4cf-e17d7b9691d4 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.091040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-73a68ff6-edcc-4708-af8c-e11fc66e463e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:35.101712 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-73a68ff6-edcc-4708-af8c-e11fc66e463e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1324 microversion: 2.1 time: 0.980392 Jul 14 14:34:35.102690 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 991/1988] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:34 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1324 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:35.107959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ad116559-7d89-4263-9d0c-8c35face4652 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:35.108913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ad116559-7d89-4263-9d0c-8c35face4652 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:35.118484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad116559-7d89-4263-9d0c-8c35face4652 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.119242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad116559-7d89-4263-9d0c-8c35face4652 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.120152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad116559-7d89-4263-9d0c-8c35face4652 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.120644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad116559-7d89-4263-9d0c-8c35face4652 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.163919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-100b94fd-12d5-432e-b4cf-e17d7b9691d4 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:35.174583 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-100b94fd-12d5-432e-b4cf-e17d7b9691d4 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1317 microversion: 2.1 time: 0.997994 Jul 14 14:34:35.175889 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 998/1989] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:34 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1317 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:35.189371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a0038ad-88de-4b2c-9a79-01939dddb3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:35.190080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3a0038ad-88de-4b2c-9a79-01939dddb3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:35.204020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a0038ad-88de-4b2c-9a79-01939dddb3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.205291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a0038ad-88de-4b2c-9a79-01939dddb3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.206539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a0038ad-88de-4b2c-9a79-01939dddb3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.207234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a0038ad-88de-4b2c-9a79-01939dddb3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.239405 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3a0038ad-88de-4b2c-9a79-01939dddb3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] HTTP exception thrown: Instance dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 could not be found. Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a0038ad-88de-4b2c-9a79-01939dddb3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Request method failure captured: Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 HTTP/1.1 Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cenn4HU6XkCSY8qKqNCtkj6EvAzCRdwvC06iSpmLiVyhSUWxuIzZIPEQEdKeZRDKKUXKEFspjEEHlcgyLRfCgc_reNU80sIs6r5NSJmX_obgK7APw5HK0H7_IHDyQzRVnvg5ehEmnYCMqjX13d3c7t459-Ewe3WClvGjcx4jm3o-Po Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: eb57648abd7742d9aac69af1744d6bc1 Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-LiveMigrationTest-1854408993 Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/eb57648abd7742d9aac69af1744d6bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/eb57648abd7742d9aac69af1744d6bc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_eb57648abd7742d9aac69af1744d6bc1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/eb57648abd7742d9aac69af1744d6bc1"}]}] Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-LiveMigrationTest-1854408993 Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: eb57648abd7742d9aac69af1744d6bc1 Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-LiveMigrationTest-1854408993 Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-LiveMigrationTest-1854408993-project Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 5c688cde0ea44a059b0bca3e020c28b3 Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-LiveMigrationTest-1854408993-project Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 could not be found. Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3'} Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 could not be found. Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 could not be found. Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:35.242635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:35.245973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:35.245973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:35.245973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:35.245973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:35.245973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:35.245973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 could not be found. Jul 14 14:34:35.245973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:35.245973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a0038ad-88de-4b2c-9a79-01939dddb3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Returning 404 to user: Instance dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:35.245973 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3a0038ad-88de-4b2c-9a79-01939dddb3ad tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3" status: 404 len: 111 microversion: 2.1 time: 0.065614 Jul 14 14:34:35.253197 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 999/1990] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:35 2022] GET /compute/v2.1/servers/dfd0b52e-c3d2-46e7-94b2-0e89ec1410a3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:35.260154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-fe1b3056-6646-4955-9b63-5df2b7be5e46 req-a06f314a-e017-4391-8f24-69c2f705d7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c103298-2487-41d2-b3b7-abc71539b1b0", "name": "network-vif-plugged", "status": "completed", "tag": "b7259213-7036-4454-a50f-4a60ff04dba9"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:35.273297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-fe1b3056-6646-4955-9b63-5df2b7be5e46 req-a06f314a-e017-4391-8f24-69c2f705d7f2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.274266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-fe1b3056-6646-4955-9b63-5df2b7be5e46 req-a06f314a-e017-4391-8f24-69c2f705d7f2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.290134 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-fe1b3056-6646-4955-9b63-5df2b7be5e46 req-a06f314a-e017-4391-8f24-69c2f705d7f2 service nova] Creating event network-vif-plugged:b7259213-7036-4454-a50f-4a60ff04dba9 for instance 1c103298-2487-41d2-b3b7-abc71539b1b0 on n-h1-767704-28 Jul 14 14:34:35.296913 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-fe1b3056-6646-4955-9b63-5df2b7be5e46 req-a06f314a-e017-4391-8f24-69c2f705d7f2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041608 Jul 14 14:34:35.302574 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1000/1991] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:35.309119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2d49f658-3f52-446f-b0f9-35fa5da8517e req-14e3ef00-4bb6-4dd1-9af8-60d5a5bf2183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c", "tag": "45612758-25eb-4c42-9ab2-3ee6cdf455bc"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:35.323582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:35.338372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2d49f658-3f52-446f-b0f9-35fa5da8517e req-14e3ef00-4bb6-4dd1-9af8-60d5a5bf2183 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.344660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2d49f658-3f52-446f-b0f9-35fa5da8517e req-14e3ef00-4bb6-4dd1-9af8-60d5a5bf2183 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.383553 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2d49f658-3f52-446f-b0f9-35fa5da8517e req-14e3ef00-4bb6-4dd1-9af8-60d5a5bf2183 service nova] Creating event network-changed:45612758-25eb-4c42-9ab2-3ee6cdf455bc for instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c on n-h2-767704-28 Jul 14 14:34:35.390779 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2d49f658-3f52-446f-b0f9-35fa5da8517e req-14e3ef00-4bb6-4dd1-9af8-60d5a5bf2183 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086202 Jul 14 14:34:35.392144 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1001/1992] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:35.601220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c5461cbb-1cb6-4963-9e02-b3108c377011 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c5e60af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:35.610212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ad116559-7d89-4263-9d0c-8c35face4652 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:35.620549 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ad116559-7d89-4263-9d0c-8c35face4652 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.516608 Jul 14 14:34:35.621723 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 992/1993] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:35 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:35.634053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3bc64dfc-ffd0-4d61-aabe-611fc75be209 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:35.635380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3bc64dfc-ffd0-4d61-aabe-611fc75be209 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:35.647074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bc64dfc-ffd0-4d61-aabe-611fc75be209 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.647810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bc64dfc-ffd0-4d61-aabe-611fc75be209 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.649305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bc64dfc-ffd0-4d61-aabe-611fc75be209 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.649941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bc64dfc-ffd0-4d61-aabe-611fc75be209 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.689208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5461cbb-1cb6-4963-9e02-b3108c377011 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.690169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5461cbb-1cb6-4963-9e02-b3108c377011 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.691592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5461cbb-1cb6-4963-9e02-b3108c377011 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.692455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5461cbb-1cb6-4963-9e02-b3108c377011 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.775702 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c5461cbb-1cb6-4963-9e02-b3108c377011 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/56c07bed66654dca95360c0608d25f8f" status: 200 len: 240 microversion: 2.36 time: 0.381687 Jul 14 14:34:35.777075 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1002/1994] 10.222.0.81 () {62 vars in 1302 bytes} [Thu Jul 14 14:34:35 2022] PUT /compute/v2.1/os-quota-sets/56c07bed66654dca95360c0608d25f8f => generated 240 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:34:35.798212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8710fd28-b7fc-48a1-a9a6-bfdfd4ed190e tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:35.803123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8710fd28-b7fc-48a1-a9a6-bfdfd4ed190e tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:35.828570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8710fd28-b7fc-48a1-a9a6-bfdfd4ed190e tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.830190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8710fd28-b7fc-48a1-a9a6-bfdfd4ed190e tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.831034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8710fd28-b7fc-48a1-a9a6-bfdfd4ed190e tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.831486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8710fd28-b7fc-48a1-a9a6-bfdfd4ed190e tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.978833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8710fd28-b7fc-48a1-a9a6-bfdfd4ed190e tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:35.991124 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8710fd28-b7fc-48a1-a9a6-bfdfd4ed190e tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1493 microversion: 2.1 time: 0.212538 Jul 14 14:34:35.998274 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1003/1995] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:35 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1493 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:36.006051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3bc64dfc-ffd0-4d61-aabe-611fc75be209 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:36.010273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-838fc453-f409-4b55-8a30-d77bb55ac6b3 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Calling method '.version_select at 0x7fd6c57a1430>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:36.016406 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3bc64dfc-ffd0-4d61-aabe-611fc75be209 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1308 microversion: 2.1 time: 0.393392 Jul 14 14:34:36.039912 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 993/1996] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:35 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1308 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:36.119737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c1928ebb-9231-46dd-94d5-bfcf75ded457 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:36.121867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c1928ebb-9231-46dd-94d5-bfcf75ded457 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:36.125928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-838fc453-f409-4b55-8a30-d77bb55ac6b3 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.126940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-838fc453-f409-4b55-8a30-d77bb55ac6b3 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.130315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-838fc453-f409-4b55-8a30-d77bb55ac6b3 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.130827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-838fc453-f409-4b55-8a30-d77bb55ac6b3 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.134604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1928ebb-9231-46dd-94d5-bfcf75ded457 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.135364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1928ebb-9231-46dd-94d5-bfcf75ded457 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.136313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1928ebb-9231-46dd-94d5-bfcf75ded457 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.138115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1928ebb-9231-46dd-94d5-bfcf75ded457 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.215827 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-838fc453-f409-4b55-8a30-d77bb55ac6b3 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/56c07bed66654dca95360c0608d25f8f/detail" status: 200 len: 672 microversion: 2.36 time: 0.215767 Jul 14 14:34:36.216457 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1004/1997] 10.222.0.81 () {60 vars in 1303 bytes} [Thu Jul 14 14:34:35 2022] GET /compute/v2.1/os-quota-sets/56c07bed66654dca95360c0608d25f8f/detail => generated 672 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:34:36.231402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e1051f7c-70e5-42e2-adba-ff01579b6096 req-d1eb5fda-c600-4e9f-8d1a-0d41bbc13c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf4b924-7b9d-46ea-8474-4e525c133b0d", "name": "network-vif-deleted", "tag": "701bc8a3-b05e-4e46-a9a6-7d2354021ffa"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:36.253898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e1051f7c-70e5-42e2-adba-ff01579b6096 req-d1eb5fda-c600-4e9f-8d1a-0d41bbc13c5e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.265319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e1051f7c-70e5-42e2-adba-ff01579b6096 req-d1eb5fda-c600-4e9f-8d1a-0d41bbc13c5e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.284777 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e1051f7c-70e5-42e2-adba-ff01579b6096 req-d1eb5fda-c600-4e9f-8d1a-0d41bbc13c5e service nova] Creating event network-vif-deleted:701bc8a3-b05e-4e46-a9a6-7d2354021ffa for instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d on n-h1-767704-28 Jul 14 14:34:36.294184 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e1051f7c-70e5-42e2-adba-ff01579b6096 req-d1eb5fda-c600-4e9f-8d1a-0d41bbc13c5e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068045 Jul 14 14:34:36.295545 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1005/1998] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:36.313102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-69852a8a-6b97-4775-8f26-b5de46f1ee28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:36.316307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-69852a8a-6b97-4775-8f26-b5de46f1ee28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:36.331466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69852a8a-6b97-4775-8f26-b5de46f1ee28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.332240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69852a8a-6b97-4775-8f26-b5de46f1ee28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.333540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69852a8a-6b97-4775-8f26-b5de46f1ee28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.334276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69852a8a-6b97-4775-8f26-b5de46f1ee28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.476282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c1928ebb-9231-46dd-94d5-bfcf75ded457 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:36.487451 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c1928ebb-9231-46dd-94d5-bfcf75ded457 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1324 microversion: 2.1 time: 0.372334 Jul 14 14:34:36.488042 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 994/1999] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:36 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1324 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:36.602393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fd4f1f84-b161-431f-b086-f3c27ae6045c tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c567eee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:36.645934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-69852a8a-6b97-4775-8f26-b5de46f1ee28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:36.662483 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-69852a8a-6b97-4775-8f26-b5de46f1ee28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1317 microversion: 2.1 time: 0.365167 Jul 14 14:34:36.663410 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1006/2000] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:36 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:36.668569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-575d7fd1-29a3-4601-b262-4c95c1495252 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:36.669214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-575d7fd1-29a3-4601-b262-4c95c1495252 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:36.686140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-575d7fd1-29a3-4601-b262-4c95c1495252 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.686607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-575d7fd1-29a3-4601-b262-4c95c1495252 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.687397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-575d7fd1-29a3-4601-b262-4c95c1495252 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.687851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-575d7fd1-29a3-4601-b262-4c95c1495252 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.718516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd4f1f84-b161-431f-b086-f3c27ae6045c tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.722038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd4f1f84-b161-431f-b086-f3c27ae6045c tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.725441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:36.727052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd4f1f84-b161-431f-b086-f3c27ae6045c tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.727757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd4f1f84-b161-431f-b086-f3c27ae6045c tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.797459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd4f1f84-b161-431f-b086-f3c27ae6045c tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.798618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd4f1f84-b161-431f-b086-f3c27ae6045c tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.799755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd4f1f84-b161-431f-b086-f3c27ae6045c tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.800410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd4f1f84-b161-431f-b086-f3c27ae6045c tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.884006 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fd4f1f84-b161-431f-b086-f3c27ae6045c tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/56c07bed66654dca95360c0608d25f8f?user_id=5136134fea624b1384b2efb5ed788085" status: 200 len: 240 microversion: 2.36 time: 0.285711 Jul 14 14:34:36.885038 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 995/2001] 10.222.0.81 () {62 vars in 1383 bytes} [Thu Jul 14 14:34:36 2022] PUT /compute/v2.1/os-quota-sets/56c07bed66654dca95360c0608d25f8f?user_id=5136134fea624b1384b2efb5ed788085 => generated 240 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:34:36.896076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eaedd3df-380f-41fc-9f08-423734dadda7 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] Calling method '.version_select at 0x7fd6c53a4670>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:37.036601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:37.055334 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eaedd3df-380f-41fc-9f08-423734dadda7 tempest-QuotasAdminTestV236-741903196 tempest-QuotasAdminTestV236-741903196-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/56c07bed66654dca95360c0608d25f8f?user_id=5136134fea624b1384b2efb5ed788085" status: 200 len: 282 microversion: 2.36 time: 0.163695 Jul 14 14:34:37.056608 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 996/2002] 10.222.0.81 () {60 vars in 1363 bytes} [Thu Jul 14 14:34:36 2022] GET /compute/v2.1/os-quota-sets/56c07bed66654dca95360c0608d25f8f?user_id=5136134fea624b1384b2efb5ed788085 => generated 282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:34:37.069248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-575d7fd1-29a3-4601-b262-4c95c1495252 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:37.075372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a6ba3226-5cf9-4d5e-b049-10e7c20fb5b9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:37.080076 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-575d7fd1-29a3-4601-b262-4c95c1495252 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.414550 Jul 14 14:34:37.081153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a6ba3226-5cf9-4d5e-b049-10e7c20fb5b9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:37.082192 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1007/2003] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:36 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:37.088249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e16f99cc-b2d9-41ce-a805-68a4742489af tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:37.089050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6ba3226-5cf9-4d5e-b049-10e7c20fb5b9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.089307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e16f99cc-b2d9-41ce-a805-68a4742489af tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:37.089696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6ba3226-5cf9-4d5e-b049-10e7c20fb5b9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.098388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6ba3226-5cf9-4d5e-b049-10e7c20fb5b9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.098954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6ba3226-5cf9-4d5e-b049-10e7c20fb5b9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.099705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e16f99cc-b2d9-41ce-a805-68a4742489af tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.100364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e16f99cc-b2d9-41ce-a805-68a4742489af tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.102653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e16f99cc-b2d9-41ce-a805-68a4742489af tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.103294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e16f99cc-b2d9-41ce-a805-68a4742489af tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.168957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6ba3226-5cf9-4d5e-b049-10e7c20fb5b9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.169482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6ba3226-5cf9-4d5e-b049-10e7c20fb5b9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.169894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-a6ba3226-5cf9-4d5e-b049-10e7c20fb5b9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lazy-loading 'fault' on Instance uuid 2bf4b924-7b9d-46ea-8474-4e525c133b0d {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:34:37.263298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a6ba3226-5cf9-4d5e-b049-10e7c20fb5b9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76419eaed7b49c0adffd3300cdb55ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a84509190c46db86a63fd33bd984a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:37.282472 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a6ba3226-5cf9-4d5e-b049-10e7c20fb5b9 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 200 len: 1318 microversion: 2.1 time: 0.224399 Jul 14 14:34:37.284504 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 997/2004] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:37 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:37.397585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e16f99cc-b2d9-41ce-a805-68a4742489af tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:37.407285 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e16f99cc-b2d9-41ce-a805-68a4742489af tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1308 microversion: 2.1 time: 0.323884 Jul 14 14:34:37.419003 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1008/2005] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:37 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1308 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:37.508343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a4119358-7121-4704-a911-0f5173008548 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:37.510116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a4119358-7121-4704-a911-0f5173008548 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:37.533866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4119358-7121-4704-a911-0f5173008548 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.534845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4119358-7121-4704-a911-0f5173008548 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.535916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4119358-7121-4704-a911-0f5173008548 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.543583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4119358-7121-4704-a911-0f5173008548 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.680071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6caa5526-28e5-4e6c-b409-1e67aa8a99ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:37.681048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6caa5526-28e5-4e6c-b409-1e67aa8a99ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:37.696502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6caa5526-28e5-4e6c-b409-1e67aa8a99ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.699509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6caa5526-28e5-4e6c-b409-1e67aa8a99ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.703773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6caa5526-28e5-4e6c-b409-1e67aa8a99ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.705802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6caa5526-28e5-4e6c-b409-1e67aa8a99ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.821762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a4119358-7121-4704-a911-0f5173008548 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:37.860142 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a4119358-7121-4704-a911-0f5173008548 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1324 microversion: 2.1 time: 0.355039 Jul 14 14:34:37.867798 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 998/2006] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:37 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:38.029767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6caa5526-28e5-4e6c-b409-1e67aa8a99ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:38.045429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6caa5526-28e5-4e6c-b409-1e67aa8a99ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1466 microversion: 2.1 time: 0.369433 Jul 14 14:34:38.059293 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1009/2007] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:37 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1466 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:38.066549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fb870e69-200f-441e-96aa-95c651b56159 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:38.067597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fb870e69-200f-441e-96aa-95c651b56159 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:38.072138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-8f0cb8a9-c46e-4fcb-8450-3e984fb569b0 req-848f5793-2fca-4fc1-8a6d-9b479a770523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df45cbe-095e-4ee6-84e9-281a0a16bf0c", "name": "network-vif-plugged", "status": "completed", "tag": "7e15b7ab-8d72-45fb-b41d-7042219db600"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:38.075509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb870e69-200f-441e-96aa-95c651b56159 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.076634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb870e69-200f-441e-96aa-95c651b56159 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.077656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb870e69-200f-441e-96aa-95c651b56159 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.078415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb870e69-200f-441e-96aa-95c651b56159 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.107815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8f0cb8a9-c46e-4fcb-8450-3e984fb569b0 req-848f5793-2fca-4fc1-8a6d-9b479a770523 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.108559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8f0cb8a9-c46e-4fcb-8450-3e984fb569b0 req-848f5793-2fca-4fc1-8a6d-9b479a770523 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.183586 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8f0cb8a9-c46e-4fcb-8450-3e984fb569b0 req-848f5793-2fca-4fc1-8a6d-9b479a770523 service nova] Creating event network-vif-plugged:7e15b7ab-8d72-45fb-b41d-7042219db600 for instance 9df45cbe-095e-4ee6-84e9-281a0a16bf0c on n-h1-767704-28 Jul 14 14:34:38.206589 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-8f0cb8a9-c46e-4fcb-8450-3e984fb569b0 req-848f5793-2fca-4fc1-8a6d-9b479a770523 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160969 Jul 14 14:34:38.208368 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 999/2008] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:38.229123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-16612d1a-23c1-4e3d-9a8e-1dac7bcb4d76 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:38.235351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-16612d1a-23c1-4e3d-9a8e-1dac7bcb4d76 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:38.258467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16612d1a-23c1-4e3d-9a8e-1dac7bcb4d76 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.259522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16612d1a-23c1-4e3d-9a8e-1dac7bcb4d76 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.260501 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fb870e69-200f-441e-96aa-95c651b56159 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1619 microversion: 2.1 time: 0.199831 Jul 14 14:34:38.261349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16612d1a-23c1-4e3d-9a8e-1dac7bcb4d76 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.261613 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1010/2009] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:38 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1619 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:38.271899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16612d1a-23c1-4e3d-9a8e-1dac7bcb4d76 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.309591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ffd74eb6-a2c7-40e2-862c-c3eb7fbfdbe5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:38.312249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ffd74eb6-a2c7-40e2-862c-c3eb7fbfdbe5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] [instance: 2bf4b924-7b9d-46ea-8474-4e525c133b0d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:38.332426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ffd74eb6-a2c7-40e2-862c-c3eb7fbfdbe5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.333428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ffd74eb6-a2c7-40e2-862c-c3eb7fbfdbe5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.334652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ffd74eb6-a2c7-40e2-862c-c3eb7fbfdbe5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.335485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ffd74eb6-a2c7-40e2-862c-c3eb7fbfdbe5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.356299 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-ffd74eb6-a2c7-40e2-862c-c3eb7fbfdbe5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] HTTP exception thrown: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ffd74eb6-a2c7-40e2-862c-c3eb7fbfdbe5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Request method failure captured: Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d HTTP/1.1 Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0ClDfE4iMG1BMiVryntGxOFJM7H6jBtUrZIy2wLxeHVp2NaltWGm3XkxQwX3UDxLsfRuyHyDpT3zQrjjJZAihoClcGhRH2PRPqgOOw70rOAkWN-CV59A67EVUwAJ5V3TGAvrWK72_yqwpSjrg7DwQNvZTK0CwNKRcPjDQT98d7nsRr8 Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 59a84509190c46db86a63fd33bd984a9 Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-234597451 Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59a84509190c46db86a63fd33bd984a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/59a84509190c46db86a63fd33bd984a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_59a84509190c46db86a63fd33bd984a9", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/59a84509190c46db86a63fd33bd984a9"}]}] Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-234597451 Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 59a84509190c46db86a63fd33bd984a9 Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-234597451 Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestMultiTenantJSON-234597451-project Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: c76419eaed7b49c0adffd3300cdb55ed Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-234597451-project Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '2bf4b924-7b9d-46ea-8474-4e525c133b0d'} Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:38.358484 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:38.365707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:38.365707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:38.365707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:38.365707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:38.365707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:38.365707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:38.365707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. Jul 14 14:34:38.365707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:38.365707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ffd74eb6-a2c7-40e2-862c-c3eb7fbfdbe5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] Returning 404 to user: Instance 2bf4b924-7b9d-46ea-8474-4e525c133b0d could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:38.365707 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ffd74eb6-a2c7-40e2-862c-c3eb7fbfdbe5 tempest-ServersNegativeTestMultiTenantJSON-234597451 tempest-ServersNegativeTestMultiTenantJSON-234597451-project] 10.222.0.81 "GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d" status: 404 len: 111 microversion: 2.1 time: 0.067242 Jul 14 14:34:38.367635 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1011/2010] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:38 2022] GET /compute/v2.1/servers/2bf4b924-7b9d-46ea-8474-4e525c133b0d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:38.427048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-012bb5d0-2ff1-4053-9b83-0d0babecd079 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:38.427882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-012bb5d0-2ff1-4053-9b83-0d0babecd079 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:38.439519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-012bb5d0-2ff1-4053-9b83-0d0babecd079 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.440777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-012bb5d0-2ff1-4053-9b83-0d0babecd079 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.445519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-012bb5d0-2ff1-4053-9b83-0d0babecd079 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.446579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-012bb5d0-2ff1-4053-9b83-0d0babecd079 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.825243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-16612d1a-23c1-4e3d-9a8e-1dac7bcb4d76 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:38.834030 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-16612d1a-23c1-4e3d-9a8e-1dac7bcb4d76 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.623599 Jul 14 14:34:38.849127 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1000/2011] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:38 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:38.857650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-012bb5d0-2ff1-4053-9b83-0d0babecd079 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:38.862434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1154026560", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ea89554c-b395-4813-8c65-81afc2ae89ec"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:38.869382 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-012bb5d0-2ff1-4053-9b83-0d0babecd079 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1308 microversion: 2.1 time: 0.447190 Jul 14 14:34:38.870302 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1012/2012] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:38 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:38.889716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1328f807-bbf9-4a28-9cd1-a4838f6d399a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:38.890348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1328f807-bbf9-4a28-9cd1-a4838f6d399a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:38.905196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1328f807-bbf9-4a28-9cd1-a4838f6d399a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.905660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1328f807-bbf9-4a28-9cd1-a4838f6d399a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.906461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1328f807-bbf9-4a28-9cd1-a4838f6d399a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.906904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1328f807-bbf9-4a28-9cd1-a4838f6d399a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.989464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:34:39.304713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1328f807-bbf9-4a28-9cd1-a4838f6d399a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:39.313050 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1328f807-bbf9-4a28-9cd1-a4838f6d399a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1324 microversion: 2.1 time: 0.427185 Jul 14 14:34:39.316311 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1013/2013] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:38 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1324 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:39.443267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:34:39.444629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:34:39.445331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:34:39.445968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:34:39.446719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:34:39.462213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:39.463016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:39.464029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:39.464700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:39.492991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:34:39.500252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Getting quotas for user f7852b6d7fb246ee980a61aa2be4f065 and project 57545ddd8fb2414f8c03c1c44d2bb47f. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:34:39.517263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:34:39.521019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:34:39.590584 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fa927f4c-4a00-4234-8372-4e18728ad24c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739823 Jul 14 14:34:39.593654 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1001/2014] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:34:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:34:39.607439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-12de27d6-005d-4a76-a658-cdc69d74d046 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:39.607993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-12de27d6-005d-4a76-a658-cdc69d74d046 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:39.698420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-12de27d6-005d-4a76-a658-cdc69d74d046 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:39.707128 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-12de27d6-005d-4a76-a658-cdc69d74d046 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1217 microversion: 2.1 time: 0.104059 Jul 14 14:34:39.731117 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1014/2015] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:39 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:39.854111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-703734a8-216d-498f-8c8f-f63f68c0d3ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:39.855302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-703734a8-216d-498f-8c8f-f63f68c0d3ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:39.871922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-703734a8-216d-498f-8c8f-f63f68c0d3ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:39.873760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-703734a8-216d-498f-8c8f-f63f68c0d3ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:39.876636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-703734a8-216d-498f-8c8f-f63f68c0d3ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:39.877447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-703734a8-216d-498f-8c8f-f63f68c0d3ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:39.888476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aaf9f724-2db4-4799-a55a-a5d97e19157d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:39.889322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aaf9f724-2db4-4799-a55a-a5d97e19157d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:39.911329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aaf9f724-2db4-4799-a55a-a5d97e19157d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:39.913371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aaf9f724-2db4-4799-a55a-a5d97e19157d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:39.917303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aaf9f724-2db4-4799-a55a-a5d97e19157d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:39.918261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aaf9f724-2db4-4799-a55a-a5d97e19157d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:40.383109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-703734a8-216d-498f-8c8f-f63f68c0d3ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:40.402228 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-703734a8-216d-498f-8c8f-f63f68c0d3ec tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.554525 Jul 14 14:34:40.419571 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1002/2016] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:39 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:40.426674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-71b07dcf-6b83-4e17-911c-37b21d9b66c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:40.430575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-71b07dcf-6b83-4e17-911c-37b21d9b66c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:40.444637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71b07dcf-6b83-4e17-911c-37b21d9b66c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:40.447880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71b07dcf-6b83-4e17-911c-37b21d9b66c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:40.450084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71b07dcf-6b83-4e17-911c-37b21d9b66c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:40.454153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-aaf9f724-2db4-4799-a55a-a5d97e19157d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:40.465399 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aaf9f724-2db4-4799-a55a-a5d97e19157d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1308 microversion: 2.1 time: 0.581730 Jul 14 14:34:40.477023 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1015/2017] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:39 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1308 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:40.477217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71b07dcf-6b83-4e17-911c-37b21d9b66c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:40.493815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:40.726989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b1795eb4-9e32-4d86-93a6-54bf280181f3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:40.727587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b1795eb4-9e32-4d86-93a6-54bf280181f3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:40.740330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1795eb4-9e32-4d86-93a6-54bf280181f3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:40.740785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1795eb4-9e32-4d86-93a6-54bf280181f3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:40.753513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1795eb4-9e32-4d86-93a6-54bf280181f3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:40.760197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1795eb4-9e32-4d86-93a6-54bf280181f3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:40.941971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-71b07dcf-6b83-4e17-911c-37b21d9b66c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:40.952095 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-71b07dcf-6b83-4e17-911c-37b21d9b66c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1324 microversion: 2.1 time: 0.531045 Jul 14 14:34:40.952958 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1003/2018] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:40 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1324 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:40.962673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b1795eb4-9e32-4d86-93a6-54bf280181f3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:40.973484 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b1795eb4-9e32-4d86-93a6-54bf280181f3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1213 microversion: 2.1 time: 0.249348 Jul 14 14:34:40.974095 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1016/2019] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:40 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1213 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:40.981993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aa9c2fe0-2149-4886-974a-2ec004c634fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:40.984132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aa9c2fe0-2149-4886-974a-2ec004c634fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:40.997798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa9c2fe0-2149-4886-974a-2ec004c634fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:40.998597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa9c2fe0-2149-4886-974a-2ec004c634fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:40.999592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa9c2fe0-2149-4886-974a-2ec004c634fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.000216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa9c2fe0-2149-4886-974a-2ec004c634fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.032225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aa9c2fe0-2149-4886-974a-2ec004c634fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:41.135439 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aa9c2fe0-2149-4886-974a-2ec004c634fb tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 204 len: 0 microversion: 2.1 time: 0.156955 Jul 14 14:34:41.136033 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1004/2020] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:40 2022] DELETE /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:41.144616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bf25c4c3-1fe0-4c81-8e19-801d7a4771ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:41.145520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bf25c4c3-1fe0-4c81-8e19-801d7a4771ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:41.158991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf25c4c3-1fe0-4c81-8e19-801d7a4771ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.159742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf25c4c3-1fe0-4c81-8e19-801d7a4771ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.161056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf25c4c3-1fe0-4c81-8e19-801d7a4771ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.161553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf25c4c3-1fe0-4c81-8e19-801d7a4771ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.371749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bf25c4c3-1fe0-4c81-8e19-801d7a4771ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:41.382825 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bf25c4c3-1fe0-4c81-8e19-801d7a4771ea tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1668 microversion: 2.1 time: 0.242507 Jul 14 14:34:41.385146 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1017/2021] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:41 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1668 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:41.426186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5fad1531-b912-43c4-80af-c3833e1879e2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:41.427022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5fad1531-b912-43c4-80af-c3833e1879e2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:41.437450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fad1531-b912-43c4-80af-c3833e1879e2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.442384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fad1531-b912-43c4-80af-c3833e1879e2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.445062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fad1531-b912-43c4-80af-c3833e1879e2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.445604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fad1531-b912-43c4-80af-c3833e1879e2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.484155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ca5037ae-91c8-49e1-b1ae-e64f10e2b353 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:41.485015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ca5037ae-91c8-49e1-b1ae-e64f10e2b353 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:41.498469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ca5037ae-91c8-49e1-b1ae-e64f10e2b353 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.500586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ca5037ae-91c8-49e1-b1ae-e64f10e2b353 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.502549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ca5037ae-91c8-49e1-b1ae-e64f10e2b353 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.506122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ca5037ae-91c8-49e1-b1ae-e64f10e2b353 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.796360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5fad1531-b912-43c4-80af-c3833e1879e2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:41.805991 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5fad1531-b912-43c4-80af-c3833e1879e2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.385697 Jul 14 14:34:41.809960 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1005/2022] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:41 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:41.893735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ca5037ae-91c8-49e1-b1ae-e64f10e2b353 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:41.908886 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ca5037ae-91c8-49e1-b1ae-e64f10e2b353 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1487 microversion: 2.1 time: 0.428848 Jul 14 14:34:41.909530 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1018/2023] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:41 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1487 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:41.928563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-678f3c4d-daf2-4351-b84e-88241abff8b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-405255552"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:41.931084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-678f3c4d-daf2-4351-b84e-88241abff8b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:41.938348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-678f3c4d-daf2-4351-b84e-88241abff8b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.939676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-678f3c4d-daf2-4351-b84e-88241abff8b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.940603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-678f3c4d-daf2-4351-b84e-88241abff8b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.941113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-678f3c4d-daf2-4351-b84e-88241abff8b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.972787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-28afd457-b7f7-4e2d-a26c-280930cab61c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:41.973581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-28afd457-b7f7-4e2d-a26c-280930cab61c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:41.982977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28afd457-b7f7-4e2d-a26c-280930cab61c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.984242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28afd457-b7f7-4e2d-a26c-280930cab61c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.990032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28afd457-b7f7-4e2d-a26c-280930cab61c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.990629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28afd457-b7f7-4e2d-a26c-280930cab61c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.317244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-28afd457-b7f7-4e2d-a26c-280930cab61c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:42.326779 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-28afd457-b7f7-4e2d-a26c-280930cab61c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1324 microversion: 2.1 time: 0.358178 Jul 14 14:34:42.327379 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1019/2024] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:41 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1324 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:42.343374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc4ceea6-abfb-4809-9a1f-9d6b0cc851ae tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:42.345974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cc4ceea6-abfb-4809-9a1f-9d6b0cc851ae tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:42.363073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc4ceea6-abfb-4809-9a1f-9d6b0cc851ae tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.363725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc4ceea6-abfb-4809-9a1f-9d6b0cc851ae tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.364645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc4ceea6-abfb-4809-9a1f-9d6b0cc851ae tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.365201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc4ceea6-abfb-4809-9a1f-9d6b0cc851ae tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.510560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cc4ceea6-abfb-4809-9a1f-9d6b0cc851ae tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:42.528995 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc4ceea6-abfb-4809-9a1f-9d6b0cc851ae tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1275 microversion: 2.1 time: 0.195632 Jul 14 14:34:42.529951 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-678f3c4d-daf2-4351-b84e-88241abff8b5 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "POST /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c/action" status: 202 len: 0 microversion: 2.1 time: 0.606597 Jul 14 14:34:42.530389 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1020/2025] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:42 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:42.535683 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1006/2026] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:34:41 2022] POST /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:34:42.542111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0ee2b2f8-8939-4a17-8aae-55cfdeeeeed9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:42.542822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0ee2b2f8-8939-4a17-8aae-55cfdeeeeed9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:42.544685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-67af75d0-746e-408b-aa4c-e6d5bb760ae7 req-938f4627-9ed5-4fd7-a68e-988cc3423a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c", "name": "network-vif-plugged", "status": "completed", "tag": "45612758-25eb-4c42-9ab2-3ee6cdf455bc"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:42.552463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ee2b2f8-8939-4a17-8aae-55cfdeeeeed9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.552917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ee2b2f8-8939-4a17-8aae-55cfdeeeeed9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.553735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ee2b2f8-8939-4a17-8aae-55cfdeeeeed9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.554275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ee2b2f8-8939-4a17-8aae-55cfdeeeeed9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.564746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-67af75d0-746e-408b-aa4c-e6d5bb760ae7 req-938f4627-9ed5-4fd7-a68e-988cc3423a24 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.569570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-67af75d0-746e-408b-aa4c-e6d5bb760ae7 req-938f4627-9ed5-4fd7-a68e-988cc3423a24 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.602622 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-67af75d0-746e-408b-aa4c-e6d5bb760ae7 req-938f4627-9ed5-4fd7-a68e-988cc3423a24 service nova] Creating event network-vif-plugged:45612758-25eb-4c42-9ab2-3ee6cdf455bc for instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c on n-h2-767704-28 Jul 14 14:34:42.618090 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-67af75d0-746e-408b-aa4c-e6d5bb760ae7 req-938f4627-9ed5-4fd7-a68e-988cc3423a24 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084631 Jul 14 14:34:42.619963 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1021/2027] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:42.644277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a3f5d2fe-502d-445a-9169-d242c77e1203 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c57343a0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:42.706610 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a3f5d2fe-502d-445a-9169-d242c77e1203 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/464dd7a8-9a98-477b-82f2-6ec7015e775d" status: 200 len: 1413 microversion: 2.1 time: 0.085385 Jul 14 14:34:42.708497 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1022/2028] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:34:42 2022] GET /compute/v2.1/images/464dd7a8-9a98-477b-82f2-6ec7015e775d => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:42.720099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8466c33e-53ea-420b-a976-729ac310cc29 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5f673a0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:42.809950 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8466c33e-53ea-420b-a976-729ac310cc29 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/464dd7a8-9a98-477b-82f2-6ec7015e775d" status: 200 len: 1413 microversion: 2.1 time: 0.092199 Jul 14 14:34:42.812238 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1023/2029] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:34:42 2022] GET /compute/v2.1/images/464dd7a8-9a98-477b-82f2-6ec7015e775d => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:42.828870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e3246312-2e1f-47d2-81d3-a148f49e61d2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:42.833547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0ee2b2f8-8939-4a17-8aae-55cfdeeeeed9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:42.834469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e3246312-2e1f-47d2-81d3-a148f49e61d2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:42.848430 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0ee2b2f8-8939-4a17-8aae-55cfdeeeeed9 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1668 microversion: 2.1 time: 0.310985 Jul 14 14:34:42.858961 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1007/2030] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:42 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1668 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:42.861729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3246312-2e1f-47d2-81d3-a148f49e61d2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.863546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3246312-2e1f-47d2-81d3-a148f49e61d2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.866025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b117b84-d5af-4d0b-9c70-6fc76567c7cb tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c53a4310>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:42.866814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3246312-2e1f-47d2-81d3-a148f49e61d2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.868531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3246312-2e1f-47d2-81d3-a148f49e61d2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.073770 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8b117b84-d5af-4d0b-9c70-6fc76567c7cb tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/images/464dd7a8-9a98-477b-82f2-6ec7015e775d" status: 204 len: 0 microversion: 2.1 time: 0.214416 Jul 14 14:34:43.074361 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1008/2031] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:42 2022] DELETE /compute/v2.1/images/464dd7a8-9a98-477b-82f2-6ec7015e775d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:43.083467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5f6127fe-5cb8-4ea6-9c50-97b0c896dd7e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c535a670>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.108974 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-5f6127fe-5cb8-4ea6-9c50-97b0c896dd7e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] HTTP exception thrown: Image not found. Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5f6127fe-5cb8-4ea6-9c50-97b0c896dd7e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Request method failure captured: Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/images/464dd7a8-9a98-477b-82f2-6ec7015e775d HTTP/1.1 Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch2LdshHkgnfLKQ09Th5yFEtJ6NDMhU3YAv5gfwMPVRyjuGs5ounfti5Desm3i53FZSU8EucGNP4Rzy0S71lUdQcdXKedt82m6kz-LwLm_uJeWZZr8mFflHZ4u7MMkkfwx71zlLEQcauCAP4aVIdWxl0MQgHe5i5BrB1GsD5uwHXUA Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3755ed287bff4882ac3ead9acadfa731", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}] Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 31ab545bcb3a47b38c53fbfa6b11a432 Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '464dd7a8-9a98-477b-82f2-6ec7015e775d'} Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 464dd7a8-9a98-477b-82f2-6ec7015e775d Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:34:43.111308 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 464dd7a8-9a98-477b-82f2-6ec7015e775d could not be found. Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.114536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5f6127fe-5cb8-4ea6-9c50-97b0c896dd7e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:43.120544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e3246312-2e1f-47d2-81d3-a148f49e61d2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:43.121140 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5f6127fe-5cb8-4ea6-9c50-97b0c896dd7e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/images/464dd7a8-9a98-477b-82f2-6ec7015e775d" status: 404 len: 62 microversion: 2.1 time: 0.034248 Jul 14 14:34:43.121140 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1009/2032] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/images/464dd7a8-9a98-477b-82f2-6ec7015e775d => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:34:43.122045 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e3246312-2e1f-47d2-81d3-a148f49e61d2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.299438 Jul 14 14:34:43.132097 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1024/2033] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:42 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:43.132256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7b875b91-dab4-4c43-a20a-2af01f69362d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.132256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7b875b91-dab4-4c43-a20a-2af01f69362d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:43.137118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b875b91-dab4-4c43-a20a-2af01f69362d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.137578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b875b91-dab4-4c43-a20a-2af01f69362d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.138371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b875b91-dab4-4c43-a20a-2af01f69362d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.138817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b875b91-dab4-4c43-a20a-2af01f69362d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.292867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7b875b91-dab4-4c43-a20a-2af01f69362d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:43.301957 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7b875b91-dab4-4c43-a20a-2af01f69362d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1499 microversion: 2.1 time: 0.180875 Jul 14 14:34:43.302777 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1010/2034] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1499 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:43.346232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a5c4386f-cc9f-4584-bf5b-bf57ca5def04 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.347255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a5c4386f-cc9f-4584-bf5b-bf57ca5def04 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:43.355546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5c4386f-cc9f-4584-bf5b-bf57ca5def04 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.356195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5c4386f-cc9f-4584-bf5b-bf57ca5def04 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.357016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5c4386f-cc9f-4584-bf5b-bf57ca5def04 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.357468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5c4386f-cc9f-4584-bf5b-bf57ca5def04 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.533433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a5c4386f-cc9f-4584-bf5b-bf57ca5def04 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:43.546705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b1141e38-0c90-4c49-ab99-2fb2e5236abd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.549676 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a5c4386f-cc9f-4584-bf5b-bf57ca5def04 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1324 microversion: 2.1 time: 0.206955 Jul 14 14:34:43.550282 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1025/2035] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1324 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:43.558348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b1141e38-0c90-4c49-ab99-2fb2e5236abd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:43.581944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1141e38-0c90-4c49-ab99-2fb2e5236abd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.583648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1141e38-0c90-4c49-ab99-2fb2e5236abd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.584472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1141e38-0c90-4c49-ab99-2fb2e5236abd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.584920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1141e38-0c90-4c49-ab99-2fb2e5236abd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.665200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b1141e38-0c90-4c49-ab99-2fb2e5236abd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:43.676227 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b1141e38-0c90-4c49-ab99-2fb2e5236abd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1275 microversion: 2.1 time: 0.134402 Jul 14 14:34:43.677249 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1011/2036] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1275 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:43.720480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-53755242-715f-4ed7-a78e-77e2ca12234c tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c5e60af0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:43.722325 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:43.722325 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:34:43.723503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-53755242-715f-4ed7-a78e-77e2ca12234c tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.723959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-53755242-715f-4ed7-a78e-77e2ca12234c tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.726423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=11 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:43.733168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-53755242-715f-4ed7-a78e-77e2ca12234c tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.733629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-53755242-715f-4ed7-a78e-77e2ca12234c tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.740813 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-53755242-715f-4ed7-a78e-77e2ca12234c tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] HTTP exception thrown: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-53755242-715f-4ed7-a78e-77e2ca12234c tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Request method failure captured: Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: request: PUT /compute/v2.1/os-services/2e651315-a1fa-460e-b149-3bce16b13486 HTTP/1.1 Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 56 Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CmD9ns4dpuy5BGf66Pl1ItfE7o4lS6gxxgahAzOdk8k3RoR7_17wSkO0IqBUtuVO_2rFDY2KPJOQeKJScEbTeQUB3S9jcykwB2jtsNSIoGNZLQmGVrmdC1Gh3eM-K23TSanE8jNjKGi9D90hqTUIyC8retXwbbC0IyA-6mvEya7hQY Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.53 Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a8420f86398542309cf330cc775a0482 Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-472002732 Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a8420f86398542309cf330cc775a0482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a8420f86398542309cf330cc775a0482"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a8420f86398542309cf330cc775a0482", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a8420f86398542309cf330cc775a0482"}]}] Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-472002732 Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a8420f86398542309cf330cc775a0482 Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-472002732 Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 56787b9e24cf405ebcf12d58ece4a318 Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: exception: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '2e651315-a1fa-460e-b149-3bce16b13486', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:34:43.742550 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-53755242-715f-4ed7-a78e-77e2ca12234c tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Returning 404 to user: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-53755242-715f-4ed7-a78e-77e2ca12234c tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-services/2e651315-a1fa-460e-b149-3bce16b13486" status: 404 len: 110 microversion: 2.53 time: 0.181802 Jul 14 14:34:43.745942 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1026/2037] 10.222.0.81 () {62 vars in 1308 bytes} [Thu Jul 14 14:34:43 2022] PUT /compute/v2.1/os-services/2e651315-a1fa-460e-b149-3bce16b13486 => generated 110 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:34:43.754706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-58450173-16fc-47ec-af34-027470371d45 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c535ab80>, body: {"status": "disabled"} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:43.756111 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:43.756111 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:34:43.757291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58450173-16fc-47ec-af34-027470371d45 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.757928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58450173-16fc-47ec-af34-027470371d45 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.765721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58450173-16fc-47ec-af34-027470371d45 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.766180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58450173-16fc-47ec-af34-027470371d45 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.773045 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-58450173-16fc-47ec-af34-027470371d45 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] HTTP exception thrown: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-58450173-16fc-47ec-af34-027470371d45 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Request method failure captured: Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: request: PUT /compute/v2.1/os-services/2e651315-a1fa-460e-b149-3bce16b13486 HTTP/1.1 Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 22 Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CmD9ns4dpuy5BGf66Pl1ItfE7o4lS6gxxgahAzOdk8k3RoR7_17wSkO0IqBUtuVO_2rFDY2KPJOQeKJScEbTeQUB3S9jcykwB2jtsNSIoGNZLQmGVrmdC1Gh3eM-K23TSanE8jNjKGi9D90hqTUIyC8retXwbbC0IyA-6mvEya7hQY Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.53 Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a8420f86398542309cf330cc775a0482 Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-472002732 Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a8420f86398542309cf330cc775a0482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a8420f86398542309cf330cc775a0482"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a8420f86398542309cf330cc775a0482", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a8420f86398542309cf330cc775a0482"}]}] Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-472002732 Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a8420f86398542309cf330cc775a0482 Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-472002732 Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 56787b9e24cf405ebcf12d58ece4a318 Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: {"status": "disabled"} Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: exception: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '2e651315-a1fa-460e-b149-3bce16b13486', 'body': {'status': 'disabled'}} Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:34:43.775044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.778389 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.780513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-58450173-16fc-47ec-af34-027470371d45 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Returning 404 to user: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:43.781601 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-58450173-16fc-47ec-af34-027470371d45 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-services/2e651315-a1fa-460e-b149-3bce16b13486" status: 404 len: 110 microversion: 2.53 time: 0.030982 Jul 14 14:34:43.788295 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1012/2038] 10.222.0.81 () {62 vars in 1308 bytes} [Thu Jul 14 14:34:43 2022] PUT /compute/v2.1/os-services/2e651315-a1fa-460e-b149-3bce16b13486 => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:34:43.794909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61d4a0ef-a361-4887-a93a-368ae953d3e5 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c83c2430>, body: {"status": "enabled"} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:43.797593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61d4a0ef-a361-4887-a93a-368ae953d3e5 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.799559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61d4a0ef-a361-4887-a93a-368ae953d3e5 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.806974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61d4a0ef-a361-4887-a93a-368ae953d3e5 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.807521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61d4a0ef-a361-4887-a93a-368ae953d3e5 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.814157 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-61d4a0ef-a361-4887-a93a-368ae953d3e5 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] HTTP exception thrown: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61d4a0ef-a361-4887-a93a-368ae953d3e5 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Request method failure captured: Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: request: PUT /compute/v2.1/os-services/2e651315-a1fa-460e-b149-3bce16b13486 HTTP/1.1 Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 21 Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CmD9ns4dpuy5BGf66Pl1ItfE7o4lS6gxxgahAzOdk8k3RoR7_17wSkO0IqBUtuVO_2rFDY2KPJOQeKJScEbTeQUB3S9jcykwB2jtsNSIoGNZLQmGVrmdC1Gh3eM-K23TSanE8jNjKGi9D90hqTUIyC8retXwbbC0IyA-6mvEya7hQY Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.53 Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a8420f86398542309cf330cc775a0482 Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-472002732 Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a8420f86398542309cf330cc775a0482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a8420f86398542309cf330cc775a0482"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a8420f86398542309cf330cc775a0482", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a8420f86398542309cf330cc775a0482"}]}] Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-472002732 Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a8420f86398542309cf330cc775a0482 Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-472002732 Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 56787b9e24cf405ebcf12d58ece4a318 Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: {"status": "enabled"} Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: exception: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '2e651315-a1fa-460e-b149-3bce16b13486', 'body': {'status': 'enabled'}} Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:34:43.815978 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61d4a0ef-a361-4887-a93a-368ae953d3e5 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Returning 404 to user: Service 2e651315-a1fa-460e-b149-3bce16b13486 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-61d4a0ef-a361-4887-a93a-368ae953d3e5 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-services/2e651315-a1fa-460e-b149-3bce16b13486" status: 404 len: 110 microversion: 2.53 time: 0.028000 Jul 14 14:34:43.819866 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1027/2039] 10.222.0.81 () {62 vars in 1308 bytes} [Thu Jul 14 14:34:43 2022] PUT /compute/v2.1/os-services/2e651315-a1fa-460e-b149-3bce16b13486 => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:34:43.829985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5c89ae2b-a603-4c02-ae61-5bab27224e19 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.831180 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:43.831180 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:34:43.832393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c89ae2b-a603-4c02-ae61-5bab27224e19 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.832857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c89ae2b-a603-4c02-ae61-5bab27224e19 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.834917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c89ae2b-a603-4c02-ae61-5bab27224e19 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.835383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c89ae2b-a603-4c02-ae61-5bab27224e19 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.862587 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5c89ae2b-a603-4c02-ae61-5bab27224e19 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.038098 Jul 14 14:34:43.863587 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1013/2040] 10.222.0.81 () {60 vars in 1177 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:34:43.866903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8c518e83-89f9-4216-a9d2-92456d381e47 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.867545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8c518e83-89f9-4216-a9d2-92456d381e47 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:43.874253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-20e5c3ab-5cac-4aa3-a0ae-a3cca3be90a8 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.875533 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:43.875533 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:34:43.876272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c518e83-89f9-4216-a9d2-92456d381e47 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.876727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c518e83-89f9-4216-a9d2-92456d381e47 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.876984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20e5c3ab-5cac-4aa3-a0ae-a3cca3be90a8 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.877523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c518e83-89f9-4216-a9d2-92456d381e47 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.877638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20e5c3ab-5cac-4aa3-a0ae-a3cca3be90a8 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.877971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c518e83-89f9-4216-a9d2-92456d381e47 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.878471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20e5c3ab-5cac-4aa3-a0ae-a3cca3be90a8 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.878889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20e5c3ab-5cac-4aa3-a0ae-a3cca3be90a8 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.903945 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-20e5c3ab-5cac-4aa3-a0ae-a3cca3be90a8 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.033383 Jul 14 14:34:43.904999 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1014/2041] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:34:43.917955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2674202c-783e-4f3f-bb7d-b0c7e2175c58 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.919314 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:43.919314 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:34:43.920692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2674202c-783e-4f3f-bb7d-b0c7e2175c58 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.921199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2674202c-783e-4f3f-bb7d-b0c7e2175c58 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.922019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2674202c-783e-4f3f-bb7d-b0c7e2175c58 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.922467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2674202c-783e-4f3f-bb7d-b0c7e2175c58 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.951687 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2674202c-783e-4f3f-bb7d-b0c7e2175c58 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.037306 Jul 14 14:34:43.952628 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1015/2042] 10.222.0.81 () {60 vars in 1177 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:34:43.968264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cee006c4-2dea-4fcb-a4c2-4d8731621bbf tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.970545 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:43.970545 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:34:43.973445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cee006c4-2dea-4fcb-a4c2-4d8731621bbf tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.973902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cee006c4-2dea-4fcb-a4c2-4d8731621bbf tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.974782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cee006c4-2dea-4fcb-a4c2-4d8731621bbf tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.975689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cee006c4-2dea-4fcb-a4c2-4d8731621bbf tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.041492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8c518e83-89f9-4216-a9d2-92456d381e47 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:44.050598 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8c518e83-89f9-4216-a9d2-92456d381e47 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1668 microversion: 2.1 time: 0.187731 Jul 14 14:34:44.051379 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1028/2043] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1668 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:44.140367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-818bd28b-a7b3-4aab-8c4d-1fe853960f4b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:44.141020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-818bd28b-a7b3-4aab-8c4d-1fe853960f4b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:44.180190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-818bd28b-a7b3-4aab-8c4d-1fe853960f4b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.180657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-818bd28b-a7b3-4aab-8c4d-1fe853960f4b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.184304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-818bd28b-a7b3-4aab-8c4d-1fe853960f4b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.187923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-818bd28b-a7b3-4aab-8c4d-1fe853960f4b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.285833 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cee006c4-2dea-4fcb-a4c2-4d8731621bbf tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?host=n-d-767704-28&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.323658 Jul 14 14:34:44.286457 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1016/2044] 10.222.0.81 () {60 vars in 1236 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/os-services?host=n-d-767704-28&binary=xxx => generated 16 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:44.303577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-585fac2b-b5c1-4e48-81e1-17ad2e24492d tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:44.304810 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:44.304810 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:34:44.312471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-585fac2b-b5c1-4e48-81e1-17ad2e24492d tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.312983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-585fac2b-b5c1-4e48-81e1-17ad2e24492d tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.315769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-585fac2b-b5c1-4e48-81e1-17ad2e24492d tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.316424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-585fac2b-b5c1-4e48-81e1-17ad2e24492d tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.371995 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-585fac2b-b5c1-4e48-81e1-17ad2e24492d tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.073577 Jul 14 14:34:44.372965 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1017/2045] 10.222.0.81 () {60 vars in 1177 bytes} [Thu Jul 14 14:34:44 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:34:44.383333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c3bc0292-febd-4892-b45c-41bf86df015c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:44.384178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c3bc0292-febd-4892-b45c-41bf86df015c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:44.406617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c3bc0292-febd-4892-b45c-41bf86df015c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.408797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c3bc0292-febd-4892-b45c-41bf86df015c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.409824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c3bc0292-febd-4892-b45c-41bf86df015c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.411447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c3bc0292-febd-4892-b45c-41bf86df015c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.782921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-818bd28b-a7b3-4aab-8c4d-1fe853960f4b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:44.798909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:44.812237 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-818bd28b-a7b3-4aab-8c4d-1fe853960f4b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.675802 Jul 14 14:34:44.815137 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1029/2046] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:44 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:44.824019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7e441e80-f95a-462b-9adc-6b6ec42c4445 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:44.837390 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:44.837390 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:34:44.840400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e441e80-f95a-462b-9adc-6b6ec42c4445 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.841539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e441e80-f95a-462b-9adc-6b6ec42c4445 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.843340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e441e80-f95a-462b-9adc-6b6ec42c4445 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.844608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e441e80-f95a-462b-9adc-6b6ec42c4445 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.919914 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7e441e80-f95a-462b-9adc-6b6ec42c4445 tempest-ServicesAdminNegativeV253TestJSON-472002732 tempest-ServicesAdminNegativeV253TestJSON-472002732-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.102866 Jul 14 14:34:44.920558 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1030/2047] 10.222.0.81 () {60 vars in 1238 bytes} [Thu Jul 14 14:34:44 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:44.923449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c3bc0292-febd-4892-b45c-41bf86df015c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:44.934043 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c3bc0292-febd-4892-b45c-41bf86df015c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1505 microversion: 2.1 time: 0.559737 Jul 14 14:34:44.944533 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1018/2048] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:44 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1505 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:44.945104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-28263aeb-470a-4e56-b800-badef20f971c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:44.950053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-28263aeb-470a-4e56-b800-badef20f971c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:44.950297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7ab505cc-b24d-46f3-a95d-7b4b3e889c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:44.954006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7ab505cc-b24d-46f3-a95d-7b4b3e889c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:44.967818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28263aeb-470a-4e56-b800-badef20f971c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.968050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7ab505cc-b24d-46f3-a95d-7b4b3e889c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.968287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28263aeb-470a-4e56-b800-badef20f971c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.972112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7ab505cc-b24d-46f3-a95d-7b4b3e889c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.973112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7ab505cc-b24d-46f3-a95d-7b4b3e889c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.973575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7ab505cc-b24d-46f3-a95d-7b4b3e889c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.974956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28263aeb-470a-4e56-b800-badef20f971c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.975893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28263aeb-470a-4e56-b800-badef20f971c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:45.404238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7ab505cc-b24d-46f3-a95d-7b4b3e889c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:45.427607 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7ab505cc-b24d-46f3-a95d-7b4b3e889c51 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1317 microversion: 2.1 time: 0.487245 Jul 14 14:34:45.429854 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1019/2049] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:44 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:45.531558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-28263aeb-470a-4e56-b800-badef20f971c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:45.541778 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-28263aeb-470a-4e56-b800-badef20f971c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1521 microversion: 2.1 time: 0.620080 Jul 14 14:34:45.548636 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1031/2050] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:44 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1521 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:45.557028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3543d2af-6746-42cc-aac1-be2c73da758b req-ba8bda10-8c1a-4b0e-aa2b-e4662061ae58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10e43da-f4f0-41c8-99db-efd48a91831a", "name": "network-vif-deleted", "tag": "bed3679e-8d64-4a5b-8ef3-bdcc56c88383"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:45.584099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3543d2af-6746-42cc-aac1-be2c73da758b req-ba8bda10-8c1a-4b0e-aa2b-e4662061ae58 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:45.584976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3543d2af-6746-42cc-aac1-be2c73da758b req-ba8bda10-8c1a-4b0e-aa2b-e4662061ae58 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:45.647329 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3543d2af-6746-42cc-aac1-be2c73da758b req-ba8bda10-8c1a-4b0e-aa2b-e4662061ae58 service nova] Creating event network-vif-deleted:bed3679e-8d64-4a5b-8ef3-bdcc56c88383 for instance e10e43da-f4f0-41c8-99db-efd48a91831a on n-h2-767704-28 Jul 14 14:34:45.677618 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3543d2af-6746-42cc-aac1-be2c73da758b req-ba8bda10-8c1a-4b0e-aa2b-e4662061ae58 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122161 Jul 14 14:34:45.680564 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1032/2051] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:45.694461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bfd3661e-54a3-4779-9e36-0ae6e0abacf2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:45.705031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bfd3661e-54a3-4779-9e36-0ae6e0abacf2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:45.718197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfd3661e-54a3-4779-9e36-0ae6e0abacf2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:45.719032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfd3661e-54a3-4779-9e36-0ae6e0abacf2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:45.720668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfd3661e-54a3-4779-9e36-0ae6e0abacf2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:45.721385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfd3661e-54a3-4779-9e36-0ae6e0abacf2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:45.781517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ca1e5e0b-8a25-403b-b506-e88309213f6d tempest-ServicesAdminNegativeV253TestJSON-1653851637 tempest-ServicesAdminNegativeV253TestJSON-1653851637-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:45.783863 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:34:45.783863 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:34:45.785291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ca1e5e0b-8a25-403b-b506-e88309213f6d tempest-ServicesAdminNegativeV253TestJSON-1653851637 tempest-ServicesAdminNegativeV253TestJSON-1653851637-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '77d73c4bb61342c5965d66321f464509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaeed479212433d8b444271d42cf5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ca1e5e0b-8a25-403b-b506-e88309213f6d tempest-ServicesAdminNegativeV253TestJSON-1653851637 tempest-ServicesAdminNegativeV253TestJSON-1653851637-project] Request method failure captured: Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CmC3zQRh9y6HRtyIDUsAwBoI1AQ8gUu4o8pY0pcDM5Q1LC1flZybmtLxbvlIytR4OGqjpnfMBRooOXEaqvPMM7dpFMHsuLybU2XzIdo7CVEiKfEOQ505mYpvakPtFAnZWz5rk-AANqzyd3Gg5COzGEaIP9YeVoeVaSXvCuet_Ksvzg Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.53 Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: bcaeed479212433d8b444271d42cf5ab Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1653851637 Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bcaeed479212433d8b444271d42cf5ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bcaeed479212433d8b444271d42cf5ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bcaeed479212433d8b444271d42cf5ab", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bcaeed479212433d8b444271d42cf5ab"}]}] Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1653851637 Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: bcaeed479212433d8b444271d42cf5ab Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1653851637 Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1653851637-project Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 77d73c4bb61342c5965d66321f464509 Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1653851637-project Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: action_args: {} Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 14 14:34:45.789504 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:45.793228 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:45.793228 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:45.793228 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:45.793228 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:45.793228 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:45.793228 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:34:45.793228 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:34:45.793228 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 14 14:34:45.793228 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:45.795723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ca1e5e0b-8a25-403b-b506-e88309213f6d tempest-ServicesAdminNegativeV253TestJSON-1653851637 tempest-ServicesAdminNegativeV253TestJSON-1653851637-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:45.797352 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ca1e5e0b-8a25-403b-b506-e88309213f6d tempest-ServicesAdminNegativeV253TestJSON-1653851637 tempest-ServicesAdminNegativeV253TestJSON-1653851637-project] 10.222.0.81 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.361194 Jul 14 14:34:45.804288 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1020/2052] 10.222.0.81 () {60 vars in 1177 bytes} [Thu Jul 14 14:34:45 2022] GET /compute/v2.1/os-services => generated 112 bytes in 370 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:34:45.826901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4b98e8a6-9a59-44e2-8b56-36bb092a88a5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:45.827710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4b98e8a6-9a59-44e2-8b56-36bb092a88a5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:45.850031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfd3661e-54a3-4779-9e36-0ae6e0abacf2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:45.853523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfd3661e-54a3-4779-9e36-0ae6e0abacf2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:45.854060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-bfd3661e-54a3-4779-9e36-0ae6e0abacf2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lazy-loading 'fault' on Instance uuid e10e43da-f4f0-41c8-99db-efd48a91831a {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:34:45.857573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b98e8a6-9a59-44e2-8b56-36bb092a88a5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:45.858062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b98e8a6-9a59-44e2-8b56-36bb092a88a5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:45.864114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b98e8a6-9a59-44e2-8b56-36bb092a88a5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:45.864591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b98e8a6-9a59-44e2-8b56-36bb092a88a5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:46.099843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bfd3661e-54a3-4779-9e36-0ae6e0abacf2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:46.108647 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bfd3661e-54a3-4779-9e36-0ae6e0abacf2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 200 len: 1325 microversion: 2.1 time: 0.425107 Jul 14 14:34:46.110936 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1033/2053] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:45 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 1325 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:46.125547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2e62357b-7272-48d9-a2d4-9623ddc3be56 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:46.126329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2e62357b-7272-48d9-a2d4-9623ddc3be56 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:46.144278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e62357b-7272-48d9-a2d4-9623ddc3be56 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:46.145109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e62357b-7272-48d9-a2d4-9623ddc3be56 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:46.146110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e62357b-7272-48d9-a2d4-9623ddc3be56 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:46.146752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e62357b-7272-48d9-a2d4-9623ddc3be56 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:46.439859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4b98e8a6-9a59-44e2-8b56-36bb092a88a5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:46.474955 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4b98e8a6-9a59-44e2-8b56-36bb092a88a5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1521 microversion: 2.1 time: 0.657702 Jul 14 14:34:46.475918 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1021/2054] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:45 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1521 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:46.483989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f45c2a5c-8640-444f-8200-d7810f277458 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:46.484624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f45c2a5c-8640-444f-8200-d7810f277458 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:46.525318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f45c2a5c-8640-444f-8200-d7810f277458 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:46.525789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f45c2a5c-8640-444f-8200-d7810f277458 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:46.528929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f45c2a5c-8640-444f-8200-d7810f277458 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:46.529561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f45c2a5c-8640-444f-8200-d7810f277458 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:46.680854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2e62357b-7272-48d9-a2d4-9623ddc3be56 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:46.691526 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2e62357b-7272-48d9-a2d4-9623ddc3be56 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.577422 Jul 14 14:34:46.692367 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1034/2055] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:46 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:46.706766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e079ab51-cdf0-4ad3-b537-95f6b13ac540 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:46.707918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e079ab51-cdf0-4ad3-b537-95f6b13ac540 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:46.714453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e079ab51-cdf0-4ad3-b537-95f6b13ac540 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:46.714793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e079ab51-cdf0-4ad3-b537-95f6b13ac540 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:46.716229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e079ab51-cdf0-4ad3-b537-95f6b13ac540 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:46.716824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e079ab51-cdf0-4ad3-b537-95f6b13ac540 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.024667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f45c2a5c-8640-444f-8200-d7810f277458 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:47.033395 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f45c2a5c-8640-444f-8200-d7810f277458 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1487 microversion: 2.1 time: 0.556319 Jul 14 14:34:47.034071 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1022/2056] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:46 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1487 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:47.050569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba8aa9c7-55b2-4263-94fe-d7921bb63f0c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-509653316", "metadata": {"": ""}}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba8aa9c7-55b2-4263-94fe-d7921bb63f0c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action HTTP/1.1 Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 106 Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-509653316", "metadata": {"": ""}}} Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-509653316', 'metadata': {'': ''}}}} Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'': ''} Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:47.053949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba8aa9c7-55b2-4263-94fe-d7921bb63f0c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:47.057997 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ba8aa9c7-55b2-4263-94fe-d7921bb63f0c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action" status: 400 len: 170 microversion: 2.1 time: 0.009577 Jul 14 14:34:47.060033 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1023/2057] 10.222.0.81 () {60 vars in 1278 bytes} [Thu Jul 14 14:34:47 2022] POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action => generated 170 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:34:47.065475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c2962923-2c80-45f8-96b0-703ad0fa4b4d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.065936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c2962923-2c80-45f8-96b0-703ad0fa4b4d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:47.072852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2962923-2c80-45f8-96b0-703ad0fa4b4d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.073344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2962923-2c80-45f8-96b0-703ad0fa4b4d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.074124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2962923-2c80-45f8-96b0-703ad0fa4b4d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.074560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2962923-2c80-45f8-96b0-703ad0fa4b4d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.102434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e079ab51-cdf0-4ad3-b537-95f6b13ac540 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:47.103423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c2962923-2c80-45f8-96b0-703ad0fa4b4d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:47.107814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:47.112302 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e079ab51-cdf0-4ad3-b537-95f6b13ac540 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1317 microversion: 2.1 time: 0.416951 Jul 14 14:34:47.113180 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1035/2058] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:46 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:47.128266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1ca95c4f-63f5-48ee-a069-2c4df5a017ab tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.129205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1ca95c4f-63f5-48ee-a069-2c4df5a017ab tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:47.136415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ca95c4f-63f5-48ee-a069-2c4df5a017ab tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.136825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ca95c4f-63f5-48ee-a069-2c4df5a017ab tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.137817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ca95c4f-63f5-48ee-a069-2c4df5a017ab tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.138411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ca95c4f-63f5-48ee-a069-2c4df5a017ab tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.237148 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c2962923-2c80-45f8-96b0-703ad0fa4b4d tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 204 len: 0 microversion: 2.1 time: 0.174304 Jul 14 14:34:47.237794 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1024/2059] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:47 2022] DELETE /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:47.250358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e62b15f1-fdfb-49a3-82a6-74498971eb0c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.251806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e62b15f1-fdfb-49a3-82a6-74498971eb0c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: e10e43da-f4f0-41c8-99db-efd48a91831a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:47.259401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e62b15f1-fdfb-49a3-82a6-74498971eb0c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.260004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e62b15f1-fdfb-49a3-82a6-74498971eb0c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.261012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e62b15f1-fdfb-49a3-82a6-74498971eb0c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.261893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e62b15f1-fdfb-49a3-82a6-74498971eb0c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.291258 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-e62b15f1-fdfb-49a3-82a6-74498971eb0c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] HTTP exception thrown: Instance e10e43da-f4f0-41c8-99db-efd48a91831a could not be found. Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e62b15f1-fdfb-49a3-82a6-74498971eb0c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Request method failure captured: Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a HTTP/1.1 Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cenn4HU6XkCSY8qKqNCtkj6EvAzCRdwvC06iSpmLiVyhSUWxuIzZIPEQEdKeZRDKKUXKEFspjEEHlcgyLRfCgc_reNU80sIs6r5NSJmX_obgK7APw5HK0H7_IHDyQzRVnvg5ehEmnYCMqjX13d3c7t459-Ewe3WClvGjcx4jm3o-Po Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: eb57648abd7742d9aac69af1744d6bc1 Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-LiveMigrationTest-1854408993 Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/eb57648abd7742d9aac69af1744d6bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/eb57648abd7742d9aac69af1744d6bc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_eb57648abd7742d9aac69af1744d6bc1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/eb57648abd7742d9aac69af1744d6bc1"}]}] Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-LiveMigrationTest-1854408993 Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: eb57648abd7742d9aac69af1744d6bc1 Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-LiveMigrationTest-1854408993 Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-LiveMigrationTest-1854408993-project Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 5c688cde0ea44a059b0bca3e020c28b3 Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-LiveMigrationTest-1854408993-project Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance e10e43da-f4f0-41c8-99db-efd48a91831a could not be found. Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'e10e43da-f4f0-41c8-99db-efd48a91831a'} Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10e43da-f4f0-41c8-99db-efd48a91831a could not be found. Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10e43da-f4f0-41c8-99db-efd48a91831a could not be found. Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:47.293062 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.301233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.301233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:47.301233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:47.301233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:47.301233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:47.301233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10e43da-f4f0-41c8-99db-efd48a91831a could not be found. Jul 14 14:34:47.301233 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.301233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e62b15f1-fdfb-49a3-82a6-74498971eb0c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Returning 404 to user: Instance e10e43da-f4f0-41c8-99db-efd48a91831a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:47.301233 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e62b15f1-fdfb-49a3-82a6-74498971eb0c tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a" status: 404 len: 111 microversion: 2.1 time: 0.049754 Jul 14 14:34:47.301233 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1025/2060] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:47 2022] GET /compute/v2.1/servers/e10e43da-f4f0-41c8-99db-efd48a91831a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:47.303113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77bed3af-23db-45d1-8cf7-1062318853b0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5971a60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.334550 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-77bed3af-23db-45d1-8cf7-1062318853b0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] HTTP exception thrown: Image not found. Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77bed3af-23db-45d1-8cf7-1062318853b0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Request method failure captured: Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/images/464dd7a8-9a98-477b-82f2-6ec7015e775d HTTP/1.1 Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch2LdshHkgnfLKQ09Th5yFEtJ6NDMhU3YAv5gfwMPVRyjuGs5ounfti5Desm3i53FZSU8EucGNP4Rzy0S71lUdQcdXKedt82m6kz-LwLm_uJeWZZr8mFflHZ4u7MMkkfwx71zlLEQcauCAP4aVIdWxl0MQgHe5i5BrB1GsD5uwHXUA Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3755ed287bff4882ac3ead9acadfa731", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}] Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 31ab545bcb3a47b38c53fbfa6b11a432 Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '464dd7a8-9a98-477b-82f2-6ec7015e775d'} Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 464dd7a8-9a98-477b-82f2-6ec7015e775d to delete Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 464dd7a8-9a98-477b-82f2-6ec7015e775d could not be found. Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.336632 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77bed3af-23db-45d1-8cf7-1062318853b0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:47.340097 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-77bed3af-23db-45d1-8cf7-1062318853b0 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/images/464dd7a8-9a98-477b-82f2-6ec7015e775d" status: 404 len: 62 microversion: 2.1 time: 0.041345 Jul 14 14:34:47.342159 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1026/2061] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:47 2022] DELETE /compute/v2.1/images/464dd7a8-9a98-477b-82f2-6ec7015e775d => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:34:47.347308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a38e495b-101b-4860-a84b-c0ce77af40a2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '.version_select at 0x7fd6c533ae50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.373870 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a38e495b-101b-4860-a84b-c0ce77af40a2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116421153" status: 202 len: 0 microversion: 2.1 time: 0.030429 Jul 14 14:34:47.374349 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1027/2062] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 14:34:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116421153 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:34:47.383106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-48dfd18b-2c1d-43e3-9651-30cd0d1a196a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.383850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-48dfd18b-2c1d-43e3-9651-30cd0d1a196a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:47.390262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48dfd18b-2c1d-43e3-9651-30cd0d1a196a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.390646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48dfd18b-2c1d-43e3-9651-30cd0d1a196a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.392087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48dfd18b-2c1d-43e3-9651-30cd0d1a196a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.392536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48dfd18b-2c1d-43e3-9651-30cd0d1a196a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.413078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1ca95c4f-63f5-48ee-a069-2c4df5a017ab tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:47.420320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-48dfd18b-2c1d-43e3-9651-30cd0d1a196a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:47.432187 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1ca95c4f-63f5-48ee-a069-2c4df5a017ab tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1521 microversion: 2.1 time: 0.308265 Jul 14 14:34:47.433970 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1036/2063] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:47 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:47.452757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-052644f3-6832-4f9b-88d3-e7b773725b23 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.454474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-052644f3-6832-4f9b-88d3-e7b773725b23 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:47.462351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-052644f3-6832-4f9b-88d3-e7b773725b23 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.463366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-052644f3-6832-4f9b-88d3-e7b773725b23 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.464509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-052644f3-6832-4f9b-88d3-e7b773725b23 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.465205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-052644f3-6832-4f9b-88d3-e7b773725b23 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.514680 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.compute.api [None req-48dfd18b-2c1d-43e3-9651-30cd0d1a196a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Instance is already in deleting state, ignoring this request Jul 14 14:34:47.515592 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-48dfd18b-2c1d-43e3-9651-30cd0d1a196a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 204 len: 0 microversion: 2.1 time: 0.139987 Jul 14 14:34:47.516188 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1028/2064] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:47 2022] DELETE /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:47.525500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0e156191-d164-448d-8741-92a167dbb8dc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.526130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0e156191-d164-448d-8741-92a167dbb8dc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:47.537078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e156191-d164-448d-8741-92a167dbb8dc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.537078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e156191-d164-448d-8741-92a167dbb8dc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.537223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e156191-d164-448d-8741-92a167dbb8dc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.537636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e156191-d164-448d-8741-92a167dbb8dc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.768402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-052644f3-6832-4f9b-88d3-e7b773725b23 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:47.777157 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-052644f3-6832-4f9b-88d3-e7b773725b23 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1521 microversion: 2.1 time: 0.329061 Jul 14 14:34:47.788789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0e156191-d164-448d-8741-92a167dbb8dc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:47.789401 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1037/2065] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:47 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:47.790894 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0e156191-d164-448d-8741-92a167dbb8dc tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1493 microversion: 2.1 time: 0.269747 Jul 14 14:34:47.796685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ec87f20e-c1d1-4ee7-ad3a-c3d871a1dce6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.798316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ec87f20e-c1d1-4ee7-ad3a-c3d871a1dce6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:47.805136 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1029/2066] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:47 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1493 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:47.805813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec87f20e-c1d1-4ee7-ad3a-c3d871a1dce6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.806329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec87f20e-c1d1-4ee7-ad3a-c3d871a1dce6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.807305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec87f20e-c1d1-4ee7-ad3a-c3d871a1dce6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.807924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec87f20e-c1d1-4ee7-ad3a-c3d871a1dce6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.812754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d91cc40c-dd85-4f1e-af8a-a323faa0d50e req-4c1c82e9-b886-4fad-9220-14305400fa8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63e0542-7919-4dab-ac01-8886ee2810ce", "tag": "133c788b-8267-4ccc-867a-c10f112b9cc1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:47.825876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d91cc40c-dd85-4f1e-af8a-a323faa0d50e req-4c1c82e9-b886-4fad-9220-14305400fa8a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.827622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d91cc40c-dd85-4f1e-af8a-a323faa0d50e req-4c1c82e9-b886-4fad-9220-14305400fa8a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.841731 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d91cc40c-dd85-4f1e-af8a-a323faa0d50e req-4c1c82e9-b886-4fad-9220-14305400fa8a service nova] Creating event network-changed:133c788b-8267-4ccc-867a-c10f112b9cc1 for instance d63e0542-7919-4dab-ac01-8886ee2810ce on n-h2-767704-28 Jul 14 14:34:47.847652 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d91cc40c-dd85-4f1e-af8a-a323faa0d50e req-4c1c82e9-b886-4fad-9220-14305400fa8a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040795 Jul 14 14:34:47.848257 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1030/2067] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:47.854354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-28d59736-79c1-4d25-b417-29227cc29a3d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-825072757", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-28d59736-79c1-4d25-b417-29227cc29a3d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action HTTP/1.1 Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 618 Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-825072757", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-825072757', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:34:47.857470 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:34:47.859677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:47.864134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-28d59736-79c1-4d25-b417-29227cc29a3d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:47.864134 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-28d59736-79c1-4d25-b417-29227cc29a3d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action" status: 400 len: 938 microversion: 2.1 time: 0.009242 Jul 14 14:34:47.864741 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1031/2068] 10.222.0.81 () {60 vars in 1278 bytes} [Thu Jul 14 14:34:47 2022] POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action => generated 938 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:34:47.869589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-48b01bed-b6b1-4da1-acc0-f012be783906 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.870409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-48b01bed-b6b1-4da1-acc0-f012be783906 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:47.872544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:47.881558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48b01bed-b6b1-4da1-acc0-f012be783906 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.882122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48b01bed-b6b1-4da1-acc0-f012be783906 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.883413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48b01bed-b6b1-4da1-acc0-f012be783906 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.883993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48b01bed-b6b1-4da1-acc0-f012be783906 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.057835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ec87f20e-c1d1-4ee7-ad3a-c3d871a1dce6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:48.066631 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ec87f20e-c1d1-4ee7-ad3a-c3d871a1dce6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.275777 Jul 14 14:34:48.077386 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1038/2069] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:47 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:48.130642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-34e831ef-ac70-43c6-a163-434077083b28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:48.131350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-34e831ef-ac70-43c6-a163-434077083b28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:48.138974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34e831ef-ac70-43c6-a163-434077083b28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.140034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34e831ef-ac70-43c6-a163-434077083b28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.141291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34e831ef-ac70-43c6-a163-434077083b28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.142696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34e831ef-ac70-43c6-a163-434077083b28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.150910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-48b01bed-b6b1-4da1-acc0-f012be783906 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:48.163998 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-48b01bed-b6b1-4da1-acc0-f012be783906 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1521 microversion: 2.1 time: 0.297940 Jul 14 14:34:48.177298 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1032/2070] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:47 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:48.186022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5c27023b-99f0-4cbb-9137-5b126261d718 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:48.193687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5c27023b-99f0-4cbb-9137-5b126261d718 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:48.201708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c27023b-99f0-4cbb-9137-5b126261d718 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.202266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c27023b-99f0-4cbb-9137-5b126261d718 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.203132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c27023b-99f0-4cbb-9137-5b126261d718 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.204492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c27023b-99f0-4cbb-9137-5b126261d718 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.469095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-34e831ef-ac70-43c6-a163-434077083b28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:48.477827 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-34e831ef-ac70-43c6-a163-434077083b28 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1317 microversion: 2.1 time: 0.352108 Jul 14 14:34:48.489297 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1039/2071] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:48 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:48.504281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5c27023b-99f0-4cbb-9137-5b126261d718 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:48.512885 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5c27023b-99f0-4cbb-9137-5b126261d718 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1521 microversion: 2.1 time: 0.330615 Jul 14 14:34:48.513635 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1033/2072] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:48 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:48.529597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a087cb76-48ae-4fe0-8b1a-99ecc0f62871 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a087cb76-48ae-4fe0-8b1a-99ecc0f62871 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action HTTP/1.1 Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 285 Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:48.532586 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a087cb76-48ae-4fe0-8b1a-99ecc0f62871 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:48.538467 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a087cb76-48ae-4fe0-8b1a-99ecc0f62871 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action" status: 400 len: 619 microversion: 2.1 time: 0.008518 Jul 14 14:34:48.542831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4819dd19-20d8-4c1f-8822-fb588cfe7185 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:48.543457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4819dd19-20d8-4c1f-8822-fb588cfe7185 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:48.549063 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1040/2073] 10.222.0.81 () {60 vars in 1278 bytes} [Thu Jul 14 14:34:48 2022] POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:34:48.550708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4819dd19-20d8-4c1f-8822-fb588cfe7185 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.551350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4819dd19-20d8-4c1f-8822-fb588cfe7185 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.552300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4819dd19-20d8-4c1f-8822-fb588cfe7185 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.552747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4819dd19-20d8-4c1f-8822-fb588cfe7185 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.741115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4819dd19-20d8-4c1f-8822-fb588cfe7185 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:48.751715 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4819dd19-20d8-4c1f-8822-fb588cfe7185 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1521 microversion: 2.1 time: 0.211738 Jul 14 14:34:48.752660 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1034/2074] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:48 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:48.772255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24db07c7-bd8e-4d64-b68c-636539a098bd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:48.773528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-24db07c7-bd8e-4d64-b68c-636539a098bd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:48.780978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24db07c7-bd8e-4d64-b68c-636539a098bd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.781534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24db07c7-bd8e-4d64-b68c-636539a098bd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.782559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24db07c7-bd8e-4d64-b68c-636539a098bd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.783219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24db07c7-bd8e-4d64-b68c-636539a098bd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.823801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7842d4f7-ff80-46fe-a029-7c08d652da09 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:48.824586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7842d4f7-ff80-46fe-a029-7c08d652da09 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:48.838263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7842d4f7-ff80-46fe-a029-7c08d652da09 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.839802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7842d4f7-ff80-46fe-a029-7c08d652da09 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.841255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7842d4f7-ff80-46fe-a029-7c08d652da09 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.844650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7842d4f7-ff80-46fe-a029-7c08d652da09 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.988883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-24db07c7-bd8e-4d64-b68c-636539a098bd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:48.997724 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-24db07c7-bd8e-4d64-b68c-636539a098bd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1521 microversion: 2.1 time: 0.229363 Jul 14 14:34:49.010669 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1041/2075] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:48 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:49.022992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a6081c29-3e11-43ad-b89a-50417d3a2195 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:49.029022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a6081c29-3e11-43ad-b89a-50417d3a2195 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:49.030098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a6081c29-3e11-43ad-b89a-50417d3a2195 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Searching by: {'deleted': False, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:34:49.038772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6081c29-3e11-43ad-b89a-50417d3a2195 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.039696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6081c29-3e11-43ad-b89a-50417d3a2195 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.040694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6081c29-3e11-43ad-b89a-50417d3a2195 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.041338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6081c29-3e11-43ad-b89a-50417d3a2195 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.070614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7842d4f7-ff80-46fe-a029-7c08d652da09 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:49.078559 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7842d4f7-ff80-46fe-a029-7c08d652da09 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1493 microversion: 2.1 time: 0.261813 Jul 14 14:34:49.080060 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1035/2076] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:48 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1493 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:49.091439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d8cea2d6-0bd0-4c2a-96e8-2158b9b2bb8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-726892902"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:49.092611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d8cea2d6-0bd0-4c2a-96e8-2158b9b2bb8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:49.100854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8cea2d6-0bd0-4c2a-96e8-2158b9b2bb8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.101421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8cea2d6-0bd0-4c2a-96e8-2158b9b2bb8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.102524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8cea2d6-0bd0-4c2a-96e8-2158b9b2bb8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.103067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8cea2d6-0bd0-4c2a-96e8-2158b9b2bb8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.103589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-a6081c29-3e11-43ad-b89a-50417d3a2195 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:34:49.172920 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a6081c29-3e11-43ad-b89a-50417d3a2195 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 331 microversion: 2.1 time: 0.160516 Jul 14 14:34:49.184789 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1042/2077] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 14:34:49 2022] GET /compute/v2.1/servers => generated 331 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:49.199838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c15d9098-20fe-4e33-a1be-267c697289a7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:49.204450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c15d9098-20fe-4e33-a1be-267c697289a7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:49.211719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c15d9098-20fe-4e33-a1be-267c697289a7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.214738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c15d9098-20fe-4e33-a1be-267c697289a7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.218027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c15d9098-20fe-4e33-a1be-267c697289a7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.220657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c15d9098-20fe-4e33-a1be-267c697289a7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.254715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c15d9098-20fe-4e33-a1be-267c697289a7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:49.352670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:49.358011 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c15d9098-20fe-4e33-a1be-267c697289a7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 204 len: 0 microversion: 2.1 time: 0.171643 Jul 14 14:34:49.363215 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1043/2078] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:49 2022] DELETE /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:49.372973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-46878f55-7455-4d65-bda3-7a6deb4cf3c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:49.374084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-46878f55-7455-4d65-bda3-7a6deb4cf3c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:49.386712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46878f55-7455-4d65-bda3-7a6deb4cf3c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.387987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46878f55-7455-4d65-bda3-7a6deb4cf3c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.389417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46878f55-7455-4d65-bda3-7a6deb4cf3c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.390079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46878f55-7455-4d65-bda3-7a6deb4cf3c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.535175 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d8cea2d6-0bd0-4c2a-96e8-2158b9b2bb8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action" status: 202 len: 0 microversion: 2.1 time: 0.447358 Jul 14 14:34:49.536208 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1036/2079] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:34:49 2022] POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:34:49.539454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=22 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:49.546312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5479ca3-2e2e-4f6c-9665-bc4ac22ef6f7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:49.553444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e5479ca3-2e2e-4f6c-9665-bc4ac22ef6f7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:49.554829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e5479ca3-2e2e-4f6c-9665-bc4ac22ef6f7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Searching by: {'deleted': False, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:34:49.565540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5479ca3-2e2e-4f6c-9665-bc4ac22ef6f7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.566254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5479ca3-2e2e-4f6c-9665-bc4ac22ef6f7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.567250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5479ca3-2e2e-4f6c-9665-bc4ac22ef6f7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.568053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5479ca3-2e2e-4f6c-9665-bc4ac22ef6f7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.688835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-e5479ca3-2e2e-4f6c-9665-bc4ac22ef6f7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:34:49.706668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=32 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:49.797385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e5479ca3-2e2e-4f6c-9665-bc4ac22ef6f7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:49.821743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5479ca3-2e2e-4f6c-9665-bc4ac22ef6f7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.822340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5479ca3-2e2e-4f6c-9665-bc4ac22ef6f7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.878955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-46878f55-7455-4d65-bda3-7a6deb4cf3c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:49.887832 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-46878f55-7455-4d65-bda3-7a6deb4cf3c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.526151 Jul 14 14:34:49.893715 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1044/2080] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:49 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:49.899432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-50a366a9-4fdd-4911-84fc-1a879de156a4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:49.903584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-50a366a9-4fdd-4911-84fc-1a879de156a4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:49.928734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50a366a9-4fdd-4911-84fc-1a879de156a4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.929358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50a366a9-4fdd-4911-84fc-1a879de156a4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.934384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50a366a9-4fdd-4911-84fc-1a879de156a4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.941400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50a366a9-4fdd-4911-84fc-1a879de156a4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.171201 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e5479ca3-2e2e-4f6c-9665-bc4ac22ef6f7 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.632758 Jul 14 14:34:50.171802 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1037/2081] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:34:49 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:50.194918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-28d4911c-9b63-4c39-aadf-a77c6bfdc619 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:50.195609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-28d4911c-9b63-4c39-aadf-a77c6bfdc619 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:50.203049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28d4911c-9b63-4c39-aadf-a77c6bfdc619 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.203513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28d4911c-9b63-4c39-aadf-a77c6bfdc619 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.206350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28d4911c-9b63-4c39-aadf-a77c6bfdc619 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.206817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28d4911c-9b63-4c39-aadf-a77c6bfdc619 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.444740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-50a366a9-4fdd-4911-84fc-1a879de156a4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:50.459668 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-50a366a9-4fdd-4911-84fc-1a879de156a4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1483 microversion: 2.1 time: 0.564486 Jul 14 14:34:50.460460 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1045/2082] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:49 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1483 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:50.482325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-83559341-6cf1-42ce-965f-b5fdc7ecd3a7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1148632185"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:50.483724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-83559341-6cf1-42ce-965f-b5fdc7ecd3a7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:50.493310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83559341-6cf1-42ce-965f-b5fdc7ecd3a7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.494710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83559341-6cf1-42ce-965f-b5fdc7ecd3a7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.496808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83559341-6cf1-42ce-965f-b5fdc7ecd3a7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.497578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83559341-6cf1-42ce-965f-b5fdc7ecd3a7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.536979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:50.554164 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-83559341-6cf1-42ce-965f-b5fdc7ecd3a7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] HTTP exception thrown: Cannot 'createImage' instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c while it is in task_state image_snapshot Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-83559341-6cf1-42ce-965f-b5fdc7ecd3a7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action HTTP/1.1 Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 85 Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1148632185"}} Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: exception: Cannot 'createImage' instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c while it is in task_state image_snapshot Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1148632185'}}} Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1348, in _action_create_image Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1353, in _action_create_image Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:34:50.556668 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c while it is in task_state image_snapshot Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c while it is in task_state image_snapshot Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-83559341-6cf1-42ce-965f-b5fdc7ecd3a7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 409 to user: Cannot 'createImage' instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c while it is in task_state image_snapshot {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-83559341-6cf1-42ce-965f-b5fdc7ecd3a7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action" status: 409 len: 159 microversion: 2.1 time: 0.084798 Jul 14 14:34:50.559870 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1046/2083] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:34:50 2022] POST /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c/action => generated 159 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:34:50.567800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65c8a056-bca0-49a3-a5a4-12bcedb8092a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:50.568516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-65c8a056-bca0-49a3-a5a4-12bcedb8092a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:50.574923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-28d4911c-9b63-4c39-aadf-a77c6bfdc619 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:50.583864 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-28d4911c-9b63-4c39-aadf-a77c6bfdc619 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1317 microversion: 2.1 time: 0.394282 Jul 14 14:34:50.584452 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1038/2084] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:50 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:50.595671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ef312957-e2d5-462b-897f-c2eb77bdf094 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:50.598704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65c8a056-bca0-49a3-a5a4-12bcedb8092a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.599164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65c8a056-bca0-49a3-a5a4-12bcedb8092a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.601140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65c8a056-bca0-49a3-a5a4-12bcedb8092a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.602013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65c8a056-bca0-49a3-a5a4-12bcedb8092a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.627834 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ef312957-e2d5-462b-897f-c2eb77bdf094 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041378 Jul 14 14:34:50.629813 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1039/2085] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:34:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:50.643576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-40e88a47-b370-4ae1-b37a-58ebe96258c3 req-b1717ed4-22dc-4784-946f-7614b2bb4e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df45cbe-095e-4ee6-84e9-281a0a16bf0c", "name": "network-vif-plugged", "status": "completed", "tag": "7e15b7ab-8d72-45fb-b41d-7042219db600"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:50.669673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-40e88a47-b370-4ae1-b37a-58ebe96258c3 req-b1717ed4-22dc-4784-946f-7614b2bb4e1c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.673733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-40e88a47-b370-4ae1-b37a-58ebe96258c3 req-b1717ed4-22dc-4784-946f-7614b2bb4e1c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.706482 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-40e88a47-b370-4ae1-b37a-58ebe96258c3 req-b1717ed4-22dc-4784-946f-7614b2bb4e1c service nova] Creating event network-vif-plugged:7e15b7ab-8d72-45fb-b41d-7042219db600 for instance 9df45cbe-095e-4ee6-84e9-281a0a16bf0c on n-h1-767704-28 Jul 14 14:34:50.720091 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-40e88a47-b370-4ae1-b37a-58ebe96258c3 req-b1717ed4-22dc-4784-946f-7614b2bb4e1c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086950 Jul 14 14:34:50.725929 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1040/2086] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:50.742030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-65c8a056-bca0-49a3-a5a4-12bcedb8092a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ab545bcb3a47b38c53fbfa6b11a432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3755ed287bff4882ac3ead9acadfa731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:50.755974 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65c8a056-bca0-49a3-a5a4-12bcedb8092a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 200 len: 1451 microversion: 2.1 time: 0.191166 Jul 14 14:34:50.757170 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1047/2087] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:50 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 1451 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:50.758708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5f5116d7-a50b-45ba-85fd-a2c1e527160e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '.version_select at 0x7fd6c533adc0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:50.912364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f74deee-58f1-41d2-8fce-9b16d3ad947f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:50.913065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f74deee-58f1-41d2-8fce-9b16d3ad947f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:50.935544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f74deee-58f1-41d2-8fce-9b16d3ad947f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.937577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f74deee-58f1-41d2-8fce-9b16d3ad947f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.942316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f74deee-58f1-41d2-8fce-9b16d3ad947f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.946153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f74deee-58f1-41d2-8fce-9b16d3ad947f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.067687 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5f5116d7-a50b-45ba-85fd-a2c1e527160e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "DELETE /compute/v2.1/images/83410113-e86d-4edb-8cee-1f0e53b67ad0" status: 204 len: 0 microversion: 2.1 time: 0.339890 Jul 14 14:34:51.068633 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1041/2088] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:50 2022] DELETE /compute/v2.1/images/83410113-e86d-4edb-8cee-1f0e53b67ad0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:51.075807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-223b8936-0468-4652-9762-be1e715843bb tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:51.076706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-223b8936-0468-4652-9762-be1e715843bb tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:51.093446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-223b8936-0468-4652-9762-be1e715843bb tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:51.094267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-223b8936-0468-4652-9762-be1e715843bb tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.098494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-223b8936-0468-4652-9762-be1e715843bb tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:51.101718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-223b8936-0468-4652-9762-be1e715843bb tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.176889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-223b8936-0468-4652-9762-be1e715843bb tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:51.249893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:51.400850 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-223b8936-0468-4652-9762-be1e715843bb tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "DELETE /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 204 len: 0 microversion: 2.1 time: 0.330456 Jul 14 14:34:51.402358 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1042/2089] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:51 2022] DELETE /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:51.411067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77916cde-e2aa-498d-87c2-9a5b4322bbe4 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:51.415202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-77916cde-e2aa-498d-87c2-9a5b4322bbe4 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:51.444800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77916cde-e2aa-498d-87c2-9a5b4322bbe4 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:51.446801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77916cde-e2aa-498d-87c2-9a5b4322bbe4 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.450852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77916cde-e2aa-498d-87c2-9a5b4322bbe4 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:51.454923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77916cde-e2aa-498d-87c2-9a5b4322bbe4 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.883241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f74deee-58f1-41d2-8fce-9b16d3ad947f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:51.885803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-77916cde-e2aa-498d-87c2-9a5b4322bbe4 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:51.894728 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-77916cde-e2aa-498d-87c2-9a5b4322bbe4 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1539 microversion: 2.1 time: 0.491053 Jul 14 14:34:51.895549 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f74deee-58f1-41d2-8fce-9b16d3ad947f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.988708 Jul 14 14:34:51.896069 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1043/2090] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:51 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1539 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:51.897379 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1048/2091] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:50 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:51.903371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9b8f9742-6132-4d11-801f-49434fc6eb96 req-eaebd91a-9dcc-486a-ab19-47caef5ca58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df45cbe-095e-4ee6-84e9-281a0a16bf0c", "name": "network-vif-deleted", "tag": "7e15b7ab-8d72-45fb-b41d-7042219db600"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:51.911512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ff4bc3a1-45c5-4fd5-888d-81c9ccb86bcf req-a44528ee-03d9-448a-a555-bda7f935dd1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec366efc-f03e-4022-9d20-aea3951399f2", "name": "network-vif-deleted", "tag": "de0ff888-9f89-477e-af2f-da88a54bd7a3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:51.923564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9b8f9742-6132-4d11-801f-49434fc6eb96 req-eaebd91a-9dcc-486a-ab19-47caef5ca58f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:51.925358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9b8f9742-6132-4d11-801f-49434fc6eb96 req-eaebd91a-9dcc-486a-ab19-47caef5ca58f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.925773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ff4bc3a1-45c5-4fd5-888d-81c9ccb86bcf req-a44528ee-03d9-448a-a555-bda7f935dd1a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:51.926286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ff4bc3a1-45c5-4fd5-888d-81c9ccb86bcf req-a44528ee-03d9-448a-a555-bda7f935dd1a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.941493 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ff4bc3a1-45c5-4fd5-888d-81c9ccb86bcf req-a44528ee-03d9-448a-a555-bda7f935dd1a service nova] Creating event network-vif-deleted:de0ff888-9f89-477e-af2f-da88a54bd7a3 for instance ec366efc-f03e-4022-9d20-aea3951399f2 on n-h2-767704-28 Jul 14 14:34:51.947597 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ff4bc3a1-45c5-4fd5-888d-81c9ccb86bcf req-a44528ee-03d9-448a-a555-bda7f935dd1a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049922 Jul 14 14:34:51.948859 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1044/2092] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:51.950380 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9b8f9742-6132-4d11-801f-49434fc6eb96 req-eaebd91a-9dcc-486a-ab19-47caef5ca58f service nova] Creating event network-vif-deleted:7e15b7ab-8d72-45fb-b41d-7042219db600 for instance 9df45cbe-095e-4ee6-84e9-281a0a16bf0c on n-h1-767704-28 Jul 14 14:34:51.954559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f0999dc3-fcac-4f0b-99cb-8897e7ebaec1 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:51.955680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f0999dc3-fcac-4f0b-99cb-8897e7ebaec1 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:51.957376 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9b8f9742-6132-4d11-801f-49434fc6eb96 req-eaebd91a-9dcc-486a-ab19-47caef5ca58f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057519 Jul 14 14:34:51.958072 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1049/2093] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:51.963962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a7ebd958-8c54-46cf-af0e-3d0a689ce7b7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:51.964727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a7ebd958-8c54-46cf-af0e-3d0a689ce7b7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:51.967501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0999dc3-fcac-4f0b-99cb-8897e7ebaec1 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:51.968209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0999dc3-fcac-4f0b-99cb-8897e7ebaec1 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.969745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0999dc3-fcac-4f0b-99cb-8897e7ebaec1 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:51.970420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0999dc3-fcac-4f0b-99cb-8897e7ebaec1 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.973263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7ebd958-8c54-46cf-af0e-3d0a689ce7b7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:51.973760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7ebd958-8c54-46cf-af0e-3d0a689ce7b7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.974613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7ebd958-8c54-46cf-af0e-3d0a689ce7b7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:51.975004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7ebd958-8c54-46cf-af0e-3d0a689ce7b7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.025904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7ebd958-8c54-46cf-af0e-3d0a689ce7b7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.026976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7ebd958-8c54-46cf-af0e-3d0a689ce7b7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.027593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-a7ebd958-8c54-46cf-af0e-3d0a689ce7b7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lazy-loading 'fault' on Instance uuid ec366efc-f03e-4022-9d20-aea3951399f2 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:34:52.091075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a7ebd958-8c54-46cf-af0e-3d0a689ce7b7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:52.100985 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a7ebd958-8c54-46cf-af0e-3d0a689ce7b7 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1300 microversion: 2.1 time: 0.141233 Jul 14 14:34:52.101594 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1050/2094] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:51 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1300 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:52.182680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f0999dc3-fcac-4f0b-99cb-8897e7ebaec1 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:52.194080 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f0999dc3-fcac-4f0b-99cb-8897e7ebaec1 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1699 microversion: 2.1 time: 0.243913 Jul 14 14:34:52.195001 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1045/2095] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:51 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1699 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:52.199570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-586be442-f428-495d-b99d-0d2b896ef728 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.200186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-586be442-f428-495d-b99d-0d2b896ef728 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:52.208136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-586be442-f428-495d-b99d-0d2b896ef728 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.208822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-586be442-f428-495d-b99d-0d2b896ef728 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.209730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-586be442-f428-495d-b99d-0d2b896ef728 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.210179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-586be442-f428-495d-b99d-0d2b896ef728 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.263174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1574514584", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:52.326889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:34:52.477559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-586be442-f428-495d-b99d-0d2b896ef728 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:52.485366 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-586be442-f428-495d-b99d-0d2b896ef728 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1317 microversion: 2.1 time: 0.289130 Jul 14 14:34:52.486210 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1046/2096] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:52 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:52.491105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-de2dc866-b40d-4765-b37b-0ac193787f07 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.492109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-de2dc866-b40d-4765-b37b-0ac193787f07 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: 9df45cbe-095e-4ee6-84e9-281a0a16bf0c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:52.499036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de2dc866-b40d-4765-b37b-0ac193787f07 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.499487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de2dc866-b40d-4765-b37b-0ac193787f07 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.500273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de2dc866-b40d-4765-b37b-0ac193787f07 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.501302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de2dc866-b40d-4765-b37b-0ac193787f07 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.515652 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-de2dc866-b40d-4765-b37b-0ac193787f07 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] HTTP exception thrown: Instance 9df45cbe-095e-4ee6-84e9-281a0a16bf0c could not be found. Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-de2dc866-b40d-4765-b37b-0ac193787f07 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Request method failure captured: Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c HTTP/1.1 Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch2LdshHkgnfLKQ09Th5yFEtJ6NDMhU3YAv5gfwMPVRyjuGs5ounfti5Desm3i53FZSU8EucGNP4Rzy0S71lUdQcdXKedt82m6kz-LwLm_uJeWZZr8mFflHZ4u7MMkkfwx71zlLEQcauCAP4aVIdWxl0MQgHe5i5BrB1GsD5uwHXUA Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3755ed287bff4882ac3ead9acadfa731", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}] Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 31ab545bcb3a47b38c53fbfa6b11a432 Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 9df45cbe-095e-4ee6-84e9-281a0a16bf0c could not be found. Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '9df45cbe-095e-4ee6-84e9-281a0a16bf0c'} Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df45cbe-095e-4ee6-84e9-281a0a16bf0c could not be found. Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df45cbe-095e-4ee6-84e9-281a0a16bf0c could not be found. Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.518330 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.523364 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.523364 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.523364 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:52.523364 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:52.523364 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df45cbe-095e-4ee6-84e9-281a0a16bf0c could not be found. Jul 14 14:34:52.523364 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.523364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-de2dc866-b40d-4765-b37b-0ac193787f07 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Returning 404 to user: Instance 9df45cbe-095e-4ee6-84e9-281a0a16bf0c could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:52.523364 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-de2dc866-b40d-4765-b37b-0ac193787f07 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c" status: 404 len: 111 microversion: 2.1 time: 0.032417 Jul 14 14:34:52.523364 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1047/2097] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:52 2022] GET /compute/v2.1/servers/9df45cbe-095e-4ee6-84e9-281a0a16bf0c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:52.527988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6020d2d-a8bd-44ae-837e-f5fffd682855 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5395d30>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.550800 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b6020d2d-a8bd-44ae-837e-f5fffd682855 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] HTTP exception thrown: Image not found. Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6020d2d-a8bd-44ae-837e-f5fffd682855 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Request method failure captured: Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb HTTP/1.1 Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch2LdshHkgnfLKQ09Th5yFEtJ6NDMhU3YAv5gfwMPVRyjuGs5ounfti5Desm3i53FZSU8EucGNP4Rzy0S71lUdQcdXKedt82m6kz-LwLm_uJeWZZr8mFflHZ4u7MMkkfwx71zlLEQcauCAP4aVIdWxl0MQgHe5i5BrB1GsD5uwHXUA Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3755ed287bff4882ac3ead9acadfa731", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}] Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 31ab545bcb3a47b38c53fbfa6b11a432 Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'a17a0250-c5ad-470f-aac1-963e63c21edb'} Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a17a0250-c5ad-470f-aac1-963e63c21edb to delete Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a17a0250-c5ad-470f-aac1-963e63c21edb could not be found. Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.552614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.556057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6020d2d-a8bd-44ae-837e-f5fffd682855 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:52.564713 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b6020d2d-a8bd-44ae-837e-f5fffd682855 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb" status: 404 len: 62 microversion: 2.1 time: 0.030500 Jul 14 14:34:52.569080 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1048/2098] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:52 2022] DELETE /compute/v2.1/images/a17a0250-c5ad-470f-aac1-963e63c21edb => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:34:52.575054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23fd0d9d-3e6c-4de8-9b2d-b45a3db70c6c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.575739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-23fd0d9d-3e6c-4de8-9b2d-b45a3db70c6c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:52.586613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23fd0d9d-3e6c-4de8-9b2d-b45a3db70c6c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.589230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23fd0d9d-3e6c-4de8-9b2d-b45a3db70c6c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.590823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23fd0d9d-3e6c-4de8-9b2d-b45a3db70c6c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.591471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23fd0d9d-3e6c-4de8-9b2d-b45a3db70c6c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.618591 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-23fd0d9d-3e6c-4de8-9b2d-b45a3db70c6c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] HTTP exception thrown: Instance cdad3a0f-8ff2-44ed-9523-482791b158be could not be found. Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23fd0d9d-3e6c-4de8-9b2d-b45a3db70c6c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Request method failure captured: Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be HTTP/1.1 Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch2LdshHkgnfLKQ09Th5yFEtJ6NDMhU3YAv5gfwMPVRyjuGs5ounfti5Desm3i53FZSU8EucGNP4Rzy0S71lUdQcdXKedt82m6kz-LwLm_uJeWZZr8mFflHZ4u7MMkkfwx71zlLEQcauCAP4aVIdWxl0MQgHe5i5BrB1GsD5uwHXUA Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3755ed287bff4882ac3ead9acadfa731", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}] Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 31ab545bcb3a47b38c53fbfa6b11a432 Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance cdad3a0f-8ff2-44ed-9523-482791b158be could not be found. Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'cdad3a0f-8ff2-44ed-9523-482791b158be'} Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdad3a0f-8ff2-44ed-9523-482791b158be could not be found. Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:52.620184 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdad3a0f-8ff2-44ed-9523-482791b158be could not be found. Jul 14 14:34:52.623790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.623790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.623790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.623790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.623790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.623790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.623790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:52.623790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:52.623790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdad3a0f-8ff2-44ed-9523-482791b158be could not be found. Jul 14 14:34:52.623790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.623790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23fd0d9d-3e6c-4de8-9b2d-b45a3db70c6c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Returning 404 to user: Instance cdad3a0f-8ff2-44ed-9523-482791b158be could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:52.623790 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-23fd0d9d-3e6c-4de8-9b2d-b45a3db70c6c tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 404 len: 111 microversion: 2.1 time: 0.051321 Jul 14 14:34:52.626124 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1049/2099] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:52 2022] DELETE /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:52.631107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-544e3129-4976-4794-97c4-0075dd96e508 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.631731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-544e3129-4976-4794-97c4-0075dd96e508 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: cdad3a0f-8ff2-44ed-9523-482791b158be] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:52.633914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:34:52.634823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:34:52.634823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:34:52.635248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:34:52.635673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:34:52.638180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-544e3129-4976-4794-97c4-0075dd96e508 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.638636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-544e3129-4976-4794-97c4-0075dd96e508 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.639419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-544e3129-4976-4794-97c4-0075dd96e508 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.639859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-544e3129-4976-4794-97c4-0075dd96e508 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.653350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.654872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.662371 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-544e3129-4976-4794-97c4-0075dd96e508 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] HTTP exception thrown: Instance cdad3a0f-8ff2-44ed-9523-482791b158be could not be found. Jul 14 14:34:52.662879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-544e3129-4976-4794-97c4-0075dd96e508 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Request method failure captured: Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be HTTP/1.1 Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch2LdshHkgnfLKQ09Th5yFEtJ6NDMhU3YAv5gfwMPVRyjuGs5ounfti5Desm3i53FZSU8EucGNP4Rzy0S71lUdQcdXKedt82m6kz-LwLm_uJeWZZr8mFflHZ4u7MMkkfwx71zlLEQcauCAP4aVIdWxl0MQgHe5i5BrB1GsD5uwHXUA Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3755ed287bff4882ac3ead9acadfa731", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}] Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 31ab545bcb3a47b38c53fbfa6b11a432 Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance cdad3a0f-8ff2-44ed-9523-482791b158be could not be found. Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'cdad3a0f-8ff2-44ed-9523-482791b158be'} Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdad3a0f-8ff2-44ed-9523-482791b158be could not be found. Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdad3a0f-8ff2-44ed-9523-482791b158be could not be found. Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.663940 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.669191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.669191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.669191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:52.669191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:52.669191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdad3a0f-8ff2-44ed-9523-482791b158be could not be found. Jul 14 14:34:52.669191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.669191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-544e3129-4976-4794-97c4-0075dd96e508 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Returning 404 to user: Instance cdad3a0f-8ff2-44ed-9523-482791b158be could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:52.669191 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-544e3129-4976-4794-97c4-0075dd96e508 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be" status: 404 len: 111 microversion: 2.1 time: 0.038373 Jul 14 14:34:52.669819 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1050/2100] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:52 2022] GET /compute/v2.1/servers/cdad3a0f-8ff2-44ed-9523-482791b158be => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:52.670763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.674272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a1a1f10c-13a7-4570-9308-aa1b84560614 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5e244c0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.704856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Getting quotas for project d3fd17b0a0dc45f08d3c9b4cfdb6da21. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:34:52.712009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Getting quotas for user 461baecf4a774ef8ac1060fdf06ab7aa and project d3fd17b0a0dc45f08d3c9b4cfdb6da21. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:34:52.727198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:34:52.733519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:34:52.739444 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-a1a1f10c-13a7-4570-9308-aa1b84560614 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] HTTP exception thrown: Image not found. Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a1a1f10c-13a7-4570-9308-aa1b84560614 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Request method failure captured: Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae HTTP/1.1 Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch2LdshHkgnfLKQ09Th5yFEtJ6NDMhU3YAv5gfwMPVRyjuGs5ounfti5Desm3i53FZSU8EucGNP4Rzy0S71lUdQcdXKedt82m6kz-LwLm_uJeWZZr8mFflHZ4u7MMkkfwx71zlLEQcauCAP4aVIdWxl0MQgHe5i5BrB1GsD5uwHXUA Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3755ed287bff4882ac3ead9acadfa731", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}] Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 31ab545bcb3a47b38c53fbfa6b11a432 Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'ac42049a-e09d-4996-b570-723f7f07b9ae'} Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ac42049a-e09d-4996-b570-723f7f07b9ae to delete Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac42049a-e09d-4996-b570-723f7f07b9ae could not be found. Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.741991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a1a1f10c-13a7-4570-9308-aa1b84560614 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a1a1f10c-13a7-4570-9308-aa1b84560614 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae" status: 404 len: 62 microversion: 2.1 time: 0.073782 Jul 14 14:34:52.752195 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1051/2101] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:52 2022] DELETE /compute/v2.1/images/ac42049a-e09d-4996-b570-723f7f07b9ae => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:34:52.777260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d949a76e-d734-4113-8406-9d67b07d318a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.777777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d949a76e-d734-4113-8406-9d67b07d318a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:52.792178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d949a76e-d734-4113-8406-9d67b07d318a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.792615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d949a76e-d734-4113-8406-9d67b07d318a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.793482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d949a76e-d734-4113-8406-9d67b07d318a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.794406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d949a76e-d734-4113-8406-9d67b07d318a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.836684 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-d949a76e-d734-4113-8406-9d67b07d318a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] HTTP exception thrown: Instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 could not be found. Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d949a76e-d734-4113-8406-9d67b07d318a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Request method failure captured: Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 HTTP/1.1 Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch2LdshHkgnfLKQ09Th5yFEtJ6NDMhU3YAv5gfwMPVRyjuGs5ounfti5Desm3i53FZSU8EucGNP4Rzy0S71lUdQcdXKedt82m6kz-LwLm_uJeWZZr8mFflHZ4u7MMkkfwx71zlLEQcauCAP4aVIdWxl0MQgHe5i5BrB1GsD5uwHXUA Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3755ed287bff4882ac3ead9acadfa731", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}] Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 31ab545bcb3a47b38c53fbfa6b11a432 Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 could not be found. Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'c850b90e-27fa-4f9a-bd80-6704843cb1a0'} Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 could not be found. Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:52.840305 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 could not be found. Jul 14 14:34:52.843643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.843643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.843643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.843643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.843643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.843643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.843643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:52.843643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:52.843643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 could not be found. Jul 14 14:34:52.843643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.847087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d949a76e-d734-4113-8406-9d67b07d318a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Returning 404 to user: Instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:52.848166 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d949a76e-d734-4113-8406-9d67b07d318a tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 404 len: 111 microversion: 2.1 time: 0.095252 Jul 14 14:34:52.850060 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1052/2102] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:52 2022] DELETE /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:52.867381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-27b84f76-bbda-4119-9adb-ef0239922c1e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.868369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-27b84f76-bbda-4119-9adb-ef0239922c1e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: c850b90e-27fa-4f9a-bd80-6704843cb1a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:52.878322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27b84f76-bbda-4119-9adb-ef0239922c1e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.878911 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cff56b20-3981-4f4b-901c-620f0fc8c24c tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776230 Jul 14 14:34:52.879375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27b84f76-bbda-4119-9adb-ef0239922c1e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.886136 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1051/2103] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:34:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:34:52.886981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27b84f76-bbda-4119-9adb-ef0239922c1e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.887598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27b84f76-bbda-4119-9adb-ef0239922c1e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.901034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ad724c3f-957c-4ca3-b573-039c882f9870 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.901864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ad724c3f-957c-4ca3-b573-039c882f9870 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:52.911802 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-27b84f76-bbda-4119-9adb-ef0239922c1e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] HTTP exception thrown: Instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 could not be found. Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-27b84f76-bbda-4119-9adb-ef0239922c1e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Request method failure captured: Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 HTTP/1.1 Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch2LdshHkgnfLKQ09Th5yFEtJ6NDMhU3YAv5gfwMPVRyjuGs5ounfti5Desm3i53FZSU8EucGNP4Rzy0S71lUdQcdXKedt82m6kz-LwLm_uJeWZZr8mFflHZ4u7MMkkfwx71zlLEQcauCAP4aVIdWxl0MQgHe5i5BrB1GsD5uwHXUA Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3755ed287bff4882ac3ead9acadfa731", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}] Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 31ab545bcb3a47b38c53fbfa6b11a432 Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 could not be found. Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'c850b90e-27fa-4f9a-bd80-6704843cb1a0'} Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 could not be found. Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 could not be found. Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.913252 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.917103 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.917103 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.917103 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:52.917103 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:52.917103 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 could not be found. Jul 14 14:34:52.917103 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.917103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-27b84f76-bbda-4119-9adb-ef0239922c1e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Returning 404 to user: Instance c850b90e-27fa-4f9a-bd80-6704843cb1a0 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:52.917103 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-27b84f76-bbda-4119-9adb-ef0239922c1e tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0" status: 404 len: 111 microversion: 2.1 time: 0.057606 Jul 14 14:34:52.917103 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1053/2104] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:52 2022] GET /compute/v2.1/servers/c850b90e-27fa-4f9a-bd80-6704843cb1a0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:52.938948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c409974b-6cac-42e4-8700-e4a1b79e1025 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.939752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c409974b-6cac-42e4-8700-e4a1b79e1025 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:52.949572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c409974b-6cac-42e4-8700-e4a1b79e1025 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.950197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c409974b-6cac-42e4-8700-e4a1b79e1025 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.952491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c409974b-6cac-42e4-8700-e4a1b79e1025 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.954537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c409974b-6cac-42e4-8700-e4a1b79e1025 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.009473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ad724c3f-957c-4ca3-b573-039c882f9870 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:53.017679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ad724c3f-957c-4ca3-b573-039c882f9870 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1214 microversion: 2.1 time: 0.130379 Jul 14 14:34:53.026874 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1052/2105] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:52 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:53.029744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-acbd3c62-dbc8-4ea1-8f24-06487ef252ad tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:53.031094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-acbd3c62-dbc8-4ea1-8f24-06487ef252ad tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:53.039183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-acbd3c62-dbc8-4ea1-8f24-06487ef252ad tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.039642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-acbd3c62-dbc8-4ea1-8f24-06487ef252ad tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.057688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-acbd3c62-dbc8-4ea1-8f24-06487ef252ad tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.058293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-acbd3c62-dbc8-4ea1-8f24-06487ef252ad tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.342712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c409974b-6cac-42e4-8700-e4a1b79e1025 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:53.357087 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c409974b-6cac-42e4-8700-e4a1b79e1025 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1539 microversion: 2.1 time: 0.421678 Jul 14 14:34:53.357702 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1054/2106] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:52 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1539 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:53.379457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e86a1251-05fc-4896-abaf-6fb956ec7793 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '.version_select at 0x7fd6c5f1a280>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:53.413152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-acbd3c62-dbc8-4ea1-8f24-06487ef252ad tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:53.425864 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-acbd3c62-dbc8-4ea1-8f24-06487ef252ad tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.403548 Jul 14 14:34:53.429313 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1053/2107] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:53 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:53.439049 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-e86a1251-05fc-4896-abaf-6fb956ec7793 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] HTTP exception thrown: Image not found. Jul 14 14:34:53.442389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-23b21652-44b3-4288-963b-f445ba007239 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e86a1251-05fc-4896-abaf-6fb956ec7793 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Request method failure captured: Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a HTTP/1.1 Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch2LdshHkgnfLKQ09Th5yFEtJ6NDMhU3YAv5gfwMPVRyjuGs5ounfti5Desm3i53FZSU8EucGNP4Rzy0S71lUdQcdXKedt82m6kz-LwLm_uJeWZZr8mFflHZ4u7MMkkfwx71zlLEQcauCAP4aVIdWxl0MQgHe5i5BrB1GsD5uwHXUA Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3755ed287bff4882ac3ead9acadfa731", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}] Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 31ab545bcb3a47b38c53fbfa6b11a432 Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '24518304-8292-482a-a03b-ff1781ea124a'} Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 24518304-8292-482a-a03b-ff1781ea124a to delete Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 24518304-8292-482a-a03b-ff1781ea124a could not be found. Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.443041 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:34:53.447458 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.448997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-23b21652-44b3-4288-963b-f445ba007239 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:53.449086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e86a1251-05fc-4896-abaf-6fb956ec7793 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:53.450278 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e86a1251-05fc-4896-abaf-6fb956ec7793 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a" status: 404 len: 62 microversion: 2.1 time: 0.087427 Jul 14 14:34:53.450278 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1055/2108] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:53 2022] DELETE /compute/v2.1/images/24518304-8292-482a-a03b-ff1781ea124a => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:34:53.451617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23b21652-44b3-4288-963b-f445ba007239 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.454315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23b21652-44b3-4288-963b-f445ba007239 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.455899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23b21652-44b3-4288-963b-f445ba007239 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.456429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23b21652-44b3-4288-963b-f445ba007239 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.461432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-efb522a3-81cb-437e-8f22-c3f7a07283e4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:53.462059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-efb522a3-81cb-437e-8f22-c3f7a07283e4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:53.473408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efb522a3-81cb-437e-8f22-c3f7a07283e4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.473878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efb522a3-81cb-437e-8f22-c3f7a07283e4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.475143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efb522a3-81cb-437e-8f22-c3f7a07283e4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.476240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efb522a3-81cb-437e-8f22-c3f7a07283e4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.496731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23b21652-44b3-4288-963b-f445ba007239 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.497426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23b21652-44b3-4288-963b-f445ba007239 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.498022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-23b21652-44b3-4288-963b-f445ba007239 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lazy-loading 'fault' on Instance uuid ec366efc-f03e-4022-9d20-aea3951399f2 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:34:53.583960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-23b21652-44b3-4288-963b-f445ba007239 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:53.596971 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-23b21652-44b3-4288-963b-f445ba007239 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 200 len: 1300 microversion: 2.1 time: 0.164161 Jul 14 14:34:53.610088 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1054/2109] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:53 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 1300 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:53.610088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4ca03752-fb7e-408d-a05d-2a80fcfd1169 req-e02fbe3e-4212-4ca0-a685-45b6ad43bf3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63e0542-7919-4dab-ac01-8886ee2810ce", "name": "network-vif-plugged", "status": "completed", "tag": "133c788b-8267-4ccc-867a-c10f112b9cc1"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:53.617246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4ca03752-fb7e-408d-a05d-2a80fcfd1169 req-e02fbe3e-4212-4ca0-a685-45b6ad43bf3b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.617701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4ca03752-fb7e-408d-a05d-2a80fcfd1169 req-e02fbe3e-4212-4ca0-a685-45b6ad43bf3b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.629840 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4ca03752-fb7e-408d-a05d-2a80fcfd1169 req-e02fbe3e-4212-4ca0-a685-45b6ad43bf3b service nova] Creating event network-vif-plugged:133c788b-8267-4ccc-867a-c10f112b9cc1 for instance d63e0542-7919-4dab-ac01-8886ee2810ce on n-h2-767704-28 Jul 14 14:34:53.635507 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4ca03752-fb7e-408d-a05d-2a80fcfd1169 req-e02fbe3e-4212-4ca0-a685-45b6ad43bf3b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036141 Jul 14 14:34:53.639235 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1055/2110] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:53.645971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7d36e957-6027-4b01-bca6-ffb04a060e1b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:53.646567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7d36e957-6027-4b01-bca6-ffb04a060e1b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:53.653905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d36e957-6027-4b01-bca6-ffb04a060e1b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.654359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d36e957-6027-4b01-bca6-ffb04a060e1b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.655149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d36e957-6027-4b01-bca6-ffb04a060e1b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.655590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d36e957-6027-4b01-bca6-ffb04a060e1b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.671472 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-7d36e957-6027-4b01-bca6-ffb04a060e1b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] HTTP exception thrown: Instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 could not be found. Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7d36e957-6027-4b01-bca6-ffb04a060e1b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Request method failure captured: Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 HTTP/1.1 Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ch2LdshHkgnfLKQ09Th5yFEtJ6NDMhU3YAv5gfwMPVRyjuGs5ounfti5Desm3i53FZSU8EucGNP4Rzy0S71lUdQcdXKedt82m6kz-LwLm_uJeWZZr8mFflHZ4u7MMkkfwx71zlLEQcauCAP4aVIdWxl0MQgHe5i5BrB1GsD5uwHXUA Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3755ed287bff4882ac3ead9acadfa731", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}] Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 31ab545bcb3a47b38c53fbfa6b11a432 Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 could not be found. Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'dc69728d-ad31-4750-a7e2-ef09d6dd3686'} Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 could not be found. Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:53.674107 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 could not be found. Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 could not be found. Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7d36e957-6027-4b01-bca6-ffb04a060e1b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Returning 404 to user: Instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7d36e957-6027-4b01-bca6-ffb04a060e1b tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 404 len: 111 microversion: 2.1 time: 0.035125 Jul 14 14:34:53.677276 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1056/2111] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:53 2022] DELETE /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:53.681076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a230b843-f687-487b-ad18-2520629fcbd9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:53.681697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a230b843-f687-487b-ad18-2520629fcbd9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:53.689761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a230b843-f687-487b-ad18-2520629fcbd9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.690218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a230b843-f687-487b-ad18-2520629fcbd9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.691363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a230b843-f687-487b-ad18-2520629fcbd9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.691816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a230b843-f687-487b-ad18-2520629fcbd9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.714608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-efb522a3-81cb-437e-8f22-c3f7a07283e4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:53.730814 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-efb522a3-81cb-437e-8f22-c3f7a07283e4 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1699 microversion: 2.1 time: 0.269668 Jul 14 14:34:53.731562 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1056/2112] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:53 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1699 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:53.739314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-41e73f7d-0eeb-45e9-87cc-70675abb9a62 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:53.741994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-41e73f7d-0eeb-45e9-87cc-70675abb9a62 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] [instance: dc69728d-ad31-4750-a7e2-ef09d6dd3686] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:53.748591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41e73f7d-0eeb-45e9-87cc-70675abb9a62 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.749172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41e73f7d-0eeb-45e9-87cc-70675abb9a62 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.752861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41e73f7d-0eeb-45e9-87cc-70675abb9a62 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.752861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41e73f7d-0eeb-45e9-87cc-70675abb9a62 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.768883 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-41e73f7d-0eeb-45e9-87cc-70675abb9a62 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] HTTP exception thrown: Instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 could not be found. Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-41e73f7d-0eeb-45e9-87cc-70675abb9a62 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Request method failure captured: Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 HTTP/1.1 Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ch2LdshHkgnfLKQ09Th5yFEtJ6NDMhU3YAv5gfwMPVRyjuGs5ounfti5Desm3i53FZSU8EucGNP4Rzy0S71lUdQcdXKedt82m6kz-LwLm_uJeWZZr8mFflHZ4u7MMkkfwx71zlLEQcauCAP4aVIdWxl0MQgHe5i5BrB1GsD5uwHXUA Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3755ed287bff4882ac3ead9acadfa731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3755ed287bff4882ac3ead9acadfa731", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3755ed287bff4882ac3ead9acadfa731"}]}] Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3755ed287bff4882ac3ead9acadfa731 Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesTestJSON-1601355520 Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 31ab545bcb3a47b38c53fbfa6b11a432 Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesTestJSON-1601355520-project Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 could not be found. Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'dc69728d-ad31-4750-a7e2-ef09d6dd3686'} Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 could not be found. Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 could not be found. Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.770784 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:53.774575 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:53.774575 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:53.774575 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:53.774575 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:53.774575 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 could not be found. Jul 14 14:34:53.774575 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:53.774575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-41e73f7d-0eeb-45e9-87cc-70675abb9a62 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] Returning 404 to user: Instance dc69728d-ad31-4750-a7e2-ef09d6dd3686 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:53.774575 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-41e73f7d-0eeb-45e9-87cc-70675abb9a62 tempest-ImagesTestJSON-1601355520 tempest-ImagesTestJSON-1601355520-project] 10.222.0.81 "GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686" status: 404 len: 111 microversion: 2.1 time: 0.039505 Jul 14 14:34:53.774575 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1057/2113] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:53 2022] GET /compute/v2.1/servers/dc69728d-ad31-4750-a7e2-ef09d6dd3686 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:53.878611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a230b843-f687-487b-ad18-2520629fcbd9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:53.888397 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a230b843-f687-487b-ad18-2520629fcbd9 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1317 microversion: 2.1 time: 0.211179 Jul 14 14:34:53.890297 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1057/2114] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:53 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:54.035285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cef97369-fbb5-434a-be0a-44bfd922dbbc tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:54.036074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cef97369-fbb5-434a-be0a-44bfd922dbbc tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:54.042920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cef97369-fbb5-434a-be0a-44bfd922dbbc tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.043405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cef97369-fbb5-434a-be0a-44bfd922dbbc tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.044208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cef97369-fbb5-434a-be0a-44bfd922dbbc tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.044656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cef97369-fbb5-434a-be0a-44bfd922dbbc tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.114327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cef97369-fbb5-434a-be0a-44bfd922dbbc tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:54.122615 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cef97369-fbb5-434a-be0a-44bfd922dbbc tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1266 microversion: 2.1 time: 0.092481 Jul 14 14:34:54.123202 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1058/2115] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:54 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:54.379665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fc9c2d1f-5f3f-4441-8aed-526477f55fb1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:54.380356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fc9c2d1f-5f3f-4441-8aed-526477f55fb1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:54.394916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc9c2d1f-5f3f-4441-8aed-526477f55fb1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.399674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc9c2d1f-5f3f-4441-8aed-526477f55fb1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.404910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc9c2d1f-5f3f-4441-8aed-526477f55fb1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.406274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc9c2d1f-5f3f-4441-8aed-526477f55fb1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.447857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-42a3803b-80c9-45ac-bdfe-b57f0c30b55d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:54.450209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-42a3803b-80c9-45ac-bdfe-b57f0c30b55d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:54.476286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42a3803b-80c9-45ac-bdfe-b57f0c30b55d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.476994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42a3803b-80c9-45ac-bdfe-b57f0c30b55d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.480403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42a3803b-80c9-45ac-bdfe-b57f0c30b55d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.481124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42a3803b-80c9-45ac-bdfe-b57f0c30b55d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.819195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-42a3803b-80c9-45ac-bdfe-b57f0c30b55d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:54.830831 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-42a3803b-80c9-45ac-bdfe-b57f0c30b55d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1506 microversion: 2.1 time: 0.390630 Jul 14 14:34:54.833169 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1059/2116] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:54 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:54.849564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d11f4e48-6b15-46c7-b1d4-9dd20912aaee tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:54.850943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d11f4e48-6b15-46c7-b1d4-9dd20912aaee tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: ec366efc-f03e-4022-9d20-aea3951399f2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:54.861967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d11f4e48-6b15-46c7-b1d4-9dd20912aaee tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.862824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d11f4e48-6b15-46c7-b1d4-9dd20912aaee tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.864079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d11f4e48-6b15-46c7-b1d4-9dd20912aaee tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.864724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d11f4e48-6b15-46c7-b1d4-9dd20912aaee tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.881871 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-d11f4e48-6b15-46c7-b1d4-9dd20912aaee tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] HTTP exception thrown: Instance ec366efc-f03e-4022-9d20-aea3951399f2 could not be found. Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d11f4e48-6b15-46c7-b1d4-9dd20912aaee tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Request method failure captured: Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 HTTP/1.1 Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cenn4HU6XkCSY8qKqNCtkj6EvAzCRdwvC06iSpmLiVyhSUWxuIzZIPEQEdKeZRDKKUXKEFspjEEHlcgyLRfCgc_reNU80sIs6r5NSJmX_obgK7APw5HK0H7_IHDyQzRVnvg5ehEmnYCMqjX13d3c7t459-Ewe3WClvGjcx4jm3o-Po Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: eb57648abd7742d9aac69af1744d6bc1 Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-LiveMigrationTest-1854408993 Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/eb57648abd7742d9aac69af1744d6bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/eb57648abd7742d9aac69af1744d6bc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_eb57648abd7742d9aac69af1744d6bc1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/eb57648abd7742d9aac69af1744d6bc1"}]}] Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-LiveMigrationTest-1854408993 Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: eb57648abd7742d9aac69af1744d6bc1 Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-LiveMigrationTest-1854408993 Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-LiveMigrationTest-1854408993-project Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 5c688cde0ea44a059b0bca3e020c28b3 Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-LiveMigrationTest-1854408993-project Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance ec366efc-f03e-4022-9d20-aea3951399f2 could not be found. Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'ec366efc-f03e-4022-9d20-aea3951399f2'} Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec366efc-f03e-4022-9d20-aea3951399f2 could not be found. Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec366efc-f03e-4022-9d20-aea3951399f2 could not be found. Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:54.898034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:54.901548 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:54.901548 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:54.901548 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:54.901548 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:54.901548 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:54.901548 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec366efc-f03e-4022-9d20-aea3951399f2 could not be found. Jul 14 14:34:54.901548 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:34:54.901548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d11f4e48-6b15-46c7-b1d4-9dd20912aaee tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Returning 404 to user: Instance ec366efc-f03e-4022-9d20-aea3951399f2 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:54.901548 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d11f4e48-6b15-46c7-b1d4-9dd20912aaee tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2" status: 404 len: 111 microversion: 2.1 time: 0.061558 Jul 14 14:34:54.903452 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1060/2117] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:54 2022] GET /compute/v2.1/servers/ec366efc-f03e-4022-9d20-aea3951399f2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:54.920497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8db85eeb-5365-43fc-be66-d60d6c8c5bf6 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:54.923942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8db85eeb-5365-43fc-be66-d60d6c8c5bf6 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:54.945911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8db85eeb-5365-43fc-be66-d60d6c8c5bf6 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.947561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8db85eeb-5365-43fc-be66-d60d6c8c5bf6 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.949198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8db85eeb-5365-43fc-be66-d60d6c8c5bf6 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.949661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8db85eeb-5365-43fc-be66-d60d6c8c5bf6 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:55.025378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fc9c2d1f-5f3f-4441-8aed-526477f55fb1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:55.036471 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fc9c2d1f-5f3f-4441-8aed-526477f55fb1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1534 microversion: 2.1 time: 0.662183 Jul 14 14:34:55.042509 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1058/2118] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:54 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1534 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:55.051609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b56ae2f0-ee9c-42c4-b0c0-8850b81babfd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:55.052335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b56ae2f0-ee9c-42c4-b0c0-8850b81babfd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:55.062613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b56ae2f0-ee9c-42c4-b0c0-8850b81babfd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:55.063525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b56ae2f0-ee9c-42c4-b0c0-8850b81babfd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:55.064486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b56ae2f0-ee9c-42c4-b0c0-8850b81babfd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:55.065157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b56ae2f0-ee9c-42c4-b0c0-8850b81babfd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:55.104280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b56ae2f0-ee9c-42c4-b0c0-8850b81babfd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:55.209643 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b56ae2f0-ee9c-42c4-b0c0-8850b81babfd tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 204 len: 0 microversion: 2.1 time: 0.165076 Jul 14 14:34:55.210675 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1059/2119] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:55 2022] DELETE /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:55.220516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f95a36c0-a6fd-42dd-87fa-c9d148dfc09c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:55.221579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f95a36c0-a6fd-42dd-87fa-c9d148dfc09c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:55.229311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f95a36c0-a6fd-42dd-87fa-c9d148dfc09c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:55.229761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f95a36c0-a6fd-42dd-87fa-c9d148dfc09c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:55.230718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f95a36c0-a6fd-42dd-87fa-c9d148dfc09c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:55.231159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f95a36c0-a6fd-42dd-87fa-c9d148dfc09c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:55.258762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8db85eeb-5365-43fc-be66-d60d6c8c5bf6 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:55.282764 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8db85eeb-5365-43fc-be66-d60d6c8c5bf6 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1699 microversion: 2.1 time: 0.377674 Jul 14 14:34:55.283552 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1061/2120] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:54 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1699 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:55.288627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b82ab34-eecf-43cc-9f35-616a86667206 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:55.289277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0b82ab34-eecf-43cc-9f35-616a86667206 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:55.299302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b82ab34-eecf-43cc-9f35-616a86667206 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:55.300002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b82ab34-eecf-43cc-9f35-616a86667206 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:55.301095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b82ab34-eecf-43cc-9f35-616a86667206 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:55.302195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b82ab34-eecf-43cc-9f35-616a86667206 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:55.487703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0b82ab34-eecf-43cc-9f35-616a86667206 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:55.513336 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0b82ab34-eecf-43cc-9f35-616a86667206 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1272 microversion: 2.1 time: 0.228415 Jul 14 14:34:55.519158 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1062/2121] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:55 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:55.531739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-59de1de8-acc4-49f8-b3f1-4a7bc1aad144 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:55.532651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-59de1de8-acc4-49f8-b3f1-4a7bc1aad144 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:55.550264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59de1de8-acc4-49f8-b3f1-4a7bc1aad144 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:55.551482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59de1de8-acc4-49f8-b3f1-4a7bc1aad144 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:55.552673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59de1de8-acc4-49f8-b3f1-4a7bc1aad144 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:55.553217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59de1de8-acc4-49f8-b3f1-4a7bc1aad144 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:55.587920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f95a36c0-a6fd-42dd-87fa-c9d148dfc09c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:55.600185 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f95a36c0-a6fd-42dd-87fa-c9d148dfc09c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1317 microversion: 2.1 time: 0.387598 Jul 14 14:34:55.601703 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1060/2122] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:55 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:55.839839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-59de1de8-acc4-49f8-b3f1-4a7bc1aad144 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:55.850676 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-59de1de8-acc4-49f8-b3f1-4a7bc1aad144 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1499 microversion: 2.1 time: 0.328594 Jul 14 14:34:55.851451 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1063/2123] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:55 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1499 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:55.872779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af35ff7c-61ec-43fc-865b-e0b8e187ad47 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:55.872779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-af35ff7c-61ec-43fc-865b-e0b8e187ad47 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:55.881991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af35ff7c-61ec-43fc-865b-e0b8e187ad47 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:55.882457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af35ff7c-61ec-43fc-865b-e0b8e187ad47 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:55.883240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af35ff7c-61ec-43fc-865b-e0b8e187ad47 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:55.883680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af35ff7c-61ec-43fc-865b-e0b8e187ad47 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.063692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cf298577-1d67-4cc7-b6c9-99eb32bd52ce tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:56.064787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cf298577-1d67-4cc7-b6c9-99eb32bd52ce tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:56.077290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf298577-1d67-4cc7-b6c9-99eb32bd52ce tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.079885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf298577-1d67-4cc7-b6c9-99eb32bd52ce tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.080985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf298577-1d67-4cc7-b6c9-99eb32bd52ce tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.081996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf298577-1d67-4cc7-b6c9-99eb32bd52ce tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.356317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-af35ff7c-61ec-43fc-865b-e0b8e187ad47 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:56.365816 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af35ff7c-61ec-43fc-865b-e0b8e187ad47 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1527 microversion: 2.1 time: 0.515873 Jul 14 14:34:56.369834 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1061/2124] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:55 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1527 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:56.382615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ac413455-e0c8-442e-b24b-2b58c0b9545e req-2c045a7e-56ec-464d-b548-3476ee99c885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311addf3-6349-4923-8f5b-89f80e649e21", "name": "network-vif-deleted", "tag": "8c7f6fa5-ec9a-4d3e-ab0f-bb398a38696c"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:56.417002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ac413455-e0c8-442e-b24b-2b58c0b9545e req-2c045a7e-56ec-464d-b548-3476ee99c885 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.417812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ac413455-e0c8-442e-b24b-2b58c0b9545e req-2c045a7e-56ec-464d-b548-3476ee99c885 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.434443 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ac413455-e0c8-442e-b24b-2b58c0b9545e req-2c045a7e-56ec-464d-b548-3476ee99c885 service nova] Creating event network-vif-deleted:8c7f6fa5-ec9a-4d3e-ab0f-bb398a38696c for instance 311addf3-6349-4923-8f5b-89f80e649e21 on n-h2-767704-28 Jul 14 14:34:56.456619 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ac413455-e0c8-442e-b24b-2b58c0b9545e req-2c045a7e-56ec-464d-b548-3476ee99c885 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085262 Jul 14 14:34:56.457272 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1062/2125] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:56.462313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7789ec5a-dbde-46ca-bcdf-24a64897d7b5 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:56.463019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7789ec5a-dbde-46ca-bcdf-24a64897d7b5 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:56.480885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7789ec5a-dbde-46ca-bcdf-24a64897d7b5 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.481726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7789ec5a-dbde-46ca-bcdf-24a64897d7b5 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.482914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7789ec5a-dbde-46ca-bcdf-24a64897d7b5 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.483582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7789ec5a-dbde-46ca-bcdf-24a64897d7b5 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.647788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7789ec5a-dbde-46ca-bcdf-24a64897d7b5 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf4359ec8544e118d266ef97e131398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058b0841c5944cfdb9fa3c15cf63d395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:56.665779 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7789ec5a-dbde-46ca-bcdf-24a64897d7b5 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 200 len: 1351 microversion: 2.1 time: 0.203713 Jul 14 14:34:56.671098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cf298577-1d67-4cc7-b6c9-99eb32bd52ce tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:56.674299 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1063/2126] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:56 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 1351 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:56.690903 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cf298577-1d67-4cc7-b6c9-99eb32bd52ce tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1521 microversion: 2.1 time: 0.639315 Jul 14 14:34:56.691041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4dc33459-f54e-4068-b2ad-2becfb687b18 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:56.691671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4dc33459-f54e-4068-b2ad-2becfb687b18 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:56.693669 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1064/2127] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:56 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1521 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:56.708422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ca8d6535-3810-4bea-add8-1f8188fd9bb3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:56.709283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4dc33459-f54e-4068-b2ad-2becfb687b18 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.709692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ca8d6535-3810-4bea-add8-1f8188fd9bb3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:56.709799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4dc33459-f54e-4068-b2ad-2becfb687b18 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.710531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4dc33459-f54e-4068-b2ad-2becfb687b18 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.712363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4dc33459-f54e-4068-b2ad-2becfb687b18 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.727160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca8d6535-3810-4bea-add8-1f8188fd9bb3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.728517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca8d6535-3810-4bea-add8-1f8188fd9bb3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.729606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca8d6535-3810-4bea-add8-1f8188fd9bb3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.740057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca8d6535-3810-4bea-add8-1f8188fd9bb3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:57.166040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ca8d6535-3810-4bea-add8-1f8188fd9bb3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:57.175953 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ca8d6535-3810-4bea-add8-1f8188fd9bb3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1466 microversion: 2.1 time: 0.477684 Jul 14 14:34:57.189414 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1065/2128] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:56 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1466 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:57.195179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-79c69c43-26b9-4bef-ba78-d1451eee8008 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:57.195929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-79c69c43-26b9-4bef-ba78-d1451eee8008 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:57.203051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79c69c43-26b9-4bef-ba78-d1451eee8008 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:57.203737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79c69c43-26b9-4bef-ba78-d1451eee8008 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:57.204719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79c69c43-26b9-4bef-ba78-d1451eee8008 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:57.205340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79c69c43-26b9-4bef-ba78-d1451eee8008 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:57.233370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4dc33459-f54e-4068-b2ad-2becfb687b18 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:57.233713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-79c69c43-26b9-4bef-ba78-d1451eee8008 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:57.239955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:57.249895 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4dc33459-f54e-4068-b2ad-2becfb687b18 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1314 microversion: 2.1 time: 0.573480 Jul 14 14:34:57.253325 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1064/2129] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:56 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:57.274815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-854af2df-d5db-493f-9e00-fef83617a722 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:57.275468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-854af2df-d5db-493f-9e00-fef83617a722 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:57.304198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-854af2df-d5db-493f-9e00-fef83617a722 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:57.306029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-854af2df-d5db-493f-9e00-fef83617a722 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:57.309621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-854af2df-d5db-493f-9e00-fef83617a722 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:57.314388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-854af2df-d5db-493f-9e00-fef83617a722 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:57.333914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:57.338422 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-79c69c43-26b9-4bef-ba78-d1451eee8008 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 204 len: 0 microversion: 2.1 time: 0.147247 Jul 14 14:34:57.343372 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1066/2130] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:57 2022] DELETE /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:57.351747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b237f5c6-8bf4-4d89-becb-22154db2c684 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:57.354021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b237f5c6-8bf4-4d89-becb-22154db2c684 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:57.374003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b237f5c6-8bf4-4d89-becb-22154db2c684 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:57.374705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b237f5c6-8bf4-4d89-becb-22154db2c684 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:57.377431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b237f5c6-8bf4-4d89-becb-22154db2c684 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:57.378269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b237f5c6-8bf4-4d89-becb-22154db2c684 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:57.775385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-854af2df-d5db-493f-9e00-fef83617a722 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:57.790706 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-854af2df-d5db-493f-9e00-fef83617a722 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1499 microversion: 2.1 time: 0.533554 Jul 14 14:34:57.791314 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1065/2131] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:57 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1499 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:57.808559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c2d91e62-e4df-4bf9-b71f-70107d2b4faf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:57.811614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c2d91e62-e4df-4bf9-b71f-70107d2b4faf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:57.824842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2d91e62-e4df-4bf9-b71f-70107d2b4faf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:57.833135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2d91e62-e4df-4bf9-b71f-70107d2b4faf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:57.834301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2d91e62-e4df-4bf9-b71f-70107d2b4faf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:57.834921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2d91e62-e4df-4bf9-b71f-70107d2b4faf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:58.176359 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b237f5c6-8bf4-4d89-becb-22154db2c684 tempest-ServersOnMultiNodesTest-1802283370 tempest-ServersOnMultiNodesTest-1802283370-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1619 microversion: 2.1 time: 0.830578 Jul 14 14:34:58.183192 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1067/2132] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:57 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1619 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:58.195097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ab61516-adf2-48c9-a44a-26cb3bf834a9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:58.196540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8ab61516-adf2-48c9-a44a-26cb3bf834a9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:58.217765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ab61516-adf2-48c9-a44a-26cb3bf834a9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:58.218236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ab61516-adf2-48c9-a44a-26cb3bf834a9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:58.222906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ab61516-adf2-48c9-a44a-26cb3bf834a9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:58.223690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ab61516-adf2-48c9-a44a-26cb3bf834a9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:58.699900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c2d91e62-e4df-4bf9-b71f-70107d2b4faf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:58.747619 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c2d91e62-e4df-4bf9-b71f-70107d2b4faf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1527 microversion: 2.1 time: 0.944865 Jul 14 14:34:58.749051 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1066/2133] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:57 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1527 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:58.778199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9e88e53-1e02-4a87-ace0-8eeda4cc5976 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:58.780430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b9e88e53-1e02-4a87-ace0-8eeda4cc5976 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] [instance: 311addf3-6349-4923-8f5b-89f80e649e21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:58.805314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9e88e53-1e02-4a87-ace0-8eeda4cc5976 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:58.807482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9e88e53-1e02-4a87-ace0-8eeda4cc5976 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:58.810624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9e88e53-1e02-4a87-ace0-8eeda4cc5976 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:58.815254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9e88e53-1e02-4a87-ace0-8eeda4cc5976 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:58.841870 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-b9e88e53-1e02-4a87-ace0-8eeda4cc5976 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] HTTP exception thrown: Instance 311addf3-6349-4923-8f5b-89f80e649e21 could not be found. Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9e88e53-1e02-4a87-ace0-8eeda4cc5976 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Request method failure captured: Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 HTTP/1.1 Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ck61pP5qnOA1AuxKYOGR0fWRL0BwMs2Wwq15UwyLx-aTbVWGRTlp969tmj4he0zOYbjtAPS4CgLelaXDfayb25RyXfKH9gdwnvp0lVvl7yFH7vjWuqQ00PSorMlByNo3SIsuSWjo3zuzrbg9vhaInnnfPcrYd60M9GjR6mvBbJ1Rxs Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 058b0841c5944cfdb9fa3c15cf63d395 Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestJSON-1917457052 Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/058b0841c5944cfdb9fa3c15cf63d395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/058b0841c5944cfdb9fa3c15cf63d395"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_058b0841c5944cfdb9fa3c15cf63d395", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/058b0841c5944cfdb9fa3c15cf63d395"}]}] Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestJSON-1917457052 Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 058b0841c5944cfdb9fa3c15cf63d395 Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestJSON-1917457052 Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestJSON-1917457052-project Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4cf4359ec8544e118d266ef97e131398 Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestJSON-1917457052-project Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 311addf3-6349-4923-8f5b-89f80e649e21 could not be found. Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '311addf3-6349-4923-8f5b-89f80e649e21'} Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311addf3-6349-4923-8f5b-89f80e649e21 could not be found. Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311addf3-6349-4923-8f5b-89f80e649e21 could not be found. Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:58.846399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:58.853855 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:58.853855 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:58.853855 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:58.853855 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:58.853855 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311addf3-6349-4923-8f5b-89f80e649e21 could not be found. Jul 14 14:34:58.853855 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:34:58.854711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9e88e53-1e02-4a87-ace0-8eeda4cc5976 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Returning 404 to user: Instance 311addf3-6349-4923-8f5b-89f80e649e21 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:58.856190 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b9e88e53-1e02-4a87-ace0-8eeda4cc5976 tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21" status: 404 len: 111 microversion: 2.1 time: 0.104136 Jul 14 14:34:58.856441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8ab61516-adf2-48c9-a44a-26cb3bf834a9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:58.864348 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1067/2134] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:58 2022] GET /compute/v2.1/servers/311addf3-6349-4923-8f5b-89f80e649e21 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:58.876178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-95b4d5b2-a10e-40f8-9fce-6e98cb661020 req-758673a7-d281-42b9-8100-fb0d85a42bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c", "name": "network-vif-plugged", "status": "completed", "tag": "45612758-25eb-4c42-9ab2-3ee6cdf455bc"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:58.878693 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8ab61516-adf2-48c9-a44a-26cb3bf834a9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1522 microversion: 2.1 time: 0.693315 Jul 14 14:34:58.890654 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1068/2135] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:58 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1522 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:58.896345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-95b4d5b2-a10e-40f8-9fce-6e98cb661020 req-758673a7-d281-42b9-8100-fb0d85a42bfb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:58.896939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-95b4d5b2-a10e-40f8-9fce-6e98cb661020 req-758673a7-d281-42b9-8100-fb0d85a42bfb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:58.908512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9858605-114e-4f95-86d2-00f31f9db927 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:58.909395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c9858605-114e-4f95-86d2-00f31f9db927 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:58.919439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9858605-114e-4f95-86d2-00f31f9db927 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:58.920217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9858605-114e-4f95-86d2-00f31f9db927 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:58.921317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9858605-114e-4f95-86d2-00f31f9db927 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:58.921950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9858605-114e-4f95-86d2-00f31f9db927 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:58.925337 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-95b4d5b2-a10e-40f8-9fce-6e98cb661020 req-758673a7-d281-42b9-8100-fb0d85a42bfb service nova] Creating event network-vif-plugged:45612758-25eb-4c42-9ab2-3ee6cdf455bc for instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c on n-h2-767704-28 Jul 14 14:34:58.945693 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-95b4d5b2-a10e-40f8-9fce-6e98cb661020 req-758673a7-d281-42b9-8100-fb0d85a42bfb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082209 Jul 14 14:34:58.947595 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1068/2136] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:58.958221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eef727a8-2aa3-4019-b7d9-7f9b98193492 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:58.963048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eef727a8-2aa3-4019-b7d9-7f9b98193492 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:58.974637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eef727a8-2aa3-4019-b7d9-7f9b98193492 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:58.975105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eef727a8-2aa3-4019-b7d9-7f9b98193492 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:58.976250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eef727a8-2aa3-4019-b7d9-7f9b98193492 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:58.981046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eef727a8-2aa3-4019-b7d9-7f9b98193492 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:58.999484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c9858605-114e-4f95-86d2-00f31f9db927 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:59.183609 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c9858605-114e-4f95-86d2-00f31f9db927 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 204 len: 0 microversion: 2.1 time: 0.290148 Jul 14 14:34:59.184216 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1069/2137] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:58 2022] DELETE /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:59.194791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-949ce3f2-718e-4b91-87bd-a1704da4a5e4 req-6bde2e6d-35c6-4030-9abe-69776aea11a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae081a7-42be-48bc-8677-d0cf09d35d44", "name": "network-vif-deleted", "tag": "3f8c3da8-475e-4406-a1d0-02853d840025"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:59.222642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-949ce3f2-718e-4b91-87bd-a1704da4a5e4 req-6bde2e6d-35c6-4030-9abe-69776aea11a5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:59.223646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-949ce3f2-718e-4b91-87bd-a1704da4a5e4 req-6bde2e6d-35c6-4030-9abe-69776aea11a5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:59.257448 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-949ce3f2-718e-4b91-87bd-a1704da4a5e4 req-6bde2e6d-35c6-4030-9abe-69776aea11a5 service nova] Creating event network-vif-deleted:3f8c3da8-475e-4406-a1d0-02853d840025 for instance 6ae081a7-42be-48bc-8677-d0cf09d35d44 on n-h2-767704-28 Jul 14 14:34:59.263546 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-949ce3f2-718e-4b91-87bd-a1704da4a5e4 req-6bde2e6d-35c6-4030-9abe-69776aea11a5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077903 Jul 14 14:34:59.267080 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1070/2138] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:59.273695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ee924003-74f6-4ea3-a59f-e3a37c1c91df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:59.275672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ee924003-74f6-4ea3-a59f-e3a37c1c91df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:59.288807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee924003-74f6-4ea3-a59f-e3a37c1c91df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:59.289770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee924003-74f6-4ea3-a59f-e3a37c1c91df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:59.290910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee924003-74f6-4ea3-a59f-e3a37c1c91df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:59.291578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee924003-74f6-4ea3-a59f-e3a37c1c91df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:59.457159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ee924003-74f6-4ea3-a59f-e3a37c1c91df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:59.474386 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ee924003-74f6-4ea3-a59f-e3a37c1c91df tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1457 microversion: 2.1 time: 0.205465 Jul 14 14:34:59.474986 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1071/2139] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:59 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1457 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:59.485303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-06d6f31d-fbad-4f64-90d5-0ee7196e792b tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] Calling method '.version_select at 0x7fd6c61d4160>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:59.518647 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-06d6f31d-fbad-4f64-90d5-0ee7196e792b tempest-ServersTestJSON-1917457052 tempest-ServersTestJSON-1917457052-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-374576126" status: 202 len: 0 microversion: 2.1 time: 0.042294 Jul 14 14:34:59.522284 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1072/2140] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jul 14 14:34:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-374576126 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:34:59.524333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ff17ff56-8657-4ff7-9b23-721a487360bb tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:59.529105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ff17ff56-8657-4ff7-9b23-721a487360bb tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:59.538066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eef727a8-2aa3-4019-b7d9-7f9b98193492 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:59.546065 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eef727a8-2aa3-4019-b7d9-7f9b98193492 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1314 microversion: 2.1 time: 0.597567 Jul 14 14:34:59.546274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff17ff56-8657-4ff7-9b23-721a487360bb tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:59.549858 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1069/2141] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:58 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:59.558134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff17ff56-8657-4ff7-9b23-721a487360bb tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:59.559694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff17ff56-8657-4ff7-9b23-721a487360bb tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:59.560421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff17ff56-8657-4ff7-9b23-721a487360bb tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:59.607476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=21 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:59.766323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c78b8501-6239-496d-9527-d3d560eb91f5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:59.766950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c78b8501-6239-496d-9527-d3d560eb91f5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:59.791164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:59.800193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c78b8501-6239-496d-9527-d3d560eb91f5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:59.801509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c78b8501-6239-496d-9527-d3d560eb91f5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:59.803199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c78b8501-6239-496d-9527-d3d560eb91f5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:59.803869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c78b8501-6239-496d-9527-d3d560eb91f5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:00.486299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ff17ff56-8657-4ff7-9b23-721a487360bb tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:00.502396 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ff17ff56-8657-4ff7-9b23-721a487360bb tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1472 microversion: 2.1 time: 0.981378 Jul 14 14:35:00.503255 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1073/2142] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:59 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1472 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:00.511989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-efd1151a-bac1-4346-b268-63e48e37e10a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:00.513276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-efd1151a-bac1-4346-b268-63e48e37e10a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:00.524198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efd1151a-bac1-4346-b268-63e48e37e10a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:00.525157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efd1151a-bac1-4346-b268-63e48e37e10a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:00.527725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efd1151a-bac1-4346-b268-63e48e37e10a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:00.528492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efd1151a-bac1-4346-b268-63e48e37e10a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:00.652896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c78b8501-6239-496d-9527-d3d560eb91f5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:00.668408 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c78b8501-6239-496d-9527-d3d560eb91f5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1527 microversion: 2.1 time: 0.905967 Jul 14 14:35:00.679763 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1070/2143] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:59 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1527 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:00.689656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-581d5095-0a39-49f1-a951-07cad64594f4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:00.690674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-581d5095-0a39-49f1-a951-07cad64594f4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:00.697445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-581d5095-0a39-49f1-a951-07cad64594f4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:00.710525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-581d5095-0a39-49f1-a951-07cad64594f4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:00.711403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-581d5095-0a39-49f1-a951-07cad64594f4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:00.711859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-581d5095-0a39-49f1-a951-07cad64594f4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:01.090212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-581d5095-0a39-49f1-a951-07cad64594f4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c688cde0ea44a059b0bca3e020c28b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57648abd7742d9aac69af1744d6bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:01.103765 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-581d5095-0a39-49f1-a951-07cad64594f4 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 200 len: 1296 microversion: 2.1 time: 0.422197 Jul 14 14:35:01.104366 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1071/2144] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:00 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 1296 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:01.118779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77331464-5076-449d-9d10-a18d711be8cf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:01.119523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-77331464-5076-449d-9d10-a18d711be8cf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:01.131357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77331464-5076-449d-9d10-a18d711be8cf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:01.134744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77331464-5076-449d-9d10-a18d711be8cf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:01.136155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77331464-5076-449d-9d10-a18d711be8cf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:01.136864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77331464-5076-449d-9d10-a18d711be8cf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:01.512494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-efd1151a-bac1-4346-b268-63e48e37e10a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:01.529761 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-efd1151a-bac1-4346-b268-63e48e37e10a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1522 microversion: 2.1 time: 1.024881 Jul 14 14:35:01.538081 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1074/2145] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:00 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1522 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:01.543265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-01cd49a6-134d-47fc-b0e8-75b772da1acf req-d5b08580-8d76-46d9-b2e3-e0f67b67e992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060acd95-d011-4085-a6ea-0dd61f800a44", "tag": "24844627-1861-4f62-b756-6ff59877d5d0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:01.555591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:01.574400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-01cd49a6-134d-47fc-b0e8-75b772da1acf req-d5b08580-8d76-46d9-b2e3-e0f67b67e992 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:01.582854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-01cd49a6-134d-47fc-b0e8-75b772da1acf req-d5b08580-8d76-46d9-b2e3-e0f67b67e992 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:01.608225 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-01cd49a6-134d-47fc-b0e8-75b772da1acf req-d5b08580-8d76-46d9-b2e3-e0f67b67e992 service nova] Creating event network-changed:24844627-1861-4f62-b756-6ff59877d5d0 for instance 060acd95-d011-4085-a6ea-0dd61f800a44 on n-h1-767704-28 Jul 14 14:35:01.618836 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-01cd49a6-134d-47fc-b0e8-75b772da1acf req-d5b08580-8d76-46d9-b2e3-e0f67b67e992 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079221 Jul 14 14:35:01.620156 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1075/2146] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:01.626308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d645135f-e8dc-44ba-b8d4-7a1f134cab29 req-51a555d9-8d2e-4694-84d1-4bc6b518e46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131fc2d4-00c2-462b-b7e2-4fbb53234749", "name": "network-vif-plugged", "status": "completed", "tag": "8f81fa18-1ee0-41c0-a4e5-0c0a8bc1111a"}, {"server_uuid": "a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c", "name": "network-vif-unplugged", "status": "completed", "tag": "45612758-25eb-4c42-9ab2-3ee6cdf455bc"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:01.649770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d645135f-e8dc-44ba-b8d4-7a1f134cab29 req-51a555d9-8d2e-4694-84d1-4bc6b518e46a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:01.659024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d645135f-e8dc-44ba-b8d4-7a1f134cab29 req-51a555d9-8d2e-4694-84d1-4bc6b518e46a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:01.677835 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d645135f-e8dc-44ba-b8d4-7a1f134cab29 req-51a555d9-8d2e-4694-84d1-4bc6b518e46a service nova] Creating event network-vif-plugged:8f81fa18-1ee0-41c0-a4e5-0c0a8bc1111a for instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 on n-h2-767704-28 Jul 14 14:35:01.683901 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d645135f-e8dc-44ba-b8d4-7a1f134cab29 req-51a555d9-8d2e-4694-84d1-4bc6b518e46a service nova] Creating event network-vif-unplugged:45612758-25eb-4c42-9ab2-3ee6cdf455bc for instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c on n-h2-767704-28 Jul 14 14:35:01.703549 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d645135f-e8dc-44ba-b8d4-7a1f134cab29 req-51a555d9-8d2e-4694-84d1-4bc6b518e46a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.081496 Jul 14 14:35:01.707096 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1076/2147] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:01.715561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-92b8ce5f-55d3-47b9-a556-4bf58a2e17d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:01.718006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-92b8ce5f-55d3-47b9-a556-4bf58a2e17d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:01.732145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92b8ce5f-55d3-47b9-a556-4bf58a2e17d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:01.733576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92b8ce5f-55d3-47b9-a556-4bf58a2e17d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:01.741501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92b8ce5f-55d3-47b9-a556-4bf58a2e17d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:01.743556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92b8ce5f-55d3-47b9-a556-4bf58a2e17d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:02.207238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-77331464-5076-449d-9d10-a18d711be8cf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:02.226818 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-77331464-5076-449d-9d10-a18d711be8cf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1314 microversion: 2.1 time: 1.115555 Jul 14 14:35:02.237041 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1072/2148] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:01 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1314 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:02.245952 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc3f8ac1-d9ce-4e6a-a2bd-1c796fe55858 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:02.246995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc3f8ac1-d9ce-4e6a-a2bd-1c796fe55858 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:02.257578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc3f8ac1-d9ce-4e6a-a2bd-1c796fe55858 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:02.258435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc3f8ac1-d9ce-4e6a-a2bd-1c796fe55858 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:02.259514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc3f8ac1-d9ce-4e6a-a2bd-1c796fe55858 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:02.260266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc3f8ac1-d9ce-4e6a-a2bd-1c796fe55858 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:02.690784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=9 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:02.882866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-92b8ce5f-55d3-47b9-a556-4bf58a2e17d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:02.910126 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-92b8ce5f-55d3-47b9-a556-4bf58a2e17d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 200 len: 1472 microversion: 2.1 time: 1.187834 Jul 14 14:35:02.911388 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1077/2149] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:01 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 1472 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:02.941704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-547cff63-166c-4dd8-ba66-c7e189d90ff2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:02.942510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-547cff63-166c-4dd8-ba66-c7e189d90ff2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] [instance: 6ae081a7-42be-48bc-8677-d0cf09d35d44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:02.971537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-547cff63-166c-4dd8-ba66-c7e189d90ff2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:02.972237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-547cff63-166c-4dd8-ba66-c7e189d90ff2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:02.974341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-547cff63-166c-4dd8-ba66-c7e189d90ff2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:02.976747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-547cff63-166c-4dd8-ba66-c7e189d90ff2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:03.013943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:03.039606 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-547cff63-166c-4dd8-ba66-c7e189d90ff2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] HTTP exception thrown: Instance 6ae081a7-42be-48bc-8677-d0cf09d35d44 could not be found. Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-547cff63-166c-4dd8-ba66-c7e189d90ff2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Request method failure captured: Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 HTTP/1.1 Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cenn4HU6XkCSY8qKqNCtkj6EvAzCRdwvC06iSpmLiVyhSUWxuIzZIPEQEdKeZRDKKUXKEFspjEEHlcgyLRfCgc_reNU80sIs6r5NSJmX_obgK7APw5HK0H7_IHDyQzRVnvg5ehEmnYCMqjX13d3c7t459-Ewe3WClvGjcx4jm3o-Po Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: eb57648abd7742d9aac69af1744d6bc1 Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-LiveMigrationTest-1854408993 Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/eb57648abd7742d9aac69af1744d6bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/eb57648abd7742d9aac69af1744d6bc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_eb57648abd7742d9aac69af1744d6bc1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/eb57648abd7742d9aac69af1744d6bc1"}]}] Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-LiveMigrationTest-1854408993 Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: eb57648abd7742d9aac69af1744d6bc1 Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-LiveMigrationTest-1854408993 Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-LiveMigrationTest-1854408993-project Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 5c688cde0ea44a059b0bca3e020c28b3 Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-LiveMigrationTest-1854408993-project Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6ae081a7-42be-48bc-8677-d0cf09d35d44 could not be found. Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6ae081a7-42be-48bc-8677-d0cf09d35d44'} Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ae081a7-42be-48bc-8677-d0cf09d35d44 could not be found. Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ae081a7-42be-48bc-8677-d0cf09d35d44 could not be found. Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:03.042906 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:03.047933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:03.047933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:03.047933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:03.047933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:03.047933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:03.047933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ae081a7-42be-48bc-8677-d0cf09d35d44 could not be found. Jul 14 14:35:03.047933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:03.052074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-547cff63-166c-4dd8-ba66-c7e189d90ff2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] Returning 404 to user: Instance 6ae081a7-42be-48bc-8677-d0cf09d35d44 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:03.054713 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-547cff63-166c-4dd8-ba66-c7e189d90ff2 tempest-LiveMigrationTest-1854408993 tempest-LiveMigrationTest-1854408993-project] 10.222.0.81 "GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44" status: 404 len: 111 microversion: 2.1 time: 0.127270 Jul 14 14:35:03.057634 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1078/2150] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:02 2022] GET /compute/v2.1/servers/6ae081a7-42be-48bc-8677-d0cf09d35d44 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:03.079190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1fcd744a-2edb-4cc0-90e9-a8a421c62ebb tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:03.079841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1fcd744a-2edb-4cc0-90e9-a8a421c62ebb tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:03.102089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1fcd744a-2edb-4cc0-90e9-a8a421c62ebb tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:03.104493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1fcd744a-2edb-4cc0-90e9-a8a421c62ebb tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:03.105553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1fcd744a-2edb-4cc0-90e9-a8a421c62ebb tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:03.109532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1fcd744a-2edb-4cc0-90e9-a8a421c62ebb tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:04.440620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc3f8ac1-d9ce-4e6a-a2bd-1c796fe55858 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:04.454421 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc3f8ac1-d9ce-4e6a-a2bd-1c796fe55858 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 200 len: 1527 microversion: 2.1 time: 2.222755 Jul 14 14:35:04.458577 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1073/2151] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:02 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 1527 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:04.472493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1baf4bcc-1983-4d3d-9a49-d57c36451858 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:04.473875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1baf4bcc-1983-4d3d-9a49-d57c36451858 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:04.517208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1baf4bcc-1983-4d3d-9a49-d57c36451858 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:04.517683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1baf4bcc-1983-4d3d-9a49-d57c36451858 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:04.526340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1baf4bcc-1983-4d3d-9a49-d57c36451858 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:04.530591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1baf4bcc-1983-4d3d-9a49-d57c36451858 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:04.601263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1fcd744a-2edb-4cc0-90e9-a8a421c62ebb tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:04.611059 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1fcd744a-2edb-4cc0-90e9-a8a421c62ebb tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1522 microversion: 2.1 time: 1.545113 Jul 14 14:35:04.625765 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1079/2152] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:03 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1522 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:04.630414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-04331371-01a6-4eb6-8854-74d78e9f62e8 req-2a95f344-28c8-438f-9004-b87ba3ca196c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63e0542-7919-4dab-ac01-8886ee2810ce", "name": "network-vif-deleted", "tag": "133c788b-8267-4ccc-867a-c10f112b9cc1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:04.670349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-04331371-01a6-4eb6-8854-74d78e9f62e8 req-2a95f344-28c8-438f-9004-b87ba3ca196c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:04.676599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-04331371-01a6-4eb6-8854-74d78e9f62e8 req-2a95f344-28c8-438f-9004-b87ba3ca196c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:04.723115 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-04331371-01a6-4eb6-8854-74d78e9f62e8 req-2a95f344-28c8-438f-9004-b87ba3ca196c service nova] Creating event network-vif-deleted:133c788b-8267-4ccc-867a-c10f112b9cc1 for instance d63e0542-7919-4dab-ac01-8886ee2810ce on n-h2-767704-28 Jul 14 14:35:04.746271 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-04331371-01a6-4eb6-8854-74d78e9f62e8 req-2a95f344-28c8-438f-9004-b87ba3ca196c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119369 Jul 14 14:35:04.750373 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1080/2153] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:04.756916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f35fbb20-5c90-4f1d-8518-3f03042222d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:04.764674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f35fbb20-5c90-4f1d-8518-3f03042222d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: d63e0542-7919-4dab-ac01-8886ee2810ce] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:04.791880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f35fbb20-5c90-4f1d-8518-3f03042222d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:04.792818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f35fbb20-5c90-4f1d-8518-3f03042222d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:04.794091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f35fbb20-5c90-4f1d-8518-3f03042222d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:04.794818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f35fbb20-5c90-4f1d-8518-3f03042222d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:04.827749 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f35fbb20-5c90-4f1d-8518-3f03042222d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] HTTP exception thrown: Instance d63e0542-7919-4dab-ac01-8886ee2810ce could not be found. Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f35fbb20-5c90-4f1d-8518-3f03042222d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Request method failure captured: Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce HTTP/1.1 Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CjT3c3zJJ84LE-QTmu_N7TKc2vJamFLSX_RsNCc08bkmpF5n-Nu9FWM1NtArGpB5CPF5xMY4uJtIuYE6LZqhvGYf2JzXeGgXNt6b7VR2u0JPoNAJCHJHhj9V7Dqz90qdjKz2o2f2PhRD9Ft-YN05uGZlojn_Lv-A-BD95QzQ-Q1ROU Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_57545ddd8fb2414f8c03c1c44d2bb47f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}] Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f7852b6d7fb246ee980a61aa2be4f065 Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance d63e0542-7919-4dab-ac01-8886ee2810ce could not be found. Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'd63e0542-7919-4dab-ac01-8886ee2810ce'} Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63e0542-7919-4dab-ac01-8886ee2810ce could not be found. Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63e0542-7919-4dab-ac01-8886ee2810ce could not be found. Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:04.832982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:04.836878 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:04.836878 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:04.836878 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:04.836878 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:04.836878 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:04.836878 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63e0542-7919-4dab-ac01-8886ee2810ce could not be found. Jul 14 14:35:04.836878 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:04.843784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f35fbb20-5c90-4f1d-8518-3f03042222d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Returning 404 to user: Instance d63e0542-7919-4dab-ac01-8886ee2810ce could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:04.845441 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f35fbb20-5c90-4f1d-8518-3f03042222d1 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce" status: 404 len: 111 microversion: 2.1 time: 0.093169 Jul 14 14:35:04.852491 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1081/2154] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:04 2022] GET /compute/v2.1/servers/d63e0542-7919-4dab-ac01-8886ee2810ce => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:04.868900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2aaffe79-2730-47ab-8cf7-51d602d5f735 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:04.869832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2aaffe79-2730-47ab-8cf7-51d602d5f735 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:04.891713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2aaffe79-2730-47ab-8cf7-51d602d5f735 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:04.892842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2aaffe79-2730-47ab-8cf7-51d602d5f735 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:04.894321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2aaffe79-2730-47ab-8cf7-51d602d5f735 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:04.895890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2aaffe79-2730-47ab-8cf7-51d602d5f735 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:04.958629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2aaffe79-2730-47ab-8cf7-51d602d5f735 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:05.124112 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2aaffe79-2730-47ab-8cf7-51d602d5f735 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 204 len: 0 microversion: 2.1 time: 0.267440 Jul 14 14:35:05.126526 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1082/2155] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:04 2022] DELETE /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:05.143889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf324681-ded3-44a6-a934-49aa91de7a4f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:05.144968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bf324681-ded3-44a6-a934-49aa91de7a4f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:05.157229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf324681-ded3-44a6-a934-49aa91de7a4f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:05.158045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf324681-ded3-44a6-a934-49aa91de7a4f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:05.159166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf324681-ded3-44a6-a934-49aa91de7a4f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:05.160190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf324681-ded3-44a6-a934-49aa91de7a4f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:05.201091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:05.408874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1baf4bcc-1983-4d3d-9a49-d57c36451858 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:05.425789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1baf4bcc-1983-4d3d-9a49-d57c36451858 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1314 microversion: 2.1 time: 0.965318 Jul 14 14:35:05.435633 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1074/2156] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:04 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1314 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:05.480128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-16d017e8-81f8-4e36-a384-0f86aca795b1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:05.481524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-16d017e8-81f8-4e36-a384-0f86aca795b1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:05.490917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16d017e8-81f8-4e36-a384-0f86aca795b1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:05.491663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16d017e8-81f8-4e36-a384-0f86aca795b1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:05.493609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16d017e8-81f8-4e36-a384-0f86aca795b1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:05.494297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16d017e8-81f8-4e36-a384-0f86aca795b1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:05.529898 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-16d017e8-81f8-4e36-a384-0f86aca795b1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] HTTP exception thrown: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-16d017e8-81f8-4e36-a384-0f86aca795b1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c HTTP/1.1 Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c'} Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:05.532236 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:05.535610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:05.535610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:05.535610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:05.535610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:05.535610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:05.535610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:05.535610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:35:05.535610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:05.539261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-16d017e8-81f8-4e36-a384-0f86aca795b1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 404 to user: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:05.540349 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-16d017e8-81f8-4e36-a384-0f86aca795b1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 404 len: 111 microversion: 2.1 time: 0.064302 Jul 14 14:35:05.541212 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1075/2157] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:05 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:35:05.553247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7af6a7b8-6538-483c-84d0-72a4d1eb00b3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Action: 'create', calling method: .version_select at 0x7fd6c573c160>, body: {"keypair": {"name": "tempest-keypair-1032438394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCl/hGu70lbbPDTdYrxnLxHOE5/xadVeLLz0ccYW+6Unr2M5ok6YM8hPwR5WMRCXDvazWqMF4vAywlGj+HxwDHZ0ly8zvTgtpXPHOHxGvdYp724IyUzl6dwpuAPyXZs9vw=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:05.592109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-7af6a7b8-6538-483c-84d0-72a4d1eb00b3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Getting quotas for project ad9c7d3620e34c95bb8a772e532fc660. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:35:05.605230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-7af6a7b8-6538-483c-84d0-72a4d1eb00b3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Getting quotas for user 935bde481e9c41a1951bcdab5af71211 and project ad9c7d3620e34c95bb8a772e532fc660. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:35:05.616034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:05.677197 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7af6a7b8-6538-483c-84d0-72a4d1eb00b3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127696 Jul 14 14:35:05.678579 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1076/2158] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:35:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:05.687260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-afd1106f-59a5-4833-98b1-f43e3339af52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:05.691734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-afd1106f-59a5-4833-98b1-f43e3339af52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:05.712537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afd1106f-59a5-4833-98b1-f43e3339af52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:05.713311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afd1106f-59a5-4833-98b1-f43e3339af52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:05.715089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afd1106f-59a5-4833-98b1-f43e3339af52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:05.716051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afd1106f-59a5-4833-98b1-f43e3339af52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:06.001930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bf324681-ded3-44a6-a934-49aa91de7a4f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:06.013505 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf324681-ded3-44a6-a934-49aa91de7a4f tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1472 microversion: 2.1 time: 0.881843 Jul 14 14:35:06.028454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-afd1106f-59a5-4833-98b1-f43e3339af52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:06.037276 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-afd1106f-59a5-4833-98b1-f43e3339af52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1522 microversion: 2.1 time: 0.356943 Jul 14 14:35:06.038310 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1083/2159] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:05 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1472 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:06.038588 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1077/2160] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:05 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:06.443807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-496ba668-e142-4eb1-9f82-af72fa4ba578 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:06.444438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-496ba668-e142-4eb1-9f82-af72fa4ba578 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:06.460826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-496ba668-e142-4eb1-9f82-af72fa4ba578 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:06.461312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-496ba668-e142-4eb1-9f82-af72fa4ba578 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:06.462122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-496ba668-e142-4eb1-9f82-af72fa4ba578 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:06.462568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-496ba668-e142-4eb1-9f82-af72fa4ba578 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:07.031575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1922cd58-0743-4ee5-affe-1a1efaeed5a5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:07.032392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1922cd58-0743-4ee5-affe-1a1efaeed5a5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:07.042320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1922cd58-0743-4ee5-affe-1a1efaeed5a5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:07.049229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1922cd58-0743-4ee5-affe-1a1efaeed5a5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:07.051790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1922cd58-0743-4ee5-affe-1a1efaeed5a5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:07.054768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1922cd58-0743-4ee5-affe-1a1efaeed5a5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:07.974749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-496ba668-e142-4eb1-9f82-af72fa4ba578 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:07.993344 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-496ba668-e142-4eb1-9f82-af72fa4ba578 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1314 microversion: 2.1 time: 1.552809 Jul 14 14:35:07.998349 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1084/2161] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:06 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1314 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:08.009722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2d5c1ae4-f171-4edd-bfa7-9662b1f6b883 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:08.011287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2d5c1ae4-f171-4edd-bfa7-9662b1f6b883 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:08.019600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1922cd58-0743-4ee5-affe-1a1efaeed5a5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:08.020967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d5c1ae4-f171-4edd-bfa7-9662b1f6b883 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:08.023071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d5c1ae4-f171-4edd-bfa7-9662b1f6b883 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:08.024164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d5c1ae4-f171-4edd-bfa7-9662b1f6b883 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:08.024771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d5c1ae4-f171-4edd-bfa7-9662b1f6b883 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:08.064762 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1922cd58-0743-4ee5-affe-1a1efaeed5a5 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1472 microversion: 2.1 time: 1.029251 Jul 14 14:35:08.067144 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1078/2162] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:07 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1472 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:08.084687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-375f5cd1-192a-44ee-80c8-f93762afa197 req-e12655c1-6fcb-4944-ab15-f0c9ba040402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c", "name": "network-vif-deleted", "tag": "45612758-25eb-4c42-9ab2-3ee6cdf455bc"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:08.126956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-375f5cd1-192a-44ee-80c8-f93762afa197 req-e12655c1-6fcb-4944-ab15-f0c9ba040402 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:08.128246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-375f5cd1-192a-44ee-80c8-f93762afa197 req-e12655c1-6fcb-4944-ab15-f0c9ba040402 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:08.150798 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-375f5cd1-192a-44ee-80c8-f93762afa197 req-e12655c1-6fcb-4944-ab15-f0c9ba040402 service nova] Creating event network-vif-deleted:45612758-25eb-4c42-9ab2-3ee6cdf455bc for instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c on n-h2-767704-28 Jul 14 14:35:08.162694 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-375f5cd1-192a-44ee-80c8-f93762afa197 req-e12655c1-6fcb-4944-ab15-f0c9ba040402 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093709 Jul 14 14:35:08.163327 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1079/2163] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:08.954350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2d5c1ae4-f171-4edd-bfa7-9662b1f6b883 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:08.971788 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2d5c1ae4-f171-4edd-bfa7-9662b1f6b883 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1522 microversion: 2.1 time: 0.968390 Jul 14 14:35:08.980751 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1085/2164] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:07 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1522 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:09.019018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af916bb4-922c-45a7-a188-540c03a81796 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:09.019737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-af916bb4-922c-45a7-a188-540c03a81796 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:09.046144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af916bb4-922c-45a7-a188-540c03a81796 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:09.047403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af916bb4-922c-45a7-a188-540c03a81796 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:09.048246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af916bb4-922c-45a7-a188-540c03a81796 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:09.048701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af916bb4-922c-45a7-a188-540c03a81796 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:09.084678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-91ef8427-fa5a-4951-bc1a-b713d7bc040d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:09.085343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-91ef8427-fa5a-4951-bc1a-b713d7bc040d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:09.102790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91ef8427-fa5a-4951-bc1a-b713d7bc040d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:09.106648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91ef8427-fa5a-4951-bc1a-b713d7bc040d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:09.111260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91ef8427-fa5a-4951-bc1a-b713d7bc040d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:09.112121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91ef8427-fa5a-4951-bc1a-b713d7bc040d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:09.765497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-91ef8427-fa5a-4951-bc1a-b713d7bc040d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:09.784687 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-91ef8427-fa5a-4951-bc1a-b713d7bc040d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1472 microversion: 2.1 time: 0.704537 Jul 14 14:35:09.785612 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1086/2165] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:09 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1472 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:10.002280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dae19503-99f4-4af2-aa00-61f44e4716a7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:10.004537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dae19503-99f4-4af2-aa00-61f44e4716a7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:10.037027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dae19503-99f4-4af2-aa00-61f44e4716a7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:10.038178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dae19503-99f4-4af2-aa00-61f44e4716a7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:10.044689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dae19503-99f4-4af2-aa00-61f44e4716a7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:10.046032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dae19503-99f4-4af2-aa00-61f44e4716a7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:10.509509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-af916bb4-922c-45a7-a188-540c03a81796 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:10.546706 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af916bb4-922c-45a7-a188-540c03a81796 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1314 microversion: 2.1 time: 1.533455 Jul 14 14:35:10.549115 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1080/2166] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:09 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1314 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:10.776142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af916bb4-922c-45a7-a188-540c03a81796 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:10.787398 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af916bb4-922c-45a7-a188-540c03a81796 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute//" status: 200 len: 377 microversion: - time: 0.016871 Jul 14 14:35:10.831077 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1081/2167] 10.222.0.81 () {56 vars in 885 bytes} [Thu Jul 14 14:35:10 2022] GET /compute/ => generated 377 bytes in 43 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 14 14:35:10.831077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e76105fc-9ceb-4aa2-815b-2ea9f6eed067 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:10.831077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e76105fc-9ceb-4aa2-815b-2ea9f6eed067 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:10.831077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e76105fc-9ceb-4aa2-815b-2ea9f6eed067 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:10.839302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e76105fc-9ceb-4aa2-815b-2ea9f6eed067 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:10.847427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e76105fc-9ceb-4aa2-815b-2ea9f6eed067 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:10.848374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e76105fc-9ceb-4aa2-815b-2ea9f6eed067 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:11.134198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e76105fc-9ceb-4aa2-815b-2ea9f6eed067 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:11.147895 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e76105fc-9ceb-4aa2-815b-2ea9f6eed067 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 200 len: 1430 microversion: 2.1 time: 0.337801 Jul 14 14:35:11.155827 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1082/2168] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:10 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 1430 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:11.171447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4b5474ce-0f66-4f4c-832c-f2a5340d4216 req-79d49a1a-e1ec-48fc-b58a-74496a8776ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060acd95-d011-4085-a6ea-0dd61f800a44", "name": "network-vif-plugged", "status": "completed", "tag": "24844627-1861-4f62-b756-6ff59877d5d0"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:11.192644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4b5474ce-0f66-4f4c-832c-f2a5340d4216 req-79d49a1a-e1ec-48fc-b58a-74496a8776ed service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:11.194647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4b5474ce-0f66-4f4c-832c-f2a5340d4216 req-79d49a1a-e1ec-48fc-b58a-74496a8776ed service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:11.231189 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4b5474ce-0f66-4f4c-832c-f2a5340d4216 req-79d49a1a-e1ec-48fc-b58a-74496a8776ed service nova] Creating event network-vif-plugged:24844627-1861-4f62-b756-6ff59877d5d0 for instance 060acd95-d011-4085-a6ea-0dd61f800a44 on n-h1-767704-28 Jul 14 14:35:11.248210 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4b5474ce-0f66-4f4c-832c-f2a5340d4216 req-79d49a1a-e1ec-48fc-b58a-74496a8776ed service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089694 Jul 14 14:35:11.249583 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1083/2169] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:11.575699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b45c1d03-b080-4910-af6a-2247c849f15b tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:11.576516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b45c1d03-b080-4910-af6a-2247c849f15b tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:11.592205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b45c1d03-b080-4910-af6a-2247c849f15b tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:11.593037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b45c1d03-b080-4910-af6a-2247c849f15b tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:11.594204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b45c1d03-b080-4910-af6a-2247c849f15b tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:11.596469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b45c1d03-b080-4910-af6a-2247c849f15b tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:12.411523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dae19503-99f4-4af2-aa00-61f44e4716a7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:12.424901 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dae19503-99f4-4af2-aa00-61f44e4716a7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1522 microversion: 2.1 time: 2.426344 Jul 14 14:35:12.426211 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1087/2170] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:09 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1522 bytes in 2433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:12.439748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6cfc3512-5f25-441e-bca4-3734b345974e req-228baef9-ccd9-4e7a-a3e0-f06de641bd0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c103298-2487-41d2-b3b7-abc71539b1b0", "name": "network-vif-deleted", "tag": "b7259213-7036-4454-a50f-4a60ff04dba9"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:12.484211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6cfc3512-5f25-441e-bca4-3734b345974e req-228baef9-ccd9-4e7a-a3e0-f06de641bd0f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:12.495052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6cfc3512-5f25-441e-bca4-3734b345974e req-228baef9-ccd9-4e7a-a3e0-f06de641bd0f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:12.528782 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6cfc3512-5f25-441e-bca4-3734b345974e req-228baef9-ccd9-4e7a-a3e0-f06de641bd0f service nova] Creating event network-vif-deleted:b7259213-7036-4454-a50f-4a60ff04dba9 for instance 1c103298-2487-41d2-b3b7-abc71539b1b0 on n-h1-767704-28 Jul 14 14:35:12.545235 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6cfc3512-5f25-441e-bca4-3734b345974e req-228baef9-ccd9-4e7a-a3e0-f06de641bd0f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115002 Jul 14 14:35:12.548216 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1088/2171] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:12.556365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ad25870-4fb7-4dbc-9a48-720a980fe076 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:12.561453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8ad25870-4fb7-4dbc-9a48-720a980fe076 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 1c103298-2487-41d2-b3b7-abc71539b1b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:12.602831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ad25870-4fb7-4dbc-9a48-720a980fe076 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:12.603582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ad25870-4fb7-4dbc-9a48-720a980fe076 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:12.608609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ad25870-4fb7-4dbc-9a48-720a980fe076 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:12.609405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ad25870-4fb7-4dbc-9a48-720a980fe076 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:12.660855 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-8ad25870-4fb7-4dbc-9a48-720a980fe076 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] HTTP exception thrown: Instance 1c103298-2487-41d2-b3b7-abc71539b1b0 could not be found. Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ad25870-4fb7-4dbc-9a48-720a980fe076 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Request method failure captured: Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 HTTP/1.1 Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CjT3c3zJJ84LE-QTmu_N7TKc2vJamFLSX_RsNCc08bkmpF5n-Nu9FWM1NtArGpB5CPF5xMY4uJtIuYE6LZqhvGYf2JzXeGgXNt6b7VR2u0JPoNAJCHJHhj9V7Dqz90qdjKz2o2f2PhRD9Ft-YN05uGZlojn_Lv-A-BD95QzQ-Q1ROU Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_57545ddd8fb2414f8c03c1c44d2bb47f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}] Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f7852b6d7fb246ee980a61aa2be4f065 Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 1c103298-2487-41d2-b3b7-abc71539b1b0 could not be found. Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '1c103298-2487-41d2-b3b7-abc71539b1b0'} Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c103298-2487-41d2-b3b7-abc71539b1b0 could not be found. Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c103298-2487-41d2-b3b7-abc71539b1b0 could not be found. Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:12.662705 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.666172 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:12.666172 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:12.666172 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:12.666172 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:12.666172 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:12.666172 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c103298-2487-41d2-b3b7-abc71539b1b0 could not be found. Jul 14 14:35:12.666172 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.666172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ad25870-4fb7-4dbc-9a48-720a980fe076 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Returning 404 to user: Instance 1c103298-2487-41d2-b3b7-abc71539b1b0 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:12.666172 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8ad25870-4fb7-4dbc-9a48-720a980fe076 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0" status: 404 len: 111 microversion: 2.1 time: 0.114378 Jul 14 14:35:12.666172 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1089/2172] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:12 2022] GET /compute/v2.1/servers/1c103298-2487-41d2-b3b7-abc71539b1b0 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:12.677685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-43d5b49a-87c3-4acf-aeae-ebb130f34b75 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:12.678199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-43d5b49a-87c3-4acf-aeae-ebb130f34b75 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:12.690406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43d5b49a-87c3-4acf-aeae-ebb130f34b75 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:12.690878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43d5b49a-87c3-4acf-aeae-ebb130f34b75 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:12.691679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43d5b49a-87c3-4acf-aeae-ebb130f34b75 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:12.695857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43d5b49a-87c3-4acf-aeae-ebb130f34b75 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:12.756484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-43d5b49a-87c3-4acf-aeae-ebb130f34b75 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:12.891890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b45c1d03-b080-4910-af6a-2247c849f15b tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:12.905254 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b45c1d03-b080-4910-af6a-2247c849f15b tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1314 microversion: 2.1 time: 1.333791 Jul 14 14:35:12.910302 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1084/2173] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:11 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1314 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:12.982986 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-43d5b49a-87c3-4acf-aeae-ebb130f34b75 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "DELETE /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 204 len: 0 microversion: 2.1 time: 0.308368 Jul 14 14:35:12.988822 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1090/2174] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:12 2022] DELETE /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:35:13.000757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f34a768e-7fb5-4896-bd69-02eae895b3dd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:13.007089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f34a768e-7fb5-4896-bd69-02eae895b3dd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:13.026743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f34a768e-7fb5-4896-bd69-02eae895b3dd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:13.032692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1198349654", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:13.033762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f34a768e-7fb5-4896-bd69-02eae895b3dd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:13.039508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f34a768e-7fb5-4896-bd69-02eae895b3dd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:13.040371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f34a768e-7fb5-4896-bd69-02eae895b3dd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:13.134258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] validate_networks() for [('7c43dfbf-9695-44fa-8557-60f7b955d643', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:35:13.761038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f34a768e-7fb5-4896-bd69-02eae895b3dd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:13.776317 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f34a768e-7fb5-4896-bd69-02eae895b3dd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1472 microversion: 2.1 time: 0.785918 Jul 14 14:35:13.788483 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1085/2175] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:12 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1472 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:13.793712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-432b6094-b5b2-4a04-9360-782efb0efeb7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:13.794579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-432b6094-b5b2-4a04-9360-782efb0efeb7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:13.824146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-432b6094-b5b2-4a04-9360-782efb0efeb7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:13.824819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-432b6094-b5b2-4a04-9360-782efb0efeb7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:13.827964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-432b6094-b5b2-4a04-9360-782efb0efeb7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:13.829735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-432b6094-b5b2-4a04-9360-782efb0efeb7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:14.850836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-432b6094-b5b2-4a04-9360-782efb0efeb7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:14.866514 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-432b6094-b5b2-4a04-9360-782efb0efeb7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1522 microversion: 2.1 time: 1.076596 Jul 14 14:35:14.867794 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1086/2176] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:13 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1522 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:14.872541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6663b025-2f3e-4a4a-8e18-e1c150602e9e tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.873215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6663b025-2f3e-4a4a-8e18-e1c150602e9e tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:14.897004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6663b025-2f3e-4a4a-8e18-e1c150602e9e tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:14.897462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6663b025-2f3e-4a4a-8e18-e1c150602e9e tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:14.898278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6663b025-2f3e-4a4a-8e18-e1c150602e9e tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:14.898892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6663b025-2f3e-4a4a-8e18-e1c150602e9e tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:14.903635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:15.172582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:35:15.173239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:35:15.173848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:35:15.174362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:35:15.175021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:35:15.201992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:15.206321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:15.207732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:15.209427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:15.263222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Getting quotas for project ad9c7d3620e34c95bb8a772e532fc660. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:35:15.279832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Getting quotas for user 935bde481e9c41a1951bcdab5af71211 and project ad9c7d3620e34c95bb8a772e532fc660. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:35:15.326916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:35:15.335906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:35:15.443974 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2fb8cfac-2e6f-4734-b4af-ce24660791d3 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.419273 Jul 14 14:35:15.444721 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1091/2177] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:35:15.466522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-13497b24-e39d-4e83-b004-3ab86f18cabd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.467152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-13497b24-e39d-4e83-b004-3ab86f18cabd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:15.500521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13497b24-e39d-4e83-b004-3ab86f18cabd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:15.501323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13497b24-e39d-4e83-b004-3ab86f18cabd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:15.502419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13497b24-e39d-4e83-b004-3ab86f18cabd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:15.502980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13497b24-e39d-4e83-b004-3ab86f18cabd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:15.631560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:16.958033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6663b025-2f3e-4a4a-8e18-e1c150602e9e tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:16.971090 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6663b025-2f3e-4a4a-8e18-e1c150602e9e tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1314 microversion: 2.1 time: 2.102142 Jul 14 14:35:16.983314 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1087/2178] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1314 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:17.011750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b3572efe-4bc5-4160-8a5d-c75f7066622b tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:17.012383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b3572efe-4bc5-4160-8a5d-c75f7066622b tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:17.056206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3572efe-4bc5-4160-8a5d-c75f7066622b tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:17.059891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3572efe-4bc5-4160-8a5d-c75f7066622b tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:17.061398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3572efe-4bc5-4160-8a5d-c75f7066622b tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:17.063127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3572efe-4bc5-4160-8a5d-c75f7066622b tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:17.154171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-13497b24-e39d-4e83-b004-3ab86f18cabd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:17.191662 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-13497b24-e39d-4e83-b004-3ab86f18cabd tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1472 microversion: 2.1 time: 1.737624 Jul 14 14:35:17.192304 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1092/2179] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:15 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1472 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:17.216478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7a23ac65-6a2c-4000-8008-3b0214c7ae21 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:17.228191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7a23ac65-6a2c-4000-8008-3b0214c7ae21 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:17.257154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a23ac65-6a2c-4000-8008-3b0214c7ae21 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:17.257898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a23ac65-6a2c-4000-8008-3b0214c7ae21 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:17.261519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a23ac65-6a2c-4000-8008-3b0214c7ae21 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:17.262311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a23ac65-6a2c-4000-8008-3b0214c7ae21 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:17.629080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b3572efe-4bc5-4160-8a5d-c75f7066622b tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:17.654738 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b3572efe-4bc5-4160-8a5d-c75f7066622b tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1221 microversion: 2.1 time: 0.641255 Jul 14 14:35:17.656342 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1088/2180] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:16 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1221 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:18.004622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8331adc-3821-4067-9704-8469694e6fa6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:18.009270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8331adc-3821-4067-9704-8469694e6fa6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:18.017294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8331adc-3821-4067-9704-8469694e6fa6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:18.018007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8331adc-3821-4067-9704-8469694e6fa6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:18.019129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8331adc-3821-4067-9704-8469694e6fa6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:18.025356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8331adc-3821-4067-9704-8469694e6fa6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:18.981566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7a23ac65-6a2c-4000-8008-3b0214c7ae21 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:18.999208 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7a23ac65-6a2c-4000-8008-3b0214c7ae21 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1522 microversion: 2.1 time: 1.791880 Jul 14 14:35:19.001754 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1093/2181] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:17 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1522 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:19.014750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-547966f8-3fa0-44e2-a12c-e30c5d0d8b65 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:19.017237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-547966f8-3fa0-44e2-a12c-e30c5d0d8b65 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:19.036031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-547966f8-3fa0-44e2-a12c-e30c5d0d8b65 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:19.037529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-547966f8-3fa0-44e2-a12c-e30c5d0d8b65 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:19.040184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-547966f8-3fa0-44e2-a12c-e30c5d0d8b65 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:19.041287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-547966f8-3fa0-44e2-a12c-e30c5d0d8b65 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:19.122433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f8331adc-3821-4067-9704-8469694e6fa6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:19.139756 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8331adc-3821-4067-9704-8469694e6fa6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1464 microversion: 2.1 time: 1.139778 Jul 14 14:35:19.143811 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1089/2182] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:17 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1464 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:19.157664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-74cc90c1-f3c4-438c-a838-fbc5ad04cea5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:19.160039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-74cc90c1-f3c4-438c-a838-fbc5ad04cea5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:19.181805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74cc90c1-f3c4-438c-a838-fbc5ad04cea5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:19.182565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74cc90c1-f3c4-438c-a838-fbc5ad04cea5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:19.183684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74cc90c1-f3c4-438c-a838-fbc5ad04cea5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:19.184287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74cc90c1-f3c4-438c-a838-fbc5ad04cea5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:19.277345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-547966f8-3fa0-44e2-a12c-e30c5d0d8b65 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:19.298156 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-547966f8-3fa0-44e2-a12c-e30c5d0d8b65 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1430 microversion: 2.1 time: 0.295181 Jul 14 14:35:19.298758 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1094/2183] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:19 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1430 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:19.593581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-535634ff-ac35-47f5-be10-180d4a825d68 tempest-TenantUsagesTestJSON-357302197 tempest-TenantUsagesTestJSON-357302197-project-admin] Calling method '.version_select at 0x7fd6c533ab80>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:19.615935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-535634ff-ac35-47f5-be10-180d4a825d68 tempest-TenantUsagesTestJSON-357302197 tempest-TenantUsagesTestJSON-357302197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:19.616987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-535634ff-ac35-47f5-be10-180d4a825d68 tempest-TenantUsagesTestJSON-357302197 tempest-TenantUsagesTestJSON-357302197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:19.655806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-535634ff-ac35-47f5-be10-180d4a825d68 tempest-TenantUsagesTestJSON-357302197 tempest-TenantUsagesTestJSON-357302197-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:19.663523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-535634ff-ac35-47f5-be10-180d4a825d68 tempest-TenantUsagesTestJSON-357302197 tempest-TenantUsagesTestJSON-357302197-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:19.752571 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-535634ff-ac35-47f5-be10-180d4a825d68 tempest-TenantUsagesTestJSON-357302197 tempest-TenantUsagesTestJSON-357302197-project-admin] 10.222.0.81 "GET /compute/v2.1/os-simple-tenant-usage/d3fd17b0a0dc45f08d3c9b4cfdb6da21?start=2022-07-13T14%3A35%3A19.154650&end=2022-07-15T14%3A35%3A19.154650" status: 200 len: 691 microversion: 2.1 time: 0.433033 Jul 14 14:35:19.762366 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1095/2184] 10.222.0.81 () {58 vars in 1411 bytes} [Thu Jul 14 14:35:19 2022] GET /compute/v2.1/os-simple-tenant-usage/d3fd17b0a0dc45f08d3c9b4cfdb6da21?start=2022-07-13T14%3A35%3A19.154650&end=2022-07-15T14%3A35%3A19.154650 => generated 691 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:19.768195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5a980362-2679-40f1-8c7d-e7101718d5f6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '.version_select at 0x7fd6c6310a60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:19.797154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a980362-2679-40f1-8c7d-e7101718d5f6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:19.803293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a980362-2679-40f1-8c7d-e7101718d5f6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:19.827012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-74cc90c1-f3c4-438c-a838-fbc5ad04cea5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:19.850814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a980362-2679-40f1-8c7d-e7101718d5f6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:19.852435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a980362-2679-40f1-8c7d-e7101718d5f6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:19.857320 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-74cc90c1-f3c4-438c-a838-fbc5ad04cea5 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1283 microversion: 2.1 time: 0.705973 Jul 14 14:35:19.875181 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1090/2185] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:19 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1283 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:19.891133 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5a980362-2679-40f1-8c7d-e7101718d5f6 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/os-simple-tenant-usage/d3fd17b0a0dc45f08d3c9b4cfdb6da21?start=2022-07-13T14%3A35%3A19.154650&end=2022-07-15T14%3A35%3A19.154650" status: 200 len: 695 microversion: 2.1 time: 0.126508 Jul 14 14:35:19.917532 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1096/2186] 10.222.0.81 () {58 vars in 1411 bytes} [Thu Jul 14 14:35:19 2022] GET /compute/v2.1/os-simple-tenant-usage/d3fd17b0a0dc45f08d3c9b4cfdb6da21?start=2022-07-13T14%3A35%3A19.154650&end=2022-07-15T14%3A35%3A19.154650 => generated 695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:19.921358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af146954-c48d-4026-bdf1-a39e5d4ce03b tempest-TenantUsagesTestJSON-357302197 tempest-TenantUsagesTestJSON-357302197-project-admin] Calling method '.version_select at 0x7fd6c573ca60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:19.935017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af146954-c48d-4026-bdf1-a39e5d4ce03b tempest-TenantUsagesTestJSON-357302197 tempest-TenantUsagesTestJSON-357302197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:19.937815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af146954-c48d-4026-bdf1-a39e5d4ce03b tempest-TenantUsagesTestJSON-357302197 tempest-TenantUsagesTestJSON-357302197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:19.996990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af146954-c48d-4026-bdf1-a39e5d4ce03b tempest-TenantUsagesTestJSON-357302197 tempest-TenantUsagesTestJSON-357302197-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:19.997517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af146954-c48d-4026-bdf1-a39e5d4ce03b tempest-TenantUsagesTestJSON-357302197 tempest-TenantUsagesTestJSON-357302197-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:20.023573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-043096dd-57d1-47c8-89a2-a1046b2fc3ab tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:20.029333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-043096dd-57d1-47c8-89a2-a1046b2fc3ab tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:20.064277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-043096dd-57d1-47c8-89a2-a1046b2fc3ab tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:20.064277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-043096dd-57d1-47c8-89a2-a1046b2fc3ab tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:20.066352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-043096dd-57d1-47c8-89a2-a1046b2fc3ab tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:20.079407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-043096dd-57d1-47c8-89a2-a1046b2fc3ab tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:20.226234 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af146954-c48d-4026-bdf1-a39e5d4ce03b tempest-TenantUsagesTestJSON-357302197 tempest-TenantUsagesTestJSON-357302197-project-admin] 10.222.0.81 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-13T14%3A35%3A19.154650&end=2022-07-15T14%3A35%3A19.154650&detailed=1" status: 200 len: 27823 microversion: 2.1 time: 0.309186 Jul 14 14:35:20.228310 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1091/2187] 10.222.0.81 () {58 vars in 1334 bytes} [Thu Jul 14 14:35:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-13T14%3A35%3A19.154650&end=2022-07-15T14%3A35%3A19.154650&detailed=1 => generated 27823 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:35:20.276448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f1227e9-014f-4e3d-bc16-25735042d278 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:20.277265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3f1227e9-014f-4e3d-bc16-25735042d278 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:20.305789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f1227e9-014f-4e3d-bc16-25735042d278 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:20.312441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f1227e9-014f-4e3d-bc16-25735042d278 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:20.315361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f1227e9-014f-4e3d-bc16-25735042d278 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:20.317010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f1227e9-014f-4e3d-bc16-25735042d278 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:20.393451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3f1227e9-014f-4e3d-bc16-25735042d278 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:20.576193 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f1227e9-014f-4e3d-bc16-25735042d278 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "DELETE /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 204 len: 0 microversion: 2.1 time: 0.314314 Jul 14 14:35:20.577258 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1092/2188] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:20 2022] DELETE /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:35:20.597128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-085f3e5c-46d1-4d76-8d86-71b18c1b4315 req-10cbaefd-462e-49e4-9de8-bda2e8b4d4ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0", "name": "network-vif-deleted", "tag": "bef791a8-fac8-4dbf-b4bd-89eb84bb40fb"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:20.620186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-085f3e5c-46d1-4d76-8d86-71b18c1b4315 req-10cbaefd-462e-49e4-9de8-bda2e8b4d4ee service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:20.621038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-085f3e5c-46d1-4d76-8d86-71b18c1b4315 req-10cbaefd-462e-49e4-9de8-bda2e8b4d4ee service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:20.637090 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-085f3e5c-46d1-4d76-8d86-71b18c1b4315 req-10cbaefd-462e-49e4-9de8-bda2e8b4d4ee service nova] Creating event network-vif-deleted:bef791a8-fac8-4dbf-b4bd-89eb84bb40fb for instance 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 on n-h1-767704-28 Jul 14 14:35:20.648217 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-085f3e5c-46d1-4d76-8d86-71b18c1b4315 req-10cbaefd-462e-49e4-9de8-bda2e8b4d4ee service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068547 Jul 14 14:35:20.649558 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1093/2189] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:20.658573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-51714be3-1134-4567-9286-b5bf5d9ec600 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:20.660421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-51714be3-1134-4567-9286-b5bf5d9ec600 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:20.668311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51714be3-1134-4567-9286-b5bf5d9ec600 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:20.669169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51714be3-1134-4567-9286-b5bf5d9ec600 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:20.670447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51714be3-1134-4567-9286-b5bf5d9ec600 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:20.671162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51714be3-1134-4567-9286-b5bf5d9ec600 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:20.724940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51714be3-1134-4567-9286-b5bf5d9ec600 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:20.727005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51714be3-1134-4567-9286-b5bf5d9ec600 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:20.727718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-51714be3-1134-4567-9286-b5bf5d9ec600 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lazy-loading 'fault' on Instance uuid 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:35:20.820597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-51714be3-1134-4567-9286-b5bf5d9ec600 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:20.832679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-51714be3-1134-4567-9286-b5bf5d9ec600 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1307 microversion: 2.1 time: 0.179253 Jul 14 14:35:20.837573 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1094/2190] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:20 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1307 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:20.848494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fdbd122f-022c-46a3-99b3-0f2a267041bf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:20.849214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fdbd122f-022c-46a3-99b3-0f2a267041bf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:20.871393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdbd122f-022c-46a3-99b3-0f2a267041bf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:20.871855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdbd122f-022c-46a3-99b3-0f2a267041bf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:20.872655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdbd122f-022c-46a3-99b3-0f2a267041bf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:20.873120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdbd122f-022c-46a3-99b3-0f2a267041bf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:21.019971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-043096dd-57d1-47c8-89a2-a1046b2fc3ab tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:21.033080 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-043096dd-57d1-47c8-89a2-a1046b2fc3ab tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1522 microversion: 2.1 time: 1.016336 Jul 14 14:35:21.036267 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1097/2191] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:20 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1522 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:21.050820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d63c2f30-0d4a-4414-85a9-68ebda7b4774 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:21.051728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d63c2f30-0d4a-4414-85a9-68ebda7b4774 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:21.066898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d63c2f30-0d4a-4414-85a9-68ebda7b4774 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:21.070665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d63c2f30-0d4a-4414-85a9-68ebda7b4774 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:21.071735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d63c2f30-0d4a-4414-85a9-68ebda7b4774 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:21.072397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d63c2f30-0d4a-4414-85a9-68ebda7b4774 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:21.208893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d63c2f30-0d4a-4414-85a9-68ebda7b4774 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:21.223567 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d63c2f30-0d4a-4414-85a9-68ebda7b4774 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1283 microversion: 2.1 time: 0.185328 Jul 14 14:35:21.224387 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1098/2192] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:21 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1283 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:21.855009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7889dfc7-09b4-47d5-b977-8bd9ac7494b6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:21.856045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7889dfc7-09b4-47d5-b977-8bd9ac7494b6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:21.869406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7889dfc7-09b4-47d5-b977-8bd9ac7494b6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:21.871438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7889dfc7-09b4-47d5-b977-8bd9ac7494b6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:21.875689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7889dfc7-09b4-47d5-b977-8bd9ac7494b6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:21.877229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7889dfc7-09b4-47d5-b977-8bd9ac7494b6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:21.970114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7889dfc7-09b4-47d5-b977-8bd9ac7494b6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:21.972130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7889dfc7-09b4-47d5-b977-8bd9ac7494b6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:21.973122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-7889dfc7-09b4-47d5-b977-8bd9ac7494b6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lazy-loading 'fault' on Instance uuid 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:35:22.088290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7889dfc7-09b4-47d5-b977-8bd9ac7494b6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:22.103155 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7889dfc7-09b4-47d5-b977-8bd9ac7494b6 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 200 len: 1307 microversion: 2.1 time: 0.252840 Jul 14 14:35:22.105586 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1099/2193] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:21 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 1307 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:22.129218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5957f398-63e5-4630-90ba-9ac3cb0b8183 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:22.130604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5957f398-63e5-4630-90ba-9ac3cb0b8183 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:22.165538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5957f398-63e5-4630-90ba-9ac3cb0b8183 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:22.169779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5957f398-63e5-4630-90ba-9ac3cb0b8183 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:22.174269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5957f398-63e5-4630-90ba-9ac3cb0b8183 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:22.179489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5957f398-63e5-4630-90ba-9ac3cb0b8183 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:23.428590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fdbd122f-022c-46a3-99b3-0f2a267041bf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:23.445447 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fdbd122f-022c-46a3-99b3-0f2a267041bf tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1470 microversion: 2.1 time: 2.598250 Jul 14 14:35:23.446583 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1095/2194] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:20 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1470 bytes in 2608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:23.451511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ee06a8d6-f23d-44f4-a6f6-e57db4e8993d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:23.452139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ee06a8d6-f23d-44f4-a6f6-e57db4e8993d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:23.478159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee06a8d6-f23d-44f4-a6f6-e57db4e8993d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:23.485445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee06a8d6-f23d-44f4-a6f6-e57db4e8993d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:23.487552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee06a8d6-f23d-44f4-a6f6-e57db4e8993d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:23.488523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee06a8d6-f23d-44f4-a6f6-e57db4e8993d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:24.898731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5957f398-63e5-4630-90ba-9ac3cb0b8183 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:24.902637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ee06a8d6-f23d-44f4-a6f6-e57db4e8993d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:24.917878 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5957f398-63e5-4630-90ba-9ac3cb0b8183 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1522 microversion: 2.1 time: 2.808039 Jul 14 14:35:24.923421 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ee06a8d6-f23d-44f4-a6f6-e57db4e8993d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1325 microversion: 2.1 time: 1.475733 Jul 14 14:35:24.938112 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1100/2195] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:22 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1522 bytes in 2822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:24.949057 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1096/2196] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:23 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1325 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:24.979189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1bea9458-a636-4464-a424-ecb4f3a74303 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:24.983181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5697280f-55c9-41a7-9319-5ffd7515cc14 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:24.984184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1bea9458-a636-4464-a424-ecb4f3a74303 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:24.984507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5697280f-55c9-41a7-9319-5ffd7515cc14 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:25.002013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1bea9458-a636-4464-a424-ecb4f3a74303 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.002478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1bea9458-a636-4464-a424-ecb4f3a74303 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.006665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1bea9458-a636-4464-a424-ecb4f3a74303 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.007048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5697280f-55c9-41a7-9319-5ffd7515cc14 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.007522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5697280f-55c9-41a7-9319-5ffd7515cc14 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.008523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5697280f-55c9-41a7-9319-5ffd7515cc14 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.008727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1bea9458-a636-4464-a424-ecb4f3a74303 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.008963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5697280f-55c9-41a7-9319-5ffd7515cc14 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.047373 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-1bea9458-a636-4464-a424-ecb4f3a74303 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] HTTP exception thrown: Instance 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 could not be found. Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1bea9458-a636-4464-a424-ecb4f3a74303 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Request method failure captured: Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 HTTP/1.1 Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CjT3c3zJJ84LE-QTmu_N7TKc2vJamFLSX_RsNCc08bkmpF5n-Nu9FWM1NtArGpB5CPF5xMY4uJtIuYE6LZqhvGYf2JzXeGgXNt6b7VR2u0JPoNAJCHJHhj9V7Dqz90qdjKz2o2f2PhRD9Ft-YN05uGZlojn_Lv-A-BD95QzQ-Q1ROU Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_57545ddd8fb2414f8c03c1c44d2bb47f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}] Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f7852b6d7fb246ee980a61aa2be4f065 Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 could not be found. Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0'} Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 could not be found. Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 could not be found. Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:25.052287 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:25.057051 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:25.057051 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:25.057051 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:25.057051 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:25.057051 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:25.057051 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 could not be found. Jul 14 14:35:25.057051 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:25.059316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1bea9458-a636-4464-a424-ecb4f3a74303 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Returning 404 to user: Instance 01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:25.062305 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1bea9458-a636-4464-a424-ecb4f3a74303 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0" status: 404 len: 111 microversion: 2.1 time: 0.130821 Jul 14 14:35:25.063789 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1101/2197] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:24 2022] GET /compute/v2.1/servers/01d429af-cb44-41a8-ae7f-f9fbb6ac5fa0 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:25.080485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ee4e53f3-6273-4b18-a80a-64af20932b3e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:25.081200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ee4e53f3-6273-4b18-a80a-64af20932b3e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 2bad1987-d086-4152-bb13-99ccbd92bb8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:25.099616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee4e53f3-6273-4b18-a80a-64af20932b3e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.100621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee4e53f3-6273-4b18-a80a-64af20932b3e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.101567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee4e53f3-6273-4b18-a80a-64af20932b3e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.102945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee4e53f3-6273-4b18-a80a-64af20932b3e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.121915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:25.160409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ee4e53f3-6273-4b18-a80a-64af20932b3e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 2bad1987-d086-4152-bb13-99ccbd92bb8c] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:25.313734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:25.378837 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ee4e53f3-6273-4b18-a80a-64af20932b3e tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c" status: 204 len: 0 microversion: 2.1 time: 0.307913 Jul 14 14:35:25.384756 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1102/2198] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:25 2022] DELETE /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:25.401902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a4a96a3f-46da-4104-934f-f3e3f26efe13 req-1d1cb402-c36e-434b-9634-61db7ce01186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060acd95-d011-4085-a6ea-0dd61f800a44", "name": "network-vif-unplugged", "status": "completed", "tag": "24844627-1861-4f62-b756-6ff59877d5d0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:25.439319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a4a96a3f-46da-4104-934f-f3e3f26efe13 req-1d1cb402-c36e-434b-9634-61db7ce01186 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.441864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a4a96a3f-46da-4104-934f-f3e3f26efe13 req-1d1cb402-c36e-434b-9634-61db7ce01186 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.477846 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a4a96a3f-46da-4104-934f-f3e3f26efe13 req-1d1cb402-c36e-434b-9634-61db7ce01186 service nova] Creating event network-vif-unplugged:24844627-1861-4f62-b756-6ff59877d5d0 for instance 060acd95-d011-4085-a6ea-0dd61f800a44 on n-h1-767704-28 Jul 14 14:35:25.505003 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a4a96a3f-46da-4104-934f-f3e3f26efe13 req-1d1cb402-c36e-434b-9634-61db7ce01186 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116021 Jul 14 14:35:25.508143 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1103/2199] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:25.522447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae4112dc-f383-4e93-9912-327cf35e12c3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:25.524995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae4112dc-f383-4e93-9912-327cf35e12c3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:25.546314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae4112dc-f383-4e93-9912-327cf35e12c3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.547296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae4112dc-f383-4e93-9912-327cf35e12c3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.551398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae4112dc-f383-4e93-9912-327cf35e12c3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.552138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae4112dc-f383-4e93-9912-327cf35e12c3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.630730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae4112dc-f383-4e93-9912-327cf35e12c3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:25.849708 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ae4112dc-f383-4e93-9912-327cf35e12c3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 204 len: 0 microversion: 2.1 time: 0.337744 Jul 14 14:35:25.856971 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1104/2200] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:25 2022] DELETE /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:25.873850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-16e5bea5-4832-4696-be05-afc744901479 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:25.879722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-16e5bea5-4832-4696-be05-afc744901479 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 2bad1987-d086-4152-bb13-99ccbd92bb8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:25.889361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:25.912452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16e5bea5-4832-4696-be05-afc744901479 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.913223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16e5bea5-4832-4696-be05-afc744901479 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.913694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16e5bea5-4832-4696-be05-afc744901479 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.914931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16e5bea5-4832-4696-be05-afc744901479 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:26.788872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5697280f-55c9-41a7-9319-5ffd7515cc14 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461baecf4a774ef8ac1060fdf06ab7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd17b0a0dc45f08d3c9b4cfdb6da21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:26.820156 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5697280f-55c9-41a7-9319-5ffd7515cc14 tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 200 len: 1470 microversion: 2.1 time: 1.862046 Jul 14 14:35:26.834908 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1097/2201] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:24 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 1470 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:26.849675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bfd7a785-ebda-46fa-a372-c920dd7d2807 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:26.851078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bfd7a785-ebda-46fa-a372-c920dd7d2807 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:26.867147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfd7a785-ebda-46fa-a372-c920dd7d2807 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:26.871286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfd7a785-ebda-46fa-a372-c920dd7d2807 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:26.872418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfd7a785-ebda-46fa-a372-c920dd7d2807 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:26.873173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfd7a785-ebda-46fa-a372-c920dd7d2807 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:27.039471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-16e5bea5-4832-4696-be05-afc744901479 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:27.066855 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-16e5bea5-4832-4696-be05-afc744901479 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c" status: 200 len: 1475 microversion: 2.1 time: 1.208422 Jul 14 14:35:27.067488 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1105/2202] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:25 2022] GET /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c => generated 1475 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:27.082802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e2acd11-5ec8-4f67-8744-93b071a92861 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:27.083662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4e2acd11-5ec8-4f67-8744-93b071a92861 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:27.090305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e2acd11-5ec8-4f67-8744-93b071a92861 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:27.097771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e2acd11-5ec8-4f67-8744-93b071a92861 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:27.098838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e2acd11-5ec8-4f67-8744-93b071a92861 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:27.099737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e2acd11-5ec8-4f67-8744-93b071a92861 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:27.978655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bfd7a785-ebda-46fa-a372-c920dd7d2807 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:28.032978 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bfd7a785-ebda-46fa-a372-c920dd7d2807 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1522 microversion: 2.1 time: 1.195977 Jul 14 14:35:28.066488 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1098/2203] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:26 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1522 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:28.372832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4e2acd11-5ec8-4f67-8744-93b071a92861 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:28.408231 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e2acd11-5ec8-4f67-8744-93b071a92861 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1325 microversion: 2.1 time: 1.339074 Jul 14 14:35:28.413115 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1106/2204] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:27 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1325 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:28.573421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-109afc71-de2a-4874-88f7-897abc6316d0 tempest-ExtensionsTest-1782362842 tempest-ExtensionsTest-1782362842-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:28.575171 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-109afc71-de2a-4874-88f7-897abc6316d0 tempest-ExtensionsTest-1782362842 tempest-ExtensionsTest-1782362842-project] 10.222.0.81 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.506630 Jul 14 14:35:28.575814 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1099/2205] 10.222.0.81 () {58 vars in 1169 bytes} [Thu Jul 14 14:35:28 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:28.586339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-d0be82c1-cd0c-4488-bfee-8a375d281fec req-87400b00-0cd7-40c6-bec8-59ba1a6db331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060acd95-d011-4085-a6ea-0dd61f800a44", "name": "network-vif-deleted", "tag": "24844627-1861-4f62-b756-6ff59877d5d0"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:28.606563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d0be82c1-cd0c-4488-bfee-8a375d281fec req-87400b00-0cd7-40c6-bec8-59ba1a6db331 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:28.609471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d0be82c1-cd0c-4488-bfee-8a375d281fec req-87400b00-0cd7-40c6-bec8-59ba1a6db331 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:28.642162 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-d0be82c1-cd0c-4488-bfee-8a375d281fec req-87400b00-0cd7-40c6-bec8-59ba1a6db331 service nova] Creating event network-vif-deleted:24844627-1861-4f62-b756-6ff59877d5d0 for instance 060acd95-d011-4085-a6ea-0dd61f800a44 on n-h1-767704-28 Jul 14 14:35:28.664714 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-d0be82c1-cd0c-4488-bfee-8a375d281fec req-87400b00-0cd7-40c6-bec8-59ba1a6db331 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087486 Jul 14 14:35:28.668309 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1100/2206] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:28.684495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61a253da-f9f1-47fb-bca0-fd28956eaead tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:28.694228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-61a253da-f9f1-47fb-bca0-fd28956eaead tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] [instance: 060acd95-d011-4085-a6ea-0dd61f800a44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:28.707583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61a253da-f9f1-47fb-bca0-fd28956eaead tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:28.708356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61a253da-f9f1-47fb-bca0-fd28956eaead tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:28.710611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61a253da-f9f1-47fb-bca0-fd28956eaead tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:28.711836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61a253da-f9f1-47fb-bca0-fd28956eaead tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:28.759284 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-61a253da-f9f1-47fb-bca0-fd28956eaead tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] HTTP exception thrown: Instance 060acd95-d011-4085-a6ea-0dd61f800a44 could not be found. Jul 14 14:35:28.772931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2de3367e-c9bb-48cf-962b-a3fb01bf593c tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Action: 'create', calling method: .version_select at 0x7fd6c61dc5e0>, body: {"keypair": {"name": "tempest-keypair-712286250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4YobV4sHAJ9cAXiBgUnh/nVa4egq/2Q2x2Nobcz3oKwddX0uYqDSSM7f8O27onB7ku70pL9Ii4yxCNqeet3KFtCR/rfwYbi6hjigXkCm5zzu/6RT5whE//GIksInOShA=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61a253da-f9f1-47fb-bca0-fd28956eaead tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Request method failure captured: Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 HTTP/1.1 Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CmJxnhPg0bagDVrLkX_MLiFr6czY558Wj1Iuhmy8Tl5bhR9ynwUVCRqJr3yzxewOandy_uBF0-dRG6QKQKpNcn2UYXxRj9CPUzmOPHCeMCj3dsPCQJAMfhogWh9oj88RzOeEv_s3jb08SLVZ0PRPEgXwNnhVNw0Fm_qiq0p1lTZYic Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d3fd17b0a0dc45f08d3c9b4cfdb6da21 Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TenantUsagesTestJSON-2118817986 Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d3fd17b0a0dc45f08d3c9b4cfdb6da21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d3fd17b0a0dc45f08d3c9b4cfdb6da21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d3fd17b0a0dc45f08d3c9b4cfdb6da21", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d3fd17b0a0dc45f08d3c9b4cfdb6da21"}]}] Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TenantUsagesTestJSON-2118817986 Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d3fd17b0a0dc45f08d3c9b4cfdb6da21 Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TenantUsagesTestJSON-2118817986 Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TenantUsagesTestJSON-2118817986-project Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 461baecf4a774ef8ac1060fdf06ab7aa Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TenantUsagesTestJSON-2118817986-project Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 060acd95-d011-4085-a6ea-0dd61f800a44 could not be found. Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '060acd95-d011-4085-a6ea-0dd61f800a44'} Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 060acd95-d011-4085-a6ea-0dd61f800a44 could not be found. Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 060acd95-d011-4085-a6ea-0dd61f800a44 could not be found. Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:28.775115 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:28.779142 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:28.779142 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:28.779142 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:28.779142 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:28.779142 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:28.779142 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 060acd95-d011-4085-a6ea-0dd61f800a44 could not be found. Jul 14 14:35:28.779142 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:28.781355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61a253da-f9f1-47fb-bca0-fd28956eaead tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] Returning 404 to user: Instance 060acd95-d011-4085-a6ea-0dd61f800a44 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:28.784447 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-61a253da-f9f1-47fb-bca0-fd28956eaead tempest-TenantUsagesTestJSON-2118817986 tempest-TenantUsagesTestJSON-2118817986-project] 10.222.0.81 "GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44" status: 404 len: 111 microversion: 2.1 time: 0.114224 Jul 14 14:35:28.785557 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1101/2207] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:28 2022] GET /compute/v2.1/servers/060acd95-d011-4085-a6ea-0dd61f800a44 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:28.798120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b23f4c4e-513d-4050-8e07-6ae2a28db2ee tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:28.801920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b23f4c4e-513d-4050-8e07-6ae2a28db2ee tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 2bad1987-d086-4152-bb13-99ccbd92bb8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:28.818257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b23f4c4e-513d-4050-8e07-6ae2a28db2ee tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:28.822175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b23f4c4e-513d-4050-8e07-6ae2a28db2ee tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:28.822766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-2de3367e-c9bb-48cf-962b-a3fb01bf593c tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Getting quotas for project c63db38e19164be5a420831ee77fe875. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:35:28.823847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b23f4c4e-513d-4050-8e07-6ae2a28db2ee tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:28.824470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b23f4c4e-513d-4050-8e07-6ae2a28db2ee tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:28.839231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-2de3367e-c9bb-48cf-962b-a3fb01bf593c tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Getting quotas for user 091085fb7a6342028a985fc718513c3a and project c63db38e19164be5a420831ee77fe875. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:35:28.898601 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2de3367e-c9bb-48cf-962b-a3fb01bf593c tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.483947 Jul 14 14:35:28.900162 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1107/2208] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:35:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:28.917218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21b29e07-29b9-4a0c-abe0-906cabcf122d tempest-ExtensionsTest-1782362842 tempest-ExtensionsTest-1782362842-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:28.919712 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21b29e07-29b9-4a0c-abe0-906cabcf122d tempest-ExtensionsTest-1782362842 tempest-ExtensionsTest-1782362842-project] 10.222.0.81 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.018411 Jul 14 14:35:28.920487 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1108/2209] 10.222.0.81 () {58 vars in 1133 bytes} [Thu Jul 14 14:35:28 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:35:29.040387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b23f4c4e-513d-4050-8e07-6ae2a28db2ee tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:29.052092 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b23f4c4e-513d-4050-8e07-6ae2a28db2ee tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c" status: 200 len: 1433 microversion: 2.1 time: 0.264502 Jul 14 14:35:29.053182 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1102/2210] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:28 2022] GET /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c => generated 1433 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:29.080689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f86dcd55-3fbc-44bd-868c-db03b02a967f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:29.081715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f86dcd55-3fbc-44bd-868c-db03b02a967f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:29.093983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f86dcd55-3fbc-44bd-868c-db03b02a967f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:29.097536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f86dcd55-3fbc-44bd-868c-db03b02a967f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:29.098588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f86dcd55-3fbc-44bd-868c-db03b02a967f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:29.101637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f86dcd55-3fbc-44bd-868c-db03b02a967f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:29.259507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6abdf1bd-e8b0-4565-806b-0cce9a8bff9f req-04690d77-4765-4b0c-9500-d21556f5c53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bad1987-d086-4152-bb13-99ccbd92bb8c", "name": "network-vif-deleted", "tag": "fe774887-d248-4bf3-bb6b-abe60ece7908"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:29.279364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6abdf1bd-e8b0-4565-806b-0cce9a8bff9f req-04690d77-4765-4b0c-9500-d21556f5c53e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:29.282754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6abdf1bd-e8b0-4565-806b-0cce9a8bff9f req-04690d77-4765-4b0c-9500-d21556f5c53e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:29.333218 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6abdf1bd-e8b0-4565-806b-0cce9a8bff9f req-04690d77-4765-4b0c-9500-d21556f5c53e service nova] Creating event network-vif-deleted:fe774887-d248-4bf3-bb6b-abe60ece7908 for instance 2bad1987-d086-4152-bb13-99ccbd92bb8c on n-h2-767704-28 Jul 14 14:35:29.354222 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6abdf1bd-e8b0-4565-806b-0cce9a8bff9f req-04690d77-4765-4b0c-9500-d21556f5c53e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100660 Jul 14 14:35:29.361583 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1103/2211] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:29.428826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-22bcfd48-9fa2-42d9-84c3-90ccb7fbc0c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:29.434603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-22bcfd48-9fa2-42d9-84c3-90ccb7fbc0c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:29.455341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22bcfd48-9fa2-42d9-84c3-90ccb7fbc0c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:29.460044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22bcfd48-9fa2-42d9-84c3-90ccb7fbc0c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:29.467321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22bcfd48-9fa2-42d9-84c3-90ccb7fbc0c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:29.468544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22bcfd48-9fa2-42d9-84c3-90ccb7fbc0c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:29.837769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:29.991735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:30.871395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f86dcd55-3fbc-44bd-868c-db03b02a967f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:30.888721 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f86dcd55-3fbc-44bd-868c-db03b02a967f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1522 microversion: 2.1 time: 1.812231 Jul 14 14:35:30.895138 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1109/2212] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:29 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1522 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:30.903941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e262a34b-3dcd-4909-bb2f-14e8d8c9101d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:30.905009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e262a34b-3dcd-4909-bb2f-14e8d8c9101d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 2bad1987-d086-4152-bb13-99ccbd92bb8c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:30.924367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e262a34b-3dcd-4909-bb2f-14e8d8c9101d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:30.926462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e262a34b-3dcd-4909-bb2f-14e8d8c9101d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:30.927472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e262a34b-3dcd-4909-bb2f-14e8d8c9101d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:30.930210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e262a34b-3dcd-4909-bb2f-14e8d8c9101d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:30.962753 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-e262a34b-3dcd-4909-bb2f-14e8d8c9101d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] HTTP exception thrown: Instance 2bad1987-d086-4152-bb13-99ccbd92bb8c could not be found. Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e262a34b-3dcd-4909-bb2f-14e8d8c9101d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Request method failure captured: Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c HTTP/1.1 Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CjT3c3zJJ84LE-QTmu_N7TKc2vJamFLSX_RsNCc08bkmpF5n-Nu9FWM1NtArGpB5CPF5xMY4uJtIuYE6LZqhvGYf2JzXeGgXNt6b7VR2u0JPoNAJCHJHhj9V7Dqz90qdjKz2o2f2PhRD9Ft-YN05uGZlojn_Lv-A-BD95QzQ-Q1ROU Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_57545ddd8fb2414f8c03c1c44d2bb47f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}] Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f7852b6d7fb246ee980a61aa2be4f065 Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 2bad1987-d086-4152-bb13-99ccbd92bb8c could not be found. Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '2bad1987-d086-4152-bb13-99ccbd92bb8c'} Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bad1987-d086-4152-bb13-99ccbd92bb8c could not be found. Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bad1987-d086-4152-bb13-99ccbd92bb8c could not be found. Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:30.965016 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:30.971933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:30.971933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:30.971933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:30.971933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:30.971933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:30.971933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bad1987-d086-4152-bb13-99ccbd92bb8c could not be found. Jul 14 14:35:30.971933 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:30.974022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e262a34b-3dcd-4909-bb2f-14e8d8c9101d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Returning 404 to user: Instance 2bad1987-d086-4152-bb13-99ccbd92bb8c could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:30.980267 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e262a34b-3dcd-4909-bb2f-14e8d8c9101d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c" status: 404 len: 111 microversion: 2.1 time: 0.083682 Jul 14 14:35:30.981164 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1110/2213] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:30 2022] GET /compute/v2.1/servers/2bad1987-d086-4152-bb13-99ccbd92bb8c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:30.992005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0482af45-7d2a-4358-bdbe-24fcf26b40cd req-2e70a948-0719-4964-babb-6991db414273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c46f722-10e5-4303-a3fa-716190afe6b0", "name": "network-vif-unplugged", "status": "completed", "tag": "d148890b-4fb9-4562-bf79-cbf8e06f2a18"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:31.009791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0482af45-7d2a-4358-bdbe-24fcf26b40cd req-2e70a948-0719-4964-babb-6991db414273 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:31.010474 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0482af45-7d2a-4358-bdbe-24fcf26b40cd req-2e70a948-0719-4964-babb-6991db414273 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:31.029410 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0482af45-7d2a-4358-bdbe-24fcf26b40cd req-2e70a948-0719-4964-babb-6991db414273 service nova] Creating event network-vif-unplugged:d148890b-4fb9-4562-bf79-cbf8e06f2a18 for instance 6c46f722-10e5-4303-a3fa-716190afe6b0 on n-h1-767704-28 Jul 14 14:35:31.044904 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0482af45-7d2a-4358-bdbe-24fcf26b40cd req-2e70a948-0719-4964-babb-6991db414273 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059861 Jul 14 14:35:31.046452 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1111/2214] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:31.060461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ef3a3024-4afa-447a-a0fa-dc8e1ef12ed7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:31.061347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ef3a3024-4afa-447a-a0fa-dc8e1ef12ed7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:31.075178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef3a3024-4afa-447a-a0fa-dc8e1ef12ed7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:31.075753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef3a3024-4afa-447a-a0fa-dc8e1ef12ed7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:31.076665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef3a3024-4afa-447a-a0fa-dc8e1ef12ed7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:31.077768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef3a3024-4afa-447a-a0fa-dc8e1ef12ed7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:32.141698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-22bcfd48-9fa2-42d9-84c3-90ccb7fbc0c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:32.164171 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-22bcfd48-9fa2-42d9-84c3-90ccb7fbc0c6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1325 microversion: 2.1 time: 2.740688 Jul 14 14:35:32.165177 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1104/2215] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:29 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1325 bytes in 2742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:32.175568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-188cab88-9e42-453d-a332-5352b3e81ea4 req-65681486-c49a-4ccb-97f7-a2d2d81eef99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad", "tag": "e5602274-dec3-49a9-9a61-41955c9e695f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:32.198783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-188cab88-9e42-453d-a332-5352b3e81ea4 req-65681486-c49a-4ccb-97f7-a2d2d81eef99 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:32.201396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-188cab88-9e42-453d-a332-5352b3e81ea4 req-65681486-c49a-4ccb-97f7-a2d2d81eef99 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:32.235019 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-188cab88-9e42-453d-a332-5352b3e81ea4 req-65681486-c49a-4ccb-97f7-a2d2d81eef99 service nova] Creating event network-changed:e5602274-dec3-49a9-9a61-41955c9e695f for instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad on n-h2-767704-28 Jul 14 14:35:32.251534 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-188cab88-9e42-453d-a332-5352b3e81ea4 req-65681486-c49a-4ccb-97f7-a2d2d81eef99 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082443 Jul 14 14:35:32.258548 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1105/2216] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:32.265465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc2b1a28-2607-4253-b8f8-0e62d966d7c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:32.271140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc2b1a28-2607-4253-b8f8-0e62d966d7c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:32.287536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc2b1a28-2607-4253-b8f8-0e62d966d7c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:32.288001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc2b1a28-2607-4253-b8f8-0e62d966d7c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:32.294039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc2b1a28-2607-4253-b8f8-0e62d966d7c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:32.294514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc2b1a28-2607-4253-b8f8-0e62d966d7c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:32.941210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ef3a3024-4afa-447a-a0fa-dc8e1ef12ed7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:32.974732 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ef3a3024-4afa-447a-a0fa-dc8e1ef12ed7 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 200 len: 1475 microversion: 2.1 time: 1.926731 Jul 14 14:35:32.986283 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1112/2217] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:31 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 1475 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:33.183464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-40143402-a327-4cf8-ab8e-585fe002e681 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:33.184417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-40143402-a327-4cf8-ab8e-585fe002e681 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:33.192153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-40143402-a327-4cf8-ab8e-585fe002e681 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:33.192789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-40143402-a327-4cf8-ab8e-585fe002e681 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:33.193715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-40143402-a327-4cf8-ab8e-585fe002e681 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:33.194047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-40143402-a327-4cf8-ab8e-585fe002e681 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:33.321012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc2b1a28-2607-4253-b8f8-0e62d966d7c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:33.341903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:33.347688 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc2b1a28-2607-4253-b8f8-0e62d966d7c6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1504 microversion: 2.1 time: 1.085046 Jul 14 14:35:33.349370 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1106/2218] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:32 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1504 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:33.993635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a18aae37-1186-4cb2-a519-4a32970d30ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:33.994348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a18aae37-1186-4cb2-a519-4a32970d30ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: 6c46f722-10e5-4303-a3fa-716190afe6b0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:34.020111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a18aae37-1186-4cb2-a519-4a32970d30ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.024424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a18aae37-1186-4cb2-a519-4a32970d30ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:34.025699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a18aae37-1186-4cb2-a519-4a32970d30ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.036204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a18aae37-1186-4cb2-a519-4a32970d30ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:34.076083 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-a18aae37-1186-4cb2-a519-4a32970d30ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] HTTP exception thrown: Instance 6c46f722-10e5-4303-a3fa-716190afe6b0 could not be found. Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a18aae37-1186-4cb2-a519-4a32970d30ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Request method failure captured: Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 HTTP/1.1 Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CjT3c3zJJ84LE-QTmu_N7TKc2vJamFLSX_RsNCc08bkmpF5n-Nu9FWM1NtArGpB5CPF5xMY4uJtIuYE6LZqhvGYf2JzXeGgXNt6b7VR2u0JPoNAJCHJHhj9V7Dqz90qdjKz2o2f2PhRD9Ft-YN05uGZlojn_Lv-A-BD95QzQ-Q1ROU Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_57545ddd8fb2414f8c03c1c44d2bb47f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}] Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: f7852b6d7fb246ee980a61aa2be4f065 Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 6c46f722-10e5-4303-a3fa-716190afe6b0 could not be found. Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6c46f722-10e5-4303-a3fa-716190afe6b0'} Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c46f722-10e5-4303-a3fa-716190afe6b0 could not be found. Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c46f722-10e5-4303-a3fa-716190afe6b0 could not be found. Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:34.082987 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.087343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.087343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.087343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.087343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:34.087343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:34.087343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c46f722-10e5-4303-a3fa-716190afe6b0 could not be found. Jul 14 14:35:34.087343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.089575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a18aae37-1186-4cb2-a519-4a32970d30ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Returning 404 to user: Instance 6c46f722-10e5-4303-a3fa-716190afe6b0 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:34.093282 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a18aae37-1186-4cb2-a519-4a32970d30ab tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0" status: 404 len: 111 microversion: 2.1 time: 0.101166 Jul 14 14:35:34.094429 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1107/2219] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:33 2022] GET /compute/v2.1/servers/6c46f722-10e5-4303-a3fa-716190afe6b0 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:35:34.103307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fbfae571-56e0-4be7-80d1-1f9510783ad3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.183843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-40143402-a327-4cf8-ab8e-585fe002e681 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:34.197205 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-40143402-a327-4cf8-ab8e-585fe002e681 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1325 microversion: 2.1 time: 1.019653 Jul 14 14:35:34.201257 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1113/2220] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:33 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1325 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:34.202840 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fbfae571-56e0-4be7-80d1-1f9510783ad3 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/d294f556-b8c6-437e-a82d-e0f4994a1030" status: 204 len: 0 microversion: 2.1 time: 0.101316 Jul 14 14:35:34.209762 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1108/2221] 10.222.0.81 () {58 vars in 1265 bytes} [Thu Jul 14 14:35:34 2022] DELETE /compute/v2.1/os-server-groups/d294f556-b8c6-437e-a82d-e0f4994a1030 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:34.221093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ed06a81-fafa-436f-b21d-8dcbe09dc15d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.223867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ed06a81-fafa-436f-b21d-8dcbe09dc15d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ae5e79cc-1b63-403c-b5ed-83db2b2f1b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:34.250341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ed06a81-fafa-436f-b21d-8dcbe09dc15d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.255141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ed06a81-fafa-436f-b21d-8dcbe09dc15d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:34.258484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ed06a81-fafa-436f-b21d-8dcbe09dc15d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.265216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ed06a81-fafa-436f-b21d-8dcbe09dc15d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:34.363969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b00cc200-447c-46a5-803c-f86f18f1b5df req-013b115b-303b-415d-b949-63dd4b97d8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c46f722-10e5-4303-a3fa-716190afe6b0", "name": "network-vif-deleted", "tag": "d148890b-4fb9-4562-bf79-cbf8e06f2a18"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:34.387392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ed06a81-fafa-436f-b21d-8dcbe09dc15d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ae5e79cc-1b63-403c-b5ed-83db2b2f1b98] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:34.395273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b00cc200-447c-46a5-803c-f86f18f1b5df req-013b115b-303b-415d-b949-63dd4b97d8e2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.400682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b00cc200-447c-46a5-803c-f86f18f1b5df req-013b115b-303b-415d-b949-63dd4b97d8e2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:34.439884 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b00cc200-447c-46a5-803c-f86f18f1b5df req-013b115b-303b-415d-b949-63dd4b97d8e2 service nova] Creating event network-vif-deleted:d148890b-4fb9-4562-bf79-cbf8e06f2a18 for instance 6c46f722-10e5-4303-a3fa-716190afe6b0 on n-h1-767704-28 Jul 14 14:35:34.455700 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b00cc200-447c-46a5-803c-f86f18f1b5df req-013b115b-303b-415d-b949-63dd4b97d8e2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093877 Jul 14 14:35:34.456884 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1109/2222] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:34.466866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5e7d7a6e-52b2-4040-ac63-e9b769fd16fd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.470611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5e7d7a6e-52b2-4040-ac63-e9b769fd16fd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:34.497585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e7d7a6e-52b2-4040-ac63-e9b769fd16fd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.505382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e7d7a6e-52b2-4040-ac63-e9b769fd16fd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:34.506745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e7d7a6e-52b2-4040-ac63-e9b769fd16fd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.510852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e7d7a6e-52b2-4040-ac63-e9b769fd16fd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:34.637655 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ed06a81-fafa-436f-b21d-8dcbe09dc15d tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98" status: 204 len: 0 microversion: 2.1 time: 0.428309 Jul 14 14:35:34.638827 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1114/2223] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:34 2022] DELETE /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:34.665042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e2e24d77-e06b-40c3-9c3f-40e9449500a8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.665758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e2e24d77-e06b-40c3-9c3f-40e9449500a8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: c13590db-1680-4b10-b598-cc2eb89d8b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:34.682539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2e24d77-e06b-40c3-9c3f-40e9449500a8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.683065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2e24d77-e06b-40c3-9c3f-40e9449500a8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:34.683904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2e24d77-e06b-40c3-9c3f-40e9449500a8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.689332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2e24d77-e06b-40c3-9c3f-40e9449500a8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:34.783932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e2e24d77-e06b-40c3-9c3f-40e9449500a8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: c13590db-1680-4b10-b598-cc2eb89d8b32] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:34.994696 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e2e24d77-e06b-40c3-9c3f-40e9449500a8 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32" status: 204 len: 0 microversion: 2.1 time: 0.344962 Jul 14 14:35:34.997163 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1115/2224] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:34 2022] DELETE /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:35:35.015774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0e8c53a1-7382-48a3-ae9c-f82ece9c387a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:35.016750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0e8c53a1-7382-48a3-ae9c-f82ece9c387a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ae5e79cc-1b63-403c-b5ed-83db2b2f1b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:35.036837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e8c53a1-7382-48a3-ae9c-f82ece9c387a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:35.037485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e8c53a1-7382-48a3-ae9c-f82ece9c387a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:35.038337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e8c53a1-7382-48a3-ae9c-f82ece9c387a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:35.038790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e8c53a1-7382-48a3-ae9c-f82ece9c387a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:35.052187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:35.073502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5e7d7a6e-52b2-4040-ac63-e9b769fd16fd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:35.087610 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5e7d7a6e-52b2-4040-ac63-e9b769fd16fd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1504 microversion: 2.1 time: 0.627036 Jul 14 14:35:35.089925 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1110/2225] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:34 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1504 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:35.223436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aa9715a9-e8df-444a-8c7a-13b717a5a5d1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:35.224075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aa9715a9-e8df-444a-8c7a-13b717a5a5d1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:35.239222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa9715a9-e8df-444a-8c7a-13b717a5a5d1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:35.239695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa9715a9-e8df-444a-8c7a-13b717a5a5d1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:35.241389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa9715a9-e8df-444a-8c7a-13b717a5a5d1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:35.242890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa9715a9-e8df-444a-8c7a-13b717a5a5d1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:35.363229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0e8c53a1-7382-48a3-ae9c-f82ece9c387a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:35.376436 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0e8c53a1-7382-48a3-ae9c-f82ece9c387a tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98" status: 200 len: 1474 microversion: 2.1 time: 0.366886 Jul 14 14:35:35.394428 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1116/2226] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:35 2022] GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 => generated 1474 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:35.465334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-4252b1a0-bb55-46dd-9ae5-2e50ba432993 req-29ebb64c-3291-45dd-a372-43e6dcfd097f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131fc2d4-00c2-462b-b7e2-4fbb53234749", "name": "network-vif-unplugged", "status": "completed", "tag": "8f81fa18-1ee0-41c0-a4e5-0c0a8bc1111a"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:35.492347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4252b1a0-bb55-46dd-9ae5-2e50ba432993 req-29ebb64c-3291-45dd-a372-43e6dcfd097f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:35.492889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4252b1a0-bb55-46dd-9ae5-2e50ba432993 req-29ebb64c-3291-45dd-a372-43e6dcfd097f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:35.518553 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-4252b1a0-bb55-46dd-9ae5-2e50ba432993 req-29ebb64c-3291-45dd-a372-43e6dcfd097f service nova] Creating event network-vif-unplugged:8f81fa18-1ee0-41c0-a4e5-0c0a8bc1111a for instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 on n-h2-767704-28 Jul 14 14:35:35.534845 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-4252b1a0-bb55-46dd-9ae5-2e50ba432993 req-29ebb64c-3291-45dd-a372-43e6dcfd097f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075659 Jul 14 14:35:35.539206 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1117/2227] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:35.620402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-aa9715a9-e8df-444a-8c7a-13b717a5a5d1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:35.633041 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aa9715a9-e8df-444a-8c7a-13b717a5a5d1 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1325 microversion: 2.1 time: 0.415256 Jul 14 14:35:35.633906 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1111/2228] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:35 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1325 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:35.734669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "08f37582-602e-4a13-8c32-a863c3f77c4a"}], "security_groups": [{"name": "tempest-securitygroup--1120552297"}], "key_name": "tempest-keypair-712286250", "user_data": "}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:36.022699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] validate_networks() for [('08f37582-602e-4a13-8c32-a863c3f77c4a', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:35:36.111993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a31df47-9d84-421f-a006-1375cf93f7a3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.113249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2a31df47-9d84-421f-a006-1375cf93f7a3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:36.134864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:36.148759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a31df47-9d84-421f-a006-1375cf93f7a3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:36.152473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a31df47-9d84-421f-a006-1375cf93f7a3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:36.154075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a31df47-9d84-421f-a006-1375cf93f7a3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:36.155125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a31df47-9d84-421f-a006-1375cf93f7a3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:36.973985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2a31df47-9d84-421f-a006-1375cf93f7a3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:36.994129 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a31df47-9d84-421f-a006-1375cf93f7a3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1504 microversion: 2.1 time: 0.890847 Jul 14 14:35:36.994900 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1112/2229] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:36 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1504 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:36.999716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f317a494-59ee-40f6-8465-6377fd4980ff tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:37.000345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f317a494-59ee-40f6-8465-6377fd4980ff tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ae5e79cc-1b63-403c-b5ed-83db2b2f1b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:37.007247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f317a494-59ee-40f6-8465-6377fd4980ff tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:37.007877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f317a494-59ee-40f6-8465-6377fd4980ff tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:37.008835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f317a494-59ee-40f6-8465-6377fd4980ff tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:37.009704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f317a494-59ee-40f6-8465-6377fd4980ff tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:37.392710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f317a494-59ee-40f6-8465-6377fd4980ff tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:37.409732 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f317a494-59ee-40f6-8465-6377fd4980ff tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98" status: 200 len: 1474 microversion: 2.1 time: 0.413773 Jul 14 14:35:37.419269 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1113/2230] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:36 2022] GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 => generated 1474 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:37.425904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4bdf814a-af87-435b-9f8c-325cec30e19d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:37.426554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4bdf814a-af87-435b-9f8c-325cec30e19d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:37.433801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4bdf814a-af87-435b-9f8c-325cec30e19d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:37.434256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4bdf814a-af87-435b-9f8c-325cec30e19d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:37.435042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4bdf814a-af87-435b-9f8c-325cec30e19d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:37.435481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4bdf814a-af87-435b-9f8c-325cec30e19d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:37.979145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:35:37.980128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:35:37.980841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:35:37.982223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:35:37.983586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:35:38.022378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.023792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.026236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.027344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.066079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Getting quotas for project c63db38e19164be5a420831ee77fe875. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:35:38.073827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Getting quotas for user 091085fb7a6342028a985fc718513c3a and project c63db38e19164be5a420831ee77fe875. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:35:38.100521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:35:38.104491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:35:38.206777 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2cddc990-03b8-4e44-9833-daaa131ebe25 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.480272 Jul 14 14:35:38.217523 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1118/2231] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:35:38.244928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-db75b626-8407-4e13-95f4-736139d40c82 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:38.250140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-db75b626-8407-4e13-95f4-736139d40c82 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:38.258987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4bdf814a-af87-435b-9f8c-325cec30e19d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:38.280009 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4bdf814a-af87-435b-9f8c-325cec30e19d tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1325 microversion: 2.1 time: 0.858526 Jul 14 14:35:38.282615 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1114/2232] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:37 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1325 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:38.286677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db75b626-8407-4e13-95f4-736139d40c82 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.287139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db75b626-8407-4e13-95f4-736139d40c82 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.287935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db75b626-8407-4e13-95f4-736139d40c82 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.288381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db75b626-8407-4e13-95f4-736139d40c82 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.292333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4c556241-c7dd-41f7-ba4c-75d682c3c13f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:38.293814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4c556241-c7dd-41f7-ba4c-75d682c3c13f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:38.755343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4c556241-c7dd-41f7-ba4c-75d682c3c13f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:38.763985 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4c556241-c7dd-41f7-ba4c-75d682c3c13f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1225 microversion: 2.1 time: 0.480252 Jul 14 14:35:38.770300 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1115/2233] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:38 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1225 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:38.778343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ebaaf96-c6cb-45e8-b608-3f45b20b1e11 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:38.782416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ebaaf96-c6cb-45e8-b608-3f45b20b1e11 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ae5e79cc-1b63-403c-b5ed-83db2b2f1b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:38.802680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ebaaf96-c6cb-45e8-b608-3f45b20b1e11 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.804203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ebaaf96-c6cb-45e8-b608-3f45b20b1e11 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.806606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ebaaf96-c6cb-45e8-b608-3f45b20b1e11 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.807298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ebaaf96-c6cb-45e8-b608-3f45b20b1e11 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:39.946382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ebaaf96-c6cb-45e8-b608-3f45b20b1e11 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:39.957758 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ebaaf96-c6cb-45e8-b608-3f45b20b1e11 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98" status: 200 len: 1474 microversion: 2.1 time: 1.186118 Jul 14 14:35:39.960579 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1116/2234] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:38 2022] GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 => generated 1474 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:39.977189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5530ce12-6a98-420f-a1c6-a679048a779f tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:39.980306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5530ce12-6a98-420f-a1c6-a679048a779f tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:40.003652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5530ce12-6a98-420f-a1c6-a679048a779f tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:40.006136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5530ce12-6a98-420f-a1c6-a679048a779f tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:40.008263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5530ce12-6a98-420f-a1c6-a679048a779f tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:40.009479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5530ce12-6a98-420f-a1c6-a679048a779f tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:40.259839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-db75b626-8407-4e13-95f4-736139d40c82 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:40.285397 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-db75b626-8407-4e13-95f4-736139d40c82 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 200 len: 1447 microversion: 2.1 time: 2.063473 Jul 14 14:35:40.288774 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1119/2235] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:38 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 1447 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:40.301038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f2f57f26-d489-492d-8fed-a22594921b05 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:40.301937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f2f57f26-d489-492d-8fed-a22594921b05 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:40.328981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2f57f26-d489-492d-8fed-a22594921b05 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:40.329654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2f57f26-d489-492d-8fed-a22594921b05 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:40.331390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2f57f26-d489-492d-8fed-a22594921b05 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:40.333927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2f57f26-d489-492d-8fed-a22594921b05 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:41.576253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f2f57f26-d489-492d-8fed-a22594921b05 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:41.587644 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f2f57f26-d489-492d-8fed-a22594921b05 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1285 microversion: 2.1 time: 1.296055 Jul 14 14:35:41.601317 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1120/2236] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:40 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1285 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:41.606583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:41.607486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:41.624098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:41.627540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:41.628451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:41.628911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:41.684872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:41.698945 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.compute.api [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Working on deleting snapshot 7e719250-909e-43d7-a064-abde4db99b2e from shelved instance... Jul 14 14:35:41.845349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5530ce12-6a98-420f-a1c6-a679048a779f tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:41.864738 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5530ce12-6a98-420f-a1c6-a679048a779f tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1325 microversion: 2.1 time: 1.894017 Jul 14 14:35:41.877153 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1117/2237] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:39 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1325 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:41.895553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c51264ef-ca27-4847-bb93-1785dae63087 req-368f56cb-cf3a-4633-a908-c26200bd5345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5e79cc-1b63-403c-b5ed-83db2b2f1b98", "name": "network-vif-deleted", "tag": "b84c6666-dca9-49d7-a2ae-d3c4b1247ecb"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:41.924050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c51264ef-ca27-4847-bb93-1785dae63087 req-368f56cb-cf3a-4633-a908-c26200bd5345 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:41.924502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c51264ef-ca27-4847-bb93-1785dae63087 req-368f56cb-cf3a-4633-a908-c26200bd5345 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:41.952760 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c51264ef-ca27-4847-bb93-1785dae63087 req-368f56cb-cf3a-4633-a908-c26200bd5345 service nova] Creating event network-vif-deleted:b84c6666-dca9-49d7-a2ae-d3c4b1247ecb for instance ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 on n-h1-767704-28 Jul 14 14:35:41.966541 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c51264ef-ca27-4847-bb93-1785dae63087 req-368f56cb-cf3a-4633-a908-c26200bd5345 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078808 Jul 14 14:35:41.969549 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1118/2238] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:41.981215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd013e56-9c3c-4c59-acdb-8a428c73f214 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:41.982274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bd013e56-9c3c-4c59-acdb-8a428c73f214 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ae5e79cc-1b63-403c-b5ed-83db2b2f1b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:41.999240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd013e56-9c3c-4c59-acdb-8a428c73f214 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.000633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd013e56-9c3c-4c59-acdb-8a428c73f214 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.004567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd013e56-9c3c-4c59-acdb-8a428c73f214 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.005405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd013e56-9c3c-4c59-acdb-8a428c73f214 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.049964 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-bd013e56-9c3c-4c59-acdb-8a428c73f214 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] HTTP exception thrown: Instance ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 could not be found. Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd013e56-9c3c-4c59-acdb-8a428c73f214 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Request method failure captured: Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 HTTP/1.1 Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CjT3c3zJJ84LE-QTmu_N7TKc2vJamFLSX_RsNCc08bkmpF5n-Nu9FWM1NtArGpB5CPF5xMY4uJtIuYE6LZqhvGYf2JzXeGgXNt6b7VR2u0JPoNAJCHJHhj9V7Dqz90qdjKz2o2f2PhRD9Ft-YN05uGZlojn_Lv-A-BD95QzQ-Q1ROU Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_57545ddd8fb2414f8c03c1c44d2bb47f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}] Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: f7852b6d7fb246ee980a61aa2be4f065 Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 could not be found. Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'ae5e79cc-1b63-403c-b5ed-83db2b2f1b98'} Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 could not be found. Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 could not be found. Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:42.053068 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:42.057937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:42.057937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:42.057937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:42.057937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:42.057937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:42.057937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 could not be found. Jul 14 14:35:42.057937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:42.059372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd013e56-9c3c-4c59-acdb-8a428c73f214 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Returning 404 to user: Instance ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:42.061497 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bd013e56-9c3c-4c59-acdb-8a428c73f214 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98" status: 404 len: 111 microversion: 2.1 time: 0.089531 Jul 14 14:35:42.063371 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1119/2239] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:41 2022] GET /compute/v2.1/servers/ae5e79cc-1b63-403c-b5ed-83db2b2f1b98 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:42.074880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d06c3d08-243c-468e-a113-5f07da1af970 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:42.077888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d06c3d08-243c-468e-a113-5f07da1af970 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: c13590db-1680-4b10-b598-cc2eb89d8b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:42.094366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d06c3d08-243c-468e-a113-5f07da1af970 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.095063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d06c3d08-243c-468e-a113-5f07da1af970 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.101082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d06c3d08-243c-468e-a113-5f07da1af970 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.101897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d06c3d08-243c-468e-a113-5f07da1af970 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.387708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d06c3d08-243c-468e-a113-5f07da1af970 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:42.401510 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d06c3d08-243c-468e-a113-5f07da1af970 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32" status: 200 len: 1304 microversion: 2.1 time: 0.329861 Jul 14 14:35:42.404015 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1120/2240] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:42 2022] GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32 => generated 1304 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:42.606246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e20f5f9b-2241-4749-a18c-93356cf10ba5 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:42.607339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e20f5f9b-2241-4749-a18c-93356cf10ba5 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:42.627439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e20f5f9b-2241-4749-a18c-93356cf10ba5 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.628553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e20f5f9b-2241-4749-a18c-93356cf10ba5 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.639950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e20f5f9b-2241-4749-a18c-93356cf10ba5 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.640493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e20f5f9b-2241-4749-a18c-93356cf10ba5 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:43.446212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Doing local delete in cell e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) {{(pid=119511) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 14 14:35:43.447251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:43.447814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:43.448366 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.compute.api [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 14 14:35:43.454189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] deallocate_for_instance() {{(pid=119511) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 14 14:35:43.526912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e20f5f9b-2241-4749-a18c-93356cf10ba5 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:43.539711 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e20f5f9b-2241-4749-a18c-93356cf10ba5 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1351 microversion: 2.1 time: 0.937388 Jul 14 14:35:43.540309 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1121/2241] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:42 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1351 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:43.565567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2adc2777-23ed-4e7b-a97e-971ef28d6f82 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:43.566213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2adc2777-23ed-4e7b-a97e-971ef28d6f82 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:43.592349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2adc2777-23ed-4e7b-a97e-971ef28d6f82 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:43.592851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2adc2777-23ed-4e7b-a97e-971ef28d6f82 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:43.624452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2adc2777-23ed-4e7b-a97e-971ef28d6f82 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:43.627965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2adc2777-23ed-4e7b-a97e-971ef28d6f82 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.105057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2adc2777-23ed-4e7b-a97e-971ef28d6f82 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:44.118801 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2adc2777-23ed-4e7b-a97e-971ef28d6f82 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1325 microversion: 2.1 time: 0.573411 Jul 14 14:35:44.119671 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1122/2242] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:43 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1325 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:44.139421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b2a8ba4a-242d-454b-8665-8123c4f5034e req-5937bf68-4c3d-451e-874c-57545388513e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad", "name": "network-vif-plugged", "status": "completed", "tag": "e5602274-dec3-49a9-9a61-41955c9e695f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:44.166621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b2a8ba4a-242d-454b-8665-8123c4f5034e req-5937bf68-4c3d-451e-874c-57545388513e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.167330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b2a8ba4a-242d-454b-8665-8123c4f5034e req-5937bf68-4c3d-451e-874c-57545388513e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.196490 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b2a8ba4a-242d-454b-8665-8123c4f5034e req-5937bf68-4c3d-451e-874c-57545388513e service nova] Creating event network-vif-plugged:e5602274-dec3-49a9-9a61-41955c9e695f for instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad on n-h2-767704-28 Jul 14 14:35:44.210559 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b2a8ba4a-242d-454b-8665-8123c4f5034e req-5937bf68-4c3d-451e-874c-57545388513e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078536 Jul 14 14:35:44.211853 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1123/2243] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:44.220320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6b073fea-e844-4d57-ad08-263e584fbe40 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:44.227138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6b073fea-e844-4d57-ad08-263e584fbe40 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: c13590db-1680-4b10-b598-cc2eb89d8b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:44.240540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b073fea-e844-4d57-ad08-263e584fbe40 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.241053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b073fea-e844-4d57-ad08-263e584fbe40 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.241877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b073fea-e844-4d57-ad08-263e584fbe40 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.242344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b073fea-e844-4d57-ad08-263e584fbe40 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.267145 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-6b073fea-e844-4d57-ad08-263e584fbe40 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] HTTP exception thrown: Instance c13590db-1680-4b10-b598-cc2eb89d8b32 could not be found. Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6b073fea-e844-4d57-ad08-263e584fbe40 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Request method failure captured: Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32 HTTP/1.1 Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CjT3c3zJJ84LE-QTmu_N7TKc2vJamFLSX_RsNCc08bkmpF5n-Nu9FWM1NtArGpB5CPF5xMY4uJtIuYE6LZqhvGYf2JzXeGgXNt6b7VR2u0JPoNAJCHJHhj9V7Dqz90qdjKz2o2f2PhRD9Ft-YN05uGZlojn_Lv-A-BD95QzQ-Q1ROU Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_57545ddd8fb2414f8c03c1c44d2bb47f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}] Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: f7852b6d7fb246ee980a61aa2be4f065 Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance c13590db-1680-4b10-b598-cc2eb89d8b32 could not be found. Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'c13590db-1680-4b10-b598-cc2eb89d8b32'} Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13590db-1680-4b10-b598-cc2eb89d8b32 could not be found. Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13590db-1680-4b10-b598-cc2eb89d8b32 could not be found. Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:44.279421 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:44.283875 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:44.283875 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:44.283875 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:44.283875 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:44.283875 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:44.283875 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13590db-1680-4b10-b598-cc2eb89d8b32 could not be found. Jul 14 14:35:44.283875 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:44.288109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6b073fea-e844-4d57-ad08-263e584fbe40 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Returning 404 to user: Instance c13590db-1680-4b10-b598-cc2eb89d8b32 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:44.291254 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6b073fea-e844-4d57-ad08-263e584fbe40 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32" status: 404 len: 111 microversion: 2.1 time: 0.078071 Jul 14 14:35:44.293532 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1124/2244] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:44 2022] GET /compute/v2.1/servers/c13590db-1680-4b10-b598-cc2eb89d8b32 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:44.301936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-aee510c4-7cbf-4116-ae5b-67dc70d9e95a req-2d00a39e-c9de-4a54-855e-72b413305dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13590db-1680-4b10-b598-cc2eb89d8b32", "name": "network-vif-deleted", "tag": "cf68efb1-cc06-4e24-864e-f40811e389f0"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:44.321191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-aee510c4-7cbf-4116-ae5b-67dc70d9e95a req-2d00a39e-c9de-4a54-855e-72b413305dce service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.324394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-aee510c4-7cbf-4116-ae5b-67dc70d9e95a req-2d00a39e-c9de-4a54-855e-72b413305dce service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.344132 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-aee510c4-7cbf-4116-ae5b-67dc70d9e95a req-2d00a39e-c9de-4a54-855e-72b413305dce service nova] Creating event network-vif-deleted:cf68efb1-cc06-4e24-864e-f40811e389f0 for instance c13590db-1680-4b10-b598-cc2eb89d8b32 on n-h1-767704-28 Jul 14 14:35:44.356876 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-aee510c4-7cbf-4116-ae5b-67dc70d9e95a req-2d00a39e-c9de-4a54-855e-72b413305dce service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058618 Jul 14 14:35:44.358197 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1125/2245] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:44.375026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-58abb991-b6e7-4e49-a452-b7a9fc06b00c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:44.408028 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-58abb991-b6e7-4e49-a452-b7a9fc06b00c tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/8f903015-f899-4c1c-a569-d0d95fdea4a2" status: 204 len: 0 microversion: 2.1 time: 0.047428 Jul 14 14:35:44.409589 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1126/2246] 10.222.0.81 () {58 vars in 1265 bytes} [Thu Jul 14 14:35:44 2022] DELETE /compute/v2.1/os-server-groups/8f903015-f899-4c1c-a569-d0d95fdea4a2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:44.878144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-88e082e8-e735-4dba-aee2-9e8662644a83 req-ad82f6fb-8136-4392-b19a-fb26d76255fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd69c7d-4c91-46fa-bee9-fd8f45219ff3", "tag": "49324fac-c63d-43ac-9300-0527c1efdc95"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:44.902423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-88e082e8-e735-4dba-aee2-9e8662644a83 req-ad82f6fb-8136-4392-b19a-fb26d76255fa service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.903180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-88e082e8-e735-4dba-aee2-9e8662644a83 req-ad82f6fb-8136-4392-b19a-fb26d76255fa service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.942262 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-88e082e8-e735-4dba-aee2-9e8662644a83 req-ad82f6fb-8136-4392-b19a-fb26d76255fa service nova] Creating event network-changed:49324fac-c63d-43ac-9300-0527c1efdc95 for instance bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 on n-h1-767704-28 Jul 14 14:35:44.956696 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-88e082e8-e735-4dba-aee2-9e8662644a83 req-ad82f6fb-8136-4392-b19a-fb26d76255fa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.540777 Jul 14 14:35:44.957790 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1127/2247] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:44.966797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2377d73f-0927-4e28-8e3f-40eced212605 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:44.970557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2377d73f-0927-4e28-8e3f-40eced212605 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:44.986043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2377d73f-0927-4e28-8e3f-40eced212605 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.989775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2377d73f-0927-4e28-8e3f-40eced212605 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.992166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2377d73f-0927-4e28-8e3f-40eced212605 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.993559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2377d73f-0927-4e28-8e3f-40eced212605 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:45.046629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2377d73f-0927-4e28-8e3f-40eced212605 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:45.226314 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2377d73f-0927-4e28-8e3f-40eced212605 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 204 len: 0 microversion: 2.1 time: 0.266742 Jul 14 14:35:45.227512 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1128/2248] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:44 2022] DELETE /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:45.236042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6d9aec7f-3f18-476e-a226-e85246b53276 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:45.237161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6d9aec7f-3f18-476e-a226-e85246b53276 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:45.245575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d9aec7f-3f18-476e-a226-e85246b53276 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:45.246140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d9aec7f-3f18-476e-a226-e85246b53276 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:45.247196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d9aec7f-3f18-476e-a226-e85246b53276 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:45.247710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d9aec7f-3f18-476e-a226-e85246b53276 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:45.332666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Updating instance_info_cache with network_info: [] {{(pid=119511) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:35:45.689104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6d9aec7f-3f18-476e-a226-e85246b53276 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:45.699881 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6d9aec7f-3f18-476e-a226-e85246b53276 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1351 microversion: 2.1 time: 0.470663 Jul 14 14:35:45.700545 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1129/2249] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:45 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1351 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:45.719109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1d964df3-8065-4203-a312-c8722a3a5f47 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:45.719676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1d964df3-8065-4203-a312-c8722a3a5f47 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:45.737622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d964df3-8065-4203-a312-c8722a3a5f47 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:45.739723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d964df3-8065-4203-a312-c8722a3a5f47 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:45.740771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d964df3-8065-4203-a312-c8722a3a5f47 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:45.741278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d964df3-8065-4203-a312-c8722a3a5f47 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:45.749693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:46.112408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1d964df3-8065-4203-a312-c8722a3a5f47 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:46.124711 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1d964df3-8065-4203-a312-c8722a3a5f47 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1325 microversion: 2.1 time: 0.409788 Jul 14 14:35:46.125996 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1130/2250] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:45 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1325 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:46.131187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4119baf6-9cf9-402e-a654-a1d73c1ab6c2 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:46.131896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4119baf6-9cf9-402e-a654-a1d73c1ab6c2 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:46.142408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4119baf6-9cf9-402e-a654-a1d73c1ab6c2 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.142997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4119baf6-9cf9-402e-a654-a1d73c1ab6c2 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.143973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4119baf6-9cf9-402e-a654-a1d73c1ab6c2 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.144765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4119baf6-9cf9-402e-a654-a1d73c1ab6c2 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.396715 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c37906ec-a118-4bff-b0e7-51ef466247af tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 204 len: 0 microversion: 2.1 time: 4.793758 Jul 14 14:35:46.400965 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1121/2251] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:41 2022] DELETE /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 0 bytes in 4796 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:46.407089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-38610ce8-de96-43db-b135-75b9029f2522 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:46.407889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-38610ce8-de96-43db-b135-75b9029f2522 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:46.417487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38610ce8-de96-43db-b135-75b9029f2522 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.418490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38610ce8-de96-43db-b135-75b9029f2522 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.420728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38610ce8-de96-43db-b135-75b9029f2522 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.422105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38610ce8-de96-43db-b135-75b9029f2522 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.457363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4119baf6-9cf9-402e-a654-a1d73c1ab6c2 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:46.463394 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-38610ce8-de96-43db-b135-75b9029f2522 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-38610ce8-de96-43db-b135-75b9029f2522 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 HTTP/1.1 Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '131fc2d4-00c2-462b-b7e2-4fbb53234749'} Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:46.466248 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:46.471260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:46.471260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:46.471260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:46.471260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:46.471260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:46.471260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:35:46.471260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:46.471260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-38610ce8-de96-43db-b135-75b9029f2522 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:46.471260 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-38610ce8-de96-43db-b135-75b9029f2522 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 404 len: 111 microversion: 2.1 time: 0.065925 Jul 14 14:35:46.471260 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1122/2252] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:46 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:46.478584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e3d486ed-4eeb-4956-94a9-e84bdcebd24e req-1e8e7934-e540-49db-82f7-1cfa350ae825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131fc2d4-00c2-462b-b7e2-4fbb53234749", "name": "network-vif-deleted", "tag": "8f81fa18-1ee0-41c0-a4e5-0c0a8bc1111a"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:46.491235 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4119baf6-9cf9-402e-a654-a1d73c1ab6c2 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1472 microversion: 2.1 time: 0.364055 Jul 14 14:35:46.491845 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1131/2253] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:46 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:46.494105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e3d486ed-4eeb-4956-94a9-e84bdcebd24e req-1e8e7934-e540-49db-82f7-1cfa350ae825 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.494718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e3d486ed-4eeb-4956-94a9-e84bdcebd24e req-1e8e7934-e540-49db-82f7-1cfa350ae825 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.509494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.compute.server_external_events [req-e3d486ed-4eeb-4956-94a9-e84bdcebd24e req-1e8e7934-e540-49db-82f7-1cfa350ae825 service nova] Unable to find a host for instance 131fc2d4-00c2-462b-b7e2-4fbb53234749. Dropping event network-vif-deleted {{(pid=119511) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 14:35:46.510400 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e3d486ed-4eeb-4956-94a9-e84bdcebd24e req-1e8e7934-e540-49db-82f7-1cfa350ae825 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.039906 Jul 14 14:35:46.512729 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1123/2254] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 14:35:46.716882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b048d8bf-7f94-4432-833d-910a98fe0973 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:46.717631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b048d8bf-7f94-4432-833d-910a98fe0973 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:46.725531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b048d8bf-7f94-4432-833d-910a98fe0973 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.726028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b048d8bf-7f94-4432-833d-910a98fe0973 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.727083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b048d8bf-7f94-4432-833d-910a98fe0973 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.727870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b048d8bf-7f94-4432-833d-910a98fe0973 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.835416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1313340976", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "e15a1c98-dd72-4729-94f4-9ad8a53d679a"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:46.975188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] validate_networks() for [('e15a1c98-dd72-4729-94f4-9ad8a53d679a', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:35:47.049730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b048d8bf-7f94-4432-833d-910a98fe0973 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:47.062581 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b048d8bf-7f94-4432-833d-910a98fe0973 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1351 microversion: 2.1 time: 0.349218 Jul 14 14:35:47.073703 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1132/2255] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:46 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1351 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:47.144286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-385fe435-e251-41a8-9499-351ca10dad76 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:47.147593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-385fe435-e251-41a8-9499-351ca10dad76 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:47.155245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-385fe435-e251-41a8-9499-351ca10dad76 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.158106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-385fe435-e251-41a8-9499-351ca10dad76 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.159606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-385fe435-e251-41a8-9499-351ca10dad76 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.160283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-385fe435-e251-41a8-9499-351ca10dad76 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.867573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-385fe435-e251-41a8-9499-351ca10dad76 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:47.883744 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-385fe435-e251-41a8-9499-351ca10dad76 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1325 microversion: 2.1 time: 0.742813 Jul 14 14:35:47.886068 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1133/2256] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:47 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1325 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:47.907497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1e59162-2f52-4e04-be17-918b77790cef tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:47.910819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f1e59162-2f52-4e04-be17-918b77790cef tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:47.929217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1e59162-2f52-4e04-be17-918b77790cef tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.929671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1e59162-2f52-4e04-be17-918b77790cef tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.930448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1e59162-2f52-4e04-be17-918b77790cef tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.930884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1e59162-2f52-4e04-be17-918b77790cef tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:48.048013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:48.089423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=10 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:48.230524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f1e59162-2f52-4e04-be17-918b77790cef tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:48.239299 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f1e59162-2f52-4e04-be17-918b77790cef tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1472 microversion: 2.1 time: 0.351989 Jul 14 14:35:48.254293 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1134/2257] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:47 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1472 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:48.265598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-745edbf1-c518-4fe0-aa54-b18b87fed4b1 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:48.268513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-745edbf1-c518-4fe0-aa54-b18b87fed4b1 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:48.284136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-745edbf1-c518-4fe0-aa54-b18b87fed4b1 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:48.284744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-745edbf1-c518-4fe0-aa54-b18b87fed4b1 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:48.286189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-745edbf1-c518-4fe0-aa54-b18b87fed4b1 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:48.287922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-745edbf1-c518-4fe0-aa54-b18b87fed4b1 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:48.695099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-745edbf1-c518-4fe0-aa54-b18b87fed4b1 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:48.707798 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-745edbf1-c518-4fe0-aa54-b18b87fed4b1 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1351 microversion: 2.1 time: 0.451607 Jul 14 14:35:48.721066 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1135/2258] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:48 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1351 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:48.902573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4346122a-4fa4-4e00-978a-12c81944f995 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:48.903199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4346122a-4fa4-4e00-978a-12c81944f995 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:48.906013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:48.916532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4346122a-4fa4-4e00-978a-12c81944f995 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:48.932370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4346122a-4fa4-4e00-978a-12c81944f995 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:48.933526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4346122a-4fa4-4e00-978a-12c81944f995 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:48.935366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4346122a-4fa4-4e00-978a-12c81944f995 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:48.975867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:35:48.976446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:35:48.977080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:35:48.977520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:35:48.978006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:35:48.996363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:48.998578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.000146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.003866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.035110 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:35:49.041354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for user d56c219e943b4398bea8add8299df84f and project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:35:49.057967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:35:49.061428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:35:49.133412 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-396236f6-4998-420b-a556-7b7cf2a66033 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.301689 Jul 14 14:35:49.134920 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1124/2259] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:35:49.146019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-feab026f-f200-4a23-af64-a08aa983835a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:49.146677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-feab026f-f200-4a23-af64-a08aa983835a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:49.158915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:49.777157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-feab026f-f200-4a23-af64-a08aa983835a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:49.792448 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-feab026f-f200-4a23-af64-a08aa983835a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1215 microversion: 2.1 time: 0.649686 Jul 14 14:35:49.795838 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1125/2260] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:49 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1215 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:49.819894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d988bf10-1a40-46cd-89d6-f08c63e59038 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:49.822617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d988bf10-1a40-46cd-89d6-f08c63e59038 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:49.861335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d988bf10-1a40-46cd-89d6-f08c63e59038 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.861912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d988bf10-1a40-46cd-89d6-f08c63e59038 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.867774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d988bf10-1a40-46cd-89d6-f08c63e59038 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.869200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d988bf10-1a40-46cd-89d6-f08c63e59038 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.175907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d988bf10-1a40-46cd-89d6-f08c63e59038 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7852b6d7fb246ee980a61aa2be4f065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57545ddd8fb2414f8c03c1c44d2bb47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:50.182081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4346122a-4fa4-4e00-978a-12c81944f995 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:50.192998 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d988bf10-1a40-46cd-89d6-f08c63e59038 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 200 len: 1430 microversion: 2.1 time: 0.386336 Jul 14 14:35:50.196073 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4346122a-4fa4-4e00-978a-12c81944f995 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1522 microversion: 2.1 time: 1.296628 Jul 14 14:35:50.197186 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1126/2261] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:49 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 1430 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:50.197753 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1136/2262] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:48 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1522 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:50.203429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a51812fe-099d-4fff-aca6-5351a6ef44de req-30a2618a-2977-469a-a5e0-514fca1d4798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea89554c-b395-4813-8c65-81afc2ae89ec", "name": "network-vif-deleted", "tag": "7a6cfe65-45f8-4c9e-9bea-76a19c294b1f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:50.214382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a51812fe-099d-4fff-aca6-5351a6ef44de req-30a2618a-2977-469a-a5e0-514fca1d4798 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.215169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a51812fe-099d-4fff-aca6-5351a6ef44de req-30a2618a-2977-469a-a5e0-514fca1d4798 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.217943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b2be8f7-b82b-4e8b-88d7-2fce0a746245 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:50.221164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0b2be8f7-b82b-4e8b-88d7-2fce0a746245 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:50.243661 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a51812fe-099d-4fff-aca6-5351a6ef44de req-30a2618a-2977-469a-a5e0-514fca1d4798 service nova] Creating event network-vif-deleted:7a6cfe65-45f8-4c9e-9bea-76a19c294b1f for instance ea89554c-b395-4813-8c65-81afc2ae89ec on n-h2-767704-28 Jul 14 14:35:50.252671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b2be8f7-b82b-4e8b-88d7-2fce0a746245 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.253049 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a51812fe-099d-4fff-aca6-5351a6ef44de req-30a2618a-2977-469a-a5e0-514fca1d4798 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052889 Jul 14 14:35:50.254241 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1137/2263] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:50.256591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b2be8f7-b82b-4e8b-88d7-2fce0a746245 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.257771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b2be8f7-b82b-4e8b-88d7-2fce0a746245 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.260016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b2be8f7-b82b-4e8b-88d7-2fce0a746245 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.271553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d689a004-23db-4ed4-8cb5-9f4471384eff tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:50.272850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d689a004-23db-4ed4-8cb5-9f4471384eff tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:50.282502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d689a004-23db-4ed4-8cb5-9f4471384eff tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.283235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d689a004-23db-4ed4-8cb5-9f4471384eff tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.284219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d689a004-23db-4ed4-8cb5-9f4471384eff tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.284817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d689a004-23db-4ed4-8cb5-9f4471384eff tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.648292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d689a004-23db-4ed4-8cb5-9f4471384eff tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:50.661861 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d689a004-23db-4ed4-8cb5-9f4471384eff tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1522 microversion: 2.1 time: 0.405418 Jul 14 14:35:50.662457 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1138/2264] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:50 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:50.749333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0b2be8f7-b82b-4e8b-88d7-2fce0a746245 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:50.758115 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0b2be8f7-b82b-4e8b-88d7-2fce0a746245 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1351 microversion: 2.1 time: 0.557272 Jul 14 14:35:50.760878 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1127/2265] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:50 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1351 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:50.777642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f90c36d2-0a50-4871-bb86-c36589b63749 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-666251412"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:50.779179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f90c36d2-0a50-4871-bb86-c36589b63749 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:50.803676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f90c36d2-0a50-4871-bb86-c36589b63749 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.804394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f90c36d2-0a50-4871-bb86-c36589b63749 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.805363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f90c36d2-0a50-4871-bb86-c36589b63749 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.805877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f90c36d2-0a50-4871-bb86-c36589b63749 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.971953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9a404e32-362f-4f84-ab10-354e74998a1e tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Calling method '.version_select at 0x7fd6c5637700>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:51.571090 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f90c36d2-0a50-4871-bb86-c36589b63749 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "POST /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad/action" status: 202 len: 0 microversion: 2.1 time: 0.808095 Jul 14 14:35:51.571771 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1128/2266] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:35:50 2022] POST /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:35:51.778122 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9a404e32-362f-4f84-ab10-354e74998a1e tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/22ecc1b7c57a49f087844628eb868a20" status: 200 len: 371 microversion: 2.1 time: 1.103282 Jul 14 14:35:51.788267 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1139/2267] 10.222.0.81 () {58 vars in 1241 bytes} [Thu Jul 14 14:35:50 2022] GET /compute/v2.1/os-quota-sets/22ecc1b7c57a49f087844628eb868a20 => generated 371 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:51.800777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cf4feb84-07f9-4212-9c7c-1fcbd31ee8b5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:51.801442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cf4feb84-07f9-4212-9c7c-1fcbd31ee8b5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:51.814675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf4feb84-07f9-4212-9c7c-1fcbd31ee8b5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.818299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf4feb84-07f9-4212-9c7c-1fcbd31ee8b5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.819238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf4feb84-07f9-4212-9c7c-1fcbd31ee8b5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.819701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf4feb84-07f9-4212-9c7c-1fcbd31ee8b5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.935800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cf4feb84-07f9-4212-9c7c-1fcbd31ee8b5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:51.936706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b4f57464-fb52-43a6-8568-e897b4f0c2e9 req-f50ba211-8715-4558-8747-37d7dcb2f42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd69c7d-4c91-46fa-bee9-fd8f45219ff3", "name": "network-vif-plugged", "status": "completed", "tag": "49324fac-c63d-43ac-9300-0527c1efdc95"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:51.945343 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cf4feb84-07f9-4212-9c7c-1fcbd31ee8b5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1273 microversion: 2.1 time: 0.155857 Jul 14 14:35:51.946389 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1140/2268] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:51 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:51.951175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77df7771-c2bb-4997-8c6f-986d805528c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:51.952180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-77df7771-c2bb-4997-8c6f-986d805528c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] [instance: ea89554c-b395-4813-8c65-81afc2ae89ec] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:51.959998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b4f57464-fb52-43a6-8568-e897b4f0c2e9 req-f50ba211-8715-4558-8747-37d7dcb2f42a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.960745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b4f57464-fb52-43a6-8568-e897b4f0c2e9 req-f50ba211-8715-4558-8747-37d7dcb2f42a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.964646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77df7771-c2bb-4997-8c6f-986d805528c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.965331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77df7771-c2bb-4997-8c6f-986d805528c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.966460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77df7771-c2bb-4997-8c6f-986d805528c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.967605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77df7771-c2bb-4997-8c6f-986d805528c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.987220 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-77df7771-c2bb-4997-8c6f-986d805528c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] HTTP exception thrown: Instance ea89554c-b395-4813-8c65-81afc2ae89ec could not be found. Jul 14 14:35:51.987413 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b4f57464-fb52-43a6-8568-e897b4f0c2e9 req-f50ba211-8715-4558-8747-37d7dcb2f42a service nova] Creating event network-vif-plugged:49324fac-c63d-43ac-9300-0527c1efdc95 for instance bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 on n-h1-767704-28 Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77df7771-c2bb-4997-8c6f-986d805528c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Request method failure captured: Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec HTTP/1.1 Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CjT3c3zJJ84LE-QTmu_N7TKc2vJamFLSX_RsNCc08bkmpF5n-Nu9FWM1NtArGpB5CPF5xMY4uJtIuYE6LZqhvGYf2JzXeGgXNt6b7VR2u0JPoNAJCHJHhj9V7Dqz90qdjKz2o2f2PhRD9Ft-YN05uGZlojn_Lv-A-BD95QzQ-Q1ROU Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/57545ddd8fb2414f8c03c1c44d2bb47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_57545ddd8fb2414f8c03c1c44d2bb47f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57545ddd8fb2414f8c03c1c44d2bb47f"}]}] Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 57545ddd8fb2414f8c03c1c44d2bb47f Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1784175658 Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: f7852b6d7fb246ee980a61aa2be4f065 Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersOnMultiNodesTest-1784175658-project Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance ea89554c-b395-4813-8c65-81afc2ae89ec could not be found. Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'ea89554c-b395-4813-8c65-81afc2ae89ec'} Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea89554c-b395-4813-8c65-81afc2ae89ec could not be found. Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea89554c-b395-4813-8c65-81afc2ae89ec could not be found. Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:51.988916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:51.993720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:51.993720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:51.993720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:51.993720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:51.993720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:51.993720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea89554c-b395-4813-8c65-81afc2ae89ec could not be found. Jul 14 14:35:51.993720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:51.993720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77df7771-c2bb-4997-8c6f-986d805528c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] Returning 404 to user: Instance ea89554c-b395-4813-8c65-81afc2ae89ec could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:51.993720 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-77df7771-c2bb-4997-8c6f-986d805528c0 tempest-ServersOnMultiNodesTest-1784175658 tempest-ServersOnMultiNodesTest-1784175658-project] 10.222.0.81 "GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec" status: 404 len: 111 microversion: 2.1 time: 0.043466 Jul 14 14:35:51.993720 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1141/2269] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:51 2022] GET /compute/v2.1/servers/ea89554c-b395-4813-8c65-81afc2ae89ec => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:51.997392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac1a68cd-738d-4488-8cdc-7ecdc12bd2cf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '.version_select at 0x7fd6c571c430>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:52.001805 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b4f57464-fb52-43a6-8568-e897b4f0c2e9 req-f50ba211-8715-4558-8747-37d7dcb2f42a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.414089 Jul 14 14:35:52.002729 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1129/2270] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:52.007950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d0408887-0a69-4fae-9ac8-e158fdf70ce7 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:52.008517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d0408887-0a69-4fae-9ac8-e158fdf70ce7 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:52.025734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0408887-0a69-4fae-9ac8-e158fdf70ce7 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:52.026186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0408887-0a69-4fae-9ac8-e158fdf70ce7 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:52.026981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0408887-0a69-4fae-9ac8-e158fdf70ce7 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:52.027421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0408887-0a69-4fae-9ac8-e158fdf70ce7 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:52.042264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:52.273801 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac1a68cd-738d-4488-8cdc-7ecdc12bd2cf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "DELETE /compute/v2.1/images/e2a2233b-79ab-4a75-9790-1953468ce618" status: 204 len: 0 microversion: 2.1 time: 0.280573 Jul 14 14:35:52.277754 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1142/2271] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:51 2022] DELETE /compute/v2.1/images/e2a2233b-79ab-4a75-9790-1953468ce618 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:52.292579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c27f08fd-ff5e-4ece-a080-5d9536b94730 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c571caf0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:52.308254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d0408887-0a69-4fae-9ac8-e158fdf70ce7 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:52.321949 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d0408887-0a69-4fae-9ac8-e158fdf70ce7 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1351 microversion: 2.1 time: 0.316901 Jul 14 14:35:52.323731 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1130/2272] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:52 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1351 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:52.885736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ccf3dd05-50ea-499a-b627-aa15270b8433 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'create', calling method: .version_select at 0x7fd6c5b58b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-655872478", "description": "tempest-description-741844724"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:53.061109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c27f08fd-ff5e-4ece-a080-5d9536b94730 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.062428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c27f08fd-ff5e-4ece-a080-5d9536b94730 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.065464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c27f08fd-ff5e-4ece-a080-5d9536b94730 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.066374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c27f08fd-ff5e-4ece-a080-5d9536b94730 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.203284 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c27f08fd-ff5e-4ece-a080-5d9536b94730 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/22ecc1b7c57a49f087844628eb868a20" status: 200 len: 328 microversion: 2.1 time: 0.918613 Jul 14 14:35:53.211511 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1143/2273] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:35:52 2022] PUT /compute/v2.1/os-quota-sets/22ecc1b7c57a49f087844628eb868a20 => generated 328 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:53.224412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c53127bc-f3c2-4b1b-b761-ba342a8e773a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '.version_select at 0x7fd6c56dd3a0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:53.242876 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ccf3dd05-50ea-499a-b627-aa15270b8433 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.917390 Jul 14 14:35:53.243648 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1131/2274] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:35:52 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:53.253780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c5cbbc13-0796-4f5e-9040-28900f238c99 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:53.254741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c5cbbc13-0796-4f5e-9040-28900f238c99 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:53.263880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5cbbc13-0796-4f5e-9040-28900f238c99 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.264540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5cbbc13-0796-4f5e-9040-28900f238c99 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.265539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5cbbc13-0796-4f5e-9040-28900f238c99 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.266130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5cbbc13-0796-4f5e-9040-28900f238c99 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.288564 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-c53127bc-f3c2-4b1b-b761-ba342a8e773a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] HTTP exception thrown: Image not found. Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c53127bc-f3c2-4b1b-b761-ba342a8e773a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/images/e2a2233b-79ab-4a75-9790-1953468ce618 HTTP/1.1 Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: exception: Image not found. Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'e2a2233b-79ab-4a75-9790-1953468ce618'} Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e2a2233b-79ab-4a75-9790-1953468ce618 Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:35:53.291518 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e2a2233b-79ab-4a75-9790-1953468ce618 could not be found. Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:35:53.296435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:35:53.303210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c53127bc-f3c2-4b1b-b761-ba342a8e773a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 404 to user: Image not found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:53.304462 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c53127bc-f3c2-4b1b-b761-ba342a8e773a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/images/e2a2233b-79ab-4a75-9790-1953468ce618" status: 404 len: 62 microversion: 2.1 time: 0.091611 Jul 14 14:35:53.305353 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1144/2275] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:35:53 2022] GET /compute/v2.1/images/e2a2233b-79ab-4a75-9790-1953468ce618 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:35:53.316290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7995f531-0756-4142-978d-c0b42e431b59 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:53.347088 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7995f531-0756-4142-978d-c0b42e431b59 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-quota-sets/22ecc1b7c57a49f087844628eb868a20" status: 202 len: 0 microversion: 2.1 time: 0.040250 Jul 14 14:35:53.352036 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1145/2276] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 14:35:53 2022] DELETE /compute/v2.1/os-quota-sets/22ecc1b7c57a49f087844628eb868a20 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:53.368352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7e0c3e56-3545-41eb-8b0d-07f4748648e2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'create', calling method: .version_select at 0x7fd6c569e5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1285567475", "description": "tempest-description-1665652001"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:53.727248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c5cbbc13-0796-4f5e-9040-28900f238c99 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:53.741407 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c5cbbc13-0796-4f5e-9040-28900f238c99 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1315 microversion: 2.1 time: 0.495185 Jul 14 14:35:53.742774 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7e0c3e56-3545-41eb-8b0d-07f4748648e2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.388538 Jul 14 14:35:53.745464 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1132/2278] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:53 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:53.752504 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1146/2278] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:35:53 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:53.757599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-30c85c95-2636-4efa-912e-782c0085cda9 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:53.758226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-30c85c95-2636-4efa-912e-782c0085cda9 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:53.776384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4eda1e3a-e508-4f3f-9385-a544ce42f92e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:53.777528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4eda1e3a-e508-4f3f-9385-a544ce42f92e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:53.783587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30c85c95-2636-4efa-912e-782c0085cda9 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.794738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30c85c95-2636-4efa-912e-782c0085cda9 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.796120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4eda1e3a-e508-4f3f-9385-a544ce42f92e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.796255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30c85c95-2636-4efa-912e-782c0085cda9 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.797385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30c85c95-2636-4efa-912e-782c0085cda9 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.798369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4eda1e3a-e508-4f3f-9385-a544ce42f92e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.799456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4eda1e3a-e508-4f3f-9385-a544ce42f92e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.803237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4eda1e3a-e508-4f3f-9385-a544ce42f92e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.268134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-30c85c95-2636-4efa-912e-782c0085cda9 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:54.276325 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-30c85c95-2636-4efa-912e-782c0085cda9 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1351 microversion: 2.1 time: 0.522596 Jul 14 14:35:54.290922 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1147/2279] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:53 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1351 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:54.300704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-254237d0-d7b1-4c64-86e8-d434f51c07cf tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Calling method '.version_select at 0x7fd6c562bf70>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:54.423883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4eda1e3a-e508-4f3f-9385-a544ce42f92e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:54.432503 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4eda1e3a-e508-4f3f-9385-a544ce42f92e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1540 microversion: 2.1 time: 0.685561 Jul 14 14:35:54.433136 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1133/2280] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:53 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1540 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:54.466060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1248212682", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "ac8ff2ab-77b4-4f10-a730-efd282361317"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:54.548454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] validate_networks() for [('ac8ff2ab-77b4-4f10-a730-efd282361317', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:35:55.144568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:35:55.145980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:35:55.146633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:35:55.147190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:35:55.147750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:35:55.170514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.172661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.173932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.174053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.209984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Getting quotas for project a63994cd418f458d80ef0b54128592fc. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:35:55.219044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Getting quotas for user 1ae1d6f3c8a2476aab57620c281ecdc1 and project a63994cd418f458d80ef0b54128592fc. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:35:55.246005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:35:55.253022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:35:55.341485 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-254237d0-d7b1-4c64-86e8-d434f51c07cf tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/22ecc1b7c57a49f087844628eb868a20" status: 200 len: 371 microversion: 2.1 time: 1.049086 Jul 14 14:35:55.344042 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1148/2281] 10.222.0.81 () {58 vars in 1241 bytes} [Thu Jul 14 14:35:54 2022] GET /compute/v2.1/os-quota-sets/22ecc1b7c57a49f087844628eb868a20 => generated 371 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:55.347442 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e36339e1-faf8-40ef-827c-59dae2c81ca8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885188 Jul 14 14:35:55.348585 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1134/2282] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:35:55.358804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-d2d784a3-86ae-4228-9ab2-ac10a7ff13ce req-44f72345-e2d2-4b4e-a7b0-69250d56eb18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deb1f152-0733-4f36-91a0-71797b749e16", "tag": "db2d2768-461e-4832-b4e6-c4e4a8334c60"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:55.361267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8a315491-6eeb-4bb7-ba18-7df5d93c447a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:55.364467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8a315491-6eeb-4bb7-ba18-7df5d93c447a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:55.387689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a315491-6eeb-4bb7-ba18-7df5d93c447a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.388479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a315491-6eeb-4bb7-ba18-7df5d93c447a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.389601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a315491-6eeb-4bb7-ba18-7df5d93c447a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.393914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=5,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:55.398435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a315491-6eeb-4bb7-ba18-7df5d93c447a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.427360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d2d784a3-86ae-4228-9ab2-ac10a7ff13ce req-44f72345-e2d2-4b4e-a7b0-69250d56eb18 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.429404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d2d784a3-86ae-4228-9ab2-ac10a7ff13ce req-44f72345-e2d2-4b4e-a7b0-69250d56eb18 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.457757 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-d2d784a3-86ae-4228-9ab2-ac10a7ff13ce req-44f72345-e2d2-4b4e-a7b0-69250d56eb18 service nova] Creating event network-changed:db2d2768-461e-4832-b4e6-c4e4a8334c60 for instance deb1f152-0733-4f36-91a0-71797b749e16 on n-h1-767704-28 Jul 14 14:35:55.480657 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-d2d784a3-86ae-4228-9ab2-ac10a7ff13ce req-44f72345-e2d2-4b4e-a7b0-69250d56eb18 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135331 Jul 14 14:35:55.485799 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1149/2283] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:55.505863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c485a6b9-170c-41a0-a123-aabfc41dbd20 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:55.506598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c485a6b9-170c-41a0-a123-aabfc41dbd20 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:55.528528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c485a6b9-170c-41a0-a123-aabfc41dbd20 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.529599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c485a6b9-170c-41a0-a123-aabfc41dbd20 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.530335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c485a6b9-170c-41a0-a123-aabfc41dbd20 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.530978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c485a6b9-170c-41a0-a123-aabfc41dbd20 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.105598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8a315491-6eeb-4bb7-ba18-7df5d93c447a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:56.119169 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8a315491-6eeb-4bb7-ba18-7df5d93c447a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1315 microversion: 2.1 time: 0.769201 Jul 14 14:35:56.121993 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1135/2284] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:55 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1315 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:56.145437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-00f525fd-bca3-470a-9e59-1ffafbc56344 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:56.150367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-00f525fd-bca3-470a-9e59-1ffafbc56344 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:56.287696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c485a6b9-170c-41a0-a123-aabfc41dbd20 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:56.290092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-00f525fd-bca3-470a-9e59-1ffafbc56344 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:56.307447 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-00f525fd-bca3-470a-9e59-1ffafbc56344 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1216 microversion: 2.1 time: 0.173970 Jul 14 14:35:56.308886 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c485a6b9-170c-41a0-a123-aabfc41dbd20 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1542 microversion: 2.1 time: 0.821356 Jul 14 14:35:56.311569 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1150/2285] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:55 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1542 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:56.314109 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1136/2286] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:56 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1216 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:56.327692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-55dcde67-4a50-4735-8016-9d9b1222bfba tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Calling method '.version_select at 0x7fd6c61d48b0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:56.329382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-587969d8-b05e-4910-9b4a-75d66c1e23db tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:56.329832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-587969d8-b05e-4910-9b4a-75d66c1e23db tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:56.350376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-587969d8-b05e-4910-9b4a-75d66c1e23db tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.351027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-587969d8-b05e-4910-9b4a-75d66c1e23db tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.352035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-587969d8-b05e-4910-9b4a-75d66c1e23db tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.352359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-587969d8-b05e-4910-9b4a-75d66c1e23db tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.728289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-587969d8-b05e-4910-9b4a-75d66c1e23db tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:56.739970 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-55dcde67-4a50-4735-8016-9d9b1222bfba tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/8e01cf00280b44b88fe3c45e4c2d669d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.425142 Jul 14 14:35:56.745759 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1137/2287] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:35:56 2022] GET /compute/v2.1/os-quota-sets/8e01cf00280b44b88fe3c45e4c2d669d/defaults => generated 371 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:56.750861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eb3c7c84-b4ba-41c5-91c3-6adb3afa2f93 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:56.752583 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-587969d8-b05e-4910-9b4a-75d66c1e23db tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1522 microversion: 2.1 time: 0.432580 Jul 14 14:35:56.753791 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1151/2288] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:56 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:56.754304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eb3c7c84-b4ba-41c5-91c3-6adb3afa2f93 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:56.761192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb3c7c84-b4ba-41c5-91c3-6adb3afa2f93 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.761887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb3c7c84-b4ba-41c5-91c3-6adb3afa2f93 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.762806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb3c7c84-b4ba-41c5-91c3-6adb3afa2f93 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.763903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb3c7c84-b4ba-41c5-91c3-6adb3afa2f93 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.770218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f18d0c33-db1a-4fd7-b0b3-a3520dec2e34 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:56.770873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f18d0c33-db1a-4fd7-b0b3-a3520dec2e34 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:56.777448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f18d0c33-db1a-4fd7-b0b3-a3520dec2e34 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.786325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f18d0c33-db1a-4fd7-b0b3-a3520dec2e34 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.787457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f18d0c33-db1a-4fd7-b0b3-a3520dec2e34 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.798105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f18d0c33-db1a-4fd7-b0b3-a3520dec2e34 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.846892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f18d0c33-db1a-4fd7-b0b3-a3520dec2e34 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:56.982602 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eb3c7c84-b4ba-41c5-91c3-6adb3afa2f93 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.235599 Jul 14 14:35:56.983759 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1138/2289] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:35:56 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3/os-interface => generated 285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:57.094676 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f18d0c33-db1a-4fd7-b0b3-a3520dec2e34 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 204 len: 0 microversion: 2.1 time: 0.327764 Jul 14 14:35:57.097161 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1152/2290] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:56 2022] DELETE /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:57.105340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ff860f2f-9648-453d-b617-b8e7a950cfc2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:57.106253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ff860f2f-9648-453d-b617-b8e7a950cfc2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:57.119289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff860f2f-9648-453d-b617-b8e7a950cfc2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.122727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff860f2f-9648-453d-b617-b8e7a950cfc2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.124540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff860f2f-9648-453d-b617-b8e7a950cfc2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.125208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff860f2f-9648-453d-b617-b8e7a950cfc2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.140054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9093de65-ac26-444a-a583-8b2235f1150c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:57.140960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9093de65-ac26-444a-a583-8b2235f1150c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:57.155124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9093de65-ac26-444a-a583-8b2235f1150c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.156537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9093de65-ac26-444a-a583-8b2235f1150c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.158117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9093de65-ac26-444a-a583-8b2235f1150c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.159203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9093de65-ac26-444a-a583-8b2235f1150c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.505921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ff860f2f-9648-453d-b617-b8e7a950cfc2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:57.517811 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ff860f2f-9648-453d-b617-b8e7a950cfc2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1528 microversion: 2.1 time: 0.416215 Jul 14 14:35:57.530545 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1139/2291] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:57 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1528 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:57.541429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d0773963-074f-48a9-ae4b-c7f162193855 req-4c422d65-d47f-4736-a399-14c20a60c3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad", "name": "network-vif-plugged", "status": "completed", "tag": "e5602274-dec3-49a9-9a61-41955c9e695f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:57.555948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d0773963-074f-48a9-ae4b-c7f162193855 req-4c422d65-d47f-4736-a399-14c20a60c3c2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.556719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d0773963-074f-48a9-ae4b-c7f162193855 req-4c422d65-d47f-4736-a399-14c20a60c3c2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.572411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9093de65-ac26-444a-a583-8b2235f1150c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:57.574834 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d0773963-074f-48a9-ae4b-c7f162193855 req-4c422d65-d47f-4736-a399-14c20a60c3c2 service nova] Creating event network-vif-plugged:e5602274-dec3-49a9-9a61-41955c9e695f for instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad on n-h2-767704-28 Jul 14 14:35:57.581485 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d0773963-074f-48a9-ae4b-c7f162193855 req-4c422d65-d47f-4736-a399-14c20a60c3c2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047357 Jul 14 14:35:57.583027 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1140/2292] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:57.590459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-62fb0300-610d-475d-80ce-20cbd8d6132c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:57.591426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-62fb0300-610d-475d-80ce-20cbd8d6132c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:57.598713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:57.604289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62fb0300-610d-475d-80ce-20cbd8d6132c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.605251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62fb0300-610d-475d-80ce-20cbd8d6132c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.606246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62fb0300-610d-475d-80ce-20cbd8d6132c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.607788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62fb0300-610d-475d-80ce-20cbd8d6132c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.608075 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9093de65-ac26-444a-a583-8b2235f1150c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1315 microversion: 2.1 time: 0.473189 Jul 14 14:35:57.618609 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1153/2293] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:57 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:57.701688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-62fb0300-610d-475d-80ce-20cbd8d6132c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:57.714316 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-62fb0300-610d-475d-80ce-20cbd8d6132c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1276 microversion: 2.1 time: 0.129850 Jul 14 14:35:57.716144 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1141/2294] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:57 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:58.001739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0919ab45-fa5c-4d9f-97d0-34c39fa913a6 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c565fc10>, body: {"quota_set": {"ram": "5120"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:58.364090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0919ab45-fa5c-4d9f-97d0-34c39fa913a6 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.364897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0919ab45-fa5c-4d9f-97d0-34c39fa913a6 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.366477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0919ab45-fa5c-4d9f-97d0-34c39fa913a6 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.367175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0919ab45-fa5c-4d9f-97d0-34c39fa913a6 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.441370 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0919ab45-fa5c-4d9f-97d0-34c39fa913a6 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/c52d66a7d39f436396027b9e8cddf138" status: 200 len: 328 microversion: 2.1 time: 0.444263 Jul 14 14:35:58.446941 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1154/2295] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:35:57 2022] PUT /compute/v2.1/os-quota-sets/c52d66a7d39f436396027b9e8cddf138 => generated 328 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:58.455278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ffc8ca97-8112-49df-9dd6-9bbd72bfe5df tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Calling method '.version_select at 0x7fd6c5b58ca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:58.536921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6cfb3ffe-f7f1-453a-83ae-d7c3488e4c60 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:58.538862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6cfb3ffe-f7f1-453a-83ae-d7c3488e4c60 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:58.549744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6cfb3ffe-f7f1-453a-83ae-d7c3488e4c60 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.551576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6cfb3ffe-f7f1-453a-83ae-d7c3488e4c60 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.552216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6cfb3ffe-f7f1-453a-83ae-d7c3488e4c60 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.552662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6cfb3ffe-f7f1-453a-83ae-d7c3488e4c60 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.776724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6cfb3ffe-f7f1-453a-83ae-d7c3488e4c60 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:58.787495 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6cfb3ffe-f7f1-453a-83ae-d7c3488e4c60 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1528 microversion: 2.1 time: 0.255553 Jul 14 14:35:58.800912 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1155/2296] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:58 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1528 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:58.809751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-108d888c-68d7-429b-a9f7-699bcb025f08 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:58.813794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-108d888c-68d7-429b-a9f7-699bcb025f08 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:58.822049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-108d888c-68d7-429b-a9f7-699bcb025f08 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.822823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-108d888c-68d7-429b-a9f7-699bcb025f08 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.824219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-108d888c-68d7-429b-a9f7-699bcb025f08 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.824850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-108d888c-68d7-429b-a9f7-699bcb025f08 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.056456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffc8ca97-8112-49df-9dd6-9bbd72bfe5df tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.056936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffc8ca97-8112-49df-9dd6-9bbd72bfe5df tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.060000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffc8ca97-8112-49df-9dd6-9bbd72bfe5df tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.061427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffc8ca97-8112-49df-9dd6-9bbd72bfe5df tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.143951 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ffc8ca97-8112-49df-9dd6-9bbd72bfe5df tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/c52d66a7d39f436396027b9e8cddf138/detail" status: 200 len: 916 microversion: 2.1 time: 0.692503 Jul 14 14:35:59.146399 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1142/2297] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:35:58 2022] GET /compute/v2.1/os-quota-sets/c52d66a7d39f436396027b9e8cddf138/detail => generated 916 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:59.152683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4fd2874f-bcaf-4f05-989b-3c3979922833 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:59.153565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4fd2874f-bcaf-4f05-989b-3c3979922833 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:59.160750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-108d888c-68d7-429b-a9f7-699bcb025f08 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:59.163324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fd2874f-bcaf-4f05-989b-3c3979922833 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.163955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fd2874f-bcaf-4f05-989b-3c3979922833 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.165932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fd2874f-bcaf-4f05-989b-3c3979922833 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.166540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fd2874f-bcaf-4f05-989b-3c3979922833 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.174629 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-108d888c-68d7-429b-a9f7-699bcb025f08 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1315 microversion: 2.1 time: 0.368278 Jul 14 14:35:59.175566 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1156/2298] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:58 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:59.188265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-27e7e9a2-7675-47e1-a941-f70069653d99 req-047d604b-c9be-4d8f-9d9d-4edbfef4e5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd69c7d-4c91-46fa-bee9-fd8f45219ff3", "tag": "49324fac-c63d-43ac-9300-0527c1efdc95"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:59.204122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-27e7e9a2-7675-47e1-a941-f70069653d99 req-047d604b-c9be-4d8f-9d9d-4edbfef4e5d4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.206863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-27e7e9a2-7675-47e1-a941-f70069653d99 req-047d604b-c9be-4d8f-9d9d-4edbfef4e5d4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.233683 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-27e7e9a2-7675-47e1-a941-f70069653d99 req-047d604b-c9be-4d8f-9d9d-4edbfef4e5d4 service nova] Creating event network-changed:49324fac-c63d-43ac-9300-0527c1efdc95 for instance bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 on n-h1-767704-28 Jul 14 14:35:59.242707 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-27e7e9a2-7675-47e1-a941-f70069653d99 req-047d604b-c9be-4d8f-9d9d-4edbfef4e5d4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065951 Jul 14 14:35:59.247951 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1157/2299] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:59.334588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4fd2874f-bcaf-4f05-989b-3c3979922833 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:59.350344 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4fd2874f-bcaf-4f05-989b-3c3979922833 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1286 microversion: 2.1 time: 0.202142 Jul 14 14:35:59.350949 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1143/2300] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:59 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1286 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:59.728536 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-51e1326d-56a5-4858-9728-a8c88d8a32c4 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] 10.222.0.81 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.402547 Jul 14 14:35:59.729583 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1158/2301] 10.222.0.81 () {58 vars in 1127 bytes} [Thu Jul 14 14:35:59 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 14:35:59.741882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-07aed7e4-abe3-4b0a-9ef3-7b59302f83e3 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Calling method '.version_select at 0x7fd6c61d4790>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:59.794085 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-07aed7e4-abe3-4b0a-9ef3-7b59302f83e3 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] HTTP exception thrown: Image not found. Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-07aed7e4-abe3-4b0a-9ef3-7b59302f83e3 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Request method failure captured: Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnPEwnbzfcAbOdtIJZs9zj7dIdWin9ZUKuA7w_vwEbIM9wIbCitz_5qC6a9lrg-SS4ms2bKPGEJJjC9ERGs2o3fpv7kcIZCLKIDYI3KgdPIG-gRvMCMZrGFAps4u-UzGfDYKwlzY-ndrD5iHeLnyqbPjclMQUqENLygZnOcsJ-I7Ho Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d75ab2ae199e4f4596f10ce270686553 Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d75ab2ae199e4f4596f10ce270686553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d75ab2ae199e4f4596f10ce270686553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d75ab2ae199e4f4596f10ce270686553", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d75ab2ae199e4f4596f10ce270686553"}]}] Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d75ab2ae199e4f4596f10ce270686553 Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesDeleteNegativeTestJSON-518531557-project Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f4c160c8227143e29f1baa396645197d Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-518531557-project Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '-1'} Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.797790 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.803611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-07aed7e4-abe3-4b0a-9ef3-7b59302f83e3 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:59.806625 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-07aed7e4-abe3-4b0a-9ef3-7b59302f83e3 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] 10.222.0.81 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.061975 Jul 14 14:35:59.807369 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1144/2302] 10.222.0.81 () {58 vars in 1133 bytes} [Thu Jul 14 14:35:59 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:35:59.819354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8f275768-e925-4bb6-8656-dabf6f68f147 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:59.821803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8f275768-e925-4bb6-8656-dabf6f68f147 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:59.822604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b35aaa55-8ef3-4790-9c52-606bc1c1e008 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Calling method '.version_select at 0x7fd6c5b3c5e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:59.844093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f275768-e925-4bb6-8656-dabf6f68f147 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.846442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f275768-e925-4bb6-8656-dabf6f68f147 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.850543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f275768-e925-4bb6-8656-dabf6f68f147 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.855007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f275768-e925-4bb6-8656-dabf6f68f147 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.868787 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b35aaa55-8ef3-4790-9c52-606bc1c1e008 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] HTTP exception thrown: Image not found. Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b35aaa55-8ef3-4790-9c52-606bc1c1e008 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Request method failure captured: Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/images/84ad4b0c-ab88-4d6e-9664-e4788f8f63aj HTTP/1.1 Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnPEwnbzfcAbOdtIJZs9zj7dIdWin9ZUKuA7w_vwEbIM9wIbCitz_5qC6a9lrg-SS4ms2bKPGEJJjC9ERGs2o3fpv7kcIZCLKIDYI3KgdPIG-gRvMCMZrGFAps4u-UzGfDYKwlzY-ndrD5iHeLnyqbPjclMQUqENLygZnOcsJ-I7Ho Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d75ab2ae199e4f4596f10ce270686553 Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d75ab2ae199e4f4596f10ce270686553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d75ab2ae199e4f4596f10ce270686553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d75ab2ae199e4f4596f10ce270686553", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d75ab2ae199e4f4596f10ce270686553"}]}] Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d75ab2ae199e4f4596f10ce270686553 Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesDeleteNegativeTestJSON-518531557-project Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f4c160c8227143e29f1baa396645197d Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-518531557-project Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '84ad4b0c-ab88-4d6e-9664-e4788f8f63aj'} Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 84ad4b0c-ab88-4d6e-9664-e4788f8f63aj to delete Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 84ad4b0c-ab88-4d6e-9664-e4788f8f63aj could not be found. Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:59.871217 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:35:59.875561 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.884980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b35aaa55-8ef3-4790-9c52-606bc1c1e008 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:59.886921 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b35aaa55-8ef3-4790-9c52-606bc1c1e008 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] 10.222.0.81 "DELETE /compute/v2.1/images/84ad4b0c-ab88-4d6e-9664-e4788f8f63aj" status: 404 len: 62 microversion: 2.1 time: 0.068516 Jul 14 14:35:59.887956 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1145/2303] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:59 2022] DELETE /compute/v2.1/images/84ad4b0c-ab88-4d6e-9664-e4788f8f63aj => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:35:59.900825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f7340e1-50a3-448f-91b8-5ca8aa46890b tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Calling method '.version_select at 0x7fd6c61dc5e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:59.921561 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-9f7340e1-50a3-448f-91b8-5ca8aa46890b tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] HTTP exception thrown: Image not found. Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f7340e1-50a3-448f-91b8-5ca8aa46890b tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Request method failure captured: Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/images/a6f08e92-a52a-4820-8009-903c8eb7d0e21 HTTP/1.1 Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnPEwnbzfcAbOdtIJZs9zj7dIdWin9ZUKuA7w_vwEbIM9wIbCitz_5qC6a9lrg-SS4ms2bKPGEJJjC9ERGs2o3fpv7kcIZCLKIDYI3KgdPIG-gRvMCMZrGFAps4u-UzGfDYKwlzY-ndrD5iHeLnyqbPjclMQUqENLygZnOcsJ-I7Ho Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d75ab2ae199e4f4596f10ce270686553 Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d75ab2ae199e4f4596f10ce270686553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d75ab2ae199e4f4596f10ce270686553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d75ab2ae199e4f4596f10ce270686553", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d75ab2ae199e4f4596f10ce270686553"}]}] Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d75ab2ae199e4f4596f10ce270686553 Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesDeleteNegativeTestJSON-518531557-project Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f4c160c8227143e29f1baa396645197d Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-518531557-project Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'a6f08e92-a52a-4820-8009-903c8eb7d0e21'} Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a6f08e92-a52a-4820-8009-903c8eb7d0e21 to delete Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a6f08e92-a52a-4820-8009-903c8eb7d0e21 could not be found. Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:59.924261 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f7340e1-50a3-448f-91b8-5ca8aa46890b tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9f7340e1-50a3-448f-91b8-5ca8aa46890b tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] 10.222.0.81 "DELETE /compute/v2.1/images/a6f08e92-a52a-4820-8009-903c8eb7d0e21" status: 404 len: 62 microversion: 2.1 time: 0.030840 Jul 14 14:35:59.927853 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1146/2304] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:59 2022] DELETE /compute/v2.1/images/a6f08e92-a52a-4820-8009-903c8eb7d0e21 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:35:59.942654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b1775170-6c0e-49cb-bc5e-437d699a261f tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c645c550>, body: {"quota_set": {"ram": "2048"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:00.120764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1775170-6c0e-49cb-bc5e-437d699a261f tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.123453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1775170-6c0e-49cb-bc5e-437d699a261f tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.124692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1775170-6c0e-49cb-bc5e-437d699a261f tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.125643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1775170-6c0e-49cb-bc5e-437d699a261f tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.215639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1775170-6c0e-49cb-bc5e-437d699a261f tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.216605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1775170-6c0e-49cb-bc5e-437d699a261f tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.218117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1775170-6c0e-49cb-bc5e-437d699a261f tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.218860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1775170-6c0e-49cb-bc5e-437d699a261f tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.322582 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b1775170-6c0e-49cb-bc5e-437d699a261f tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/c52d66a7d39f436396027b9e8cddf138?user_id=7b57b39550de4c0493152d17255a4c8c" status: 200 len: 328 microversion: 2.1 time: 0.392944 Jul 14 14:36:00.331160 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1147/2305] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:35:59 2022] PUT /compute/v2.1/os-quota-sets/c52d66a7d39f436396027b9e8cddf138?user_id=7b57b39550de4c0493152d17255a4c8c => generated 328 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:00.337669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed2babfc-5faa-4c62-acc5-d7ae8cae1f0e tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Calling method '.version_select at 0x7fd6c5bd9670>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:00.373948 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-ed2babfc-5faa-4c62-acc5-d7ae8cae1f0e tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] HTTP exception thrown: Image not found. Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed2babfc-5faa-4c62-acc5-d7ae8cae1f0e tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Request method failure captured: Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/images/tempest-invalid-931950736 HTTP/1.1 Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnPEwnbzfcAbOdtIJZs9zj7dIdWin9ZUKuA7w_vwEbIM9wIbCitz_5qC6a9lrg-SS4ms2bKPGEJJjC9ERGs2o3fpv7kcIZCLKIDYI3KgdPIG-gRvMCMZrGFAps4u-UzGfDYKwlzY-ndrD5iHeLnyqbPjclMQUqENLygZnOcsJ-I7Ho Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d75ab2ae199e4f4596f10ce270686553 Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d75ab2ae199e4f4596f10ce270686553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d75ab2ae199e4f4596f10ce270686553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d75ab2ae199e4f4596f10ce270686553", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d75ab2ae199e4f4596f10ce270686553"}]}] Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d75ab2ae199e4f4596f10ce270686553 Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesDeleteNegativeTestJSON-518531557-project Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f4c160c8227143e29f1baa396645197d Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-518531557-project Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'tempest-invalid-931950736'} Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-931950736 to delete Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-931950736 could not be found. Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.376063 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:36:00.380768 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.385118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed2babfc-5faa-4c62-acc5-d7ae8cae1f0e tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:00.386189 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed2babfc-5faa-4c62-acc5-d7ae8cae1f0e tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] 10.222.0.81 "DELETE /compute/v2.1/images/tempest-invalid-931950736" status: 404 len: 62 microversion: 2.1 time: 0.053492 Jul 14 14:36:00.386987 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1148/2306] 10.222.0.81 () {58 vars in 1202 bytes} [Thu Jul 14 14:36:00 2022] DELETE /compute/v2.1/images/tempest-invalid-931950736 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:36:00.396467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-034f5b45-eaaa-457c-854e-e4912e5b3d4d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:00.397673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-034f5b45-eaaa-457c-854e-e4912e5b3d4d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:00.408109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-034f5b45-eaaa-457c-854e-e4912e5b3d4d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.409142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-034f5b45-eaaa-457c-854e-e4912e5b3d4d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.410369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-034f5b45-eaaa-457c-854e-e4912e5b3d4d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.411066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-034f5b45-eaaa-457c-854e-e4912e5b3d4d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.796713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8f275768-e925-4bb6-8656-dabf6f68f147 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:00.813159 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8f275768-e925-4bb6-8656-dabf6f68f147 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 200 len: 1528 microversion: 2.1 time: 1.002434 Jul 14 14:36:00.816511 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1159/2307] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:59 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 1528 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:00.827087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3e08314a-42dc-48d3-aa22-e91f1abf0e8f tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Calling method '.version_select at 0x7fd6c55fb280>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:01.926831 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3e08314a-42dc-48d3-aa22-e91f1abf0e8f tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/c52d66a7d39f436396027b9e8cddf138?user_id=7b57b39550de4c0493152d17255a4c8c" status: 200 len: 370 microversion: 2.1 time: 1.108560 Jul 14 14:36:01.927470 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1160/2308] 10.222.0.81 () {58 vars in 1322 bytes} [Thu Jul 14 14:36:00 2022] GET /compute/v2.1/os-quota-sets/c52d66a7d39f436396027b9e8cddf138?user_id=7b57b39550de4c0493152d17255a4c8c => generated 370 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:01.937055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f53ccb78-1272-4917-a13d-481521f45445 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:01.937687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f53ccb78-1272-4917-a13d-481521f45445 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:01.945143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f53ccb78-1272-4917-a13d-481521f45445 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:01.945829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f53ccb78-1272-4917-a13d-481521f45445 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:01.946830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f53ccb78-1272-4917-a13d-481521f45445 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:01.947440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f53ccb78-1272-4917-a13d-481521f45445 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:01.975223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-034f5b45-eaaa-457c-854e-e4912e5b3d4d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:01.995659 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-034f5b45-eaaa-457c-854e-e4912e5b3d4d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1315 microversion: 2.1 time: 1.604320 Jul 14 14:36:02.000302 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1149/2309] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:00 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1315 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:02.009869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99ce3722-539b-4f7d-9e20-badf0b649349 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Calling method '.version_select at 0x7fd6c61e2160>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:02.051687 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-99ce3722-539b-4f7d-9e20-badf0b649349 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] HTTP exception thrown: Image not found. Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99ce3722-539b-4f7d-9e20-badf0b649349 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Request method failure captured: Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/images/0bef0d99-925a-4532-bee4-cc0fe8540758 HTTP/1.1 Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnPEwnbzfcAbOdtIJZs9zj7dIdWin9ZUKuA7w_vwEbIM9wIbCitz_5qC6a9lrg-SS4ms2bKPGEJJjC9ERGs2o3fpv7kcIZCLKIDYI3KgdPIG-gRvMCMZrGFAps4u-UzGfDYKwlzY-ndrD5iHeLnyqbPjclMQUqENLygZnOcsJ-I7Ho Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d75ab2ae199e4f4596f10ce270686553 Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d75ab2ae199e4f4596f10ce270686553"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d75ab2ae199e4f4596f10ce270686553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d75ab2ae199e4f4596f10ce270686553", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d75ab2ae199e4f4596f10ce270686553"}]}] Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d75ab2ae199e4f4596f10ce270686553 Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-518531557 Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesDeleteNegativeTestJSON-518531557-project Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f4c160c8227143e29f1baa396645197d Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-518531557-project Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: exception: Image not found. Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0bef0d99-925a-4532-bee4-cc0fe8540758'} Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0bef0d99-925a-4532-bee4-cc0fe8540758 to delete Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0bef0d99-925a-4532-bee4-cc0fe8540758 could not be found. Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:02.053811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:36:02.058260 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:02.062668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99ce3722-539b-4f7d-9e20-badf0b649349 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] Returning 404 to user: Image not found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:02.064131 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99ce3722-539b-4f7d-9e20-badf0b649349 tempest-ImagesDeleteNegativeTestJSON-518531557 tempest-ImagesDeleteNegativeTestJSON-518531557-project] 10.222.0.81 "DELETE /compute/v2.1/images/0bef0d99-925a-4532-bee4-cc0fe8540758" status: 404 len: 62 microversion: 2.1 time: 0.062307 Jul 14 14:36:02.069884 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1150/2310] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:02 2022] DELETE /compute/v2.1/images/0bef0d99-925a-4532-bee4-cc0fe8540758 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:36:02.081720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b6782950-d7b7-4b9b-a7bb-17c9158c74a3 req-33463966-d388-4cb1-8ccb-20ddcc7a550c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb1f152-0733-4f36-91a0-71797b749e16", "name": "network-vif-plugged", "status": "completed", "tag": "db2d2768-461e-4832-b4e6-c4e4a8334c60"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:02.096673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b6782950-d7b7-4b9b-a7bb-17c9158c74a3 req-33463966-d388-4cb1-8ccb-20ddcc7a550c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:02.097830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b6782950-d7b7-4b9b-a7bb-17c9158c74a3 req-33463966-d388-4cb1-8ccb-20ddcc7a550c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.113761 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b6782950-d7b7-4b9b-a7bb-17c9158c74a3 req-33463966-d388-4cb1-8ccb-20ddcc7a550c service nova] Creating event network-vif-plugged:db2d2768-461e-4832-b4e6-c4e4a8334c60 for instance deb1f152-0733-4f36-91a0-71797b749e16 on n-h1-767704-28 Jul 14 14:36:02.121431 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b6782950-d7b7-4b9b-a7bb-17c9158c74a3 req-33463966-d388-4cb1-8ccb-20ddcc7a550c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049480 Jul 14 14:36:02.124111 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1151/2311] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:02.131064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-19cce5f2-f3f8-4a71-935d-7ca2c4729875 req-db77bc80-6c68-4ebe-9255-9ac7753b3056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad", "name": "network-vif-deleted", "tag": "e5602274-dec3-49a9-9a61-41955c9e695f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:02.142326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-19cce5f2-f3f8-4a71-935d-7ca2c4729875 req-db77bc80-6c68-4ebe-9255-9ac7753b3056 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:02.143250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-19cce5f2-f3f8-4a71-935d-7ca2c4729875 req-db77bc80-6c68-4ebe-9255-9ac7753b3056 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.183742 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-19cce5f2-f3f8-4a71-935d-7ca2c4729875 req-db77bc80-6c68-4ebe-9255-9ac7753b3056 service nova] Creating event network-vif-deleted:e5602274-dec3-49a9-9a61-41955c9e695f for instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad on n-h2-767704-28 Jul 14 14:36:02.190866 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-19cce5f2-f3f8-4a71-935d-7ca2c4729875 req-db77bc80-6c68-4ebe-9255-9ac7753b3056 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065052 Jul 14 14:36:02.193880 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1152/2312] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:02.200174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d5f4f56-9615-451a-9090-7224fa70dd88 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:02.201072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8d5f4f56-9615-451a-9090-7224fa70dd88 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:02.210123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d5f4f56-9615-451a-9090-7224fa70dd88 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:02.210884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d5f4f56-9615-451a-9090-7224fa70dd88 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.212105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d5f4f56-9615-451a-9090-7224fa70dd88 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:02.219461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d5f4f56-9615-451a-9090-7224fa70dd88 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.242879 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-8d5f4f56-9615-451a-9090-7224fa70dd88 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] HTTP exception thrown: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d5f4f56-9615-451a-9090-7224fa70dd88 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad HTTP/1.1 Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad'} Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:02.244876 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:02.250099 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:02.250099 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:02.250099 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:02.250099 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:02.250099 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:02.250099 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:02.250099 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:02.250099 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:02.252258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d5f4f56-9615-451a-9090-7224fa70dd88 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 404 to user: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:02.253324 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8d5f4f56-9615-451a-9090-7224fa70dd88 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 404 len: 111 microversion: 2.1 time: 0.057853 Jul 14 14:36:02.264840 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1153/2313] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:02 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:02.367146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f53ccb78-1272-4917-a13d-481521f45445 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:02.381492 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f53ccb78-1272-4917-a13d-481521f45445 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1316 microversion: 2.1 time: 0.452857 Jul 14 14:36:02.382695 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1161/2314] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:01 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:02.631214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-819942365", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:02.734526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] validate_networks() for [('7c43dfbf-9695-44fa-8557-60f7b955d643', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:02.951360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4b1e6936-1e09-4f49-846c-055777fe38a9 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Calling method '.version_select at 0x7fd6c56dddc0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:03.547933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:03.548476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:03.548880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:03.549348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:03.549761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:03.568710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.569197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.570016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.570462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.593625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Getting quotas for project ad9c7d3620e34c95bb8a772e532fc660. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:03.611015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Getting quotas for user 935bde481e9c41a1951bcdab5af71211 and project ad9c7d3620e34c95bb8a772e532fc660. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:03.611199 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4b1e6936-1e09-4f49-846c-055777fe38a9 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/8e01cf00280b44b88fe3c45e4c2d669d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.657755 Jul 14 14:36:03.619352 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1162/2315] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:36:02 2022] GET /compute/v2.1/os-quota-sets/8e01cf00280b44b88fe3c45e4c2d669d/defaults => generated 371 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:03.635674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-088102b0-dc62-4f15-b345-0202b74ac132 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:03.637683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-088102b0-dc62-4f15-b345-0202b74ac132 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:03.639992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:03.642350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:03.655490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-088102b0-dc62-4f15-b345-0202b74ac132 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.656440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-088102b0-dc62-4f15-b345-0202b74ac132 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.658148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-088102b0-dc62-4f15-b345-0202b74ac132 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.659261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-088102b0-dc62-4f15-b345-0202b74ac132 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.708429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:03.739678 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bcbfbaa0-2866-4c08-872d-77155f2fb945 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.113631 Jul 14 14:36:03.740683 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1154/2316] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:36:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:36:03.748960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a7f03d86-a1c3-4cad-9ac9-b2e7a9225a82 req-5343e347-b732-486e-bfb1-3bfac83768b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68", "tag": "a463658a-4486-4768-9db2-ddb8cc33d3aa"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:03.761929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a7f03d86-a1c3-4cad-9ac9-b2e7a9225a82 req-5343e347-b732-486e-bfb1-3bfac83768b6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.762632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a7f03d86-a1c3-4cad-9ac9-b2e7a9225a82 req-5343e347-b732-486e-bfb1-3bfac83768b6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.779245 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a7f03d86-a1c3-4cad-9ac9-b2e7a9225a82 req-5343e347-b732-486e-bfb1-3bfac83768b6 service nova] Creating event network-changed:a463658a-4486-4768-9db2-ddb8cc33d3aa for instance e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 on n-h2-767704-28 Jul 14 14:36:03.786789 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a7f03d86-a1c3-4cad-9ac9-b2e7a9225a82 req-5343e347-b732-486e-bfb1-3bfac83768b6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042375 Jul 14 14:36:03.788126 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1155/2317] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:03.794401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a95d1e6d-dccc-47db-9130-3a38eb66a3d5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:03.796234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a95d1e6d-dccc-47db-9130-3a38eb66a3d5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:03.805230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a95d1e6d-dccc-47db-9130-3a38eb66a3d5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.806183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a95d1e6d-dccc-47db-9130-3a38eb66a3d5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.807560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a95d1e6d-dccc-47db-9130-3a38eb66a3d5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.808265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a95d1e6d-dccc-47db-9130-3a38eb66a3d5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:04.310017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a95d1e6d-dccc-47db-9130-3a38eb66a3d5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:04.320302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-088102b0-dc62-4f15-b345-0202b74ac132 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:04.325201 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a95d1e6d-dccc-47db-9130-3a38eb66a3d5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1316 microversion: 2.1 time: 0.533575 Jul 14 14:36:04.326529 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1156/2318] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:03 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:04.332990 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-088102b0-dc62-4f15-b345-0202b74ac132 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1315 microversion: 2.1 time: 0.712119 Jul 14 14:36:04.334664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e75b3113-63cf-4a67-9f42-6c4a35c87796 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c63cd0d0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:04.339473 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1163/2319] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:03 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:04.349493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc79479c-8eef-4be9-96c0-9395d58143f7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:04.353597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dc79479c-8eef-4be9-96c0-9395d58143f7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:04.436479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dc79479c-8eef-4be9-96c0-9395d58143f7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:04.445520 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dc79479c-8eef-4be9-96c0-9395d58143f7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1224 microversion: 2.1 time: 0.101833 Jul 14 14:36:04.446111 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1164/2320] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:04 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:04.675184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e75b3113-63cf-4a67-9f42-6c4a35c87796 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:04.675724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e75b3113-63cf-4a67-9f42-6c4a35c87796 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:04.676884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e75b3113-63cf-4a67-9f42-6c4a35c87796 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:04.677380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e75b3113-63cf-4a67-9f42-6c4a35c87796 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:04.922333 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e75b3113-63cf-4a67-9f42-6c4a35c87796 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/8e01cf00280b44b88fe3c45e4c2d669d" status: 200 len: 329 microversion: 2.1 time: 0.593956 Jul 14 14:36:04.922989 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1157/2321] 10.222.0.81 () {60 vars in 1262 bytes} [Thu Jul 14 14:36:04 2022] PUT /compute/v2.1/os-quota-sets/8e01cf00280b44b88fe3c45e4c2d669d => generated 329 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:04.933744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-80ba02bd-c53e-4f71-b449-ac309624daf5 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Action: 'update', calling method: .version_select at 0x7fd6c56ddca0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:05.311358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80ba02bd-c53e-4f71-b449-ac309624daf5 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:05.311831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80ba02bd-c53e-4f71-b449-ac309624daf5 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:05.312667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80ba02bd-c53e-4f71-b449-ac309624daf5 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:05.313150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80ba02bd-c53e-4f71-b449-ac309624daf5 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:05.344229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-37c462d3-9495-4574-b130-b6c9c60f3fb0 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:05.345103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-37c462d3-9495-4574-b130-b6c9c60f3fb0 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:05.354335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37c462d3-9495-4574-b130-b6c9c60f3fb0 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:05.355393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37c462d3-9495-4574-b130-b6c9c60f3fb0 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:05.356141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37c462d3-9495-4574-b130-b6c9c60f3fb0 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:05.356862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37c462d3-9495-4574-b130-b6c9c60f3fb0 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:05.646350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=11,nova_api:INSERT=11 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:05.696549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-37c462d3-9495-4574-b130-b6c9c60f3fb0 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:05.715467 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-37c462d3-9495-4574-b130-b6c9c60f3fb0 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1316 microversion: 2.1 time: 0.375844 Jul 14 14:36:05.718827 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1158/2322] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:05 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:05.735686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-557a45d5-182a-4d47-ae36-14e155cd5e50 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:05.739555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-557a45d5-182a-4d47-ae36-14e155cd5e50 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:05.759024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-557a45d5-182a-4d47-ae36-14e155cd5e50 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:05.777479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-557a45d5-182a-4d47-ae36-14e155cd5e50 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:05.780399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-557a45d5-182a-4d47-ae36-14e155cd5e50 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:05.786242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-557a45d5-182a-4d47-ae36-14e155cd5e50 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:05.874456 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-80ba02bd-c53e-4f71-b449-ac309624daf5 tempest-QuotasAdminTestJSON-717588950 tempest-QuotasAdminTestJSON-717588950-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-quota-sets/8e01cf00280b44b88fe3c45e4c2d669d" status: 200 len: 329 microversion: 2.1 time: 0.944686 Jul 14 14:36:05.875360 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1165/2323] 10.222.0.81 () {60 vars in 1262 bytes} [Thu Jul 14 14:36:04 2022] PUT /compute/v2.1/os-quota-sets/8e01cf00280b44b88fe3c45e4c2d669d => generated 329 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:05.886861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-66090f0f-a7db-481a-b785-159b1c951d8a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:05.890711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-66090f0f-a7db-481a-b785-159b1c951d8a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:05.908374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66090f0f-a7db-481a-b785-159b1c951d8a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:05.909057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66090f0f-a7db-481a-b785-159b1c951d8a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:05.912412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66090f0f-a7db-481a-b785-159b1c951d8a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:05.913999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66090f0f-a7db-481a-b785-159b1c951d8a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:06.055295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-66090f0f-a7db-481a-b785-159b1c951d8a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:06.065242 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-66090f0f-a7db-481a-b785-159b1c951d8a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1276 microversion: 2.1 time: 0.186612 Jul 14 14:36:06.068578 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1166/2324] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:05 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:06.137301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-557a45d5-182a-4d47-ae36-14e155cd5e50 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:06.159816 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-557a45d5-182a-4d47-ae36-14e155cd5e50 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1503 microversion: 2.1 time: 0.433145 Jul 14 14:36:06.177461 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1159/2325] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:05 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1503 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:06.183511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cb6ffbd5-fb13-42c6-80dc-12f7c7766ec2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:06.194221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb6ffbd5-fb13-42c6-80dc-12f7c7766ec2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:06.194685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb6ffbd5-fb13-42c6-80dc-12f7c7766ec2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:06.220969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cb6ffbd5-fb13-42c6-80dc-12f7c7766ec2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Going to try to stop instance {{(pid=119512) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:36:06.291705 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cb6ffbd5-fb13-42c6-80dc-12f7c7766ec2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "POST /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16/action" status: 202 len: 0 microversion: 2.1 time: 0.111711 Jul 14 14:36:06.292410 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1167/2326] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:36:06 2022] POST /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:06.301710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5684a61d-a414-4461-b3c4-9119d82bfe55 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:06.302324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5684a61d-a414-4461-b3c4-9119d82bfe55 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:06.323231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5684a61d-a414-4461-b3c4-9119d82bfe55 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:06.323941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5684a61d-a414-4461-b3c4-9119d82bfe55 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:06.325140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5684a61d-a414-4461-b3c4-9119d82bfe55 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:06.326548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5684a61d-a414-4461-b3c4-9119d82bfe55 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:06.725039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5684a61d-a414-4461-b3c4-9119d82bfe55 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:06.734649 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5684a61d-a414-4461-b3c4-9119d82bfe55 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.437210 Jul 14 14:36:06.743976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc53bea6-86aa-41da-8fa2-f7a3eec5c755 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:06.745356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cc53bea6-86aa-41da-8fa2-f7a3eec5c755 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:06.749096 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1160/2327] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:06 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:06.768812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc53bea6-86aa-41da-8fa2-f7a3eec5c755 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:06.769450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc53bea6-86aa-41da-8fa2-f7a3eec5c755 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:06.770525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc53bea6-86aa-41da-8fa2-f7a3eec5c755 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:06.771179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc53bea6-86aa-41da-8fa2-f7a3eec5c755 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:07.057459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cc53bea6-86aa-41da-8fa2-f7a3eec5c755 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:07.073429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc53bea6-86aa-41da-8fa2-f7a3eec5c755 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1316 microversion: 2.1 time: 0.340187 Jul 14 14:36:07.074740 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1168/2328] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:06 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:07.090693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-66dbde57-0b19-4cc9-95e9-ef52083f30aa tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:07.093260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-66dbde57-0b19-4cc9-95e9-ef52083f30aa tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:07.106464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66dbde57-0b19-4cc9-95e9-ef52083f30aa tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:07.110083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66dbde57-0b19-4cc9-95e9-ef52083f30aa tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:07.111854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66dbde57-0b19-4cc9-95e9-ef52083f30aa tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:07.114628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66dbde57-0b19-4cc9-95e9-ef52083f30aa tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:07.172249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:07.292989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-66dbde57-0b19-4cc9-95e9-ef52083f30aa tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:07.304885 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-66dbde57-0b19-4cc9-95e9-ef52083f30aa tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1282 microversion: 2.1 time: 0.220643 Jul 14 14:36:07.309142 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1161/2329] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:07 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1282 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:07.754516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b839e4c-df57-47bf-9698-2b41b37b2e7c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:07.755144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b839e4c-df57-47bf-9698-2b41b37b2e7c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:07.773509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b839e4c-df57-47bf-9698-2b41b37b2e7c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:07.778494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b839e4c-df57-47bf-9698-2b41b37b2e7c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:07.780019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b839e4c-df57-47bf-9698-2b41b37b2e7c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:07.780487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b839e4c-df57-47bf-9698-2b41b37b2e7c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:08.085033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-da76680c-92c5-4657-8c02-317fb5b6442c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c59ceb80>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:08.162922 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-da76680c-92c5-4657-8c02-317fb5b6442c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/a8a2f556-5651-4f4f-ae94-8e655f609000" status: 200 len: 661 microversion: 2.1 time: 0.089770 Jul 14 14:36:08.165199 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1162/2330] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:08 2022] GET /compute/v2.1/images/a8a2f556-5651-4f4f-ae94-8e655f609000 => generated 661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:08.176837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d319637b-8280-4f10-810a-d55ba91db4cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:08.181660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d319637b-8280-4f10-810a-d55ba91db4cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:08.190942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d319637b-8280-4f10-810a-d55ba91db4cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:08.191667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d319637b-8280-4f10-810a-d55ba91db4cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:08.192620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d319637b-8280-4f10-810a-d55ba91db4cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:08.193491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d319637b-8280-4f10-810a-d55ba91db4cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:08.227220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9b839e4c-df57-47bf-9698-2b41b37b2e7c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:08.237838 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9b839e4c-df57-47bf-9698-2b41b37b2e7c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.487358 Jul 14 14:36:08.240325 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1169/2331] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:07 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:08.249976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f58fd6f-9619-4833-82ee-ce78bdd89e36 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5681ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:08.303613 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f58fd6f-9619-4833-82ee-ce78bdd89e36 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/a8a2f556-5651-4f4f-ae94-8e655f609000" status: 200 len: 661 microversion: 2.1 time: 0.059688 Jul 14 14:36:08.304930 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1170/2332] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:08 2022] GET /compute/v2.1/images/a8a2f556-5651-4f4f-ae94-8e655f609000 => generated 661 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:08.334668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b75682d7-34f7-4705-8d77-01ab6a8f4fdf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:08.338419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b75682d7-34f7-4705-8d77-01ab6a8f4fdf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:08.352688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b75682d7-34f7-4705-8d77-01ab6a8f4fdf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:08.353189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b75682d7-34f7-4705-8d77-01ab6a8f4fdf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:08.353981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b75682d7-34f7-4705-8d77-01ab6a8f4fdf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:08.357857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b75682d7-34f7-4705-8d77-01ab6a8f4fdf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:08.587860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d319637b-8280-4f10-810a-d55ba91db4cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:08.604402 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d319637b-8280-4f10-810a-d55ba91db4cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1316 microversion: 2.1 time: 0.437329 Jul 14 14:36:08.606239 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1163/2333] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:08 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:08.630897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b75682d7-34f7-4705-8d77-01ab6a8f4fdf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:08.645563 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b75682d7-34f7-4705-8d77-01ab6a8f4fdf tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1324 microversion: 2.1 time: 0.319196 Jul 14 14:36:08.646994 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1171/2334] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:08 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1324 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:09.257647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0f55db12-2689-4c33-bb24-26f8faa8b8e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:09.262009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-7ca5e668-0d9d-46ea-a05f-a3095047150c req-f7616677-cb6f-4cc1-94bd-cb4a16f0396e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe27ada-2ed3-48c1-a28f-94584e1a2fb9", "tag": "08fc5bf4-4f28-414b-9c19-eeba9861d7b6"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:09.264213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0f55db12-2689-4c33-bb24-26f8faa8b8e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:09.298118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f55db12-2689-4c33-bb24-26f8faa8b8e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.305312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f55db12-2689-4c33-bb24-26f8faa8b8e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.307253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f55db12-2689-4c33-bb24-26f8faa8b8e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.309512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f55db12-2689-4c33-bb24-26f8faa8b8e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.310712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7ca5e668-0d9d-46ea-a05f-a3095047150c req-f7616677-cb6f-4cc1-94bd-cb4a16f0396e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.313858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7ca5e668-0d9d-46ea-a05f-a3095047150c req-f7616677-cb6f-4cc1-94bd-cb4a16f0396e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.347850 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-7ca5e668-0d9d-46ea-a05f-a3095047150c req-f7616677-cb6f-4cc1-94bd-cb4a16f0396e service nova] Creating event network-changed:08fc5bf4-4f28-414b-9c19-eeba9861d7b6 for instance 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 on n-h2-767704-28 Jul 14 14:36:09.362840 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-7ca5e668-0d9d-46ea-a05f-a3095047150c req-f7616677-cb6f-4cc1-94bd-cb4a16f0396e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115816 Jul 14 14:36:09.364079 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1164/2335] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:09.411463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f87d1db6-ab4f-4c16-bb26-4eb4853e303c req-29ad69b8-46b8-4bf3-98ae-86fd9b267c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68", "name": "network-vif-plugged", "status": "completed", "tag": "a463658a-4486-4768-9db2-ddb8cc33d3aa"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:09.423889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f87d1db6-ab4f-4c16-bb26-4eb4853e303c req-29ad69b8-46b8-4bf3-98ae-86fd9b267c22 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.425013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f87d1db6-ab4f-4c16-bb26-4eb4853e303c req-29ad69b8-46b8-4bf3-98ae-86fd9b267c22 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.445680 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f87d1db6-ab4f-4c16-bb26-4eb4853e303c req-29ad69b8-46b8-4bf3-98ae-86fd9b267c22 service nova] Creating event network-vif-plugged:a463658a-4486-4768-9db2-ddb8cc33d3aa for instance e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 on n-h2-767704-28 Jul 14 14:36:09.452900 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f87d1db6-ab4f-4c16-bb26-4eb4853e303c req-29ad69b8-46b8-4bf3-98ae-86fd9b267c22 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050036 Jul 14 14:36:09.455086 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1165/2336] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:09.623539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-161dd3a6-9bed-44a3-845a-a26aea8f5b85 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:09.624341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-161dd3a6-9bed-44a3-845a-a26aea8f5b85 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:09.634558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-161dd3a6-9bed-44a3-845a-a26aea8f5b85 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.637498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-161dd3a6-9bed-44a3-845a-a26aea8f5b85 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.641410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-161dd3a6-9bed-44a3-845a-a26aea8f5b85 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.641959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-161dd3a6-9bed-44a3-845a-a26aea8f5b85 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.733286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0f55db12-2689-4c33-bb24-26f8faa8b8e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:09.741816 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0f55db12-2689-4c33-bb24-26f8faa8b8e7 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.490592 Jul 14 14:36:09.742696 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1172/2337] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:09 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:09.753544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b873239-9167-4bce-9617-0871a242c698 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:09.755267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b873239-9167-4bce-9617-0871a242c698 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:09.761877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b873239-9167-4bce-9617-0871a242c698 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.762630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b873239-9167-4bce-9617-0871a242c698 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.764539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b873239-9167-4bce-9617-0871a242c698 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.765392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b873239-9167-4bce-9617-0871a242c698 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.931476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-161dd3a6-9bed-44a3-845a-a26aea8f5b85 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:09.941821 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-161dd3a6-9bed-44a3-845a-a26aea8f5b85 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1316 microversion: 2.1 time: 0.322647 Jul 14 14:36:09.942415 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1166/2338] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:09 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:09.997794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2b873239-9167-4bce-9617-0871a242c698 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:10.007558 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b873239-9167-4bce-9617-0871a242c698 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1324 microversion: 2.1 time: 0.259180 Jul 14 14:36:10.009031 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1173/2339] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:09 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1324 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:10.223088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6c1ed05a-e4a3-4565-a1c1-5422b141962f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c60eb4c0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:10.273576 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6c1ed05a-e4a3-4565-a1c1-5422b141962f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/81f29835-ca09-418a-a363-4efd52423134" status: 200 len: 662 microversion: 2.1 time: 0.055048 Jul 14 14:36:10.274416 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1167/2340] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:10 2022] GET /compute/v2.1/images/81f29835-ca09-418a-a363-4efd52423134 => generated 662 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:10.287070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-110fd3cb-1bde-42c9-8197-d3de07bbcf51 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5734310>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:10.345398 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-110fd3cb-1bde-42c9-8197-d3de07bbcf51 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/81f29835-ca09-418a-a363-4efd52423134" status: 200 len: 662 microversion: 2.1 time: 0.062129 Jul 14 14:36:10.346339 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1174/2341] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:10 2022] GET /compute/v2.1/images/81f29835-ca09-418a-a363-4efd52423134 => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:10.760429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c13a45aa-ea96-4dd3-b1e5-779940be1d6f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:10.761036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c13a45aa-ea96-4dd3-b1e5-779940be1d6f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:10.770523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c13a45aa-ea96-4dd3-b1e5-779940be1d6f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.771098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c13a45aa-ea96-4dd3-b1e5-779940be1d6f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:10.772056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c13a45aa-ea96-4dd3-b1e5-779940be1d6f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.772497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c13a45aa-ea96-4dd3-b1e5-779940be1d6f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:10.958933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc49d938-5454-4d4b-b7a7-a2c5796f5fd8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:10.959838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dc49d938-5454-4d4b-b7a7-a2c5796f5fd8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:10.969035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c13a45aa-ea96-4dd3-b1e5-779940be1d6f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:10.971458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc49d938-5454-4d4b-b7a7-a2c5796f5fd8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.972090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc49d938-5454-4d4b-b7a7-a2c5796f5fd8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:10.973214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc49d938-5454-4d4b-b7a7-a2c5796f5fd8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.973831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc49d938-5454-4d4b-b7a7-a2c5796f5fd8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:10.977350 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c13a45aa-ea96-4dd3-b1e5-779940be1d6f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.221985 Jul 14 14:36:10.977956 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1168/2342] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:10 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:11.027072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b56ad61-a448-43ea-9721-bc6d9312e4eb tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:11.027733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0b56ad61-a448-43ea-9721-bc6d9312e4eb tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:11.040305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b56ad61-a448-43ea-9721-bc6d9312e4eb tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.040867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b56ad61-a448-43ea-9721-bc6d9312e4eb tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.041696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b56ad61-a448-43ea-9721-bc6d9312e4eb tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.047399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b56ad61-a448-43ea-9721-bc6d9312e4eb tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.207125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dc49d938-5454-4d4b-b7a7-a2c5796f5fd8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:11.214921 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dc49d938-5454-4d4b-b7a7-a2c5796f5fd8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1316 microversion: 2.1 time: 0.259966 Jul 14 14:36:11.217275 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1175/2343] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:10 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:11.267009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0b56ad61-a448-43ea-9721-bc6d9312e4eb tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:11.276765 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0b56ad61-a448-43ea-9721-bc6d9312e4eb tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1324 microversion: 2.1 time: 0.254768 Jul 14 14:36:11.278148 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1169/2344] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:11 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:11.999064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cf0ba33d-9055-4c36-9ef2-ba47b573daab tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c59a10d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:12.004416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd802ae2-d5d0-4e59-bb2c-2719c212baf0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:12.004416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cd802ae2-d5d0-4e59-bb2c-2719c212baf0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:12.017355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd802ae2-d5d0-4e59-bb2c-2719c212baf0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.017797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd802ae2-d5d0-4e59-bb2c-2719c212baf0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.018605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd802ae2-d5d0-4e59-bb2c-2719c212baf0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.019054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd802ae2-d5d0-4e59-bb2c-2719c212baf0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.092102 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cf0ba33d-9055-4c36-9ef2-ba47b573daab tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/122b005d-e658-4fff-a7c7-caea456d93ae" status: 200 len: 662 microversion: 2.1 time: 0.096462 Jul 14 14:36:12.092704 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1170/2345] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:11 2022] GET /compute/v2.1/images/122b005d-e658-4fff-a7c7-caea456d93ae => generated 662 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:12.104729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-05f20bdb-0dc1-452d-b336-b20b9b256cfa tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c57e39d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:12.209220 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-05f20bdb-0dc1-452d-b336-b20b9b256cfa tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/122b005d-e658-4fff-a7c7-caea456d93ae" status: 200 len: 662 microversion: 2.1 time: 0.106579 Jul 14 14:36:12.213236 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1171/2346] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:12 2022] GET /compute/v2.1/images/122b005d-e658-4fff-a7c7-caea456d93ae => generated 662 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:12.238103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cce14d9b-0a42-4060-8256-6ed508288da8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:12.239739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cce14d9b-0a42-4060-8256-6ed508288da8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:12.250966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cce14d9b-0a42-4060-8256-6ed508288da8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.251428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cce14d9b-0a42-4060-8256-6ed508288da8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.252230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cce14d9b-0a42-4060-8256-6ed508288da8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.252666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cce14d9b-0a42-4060-8256-6ed508288da8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.271327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cd802ae2-d5d0-4e59-bb2c-2719c212baf0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:12.282067 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cd802ae2-d5d0-4e59-bb2c-2719c212baf0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.290968 Jul 14 14:36:12.295296 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1176/2347] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:11 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:12.300450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6126378a-a2d2-4609-86a5-aa287bee705a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:12.305414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6126378a-a2d2-4609-86a5-aa287bee705a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:12.321781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6126378a-a2d2-4609-86a5-aa287bee705a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.326689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6126378a-a2d2-4609-86a5-aa287bee705a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.328990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6126378a-a2d2-4609-86a5-aa287bee705a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.330762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6126378a-a2d2-4609-86a5-aa287bee705a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.381274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:12.570049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cce14d9b-0a42-4060-8256-6ed508288da8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:12.579412 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cce14d9b-0a42-4060-8256-6ed508288da8 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1504 microversion: 2.1 time: 0.349503 Jul 14 14:36:12.580001 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1172/2348] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:12 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:12.585442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-274216067", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:12.596217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6126378a-a2d2-4609-86a5-aa287bee705a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:12.619433 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6126378a-a2d2-4609-86a5-aa287bee705a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1324 microversion: 2.1 time: 0.322696 Jul 14 14:36:12.622866 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1177/2349] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:12 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1324 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:12.663346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:12.872790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-29378976", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:12.933254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:12.939736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:12.940542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:12.941322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:12.941926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:12.942577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:12.956461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.957429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.958297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.958990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.998172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Getting quotas for project bd972941395b44d288fafe30e02af1d4. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:13.005829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Getting quotas for user 4798e509f5f74d93b6e50ad9d8d25436 and project bd972941395b44d288fafe30e02af1d4. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:13.022789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:13.030436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:13.095738 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a0108922-7aa1-44a7-966a-d9ba72c1e095 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514295 Jul 14 14:36:13.097108 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1173/2350] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:36:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:36:13.102753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-30cd8e00-be06-4982-a41e-23170ade456c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-655872478"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:13.103666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-30cd8e00-be06-4982-a41e-23170ade456c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:13.111632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30cd8e00-be06-4982-a41e-23170ade456c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:13.112476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30cd8e00-be06-4982-a41e-23170ade456c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:13.113584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30cd8e00-be06-4982-a41e-23170ade456c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:13.114320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30cd8e00-be06-4982-a41e-23170ade456c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:13.364082 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.network.security_group_api [None req-30cd8e00-be06-4982-a41e-23170ade456c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Adding security group 9032c326-4394-49c4-9e63-e96969509fee to port a463658a-4486-4768-9db2-ddb8cc33d3aa Jul 14 14:36:13.407701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:13.408203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:13.408605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:13.409213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:13.409830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:13.430911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:13.432193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:13.434610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:13.436534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:13.482251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Getting quotas for project 8a0c595b04c74827b3c00228b9a57c27. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:13.491154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Getting quotas for user 89d755b092134384b11c41c5f63fcae4 and project 8a0c595b04c74827b3c00228b9a57c27. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:13.510150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:13.512634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:13.611348 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8e4ebbe6-2c79-455c-815d-377be57d3add tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974471 Jul 14 14:36:13.626082 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1178/2351] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:36:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:36:13.636052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-93fd4725-44a6-48b3-acdd-8028cde7fbd0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:13.637308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-93fd4725-44a6-48b3-acdd-8028cde7fbd0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:13.661582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93fd4725-44a6-48b3-acdd-8028cde7fbd0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:13.663359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93fd4725-44a6-48b3-acdd-8028cde7fbd0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:13.664185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93fd4725-44a6-48b3-acdd-8028cde7fbd0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:13.667190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93fd4725-44a6-48b3-acdd-8028cde7fbd0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:14.453175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-93fd4725-44a6-48b3-acdd-8028cde7fbd0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:14.461423 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-93fd4725-44a6-48b3-acdd-8028cde7fbd0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.834106 Jul 14 14:36:14.462024 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1179/2352] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:13 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:14.467638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1589627997", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:14.539923 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-30cd8e00-be06-4982-a41e-23170ade456c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68/action" status: 202 len: 0 microversion: 2.1 time: 1.441396 Jul 14 14:36:14.541195 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1174/2353] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:36:13 2022] POST /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68/action => generated 0 bytes in 1443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:14.549553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:14.551322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7a8bdae3-6c5e-40b3-92a5-2473d2adfc5c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:14.552135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7a8bdae3-6c5e-40b3-92a5-2473d2adfc5c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:14.566180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a8bdae3-6c5e-40b3-92a5-2473d2adfc5c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:14.569442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a8bdae3-6c5e-40b3-92a5-2473d2adfc5c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:14.570478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a8bdae3-6c5e-40b3-92a5-2473d2adfc5c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:14.573987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a8bdae3-6c5e-40b3-92a5-2473d2adfc5c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:15.050029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:15.050474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:15.051188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:15.051611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:15.052110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:15.068543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:15.069221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:15.071581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:15.079127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:15.121865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Getting quotas for project bd972941395b44d288fafe30e02af1d4. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:15.128842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Getting quotas for user 4798e509f5f74d93b6e50ad9d8d25436 and project bd972941395b44d288fafe30e02af1d4. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:15.147480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:15.149483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:15.165711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7a8bdae3-6c5e-40b3-92a5-2473d2adfc5c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:15.178029 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7a8bdae3-6c5e-40b3-92a5-2473d2adfc5c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1324 microversion: 2.1 time: 0.627940 Jul 14 14:36:15.180660 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1175/2354] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:14 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1324 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:15.200336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-536812103", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:15.230603 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-91090cb5-b3c8-4b84-bad7-c3492c0404ba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767340 Jul 14 14:36:15.231266 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1180/2355] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:36:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:36:15.244419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8b000d4-0711-4d8f-b490-3f6d5e5bdbda tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1285567475"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:15.245500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8b000d4-0711-4d8f-b490-3f6d5e5bdbda tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:15.269918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8b000d4-0711-4d8f-b490-3f6d5e5bdbda tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:15.270424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8b000d4-0711-4d8f-b490-3f6d5e5bdbda tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:15.275144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8b000d4-0711-4d8f-b490-3f6d5e5bdbda tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:15.275144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8b000d4-0711-4d8f-b490-3f6d5e5bdbda tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:15.303554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:15.825211 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.network.security_group_api [None req-d8b000d4-0711-4d8f-b490-3f6d5e5bdbda tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Adding security group c287caee-f2ba-4df0-bedc-508759addca3 to port a463658a-4486-4768-9db2-ddb8cc33d3aa Jul 14 14:36:16.059487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:16.060687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:16.061386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:16.061989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:16.062696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:16.083441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.083902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.084895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.085527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.131744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Getting quotas for project 8a0c595b04c74827b3c00228b9a57c27. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:16.143740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Getting quotas for user 89d755b092134384b11c41c5f63fcae4 and project 8a0c595b04c74827b3c00228b9a57c27. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:16.160293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:INSERT=19,nova_api:SELECT=81 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:16.168085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:16.172504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:16.259700 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7a818523-c562-46ab-b225-13096ead3f44 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070464 Jul 14 14:36:16.262053 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1176/2356] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:36:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:36:16.281766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c0a74396-a734-42ef-8329-56cc556dc15b req-73efbe50-c573-49c2-b2aa-8aa7b0fd47ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68", "tag": "a463658a-4486-4768-9db2-ddb8cc33d3aa"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:16.298672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c0a74396-a734-42ef-8329-56cc556dc15b req-73efbe50-c573-49c2-b2aa-8aa7b0fd47ef service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.300133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c0a74396-a734-42ef-8329-56cc556dc15b req-73efbe50-c573-49c2-b2aa-8aa7b0fd47ef service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.319036 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c0a74396-a734-42ef-8329-56cc556dc15b req-73efbe50-c573-49c2-b2aa-8aa7b0fd47ef service nova] Creating event network-changed:a463658a-4486-4768-9db2-ddb8cc33d3aa for instance e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 on n-h2-767704-28 Jul 14 14:36:16.327443 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c0a74396-a734-42ef-8329-56cc556dc15b req-73efbe50-c573-49c2-b2aa-8aa7b0fd47ef service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060651 Jul 14 14:36:16.328940 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1177/2357] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:16.338702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f1ab7999-e1cd-4043-99aa-491588048197 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:16.339658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f1ab7999-e1cd-4043-99aa-491588048197 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:16.349517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1ab7999-e1cd-4043-99aa-491588048197 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.350432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1ab7999-e1cd-4043-99aa-491588048197 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.352572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1ab7999-e1cd-4043-99aa-491588048197 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.353344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1ab7999-e1cd-4043-99aa-491588048197 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.495664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f1ab7999-e1cd-4043-99aa-491588048197 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:16.521608 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f1ab7999-e1cd-4043-99aa-491588048197 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1214 microversion: 2.1 time: 0.190951 Jul 14 14:36:16.525953 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1178/2358] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:16 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:16.563015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ea1ddca-4869-4e79-837f-7585bfbadd52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:16.566987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8ea1ddca-4869-4e79-837f-7585bfbadd52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:16.588925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ea1ddca-4869-4e79-837f-7585bfbadd52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.590511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ea1ddca-4869-4e79-837f-7585bfbadd52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.594245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ea1ddca-4869-4e79-837f-7585bfbadd52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.595710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ea1ddca-4869-4e79-837f-7585bfbadd52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:17.316216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8ea1ddca-4869-4e79-837f-7585bfbadd52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:17.329811 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8ea1ddca-4869-4e79-837f-7585bfbadd52 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.797934 Jul 14 14:36:17.332404 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1179/2359] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:16 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:17.345710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c6d46676-bade-4afe-bf0e-09df8813fc74 req-de633d75-21d9-482b-a193-330636c2e283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe27ada-2ed3-48c1-a28f-94584e1a2fb9", "name": "network-vif-plugged", "status": "completed", "tag": "08fc5bf4-4f28-414b-9c19-eeba9861d7b6"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:17.377446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c6d46676-bade-4afe-bf0e-09df8813fc74 req-de633d75-21d9-482b-a193-330636c2e283 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:17.379070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c6d46676-bade-4afe-bf0e-09df8813fc74 req-de633d75-21d9-482b-a193-330636c2e283 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:17.443199 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c6d46676-bade-4afe-bf0e-09df8813fc74 req-de633d75-21d9-482b-a193-330636c2e283 service nova] Creating event network-vif-plugged:08fc5bf4-4f28-414b-9c19-eeba9861d7b6 for instance 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 on n-h2-767704-28 Jul 14 14:36:17.471484 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8b000d4-0711-4d8f-b490-3f6d5e5bdbda tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68/action" status: 202 len: 0 microversion: 2.1 time: 2.239078 Jul 14 14:36:17.472079 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1181/2360] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:36:15 2022] POST /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68/action => generated 0 bytes in 2240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:17.478796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a1b7f2f3-6c23-451a-9c9c-c8a08f81b75a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:17.479438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a1b7f2f3-6c23-451a-9c9c-c8a08f81b75a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:17.490763 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c6d46676-bade-4afe-bf0e-09df8813fc74 req-de633d75-21d9-482b-a193-330636c2e283 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153261 Jul 14 14:36:17.491684 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1180/2361] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:17.498691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-95bfcdaf-8e51-4bd1-b001-1cf60c5143d0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:17.511194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1b7f2f3-6c23-451a-9c9c-c8a08f81b75a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:17.519854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1b7f2f3-6c23-451a-9c9c-c8a08f81b75a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:17.521019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1b7f2f3-6c23-451a-9c9c-c8a08f81b75a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:17.522821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-95bfcdaf-8e51-4bd1-b001-1cf60c5143d0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:17.523476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1b7f2f3-6c23-451a-9c9c-c8a08f81b75a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:17.554024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95bfcdaf-8e51-4bd1-b001-1cf60c5143d0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:17.566653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95bfcdaf-8e51-4bd1-b001-1cf60c5143d0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:17.569045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95bfcdaf-8e51-4bd1-b001-1cf60c5143d0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:17.572547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95bfcdaf-8e51-4bd1-b001-1cf60c5143d0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:18.027417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-95bfcdaf-8e51-4bd1-b001-1cf60c5143d0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:18.055411 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-95bfcdaf-8e51-4bd1-b001-1cf60c5143d0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1209 microversion: 2.1 time: 0.561321 Jul 14 14:36:18.082296 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1181/2362] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:17 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1209 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:18.097341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-51bafb05-1451-4d04-aa75-70cdbbc9019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:18.098992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-51bafb05-1451-4d04-aa75-70cdbbc9019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:18.118327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51bafb05-1451-4d04-aa75-70cdbbc9019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:18.120362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51bafb05-1451-4d04-aa75-70cdbbc9019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:18.124326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51bafb05-1451-4d04-aa75-70cdbbc9019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:18.125099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51bafb05-1451-4d04-aa75-70cdbbc9019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:18.205067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a1b7f2f3-6c23-451a-9c9c-c8a08f81b75a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:18.224508 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a1b7f2f3-6c23-451a-9c9c-c8a08f81b75a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1324 microversion: 2.1 time: 0.749331 Jul 14 14:36:18.227653 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1182/2363] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:17 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1324 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:18.248747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7bf5d3b8-e427-46b6-bde3-c8c1db3717fa tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:18.253486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7bf5d3b8-e427-46b6-bde3-c8c1db3717fa tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:18.272262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7bf5d3b8-e427-46b6-bde3-c8c1db3717fa tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:18.273944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7bf5d3b8-e427-46b6-bde3-c8c1db3717fa tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:18.277556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7bf5d3b8-e427-46b6-bde3-c8c1db3717fa tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:18.279626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7bf5d3b8-e427-46b6-bde3-c8c1db3717fa tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:18.472853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7bf5d3b8-e427-46b6-bde3-c8c1db3717fa tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:18.490466 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7bf5d3b8-e427-46b6-bde3-c8c1db3717fa tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1276 microversion: 2.1 time: 0.258084 Jul 14 14:36:18.498683 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1183/2364] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:18 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:18.504669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1f65d980-c4a8-4dc6-88a9-b07d0f176529 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:18.505665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f65d980-c4a8-4dc6-88a9-b07d0f176529 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:18.513133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f65d980-c4a8-4dc6-88a9-b07d0f176529 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:18.513556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f65d980-c4a8-4dc6-88a9-b07d0f176529 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:18.514401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f65d980-c4a8-4dc6-88a9-b07d0f176529 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:18.515013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f65d980-c4a8-4dc6-88a9-b07d0f176529 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:18.808242 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-51bafb05-1451-4d04-aa75-70cdbbc9019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.723096 Jul 14 14:36:18.811445 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1182/2365] 10.222.0.81 () {58 vars in 1292 bytes} [Thu Jul 14 14:36:18 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68/os-security-groups => generated 1157 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:18.823330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-85848298-0b7e-40f9-b47f-ac9951c7ff61 req-e20f46b4-df46-4f70-bad3-f299fdab38d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68", "tag": "a463658a-4486-4768-9db2-ddb8cc33d3aa"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:18.838094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-85848298-0b7e-40f9-b47f-ac9951c7ff61 req-e20f46b4-df46-4f70-bad3-f299fdab38d1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:18.838951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-85848298-0b7e-40f9-b47f-ac9951c7ff61 req-e20f46b4-df46-4f70-bad3-f299fdab38d1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:18.871023 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-85848298-0b7e-40f9-b47f-ac9951c7ff61 req-e20f46b4-df46-4f70-bad3-f299fdab38d1 service nova] Creating event network-changed:a463658a-4486-4768-9db2-ddb8cc33d3aa for instance e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 on n-h2-767704-28 Jul 14 14:36:18.880263 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-85848298-0b7e-40f9-b47f-ac9951c7ff61 req-e20f46b4-df46-4f70-bad3-f299fdab38d1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066706 Jul 14 14:36:18.882029 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1183/2366] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:18.890235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be7e7a4c-49a1-4a8c-9cd3-27c7aa0b590b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'create', calling method: .version_select at 0x7fd6c56ff310>, body: {"security_group": {"name": " tempest-securitygroup -14876852 ", "description": "tempest-description-1877771359"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:18.949091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f65d980-c4a8-4dc6-88a9-b07d0f176529 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:18.968487 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1f65d980-c4a8-4dc6-88a9-b07d0f176529 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.460159 Jul 14 14:36:18.968487 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1184/2367] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:18 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:19.074998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e6fe13e2-84f7-4e76-96a9-502292634529 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:19.076839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e6fe13e2-84f7-4e76-96a9-502292634529 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:19.089280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6fe13e2-84f7-4e76-96a9-502292634529 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.089631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6fe13e2-84f7-4e76-96a9-502292634529 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.090437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6fe13e2-84f7-4e76-96a9-502292634529 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.094953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6fe13e2-84f7-4e76-96a9-502292634529 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.456900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e6fe13e2-84f7-4e76-96a9-502292634529 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:19.468353 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e6fe13e2-84f7-4e76-96a9-502292634529 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1271 microversion: 2.1 time: 0.398020 Jul 14 14:36:19.470366 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1185/2368] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:19 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1271 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:19.476055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65fbf989-99aa-4c8e-8522-13416b68c157 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:19.490393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-65fbf989-99aa-4c8e-8522-13416b68c157 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:19.518531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65fbf989-99aa-4c8e-8522-13416b68c157 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.520182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65fbf989-99aa-4c8e-8522-13416b68c157 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.521880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65fbf989-99aa-4c8e-8522-13416b68c157 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.523962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65fbf989-99aa-4c8e-8522-13416b68c157 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.763819 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-be7e7a4c-49a1-4a8c-9cd3-27c7aa0b590b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.879545 Jul 14 14:36:19.764780 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1184/2369] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:36:18 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:19.773348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-851cbf9a-8fa8-4d88-9fc1-9ef4c4dd0fec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:19.775295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-851cbf9a-8fa8-4d88-9fc1-9ef4c4dd0fec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:19.808513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-851cbf9a-8fa8-4d88-9fc1-9ef4c4dd0fec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.809149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-851cbf9a-8fa8-4d88-9fc1-9ef4c4dd0fec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.814077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-851cbf9a-8fa8-4d88-9fc1-9ef4c4dd0fec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.815193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-851cbf9a-8fa8-4d88-9fc1-9ef4c4dd0fec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:20.281949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-851cbf9a-8fa8-4d88-9fc1-9ef4c4dd0fec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:20.289684 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-851cbf9a-8fa8-4d88-9fc1-9ef4c4dd0fec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1276 microversion: 2.1 time: 0.523544 Jul 14 14:36:20.290268 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1185/2370] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:19 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1276 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:20.303289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dd46909e-8a61-4b69-ad46-1e9cab94d58d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c5b498b0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:20.501354 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dd46909e-8a61-4b69-ad46-1e9cab94d58d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/873f437d-966b-4d47-9b35-637e03723ebf" status: 200 len: 222 microversion: 2.1 time: 0.209867 Jul 14 14:36:20.501851 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1186/2371] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:36:20 2022] GET /compute/v2.1/os-security-groups/873f437d-966b-4d47-9b35-637e03723ebf => generated 222 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:20.513334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f9fc4aed-9da0-494e-b528-cf871e39d29b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:20.514447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f9fc4aed-9da0-494e-b528-cf871e39d29b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:20.538269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9fc4aed-9da0-494e-b528-cf871e39d29b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:20.538725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9fc4aed-9da0-494e-b528-cf871e39d29b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:20.539906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-65fbf989-99aa-4c8e-8522-13416b68c157 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:20.542548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9fc4aed-9da0-494e-b528-cf871e39d29b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:20.543320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9fc4aed-9da0-494e-b528-cf871e39d29b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:20.554023 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65fbf989-99aa-4c8e-8522-13416b68c157 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1324 microversion: 2.1 time: 1.079056 Jul 14 14:36:20.555588 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1186/2372] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:19 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1324 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:20.574498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-99b93f00-da30-4246-8bb5-cd451d6072ac req-e71e7cf5-dc82-449a-b0d8-b2285b923a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83dae6b9-f87b-4ee4-ab0d-3706cd2602a2", "tag": "9462ad9c-5eb2-40e6-922b-2e480cd3ce7b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:20.587519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-99b93f00-da30-4246-8bb5-cd451d6072ac req-e71e7cf5-dc82-449a-b0d8-b2285b923a92 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:20.587977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-99b93f00-da30-4246-8bb5-cd451d6072ac req-e71e7cf5-dc82-449a-b0d8-b2285b923a92 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:20.616489 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-99b93f00-da30-4246-8bb5-cd451d6072ac req-e71e7cf5-dc82-449a-b0d8-b2285b923a92 service nova] Creating event network-changed:9462ad9c-5eb2-40e6-922b-2e480cd3ce7b for instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 on n-h1-767704-28 Jul 14 14:36:20.623499 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-99b93f00-da30-4246-8bb5-cd451d6072ac req-e71e7cf5-dc82-449a-b0d8-b2285b923a92 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054090 Jul 14 14:36:20.624229 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1187/2373] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:20.631374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7a1304fb-62ab-4a78-8cf8-ef962ee4bb45 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:20.632424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7a1304fb-62ab-4a78-8cf8-ef962ee4bb45 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:20.641064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a1304fb-62ab-4a78-8cf8-ef962ee4bb45 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:20.641959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a1304fb-62ab-4a78-8cf8-ef962ee4bb45 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:20.643377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a1304fb-62ab-4a78-8cf8-ef962ee4bb45 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:20.644018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a1304fb-62ab-4a78-8cf8-ef962ee4bb45 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:20.912373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7a1304fb-62ab-4a78-8cf8-ef962ee4bb45 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:20.923962 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7a1304fb-62ab-4a78-8cf8-ef962ee4bb45 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1271 microversion: 2.1 time: 0.298273 Jul 14 14:36:20.927854 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1188/2374] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:20 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1271 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:20.937643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-256bf2bc-6674-4590-b3ba-8dcd06044867 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c5eb8f70>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:21.133935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f9fc4aed-9da0-494e-b528-cf871e39d29b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:21.178131 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f9fc4aed-9da0-494e-b528-cf871e39d29b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.665888 Jul 14 14:36:21.179236 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1187/2375] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:20 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:21.312020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9dd71aff-6dde-454b-84f8-36edc3427d6a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:21.313392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9dd71aff-6dde-454b-84f8-36edc3427d6a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:21.328567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9dd71aff-6dde-454b-84f8-36edc3427d6a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:21.329248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9dd71aff-6dde-454b-84f8-36edc3427d6a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:21.331348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9dd71aff-6dde-454b-84f8-36edc3427d6a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:21.331865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9dd71aff-6dde-454b-84f8-36edc3427d6a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:21.770351 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-256bf2bc-6674-4590-b3ba-8dcd06044867 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/873f437d-966b-4d47-9b35-637e03723ebf" status: 202 len: 0 microversion: 2.1 time: 0.839648 Jul 14 14:36:21.770937 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1189/2376] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:36:20 2022] DELETE /compute/v2.1/os-security-groups/873f437d-966b-4d47-9b35-637e03723ebf => generated 0 bytes in 842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:21.782000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-efbb8789-67d5-4a89-9c0f-2e345a576c0a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:21.782743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-efbb8789-67d5-4a89-9c0f-2e345a576c0a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:21.791548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efbb8789-67d5-4a89-9c0f-2e345a576c0a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:21.792121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efbb8789-67d5-4a89-9c0f-2e345a576c0a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:21.793027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efbb8789-67d5-4a89-9c0f-2e345a576c0a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:21.793543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efbb8789-67d5-4a89-9c0f-2e345a576c0a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:21.871903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9dd71aff-6dde-454b-84f8-36edc3427d6a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:21.883353 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9dd71aff-6dde-454b-84f8-36edc3427d6a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1318 microversion: 2.1 time: 0.579981 Jul 14 14:36:21.885456 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1188/2377] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:21 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:21.892160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d3f25e2-9ab2-4b94-a3a3-21ca34d704af tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c56e2820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:21.997871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-7d3f25e2-9ab2-4b94-a3a3-21ca34d704af tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:36:21.998721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.security_group_api [None req-7d3f25e2-9ab2-4b94-a3a3-21ca34d704af tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Neutron security group 873f437d-966b-4d47-9b35-637e03723ebf not found {{(pid=119511) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:36:21.999344 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-7d3f25e2-9ab2-4b94-a3a3-21ca34d704af tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:36:21.999344 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-c9fd649a-acc9-4176-8b8c-37934c34e990'] Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d3f25e2-9ab2-4b94-a3a3-21ca34d704af tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-security-groups/873f437d-966b-4d47-9b35-637e03723ebf HTTP/1.1 Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: exception: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-c9fd649a-acc9-4176-8b8c-37934c34e990'] Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '873f437d-966b-4d47-9b35-637e03723ebf'} Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:36:22.001702 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9fd649a-acc9-4176-8b8c-37934c34e990'] Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9fd649a-acc9-4176-8b8c-37934c34e990'] Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9fd649a-acc9-4176-8b8c-37934c34e990'] Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9fd649a-acc9-4176-8b8c-37934c34e990'] Jul 14 14:36:22.005392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:22.011154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d3f25e2-9ab2-4b94-a3a3-21ca34d704af tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:36:22.011154 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-c9fd649a-acc9-4176-8b8c-37934c34e990'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:22.012488 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d3f25e2-9ab2-4b94-a3a3-21ca34d704af tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/873f437d-966b-4d47-9b35-637e03723ebf" status: 404 len: 194 microversion: 2.1 time: 0.125828 Jul 14 14:36:22.014457 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1189/2378] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:36:21 2022] GET /compute/v2.1/os-security-groups/873f437d-966b-4d47-9b35-637e03723ebf => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:22.023327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-377bafd1-5c7e-460d-924c-c24ee2caacac tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:22.024093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-377bafd1-5c7e-460d-924c-c24ee2caacac tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:22.034140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-377bafd1-5c7e-460d-924c-c24ee2caacac tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:22.034956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-377bafd1-5c7e-460d-924c-c24ee2caacac tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:22.036237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-377bafd1-5c7e-460d-924c-c24ee2caacac tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:22.037421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-377bafd1-5c7e-460d-924c-c24ee2caacac tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:22.057964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:22.212769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-efbb8789-67d5-4a89-9c0f-2e345a576c0a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:22.225154 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-efbb8789-67d5-4a89-9c0f-2e345a576c0a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1522 microversion: 2.1 time: 0.448856 Jul 14 14:36:22.225750 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1190/2379] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:21 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:22.230310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-49f1ee85-3862-41b3-a232-8587f8e5bc8d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'create', calling method: .version_select at 0x7fd6c5734ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-594198163", "description": "tempest-description-421758814"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:22.543718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-377bafd1-5c7e-460d-924c-c24ee2caacac tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:22.556652 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-377bafd1-5c7e-460d-924c-c24ee2caacac tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1313 microversion: 2.1 time: 0.540884 Jul 14 14:36:22.557547 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1190/2380] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:22 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:22.571675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-10c7f97a-de6e-49d5-80a3-c6cd1c4620d0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:22.572550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-10c7f97a-de6e-49d5-80a3-c6cd1c4620d0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:22.585494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10c7f97a-de6e-49d5-80a3-c6cd1c4620d0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:22.586242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10c7f97a-de6e-49d5-80a3-c6cd1c4620d0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:22.587205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10c7f97a-de6e-49d5-80a3-c6cd1c4620d0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:22.587802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10c7f97a-de6e-49d5-80a3-c6cd1c4620d0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:22.976802 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-49f1ee85-3862-41b3-a232-8587f8e5bc8d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.748967 Jul 14 14:36:22.978916 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1191/2381] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:36:22 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:22.996039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af0072b2-8802-4f57-8723-d9506cf2a8d6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:22.998874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-af0072b2-8802-4f57-8723-d9506cf2a8d6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:23.025171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af0072b2-8802-4f57-8723-d9506cf2a8d6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:23.026599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af0072b2-8802-4f57-8723-d9506cf2a8d6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:23.029299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af0072b2-8802-4f57-8723-d9506cf2a8d6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:23.030064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af0072b2-8802-4f57-8723-d9506cf2a8d6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:23.084925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-af0072b2-8802-4f57-8723-d9506cf2a8d6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:36:23.164799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-10c7f97a-de6e-49d5-80a3-c6cd1c4620d0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:23.182466 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-10c7f97a-de6e-49d5-80a3-c6cd1c4620d0 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.614765 Jul 14 14:36:23.186224 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1191/2382] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:22 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:23.200209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-432d0c03-a513-448f-aa3f-f759ec281268 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:23.201166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-432d0c03-a513-448f-aa3f-f759ec281268 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:23.222946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=10,nova_api:UPDATE=5 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:23.229459 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af0072b2-8802-4f57-8723-d9506cf2a8d6 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 204 len: 0 microversion: 2.1 time: 0.247933 Jul 14 14:36:23.230688 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1192/2383] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:36:22 2022] DELETE /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:36:23.235605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-432d0c03-a513-448f-aa3f-f759ec281268 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:23.236119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-432d0c03-a513-448f-aa3f-f759ec281268 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:23.239581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-900904dd-44ff-4e41-9bd7-674bc45573f0 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'create', calling method: .version_select at 0x7fd6c573c0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-698610998", "description": "tempest-description-1657260294"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:23.241976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-432d0c03-a513-448f-aa3f-f759ec281268 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:23.242452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-432d0c03-a513-448f-aa3f-f759ec281268 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:23.994687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-432d0c03-a513-448f-aa3f-f759ec281268 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:24.005536 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-432d0c03-a513-448f-aa3f-f759ec281268 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1318 microversion: 2.1 time: 0.818036 Jul 14 14:36:24.006397 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1192/2384] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:23 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1318 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:24.012321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c8661090-f562-4871-b5b5-c17af6b3670a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:24.014464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c8661090-f562-4871-b5b5-c17af6b3670a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:24.022639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8661090-f562-4871-b5b5-c17af6b3670a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:24.023105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8661090-f562-4871-b5b5-c17af6b3670a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:24.023888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8661090-f562-4871-b5b5-c17af6b3670a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:24.024706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8661090-f562-4871-b5b5-c17af6b3670a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:24.368567 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-900904dd-44ff-4e41-9bd7-674bc45573f0 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.135636 Jul 14 14:36:24.376427 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1193/2385] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:36:23 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:24.381345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1ca6c11c-e3ab-437a-acad-2e1d0c875428 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:24.382088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1ca6c11c-e3ab-437a-acad-2e1d0c875428 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:24.397522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ca6c11c-e3ab-437a-acad-2e1d0c875428 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:24.397977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ca6c11c-e3ab-437a-acad-2e1d0c875428 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:24.398765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ca6c11c-e3ab-437a-acad-2e1d0c875428 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:24.399198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ca6c11c-e3ab-437a-acad-2e1d0c875428 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:24.651684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c8661090-f562-4871-b5b5-c17af6b3670a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:24.668396 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c8661090-f562-4871-b5b5-c17af6b3670a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1528 microversion: 2.1 time: 0.660651 Jul 14 14:36:24.670871 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1193/2386] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:24 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1528 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:24.677954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5ef5091f-897e-4844-ba0e-7ad2ce86a2ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:24.678972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5ef5091f-897e-4844-ba0e-7ad2ce86a2ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:24.686413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ef5091f-897e-4844-ba0e-7ad2ce86a2ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:24.687061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ef5091f-897e-4844-ba0e-7ad2ce86a2ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:24.689128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ef5091f-897e-4844-ba0e-7ad2ce86a2ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:24.689732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ef5091f-897e-4844-ba0e-7ad2ce86a2ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:25.100350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=10 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:25.143420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1ca6c11c-e3ab-437a-acad-2e1d0c875428 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:25.146136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=72 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:25.163046 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1ca6c11c-e3ab-437a-acad-2e1d0c875428 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1313 microversion: 2.1 time: 0.785352 Jul 14 14:36:25.167603 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1194/2387] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:24 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1313 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:25.186230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9e1b8dfd-cc5b-43cd-b81d-48c5b3ea52f5 req-82b62c61-5cf4-458f-aae2-7498202cabab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ebe371-1ebb-4849-a18f-4b3e40035dfb", "tag": "929f1d52-94d9-463b-b94c-fe77458a9e1a"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:25.213788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9e1b8dfd-cc5b-43cd-b81d-48c5b3ea52f5 req-82b62c61-5cf4-458f-aae2-7498202cabab service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:25.214296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9e1b8dfd-cc5b-43cd-b81d-48c5b3ea52f5 req-82b62c61-5cf4-458f-aae2-7498202cabab service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:25.236225 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9e1b8dfd-cc5b-43cd-b81d-48c5b3ea52f5 req-82b62c61-5cf4-458f-aae2-7498202cabab service nova] Creating event network-changed:929f1d52-94d9-463b-b94c-fe77458a9e1a for instance 13ebe371-1ebb-4849-a18f-4b3e40035dfb on n-h1-767704-28 Jul 14 14:36:25.250333 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9e1b8dfd-cc5b-43cd-b81d-48c5b3ea52f5 req-82b62c61-5cf4-458f-aae2-7498202cabab service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079745 Jul 14 14:36:25.251619 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1195/2388] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:25.258333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c843677e-5ac8-4ece-9a57-c26812d86724 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'create', calling method: .version_select at 0x7fd6c67d1dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-882051025", "description": "tempest-description-1526520703"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:25.341669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5ef5091f-897e-4844-ba0e-7ad2ce86a2ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:25.358704 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5ef5091f-897e-4844-ba0e-7ad2ce86a2ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.685770 Jul 14 14:36:25.359975 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1194/2389] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:24 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:25.369935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cdd84691-72f4-4d36-b735-047cca7f079c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:25.374622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cdd84691-72f4-4d36-b735-047cca7f079c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:25.387188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cdd84691-72f4-4d36-b735-047cca7f079c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:25.391066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cdd84691-72f4-4d36-b735-047cca7f079c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:25.392161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cdd84691-72f4-4d36-b735-047cca7f079c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:25.395353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cdd84691-72f4-4d36-b735-047cca7f079c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:26.108599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=19 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:26.157457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=82 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:26.389053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cdd84691-72f4-4d36-b735-047cca7f079c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:26.399454 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cdd84691-72f4-4d36-b735-047cca7f079c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1318 microversion: 2.1 time: 1.038239 Jul 14 14:36:26.400711 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1195/2390] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:25 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1318 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:26.407181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bd46d37e-458b-4b90-bdbe-5b259f5756c2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:26.408636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bd46d37e-458b-4b90-bdbe-5b259f5756c2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:26.416215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd46d37e-458b-4b90-bdbe-5b259f5756c2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:26.417015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd46d37e-458b-4b90-bdbe-5b259f5756c2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:26.418231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd46d37e-458b-4b90-bdbe-5b259f5756c2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:26.418945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd46d37e-458b-4b90-bdbe-5b259f5756c2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:26.464435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd46d37e-458b-4b90-bdbe-5b259f5756c2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:26.465546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd46d37e-458b-4b90-bdbe-5b259f5756c2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:26.466586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-bd46d37e-458b-4b90-bdbe-5b259f5756c2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lazy-loading 'fault' on Instance uuid 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:36:26.667338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bd46d37e-458b-4b90-bdbe-5b259f5756c2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '935bde481e9c41a1951bcdab5af71211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9c7d3620e34c95bb8a772e532fc660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:26.693273 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bd46d37e-458b-4b90-bdbe-5b259f5756c2 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 200 len: 1314 microversion: 2.1 time: 0.290964 Jul 14 14:36:26.697306 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1196/2391] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:26 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:26.713100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-2e0679b0-da30-48bd-9b41-da4d7260dddf req-e77df761-4ee8-427c-aacd-570d5c0f824a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe27ada-2ed3-48c1-a28f-94584e1a2fb9", "name": "network-vif-deleted", "tag": "08fc5bf4-4f28-414b-9c19-eeba9861d7b6"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:26.738158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2e0679b0-da30-48bd-9b41-da4d7260dddf req-e77df761-4ee8-427c-aacd-570d5c0f824a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:26.738618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2e0679b0-da30-48bd-9b41-da4d7260dddf req-e77df761-4ee8-427c-aacd-570d5c0f824a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:26.770488 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-2e0679b0-da30-48bd-9b41-da4d7260dddf req-e77df761-4ee8-427c-aacd-570d5c0f824a service nova] Creating event network-vif-deleted:08fc5bf4-4f28-414b-9c19-eeba9861d7b6 for instance 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 on n-h2-767704-28 Jul 14 14:36:26.782793 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-2e0679b0-da30-48bd-9b41-da4d7260dddf req-e77df761-4ee8-427c-aacd-570d5c0f824a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082456 Jul 14 14:36:26.785292 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1197/2392] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:26.802117 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c843677e-5ac8-4ece-9a57-c26812d86724 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.548497 Jul 14 14:36:26.803997 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1196/2393] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:36:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:26.810336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e4210b8c-6049-4e35-afbc-578a9e6b765e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:26.812019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e5314f8-f61c-4da5-bf5c-380e61c2a80e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:26.816596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e4210b8c-6049-4e35-afbc-578a9e6b765e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:26.820926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4e5314f8-f61c-4da5-bf5c-380e61c2a80e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:26.839625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e5314f8-f61c-4da5-bf5c-380e61c2a80e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:26.840086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e5314f8-f61c-4da5-bf5c-380e61c2a80e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:26.843685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4210b8c-6049-4e35-afbc-578a9e6b765e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:26.844151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4210b8c-6049-4e35-afbc-578a9e6b765e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:26.850272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4210b8c-6049-4e35-afbc-578a9e6b765e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:26.850789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4210b8c-6049-4e35-afbc-578a9e6b765e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:26.854046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e5314f8-f61c-4da5-bf5c-380e61c2a80e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:26.854622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e5314f8-f61c-4da5-bf5c-380e61c2a80e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:27.373121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4e5314f8-f61c-4da5-bf5c-380e61c2a80e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:27.393974 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e5314f8-f61c-4da5-bf5c-380e61c2a80e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1313 microversion: 2.1 time: 0.593030 Jul 14 14:36:27.404976 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1198/2394] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:26 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:27.410220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e04a9498-a36c-429a-b55e-8ee4a9478e53 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c5b03040>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:27.425687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e4210b8c-6049-4e35-afbc-578a9e6b765e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:27.438169 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e4210b8c-6049-4e35-afbc-578a9e6b765e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.632912 Jul 14 14:36:27.449333 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1197/2395] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:26 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:27.457104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-150555f5-d356-4d30-a741-90b5e7a8f401 req-c15816c5-d459-4ced-ab8d-dabb8d62bef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83dae6b9-f87b-4ee4-ab0d-3706cd2602a2", "name": "network-vif-plugged", "status": "completed", "tag": "9462ad9c-5eb2-40e6-922b-2e480cd3ce7b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:27.469213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-150555f5-d356-4d30-a741-90b5e7a8f401 req-c15816c5-d459-4ced-ab8d-dabb8d62bef7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:27.469986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-150555f5-d356-4d30-a741-90b5e7a8f401 req-c15816c5-d459-4ced-ab8d-dabb8d62bef7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:27.494040 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-150555f5-d356-4d30-a741-90b5e7a8f401 req-c15816c5-d459-4ced-ab8d-dabb8d62bef7 service nova] Creating event network-vif-plugged:9462ad9c-5eb2-40e6-922b-2e480cd3ce7b for instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 on n-h1-767704-28 Jul 14 14:36:27.500409 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-150555f5-d356-4d30-a741-90b5e7a8f401 req-c15816c5-d459-4ced-ab8d-dabb8d62bef7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051760 Jul 14 14:36:27.501180 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1198/2396] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:27.506746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-66bf501b-90ee-44e8-868b-d5c8f3bb9944 req-a25786cd-5281-4352-ad07-c9a1c24035da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "421b3e7a-56b8-4241-a496-2a091a9686f3", "tag": "40cb08bf-70f2-461c-9c75-c450c62e8c00"}, {"name": "network-changed", "server_uuid": "d4beb02f-8f03-4186-8e65-0f132e384e4c", "tag": "85dc8019-423e-431f-a854-ebcdc42a891a"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:27.523117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-66bf501b-90ee-44e8-868b-d5c8f3bb9944 req-a25786cd-5281-4352-ad07-c9a1c24035da service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:27.523670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-66bf501b-90ee-44e8-868b-d5c8f3bb9944 req-a25786cd-5281-4352-ad07-c9a1c24035da service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:27.541384 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-66bf501b-90ee-44e8-868b-d5c8f3bb9944 req-a25786cd-5281-4352-ad07-c9a1c24035da service nova] Creating event network-changed:40cb08bf-70f2-461c-9c75-c450c62e8c00 for instance 421b3e7a-56b8-4241-a496-2a091a9686f3 on n-h2-767704-28 Jul 14 14:36:27.542049 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-66bf501b-90ee-44e8-868b-d5c8f3bb9944 req-a25786cd-5281-4352-ad07-c9a1c24035da service nova] Creating event network-changed:85dc8019-423e-431f-a854-ebcdc42a891a for instance d4beb02f-8f03-4186-8e65-0f132e384e4c on n-h2-767704-28 Jul 14 14:36:27.550590 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-66bf501b-90ee-44e8-868b-d5c8f3bb9944 req-a25786cd-5281-4352-ad07-c9a1c24035da service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047920 Jul 14 14:36:27.551637 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1199/2397] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:27.557901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-33dd14ca-f5e3-4136-bf83-b851cf2b6a00 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:27.560294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-33dd14ca-f5e3-4136-bf83-b851cf2b6a00 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:27.579138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33dd14ca-f5e3-4136-bf83-b851cf2b6a00 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:27.580119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33dd14ca-f5e3-4136-bf83-b851cf2b6a00 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:27.581303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33dd14ca-f5e3-4136-bf83-b851cf2b6a00 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:27.582042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33dd14ca-f5e3-4136-bf83-b851cf2b6a00 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:27.826760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-33dd14ca-f5e3-4136-bf83-b851cf2b6a00 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:27.831528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:27.838422 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-33dd14ca-f5e3-4136-bf83-b851cf2b6a00 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1318 microversion: 2.1 time: 0.285245 Jul 14 14:36:27.840581 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1200/2398] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:27 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:27.848414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ef8cdde-822f-4b69-9db6-4f94b777c055 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:27.854278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6ef8cdde-822f-4b69-9db6-4f94b777c055 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:27.872860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ef8cdde-822f-4b69-9db6-4f94b777c055 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:27.874269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ef8cdde-822f-4b69-9db6-4f94b777c055 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:27.876120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ef8cdde-822f-4b69-9db6-4f94b777c055 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:27.876666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ef8cdde-822f-4b69-9db6-4f94b777c055 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:27.929513 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-6ef8cdde-822f-4b69-9db6-4f94b777c055 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] HTTP exception thrown: Instance 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 could not be found. Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ef8cdde-822f-4b69-9db6-4f94b777c055 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 HTTP/1.1 Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 could not be found. Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '0fe27ada-2ed3-48c1-a28f-94584e1a2fb9'} Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 could not be found. Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 could not be found. Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:27.932557 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:27.937036 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:27.937036 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:27.937036 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:27.937036 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:27.937036 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:27.937036 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:27.937036 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 could not be found. Jul 14 14:36:27.937036 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:27.937036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ef8cdde-822f-4b69-9db6-4f94b777c055 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 404 to user: Instance 0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:27.937036 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6ef8cdde-822f-4b69-9db6-4f94b777c055 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9" status: 404 len: 111 microversion: 2.1 time: 0.092896 Jul 14 14:36:27.937036 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1201/2399] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:27 2022] GET /compute/v2.1/servers/0fe27ada-2ed3-48c1-a28f-94584e1a2fb9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:27.972132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b1beff4-c45f-48fa-b212-8acfbf9db44a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '.version_select at 0x7fd6c5b43430>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:27.984206 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e04a9498-a36c-429a-b55e-8ee4a9478e53 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.577559 Jul 14 14:36:27.985688 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1199/2400] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:36:27 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:28.003437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-32fb7965-7705-4bec-bb2f-9e9a6c2b10d0 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c567fdc0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:28.029761 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-5b1beff4-c45f-48fa-b212-8acfbf9db44a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] HTTP exception thrown: Image not found. Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b1beff4-c45f-48fa-b212-8acfbf9db44a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/images/e2a2233b-79ab-4a75-9790-1953468ce618 HTTP/1.1 Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: exception: Image not found. Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'e2a2233b-79ab-4a75-9790-1953468ce618'} Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e2a2233b-79ab-4a75-9790-1953468ce618 to delete Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e2a2233b-79ab-4a75-9790-1953468ce618 could not be found. Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:28.034040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.039154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b1beff4-c45f-48fa-b212-8acfbf9db44a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 404 to user: Image not found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:28.041601 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b1beff4-c45f-48fa-b212-8acfbf9db44a tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "DELETE /compute/v2.1/images/e2a2233b-79ab-4a75-9790-1953468ce618" status: 404 len: 62 microversion: 2.1 time: 0.088051 Jul 14 14:36:28.042292 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1202/2401] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:27 2022] DELETE /compute/v2.1/images/e2a2233b-79ab-4a75-9790-1953468ce618 => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:36:28.059008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8f19482b-ab15-479f-8a1c-7b848a15f388 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:28.059715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8f19482b-ab15-479f-8a1c-7b848a15f388 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:28.073523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f19482b-ab15-479f-8a1c-7b848a15f388 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.074007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f19482b-ab15-479f-8a1c-7b848a15f388 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.075390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f19482b-ab15-479f-8a1c-7b848a15f388 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.082545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f19482b-ab15-479f-8a1c-7b848a15f388 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.105667 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-8f19482b-ab15-479f-8a1c-7b848a15f388 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] HTTP exception thrown: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8f19482b-ab15-479f-8a1c-7b848a15f388 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad HTTP/1.1 Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad'} Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:28.117270 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8f19482b-ab15-479f-8a1c-7b848a15f388 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 404 to user: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:28.121746 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8f19482b-ab15-479f-8a1c-7b848a15f388 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 404 len: 111 microversion: 2.1 time: 0.071605 Jul 14 14:36:28.123013 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1203/2402] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:36:28 2022] DELETE /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:36:28.127741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-563831bc-a1a7-4d92-8da9-51b9399ac14c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:28.128373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-563831bc-a1a7-4d92-8da9-51b9399ac14c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:28.149745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-563831bc-a1a7-4d92-8da9-51b9399ac14c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.150209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-563831bc-a1a7-4d92-8da9-51b9399ac14c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.151475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-563831bc-a1a7-4d92-8da9-51b9399ac14c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.151931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-563831bc-a1a7-4d92-8da9-51b9399ac14c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.172745 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-563831bc-a1a7-4d92-8da9-51b9399ac14c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] HTTP exception thrown: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-563831bc-a1a7-4d92-8da9-51b9399ac14c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad HTTP/1.1 Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad'} Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.174339 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:28.178774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.178774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.178774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:28.178774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:28.178774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:28.178774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:28.178774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. Jul 14 14:36:28.178774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.178774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-563831bc-a1a7-4d92-8da9-51b9399ac14c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 404 to user: Instance cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:28.178774 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-563831bc-a1a7-4d92-8da9-51b9399ac14c tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad" status: 404 len: 111 microversion: 2.1 time: 0.051983 Jul 14 14:36:28.180759 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1204/2403] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:28 2022] GET /compute/v2.1/servers/cd5677c1-cd7d-4a93-8dc0-908d8dfc86ad => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:28.194632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fc594e6e-f466-4584-8e01-b92aad40b296 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '.version_select at 0x7fd6c5749790>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:28.222661 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fc594e6e-f466-4584-8e01-b92aad40b296 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032438394" status: 202 len: 0 microversion: 2.1 time: 0.034351 Jul 14 14:36:28.242318 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1205/2404] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 14:36:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032438394 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:28.412037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6e8d8dd0-7336-4ccb-9f05-f7e2bcfd9dc9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:28.412670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6e8d8dd0-7336-4ccb-9f05-f7e2bcfd9dc9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:28.432433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e8d8dd0-7336-4ccb-9f05-f7e2bcfd9dc9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.432909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e8d8dd0-7336-4ccb-9f05-f7e2bcfd9dc9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.433747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e8d8dd0-7336-4ccb-9f05-f7e2bcfd9dc9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.434595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e8d8dd0-7336-4ccb-9f05-f7e2bcfd9dc9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.616511 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-32fb7965-7705-4bec-bb2f-9e9a6c2b10d0 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/fea49f58-2252-4cd2-a7bc-5bf0c7ef4313" status: 202 len: 0 microversion: 2.1 time: 0.618242 Jul 14 14:36:28.621236 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1200/2405] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:36:27 2022] DELETE /compute/v2.1/os-security-groups/fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:28.626732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5f11a507-fad4-4259-8cc5-3533fe7be0c8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:28.628178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5f11a507-fad4-4259-8cc5-3533fe7be0c8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:28.638379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f11a507-fad4-4259-8cc5-3533fe7be0c8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.639179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f11a507-fad4-4259-8cc5-3533fe7be0c8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.640337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f11a507-fad4-4259-8cc5-3533fe7be0c8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.640934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f11a507-fad4-4259-8cc5-3533fe7be0c8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.679452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6e8d8dd0-7336-4ccb-9f05-f7e2bcfd9dc9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:28.692820 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6e8d8dd0-7336-4ccb-9f05-f7e2bcfd9dc9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1313 microversion: 2.1 time: 0.283227 Jul 14 14:36:28.702061 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1206/2406] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:28 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:28.714242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6d362593-9ada-4c9e-a2d2-f9196d15e439 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c5f10940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:28.888687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG neutronclient.v2_0.client [None req-6d362593-9ada-4c9e-a2d2-f9196d15e439 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist", "detail": ""}} {{(pid=119512) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:36:28.891313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.security_group_api [None req-6d362593-9ada-4c9e-a2d2-f9196d15e439 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Neutron security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 not found {{(pid=119512) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:36:28.892852 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-6d362593-9ada-4c9e-a2d2-f9196d15e439 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:36:28.892852 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-87eaa36d-027d-4ae8-a639-c8ec7c4b5a10'] Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6d362593-9ada-4c9e-a2d2-f9196d15e439 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-security-groups/fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 HTTP/1.1 Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: exception: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-87eaa36d-027d-4ae8-a639-c8ec7c4b5a10'] Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'fea49f58-2252-4cd2-a7bc-5bf0c7ef4313'} Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:36:28.897196 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87eaa36d-027d-4ae8-a639-c8ec7c4b5a10'] Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87eaa36d-027d-4ae8-a639-c8ec7c4b5a10'] Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87eaa36d-027d-4ae8-a639-c8ec7c4b5a10'] Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87eaa36d-027d-4ae8-a639-c8ec7c4b5a10'] Jul 14 14:36:28.900836 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:28.908797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6d362593-9ada-4c9e-a2d2-f9196d15e439 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:36:28.908797 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-87eaa36d-027d-4ae8-a639-c8ec7c4b5a10'] {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:28.919233 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6d362593-9ada-4c9e-a2d2-f9196d15e439 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/fea49f58-2252-4cd2-a7bc-5bf0c7ef4313" status: 404 len: 194 microversion: 2.1 time: 0.207791 Jul 14 14:36:28.921263 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1207/2407] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:36:28 2022] GET /compute/v2.1/os-security-groups/fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 => generated 194 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:28.931843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2e090f10-aec5-4fc3-b5a0-04c777865b61 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:28.933337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2e090f10-aec5-4fc3-b5a0-04c777865b61 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:28.943786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e090f10-aec5-4fc3-b5a0-04c777865b61 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.944653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e090f10-aec5-4fc3-b5a0-04c777865b61 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.945831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e090f10-aec5-4fc3-b5a0-04c777865b61 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.946440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e090f10-aec5-4fc3-b5a0-04c777865b61 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:29.133255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5f11a507-fad4-4259-8cc5-3533fe7be0c8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:29.144869 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5f11a507-fad4-4259-8cc5-3533fe7be0c8 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.521691 Jul 14 14:36:29.145836 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1201/2408] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:28 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:29.164635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9970ccd4-f8f7-484b-a148-7af472108cb1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c5793af0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:29.338010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2e090f10-aec5-4fc3-b5a0-04c777865b61 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:29.347977 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2e090f10-aec5-4fc3-b5a0-04c777865b61 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1318 microversion: 2.1 time: 0.424316 Jul 14 14:36:29.351087 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1208/2409] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:28 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:29.358148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3fcf2d05-f23c-4eba-a02b-0dc420f5bdb7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '.version_select at 0x7fd6c5b43af0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:29.388003 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3fcf2d05-f23c-4eba-a02b-0dc420f5bdb7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] HTTP exception thrown: Image not found. Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3fcf2d05-f23c-4eba-a02b-0dc420f5bdb7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/images/83410113-e86d-4edb-8cee-1f0e53b67ad0 HTTP/1.1 Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: exception: Image not found. Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '83410113-e86d-4edb-8cee-1f0e53b67ad0'} Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 83410113-e86d-4edb-8cee-1f0e53b67ad0 to delete Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 83410113-e86d-4edb-8cee-1f0e53b67ad0 could not be found. Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:29.390241 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3fcf2d05-f23c-4eba-a02b-0dc420f5bdb7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 404 to user: Image not found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3fcf2d05-f23c-4eba-a02b-0dc420f5bdb7 tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "DELETE /compute/v2.1/images/83410113-e86d-4edb-8cee-1f0e53b67ad0" status: 404 len: 62 microversion: 2.1 time: 0.040211 Jul 14 14:36:29.394882 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1209/2410] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:29 2022] DELETE /compute/v2.1/images/83410113-e86d-4edb-8cee-1f0e53b67ad0 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:36:29.411345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0f04d696-d27f-467d-bdb5-e8318a446b8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:29.411878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0f04d696-d27f-467d-bdb5-e8318a446b8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:29.423423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f04d696-d27f-467d-bdb5-e8318a446b8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:29.423902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f04d696-d27f-467d-bdb5-e8318a446b8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:29.425031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f04d696-d27f-467d-bdb5-e8318a446b8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:29.425635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f04d696-d27f-467d-bdb5-e8318a446b8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:29.449679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-0f04d696-d27f-467d-bdb5-e8318a446b8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] HTTP exception thrown: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0f04d696-d27f-467d-bdb5-e8318a446b8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c HTTP/1.1 Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c'} Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:29.452493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0f04d696-d27f-467d-bdb5-e8318a446b8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 404 to user: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0f04d696-d27f-467d-bdb5-e8318a446b8e tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 404 len: 111 microversion: 2.1 time: 0.056235 Jul 14 14:36:29.456135 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1210/2411] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:36:29 2022] DELETE /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:29.463292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24b5be8d-556b-4ada-bf24-b79976649dbd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:29.463932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-24b5be8d-556b-4ada-bf24-b79976649dbd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] [instance: a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:29.486649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24b5be8d-556b-4ada-bf24-b79976649dbd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:29.487898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24b5be8d-556b-4ada-bf24-b79976649dbd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:29.488740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24b5be8d-556b-4ada-bf24-b79976649dbd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:29.489229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24b5be8d-556b-4ada-bf24-b79976649dbd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:29.489398 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9970ccd4-f8f7-484b-a148-7af472108cb1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/7d23a9a4-8620-49b6-9079-3cdc8bb93938" status: 202 len: 0 microversion: 2.1 time: 0.329080 Jul 14 14:36:29.490190 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1202/2412] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:36:29 2022] DELETE /compute/v2.1/os-security-groups/7d23a9a4-8620-49b6-9079-3cdc8bb93938 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:29.500777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45373c8c-1a83-41ba-bae6-16c62bd44ee9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c567f9d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:29.510326 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-24b5be8d-556b-4ada-bf24-b79976649dbd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] HTTP exception thrown: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24b5be8d-556b-4ada-bf24-b79976649dbd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Request method failure captured: Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c HTTP/1.1 Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Clyfgykug8ad29zQ9KG6XDfEIednjj_wnyt8MQtOiAvQ1nA7anytnSHM88ZvypCkeUhFeIo-hrztj2DFPYMmm_wKVEE-bewkNYx4xIiCeE82qm4dsTFHCroZFWgxexp6o9WVxUJZBzY9kQcomviTOJ7RNCN10Fln9EuI3ykhk_d4HU Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ad9c7d3620e34c95bb8a772e532fc660"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ad9c7d3620e34c95bb8a772e532fc660", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ad9c7d3620e34c95bb8a772e532fc660"}]}] Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ad9c7d3620e34c95bb8a772e532fc660 Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-55224725 Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 935bde481e9c41a1951bcdab5af71211 Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-55224725-project Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c'} Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.512073 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:29.517565 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.517565 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.517565 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:29.517565 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:29.517565 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:29.517565 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:29.517565 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. Jul 14 14:36:29.517565 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.517565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24b5be8d-556b-4ada-bf24-b79976649dbd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] Returning 404 to user: Instance a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:29.517565 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-24b5be8d-556b-4ada-bf24-b79976649dbd tempest-ImagesOneServerNegativeTestJSON-55224725 tempest-ImagesOneServerNegativeTestJSON-55224725-project] 10.222.0.81 "GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c" status: 404 len: 111 microversion: 2.1 time: 0.055629 Jul 14 14:36:29.517565 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1211/2413] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:29 2022] GET /compute/v2.1/servers/a29c6bcc-ae67-4aff-9b79-2900bc3e6a8c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:29.626137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-45373c8c-1a83-41ba-bae6-16c62bd44ee9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:36:29.627772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.security_group_api [None req-45373c8c-1a83-41ba-bae6-16c62bd44ee9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Neutron security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 not found {{(pid=119511) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:36:29.628613 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-45373c8c-1a83-41ba-bae6-16c62bd44ee9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:36:29.628613 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-cec26c71-a911-42c9-b599-a3e8ea2ba00b'] Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45373c8c-1a83-41ba-bae6-16c62bd44ee9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-security-groups/7d23a9a4-8620-49b6-9079-3cdc8bb93938 HTTP/1.1 Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: exception: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-cec26c71-a911-42c9-b599-a3e8ea2ba00b'] Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '7d23a9a4-8620-49b6-9079-3cdc8bb93938'} Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:36:29.631509 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cec26c71-a911-42c9-b599-a3e8ea2ba00b'] Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cec26c71-a911-42c9-b599-a3e8ea2ba00b'] Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cec26c71-a911-42c9-b599-a3e8ea2ba00b'] Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cec26c71-a911-42c9-b599-a3e8ea2ba00b'] Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45373c8c-1a83-41ba-bae6-16c62bd44ee9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-cec26c71-a911-42c9-b599-a3e8ea2ba00b'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-45373c8c-1a83-41ba-bae6-16c62bd44ee9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/7d23a9a4-8620-49b6-9079-3cdc8bb93938" status: 404 len: 194 microversion: 2.1 time: 0.139020 Jul 14 14:36:29.635947 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1203/2414] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:36:29 2022] GET /compute/v2.1/os-security-groups/7d23a9a4-8620-49b6-9079-3cdc8bb93938 => generated 194 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:29.643518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-41884873-f0bf-427f-a756-a66d6bbdfe97 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c5749940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:29.710808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a801e51c-500a-4e5b-9f12-b57759c3385b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:29.712443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a801e51c-500a-4e5b-9f12-b57759c3385b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:29.724418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a801e51c-500a-4e5b-9f12-b57759c3385b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:29.727729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a801e51c-500a-4e5b-9f12-b57759c3385b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:29.729876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a801e51c-500a-4e5b-9f12-b57759c3385b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:29.733095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a801e51c-500a-4e5b-9f12-b57759c3385b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:30.056273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a801e51c-500a-4e5b-9f12-b57759c3385b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:30.069914 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a801e51c-500a-4e5b-9f12-b57759c3385b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1313 microversion: 2.1 time: 0.363696 Jul 14 14:36:30.071090 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1204/2415] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:29 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:30.162819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-627c7446-0db7-420c-a6e4-fa1a2d83a4d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:30.163772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-627c7446-0db7-420c-a6e4-fa1a2d83a4d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:30.178190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-627c7446-0db7-420c-a6e4-fa1a2d83a4d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:30.178649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-627c7446-0db7-420c-a6e4-fa1a2d83a4d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:30.179449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-627c7446-0db7-420c-a6e4-fa1a2d83a4d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:30.179892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-627c7446-0db7-420c-a6e4-fa1a2d83a4d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:30.198457 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-41884873-f0bf-427f-a756-a66d6bbdfe97 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/79cfdd60-7506-4f5f-b5c8-6cd487eb5996" status: 202 len: 0 microversion: 2.1 time: 0.559294 Jul 14 14:36:30.199068 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1212/2416] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:36:29 2022] DELETE /compute/v2.1/os-security-groups/79cfdd60-7506-4f5f-b5c8-6cd487eb5996 => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:30.211936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eb31c5fc-eea1-4a94-87d9-65ad36ab9063 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c59b48b0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:30.392408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG neutronclient.v2_0.client [None req-eb31c5fc-eea1-4a94-87d9-65ad36ab9063 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist", "detail": ""}} {{(pid=119512) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:36:30.393113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.security_group_api [None req-eb31c5fc-eea1-4a94-87d9-65ad36ab9063 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Neutron security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 not found {{(pid=119512) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:36:30.393994 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-eb31c5fc-eea1-4a94-87d9-65ad36ab9063 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:36:30.393994 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-d7a379df-5655-45b3-9b04-d882f9074bca'] Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eb31c5fc-eea1-4a94-87d9-65ad36ab9063 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-security-groups/79cfdd60-7506-4f5f-b5c8-6cd487eb5996 HTTP/1.1 Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: exception: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-d7a379df-5655-45b3-9b04-d882f9074bca'] Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '79cfdd60-7506-4f5f-b5c8-6cd487eb5996'} Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:36:30.395747 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7a379df-5655-45b3-9b04-d882f9074bca'] Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7a379df-5655-45b3-9b04-d882f9074bca'] Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7a379df-5655-45b3-9b04-d882f9074bca'] Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7a379df-5655-45b3-9b04-d882f9074bca'] Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eb31c5fc-eea1-4a94-87d9-65ad36ab9063 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-d7a379df-5655-45b3-9b04-d882f9074bca'] {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eb31c5fc-eea1-4a94-87d9-65ad36ab9063 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/79cfdd60-7506-4f5f-b5c8-6cd487eb5996" status: 404 len: 194 microversion: 2.1 time: 0.193271 Jul 14 14:36:30.399297 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1213/2417] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:36:30 2022] GET /compute/v2.1/os-security-groups/79cfdd60-7506-4f5f-b5c8-6cd487eb5996 => generated 194 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:30.405446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f7c843f4-ac77-4c88-ae8c-97d1402a4e95 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:30.406080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f7c843f4-ac77-4c88-ae8c-97d1402a4e95 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:30.425815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7c843f4-ac77-4c88-ae8c-97d1402a4e95 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:30.426417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7c843f4-ac77-4c88-ae8c-97d1402a4e95 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:30.427992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7c843f4-ac77-4c88-ae8c-97d1402a4e95 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:30.428917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7c843f4-ac77-4c88-ae8c-97d1402a4e95 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:30.589252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-627c7446-0db7-420c-a6e4-fa1a2d83a4d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:30.603517 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-627c7446-0db7-420c-a6e4-fa1a2d83a4d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.444007 Jul 14 14:36:30.607453 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1205/2418] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:30 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:30.614562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bdeaa4a4-df14-45a8-af93-138df717bef3 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c57e3940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:30.751684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f7c843f4-ac77-4c88-ae8c-97d1402a4e95 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:30.769492 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f7c843f4-ac77-4c88-ae8c-97d1402a4e95 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1318 microversion: 2.1 time: 0.370309 Jul 14 14:36:30.770075 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1214/2419] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:30 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:31.012365 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bdeaa4a4-df14-45a8-af93-138df717bef3 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.402655 Jul 14 14:36:31.025934 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1206/2420] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:36:30 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:31.031478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1095bc3a-23a4-44bd-a8f9-dce0e7862f47 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'create', calling method: .version_select at 0x7fd6c5749ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1404400151", "description": "tempest-description-521072651"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:31.092008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-08e8900a-376e-41d3-a801-21f98c32c386 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:31.092752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-08e8900a-376e-41d3-a801-21f98c32c386 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:31.115827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08e8900a-376e-41d3-a801-21f98c32c386 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.119624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08e8900a-376e-41d3-a801-21f98c32c386 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:31.126916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08e8900a-376e-41d3-a801-21f98c32c386 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.129752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08e8900a-376e-41d3-a801-21f98c32c386 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:31.543808 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1095bc3a-23a4-44bd-a8f9-dce0e7862f47 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.515715 Jul 14 14:36:31.554031 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1215/2421] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:36:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:31.561902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4aba3c2e-40b8-4462-a1f6-7418494d7baa tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'create', calling method: .version_select at 0x7fd6c5b433a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1655602781", "description": "tempest-description-1952331320"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:31.771655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-08e8900a-376e-41d3-a801-21f98c32c386 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:31.790422 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-08e8900a-376e-41d3-a801-21f98c32c386 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1313 microversion: 2.1 time: 0.705891 Jul 14 14:36:31.791634 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1207/2422] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:31 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1313 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:31.800437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b0ca5dae-9fdf-44d5-bc3e-d7285c86effc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:31.801979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b0ca5dae-9fdf-44d5-bc3e-d7285c86effc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:31.812418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0ca5dae-9fdf-44d5-bc3e-d7285c86effc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.813352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0ca5dae-9fdf-44d5-bc3e-d7285c86effc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:31.814864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0ca5dae-9fdf-44d5-bc3e-d7285c86effc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.815470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0ca5dae-9fdf-44d5-bc3e-d7285c86effc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.483436 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4aba3c2e-40b8-4462-a1f6-7418494d7baa tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.927670 Jul 14 14:36:32.484777 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1216/2423] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:36:31 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:32.489720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-45590c62-dc67-415b-ad62-9d64068e93c6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:32.490647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-45590c62-dc67-415b-ad62-9d64068e93c6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:32.505376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-45590c62-dc67-415b-ad62-9d64068e93c6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.512168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b0ca5dae-9fdf-44d5-bc3e-d7285c86effc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:32.516094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-45590c62-dc67-415b-ad62-9d64068e93c6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.521030 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b0ca5dae-9fdf-44d5-bc3e-d7285c86effc tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.728019 Jul 14 14:36:32.523037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-45590c62-dc67-415b-ad62-9d64068e93c6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.529301 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1208/2424] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:31 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:32.529488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-45590c62-dc67-415b-ad62-9d64068e93c6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.698630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-250028216", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "ac8ff2ab-77b4-4f10-a730-efd282361317"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:32.785199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] validate_networks() for [('ac8ff2ab-77b4-4f10-a730-efd282361317', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:32.925612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-45590c62-dc67-415b-ad62-9d64068e93c6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:32.939032 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-45590c62-dc67-415b-ad62-9d64068e93c6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1318 microversion: 2.1 time: 0.452849 Jul 14 14:36:32.940854 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1217/2425] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:32 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:32.946970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fed7948c-1ca0-488f-bfb6-ff41fc492186 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:32.947912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fed7948c-1ca0-488f-bfb6-ff41fc492186 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:32.968875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fed7948c-1ca0-488f-bfb6-ff41fc492186 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.969957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fed7948c-1ca0-488f-bfb6-ff41fc492186 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.970842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fed7948c-1ca0-488f-bfb6-ff41fc492186 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.971538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fed7948c-1ca0-488f-bfb6-ff41fc492186 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:33.596404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fed7948c-1ca0-488f-bfb6-ff41fc492186 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:33.607963 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fed7948c-1ca0-488f-bfb6-ff41fc492186 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1313 microversion: 2.1 time: 0.664460 Jul 14 14:36:33.608670 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1218/2426] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:32 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:33.621684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e19581fd-6920-43f7-8740-20bf3f821071 req-44f2cbcd-307b-45ab-8b39-60d78b2255c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ebe371-1ebb-4849-a18f-4b3e40035dfb", "name": "network-vif-plugged", "status": "completed", "tag": "929f1d52-94d9-463b-b94c-fe77458a9e1a"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:33.634460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e19581fd-6920-43f7-8740-20bf3f821071 req-44f2cbcd-307b-45ab-8b39-60d78b2255c6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:33.635088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e19581fd-6920-43f7-8740-20bf3f821071 req-44f2cbcd-307b-45ab-8b39-60d78b2255c6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:33.671838 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e19581fd-6920-43f7-8740-20bf3f821071 req-44f2cbcd-307b-45ab-8b39-60d78b2255c6 service nova] Creating event network-vif-plugged:929f1d52-94d9-463b-b94c-fe77458a9e1a for instance 13ebe371-1ebb-4849-a18f-4b3e40035dfb on n-h1-767704-28 Jul 14 14:36:33.685258 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e19581fd-6920-43f7-8740-20bf3f821071 req-44f2cbcd-307b-45ab-8b39-60d78b2255c6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068816 Jul 14 14:36:33.685936 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1219/2427] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:33.699475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4f6828d6-d5f1-4ca3-abae-37e03b48e1ef tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:33.701196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4f6828d6-d5f1-4ca3-abae-37e03b48e1ef tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:33.708307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f6828d6-d5f1-4ca3-abae-37e03b48e1ef tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:33.709204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f6828d6-d5f1-4ca3-abae-37e03b48e1ef tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:33.711108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f6828d6-d5f1-4ca3-abae-37e03b48e1ef tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:33.711765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f6828d6-d5f1-4ca3-abae-37e03b48e1ef tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.311259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4f6828d6-d5f1-4ca3-abae-37e03b48e1ef tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:34.327286 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4f6828d6-d5f1-4ca3-abae-37e03b48e1ef tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.640056 Jul 14 14:36:34.327876 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1220/2428] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:33 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:34.339713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4e6c0df3-9588-4be6-82cc-fb1cc14798f3 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:34.341108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4e6c0df3-9588-4be6-82cc-fb1cc14798f3 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:34.360772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4e6c0df3-9588-4be6-82cc-fb1cc14798f3 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.361528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4e6c0df3-9588-4be6-82cc-fb1cc14798f3 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.362482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4e6c0df3-9588-4be6-82cc-fb1cc14798f3 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.365119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4e6c0df3-9588-4be6-82cc-fb1cc14798f3 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.741876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:34.743001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:34.743642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:34.744816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:34.745451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:34.765190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.765977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.767302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.782817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.803279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4e6c0df3-9588-4be6-82cc-fb1cc14798f3 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:34.810320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Getting quotas for project a63994cd418f458d80ef0b54128592fc. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:34.814615 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4e6c0df3-9588-4be6-82cc-fb1cc14798f3 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1318 microversion: 2.1 time: 0.485378 Jul 14 14:36:34.815210 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1221/2429] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:34 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:34.838715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Getting quotas for user 1ae1d6f3c8a2476aab57620c281ecdc1 and project a63994cd418f458d80ef0b54128592fc. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:34.839906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-02950af4-13e3-4fd1-840c-02e1c7be076d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:34.841516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-02950af4-13e3-4fd1-840c-02e1c7be076d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:34.852512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02950af4-13e3-4fd1-840c-02e1c7be076d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.853762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02950af4-13e3-4fd1-840c-02e1c7be076d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.855963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02950af4-13e3-4fd1-840c-02e1c7be076d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.857696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02950af4-13e3-4fd1-840c-02e1c7be076d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.877157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:34.884889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:34.982059 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f6e960a5-a7f5-4db7-aa69-1339221c1606 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.286913 Jul 14 14:36:34.987674 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1209/2430] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:36:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:36:34.988324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eee3abe7-d611-4e05-a32e-55d145dbc173 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:34.989177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eee3abe7-d611-4e05-a32e-55d145dbc173 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:34.996411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eee3abe7-d611-4e05-a32e-55d145dbc173 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.997664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eee3abe7-d611-4e05-a32e-55d145dbc173 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.998480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eee3abe7-d611-4e05-a32e-55d145dbc173 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.999256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eee3abe7-d611-4e05-a32e-55d145dbc173 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.033501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eee3abe7-d611-4e05-a32e-55d145dbc173 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:36:35.130957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-02950af4-13e3-4fd1-840c-02e1c7be076d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:35.155536 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-02950af4-13e3-4fd1-840c-02e1c7be076d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1313 microversion: 2.1 time: 0.338992 Jul 14 14:36:35.156138 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1222/2431] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:34 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:35.171430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e084cdc5-5d27-4836-b8d0-e50dd630e7de tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:35.172818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e084cdc5-5d27-4836-b8d0-e50dd630e7de tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:35.223489 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eee3abe7-d611-4e05-a32e-55d145dbc173 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "DELETE /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 204 len: 0 microversion: 2.1 time: 0.238294 Jul 14 14:36:35.225057 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1210/2432] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:36:34 2022] DELETE /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:36:35.240641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eba1f649-2cc3-4362-a932-00ef78992332 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:35.241786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eba1f649-2cc3-4362-a932-00ef78992332 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:35.255568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eba1f649-2cc3-4362-a932-00ef78992332 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.256143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eba1f649-2cc3-4362-a932-00ef78992332 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.257507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eba1f649-2cc3-4362-a932-00ef78992332 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.259008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eba1f649-2cc3-4362-a932-00ef78992332 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.273558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e084cdc5-5d27-4836-b8d0-e50dd630e7de tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:35.282253 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e084cdc5-5d27-4836-b8d0-e50dd630e7de tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1215 microversion: 2.1 time: 0.115319 Jul 14 14:36:35.284031 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1223/2433] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:35 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:35.294500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:35.346294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65cce880-a085-4460-9291-5502a5339a3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:35.346948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-65cce880-a085-4460-9291-5502a5339a3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:35.358424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65cce880-a085-4460-9291-5502a5339a3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.362221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65cce880-a085-4460-9291-5502a5339a3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.363311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65cce880-a085-4460-9291-5502a5339a3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.369982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65cce880-a085-4460-9291-5502a5339a3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.599125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eba1f649-2cc3-4362-a932-00ef78992332 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:35.615397 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eba1f649-2cc3-4362-a932-00ef78992332 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1667 microversion: 2.1 time: 0.383101 Jul 14 14:36:35.616007 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1211/2434] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:35 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1667 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:35.680397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-65cce880-a085-4460-9291-5502a5339a3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:35.691588 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65cce880-a085-4460-9291-5502a5339a3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.351706 Jul 14 14:36:35.692769 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1224/2435] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:35 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:35.720543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-cd60e7ec-5102-40b3-891f-014314bd7a80 req-48c47bd6-bba6-4b63-9543-cfc314da0383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421b3e7a-56b8-4241-a496-2a091a9686f3", "name": "network-vif-plugged", "status": "completed", "tag": "40cb08bf-70f2-461c-9c75-c450c62e8c00"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:35.730139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cd60e7ec-5102-40b3-891f-014314bd7a80 req-48c47bd6-bba6-4b63-9543-cfc314da0383 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.731640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cd60e7ec-5102-40b3-891f-014314bd7a80 req-48c47bd6-bba6-4b63-9543-cfc314da0383 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.745153 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-cd60e7ec-5102-40b3-891f-014314bd7a80 req-48c47bd6-bba6-4b63-9543-cfc314da0383 service nova] Creating event network-vif-plugged:40cb08bf-70f2-461c-9c75-c450c62e8c00 for instance 421b3e7a-56b8-4241-a496-2a091a9686f3 on n-h2-767704-28 Jul 14 14:36:35.752421 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-cd60e7ec-5102-40b3-891f-014314bd7a80 req-48c47bd6-bba6-4b63-9543-cfc314da0383 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035792 Jul 14 14:36:35.753653 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1212/2436] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:35.832920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1a289274-4792-4d9c-8c1c-fe454b81ed82 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:35.833692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1a289274-4792-4d9c-8c1c-fe454b81ed82 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:35.849154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a289274-4792-4d9c-8c1c-fe454b81ed82 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.850287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a289274-4792-4d9c-8c1c-fe454b81ed82 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.856863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a289274-4792-4d9c-8c1c-fe454b81ed82 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.859751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a289274-4792-4d9c-8c1c-fe454b81ed82 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.116412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a289274-4792-4d9c-8c1c-fe454b81ed82 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:36.127443 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1a289274-4792-4d9c-8c1c-fe454b81ed82 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1318 microversion: 2.1 time: 0.299818 Jul 14 14:36:36.136522 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1225/2437] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:35 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:36.173880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f0937e75-f310-408c-8904-e3268880e94f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:36.174905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f0937e75-f310-408c-8904-e3268880e94f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:36.186852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0937e75-f310-408c-8904-e3268880e94f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.187752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0937e75-f310-408c-8904-e3268880e94f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.190364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0937e75-f310-408c-8904-e3268880e94f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.191288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0937e75-f310-408c-8904-e3268880e94f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.302453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-32814fa0-d470-4f90-8f28-b12a83f195c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:36.303346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-32814fa0-d470-4f90-8f28-b12a83f195c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:36.311903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32814fa0-d470-4f90-8f28-b12a83f195c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.312771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32814fa0-d470-4f90-8f28-b12a83f195c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.313713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32814fa0-d470-4f90-8f28-b12a83f195c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.314640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32814fa0-d470-4f90-8f28-b12a83f195c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.405113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-32814fa0-d470-4f90-8f28-b12a83f195c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:36.413799 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-32814fa0-d470-4f90-8f28-b12a83f195c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1219 microversion: 2.1 time: 0.117081 Jul 14 14:36:36.426384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f0937e75-f310-408c-8904-e3268880e94f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:36.427818 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1226/2438] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:36 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:36.437313 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f0937e75-f310-408c-8904-e3268880e94f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1313 microversion: 2.1 time: 0.267100 Jul 14 14:36:36.437517 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1213/2439] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:36 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:36.633738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2292bde9-48db-4984-ae41-4b77e9233e0d tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:36.634355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2292bde9-48db-4984-ae41-4b77e9233e0d tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:36.641911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2292bde9-48db-4984-ae41-4b77e9233e0d tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.642521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2292bde9-48db-4984-ae41-4b77e9233e0d tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.643500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2292bde9-48db-4984-ae41-4b77e9233e0d tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.643944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2292bde9-48db-4984-ae41-4b77e9233e0d tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.709425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-75d64a50-1a5b-4100-959b-40174b423f18 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:36.710050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-75d64a50-1a5b-4100-959b-40174b423f18 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:36.722298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75d64a50-1a5b-4100-959b-40174b423f18 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.723298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75d64a50-1a5b-4100-959b-40174b423f18 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.725059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75d64a50-1a5b-4100-959b-40174b423f18 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.725511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75d64a50-1a5b-4100-959b-40174b423f18 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.921978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2292bde9-48db-4984-ae41-4b77e9233e0d tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:36.937257 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2292bde9-48db-4984-ae41-4b77e9233e0d tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1667 microversion: 2.1 time: 0.305682 Jul 14 14:36:36.939328 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1227/2440] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:36 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1667 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:36.950170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-75d64a50-1a5b-4100-959b-40174b423f18 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:36.959647 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-75d64a50-1a5b-4100-959b-40174b423f18 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1513 microversion: 2.1 time: 0.254128 Jul 14 14:36:36.971491 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1214/2441] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:36 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:37.152074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-84462316-11f7-4cab-958b-ad5662d2004f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:37.154804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-84462316-11f7-4cab-958b-ad5662d2004f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:37.164405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84462316-11f7-4cab-958b-ad5662d2004f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.165376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84462316-11f7-4cab-958b-ad5662d2004f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.166886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84462316-11f7-4cab-958b-ad5662d2004f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.167912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84462316-11f7-4cab-958b-ad5662d2004f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.437405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c48aae2a-748b-4a99-8983-6ffb486f88ae tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:37.438399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c48aae2a-748b-4a99-8983-6ffb486f88ae tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:37.456140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c48aae2a-748b-4a99-8983-6ffb486f88ae tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.478914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c48aae2a-748b-4a99-8983-6ffb486f88ae tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.491034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c48aae2a-748b-4a99-8983-6ffb486f88ae tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.491336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-84462316-11f7-4cab-958b-ad5662d2004f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:37.492582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c48aae2a-748b-4a99-8983-6ffb486f88ae tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.501599 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-84462316-11f7-4cab-958b-ad5662d2004f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1318 microversion: 2.1 time: 0.360418 Jul 14 14:36:37.510400 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1228/2442] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:37 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:37.516734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3ffdc364-cce0-40f0-a8b6-1f2b245d124b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:37.521767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3ffdc364-cce0-40f0-a8b6-1f2b245d124b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:37.535633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ffdc364-cce0-40f0-a8b6-1f2b245d124b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.537026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ffdc364-cce0-40f0-a8b6-1f2b245d124b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.538132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ffdc364-cce0-40f0-a8b6-1f2b245d124b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.542838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ffdc364-cce0-40f0-a8b6-1f2b245d124b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.607118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c48aae2a-748b-4a99-8983-6ffb486f88ae tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:37.622043 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c48aae2a-748b-4a99-8983-6ffb486f88ae tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1211 microversion: 2.1 time: 0.189440 Jul 14 14:36:37.625629 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1215/2443] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:37 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1211 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:37.772221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-38d9e993-de29-468a-bef3-51bcc8fd80ab req-862d94e9-a28d-4fcc-b69f-fac3ebc8745a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4beb02f-8f03-4186-8e65-0f132e384e4c", "name": "network-vif-plugged", "status": "completed", "tag": "85dc8019-423e-431f-a854-ebcdc42a891a"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:37.783243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-38d9e993-de29-468a-bef3-51bcc8fd80ab req-862d94e9-a28d-4fcc-b69f-fac3ebc8745a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.784215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-38d9e993-de29-468a-bef3-51bcc8fd80ab req-862d94e9-a28d-4fcc-b69f-fac3ebc8745a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.798513 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-38d9e993-de29-468a-bef3-51bcc8fd80ab req-862d94e9-a28d-4fcc-b69f-fac3ebc8745a service nova] Creating event network-vif-plugged:85dc8019-423e-431f-a854-ebcdc42a891a for instance d4beb02f-8f03-4186-8e65-0f132e384e4c on n-h2-767704-28 Jul 14 14:36:37.805846 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-38d9e993-de29-468a-bef3-51bcc8fd80ab req-862d94e9-a28d-4fcc-b69f-fac3ebc8745a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037373 Jul 14 14:36:37.811556 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1216/2444] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:37.843220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3ffdc364-cce0-40f0-a8b6-1f2b245d124b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:37.852087 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3ffdc364-cce0-40f0-a8b6-1f2b245d124b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1313 microversion: 2.1 time: 0.340199 Jul 14 14:36:37.852687 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1229/2445] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:37 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:37.957804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ec2cdc8e-e8b0-4ac9-9159-a8e1b0130b99 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:37.958819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ec2cdc8e-e8b0-4ac9-9159-a8e1b0130b99 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:37.968158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec2cdc8e-e8b0-4ac9-9159-a8e1b0130b99 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.969010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec2cdc8e-e8b0-4ac9-9159-a8e1b0130b99 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.970047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec2cdc8e-e8b0-4ac9-9159-a8e1b0130b99 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.970708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec2cdc8e-e8b0-4ac9-9159-a8e1b0130b99 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:38.001885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:38.327778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-61ac632f-af06-434f-8017-ae9d72e14b66 tempest-AbsoluteLimitsTestJSON-2012553652 tempest-AbsoluteLimitsTestJSON-2012553652-project] Calling method '.version_select at 0x7fd6c6545b80>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:38.353726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61ac632f-af06-434f-8017-ae9d72e14b66 tempest-AbsoluteLimitsTestJSON-2012553652 tempest-AbsoluteLimitsTestJSON-2012553652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:38.355334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61ac632f-af06-434f-8017-ae9d72e14b66 tempest-AbsoluteLimitsTestJSON-2012553652 tempest-AbsoluteLimitsTestJSON-2012553652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:38.357152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61ac632f-af06-434f-8017-ae9d72e14b66 tempest-AbsoluteLimitsTestJSON-2012553652 tempest-AbsoluteLimitsTestJSON-2012553652-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:38.358222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61ac632f-af06-434f-8017-ae9d72e14b66 tempest-AbsoluteLimitsTestJSON-2012553652 tempest-AbsoluteLimitsTestJSON-2012553652-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:38.406733 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-61ac632f-af06-434f-8017-ae9d72e14b66 tempest-AbsoluteLimitsTestJSON-2012553652 tempest-AbsoluteLimitsTestJSON-2012553652-project] 10.222.0.81 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.592143 Jul 14 14:36:38.408525 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1217/2446] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:37 2022] GET /compute/v2.1/limits => generated 511 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:38.421836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a3068863-aa0b-4d91-99b2-09a6e23badf9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:38.423566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a3068863-aa0b-4d91-99b2-09a6e23badf9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:38.432961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3068863-aa0b-4d91-99b2-09a6e23badf9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:38.434364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3068863-aa0b-4d91-99b2-09a6e23badf9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:38.435442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3068863-aa0b-4d91-99b2-09a6e23badf9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:38.436349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3068863-aa0b-4d91-99b2-09a6e23badf9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:38.823411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ec2cdc8e-e8b0-4ac9-9159-a8e1b0130b99 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:38.835010 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ec2cdc8e-e8b0-4ac9-9159-a8e1b0130b99 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1667 microversion: 2.1 time: 0.881327 Jul 14 14:36:38.839153 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1230/2447] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:37 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1667 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:38.861791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e8604bb-ca1e-4487-ab49-abb292bf20a9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:38.863261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8e8604bb-ca1e-4487-ab49-abb292bf20a9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:38.893204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e8604bb-ca1e-4487-ab49-abb292bf20a9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:38.896408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e8604bb-ca1e-4487-ab49-abb292bf20a9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:38.898576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e8604bb-ca1e-4487-ab49-abb292bf20a9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:38.900155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e8604bb-ca1e-4487-ab49-abb292bf20a9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:38.957676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a3068863-aa0b-4d91-99b2-09a6e23badf9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:38.968106 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a3068863-aa0b-4d91-99b2-09a6e23badf9 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1490 microversion: 2.1 time: 0.558448 Jul 14 14:36:38.969029 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1218/2448] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:38 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1490 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:38.976912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-06fdd0ef-925f-4c43-b8cb-cdaa6d7c21de tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:38.977835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-06fdd0ef-925f-4c43-b8cb-cdaa6d7c21de tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:38.982155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:38.988408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06fdd0ef-925f-4c43-b8cb-cdaa6d7c21de tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:38.989185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06fdd0ef-925f-4c43-b8cb-cdaa6d7c21de tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:38.990179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06fdd0ef-925f-4c43-b8cb-cdaa6d7c21de tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:38.990809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06fdd0ef-925f-4c43-b8cb-cdaa6d7c21de tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:39.368025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8e8604bb-ca1e-4487-ab49-abb292bf20a9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:39.379041 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8e8604bb-ca1e-4487-ab49-abb292bf20a9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1467 microversion: 2.1 time: 0.538113 Jul 14 14:36:39.380370 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1231/2449] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:38 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1467 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:39.393393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-da16489c-ad9a-4560-92ef-af554114f954 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:39.399863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-da16489c-ad9a-4560-92ef-af554114f954 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:39.413091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da16489c-ad9a-4560-92ef-af554114f954 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.414019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da16489c-ad9a-4560-92ef-af554114f954 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:39.415856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da16489c-ad9a-4560-92ef-af554114f954 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.416630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da16489c-ad9a-4560-92ef-af554114f954 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:39.530991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-06fdd0ef-925f-4c43-b8cb-cdaa6d7c21de tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:39.540477 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-06fdd0ef-925f-4c43-b8cb-cdaa6d7c21de tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1315 microversion: 2.1 time: 0.569111 Jul 14 14:36:39.549065 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1219/2450] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:38 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:39.555007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9cd7771a-d469-4b62-a8ae-9e8a928beac2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:39.556686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9cd7771a-d469-4b62-a8ae-9e8a928beac2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:39.580724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cd7771a-d469-4b62-a8ae-9e8a928beac2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.581339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cd7771a-d469-4b62-a8ae-9e8a928beac2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:39.585263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cd7771a-d469-4b62-a8ae-9e8a928beac2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.585994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cd7771a-d469-4b62-a8ae-9e8a928beac2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:39.644331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9cd7771a-d469-4b62-a8ae-9e8a928beac2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:36:39.775286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-da16489c-ad9a-4560-92ef-af554114f954 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:39.792089 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-da16489c-ad9a-4560-92ef-af554114f954 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1313 microversion: 2.1 time: 0.409127 Jul 14 14:36:39.792727 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1232/2451] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:39 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:39.809299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-26609d53-fff4-4cf6-a0e5-a701fa35d05c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:39.810260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-26609d53-fff4-4cf6-a0e5-a701fa35d05c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:39.829428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26609d53-fff4-4cf6-a0e5-a701fa35d05c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.832981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26609d53-fff4-4cf6-a0e5-a701fa35d05c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:39.834283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26609d53-fff4-4cf6-a0e5-a701fa35d05c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.834956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26609d53-fff4-4cf6-a0e5-a701fa35d05c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:39.859640 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9cd7771a-d469-4b62-a8ae-9e8a928beac2 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 204 len: 0 microversion: 2.1 time: 0.306926 Jul 14 14:36:39.863116 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1220/2452] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:36:39 2022] DELETE /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:36:39.876094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6564cbfe-45e3-4787-a78d-2d6d89232bfb tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:39.878630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6564cbfe-45e3-4787-a78d-2d6d89232bfb tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:39.897489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6564cbfe-45e3-4787-a78d-2d6d89232bfb tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.898288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6564cbfe-45e3-4787-a78d-2d6d89232bfb tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:39.900102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6564cbfe-45e3-4787-a78d-2d6d89232bfb tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.900730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6564cbfe-45e3-4787-a78d-2d6d89232bfb tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.044177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6564cbfe-45e3-4787-a78d-2d6d89232bfb tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:40.055569 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6564cbfe-45e3-4787-a78d-2d6d89232bfb tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1599 microversion: 2.1 time: 0.190765 Jul 14 14:36:40.056177 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1221/2453] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:39 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1599 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:40.063770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0f56fda3-bc6c-4615-a7d8-19cb79314bc6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:40.068668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0f56fda3-bc6c-4615-a7d8-19cb79314bc6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:40.083710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f56fda3-bc6c-4615-a7d8-19cb79314bc6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.084222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f56fda3-bc6c-4615-a7d8-19cb79314bc6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.087712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f56fda3-bc6c-4615-a7d8-19cb79314bc6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.088230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f56fda3-bc6c-4615-a7d8-19cb79314bc6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.426915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-26609d53-fff4-4cf6-a0e5-a701fa35d05c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:40.438087 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-26609d53-fff4-4cf6-a0e5-a701fa35d05c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2" status: 200 len: 1466 microversion: 2.1 time: 0.644204 Jul 14 14:36:40.441536 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1233/2454] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:39 2022] GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 => generated 1466 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:40.451191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-94ee1265-9525-4003-a0d4-79c81996611e req-c6930210-7fe7-412b-b949-4bd79629f187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd69c7d-4c91-46fa-bee9-fd8f45219ff3", "name": "network-vif-deleted", "tag": "49324fac-c63d-43ac-9300-0527c1efdc95"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:40.472318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-94ee1265-9525-4003-a0d4-79c81996611e req-c6930210-7fe7-412b-b949-4bd79629f187 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.473025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-94ee1265-9525-4003-a0d4-79c81996611e req-c6930210-7fe7-412b-b949-4bd79629f187 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.507240 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-94ee1265-9525-4003-a0d4-79c81996611e req-c6930210-7fe7-412b-b949-4bd79629f187 service nova] Creating event network-vif-deleted:49324fac-c63d-43ac-9300-0527c1efdc95 for instance bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 on n-h1-767704-28 Jul 14 14:36:40.522496 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-94ee1265-9525-4003-a0d4-79c81996611e req-c6930210-7fe7-412b-b949-4bd79629f187 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079466 Jul 14 14:36:40.527259 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1234/2455] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:40.535669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cedee705-5895-4d1a-a266-0dbd881e2d83 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1343653027"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:40.546428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cedee705-5895-4d1a-a266-0dbd881e2d83 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:40.561604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cedee705-5895-4d1a-a266-0dbd881e2d83 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.563805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cedee705-5895-4d1a-a266-0dbd881e2d83 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.565509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cedee705-5895-4d1a-a266-0dbd881e2d83 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.567274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cedee705-5895-4d1a-a266-0dbd881e2d83 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.619407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0f56fda3-bc6c-4615-a7d8-19cb79314bc6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:40.628246 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0f56fda3-bc6c-4615-a7d8-19cb79314bc6 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1496 microversion: 2.1 time: 0.571015 Jul 14 14:36:40.631466 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1222/2456] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:40 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1496 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:40.643465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-baf9861d-68ce-44de-afa9-19f839a43726 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:40.644645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-baf9861d-68ce-44de-afa9-19f839a43726 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:40.660295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baf9861d-68ce-44de-afa9-19f839a43726 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.667588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baf9861d-68ce-44de-afa9-19f839a43726 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.669850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baf9861d-68ce-44de-afa9-19f839a43726 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.670328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baf9861d-68ce-44de-afa9-19f839a43726 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.938094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-baf9861d-68ce-44de-afa9-19f839a43726 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:40.956658 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-baf9861d-68ce-44de-afa9-19f839a43726 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1315 microversion: 2.1 time: 0.323768 Jul 14 14:36:40.958733 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1223/2457] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:40 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:40.964369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e1bfcd7a-3244-4ca3-b5f5-1354a27d5203 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:40.965738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e1bfcd7a-3244-4ca3-b5f5-1354a27d5203 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:40.983643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e1bfcd7a-3244-4ca3-b5f5-1354a27d5203 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.984087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e1bfcd7a-3244-4ca3-b5f5-1354a27d5203 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.984864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e1bfcd7a-3244-4ca3-b5f5-1354a27d5203 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.985354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e1bfcd7a-3244-4ca3-b5f5-1354a27d5203 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.138964 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cedee705-5895-4d1a-a266-0dbd881e2d83 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "POST /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2/action" status: 202 len: 0 microversion: 2.1 time: 0.608047 Jul 14 14:36:41.140025 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1235/2458] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:36:40 2022] POST /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:36:41.153575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e1580645-5309-4339-8cf7-8e6fd6c10f60 req-77eb8a19-ecc6-4755-9cf4-c0c6d07f0862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68217dfd-b29a-45a3-b3ec-e2e0a3fca887", "tag": "5b7dd2ba-3b91-4c6a-9733-caca69e51884"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:41.174800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e1580645-5309-4339-8cf7-8e6fd6c10f60 req-77eb8a19-ecc6-4755-9cf4-c0c6d07f0862 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.178848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e1580645-5309-4339-8cf7-8e6fd6c10f60 req-77eb8a19-ecc6-4755-9cf4-c0c6d07f0862 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.203161 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e1580645-5309-4339-8cf7-8e6fd6c10f60 req-77eb8a19-ecc6-4755-9cf4-c0c6d07f0862 service nova] Creating event network-changed:5b7dd2ba-3b91-4c6a-9733-caca69e51884 for instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 on n-h1-767704-28 Jul 14 14:36:41.216123 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e1580645-5309-4339-8cf7-8e6fd6c10f60 req-77eb8a19-ecc6-4755-9cf4-c0c6d07f0862 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074573 Jul 14 14:36:41.237129 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1236/2459] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:41.243148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b84d454c-9c5c-44cc-af71-a731b74ff87f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:41.259945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b84d454c-9c5c-44cc-af71-a731b74ff87f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:41.270065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b84d454c-9c5c-44cc-af71-a731b74ff87f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.274307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b84d454c-9c5c-44cc-af71-a731b74ff87f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.279240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b84d454c-9c5c-44cc-af71-a731b74ff87f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.279957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b84d454c-9c5c-44cc-af71-a731b74ff87f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.288538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e1bfcd7a-3244-4ca3-b5f5-1354a27d5203 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:41.305657 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e1bfcd7a-3244-4ca3-b5f5-1354a27d5203 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1463 microversion: 2.1 time: 0.345065 Jul 14 14:36:41.308674 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1224/2460] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:40 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1463 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:41.321603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e4044b41-cf1f-45f7-8fd4-1adf62d4938e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5e244c0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:41.402915 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e4044b41-cf1f-45f7-8fd4-1adf62d4938e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.088502 Jul 14 14:36:41.404296 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1225/2461] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:41 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:41.419047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4818a87b-6fbe-4a1e-93bd-c1bb4c11e9cd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:41.422441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4818a87b-6fbe-4a1e-93bd-c1bb4c11e9cd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:41.445005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4818a87b-6fbe-4a1e-93bd-c1bb4c11e9cd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.445958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4818a87b-6fbe-4a1e-93bd-c1bb4c11e9cd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.447176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4818a87b-6fbe-4a1e-93bd-c1bb4c11e9cd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.447847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4818a87b-6fbe-4a1e-93bd-c1bb4c11e9cd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.491418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b84d454c-9c5c-44cc-af71-a731b74ff87f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091085fb7a6342028a985fc718513c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63db38e19164be5a420831ee77fe875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:41.508123 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b84d454c-9c5c-44cc-af71-a731b74ff87f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 200 len: 1599 microversion: 2.1 time: 0.262600 Jul 14 14:36:41.508828 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1237/2462] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:41 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 1599 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:41.647581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-69f41b07-2cab-45fe-8ecc-567c6947ac66 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:41.648512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-69f41b07-2cab-45fe-8ecc-567c6947ac66 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:41.659903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69f41b07-2cab-45fe-8ecc-567c6947ac66 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.661764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69f41b07-2cab-45fe-8ecc-567c6947ac66 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.665117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69f41b07-2cab-45fe-8ecc-567c6947ac66 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.668326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69f41b07-2cab-45fe-8ecc-567c6947ac66 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:42.220628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-69f41b07-2cab-45fe-8ecc-567c6947ac66 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:42.233331 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-69f41b07-2cab-45fe-8ecc-567c6947ac66 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1496 microversion: 2.1 time: 0.589466 Jul 14 14:36:42.234163 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1238/2463] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:41 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1496 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:42.239704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-75ab3041-ac46-4bb0-a777-9d89a7c2b7aa tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:42.240523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-75ab3041-ac46-4bb0-a777-9d89a7c2b7aa tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:42.248735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75ab3041-ac46-4bb0-a777-9d89a7c2b7aa tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:42.249589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75ab3041-ac46-4bb0-a777-9d89a7c2b7aa tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:42.250335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4818a87b-6fbe-4a1e-93bd-c1bb4c11e9cd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:42.261388 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4818a87b-6fbe-4a1e-93bd-c1bb4c11e9cd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1460 microversion: 2.1 time: 0.855458 Jul 14 14:36:42.262087 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1226/2464] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:41 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1460 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:42.275589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75ab3041-ac46-4bb0-a777-9d89a7c2b7aa tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:42.279034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75ab3041-ac46-4bb0-a777-9d89a7c2b7aa tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:42.529599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d418a1ab-e41a-483b-afa5-b5b7e58de767 tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] Calling method '.version_select at 0x7fd6c596c040>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:42.543913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d418a1ab-e41a-483b-afa5-b5b7e58de767 tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:42.544378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d418a1ab-e41a-483b-afa5-b5b7e58de767 tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:42.545218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d418a1ab-e41a-483b-afa5-b5b7e58de767 tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:42.551014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d418a1ab-e41a-483b-afa5-b5b7e58de767 tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:42.592080 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d418a1ab-e41a-483b-afa5-b5b7e58de767 tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] 10.222.0.81 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.325475 Jul 14 14:36:42.593215 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1227/2465] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:42 2022] GET /compute/v2.1/limits => generated 511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:42.600150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1693ddc8-b5ba-4a94-a4f5-16b257e6767e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c596c4c0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:42.631325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-75ab3041-ac46-4bb0-a777-9d89a7c2b7aa tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:42.643198 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-75ab3041-ac46-4bb0-a777-9d89a7c2b7aa tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1315 microversion: 2.1 time: 0.407629 Jul 14 14:36:42.644460 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1239/2466] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:42 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:42.649909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-736195887", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "13ebe371-1ebb-4849-a18f-4b3e40035dfb"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:42.674542 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1693ddc8-b5ba-4a94-a4f5-16b257e6767e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.080224 Jul 14 14:36:42.682388 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1228/2467] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:42 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:42.688315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4a27c6e4-eb9d-4a4f-b058-9bd9a739a44f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:42.689198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4a27c6e4-eb9d-4a4f-b058-9bd9a739a44f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] [instance: bdd69c7d-4c91-46fa-bee9-fd8f45219ff3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:42.696240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4a27c6e4-eb9d-4a4f-b058-9bd9a739a44f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:42.697562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4a27c6e4-eb9d-4a4f-b058-9bd9a739a44f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:42.698615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4a27c6e4-eb9d-4a4f-b058-9bd9a739a44f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:42.699255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4a27c6e4-eb9d-4a4f-b058-9bd9a739a44f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:42.721242 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-4a27c6e4-eb9d-4a4f-b058-9bd9a739a44f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] HTTP exception thrown: Instance bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 could not be found. Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4a27c6e4-eb9d-4a4f-b058-9bd9a739a44f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Request method failure captured: Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 HTTP/1.1 Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CmumY97Qrw4XpPw3H1uBtv6_te7U9fBWWA7-e7CBooZiuxorfwIepZf1SCzbD4xik3W-uv9wiINN-w1aUYUN4dw8fvpmidSePECjt1Eus0yXFAfIKsZomYjbjYIv6kLN1_2yT7t3nJuG0-Hg_Zhmm2ElsnMmSneSgiWuATkNxCT5-w Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: c63db38e19164be5a420831ee77fe875 Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestFqdnHostnames-1362932891 Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c63db38e19164be5a420831ee77fe875"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c63db38e19164be5a420831ee77fe875"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c63db38e19164be5a420831ee77fe875", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c63db38e19164be5a420831ee77fe875"}]}] Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestFqdnHostnames-1362932891 Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: c63db38e19164be5a420831ee77fe875 Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1362932891 Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestFqdnHostnames-1362932891-project Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 091085fb7a6342028a985fc718513c3a Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestFqdnHostnames-1362932891-project Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 could not be found. Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'bdd69c7d-4c91-46fa-bee9-fd8f45219ff3'} Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 could not be found. Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 could not be found. Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:42.724020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:42.729523 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:42.729523 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:42.729523 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:42.729523 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:42.729523 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:42.729523 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 could not be found. Jul 14 14:36:42.729523 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:42.733687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4a27c6e4-eb9d-4a4f-b058-9bd9a739a44f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Returning 404 to user: Instance bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:42.734822 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4a27c6e4-eb9d-4a4f-b058-9bd9a739a44f tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3" status: 404 len: 111 microversion: 2.1 time: 0.051432 Jul 14 14:36:42.735823 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1229/2468] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:42 2022] GET /compute/v2.1/servers/bdd69c7d-4c91-46fa-bee9-fd8f45219ff3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:42.740939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a9498970-6eb3-4f0f-baa4-2be36a6180ab tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-656978267", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:42.741285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] validate_networks() for None {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:42.811928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a9498970-6eb3-4f0f-baa4-2be36a6180ab tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:43.271305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:43.272334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:43.273075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:43.273657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:43.274267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:43.299098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.299889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.300683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.301177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.342706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a9498970-6eb3-4f0f-baa4-2be36a6180ab tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] Getting quotas for project b2ad0980872542beb27bef91a37581dd. Resources: dict_keys(['metadata_items']) {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:43.351414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a9498970-6eb3-4f0f-baa4-2be36a6180ab tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] Getting quotas for user 631ab05847524a2e8eb267c4438b07f1 and project b2ad0980872542beb27bef91a37581dd. Resources: dict_keys(['metadata_items']) {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:43.353854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Getting quotas for project 8a0c595b04c74827b3c00228b9a57c27. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:43.374532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Getting quotas for user 89d755b092134384b11c41c5f63fcae4 and project 8a0c595b04c74827b3c00228b9a57c27. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:43.384772 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-a9498970-6eb3-4f0f-baa4-2be36a6180ab tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a9498970-6eb3-4f0f-baa4-2be36a6180ab tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] Request method failure captured: Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 1751 Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cn6HMaGuwK0WxNOV7UEjzMIulsNWVY2_qAIwSt--BaJ4DDKrZx5HQZNh7YrNrsY3-pFvdXlwKWHt-11BZtaGyr03mUTiFJ98qd0yEDLvHEQwRlRpkiuU6YuEDQM5Csjb3o2GjAIqN1P7YN1ZQkc8cv_i-zcsLDDBDwaP8g2mjb-jjk Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: b2ad0980872542beb27bef91a37581dd Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-2011929241 Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b2ad0980872542beb27bef91a37581dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b2ad0980872542beb27bef91a37581dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b2ad0980872542beb27bef91a37581dd", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b2ad0980872542beb27bef91a37581dd"}]}] Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-2011929241 Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: b2ad0980872542beb27bef91a37581dd Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-2011929241 Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 631ab05847524a2e8eb267c4438b07f1 Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-656978267", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:36:43.387353 n-d-767704-28 devstack@n-api.service[119511]: exception: Maximum number of metadata items exceeds 128 Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-656978267', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:36:43.389709 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 802, in create Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a9498970-6eb3-4f0f-baa4-2be36a6180ab tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:43.392401 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a9498970-6eb3-4f0f-baa4-2be36a6180ab tempest-AbsoluteLimitsNegativeTestJSON-2011929241 tempest-AbsoluteLimitsNegativeTestJSON-2011929241-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.653830 Jul 14 14:36:43.395031 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1230/2469] 10.222.0.81 () {60 vars in 1147 bytes} [Thu Jul 14 14:36:42 2022] POST /compute/v2.1/servers => generated 87 bytes in 657 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:36:43.395904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:43.398399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:43.401626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-51b3d6ab-ccc6-4b5d-8bab-cc24a812db59 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] Calling method '.version_select at 0x7fd6c61e2160>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:43.430669 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-51b3d6ab-ccc6-4b5d-8bab-cc24a812db59 tempest-ServersTestFqdnHostnames-1362932891 tempest-ServersTestFqdnHostnames-1362932891-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-712286250" status: 202 len: 0 microversion: 2.1 time: 0.035113 Jul 14 14:36:43.432409 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1231/2470] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jul 14 14:36:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-712286250 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:43.449761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-830a7a7a-0345-4780-bd63-f2c425611659 req-211c6086-9c41-42f9-b7fc-36a9e094f9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb1f152-0733-4f36-91a0-71797b749e16", "name": "network-vif-deleted", "tag": "db2d2768-461e-4832-b4e6-c4e4a8334c60"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:43.469636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-830a7a7a-0345-4780-bd63-f2c425611659 req-211c6086-9c41-42f9-b7fc-36a9e094f9d6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.473666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-830a7a7a-0345-4780-bd63-f2c425611659 req-211c6086-9c41-42f9-b7fc-36a9e094f9d6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.486894 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f4fde03c-1793-422e-980c-db5cb05ef838 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840024 Jul 14 14:36:43.486894 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1240/2471] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:36:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:36:43.500858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8ede3655-953c-4737-92c5-fa5bec7e253d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:43.501544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8ede3655-953c-4737-92c5-fa5bec7e253d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:43.518292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ede3655-953c-4737-92c5-fa5bec7e253d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.518762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ede3655-953c-4737-92c5-fa5bec7e253d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.522833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ede3655-953c-4737-92c5-fa5bec7e253d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.523304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ede3655-953c-4737-92c5-fa5bec7e253d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.532623 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-830a7a7a-0345-4780-bd63-f2c425611659 req-211c6086-9c41-42f9-b7fc-36a9e094f9d6 service nova] Creating event network-vif-deleted:db2d2768-461e-4832-b4e6-c4e4a8334c60 for instance deb1f152-0733-4f36-91a0-71797b749e16 on n-h1-767704-28 Jul 14 14:36:43.546127 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-830a7a7a-0345-4780-bd63-f2c425611659 req-211c6086-9c41-42f9-b7fc-36a9e094f9d6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112294 Jul 14 14:36:43.550135 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1232/2472] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:43.564056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-52fc32f9-2c2c-4925-8804-5863c5dd5210 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:43.564770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-52fc32f9-2c2c-4925-8804-5863c5dd5210 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:43.615342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:43.617109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ede3655-953c-4737-92c5-fa5bec7e253d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.617563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ede3655-953c-4737-92c5-fa5bec7e253d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.618260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-8ede3655-953c-4737-92c5-fa5bec7e253d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lazy-loading 'fault' on Instance uuid deb1f152-0733-4f36-91a0-71797b749e16 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:36:43.766338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-52fc32f9-2c2c-4925-8804-5863c5dd5210 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:43.769624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8ede3655-953c-4737-92c5-fa5bec7e253d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:43.777325 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-52fc32f9-2c2c-4925-8804-5863c5dd5210 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1213 microversion: 2.1 time: 0.222302 Jul 14 14:36:43.779968 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1233/2473] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:43 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1213 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:43.798185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77794551-4f2f-4538-81d2-f2f50e8dd3a7 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:43.800471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-77794551-4f2f-4538-81d2-f2f50e8dd3a7 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:43.800615 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8ede3655-953c-4737-92c5-fa5bec7e253d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 200 len: 1305 microversion: 2.1 time: 0.310483 Jul 14 14:36:43.812774 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1241/2474] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:43 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 1305 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:43.818534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a670bbb3-5717-4c75-9d54-c8db01d1cfe1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c56f1f70>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:43.828832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77794551-4f2f-4538-81d2-f2f50e8dd3a7 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.829321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77794551-4f2f-4538-81d2-f2f50e8dd3a7 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.830116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77794551-4f2f-4538-81d2-f2f50e8dd3a7 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.830542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77794551-4f2f-4538-81d2-f2f50e8dd3a7 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.878274 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a670bbb3-5717-4c75-9d54-c8db01d1cfe1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.064083 Jul 14 14:36:43.880085 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1242/2475] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:43 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:44.509682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-77794551-4f2f-4538-81d2-f2f50e8dd3a7 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:44.517664 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-77794551-4f2f-4538-81d2-f2f50e8dd3a7 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1315 microversion: 2.1 time: 0.736341 Jul 14 14:36:44.527936 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1234/2476] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:43 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1315 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:44.797854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-afa7274a-8002-409f-a22e-dbf205729323 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:44.799289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-afa7274a-8002-409f-a22e-dbf205729323 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:44.816485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afa7274a-8002-409f-a22e-dbf205729323 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:44.817266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afa7274a-8002-409f-a22e-dbf205729323 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:44.818306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afa7274a-8002-409f-a22e-dbf205729323 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:44.819351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-afa7274a-8002-409f-a22e-dbf205729323 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:44.822385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-555033f3-0f73-4b32-b7ac-7b6417ea2208 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:44.825481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-555033f3-0f73-4b32-b7ac-7b6417ea2208 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:44.843951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-555033f3-0f73-4b32-b7ac-7b6417ea2208 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:44.844422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-555033f3-0f73-4b32-b7ac-7b6417ea2208 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:44.845245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-555033f3-0f73-4b32-b7ac-7b6417ea2208 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:44.845898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-555033f3-0f73-4b32-b7ac-7b6417ea2208 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:44.861973 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-555033f3-0f73-4b32-b7ac-7b6417ea2208 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-555033f3-0f73-4b32-b7ac-7b6417ea2208 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 HTTP/1.1 Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'deb1f152-0733-4f36-91a0-71797b749e16'} Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:44.864263 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:44.870596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:44.870596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:44.870596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:44.870596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:44.870596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:44.870596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:36:44.870596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:36:44.870596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-555033f3-0f73-4b32-b7ac-7b6417ea2208 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:44.870596 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-555033f3-0f73-4b32-b7ac-7b6417ea2208 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 404 len: 111 microversion: 2.1 time: 0.051076 Jul 14 14:36:44.887507 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1235/2477] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:44 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:44.903379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f586a56-dcf7-4bba-a7f8-e0f523c8aa10 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c567e9d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:44.910878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-afa7274a-8002-409f-a22e-dbf205729323 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:44.936301 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-afa7274a-8002-409f-a22e-dbf205729323 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1265 microversion: 2.1 time: 0.144264 Jul 14 14:36:44.942605 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1243/2478] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:44 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:44.971658 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9f586a56-dcf7-4bba-a7f8-e0f523c8aa10 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.072795 Jul 14 14:36:44.972390 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1236/2479] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:44 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:45.034984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-755169460", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "e15a1c98-dd72-4729-94f4-9ad8a53d679a"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:45.094859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] validate_networks() for [('e15a1c98-dd72-4729-94f4-9ad8a53d679a', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:45.537771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aad576ef-fc15-4ead-b8f1-08d6d36a9601 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:45.539607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aad576ef-fc15-4ead-b8f1-08d6d36a9601 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:45.550937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aad576ef-fc15-4ead-b8f1-08d6d36a9601 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:45.551645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aad576ef-fc15-4ead-b8f1-08d6d36a9601 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:45.552638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aad576ef-fc15-4ead-b8f1-08d6d36a9601 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:45.553846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aad576ef-fc15-4ead-b8f1-08d6d36a9601 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:45.586115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:46.225340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:46.226109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:46.226721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:46.227236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:46.227753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:46.235994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aad576ef-fc15-4ead-b8f1-08d6d36a9601 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:46.246915 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aad576ef-fc15-4ead-b8f1-08d6d36a9601 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1315 microversion: 2.1 time: 0.715688 Jul 14 14:36:46.249427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:46.251581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:46.252669 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1237/2480] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:45 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1315 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:46.253197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:46.254089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:46.272407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ce074b25-ba33-4758-86c1-cf8370392950 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:46.273200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ce074b25-ba33-4758-86c1-cf8370392950 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:46.294911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce074b25-ba33-4758-86c1-cf8370392950 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:46.302729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce074b25-ba33-4758-86c1-cf8370392950 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:46.306100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:46.309453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce074b25-ba33-4758-86c1-cf8370392950 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:46.310133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce074b25-ba33-4758-86c1-cf8370392950 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:46.322734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Getting quotas for user d56c219e943b4398bea8add8299df84f and project 703f537dac264574ac66287c275cad22. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:46.358669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:46.360876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:46.466595 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-22ce80d5-573c-4ba9-a668-a00941856fb5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.433902 Jul 14 14:36:46.467284 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1244/2481] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:36:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:36:46.478833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-679196e9-140f-4406-9701-98568b78ff50 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5681700>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:46.521934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ce074b25-ba33-4758-86c1-cf8370392950 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:46.546005 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ce074b25-ba33-4758-86c1-cf8370392950 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1271 microversion: 2.1 time: 0.290185 Jul 14 14:36:46.547238 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1238/2482] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:46 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1271 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:46.556525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8955b248-07f0-49a8-bfc7-bce18db54beb tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:46.564034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8955b248-07f0-49a8-bfc7-bce18db54beb tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:46.594610 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-679196e9-140f-4406-9701-98568b78ff50 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.124269 Jul 14 14:36:46.595666 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1245/2483] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:46 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:46.737331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8955b248-07f0-49a8-bfc7-bce18db54beb tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:46.747793 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8955b248-07f0-49a8-bfc7-bce18db54beb tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1214 microversion: 2.1 time: 0.197863 Jul 14 14:36:46.755111 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1239/2484] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:46 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:47.274548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-02b2422a-0268-45f9-b7af-c5281a43971a tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:47.275257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-02b2422a-0268-45f9-b7af-c5281a43971a tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:47.304321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02b2422a-0268-45f9-b7af-c5281a43971a tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:47.309212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02b2422a-0268-45f9-b7af-c5281a43971a tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:47.314183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02b2422a-0268-45f9-b7af-c5281a43971a tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:47.318146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02b2422a-0268-45f9-b7af-c5281a43971a tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:47.394290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-7a49d04a-ff8a-4a61-92c9-9c460271904a req-96f46273-7f35-4605-85d6-03ec53d54b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83dae6b9-f87b-4ee4-ab0d-3706cd2602a2", "name": "network-vif-plugged", "status": "completed", "tag": "9462ad9c-5eb2-40e6-922b-2e480cd3ce7b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:47.435091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7a49d04a-ff8a-4a61-92c9-9c460271904a req-96f46273-7f35-4605-85d6-03ec53d54b4d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:47.439068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7a49d04a-ff8a-4a61-92c9-9c460271904a req-96f46273-7f35-4605-85d6-03ec53d54b4d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:47.467419 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-7a49d04a-ff8a-4a61-92c9-9c460271904a req-96f46273-7f35-4605-85d6-03ec53d54b4d service nova] Creating event network-vif-plugged:9462ad9c-5eb2-40e6-922b-2e480cd3ce7b for instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 on n-h1-767704-28 Jul 14 14:36:47.489070 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-7a49d04a-ff8a-4a61-92c9-9c460271904a req-96f46273-7f35-4605-85d6-03ec53d54b4d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099204 Jul 14 14:36:47.490376 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1240/2485] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 14 14:36:47.566562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9004765e-2d4d-4781-8b09-88a049e1bc23 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:47.567637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9004765e-2d4d-4781-8b09-88a049e1bc23 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:47.586125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9004765e-2d4d-4781-8b09-88a049e1bc23 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:47.594683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9004765e-2d4d-4781-8b09-88a049e1bc23 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:47.595908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9004765e-2d4d-4781-8b09-88a049e1bc23 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:47.598584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9004765e-2d4d-4781-8b09-88a049e1bc23 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:47.877660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-02b2422a-0268-45f9-b7af-c5281a43971a tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:47.890097 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-02b2422a-0268-45f9-b7af-c5281a43971a tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1315 microversion: 2.1 time: 0.622099 Jul 14 14:36:47.895047 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1246/2486] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:47 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:47.914956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-507160d7-f34f-4154-a7e2-69283aabbad8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5b43e50>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:47.920691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9004765e-2d4d-4781-8b09-88a049e1bc23 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:47.941495 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9004765e-2d4d-4781-8b09-88a049e1bc23 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1271 microversion: 2.1 time: 0.380467 Jul 14 14:36:47.944912 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1241/2487] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:47 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1271 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:47.968406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b1f0ca9c-e6f5-44b1-ae12-995a3dc20485 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:47.977865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b1f0ca9c-e6f5-44b1-ae12-995a3dc20485 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:48.015429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1f0ca9c-e6f5-44b1-ae12-995a3dc20485 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:48.016324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1f0ca9c-e6f5-44b1-ae12-995a3dc20485 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:48.017842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1f0ca9c-e6f5-44b1-ae12-995a3dc20485 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:48.018500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1f0ca9c-e6f5-44b1-ae12-995a3dc20485 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:48.053288 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-507160d7-f34f-4154-a7e2-69283aabbad8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.155408 Jul 14 14:36:48.054593 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1247/2488] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:47 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:48.292057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b1f0ca9c-e6f5-44b1-ae12-995a3dc20485 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:48.311512 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b1f0ca9c-e6f5-44b1-ae12-995a3dc20485 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1266 microversion: 2.1 time: 0.362524 Jul 14 14:36:48.323684 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1242/2489] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:47 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1266 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:48.914590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b494e4a-fdca-41d4-a340-399b9ad09234 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:48.915224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1b494e4a-fdca-41d4-a340-399b9ad09234 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:48.936093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b494e4a-fdca-41d4-a340-399b9ad09234 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:48.936823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b494e4a-fdca-41d4-a340-399b9ad09234 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:48.938988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b494e4a-fdca-41d4-a340-399b9ad09234 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:48.944210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b494e4a-fdca-41d4-a340-399b9ad09234 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:48.971720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e83421b-1b8e-4cab-9942-677b6a1c3b1e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:48.971720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5e83421b-1b8e-4cab-9942-677b6a1c3b1e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:49.003771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e83421b-1b8e-4cab-9942-677b6a1c3b1e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:49.004757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e83421b-1b8e-4cab-9942-677b6a1c3b1e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:49.018342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e83421b-1b8e-4cab-9942-677b6a1c3b1e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:49.019265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e83421b-1b8e-4cab-9942-677b6a1c3b1e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:50.340478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5e83421b-1b8e-4cab-9942-677b6a1c3b1e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:50.366076 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5e83421b-1b8e-4cab-9942-677b6a1c3b1e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1313 microversion: 2.1 time: 1.407801 Jul 14 14:36:50.381805 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1243/2490] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:48 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1313 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:50.405020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-95282e7a-e212-49d8-a287-5afb87e34da5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5e55700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:50.457672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1b494e4a-fdca-41d4-a340-399b9ad09234 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:50.481006 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1b494e4a-fdca-41d4-a340-399b9ad09234 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1315 microversion: 2.1 time: 1.571746 Jul 14 14:36:50.482629 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1248/2491] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:48 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1315 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:50.509846 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-95282e7a-e212-49d8-a287-5afb87e34da5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.126557 Jul 14 14:36:50.517347 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1244/2492] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:50 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:50.525462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ec3eb47-ea72-4438-8b1d-16e3fe8e936e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:50.529064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-5e85df33-6003-4ecb-9c71-2ea96a177ef2 req-a7dc1749-d2e6-45d1-8944-615a027aaf47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42b1bbb-db42-4319-8676-09a2ab7931a4", "tag": "82fed217-982e-4197-ac83-35630f9e27e5"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:50.530758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ec3eb47-ea72-4438-8b1d-16e3fe8e936e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:50.563037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ec3eb47-ea72-4438-8b1d-16e3fe8e936e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:50.565839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ec3eb47-ea72-4438-8b1d-16e3fe8e936e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:50.571252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5e85df33-6003-4ecb-9c71-2ea96a177ef2 req-a7dc1749-d2e6-45d1-8944-615a027aaf47 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:50.571780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ec3eb47-ea72-4438-8b1d-16e3fe8e936e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:50.572276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ec3eb47-ea72-4438-8b1d-16e3fe8e936e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:50.572811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5e85df33-6003-4ecb-9c71-2ea96a177ef2 req-a7dc1749-d2e6-45d1-8944-615a027aaf47 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:50.609420 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-5e85df33-6003-4ecb-9c71-2ea96a177ef2 req-a7dc1749-d2e6-45d1-8944-615a027aaf47 service nova] Creating event network-changed:82fed217-982e-4197-ac83-35630f9e27e5 for instance d42b1bbb-db42-4319-8676-09a2ab7931a4 on n-h1-767704-28 Jul 14 14:36:50.622652 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-5e85df33-6003-4ecb-9c71-2ea96a177ef2 req-a7dc1749-d2e6-45d1-8944-615a027aaf47 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101379 Jul 14 14:36:50.628008 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1245/2493] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:50.845867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ec3eb47-ea72-4438-8b1d-16e3fe8e936e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:50.855728 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ec3eb47-ea72-4438-8b1d-16e3fe8e936e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1272 microversion: 2.1 time: 0.366006 Jul 14 14:36:50.865656 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1249/2494] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:50 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1272 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:51.388622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5f1159a-f85a-41bb-8d3b-1e7a4d212eda tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:51.397938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d5f1159a-f85a-41bb-8d3b-1e7a4d212eda tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:51.451254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5f1159a-f85a-41bb-8d3b-1e7a4d212eda tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.459226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5f1159a-f85a-41bb-8d3b-1e7a4d212eda tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.465288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5f1159a-f85a-41bb-8d3b-1e7a4d212eda tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.472939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5f1159a-f85a-41bb-8d3b-1e7a4d212eda tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.504386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7b9e6b9f-9488-4e27-970f-b5f577c3ab8d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:51.506329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7b9e6b9f-9488-4e27-970f-b5f577c3ab8d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:51.555902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b9e6b9f-9488-4e27-970f-b5f577c3ab8d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.556693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b9e6b9f-9488-4e27-970f-b5f577c3ab8d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.566370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b9e6b9f-9488-4e27-970f-b5f577c3ab8d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.567128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b9e6b9f-9488-4e27-970f-b5f577c3ab8d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:52.574532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:52.765519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7b9e6b9f-9488-4e27-970f-b5f577c3ab8d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:52.779312 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7b9e6b9f-9488-4e27-970f-b5f577c3ab8d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1315 microversion: 2.1 time: 1.281893 Jul 14 14:36:52.793333 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1250/2495] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:51 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1315 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:52.813451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1182aa0f-9a3d-4771-8064-98df9d46cfe8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5e15ee0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:52.928380 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1182aa0f-9a3d-4771-8064-98df9d46cfe8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.133775 Jul 14 14:36:52.929000 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1251/2496] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:52 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:52.940328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b3c22930-0128-4d4a-b58f-191bf7c9e0c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:52.941216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b3c22930-0128-4d4a-b58f-191bf7c9e0c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:52.950158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3c22930-0128-4d4a-b58f-191bf7c9e0c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:52.950878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3c22930-0128-4d4a-b58f-191bf7c9e0c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:52.956010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3c22930-0128-4d4a-b58f-191bf7c9e0c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:52.962826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3c22930-0128-4d4a-b58f-191bf7c9e0c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:52.971702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:53.084746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d5f1159a-f85a-41bb-8d3b-1e7a4d212eda tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:53.134824 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d5f1159a-f85a-41bb-8d3b-1e7a4d212eda tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1313 microversion: 2.1 time: 1.753187 Jul 14 14:36:53.138693 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1246/2497] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:51 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1313 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:53.150540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-fbce9230-040b-4694-801d-e99a035e5188 req-27ee1f04-880c-4852-9dcc-9a882db2a021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68217dfd-b29a-45a3-b3ec-e2e0a3fca887", "name": "network-vif-plugged", "status": "completed", "tag": "5b7dd2ba-3b91-4c6a-9733-caca69e51884"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:53.173264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-fbce9230-040b-4694-801d-e99a035e5188 req-27ee1f04-880c-4852-9dcc-9a882db2a021 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:53.183590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-fbce9230-040b-4694-801d-e99a035e5188 req-27ee1f04-880c-4852-9dcc-9a882db2a021 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:53.234805 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-fbce9230-040b-4694-801d-e99a035e5188 req-27ee1f04-880c-4852-9dcc-9a882db2a021 service nova] Creating event network-vif-plugged:5b7dd2ba-3b91-4c6a-9733-caca69e51884 for instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 on n-h1-767704-28 Jul 14 14:36:53.247889 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-fbce9230-040b-4694-801d-e99a035e5188 req-27ee1f04-880c-4852-9dcc-9a882db2a021 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106510 Jul 14 14:36:53.250612 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1247/2498] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:53.798103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-abd9f74a-753a-4452-8751-87e1d3e9c25f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:53.798816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-abd9f74a-753a-4452-8751-87e1d3e9c25f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:53.816246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abd9f74a-753a-4452-8751-87e1d3e9c25f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:53.819658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abd9f74a-753a-4452-8751-87e1d3e9c25f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:53.820588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abd9f74a-753a-4452-8751-87e1d3e9c25f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:53.821073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abd9f74a-753a-4452-8751-87e1d3e9c25f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:53.975434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b3c22930-0128-4d4a-b58f-191bf7c9e0c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:54.000214 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b3c22930-0128-4d4a-b58f-191bf7c9e0c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1314 microversion: 2.1 time: 1.064207 Jul 14 14:36:54.004761 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1252/2499] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:52 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1314 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:54.013482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c765a34-004e-46b5-b72f-b8b7b2584cbb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c6690e50>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:54.128196 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1c765a34-004e-46b5-b72f-b8b7b2584cbb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.119074 Jul 14 14:36:54.128816 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1253/2500] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:54 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:54.158176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a67949aa-0655-4c85-b0d6-a90a1c76f822 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:54.159030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a67949aa-0655-4c85-b0d6-a90a1c76f822 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:54.180050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a67949aa-0655-4c85-b0d6-a90a1c76f822 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:54.182304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a67949aa-0655-4c85-b0d6-a90a1c76f822 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:54.183309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a67949aa-0655-4c85-b0d6-a90a1c76f822 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:54.184981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a67949aa-0655-4c85-b0d6-a90a1c76f822 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:54.911974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-abd9f74a-753a-4452-8751-87e1d3e9c25f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:54.925938 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-abd9f74a-753a-4452-8751-87e1d3e9c25f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1315 microversion: 2.1 time: 1.128567 Jul 14 14:36:54.927388 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1248/2501] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:53 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1315 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:55.032456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4b0d12f2-f728-4823-b4d2-d6d9dabbd45b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:55.033656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4b0d12f2-f728-4823-b4d2-d6d9dabbd45b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:55.062222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b0d12f2-f728-4823-b4d2-d6d9dabbd45b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:55.063590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b0d12f2-f728-4823-b4d2-d6d9dabbd45b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:55.065823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b0d12f2-f728-4823-b4d2-d6d9dabbd45b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:55.066685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b0d12f2-f728-4823-b4d2-d6d9dabbd45b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:55.175162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a67949aa-0655-4c85-b0d6-a90a1c76f822 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:55.197588 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a67949aa-0655-4c85-b0d6-a90a1c76f822 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1313 microversion: 2.1 time: 1.046048 Jul 14 14:36:55.203059 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1254/2502] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:54 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1313 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:55.216692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36189c18-fd12-4146-a103-578258f0289d tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5681ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:55.322487 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-36189c18-fd12-4146-a103-578258f0289d tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.117850 Jul 14 14:36:55.323458 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1255/2503] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:55 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:55.928864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4b0d12f2-f728-4823-b4d2-d6d9dabbd45b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:55.941894 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4b0d12f2-f728-4823-b4d2-d6d9dabbd45b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1314 microversion: 2.1 time: 0.921259 Jul 14 14:36:55.955193 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1249/2504] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:55 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1314 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:55.955937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e16e7044-8e84-49a1-9e5d-f9c613112ba5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:55.956592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e16e7044-8e84-49a1-9e5d-f9c613112ba5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:55.981546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e16e7044-8e84-49a1-9e5d-f9c613112ba5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:55.982018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e16e7044-8e84-49a1-9e5d-f9c613112ba5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:55.993633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e16e7044-8e84-49a1-9e5d-f9c613112ba5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:55.996823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e16e7044-8e84-49a1-9e5d-f9c613112ba5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:56.235147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2238f95c-fcfb-4efa-b691-6c3b269631f0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:56.236569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2238f95c-fcfb-4efa-b691-6c3b269631f0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:56.267075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2238f95c-fcfb-4efa-b691-6c3b269631f0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:56.268254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2238f95c-fcfb-4efa-b691-6c3b269631f0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:56.270836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2238f95c-fcfb-4efa-b691-6c3b269631f0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:56.277590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2238f95c-fcfb-4efa-b691-6c3b269631f0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:56.280643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:56.346590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=14 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:56.611753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e16e7044-8e84-49a1-9e5d-f9c613112ba5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:56.626622 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e16e7044-8e84-49a1-9e5d-f9c613112ba5 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1315 microversion: 2.1 time: 0.686613 Jul 14 14:36:56.629254 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1256/2505] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:55 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:56.643732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a4cf1f88-af6e-4022-a247-7134a058c2fa tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5bdfa60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:56.744262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=18 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:56.758945 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a4cf1f88-af6e-4022-a247-7134a058c2fa tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.127544 Jul 14 14:36:56.766794 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1257/2506] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:56 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:56.785418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ffaaefe7-dde1-4b8c-b65e-a02d9f1a429b req-059712fc-8653-41a4-9181-47e3e2f5f434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9651eb2-09b7-4fe5-830c-c1974c834b44", "tag": "e696bab4-d60d-4215-8658-6bde817e300f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:56.825368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ffaaefe7-dde1-4b8c-b65e-a02d9f1a429b req-059712fc-8653-41a4-9181-47e3e2f5f434 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:56.828418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ffaaefe7-dde1-4b8c-b65e-a02d9f1a429b req-059712fc-8653-41a4-9181-47e3e2f5f434 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:56.869128 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ffaaefe7-dde1-4b8c-b65e-a02d9f1a429b req-059712fc-8653-41a4-9181-47e3e2f5f434 service nova] Creating event network-changed:e696bab4-d60d-4215-8658-6bde817e300f for instance b9651eb2-09b7-4fe5-830c-c1974c834b44 on n-h2-767704-28 Jul 14 14:36:56.957589 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ffaaefe7-dde1-4b8c-b65e-a02d9f1a429b req-059712fc-8653-41a4-9181-47e3e2f5f434 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187177 Jul 14 14:36:56.965705 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1258/2507] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:56.985319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e61a1f94-00c4-4160-b445-f866d2797b31 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:56.994472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e61a1f94-00c4-4160-b445-f866d2797b31 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:57.028700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e61a1f94-00c4-4160-b445-f866d2797b31 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:57.029485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e61a1f94-00c4-4160-b445-f866d2797b31 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:57.030518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e61a1f94-00c4-4160-b445-f866d2797b31 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:57.031131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e61a1f94-00c4-4160-b445-f866d2797b31 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:57.053825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2238f95c-fcfb-4efa-b691-6c3b269631f0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:57.077129 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2238f95c-fcfb-4efa-b691-6c3b269631f0 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1313 microversion: 2.1 time: 0.845818 Jul 14 14:36:57.081059 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1250/2508] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:56 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1313 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:57.643602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-67023829-5966-4697-81a7-5b00305f4b43 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:57.644224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-67023829-5966-4697-81a7-5b00305f4b43 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:57.655727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-67023829-5966-4697-81a7-5b00305f4b43 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:57.666212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-67023829-5966-4697-81a7-5b00305f4b43 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:57.669665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-67023829-5966-4697-81a7-5b00305f4b43 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:57.670130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-67023829-5966-4697-81a7-5b00305f4b43 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:58.595651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e61a1f94-00c4-4160-b445-f866d2797b31 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:58.606744 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e61a1f94-00c4-4160-b445-f866d2797b31 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1314 microversion: 2.1 time: 1.639319 Jul 14 14:36:58.607344 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1259/2509] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:56 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1314 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:58.626667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1a6860b1-00ea-459b-9efc-96bc1ad0b04f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c6741700>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:58.714071 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1a6860b1-00ea-459b-9efc-96bc1ad0b04f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.094816 Jul 14 14:36:58.714755 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1260/2510] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:58 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:58.734220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-67023829-5966-4697-81a7-5b00305f4b43 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:58.738766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-30617b70-b8c0-4692-a195-36f06a18030a tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:58.741530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-30617b70-b8c0-4692-a195-36f06a18030a tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:58.743700 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-67023829-5966-4697-81a7-5b00305f4b43 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1504 microversion: 2.1 time: 1.103859 Jul 14 14:36:58.752348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30617b70-b8c0-4692-a195-36f06a18030a tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:58.753199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30617b70-b8c0-4692-a195-36f06a18030a tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:58.754216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30617b70-b8c0-4692-a195-36f06a18030a tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:58.755006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30617b70-b8c0-4692-a195-36f06a18030a tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:58.765807 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1251/2511] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:57 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1504 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:58.793355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b7313e3c-1e3b-40ca-be57-cfb84fb16bd1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1404400151"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:58.794153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b7313e3c-1e3b-40ca-be57-cfb84fb16bd1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:58.812711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7313e3c-1e3b-40ca-be57-cfb84fb16bd1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:58.813219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7313e3c-1e3b-40ca-be57-cfb84fb16bd1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:58.814669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7313e3c-1e3b-40ca-be57-cfb84fb16bd1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:58.817083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7313e3c-1e3b-40ca-be57-cfb84fb16bd1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:00.325264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-30617b70-b8c0-4692-a195-36f06a18030a tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:00.337981 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-30617b70-b8c0-4692-a195-36f06a18030a tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1313 microversion: 2.1 time: 1.611292 Jul 14 14:37:00.353161 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1261/2512] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:58 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1313 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:00.366426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77a12910-71c7-45fd-8187-08643becf321 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:00.368662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-77a12910-71c7-45fd-8187-08643becf321 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:00.387292 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.network.security_group_api [None req-b7313e3c-1e3b-40ca-be57-cfb84fb16bd1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Adding security group da40307a-6d46-430a-8597-998e571898cd to port 5b7dd2ba-3b91-4c6a-9733-caca69e51884 Jul 14 14:37:00.393894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77a12910-71c7-45fd-8187-08643becf321 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:00.396317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77a12910-71c7-45fd-8187-08643becf321 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:00.399994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77a12910-71c7-45fd-8187-08643becf321 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:00.402377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77a12910-71c7-45fd-8187-08643becf321 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:01.576892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-77a12910-71c7-45fd-8187-08643becf321 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:01.595474 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-77a12910-71c7-45fd-8187-08643becf321 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1314 microversion: 2.1 time: 1.240665 Jul 14 14:37:01.597611 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1262/2513] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:00 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1314 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:01.605591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4d99c473-873d-4ffe-8f41-a0ed135cd7b1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5e60b80>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:01.708434 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4d99c473-873d-4ffe-8f41-a0ed135cd7b1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.109001 Jul 14 14:37:01.709196 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1263/2514] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:01 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:01.719473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-27136b2c-edee-4ca9-895f-d1e466cd0a75 req-06ed3994-c83f-4919-a814-3b5ebeb8a444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42b1bbb-db42-4319-8676-09a2ab7931a4", "name": "network-vif-plugged", "status": "completed", "tag": "82fed217-982e-4197-ac83-35630f9e27e5"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:01.756095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-27136b2c-edee-4ca9-895f-d1e466cd0a75 req-06ed3994-c83f-4919-a814-3b5ebeb8a444 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:01.759281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-27136b2c-edee-4ca9-895f-d1e466cd0a75 req-06ed3994-c83f-4919-a814-3b5ebeb8a444 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:01.798472 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-27136b2c-edee-4ca9-895f-d1e466cd0a75 req-06ed3994-c83f-4919-a814-3b5ebeb8a444 service nova] Creating event network-vif-plugged:82fed217-982e-4197-ac83-35630f9e27e5 for instance d42b1bbb-db42-4319-8676-09a2ab7931a4 on n-h1-767704-28 Jul 14 14:37:01.833653 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-27136b2c-edee-4ca9-895f-d1e466cd0a75 req-06ed3994-c83f-4919-a814-3b5ebeb8a444 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123092 Jul 14 14:37:01.837311 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1264/2515] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:01.852592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a3d31d84-2e88-4be4-b6e0-3fff696d67d6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:01.853621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a3d31d84-2e88-4be4-b6e0-3fff696d67d6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:01.873150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3d31d84-2e88-4be4-b6e0-3fff696d67d6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:01.874239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3d31d84-2e88-4be4-b6e0-3fff696d67d6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:01.875326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3d31d84-2e88-4be4-b6e0-3fff696d67d6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:01.876708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3d31d84-2e88-4be4-b6e0-3fff696d67d6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:03.100611 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b7313e3c-1e3b-40ca-be57-cfb84fb16bd1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887/action" status: 202 len: 0 microversion: 2.1 time: 4.324580 Jul 14 14:37:03.101287 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1252/2516] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:36:58 2022] POST /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887/action => generated 0 bytes in 4327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:03.107726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bb4cc9df-7763-4d3c-939c-ad6d97289c23 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:03.109389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bb4cc9df-7763-4d3c-939c-ad6d97289c23 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:03.152652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb4cc9df-7763-4d3c-939c-ad6d97289c23 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:03.158593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb4cc9df-7763-4d3c-939c-ad6d97289c23 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:03.160491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb4cc9df-7763-4d3c-939c-ad6d97289c23 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:03.169198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb4cc9df-7763-4d3c-939c-ad6d97289c23 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:04.428938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a3d31d84-2e88-4be4-b6e0-3fff696d67d6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:04.444066 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a3d31d84-2e88-4be4-b6e0-3fff696d67d6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1313 microversion: 2.1 time: 2.601858 Jul 14 14:37:04.450545 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1265/2517] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:01 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1313 bytes in 2611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:04.481771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b0963789-42de-4492-853a-ff317e54419e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c65ccee0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:04.623892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bb4cc9df-7763-4d3c-939c-ad6d97289c23 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:04.648231 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b0963789-42de-4492-853a-ff317e54419e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.191577 Jul 14 14:37:04.652382 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1266/2518] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:04 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:04.683689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d7286075-3861-40fd-96ba-d27ec9e456d2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c5e60940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:04.686635 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bb4cc9df-7763-4d3c-939c-ad6d97289c23 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1314 microversion: 2.1 time: 1.584269 Jul 14 14:37:04.700113 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1253/2519] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:03 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1314 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:04.716629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-15babd2c-7afb-48b3-bf85-0c9a957e0451 req-26c3556c-fdd1-468d-8fbc-ca2c452f131b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68217dfd-b29a-45a3-b3ec-e2e0a3fca887", "tag": "5b7dd2ba-3b91-4c6a-9733-caca69e51884"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:04.734791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-15babd2c-7afb-48b3-bf85-0c9a957e0451 req-26c3556c-fdd1-468d-8fbc-ca2c452f131b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:04.736244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-15babd2c-7afb-48b3-bf85-0c9a957e0451 req-26c3556c-fdd1-468d-8fbc-ca2c452f131b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:04.765694 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-15babd2c-7afb-48b3-bf85-0c9a957e0451 req-26c3556c-fdd1-468d-8fbc-ca2c452f131b service nova] Creating event network-changed:5b7dd2ba-3b91-4c6a-9733-caca69e51884 for instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 on n-h1-767704-28 Jul 14 14:37:04.774759 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-15babd2c-7afb-48b3-bf85-0c9a957e0451 req-26c3556c-fdd1-468d-8fbc-ca2c452f131b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071832 Jul 14 14:37:04.778727 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1254/2520] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:05.473482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f362b547-2a7b-4c3d-afdd-bbe94a2baf52 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:05.481199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f362b547-2a7b-4c3d-afdd-bbe94a2baf52 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:05.533723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f362b547-2a7b-4c3d-afdd-bbe94a2baf52 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.534434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f362b547-2a7b-4c3d-afdd-bbe94a2baf52 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.543220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f362b547-2a7b-4c3d-afdd-bbe94a2baf52 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.543892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f362b547-2a7b-4c3d-afdd-bbe94a2baf52 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.679552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG neutronclient.v2_0.client [None req-d7286075-3861-40fd-96ba-d27ec9e456d2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group da40307a-6d46-430a-8597-998e571898cd in use.", "detail": ""}} {{(pid=119512) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:37:05.680348 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-d7286075-3861-40fd-96ba-d27ec9e456d2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Security Group da40307a-6d46-430a-8597-998e571898cd in use. Jul 14 14:37:05.680348 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-18a0670b-d850-4ead-8d0f-0ced8a131d97'] Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d7286075-3861-40fd-96ba-d27ec9e456d2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-security-groups/da40307a-6d46-430a-8597-998e571898cd HTTP/1.1 Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: exception: Security Group da40307a-6d46-430a-8597-998e571898cd in use. Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-18a0670b-d850-4ead-8d0f-0ced8a131d97'] Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'da40307a-6d46-430a-8597-998e571898cd'} Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:37:05.682864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group da40307a-6d46-430a-8597-998e571898cd in use. Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18a0670b-d850-4ead-8d0f-0ced8a131d97'] Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group da40307a-6d46-430a-8597-998e571898cd in use. Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18a0670b-d850-4ead-8d0f-0ced8a131d97'] Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group da40307a-6d46-430a-8597-998e571898cd in use. Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18a0670b-d850-4ead-8d0f-0ced8a131d97'] Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group da40307a-6d46-430a-8597-998e571898cd in use. Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18a0670b-d850-4ead-8d0f-0ced8a131d97'] Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d7286075-3861-40fd-96ba-d27ec9e456d2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 400 to user: Security Group da40307a-6d46-430a-8597-998e571898cd in use. Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-18a0670b-d850-4ead-8d0f-0ced8a131d97'] {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d7286075-3861-40fd-96ba-d27ec9e456d2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/da40307a-6d46-430a-8597-998e571898cd" status: 400 len: 185 microversion: 2.1 time: 1.029922 Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1267/2521] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:04 2022] DELETE /compute/v2.1/os-security-groups/da40307a-6d46-430a-8597-998e571898cd => generated 185 bytes in 1032 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:37:05.690832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ec8c8eee-7f76-4996-8dc6-0b76fdfa0cea tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c605b820>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:05.794700 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ec8c8eee-7f76-4996-8dc6-0b76fdfa0cea tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.104885 Jul 14 14:37:05.797796 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1268/2522] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:05 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:05.816857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f45e689f-6089-440c-8194-19eac85641f1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:05.819087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f45e689f-6089-440c-8194-19eac85641f1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:05.849922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f45e689f-6089-440c-8194-19eac85641f1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.850394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f45e689f-6089-440c-8194-19eac85641f1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.851204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f45e689f-6089-440c-8194-19eac85641f1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.851647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f45e689f-6089-440c-8194-19eac85641f1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:06.085634 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f45e689f-6089-440c-8194-19eac85641f1 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887/action" status: 202 len: 0 microversion: 2.1 time: 0.286552 Jul 14 14:37:06.088378 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1269/2523] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:05 2022] POST /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:06.102944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-382090e0-10c9-4353-a0b7-a30d017e666b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:06.108652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-382090e0-10c9-4353-a0b7-a30d017e666b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:06.128514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-382090e0-10c9-4353-a0b7-a30d017e666b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:06.129864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-382090e0-10c9-4353-a0b7-a30d017e666b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:06.130858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-382090e0-10c9-4353-a0b7-a30d017e666b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:06.131464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-382090e0-10c9-4353-a0b7-a30d017e666b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:06.433490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f362b547-2a7b-4c3d-afdd-bbe94a2baf52 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:06.455713 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f362b547-2a7b-4c3d-afdd-bbe94a2baf52 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1463 microversion: 2.1 time: 0.987985 Jul 14 14:37:06.456691 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1255/2524] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:05 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1463 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:37:06.474771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4c7564cf-51c9-43f3-acea-7ef478778f6e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:06.475922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4c7564cf-51c9-43f3-acea-7ef478778f6e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:06.494363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c7564cf-51c9-43f3-acea-7ef478778f6e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:06.500411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c7564cf-51c9-43f3-acea-7ef478778f6e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:06.509172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c7564cf-51c9-43f3-acea-7ef478778f6e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:06.510770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c7564cf-51c9-43f3-acea-7ef478778f6e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.394608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-382090e0-10c9-4353-a0b7-a30d017e666b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:07.408302 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-382090e0-10c9-4353-a0b7-a30d017e666b tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1314 microversion: 2.1 time: 1.317052 Jul 14 14:37:07.409279 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1270/2525] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:06 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1314 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:07.798644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4c7564cf-51c9-43f3-acea-7ef478778f6e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:07.811862 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4c7564cf-51c9-43f3-acea-7ef478778f6e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1575 microversion: 2.1 time: 1.353868 Jul 14 14:37:07.812461 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1256/2526] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:06 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1575 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:07.820661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a5a82b08-b4d7-4921-a7b9-6ea34bee7393 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cad0c790>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:07.933798 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a5a82b08-b4d7-4921-a7b9-6ea34bee7393 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.120156 Jul 14 14:37:07.934993 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1257/2527] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:07 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:08.034849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-39c951d7-4605-4299-b477-41a9a67f2a67 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:08.039652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-39c951d7-4605-4299-b477-41a9a67f2a67 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Searching by: {'deleted': False, 'project_id': '0243c2dec64e4de0aa0800fedd1fbfe7'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:08.085480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39c951d7-4605-4299-b477-41a9a67f2a67 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:08.087909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39c951d7-4605-4299-b477-41a9a67f2a67 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:08.094803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39c951d7-4605-4299-b477-41a9a67f2a67 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:08.098454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39c951d7-4605-4299-b477-41a9a67f2a67 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:08.274389 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-39c951d7-4605-4299-b477-41a9a67f2a67 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.858121 Jul 14 14:37:08.275825 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1271/2528] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:37:07 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:37:08.292628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc50119c-5392-4411-9705-c7017e5367bf tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:08.299758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cc50119c-5392-4411-9705-c7017e5367bf tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Searching by: {'deleted': False} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:08.311983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc50119c-5392-4411-9705-c7017e5367bf tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:08.314779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc50119c-5392-4411-9705-c7017e5367bf tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:08.324198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc50119c-5392-4411-9705-c7017e5367bf tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:08.324939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc50119c-5392-4411-9705-c7017e5367bf tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:08.328924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-482905828", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "f7f647f4-8936-4576-8231-3570e86f95fa"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:08.467471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] validate_networks() for [('f7f647f4-8936-4576-8231-3570e86f95fa', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:37:08.572557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-cc50119c-5392-4411-9705-c7017e5367bf tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:08.780224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc50119c-5392-4411-9705-c7017e5367bf tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:08.783077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc50119c-5392-4411-9705-c7017e5367bf tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.018481 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc50119c-5392-4411-9705-c7017e5367bf tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 13019 microversion: 2.1 time: 1.730389 Jul 14 14:37:10.019450 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1272/2529] 10.222.0.81 () {58 vars in 1170 bytes} [Thu Jul 14 14:37:08 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 13019 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:37:10.038278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a689c54-5112-4b72-93dc-27352382043c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:10.039222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3a689c54-5112-4b72-93dc-27352382043c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:10.053219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a689c54-5112-4b72-93dc-27352382043c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.055963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a689c54-5112-4b72-93dc-27352382043c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.057953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a689c54-5112-4b72-93dc-27352382043c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.062013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a689c54-5112-4b72-93dc-27352382043c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.173489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:10.174973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:10.175671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:10.176439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:10.177144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:10.195891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:10.217224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.218038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.219707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.227634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.281589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Getting quotas for project 9c1ec8796d414035aee2a18ba3e2cfa4. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:10.290815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Getting quotas for user adb334fc0f7a4db3861ebe09a695fb20 and project 9c1ec8796d414035aee2a18ba3e2cfa4. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:10.319983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:37:10.324843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:37:10.418706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3a689c54-5112-4b72-93dc-27352382043c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:10.433695 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3a689c54-5112-4b72-93dc-27352382043c tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1314 microversion: 2.1 time: 0.412949 Jul 14 14:37:10.434665 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1273/2530] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:10 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:10.440859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0d5480ed-f429-4930-a267-8c25d75fa583 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:10.461456 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-48e5c55b-3987-44ae-9d7b-58c1569695b5 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.522809 Jul 14 14:37:10.462673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0d5480ed-f429-4930-a267-8c25d75fa583 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:10.465632 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1258/2531] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:37:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2530 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:37:10.472047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c1c6970b-4b00-4d36-bc3f-592499348d95 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c567e0d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:10.496983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d5480ed-f429-4930-a267-8c25d75fa583 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.503838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d5480ed-f429-4930-a267-8c25d75fa583 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.514021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d5480ed-f429-4930-a267-8c25d75fa583 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.514733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d5480ed-f429-4930-a267-8c25d75fa583 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.562242 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c1c6970b-4b00-4d36-bc3f-592499348d95 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.095638 Jul 14 14:37:10.563783 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1259/2532] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:10 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:10.577696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4481306a-7ef1-40f1-9aab-878f01e5d147 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:10.586082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4481306a-7ef1-40f1-9aab-878f01e5d147 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Searching by: {'deleted': False, 'project_id': '0243c2dec64e4de0aa0800fedd1fbfe7'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:10.644803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4481306a-7ef1-40f1-9aab-878f01e5d147 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.645349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4481306a-7ef1-40f1-9aab-878f01e5d147 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.646227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4481306a-7ef1-40f1-9aab-878f01e5d147 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.646678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4481306a-7ef1-40f1-9aab-878f01e5d147 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.723507 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4481306a-7ef1-40f1-9aab-878f01e5d147 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/detail?tenant_id=8a0c595b04c74827b3c00228b9a57c27" status: 200 len: 15 microversion: 2.1 time: 0.158857 Jul 14 14:37:10.724301 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1260/2533] 10.222.0.81 () {58 vars in 1230 bytes} [Thu Jul 14 14:37:10 2022] GET /compute/v2.1/servers/detail?tenant_id=8a0c595b04c74827b3c00228b9a57c27 => generated 15 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:37:10.752863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-924c05f9-7558-42fc-82a1-a5f243d5639a tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:10.756444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-924c05f9-7558-42fc-82a1-a5f243d5639a tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:11.083992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-924c05f9-7558-42fc-82a1-a5f243d5639a tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:11.093194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-924c05f9-7558-42fc-82a1-a5f243d5639a tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:11.102946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-924c05f9-7558-42fc-82a1-a5f243d5639a tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:11.107990 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-924c05f9-7558-42fc-82a1-a5f243d5639a tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1258 microversion: 2.21 time: 0.366875 Jul 14 14:37:11.127819 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1261/2534] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:10 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1258 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:11.134006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f0e42297-1a57-4d9a-af7e-eb1956a6a086 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:11.142854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f0e42297-1a57-4d9a-af7e-eb1956a6a086 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Searching by: {'tenant_id': '8a0c595b04c74827b3c00228b9a57c27', 'deleted': False} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:11.158486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0e42297-1a57-4d9a-af7e-eb1956a6a086 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:11.159401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0e42297-1a57-4d9a-af7e-eb1956a6a086 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:11.159976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0e42297-1a57-4d9a-af7e-eb1956a6a086 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:11.160540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0e42297-1a57-4d9a-af7e-eb1956a6a086 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:11.187330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d5480ed-f429-4930-a267-8c25d75fa583 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:11.209132 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0d5480ed-f429-4930-a267-8c25d75fa583 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1575 microversion: 2.1 time: 0.772077 Jul 14 14:37:11.224737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-f0e42297-1a57-4d9a-af7e-eb1956a6a086 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:11.229257 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1274/2535] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:10 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1575 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:11.353753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:11.429928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0e42297-1a57-4d9a-af7e-eb1956a6a086 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:11.430530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0e42297-1a57-4d9a-af7e-eb1956a6a086 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:11.676691 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f0e42297-1a57-4d9a-af7e-eb1956a6a086 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8a0c595b04c74827b3c00228b9a57c27" status: 200 len: 4828 microversion: 2.1 time: 0.547424 Jul 14 14:37:11.690389 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1262/2536] 10.222.0.81 () {58 vars in 1256 bytes} [Thu Jul 14 14:37:11 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8a0c595b04c74827b3c00228b9a57c27 => generated 4828 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:11.697717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-36f4df21-598e-498a-931d-b03f67b83972 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:11.700410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-36f4df21-598e-498a-931d-b03f67b83972 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:11.722326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36f4df21-598e-498a-931d-b03f67b83972 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:11.722916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36f4df21-598e-498a-931d-b03f67b83972 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:11.723797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36f4df21-598e-498a-931d-b03f67b83972 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:11.724243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36f4df21-598e-498a-931d-b03f67b83972 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:11.855042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1219910380", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "4046f3fe-49bf-473f-9c6d-bf81c814408f"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:12.031689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] validate_networks() for [('4046f3fe-49bf-473f-9c6d-bf81c814408f', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:37:12.053950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-36f4df21-598e-498a-931d-b03f67b83972 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:12.067605 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-36f4df21-598e-498a-931d-b03f67b83972 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1314 microversion: 2.1 time: 0.375623 Jul 14 14:37:12.070115 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1263/2537] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:11 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:12.084561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf456757-987b-46f3-8527-acd15a608830 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c53a4e50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:12.202675 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf456757-987b-46f3-8527-acd15a608830 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.130728 Jul 14 14:37:12.208981 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1264/2538] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:12 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:12.257493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1717abf8-6117-4c74-ac8b-f3a69597c82d tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:12.272106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1717abf8-6117-4c74-ac8b-f3a69597c82d tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Searching by: {'tenant_id': '0243c2dec64e4de0aa0800fedd1fbfe7', 'deleted': False} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:12.280494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1717abf8-6117-4c74-ac8b-f3a69597c82d tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.281404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1717abf8-6117-4c74-ac8b-f3a69597c82d tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.283301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1717abf8-6117-4c74-ac8b-f3a69597c82d tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.284138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1717abf8-6117-4c74-ac8b-f3a69597c82d tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.340842 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1717abf8-6117-4c74-ac8b-f3a69597c82d tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0243c2dec64e4de0aa0800fedd1fbfe7" status: 200 len: 15 microversion: 2.1 time: 0.129693 Jul 14 14:37:12.342931 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1265/2539] 10.222.0.81 () {58 vars in 1256 bytes} [Thu Jul 14 14:37:12 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0243c2dec64e4de0aa0800fedd1fbfe7 => generated 15 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:37:12.365201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1ea5d8ed-63f6-4d8d-a71b-dd29eabcb91f tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:12.368554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1ea5d8ed-63f6-4d8d-a71b-dd29eabcb91f tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:12.383844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1ea5d8ed-63f6-4d8d-a71b-dd29eabcb91f tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.385881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1ea5d8ed-63f6-4d8d-a71b-dd29eabcb91f tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.387946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1ea5d8ed-63f6-4d8d-a71b-dd29eabcb91f tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.388716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1ea5d8ed-63f6-4d8d-a71b-dd29eabcb91f tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.549801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1ea5d8ed-63f6-4d8d-a71b-dd29eabcb91f tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:12.569154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1ea5d8ed-63f6-4d8d-a71b-dd29eabcb91f tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:12.572758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1ea5d8ed-63f6-4d8d-a71b-dd29eabcb91f tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:12.575484 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1ea5d8ed-63f6-4d8d-a71b-dd29eabcb91f tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1310 microversion: 2.21 time: 0.220870 Jul 14 14:37:12.576727 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1266/2540] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:12 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1310 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:12.623871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-da008bbe-ccf9-475d-92e8-43798f25a6df tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:12.624867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-da008bbe-ccf9-475d-92e8-43798f25a6df tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:12.651433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da008bbe-ccf9-475d-92e8-43798f25a6df tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.685045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da008bbe-ccf9-475d-92e8-43798f25a6df tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.691757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da008bbe-ccf9-475d-92e8-43798f25a6df tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.704472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da008bbe-ccf9-475d-92e8-43798f25a6df tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:13.806230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-da008bbe-ccf9-475d-92e8-43798f25a6df tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:13.819093 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-da008bbe-ccf9-475d-92e8-43798f25a6df tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1573 microversion: 2.1 time: 1.236675 Jul 14 14:37:13.822041 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1267/2541] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:12 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1573 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:13.850370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2f669ac8-09db-4bb9-a71d-130aeef7ceab tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:13.860477 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2f669ac8-09db-4bb9-a71d-130aeef7ceab tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.037328 Jul 14 14:37:13.869621 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1268/2542] 10.222.0.81 () {58 vars in 1188 bytes} [Thu Jul 14 14:37:13 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:37:13.883669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-fdbc7284-224a-459b-88aa-44d27543f252 req-8df00d79-7d71-491c-b589-be1589dbd419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9651eb2-09b7-4fe5-830c-c1974c834b44", "name": "network-vif-plugged", "status": "completed", "tag": "e696bab4-d60d-4215-8658-6bde817e300f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:13.927248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-fdbc7284-224a-459b-88aa-44d27543f252 req-8df00d79-7d71-491c-b589-be1589dbd419 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:13.928125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-fdbc7284-224a-459b-88aa-44d27543f252 req-8df00d79-7d71-491c-b589-be1589dbd419 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:13.949289 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-fdbc7284-224a-459b-88aa-44d27543f252 req-8df00d79-7d71-491c-b589-be1589dbd419 service nova] Creating event network-vif-plugged:e696bab4-d60d-4215-8658-6bde817e300f for instance b9651eb2-09b7-4fe5-830c-c1974c834b44 on n-h2-767704-28 Jul 14 14:37:13.968755 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-fdbc7284-224a-459b-88aa-44d27543f252 req-8df00d79-7d71-491c-b589-be1589dbd419 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097390 Jul 14 14:37:13.972378 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1269/2543] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:13.990433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-db8f906c-a80a-4bd3-9314-dd40cb2d7c3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:13.991276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-db8f906c-a80a-4bd3-9314-dd40cb2d7c3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:14.007127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db8f906c-a80a-4bd3-9314-dd40cb2d7c3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:14.007591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db8f906c-a80a-4bd3-9314-dd40cb2d7c3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:14.011662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db8f906c-a80a-4bd3-9314-dd40cb2d7c3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:14.014970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db8f906c-a80a-4bd3-9314-dd40cb2d7c3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:14.393370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:14.394931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:14.395988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:14.396803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:14.397726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:14.406786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:14.445899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:14.447708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:14.450923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:14.452381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:14.529683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Getting quotas for project 2e9036125df9487d9f5cf8afe8f13907. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:14.552931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Getting quotas for user 4e1ce229470845ddac37073e2b42373e and project 2e9036125df9487d9f5cf8afe8f13907. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:14.603739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:37:14.611977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:37:14.739201 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a0eafc79-57de-45c9-b4d9-2ae6409d9c5c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.507247 Jul 14 14:37:14.744521 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1275/2544] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:37:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:37:14.772395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-073aa8c8-6510-4f89-8091-e9685c5c5211 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5f1aee0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:14.781468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-db8f906c-a80a-4bd3-9314-dd40cb2d7c3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:14.795947 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-db8f906c-a80a-4bd3-9314-dd40cb2d7c3d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1314 microversion: 2.1 time: 0.822161 Jul 14 14:37:14.810998 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1270/2545] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:13 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1314 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:14.822025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-95158192-1f0c-4f87-bc20-eade67bccd84 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:14.823358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-95158192-1f0c-4f87-bc20-eade67bccd84 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:14.833608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95158192-1f0c-4f87-bc20-eade67bccd84 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:14.837207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95158192-1f0c-4f87-bc20-eade67bccd84 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:14.838817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95158192-1f0c-4f87-bc20-eade67bccd84 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:14.840147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95158192-1f0c-4f87-bc20-eade67bccd84 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:14.884793 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-073aa8c8-6510-4f89-8091-e9685c5c5211 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1455 microversion: 2.1 time: 0.134818 Jul 14 14:37:14.888279 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1276/2546] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:14 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:14.897737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6566d3bb-a797-4a24-9c67-74d9487406d9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1655602781"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:14.898580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6566d3bb-a797-4a24-9c67-74d9487406d9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:14.909786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6566d3bb-a797-4a24-9c67-74d9487406d9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:14.910354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6566d3bb-a797-4a24-9c67-74d9487406d9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:14.911181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6566d3bb-a797-4a24-9c67-74d9487406d9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:14.913257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6566d3bb-a797-4a24-9c67-74d9487406d9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:15.120753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-95158192-1f0c-4f87-bc20-eade67bccd84 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:15.139875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-95158192-1f0c-4f87-bc20-eade67bccd84 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:15.146275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-95158192-1f0c-4f87-bc20-eade67bccd84 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:15.148864 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-95158192-1f0c-4f87-bc20-eade67bccd84 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1316 microversion: 2.21 time: 0.335237 Jul 14 14:37:15.159131 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1271/2547] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:14 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:15.170692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c5df55b-3fa8-4c46-8114-517a81546a51 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:15.172681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3c5df55b-3fa8-4c46-8114-517a81546a51 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:15.190125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c5df55b-3fa8-4c46-8114-517a81546a51 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:15.190941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c5df55b-3fa8-4c46-8114-517a81546a51 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:15.193023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c5df55b-3fa8-4c46-8114-517a81546a51 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:15.193720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c5df55b-3fa8-4c46-8114-517a81546a51 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:15.358918 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3c5df55b-3fa8-4c46-8114-517a81546a51 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action" status: 202 len: 0 microversion: 2.1 time: 0.198292 Jul 14 14:37:15.360063 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1272/2548] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:15 2022] POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:15.375887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-223748947", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "4046f3fe-49bf-473f-9c6d-bf81c814408f"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:15.582748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] validate_networks() for [('4046f3fe-49bf-473f-9c6d-bf81c814408f', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:37:15.827601 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.network.security_group_api [None req-6566d3bb-a797-4a24-9c67-74d9487406d9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Adding security group 16a16ef2-b9e7-434f-87a5-f21bda440592 to port 5b7dd2ba-3b91-4c6a-9733-caca69e51884 Jul 14 14:37:18.300676 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6566d3bb-a797-4a24-9c67-74d9487406d9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887/action" status: 202 len: 0 microversion: 2.1 time: 3.410688 Jul 14 14:37:18.301791 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1277/2549] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:14 2022] POST /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887/action => generated 0 bytes in 3413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:18.308599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af111496-6651-46f2-9fa3-0dd1009e515e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:18.315497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-af111496-6651-46f2-9fa3-0dd1009e515e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:18.317628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-af111496-6651-46f2-9fa3-0dd1009e515e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '8a0c595b04c74827b3c00228b9a57c27'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:18.341698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af111496-6651-46f2-9fa3-0dd1009e515e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:18.342097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af111496-6651-46f2-9fa3-0dd1009e515e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:18.343488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af111496-6651-46f2-9fa3-0dd1009e515e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:18.348557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af111496-6651-46f2-9fa3-0dd1009e515e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:18.563993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-af111496-6651-46f2-9fa3-0dd1009e515e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:18.690562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:18.706631 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af111496-6651-46f2-9fa3-0dd1009e515e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers?status=error" status: 200 len: 337 microversion: 2.1 time: 0.389840 Jul 14 14:37:18.707323 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1278/2550] 10.222.0.81 () {58 vars in 1149 bytes} [Thu Jul 14 14:37:18 2022] GET /compute/v2.1/servers?status=error => generated 337 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:18.722997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-be449f18-5f9c-4027-829e-75185e0ca78f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:18.725095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-be449f18-5f9c-4027-829e-75185e0ca78f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:18.738829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-be449f18-5f9c-4027-829e-75185e0ca78f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:18.739554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-be449f18-5f9c-4027-829e-75185e0ca78f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:18.740510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-be449f18-5f9c-4027-829e-75185e0ca78f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:18.741932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-be449f18-5f9c-4027-829e-75185e0ca78f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:18.863102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:18.863844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:18.865204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:18.866253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:18.867409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:18.892608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:18.896342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:18.912874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:18.913681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:18.983903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Getting quotas for project 2e9036125df9487d9f5cf8afe8f13907. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:19.000706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Getting quotas for user 4e1ce229470845ddac37073e2b42373e and project 2e9036125df9487d9f5cf8afe8f13907. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:19.022749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:37:19.035502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:37:19.133258 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3b87edc7-8bcf-42e9-a143-19b2531d3380 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.771923 Jul 14 14:37:19.134380 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1273/2551] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:37:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:37:19.141462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9df5b10c-7827-4a75-9196-40850ed80d3f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c52e5550>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:19.282441 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9df5b10c-7827-4a75-9196-40850ed80d3f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1464 microversion: 2.1 time: 0.141682 Jul 14 14:37:19.285120 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1274/2552] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:19 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:19.303393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dd2a98f2-e269-4afe-b309-93b91e372e42 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:19.305136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dd2a98f2-e269-4afe-b309-93b91e372e42 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:19.320687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd2a98f2-e269-4afe-b309-93b91e372e42 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:19.323275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd2a98f2-e269-4afe-b309-93b91e372e42 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:19.328174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd2a98f2-e269-4afe-b309-93b91e372e42 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:19.329716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd2a98f2-e269-4afe-b309-93b91e372e42 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:19.691294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-be449f18-5f9c-4027-829e-75185e0ca78f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:19.697802 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-be449f18-5f9c-4027-829e-75185e0ca78f tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1501 microversion: 2.1 time: 0.989197 Jul 14 14:37:19.700592 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1279/2553] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:18 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1501 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:19.715577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b7c3e06-e486-4d3b-9d79-13c43b14d0cf tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c5e15ee0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:20.091678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dd2a98f2-e269-4afe-b309-93b91e372e42 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:20.108405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dd2a98f2-e269-4afe-b309-93b91e372e42 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:20.115487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dd2a98f2-e269-4afe-b309-93b91e372e42 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:20.117108 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dd2a98f2-e269-4afe-b309-93b91e372e42 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1358 microversion: 2.21 time: 0.830726 Jul 14 14:37:20.118240 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1275/2554] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:19 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1358 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:20.322690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG neutronclient.v2_0.client [None req-3b7c3e06-e486-4d3b-9d79-13c43b14d0cf tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 16a16ef2-b9e7-434f-87a5-f21bda440592 in use.", "detail": ""}} {{(pid=119512) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:37:20.325784 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3b7c3e06-e486-4d3b-9d79-13c43b14d0cf tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Security Group 16a16ef2-b9e7-434f-87a5-f21bda440592 in use. Jul 14 14:37:20.325784 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-66edc2d9-13fa-49a7-81e9-fd366db9b7cb'] Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b7c3e06-e486-4d3b-9d79-13c43b14d0cf tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-security-groups/16a16ef2-b9e7-434f-87a5-f21bda440592 HTTP/1.1 Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: exception: Security Group 16a16ef2-b9e7-434f-87a5-f21bda440592 in use. Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-66edc2d9-13fa-49a7-81e9-fd366db9b7cb'] Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '16a16ef2-b9e7-434f-87a5-f21bda440592'} Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:37:20.332426 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 16a16ef2-b9e7-434f-87a5-f21bda440592 in use. Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66edc2d9-13fa-49a7-81e9-fd366db9b7cb'] Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 16a16ef2-b9e7-434f-87a5-f21bda440592 in use. Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66edc2d9-13fa-49a7-81e9-fd366db9b7cb'] Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 16a16ef2-b9e7-434f-87a5-f21bda440592 in use. Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66edc2d9-13fa-49a7-81e9-fd366db9b7cb'] Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 16a16ef2-b9e7-434f-87a5-f21bda440592 in use. Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66edc2d9-13fa-49a7-81e9-fd366db9b7cb'] Jul 14 14:37:20.337006 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:20.343643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b7c3e06-e486-4d3b-9d79-13c43b14d0cf tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 400 to user: Security Group 16a16ef2-b9e7-434f-87a5-f21bda440592 in use. Jul 14 14:37:20.343643 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-66edc2d9-13fa-49a7-81e9-fd366db9b7cb'] {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:20.345039 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b7c3e06-e486-4d3b-9d79-13c43b14d0cf tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/16a16ef2-b9e7-434f-87a5-f21bda440592" status: 400 len: 185 microversion: 2.1 time: 0.641436 Jul 14 14:37:20.346319 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1280/2555] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:19 2022] DELETE /compute/v2.1/os-security-groups/16a16ef2-b9e7-434f-87a5-f21bda440592 => generated 185 bytes in 645 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:37:20.361725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7d9c45d7-2dc6-44b6-952b-59236e2fa704 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:20.374168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7d9c45d7-2dc6-44b6-952b-59236e2fa704 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:20.399941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d9c45d7-2dc6-44b6-952b-59236e2fa704 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:20.401022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d9c45d7-2dc6-44b6-952b-59236e2fa704 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:20.405467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d9c45d7-2dc6-44b6-952b-59236e2fa704 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:20.408564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d9c45d7-2dc6-44b6-952b-59236e2fa704 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:20.614954 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7d9c45d7-2dc6-44b6-952b-59236e2fa704 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action" status: 202 len: 0 microversion: 2.1 time: 0.266323 Jul 14 14:37:20.619073 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1281/2556] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:20 2022] POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:20.634173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3ca900da-07c1-4184-ab9c-fb580c7ea4f9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5c32d30>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:20.756798 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3ca900da-07c1-4184-ab9c-fb580c7ea4f9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 200 len: 1464 microversion: 2.1 time: 0.129675 Jul 14 14:37:20.761434 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1282/2557] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:20 2022] GET /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:20.781726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-225007327", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "451", "networks": [{"uuid": "4046f3fe-49bf-473f-9c6d-bf81c814408f"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:20.895725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] validate_networks() for [('4046f3fe-49bf-473f-9c6d-bf81c814408f', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:37:21.121354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-57d8e97a-8689-4b17-a62d-bdfcdca38805 req-1fda0bf3-5947-479c-ab5b-6ca5b04c18b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68217dfd-b29a-45a3-b3ec-e2e0a3fca887", "tag": "5b7dd2ba-3b91-4c6a-9733-caca69e51884"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:21.141801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-57d8e97a-8689-4b17-a62d-bdfcdca38805 req-1fda0bf3-5947-479c-ab5b-6ca5b04c18b7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:21.144220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-57d8e97a-8689-4b17-a62d-bdfcdca38805 req-1fda0bf3-5947-479c-ab5b-6ca5b04c18b7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:21.178771 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-57d8e97a-8689-4b17-a62d-bdfcdca38805 req-1fda0bf3-5947-479c-ab5b-6ca5b04c18b7 service nova] Creating event network-changed:5b7dd2ba-3b91-4c6a-9733-caca69e51884 for instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 on n-h1-767704-28 Jul 14 14:37:21.186276 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-57d8e97a-8689-4b17-a62d-bdfcdca38805 req-1fda0bf3-5947-479c-ab5b-6ca5b04c18b7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.066351 Jul 14 14:37:21.187670 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1276/2558] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:21.195716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-087ca451-0259-437a-bf8f-740beda57348 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:21.201554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-087ca451-0259-437a-bf8f-740beda57348 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:21.212682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-087ca451-0259-437a-bf8f-740beda57348 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:21.217788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-087ca451-0259-437a-bf8f-740beda57348 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:21.219499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-087ca451-0259-437a-bf8f-740beda57348 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:21.222290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-087ca451-0259-437a-bf8f-740beda57348 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:21.252672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-087ca451-0259-437a-bf8f-740beda57348 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lazy-loading 'flavor' on Instance uuid b9651eb2-09b7-4fe5-830c-c1974c834b44 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:21.462818 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-087ca451-0259-437a-bf8f-740beda57348 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "POST /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44/action" status: 202 len: 0 microversion: 2.1 time: 0.273290 Jul 14 14:37:21.463659 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1277/2559] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:21 2022] POST /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:21.471057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2955265f-6a85-49d1-972d-66e34162019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:21.472071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2955265f-6a85-49d1-972d-66e34162019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:21.481900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2955265f-6a85-49d1-972d-66e34162019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:21.482777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2955265f-6a85-49d1-972d-66e34162019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:21.492175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2955265f-6a85-49d1-972d-66e34162019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:21.492981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2955265f-6a85-49d1-972d-66e34162019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:21.533843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2955265f-6a85-49d1-972d-66e34162019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:37:21.638468 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2955265f-6a85-49d1-972d-66e34162019b tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 204 len: 0 microversion: 2.1 time: 0.171885 Jul 14 14:37:21.639449 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1278/2560] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:21 2022] DELETE /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:37:21.645196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae2d142d-c4ab-4f2e-94fd-58b3ad940129 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:21.645925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae2d142d-c4ab-4f2e-94fd-58b3ad940129 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:21.663593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae2d142d-c4ab-4f2e-94fd-58b3ad940129 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:21.664822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae2d142d-c4ab-4f2e-94fd-58b3ad940129 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:21.666534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae2d142d-c4ab-4f2e-94fd-58b3ad940129 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:21.668485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae2d142d-c4ab-4f2e-94fd-58b3ad940129 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:22.424845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:22.437191 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ae2d142d-c4ab-4f2e-94fd-58b3ad940129 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1613 microversion: 2.1 time: 0.796020 Jul 14 14:37:22.453375 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1279/2561] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:21 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1613 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:22.460290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-424e44a1-a1ab-4500-bb72-2a5a15dbbec9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:22.461794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-424e44a1-a1ab-4500-bb72-2a5a15dbbec9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:22.474821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-424e44a1-a1ab-4500-bb72-2a5a15dbbec9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:22.475622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-424e44a1-a1ab-4500-bb72-2a5a15dbbec9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:22.476659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-424e44a1-a1ab-4500-bb72-2a5a15dbbec9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:22.477350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-424e44a1-a1ab-4500-bb72-2a5a15dbbec9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:22.964783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:22.964783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:22.964783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:22.964783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:22.964783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:22.983477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:22.984187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:22.985394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:22.986053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.029435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Getting quotas for project 2e9036125df9487d9f5cf8afe8f13907. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:23.037705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Getting quotas for user 4e1ce229470845ddac37073e2b42373e and project 2e9036125df9487d9f5cf8afe8f13907. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:23.080177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:37:23.090074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:37:23.187789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a2fbfba1-029e-4d47-b796-38efe01918ea tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.424334 Jul 14 14:37:23.189613 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1283/2562] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:37:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:37:23.204374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05803c38-6eee-4246-a3d7-2370d7245de4 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:23.206222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-05803c38-6eee-4246-a3d7-2370d7245de4 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:23.221452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05803c38-6eee-4246-a3d7-2370d7245de4 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.222330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05803c38-6eee-4246-a3d7-2370d7245de4 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.223434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05803c38-6eee-4246-a3d7-2370d7245de4 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.224179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05803c38-6eee-4246-a3d7-2370d7245de4 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.461364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-424e44a1-a1ab-4500-bb72-2a5a15dbbec9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:23.471119 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-424e44a1-a1ab-4500-bb72-2a5a15dbbec9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2" status: 200 len: 1466 microversion: 2.1 time: 1.016186 Jul 14 14:37:23.476291 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1280/2563] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:22 2022] GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 => generated 1466 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:23.488467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-879b26c4-7fa2-4927-ab4f-2771a54873e4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:23.489146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-879b26c4-7fa2-4927-ab4f-2771a54873e4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:23.518375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-879b26c4-7fa2-4927-ab4f-2771a54873e4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.519010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-879b26c4-7fa2-4927-ab4f-2771a54873e4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.526396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-879b26c4-7fa2-4927-ab4f-2771a54873e4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.528492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-879b26c4-7fa2-4927-ab4f-2771a54873e4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.907180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-05803c38-6eee-4246-a3d7-2370d7245de4 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:23.919962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-05803c38-6eee-4246-a3d7-2370d7245de4 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:23.925173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-05803c38-6eee-4246-a3d7-2370d7245de4 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:23.926462 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-05803c38-6eee-4246-a3d7-2370d7245de4 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1358 microversion: 2.21 time: 0.734973 Jul 14 14:37:23.938099 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1284/2564] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:23 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1358 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:23.938099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d33bcb33-e8d8-4c22-bda0-e91130cecf4d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:23.938099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d33bcb33-e8d8-4c22-bda0-e91130cecf4d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:23.941148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d33bcb33-e8d8-4c22-bda0-e91130cecf4d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.941862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d33bcb33-e8d8-4c22-bda0-e91130cecf4d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.942841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d33bcb33-e8d8-4c22-bda0-e91130cecf4d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.943873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d33bcb33-e8d8-4c22-bda0-e91130cecf4d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:24.495903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-879b26c4-7fa2-4927-ab4f-2771a54873e4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:24.511832 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-879b26c4-7fa2-4927-ab4f-2771a54873e4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1492 microversion: 2.1 time: 1.034047 Jul 14 14:37:24.554254 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1281/2565] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:23 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1492 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:24.575494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6dd6fbfc-78d0-4ddd-a2cc-3e2895350df6 req-530da6a5-b2d4-49d9-a0c3-29c8cde692ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83dae6b9-f87b-4ee4-ab0d-3706cd2602a2", "name": "network-vif-unplugged", "status": "completed", "tag": "9462ad9c-5eb2-40e6-922b-2e480cd3ce7b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:24.599922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6dd6fbfc-78d0-4ddd-a2cc-3e2895350df6 req-530da6a5-b2d4-49d9-a0c3-29c8cde692ea service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:24.600838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6dd6fbfc-78d0-4ddd-a2cc-3e2895350df6 req-530da6a5-b2d4-49d9-a0c3-29c8cde692ea service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:24.629885 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6dd6fbfc-78d0-4ddd-a2cc-3e2895350df6 req-530da6a5-b2d4-49d9-a0c3-29c8cde692ea service nova] Creating event network-vif-unplugged:9462ad9c-5eb2-40e6-922b-2e480cd3ce7b for instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 on n-h1-767704-28 Jul 14 14:37:24.650134 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6dd6fbfc-78d0-4ddd-a2cc-3e2895350df6 req-530da6a5-b2d4-49d9-a0c3-29c8cde692ea service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092703 Jul 14 14:37:24.652890 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1282/2566] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:24.683066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c6da8b15-90a7-4a53-82df-8404c56d1c93 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:24.683797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c6da8b15-90a7-4a53-82df-8404c56d1c93 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:24.700154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6da8b15-90a7-4a53-82df-8404c56d1c93 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:24.700869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6da8b15-90a7-4a53-82df-8404c56d1c93 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:24.702054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6da8b15-90a7-4a53-82df-8404c56d1c93 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:24.702994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6da8b15-90a7-4a53-82df-8404c56d1c93 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:25.071756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d33bcb33-e8d8-4c22-bda0-e91130cecf4d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:25.083074 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d33bcb33-e8d8-4c22-bda0-e91130cecf4d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1648 microversion: 2.1 time: 1.154025 Jul 14 14:37:25.093831 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1285/2567] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:23 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1648 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:25.108835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05d300f0-f3fe-47d0-83d7-2a5a65b7ae2b tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:25.113326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-05d300f0-f3fe-47d0-83d7-2a5a65b7ae2b tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:25.123215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05d300f0-f3fe-47d0-83d7-2a5a65b7ae2b tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:25.124153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05d300f0-f3fe-47d0-83d7-2a5a65b7ae2b tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:25.125522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05d300f0-f3fe-47d0-83d7-2a5a65b7ae2b tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:25.126578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05d300f0-f3fe-47d0-83d7-2a5a65b7ae2b tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:25.431637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-05d300f0-f3fe-47d0-83d7-2a5a65b7ae2b tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:25.463668 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-05d300f0-f3fe-47d0-83d7-2a5a65b7ae2b tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1290 microversion: 2.1 time: 0.358761 Jul 14 14:37:25.468305 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1286/2568] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:25 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1290 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:25.476044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-60896a43-7a76-4c70-88db-6b3db3a88c71 req-de729643-1a48-417c-8bcd-21a1b245906b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de4a96e5-12c5-41dd-a248-36d32b315964", "tag": "750daef1-f8e4-4ca6-ab79-22f3bc3f616c"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:25.489042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-60896a43-7a76-4c70-88db-6b3db3a88c71 req-de729643-1a48-417c-8bcd-21a1b245906b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:25.490451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-60896a43-7a76-4c70-88db-6b3db3a88c71 req-de729643-1a48-417c-8bcd-21a1b245906b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:25.507531 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-60896a43-7a76-4c70-88db-6b3db3a88c71 req-de729643-1a48-417c-8bcd-21a1b245906b service nova] Creating event network-changed:750daef1-f8e4-4ca6-ab79-22f3bc3f616c for instance de4a96e5-12c5-41dd-a248-36d32b315964 on n-h2-767704-28 Jul 14 14:37:25.519352 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-60896a43-7a76-4c70-88db-6b3db3a88c71 req-de729643-1a48-417c-8bcd-21a1b245906b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047160 Jul 14 14:37:25.520704 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1287/2569] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:25.532328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fa6fb2b6-305b-4ca7-88e9-e9958afe6873 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-40296208"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:25.534280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fa6fb2b6-305b-4ca7-88e9-e9958afe6873 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:25.546155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fa6fb2b6-305b-4ca7-88e9-e9958afe6873 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:25.547335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fa6fb2b6-305b-4ca7-88e9-e9958afe6873 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:25.548612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fa6fb2b6-305b-4ca7-88e9-e9958afe6873 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:25.549383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fa6fb2b6-305b-4ca7-88e9-e9958afe6873 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:25.933744 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fa6fb2b6-305b-4ca7-88e9-e9958afe6873 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "POST /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3/action" status: 202 len: 0 microversion: 2.1 time: 0.409294 Jul 14 14:37:25.934996 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1288/2570] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:25 2022] POST /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:37:25.943763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-981a8047-4f08-4638-ab1d-385d669da393 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:25.945085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-981a8047-4f08-4638-ab1d-385d669da393 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:25.955511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-981a8047-4f08-4638-ab1d-385d669da393 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:25.956548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-981a8047-4f08-4638-ab1d-385d669da393 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:25.958128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-981a8047-4f08-4638-ab1d-385d669da393 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:25.959444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-981a8047-4f08-4638-ab1d-385d669da393 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.051817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-981a8047-4f08-4638-ab1d-385d669da393 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:37:26.140765 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c6da8b15-90a7-4a53-82df-8404c56d1c93 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1613 microversion: 2.1 time: 1.482062 Jul 14 14:37:26.151877 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1283/2571] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:24 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1613 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:26.167971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3949b7ff-d4ef-49b0-b640-c2fe608c9835 req-3742dabc-a5c6-411b-bcad-a540a21fa858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "490672e6-6394-4a5a-9ab0-bd3a44e0cb8e", "tag": "cf70c5d2-de48-406d-baf0-3edb54e1f22d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:26.185460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3949b7ff-d4ef-49b0-b640-c2fe608c9835 req-3742dabc-a5c6-411b-bcad-a540a21fa858 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.191688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3949b7ff-d4ef-49b0-b640-c2fe608c9835 req-3742dabc-a5c6-411b-bcad-a540a21fa858 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.209887 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3949b7ff-d4ef-49b0-b640-c2fe608c9835 req-3742dabc-a5c6-411b-bcad-a540a21fa858 service nova] Creating event network-changed:cf70c5d2-de48-406d-baf0-3edb54e1f22d for instance 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e on n-h1-767704-28 Jul 14 14:37:26.218298 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3949b7ff-d4ef-49b0-b640-c2fe608c9835 req-3742dabc-a5c6-411b-bcad-a540a21fa858 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063435 Jul 14 14:37:26.219609 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1284/2572] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:26.229461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-445495f9-d375-41c9-8fb1-925223deb829 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:26.229689 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-981a8047-4f08-4638-ab1d-385d669da393 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 204 len: 0 microversion: 2.1 time: 0.292328 Jul 14 14:37:26.231032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-445495f9-d375-41c9-8fb1-925223deb829 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:26.232095 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1289/2573] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:25 2022] DELETE /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:37:26.239985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fd2d77d0-1a37-478a-a91c-7bd26651ce9b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5ba3d30>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:26.243195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-445495f9-d375-41c9-8fb1-925223deb829 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.243882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-445495f9-d375-41c9-8fb1-925223deb829 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.246261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-445495f9-d375-41c9-8fb1-925223deb829 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.247150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-445495f9-d375-41c9-8fb1-925223deb829 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.313758 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fd2d77d0-1a37-478a-a91c-7bd26651ce9b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.079612 Jul 14 14:37:26.318272 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1290/2574] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:26 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:26.331773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-702a51df-d8ec-418f-a5d4-28028a2fabd9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:26.333215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-702a51df-d8ec-418f-a5d4-28028a2fabd9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:26.342333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-702a51df-d8ec-418f-a5d4-28028a2fabd9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.342787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-702a51df-d8ec-418f-a5d4-28028a2fabd9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.343763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-702a51df-d8ec-418f-a5d4-28028a2fabd9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.344255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-702a51df-d8ec-418f-a5d4-28028a2fabd9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.815361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-445495f9-d375-41c9-8fb1-925223deb829 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:26.828757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-445495f9-d375-41c9-8fb1-925223deb829 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:26.831413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-445495f9-d375-41c9-8fb1-925223deb829 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:26.832936 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-445495f9-d375-41c9-8fb1-925223deb829 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1358 microversion: 2.21 time: 0.611863 Jul 14 14:37:26.833900 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1285/2575] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:26 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1358 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:26.840060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-900b9106-d144-48a5-9320-85b04afc5ff3 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:26.850418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-900b9106-d144-48a5-9320-85b04afc5ff3 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Searching by: {'host': 'n-h1-767704-28', 'deleted': False} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:26.857053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-900b9106-d144-48a5-9320-85b04afc5ff3 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.857510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-900b9106-d144-48a5-9320-85b04afc5ff3 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.858486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-900b9106-d144-48a5-9320-85b04afc5ff3 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.858937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-900b9106-d144-48a5-9320-85b04afc5ff3 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.980523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-900b9106-d144-48a5-9320-85b04afc5ff3 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:27.065719 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-900b9106-d144-48a5-9320-85b04afc5ff3 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "GET /compute/v2.1/servers?host=n-h1-767704-28&all_tenants=1" status: 200 len: 1982 microversion: 2.1 time: 0.230476 Jul 14 14:37:27.073511 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1286/2576] 10.222.0.81 () {58 vars in 1191 bytes} [Thu Jul 14 14:37:26 2022] GET /compute/v2.1/servers?host=n-h1-767704-28&all_tenants=1 => generated 1982 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:27.078736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4448814b-4190-4f93-862d-02086f395eb3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:27.079367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4448814b-4190-4f93-862d-02086f395eb3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:27.087037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4448814b-4190-4f93-862d-02086f395eb3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.087781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4448814b-4190-4f93-862d-02086f395eb3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.088818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4448814b-4190-4f93-862d-02086f395eb3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.089464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4448814b-4190-4f93-862d-02086f395eb3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.138986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-702a51df-d8ec-418f-a5d4-28028a2fabd9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:27.152279 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-702a51df-d8ec-418f-a5d4-28028a2fabd9 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1648 microversion: 2.1 time: 0.832542 Jul 14 14:37:27.153138 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1291/2577] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:26 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1648 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:27.165927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-88e989df-4212-4094-9ecf-769943bb4687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:27.166634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-88e989df-4212-4094-9ecf-769943bb4687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:27.186274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88e989df-4212-4094-9ecf-769943bb4687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.186603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88e989df-4212-4094-9ecf-769943bb4687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.187799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88e989df-4212-4094-9ecf-769943bb4687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.188592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88e989df-4212-4094-9ecf-769943bb4687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.513949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4448814b-4190-4f93-862d-02086f395eb3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:27.528198 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4448814b-4190-4f93-862d-02086f395eb3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1498 microversion: 2.1 time: 0.453120 Jul 14 14:37:27.531456 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1287/2578] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:27 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1498 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:27.554770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2962aeab-8978-4973-adad-2d7959fb3827 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:27.566320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2962aeab-8978-4973-adad-2d7959fb3827 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:27.574108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2962aeab-8978-4973-adad-2d7959fb3827 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.575780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2962aeab-8978-4973-adad-2d7959fb3827 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.576855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2962aeab-8978-4973-adad-2d7959fb3827 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.577693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2962aeab-8978-4973-adad-2d7959fb3827 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.577951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-88e989df-4212-4094-9ecf-769943bb4687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:27.591609 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-88e989df-4212-4094-9ecf-769943bb4687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1320 microversion: 2.1 time: 0.429540 Jul 14 14:37:27.592204 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1292/2579] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:27 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1320 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:27.605769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1e8b6d37-4492-4535-aad8-f5dca63f9f7f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5ba3040>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:27.631805 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2962aeab-8978-4973-adad-2d7959fb3827 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.098611 Jul 14 14:37:27.635121 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1288/2580] 10.222.0.81 () {58 vars in 1195 bytes} [Thu Jul 14 14:37:27 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:37:27.658208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-02bc9c49-51aa-49ad-b275-508b2b5e6098 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:27.662365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-02bc9c49-51aa-49ad-b275-508b2b5e6098 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:27.672851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02bc9c49-51aa-49ad-b275-508b2b5e6098 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.673543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02bc9c49-51aa-49ad-b275-508b2b5e6098 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.675101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02bc9c49-51aa-49ad-b275-508b2b5e6098 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.675869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02bc9c49-51aa-49ad-b275-508b2b5e6098 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.676789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1e8b6d37-4492-4535-aad8-f5dca63f9f7f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.080675 Jul 14 14:37:27.685615 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1293/2581] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:27 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:27.782851 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-02bc9c49-51aa-49ad-b275-508b2b5e6098 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action" status: 202 len: 0 microversion: 2.1 time: 0.139524 Jul 14 14:37:27.784131 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1289/2582] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:27 2022] POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:37:27.794548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:27.796441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:27.809122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.810282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.811970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.812482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.833801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-5d64ac45-bf68-4867-a019-3376aea87ee8 req-a8b65689-47ee-4025-9462-f05bd8f79a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aecf4db7-6444-4c98-9043-5c39faf7125a", "tag": "8215142c-738e-4be2-aacd-31ab4926d96e"}, {"server_uuid": "68217dfd-b29a-45a3-b3ec-e2e0a3fca887", "name": "network-vif-deleted", "tag": "5b7dd2ba-3b91-4c6a-9733-caca69e51884"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:27.848623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5d64ac45-bf68-4867-a019-3376aea87ee8 req-a8b65689-47ee-4025-9462-f05bd8f79a3e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.849855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5d64ac45-bf68-4867-a019-3376aea87ee8 req-a8b65689-47ee-4025-9462-f05bd8f79a3e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.893373 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-5d64ac45-bf68-4867-a019-3376aea87ee8 req-a8b65689-47ee-4025-9462-f05bd8f79a3e service nova] Creating event network-changed:8215142c-738e-4be2-aacd-31ab4926d96e for instance aecf4db7-6444-4c98-9043-5c39faf7125a on n-h2-767704-28 Jul 14 14:37:27.894168 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-5d64ac45-bf68-4867-a019-3376aea87ee8 req-a8b65689-47ee-4025-9462-f05bd8f79a3e service nova] Creating event network-vif-deleted:5b7dd2ba-3b91-4c6a-9733-caca69e51884 for instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 on n-h1-767704-28 Jul 14 14:37:27.924569 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-5d64ac45-bf68-4867-a019-3376aea87ee8 req-a8b65689-47ee-4025-9462-f05bd8f79a3e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.084769 Jul 14 14:37:27.925279 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1290/2583] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:37:27.946132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-87d815c9-6a8a-4905-a8f1-ae8a3648e490 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:27.946855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-87d815c9-6a8a-4905-a8f1-ae8a3648e490 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:27.954029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87d815c9-6a8a-4905-a8f1-ae8a3648e490 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.954768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87d815c9-6a8a-4905-a8f1-ae8a3648e490 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.955739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87d815c9-6a8a-4905-a8f1-ae8a3648e490 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.956341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87d815c9-6a8a-4905-a8f1-ae8a3648e490 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.960856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:27.965135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:27.966094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:27.969221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:27.972812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:28.108974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:28.125372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.127006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.129566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.130752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.144622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:28.201930 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2719a923-aafe-4192-9f30-f256a4f47f10 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action" status: 202 len: 1064 microversion: 2.1 time: 0.408588 Jul 14 14:37:28.217026 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1294/2584] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:27 2022] POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action => generated 1064 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 14:37:28.230606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e62c321d-bcfe-41d3-8ad9-d658124c5700 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:28.231240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e62c321d-bcfe-41d3-8ad9-d658124c5700 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:28.251157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e62c321d-bcfe-41d3-8ad9-d658124c5700 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.251619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e62c321d-bcfe-41d3-8ad9-d658124c5700 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.264910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e62c321d-bcfe-41d3-8ad9-d658124c5700 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.265417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e62c321d-bcfe-41d3-8ad9-d658124c5700 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.327573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e62c321d-bcfe-41d3-8ad9-d658124c5700 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.328215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e62c321d-bcfe-41d3-8ad9-d658124c5700 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.328604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-e62c321d-bcfe-41d3-8ad9-d658124c5700 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lazy-loading 'fault' on Instance uuid 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:28.576821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e62c321d-bcfe-41d3-8ad9-d658124c5700 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:28.586142 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e62c321d-bcfe-41d3-8ad9-d658124c5700 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 200 len: 1305 microversion: 2.1 time: 0.367832 Jul 14 14:37:28.589965 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1295/2585] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:28 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 1305 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:28.596029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-62cb2f0c-480a-4365-a9fe-a997f1f3fe34 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:28.596925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-62cb2f0c-480a-4365-a9fe-a997f1f3fe34 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:28.687921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62cb2f0c-480a-4365-a9fe-a997f1f3fe34 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.693699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62cb2f0c-480a-4365-a9fe-a997f1f3fe34 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.696184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62cb2f0c-480a-4365-a9fe-a997f1f3fe34 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.702480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62cb2f0c-480a-4365-a9fe-a997f1f3fe34 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.711161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-87d815c9-6a8a-4905-a8f1-ae8a3648e490 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:28.726545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-87d815c9-6a8a-4905-a8f1-ae8a3648e490 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:28.732160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-87d815c9-6a8a-4905-a8f1-ae8a3648e490 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:28.739960 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-87d815c9-6a8a-4905-a8f1-ae8a3648e490 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1358 microversion: 2.21 time: 0.805124 Jul 14 14:37:28.747348 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1291/2586] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:27 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1358 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:28.763698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1cef7fbe-c913-4a08-ba78-d4619496cc25 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:28.764619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1cef7fbe-c913-4a08-ba78-d4619496cc25 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:28.786274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:28.826948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1cef7fbe-c913-4a08-ba78-d4619496cc25 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.827790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1cef7fbe-c913-4a08-ba78-d4619496cc25 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.829290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1cef7fbe-c913-4a08-ba78-d4619496cc25 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.830119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1cef7fbe-c913-4a08-ba78-d4619496cc25 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.017363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=16 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:29.742121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-62cb2f0c-480a-4365-a9fe-a997f1f3fe34 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:29.750173 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-62cb2f0c-480a-4365-a9fe-a997f1f3fe34 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1468 microversion: 2.1 time: 1.158572 Jul 14 14:37:29.750766 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1296/2587] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:28 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1468 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:29.767831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-868cb5cc-5db0-44d7-859d-4a463c9d584a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:29.768691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-868cb5cc-5db0-44d7-859d-4a463c9d584a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:29.775003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-868cb5cc-5db0-44d7-859d-4a463c9d584a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.775487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-868cb5cc-5db0-44d7-859d-4a463c9d584a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.776858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-868cb5cc-5db0-44d7-859d-4a463c9d584a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.780160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1cef7fbe-c913-4a08-ba78-d4619496cc25 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:29.784679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-868cb5cc-5db0-44d7-859d-4a463c9d584a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.793762 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1cef7fbe-c913-4a08-ba78-d4619496cc25 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1498 microversion: 2.1 time: 1.044540 Jul 14 14:37:29.794556 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1292/2588] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:28 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1498 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:29.807878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-9c4792f9-1911-42e9-b621-45d725e66c7f req-2b0edbb2-cfbd-43f8-b0bc-26f7e3489335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7052fe14-7fcb-4fb5-a013-966c9b7ee3a6", "tag": "36cbf8c5-c0e4-4f58-8274-bca21639be29"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:29.817063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9c4792f9-1911-42e9-b621-45d725e66c7f req-2b0edbb2-cfbd-43f8-b0bc-26f7e3489335 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.817576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9c4792f9-1911-42e9-b621-45d725e66c7f req-2b0edbb2-cfbd-43f8-b0bc-26f7e3489335 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.830099 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-9c4792f9-1911-42e9-b621-45d725e66c7f req-2b0edbb2-cfbd-43f8-b0bc-26f7e3489335 service nova] Creating event network-changed:36cbf8c5-c0e4-4f58-8274-bca21639be29 for instance 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 on n-h1-767704-28 Jul 14 14:37:29.835688 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-9c4792f9-1911-42e9-b621-45d725e66c7f req-2b0edbb2-cfbd-43f8-b0bc-26f7e3489335 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031553 Jul 14 14:37:29.837330 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1293/2589] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:29.846178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9298322e-eac1-4743-b6d5-db19d0f6b5a3 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c53043a0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:29.897296 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9298322e-eac1-4743-b6d5-db19d0f6b5a3 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.055492 Jul 14 14:37:29.900199 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1294/2590] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:29 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:29.907700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be9ff209-101e-4989-a4a4-15e4ce1f024f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:29.908445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-be9ff209-101e-4989-a4a4-15e4ce1f024f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:29.915306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be9ff209-101e-4989-a4a4-15e4ce1f024f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.915753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be9ff209-101e-4989-a4a4-15e4ce1f024f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.916604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be9ff209-101e-4989-a4a4-15e4ce1f024f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.917365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be9ff209-101e-4989-a4a4-15e4ce1f024f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.930743 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-be9ff209-101e-4989-a4a4-15e4ce1f024f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be9ff209-101e-4989-a4a4-15e4ce1f024f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 HTTP/1.1 Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '68217dfd-b29a-45a3-b3ec-e2e0a3fca887'} Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:29.932539 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:29.941269 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:29.941269 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:29.941269 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:29.941269 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:29.941269 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:29.941269 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:29.941269 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:29.941269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be9ff209-101e-4989-a4a4-15e4ce1f024f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:29.941269 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-be9ff209-101e-4989-a4a4-15e4ce1f024f tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 404 len: 111 microversion: 2.1 time: 0.035128 Jul 14 14:37:29.941269 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1295/2591] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:29 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:29.941269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-65d00b33-3ed2-4caf-a9b7-41e2e1c01261 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:29.942670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-65d00b33-3ed2-4caf-a9b7-41e2e1c01261 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:29.949301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-65d00b33-3ed2-4caf-a9b7-41e2e1c01261 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.949742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-65d00b33-3ed2-4caf-a9b7-41e2e1c01261 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.950509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-65d00b33-3ed2-4caf-a9b7-41e2e1c01261 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.950947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-65d00b33-3ed2-4caf-a9b7-41e2e1c01261 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:30.179825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-868cb5cc-5db0-44d7-859d-4a463c9d584a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:30.190718 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-868cb5cc-5db0-44d7-859d-4a463c9d584a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1320 microversion: 2.1 time: 0.426584 Jul 14 14:37:30.191695 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1297/2592] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:29 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1320 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:30.207751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-60e3351a-cbab-4022-8c7b-7dad070a4caf tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c5c64700>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:30.250857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-65d00b33-3ed2-4caf-a9b7-41e2e1c01261 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:30.263325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-65d00b33-3ed2-4caf-a9b7-41e2e1c01261 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:30.264795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-65d00b33-3ed2-4caf-a9b7-41e2e1c01261 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:30.266077 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-65d00b33-3ed2-4caf-a9b7-41e2e1c01261 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1358 microversion: 2.21 time: 0.330366 Jul 14 14:37:30.277151 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1296/2593] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:29 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1358 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:30.569844 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-60e3351a-cbab-4022-8c7b-7dad070a4caf tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/da40307a-6d46-430a-8597-998e571898cd" status: 202 len: 0 microversion: 2.1 time: 0.365864 Jul 14 14:37:30.571369 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1298/2594] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:30 2022] DELETE /compute/v2.1/os-security-groups/da40307a-6d46-430a-8597-998e571898cd => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:30.582037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3961a039-dbe7-4c0d-a20f-39d602eacb74 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6cad0b8b0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:30.686800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f31e1bda-074e-4aa6-9bdf-953bc262de3f req-e6f8cff8-fdf1-4895-9e8e-b4909dcf6fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de4a96e5-12c5-41dd-a248-36d32b315964", "name": "network-vif-plugged", "status": "completed", "tag": "750daef1-f8e4-4ca6-ab79-22f3bc3f616c"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:30.708269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f31e1bda-074e-4aa6-9bdf-953bc262de3f req-e6f8cff8-fdf1-4895-9e8e-b4909dcf6fde service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:30.709083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f31e1bda-074e-4aa6-9bdf-953bc262de3f req-e6f8cff8-fdf1-4895-9e8e-b4909dcf6fde service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:30.729331 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f31e1bda-074e-4aa6-9bdf-953bc262de3f req-e6f8cff8-fdf1-4895-9e8e-b4909dcf6fde service nova] Creating event network-vif-plugged:750daef1-f8e4-4ca6-ab79-22f3bc3f616c for instance de4a96e5-12c5-41dd-a248-36d32b315964 on n-h2-767704-28 Jul 14 14:37:30.736067 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f31e1bda-074e-4aa6-9bdf-953bc262de3f req-e6f8cff8-fdf1-4895-9e8e-b4909dcf6fde service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053270 Jul 14 14:37:30.737205 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1299/2595] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:30.785558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1f4fe564-1069-49f6-955e-62fcd7b839f3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:30.788611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f4fe564-1069-49f6-955e-62fcd7b839f3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:30.816213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f4fe564-1069-49f6-955e-62fcd7b839f3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:30.817546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f4fe564-1069-49f6-955e-62fcd7b839f3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:30.821139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f4fe564-1069-49f6-955e-62fcd7b839f3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:30.821675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f4fe564-1069-49f6-955e-62fcd7b839f3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:31.087965 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3961a039-dbe7-4c0d-a20f-39d602eacb74 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/16a16ef2-b9e7-434f-87a5-f21bda440592" status: 202 len: 0 microversion: 2.1 time: 0.510952 Jul 14 14:37:31.090105 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1297/2596] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:30 2022] DELETE /compute/v2.1/os-security-groups/16a16ef2-b9e7-434f-87a5-f21bda440592 => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:37:31.096489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea3d6193-67b0-4c4d-90dd-2ddf927b99f5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:31.097726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ea3d6193-67b0-4c4d-90dd-2ddf927b99f5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:31.115107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea3d6193-67b0-4c4d-90dd-2ddf927b99f5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:31.115834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea3d6193-67b0-4c4d-90dd-2ddf927b99f5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:31.119192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea3d6193-67b0-4c4d-90dd-2ddf927b99f5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:31.122863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea3d6193-67b0-4c4d-90dd-2ddf927b99f5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:31.462657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f4fe564-1069-49f6-955e-62fcd7b839f3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:31.473873 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1f4fe564-1069-49f6-955e-62fcd7b839f3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1468 microversion: 2.1 time: 0.704846 Jul 14 14:37:31.487539 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1300/2597] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:30 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1468 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:31.494647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-023a8279-bbdb-4b52-aace-64f61de1503e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5ad4af0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:31.516005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ea3d6193-67b0-4c4d-90dd-2ddf927b99f5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:31.531423 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ea3d6193-67b0-4c4d-90dd-2ddf927b99f5 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1498 microversion: 2.1 time: 0.439282 Jul 14 14:37:31.538199 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1298/2598] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:31 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1498 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:31.559607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9fcc31c7-62d1-4858-8ff6-ebed66ae9843 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'create', calling method: .version_select at 0x7fd6cac9c670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1229993615", "description": "tempest-description-383502290"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:31.578782 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-023a8279-bbdb-4b52-aace-64f61de1503e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.089546 Jul 14 14:37:31.579941 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1301/2599] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:31 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:31.585142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-363ad878-9855-4d46-b85f-a90729f09e55 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:31.585978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-363ad878-9855-4d46-b85f-a90729f09e55 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:31.593799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-363ad878-9855-4d46-b85f-a90729f09e55 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:31.594448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-363ad878-9855-4d46-b85f-a90729f09e55 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:31.595460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-363ad878-9855-4d46-b85f-a90729f09e55 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:31.596076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-363ad878-9855-4d46-b85f-a90729f09e55 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:31.945053 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9fcc31c7-62d1-4858-8ff6-ebed66ae9843 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.405299 Jul 14 14:37:31.945687 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1299/2600] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:37:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:31.950544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9455123d-3495-4579-a59e-0d8405e456e0 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:31.951156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9455123d-3495-4579-a59e-0d8405e456e0 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:31.957856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9455123d-3495-4579-a59e-0d8405e456e0 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:31.958522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9455123d-3495-4579-a59e-0d8405e456e0 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:31.959361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9455123d-3495-4579-a59e-0d8405e456e0 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:31.959868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9455123d-3495-4579-a59e-0d8405e456e0 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:32.092427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-363ad878-9855-4d46-b85f-a90729f09e55 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:32.101239 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-363ad878-9855-4d46-b85f-a90729f09e55 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1320 microversion: 2.1 time: 0.519580 Jul 14 14:37:32.102442 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1302/2601] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:31 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1320 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:32.110163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0271759f-57d4-4dbc-b225-454b51ab018d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Action: 'update', calling method: .version_select at 0x7fd6c56f1ee0>, body: {"security_group": {"name": "tempest-sg-hth-624099285", "description": "tempest-description-hth-165147229"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:32.233616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9455123d-3495-4579-a59e-0d8405e456e0 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:32.242616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9455123d-3495-4579-a59e-0d8405e456e0 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:32.244371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9455123d-3495-4579-a59e-0d8405e456e0 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:32.246432 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9455123d-3495-4579-a59e-0d8405e456e0 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1358 microversion: 2.21 time: 0.299307 Jul 14 14:37:32.257604 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1300/2602] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:31 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:32.400181 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0271759f-57d4-4dbc-b225-454b51ab018d tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "PUT /compute/v2.1/os-security-groups/fd78c4ee-cfb7-4e8f-8762-359d4fdf66fc" status: 200 len: 216 microversion: 2.1 time: 0.295993 Jul 14 14:37:32.404911 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1303/2603] 10.222.0.81 () {60 vars in 1289 bytes} [Thu Jul 14 14:37:32 2022] PUT /compute/v2.1/os-security-groups/fd78c4ee-cfb7-4e8f-8762-359d4fdf66fc => generated 216 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:32.415619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9e37630d-ff02-4465-be7f-7b0f94da52a2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6cad20940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:32.510085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5ca4c228-5859-413e-96c1-8eca1b8dba26 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:32.512305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5ca4c228-5859-413e-96c1-8eca1b8dba26 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:32.518822 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9e37630d-ff02-4465-be7f-7b0f94da52a2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/fd78c4ee-cfb7-4e8f-8762-359d4fdf66fc" status: 200 len: 216 microversion: 2.1 time: 0.107216 Jul 14 14:37:32.519707 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1301/2604] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:37:32 2022] GET /compute/v2.1/os-security-groups/fd78c4ee-cfb7-4e8f-8762-359d4fdf66fc => generated 216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:32.533185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-38deccbb-f353-4421-80f0-c1a0f7201eef tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6cad7e790>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:32.537226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ca4c228-5859-413e-96c1-8eca1b8dba26 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:32.538763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ca4c228-5859-413e-96c1-8eca1b8dba26 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:32.542698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ca4c228-5859-413e-96c1-8eca1b8dba26 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:32.543151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ca4c228-5859-413e-96c1-8eca1b8dba26 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:32.916907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5ca4c228-5859-413e-96c1-8eca1b8dba26 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:32.928809 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5ca4c228-5859-413e-96c1-8eca1b8dba26 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1468 microversion: 2.1 time: 0.436894 Jul 14 14:37:32.930655 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1304/2605] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:32 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1468 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:32.949152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1166731d-6154-48c4-8455-ea3fe8a9b7bd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:32.950034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1166731d-6154-48c4-8455-ea3fe8a9b7bd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:32.958186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1166731d-6154-48c4-8455-ea3fe8a9b7bd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:32.959519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1166731d-6154-48c4-8455-ea3fe8a9b7bd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:32.961651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1166731d-6154-48c4-8455-ea3fe8a9b7bd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:32.962483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1166731d-6154-48c4-8455-ea3fe8a9b7bd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.005268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=10 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:33.041248 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-38deccbb-f353-4421-80f0-c1a0f7201eef tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/fd78c4ee-cfb7-4e8f-8762-359d4fdf66fc" status: 202 len: 0 microversion: 2.1 time: 0.511806 Jul 14 14:37:33.047039 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1302/2606] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:32 2022] DELETE /compute/v2.1/os-security-groups/fd78c4ee-cfb7-4e8f-8762-359d4fdf66fc => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:33.053808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21cf0528-e5ad-468e-9744-4f8738ecb5ff tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cac11940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:33.068056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=14 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:33.141363 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21cf0528-e5ad-468e-9744-4f8738ecb5ff tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.092737 Jul 14 14:37:33.148878 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1303/2607] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:33 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:33.154652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0deba73f-56ee-401c-bb23-c90ccf19aa48 req-fe4bdd7b-61b5-450d-b96e-1f467e97bb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490672e6-6394-4a5a-9ab0-bd3a44e0cb8e", "name": "network-vif-plugged", "status": "completed", "tag": "cf70c5d2-de48-406d-baf0-3edb54e1f22d"}, {"server_uuid": "421b3e7a-56b8-4241-a496-2a091a9686f3", "name": "network-vif-plugged", "status": "completed", "tag": "40cb08bf-70f2-461c-9c75-c450c62e8c00"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:33.165829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0deba73f-56ee-401c-bb23-c90ccf19aa48 req-fe4bdd7b-61b5-450d-b96e-1f467e97bb86 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.166487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0deba73f-56ee-401c-bb23-c90ccf19aa48 req-fe4bdd7b-61b5-450d-b96e-1f467e97bb86 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.220136 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0deba73f-56ee-401c-bb23-c90ccf19aa48 req-fe4bdd7b-61b5-450d-b96e-1f467e97bb86 service nova] Creating event network-vif-plugged:cf70c5d2-de48-406d-baf0-3edb54e1f22d for instance 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e on n-h1-767704-28 Jul 14 14:37:33.221011 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0deba73f-56ee-401c-bb23-c90ccf19aa48 req-fe4bdd7b-61b5-450d-b96e-1f467e97bb86 service nova] Creating event network-vif-plugged:40cb08bf-70f2-461c-9c75-c450c62e8c00 for instance 421b3e7a-56b8-4241-a496-2a091a9686f3 on n-h2-767704-28 Jul 14 14:37:33.251954 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0deba73f-56ee-401c-bb23-c90ccf19aa48 req-fe4bdd7b-61b5-450d-b96e-1f467e97bb86 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098329 Jul 14 14:37:33.254140 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1304/2608] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:33.273970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3e03769d-13de-451c-b957-57c091138c38 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:33.275270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3e03769d-13de-451c-b957-57c091138c38 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:33.295762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3e03769d-13de-451c-b957-57c091138c38 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.296812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3e03769d-13de-451c-b957-57c091138c38 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.300016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3e03769d-13de-451c-b957-57c091138c38 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.302498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3e03769d-13de-451c-b957-57c091138c38 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.364890 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-3e03769d-13de-451c-b957-57c091138c38 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3e03769d-13de-451c-b957-57c091138c38 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 HTTP/1.1 Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '68217dfd-b29a-45a3-b3ec-e2e0a3fca887'} Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:33.374149 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:33.378129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:33.378129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:33.378129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:33.378129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:33.378129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:33.378129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:33.378129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:33.378129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:33.378129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:33.378129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:33.378129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:33.380874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3e03769d-13de-451c-b957-57c091138c38 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:33.383198 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3e03769d-13de-451c-b957-57c091138c38 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 404 len: 111 microversion: 2.1 time: 0.119903 Jul 14 14:37:33.385159 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1305/2609] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:33 2022] DELETE /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:33.396455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8e721c79-05cd-40dd-b898-a7683cf67687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:33.406626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8e721c79-05cd-40dd-b898-a7683cf67687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:33.412913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e721c79-05cd-40dd-b898-a7683cf67687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.413402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e721c79-05cd-40dd-b898-a7683cf67687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.414177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e721c79-05cd-40dd-b898-a7683cf67687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.414611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e721c79-05cd-40dd-b898-a7683cf67687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.430275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:33.500635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1166731d-6154-48c4-8455-ea3fe8a9b7bd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:33.524852 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1166731d-6154-48c4-8455-ea3fe8a9b7bd tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1498 microversion: 2.1 time: 0.592699 Jul 14 14:37:33.526068 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1305/2610] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:32 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1498 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:33.539199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ee04cd41-46ac-477c-86cb-59290e6fa325 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:33.540070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ee04cd41-46ac-477c-86cb-59290e6fa325 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:33.549348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee04cd41-46ac-477c-86cb-59290e6fa325 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.551507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee04cd41-46ac-477c-86cb-59290e6fa325 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.562210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee04cd41-46ac-477c-86cb-59290e6fa325 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.562921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee04cd41-46ac-477c-86cb-59290e6fa325 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.252636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ee04cd41-46ac-477c-86cb-59290e6fa325 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:34.265099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ee04cd41-46ac-477c-86cb-59290e6fa325 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:34.266304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8e721c79-05cd-40dd-b898-a7683cf67687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:34.266955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ee04cd41-46ac-477c-86cb-59290e6fa325 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:34.268108 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ee04cd41-46ac-477c-86cb-59290e6fa325 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1358 microversion: 2.21 time: 0.740906 Jul 14 14:37:34.269075 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1306/2611] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:33 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1358 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:34.274105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c6eed10f-f2b4-4d08-84cc-5d334514c6cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:34.274778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c6eed10f-f2b4-4d08-84cc-5d334514c6cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: 68217dfd-b29a-45a3-b3ec-e2e0a3fca887] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:34.277666 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8e721c79-05cd-40dd-b898-a7683cf67687 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1320 microversion: 2.1 time: 0.889921 Jul 14 14:37:34.278507 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1306/2612] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:33 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1320 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:34.283540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7e3d90b8-1092-4ff2-95a7-7b00f69a4c59 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:34.284332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7e3d90b8-1092-4ff2-95a7-7b00f69a4c59 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:34.296570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6eed10f-f2b4-4d08-84cc-5d334514c6cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.297532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6eed10f-f2b4-4d08-84cc-5d334514c6cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.298567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6eed10f-f2b4-4d08-84cc-5d334514c6cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.299351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6eed10f-f2b4-4d08-84cc-5d334514c6cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.299694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e3d90b8-1092-4ff2-95a7-7b00f69a4c59 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.300337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e3d90b8-1092-4ff2-95a7-7b00f69a4c59 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.301790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e3d90b8-1092-4ff2-95a7-7b00f69a4c59 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.302526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e3d90b8-1092-4ff2-95a7-7b00f69a4c59 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.318524 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-c6eed10f-f2b4-4d08-84cc-5d334514c6cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c6eed10f-f2b4-4d08-84cc-5d334514c6cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 HTTP/1.1 Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '68217dfd-b29a-45a3-b3ec-e2e0a3fca887'} Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:34.320522 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.325754 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.325754 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:34.325754 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:34.325754 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:34.325754 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:34.325754 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. Jul 14 14:37:34.325754 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.327156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c6eed10f-f2b4-4d08-84cc-5d334514c6cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Instance 68217dfd-b29a-45a3-b3ec-e2e0a3fca887 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:34.328191 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c6eed10f-f2b4-4d08-84cc-5d334514c6cb tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887" status: 404 len: 111 microversion: 2.1 time: 0.057970 Jul 14 14:37:34.329315 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1307/2613] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:34 2022] GET /compute/v2.1/servers/68217dfd-b29a-45a3-b3ec-e2e0a3fca887 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:34.334354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b4bd09f-3982-48af-970c-39713ce40360 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c6034ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:34.397331 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b4bd09f-3982-48af-970c-39713ce40360 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.063764 Jul 14 14:37:34.398042 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1308/2614] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:34 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:34.415524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-94d76ce4-f6fc-40a1-849c-5b3228962323 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c5aaec10>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:34.484856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7e3d90b8-1092-4ff2-95a7-7b00f69a4c59 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:34.497630 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7e3d90b8-1092-4ff2-95a7-7b00f69a4c59 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1468 microversion: 2.1 time: 0.217838 Jul 14 14:37:34.507101 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1307/2615] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:34 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1468 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:34.542836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a659292e-e7df-44bf-84ef-203208082ed3 req-f17818ff-bcda-491d-97bb-c5def54b5ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9651eb2-09b7-4fe5-830c-c1974c834b44", "name": "network-vif-deleted", "tag": "e696bab4-d60d-4215-8658-6bde817e300f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:34.561215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a659292e-e7df-44bf-84ef-203208082ed3 req-f17818ff-bcda-491d-97bb-c5def54b5ace service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.561804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a659292e-e7df-44bf-84ef-203208082ed3 req-f17818ff-bcda-491d-97bb-c5def54b5ace service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.578054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG neutronclient.v2_0.client [None req-94d76ce4-f6fc-40a1-849c-5b3228962323 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 16a16ef2-b9e7-434f-87a5-f21bda440592 does not exist", "detail": ""}} {{(pid=119512) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:37:34.578675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.security_group_api [None req-94d76ce4-f6fc-40a1-849c-5b3228962323 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Neutron security group 16a16ef2-b9e7-434f-87a5-f21bda440592 not found {{(pid=119512) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:37:34.579200 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-94d76ce4-f6fc-40a1-849c-5b3228962323 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Security group 16a16ef2-b9e7-434f-87a5-f21bda440592 does not exist Jul 14 14:37:34.579200 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-b6dc9126-5603-4494-832f-1a5655f80cfb'] Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-94d76ce4-f6fc-40a1-849c-5b3228962323 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-security-groups/16a16ef2-b9e7-434f-87a5-f21bda440592 HTTP/1.1 Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: exception: Security group 16a16ef2-b9e7-434f-87a5-f21bda440592 does not exist Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-b6dc9126-5603-4494-832f-1a5655f80cfb'] Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '16a16ef2-b9e7-434f-87a5-f21bda440592'} Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:37:34.581265 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 16a16ef2-b9e7-434f-87a5-f21bda440592 does not exist Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6dc9126-5603-4494-832f-1a5655f80cfb'] Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 16a16ef2-b9e7-434f-87a5-f21bda440592 does not exist Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6dc9126-5603-4494-832f-1a5655f80cfb'] Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 16a16ef2-b9e7-434f-87a5-f21bda440592 does not exist Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6dc9126-5603-4494-832f-1a5655f80cfb'] Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 16a16ef2-b9e7-434f-87a5-f21bda440592 does not exist Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6dc9126-5603-4494-832f-1a5655f80cfb'] Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-94d76ce4-f6fc-40a1-849c-5b3228962323 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Security group 16a16ef2-b9e7-434f-87a5-f21bda440592 does not exist Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-b6dc9126-5603-4494-832f-1a5655f80cfb'] {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-94d76ce4-f6fc-40a1-849c-5b3228962323 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/16a16ef2-b9e7-434f-87a5-f21bda440592" status: 404 len: 194 microversion: 2.1 time: 0.182240 Jul 14 14:37:34.589146 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1309/2616] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:34 2022] DELETE /compute/v2.1/os-security-groups/16a16ef2-b9e7-434f-87a5-f21bda440592 => generated 194 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:34.591655 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a659292e-e7df-44bf-84ef-203208082ed3 req-f17818ff-bcda-491d-97bb-c5def54b5ace service nova] Creating event network-vif-deleted:e696bab4-d60d-4215-8658-6bde817e300f for instance b9651eb2-09b7-4fe5-830c-c1974c834b44 on n-h2-767704-28 Jul 14 14:37:34.594819 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a659292e-e7df-44bf-84ef-203208082ed3 req-f17818ff-bcda-491d-97bb-c5def54b5ace service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055825 Jul 14 14:37:34.595778 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1308/2617] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:34.613375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-32b8e577-9fdf-41df-baa6-ee7013490ce3 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6cac3d5e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:34.616362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3ea7f19d-7a16-421a-a701-00d6df935a35 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:34.618790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3ea7f19d-7a16-421a-a701-00d6df935a35 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:34.631877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ea7f19d-7a16-421a-a701-00d6df935a35 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.637755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ea7f19d-7a16-421a-a701-00d6df935a35 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.639775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ea7f19d-7a16-421a-a701-00d6df935a35 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.640536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ea7f19d-7a16-421a-a701-00d6df935a35 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.890068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-32b8e577-9fdf-41df-baa6-ee7013490ce3 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group da40307a-6d46-430a-8597-998e571898cd does not exist", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:37:34.890968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.security_group_api [None req-32b8e577-9fdf-41df-baa6-ee7013490ce3 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Neutron security group da40307a-6d46-430a-8597-998e571898cd not found {{(pid=119511) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:37:34.892039 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-32b8e577-9fdf-41df-baa6-ee7013490ce3 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Security group da40307a-6d46-430a-8597-998e571898cd does not exist Jul 14 14:37:34.892039 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-df28712a-e2a1-446d-86d2-3eb33eee9a42'] Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-32b8e577-9fdf-41df-baa6-ee7013490ce3 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-security-groups/da40307a-6d46-430a-8597-998e571898cd HTTP/1.1 Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: exception: Security group da40307a-6d46-430a-8597-998e571898cd does not exist Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-df28712a-e2a1-446d-86d2-3eb33eee9a42'] Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'da40307a-6d46-430a-8597-998e571898cd'} Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:37:34.895479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group da40307a-6d46-430a-8597-998e571898cd does not exist Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df28712a-e2a1-446d-86d2-3eb33eee9a42'] Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group da40307a-6d46-430a-8597-998e571898cd does not exist Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df28712a-e2a1-446d-86d2-3eb33eee9a42'] Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group da40307a-6d46-430a-8597-998e571898cd does not exist Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df28712a-e2a1-446d-86d2-3eb33eee9a42'] Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group da40307a-6d46-430a-8597-998e571898cd does not exist Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df28712a-e2a1-446d-86d2-3eb33eee9a42'] Jul 14 14:37:34.899215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.906885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-32b8e577-9fdf-41df-baa6-ee7013490ce3 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Security group da40307a-6d46-430a-8597-998e571898cd does not exist Jul 14 14:37:34.906885 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-df28712a-e2a1-446d-86d2-3eb33eee9a42'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:34.908094 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-32b8e577-9fdf-41df-baa6-ee7013490ce3 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/da40307a-6d46-430a-8597-998e571898cd" status: 404 len: 194 microversion: 2.1 time: 0.311164 Jul 14 14:37:34.909461 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1309/2618] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:34 2022] DELETE /compute/v2.1/os-security-groups/da40307a-6d46-430a-8597-998e571898cd => generated 194 bytes in 313 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:34.930759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3ea7f19d-7a16-421a-a701-00d6df935a35 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56c219e943b4398bea8add8299df84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703f537dac264574ac66287c275cad22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:34.941024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d75775a9-6515-4931-ae57-602c51ad065e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6cac2eca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:34.944589 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3ea7f19d-7a16-421a-a701-00d6df935a35 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 200 len: 1290 microversion: 2.1 time: 0.352496 Jul 14 14:37:34.947602 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1310/2619] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:34 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 1290 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:34.975320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-d75775a9-6515-4931-ae57-602c51ad065e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:37:34.976143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.security_group_api [None req-d75775a9-6515-4931-ae57-602c51ad065e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Neutron security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 not found {{(pid=119511) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:37:34.976694 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-d75775a9-6515-4931-ae57-602c51ad065e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:37:34.976694 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-1dc8b98f-b4c9-4620-b5ec-3a4209877b46'] Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d75775a9-6515-4931-ae57-602c51ad065e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-security-groups/79cfdd60-7506-4f5f-b5c8-6cd487eb5996 HTTP/1.1 Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: exception: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-1dc8b98f-b4c9-4620-b5ec-3a4209877b46'] Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '79cfdd60-7506-4f5f-b5c8-6cd487eb5996'} Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:37:34.979988 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dc8b98f-b4c9-4620-b5ec-3a4209877b46'] Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dc8b98f-b4c9-4620-b5ec-3a4209877b46'] Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dc8b98f-b4c9-4620-b5ec-3a4209877b46'] Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dc8b98f-b4c9-4620-b5ec-3a4209877b46'] Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d75775a9-6515-4931-ae57-602c51ad065e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Security group 79cfdd60-7506-4f5f-b5c8-6cd487eb5996 does not exist Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-1dc8b98f-b4c9-4620-b5ec-3a4209877b46'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d75775a9-6515-4931-ae57-602c51ad065e tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/79cfdd60-7506-4f5f-b5c8-6cd487eb5996" status: 404 len: 194 microversion: 2.1 time: 0.067530 Jul 14 14:37:34.983788 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1310/2620] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:34 2022] DELETE /compute/v2.1/os-security-groups/79cfdd60-7506-4f5f-b5c8-6cd487eb5996 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:34.990222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-29b633d9-d052-4d3c-90b8-7ed18f68b18c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c5aae9d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:35.014854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG neutronclient.v2_0.client [None req-29b633d9-d052-4d3c-90b8-7ed18f68b18c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist", "detail": ""}} {{(pid=119512) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:37:35.015719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.security_group_api [None req-29b633d9-d052-4d3c-90b8-7ed18f68b18c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Neutron security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 not found {{(pid=119512) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:37:35.016595 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-29b633d9-d052-4d3c-90b8-7ed18f68b18c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:37:35.016595 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-936a591d-165f-4fcd-9e2c-d54e9ddac5b3'] Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-29b633d9-d052-4d3c-90b8-7ed18f68b18c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-security-groups/7d23a9a4-8620-49b6-9079-3cdc8bb93938 HTTP/1.1 Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: exception: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-936a591d-165f-4fcd-9e2c-d54e9ddac5b3'] Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '7d23a9a4-8620-49b6-9079-3cdc8bb93938'} Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:37:35.020305 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-936a591d-165f-4fcd-9e2c-d54e9ddac5b3'] Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-936a591d-165f-4fcd-9e2c-d54e9ddac5b3'] Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-936a591d-165f-4fcd-9e2c-d54e9ddac5b3'] Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-936a591d-165f-4fcd-9e2c-d54e9ddac5b3'] Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-29b633d9-d052-4d3c-90b8-7ed18f68b18c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Security group 7d23a9a4-8620-49b6-9079-3cdc8bb93938 does not exist Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-936a591d-165f-4fcd-9e2c-d54e9ddac5b3'] {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:35.024026 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-29b633d9-d052-4d3c-90b8-7ed18f68b18c tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/7d23a9a4-8620-49b6-9079-3cdc8bb93938" status: 404 len: 194 microversion: 2.1 time: 0.037314 Jul 14 14:37:35.029419 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1311/2621] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:34 2022] DELETE /compute/v2.1/os-security-groups/7d23a9a4-8620-49b6-9079-3cdc8bb93938 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:35.034541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-839a7b9a-085c-44c9-a113-c8364e5614c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6cac3daf0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:35.077088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-839a7b9a-085c-44c9-a113-c8364e5614c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:37:35.077945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.security_group_api [None req-839a7b9a-085c-44c9-a113-c8364e5614c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Neutron security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 not found {{(pid=119511) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:37:35.079407 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-839a7b9a-085c-44c9-a113-c8364e5614c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:37:35.079407 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-7b04da3a-7695-49a9-b9e6-903592fc5d1f'] Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-839a7b9a-085c-44c9-a113-c8364e5614c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-security-groups/fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 HTTP/1.1 Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: exception: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-7b04da3a-7695-49a9-b9e6-903592fc5d1f'] Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'fea49f58-2252-4cd2-a7bc-5bf0c7ef4313'} Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:37:35.083313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b04da3a-7695-49a9-b9e6-903592fc5d1f'] Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b04da3a-7695-49a9-b9e6-903592fc5d1f'] Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b04da3a-7695-49a9-b9e6-903592fc5d1f'] Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b04da3a-7695-49a9-b9e6-903592fc5d1f'] Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-839a7b9a-085c-44c9-a113-c8364e5614c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Security group fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 does not exist Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-7b04da3a-7695-49a9-b9e6-903592fc5d1f'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-839a7b9a-085c-44c9-a113-c8364e5614c2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/fea49f58-2252-4cd2-a7bc-5bf0c7ef4313" status: 404 len: 194 microversion: 2.1 time: 0.057730 Jul 14 14:37:35.087159 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1311/2622] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:35 2022] DELETE /compute/v2.1/os-security-groups/fea49f58-2252-4cd2-a7bc-5bf0c7ef4313 => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:35.097853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e906949-03df-4d37-ad91-825266d86381 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c5c64c10>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:35.138165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG neutronclient.v2_0.client [None req-8e906949-03df-4d37-ad91-825266d86381 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist", "detail": ""}} {{(pid=119512) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:37:35.138755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.security_group_api [None req-8e906949-03df-4d37-ad91-825266d86381 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Neutron security group 873f437d-966b-4d47-9b35-637e03723ebf not found {{(pid=119512) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:37:35.139263 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-8e906949-03df-4d37-ad91-825266d86381 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:37:35.139263 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-9afaf73e-d198-49e1-8876-c23de193a6d9'] Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e906949-03df-4d37-ad91-825266d86381 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-security-groups/873f437d-966b-4d47-9b35-637e03723ebf HTTP/1.1 Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: exception: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-9afaf73e-d198-49e1-8876-c23de193a6d9'] Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '873f437d-966b-4d47-9b35-637e03723ebf'} Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:37:35.141358 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9afaf73e-d198-49e1-8876-c23de193a6d9'] Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9afaf73e-d198-49e1-8876-c23de193a6d9'] Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9afaf73e-d198-49e1-8876-c23de193a6d9'] Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9afaf73e-d198-49e1-8876-c23de193a6d9'] Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e906949-03df-4d37-ad91-825266d86381 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Security group 873f437d-966b-4d47-9b35-637e03723ebf does not exist Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: Neutron server returns request_ids: ['req-9afaf73e-d198-49e1-8876-c23de193a6d9'] {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8e906949-03df-4d37-ad91-825266d86381 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/873f437d-966b-4d47-9b35-637e03723ebf" status: 404 len: 194 microversion: 2.1 time: 0.049655 Jul 14 14:37:35.148213 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1312/2623] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:35 2022] DELETE /compute/v2.1/os-security-groups/873f437d-966b-4d47-9b35-637e03723ebf => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:35.152829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-184d98e5-9dfa-4509-b245-3c5bebf041ba tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:35.152829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-184d98e5-9dfa-4509-b245-3c5bebf041ba tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:35.163075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-184d98e5-9dfa-4509-b245-3c5bebf041ba tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.164654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-184d98e5-9dfa-4509-b245-3c5bebf041ba tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.165749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-184d98e5-9dfa-4509-b245-3c5bebf041ba tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.167971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-184d98e5-9dfa-4509-b245-3c5bebf041ba tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.264687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-184d98e5-9dfa-4509-b245-3c5bebf041ba tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:37:35.282204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a3185cca-fa5e-4ecb-8664-5ca283d185a2 req-1dfb3460-2d60-42a9-9612-d3c5685abb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7052fe14-7fcb-4fb5-a013-966c9b7ee3a6", "name": "network-vif-plugged", "status": "completed", "tag": "36cbf8c5-c0e4-4f58-8274-bca21639be29"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:35.300682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a3185cca-fa5e-4ecb-8664-5ca283d185a2 req-1dfb3460-2d60-42a9-9612-d3c5685abb07 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.301456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a3185cca-fa5e-4ecb-8664-5ca283d185a2 req-1dfb3460-2d60-42a9-9612-d3c5685abb07 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.329226 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a3185cca-fa5e-4ecb-8664-5ca283d185a2 req-1dfb3460-2d60-42a9-9612-d3c5685abb07 service nova] Creating event network-vif-plugged:36cbf8c5-c0e4-4f58-8274-bca21639be29 for instance 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 on n-h1-767704-28 Jul 14 14:37:35.340600 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a3185cca-fa5e-4ecb-8664-5ca283d185a2 req-1dfb3460-2d60-42a9-9612-d3c5685abb07 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062399 Jul 14 14:37:35.346873 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1313/2624] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:35.356047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-52e867e4-f054-4d40-920c-430302ebb36d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:35.356763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-52e867e4-f054-4d40-920c-430302ebb36d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:35.377127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52e867e4-f054-4d40-920c-430302ebb36d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.377561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52e867e4-f054-4d40-920c-430302ebb36d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.381093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52e867e4-f054-4d40-920c-430302ebb36d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.382602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52e867e4-f054-4d40-920c-430302ebb36d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.406790 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-184d98e5-9dfa-4509-b245-3c5bebf041ba tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 204 len: 0 microversion: 2.1 time: 0.257642 Jul 14 14:37:35.409150 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1312/2625] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:35 2022] DELETE /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:37:35.445471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5b9cfc7b-52fd-4a79-8869-67a2642c68dd tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:35.448357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5b9cfc7b-52fd-4a79-8869-67a2642c68dd tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:35.485044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b9cfc7b-52fd-4a79-8869-67a2642c68dd tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.485633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b9cfc7b-52fd-4a79-8869-67a2642c68dd tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.497770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b9cfc7b-52fd-4a79-8869-67a2642c68dd tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.498875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b9cfc7b-52fd-4a79-8869-67a2642c68dd tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.178160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5b9cfc7b-52fd-4a79-8869-67a2642c68dd tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.182802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-52e867e4-f054-4d40-920c-430302ebb36d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.193341 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5b9cfc7b-52fd-4a79-8869-67a2642c68dd tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1320 microversion: 2.1 time: 0.782182 Jul 14 14:37:36.194454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-52e867e4-f054-4d40-920c-430302ebb36d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.196073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-52e867e4-f054-4d40-920c-430302ebb36d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.205720 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1313/2626] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:35 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1320 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:36.206887 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-52e867e4-f054-4d40-920c-430302ebb36d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1358 microversion: 2.21 time: 0.848974 Jul 14 14:37:36.206887 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1314/2627] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:35 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1358 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:36.212377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5aa80f14-ae6d-4d99-9ca1-568dd5a14af6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cac11ee0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:36.216881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b5d24138-25c7-4099-b94b-47245a6d1bb2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:36.217581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b5d24138-25c7-4099-b94b-47245a6d1bb2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:36.229874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5d24138-25c7-4099-b94b-47245a6d1bb2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.230333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5d24138-25c7-4099-b94b-47245a6d1bb2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.231126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5d24138-25c7-4099-b94b-47245a6d1bb2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.237064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5d24138-25c7-4099-b94b-47245a6d1bb2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.280334 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5aa80f14-ae6d-4d99-9ca1-568dd5a14af6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.080652 Jul 14 14:37:36.281557 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1314/2628] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:36 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:36.290038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-87c65e22-d1fc-4165-82e2-823c2d1a740c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:36.290663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-87c65e22-d1fc-4165-82e2-823c2d1a740c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:36.298057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87c65e22-d1fc-4165-82e2-823c2d1a740c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.298761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87c65e22-d1fc-4165-82e2-823c2d1a740c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.299610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87c65e22-d1fc-4165-82e2-823c2d1a740c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.300142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87c65e22-d1fc-4165-82e2-823c2d1a740c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.664017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-87c65e22-d1fc-4165-82e2-823c2d1a740c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.673808 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-87c65e22-d1fc-4165-82e2-823c2d1a740c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1468 microversion: 2.1 time: 0.390815 Jul 14 14:37:36.684207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b5d24138-25c7-4099-b94b-47245a6d1bb2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.685115 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1315/2629] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:36 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1468 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:36.697366 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b5d24138-25c7-4099-b94b-47245a6d1bb2 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1647 microversion: 2.1 time: 0.490303 Jul 14 14:37:36.700688 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1315/2630] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:36 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1647 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:36.717300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ad26a419-8a33-42a9-a612-2da0416200ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:36.718145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ad26a419-8a33-42a9-a612-2da0416200ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:36.735221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad26a419-8a33-42a9-a612-2da0416200ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.738716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad26a419-8a33-42a9-a612-2da0416200ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.747705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad26a419-8a33-42a9-a612-2da0416200ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.750856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad26a419-8a33-42a9-a612-2da0416200ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.778169 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-ad26a419-8a33-42a9-a612-2da0416200ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ad26a419-8a33-42a9-a612-2da0416200ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 HTTP/1.1 Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'b9651eb2-09b7-4fe5-830c-c1974c834b44'} Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:36.780536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.790160 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:36.790160 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:36.790160 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:36.790160 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:36.790160 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:36.790160 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.790160 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.790160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ad26a419-8a33-42a9-a612-2da0416200ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:36.790160 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ad26a419-8a33-42a9-a612-2da0416200ff tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 404 len: 111 microversion: 2.1 time: 0.097509 Jul 14 14:37:36.790160 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1316/2631] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:36 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:36.815742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b5f663ef-dd97-416e-8807-3a2dfb2f4f61 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:36.832133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b5f663ef-dd97-416e-8807-3a2dfb2f4f61 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:36.848062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5f663ef-dd97-416e-8807-3a2dfb2f4f61 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.848524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5f663ef-dd97-416e-8807-3a2dfb2f4f61 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.857049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5f663ef-dd97-416e-8807-3a2dfb2f4f61 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.859688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5f663ef-dd97-416e-8807-3a2dfb2f4f61 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.892842 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-b5f663ef-dd97-416e-8807-3a2dfb2f4f61 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b5f663ef-dd97-416e-8807-3a2dfb2f4f61 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 HTTP/1.1 Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'b9651eb2-09b7-4fe5-830c-c1974c834b44'} Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:36.898715 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b5f663ef-dd97-416e-8807-3a2dfb2f4f61 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b5f663ef-dd97-416e-8807-3a2dfb2f4f61 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 404 len: 111 microversion: 2.1 time: 0.109408 Jul 14 14:37:36.904578 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1316/2632] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:36 2022] DELETE /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:36.910357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c509c630-af60-4f03-86b9-3af1f05a292a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:36.911013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c509c630-af60-4f03-86b9-3af1f05a292a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: b9651eb2-09b7-4fe5-830c-c1974c834b44] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:36.928240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c509c630-af60-4f03-86b9-3af1f05a292a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.929250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c509c630-af60-4f03-86b9-3af1f05a292a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.931623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c509c630-af60-4f03-86b9-3af1f05a292a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.933323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c509c630-af60-4f03-86b9-3af1f05a292a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.953578 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c509c630-af60-4f03-86b9-3af1f05a292a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c509c630-af60-4f03-86b9-3af1f05a292a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 HTTP/1.1 Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'b9651eb2-09b7-4fe5-830c-c1974c834b44'} Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:36.955424 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.960057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:36.960057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:36.960057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:36.960057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:36.960057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:36.960057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. Jul 14 14:37:36.960057 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:36.960057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c509c630-af60-4f03-86b9-3af1f05a292a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance b9651eb2-09b7-4fe5-830c-c1974c834b44 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:36.961607 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c509c630-af60-4f03-86b9-3af1f05a292a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44" status: 404 len: 111 microversion: 2.1 time: 0.051279 Jul 14 14:37:36.962846 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1317/2633] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:36 2022] GET /compute/v2.1/servers/b9651eb2-09b7-4fe5-830c-c1974c834b44 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:36.982698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b9d63c1-1e64-452a-82bb-031c53b2469e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:36.982698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b9d63c1-1e64-452a-82bb-031c53b2469e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:36.993056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b9d63c1-1e64-452a-82bb-031c53b2469e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.993737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b9d63c1-1e64-452a-82bb-031c53b2469e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.995599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b9d63c1-1e64-452a-82bb-031c53b2469e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.996599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b9d63c1-1e64-452a-82bb-031c53b2469e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.016567 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-2b9d63c1-1e64-452a-82bb-031c53b2469e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b9d63c1-1e64-452a-82bb-031c53b2469e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 HTTP/1.1 Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'deb1f152-0733-4f36-91a0-71797b749e16'} Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:37.018510 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b9d63c1-1e64-452a-82bb-031c53b2469e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b9d63c1-1e64-452a-82bb-031c53b2469e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 404 len: 111 microversion: 2.1 time: 0.051842 Jul 14 14:37:37.023477 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1317/2634] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:36 2022] DELETE /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:37.037897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4dd791a6-edd8-4c5d-a00a-bd794776654e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.038532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4dd791a6-edd8-4c5d-a00a-bd794776654e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: deb1f152-0733-4f36-91a0-71797b749e16] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:37.047597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4dd791a6-edd8-4c5d-a00a-bd794776654e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.048265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4dd791a6-edd8-4c5d-a00a-bd794776654e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.048863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4dd791a6-edd8-4c5d-a00a-bd794776654e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.049335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4dd791a6-edd8-4c5d-a00a-bd794776654e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.068291 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-4dd791a6-edd8-4c5d-a00a-bd794776654e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4dd791a6-edd8-4c5d-a00a-bd794776654e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 HTTP/1.1 Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'deb1f152-0733-4f36-91a0-71797b749e16'} Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:37.071455 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.076275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.076275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:37.076275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:37.076275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:37.076275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:37.076275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. Jul 14 14:37:37.076275 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.078730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4dd791a6-edd8-4c5d-a00a-bd794776654e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance deb1f152-0733-4f36-91a0-71797b749e16 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:37.079893 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4dd791a6-edd8-4c5d-a00a-bd794776654e tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16" status: 404 len: 111 microversion: 2.1 time: 0.051198 Jul 14 14:37:37.081099 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1318/2635] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:37 2022] GET /compute/v2.1/servers/deb1f152-0733-4f36-91a0-71797b749e16 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:37.090723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-584f62f3-35b7-4928-ae94-14fe8b0efa5a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.091250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-584f62f3-35b7-4928-ae94-14fe8b0efa5a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:37.098343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:37.100678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-584f62f3-35b7-4928-ae94-14fe8b0efa5a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.101478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-584f62f3-35b7-4928-ae94-14fe8b0efa5a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.102305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-584f62f3-35b7-4928-ae94-14fe8b0efa5a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.102915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-584f62f3-35b7-4928-ae94-14fe8b0efa5a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.122327 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-584f62f3-35b7-4928-ae94-14fe8b0efa5a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-584f62f3-35b7-4928-ae94-14fe8b0efa5a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 HTTP/1.1 Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '131fc2d4-00c2-462b-b7e2-4fbb53234749'} Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:37.124317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-584f62f3-35b7-4928-ae94-14fe8b0efa5a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:37.128487 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-584f62f3-35b7-4928-ae94-14fe8b0efa5a tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 404 len: 111 microversion: 2.1 time: 0.040345 Jul 14 14:37:37.130233 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1318/2636] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:37 2022] DELETE /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:37.135514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c04f925-d11b-40df-a5ed-355dff87df73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.136236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3c04f925-d11b-40df-a5ed-355dff87df73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 131fc2d4-00c2-462b-b7e2-4fbb53234749] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:37.143755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c04f925-d11b-40df-a5ed-355dff87df73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.144214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c04f925-d11b-40df-a5ed-355dff87df73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.145198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c04f925-d11b-40df-a5ed-355dff87df73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.145638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c04f925-d11b-40df-a5ed-355dff87df73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.170529 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-3c04f925-d11b-40df-a5ed-355dff87df73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c04f925-d11b-40df-a5ed-355dff87df73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 HTTP/1.1 Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '131fc2d4-00c2-462b-b7e2-4fbb53234749'} Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:37.172251 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.177372 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.177372 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:37.177372 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:37.177372 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:37.177372 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:37.177372 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. Jul 14 14:37:37.177372 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.177372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c04f925-d11b-40df-a5ed-355dff87df73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance 131fc2d4-00c2-462b-b7e2-4fbb53234749 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:37.177372 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3c04f925-d11b-40df-a5ed-355dff87df73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749" status: 404 len: 111 microversion: 2.1 time: 0.043466 Jul 14 14:37:37.178160 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1319/2637] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:37 2022] GET /compute/v2.1/servers/131fc2d4-00c2-462b-b7e2-4fbb53234749 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:37.183571 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b3386d26-64cd-48f4-8b07-4f79d7b86a2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.184100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b3386d26-64cd-48f4-8b07-4f79d7b86a2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:37.192315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3386d26-64cd-48f4-8b07-4f79d7b86a2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.192773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3386d26-64cd-48f4-8b07-4f79d7b86a2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.193620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3386d26-64cd-48f4-8b07-4f79d7b86a2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.194074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3386d26-64cd-48f4-8b07-4f79d7b86a2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.215256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-355599f6-1913-4c28-b11b-a3c2f195a80e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.216339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-355599f6-1913-4c28-b11b-a3c2f195a80e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:37.222529 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-b3386d26-64cd-48f4-8b07-4f79d7b86a2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b3386d26-64cd-48f4-8b07-4f79d7b86a2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 HTTP/1.1 Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'c70651b9-4d75-42ad-9463-eb29e92c4356'} Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:37.227345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:37.243728 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:37:37.243728 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.243728 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:37.243728 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.243728 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.243728 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:37.243728 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:37.243728 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:37.243728 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:37.243728 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:37:37.243728 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.243728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b3386d26-64cd-48f4-8b07-4f79d7b86a2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:37.246665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-355599f6-1913-4c28-b11b-a3c2f195a80e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.246665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-355599f6-1913-4c28-b11b-a3c2f195a80e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.247546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-355599f6-1913-4c28-b11b-a3c2f195a80e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.247761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-355599f6-1913-4c28-b11b-a3c2f195a80e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.250035 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b3386d26-64cd-48f4-8b07-4f79d7b86a2d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 404 len: 111 microversion: 2.1 time: 0.070095 Jul 14 14:37:37.254551 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1319/2638] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:37 2022] DELETE /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:37.257961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8a73bbb8-eaab-4c3f-b0ff-92e607061583 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.258670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8a73bbb8-eaab-4c3f-b0ff-92e607061583 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:37.268097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a73bbb8-eaab-4c3f-b0ff-92e607061583 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.268567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a73bbb8-eaab-4c3f-b0ff-92e607061583 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.269463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a73bbb8-eaab-4c3f-b0ff-92e607061583 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.270109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a73bbb8-eaab-4c3f-b0ff-92e607061583 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.589073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=14 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:37.700072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8a73bbb8-eaab-4c3f-b0ff-92e607061583 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:37.715973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8a73bbb8-eaab-4c3f-b0ff-92e607061583 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:37.718191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8a73bbb8-eaab-4c3f-b0ff-92e607061583 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:37.719846 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8a73bbb8-eaab-4c3f-b0ff-92e607061583 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1551 microversion: 2.21 time: 0.466820 Jul 14 14:37:37.721131 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1320/2639] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:37 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1551 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:37.728579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-72cf9e85-eb15-4605-8ac5-6164f9c5b4c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.729890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-72cf9e85-eb15-4605-8ac5-6164f9c5b4c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: c70651b9-4d75-42ad-9463-eb29e92c4356] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:37.739335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72cf9e85-eb15-4605-8ac5-6164f9c5b4c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.740359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72cf9e85-eb15-4605-8ac5-6164f9c5b4c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.741739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72cf9e85-eb15-4605-8ac5-6164f9c5b4c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.743285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72cf9e85-eb15-4605-8ac5-6164f9c5b4c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.778812 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-72cf9e85-eb15-4605-8ac5-6164f9c5b4c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-72cf9e85-eb15-4605-8ac5-6164f9c5b4c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 HTTP/1.1 Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'c70651b9-4d75-42ad-9463-eb29e92c4356'} Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:37.781637 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.786292 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:37.786292 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:37.786292 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:37.786292 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:37.786292 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:37.786292 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. Jul 14 14:37:37.786292 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:37.786292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-72cf9e85-eb15-4605-8ac5-6164f9c5b4c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance c70651b9-4d75-42ad-9463-eb29e92c4356 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:37.787258 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-72cf9e85-eb15-4605-8ac5-6164f9c5b4c3 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356" status: 404 len: 111 microversion: 2.1 time: 0.064073 Jul 14 14:37:37.792042 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1321/2640] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:37 2022] GET /compute/v2.1/servers/c70651b9-4d75-42ad-9463-eb29e92c4356 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:37.798278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8a14c1a4-f97e-46b0-b7e7-d11bbced08b8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5ba31f0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.866975 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8a14c1a4-f97e-46b0-b7e7-d11bbced08b8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.077790 Jul 14 14:37:37.871209 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1322/2641] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:37 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:37.890080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7a190854-6873-4a76-bb5d-86c56d948a97 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.890975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7a190854-6873-4a76-bb5d-86c56d948a97 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:37.909611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a190854-6873-4a76-bb5d-86c56d948a97 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.911643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a190854-6873-4a76-bb5d-86c56d948a97 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.912565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a190854-6873-4a76-bb5d-86c56d948a97 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.915266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a190854-6873-4a76-bb5d-86c56d948a97 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:38.179003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-355599f6-1913-4c28-b11b-a3c2f195a80e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:38.198147 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-355599f6-1913-4c28-b11b-a3c2f195a80e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1320 microversion: 2.1 time: 0.986837 Jul 14 14:37:38.199590 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1320/2642] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:37 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1320 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:38.204411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ab717316-67b8-4982-a189-ebf2db1b2870 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:38.217206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ab717316-67b8-4982-a189-ebf2db1b2870 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:38.224247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab717316-67b8-4982-a189-ebf2db1b2870 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:38.224994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab717316-67b8-4982-a189-ebf2db1b2870 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:38.225798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab717316-67b8-4982-a189-ebf2db1b2870 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:38.226249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab717316-67b8-4982-a189-ebf2db1b2870 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:38.941226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7a190854-6873-4a76-bb5d-86c56d948a97 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:38.951526 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7a190854-6873-4a76-bb5d-86c56d948a97 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1468 microversion: 2.1 time: 1.077296 Jul 14 14:37:38.952875 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1323/2643] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:37 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1468 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:38.957989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e22853bb-011a-4f31-b716-00e0d913f7ea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:38.961048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e22853bb-011a-4f31-b716-00e0d913f7ea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:38.973800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e22853bb-011a-4f31-b716-00e0d913f7ea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:38.974839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e22853bb-011a-4f31-b716-00e0d913f7ea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:38.975657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e22853bb-011a-4f31-b716-00e0d913f7ea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:38.976104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e22853bb-011a-4f31-b716-00e0d913f7ea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:38.979364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:39.006765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e22853bb-011a-4f31-b716-00e0d913f7ea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:37:39.132967 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e22853bb-011a-4f31-b716-00e0d913f7ea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "DELETE /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 204 len: 0 microversion: 2.21 time: 0.178405 Jul 14 14:37:39.134605 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1324/2644] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:37:38 2022] DELETE /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:37:39.144225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c39fb2a4-4411-4297-bb0e-c12e95dc74d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:39.145506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c39fb2a4-4411-4297-bb0e-c12e95dc74d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:39.154622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c39fb2a4-4411-4297-bb0e-c12e95dc74d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.155540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c39fb2a4-4411-4297-bb0e-c12e95dc74d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.156733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c39fb2a4-4411-4297-bb0e-c12e95dc74d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.157606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c39fb2a4-4411-4297-bb0e-c12e95dc74d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.185990 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-c39fb2a4-4411-4297-bb0e-c12e95dc74d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c39fb2a4-4411-4297-bb0e-c12e95dc74d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf HTTP/1.1 Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '78cbc19a-1538-43b8-8e70-91d438069caf'} Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:39.189776 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c39fb2a4-4411-4297-bb0e-c12e95dc74d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:39.194345 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c39fb2a4-4411-4297-bb0e-c12e95dc74d4 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 404 len: 111 microversion: 2.1 time: 0.054876 Jul 14 14:37:39.196045 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1325/2645] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:39 2022] DELETE /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:39.201103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c3dad34b-ff4f-4d87-876c-f4b1f547c6bb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5aae9d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:39.240326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ab717316-67b8-4982-a189-ebf2db1b2870 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.250209 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ab717316-67b8-4982-a189-ebf2db1b2870 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1647 microversion: 2.1 time: 1.049541 Jul 14 14:37:39.262431 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1321/2646] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:38 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1647 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:39.275676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-444bdaf9-d51c-46a6-a2df-ad8d2f8afcea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:39.277077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-444bdaf9-d51c-46a6-a2df-ad8d2f8afcea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:39.291003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-444bdaf9-d51c-46a6-a2df-ad8d2f8afcea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.292244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-444bdaf9-d51c-46a6-a2df-ad8d2f8afcea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.293072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-444bdaf9-d51c-46a6-a2df-ad8d2f8afcea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.293526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-444bdaf9-d51c-46a6-a2df-ad8d2f8afcea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.295515 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c3dad34b-ff4f-4d87-876c-f4b1f547c6bb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.098599 Jul 14 14:37:39.296103 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1326/2647] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:39 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:39.318213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8688547-d7e6-4d74-a050-d11e25ad1f73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:39.318858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8688547-d7e6-4d74-a050-d11e25ad1f73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 78cbc19a-1538-43b8-8e70-91d438069caf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:39.335699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8688547-d7e6-4d74-a050-d11e25ad1f73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.343066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8688547-d7e6-4d74-a050-d11e25ad1f73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.343921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8688547-d7e6-4d74-a050-d11e25ad1f73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.344370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8688547-d7e6-4d74-a050-d11e25ad1f73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.399188 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-d8688547-d7e6-4d74-a050-d11e25ad1f73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8688547-d7e6-4d74-a050-d11e25ad1f73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf HTTP/1.1 Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '78cbc19a-1538-43b8-8e70-91d438069caf'} Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:39.401340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:39.405730 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:39.405730 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:39.405730 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:39.405730 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:39.405730 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:39.405730 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. Jul 14 14:37:39.405730 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:39.414238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8688547-d7e6-4d74-a050-d11e25ad1f73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance 78cbc19a-1538-43b8-8e70-91d438069caf could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:39.415293 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8688547-d7e6-4d74-a050-d11e25ad1f73 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf" status: 404 len: 111 microversion: 2.1 time: 0.117429 Jul 14 14:37:39.416035 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1327/2648] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:39 2022] GET /compute/v2.1/servers/78cbc19a-1538-43b8-8e70-91d438069caf => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:39.442364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bbc455eb-0a55-46c5-9159-9ee4d7ddd131 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:39.442989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bbc455eb-0a55-46c5-9159-9ee4d7ddd131 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:39.461668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bbc455eb-0a55-46c5-9159-9ee4d7ddd131 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.477739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bbc455eb-0a55-46c5-9159-9ee4d7ddd131 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.479427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bbc455eb-0a55-46c5-9159-9ee4d7ddd131 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.480039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bbc455eb-0a55-46c5-9159-9ee4d7ddd131 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.934160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-444bdaf9-d51c-46a6-a2df-ad8d2f8afcea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.970377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-444bdaf9-d51c-46a6-a2df-ad8d2f8afcea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.972073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-444bdaf9-d51c-46a6-a2df-ad8d2f8afcea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.973302 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-444bdaf9-d51c-46a6-a2df-ad8d2f8afcea tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1557 microversion: 2.21 time: 0.709874 Jul 14 14:37:39.973873 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1322/2649] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:39 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1557 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:39.982484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be541d0c-08c4-451e-8edd-9af0668ffc5b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:39.983094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-be541d0c-08c4-451e-8edd-9af0668ffc5b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:40.000973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be541d0c-08c4-451e-8edd-9af0668ffc5b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.001595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be541d0c-08c4-451e-8edd-9af0668ffc5b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.002452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be541d0c-08c4-451e-8edd-9af0668ffc5b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.002909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be541d0c-08c4-451e-8edd-9af0668ffc5b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.048896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bbc455eb-0a55-46c5-9159-9ee4d7ddd131 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:40.062199 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bbc455eb-0a55-46c5-9159-9ee4d7ddd131 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1511 microversion: 2.1 time: 0.630623 Jul 14 14:37:40.063370 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1328/2650] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:39 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1511 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:40.094101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f92afc0b-e7e4-4e21-9869-1080fd6065e6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:40.095477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f92afc0b-e7e4-4e21-9869-1080fd6065e6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:40.106534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f92afc0b-e7e4-4e21-9869-1080fd6065e6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.107606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f92afc0b-e7e4-4e21-9869-1080fd6065e6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.108664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f92afc0b-e7e4-4e21-9869-1080fd6065e6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.109414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f92afc0b-e7e4-4e21-9869-1080fd6065e6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.074211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-be541d0c-08c4-451e-8edd-9af0668ffc5b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:41.090527 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-be541d0c-08c4-451e-8edd-9af0668ffc5b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1468 microversion: 2.1 time: 1.112248 Jul 14 14:37:41.093719 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1323/2651] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:39 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1468 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:41.108586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cb0d0235-881d-48c3-8609-54f240b5c2d6 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:41.111813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cb0d0235-881d-48c3-8609-54f240b5c2d6 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:41.128313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb0d0235-881d-48c3-8609-54f240b5c2d6 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.131910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb0d0235-881d-48c3-8609-54f240b5c2d6 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.136375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb0d0235-881d-48c3-8609-54f240b5c2d6 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.137856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb0d0235-881d-48c3-8609-54f240b5c2d6 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.349842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f92afc0b-e7e4-4e21-9869-1080fd6065e6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:41.366575 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f92afc0b-e7e4-4e21-9869-1080fd6065e6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1321 microversion: 2.1 time: 1.279319 Jul 14 14:37:41.367878 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1329/2652] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:40 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1321 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:41.381598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-511cc484-fec0-4b04-8f50-21ffbd27a075 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5b5c0d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:41.443955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cb0d0235-881d-48c3-8609-54f240b5c2d6 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae1d6f3c8a2476aab57620c281ecdc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63994cd418f458d80ef0b54128592fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:41.456627 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-511cc484-fec0-4b04-8f50-21ffbd27a075 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.087414 Jul 14 14:37:41.464240 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cb0d0235-881d-48c3-8609-54f240b5c2d6 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 200 len: 1468 microversion: 2.1 time: 0.369244 Jul 14 14:37:41.467631 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1330/2653] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:41 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:41.472694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b145ddd-5cfe-4fce-be12-7774b4598dc3 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:41.474018 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1324/2654] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:41 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 1468 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:41.479368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-91816f6a-c079-4e77-b0e5-8393a67b372b req-e9394170-e703-4af8-9b01-5a4c4ef1a833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68", "name": "network-vif-deleted", "tag": "a463658a-4486-4768-9db2-ddb8cc33d3aa"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:41.485159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3b145ddd-5cfe-4fce-be12-7774b4598dc3 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:41.509381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b145ddd-5cfe-4fce-be12-7774b4598dc3 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.521592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b145ddd-5cfe-4fce-be12-7774b4598dc3 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.531074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b145ddd-5cfe-4fce-be12-7774b4598dc3 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.533576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-91816f6a-c079-4e77-b0e5-8393a67b372b req-e9394170-e703-4af8-9b01-5a4c4ef1a833 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.534179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b145ddd-5cfe-4fce-be12-7774b4598dc3 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.537722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-91816f6a-c079-4e77-b0e5-8393a67b372b req-e9394170-e703-4af8-9b01-5a4c4ef1a833 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.565398 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-91816f6a-c079-4e77-b0e5-8393a67b372b req-e9394170-e703-4af8-9b01-5a4c4ef1a833 service nova] Creating event network-vif-deleted:a463658a-4486-4768-9db2-ddb8cc33d3aa for instance e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 on n-h2-767704-28 Jul 14 14:37:41.574347 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-91816f6a-c079-4e77-b0e5-8393a67b372b req-e9394170-e703-4af8-9b01-5a4c4ef1a833 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098463 Jul 14 14:37:41.577254 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1325/2655] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:42.108929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-8fa802f1-e9e3-405b-9968-f5d96468b838 req-3d969896-f00e-47d0-9605-2ee46197a661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de4a96e5-12c5-41dd-a248-36d32b315964", "name": "network-vif-deleted", "tag": "750daef1-f8e4-4ca6-ab79-22f3bc3f616c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:42.123933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8fa802f1-e9e3-405b-9968-f5d96468b838 req-3d969896-f00e-47d0-9605-2ee46197a661 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.124939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8fa802f1-e9e3-405b-9968-f5d96468b838 req-3d969896-f00e-47d0-9605-2ee46197a661 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.140785 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8fa802f1-e9e3-405b-9968-f5d96468b838 req-3d969896-f00e-47d0-9605-2ee46197a661 service nova] Creating event network-vif-deleted:750daef1-f8e4-4ca6-ab79-22f3bc3f616c for instance de4a96e5-12c5-41dd-a248-36d32b315964 on n-h2-767704-28 Jul 14 14:37:42.151083 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-8fa802f1-e9e3-405b-9968-f5d96468b838 req-3d969896-f00e-47d0-9605-2ee46197a661 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046896 Jul 14 14:37:42.155669 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1326/2656] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:42.165402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea2f4f3a-8712-4f88-818b-773f348e2329 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:42.169828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ea2f4f3a-8712-4f88-818b-773f348e2329 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:42.182630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea2f4f3a-8712-4f88-818b-773f348e2329 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.184015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea2f4f3a-8712-4f88-818b-773f348e2329 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.185872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea2f4f3a-8712-4f88-818b-773f348e2329 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.186587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea2f4f3a-8712-4f88-818b-773f348e2329 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.652320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b145ddd-5cfe-4fce-be12-7774b4598dc3 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:42.671608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b145ddd-5cfe-4fce-be12-7774b4598dc3 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:42.674084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b145ddd-5cfe-4fce-be12-7774b4598dc3 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb334fc0f7a4db3861ebe09a695fb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1ec8796d414035aee2a18ba3e2cfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:42.682269 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b145ddd-5cfe-4fce-be12-7774b4598dc3 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 200 len: 1557 microversion: 2.21 time: 1.212934 Jul 14 14:37:42.683103 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1331/2657] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:41 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 1557 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:42.711557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-757a5be9-7227-46d0-ac74-d7c858bf4284 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:42.713140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-757a5be9-7227-46d0-ac74-d7c858bf4284 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:42.722578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-757a5be9-7227-46d0-ac74-d7c858bf4284 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.723537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-757a5be9-7227-46d0-ac74-d7c858bf4284 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.724802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-757a5be9-7227-46d0-ac74-d7c858bf4284 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.725484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-757a5be9-7227-46d0-ac74-d7c858bf4284 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.792658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ea2f4f3a-8712-4f88-818b-773f348e2329 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:42.800523 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ea2f4f3a-8712-4f88-818b-773f348e2329 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1468 microversion: 2.1 time: 0.643411 Jul 14 14:37:42.813340 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1327/2658] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:42 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1468 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:42.818307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7cfe432e-3cc0-447d-b65a-984889d9cb51 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cabc8ca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:42.940913 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7cfe432e-3cc0-447d-b65a-984889d9cb51 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.126272 Jul 14 14:37:42.946567 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1328/2659] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:42 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:42.965662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2b630e12-c01c-4924-a2fa-e4a22bd3c854 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:42.976368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2b630e12-c01c-4924-a2fa-e4a22bd3c854 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] [instance: e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:42.993831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b630e12-c01c-4924-a2fa-e4a22bd3c854 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.996338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b630e12-c01c-4924-a2fa-e4a22bd3c854 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.997433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b630e12-c01c-4924-a2fa-e4a22bd3c854 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.998581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b630e12-c01c-4924-a2fa-e4a22bd3c854 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.036478 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-2b630e12-c01c-4924-a2fa-e4a22bd3c854 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] HTTP exception thrown: Instance e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 could not be found. Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2b630e12-c01c-4924-a2fa-e4a22bd3c854 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Request method failure captured: Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 HTTP/1.1 Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnHTgE9huApIzPq-QeVEX1rJyhE5VmK868YuWo_cL_TA59xLqyHm_nAglxpyD9cbUv9oJ6Mlnqyx0y3Bpk_4CGAQDRERkiy8vpYPoY5MVDfSucR_DlSQuKeaBIRtdWEzw1i3Oya1yNrHtYo1zA1YsyqeW3Guh7QF04_mQsDmm6O6uw Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a63994cd418f458d80ef0b54128592fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a63994cd418f458d80ef0b54128592fc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a63994cd418f458d80ef0b54128592fc"}]}] Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a63994cd418f458d80ef0b54128592fc Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-634840235 Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 1ae1d6f3c8a2476aab57620c281ecdc1 Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupsTestJSON-634840235-project Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 could not be found. Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68'} Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 could not be found. Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 could not be found. Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:43.038536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:43.043255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:43.043255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:43.043255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:43.043255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:43.043255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:43.043255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 could not be found. Jul 14 14:37:43.043255 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:43.045258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2b630e12-c01c-4924-a2fa-e4a22bd3c854 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Returning 404 to user: Instance e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:43.046332 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2b630e12-c01c-4924-a2fa-e4a22bd3c854 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68" status: 404 len: 111 microversion: 2.1 time: 0.103402 Jul 14 14:37:43.047521 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1329/2660] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:42 2022] GET /compute/v2.1/servers/e9dd6ad3-d671-4ba2-8873-ecc5a5d7ac68 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:43.055897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e9c53ab5-3240-4d34-9367-9c3f2967a312 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6cac3dd30>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:43.158738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-757a5be9-7227-46d0-ac74-d7c858bf4284 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:43.176652 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-757a5be9-7227-46d0-ac74-d7c858bf4284 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1321 microversion: 2.1 time: 0.485996 Jul 14 14:37:43.203548 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1332/2661] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:42 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:43.538453 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e9c53ab5-3240-4d34-9367-9c3f2967a312 tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/c287caee-f2ba-4df0-bedc-508759addca3" status: 202 len: 0 microversion: 2.1 time: 0.486141 Jul 14 14:37:43.539187 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1330/2662] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:43 2022] DELETE /compute/v2.1/os-security-groups/c287caee-f2ba-4df0-bedc-508759addca3 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:37:43.548150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-48619bf7-3791-4496-8229-fa9e597f08ef tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] Calling method '.version_select at 0x7fd6c6034ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:43.703005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-32544752-221d-467f-aa48-3db40bba6c6d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:43.703823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-32544752-221d-467f-aa48-3db40bba6c6d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:43.722553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-32544752-221d-467f-aa48-3db40bba6c6d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.729411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-32544752-221d-467f-aa48-3db40bba6c6d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.732732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-32544752-221d-467f-aa48-3db40bba6c6d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.733638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-32544752-221d-467f-aa48-3db40bba6c6d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.780653 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-32544752-221d-467f-aa48-3db40bba6c6d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] HTTP exception thrown: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-32544752-221d-467f-aa48-3db40bba6c6d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Request method failure captured: Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 HTTP/1.1 Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CoSDbKQo-ua_bXkllkPEYMKWwdVyL4IhH0lNAGZSE_SnMZkvuVW0NaE-rsKqZAsPgr7aywPyHNq5AJY7nUKc0offLmk8m4sZfY-iWe4tdEIfdJVaduQqIG6Ywp2wwixEmCRWueVYsEhAD6Z8VZhqhhEs3vR0JoSQ9L8m2Ri6P5fATU Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.21 Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 9c1ec8796d414035aee2a18ba3e2cfa4 Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1357900321 Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9c1ec8796d414035aee2a18ba3e2cfa4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9c1ec8796d414035aee2a18ba3e2cfa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9c1ec8796d414035aee2a18ba3e2cfa4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9c1ec8796d414035aee2a18ba3e2cfa4"}]}] Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-InstanceActionsV221TestJSON-1357900321 Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 9c1ec8796d414035aee2a18ba3e2cfa4 Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1357900321 Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-InstanceActionsV221TestJSON-1357900321-project Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: adb334fc0f7a4db3861ebe09a695fb20 Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-InstanceActionsV221TestJSON-1357900321-project Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'de4a96e5-12c5-41dd-a248-36d32b315964'} Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:43.784118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:43.788161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:43.788161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:43.788161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:43.788161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:43.788161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:43.788161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:43.788161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:43.788161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:43.795250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-32544752-221d-467f-aa48-3db40bba6c6d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Returning 404 to user: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:43.796574 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-32544752-221d-467f-aa48-3db40bba6c6d tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 404 len: 111 microversion: 2.21 time: 0.098227 Jul 14 14:37:43.801293 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1331/2663] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:43 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:37:43.812835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ee5fc18c-e809-4745-aebe-e5201ff6a0d5 req-a02c0836-5d8c-4ab4-a6fa-70989fcc19fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecf4db7-6444-4c98-9043-5c39faf7125a", "name": "network-vif-plugged", "status": "completed", "tag": "8215142c-738e-4be2-aacd-31ab4926d96e"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:43.875406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ee5fc18c-e809-4745-aebe-e5201ff6a0d5 req-a02c0836-5d8c-4ab4-a6fa-70989fcc19fd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.881850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ee5fc18c-e809-4745-aebe-e5201ff6a0d5 req-a02c0836-5d8c-4ab4-a6fa-70989fcc19fd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.923036 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ee5fc18c-e809-4745-aebe-e5201ff6a0d5 req-a02c0836-5d8c-4ab4-a6fa-70989fcc19fd service nova] Creating event network-vif-plugged:8215142c-738e-4be2-aacd-31ab4926d96e for instance aecf4db7-6444-4c98-9043-5c39faf7125a on n-h2-767704-28 Jul 14 14:37:43.930468 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ee5fc18c-e809-4745-aebe-e5201ff6a0d5 req-a02c0836-5d8c-4ab4-a6fa-70989fcc19fd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127104 Jul 14 14:37:43.933760 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1332/2664] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:43.940804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-439fc5de-d81b-47c8-a175-c3d7f064f629 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '.version_select at 0x7fd6cac3d820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:43.943094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-439fc5de-d81b-47c8-a175-c3d7f064f629 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:44.001395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-439fc5de-d81b-47c8-a175-c3d7f064f629 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:44.002056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-439fc5de-d81b-47c8-a175-c3d7f064f629 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:44.003710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-439fc5de-d81b-47c8-a175-c3d7f064f629 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:44.004641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-439fc5de-d81b-47c8-a175-c3d7f064f629 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:44.206600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:44.218940 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-439fc5de-d81b-47c8-a175-c3d7f064f629 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.282315 Jul 14 14:37:44.221249 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1333/2665] 10.222.0.81 () {60 vars in 1336 bytes} [Thu Jul 14 14:37:43 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964/os-instance-actions => generated 611 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:37:44.237166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d7cace52-3daa-4a7c-9550-b2996ce420b9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:44.241029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d7cace52-3daa-4a7c-9550-b2996ce420b9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:44.262857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7cace52-3daa-4a7c-9550-b2996ce420b9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:44.263746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7cace52-3daa-4a7c-9550-b2996ce420b9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:44.264780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7cace52-3daa-4a7c-9550-b2996ce420b9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:44.265492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7cace52-3daa-4a7c-9550-b2996ce420b9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:44.969527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d7cace52-3daa-4a7c-9550-b2996ce420b9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:44.993448 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d7cace52-3daa-4a7c-9550-b2996ce420b9 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1468 microversion: 2.1 time: 0.770585 Jul 14 14:37:44.998910 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1334/2666] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:44 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1468 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:45.012613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6b631454-070c-43c7-a4c5-2c69152df0c8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cac11e50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:45.117231 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6b631454-070c-43c7-a4c5-2c69152df0c8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.115449 Jul 14 14:37:45.126067 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1335/2667] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:44 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:45.133111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-796c3589-3f01-42b7-98b8-342dc10ec88d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:45.133737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-796c3589-3f01-42b7-98b8-342dc10ec88d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:45.161519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-796c3589-3f01-42b7-98b8-342dc10ec88d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.164366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-796c3589-3f01-42b7-98b8-342dc10ec88d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.190921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-796c3589-3f01-42b7-98b8-342dc10ec88d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.198724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-796c3589-3f01-42b7-98b8-342dc10ec88d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.412920 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-48619bf7-3791-4496-8229-fa9e597f08ef tempest-SecurityGroupsTestJSON-634840235 tempest-SecurityGroupsTestJSON-634840235-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/9032c326-4394-49c4-9e63-e96969509fee" status: 202 len: 0 microversion: 2.1 time: 1.869286 Jul 14 14:37:45.413865 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1333/2668] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:43 2022] DELETE /compute/v2.1/os-security-groups/9032c326-4394-49c4-9e63-e96969509fee => generated 0 bytes in 1871 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:45.420281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ee828b3b-d64b-48e3-8f35-aae749f4a5bd tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:45.421088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ee828b3b-d64b-48e3-8f35-aae749f4a5bd tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:45.445960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee828b3b-d64b-48e3-8f35-aae749f4a5bd tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.447245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee828b3b-d64b-48e3-8f35-aae749f4a5bd tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.448507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee828b3b-d64b-48e3-8f35-aae749f4a5bd tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.449194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee828b3b-d64b-48e3-8f35-aae749f4a5bd tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.495184 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-ee828b3b-d64b-48e3-8f35-aae749f4a5bd tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] HTTP exception thrown: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ee828b3b-d64b-48e3-8f35-aae749f4a5bd tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Request method failure captured: Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 HTTP/1.1 Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CoSDbKQo-ua_bXkllkPEYMKWwdVyL4IhH0lNAGZSE_SnMZkvuVW0NaE-rsKqZAsPgr7aywPyHNq5AJY7nUKc0offLmk8m4sZfY-iWe4tdEIfdJVaduQqIG6Ywp2wwixEmCRWueVYsEhAD6Z8VZhqhhEs3vR0JoSQ9L8m2Ri6P5fATU Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.21 Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 9c1ec8796d414035aee2a18ba3e2cfa4 Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1357900321 Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9c1ec8796d414035aee2a18ba3e2cfa4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9c1ec8796d414035aee2a18ba3e2cfa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9c1ec8796d414035aee2a18ba3e2cfa4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9c1ec8796d414035aee2a18ba3e2cfa4"}]}] Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-InstanceActionsV221TestJSON-1357900321 Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 9c1ec8796d414035aee2a18ba3e2cfa4 Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1357900321 Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-InstanceActionsV221TestJSON-1357900321-project Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: adb334fc0f7a4db3861ebe09a695fb20 Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-InstanceActionsV221TestJSON-1357900321-project Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'de4a96e5-12c5-41dd-a248-36d32b315964'} Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:45.497509 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:45.502156 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:45.502156 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:45.502156 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:45.502156 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:45.502156 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:45.502156 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:45.502156 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:45.502156 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:45.502156 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:45.502156 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:45.502156 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:45.515844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ee828b3b-d64b-48e3-8f35-aae749f4a5bd tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Returning 404 to user: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:45.524205 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ee828b3b-d64b-48e3-8f35-aae749f4a5bd tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "DELETE /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 404 len: 111 microversion: 2.21 time: 0.109032 Jul 14 14:37:45.525182 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1334/2669] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:37:45 2022] DELETE /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:37:45.535512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bf10f2ff-7326-4686-a667-e7262b48e972 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:45.545396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bf10f2ff-7326-4686-a667-e7262b48e972 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] [instance: de4a96e5-12c5-41dd-a248-36d32b315964] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:45.556903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf10f2ff-7326-4686-a667-e7262b48e972 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.557709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf10f2ff-7326-4686-a667-e7262b48e972 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.558699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf10f2ff-7326-4686-a667-e7262b48e972 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.560063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf10f2ff-7326-4686-a667-e7262b48e972 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.593001 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-bf10f2ff-7326-4686-a667-e7262b48e972 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] HTTP exception thrown: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bf10f2ff-7326-4686-a667-e7262b48e972 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Request method failure captured: Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 HTTP/1.1 Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CoSDbKQo-ua_bXkllkPEYMKWwdVyL4IhH0lNAGZSE_SnMZkvuVW0NaE-rsKqZAsPgr7aywPyHNq5AJY7nUKc0offLmk8m4sZfY-iWe4tdEIfdJVaduQqIG6Ywp2wwixEmCRWueVYsEhAD6Z8VZhqhhEs3vR0JoSQ9L8m2Ri6P5fATU Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.21 Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 9c1ec8796d414035aee2a18ba3e2cfa4 Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1357900321 Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9c1ec8796d414035aee2a18ba3e2cfa4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9c1ec8796d414035aee2a18ba3e2cfa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9c1ec8796d414035aee2a18ba3e2cfa4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9c1ec8796d414035aee2a18ba3e2cfa4"}]}] Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-InstanceActionsV221TestJSON-1357900321 Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 9c1ec8796d414035aee2a18ba3e2cfa4 Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1357900321 Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-InstanceActionsV221TestJSON-1357900321-project Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: adb334fc0f7a4db3861ebe09a695fb20 Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-InstanceActionsV221TestJSON-1357900321-project Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'de4a96e5-12c5-41dd-a248-36d32b315964'} Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:45.599094 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:45.603680 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:45.603680 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:45.603680 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:45.603680 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:45.603680 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:45.603680 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:45.603680 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. Jul 14 14:37:45.603680 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:45.608019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bf10f2ff-7326-4686-a667-e7262b48e972 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] Returning 404 to user: Instance de4a96e5-12c5-41dd-a248-36d32b315964 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:45.609160 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bf10f2ff-7326-4686-a667-e7262b48e972 tempest-InstanceActionsV221TestJSON-1357900321 tempest-InstanceActionsV221TestJSON-1357900321-project] 10.222.0.81 "GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964" status: 404 len: 111 microversion: 2.21 time: 0.079762 Jul 14 14:37:45.610624 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1335/2670] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:45 2022] GET /compute/v2.1/servers/de4a96e5-12c5-41dd-a248-36d32b315964 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:37:46.016363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f6b437bc-d504-4174-b222-6a701d0ecd43 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:46.017462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f6b437bc-d504-4174-b222-6a701d0ecd43 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:46.052536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6b437bc-d504-4174-b222-6a701d0ecd43 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:46.053544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6b437bc-d504-4174-b222-6a701d0ecd43 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:46.054562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6b437bc-d504-4174-b222-6a701d0ecd43 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:46.055171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6b437bc-d504-4174-b222-6a701d0ecd43 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:46.911377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-796c3589-3f01-42b7-98b8-342dc10ec88d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:46.926202 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-796c3589-3f01-42b7-98b8-342dc10ec88d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1321 microversion: 2.1 time: 1.797758 Jul 14 14:37:46.927230 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1336/2671] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:45 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1321 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:46.939139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6b437bc-d504-4174-b222-6a701d0ecd43 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:46.949969 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f6b437bc-d504-4174-b222-6a701d0ecd43 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1474 microversion: 2.1 time: 0.937768 Jul 14 14:37:46.960578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-97907e4b-a300-43c3-b900-7bdbf42f94f8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c52e5940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:46.971750 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1336/2672] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:46 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1474 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:46.981491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9080f705-980d-4610-8a8f-fe68615c6d9d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:46.982005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9080f705-980d-4610-8a8f-fe68615c6d9d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:47.003546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9080f705-980d-4610-8a8f-fe68615c6d9d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.004009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9080f705-980d-4610-8a8f-fe68615c6d9d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.007959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9080f705-980d-4610-8a8f-fe68615c6d9d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.008491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9080f705-980d-4610-8a8f-fe68615c6d9d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.048258 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-9080f705-980d-4610-8a8f-fe68615c6d9d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9080f705-980d-4610-8a8f-fe68615c6d9d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce HTTP/1.1 Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '7767fb3d-af95-439d-8bf7-385758969bce'} Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:47.050131 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:47.054609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:37:47.054609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.054609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:47.054609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.054609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:47.054609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:47.054609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:47.054609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:47.054609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:47.054609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:37:47.054609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.056643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9080f705-980d-4610-8a8f-fe68615c6d9d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:47.058369 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9080f705-980d-4610-8a8f-fe68615c6d9d tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 404 len: 111 microversion: 2.1 time: 0.085418 Jul 14 14:37:47.059110 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1337/2673] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:46 2022] DELETE /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:47.067871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9cbad5cb-e3b1-441b-a177-2d7f97c14137 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:47.069065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9cbad5cb-e3b1-441b-a177-2d7f97c14137 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: 7767fb3d-af95-439d-8bf7-385758969bce] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:47.081609 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-97907e4b-a300-43c3-b900-7bdbf42f94f8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.136849 Jul 14 14:37:47.082411 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1337/2674] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:46 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:47.086461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9cbad5cb-e3b1-441b-a177-2d7f97c14137 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.087084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9cbad5cb-e3b1-441b-a177-2d7f97c14137 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.088252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9cbad5cb-e3b1-441b-a177-2d7f97c14137 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.089533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9cbad5cb-e3b1-441b-a177-2d7f97c14137 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.113679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-9cbad5cb-e3b1-441b-a177-2d7f97c14137 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9cbad5cb-e3b1-441b-a177-2d7f97c14137 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce HTTP/1.1 Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '7767fb3d-af95-439d-8bf7-385758969bce'} Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:47.115452 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.119826 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:47.119826 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:47.119826 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:47.119826 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:47.119826 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:47.119826 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. Jul 14 14:37:47.119826 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.122265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9cbad5cb-e3b1-441b-a177-2d7f97c14137 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance 7767fb3d-af95-439d-8bf7-385758969bce could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:47.123494 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9cbad5cb-e3b1-441b-a177-2d7f97c14137 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce" status: 404 len: 111 microversion: 2.1 time: 0.060343 Jul 14 14:37:47.132825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-18df6fe5-edd8-46e8-b5b5-01e943e15f85 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:47.133631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-18df6fe5-edd8-46e8-b5b5-01e943e15f85 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:47.138372 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1338/2675] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:47 2022] GET /compute/v2.1/servers/7767fb3d-af95-439d-8bf7-385758969bce => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:37:47.142968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18df6fe5-edd8-46e8-b5b5-01e943e15f85 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.143663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18df6fe5-edd8-46e8-b5b5-01e943e15f85 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.144613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18df6fe5-edd8-46e8-b5b5-01e943e15f85 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.145244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18df6fe5-edd8-46e8-b5b5-01e943e15f85 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.163258 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-18df6fe5-edd8-46e8-b5b5-01e943e15f85 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-18df6fe5-edd8-46e8-b5b5-01e943e15f85 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb HTTP/1.1 Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'dcc9d46f-240b-4266-9cbe-5cf98e6378cb'} Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:47.165273 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:47.170247 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:37:47.170247 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.170247 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:47.170247 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.170247 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:47.170247 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:47.170247 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:47.170247 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:47.170247 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:47.170247 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:37:47.170247 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.173263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-18df6fe5-edd8-46e8-b5b5-01e943e15f85 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:47.174324 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-18df6fe5-edd8-46e8-b5b5-01e943e15f85 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 404 len: 111 microversion: 2.1 time: 0.045909 Jul 14 14:37:47.184355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc8191b9-ad76-4471-92fa-37b27f369a19 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:47.185265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dc8191b9-ad76-4471-92fa-37b27f369a19 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] [instance: dcc9d46f-240b-4266-9cbe-5cf98e6378cb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:47.190060 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1338/2676] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:47 2022] DELETE /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:47.191941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc8191b9-ad76-4471-92fa-37b27f369a19 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.192995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc8191b9-ad76-4471-92fa-37b27f369a19 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.194160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc8191b9-ad76-4471-92fa-37b27f369a19 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.195103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc8191b9-ad76-4471-92fa-37b27f369a19 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.221610 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-dc8191b9-ad76-4471-92fa-37b27f369a19 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] HTTP exception thrown: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc8191b9-ad76-4471-92fa-37b27f369a19 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Request method failure captured: Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb HTTP/1.1 Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CiO0ysZVw7ais9J62_h8ZYQHAZO8iJv8HYiE9tH5f2ZODAsxnnuxNX2KCbcM5rrFI2gqEL_fm8VqMcXLmdfCGkxmyoK8VU-z66ue-TAz9tQNaFrhNluEy9daalQnXhxDlT2KKk43wwymMQxi5GJZg1EiQo9CW6zHDF59Nw950B5CaI Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/703f537dac264574ac66287c275cad22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_703f537dac264574ac66287c275cad22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/703f537dac264574ac66287c275cad22"}]}] Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 703f537dac264574ac66287c275cad22 Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989333581 Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56c219e943b4398bea8add8299df84f Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-1989333581-project Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'dcc9d46f-240b-4266-9cbe-5cf98e6378cb'} Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:47.225952 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.231117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:47.231117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:47.231117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:47.231117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:47.231117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:47.231117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. Jul 14 14:37:47.231117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:37:47.234364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc8191b9-ad76-4471-92fa-37b27f369a19 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] Returning 404 to user: Instance dcc9d46f-240b-4266-9cbe-5cf98e6378cb could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:47.235410 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dc8191b9-ad76-4471-92fa-37b27f369a19 tempest-DeleteServersTestJSON-1989333581 tempest-DeleteServersTestJSON-1989333581-project] 10.222.0.81 "GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb" status: 404 len: 111 microversion: 2.1 time: 0.056173 Jul 14 14:37:47.240195 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1339/2677] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:47 2022] GET /compute/v2.1/servers/dcc9d46f-240b-4266-9cbe-5cf98e6378cb => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:47.945702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2d9751ff-b772-4987-be26-e4d2256d305e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:47.948729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2d9751ff-b772-4987-be26-e4d2256d305e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:47.968622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c36aac0f-212b-4bdd-8040-214cb5eab3a1 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:47.969971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c36aac0f-212b-4bdd-8040-214cb5eab3a1 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:47.974249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d9751ff-b772-4987-be26-e4d2256d305e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.976679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d9751ff-b772-4987-be26-e4d2256d305e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.979963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d9751ff-b772-4987-be26-e4d2256d305e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.980931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d9751ff-b772-4987-be26-e4d2256d305e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.981150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36aac0f-212b-4bdd-8040-214cb5eab3a1 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.981614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36aac0f-212b-4bdd-8040-214cb5eab3a1 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.982401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36aac0f-212b-4bdd-8040-214cb5eab3a1 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.985544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36aac0f-212b-4bdd-8040-214cb5eab3a1 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:48.513683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2d9751ff-b772-4987-be26-e4d2256d305e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:48.523131 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2d9751ff-b772-4987-be26-e4d2256d305e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1512 microversion: 2.1 time: 0.582928 Jul 14 14:37:48.540311 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1339/2678] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:47 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1512 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:48.549642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-345ed489-f3f9-45ba-a306-a4a29a773636 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5e244c0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:48.597105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c36aac0f-212b-4bdd-8040-214cb5eab3a1 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:48.608781 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c36aac0f-212b-4bdd-8040-214cb5eab3a1 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1474 microversion: 2.1 time: 0.644170 Jul 14 14:37:48.613905 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1340/2679] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:47 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1474 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:48.630170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6be10223-b51f-4009-8c47-bd405544a1cf tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:48.637212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6be10223-b51f-4009-8c47-bd405544a1cf tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:48.644430 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-345ed489-f3f9-45ba-a306-a4a29a773636 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.101972 Jul 14 14:37:48.645686 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1340/2680] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:48 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:48.652873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6be10223-b51f-4009-8c47-bd405544a1cf tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:48.654865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6be10223-b51f-4009-8c47-bd405544a1cf tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:48.655914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6be10223-b51f-4009-8c47-bd405544a1cf tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:48.658569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6be10223-b51f-4009-8c47-bd405544a1cf tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:49.396785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6be10223-b51f-4009-8c47-bd405544a1cf tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:49.405391 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6be10223-b51f-4009-8c47-bd405544a1cf tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e" status: 200 len: 1512 microversion: 2.1 time: 0.790129 Jul 14 14:37:49.409397 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1341/2681] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:48 2022] GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e => generated 1512 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:49.428979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98888039-2356-4f58-a960-a33c856c5ada tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:49.433815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-98888039-2356-4f58-a960-a33c856c5ada tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:49.444213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-98888039-2356-4f58-a960-a33c856c5ada tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:49.502238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98888039-2356-4f58-a960-a33c856c5ada tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:49.503134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98888039-2356-4f58-a960-a33c856c5ada tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:49.505901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98888039-2356-4f58-a960-a33c856c5ada tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:49.510243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98888039-2356-4f58-a960-a33c856c5ada tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:49.629475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9ffc8efd-5e80-4b76-a563-72ef5107b611 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:49.630086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9ffc8efd-5e80-4b76-a563-72ef5107b611 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:49.640214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ffc8efd-5e80-4b76-a563-72ef5107b611 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:49.640577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ffc8efd-5e80-4b76-a563-72ef5107b611 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:49.641397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ffc8efd-5e80-4b76-a563-72ef5107b611 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:49.646421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ffc8efd-5e80-4b76-a563-72ef5107b611 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:49.736629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-98888039-2356-4f58-a960-a33c856c5ada tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:49.829249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-98888039-2356-4f58-a960-a33c856c5ada tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:49.836042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98888039-2356-4f58-a960-a33c856c5ada tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:49.836761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98888039-2356-4f58-a960-a33c856c5ada tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:50.163550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9ffc8efd-5e80-4b76-a563-72ef5107b611 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:50.180720 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9ffc8efd-5e80-4b76-a563-72ef5107b611 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1474 microversion: 2.1 time: 0.554741 Jul 14 14:37:50.183459 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1342/2682] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:49 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1474 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:50.193223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3eec3bee-00b3-4bc8-8a9c-e01c3a8ad1c6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c56f19d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:50.251417 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98888039-2356-4f58-a960-a33c856c5ada tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.827736 Jul 14 14:37:50.261377 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1341/2683] 10.222.0.81 () {58 vars in 1166 bytes} [Thu Jul 14 14:37:49 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:50.270147 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3eec3bee-00b3-4bc8-8a9c-e01c3a8ad1c6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.085324 Jul 14 14:37:50.272906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0e6db3a8-d42a-43a6-b13c-96b34b4057ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:50.277166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0e6db3a8-d42a-43a6-b13c-96b34b4057ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:50.277951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0e6db3a8-d42a-43a6-b13c-96b34b4057ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1219910380', 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:50.278856 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1343/2684] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:50 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:50.288994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e6db3a8-d42a-43a6-b13c-96b34b4057ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:50.289478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e6db3a8-d42a-43a6-b13c-96b34b4057ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:50.290415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e6db3a8-d42a-43a6-b13c-96b34b4057ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:50.291025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e6db3a8-d42a-43a6-b13c-96b34b4057ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:50.410534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-0e6db3a8-d42a-43a6-b13c-96b34b4057ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:50.513667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0e6db3a8-d42a-43a6-b13c-96b34b4057ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:50.525727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e6db3a8-d42a-43a6-b13c-96b34b4057ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:50.526641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e6db3a8-d42a-43a6-b13c-96b34b4057ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:50.986910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a9edf9d6-8ad8-4b29-add4-7f99cad1b8ec req-ea56178c-2e3b-4065-9dc6-97a2e5d52bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ebe371-1ebb-4849-a18f-4b3e40035dfb", "name": "network-vif-plugged", "status": "completed", "tag": "929f1d52-94d9-463b-b94c-fe77458a9e1a"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:51.014718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a9edf9d6-8ad8-4b29-add4-7f99cad1b8ec req-ea56178c-2e3b-4065-9dc6-97a2e5d52bca service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.019902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a9edf9d6-8ad8-4b29-add4-7f99cad1b8ec req-ea56178c-2e3b-4065-9dc6-97a2e5d52bca service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.063034 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a9edf9d6-8ad8-4b29-add4-7f99cad1b8ec req-ea56178c-2e3b-4065-9dc6-97a2e5d52bca service nova] Creating event network-vif-plugged:929f1d52-94d9-463b-b94c-fe77458a9e1a for instance 13ebe371-1ebb-4849-a18f-4b3e40035dfb on n-h1-767704-28 Jul 14 14:37:51.080723 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a9edf9d6-8ad8-4b29-add4-7f99cad1b8ec req-ea56178c-2e3b-4065-9dc6-97a2e5d52bca service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099171 Jul 14 14:37:51.085331 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1344/2685] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:37:51.204762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4d2fdda0-051c-4648-a328-dfeb43eebe01 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:51.209819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4d2fdda0-051c-4648-a328-dfeb43eebe01 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:51.233055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2fdda0-051c-4648-a328-dfeb43eebe01 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.233918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2fdda0-051c-4648-a328-dfeb43eebe01 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.234956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2fdda0-051c-4648-a328-dfeb43eebe01 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.235735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d2fdda0-051c-4648-a328-dfeb43eebe01 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.572368 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0e6db3a8-d42a-43a6-b13c-96b34b4057ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1219910380" status: 200 len: 1515 microversion: 2.1 time: 1.304029 Jul 14 14:37:51.573660 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1342/2686] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:37:50 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1219910380 => generated 1515 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:51.578305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b3776d6b-5876-4efa-94a8-4207213c21a7 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cac2edc0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:51.650909 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b3776d6b-5876-4efa-94a8-4207213c21a7 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.075995 Jul 14 14:37:51.651788 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1343/2687] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:51 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:51.659112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6121ea6c-bd2f-4726-b8dd-c706009748e1 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:51.673279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6121ea6c-bd2f-4726-b8dd-c706009748e1 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:51.674411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6121ea6c-bd2f-4726-b8dd-c706009748e1 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:51.688104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6121ea6c-bd2f-4726-b8dd-c706009748e1 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.688864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6121ea6c-bd2f-4726-b8dd-c706009748e1 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.689927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6121ea6c-bd2f-4726-b8dd-c706009748e1 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.701732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6121ea6c-bd2f-4726-b8dd-c706009748e1 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.955978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-6121ea6c-bd2f-4726-b8dd-c706009748e1 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:52.077509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6121ea6c-bd2f-4726-b8dd-c706009748e1 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:52.095786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6121ea6c-bd2f-4726-b8dd-c706009748e1 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:52.096618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6121ea6c-bd2f-4726-b8dd-c706009748e1 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:52.460518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4d2fdda0-051c-4648-a328-dfeb43eebe01 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:52.479572 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4d2fdda0-051c-4648-a328-dfeb43eebe01 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1474 microversion: 2.1 time: 1.283987 Jul 14 14:37:52.480993 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1345/2688] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:51 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1474 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:52.664671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eab16628-6439-477c-b622-377ebb57943c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5df78b0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:52.672260 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6121ea6c-bd2f-4726-b8dd-c706009748e1 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 1.018068 Jul 14 14:37:52.672260 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1344/2689] 10.222.0.81 () {58 vars in 1172 bytes} [Thu Jul 14 14:37:51 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:52.699199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-021b2869-bb65-4130-8844-7ef4260baf0e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:52.702836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-021b2869-bb65-4130-8844-7ef4260baf0e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:52.703302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.compute.servers [None req-021b2869-bb65-4130-8844-7ef4260baf0e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Removing options 'limit' from query {{(pid=119511) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} Jul 14 14:37:52.704059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-021b2869-bb65-4130-8844-7ef4260baf0e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:52.722742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021b2869-bb65-4130-8844-7ef4260baf0e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:52.723206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021b2869-bb65-4130-8844-7ef4260baf0e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:52.724014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021b2869-bb65-4130-8844-7ef4260baf0e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:52.725044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021b2869-bb65-4130-8844-7ef4260baf0e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:52.743274 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eab16628-6439-477c-b622-377ebb57943c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.082242 Jul 14 14:37:52.744704 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1346/2690] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:52 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:37:52.816229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-021b2869-bb65-4130-8844-7ef4260baf0e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:52.827930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021b2869-bb65-4130-8844-7ef4260baf0e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:52.828447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021b2869-bb65-4130-8844-7ef4260baf0e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.235983 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-021b2869-bb65-4130-8844-7ef4260baf0e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.541035 Jul 14 14:37:53.243036 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1345/2691] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 14:37:52 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:53.268313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c269a523-1249-4b57-b37b-17201d4f1349 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:53.274265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c269a523-1249-4b57-b37b-17201d4f1349 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:53.280112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c269a523-1249-4b57-b37b-17201d4f1349 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:53.290379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c269a523-1249-4b57-b37b-17201d4f1349 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.291959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c269a523-1249-4b57-b37b-17201d4f1349 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.293061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c269a523-1249-4b57-b37b-17201d4f1349 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.293746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c269a523-1249-4b57-b37b-17201d4f1349 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.344903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-c269a523-1249-4b57-b37b-17201d4f1349 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:53.387520 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c269a523-1249-4b57-b37b-17201d4f1349 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.130874 Jul 14 14:37:53.388810 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1347/2692] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:37:53 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:53.403418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2a2643af-fa88-47ff-b197-2abdf4174a28 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:53.408443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2a2643af-fa88-47ff-b197-2abdf4174a28 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:53.408970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.compute.servers [None req-2a2643af-fa88-47ff-b197-2abdf4174a28 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Removing options 'limit' from query {{(pid=119511) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} Jul 14 14:37:53.409596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2a2643af-fa88-47ff-b197-2abdf4174a28 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:53.425283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a2643af-fa88-47ff-b197-2abdf4174a28 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.425733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a2643af-fa88-47ff-b197-2abdf4174a28 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.426528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a2643af-fa88-47ff-b197-2abdf4174a28 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.426960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a2643af-fa88-47ff-b197-2abdf4174a28 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.496108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f5fc5776-5735-4a77-b418-102b0f921ae7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:53.498267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f5fc5776-5735-4a77-b418-102b0f921ae7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:53.510203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5fc5776-5735-4a77-b418-102b0f921ae7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.511607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5fc5776-5735-4a77-b418-102b0f921ae7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.516309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5fc5776-5735-4a77-b418-102b0f921ae7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.517186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5fc5776-5735-4a77-b418-102b0f921ae7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.173435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-2a2643af-fa88-47ff-b197-2abdf4174a28 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:54.276335 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2a2643af-fa88-47ff-b197-2abdf4174a28 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.876976 Jul 14 14:37:54.277562 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1346/2693] 10.222.0.81 () {58 vars in 1149 bytes} [Thu Jul 14 14:37:53 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:54.291658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-860be188-36ce-4dc9-973e-07bf8dd5bd8a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c4bf68b0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:54.369537 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-860be188-36ce-4dc9-973e-07bf8dd5bd8a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.090499 Jul 14 14:37:54.370332 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1347/2694] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:54 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:54.377718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ce8866e5-422f-472a-8b9f-6c3aeccc2537 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:54.387196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ce8866e5-422f-472a-8b9f-6c3aeccc2537 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:54.393451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ce8866e5-422f-472a-8b9f-6c3aeccc2537 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:54.412260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce8866e5-422f-472a-8b9f-6c3aeccc2537 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.413048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce8866e5-422f-472a-8b9f-6c3aeccc2537 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.414054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce8866e5-422f-472a-8b9f-6c3aeccc2537 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.414674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce8866e5-422f-472a-8b9f-6c3aeccc2537 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.465973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-ce8866e5-422f-472a-8b9f-6c3aeccc2537 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:54.535918 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ce8866e5-422f-472a-8b9f-6c3aeccc2537 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.164256 Jul 14 14:37:54.537103 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1348/2695] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 14:37:54 2022] GET /compute/v2.1/servers => generated 1010 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:54.550018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba9e6c8f-d49a-4cc7-b3c4-dc34264d1e0d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:54.560663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ba9e6c8f-d49a-4cc7-b3c4-dc34264d1e0d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:54.573579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ba9e6c8f-d49a-4cc7-b3c4-dc34264d1e0d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:54.623602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba9e6c8f-d49a-4cc7-b3c4-dc34264d1e0d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.624081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba9e6c8f-d49a-4cc7-b3c4-dc34264d1e0d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.625314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba9e6c8f-d49a-4cc7-b3c4-dc34264d1e0d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.625773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba9e6c8f-d49a-4cc7-b3c4-dc34264d1e0d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.637337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f5fc5776-5735-4a77-b418-102b0f921ae7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:54.645809 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f5fc5776-5735-4a77-b418-102b0f921ae7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1474 microversion: 2.1 time: 1.154016 Jul 14 14:37:54.646411 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1348/2696] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:53 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1474 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:37:54.821726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-ba9e6c8f-d49a-4cc7-b3c4-dc34264d1e0d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:54.904170 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ba9e6c8f-d49a-4cc7-b3c4-dc34264d1e0d tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.353298 Jul 14 14:37:54.904170 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1349/2697] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:37:54 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:54.922636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-81f719a2-a197-4bc3-814a-508d2d2c0be0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:54.927613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-81f719a2-a197-4bc3-814a-508d2d2c0be0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:54.928374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.compute.servers [None req-81f719a2-a197-4bc3-814a-508d2d2c0be0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Removing options 'limit' from query {{(pid=119512) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} Jul 14 14:37:54.929965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-81f719a2-a197-4bc3-814a-508d2d2c0be0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:54.937263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81f719a2-a197-4bc3-814a-508d2d2c0be0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.938115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81f719a2-a197-4bc3-814a-508d2d2c0be0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.939244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81f719a2-a197-4bc3-814a-508d2d2c0be0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.939966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81f719a2-a197-4bc3-814a-508d2d2c0be0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.982047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:54.986002 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-81f719a2-a197-4bc3-814a-508d2d2c0be0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.076893 Jul 14 14:37:54.987208 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1349/2698] 10.222.0.81 () {58 vars in 1139 bytes} [Thu Jul 14 14:37:54 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:55.000017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-475750fc-6663-4887-bfba-22ad1bc9e3e5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:55.005646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-475750fc-6663-4887-bfba-22ad1bc9e3e5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:55.006620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-475750fc-6663-4887-bfba-22ad1bc9e3e5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1219910380', 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:55.013356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:55.016047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-475750fc-6663-4887-bfba-22ad1bc9e3e5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.017515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-475750fc-6663-4887-bfba-22ad1bc9e3e5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.026535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-475750fc-6663-4887-bfba-22ad1bc9e3e5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.028852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-475750fc-6663-4887-bfba-22ad1bc9e3e5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.267948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-475750fc-6663-4887-bfba-22ad1bc9e3e5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:55.387880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a2e9199c-59c6-4eb8-9cee-203ddb98780d tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5aa8430>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:55.490391 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a2e9199c-59c6-4eb8-9cee-203ddb98780d tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.110487 Jul 14 14:37:55.491006 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1350/2699] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:55 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:37:55.544326 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-475750fc-6663-4887-bfba-22ad1bc9e3e5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1219910380" status: 200 len: 346 microversion: 2.1 time: 0.549091 Jul 14 14:37:55.561568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1284456e-e4ae-4687-beb7-9c7f16be20fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:55.567136 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1350/2700] 10.222.0.81 () {58 vars in 1241 bytes} [Thu Jul 14 14:37:54 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1219910380 => generated 346 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:55.578708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1284456e-e4ae-4687-beb7-9c7f16be20fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.582319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1284456e-e4ae-4687-beb7-9c7f16be20fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.673491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-52cc74a6-d69b-4c4f-9ed2-8636a875530f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:55.681155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-52cc74a6-d69b-4c4f-9ed2-8636a875530f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:55.689108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1284456e-e4ae-4687-beb7-9c7f16be20fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Going to try to stop instance {{(pid=119512) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:37:55.727591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52cc74a6-d69b-4c4f-9ed2-8636a875530f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.728986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52cc74a6-d69b-4c4f-9ed2-8636a875530f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.746555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52cc74a6-d69b-4c4f-9ed2-8636a875530f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.747560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52cc74a6-d69b-4c4f-9ed2-8636a875530f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.801467 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1284456e-e4ae-4687-beb7-9c7f16be20fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "POST /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a/action" status: 202 len: 0 microversion: 2.1 time: 0.244539 Jul 14 14:37:55.802178 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1351/2701] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:55 2022] POST /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:55.818480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-58aa0e9e-1d99-4966-8e8b-c1dfc0c653a3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:55.823525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-58aa0e9e-1d99-4966-8e8b-c1dfc0c653a3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:55.836786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58aa0e9e-1d99-4966-8e8b-c1dfc0c653a3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.841180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58aa0e9e-1d99-4966-8e8b-c1dfc0c653a3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.842251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58aa0e9e-1d99-4966-8e8b-c1dfc0c653a3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.842895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58aa0e9e-1d99-4966-8e8b-c1dfc0c653a3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.158281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-58aa0e9e-1d99-4966-8e8b-c1dfc0c653a3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.169498 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-58aa0e9e-1d99-4966-8e8b-c1dfc0c653a3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1522 microversion: 2.1 time: 0.358485 Jul 14 14:37:56.170416 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1352/2702] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:55 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:56.507455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-698057c9-b820-4703-9583-138650a819b9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5aae550>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:56.607403 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-698057c9-b820-4703-9583-138650a819b9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.103992 Jul 14 14:37:56.612958 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1353/2703] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:56 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:57.188458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4959ee39-1532-4cc0-bf95-752312385f91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:57.189287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4959ee39-1532-4cc0-bf95-752312385f91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:57.200802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4959ee39-1532-4cc0-bf95-752312385f91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.206577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4959ee39-1532-4cc0-bf95-752312385f91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.207892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4959ee39-1532-4cc0-bf95-752312385f91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.208629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4959ee39-1532-4cc0-bf95-752312385f91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.445885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-52cc74a6-d69b-4c4f-9ed2-8636a875530f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:57.455098 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-52cc74a6-d69b-4c4f-9ed2-8636a875530f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1460 microversion: 2.1 time: 1.794290 Jul 14 14:37:57.455695 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1351/2704] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:55 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1460 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:57.471802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2fe2611a-dbf1-4010-84ea-c07b202be4ee tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:57.472375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2fe2611a-dbf1-4010-84ea-c07b202be4ee tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:57.479862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fe2611a-dbf1-4010-84ea-c07b202be4ee tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.480792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fe2611a-dbf1-4010-84ea-c07b202be4ee tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.481804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fe2611a-dbf1-4010-84ea-c07b202be4ee tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.482397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fe2611a-dbf1-4010-84ea-c07b202be4ee tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.542805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4959ee39-1532-4cc0-bf95-752312385f91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:58.553679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4959ee39-1532-4cc0-bf95-752312385f91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1522 microversion: 2.1 time: 1.369649 Jul 14 14:37:58.558034 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1354/2705] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:57 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1522 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:37:58.573831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-005977f7-c00b-4c02-97f9-43a6c794ed29 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5a5a790>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:58.651359 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-005977f7-c00b-4c02-97f9-43a6c794ed29 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.091820 Jul 14 14:37:58.657040 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1355/2706] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:37:58 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:58.688107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2fe2611a-dbf1-4010-84ea-c07b202be4ee tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:58.704121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:58.725521 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2fe2611a-dbf1-4010-84ea-c07b202be4ee tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1460 microversion: 2.1 time: 1.257402 Jul 14 14:37:58.737230 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1352/2707] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:57 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1460 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:58.747135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:58.749461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:58.757519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.758189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.760531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.761185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.896728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:58.898153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:58.898811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:58.899778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:58.901504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:59.002491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:59.013285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.014655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.015895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.017220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.074926 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-372d4f22-2359-434a-960c-e59c24974fbc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action" status: 202 len: 1064 microversion: 2.1 time: 0.334269 Jul 14 14:37:59.084808 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1356/2708] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:58 2022] POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action => generated 1064 bytes in 337 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 14:37:59.091189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0dba9028-155d-4e5d-8f44-34ea7d3ccddd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:59.091813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0dba9028-155d-4e5d-8f44-34ea7d3ccddd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:59.111999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0dba9028-155d-4e5d-8f44-34ea7d3ccddd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.112471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0dba9028-155d-4e5d-8f44-34ea7d3ccddd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.113304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0dba9028-155d-4e5d-8f44-34ea7d3ccddd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.113761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0dba9028-155d-4e5d-8f44-34ea7d3ccddd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.606905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b1a0fa05-48e6-41ba-b4ee-e96e78918b07 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:59.608706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b1a0fa05-48e6-41ba-b4ee-e96e78918b07 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:59.624493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1a0fa05-48e6-41ba-b4ee-e96e78918b07 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.626593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1a0fa05-48e6-41ba-b4ee-e96e78918b07 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.630110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1a0fa05-48e6-41ba-b4ee-e96e78918b07 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.631538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1a0fa05-48e6-41ba-b4ee-e96e78918b07 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:00.021018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0dba9028-155d-4e5d-8f44-34ea7d3ccddd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:00.036117 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0dba9028-155d-4e5d-8f44-34ea7d3ccddd tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.949361 Jul 14 14:38:00.045029 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1353/2709] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:59 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:00.072722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-300aad39-9ede-4968-9d7f-0bde0e4635ad tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cac9c3a0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:00.187692 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-300aad39-9ede-4968-9d7f-0bde0e4635ad tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.138505 Jul 14 14:38:00.194340 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1354/2710] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:00 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:01.062852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6e8525d1-c4c8-413c-bd6c-e01948d8fd6c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:01.063471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6e8525d1-c4c8-413c-bd6c-e01948d8fd6c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:01.080990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e8525d1-c4c8-413c-bd6c-e01948d8fd6c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:01.081605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e8525d1-c4c8-413c-bd6c-e01948d8fd6c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:01.084898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e8525d1-c4c8-413c-bd6c-e01948d8fd6c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:01.085443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e8525d1-c4c8-413c-bd6c-e01948d8fd6c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:01.318813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b1a0fa05-48e6-41ba-b4ee-e96e78918b07 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:01.328645 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b1a0fa05-48e6-41ba-b4ee-e96e78918b07 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1522 microversion: 2.1 time: 1.740016 Jul 14 14:38:01.339448 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1357/2711] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:59 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1522 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:01.357933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5392f5bf-4fb1-4d48-970c-ea2c5546ce51 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5c64dc0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:01.453550 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5392f5bf-4fb1-4d48-970c-ea2c5546ce51 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1453 microversion: 2.1 time: 0.112461 Jul 14 14:38:01.454145 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1358/2712] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:01 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:01.797215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6e8525d1-c4c8-413c-bd6c-e01948d8fd6c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:01.818208 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6e8525d1-c4c8-413c-bd6c-e01948d8fd6c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.759599 Jul 14 14:38:01.830010 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1355/2713] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:01 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:02.353026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b2b4e7d-5910-4292-b451-c0e8f0a08550 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:02.354601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5b2b4e7d-5910-4292-b451-c0e8f0a08550 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:02.377706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b2b4e7d-5910-4292-b451-c0e8f0a08550 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.378254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b2b4e7d-5910-4292-b451-c0e8f0a08550 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.381454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b2b4e7d-5910-4292-b451-c0e8f0a08550 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.387923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b2b4e7d-5910-4292-b451-c0e8f0a08550 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.468817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-56026edd-3870-4806-afdc-38d1b44a1165 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cad22700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:02.554615 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-56026edd-3870-4806-afdc-38d1b44a1165 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1462 microversion: 2.1 time: 0.090499 Jul 14 14:38:02.556604 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1356/2714] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:02 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1462 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:02.567863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-47ca3471-8d1b-4d21-af74-c994f43e687a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cad7e310>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:02.699106 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-47ca3471-8d1b-4d21-af74-c994f43e687a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 200 len: 1462 microversion: 2.1 time: 0.135476 Jul 14 14:38:02.702468 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1357/2715] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:02 2022] GET /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 1462 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:02.728992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9de92cd3-9e0c-45a5-be12-9ae5f98f707c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:02.733329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9de92cd3-9e0c-45a5-be12-9ae5f98f707c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:02.757622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9de92cd3-9e0c-45a5-be12-9ae5f98f707c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.758660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9de92cd3-9e0c-45a5-be12-9ae5f98f707c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.774428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9de92cd3-9e0c-45a5-be12-9ae5f98f707c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.776805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9de92cd3-9e0c-45a5-be12-9ae5f98f707c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.837985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:03.003998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5b2b4e7d-5910-4292-b451-c0e8f0a08550 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:03.042001 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b2b4e7d-5910-4292-b451-c0e8f0a08550 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1522 microversion: 2.1 time: 0.694333 Jul 14 14:38:03.047473 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1359/2716] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:02 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1522 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:03.066554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6edebdf8-020f-4f0c-83ad-222199131a33 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:03.067469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6edebdf8-020f-4f0c-83ad-222199131a33 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:03.093807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6edebdf8-020f-4f0c-83ad-222199131a33 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:03.094873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6edebdf8-020f-4f0c-83ad-222199131a33 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:03.097390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6edebdf8-020f-4f0c-83ad-222199131a33 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:03.098075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6edebdf8-020f-4f0c-83ad-222199131a33 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:03.161256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9de92cd3-9e0c-45a5-be12-9ae5f98f707c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:03.171806 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9de92cd3-9e0c-45a5-be12-9ae5f98f707c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1467 microversion: 2.1 time: 0.464290 Jul 14 14:38:03.180454 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1358/2717] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:02 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1467 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:03.191667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f869bada-a41b-49d7-9ed3-c2a7f2b6e2c5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-252593154"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:03.199700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f869bada-a41b-49d7-9ed3-c2a7f2b6e2c5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:03.246711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f869bada-a41b-49d7-9ed3-c2a7f2b6e2c5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:03.247178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f869bada-a41b-49d7-9ed3-c2a7f2b6e2c5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:03.251943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f869bada-a41b-49d7-9ed3-c2a7f2b6e2c5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:03.256827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f869bada-a41b-49d7-9ed3-c2a7f2b6e2c5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:03.622411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6edebdf8-020f-4f0c-83ad-222199131a33 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:03.641339 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6edebdf8-020f-4f0c-83ad-222199131a33 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.590474 Jul 14 14:38:03.654258 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1360/2718] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:03 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:03.879330 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f869bada-a41b-49d7-9ed3-c2a7f2b6e2c5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "POST /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2/action" status: 202 len: 0 microversion: 2.1 time: 0.691619 Jul 14 14:38:03.888613 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1359/2719] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:38:03 2022] POST /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2/action => generated 0 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 14 14:38:03.893057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-55158fff-2c62-454a-b3da-056f3e93a35c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5df78b0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:03.974323 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-55158fff-2c62-454a-b3da-056f3e93a35c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.083676 Jul 14 14:38:03.975505 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1361/2720] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:03 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:04.064736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-43b95f72-d0ca-4ff2-aec5-36ac1ca18695 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:04.065489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-43b95f72-d0ca-4ff2-aec5-36ac1ca18695 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:04.075138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43b95f72-d0ca-4ff2-aec5-36ac1ca18695 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:04.075605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43b95f72-d0ca-4ff2-aec5-36ac1ca18695 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:04.076598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43b95f72-d0ca-4ff2-aec5-36ac1ca18695 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:04.077531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43b95f72-d0ca-4ff2-aec5-36ac1ca18695 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:04.429772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-43b95f72-d0ca-4ff2-aec5-36ac1ca18695 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:04.442915 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-43b95f72-d0ca-4ff2-aec5-36ac1ca18695 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1522 microversion: 2.1 time: 0.383425 Jul 14 14:38:04.445712 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1360/2721] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:04 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:04.664780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-faa75a87-816f-4c01-944f-d98ca648af4d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:04.666117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-faa75a87-816f-4c01-944f-d98ca648af4d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:04.691663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-faa75a87-816f-4c01-944f-d98ca648af4d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:04.703147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-faa75a87-816f-4c01-944f-d98ca648af4d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:04.704618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-faa75a87-816f-4c01-944f-d98ca648af4d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:04.705185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-faa75a87-816f-4c01-944f-d98ca648af4d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:04.957064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:04.995558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2af1c0e5-b3bd-4f72-9a34-140663f7e27c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cad229d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:05.077794 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2af1c0e5-b3bd-4f72-9a34-140663f7e27c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.091555 Jul 14 14:38:05.078382 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1361/2722] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:04 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:05.461723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=16 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:05.467856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7ef3510b-26de-4cd3-968a-474211c03313 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:05.468486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7ef3510b-26de-4cd3-968a-474211c03313 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:05.488088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7ef3510b-26de-4cd3-968a-474211c03313 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:05.490632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7ef3510b-26de-4cd3-968a-474211c03313 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:05.493669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7ef3510b-26de-4cd3-968a-474211c03313 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:05.497261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7ef3510b-26de-4cd3-968a-474211c03313 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:05.730568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-faa75a87-816f-4c01-944f-d98ca648af4d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:05.741400 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-faa75a87-816f-4c01-944f-d98ca648af4d tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 1.083506 Jul 14 14:38:05.742462 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1362/2723] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:04 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:06.095268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b9d7438-8ade-4c81-b97d-2d4dfcd91de1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5a67ee0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:06.158717 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b9d7438-8ade-4c81-b97d-2d4dfcd91de1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.070726 Jul 14 14:38:06.160161 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1363/2724] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:06 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:06.355929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-29d65824-b26f-4ef6-b843-d1c4abca367f req-770bfeb4-c412-4504-b006-762f24dc755d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421b3e7a-56b8-4241-a496-2a091a9686f3", "name": "network-vif-unplugged", "status": "completed", "tag": "40cb08bf-70f2-461c-9c75-c450c62e8c00"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:06.371985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7ef3510b-26de-4cd3-968a-474211c03313 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.375145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-29d65824-b26f-4ef6-b843-d1c4abca367f req-770bfeb4-c412-4504-b006-762f24dc755d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:06.376052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-29d65824-b26f-4ef6-b843-d1c4abca367f req-770bfeb4-c412-4504-b006-762f24dc755d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:06.404992 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-29d65824-b26f-4ef6-b843-d1c4abca367f req-770bfeb4-c412-4504-b006-762f24dc755d service nova] Creating event network-vif-unplugged:40cb08bf-70f2-461c-9c75-c450c62e8c00 for instance 421b3e7a-56b8-4241-a496-2a091a9686f3 on n-h2-767704-28 Jul 14 14:38:06.422092 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-29d65824-b26f-4ef6-b843-d1c4abca367f req-770bfeb4-c412-4504-b006-762f24dc755d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071008 Jul 14 14:38:06.427784 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1364/2725] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:38:06.433432 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7ef3510b-26de-4cd3-968a-474211c03313 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1522 microversion: 2.1 time: 0.973094 Jul 14 14:38:06.436099 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1362/2726] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:05 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1522 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:06.760396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-363990e9-146f-4ffe-943f-4306fb57096f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:06.761148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-363990e9-146f-4ffe-943f-4306fb57096f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:06.772434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-363990e9-146f-4ffe-943f-4306fb57096f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:06.775422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-363990e9-146f-4ffe-943f-4306fb57096f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:06.778887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-363990e9-146f-4ffe-943f-4306fb57096f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:06.779626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-363990e9-146f-4ffe-943f-4306fb57096f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:07.173974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0c452f59-b899-4147-b636-2e561a662841 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c596c9d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:07.258042 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0c452f59-b899-4147-b636-2e561a662841 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.089294 Jul 14 14:38:07.258853 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1363/2727] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:07 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:07.443307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-363990e9-146f-4ffe-943f-4306fb57096f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:07.452188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c2eee9ee-396f-40d7-b31c-786008141aef tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:07.452808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c2eee9ee-396f-40d7-b31c-786008141aef tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:07.453990 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-363990e9-146f-4ffe-943f-4306fb57096f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.697903 Jul 14 14:38:07.464774 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1365/2728] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:06 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:07.466695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2eee9ee-396f-40d7-b31c-786008141aef tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:07.467160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2eee9ee-396f-40d7-b31c-786008141aef tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:07.468147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2eee9ee-396f-40d7-b31c-786008141aef tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:07.469577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2eee9ee-396f-40d7-b31c-786008141aef tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:07.830204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c2eee9ee-396f-40d7-b31c-786008141aef tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:07.845334 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c2eee9ee-396f-40d7-b31c-786008141aef tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1522 microversion: 2.1 time: 0.396915 Jul 14 14:38:07.846700 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1364/2729] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:07 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:08.273099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-edd7312f-069f-4994-ac62-8fbece5ddeed tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5aa91f0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:08.350285 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-edd7312f-069f-4994-ac62-8fbece5ddeed tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.082172 Jul 14 14:38:08.350846 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1366/2730] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:08 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:08.470964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b5ea4f5f-def0-4f5c-9c38-a28f422643ea tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:08.472254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5ea4f5f-def0-4f5c-9c38-a28f422643ea tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:08.486028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5ea4f5f-def0-4f5c-9c38-a28f422643ea tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.490511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5ea4f5f-def0-4f5c-9c38-a28f422643ea tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:08.491640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5ea4f5f-def0-4f5c-9c38-a28f422643ea tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.492368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5ea4f5f-def0-4f5c-9c38-a28f422643ea tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:08.864977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-43eb3dce-181f-4174-b1a8-57155840c089 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:08.865610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-43eb3dce-181f-4174-b1a8-57155840c089 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:08.868982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:08.886566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43eb3dce-181f-4174-b1a8-57155840c089 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.887023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43eb3dce-181f-4174-b1a8-57155840c089 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:08.892283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43eb3dce-181f-4174-b1a8-57155840c089 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.892696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43eb3dce-181f-4174-b1a8-57155840c089 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.136576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b5ea4f5f-def0-4f5c-9c38-a28f422643ea tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:09.150367 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b5ea4f5f-def0-4f5c-9c38-a28f422643ea tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.683063 Jul 14 14:38:09.151646 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1365/2731] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:08 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:09.363848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9854f501-1df5-4488-8f1b-2ac65a5e14f4 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cabc8310>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:09.438694 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9854f501-1df5-4488-8f1b-2ac65a5e14f4 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.078882 Jul 14 14:38:09.439426 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1366/2732] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:09 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:09.596876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-43eb3dce-181f-4174-b1a8-57155840c089 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:09.610919 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-43eb3dce-181f-4174-b1a8-57155840c089 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1522 microversion: 2.1 time: 0.744611 Jul 14 14:38:09.614617 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1367/2733] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:08 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1522 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:10.169418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-875af462-a7d3-4060-8443-6fdf41287311 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:10.170051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-875af462-a7d3-4060-8443-6fdf41287311 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:10.190749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-875af462-a7d3-4060-8443-6fdf41287311 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.191215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-875af462-a7d3-4060-8443-6fdf41287311 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.192019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-875af462-a7d3-4060-8443-6fdf41287311 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.192470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-875af462-a7d3-4060-8443-6fdf41287311 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.451699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-96ecbc4e-bc2f-422b-85f5-c2c650705923 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c58a91f0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:10.542037 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-96ecbc4e-bc2f-422b-85f5-c2c650705923 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.090242 Jul 14 14:38:10.554284 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1368/2734] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:10 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:10.628907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c28788b8-bcf2-449c-ac36-4622b86c5851 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:10.629573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c28788b8-bcf2-449c-ac36-4622b86c5851 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:10.643546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c28788b8-bcf2-449c-ac36-4622b86c5851 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.644004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c28788b8-bcf2-449c-ac36-4622b86c5851 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.644799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c28788b8-bcf2-449c-ac36-4622b86c5851 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.648679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c28788b8-bcf2-449c-ac36-4622b86c5851 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.970552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-875af462-a7d3-4060-8443-6fdf41287311 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:10.979902 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-875af462-a7d3-4060-8443-6fdf41287311 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.815992 Jul 14 14:38:10.995170 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1367/2735] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:10 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:11.188430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-687d928a-cb5c-466d-a8b9-3e854cc7cd3a req-b2a083a4-aa15-4a6f-a9b6-e5c5ed6bdd63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83dae6b9-f87b-4ee4-ab0d-3706cd2602a2", "name": "network-vif-plugged", "status": "completed", "tag": "9462ad9c-5eb2-40e6-922b-2e480cd3ce7b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:11.207879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-687d928a-cb5c-466d-a8b9-3e854cc7cd3a req-b2a083a4-aa15-4a6f-a9b6-e5c5ed6bdd63 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.209826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-687d928a-cb5c-466d-a8b9-3e854cc7cd3a req-b2a083a4-aa15-4a6f-a9b6-e5c5ed6bdd63 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.262516 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-687d928a-cb5c-466d-a8b9-3e854cc7cd3a req-b2a083a4-aa15-4a6f-a9b6-e5c5ed6bdd63 service nova] Creating event network-vif-plugged:9462ad9c-5eb2-40e6-922b-2e480cd3ce7b for instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 on n-h1-767704-28 Jul 14 14:38:11.277769 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-687d928a-cb5c-466d-a8b9-3e854cc7cd3a req-b2a083a4-aa15-4a6f-a9b6-e5c5ed6bdd63 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098350 Jul 14 14:38:11.279662 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1368/2736] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:38:11.558849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3ac7b339-457f-45e8-86c2-db3a2b3670d0 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cac2e940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:11.631162 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3ac7b339-457f-45e8-86c2-db3a2b3670d0 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.079495 Jul 14 14:38:11.634808 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1369/2737] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:11 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:11.734512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c28788b8-bcf2-449c-ac36-4622b86c5851 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:11.781867 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c28788b8-bcf2-449c-ac36-4622b86c5851 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1522 microversion: 2.1 time: 1.146524 Jul 14 14:38:11.782781 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1369/2738] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:10 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1522 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:12.011795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-75fdfe13-6511-460b-9168-190b5d5fc265 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:12.012927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-75fdfe13-6511-460b-9168-190b5d5fc265 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:12.027266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75fdfe13-6511-460b-9168-190b5d5fc265 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:12.028039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75fdfe13-6511-460b-9168-190b5d5fc265 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:12.028914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75fdfe13-6511-460b-9168-190b5d5fc265 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:12.033765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75fdfe13-6511-460b-9168-190b5d5fc265 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:12.652283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-088e93c3-c805-4ecb-905c-1033e724c9ef tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c589f1f0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:12.741785 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-088e93c3-c805-4ecb-905c-1033e724c9ef tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.098144 Jul 14 14:38:12.742744 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1370/2739] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:12 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:12.801751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6a772c0a-9773-4234-8807-d07260c08876 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:12.802678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6a772c0a-9773-4234-8807-d07260c08876 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:12.815671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a772c0a-9773-4234-8807-d07260c08876 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:12.820398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a772c0a-9773-4234-8807-d07260c08876 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:12.827152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a772c0a-9773-4234-8807-d07260c08876 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:12.830455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a772c0a-9773-4234-8807-d07260c08876 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:13.519145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-75fdfe13-6511-460b-9168-190b5d5fc265 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:13.556684 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-75fdfe13-6511-460b-9168-190b5d5fc265 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 1.548583 Jul 14 14:38:13.557336 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1370/2740] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:12 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:13.757707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-72e403ae-badf-4d41-87e1-4220f7eee429 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cac11430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:13.857371 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-72e403ae-badf-4d41-87e1-4220f7eee429 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.104374 Jul 14 14:38:13.861483 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1371/2741] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:13 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:13.985160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6a772c0a-9773-4234-8807-d07260c08876 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:13.996737 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6a772c0a-9773-4234-8807-d07260c08876 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1522 microversion: 2.1 time: 1.199791 Jul 14 14:38:13.997361 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1371/2742] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:12 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1522 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:14.573794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1a543133-8c28-4652-97a8-34c5e56b657e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:14.575029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1a543133-8c28-4652-97a8-34c5e56b657e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:14.599879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1a543133-8c28-4652-97a8-34c5e56b657e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:14.600637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1a543133-8c28-4652-97a8-34c5e56b657e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:14.601472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1a543133-8c28-4652-97a8-34c5e56b657e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:14.602079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1a543133-8c28-4652-97a8-34c5e56b657e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:14.871716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-82aae375-530d-4cb7-88eb-a0189f433884 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5a30550>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:14.962339 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-82aae375-530d-4cb7-88eb-a0189f433884 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.095168 Jul 14 14:38:14.978215 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1372/2743] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:14 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:15.020838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ad53e38e-bbe2-4b47-9f46-33b9c143ff91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:15.023468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ad53e38e-bbe2-4b47-9f46-33b9c143ff91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:15.062597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ad53e38e-bbe2-4b47-9f46-33b9c143ff91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:15.063380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ad53e38e-bbe2-4b47-9f46-33b9c143ff91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:15.064413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ad53e38e-bbe2-4b47-9f46-33b9c143ff91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:15.065233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ad53e38e-bbe2-4b47-9f46-33b9c143ff91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:15.174243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1a543133-8c28-4652-97a8-34c5e56b657e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:15.190709 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1a543133-8c28-4652-97a8-34c5e56b657e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.620773 Jul 14 14:38:15.191317 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1372/2744] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:14 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:15.975774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-09d0c8b0-d708-49a9-8515-c55fce8b1d9d tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cad20d30>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:16.050765 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-09d0c8b0-d708-49a9-8515-c55fce8b1d9d tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.078977 Jul 14 14:38:16.051713 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1373/2745] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:15 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:16.088151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ad53e38e-bbe2-4b47-9f46-33b9c143ff91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:16.099995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:16.110738 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ad53e38e-bbe2-4b47-9f46-33b9c143ff91 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1522 microversion: 2.1 time: 1.100104 Jul 14 14:38:16.130068 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1373/2746] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:15 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1522 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:16.208662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b111090c-bff5-4c00-bf9a-bf711629549f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:16.209556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b111090c-bff5-4c00-bf9a-bf711629549f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:16.224228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b111090c-bff5-4c00-bf9a-bf711629549f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.224987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b111090c-bff5-4c00-bf9a-bf711629549f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.234902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b111090c-bff5-4c00-bf9a-bf711629549f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.235668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b111090c-bff5-4c00-bf9a-bf711629549f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.707203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b111090c-bff5-4c00-bf9a-bf711629549f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:16.720253 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b111090c-bff5-4c00-bf9a-bf711629549f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.514379 Jul 14 14:38:16.734311 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1374/2747] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:16 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:17.063979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1eb24682-9005-48bd-a857-8ba6e5d97438 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c59a8280>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:17.130335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fac35e1b-6716-4b5f-8807-cb08010d9eb5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:17.131007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fac35e1b-6716-4b5f-8807-cb08010d9eb5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:17.159232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fac35e1b-6716-4b5f-8807-cb08010d9eb5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.159705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fac35e1b-6716-4b5f-8807-cb08010d9eb5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.168083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fac35e1b-6716-4b5f-8807-cb08010d9eb5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.168571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fac35e1b-6716-4b5f-8807-cb08010d9eb5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.195079 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1eb24682-9005-48bd-a857-8ba6e5d97438 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.135003 Jul 14 14:38:17.202350 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1374/2748] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:17 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:17.742651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e37cb53-5763-49c8-a8a3-be026d15626b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:17.745521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8e37cb53-5763-49c8-a8a3-be026d15626b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:17.769534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e37cb53-5763-49c8-a8a3-be026d15626b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.772788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e37cb53-5763-49c8-a8a3-be026d15626b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.779221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e37cb53-5763-49c8-a8a3-be026d15626b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.789150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e37cb53-5763-49c8-a8a3-be026d15626b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.843722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fac35e1b-6716-4b5f-8807-cb08010d9eb5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:17.853992 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fac35e1b-6716-4b5f-8807-cb08010d9eb5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1499 microversion: 2.1 time: 0.728254 Jul 14 14:38:17.854868 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1375/2749] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:17 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1499 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:17.873712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a08d835c-cc0b-4023-b8fb-4f7020314b6e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:17.878117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a08d835c-cc0b-4023-b8fb-4f7020314b6e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:17.880153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a08d835c-cc0b-4023-b8fb-4f7020314b6e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:38:17.888045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a08d835c-cc0b-4023-b8fb-4f7020314b6e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.888752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a08d835c-cc0b-4023-b8fb-4f7020314b6e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.889771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a08d835c-cc0b-4023-b8fb-4f7020314b6e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.890372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a08d835c-cc0b-4023-b8fb-4f7020314b6e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.099211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-a08d835c-cc0b-4023-b8fb-4f7020314b6e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:38:18.266251 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a08d835c-cc0b-4023-b8fb-4f7020314b6e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.397116 Jul 14 14:38:18.269910 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1376/2750] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Jul 14 14:38:17 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:18.277684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-33727427-b6c2-4e6c-b3b5-03f83e351e8c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5304280>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:18.386359 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-33727427-b6c2-4e6c-b3b5-03f83e351e8c tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.114911 Jul 14 14:38:18.389703 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1377/2751] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:18 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:18.398185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-449d2462-7952-4996-99ef-c33e9c2f464c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:18.430158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-449d2462-7952-4996-99ef-c33e9c2f464c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.434426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8e37cb53-5763-49c8-a8a3-be026d15626b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:18.448664 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8e37cb53-5763-49c8-a8a3-be026d15626b tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.713435 Jul 14 14:38:18.449306 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1375/2752] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:17 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:18.459744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-449d2462-7952-4996-99ef-c33e9c2f464c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.713246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:18.737991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-449d2462-7952-4996-99ef-c33e9c2f464c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Going to try to start instance {{(pid=119511) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 14:38:18.886443 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-449d2462-7952-4996-99ef-c33e9c2f464c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "POST /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a/action" status: 202 len: 0 microversion: 2.1 time: 0.494508 Jul 14 14:38:18.894537 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1378/2753] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:38:18 2022] POST /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:38:18.911874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d329aab6-a609-4e00-91be-18c009fb95fc tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:18.912526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d329aab6-a609-4e00-91be-18c009fb95fc tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:18.957441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d329aab6-a609-4e00-91be-18c009fb95fc tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.958384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d329aab6-a609-4e00-91be-18c009fb95fc tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.961658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d329aab6-a609-4e00-91be-18c009fb95fc tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.967605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d329aab6-a609-4e00-91be-18c009fb95fc tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:19.400827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-688c3efc-c4db-4280-964b-011dd0a681d9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cad220d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:19.527650 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-688c3efc-c4db-4280-964b-011dd0a681d9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.130062 Jul 14 14:38:19.531533 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1379/2754] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:19 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:19.544189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8ba4dfc-5769-4841-92bc-cebfd612c25c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:19.549495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b8ba4dfc-5769-4841-92bc-cebfd612c25c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:19.564155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8ba4dfc-5769-4841-92bc-cebfd612c25c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:19.567678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8ba4dfc-5769-4841-92bc-cebfd612c25c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:19.569959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8ba4dfc-5769-4841-92bc-cebfd612c25c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:19.571498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8ba4dfc-5769-4841-92bc-cebfd612c25c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:20.334668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b8ba4dfc-5769-4841-92bc-cebfd612c25c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:20.352135 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b8ba4dfc-5769-4841-92bc-cebfd612c25c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.817350 Jul 14 14:38:20.357433 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1380/2755] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:19 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:20.551489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-df73ae79-7165-46b4-b58f-2e5142228652 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cac9c1f0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:20.647197 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-df73ae79-7165-46b4-b58f-2e5142228652 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.108664 Jul 14 14:38:20.648461 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1381/2756] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:20 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:20.812454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d329aab6-a609-4e00-91be-18c009fb95fc tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:20.827677 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d329aab6-a609-4e00-91be-18c009fb95fc tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1508 microversion: 2.1 time: 1.921438 Jul 14 14:38:20.830379 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1376/2757] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:18 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1508 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:21.378272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-66350c2f-fb68-49af-b529-e00c13b023dc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:21.378991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-66350c2f-fb68-49af-b529-e00c13b023dc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:21.401017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66350c2f-fb68-49af-b529-e00c13b023dc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.405298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66350c2f-fb68-49af-b529-e00c13b023dc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.408039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66350c2f-fb68-49af-b529-e00c13b023dc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.412206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66350c2f-fb68-49af-b529-e00c13b023dc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.663263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61368295-9741-41dc-97e4-9d471bbc1ce2 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5c64dc0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:21.763020 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-61368295-9741-41dc-97e4-9d471bbc1ce2 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.104352 Jul 14 14:38:21.768434 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1377/2758] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:21 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:21.848297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-22986861-c5b8-4485-afe1-36862a2d83fb tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:21.849976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-22986861-c5b8-4485-afe1-36862a2d83fb tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:21.860521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22986861-c5b8-4485-afe1-36862a2d83fb tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.866239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22986861-c5b8-4485-afe1-36862a2d83fb tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.869312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22986861-c5b8-4485-afe1-36862a2d83fb tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.873343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22986861-c5b8-4485-afe1-36862a2d83fb tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:22.298393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-66350c2f-fb68-49af-b529-e00c13b023dc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:22.324629 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-66350c2f-fb68-49af-b529-e00c13b023dc tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.946770 Jul 14 14:38:22.332251 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1382/2759] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:21 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:22.558543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-22986861-c5b8-4485-afe1-36862a2d83fb tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:22.577158 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-22986861-c5b8-4485-afe1-36862a2d83fb tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1508 microversion: 2.1 time: 0.733558 Jul 14 14:38:22.578125 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1378/2760] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:21 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1508 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:22.781685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e28f7a0e-927a-4995-aca0-411163ac3214 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cac9c820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:22.894121 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e28f7a0e-927a-4995-aca0-411163ac3214 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.108991 Jul 14 14:38:22.908990 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1383/2761] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:22 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:23.351205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bef629fe-4ec1-4bcc-b54d-bc0aa2c0e1ff tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:23.352037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bef629fe-4ec1-4bcc-b54d-bc0aa2c0e1ff tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:23.365719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bef629fe-4ec1-4bcc-b54d-bc0aa2c0e1ff tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:23.368644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bef629fe-4ec1-4bcc-b54d-bc0aa2c0e1ff tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:23.371529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bef629fe-4ec1-4bcc-b54d-bc0aa2c0e1ff tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:23.373915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bef629fe-4ec1-4bcc-b54d-bc0aa2c0e1ff tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:23.596359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-13990e0c-bd04-4808-b7d1-c7a66265fac3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:23.597653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-13990e0c-bd04-4808-b7d1-c7a66265fac3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:23.622148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13990e0c-bd04-4808-b7d1-c7a66265fac3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:23.633624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13990e0c-bd04-4808-b7d1-c7a66265fac3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:23.639080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13990e0c-bd04-4808-b7d1-c7a66265fac3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:23.640782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13990e0c-bd04-4808-b7d1-c7a66265fac3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:24.015893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bef629fe-4ec1-4bcc-b54d-bc0aa2c0e1ff tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:24.031583 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bef629fe-4ec1-4bcc-b54d-bc0aa2c0e1ff tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.682211 Jul 14 14:38:24.032849 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1379/2762] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:23 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:24.040038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1735ff1e-93e2-47a5-b519-147f6fc9a6d5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5af2700>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:24.115047 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1735ff1e-93e2-47a5-b519-147f6fc9a6d5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.080873 Jul 14 14:38:24.121786 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1380/2763] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:24 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:24.267758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-13990e0c-bd04-4808-b7d1-c7a66265fac3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:24.287970 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-13990e0c-bd04-4808-b7d1-c7a66265fac3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1512 microversion: 2.1 time: 0.695678 Jul 14 14:38:24.291039 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1384/2764] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:23 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1512 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:24.317611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bbfec76e-d0c5-47c7-b5c8-2a2606eae336 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:24.325384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bbfec76e-d0c5-47c7-b5c8-2a2606eae336 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:24.326463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.compute.servers [None req-bbfec76e-d0c5-47c7-b5c8-2a2606eae336 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Removing options 'limit' from query {{(pid=119512) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} Jul 14 14:38:24.329989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bbfec76e-d0c5-47c7-b5c8-2a2606eae336 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:38:24.331775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bbfec76e-d0c5-47c7-b5c8-2a2606eae336 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:24.335016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bbfec76e-d0c5-47c7-b5c8-2a2606eae336 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:24.336137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bbfec76e-d0c5-47c7-b5c8-2a2606eae336 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:24.337896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bbfec76e-d0c5-47c7-b5c8-2a2606eae336 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:24.343773 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bbfec76e-d0c5-47c7-b5c8-2a2606eae336 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.030635 Jul 14 14:38:24.350918 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1381/2765] 10.222.0.81 () {58 vars in 1139 bytes} [Thu Jul 14 14:38:24 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:38:24.357737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-90197824-2608-456b-a3db-64f13d789913 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:24.358664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-90197824-2608-456b-a3db-64f13d789913 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:24.372213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90197824-2608-456b-a3db-64f13d789913 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:24.374370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90197824-2608-456b-a3db-64f13d789913 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:24.376627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90197824-2608-456b-a3db-64f13d789913 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:24.378307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90197824-2608-456b-a3db-64f13d789913 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:24.752786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-326362840", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "7548582a-20e7-4cd6-b4ed-5662b7be2ba7"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:24.862014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] validate_networks() for [('7548582a-20e7-4cd6-b4ed-5662b7be2ba7', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:38:24.969052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-90197824-2608-456b-a3db-64f13d789913 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:24.986829 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-90197824-2608-456b-a3db-64f13d789913 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1512 microversion: 2.1 time: 0.629173 Jul 14 14:38:24.996498 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1385/2766] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:24 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1512 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:25.011028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0c0019c5-9afa-42d0-9a52-c037fec4d897 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:25.012053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0c0019c5-9afa-42d0-9a52-c037fec4d897 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:25.039501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c0019c5-9afa-42d0-9a52-c037fec4d897 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:25.040774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c0019c5-9afa-42d0-9a52-c037fec4d897 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:25.044922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c0019c5-9afa-42d0-9a52-c037fec4d897 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:25.045619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c0019c5-9afa-42d0-9a52-c037fec4d897 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:26.310433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0c0019c5-9afa-42d0-9a52-c037fec4d897 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:26.324617 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0c0019c5-9afa-42d0-9a52-c037fec4d897 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e" status: 200 len: 1512 microversion: 2.1 time: 1.324008 Jul 14 14:38:26.334347 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1386/2767] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:24 2022] GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e => generated 1512 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:26.360074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7564d8bd-0aaf-452f-896a-32e07da5cbc2 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:26.362990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7564d8bd-0aaf-452f-896a-32e07da5cbc2 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:26.390630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=48 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:26.401546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7564d8bd-0aaf-452f-896a-32e07da5cbc2 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:26.402850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7564d8bd-0aaf-452f-896a-32e07da5cbc2 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:26.406459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7564d8bd-0aaf-452f-896a-32e07da5cbc2 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:26.411646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7564d8bd-0aaf-452f-896a-32e07da5cbc2 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:27.089742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7564d8bd-0aaf-452f-896a-32e07da5cbc2 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:27.097822 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7564d8bd-0aaf-452f-896a-32e07da5cbc2 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 0.762099 Jul 14 14:38:27.109153 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1387/2768] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:26 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:27.117260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c73d16a9-c9c2-447d-a6c5-4473db762074 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c57835e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:27.223335 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c73d16a9-c9c2-447d-a6c5-4473db762074 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.109811 Jul 14 14:38:27.224108 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1388/2769] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:27 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:27.452409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:38:27.452967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:38:27.453518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:38:27.454034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:38:27.454550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:38:27.474844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:27.489735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:27.494689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:27.497759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:27.567779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Getting quotas for project 67736b0882a44cd480f487d0e69c7a01. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:27.590373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Getting quotas for user fd153868f91d4fd4bf380747185b2c1f and project 67736b0882a44cd480f487d0e69c7a01. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:27.642184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:38:27.644976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:38:27.818684 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fcf79c49-8244-4549-8ab9-46bc8c8ddd2c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.421689 Jul 14 14:38:27.819868 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1382/2770] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:38:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:38:27.834700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5674eb34-83d9-4d06-b556-f221109eaa89 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:27.838372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5674eb34-83d9-4d06-b556-f221109eaa89 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:27.875602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5674eb34-83d9-4d06-b556-f221109eaa89 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:27.882084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5674eb34-83d9-4d06-b556-f221109eaa89 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:27.889950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5674eb34-83d9-4d06-b556-f221109eaa89 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:27.891612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5674eb34-83d9-4d06-b556-f221109eaa89 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:27.922626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:27.935427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-457d031c-d0e1-4b4a-82f3-3be8cbb875d3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Action: 'create', calling method: .version_select at 0x7fd6c56ff0d0>, body: {"keypair": {"name": "tempest-keypair-438563365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmEhB3OQ+WEWHQyq5RlvW8U+yL75Z16jJj7PrJfcEgQyasc5SOcnkctpZwhtgzSvNljtTYuyCc4XDfU6Xjoc0U9WK6DnFOHgjDNGMM13Uv8Dm140ERnkUpGVi9RjsE28Q=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:28.020298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-457d031c-d0e1-4b4a-82f3-3be8cbb875d3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Getting quotas for project 991226f89eee4c4dbc3ec5870984d61d. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:28.032917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-457d031c-d0e1-4b4a-82f3-3be8cbb875d3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Getting quotas for user 03af57d274df4507b3d350194128502e and project 991226f89eee4c4dbc3ec5870984d61d. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:28.120526 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-457d031c-d0e1-4b4a-82f3-3be8cbb875d3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.888353 Jul 14 14:38:28.139226 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1389/2771] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:38:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:28.144613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-519c5538-1b23-4980-a324-f2a2a91e125c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:28.145462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-519c5538-1b23-4980-a324-f2a2a91e125c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:28.340176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-519c5538-1b23-4980-a324-f2a2a91e125c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:28.347517 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-519c5538-1b23-4980-a324-f2a2a91e125c tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1224 microversion: 2.1 time: 0.207069 Jul 14 14:38:28.348107 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1390/2772] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:28 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1224 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:28.382504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c9551d1-f4a2-4ae0-ad18-4dd232c3a4de tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:28.390468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3c9551d1-f4a2-4ae0-ad18-4dd232c3a4de tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:28.411192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c9551d1-f4a2-4ae0-ad18-4dd232c3a4de tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:28.411587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c9551d1-f4a2-4ae0-ad18-4dd232c3a4de tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:28.413832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c9551d1-f4a2-4ae0-ad18-4dd232c3a4de tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:28.414295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c9551d1-f4a2-4ae0-ad18-4dd232c3a4de tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:28.744620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5674eb34-83d9-4d06-b556-f221109eaa89 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:28.757225 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5674eb34-83d9-4d06-b556-f221109eaa89 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1511 microversion: 2.1 time: 0.935974 Jul 14 14:38:28.768463 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1383/2773] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:27 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1511 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:28.781940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fb03a15a-19cd-49d7-8fef-c6b1e005e4ac tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5a648b0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:28.956008 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fb03a15a-19cd-49d7-8fef-c6b1e005e4ac tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.183047 Jul 14 14:38:28.957111 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1384/2774] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:28 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:28.975426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-69588067-0f1e-43e2-9b4f-66b63557430c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:28.988993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-69588067-0f1e-43e2-9b4f-66b63557430c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:28.990174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-69588067-0f1e-43e2-9b4f-66b63557430c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:38:30.229395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69588067-0f1e-43e2-9b4f-66b63557430c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:30.230839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69588067-0f1e-43e2-9b4f-66b63557430c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:30.232152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69588067-0f1e-43e2-9b4f-66b63557430c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:30.232857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69588067-0f1e-43e2-9b4f-66b63557430c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:30.254768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3c9551d1-f4a2-4ae0-ad18-4dd232c3a4de tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:30.280068 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3c9551d1-f4a2-4ae0-ad18-4dd232c3a4de tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 1.913079 Jul 14 14:38:30.306687 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1391/2775] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:28 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:30.312190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a4fab49e-090d-4ce1-bb04-235b3c304cc0 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:30.324687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a4fab49e-090d-4ce1-bb04-235b3c304cc0 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:30.351472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4fab49e-090d-4ce1-bb04-235b3c304cc0 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:30.353982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4fab49e-090d-4ce1-bb04-235b3c304cc0 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:30.357339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4fab49e-090d-4ce1-bb04-235b3c304cc0 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:30.361392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4fab49e-090d-4ce1-bb04-235b3c304cc0 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:30.590590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-69588067-0f1e-43e2-9b4f-66b63557430c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:38:30.790698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a4fab49e-090d-4ce1-bb04-235b3c304cc0 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:30.804889 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a4fab49e-090d-4ce1-bb04-235b3c304cc0 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1282 microversion: 2.1 time: 0.496532 Jul 14 14:38:30.806676 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1392/2776] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:30 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1282 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:30.814975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0427a5b7-f651-4f3c-b9cc-142d8f6f14e9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5783ca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:30.817587 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-69588067-0f1e-43e2-9b4f-66b63557430c tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 1.859084 Jul 14 14:38:30.824770 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1385/2777] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Jul 14 14:38:28 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:30.840936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-260c5d33-6b74-428a-9abc-b3df6e333865 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:30.842417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-260c5d33-6b74-428a-9abc-b3df6e333865 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:30.868647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-260c5d33-6b74-428a-9abc-b3df6e333865 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:30.869606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-260c5d33-6b74-428a-9abc-b3df6e333865 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:30.871095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-260c5d33-6b74-428a-9abc-b3df6e333865 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:30.872697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-260c5d33-6b74-428a-9abc-b3df6e333865 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:30.994963 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0427a5b7-f651-4f3c-b9cc-142d8f6f14e9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.186937 Jul 14 14:38:30.996517 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1393/2778] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:30 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:31.300047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0950f040-c536-4ea3-b18d-984f86a138df tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:31.300674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0950f040-c536-4ea3-b18d-984f86a138df tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:31.318143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0950f040-c536-4ea3-b18d-984f86a138df tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:31.318143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0950f040-c536-4ea3-b18d-984f86a138df tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:31.324026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0950f040-c536-4ea3-b18d-984f86a138df tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:31.324495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0950f040-c536-4ea3-b18d-984f86a138df tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:31.998142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-260c5d33-6b74-428a-9abc-b3df6e333865 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:32.019478 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-260c5d33-6b74-428a-9abc-b3df6e333865 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1512 microversion: 2.1 time: 1.179847 Jul 14 14:38:32.032657 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1386/2779] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:30 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1512 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:32.037738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7e3f6056-f400-4f1f-b617-138cdce37484 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:32.038370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7e3f6056-f400-4f1f-b617-138cdce37484 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:32.064738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e3f6056-f400-4f1f-b617-138cdce37484 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.065238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e3f6056-f400-4f1f-b617-138cdce37484 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.066052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e3f6056-f400-4f1f-b617-138cdce37484 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.066736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e3f6056-f400-4f1f-b617-138cdce37484 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.657786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7e3f6056-f400-4f1f-b617-138cdce37484 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:32.666592 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7e3f6056-f400-4f1f-b617-138cdce37484 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1282 microversion: 2.1 time: 0.632563 Jul 14 14:38:32.667120 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1387/2780] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:32 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1282 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:32.675913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b1f1e262-4e86-4c07-9edd-4a545e186f35 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5a67430>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:32.781061 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b1f1e262-4e86-4c07-9edd-4a545e186f35 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.108809 Jul 14 14:38:32.789241 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1388/2781] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:32 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:32.798070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-23a05db3-7606-49f1-b9cc-21ee76df3c51 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:32.798766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-23a05db3-7606-49f1-b9cc-21ee76df3c51 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:32.837157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0950f040-c536-4ea3-b18d-984f86a138df tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:32.843796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23a05db3-7606-49f1-b9cc-21ee76df3c51 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.844643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23a05db3-7606-49f1-b9cc-21ee76df3c51 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.845729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23a05db3-7606-49f1-b9cc-21ee76df3c51 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.846379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23a05db3-7606-49f1-b9cc-21ee76df3c51 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.857943 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0950f040-c536-4ea3-b18d-984f86a138df tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1469 microversion: 2.1 time: 1.561695 Jul 14 14:38:32.861704 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1394/2782] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:31 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1469 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:33.684873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4ef901c9-b0d6-4ed5-a138-2387fe6df697 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:33.685551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4ef901c9-b0d6-4ed5-a138-2387fe6df697 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:33.698499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ef901c9-b0d6-4ed5-a138-2387fe6df697 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:33.701040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ef901c9-b0d6-4ed5-a138-2387fe6df697 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:33.706163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ef901c9-b0d6-4ed5-a138-2387fe6df697 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:33.706902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ef901c9-b0d6-4ed5-a138-2387fe6df697 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:33.931651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-23a05db3-7606-49f1-b9cc-21ee76df3c51 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:33.946449 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-23a05db3-7606-49f1-b9cc-21ee76df3c51 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e" status: 200 len: 1512 microversion: 2.1 time: 1.155853 Jul 14 14:38:33.947390 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1389/2783] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:32 2022] GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e => generated 1512 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:33.967982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-52c56a69-be80-4995-bdb5-c6a760b998ab tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5a64c10>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:34.028363 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-52c56a69-be80-4995-bdb5-c6a760b998ab tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.079453 Jul 14 14:38:34.029387 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1390/2784] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:33 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:34.034756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a5c152b1-306b-4096-9d49-5a96d6c92087 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:34.035666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a5c152b1-306b-4096-9d49-5a96d6c92087 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:34.043089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5c152b1-306b-4096-9d49-5a96d6c92087 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:34.043874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5c152b1-306b-4096-9d49-5a96d6c92087 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:34.045053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5c152b1-306b-4096-9d49-5a96d6c92087 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:34.045741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5c152b1-306b-4096-9d49-5a96d6c92087 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:34.166176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4ef901c9-b0d6-4ed5-a138-2387fe6df697 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:34.174102 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4ef901c9-b0d6-4ed5-a138-2387fe6df697 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1282 microversion: 2.1 time: 0.494301 Jul 14 14:38:34.188166 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1395/2785] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:33 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1282 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:34.201412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-68d24a5d-7fab-4b97-b376-25046ee3e861 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:34.202159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-68d24a5d-7fab-4b97-b376-25046ee3e861 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:34.213433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68d24a5d-7fab-4b97-b376-25046ee3e861 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:34.213875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68d24a5d-7fab-4b97-b376-25046ee3e861 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:34.214669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68d24a5d-7fab-4b97-b376-25046ee3e861 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:34.215109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68d24a5d-7fab-4b97-b376-25046ee3e861 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:34.877480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a5c152b1-306b-4096-9d49-5a96d6c92087 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:34.908096 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a5c152b1-306b-4096-9d49-5a96d6c92087 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1475 microversion: 2.1 time: 0.864365 Jul 14 14:38:34.908847 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1391/2786] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:34 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1475 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:34.939197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-68d24a5d-7fab-4b97-b376-25046ee3e861 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:34.952756 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-68d24a5d-7fab-4b97-b376-25046ee3e861 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1511 microversion: 2.1 time: 0.763415 Jul 14 14:38:34.962640 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1396/2787] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:34 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1511 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:34.981788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-67c9d3f4-2e27-490c-8b2f-67738d37fec6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:34.989249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-67c9d3f4-2e27-490c-8b2f-67738d37fec6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:34.991232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-67c9d3f4-2e27-490c-8b2f-67738d37fec6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:38:34.999285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67c9d3f4-2e27-490c-8b2f-67738d37fec6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.000748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67c9d3f4-2e27-490c-8b2f-67738d37fec6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.003808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67c9d3f4-2e27-490c-8b2f-67738d37fec6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.004492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67c9d3f4-2e27-490c-8b2f-67738d37fec6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.044854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cb6f24e1-c591-4a5d-9198-abf4d21dc78a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c53a45e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:35.105917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-67c9d3f4-2e27-490c-8b2f-67738d37fec6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:38:35.126481 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cb6f24e1-c591-4a5d-9198-abf4d21dc78a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.088006 Jul 14 14:38:35.133990 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1397/2788] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:35 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:35.212337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4e2d386-16ff-4f03-9af2-24843e05ec4b tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:35.213699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b4e2d386-16ff-4f03-9af2-24843e05ec4b tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:35.228759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4e2d386-16ff-4f03-9af2-24843e05ec4b tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.229554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4e2d386-16ff-4f03-9af2-24843e05ec4b tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.230732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4e2d386-16ff-4f03-9af2-24843e05ec4b tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.231433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4e2d386-16ff-4f03-9af2-24843e05ec4b tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.372211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-67c9d3f4-2e27-490c-8b2f-67738d37fec6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:35.389899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67c9d3f4-2e27-490c-8b2f-67738d37fec6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.395989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67c9d3f4-2e27-490c-8b2f-67738d37fec6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.873653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b4e2d386-16ff-4f03-9af2-24843e05ec4b tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:35.886283 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b4e2d386-16ff-4f03-9af2-24843e05ec4b tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1324 microversion: 2.1 time: 0.691361 Jul 14 14:38:35.886891 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1398/2789] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:35 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1324 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:35.926371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-830b376c-45f2-4afe-819b-6a9a6ecf4e92 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:35.926993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-830b376c-45f2-4afe-819b-6a9a6ecf4e92 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:35.938745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-830b376c-45f2-4afe-819b-6a9a6ecf4e92 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.939216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-830b376c-45f2-4afe-819b-6a9a6ecf4e92 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.940053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-830b376c-45f2-4afe-819b-6a9a6ecf4e92 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.940596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-830b376c-45f2-4afe-819b-6a9a6ecf4e92 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:36.232075 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-67c9d3f4-2e27-490c-8b2f-67738d37fec6 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 1.255044 Jul 14 14:38:36.234126 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1392/2790] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:38:34 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:36.240245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a64124a0-73b9-4130-934f-ef502a2f743b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5e305e0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:36.346268 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a64124a0-73b9-4130-934f-ef502a2f743b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.110821 Jul 14 14:38:36.347093 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1393/2791] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:36 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:36.353980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-877530d2-78f4-40d7-ad2e-98074f6bed93 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:36.356774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-877530d2-78f4-40d7-ad2e-98074f6bed93 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:36.357478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-877530d2-78f4-40d7-ad2e-98074f6bed93 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:38:36.605581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-830b376c-45f2-4afe-819b-6a9a6ecf4e92 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:36.616589 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-830b376c-45f2-4afe-819b-6a9a6ecf4e92 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1475 microversion: 2.1 time: 0.693947 Jul 14 14:38:36.630825 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1399/2792] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:35 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1475 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:36.674331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-877530d2-78f4-40d7-ad2e-98074f6bed93 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:36.674791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-877530d2-78f4-40d7-ad2e-98074f6bed93 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:36.675603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-877530d2-78f4-40d7-ad2e-98074f6bed93 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:36.676049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-877530d2-78f4-40d7-ad2e-98074f6bed93 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:36.760307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-877530d2-78f4-40d7-ad2e-98074f6bed93 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:38:36.824587 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-877530d2-78f4-40d7-ad2e-98074f6bed93 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.476173 Jul 14 14:38:36.825509 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1394/2793] 10.222.0.81 () {58 vars in 1149 bytes} [Thu Jul 14 14:38:36 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:36.839955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1744f02d-4779-4f47-9aaf-1be40a71d6fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:36.844282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1744f02d-4779-4f47-9aaf-1be40a71d6fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:36.847246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1744f02d-4779-4f47-9aaf-1be40a71d6fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:38:36.865471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1744f02d-4779-4f47-9aaf-1be40a71d6fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:36.865974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1744f02d-4779-4f47-9aaf-1be40a71d6fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:36.866859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1744f02d-4779-4f47-9aaf-1be40a71d6fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:36.867313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1744f02d-4779-4f47-9aaf-1be40a71d6fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:36.904678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1ee43f3d-9818-458e-acaa-72a93538645d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:36.905622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1ee43f3d-9818-458e-acaa-72a93538645d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:36.926656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ee43f3d-9818-458e-acaa-72a93538645d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:36.927125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ee43f3d-9818-458e-acaa-72a93538645d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:36.927929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ee43f3d-9818-458e-acaa-72a93538645d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:36.928373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ee43f3d-9818-458e-acaa-72a93538645d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:37.027057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-1744f02d-4779-4f47-9aaf-1be40a71d6fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:38:37.107861 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1744f02d-4779-4f47-9aaf-1be40a71d6fa tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.273126 Jul 14 14:38:37.109521 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1400/2794] 10.222.0.81 () {58 vars in 1211 bytes} [Thu Jul 14 14:38:36 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:37.122499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2936c77c-5c69-4c33-b504-9091727b36a5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:37.128381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2936c77c-5c69-4c33-b504-9091727b36a5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:37.129700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2936c77c-5c69-4c33-b504-9091727b36a5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:38:37.137241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2936c77c-5c69-4c33-b504-9091727b36a5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:37.138165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2936c77c-5c69-4c33-b504-9091727b36a5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:37.139469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2936c77c-5c69-4c33-b504-9091727b36a5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:37.140270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2936c77c-5c69-4c33-b504-9091727b36a5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:37.301600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-2936c77c-5c69-4c33-b504-9091727b36a5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:38:37.338078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:37.441446 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2936c77c-5c69-4c33-b504-9091727b36a5 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.308042 Jul 14 14:38:37.441446 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1401/2795] 10.222.0.81 () {58 vars in 1195 bytes} [Thu Jul 14 14:38:37 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:37.441446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-698a4b54-b0ea-49f8-b0b7-60e186eab17b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cad20ee0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:37.509416 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-698a4b54-b0ea-49f8-b0b7-60e186eab17b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1454 microversion: 2.1 time: 0.081449 Jul 14 14:38:37.511128 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1402/2796] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:37 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:37.518085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d59eb8ad-dd4d-456b-8d42-47f1772e7ba0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:37.525762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d59eb8ad-dd4d-456b-8d42-47f1772e7ba0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:37.528219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d59eb8ad-dd4d-456b-8d42-47f1772e7ba0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'name': '1219910380', 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:38:37.543460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d59eb8ad-dd4d-456b-8d42-47f1772e7ba0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:37.543913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d59eb8ad-dd4d-456b-8d42-47f1772e7ba0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:37.544861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d59eb8ad-dd4d-456b-8d42-47f1772e7ba0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:37.545428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d59eb8ad-dd4d-456b-8d42-47f1772e7ba0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:37.691803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-d59eb8ad-dd4d-456b-8d42-47f1772e7ba0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:38:37.817452 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d59eb8ad-dd4d-456b-8d42-47f1772e7ba0 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?name=1219910380" status: 200 len: 346 microversion: 2.1 time: 0.304636 Jul 14 14:38:37.818149 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1403/2797] 10.222.0.81 () {58 vars in 1155 bytes} [Thu Jul 14 14:38:37 2022] GET /compute/v2.1/servers?name=1219910380 => generated 346 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:37.841928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea2a2ce9-8e57-4ec6-8c0f-25b1679501c5 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:37.842571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ea2a2ce9-8e57-4ec6-8c0f-25b1679501c5 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:37.860515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea2a2ce9-8e57-4ec6-8c0f-25b1679501c5 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:37.860995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea2a2ce9-8e57-4ec6-8c0f-25b1679501c5 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:37.861800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea2a2ce9-8e57-4ec6-8c0f-25b1679501c5 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:37.862244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea2a2ce9-8e57-4ec6-8c0f-25b1679501c5 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.306078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1ee43f3d-9818-458e-acaa-72a93538645d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:38.338265 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1ee43f3d-9818-458e-acaa-72a93538645d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1324 microversion: 2.1 time: 1.437477 Jul 14 14:38:38.343056 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1395/2798] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:36 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1324 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:38.346639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:38.359046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c28801b1-63d0-49ef-a602-8dee8a6c38ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:38.366802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ea2a2ce9-8e57-4ec6-8c0f-25b1679501c5 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:38.379592 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ea2a2ce9-8e57-4ec6-8c0f-25b1679501c5 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1475 microversion: 2.1 time: 0.551020 Jul 14 14:38:38.389539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c28801b1-63d0-49ef-a602-8dee8a6c38ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:38.389539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c28801b1-63d0-49ef-a602-8dee8a6c38ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:38:38.389982 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1404/2799] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:37 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1475 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:38.395222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c28801b1-63d0-49ef-a602-8dee8a6c38ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.395685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c28801b1-63d0-49ef-a602-8dee8a6c38ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.396814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c28801b1-63d0-49ef-a602-8dee8a6c38ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.397291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c28801b1-63d0-49ef-a602-8dee8a6c38ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.398216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-cf7640a3-2c10-4184-b22b-09325d6af465 req-cc6f125e-775e-41e3-bef4-0d9972bdfe6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0e1171-566a-413f-969d-08d20f2b74c5", "tag": "63428ed3-81eb-477c-baf3-ea96c76769c0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:38.420403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cf7640a3-2c10-4184-b22b-09325d6af465 req-cc6f125e-775e-41e3-bef4-0d9972bdfe6f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.423407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cf7640a3-2c10-4184-b22b-09325d6af465 req-cc6f125e-775e-41e3-bef4-0d9972bdfe6f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.451384 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-cf7640a3-2c10-4184-b22b-09325d6af465 req-cc6f125e-775e-41e3-bef4-0d9972bdfe6f service nova] Creating event network-changed:63428ed3-81eb-477c-baf3-ea96c76769c0 for instance 0c0e1171-566a-413f-969d-08d20f2b74c5 on n-h2-767704-28 Jul 14 14:38:38.466753 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-cf7640a3-2c10-4184-b22b-09325d6af465 req-cc6f125e-775e-41e3-bef4-0d9972bdfe6f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075650 Jul 14 14:38:38.469025 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1405/2800] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:38.526918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d701e417-be9a-4bdf-9c29-f08ba8549f88 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c596c0d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:38.543906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-c28801b1-63d0-49ef-a602-8dee8a6c38ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:38:38.601703 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d701e417-be9a-4bdf-9c29-f08ba8549f88 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1463 microversion: 2.1 time: 0.075603 Jul 14 14:38:38.603506 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1406/2801] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:38 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1463 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:38.615461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-320845d0-368e-4af2-9b4b-ad0d5a2f99bd tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cabc8a60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:38.651214 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c28801b1-63d0-49ef-a602-8dee8a6c38ba tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.304614 Jul 14 14:38:38.657542 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1396/2802] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Jul 14 14:38:38 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:38.662945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2c9c0ffa-cb4f-46bd-90af-85452b50f95e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:38.687252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2c9c0ffa-cb4f-46bd-90af-85452b50f95e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:38.687951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2c9c0ffa-cb4f-46bd-90af-85452b50f95e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-121991038', 'deleted': False, 'project_id': '2e9036125df9487d9f5cf8afe8f13907'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:38:38.699473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c9c0ffa-cb4f-46bd-90af-85452b50f95e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.700128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c9c0ffa-cb4f-46bd-90af-85452b50f95e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.701040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c9c0ffa-cb4f-46bd-90af-85452b50f95e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.702003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c9c0ffa-cb4f-46bd-90af-85452b50f95e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.715274 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-320845d0-368e-4af2-9b4b-ad0d5a2f99bd tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 200 len: 1463 microversion: 2.1 time: 0.103059 Jul 14 14:38:38.717732 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1407/2803] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:38 2022] GET /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 1463 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:38.730602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7f91bd08-932b-4899-ae51-d32b89901e37 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:38.734243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7f91bd08-932b-4899-ae51-d32b89901e37 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:38.772002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f91bd08-932b-4899-ae51-d32b89901e37 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.776220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f91bd08-932b-4899-ae51-d32b89901e37 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.777629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f91bd08-932b-4899-ae51-d32b89901e37 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.784391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f91bd08-932b-4899-ae51-d32b89901e37 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.912933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-2c9c0ffa-cb4f-46bd-90af-85452b50f95e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:38:39.064327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:39.066615 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2c9c0ffa-cb4f-46bd-90af-85452b50f95e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-121991038" status: 200 len: 346 microversion: 2.1 time: 0.407372 Jul 14 14:38:39.075947 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1397/2804] 10.222.0.81 () {58 vars in 1227 bytes} [Thu Jul 14 14:38:38 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-121991038 => generated 346 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:39.083609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ceac88b-0683-4c1e-99cb-23beed22ced2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:39.089568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ceac88b-0683-4c1e-99cb-23beed22ced2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:39.106848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:39.110446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ceac88b-0683-4c1e-99cb-23beed22ced2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.115177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ceac88b-0683-4c1e-99cb-23beed22ced2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.116349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ceac88b-0683-4c1e-99cb-23beed22ced2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.117004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ceac88b-0683-4c1e-99cb-23beed22ced2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.185890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ceac88b-0683-4c1e-99cb-23beed22ced2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:38:39.286754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7f91bd08-932b-4899-ae51-d32b89901e37 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:39.301472 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7f91bd08-932b-4899-ae51-d32b89901e37 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2" status: 200 len: 1466 microversion: 2.1 time: 0.571966 Jul 14 14:38:39.302148 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1408/2805] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:38 2022] GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 => generated 1466 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:39.314552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-2ad098d3-fc41-4264-bdab-35401caf6832 req-c34f58dc-ed7c-4ba1-ab21-17d18fa181f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ebe371-1ebb-4849-a18f-4b3e40035dfb", "name": "network-vif-plugged", "status": "completed", "tag": "929f1d52-94d9-463b-b94c-fe77458a9e1a"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:39.336755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2ad098d3-fc41-4264-bdab-35401caf6832 req-c34f58dc-ed7c-4ba1-ab21-17d18fa181f8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.340051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2ad098d3-fc41-4264-bdab-35401caf6832 req-c34f58dc-ed7c-4ba1-ab21-17d18fa181f8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.374333 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-2ad098d3-fc41-4264-bdab-35401caf6832 req-c34f58dc-ed7c-4ba1-ab21-17d18fa181f8 service nova] Creating event network-vif-plugged:929f1d52-94d9-463b-b94c-fe77458a9e1a for instance 13ebe371-1ebb-4849-a18f-4b3e40035dfb on n-h1-767704-28 Jul 14 14:38:39.386156 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-2ad098d3-fc41-4264-bdab-35401caf6832 req-c34f58dc-ed7c-4ba1-ab21-17d18fa181f8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081331 Jul 14 14:38:39.387120 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1409/2806] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:39.395153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c26a7e94-638a-41d3-99e4-85518cb50aba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c57e39d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:39.411980 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ceac88b-0683-4c1e-99cb-23beed22ced2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 204 len: 0 microversion: 2.1 time: 0.330701 Jul 14 14:38:39.417009 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1398/2807] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:38:39 2022] DELETE /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:39.443211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-98cd64cb-ee55-4e0c-8482-8fc966d1cb48 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:39.449038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-98cd64cb-ee55-4e0c-8482-8fc966d1cb48 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:39.471250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-98cd64cb-ee55-4e0c-8482-8fc966d1cb48 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.480685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-98cd64cb-ee55-4e0c-8482-8fc966d1cb48 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.485264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-98cd64cb-ee55-4e0c-8482-8fc966d1cb48 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.487472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-98cd64cb-ee55-4e0c-8482-8fc966d1cb48 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.554659 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c26a7e94-638a-41d3-99e4-85518cb50aba tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images?changes-since=2022-07-14T14%3A36%3A10Z" status: 200 len: 2374 microversion: 2.1 time: 0.165233 Jul 14 14:38:39.557161 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1410/2808] 10.222.0.81 () {58 vars in 1198 bytes} [Thu Jul 14 14:38:39 2022] GET /compute/v2.1/images?changes-since=2022-07-14T14%3A36%3A10Z => generated 2374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:39.562015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d7a8a8f-9e80-4b64-a60c-44ab564afdbf tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:39.563048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0d7a8a8f-9e80-4b64-a60c-44ab564afdbf tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:39.582444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d7a8a8f-9e80-4b64-a60c-44ab564afdbf tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.583214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d7a8a8f-9e80-4b64-a60c-44ab564afdbf tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.584207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d7a8a8f-9e80-4b64-a60c-44ab564afdbf tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.584882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d7a8a8f-9e80-4b64-a60c-44ab564afdbf tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:40.073798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0d7a8a8f-9e80-4b64-a60c-44ab564afdbf tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:40.082534 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0d7a8a8f-9e80-4b64-a60c-44ab564afdbf tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1475 microversion: 2.1 time: 0.524139 Jul 14 14:38:40.101078 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1411/2809] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:39 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1475 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:40.106751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9bb5b7fd-560b-46f4-8129-66c0322732a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:40.118273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9bb5b7fd-560b-46f4-8129-66c0322732a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:40.128914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bb5b7fd-560b-46f4-8129-66c0322732a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:40.134337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bb5b7fd-560b-46f4-8129-66c0322732a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:40.135361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bb5b7fd-560b-46f4-8129-66c0322732a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:40.135898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bb5b7fd-560b-46f4-8129-66c0322732a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:40.343584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-98cd64cb-ee55-4e0c-8482-8fc966d1cb48 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:40.357581 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-98cd64cb-ee55-4e0c-8482-8fc966d1cb48 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1324 microversion: 2.1 time: 0.938792 Jul 14 14:38:40.359248 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1399/2810] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:39 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1324 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:40.368420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f25e7167-c753-4ca4-8c0a-a326cd4b4eb5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5aa8d30>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:40.416181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9bb5b7fd-560b-46f4-8129-66c0322732a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:40.424299 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9bb5b7fd-560b-46f4-8129-66c0322732a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1517 microversion: 2.1 time: 0.321413 Jul 14 14:38:40.424884 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1412/2811] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:40 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1517 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:40.479710 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f25e7167-c753-4ca4-8c0a-a326cd4b4eb5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-768012386" status: 200 len: 484 microversion: 2.1 time: 0.117540 Jul 14 14:38:40.487920 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1400/2812] 10.222.0.81 () {58 vars in 1228 bytes} [Thu Jul 14 14:38:40 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-768012386 => generated 484 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:40.496080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e8beec6a-bc47-4470-9f72-3400d0cdffd5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5793820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:40.629358 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e8beec6a-bc47-4470-9f72-3400d0cdffd5 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images?server=83dae6b9-f87b-4ee4-ab0d-3706cd2602a2" status: 200 len: 957 microversion: 2.1 time: 0.141337 Jul 14 14:38:40.631923 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1413/2813] 10.222.0.81 () {58 vars in 1208 bytes} [Thu Jul 14 14:38:40 2022] GET /compute/v2.1/images?server=83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 => generated 957 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:40.643956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-131e7d9e-b622-4de8-a3fb-5928542b2abf tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c589f8b0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:40.714469 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-131e7d9e-b622-4de8-a3fb-5928542b2abf tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fv2.1%2Fservers%2F421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 483 microversion: 2.1 time: 0.074183 Jul 14 14:38:40.729108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-685bd598-8de0-47fa-bfb8-af2d854216eb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5a2a160>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:40.733880 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1401/2814] 10.222.0.81 () {58 vars in 1316 bytes} [Thu Jul 14 14:38:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fv2.1%2Fservers%2F421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 483 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:40.806632 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-685bd598-8de0-47fa-bfb8-af2d854216eb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fservers%2F421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 483 microversion: 2.1 time: 0.082291 Jul 14 14:38:40.807219 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1414/2815] 10.222.0.81 () {58 vars in 1302 bytes} [Thu Jul 14 14:38:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fservers%2F421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 483 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:40.820209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d7755c35-e163-4e02-9469-385831c4d88f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c589f1f0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:41.026523 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d7755c35-e163-4e02-9469-385831c4d88f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.211862 Jul 14 14:38:41.029845 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1402/2816] 10.222.0.81 () {58 vars in 1148 bytes} [Thu Jul 14 14:38:40 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:41.041136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5f9b41ff-4f60-4c4f-aeb8-98f066a56f40 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5a2a280>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:41.108422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-89b462d2-a92b-42d4-a616-e645d11e5734 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:41.109181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-89b462d2-a92b-42d4-a616-e645d11e5734 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:41.118448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-89b462d2-a92b-42d4-a616-e645d11e5734 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:41.129191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-89b462d2-a92b-42d4-a616-e645d11e5734 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:41.130056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-89b462d2-a92b-42d4-a616-e645d11e5734 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:41.130507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-89b462d2-a92b-42d4-a616-e645d11e5734 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:41.185005 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5f9b41ff-4f60-4c4f-aeb8-98f066a56f40 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.148555 Jul 14 14:38:41.197339 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1415/2817] 10.222.0.81 () {58 vars in 1148 bytes} [Thu Jul 14 14:38:41 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:41.208707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f679a154-8103-4cc9-a722-e8bd96b9d881 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5783940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:41.284691 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f679a154-8103-4cc9-a722-e8bd96b9d881 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.079594 Jul 14 14:38:41.288096 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1416/2818] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:38:41 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:38:41.306119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c3c36694-f497-4a85-8122-6bdb3d0c1112 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5a2a160>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:41.426356 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c3c36694-f497-4a85-8122-6bdb3d0c1112 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/detail?changes-since=2022-07-14T14%3A36%3A06Z" status: 200 len: 6332 microversion: 2.1 time: 0.129972 Jul 14 14:38:41.434634 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1417/2819] 10.222.0.81 () {58 vars in 1219 bytes} [Thu Jul 14 14:38:41 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-14T14%3A36%3A06Z => generated 6332 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:41.446495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cfa50110-326d-4f2a-a5b8-3e0c76b67520 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:41.449178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cfa50110-326d-4f2a-a5b8-3e0c76b67520 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:41.462968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cfa50110-326d-4f2a-a5b8-3e0c76b67520 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:41.464020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cfa50110-326d-4f2a-a5b8-3e0c76b67520 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:41.465382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cfa50110-326d-4f2a-a5b8-3e0c76b67520 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:41.466276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cfa50110-326d-4f2a-a5b8-3e0c76b67520 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.288963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-89b462d2-a92b-42d4-a616-e645d11e5734 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:42.303480 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-89b462d2-a92b-42d4-a616-e645d11e5734 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1475 microversion: 2.1 time: 1.198084 Jul 14 14:38:42.304970 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1403/2820] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:41 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1475 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:42.312998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-45d9337f-96bb-4fe1-92bd-083658e604ef req-ac7aa7af-ad06-4636-8c22-5deecba9eb17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83dae6b9-f87b-4ee4-ab0d-3706cd2602a2", "name": "network-vif-unplugged", "status": "completed", "tag": "9462ad9c-5eb2-40e6-922b-2e480cd3ce7b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:42.325849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-45d9337f-96bb-4fe1-92bd-083658e604ef req-ac7aa7af-ad06-4636-8c22-5deecba9eb17 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:42.327813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-45d9337f-96bb-4fe1-92bd-083658e604ef req-ac7aa7af-ad06-4636-8c22-5deecba9eb17 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.358498 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-45d9337f-96bb-4fe1-92bd-083658e604ef req-ac7aa7af-ad06-4636-8c22-5deecba9eb17 service nova] Creating event network-vif-unplugged:9462ad9c-5eb2-40e6-922b-2e480cd3ce7b for instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 on n-h1-767704-28 Jul 14 14:38:42.365425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cfa50110-326d-4f2a-a5b8-3e0c76b67520 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:42.377281 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-45d9337f-96bb-4fe1-92bd-083658e604ef req-ac7aa7af-ad06-4636-8c22-5deecba9eb17 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066670 Jul 14 14:38:42.378621 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1404/2821] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:42.381437 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cfa50110-326d-4f2a-a5b8-3e0c76b67520 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1324 microversion: 2.1 time: 0.943469 Jul 14 14:38:42.382275 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1418/2822] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:41 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1324 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:42.390161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-634b9526-6e84-4167-964e-0dce8d3bdd3f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c59a1820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:42.397935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f9531fb-b628-4ba0-81a8-c25e40dda87f tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:42.399864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f9531fb-b628-4ba0-81a8-c25e40dda87f tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:42.427240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f9531fb-b628-4ba0-81a8-c25e40dda87f tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:42.428637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f9531fb-b628-4ba0-81a8-c25e40dda87f tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.432236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f9531fb-b628-4ba0-81a8-c25e40dda87f tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:42.433409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f9531fb-b628-4ba0-81a8-c25e40dda87f tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.483263 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-634b9526-6e84-4167-964e-0dce8d3bdd3f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-768012386" status: 200 len: 664 microversion: 2.1 time: 0.099210 Jul 14 14:38:42.483868 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1419/2823] 10.222.0.81 () {58 vars in 1249 bytes} [Thu Jul 14 14:38:42 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-768012386 => generated 664 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:42.500244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-186d5584-52db-4ddf-814d-3154afd204db tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cad0b4c0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:42.561803 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-186d5584-52db-4ddf-814d-3154afd204db tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fv2.1%2Fservers%2F421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1465 microversion: 2.1 time: 0.065284 Jul 14 14:38:42.562661 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1420/2824] 10.222.0.81 () {58 vars in 1337 bytes} [Thu Jul 14 14:38:42 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fv2.1%2Fservers%2F421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1465 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:42.576345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0f983ca9-04de-492f-957f-47a77744456f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c56ffaf0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:42.686187 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0f983ca9-04de-492f-957f-47a77744456f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fservers%2F421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1465 microversion: 2.1 time: 0.113406 Jul 14 14:38:42.699294 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1421/2825] 10.222.0.81 () {58 vars in 1323 bytes} [Thu Jul 14 14:38:42 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.81%2Fcompute%2Fservers%2F421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1465 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:42.705843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c3fc2cce-8e70-44d0-b95f-45c3d70ff4d9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c56c5820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:42.707291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f9531fb-b628-4ba0-81a8-c25e40dda87f tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:42.717923 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f9531fb-b628-4ba0-81a8-c25e40dda87f tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1517 microversion: 2.1 time: 0.337723 Jul 14 14:38:42.721471 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1405/2826] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:42 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1517 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:42.940481 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c3fc2cce-8e70-44d0-b95f-45c3d70ff4d9 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.239025 Jul 14 14:38:42.941028 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1422/2827] 10.222.0.81 () {58 vars in 1169 bytes} [Thu Jul 14 14:38:42 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:42.973231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-888c7bb2-5e25-466e-8ed2-9ad34222131f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5a7c550>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:43.072647 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-888c7bb2-5e25-466e-8ed2-9ad34222131f tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.106458 Jul 14 14:38:43.079420 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1406/2828] 10.222.0.81 () {58 vars in 1169 bytes} [Thu Jul 14 14:38:42 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:43.090934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0e1546cf-1ca0-47ce-a071-ded96b609521 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c59a1820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:43.176763 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0e1546cf-1ca0-47ce-a071-ded96b609521 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/4f5e5af0-d72c-4006-a62b-d41e489facb7" status: 200 len: 784 microversion: 2.1 time: 0.094013 Jul 14 14:38:43.187861 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1423/2829] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:38:43 2022] GET /compute/v2.1/images/4f5e5af0-d72c-4006-a62b-d41e489facb7 => generated 784 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:43.193697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7af084ee-acda-4584-a7a2-99c27c5c61b6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5af6160>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:43.301463 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7af084ee-acda-4584-a7a2-99c27c5c61b6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.112304 Jul 14 14:38:43.303070 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1407/2830] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:38:43 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:43.316844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f3c8232-c69d-488e-ad24-a5be330614ce tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cad0bdc0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:43.322430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-20e84448-3e9f-4dba-9cd4-00273ef02dad tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:43.323338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-20e84448-3e9f-4dba-9cd4-00273ef02dad tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:43.338963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20e84448-3e9f-4dba-9cd4-00273ef02dad tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:43.340213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20e84448-3e9f-4dba-9cd4-00273ef02dad tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:43.341202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20e84448-3e9f-4dba-9cd4-00273ef02dad tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:43.341830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20e84448-3e9f-4dba-9cd4-00273ef02dad tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:43.970591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-20e84448-3e9f-4dba-9cd4-00273ef02dad tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:43.982859 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-20e84448-3e9f-4dba-9cd4-00273ef02dad tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1475 microversion: 2.1 time: 0.664609 Jul 14 14:38:43.994082 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1408/2831] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:43 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1475 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:44.001688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2224ff74-f030-4592-bac1-5a9e0ef39ee5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:44.002437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2224ff74-f030-4592-bac1-5a9e0ef39ee5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:44.013068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2224ff74-f030-4592-bac1-5a9e0ef39ee5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:44.013730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2224ff74-f030-4592-bac1-5a9e0ef39ee5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:44.015673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2224ff74-f030-4592-bac1-5a9e0ef39ee5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:44.016249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2224ff74-f030-4592-bac1-5a9e0ef39ee5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:44.399508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2224ff74-f030-4592-bac1-5a9e0ef39ee5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:44.409246 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2224ff74-f030-4592-bac1-5a9e0ef39ee5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1324 microversion: 2.1 time: 0.413357 Jul 14 14:38:44.416712 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1409/2832] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:43 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1324 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:44.436240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-622fcbfa-ff1e-4456-a8c9-f040863cd277 req-21ca10e7-816b-4628-85bc-23d252b6375e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7052fe14-7fcb-4fb5-a013-966c9b7ee3a6", "name": "network-vif-deleted", "tag": "36cbf8c5-c0e4-4f58-8274-bca21639be29"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:44.472166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-622fcbfa-ff1e-4456-a8c9-f040863cd277 req-21ca10e7-816b-4628-85bc-23d252b6375e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:44.472857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-622fcbfa-ff1e-4456-a8c9-f040863cd277 req-21ca10e7-816b-4628-85bc-23d252b6375e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:44.514047 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-622fcbfa-ff1e-4456-a8c9-f040863cd277 req-21ca10e7-816b-4628-85bc-23d252b6375e service nova] Creating event network-vif-deleted:36cbf8c5-c0e4-4f58-8274-bca21639be29 for instance 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 on n-h1-767704-28 Jul 14 14:38:44.527153 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-622fcbfa-ff1e-4456-a8c9-f040863cd277 req-21ca10e7-816b-4628-85bc-23d252b6375e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104974 Jul 14 14:38:44.528823 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1410/2833] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:44.543812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b2702c7d-2cee-4768-8a0d-dd0fb5f739c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:44.544756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b2702c7d-2cee-4768-8a0d-dd0fb5f739c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:44.552456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2702c7d-2cee-4768-8a0d-dd0fb5f739c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:44.552917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2702c7d-2cee-4768-8a0d-dd0fb5f739c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:44.554360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2702c7d-2cee-4768-8a0d-dd0fb5f739c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:44.555670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2702c7d-2cee-4768-8a0d-dd0fb5f739c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:44.598070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2702c7d-2cee-4768-8a0d-dd0fb5f739c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:44.598763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2702c7d-2cee-4768-8a0d-dd0fb5f739c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:44.599380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-b2702c7d-2cee-4768-8a0d-dd0fb5f739c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lazy-loading 'fault' on Instance uuid 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:44.755913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b2702c7d-2cee-4768-8a0d-dd0fb5f739c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:44.767007 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b2702c7d-2cee-4768-8a0d-dd0fb5f739c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 200 len: 1310 microversion: 2.1 time: 0.236527 Jul 14 14:38:44.771373 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1411/2834] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:44 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 1310 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:44.819953 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9f3c8232-c69d-488e-ad24-a5be330614ce tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "DELETE /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8" status: 204 len: 0 microversion: 2.1 time: 1.505836 Jul 14 14:38:44.825624 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1424/2835] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:43 2022] DELETE /compute/v2.1/images/8f27d44d-d2b6-460a-8b6c-718647c534e8 => generated 0 bytes in 1510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:44.835921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-293d1579-7dc1-4ddd-8024-9a55af6a6bbc tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c58a9310>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:45.001890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77565440-ce47-4fe0-a3d5-3ad54c92162f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:45.002640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-77565440-ce47-4fe0-a3d5-3ad54c92162f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:45.014445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77565440-ce47-4fe0-a3d5-3ad54c92162f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.014921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77565440-ce47-4fe0-a3d5-3ad54c92162f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.015719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77565440-ce47-4fe0-a3d5-3ad54c92162f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.019232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77565440-ce47-4fe0-a3d5-3ad54c92162f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.340260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-77565440-ce47-4fe0-a3d5-3ad54c92162f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:45.356008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:45.364977 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-77565440-ce47-4fe0-a3d5-3ad54c92162f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1460 microversion: 2.1 time: 0.365861 Jul 14 14:38:45.371346 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1425/2836] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:44 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1460 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:45.380858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f0466ab6-331f-45a2-8de6-89768a63a464 req-2b3930f4-fd88-45c1-b5ed-dd03c18abd63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0e1171-566a-413f-969d-08d20f2b74c5", "name": "network-vif-plugged", "status": "completed", "tag": "63428ed3-81eb-477c-baf3-ea96c76769c0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:45.417602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f0466ab6-331f-45a2-8de6-89768a63a464 req-2b3930f4-fd88-45c1-b5ed-dd03c18abd63 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.417602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f0466ab6-331f-45a2-8de6-89768a63a464 req-2b3930f4-fd88-45c1-b5ed-dd03c18abd63 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.448508 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f0466ab6-331f-45a2-8de6-89768a63a464 req-2b3930f4-fd88-45c1-b5ed-dd03c18abd63 service nova] Creating event network-vif-plugged:63428ed3-81eb-477c-baf3-ea96c76769c0 for instance 0c0e1171-566a-413f-969d-08d20f2b74c5 on n-h2-767704-28 Jul 14 14:38:45.459491 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f0466ab6-331f-45a2-8de6-89768a63a464 req-2b3930f4-fd88-45c1-b5ed-dd03c18abd63 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085852 Jul 14 14:38:45.461879 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1426/2837] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:45.467939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8e20013c-a76f-4029-89bc-a270a0f1e856 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:45.471028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8e20013c-a76f-4029-89bc-a270a0f1e856 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:45.482844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e20013c-a76f-4029-89bc-a270a0f1e856 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.484058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e20013c-a76f-4029-89bc-a270a0f1e856 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.497490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e20013c-a76f-4029-89bc-a270a0f1e856 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.501445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e20013c-a76f-4029-89bc-a270a0f1e856 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.666860 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-293d1579-7dc1-4ddd-8024-9a55af6a6bbc tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "DELETE /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed" status: 204 len: 0 microversion: 2.1 time: 0.837376 Jul 14 14:38:45.671661 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1412/2838] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:44 2022] DELETE /compute/v2.1/images/b641cb3c-b23a-45b3-a25b-71f06e9b51ed => generated 0 bytes in 841 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:45.684764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b2e57e3-35d7-4396-a477-e46f50f0e526 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:45.685907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1b2e57e3-35d7-4396-a477-e46f50f0e526 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:45.693313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b2e57e3-35d7-4396-a477-e46f50f0e526 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.694034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b2e57e3-35d7-4396-a477-e46f50f0e526 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.694964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b2e57e3-35d7-4396-a477-e46f50f0e526 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.696223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b2e57e3-35d7-4396-a477-e46f50f0e526 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.745601 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8e20013c-a76f-4029-89bc-a270a0f1e856 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action" status: 202 len: 0 microversion: 2.1 time: 0.281976 Jul 14 14:38:45.751121 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1427/2839] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:38:45 2022] POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:38:45.756167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-83d02c11-87b8-418c-9b98-18fcfb207c44 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c596cca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.109984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1b2e57e3-35d7-4396-a477-e46f50f0e526 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:46.125882 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1b2e57e3-35d7-4396-a477-e46f50f0e526 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1324 microversion: 2.1 time: 0.448505 Jul 14 14:38:46.136066 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1413/2840] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:45 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1324 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:46.136066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-122daff4-6e07-40eb-aff2-cadf8485db32 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.136066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-122daff4-6e07-40eb-aff2-cadf8485db32 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:46.152062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-122daff4-6e07-40eb-aff2-cadf8485db32 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.152533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-122daff4-6e07-40eb-aff2-cadf8485db32 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.153505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-122daff4-6e07-40eb-aff2-cadf8485db32 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.153946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-122daff4-6e07-40eb-aff2-cadf8485db32 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.227904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-122daff4-6e07-40eb-aff2-cadf8485db32 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.233223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-122daff4-6e07-40eb-aff2-cadf8485db32 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.234054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-122daff4-6e07-40eb-aff2-cadf8485db32 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lazy-loading 'fault' on Instance uuid 13ebe371-1ebb-4849-a18f-4b3e40035dfb {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:46.488772 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-122daff4-6e07-40eb-aff2-cadf8485db32 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1596 microversion: 2.1 time: 0.359375 Jul 14 14:38:46.489398 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1414/2841] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:46 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1596 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:46.505053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9a40774-4c2e-48d5-b389-8d04d5cfd937 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.506284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b9a40774-4c2e-48d5-b389-8d04d5cfd937 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:46.513267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9a40774-4c2e-48d5-b389-8d04d5cfd937 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.514075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9a40774-4c2e-48d5-b389-8d04d5cfd937 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.514873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9a40774-4c2e-48d5-b389-8d04d5cfd937 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.515470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9a40774-4c2e-48d5-b389-8d04d5cfd937 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.534600 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-b9a40774-4c2e-48d5-b389-8d04d5cfd937 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] HTTP exception thrown: Instance 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 could not be found. Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9a40774-4c2e-48d5-b389-8d04d5cfd937 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Request method failure captured: Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 HTTP/1.1 Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CoWxDNoyY1ZdWfrKjDifNz15uBFTGUSg_e2-cehcheyFGFVYiR9ztbY7c5OEivql4KUxUu5atPyUlGVLSRnFyAjuys96_-sCO3ivvi0z02Q4yNwQ2WQw_et73_OzZEbC4N-pJd6GmiMyX0UwOxMW90Ch3Va5Bv9V5dUjCD24xuT3SA Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 2e9036125df9487d9f5cf8afe8f13907 Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ListServerFiltersTestJSON-328544149 Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2e9036125df9487d9f5cf8afe8f13907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2e9036125df9487d9f5cf8afe8f13907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2e9036125df9487d9f5cf8afe8f13907", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2e9036125df9487d9f5cf8afe8f13907"}]}] Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ListServerFiltersTestJSON-328544149 Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 2e9036125df9487d9f5cf8afe8f13907 Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-328544149 Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ListServerFiltersTestJSON-328544149-project Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e1ce229470845ddac37073e2b42373e Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ListServerFiltersTestJSON-328544149-project Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 could not be found. Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '7052fe14-7fcb-4fb5-a013-966c9b7ee3a6'} Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 could not be found. Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 could not be found. Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:46.550476 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:38:46.555343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:46.555343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:46.555343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:46.555343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:46.555343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:46.555343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 could not be found. Jul 14 14:38:46.555343 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:38:46.555343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9a40774-4c2e-48d5-b389-8d04d5cfd937 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Returning 404 to user: Instance 7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:46.555343 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b9a40774-4c2e-48d5-b389-8d04d5cfd937 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6" status: 404 len: 111 microversion: 2.1 time: 0.061719 Jul 14 14:38:46.555343 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1415/2842] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:46 2022] GET /compute/v2.1/servers/7052fe14-7fcb-4fb5-a013-966c9b7ee3a6 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:46.560784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-192a629a-6918-4cc1-a917-4b58c3d960d4 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:46.562115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-192a629a-6918-4cc1-a917-4b58c3d960d4 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:46.571014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-192a629a-6918-4cc1-a917-4b58c3d960d4 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.573524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-192a629a-6918-4cc1-a917-4b58c3d960d4 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.574578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-192a629a-6918-4cc1-a917-4b58c3d960d4 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.576505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-192a629a-6918-4cc1-a917-4b58c3d960d4 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.597147 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-83d02c11-87b8-418c-9b98-18fcfb207c44 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "DELETE /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1" status: 204 len: 0 microversion: 2.1 time: 0.844690 Jul 14 14:38:46.597965 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1428/2843] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:45 2022] DELETE /compute/v2.1/images/542362b0-ee16-44cf-bc57-5138953e3fe1 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:46.605327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f85ad48-b0eb-44b4-902d-9e44616ad3df tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.605844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1f85ad48-b0eb-44b4-902d-9e44616ad3df tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:46.624087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f85ad48-b0eb-44b4-902d-9e44616ad3df tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.624554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f85ad48-b0eb-44b4-902d-9e44616ad3df tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.625384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f85ad48-b0eb-44b4-902d-9e44616ad3df tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.625838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f85ad48-b0eb-44b4-902d-9e44616ad3df tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.682915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1f85ad48-b0eb-44b4-902d-9e44616ad3df tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:38:46.704460 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-192a629a-6918-4cc1-a917-4b58c3d960d4 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action" status: 202 len: 0 microversion: 2.1 time: 0.150721 Jul 14 14:38:46.707389 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1416/2844] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:38:46 2022] POST /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:38:46.719336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-80f88365-e904-416a-ba67-8a3609ceb8e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.721391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-80f88365-e904-416a-ba67-8a3609ceb8e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:46.731404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80f88365-e904-416a-ba67-8a3609ceb8e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.732089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80f88365-e904-416a-ba67-8a3609ceb8e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.732901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80f88365-e904-416a-ba67-8a3609ceb8e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.733461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80f88365-e904-416a-ba67-8a3609ceb8e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.780913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-80f88365-e904-416a-ba67-8a3609ceb8e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:38:46.809087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:46.866596 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f85ad48-b0eb-44b4-902d-9e44616ad3df tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "DELETE /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e" status: 204 len: 0 microversion: 2.1 time: 0.266873 Jul 14 14:38:46.869303 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1429/2845] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:38:46 2022] DELETE /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:46.881124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7f4a5f85-2c9f-45ba-a996-a488999dcf23 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.881957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7f4a5f85-2c9f-45ba-a996-a488999dcf23 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:46.901109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f4a5f85-2c9f-45ba-a996-a488999dcf23 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.902978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f4a5f85-2c9f-45ba-a996-a488999dcf23 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.906214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f4a5f85-2c9f-45ba-a996-a488999dcf23 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.919326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f4a5f85-2c9f-45ba-a996-a488999dcf23 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.973240 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-80f88365-e904-416a-ba67-8a3609ceb8e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "DELETE /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 204 len: 0 microversion: 2.1 time: 0.262661 Jul 14 14:38:46.975162 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1417/2846] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:38:46 2022] DELETE /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:46.990924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24df799c-2676-4250-9902-5f06c34648be tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.993789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-24df799c-2676-4250-9902-5f06c34648be tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:47.010034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24df799c-2676-4250-9902-5f06c34648be tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.013974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24df799c-2676-4250-9902-5f06c34648be tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.015004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24df799c-2676-4250-9902-5f06c34648be tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.015643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24df799c-2676-4250-9902-5f06c34648be tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.243750 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7f4a5f85-2c9f-45ba-a996-a488999dcf23 tempest-ServersAdminTestJSON-407087336 tempest-ServersAdminTestJSON-407087336-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1613 microversion: 2.1 time: 0.369171 Jul 14 14:38:47.247694 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1430/2847] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:46 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1613 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:47.255344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4a1d438a-6611-4515-afc3-26e71ee35260 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:47.262992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4a1d438a-6611-4515-afc3-26e71ee35260 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:47.275369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4a1d438a-6611-4515-afc3-26e71ee35260 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.276117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4a1d438a-6611-4515-afc3-26e71ee35260 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.277178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4a1d438a-6611-4515-afc3-26e71ee35260 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.282975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4a1d438a-6611-4515-afc3-26e71ee35260 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.307957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-24df799c-2676-4250-9902-5f06c34648be tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:47.316141 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-24df799c-2676-4250-9902-5f06c34648be tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e" status: 200 len: 1518 microversion: 2.1 time: 0.339344 Jul 14 14:38:47.320829 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1418/2848] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:46 2022] GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e => generated 1518 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:47.332148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc93dc47-6def-465e-a945-1a54bffb2ddf tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:47.332811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc93dc47-6def-465e-a945-1a54bffb2ddf tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:47.347009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc93dc47-6def-465e-a945-1a54bffb2ddf tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.347470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc93dc47-6def-465e-a945-1a54bffb2ddf tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.348258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc93dc47-6def-465e-a945-1a54bffb2ddf tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.351717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc93dc47-6def-465e-a945-1a54bffb2ddf tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.593774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:47.662835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4a1d438a-6611-4515-afc3-26e71ee35260 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:47.679861 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4a1d438a-6611-4515-afc3-26e71ee35260 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1473 microversion: 2.1 time: 0.430727 Jul 14 14:38:47.683893 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1431/2849] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:47 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1473 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:47.694745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f563dcc-fd81-49e0-9a31-8d79dc19f9fa tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:47.698045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1f563dcc-fd81-49e0-9a31-8d79dc19f9fa tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:47.712898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f563dcc-fd81-49e0-9a31-8d79dc19f9fa tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.713905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f563dcc-fd81-49e0-9a31-8d79dc19f9fa tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.715364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f563dcc-fd81-49e0-9a31-8d79dc19f9fa tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.716046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f563dcc-fd81-49e0-9a31-8d79dc19f9fa tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.775202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1f563dcc-fd81-49e0-9a31-8d79dc19f9fa tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:38:47.779488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc93dc47-6def-465e-a945-1a54bffb2ddf tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:47.793047 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc93dc47-6def-465e-a945-1a54bffb2ddf tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1324 microversion: 2.1 time: 0.470365 Jul 14 14:38:47.795651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:47.796183 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1419/2850] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:47 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1324 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:47.941973 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f563dcc-fd81-49e0-9a31-8d79dc19f9fa tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 204 len: 0 microversion: 2.1 time: 0.256400 Jul 14 14:38:47.943789 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1432/2851] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:38:47 2022] DELETE /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:47.952066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-60f483e4-4988-4281-91fd-c173925b186c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:47.952691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-60f483e4-4988-4281-91fd-c173925b186c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:47.973694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60f483e4-4988-4281-91fd-c173925b186c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.974154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60f483e4-4988-4281-91fd-c173925b186c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.981241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60f483e4-4988-4281-91fd-c173925b186c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.981939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60f483e4-4988-4281-91fd-c173925b186c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.270560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-60f483e4-4988-4281-91fd-c173925b186c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:48.285252 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-60f483e4-4988-4281-91fd-c173925b186c tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1469 microversion: 2.1 time: 0.336795 Jul 14 14:38:48.286053 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1420/2852] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:47 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1469 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:48.340641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8aadb751-e183-4031-98a5-cf56b3280c41 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:48.341841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8aadb751-e183-4031-98a5-cf56b3280c41 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:48.356611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8aadb751-e183-4031-98a5-cf56b3280c41 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.356990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8aadb751-e183-4031-98a5-cf56b3280c41 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.358964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8aadb751-e183-4031-98a5-cf56b3280c41 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.359789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8aadb751-e183-4031-98a5-cf56b3280c41 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.560513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8aadb751-e183-4031-98a5-cf56b3280c41 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:48.571607 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8aadb751-e183-4031-98a5-cf56b3280c41 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e" status: 200 len: 1518 microversion: 2.1 time: 0.235677 Jul 14 14:38:48.572599 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1433/2853] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:48 2022] GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e => generated 1518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:48.699902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dd54b7e6-0688-450c-b73b-67193f3575e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:48.700570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dd54b7e6-0688-450c-b73b-67193f3575e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:48.724926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd54b7e6-0688-450c-b73b-67193f3575e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.725447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd54b7e6-0688-450c-b73b-67193f3575e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.726190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd54b7e6-0688-450c-b73b-67193f3575e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.726685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd54b7e6-0688-450c-b73b-67193f3575e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.786496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=12 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:48.812022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f0859539-f0d7-4dd8-9a01-37f9ab616ec5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:48.812681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f0859539-f0d7-4dd8-9a01-37f9ab616ec5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:48.822668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0859539-f0d7-4dd8-9a01-37f9ab616ec5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.823136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0859539-f0d7-4dd8-9a01-37f9ab616ec5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.829188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0859539-f0d7-4dd8-9a01-37f9ab616ec5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.829942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0859539-f0d7-4dd8-9a01-37f9ab616ec5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:49.062201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dd54b7e6-0688-450c-b73b-67193f3575e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:49.080786 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dd54b7e6-0688-450c-b73b-67193f3575e6 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1473 microversion: 2.1 time: 0.386151 Jul 14 14:38:49.080786 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1421/2854] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:48 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1473 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:49.303039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4fccf589-35df-437d-ba42-ebbd3d8f2c99 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:49.303645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4fccf589-35df-437d-ba42-ebbd3d8f2c99 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:49.314343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fccf589-35df-437d-ba42-ebbd3d8f2c99 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:49.316308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fccf589-35df-437d-ba42-ebbd3d8f2c99 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:49.318880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fccf589-35df-437d-ba42-ebbd3d8f2c99 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:49.321945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fccf589-35df-437d-ba42-ebbd3d8f2c99 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:49.957595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f0859539-f0d7-4dd8-9a01-37f9ab616ec5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:49.969530 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f0859539-f0d7-4dd8-9a01-37f9ab616ec5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1324 microversion: 2.1 time: 1.160647 Jul 14 14:38:49.983673 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1434/2855] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:48 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1324 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:49.997337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ddaac9cb-b824-4513-99f2-3612846f83a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:50.000501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ddaac9cb-b824-4513-99f2-3612846f83a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:50.037341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddaac9cb-b824-4513-99f2-3612846f83a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:50.037341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddaac9cb-b824-4513-99f2-3612846f83a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:50.040278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddaac9cb-b824-4513-99f2-3612846f83a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:50.040739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddaac9cb-b824-4513-99f2-3612846f83a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:51.054007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4fccf589-35df-437d-ba42-ebbd3d8f2c99 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:51.068696 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4fccf589-35df-437d-ba42-ebbd3d8f2c99 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1469 microversion: 2.1 time: 1.769322 Jul 14 14:38:51.069316 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1422/2856] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:49 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1469 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:51.088588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f279bf7-0499-4fac-853c-74a8f14f83d4 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:51.090687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f279bf7-0499-4fac-853c-74a8f14f83d4 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:51.108028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f279bf7-0499-4fac-853c-74a8f14f83d4 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.108851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f279bf7-0499-4fac-853c-74a8f14f83d4 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:51.110837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f279bf7-0499-4fac-853c-74a8f14f83d4 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.111545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f279bf7-0499-4fac-853c-74a8f14f83d4 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:51.541974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ddaac9cb-b824-4513-99f2-3612846f83a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:51.556690 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ddaac9cb-b824-4513-99f2-3612846f83a2 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e" status: 200 len: 1518 microversion: 2.1 time: 1.571556 Jul 14 14:38:51.561289 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1435/2857] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:49 2022] GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e => generated 1518 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:51.574937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e92e3a2b-6564-4de1-9abf-1a0410157c60 req-595f283a-7ea7-47c7-b2c6-a7bb2eeb8201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490672e6-6394-4a5a-9ab0-bd3a44e0cb8e", "name": "network-vif-deleted", "tag": "cf70c5d2-de48-406d-baf0-3edb54e1f22d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:51.596041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e92e3a2b-6564-4de1-9abf-1a0410157c60 req-595f283a-7ea7-47c7-b2c6-a7bb2eeb8201 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.602167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e92e3a2b-6564-4de1-9abf-1a0410157c60 req-595f283a-7ea7-47c7-b2c6-a7bb2eeb8201 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:51.638232 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e92e3a2b-6564-4de1-9abf-1a0410157c60 req-595f283a-7ea7-47c7-b2c6-a7bb2eeb8201 service nova] Creating event network-vif-deleted:cf70c5d2-de48-406d-baf0-3edb54e1f22d for instance 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e on n-h1-767704-28 Jul 14 14:38:51.648500 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e92e3a2b-6564-4de1-9abf-1a0410157c60 req-595f283a-7ea7-47c7-b2c6-a7bb2eeb8201 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080711 Jul 14 14:38:51.649282 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1436/2858] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:51.654688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b610c76d-c0b4-4375-9c28-3b844c8f643d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:51.655348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b610c76d-c0b4-4375-9c28-3b844c8f643d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:51.683056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b610c76d-c0b4-4375-9c28-3b844c8f643d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.683512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b610c76d-c0b4-4375-9c28-3b844c8f643d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:51.684315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b610c76d-c0b4-4375-9c28-3b844c8f643d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.684764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b610c76d-c0b4-4375-9c28-3b844c8f643d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.166283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f279bf7-0499-4fac-853c-74a8f14f83d4 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:52.197080 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f279bf7-0499-4fac-853c-74a8f14f83d4 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1473 microversion: 2.1 time: 1.116252 Jul 14 14:38:52.198256 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1423/2859] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:51 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1473 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:52.204872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ee04b10c-2810-4b95-be81-d385281cabf7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:52.205923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ee04b10c-2810-4b95-be81-d385281cabf7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:52.225647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee04b10c-2810-4b95-be81-d385281cabf7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:52.226258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee04b10c-2810-4b95-be81-d385281cabf7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.227771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee04b10c-2810-4b95-be81-d385281cabf7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:52.228286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee04b10c-2810-4b95-be81-d385281cabf7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.271330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b610c76d-c0b4-4375-9c28-3b844c8f643d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:52.292371 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b610c76d-c0b4-4375-9c28-3b844c8f643d tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1520 microversion: 2.1 time: 0.630675 Jul 14 14:38:52.295336 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1437/2860] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:51 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1520 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:52.325080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-90bf7c0d-7871-4642-86c9-3a66807c0832 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:52.325701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-90bf7c0d-7871-4642-86c9-3a66807c0832 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:52.343310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90bf7c0d-7871-4642-86c9-3a66807c0832 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:52.343780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90bf7c0d-7871-4642-86c9-3a66807c0832 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.344583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90bf7c0d-7871-4642-86c9-3a66807c0832 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:52.345060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90bf7c0d-7871-4642-86c9-3a66807c0832 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.412751 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-90bf7c0d-7871-4642-86c9-3a66807c0832 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] HTTP exception thrown: Action 999 not found Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-90bf7c0d-7871-4642-86c9-3a66807c0832 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Request method failure captured: Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5/os-instance-actions/999 HTTP/1.1 Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cpgxs3ZasxzT0TzC-x7FcmfRjgJgzvcWwvo_6QtVmHEgYn9OztfKyqZAFbljTEBmApjCi7CsoIlh6nMeVJotBo2h7gS_h0BxoD-QuKeohQtVJUrpUBGVIw1ZXcTisCMDO16cVnSoWrfLF3rOu_tfGcBO4pWvQ4KeXrH_dkLStAsfr8 Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 67736b0882a44cd480f487d0e69c7a01 Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1501280044 Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67736b0882a44cd480f487d0e69c7a01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/67736b0882a44cd480f487d0e69c7a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_67736b0882a44cd480f487d0e69c7a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67736b0882a44cd480f487d0e69c7a01"}]}] Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1501280044 Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 67736b0882a44cd480f487d0e69c7a01 Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1501280044 Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-InstanceActionsNegativeTestJSON-1501280044-project Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: fd153868f91d4fd4bf380747185b2c1f Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1501280044-project Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: exception: Action 999 not found Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'server_id': '0c0e1171-566a-413f-969d-08d20f2b74c5', 'id': '999'} Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 14 14:38:52.428340 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.434254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-90bf7c0d-7871-4642-86c9-3a66807c0832 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Returning 404 to user: Action 999 not found {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:52.438033 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-90bf7c0d-7871-4642-86c9-3a66807c0832 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.118326 Jul 14 14:38:52.438661 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1438/2861] 10.222.0.81 () {58 vars in 1307 bytes} [Thu Jul 14 14:38:52 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5/os-instance-actions/999 => generated 66 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:38:52.449131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-87990c00-d284-4b58-95a3-e5fcecb4c9d9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '.version_select at 0x7fd6c5b3cd30>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:52.449701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-87990c00-d284-4b58-95a3-e5fcecb4c9d9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 557a5f18-82b2-4c50-8566-63155f2b6b2e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:52.468246 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-87990c00-d284-4b58-95a3-e5fcecb4c9d9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] HTTP exception thrown: Instance 557a5f18-82b2-4c50-8566-63155f2b6b2e could not be found. Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-87990c00-d284-4b58-95a3-e5fcecb4c9d9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Request method failure captured: Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/557a5f18-82b2-4c50-8566-63155f2b6b2e/os-instance-actions HTTP/1.1 Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cpgxs3ZasxzT0TzC-x7FcmfRjgJgzvcWwvo_6QtVmHEgYn9OztfKyqZAFbljTEBmApjCi7CsoIlh6nMeVJotBo2h7gS_h0BxoD-QuKeohQtVJUrpUBGVIw1ZXcTisCMDO16cVnSoWrfLF3rOu_tfGcBO4pWvQ4KeXrH_dkLStAsfr8 Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 67736b0882a44cd480f487d0e69c7a01 Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1501280044 Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67736b0882a44cd480f487d0e69c7a01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/67736b0882a44cd480f487d0e69c7a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_67736b0882a44cd480f487d0e69c7a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67736b0882a44cd480f487d0e69c7a01"}]}] Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1501280044 Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 67736b0882a44cd480f487d0e69c7a01 Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1501280044 Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-InstanceActionsNegativeTestJSON-1501280044-project Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: fd153868f91d4fd4bf380747185b2c1f Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1501280044-project Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 557a5f18-82b2-4c50-8566-63155f2b6b2e could not be found. Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'server_id': '557a5f18-82b2-4c50-8566-63155f2b6b2e'} Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557a5f18-82b2-4c50-8566-63155f2b6b2e could not be found. Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:38:52.469873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557a5f18-82b2-4c50-8566-63155f2b6b2e could not be found. Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557a5f18-82b2-4c50-8566-63155f2b6b2e could not be found. Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-87990c00-d284-4b58-95a3-e5fcecb4c9d9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Returning 404 to user: Instance 557a5f18-82b2-4c50-8566-63155f2b6b2e could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:52.475850 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-87990c00-d284-4b58-95a3-e5fcecb4c9d9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/557a5f18-82b2-4c50-8566-63155f2b6b2e/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.026344 Jul 14 14:38:52.488295 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1439/2862] 10.222.0.81 () {58 vars in 1295 bytes} [Thu Jul 14 14:38:52 2022] GET /compute/v2.1/servers/557a5f18-82b2-4c50-8566-63155f2b6b2e/os-instance-actions => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:52.495023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4854e525-f5f2-4f0a-a637-a7fd8a2f83b9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:52.495586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4854e525-f5f2-4f0a-a637-a7fd8a2f83b9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:52.514331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4854e525-f5f2-4f0a-a637-a7fd8a2f83b9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:52.514790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4854e525-f5f2-4f0a-a637-a7fd8a2f83b9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.515665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4854e525-f5f2-4f0a-a637-a7fd8a2f83b9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:52.516031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4854e525-f5f2-4f0a-a637-a7fd8a2f83b9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.567111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4854e525-f5f2-4f0a-a637-a7fd8a2f83b9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:38:52.742269 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4854e525-f5f2-4f0a-a637-a7fd8a2f83b9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 204 len: 0 microversion: 2.1 time: 0.248738 Jul 14 14:38:52.750203 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1440/2863] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:38:52 2022] DELETE /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:52.772043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c6885b65-5d2d-4ab4-93b8-72c76046a1c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:52.772899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c6885b65-5d2d-4ab4-93b8-72c76046a1c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:52.777824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:52.788656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6885b65-5d2d-4ab4-93b8-72c76046a1c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:52.790660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6885b65-5d2d-4ab4-93b8-72c76046a1c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.791702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6885b65-5d2d-4ab4-93b8-72c76046a1c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:52.798818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6885b65-5d2d-4ab4-93b8-72c76046a1c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.842432 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c6885b65-5d2d-4ab4-93b8-72c76046a1c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] HTTP exception thrown: Instance 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e could not be found. Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c6885b65-5d2d-4ab4-93b8-72c76046a1c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Request method failure captured: Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e HTTP/1.1 Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CoWxDNoyY1ZdWfrKjDifNz15uBFTGUSg_e2-cehcheyFGFVYiR9ztbY7c5OEivql4KUxUu5atPyUlGVLSRnFyAjuys96_-sCO3ivvi0z02Q4yNwQ2WQw_et73_OzZEbC4N-pJd6GmiMyX0UwOxMW90Ch3Va5Bv9V5dUjCD24xuT3SA Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 2e9036125df9487d9f5cf8afe8f13907 Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ListServerFiltersTestJSON-328544149 Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2e9036125df9487d9f5cf8afe8f13907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2e9036125df9487d9f5cf8afe8f13907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2e9036125df9487d9f5cf8afe8f13907", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2e9036125df9487d9f5cf8afe8f13907"}]}] Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ListServerFiltersTestJSON-328544149 Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 2e9036125df9487d9f5cf8afe8f13907 Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-328544149 Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ListServerFiltersTestJSON-328544149-project Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4e1ce229470845ddac37073e2b42373e Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ListServerFiltersTestJSON-328544149-project Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e could not be found. Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '490672e6-6394-4a5a-9ab0-bd3a44e0cb8e'} Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e could not be found. Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e could not be found. Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:52.858968 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.864449 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:52.864449 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:52.864449 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:52.864449 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:52.864449 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:52.864449 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e could not be found. Jul 14 14:38:52.864449 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:52.868654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c6885b65-5d2d-4ab4-93b8-72c76046a1c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Returning 404 to user: Instance 490672e6-6394-4a5a-9ab0-bd3a44e0cb8e could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:52.870310 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c6885b65-5d2d-4ab4-93b8-72c76046a1c3 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e" status: 404 len: 111 microversion: 2.1 time: 0.117181 Jul 14 14:38:52.871464 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1441/2864] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:52 2022] GET /compute/v2.1/servers/490672e6-6394-4a5a-9ab0-bd3a44e0cb8e => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:52.885687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e2cb7555-f1b0-4b45-a038-9b78fb3b35d5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:52.887120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e2cb7555-f1b0-4b45-a038-9b78fb3b35d5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:52.911551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2cb7555-f1b0-4b45-a038-9b78fb3b35d5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:52.912538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2cb7555-f1b0-4b45-a038-9b78fb3b35d5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.913530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2cb7555-f1b0-4b45-a038-9b78fb3b35d5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:52.925870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2cb7555-f1b0-4b45-a038-9b78fb3b35d5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:53.485556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ee04b10c-2810-4b95-be81-d385281cabf7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:53.494610 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ee04b10c-2810-4b95-be81-d385281cabf7 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 200 len: 1469 microversion: 2.1 time: 1.294739 Jul 14 14:38:53.501517 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1424/2865] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:52 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 1469 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:53.507361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5149fd59-fbbf-4102-a0ed-78930284ad3a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:53.510634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5149fd59-fbbf-4102-a0ed-78930284ad3a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:53.528107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5149fd59-fbbf-4102-a0ed-78930284ad3a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:53.528746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5149fd59-fbbf-4102-a0ed-78930284ad3a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:53.529725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5149fd59-fbbf-4102-a0ed-78930284ad3a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:53.531016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5149fd59-fbbf-4102-a0ed-78930284ad3a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:53.613291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5149fd59-fbbf-4102-a0ed-78930284ad3a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:38:53.779160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e2cb7555-f1b0-4b45-a038-9b78fb3b35d5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:53.806978 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e2cb7555-f1b0-4b45-a038-9b78fb3b35d5 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1526 microversion: 2.1 time: 0.933867 Jul 14 14:38:53.808387 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1442/2866] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:52 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1526 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:53.817608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ccb14560-e60e-4850-9703-8abf47e88a85 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:53.818834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ccb14560-e60e-4850-9703-8abf47e88a85 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:53.832352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ccb14560-e60e-4850-9703-8abf47e88a85 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:53.835319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ccb14560-e60e-4850-9703-8abf47e88a85 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:53.840744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ccb14560-e60e-4850-9703-8abf47e88a85 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:53.841876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ccb14560-e60e-4850-9703-8abf47e88a85 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:53.854457 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5149fd59-fbbf-4102-a0ed-78930284ad3a tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "DELETE /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 204 len: 0 microversion: 2.1 time: 0.351018 Jul 14 14:38:53.866275 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1425/2867] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:38:53 2022] DELETE /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:53.887083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f23b6e68-c8e6-4b34-b21e-eb4029d38c0a req-596ba9a1-d727-4310-a234-09121adb2771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421b3e7a-56b8-4241-a496-2a091a9686f3", "name": "network-vif-deleted", "tag": "40cb08bf-70f2-461c-9c75-c450c62e8c00"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:53.910841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f23b6e68-c8e6-4b34-b21e-eb4029d38c0a req-596ba9a1-d727-4310-a234-09121adb2771 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:53.913578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f23b6e68-c8e6-4b34-b21e-eb4029d38c0a req-596ba9a1-d727-4310-a234-09121adb2771 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:53.958966 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f23b6e68-c8e6-4b34-b21e-eb4029d38c0a req-596ba9a1-d727-4310-a234-09121adb2771 service nova] Creating event network-vif-deleted:40cb08bf-70f2-461c-9c75-c450c62e8c00 for instance 421b3e7a-56b8-4241-a496-2a091a9686f3 on n-h2-767704-28 Jul 14 14:38:53.976332 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f23b6e68-c8e6-4b34-b21e-eb4029d38c0a req-596ba9a1-d727-4310-a234-09121adb2771 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107248 Jul 14 14:38:53.977997 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1426/2868] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:53.978159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ccb14560-e60e-4850-9703-8abf47e88a85 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:53.985548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cb0e588e-fa53-4a65-bb00-00228374f668 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:53.987596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cb0e588e-fa53-4a65-bb00-00228374f668 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:53.990669 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ccb14560-e60e-4850-9703-8abf47e88a85 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1431 microversion: 2.1 time: 0.179220 Jul 14 14:38:54.011524 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1443/2869] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:53 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1431 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:54.034063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb0e588e-fa53-4a65-bb00-00228374f668 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:54.037868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb0e588e-fa53-4a65-bb00-00228374f668 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:54.040173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb0e588e-fa53-4a65-bb00-00228374f668 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:54.041614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb0e588e-fa53-4a65-bb00-00228374f668 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:54.516284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c959b606-c94b-4b6c-9fea-9e50611b4441 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:54.517224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c959b606-c94b-4b6c-9fea-9e50611b4441 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d42b1bbb-db42-4319-8676-09a2ab7931a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:54.530127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c959b606-c94b-4b6c-9fea-9e50611b4441 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:54.530902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c959b606-c94b-4b6c-9fea-9e50611b4441 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:54.532104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c959b606-c94b-4b6c-9fea-9e50611b4441 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:54.532698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c959b606-c94b-4b6c-9fea-9e50611b4441 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:54.544083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cb0e588e-fa53-4a65-bb00-00228374f668 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:54.559697 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cb0e588e-fa53-4a65-bb00-00228374f668 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1518 microversion: 2.1 time: 0.579992 Jul 14 14:38:54.562598 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1427/2870] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:53 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1518 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:54.582669 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c959b606-c94b-4b6c-9fea-9e50611b4441 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] HTTP exception thrown: Instance d42b1bbb-db42-4319-8676-09a2ab7931a4 could not be found. Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c959b606-c94b-4b6c-9fea-9e50611b4441 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Request method failure captured: Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 HTTP/1.1 Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnbEi7ngBALLh_6FCsgvYxbTlj2Yuo9NLmSnhIZuY42UP0datdc-OHxNVP9a3fnVvwTZm4-EGPikl9kpAKWcqMuQHbWI3MeIIp_y-3oxLksV67XkntcymFHqC4JmNOm0qGcCeFJAtDnxnIXasYRtV64w3pqZ0reVyAmS06K3lV3pTs Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 8a0c595b04c74827b3c00228b9a57c27 Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersAdminTestJSON-1626976122 Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8a0c595b04c74827b3c00228b9a57c27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8a0c595b04c74827b3c00228b9a57c27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8a0c595b04c74827b3c00228b9a57c27", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8a0c595b04c74827b3c00228b9a57c27"}]}] Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersAdminTestJSON-1626976122 Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 8a0c595b04c74827b3c00228b9a57c27 Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersAdminTestJSON-1626976122 Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersAdminTestJSON-1626976122-project Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 89d755b092134384b11c41c5f63fcae4 Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersAdminTestJSON-1626976122-project Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance d42b1bbb-db42-4319-8676-09a2ab7931a4 could not be found. Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'd42b1bbb-db42-4319-8676-09a2ab7931a4'} Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d42b1bbb-db42-4319-8676-09a2ab7931a4 could not be found. Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d42b1bbb-db42-4319-8676-09a2ab7931a4 could not be found. Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:54.585873 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:54.591620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:54.591620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:54.591620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:54.591620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:54.591620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:54.591620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d42b1bbb-db42-4319-8676-09a2ab7931a4 could not be found. Jul 14 14:38:54.591620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:54.592498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c959b606-c94b-4b6c-9fea-9e50611b4441 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Returning 404 to user: Instance d42b1bbb-db42-4319-8676-09a2ab7931a4 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:54.593484 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c959b606-c94b-4b6c-9fea-9e50611b4441 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4" status: 404 len: 111 microversion: 2.1 time: 0.085840 Jul 14 14:38:54.594560 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1444/2871] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:54 2022] GET /compute/v2.1/servers/d42b1bbb-db42-4319-8676-09a2ab7931a4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:54.606259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-747ab7eb-9688-4bc0-9955-90398131f44f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:54.607011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-747ab7eb-9688-4bc0-9955-90398131f44f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:54.624136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-747ab7eb-9688-4bc0-9955-90398131f44f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:54.624799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-747ab7eb-9688-4bc0-9955-90398131f44f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:54.630738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-747ab7eb-9688-4bc0-9955-90398131f44f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:54.634900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-747ab7eb-9688-4bc0-9955-90398131f44f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:54.722109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-747ab7eb-9688-4bc0-9955-90398131f44f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:38:54.826613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-27ad11fb-aacf-4d1f-932e-dadbda26a87e tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:54.827587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-27ad11fb-aacf-4d1f-932e-dadbda26a87e tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:54.851277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27ad11fb-aacf-4d1f-932e-dadbda26a87e tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:54.853164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27ad11fb-aacf-4d1f-932e-dadbda26a87e tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:54.854460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27ad11fb-aacf-4d1f-932e-dadbda26a87e tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:54.856237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27ad11fb-aacf-4d1f-932e-dadbda26a87e tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:54.948177 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-747ab7eb-9688-4bc0-9955-90398131f44f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 204 len: 0 microversion: 2.1 time: 0.335202 Jul 14 14:38:54.953672 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1428/2872] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:38:54 2022] DELETE /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:54.969048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f9f9e80a-03ea-4871-9880-60b209400fe6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:54.970185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f9f9e80a-03ea-4871-9880-60b209400fe6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:54.994463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f9f9e80a-03ea-4871-9880-60b209400fe6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:54.995508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f9f9e80a-03ea-4871-9880-60b209400fe6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:54.996306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f9f9e80a-03ea-4871-9880-60b209400fe6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:54.996988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f9f9e80a-03ea-4871-9880-60b209400fe6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:55.627571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-27ad11fb-aacf-4d1f-932e-dadbda26a87e tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:55.657937 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-27ad11fb-aacf-4d1f-932e-dadbda26a87e tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1526 microversion: 2.1 time: 0.835157 Jul 14 14:38:55.661285 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1445/2873] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:54 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1526 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:55.675240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-759fc97d-2025-4076-b95d-3dba582736ec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:55.676384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-759fc97d-2025-4076-b95d-3dba582736ec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:55.703389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-759fc97d-2025-4076-b95d-3dba582736ec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:55.704159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-759fc97d-2025-4076-b95d-3dba582736ec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:55.717155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-759fc97d-2025-4076-b95d-3dba582736ec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:55.718940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-759fc97d-2025-4076-b95d-3dba582736ec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:55.893370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f9f9e80a-03ea-4871-9880-60b209400fe6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:55.918267 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f9f9e80a-03ea-4871-9880-60b209400fe6 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1469 microversion: 2.1 time: 0.957758 Jul 14 14:38:55.918993 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1429/2874] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:54 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1469 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:55.926985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05f841e3-d249-4faa-b78c-c749ad5c5f7e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:55.927617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-05f841e3-d249-4faa-b78c-c749ad5c5f7e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:55.954029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05f841e3-d249-4faa-b78c-c749ad5c5f7e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:55.954220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-759fc97d-2025-4076-b95d-3dba582736ec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:55.954761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05f841e3-d249-4faa-b78c-c749ad5c5f7e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:55.955678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05f841e3-d249-4faa-b78c-c749ad5c5f7e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:55.956158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05f841e3-d249-4faa-b78c-c749ad5c5f7e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:55.965365 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-759fc97d-2025-4076-b95d-3dba582736ec tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1303 microversion: 2.1 time: 0.302158 Jul 14 14:38:55.966828 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1446/2875] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:55 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1303 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:55.991030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:56.137341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-4c056c8a-136b-4e68-9928-41b31e9aef9d req-3ae75fb0-dc73-45cb-a750-4bc885ee8094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42b1bbb-db42-4319-8676-09a2ab7931a4", "name": "network-vif-deleted", "tag": "82fed217-982e-4197-ac83-35630f9e27e5"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:56.157958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4c056c8a-136b-4e68-9928-41b31e9aef9d req-3ae75fb0-dc73-45cb-a750-4bc885ee8094 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.159149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4c056c8a-136b-4e68-9928-41b31e9aef9d req-3ae75fb0-dc73-45cb-a750-4bc885ee8094 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:56.181976 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-4c056c8a-136b-4e68-9928-41b31e9aef9d req-3ae75fb0-dc73-45cb-a750-4bc885ee8094 service nova] Creating event network-vif-deleted:82fed217-982e-4197-ac83-35630f9e27e5 for instance d42b1bbb-db42-4319-8676-09a2ab7931a4 on n-h1-767704-28 Jul 14 14:38:56.188892 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-4c056c8a-136b-4e68-9928-41b31e9aef9d req-3ae75fb0-dc73-45cb-a750-4bc885ee8094 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055332 Jul 14 14:38:56.189865 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1447/2876] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:38:56.324286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-05f841e3-d249-4faa-b78c-c749ad5c5f7e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:56.338253 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-05f841e3-d249-4faa-b78c-c749ad5c5f7e tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1518 microversion: 2.1 time: 0.418048 Jul 14 14:38:56.338851 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1430/2877] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:55 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1518 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:56.682107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9aac0d5-18b0-45cd-bc49-ffa7e592b6e9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:56.683542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c9aac0d5-18b0-45cd-bc49-ffa7e592b6e9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:56.699331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9aac0d5-18b0-45cd-bc49-ffa7e592b6e9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.703370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9aac0d5-18b0-45cd-bc49-ffa7e592b6e9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:56.708888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9aac0d5-18b0-45cd-bc49-ffa7e592b6e9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.709636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9aac0d5-18b0-45cd-bc49-ffa7e592b6e9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:56.936579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f18e3077-75ae-421a-af46-f1ecb53f29be tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:56.937250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f18e3077-75ae-421a-af46-f1ecb53f29be tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:56.958057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f18e3077-75ae-421a-af46-f1ecb53f29be tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.958581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f18e3077-75ae-421a-af46-f1ecb53f29be tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:56.959708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f18e3077-75ae-421a-af46-f1ecb53f29be tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.959878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f18e3077-75ae-421a-af46-f1ecb53f29be tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:57.086293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c9aac0d5-18b0-45cd-bc49-ffa7e592b6e9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:57.100121 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c9aac0d5-18b0-45cd-bc49-ffa7e592b6e9 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1526 microversion: 2.1 time: 0.424757 Jul 14 14:38:57.109513 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1448/2878] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:56 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1526 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:57.120539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4691b61-573c-427d-b9e1-b4e9325e914b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:57.127639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b4691b61-573c-427d-b9e1-b4e9325e914b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:57.136745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4691b61-573c-427d-b9e1-b4e9325e914b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:57.137231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4691b61-573c-427d-b9e1-b4e9325e914b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:57.138105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4691b61-573c-427d-b9e1-b4e9325e914b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:57.138457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4691b61-573c-427d-b9e1-b4e9325e914b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:57.746178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b4691b61-573c-427d-b9e1-b4e9325e914b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:57.755892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:57.782956 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b4691b61-573c-427d-b9e1-b4e9325e914b tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 200 len: 1303 microversion: 2.1 time: 0.680093 Jul 14 14:38:57.795019 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1449/2879] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:57 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 1303 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:57.809101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f76148fe-164d-4478-8aa6-8a2ef4bd04f4 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:57.809987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f76148fe-164d-4478-8aa6-8a2ef4bd04f4 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:57.832886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f76148fe-164d-4478-8aa6-8a2ef4bd04f4 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:57.833384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f76148fe-164d-4478-8aa6-8a2ef4bd04f4 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:57.837761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f76148fe-164d-4478-8aa6-8a2ef4bd04f4 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:57.841230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f76148fe-164d-4478-8aa6-8a2ef4bd04f4 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:58.282821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f18e3077-75ae-421a-af46-f1ecb53f29be tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:58.296679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f18e3077-75ae-421a-af46-f1ecb53f29be tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1469 microversion: 2.1 time: 1.363591 Jul 14 14:38:58.313783 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1431/2880] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:56 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1469 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:58.323126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0ea565c7-ab50-457a-a808-37582859efab tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:58.328905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0ea565c7-ab50-457a-a808-37582859efab tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:58.347771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ea565c7-ab50-457a-a808-37582859efab tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:58.354370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ea565c7-ab50-457a-a808-37582859efab tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:58.355966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ea565c7-ab50-457a-a808-37582859efab tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:58.356632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ea565c7-ab50-457a-a808-37582859efab tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:58.953468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f76148fe-164d-4478-8aa6-8a2ef4bd04f4 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1ce229470845ddac37073e2b42373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9036125df9487d9f5cf8afe8f13907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:58.979827 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f76148fe-164d-4478-8aa6-8a2ef4bd04f4 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 200 len: 1518 microversion: 2.1 time: 1.181600 Jul 14 14:38:59.023859 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1450/2881] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:57 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 1518 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:59.032627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-42bc4d3f-885c-4bce-a333-eb8da21be3b1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:59.061447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-42bc4d3f-885c-4bce-a333-eb8da21be3b1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 421b3e7a-56b8-4241-a496-2a091a9686f3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:59.077126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42bc4d3f-885c-4bce-a333-eb8da21be3b1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.080686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42bc4d3f-885c-4bce-a333-eb8da21be3b1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:59.082506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42bc4d3f-885c-4bce-a333-eb8da21be3b1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.082961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42bc4d3f-885c-4bce-a333-eb8da21be3b1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:59.168349 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-42bc4d3f-885c-4bce-a333-eb8da21be3b1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] HTTP exception thrown: Instance 421b3e7a-56b8-4241-a496-2a091a9686f3 could not be found. Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-42bc4d3f-885c-4bce-a333-eb8da21be3b1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Request method failure captured: Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 HTTP/1.1 Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CnVrPocP6HKoOUreqgns42Obq6ZjFJw3j18wzxLeknQh2QBq0Vlea--qrYukBESdryL-FLp2ql5K4FBNiLQ9-cLnhnHEFDxImPkAb23fr410nfhyvNAvg2Ay0onFnE4QAf6dSdqDF7nRApWRfBOU6Qa2CEbDJOE_nU8ocAJr0aCI_w Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: bd972941395b44d288fafe30e02af1d4 Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ListImageFiltersTestJSON-1479846462 Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bd972941395b44d288fafe30e02af1d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bd972941395b44d288fafe30e02af1d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bd972941395b44d288fafe30e02af1d4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bd972941395b44d288fafe30e02af1d4"}]}] Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ListImageFiltersTestJSON-1479846462 Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: bd972941395b44d288fafe30e02af1d4 Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1479846462 Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ListImageFiltersTestJSON-1479846462-project Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4798e509f5f74d93b6e50ad9d8d25436 Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ListImageFiltersTestJSON-1479846462-project Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 421b3e7a-56b8-4241-a496-2a091a9686f3 could not be found. Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '421b3e7a-56b8-4241-a496-2a091a9686f3'} Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 421b3e7a-56b8-4241-a496-2a091a9686f3 could not be found. Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 421b3e7a-56b8-4241-a496-2a091a9686f3 could not be found. Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:59.188396 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:59.196020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:59.196020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:59.196020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:59.196020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:59.196020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:59.196020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 421b3e7a-56b8-4241-a496-2a091a9686f3 could not be found. Jul 14 14:38:59.196020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:38:59.199376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-42bc4d3f-885c-4bce-a333-eb8da21be3b1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Returning 404 to user: Instance 421b3e7a-56b8-4241-a496-2a091a9686f3 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:59.202860 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-42bc4d3f-885c-4bce-a333-eb8da21be3b1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3" status: 404 len: 111 microversion: 2.1 time: 0.177575 Jul 14 14:38:59.230112 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1451/2882] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:59 2022] GET /compute/v2.1/servers/421b3e7a-56b8-4241-a496-2a091a9686f3 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:59.258611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-cd4b4555-13ac-497a-8047-88a69dd89ffc req-1be44ebc-13fa-4107-a274-0f21e839f89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecf4db7-6444-4c98-9043-5c39faf7125a", "name": "network-vif-deleted", "tag": "8215142c-738e-4be2-aacd-31ab4926d96e"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:59.287058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cd4b4555-13ac-497a-8047-88a69dd89ffc req-1be44ebc-13fa-4107-a274-0f21e839f89f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.287977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cd4b4555-13ac-497a-8047-88a69dd89ffc req-1be44ebc-13fa-4107-a274-0f21e839f89f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:59.335521 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-cd4b4555-13ac-497a-8047-88a69dd89ffc req-1be44ebc-13fa-4107-a274-0f21e839f89f service nova] Creating event network-vif-deleted:8215142c-738e-4be2-aacd-31ab4926d96e for instance aecf4db7-6444-4c98-9043-5c39faf7125a on n-h2-767704-28 Jul 14 14:38:59.370338 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-cd4b4555-13ac-497a-8047-88a69dd89ffc req-1be44ebc-13fa-4107-a274-0f21e839f89f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134626 Jul 14 14:38:59.372522 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1452/2883] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:59.386242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae8a0e33-44e3-4b89-9f2b-781c4c858f0e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:59.388235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae8a0e33-44e3-4b89-9f2b-781c4c858f0e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:59.417247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae8a0e33-44e3-4b89-9f2b-781c4c858f0e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.419219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae8a0e33-44e3-4b89-9f2b-781c4c858f0e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:59.421016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae8a0e33-44e3-4b89-9f2b-781c4c858f0e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.424076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae8a0e33-44e3-4b89-9f2b-781c4c858f0e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:59.514149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae8a0e33-44e3-4b89-9f2b-781c4c858f0e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:38:59.700283 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ae8a0e33-44e3-4b89-9f2b-781c4c858f0e tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "DELETE /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2" status: 204 len: 0 microversion: 2.1 time: 0.322523 Jul 14 14:38:59.701222 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1453/2884] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:38:59 2022] DELETE /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:59.708600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1461ae0a-3d06-4c14-aa5e-3837a5330d8f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:59.710122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1461ae0a-3d06-4c14-aa5e-3837a5330d8f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:59.736714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1461ae0a-3d06-4c14-aa5e-3837a5330d8f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.737805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1461ae0a-3d06-4c14-aa5e-3837a5330d8f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:59.738852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1461ae0a-3d06-4c14-aa5e-3837a5330d8f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.739591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1461ae0a-3d06-4c14-aa5e-3837a5330d8f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:59.876601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0ea565c7-ab50-457a-a808-37582859efab tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:59.887129 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0ea565c7-ab50-457a-a808-37582859efab tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1526 microversion: 2.1 time: 1.571909 Jul 14 14:38:59.903230 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1432/2885] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:58 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1526 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:59.917751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5558bd69-ab2a-4f86-82d8-ac46c22cfea8 req-dbafe82e-6c0e-43d7-8e5d-f26a3a9ca7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0e1171-566a-413f-969d-08d20f2b74c5", "name": "network-vif-unplugged", "status": "completed", "tag": "63428ed3-81eb-477c-baf3-ea96c76769c0"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:59.929260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5558bd69-ab2a-4f86-82d8-ac46c22cfea8 req-dbafe82e-6c0e-43d7-8e5d-f26a3a9ca7e0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.933824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5558bd69-ab2a-4f86-82d8-ac46c22cfea8 req-dbafe82e-6c0e-43d7-8e5d-f26a3a9ca7e0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:59.949636 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5558bd69-ab2a-4f86-82d8-ac46c22cfea8 req-dbafe82e-6c0e-43d7-8e5d-f26a3a9ca7e0 service nova] Creating event network-vif-unplugged:63428ed3-81eb-477c-baf3-ea96c76769c0 for instance 0c0e1171-566a-413f-969d-08d20f2b74c5 on n-h2-767704-28 Jul 14 14:38:59.955080 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5558bd69-ab2a-4f86-82d8-ac46c22cfea8 req-dbafe82e-6c0e-43d7-8e5d-f26a3a9ca7e0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050419 Jul 14 14:38:59.956011 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1433/2886] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:59.971203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-396ca89b-ad94-4989-97f2-d78a5dd9be9a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:59.972320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-396ca89b-ad94-4989-97f2-d78a5dd9be9a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:59.981121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-396ca89b-ad94-4989-97f2-d78a5dd9be9a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.982054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-396ca89b-ad94-4989-97f2-d78a5dd9be9a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:59.983041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-396ca89b-ad94-4989-97f2-d78a5dd9be9a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.983655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-396ca89b-ad94-4989-97f2-d78a5dd9be9a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.827080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-396ca89b-ad94-4989-97f2-d78a5dd9be9a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:00.829445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1461ae0a-3d06-4c14-aa5e-3837a5330d8f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:00.836156 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-396ca89b-ad94-4989-97f2-d78a5dd9be9a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2" status: 200 len: 1472 microversion: 2.1 time: 0.870727 Jul 14 14:39:00.846777 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1461ae0a-3d06-4c14-aa5e-3837a5330d8f tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1469 microversion: 2.1 time: 1.134760 Jul 14 14:39:00.847746 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1434/2887] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:59 2022] GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 => generated 1472 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:00.849295 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1454/2888] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:59 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1469 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:00.853909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5c6243ee-de8a-4444-a939-646091751981 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:00.854776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5c6243ee-de8a-4444-a939-646091751981 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] [instance: aecf4db7-6444-4c98-9043-5c39faf7125a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:00.862560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c6243ee-de8a-4444-a939-646091751981 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.864121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c6243ee-de8a-4444-a939-646091751981 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.865151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c6243ee-de8a-4444-a939-646091751981 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.865765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c6243ee-de8a-4444-a939-646091751981 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.908475 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-5c6243ee-de8a-4444-a939-646091751981 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] HTTP exception thrown: Instance aecf4db7-6444-4c98-9043-5c39faf7125a could not be found. Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5c6243ee-de8a-4444-a939-646091751981 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Request method failure captured: Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a HTTP/1.1 Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CoWxDNoyY1ZdWfrKjDifNz15uBFTGUSg_e2-cehcheyFGFVYiR9ztbY7c5OEivql4KUxUu5atPyUlGVLSRnFyAjuys96_-sCO3ivvi0z02Q4yNwQ2WQw_et73_OzZEbC4N-pJd6GmiMyX0UwOxMW90Ch3Va5Bv9V5dUjCD24xuT3SA Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 2e9036125df9487d9f5cf8afe8f13907 Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ListServerFiltersTestJSON-328544149 Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2e9036125df9487d9f5cf8afe8f13907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2e9036125df9487d9f5cf8afe8f13907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2e9036125df9487d9f5cf8afe8f13907", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2e9036125df9487d9f5cf8afe8f13907"}]}] Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ListServerFiltersTestJSON-328544149 Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 2e9036125df9487d9f5cf8afe8f13907 Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-328544149 Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ListServerFiltersTestJSON-328544149-project Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e1ce229470845ddac37073e2b42373e Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ListServerFiltersTestJSON-328544149-project Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance aecf4db7-6444-4c98-9043-5c39faf7125a could not be found. Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'aecf4db7-6444-4c98-9043-5c39faf7125a'} Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aecf4db7-6444-4c98-9043-5c39faf7125a could not be found. Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aecf4db7-6444-4c98-9043-5c39faf7125a could not be found. Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:00.910290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:00.915546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:00.915546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:00.915546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:00.915546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:00.915546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:00.915546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aecf4db7-6444-4c98-9043-5c39faf7125a could not be found. Jul 14 14:39:00.915546 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:00.915546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5c6243ee-de8a-4444-a939-646091751981 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] Returning 404 to user: Instance aecf4db7-6444-4c98-9043-5c39faf7125a could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:00.915546 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5c6243ee-de8a-4444-a939-646091751981 tempest-ListServerFiltersTestJSON-328544149 tempest-ListServerFiltersTestJSON-328544149-project] 10.222.0.81 "GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a" status: 404 len: 111 microversion: 2.1 time: 0.062894 Jul 14 14:39:00.916390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a8c0ea97-ebe4-4452-9be9-e4b5bf631a18 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:00.916390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a8c0ea97-ebe4-4452-9be9-e4b5bf631a18 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:00.916601 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1435/2889] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:00 2022] GET /compute/v2.1/servers/aecf4db7-6444-4c98-9043-5c39faf7125a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:00.936381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8c0ea97-ebe4-4452-9be9-e4b5bf631a18 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.937627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8c0ea97-ebe4-4452-9be9-e4b5bf631a18 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.940147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8c0ea97-ebe4-4452-9be9-e4b5bf631a18 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.942133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8c0ea97-ebe4-4452-9be9-e4b5bf631a18 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.140478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a8c0ea97-ebe4-4452-9be9-e4b5bf631a18 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:01.154379 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a8c0ea97-ebe4-4452-9be9-e4b5bf631a18 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1484 microversion: 2.1 time: 0.244505 Jul 14 14:39:01.157305 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1455/2890] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:00 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1484 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:01.831439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5669dba4-2209-4d62-942c-f1aa05761c2c req-8f46a392-9620-4e6c-a187-5e15a898edc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0e1171-566a-413f-969d-08d20f2b74c5", "name": "network-vif-deleted", "tag": "63428ed3-81eb-477c-baf3-ea96c76769c0"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:01.855935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-da07bbe0-e8aa-4762-a3d4-1ff3e5377aa8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:01.856622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-da07bbe0-e8aa-4762-a3d4-1ff3e5377aa8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:01.877473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5669dba4-2209-4d62-942c-f1aa05761c2c req-8f46a392-9620-4e6c-a187-5e15a898edc5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.877935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5669dba4-2209-4d62-942c-f1aa05761c2c req-8f46a392-9620-4e6c-a187-5e15a898edc5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.880745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da07bbe0-e8aa-4762-a3d4-1ff3e5377aa8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.881234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da07bbe0-e8aa-4762-a3d4-1ff3e5377aa8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.882018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da07bbe0-e8aa-4762-a3d4-1ff3e5377aa8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.882554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da07bbe0-e8aa-4762-a3d4-1ff3e5377aa8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.925949 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5669dba4-2209-4d62-942c-f1aa05761c2c req-8f46a392-9620-4e6c-a187-5e15a898edc5 service nova] Creating event network-vif-deleted:63428ed3-81eb-477c-baf3-ea96c76769c0 for instance 0c0e1171-566a-413f-969d-08d20f2b74c5 on n-h2-767704-28 Jul 14 14:39:01.934117 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5669dba4-2209-4d62-942c-f1aa05761c2c req-8f46a392-9620-4e6c-a187-5e15a898edc5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106338 Jul 14 14:39:01.934876 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1436/2891] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:01.946246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-872aeef3-ee63-4fb0-8f8d-7fda854d6367 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:01.947731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-872aeef3-ee63-4fb0-8f8d-7fda854d6367 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:01.969099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-872aeef3-ee63-4fb0-8f8d-7fda854d6367 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.969778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-872aeef3-ee63-4fb0-8f8d-7fda854d6367 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.970769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-872aeef3-ee63-4fb0-8f8d-7fda854d6367 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.971630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-872aeef3-ee63-4fb0-8f8d-7fda854d6367 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.675622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-da07bbe0-e8aa-4762-a3d4-1ff3e5377aa8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:02.686197 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-da07bbe0-e8aa-4762-a3d4-1ff3e5377aa8 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2" status: 200 len: 1472 microversion: 2.1 time: 0.835244 Jul 14 14:39:02.700675 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1456/2892] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:01 2022] GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 => generated 1472 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:02.714962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-9c2b6df7-26d7-498d-b524-b8ab166ab61d req-0b1d8084-58f7-44b4-81c1-81dd044bc623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4beb02f-8f03-4186-8e65-0f132e384e4c", "name": "network-vif-unplugged", "status": "completed", "tag": "85dc8019-423e-431f-a854-ebcdc42a891a"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:02.738715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9c2b6df7-26d7-498d-b524-b8ab166ab61d req-0b1d8084-58f7-44b4-81c1-81dd044bc623 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.739170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9c2b6df7-26d7-498d-b524-b8ab166ab61d req-0b1d8084-58f7-44b4-81c1-81dd044bc623 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.755785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-872aeef3-ee63-4fb0-8f8d-7fda854d6367 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:02.766006 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-872aeef3-ee63-4fb0-8f8d-7fda854d6367 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 200 len: 1427 microversion: 2.1 time: 0.829604 Jul 14 14:39:02.788176 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1437/2893] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:01 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 1427 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:02.789816 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-9c2b6df7-26d7-498d-b524-b8ab166ab61d req-0b1d8084-58f7-44b4-81c1-81dd044bc623 service nova] Creating event network-vif-unplugged:85dc8019-423e-431f-a854-ebcdc42a891a for instance d4beb02f-8f03-4186-8e65-0f132e384e4c on n-h2-767704-28 Jul 14 14:39:02.804154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-44a118dd-1e58-46dd-a816-0eba5d06a607 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:02.810447 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-9c2b6df7-26d7-498d-b524-b8ab166ab61d req-0b1d8084-58f7-44b4-81c1-81dd044bc623 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104836 Jul 14 14:39:02.811283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-44a118dd-1e58-46dd-a816-0eba5d06a607 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:02.811654 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1457/2894] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:02.837934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44a118dd-1e58-46dd-a816-0eba5d06a607 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.838606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44a118dd-1e58-46dd-a816-0eba5d06a607 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.839552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44a118dd-1e58-46dd-a816-0eba5d06a607 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.845433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44a118dd-1e58-46dd-a816-0eba5d06a607 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.948070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44a118dd-1e58-46dd-a816-0eba5d06a607 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.953101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44a118dd-1e58-46dd-a816-0eba5d06a607 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.954065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-44a118dd-1e58-46dd-a816-0eba5d06a607 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lazy-loading 'fault' on Instance uuid 0c0e1171-566a-413f-969d-08d20f2b74c5 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:03.283035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-44a118dd-1e58-46dd-a816-0eba5d06a607 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd153868f91d4fd4bf380747185b2c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67736b0882a44cd480f487d0e69c7a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:03.303012 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-44a118dd-1e58-46dd-a816-0eba5d06a607 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 200 len: 1314 microversion: 2.1 time: 0.511415 Jul 14 14:39:03.308674 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1438/2895] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:02 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:03.711304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-285650c2-5bfb-40a7-b8fa-37f901a9e240 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:03.712563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-285650c2-5bfb-40a7-b8fa-37f901a9e240 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:03.737356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285650c2-5bfb-40a7-b8fa-37f901a9e240 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.741145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285650c2-5bfb-40a7-b8fa-37f901a9e240 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.745591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285650c2-5bfb-40a7-b8fa-37f901a9e240 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.748295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285650c2-5bfb-40a7-b8fa-37f901a9e240 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.795868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3957c60c-1ef8-4d3c-9507-a9e5d9908d7e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:03.796789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3957c60c-1ef8-4d3c-9507-a9e5d9908d7e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: d4beb02f-8f03-4186-8e65-0f132e384e4c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:03.810169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:03.826365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3957c60c-1ef8-4d3c-9507-a9e5d9908d7e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.831060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3957c60c-1ef8-4d3c-9507-a9e5d9908d7e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.836681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3957c60c-1ef8-4d3c-9507-a9e5d9908d7e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.837626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3957c60c-1ef8-4d3c-9507-a9e5d9908d7e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.840924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285650c2-5bfb-40a7-b8fa-37f901a9e240 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.846987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285650c2-5bfb-40a7-b8fa-37f901a9e240 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.847734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-285650c2-5bfb-40a7-b8fa-37f901a9e240 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lazy-loading 'fault' on Instance uuid 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:03.888731 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3957c60c-1ef8-4d3c-9507-a9e5d9908d7e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] HTTP exception thrown: Instance d4beb02f-8f03-4186-8e65-0f132e384e4c could not be found. Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3957c60c-1ef8-4d3c-9507-a9e5d9908d7e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Request method failure captured: Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c HTTP/1.1 Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CnbEi7ngBALLh_6FCsgvYxbTlj2Yuo9NLmSnhIZuY42UP0datdc-OHxNVP9a3fnVvwTZm4-EGPikl9kpAKWcqMuQHbWI3MeIIp_y-3oxLksV67XkntcymFHqC4JmNOm0qGcCeFJAtDnxnIXasYRtV64w3pqZ0reVyAmS06K3lV3pTs Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 8a0c595b04c74827b3c00228b9a57c27 Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersAdminTestJSON-1626976122 Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8a0c595b04c74827b3c00228b9a57c27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8a0c595b04c74827b3c00228b9a57c27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8a0c595b04c74827b3c00228b9a57c27", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8a0c595b04c74827b3c00228b9a57c27"}]}] Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersAdminTestJSON-1626976122 Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 8a0c595b04c74827b3c00228b9a57c27 Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersAdminTestJSON-1626976122 Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersAdminTestJSON-1626976122-project Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 89d755b092134384b11c41c5f63fcae4 Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersAdminTestJSON-1626976122-project Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance d4beb02f-8f03-4186-8e65-0f132e384e4c could not be found. Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'd4beb02f-8f03-4186-8e65-0f132e384e4c'} Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4beb02f-8f03-4186-8e65-0f132e384e4c could not be found. Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4beb02f-8f03-4186-8e65-0f132e384e4c could not be found. Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:03.891638 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:03.896473 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:03.896473 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:03.896473 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:03.896473 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:03.896473 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:03.896473 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4beb02f-8f03-4186-8e65-0f132e384e4c could not be found. Jul 14 14:39:03.896473 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:03.907843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3957c60c-1ef8-4d3c-9507-a9e5d9908d7e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Returning 404 to user: Instance d4beb02f-8f03-4186-8e65-0f132e384e4c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:03.914539 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3957c60c-1ef8-4d3c-9507-a9e5d9908d7e tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c" status: 404 len: 111 microversion: 2.1 time: 0.125056 Jul 14 14:39:03.918960 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1439/2896] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:03 2022] GET /compute/v2.1/servers/d4beb02f-8f03-4186-8e65-0f132e384e4c => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:03.924525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-10213e35-24ba-4188-a3b0-be1dc5591571 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:03.925318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-10213e35-24ba-4188-a3b0-be1dc5591571 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:03.932989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-285650c2-5bfb-40a7-b8fa-37f901a9e240 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:03.933463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10213e35-24ba-4188-a3b0-be1dc5591571 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.934099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10213e35-24ba-4188-a3b0-be1dc5591571 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.935322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10213e35-24ba-4188-a3b0-be1dc5591571 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.935964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10213e35-24ba-4188-a3b0-be1dc5591571 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.949680 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-285650c2-5bfb-40a7-b8fa-37f901a9e240 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2" status: 200 len: 1307 microversion: 2.1 time: 0.246568 Jul 14 14:39:03.951555 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1458/2897] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:03 2022] GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 => generated 1307 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:03.970176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-683d798f-32fb-4355-88a9-df4948ee0367 req-c7b66efc-1546-436f-9d7f-0519107f2da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4beb02f-8f03-4186-8e65-0f132e384e4c", "name": "network-vif-deleted", "tag": "85dc8019-423e-431f-a854-ebcdc42a891a"}, {"server_uuid": "83dae6b9-f87b-4ee4-ab0d-3706cd2602a2", "name": "network-vif-deleted", "tag": "9462ad9c-5eb2-40e6-922b-2e480cd3ce7b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:03.985900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-683d798f-32fb-4355-88a9-df4948ee0367 req-c7b66efc-1546-436f-9d7f-0519107f2da3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.989509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-683d798f-32fb-4355-88a9-df4948ee0367 req-c7b66efc-1546-436f-9d7f-0519107f2da3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.994009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-10213e35-24ba-4188-a3b0-be1dc5591571 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:04.013771 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-683d798f-32fb-4355-88a9-df4948ee0367 req-c7b66efc-1546-436f-9d7f-0519107f2da3 service nova] Creating event network-vif-deleted:85dc8019-423e-431f-a854-ebcdc42a891a for instance d4beb02f-8f03-4186-8e65-0f132e384e4c on n-h2-767704-28 Jul 14 14:39:04.014545 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-683d798f-32fb-4355-88a9-df4948ee0367 req-c7b66efc-1546-436f-9d7f-0519107f2da3 service nova] Creating event network-vif-deleted:9462ad9c-5eb2-40e6-922b-2e480cd3ce7b for instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 on n-h1-767704-28 Jul 14 14:39:04.030785 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-683d798f-32fb-4355-88a9-df4948ee0367 req-c7b66efc-1546-436f-9d7f-0519107f2da3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075177 Jul 14 14:39:04.036196 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1459/2898] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:04.112598 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-10213e35-24ba-4188-a3b0-be1dc5591571 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "DELETE /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 204 len: 0 microversion: 2.1 time: 0.191278 Jul 14 14:39:04.121044 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1440/2899] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:39:03 2022] DELETE /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:04.129922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0f5ede72-909d-4a39-a724-1dbef8fe4ba3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:04.130991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0f5ede72-909d-4a39-a724-1dbef8fe4ba3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:04.141955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f5ede72-909d-4a39-a724-1dbef8fe4ba3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.142915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f5ede72-909d-4a39-a724-1dbef8fe4ba3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.144036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f5ede72-909d-4a39-a724-1dbef8fe4ba3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.144913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f5ede72-909d-4a39-a724-1dbef8fe4ba3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.325701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a260529e-bddd-4592-9ae7-007b4978ad53 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:04.326704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a260529e-bddd-4592-9ae7-007b4978ad53 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] [instance: 0c0e1171-566a-413f-969d-08d20f2b74c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:04.335446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a260529e-bddd-4592-9ae7-007b4978ad53 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.337417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a260529e-bddd-4592-9ae7-007b4978ad53 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.338742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a260529e-bddd-4592-9ae7-007b4978ad53 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.339519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a260529e-bddd-4592-9ae7-007b4978ad53 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.360667 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-a260529e-bddd-4592-9ae7-007b4978ad53 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] HTTP exception thrown: Instance 0c0e1171-566a-413f-969d-08d20f2b74c5 could not be found. Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a260529e-bddd-4592-9ae7-007b4978ad53 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Request method failure captured: Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 HTTP/1.1 Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cpgxs3ZasxzT0TzC-x7FcmfRjgJgzvcWwvo_6QtVmHEgYn9OztfKyqZAFbljTEBmApjCi7CsoIlh6nMeVJotBo2h7gS_h0BxoD-QuKeohQtVJUrpUBGVIw1ZXcTisCMDO16cVnSoWrfLF3rOu_tfGcBO4pWvQ4KeXrH_dkLStAsfr8 Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 67736b0882a44cd480f487d0e69c7a01 Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1501280044 Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67736b0882a44cd480f487d0e69c7a01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/67736b0882a44cd480f487d0e69c7a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_67736b0882a44cd480f487d0e69c7a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67736b0882a44cd480f487d0e69c7a01"}]}] Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1501280044 Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 67736b0882a44cd480f487d0e69c7a01 Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1501280044 Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-InstanceActionsNegativeTestJSON-1501280044-project Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: fd153868f91d4fd4bf380747185b2c1f Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1501280044-project Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 0c0e1171-566a-413f-969d-08d20f2b74c5 could not be found. Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '0c0e1171-566a-413f-969d-08d20f2b74c5'} Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c0e1171-566a-413f-969d-08d20f2b74c5 could not be found. Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c0e1171-566a-413f-969d-08d20f2b74c5 could not be found. Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:04.363960 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:04.374739 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:04.374739 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:04.374739 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:04.374739 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:04.374739 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:04.374739 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:04.374739 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c0e1171-566a-413f-969d-08d20f2b74c5 could not be found. Jul 14 14:39:04.374739 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:04.377553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a260529e-bddd-4592-9ae7-007b4978ad53 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] Returning 404 to user: Instance 0c0e1171-566a-413f-969d-08d20f2b74c5 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:04.379633 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a260529e-bddd-4592-9ae7-007b4978ad53 tempest-InstanceActionsNegativeTestJSON-1501280044 tempest-InstanceActionsNegativeTestJSON-1501280044-project] 10.222.0.81 "GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5" status: 404 len: 111 microversion: 2.1 time: 0.061274 Jul 14 14:39:04.380853 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1441/2900] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:04 2022] GET /compute/v2.1/servers/0c0e1171-566a-413f-969d-08d20f2b74c5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:04.406747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0f5ede72-909d-4a39-a724-1dbef8fe4ba3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:04.416935 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0f5ede72-909d-4a39-a724-1dbef8fe4ba3 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1466 microversion: 2.1 time: 0.297160 Jul 14 14:39:04.421355 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1460/2901] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:04 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1466 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:04.972739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dca2e0a9-e949-4532-90a4-8370d8dbc7af tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:04.973787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dca2e0a9-e949-4532-90a4-8370d8dbc7af tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:04.992820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dca2e0a9-e949-4532-90a4-8370d8dbc7af tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.995342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dca2e0a9-e949-4532-90a4-8370d8dbc7af tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.997847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dca2e0a9-e949-4532-90a4-8370d8dbc7af tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.999483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dca2e0a9-e949-4532-90a4-8370d8dbc7af tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:05.081625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dca2e0a9-e949-4532-90a4-8370d8dbc7af tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:05.082366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dca2e0a9-e949-4532-90a4-8370d8dbc7af tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:05.084033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-dca2e0a9-e949-4532-90a4-8370d8dbc7af tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lazy-loading 'fault' on Instance uuid 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:05.157157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dca2e0a9-e949-4532-90a4-8370d8dbc7af tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4798e509f5f74d93b6e50ad9d8d25436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd972941395b44d288fafe30e02af1d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:05.173801 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dca2e0a9-e949-4532-90a4-8370d8dbc7af tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2" status: 200 len: 1307 microversion: 2.1 time: 0.206027 Jul 14 14:39:05.174828 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1442/2902] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:04 2022] GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 => generated 1307 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:05.434631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c45aa238-7cc4-4192-a902-ba6431709581 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:05.435264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c45aa238-7cc4-4192-a902-ba6431709581 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:05.459611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c45aa238-7cc4-4192-a902-ba6431709581 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:05.460081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c45aa238-7cc4-4192-a902-ba6431709581 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:05.468446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c45aa238-7cc4-4192-a902-ba6431709581 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:05.469751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c45aa238-7cc4-4192-a902-ba6431709581 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:05.777688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c45aa238-7cc4-4192-a902-ba6431709581 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:05.788305 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c45aa238-7cc4-4192-a902-ba6431709581 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1466 microversion: 2.1 time: 0.357848 Jul 14 14:39:05.789262 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1461/2903] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:05 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1466 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:06.199836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3bdcd353-c015-4cd7-96aa-98c0b0648dbb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:06.203024 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3bdcd353-c015-4cd7-96aa-98c0b0648dbb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] [instance: 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:06.252769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3bdcd353-c015-4cd7-96aa-98c0b0648dbb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.253405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3bdcd353-c015-4cd7-96aa-98c0b0648dbb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.255438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3bdcd353-c015-4cd7-96aa-98c0b0648dbb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.255627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3bdcd353-c015-4cd7-96aa-98c0b0648dbb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.304145 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3bdcd353-c015-4cd7-96aa-98c0b0648dbb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] HTTP exception thrown: Instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 could not be found. Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3bdcd353-c015-4cd7-96aa-98c0b0648dbb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Request method failure captured: Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 HTTP/1.1 Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CnVrPocP6HKoOUreqgns42Obq6ZjFJw3j18wzxLeknQh2QBq0Vlea--qrYukBESdryL-FLp2ql5K4FBNiLQ9-cLnhnHEFDxImPkAb23fr410nfhyvNAvg2Ay0onFnE4QAf6dSdqDF7nRApWRfBOU6Qa2CEbDJOE_nU8ocAJr0aCI_w Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: bd972941395b44d288fafe30e02af1d4 Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ListImageFiltersTestJSON-1479846462 Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bd972941395b44d288fafe30e02af1d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bd972941395b44d288fafe30e02af1d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bd972941395b44d288fafe30e02af1d4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bd972941395b44d288fafe30e02af1d4"}]}] Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ListImageFiltersTestJSON-1479846462 Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: bd972941395b44d288fafe30e02af1d4 Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1479846462 Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ListImageFiltersTestJSON-1479846462-project Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4798e509f5f74d93b6e50ad9d8d25436 Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ListImageFiltersTestJSON-1479846462-project Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 could not be found. Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '83dae6b9-f87b-4ee4-ab0d-3706cd2602a2'} Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 could not be found. Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 could not be found. Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:06.323764 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:06.327902 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:06.327902 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:06.327902 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:06.327902 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:06.327902 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:06.327902 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 could not be found. Jul 14 14:39:06.327902 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:06.327902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3bdcd353-c015-4cd7-96aa-98c0b0648dbb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Returning 404 to user: Instance 83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:06.327902 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3bdcd353-c015-4cd7-96aa-98c0b0648dbb tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2" status: 404 len: 111 microversion: 2.1 time: 0.138325 Jul 14 14:39:06.330200 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1443/2904] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:06 2022] GET /compute/v2.1/servers/83dae6b9-f87b-4ee4-ab0d-3706cd2602a2 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:06.335082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b7d016b8-a2f0-4336-ac79-ecc9866e268d tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6cac11b80>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:06.808675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7a33cd0b-42b4-4b9a-8e70-c923245e9b81 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:06.809728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7a33cd0b-42b4-4b9a-8e70-c923245e9b81 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:06.846201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a33cd0b-42b4-4b9a-8e70-c923245e9b81 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.846792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a33cd0b-42b4-4b9a-8e70-c923245e9b81 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.851183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a33cd0b-42b4-4b9a-8e70-c923245e9b81 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.856679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a33cd0b-42b4-4b9a-8e70-c923245e9b81 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:07.173635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7a33cd0b-42b4-4b9a-8e70-c923245e9b81 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89d755b092134384b11c41c5f63fcae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c595b04c74827b3c00228b9a57c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:07.195658 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7a33cd0b-42b4-4b9a-8e70-c923245e9b81 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 200 len: 1424 microversion: 2.1 time: 0.390837 Jul 14 14:39:07.209606 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1444/2905] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:06 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 1424 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:39:07.231138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0d539b6e-220d-4c19-9b0f-11aa8f54d81b req-69ab901c-4420-4735-a01e-7cda875aebb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ebe371-1ebb-4849-a18f-4b3e40035dfb", "name": "network-vif-deleted", "tag": "929f1d52-94d9-463b-b94c-fe77458a9e1a"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:07.267548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0d539b6e-220d-4c19-9b0f-11aa8f54d81b req-69ab901c-4420-4735-a01e-7cda875aebb4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:07.268843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0d539b6e-220d-4c19-9b0f-11aa8f54d81b req-69ab901c-4420-4735-a01e-7cda875aebb4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:07.296074 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0d539b6e-220d-4c19-9b0f-11aa8f54d81b req-69ab901c-4420-4735-a01e-7cda875aebb4 service nova] Creating event network-vif-deleted:929f1d52-94d9-463b-b94c-fe77458a9e1a for instance 13ebe371-1ebb-4849-a18f-4b3e40035dfb on n-h1-767704-28 Jul 14 14:39:07.306801 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0d539b6e-220d-4c19-9b0f-11aa8f54d81b req-69ab901c-4420-4735-a01e-7cda875aebb4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090662 Jul 14 14:39:07.307425 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1445/2906] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:07.630815 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b7d016b8-a2f0-4336-ac79-ecc9866e268d tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "DELETE /compute/v2.1/images/122b005d-e658-4fff-a7c7-caea456d93ae" status: 204 len: 0 microversion: 2.1 time: 1.299582 Jul 14 14:39:07.631624 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1462/2907] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:06 2022] DELETE /compute/v2.1/images/122b005d-e658-4fff-a7c7-caea456d93ae => generated 0 bytes in 1301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:07.642008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-87de6782-103f-42c4-80e8-b8d550b007a1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5005b80>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:08.147053 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-87de6782-103f-42c4-80e8-b8d550b007a1 tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "DELETE /compute/v2.1/images/81f29835-ca09-418a-a363-4efd52423134" status: 204 len: 0 microversion: 2.1 time: 0.510692 Jul 14 14:39:08.158253 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1446/2908] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:07 2022] DELETE /compute/v2.1/images/81f29835-ca09-418a-a363-4efd52423134 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:08.163409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-658a1a0c-d37f-4d50-ae0e-1482412a725a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] Calling method '.version_select at 0x7fd6c5e3ef70>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:08.217990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2efe83bb-397b-44ad-b66e-3330c3f01557 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:08.220616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2efe83bb-397b-44ad-b66e-3330c3f01557 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] [instance: 13ebe371-1ebb-4849-a18f-4b3e40035dfb] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:08.239507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2efe83bb-397b-44ad-b66e-3330c3f01557 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:08.239959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2efe83bb-397b-44ad-b66e-3330c3f01557 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:08.254331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2efe83bb-397b-44ad-b66e-3330c3f01557 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:08.257639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2efe83bb-397b-44ad-b66e-3330c3f01557 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:08.338523 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-2efe83bb-397b-44ad-b66e-3330c3f01557 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] HTTP exception thrown: Instance 13ebe371-1ebb-4849-a18f-4b3e40035dfb could not be found. Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2efe83bb-397b-44ad-b66e-3330c3f01557 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Request method failure captured: Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb HTTP/1.1 Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CnbEi7ngBALLh_6FCsgvYxbTlj2Yuo9NLmSnhIZuY42UP0datdc-OHxNVP9a3fnVvwTZm4-EGPikl9kpAKWcqMuQHbWI3MeIIp_y-3oxLksV67XkntcymFHqC4JmNOm0qGcCeFJAtDnxnIXasYRtV64w3pqZ0reVyAmS06K3lV3pTs Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 8a0c595b04c74827b3c00228b9a57c27 Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersAdminTestJSON-1626976122 Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8a0c595b04c74827b3c00228b9a57c27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8a0c595b04c74827b3c00228b9a57c27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8a0c595b04c74827b3c00228b9a57c27", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8a0c595b04c74827b3c00228b9a57c27"}]}] Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersAdminTestJSON-1626976122 Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 8a0c595b04c74827b3c00228b9a57c27 Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersAdminTestJSON-1626976122 Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersAdminTestJSON-1626976122-project Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 89d755b092134384b11c41c5f63fcae4 Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersAdminTestJSON-1626976122-project Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 13ebe371-1ebb-4849-a18f-4b3e40035dfb could not be found. Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '13ebe371-1ebb-4849-a18f-4b3e40035dfb'} Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ebe371-1ebb-4849-a18f-4b3e40035dfb could not be found. Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ebe371-1ebb-4849-a18f-4b3e40035dfb could not be found. Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:08.342854 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:08.347047 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:08.347047 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:08.347047 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:08.347047 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:08.347047 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:08.347047 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ebe371-1ebb-4849-a18f-4b3e40035dfb could not be found. Jul 14 14:39:08.347047 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:08.349990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2efe83bb-397b-44ad-b66e-3330c3f01557 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] Returning 404 to user: Instance 13ebe371-1ebb-4849-a18f-4b3e40035dfb could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:08.353401 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2efe83bb-397b-44ad-b66e-3330c3f01557 tempest-ServersAdminTestJSON-1626976122 tempest-ServersAdminTestJSON-1626976122-project] 10.222.0.81 "GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb" status: 404 len: 111 microversion: 2.1 time: 0.140571 Jul 14 14:39:08.355522 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1447/2909] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:08 2022] GET /compute/v2.1/servers/13ebe371-1ebb-4849-a18f-4b3e40035dfb => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:39:08.823914 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-658a1a0c-d37f-4d50-ae0e-1482412a725a tempest-ListImageFiltersTestJSON-1479846462 tempest-ListImageFiltersTestJSON-1479846462-project] 10.222.0.81 "DELETE /compute/v2.1/images/a8a2f556-5651-4f4f-ae94-8e655f609000" status: 204 len: 0 microversion: 2.1 time: 0.665998 Jul 14 14:39:08.824894 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1463/2910] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:08 2022] DELETE /compute/v2.1/images/a8a2f556-5651-4f4f-ae94-8e655f609000 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:14.119243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b196e9c8-a2d3-4ebc-bde6-3d39d5ca330c tempest-ListImageFiltersNegativeTestJSON-1146729584 tempest-ListImageFiltersNegativeTestJSON-1146729584-project] Calling method '.version_select at 0x7fd6c5005310>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:14.162098 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-b196e9c8-a2d3-4ebc-bde6-3d39d5ca330c tempest-ListImageFiltersNegativeTestJSON-1146729584 tempest-ListImageFiltersNegativeTestJSON-1146729584-project] HTTP exception thrown: Image not found. Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b196e9c8-a2d3-4ebc-bde6-3d39d5ca330c tempest-ListImageFiltersNegativeTestJSON-1146729584 tempest-ListImageFiltersNegativeTestJSON-1146729584-project] Request method failure captured: Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/images/4df2bfa0-9dc7-49bf-81af-3b6e5914517d HTTP/1.1 Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CqR1bTljkPvPiENRWh5Anm7BVFvScsICqZx77WFrgPM8YI8eyiAkgGrj9cDcGIZ81N0uyx9DlmV33y1ZFY9f_ncpzYAqAxCKViDVMv-ef59lSvOnOiwttVj1VPHSQJWuhnU3BaledyWNY7MHuGYyus5FSEYTLki9yZYMXkkiUjYN9o Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d9b897b0296b4380b87f03cc882bfaab Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1146729584 Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d9b897b0296b4380b87f03cc882bfaab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d9b897b0296b4380b87f03cc882bfaab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d9b897b0296b4380b87f03cc882bfaab", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d9b897b0296b4380b87f03cc882bfaab"}]}] Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1146729584 Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d9b897b0296b4380b87f03cc882bfaab Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1146729584 Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ListImageFiltersNegativeTestJSON-1146729584-project Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 750f2b5e509a4a14b846715922a5a046 Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1146729584-project Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: exception: Image not found. Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '4df2bfa0-9dc7-49bf-81af-3b6e5914517d'} Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4df2bfa0-9dc7-49bf-81af-3b6e5914517d Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:39:14.169912 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4df2bfa0-9dc7-49bf-81af-3b6e5914517d could not be found. Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:39:14.174930 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:39:14.179946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b196e9c8-a2d3-4ebc-bde6-3d39d5ca330c tempest-ListImageFiltersNegativeTestJSON-1146729584 tempest-ListImageFiltersNegativeTestJSON-1146729584-project] Returning 404 to user: Image not found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:14.181083 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b196e9c8-a2d3-4ebc-bde6-3d39d5ca330c tempest-ListImageFiltersNegativeTestJSON-1146729584 tempest-ListImageFiltersNegativeTestJSON-1146729584-project] 10.222.0.81 "GET /compute/v2.1/images/4df2bfa0-9dc7-49bf-81af-3b6e5914517d" status: 404 len: 62 microversion: 2.1 time: 0.819429 Jul 14 14:39:14.191781 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1448/2911] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:39:13 2022] GET /compute/v2.1/images/4df2bfa0-9dc7-49bf-81af-3b6e5914517d => generated 62 bytes in 830 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:39:17.424350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1678674956", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f8db374a-61e0-43f1-b647-aa54a639b76e"}], "security_groups": [{"name": "tempest-securitygroup--1594534917"}], "key_name": "tempest-keypair-438563365", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "3a960d66-9965-44d2-9831-2fc430066e18", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:17.462654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:17.465449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:18.019252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] validate_networks() for [('f8db374a-61e0-43f1-b647-aa54a639b76e', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:39:19.433286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:19.437846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:20.070268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b3ceb883-1d1e-4e49-9613-8b917bfd9cda tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Action: 'create', calling method: .version_select at 0x7fd6c4fab940>, body: {"keypair": {"name": "tempest-keypair-862377709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsidURfrMC8sTBt9HOKCy0D8iTVtfcmaUf6QGgQNVa2411g0mpf0Oiq5rjbuQBYv1b8wsPsxyGMVCInmADIkZUJesEEEgcVZP9QnWIRMjsnHepm//HepZ8DKgRYGYxM3w=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:20.111831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-b3ceb883-1d1e-4e49-9613-8b917bfd9cda tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Getting quotas for project 6824e8d395844ef9a0f77182e2406db7. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:20.123721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-b3ceb883-1d1e-4e49-9613-8b917bfd9cda tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Getting quotas for user a6d0bedfa07d4704b2de8c8b6feacdcd and project 6824e8d395844ef9a0f77182e2406db7. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:20.171470 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b3ceb883-1d1e-4e49-9613-8b917bfd9cda tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.747279 Jul 14 14:39:20.177539 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1449/2912] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:39:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:39:20.201152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9a85c41d-8715-41cb-b684-7d618dfa4688 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Calling method '.version_select at 0x7fd6c501aee0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:20.203203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Getting quotas for project 991226f89eee4c4dbc3ec5870984d61d. Resources: dict_keys(['metadata_items']) {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:20.216827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Getting quotas for user 03af57d274df4507b3d350194128502e and project 991226f89eee4c4dbc3ec5870984d61d. Resources: dict_keys(['metadata_items']) {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:20.224769 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9a85c41d-8715-41cb-b684-7d618dfa4688 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs/tempest-keypair-862377709" status: 200 len: 497 microversion: 2.1 time: 0.040744 Jul 14 14:39:20.226793 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1450/2913] 10.222.0.81 () {58 vars in 1214 bytes} [Thu Jul 14 14:39:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-862377709 => generated 497 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:20.239530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b6b484f-d196-4503-9105-abbe52972145 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Calling method '.version_select at 0x7fd6c5c46790>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:20.257573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:39:20.258329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:39:20.265156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:39:20.265703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:39:20.266731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:39:20.289523 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b6b484f-d196-4503-9105-abbe52972145 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-862377709" status: 202 len: 0 microversion: 2.1 time: 0.055507 Jul 14 14:39:20.290106 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1451/2914] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jul 14 14:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-862377709 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:39:20.291398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:20.298410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:20.305830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:20.307015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:20.326455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-21dad575-591b-47ca-8f67-311ef03b0f97 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Action: 'create', calling method: .version_select at 0x7fd6c501dd30>, body: {"keypair": {"name": "tempest-keypair-305311837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM7uHHLAEeUa65Jm1ujGfHrdiY+r5HSXyPi1+v2qJXZdThIZ4eLaJ+ZzUXO/170RvG1l4n/5nMUk8UBmq3Pizr2b1g0rChtncQ6Odhd5O1HTPATIi1y1vkCZHbCUrENBA=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:20.375573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Getting quotas for project 991226f89eee4c4dbc3ec5870984d61d. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:20.385430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-21dad575-591b-47ca-8f67-311ef03b0f97 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Getting quotas for project 6824e8d395844ef9a0f77182e2406db7. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:20.393077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Getting quotas for user 03af57d274df4507b3d350194128502e and project 991226f89eee4c4dbc3ec5870984d61d. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:20.399988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-21dad575-591b-47ca-8f67-311ef03b0f97 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Getting quotas for user a6d0bedfa07d4704b2de8c8b6feacdcd and project 6824e8d395844ef9a0f77182e2406db7. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:20.476176 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-21dad575-591b-47ca-8f67-311ef03b0f97 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161420 Jul 14 14:39:20.477506 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1452/2915] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:39:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:20.499013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-889afb68-250e-4900-b7b0-ad71742c46b8 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Calling method '.version_select at 0x7fd6c569e9d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:20.578446 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-889afb68-250e-4900-b7b0-ad71742c46b8 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-305311837" status: 202 len: 0 microversion: 2.1 time: 0.084727 Jul 14 14:39:20.585294 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1453/2916] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jul 14 14:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-305311837 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:39:20.607084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-64648eb7-64a6-47c7-bb81-a2ea89cc49f5 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Action: 'create', calling method: .version_select at 0x7fd6c501a1f0>, body: {"keypair": {"name": "tempest-keypair-2025128969", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:20.622696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:39:20.625208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3a960d66-9965-44d2-9831-2fc430066e18',volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:39:20.670012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-64648eb7-64a6-47c7-bb81-a2ea89cc49f5 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Getting quotas for project 6824e8d395844ef9a0f77182e2406db7. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:20.689709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-64648eb7-64a6-47c7-bb81-a2ea89cc49f5 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Getting quotas for user a6d0bedfa07d4704b2de8c8b6feacdcd and project 6824e8d395844ef9a0f77182e2406db7. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:20.753270 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-64648eb7-64a6-47c7-bb81-a2ea89cc49f5 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.160117 Jul 14 14:39:20.770879 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1454/2917] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:39:20 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:20.787875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a9ebe83c-21b9-4724-a989-dfbb5d86822c tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Calling method '.version_select at 0x7fd6c5aa8670>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:20.832683 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a9ebe83c-21b9-4724-a989-dfbb5d86822c tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025128969" status: 202 len: 0 microversion: 2.1 time: 0.063333 Jul 14 14:39:20.849033 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1455/2918] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 14:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025128969 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:39:20.855860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4a9dbeed-068e-4f6a-bfa8-1258326946fa tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Action: 'create', calling method: .version_select at 0x7fd6c501a8b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2011244283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyhcW/6+cL3tZ3X4bhnF9mgefEWNSQh8CdQizleqOm+r8Q8FKK5puscih7M8O2PJ8KlyI8fe4H93pu1W03+pIKe3pS4E6Gf71v8Sz8XxpGdGo2nwCX6oM3CJ/BphZ9rvA=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:20.909268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4a9dbeed-068e-4f6a-bfa8-1258326946fa tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Getting quotas for project 6824e8d395844ef9a0f77182e2406db7. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:20.935744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4a9dbeed-068e-4f6a-bfa8-1258326946fa tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Getting quotas for user a6d0bedfa07d4704b2de8c8b6feacdcd and project 6824e8d395844ef9a0f77182e2406db7. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:21.003682 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4a9dbeed-068e-4f6a-bfa8-1258326946fa tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.152717 Jul 14 14:39:21.021809 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1456/2919] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:39:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:21.057261 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5d605279-52ed-42ed-962e-9470df8197e1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.623644 Jul 14 14:39:21.060022 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1464/2920] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:39:17 2022] POST /compute/v2.1/servers => generated 407 bytes in 3641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:39:21.081868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2cea4f4f-38c1-4d34-9daf-6f2c16caad12 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Action: 'create', calling method: .version_select at 0x7fd6c4fa8280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-164425404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiEIp5IKhGTgX1EE7xftunS85VXbXRtvIhk3p8chk1VHDQxDZzThuWr5/DFkDevWx0n4MYyMAEOSAv34qWOnllxA00uXFt2gVZxmyMhcY0ZP5bskQaLds07umbytIPvSw=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:21.084217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9fe63f7d-22e2-46a1-ab5f-73453e8051b6 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:21.084858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9fe63f7d-22e2-46a1-ab5f-73453e8051b6 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:21.166334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2cea4f4f-38c1-4d34-9daf-6f2c16caad12 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Getting quotas for project 6824e8d395844ef9a0f77182e2406db7. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:21.185157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2cea4f4f-38c1-4d34-9daf-6f2c16caad12 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Getting quotas for user a6d0bedfa07d4704b2de8c8b6feacdcd and project 6824e8d395844ef9a0f77182e2406db7. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:21.274179 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2cea4f4f-38c1-4d34-9daf-6f2c16caad12 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.251107 Jul 14 14:39:21.282912 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1457/2921] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:39:21 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:21.292169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-14eedb9d-956c-4bd4-a9a7-f05eec57aaa0 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Action: 'create', calling method: .version_select at 0x7fd6c4fa83a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-685386497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmL+d5LoNzbrlLonWkoJKPJXR+zPqC0EU0GmmO2obQdm2ag/pk/VCYbVd+K53saFuj3EwQEZjt8hAojfM/udwjL7QVaBHRb3b+oFSiigvdEefylpBo3Ky2RyZu3jHCwOg=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:21.344195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-14eedb9d-956c-4bd4-a9a7-f05eec57aaa0 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Getting quotas for project 6824e8d395844ef9a0f77182e2406db7. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:21.363669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-14eedb9d-956c-4bd4-a9a7-f05eec57aaa0 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Getting quotas for user a6d0bedfa07d4704b2de8c8b6feacdcd and project 6824e8d395844ef9a0f77182e2406db7. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:21.405964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9fe63f7d-22e2-46a1-ab5f-73453e8051b6 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:21.416392 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9fe63f7d-22e2-46a1-ab5f-73453e8051b6 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1121 microversion: 2.1 time: 0.351712 Jul 14 14:39:21.427892 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1465/2922] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:21 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1121 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:21.434081 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-14eedb9d-956c-4bd4-a9a7-f05eec57aaa0 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.149893 Jul 14 14:39:21.434761 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1458/2923] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:39:21 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:21.450416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b57442e1-5b4f-4c03-ae20-e832e8423ceb tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Calling method '.version_select at 0x7fd6cad0be50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:21.462190 n-d-767704-28 devstack@n-api.service[119511]: WARNING oslo_db.sqlalchemy.utils [None req-b57442e1-5b4f-4c03-ae20-e832e8423ceb tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 14 14:39:21.485767 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b57442e1-5b4f-4c03-ae20-e832e8423ceb tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.041571 Jul 14 14:39:21.487829 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1466/2924] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:39:21 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:21.501677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-64cbd98a-9f30-42d9-8be7-9a88b06c8463 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Calling method '.version_select at 0x7fd6c5b9b9d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:21.580076 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-64cbd98a-9f30-42d9-8be7-9a88b06c8463 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-685386497" status: 202 len: 0 microversion: 2.1 time: 0.082393 Jul 14 14:39:21.583823 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1459/2925] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:39:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-685386497 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:39:21.591851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77adb453-c36f-4f4f-9173-7732c807ab23 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Calling method '.version_select at 0x7fd6c5e3ec10>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:21.630445 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-77adb453-c36f-4f4f-9173-7732c807ab23 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-164425404" status: 202 len: 0 microversion: 2.1 time: 0.042270 Jul 14 14:39:21.632849 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1467/2926] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:39:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-164425404 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:39:21.650563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-00f1b08b-02b4-408a-862f-f97ccdb5ae93 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] Calling method '.version_select at 0x7fd6c5005430>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:21.711135 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-00f1b08b-02b4-408a-862f-f97ccdb5ae93 tempest-KeyPairsV2TestJSON-1311440050 tempest-KeyPairsV2TestJSON-1311440050-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2011244283" status: 202 len: 0 microversion: 2.1 time: 0.071039 Jul 14 14:39:21.718453 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1460/2927] 10.222.0.81 () {58 vars in 1277 bytes} [Thu Jul 14 14:39:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2011244283 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:39:22.450975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-db947ed1-1908-40d2-9cf6-4ee70de44945 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:22.456023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-db947ed1-1908-40d2-9cf6-4ee70de44945 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:22.536381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db947ed1-1908-40d2-9cf6-4ee70de44945 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:22.537549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db947ed1-1908-40d2-9cf6-4ee70de44945 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:22.540546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db947ed1-1908-40d2-9cf6-4ee70de44945 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:22.543985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db947ed1-1908-40d2-9cf6-4ee70de44945 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:22.871321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-db947ed1-1908-40d2-9cf6-4ee70de44945 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:22.888372 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-db947ed1-1908-40d2-9cf6-4ee70de44945 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1171 microversion: 2.1 time: 0.447262 Jul 14 14:39:22.891306 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1468/2928] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:22 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1171 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:23.907839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2390a3e0-f8fd-4d3a-9eb7-fc46f59061e4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:23.908897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2390a3e0-f8fd-4d3a-9eb7-fc46f59061e4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:23.920378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2390a3e0-f8fd-4d3a-9eb7-fc46f59061e4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:23.922946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2390a3e0-f8fd-4d3a-9eb7-fc46f59061e4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:23.923976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2390a3e0-f8fd-4d3a-9eb7-fc46f59061e4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:23.924436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2390a3e0-f8fd-4d3a-9eb7-fc46f59061e4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:24.330992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2390a3e0-f8fd-4d3a-9eb7-fc46f59061e4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:24.340584 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2390a3e0-f8fd-4d3a-9eb7-fc46f59061e4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1237 microversion: 2.1 time: 0.437504 Jul 14 14:39:24.344892 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1461/2929] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:23 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1237 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:25.365314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bafd1916-da67-408d-9f7d-7d9a531fa046 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:25.365938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bafd1916-da67-408d-9f7d-7d9a531fa046 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:25.380067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bafd1916-da67-408d-9f7d-7d9a531fa046 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:25.380778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bafd1916-da67-408d-9f7d-7d9a531fa046 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:25.381774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bafd1916-da67-408d-9f7d-7d9a531fa046 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:25.385014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bafd1916-da67-408d-9f7d-7d9a531fa046 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:25.698746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bafd1916-da67-408d-9f7d-7d9a531fa046 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:25.714173 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bafd1916-da67-408d-9f7d-7d9a531fa046 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1237 microversion: 2.1 time: 0.352824 Jul 14 14:39:25.714774 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1469/2930] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:25 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1237 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:26.732121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-78e06024-e43a-4548-ba41-4c87d561293d tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:26.734959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-78e06024-e43a-4548-ba41-4c87d561293d tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:26.760855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78e06024-e43a-4548-ba41-4c87d561293d tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:26.764222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78e06024-e43a-4548-ba41-4c87d561293d tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:26.769350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78e06024-e43a-4548-ba41-4c87d561293d tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:26.770227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78e06024-e43a-4548-ba41-4c87d561293d tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:27.032561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-78e06024-e43a-4548-ba41-4c87d561293d tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:27.052605 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-78e06024-e43a-4548-ba41-4c87d561293d tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1237 microversion: 2.1 time: 0.325179 Jul 14 14:39:27.059924 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1470/2931] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:26 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1237 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:27.228588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a238eaaf-8757-4fe9-ac34-65e0c1b479f1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'create', calling method: .version_select at 0x7fd6c5a30430>, body: {"keypair": {"name": "tempest-keypair-1735912081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+0J7bbRzbe4NA2edBM0/XxiaC38pLGlh1N0aQjxWQMVKkbiWCsWDHHq2QcUwf1M5nGLB2LVrJsHXIUfTZL7M6mdtjVqG7/zNkvMvZxhxxcrISZ0ef9+4FTgfMAe19hLg=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:27.264311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:27.339584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a238eaaf-8757-4fe9-ac34-65e0c1b479f1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Getting quotas for project 1933006fa13c44ae9128f00267210152. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:27.356751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a238eaaf-8757-4fe9-ac34-65e0c1b479f1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Getting quotas for user f157150edd1d441aa2c7335dbb2363ca and project 1933006fa13c44ae9128f00267210152. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:27.436407 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a238eaaf-8757-4fe9-ac34-65e0c1b479f1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.037116 Jul 14 14:39:27.441443 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1462/2932] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:39:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:28.098531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4cf6596b-d632-4a1f-a85e-3e2ae9158fde tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:28.104103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4cf6596b-d632-4a1f-a85e-3e2ae9158fde tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:28.167382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4cf6596b-d632-4a1f-a85e-3e2ae9158fde tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:28.171048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4cf6596b-d632-4a1f-a85e-3e2ae9158fde tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:28.177534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4cf6596b-d632-4a1f-a85e-3e2ae9158fde tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:28.182488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4cf6596b-d632-4a1f-a85e-3e2ae9158fde tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:28.701159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4cf6596b-d632-4a1f-a85e-3e2ae9158fde tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:28.711657 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4cf6596b-d632-4a1f-a85e-3e2ae9158fde tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1305 microversion: 2.1 time: 0.622444 Jul 14 14:39:28.713342 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1471/2933] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:28 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1305 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:29.730814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c22add10-01b6-4761-a720-9449018d7094 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:29.732683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c22add10-01b6-4761-a720-9449018d7094 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:29.759354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c22add10-01b6-4761-a720-9449018d7094 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:29.761169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c22add10-01b6-4761-a720-9449018d7094 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:29.766482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c22add10-01b6-4761-a720-9449018d7094 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:29.767170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c22add10-01b6-4761-a720-9449018d7094 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:31.469072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c22add10-01b6-4761-a720-9449018d7094 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:31.504891 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c22add10-01b6-4761-a720-9449018d7094 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1305 microversion: 2.1 time: 1.778916 Jul 14 14:39:31.506433 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1463/2934] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:29 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1305 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:32.523727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a365b768-62b2-461f-8b82-6c0ce5c1fadc tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:32.524383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a365b768-62b2-461f-8b82-6c0ce5c1fadc tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:32.535045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:32.535818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:32.539469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a365b768-62b2-461f-8b82-6c0ce5c1fadc tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:32.541564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a365b768-62b2-461f-8b82-6c0ce5c1fadc tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:32.542618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a365b768-62b2-461f-8b82-6c0ce5c1fadc tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:32.549688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a365b768-62b2-461f-8b82-6c0ce5c1fadc tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:33.576504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a365b768-62b2-461f-8b82-6c0ce5c1fadc tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:33.588869 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a365b768-62b2-461f-8b82-6c0ce5c1fadc tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1305 microversion: 2.1 time: 1.069933 Jul 14 14:39:33.595071 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1472/2935] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:32 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1305 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:39:33.946670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ddd417be-db78-46c8-9aa9-07111730791b req-b36d145d-3bbc-46dc-8365-df6d91dcc800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7de27ce5-f75f-47eb-8dee-2a9d98e103f5", "tag": "63549d3b-cf27-4f40-93e4-ba05e71f3d8f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:33.996230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ddd417be-db78-46c8-9aa9-07111730791b req-b36d145d-3bbc-46dc-8365-df6d91dcc800 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:33.996696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ddd417be-db78-46c8-9aa9-07111730791b req-b36d145d-3bbc-46dc-8365-df6d91dcc800 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:34.047582 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ddd417be-db78-46c8-9aa9-07111730791b req-b36d145d-3bbc-46dc-8365-df6d91dcc800 service nova] Creating event network-changed:63549d3b-cf27-4f40-93e4-ba05e71f3d8f for instance 7de27ce5-f75f-47eb-8dee-2a9d98e103f5 on n-h1-767704-28 Jul 14 14:39:34.059835 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ddd417be-db78-46c8-9aa9-07111730791b req-b36d145d-3bbc-46dc-8365-df6d91dcc800 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120593 Jul 14 14:39:34.060532 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1464/2936] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:34.585683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1794439196", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05e588dd-ea85-4edc-9918-44620e736097"}], "security_groups": [{"name": "tempest-securitygroup--1045417000"}], "key_name": "tempest-keypair-1735912081", "user_data": "}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:34.613925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c9e377cb-ebfb-4e2c-8161-5540b13a7cc1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:34.614724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c9e377cb-ebfb-4e2c-8161-5540b13a7cc1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:34.629558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9e377cb-ebfb-4e2c-8161-5540b13a7cc1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:34.634102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9e377cb-ebfb-4e2c-8161-5540b13a7cc1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:34.635244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9e377cb-ebfb-4e2c-8161-5540b13a7cc1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:34.635900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9e377cb-ebfb-4e2c-8161-5540b13a7cc1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:35.380234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] validate_networks() for [('05e588dd-ea85-4edc-9918-44620e736097', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:39:36.031556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c9e377cb-ebfb-4e2c-8161-5540b13a7cc1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:36.046074 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c9e377cb-ebfb-4e2c-8161-5540b13a7cc1 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1305 microversion: 2.1 time: 1.436505 Jul 14 14:39:36.046613 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1465/2937] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:34 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1305 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:37.063680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b4a9761a-dce9-4fa2-905c-9bbc6b148792 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:37.064673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b4a9761a-dce9-4fa2-905c-9bbc6b148792 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:37.082033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b4a9761a-dce9-4fa2-905c-9bbc6b148792 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:37.082812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b4a9761a-dce9-4fa2-905c-9bbc6b148792 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:37.084560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b4a9761a-dce9-4fa2-905c-9bbc6b148792 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:37.085910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b4a9761a-dce9-4fa2-905c-9bbc6b148792 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:37.393880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=28 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:38.154074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b4a9761a-dce9-4fa2-905c-9bbc6b148792 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:38.182804 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b4a9761a-dce9-4fa2-905c-9bbc6b148792 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1293 microversion: 2.1 time: 1.122924 Jul 14 14:39:38.183761 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1466/2938] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:37 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1293 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:39.011352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:39:39.012662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:39:39.013654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:39:39.014901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:39:39.015599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:39:39.043174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:39.043887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:39.044871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:39.045531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:39.095292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Getting quotas for project 1933006fa13c44ae9128f00267210152. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:39.110069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Getting quotas for user f157150edd1d441aa2c7335dbb2363ca and project 1933006fa13c44ae9128f00267210152. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:39.126675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:39:39.130006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:39:39.199830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d0de224a-936f-48c1-b55a-eecb6f928905 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:39.201446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d0de224a-936f-48c1-b55a-eecb6f928905 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:39.213650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0de224a-936f-48c1-b55a-eecb6f928905 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:39.214374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0de224a-936f-48c1-b55a-eecb6f928905 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:39.218235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0de224a-936f-48c1-b55a-eecb6f928905 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:39.218964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0de224a-936f-48c1-b55a-eecb6f928905 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:39.231646 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ec560556-0989-4735-8e0a-ca1c07de7908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.661133 Jul 14 14:39:39.232998 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1473/2939] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:39:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 4663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:39:39.244449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d20cc090-1f7c-4103-9ee9-fcb193966844 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:39.245609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d20cc090-1f7c-4103-9ee9-fcb193966844 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:39.821876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d20cc090-1f7c-4103-9ee9-fcb193966844 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:39.853793 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d20cc090-1f7c-4103-9ee9-fcb193966844 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1239 microversion: 2.1 time: 0.614885 Jul 14 14:39:39.861313 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1474/2940] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:39 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1239 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:40.882980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-69c05e1b-c100-4f21-bded-bc01d183d468 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:40.883745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-69c05e1b-c100-4f21-bded-bc01d183d468 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:40.896026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69c05e1b-c100-4f21-bded-bc01d183d468 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:40.900441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69c05e1b-c100-4f21-bded-bc01d183d468 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:40.903160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69c05e1b-c100-4f21-bded-bc01d183d468 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:40.903745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69c05e1b-c100-4f21-bded-bc01d183d468 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:41.023940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d0de224a-936f-48c1-b55a-eecb6f928905 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:41.048358 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d0de224a-936f-48c1-b55a-eecb6f928905 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1293 microversion: 2.1 time: 1.850617 Jul 14 14:39:41.051464 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1467/2941] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:39 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1293 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:41.077229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-69c05e1b-c100-4f21-bded-bc01d183d468 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:41.090158 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-69c05e1b-c100-4f21-bded-bc01d183d468 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1291 microversion: 2.1 time: 0.216013 Jul 14 14:39:41.097941 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1475/2942] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:40 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1291 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:42.071233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-45d63546-afa2-46b6-bdab-619f8492e222 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:42.073741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-45d63546-afa2-46b6-bdab-619f8492e222 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:42.085735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-45d63546-afa2-46b6-bdab-619f8492e222 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:42.086590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-45d63546-afa2-46b6-bdab-619f8492e222 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:42.088362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-45d63546-afa2-46b6-bdab-619f8492e222 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:42.091009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-45d63546-afa2-46b6-bdab-619f8492e222 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:42.118485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a09f5006-d823-4a44-aada-65d0ec118ce1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:42.119509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a09f5006-d823-4a44-aada-65d0ec118ce1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:42.136677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a09f5006-d823-4a44-aada-65d0ec118ce1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:42.138292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a09f5006-d823-4a44-aada-65d0ec118ce1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:42.139445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a09f5006-d823-4a44-aada-65d0ec118ce1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:42.140143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a09f5006-d823-4a44-aada-65d0ec118ce1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:42.544079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a09f5006-d823-4a44-aada-65d0ec118ce1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:42.556371 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a09f5006-d823-4a44-aada-65d0ec118ce1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1297 microversion: 2.1 time: 0.444925 Jul 14 14:39:42.557793 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1476/2943] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:42 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1297 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:39:43.030287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-45d63546-afa2-46b6-bdab-619f8492e222 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:43.045863 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-45d63546-afa2-46b6-bdab-619f8492e222 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1293 microversion: 2.1 time: 0.982298 Jul 14 14:39:43.046887 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1468/2944] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:42 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1293 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:43.574306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39cbaab9-6a98-48ad-b689-12d0da0e5302 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:43.575101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-39cbaab9-6a98-48ad-b689-12d0da0e5302 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:43.587506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39cbaab9-6a98-48ad-b689-12d0da0e5302 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:43.594180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39cbaab9-6a98-48ad-b689-12d0da0e5302 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:43.595272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39cbaab9-6a98-48ad-b689-12d0da0e5302 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:43.595922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39cbaab9-6a98-48ad-b689-12d0da0e5302 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:43.876547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-39cbaab9-6a98-48ad-b689-12d0da0e5302 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:43.887547 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-39cbaab9-6a98-48ad-b689-12d0da0e5302 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1297 microversion: 2.1 time: 0.317379 Jul 14 14:39:43.889712 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1477/2945] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:43 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1297 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:44.077437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c6e233b9-0eee-4dc2-bea2-8b10e01fed71 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:44.080731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c6e233b9-0eee-4dc2-bea2-8b10e01fed71 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:44.096567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6e233b9-0eee-4dc2-bea2-8b10e01fed71 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:44.097717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6e233b9-0eee-4dc2-bea2-8b10e01fed71 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:44.099389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6e233b9-0eee-4dc2-bea2-8b10e01fed71 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:44.100799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6e233b9-0eee-4dc2-bea2-8b10e01fed71 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:44.908736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-002733d1-10e4-492a-8cfd-b3b4d314b556 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:44.910961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-002733d1-10e4-492a-8cfd-b3b4d314b556 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:44.924760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-002733d1-10e4-492a-8cfd-b3b4d314b556 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:44.927679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-002733d1-10e4-492a-8cfd-b3b4d314b556 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:44.930088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-002733d1-10e4-492a-8cfd-b3b4d314b556 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:44.932575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-002733d1-10e4-492a-8cfd-b3b4d314b556 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:45.902830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c6e233b9-0eee-4dc2-bea2-8b10e01fed71 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:45.921974 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c6e233b9-0eee-4dc2-bea2-8b10e01fed71 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1293 microversion: 2.1 time: 1.858582 Jul 14 14:39:45.923427 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1469/2946] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:44 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1293 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:46.056325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-002733d1-10e4-492a-8cfd-b3b4d314b556 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:46.091334 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-002733d1-10e4-492a-8cfd-b3b4d314b556 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1297 microversion: 2.1 time: 1.187407 Jul 14 14:39:46.105736 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1478/2947] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:44 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1297 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:39:46.943463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-209f2ae3-4222-4281-af4e-582b6aaf419a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:46.944587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-209f2ae3-4222-4281-af4e-582b6aaf419a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:46.956939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-209f2ae3-4222-4281-af4e-582b6aaf419a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:46.966352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-209f2ae3-4222-4281-af4e-582b6aaf419a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:46.967252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-209f2ae3-4222-4281-af4e-582b6aaf419a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:46.967701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-209f2ae3-4222-4281-af4e-582b6aaf419a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:47.125297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4d010c32-e9e2-43f3-98ce-1374fe1a474f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:47.129962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4d010c32-e9e2-43f3-98ce-1374fe1a474f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:47.159464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d010c32-e9e2-43f3-98ce-1374fe1a474f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:47.165718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d010c32-e9e2-43f3-98ce-1374fe1a474f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:47.171426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d010c32-e9e2-43f3-98ce-1374fe1a474f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:47.176127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d010c32-e9e2-43f3-98ce-1374fe1a474f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:48.873548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4d010c32-e9e2-43f3-98ce-1374fe1a474f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:48.880585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=63 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:48.886406 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4d010c32-e9e2-43f3-98ce-1374fe1a474f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1365 microversion: 2.1 time: 1.766831 Jul 14 14:39:48.890213 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1479/2948] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:47 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1365 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:48.974167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-209f2ae3-4222-4281-af4e-582b6aaf419a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:48.997605 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-209f2ae3-4222-4281-af4e-582b6aaf419a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1293 microversion: 2.1 time: 2.059564 Jul 14 14:39:49.000785 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1470/2949] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:46 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1293 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:49.745596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d866665f-3939-4568-8a07-8e321b8e3b5b req-8865882f-7258-42a9-8e47-137508277d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de27ce5-f75f-47eb-8dee-2a9d98e103f5", "name": "network-vif-plugged", "status": "completed", "tag": "63549d3b-cf27-4f40-93e4-ba05e71f3d8f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:49.755167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:49.758209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:49.785557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d866665f-3939-4568-8a07-8e321b8e3b5b req-8865882f-7258-42a9-8e47-137508277d46 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:49.786335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d866665f-3939-4568-8a07-8e321b8e3b5b req-8865882f-7258-42a9-8e47-137508277d46 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:49.816458 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d866665f-3939-4568-8a07-8e321b8e3b5b req-8865882f-7258-42a9-8e47-137508277d46 service nova] Creating event network-vif-plugged:63549d3b-cf27-4f40-93e4-ba05e71f3d8f for instance 7de27ce5-f75f-47eb-8dee-2a9d98e103f5 on n-h1-767704-28 Jul 14 14:39:49.823845 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d866665f-3939-4568-8a07-8e321b8e3b5b req-8865882f-7258-42a9-8e47-137508277d46 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082828 Jul 14 14:39:49.825205 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1480/2950] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:49.911499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-28946b6a-6137-4f9e-8dac-6d3d232afba0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:49.912274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-28946b6a-6137-4f9e-8dac-6d3d232afba0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:49.924053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28946b6a-6137-4f9e-8dac-6d3d232afba0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:49.924518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28946b6a-6137-4f9e-8dac-6d3d232afba0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:49.930112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28946b6a-6137-4f9e-8dac-6d3d232afba0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:49.933547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28946b6a-6137-4f9e-8dac-6d3d232afba0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:49.993421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=51 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:50.017900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:50.025623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6fd8fb54-ba78-4a94-857f-783aa6d385d5 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:50.027033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6fd8fb54-ba78-4a94-857f-783aa6d385d5 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:50.040340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fd8fb54-ba78-4a94-857f-783aa6d385d5 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:50.041268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fd8fb54-ba78-4a94-857f-783aa6d385d5 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:50.042549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fd8fb54-ba78-4a94-857f-783aa6d385d5 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:50.043512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fd8fb54-ba78-4a94-857f-783aa6d385d5 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:51.034808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-28946b6a-6137-4f9e-8dac-6d3d232afba0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:51.047895 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-28946b6a-6137-4f9e-8dac-6d3d232afba0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1365 microversion: 2.1 time: 1.140520 Jul 14 14:39:51.058519 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1471/2951] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:49 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1365 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:51.064370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a829b67a-b390-40ef-9375-12b1f6863103 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Action: 'create', calling method: .version_select at 0x7fd6c4fc3c10>, body: {"keypair": {"name": "tempest-keypair-1318752447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh+XucX/GWhTzOHYNCo8e7XSUQgyxXJWrqgQiniL/10Dvto+aNs59NP1VxNUOjZcY5BvZcnxf+xAoVoK58i/WtBI9WL2OKlYr62I+yo5BepsYA7dp1Bv6yAbbigh4bmsQ=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:51.072403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6fd8fb54-ba78-4a94-857f-783aa6d385d5 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:51.091288 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6fd8fb54-ba78-4a94-857f-783aa6d385d5 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1293 microversion: 2.1 time: 1.071891 Jul 14 14:39:51.094222 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1481/2952] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:50 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1293 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:39:51.121440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a829b67a-b390-40ef-9375-12b1f6863103 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Getting quotas for project 5eb8f7dedbf34c44922ce681e837045d. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:51.136460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a829b67a-b390-40ef-9375-12b1f6863103 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Getting quotas for user 53dc8a2925ac47dfa2b9518242f99370 and project 5eb8f7dedbf34c44922ce681e837045d. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:51.184998 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a829b67a-b390-40ef-9375-12b1f6863103 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.135249 Jul 14 14:39:51.186214 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1472/2953] 10.222.0.81 () {62 vars in 1199 bytes} [Thu Jul 14 14:39:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:39:51.829850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-80b9069e-5ccf-461e-ac4e-27deed1aa912 req-5817ffd9-138e-4b01-9307-0355d1a9481d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b55c122-95db-42f1-95a9-ae5bbb4ff958", "tag": "b14caf9c-97a3-483c-92a9-d43af26af98c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:51.854177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-80b9069e-5ccf-461e-ac4e-27deed1aa912 req-5817ffd9-138e-4b01-9307-0355d1a9481d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:51.854998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-80b9069e-5ccf-461e-ac4e-27deed1aa912 req-5817ffd9-138e-4b01-9307-0355d1a9481d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:51.915152 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-80b9069e-5ccf-461e-ac4e-27deed1aa912 req-5817ffd9-138e-4b01-9307-0355d1a9481d service nova] Creating event network-changed:b14caf9c-97a3-483c-92a9-d43af26af98c for instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 on n-h2-767704-28 Jul 14 14:39:51.939579 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-80b9069e-5ccf-461e-ac4e-27deed1aa912 req-5817ffd9-138e-4b01-9307-0355d1a9481d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110440 Jul 14 14:39:51.940449 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1482/2954] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:52.068261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd7f291d-b4d1-49cb-b4bf-117d02ae7930 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:52.074569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bd7f291d-b4d1-49cb-b4bf-117d02ae7930 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:52.098917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd7f291d-b4d1-49cb-b4bf-117d02ae7930 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:52.102481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd7f291d-b4d1-49cb-b4bf-117d02ae7930 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:52.105509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd7f291d-b4d1-49cb-b4bf-117d02ae7930 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:52.106747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd7f291d-b4d1-49cb-b4bf-117d02ae7930 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:52.112888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f184e0a-42f8-404c-8989-e468f0b8bc47 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:52.113809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1f184e0a-42f8-404c-8989-e468f0b8bc47 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:52.131885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f184e0a-42f8-404c-8989-e468f0b8bc47 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:52.135808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f184e0a-42f8-404c-8989-e468f0b8bc47 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:52.136591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f184e0a-42f8-404c-8989-e468f0b8bc47 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:52.140701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f184e0a-42f8-404c-8989-e468f0b8bc47 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:52.793349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bd7f291d-b4d1-49cb-b4bf-117d02ae7930 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:52.801912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1f184e0a-42f8-404c-8989-e468f0b8bc47 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:52.807942 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bd7f291d-b4d1-49cb-b4bf-117d02ae7930 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1365 microversion: 2.1 time: 0.739487 Jul 14 14:39:52.818224 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f184e0a-42f8-404c-8989-e468f0b8bc47 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1293 microversion: 2.1 time: 0.707262 Jul 14 14:39:52.819804 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1473/2955] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:52 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1365 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:52.826265 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1483/2956] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:52 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1293 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:53.827322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8213ab8a-b4ee-49e1-bf7f-03fec603f931 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:53.827322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8213ab8a-b4ee-49e1-bf7f-03fec603f931 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:53.837215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-82d9309c-0d6a-4ccf-88a3-d8870a48a9fb tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:53.840713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8213ab8a-b4ee-49e1-bf7f-03fec603f931 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:53.841222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8213ab8a-b4ee-49e1-bf7f-03fec603f931 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:53.841505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-82d9309c-0d6a-4ccf-88a3-d8870a48a9fb tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:53.844295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8213ab8a-b4ee-49e1-bf7f-03fec603f931 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:53.847822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8213ab8a-b4ee-49e1-bf7f-03fec603f931 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:53.859770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82d9309c-0d6a-4ccf-88a3-d8870a48a9fb tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:53.862075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82d9309c-0d6a-4ccf-88a3-d8870a48a9fb tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:53.868103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82d9309c-0d6a-4ccf-88a3-d8870a48a9fb tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:53.869533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82d9309c-0d6a-4ccf-88a3-d8870a48a9fb tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:54.538852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8213ab8a-b4ee-49e1-bf7f-03fec603f931 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:54.552512 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8213ab8a-b4ee-49e1-bf7f-03fec603f931 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1365 microversion: 2.1 time: 0.729063 Jul 14 14:39:54.556136 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1474/2957] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:53 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1365 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:54.561654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-82d9309c-0d6a-4ccf-88a3-d8870a48a9fb tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:54.571794 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-82d9309c-0d6a-4ccf-88a3-d8870a48a9fb tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1484 microversion: 2.1 time: 0.741912 Jul 14 14:39:54.575969 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1484/2958] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:53 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1484 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:39:54.604667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b2cf8766-6a8a-4a22-841c-068e746d3462 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:54.605835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b2cf8766-6a8a-4a22-841c-068e746d3462 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:54.614314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2cf8766-6a8a-4a22-841c-068e746d3462 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:54.618279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2cf8766-6a8a-4a22-841c-068e746d3462 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:54.619677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2cf8766-6a8a-4a22-841c-068e746d3462 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:54.620424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2cf8766-6a8a-4a22-841c-068e746d3462 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:54.891704 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b2cf8766-6a8a-4a22-841c-068e746d3462 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.293252 Jul 14 14:39:54.892712 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1475/2959] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:39:54 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5/os-interface => generated 284 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:54.937685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-173900408", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8c448ce4-e55f-491a-840c-8d1ab5d30cec"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:55.003460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] validate_networks() for [('8c448ce4-e55f-491a-840c-8d1ab5d30cec', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:39:55.572720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ee03a36d-d87c-459e-a03b-5c4cd526529c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:55.573735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ee03a36d-d87c-459e-a03b-5c4cd526529c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:55.585223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee03a36d-d87c-459e-a03b-5c4cd526529c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:55.586117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee03a36d-d87c-459e-a03b-5c4cd526529c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:55.587154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee03a36d-d87c-459e-a03b-5c4cd526529c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:55.589269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee03a36d-d87c-459e-a03b-5c4cd526529c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:56.368046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ee03a36d-d87c-459e-a03b-5c4cd526529c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:56.396425 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ee03a36d-d87c-459e-a03b-5c4cd526529c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1365 microversion: 2.1 time: 0.826288 Jul 14 14:39:56.400754 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1476/2960] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:55 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1365 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:39:56.533061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:39:56.533579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:39:56.535162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:39:56.535634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:39:56.536198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:39:56.576169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:56.577031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:56.578065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:56.578664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:56.622884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Getting quotas for project bfc4a794988d4bfd9e3566a815233828. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:56.631054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Getting quotas for user 5ea6d3737ade48b28caa4de080a83bea and project bfc4a794988d4bfd9e3566a815233828. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:56.655590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Going to run 2 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:39:56.659324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: a7af3bd7-3948-4f54-acb6-feca9e054bd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:39:56.714187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=a7af3bd7-3948-4f54-acb6-feca9e054bd0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:39:56.836192 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d9686258-db89-4884-8d1b-dde384769f9b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.122289 Jul 14 14:39:56.837961 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1485/2961] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:39:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:39:56.852401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7a6626e8-4b9b-47ff-ac6a-6d51e01fb63a tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:56.856630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7a6626e8-4b9b-47ff-ac6a-6d51e01fb63a tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:56.857636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7a6626e8-4b9b-47ff-ac6a-6d51e01fb63a tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Searching by: {'deleted': False, 'project_id': 'bfc4a794988d4bfd9e3566a815233828'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:39:56.910163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a6626e8-4b9b-47ff-ac6a-6d51e01fb63a tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:56.911258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a6626e8-4b9b-47ff-ac6a-6d51e01fb63a tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:56.913186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a6626e8-4b9b-47ff-ac6a-6d51e01fb63a tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:56.913905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a6626e8-4b9b-47ff-ac6a-6d51e01fb63a tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:56.953994 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7a6626e8-4b9b-47ff-ac6a-6d51e01fb63a tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.107154 Jul 14 14:39:56.978003 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1477/2962] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 14:39:56 2022] GET /compute/v2.1/servers => generated 675 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:56.988229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e59f8315-c60b-432b-a4fa-b7ffa581c1bb tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:56.989408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e59f8315-c60b-432b-a4fa-b7ffa581c1bb tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:57.345893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e59f8315-c60b-432b-a4fa-b7ffa581c1bb tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:57.355278 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e59f8315-c60b-432b-a4fa-b7ffa581c1bb tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b" status: 200 len: 1219 microversion: 2.1 time: 0.383919 Jul 14 14:39:57.361750 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1486/2963] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:56 2022] GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b => generated 1219 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:57.416422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a9a96a4d-39ca-4434-989a-ff8ea309db98 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:57.417085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a9a96a4d-39ca-4434-989a-ff8ea309db98 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:57.426228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:57.429995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9a96a4d-39ca-4434-989a-ff8ea309db98 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:57.430515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9a96a4d-39ca-4434-989a-ff8ea309db98 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:57.431343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9a96a4d-39ca-4434-989a-ff8ea309db98 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:57.434130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9a96a4d-39ca-4434-989a-ff8ea309db98 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:57.725811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cd30716e-ca2a-4e18-bd8c-67a6fbb67f30 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c5a2aee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1351106440", "description": "tempest-description-832790551"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:57.886315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a9a96a4d-39ca-4434-989a-ff8ea309db98 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:57.900343 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a9a96a4d-39ca-4434-989a-ff8ea309db98 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1365 microversion: 2.1 time: 0.488096 Jul 14 14:39:57.900987 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1478/2964] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:57 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1365 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:58.258847 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cd30716e-ca2a-4e18-bd8c-67a6fbb67f30 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.682758 Jul 14 14:39:58.260018 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1487/2965] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:39:57 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:39:58.271554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-074ce660-2800-4bf1-9817-e30c8a5bd582 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c501a040>, body: {"security_group_rule": {"parent_group_id": "278e6f20-f857-4f27-b5b8-de58e23f9724", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:58.387490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-91611878-c3ef-4129-a7c4-b84370fd5858 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:58.388123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-91611878-c3ef-4129-a7c4-b84370fd5858 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:58.417728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91611878-c3ef-4129-a7c4-b84370fd5858 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:58.418197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91611878-c3ef-4129-a7c4-b84370fd5858 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:58.420365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91611878-c3ef-4129-a7c4-b84370fd5858 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:58.420828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91611878-c3ef-4129-a7c4-b84370fd5858 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:59.618277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-91611878-c3ef-4129-a7c4-b84370fd5858 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:59.635608 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-91611878-c3ef-4129-a7c4-b84370fd5858 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b" status: 200 len: 1223 microversion: 2.1 time: 1.259844 Jul 14 14:39:59.637645 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1488/2966] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:58 2022] GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b => generated 1223 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:39:59.644406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e8965d08-2c16-4f41-8eff-cb9ac39cdcf7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:59.645453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e8965d08-2c16-4f41-8eff-cb9ac39cdcf7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:59.658044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8965d08-2c16-4f41-8eff-cb9ac39cdcf7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:59.659105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8965d08-2c16-4f41-8eff-cb9ac39cdcf7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:59.661594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8965d08-2c16-4f41-8eff-cb9ac39cdcf7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:59.663306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8965d08-2c16-4f41-8eff-cb9ac39cdcf7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:00.473755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e8965d08-2c16-4f41-8eff-cb9ac39cdcf7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:00.491980 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e8965d08-2c16-4f41-8eff-cb9ac39cdcf7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1365 microversion: 2.1 time: 0.849815 Jul 14 14:40:00.502045 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1489/2967] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:59 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1365 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:00.512220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-346532016", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "daccc02b-44c7-41ec-9585-3ce66dffb1d5"}, {"port": "6d8c96b9-5962-4646-ba07-34e1518619fa", "tag": "port-1"}, {"port": "7014e99c-e595-47e8-980b-489824ecb7f8", "tag": "port-2"}, {"uuid": "1f208963-b920-498a-adc8-3479506f3bc6", "tag": "net-1"}, {"uuid": "1f208963-b920-498a-adc8-3479506f3bc6"}, {"uuid": "72954340-ab98-4ac2-aa9b-8a8c961ec162", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "72954340-ab98-4ac2-aa9b-8a8c961ec162", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ed5792af-0697-4dc4-9e98-0dfc75460892", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "25d31229-c0bb-421f-8904-c3820df465f8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a902c398-1e05-4e7c-a6cd-f3a30a5c5e62", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1561134422"}], "key_name": "tempest-keypair-1318752447", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:00.698866 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-074ce660-2800-4bf1-9817-e30c8a5bd582 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.430708 Jul 14 14:40:00.705787 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1479/2968] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:39:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:00.710893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd81d423-fcd8-4263-b37c-c0f79835c9f6 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:00.711570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cd81d423-fcd8-4263-b37c-c0f79835c9f6 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:00.745771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd81d423-fcd8-4263-b37c-c0f79835c9f6 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:00.746391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd81d423-fcd8-4263-b37c-c0f79835c9f6 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:00.747464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd81d423-fcd8-4263-b37c-c0f79835c9f6 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:00.747916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd81d423-fcd8-4263-b37c-c0f79835c9f6 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:01.069886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] validate_networks() for [('daccc02b-44c7-41ec-9585-3ce66dffb1d5', None, None, None, None, None), (None, None, '6d8c96b9-5962-4646-ba07-34e1518619fa', None, None, None), (None, None, '7014e99c-e595-47e8-980b-489824ecb7f8', None, None, None), ('1f208963-b920-498a-adc8-3479506f3bc6', None, None, None, None, None), ('1f208963-b920-498a-adc8-3479506f3bc6', None, None, None, None, None), ('72954340-ab98-4ac2-aa9b-8a8c961ec162', '10.2.2.100', None, None, None, None), ('72954340-ab98-4ac2-aa9b-8a8c961ec162', '10.2.2.200', None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:40:01.156202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:01.706783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cd81d423-fcd8-4263-b37c-c0f79835c9f6 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:01.729365 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cd81d423-fcd8-4263-b37c-c0f79835c9f6 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1484 microversion: 2.1 time: 1.019447 Jul 14 14:40:01.732512 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1480/2969] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:00 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1484 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:01.822548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5d649081-7287-4bc9-9a5b-cba38f615766 req-6639c934-8dd9-497d-af14-2c7f45be7788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7de27ce5-f75f-47eb-8dee-2a9d98e103f5", "tag": "63549d3b-cf27-4f40-93e4-ba05e71f3d8f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:01.857710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5d649081-7287-4bc9-9a5b-cba38f615766 req-6639c934-8dd9-497d-af14-2c7f45be7788 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:01.859990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5d649081-7287-4bc9-9a5b-cba38f615766 req-6639c934-8dd9-497d-af14-2c7f45be7788 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:01.927294 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5d649081-7287-4bc9-9a5b-cba38f615766 req-6639c934-8dd9-497d-af14-2c7f45be7788 service nova] Creating event network-changed:63549d3b-cf27-4f40-93e4-ba05e71f3d8f for instance 7de27ce5-f75f-47eb-8dee-2a9d98e103f5 on n-h1-767704-28 Jul 14 14:40:01.948809 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5d649081-7287-4bc9-9a5b-cba38f615766 req-6639c934-8dd9-497d-af14-2c7f45be7788 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213777 Jul 14 14:40:01.953271 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1481/2970] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:01.979688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c13b9302-c9b8-4ff7-99e1-b6f3532bb9a3 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:01.980418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c13b9302-c9b8-4ff7-99e1-b6f3532bb9a3 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:02.007384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c13b9302-c9b8-4ff7-99e1-b6f3532bb9a3 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:02.009592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c13b9302-c9b8-4ff7-99e1-b6f3532bb9a3 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:02.013225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c13b9302-c9b8-4ff7-99e1-b6f3532bb9a3 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:02.014064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c13b9302-c9b8-4ff7-99e1-b6f3532bb9a3 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:02.242588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c13b9302-c9b8-4ff7-99e1-b6f3532bb9a3 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:02.255514 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c13b9302-c9b8-4ff7-99e1-b6f3532bb9a3 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b" status: 200 len: 1277 microversion: 2.1 time: 0.300920 Jul 14 14:40:02.277412 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1482/2971] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:01 2022] GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b => generated 1277 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:02.296014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-782e5a8e-a9ec-4ebc-9b92-e1b576ae3722 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c5005dc0>, body: {"security_group_rule": {"parent_group_id": "278e6f20-f857-4f27-b5b8-de58e23f9724", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:02.569612 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-782e5a8e-a9ec-4ebc-9b92-e1b576ae3722 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] HTTP exception thrown: This rule already exists in group 278e6f20-f857-4f27-b5b8-de58e23f9724 Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-782e5a8e-a9ec-4ebc-9b92-e1b576ae3722 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Request method failure captured: Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 138 Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cq9AH5mKN2a_Z_cEZK2AYF9faMXLF0sKknsxQ77Slt_PSFloqPn8NvGtkgmfgeY14C_hf20QqT9TwZ7S4OhSfv7CxaanVFVuTr-8BOEncSLNOqD27jb13DkXDnDItrJ5YgAeseZ_wci5YaJvcGMuNwFKjP4p5xGwwQitYXfoOL-5js Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d73e699372e24ef28ea309f067bf141e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}] Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: aeddb2fef49e4d8fbe0221a9574adfdc Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: {"security_group_rule": {"parent_group_id": "278e6f20-f857-4f27-b5b8-de58e23f9724", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: exception: This rule already exists in group 278e6f20-f857-4f27-b5b8-de58e23f9724 Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'security_group_rule': {'parent_group_id': '278e6f20-f857-4f27-b5b8-de58e23f9724', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 278e6f20-f857-4f27-b5b8-de58e23f9724 Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 278e6f20-f857-4f27-b5b8-de58e23f9724 Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:02.572864 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:02.580072 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:02.580072 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:02.580072 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 278e6f20-f857-4f27-b5b8-de58e23f9724 Jul 14 14:40:02.580072 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:02.582419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-782e5a8e-a9ec-4ebc-9b92-e1b576ae3722 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Returning 400 to user: This rule already exists in group 278e6f20-f857-4f27-b5b8-de58e23f9724 {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:02.583578 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-782e5a8e-a9ec-4ebc-9b92-e1b576ae3722 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.304416 Jul 14 14:40:02.584457 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1483/2972] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:40:02 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 307 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:40:02.598566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-80ec689f-e887-471c-a5b0-d37e73e93a5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:02.605039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-80ec689f-e887-471c-a5b0-d37e73e93a5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:02.635142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80ec689f-e887-471c-a5b0-d37e73e93a5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:02.639579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80ec689f-e887-471c-a5b0-d37e73e93a5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:02.646067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80ec689f-e887-471c-a5b0-d37e73e93a5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:02.648000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80ec689f-e887-471c-a5b0-d37e73e93a5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:03.606464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-80ec689f-e887-471c-a5b0-d37e73e93a5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:03.679064 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-80ec689f-e887-471c-a5b0-d37e73e93a5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1365 microversion: 2.1 time: 1.092373 Jul 14 14:40:03.679493 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1484/2973] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:02 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1365 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:03.737261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c2824531-a018-438a-ae23-bd68a63a8e2b tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Calling method '.version_select at 0x7fd6c58b34c0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:06.598154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:06.924436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:07.355845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:08.092107 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c2824531-a018-438a-ae23-bd68a63a8e2b tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-group-rules/63b77be2-1add-4a69-bbed-1749e855435e" status: 202 len: 0 microversion: 2.1 time: 4.377258 Jul 14 14:40:08.093190 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1485/2974] 10.222.0.81 () {58 vars in 1286 bytes} [Thu Jul 14 14:40:03 2022] DELETE /compute/v2.1/os-security-group-rules/63b77be2-1add-4a69-bbed-1749e855435e => generated 0 bytes in 4413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:40:08.105816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd3c42db-b2ed-47b3-b384-91cf5d01fd6c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:08.114180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bd3c42db-b2ed-47b3-b384-91cf5d01fd6c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:08.136477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd3c42db-b2ed-47b3-b384-91cf5d01fd6c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:08.138676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd3c42db-b2ed-47b3-b384-91cf5d01fd6c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:08.142774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd3c42db-b2ed-47b3-b384-91cf5d01fd6c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:08.149959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd3c42db-b2ed-47b3-b384-91cf5d01fd6c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:08.942839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bd3c42db-b2ed-47b3-b384-91cf5d01fd6c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:08.983082 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bd3c42db-b2ed-47b3-b384-91cf5d01fd6c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b" status: 200 len: 1319 microversion: 2.1 time: 0.875669 Jul 14 14:40:08.985796 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1486/2975] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:08 2022] GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b => generated 1319 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:09.009487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-d2069cd5-c853-4175-996c-817016038db9 req-5564b9f1-96cd-492a-b616-ca9a72dad2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b55c122-95db-42f1-95a9-ae5bbb4ff958", "name": "network-vif-plugged", "status": "completed", "tag": "b14caf9c-97a3-483c-92a9-d43af26af98c"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:09.096867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d2069cd5-c853-4175-996c-817016038db9 req-5564b9f1-96cd-492a-b616-ca9a72dad2b0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:09.097952 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d2069cd5-c853-4175-996c-817016038db9 req-5564b9f1-96cd-492a-b616-ca9a72dad2b0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:09.197361 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-d2069cd5-c853-4175-996c-817016038db9 req-5564b9f1-96cd-492a-b616-ca9a72dad2b0 service nova] Creating event network-vif-plugged:b14caf9c-97a3-483c-92a9-d43af26af98c for instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 on n-h2-767704-28 Jul 14 14:40:09.274364 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-d2069cd5-c853-4175-996c-817016038db9 req-5564b9f1-96cd-492a-b616-ca9a72dad2b0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261327 Jul 14 14:40:09.279108 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1487/2976] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:09.331835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bddc4d06-46e8-4cd6-869c-bc4b51663b80 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:09.347976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bddc4d06-46e8-4cd6-869c-bc4b51663b80 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:09.383841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bddc4d06-46e8-4cd6-869c-bc4b51663b80 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:09.384384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bddc4d06-46e8-4cd6-869c-bc4b51663b80 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:09.385596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bddc4d06-46e8-4cd6-869c-bc4b51663b80 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:09.386233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bddc4d06-46e8-4cd6-869c-bc4b51663b80 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:10.480652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=37 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:10.825861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bddc4d06-46e8-4cd6-869c-bc4b51663b80 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:10.872768 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bddc4d06-46e8-4cd6-869c-bc4b51663b80 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1365 microversion: 2.1 time: 1.583674 Jul 14 14:40:10.885746 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1488/2977] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:09 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1365 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:10.914743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a7938aea-efc6-475b-9a38-462e9f3426b6 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c4fc3550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1275741494", "description": "tempest-description-1966766999"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:13.215597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:13.591118 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a7938aea-efc6-475b-9a38-462e9f3426b6 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 2.703403 Jul 14 14:40:13.599020 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1489/2978] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:40:10 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:13.606026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5dd2a4b5-f064-4a10-986d-c65061a7f162 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:13.616736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5dd2a4b5-f064-4a10-986d-c65061a7f162 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:13.625510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4b5-f064-4a10-986d-c65061a7f162 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:13.632152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4b5-f064-4a10-986d-c65061a7f162 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:13.633404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4b5-f064-4a10-986d-c65061a7f162 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:13.634101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5dd2a4b5-f064-4a10-986d-c65061a7f162 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:14.172197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5dd2a4b5-f064-4a10-986d-c65061a7f162 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:14.197117 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5dd2a4b5-f064-4a10-986d-c65061a7f162 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b" status: 200 len: 1319 microversion: 2.1 time: 0.594194 Jul 14 14:40:14.198556 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1490/2979] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:13 2022] GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:14.214983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6368a672-af76-4cec-8010-ba78b53113ef req-843d629d-3ff1-481c-acb6-18f7f3b1f2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7af3bd7-3948-4f54-acb6-feca9e054bd0", "tag": "bbec25dc-296a-418f-a1b8-1b9cdb568441"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:14.259675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6368a672-af76-4cec-8010-ba78b53113ef req-843d629d-3ff1-481c-acb6-18f7f3b1f2e4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:14.261206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6368a672-af76-4cec-8010-ba78b53113ef req-843d629d-3ff1-481c-acb6-18f7f3b1f2e4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:14.349025 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6368a672-af76-4cec-8010-ba78b53113ef req-843d629d-3ff1-481c-acb6-18f7f3b1f2e4 service nova] Creating event network-changed:bbec25dc-296a-418f-a1b8-1b9cdb568441 for instance a7af3bd7-3948-4f54-acb6-feca9e054bd0 on n-h1-767704-28 Jul 14 14:40:14.367246 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6368a672-af76-4cec-8010-ba78b53113ef req-843d629d-3ff1-481c-acb6-18f7f3b1f2e4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164811 Jul 14 14:40:14.367867 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1491/2980] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:14.388975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3c108382-19f0-430c-a2bf-47d6a6b4ba2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:14.390588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3c108382-19f0-430c-a2bf-47d6a6b4ba2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:14.406501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c108382-19f0-430c-a2bf-47d6a6b4ba2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:14.408067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c108382-19f0-430c-a2bf-47d6a6b4ba2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:14.409638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c108382-19f0-430c-a2bf-47d6a6b4ba2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:14.410892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c108382-19f0-430c-a2bf-47d6a6b4ba2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:15.150008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3c108382-19f0-430c-a2bf-47d6a6b4ba2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:15.179920 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3c108382-19f0-430c-a2bf-47d6a6b4ba2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1552 microversion: 2.1 time: 0.810306 Jul 14 14:40:15.189164 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1492/2981] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:14 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1552 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:15.229085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eb20dc2d-6548-49a6-b41a-afd04eb79208 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c4fc0280>, body: {"security_group_rule": {"parent_group_id": "f893e0f9-8bdd-41a1-bed9-63f199d451c7", "ip_protocol": "tcp", "from_port": 925580192, "to_port": 22}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:16.372531 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-eb20dc2d-6548-49a6-b41a-afd04eb79208 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] HTTP exception thrown: Invalid port range 925580192:22. Former value cannot be greater than the later Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eb20dc2d-6548-49a6-b41a-afd04eb79208 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Request method failure captured: Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 145 Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cq9AH5mKN2a_Z_cEZK2AYF9faMXLF0sKknsxQ77Slt_PSFloqPn8NvGtkgmfgeY14C_hf20QqT9TwZ7S4OhSfv7CxaanVFVuTr-8BOEncSLNOqD27jb13DkXDnDItrJ5YgAeseZ_wci5YaJvcGMuNwFKjP4p5xGwwQitYXfoOL-5js Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d73e699372e24ef28ea309f067bf141e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}] Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: aeddb2fef49e4d8fbe0221a9574adfdc Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: {"security_group_rule": {"parent_group_id": "f893e0f9-8bdd-41a1-bed9-63f199d451c7", "ip_protocol": "tcp", "from_port": 925580192, "to_port": 22}} Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid port range 925580192:22. Former value cannot be greater than the later Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f893e0f9-8bdd-41a1-bed9-63f199d451c7', 'ip_protocol': 'tcp', 'from_port': 925580192, 'to_port': 22}}} Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 925580192:22. Former value cannot be greater than the later Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 925580192:22. Former value cannot be greater than the later Jul 14 14:40:16.375316 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:16.380318 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:16.380318 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:16.380318 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:16.380318 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:16.380318 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:16.380318 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:16.380318 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:16.380318 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 925580192:22. Former value cannot be greater than the later Jul 14 14:40:16.380318 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:16.381856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eb20dc2d-6548-49a6-b41a-afd04eb79208 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Returning 400 to user: Invalid port range 925580192:22. Former value cannot be greater than the later {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:16.382894 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eb20dc2d-6548-49a6-b41a-afd04eb79208 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 1.191539 Jul 14 14:40:16.383658 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1493/2982] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:40:15 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 1193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:40:16.395540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-da7892a8-6e0b-4052-a5b5-478c50e642ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:16.396844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-da7892a8-6e0b-4052-a5b5-478c50e642ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:16.424576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da7892a8-6e0b-4052-a5b5-478c50e642ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:16.425354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da7892a8-6e0b-4052-a5b5-478c50e642ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:16.426458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da7892a8-6e0b-4052-a5b5-478c50e642ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:16.427060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da7892a8-6e0b-4052-a5b5-478c50e642ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:16.611322 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-da7892a8-6e0b-4052-a5b5-478c50e642ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.226287 Jul 14 14:40:16.612042 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1494/2983] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:40:16 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/os-interface => generated 284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:16.619765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ea1833ed-8582-4bef-a47b-e65896683501 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:16.620832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ea1833ed-8582-4bef-a47b-e65896683501 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:16.624723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:40:16.627652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:40:16.628487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:40:16.629183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:40:16.630308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:40:16.653723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:16.655725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:16.658372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea1833ed-8582-4bef-a47b-e65896683501 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:16.659089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:16.659749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:16.662316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea1833ed-8582-4bef-a47b-e65896683501 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:16.669955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea1833ed-8582-4bef-a47b-e65896683501 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:16.675836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea1833ed-8582-4bef-a47b-e65896683501 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:16.723439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Getting quotas for project 5eb8f7dedbf34c44922ce681e837045d. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:40:16.740888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Getting quotas for user 53dc8a2925ac47dfa2b9518242f99370 and project 5eb8f7dedbf34c44922ce681e837045d. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:40:17.016101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:40:17.019653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ed5792af-0697-4dc4-9e98-0dfc75460892',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='25d31229-c0bb-421f-8904-c3820df465f8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a902c398-1e05-4e7c-a6cd-f3a30a5c5e62',volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:40:17.037838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ea1833ed-8582-4bef-a47b-e65896683501 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:17.054270 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ea1833ed-8582-4bef-a47b-e65896683501 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b" status: 200 len: 1319 microversion: 2.1 time: 0.440167 Jul 14 14:40:17.055044 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1495/2984] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:16 2022] GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:17.070729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3600aa9e-a3e3-4c99-9edc-4959307303a3 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c569e9d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1218492676", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:17.079678 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3600aa9e-a3e3-4c99-9edc-4959307303a3 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] HTTP exception thrown: Security group id should be uuid Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3600aa9e-a3e3-4c99-9edc-4959307303a3 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Request method failure captured: Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 131 Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cq9AH5mKN2a_Z_cEZK2AYF9faMXLF0sKknsxQ77Slt_PSFloqPn8NvGtkgmfgeY14C_hf20QqT9TwZ7S4OhSfv7CxaanVFVuTr-8BOEncSLNOqD27jb13DkXDnDItrJ5YgAeseZ_wci5YaJvcGMuNwFKjP4p5xGwwQitYXfoOL-5js Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d73e699372e24ef28ea309f067bf141e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}] Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: aeddb2fef49e4d8fbe0221a9574adfdc Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1218492676", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: exception: Security group id should be uuid Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1218492676', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:17.081575 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:17.088322 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 14 14:40:17.088322 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:17.096038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3600aa9e-a3e3-4c99-9edc-4959307303a3 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Returning 400 to user: Security group id should be uuid {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:17.097592 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3600aa9e-a3e3-4c99-9edc-4959307303a3 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.041106 Jul 14 14:40:17.101196 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1496/2985] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:40:17 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:17.113335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5d09755a-2d3e-426b-9e99-0947a3e4f3c4 req-c8371050-4802-4574-a51d-2ec2ae16129d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36db0748-9d5e-4217-a2b6-6a55efe3693b", "tag": "9fe2e47f-d953-478d-a62c-a812fde3c1b3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:17.142836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5d09755a-2d3e-426b-9e99-0947a3e4f3c4 req-c8371050-4802-4574-a51d-2ec2ae16129d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:17.143684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5d09755a-2d3e-426b-9e99-0947a3e4f3c4 req-c8371050-4802-4574-a51d-2ec2ae16129d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:17.171304 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5d09755a-2d3e-426b-9e99-0947a3e4f3c4 req-c8371050-4802-4574-a51d-2ec2ae16129d service nova] Creating event network-changed:9fe2e47f-d953-478d-a62c-a812fde3c1b3 for instance 36db0748-9d5e-4217-a2b6-6a55efe3693b on n-h2-767704-28 Jul 14 14:40:17.180311 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5d09755a-2d3e-426b-9e99-0947a3e4f3c4 req-c8371050-4802-4574-a51d-2ec2ae16129d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077514 Jul 14 14:40:17.184009 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1497/2986] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:17.199460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2cdc3018-99e5-425a-ad46-542ddb0c705f tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c4fc01f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1968657934", "description": "tempest-description-1525983915"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:17.829018 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2cdc3018-99e5-425a-ad46-542ddb0c705f tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.643380 Jul 14 14:40:17.830714 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1498/2987] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:40:17 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:17.847884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-eafe8df7-c8ef-403a-8bb9-348e1e8b72e0 req-18319ded-e794-495c-b41c-11e5dda0327a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7af3bd7-3948-4f54-acb6-feca9e054bd0", "name": "network-vif-plugged", "status": "completed", "tag": "bbec25dc-296a-418f-a1b8-1b9cdb568441"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:17.867779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-eafe8df7-c8ef-403a-8bb9-348e1e8b72e0 req-18319ded-e794-495c-b41c-11e5dda0327a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:17.868657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-eafe8df7-c8ef-403a-8bb9-348e1e8b72e0 req-18319ded-e794-495c-b41c-11e5dda0327a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:17.891226 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-eafe8df7-c8ef-403a-8bb9-348e1e8b72e0 req-18319ded-e794-495c-b41c-11e5dda0327a service nova] Creating event network-vif-plugged:bbec25dc-296a-418f-a1b8-1b9cdb568441 for instance a7af3bd7-3948-4f54-acb6-feca9e054bd0 on n-h1-767704-28 Jul 14 14:40:17.907794 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-eafe8df7-c8ef-403a-8bb9-348e1e8b72e0 req-18319ded-e794-495c-b41c-11e5dda0327a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075469 Jul 14 14:40:17.909600 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1499/2988] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:17.917330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0bbbb40f-ea0b-48b5-a098-712b04b32893 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c589f8b0>, body: {"security_group_rule": {"parent_group_id": "cf48dc6d-2697-41b9-ba95-346eda49c048", "ip_protocol": "tempest-999-1618617849", "from_port": 22, "to_port": 22}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:18.133759 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ebf16070-bbb8-4e42-b4fb-4e5aafd26632 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 17.636992 Jul 14 14:40:18.142889 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1490/2989] 10.222.0.81 () {62 vars in 1188 bytes} [Thu Jul 14 14:40:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 17642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:40:18.156564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4c121322-08d2-4f91-aff6-ed31decb3c7f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:18.161946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4c121322-08d2-4f91-aff6-ed31decb3c7f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:18.181683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c121322-08d2-4f91-aff6-ed31decb3c7f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:18.182142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c121322-08d2-4f91-aff6-ed31decb3c7f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:18.182996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c121322-08d2-4f91-aff6-ed31decb3c7f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:18.183438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c121322-08d2-4f91-aff6-ed31decb3c7f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:18.198513 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-0bbbb40f-ea0b-48b5-a098-712b04b32893 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] HTTP exception thrown: Invalid IP protocol tempest-999-1618617849. Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0bbbb40f-ea0b-48b5-a098-712b04b32893 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Request method failure captured: Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 157 Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cq9AH5mKN2a_Z_cEZK2AYF9faMXLF0sKknsxQ77Slt_PSFloqPn8NvGtkgmfgeY14C_hf20QqT9TwZ7S4OhSfv7CxaanVFVuTr-8BOEncSLNOqD27jb13DkXDnDItrJ5YgAeseZ_wci5YaJvcGMuNwFKjP4p5xGwwQitYXfoOL-5js Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d73e699372e24ef28ea309f067bf141e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}] Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: aeddb2fef49e4d8fbe0221a9574adfdc Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: {"security_group_rule": {"parent_group_id": "cf48dc6d-2697-41b9-ba95-346eda49c048", "ip_protocol": "tempest-999-1618617849", "from_port": 22, "to_port": 22}} Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid IP protocol tempest-999-1618617849. Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cf48dc6d-2697-41b9-ba95-346eda49c048', 'ip_protocol': 'tempest-999-1618617849', 'from_port': 22, 'to_port': 22}}} Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1618617849. Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1618617849. Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:18.200219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:18.213402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:18.213402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:18.213402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:18.213402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:18.213402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:18.213402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:18.213402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1618617849. Jul 14 14:40:18.213402 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:18.213402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0bbbb40f-ea0b-48b5-a098-712b04b32893 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Returning 400 to user: Invalid IP protocol tempest-999-1618617849. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:18.213402 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0bbbb40f-ea0b-48b5-a098-712b04b32893 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.290655 Jul 14 14:40:18.213402 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1500/2990] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:40:17 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 298 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:40:18.215222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9cad8139-481f-481f-b275-b63244626143 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:18.215222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9cad8139-481f-481f-b275-b63244626143 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:18.441916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9cad8139-481f-481f-b275-b63244626143 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:18.452695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9cad8139-481f-481f-b275-b63244626143 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:18.459559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9cad8139-481f-481f-b275-b63244626143 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:18.463057 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9cad8139-481f-481f-b275-b63244626143 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1285 microversion: 2.42 time: 0.252805 Jul 14 14:40:18.465126 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1501/2991] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:18 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1285 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:18.481100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-87c27c2e-abaf-421d-9cc4-060c303bec25 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c4fd2af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1759914597", "description": "tempest-description-293457963"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:18.850545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4c121322-08d2-4f91-aff6-ed31decb3c7f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:18.870593 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4c121322-08d2-4f91-aff6-ed31decb3c7f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b" status: 200 len: 1319 microversion: 2.1 time: 0.731153 Jul 14 14:40:18.872061 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1491/2992] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:18 2022] GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b => generated 1319 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:19.486757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d17a9983-a35d-4651-95f3-f3ceb9d2fdb3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:19.487802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d17a9983-a35d-4651-95f3-f3ceb9d2fdb3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:19.816643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d17a9983-a35d-4651-95f3-f3ceb9d2fdb3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:19.867897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d17a9983-a35d-4651-95f3-f3ceb9d2fdb3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:19.873132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d17a9983-a35d-4651-95f3-f3ceb9d2fdb3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:19.878418 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d17a9983-a35d-4651-95f3-f3ceb9d2fdb3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1285 microversion: 2.42 time: 0.395834 Jul 14 14:40:19.879893 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1492/2993] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:19 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1285 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:19.892935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-002d3a89-8e4a-40f4-9205-586c5bc594ed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:19.896633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-002d3a89-8e4a-40f4-9205-586c5bc594ed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:19.971648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-002d3a89-8e4a-40f4-9205-586c5bc594ed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:19.972692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-002d3a89-8e4a-40f4-9205-586c5bc594ed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:19.974008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-002d3a89-8e4a-40f4-9205-586c5bc594ed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:19.975574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-002d3a89-8e4a-40f4-9205-586c5bc594ed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:20.174157 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-87c27c2e-abaf-421d-9cc4-060c303bec25 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.705287 Jul 14 14:40:20.176672 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1502/2994] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:40:18 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:20.193467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e137d86-e11a-4701-a7ca-68910bf3b8b5 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c4ffac10>, body: {"security_group_rule": {"parent_group_id": "14eaf30c-c3c5-4139-8003-8272e51bedb7", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:20.700347 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-8e137d86-e11a-4701-a7ca-68910bf3b8b5 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e137d86-e11a-4701-a7ca-68910bf3b8b5 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Request method failure captured: Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 138 Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cq9AH5mKN2a_Z_cEZK2AYF9faMXLF0sKknsxQ77Slt_PSFloqPn8NvGtkgmfgeY14C_hf20QqT9TwZ7S4OhSfv7CxaanVFVuTr-8BOEncSLNOqD27jb13DkXDnDItrJ5YgAeseZ_wci5YaJvcGMuNwFKjP4p5xGwwQitYXfoOL-5js Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d73e699372e24ef28ea309f067bf141e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}] Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: aeddb2fef49e4d8fbe0221a9574adfdc Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: {"security_group_rule": {"parent_group_id": "14eaf30c-c3c5-4139-8003-8272e51bedb7", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'security_group_rule': {'parent_group_id': '14eaf30c-c3c5-4139-8003-8272e51bedb7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 14 14:40:20.703678 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:20.711811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:20.711811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:20.711811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:20.711811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:20.711811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:20.711811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:20.711811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:20.711811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 14 14:40:20.711811 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:20.711811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e137d86-e11a-4701-a7ca-68910bf3b8b5 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:20.711811 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8e137d86-e11a-4701-a7ca-68910bf3b8b5 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.520173 Jul 14 14:40:20.711811 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1503/2995] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:40:20 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 523 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:40:20.751534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-250aa053-f469-4162-8dce-2fe2884b8a6f tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c4ffaaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1304404863", "description": "tempest-description-1939506024"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:20.870910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-002d3a89-8e4a-40f4-9205-586c5bc594ed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:20.891227 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-002d3a89-8e4a-40f4-9205-586c5bc594ed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b" status: 200 len: 1319 microversion: 2.1 time: 1.004304 Jul 14 14:40:20.906219 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1493/2996] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:19 2022] GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b => generated 1319 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:40:20.922837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f9e3ee0-f76c-42cf-ac18-dc728a16f15f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:20.924247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8f9e3ee0-f76c-42cf-ac18-dc728a16f15f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:20.933883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f9e3ee0-f76c-42cf-ac18-dc728a16f15f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:20.934733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f9e3ee0-f76c-42cf-ac18-dc728a16f15f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:20.935947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f9e3ee0-f76c-42cf-ac18-dc728a16f15f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:20.936639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f9e3ee0-f76c-42cf-ac18-dc728a16f15f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:21.252644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f9e3ee0-f76c-42cf-ac18-dc728a16f15f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:21.286469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f9e3ee0-f76c-42cf-ac18-dc728a16f15f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:21.294689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f9e3ee0-f76c-42cf-ac18-dc728a16f15f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:21.301014 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8f9e3ee0-f76c-42cf-ac18-dc728a16f15f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1575 microversion: 2.42 time: 0.386777 Jul 14 14:40:21.302253 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1494/2997] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:20 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1575 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:21.574685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d35b4aa3-23c5-4a5a-8b45-7ca83b9d9d3f req-b615bf63-e08b-498d-a7d0-abb36717d52b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b55c122-95db-42f1-95a9-ae5bbb4ff958", "tag": "b14caf9c-97a3-483c-92a9-d43af26af98c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:21.615390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d35b4aa3-23c5-4a5a-8b45-7ca83b9d9d3f req-b615bf63-e08b-498d-a7d0-abb36717d52b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:21.622980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d35b4aa3-23c5-4a5a-8b45-7ca83b9d9d3f req-b615bf63-e08b-498d-a7d0-abb36717d52b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:21.626309 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-250aa053-f469-4162-8dce-2fe2884b8a6f tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.909765 Jul 14 14:40:21.628578 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1504/2998] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:40:20 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:21.651833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-47459bab-f829-458f-9c8d-3a7b84ac3de0 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c5a64c10>, body: {"security_group_rule": {"parent_group_id": "8becd470-7e2c-461b-ba25-af0f06611cbf", "ip_protocol": "tcp", "from_port": 22, "to_port": 534787543}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:21.692007 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d35b4aa3-23c5-4a5a-8b45-7ca83b9d9d3f req-b615bf63-e08b-498d-a7d0-abb36717d52b service nova] Creating event network-changed:b14caf9c-97a3-483c-92a9-d43af26af98c for instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 on n-h2-767704-28 Jul 14 14:40:21.712503 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d35b4aa3-23c5-4a5a-8b45-7ca83b9d9d3f req-b615bf63-e08b-498d-a7d0-abb36717d52b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141934 Jul 14 14:40:21.715886 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1495/2999] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:40:21.889463 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-47459bab-f829-458f-9c8d-3a7b84ac3de0 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] HTTP exception thrown: Invalid port range 22:534787543. Valid TCP ports should be between 1-65535 Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-47459bab-f829-458f-9c8d-3a7b84ac3de0 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Request method failure captured: Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 145 Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cq9AH5mKN2a_Z_cEZK2AYF9faMXLF0sKknsxQ77Slt_PSFloqPn8NvGtkgmfgeY14C_hf20QqT9TwZ7S4OhSfv7CxaanVFVuTr-8BOEncSLNOqD27jb13DkXDnDItrJ5YgAeseZ_wci5YaJvcGMuNwFKjP4p5xGwwQitYXfoOL-5js Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d73e699372e24ef28ea309f067bf141e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}] Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: aeddb2fef49e4d8fbe0221a9574adfdc Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: {"security_group_rule": {"parent_group_id": "8becd470-7e2c-461b-ba25-af0f06611cbf", "ip_protocol": "tcp", "from_port": 22, "to_port": 534787543}} Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid port range 22:534787543. Valid TCP ports should be between 1-65535 Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8becd470-7e2c-461b-ba25-af0f06611cbf', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 534787543}}} Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:534787543. Valid TCP ports should be between 1-65535 Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:534787543. Valid TCP ports should be between 1-65535 Jul 14 14:40:21.891985 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:21.897095 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:21.897095 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:21.897095 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:21.897095 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:21.897095 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:21.897095 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:21.897095 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:21.897095 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:534787543. Valid TCP ports should be between 1-65535 Jul 14 14:40:21.897095 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:40:21.899437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-47459bab-f829-458f-9c8d-3a7b84ac3de0 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Returning 400 to user: Invalid port range 22:534787543. Valid TCP ports should be between 1-65535 {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:21.901390 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-47459bab-f829-458f-9c8d-3a7b84ac3de0 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.264283 Jul 14 14:40:21.905505 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1505/3000] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:40:21 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:40:21.920779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cea0f266-d916-4f41-974e-76b7dd16ead1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Action: 'create', calling method: .version_select at 0x7fd6c5e3ec10>, body: {"security_group_rule": {"parent_group_id": "79aea769-7983-4cd7-812f-677e590e0d84", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:21.930243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ae5231de-6b3f-4872-9ade-83b0136dcc82 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:21.931032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ae5231de-6b3f-4872-9ade-83b0136dcc82 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:21.957078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae5231de-6b3f-4872-9ade-83b0136dcc82 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:21.958067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae5231de-6b3f-4872-9ade-83b0136dcc82 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:21.959531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae5231de-6b3f-4872-9ade-83b0136dcc82 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:21.960006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae5231de-6b3f-4872-9ade-83b0136dcc82 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:21.973934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:22.008438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-cea0f266-d916-4f41-974e-76b7dd16ead1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 79aea769-7983-4cd7-812f-677e590e0d84 does not exist", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:40:22.009083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.security_group_api [None req-cea0f266-d916-4f41-974e-76b7dd16ead1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Neutron security group 79aea769-7983-4cd7-812f-677e590e0d84 not found {{(pid=119511) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:40:22.009636 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-cea0f266-d916-4f41-974e-76b7dd16ead1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] HTTP exception thrown: Security group 79aea769-7983-4cd7-812f-677e590e0d84 does not exist Jul 14 14:40:22.009636 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-827140e1-9f53-47d2-996f-3efd1e0fec0e'] Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cea0f266-d916-4f41-974e-76b7dd16ead1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Request method failure captured: Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 138 Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cq9AH5mKN2a_Z_cEZK2AYF9faMXLF0sKknsxQ77Slt_PSFloqPn8NvGtkgmfgeY14C_hf20QqT9TwZ7S4OhSfv7CxaanVFVuTr-8BOEncSLNOqD27jb13DkXDnDItrJ5YgAeseZ_wci5YaJvcGMuNwFKjP4p5xGwwQitYXfoOL-5js Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d73e699372e24ef28ea309f067bf141e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}] Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: aeddb2fef49e4d8fbe0221a9574adfdc Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: {"security_group_rule": {"parent_group_id": "79aea769-7983-4cd7-812f-677e590e0d84", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: exception: Security group 79aea769-7983-4cd7-812f-677e590e0d84 does not exist Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-827140e1-9f53-47d2-996f-3efd1e0fec0e'] Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'security_group_rule': {'parent_group_id': '79aea769-7983-4cd7-812f-677e590e0d84', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:40:22.011675 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 79aea769-7983-4cd7-812f-677e590e0d84 does not exist Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-827140e1-9f53-47d2-996f-3efd1e0fec0e'] Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 79aea769-7983-4cd7-812f-677e590e0d84 does not exist Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-827140e1-9f53-47d2-996f-3efd1e0fec0e'] Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 79aea769-7983-4cd7-812f-677e590e0d84 does not exist Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-827140e1-9f53-47d2-996f-3efd1e0fec0e'] Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 79aea769-7983-4cd7-812f-677e590e0d84 does not exist Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-827140e1-9f53-47d2-996f-3efd1e0fec0e'] Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cea0f266-d916-4f41-974e-76b7dd16ead1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Returning 404 to user: Security group 79aea769-7983-4cd7-812f-677e590e0d84 does not exist Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-827140e1-9f53-47d2-996f-3efd1e0fec0e'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:22.016034 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cea0f266-d916-4f41-974e-76b7dd16ead1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.098478 Jul 14 14:40:22.020231 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1496/3001] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:40:21 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:40:22.038123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e014b705-1e1e-42d1-82d8-18d9803ecaa1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Calling method '.version_select at 0x7fd6c5af7ca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:22.747362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-e014b705-1e1e-42d1-82d8-18d9803ecaa1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913 does not exist", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:40:22.748399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.security_group_api [None req-e014b705-1e1e-42d1-82d8-18d9803ecaa1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Neutron security group rule 1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913 not found {{(pid=119511) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 14 14:40:22.748979 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-e014b705-1e1e-42d1-82d8-18d9803ecaa1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] HTTP exception thrown: Security group rule 1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913 does not exist Jul 14 14:40:22.748979 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-46918cdc-389f-4ef2-bce3-699ae1bccfaa'] Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e014b705-1e1e-42d1-82d8-18d9803ecaa1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Request method failure captured: Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-security-group-rules/1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913 HTTP/1.1 Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cq9AH5mKN2a_Z_cEZK2AYF9faMXLF0sKknsxQ77Slt_PSFloqPn8NvGtkgmfgeY14C_hf20QqT9TwZ7S4OhSfv7CxaanVFVuTr-8BOEncSLNOqD27jb13DkXDnDItrJ5YgAeseZ_wci5YaJvcGMuNwFKjP4p5xGwwQitYXfoOL-5js Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d73e699372e24ef28ea309f067bf141e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d73e699372e24ef28ea309f067bf141e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d73e699372e24ef28ea309f067bf141e"}]}] Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d73e699372e24ef28ea309f067bf141e Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526 Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: aeddb2fef49e4d8fbe0221a9574adfdc Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: exception: Security group rule 1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913 does not exist Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-46918cdc-389f-4ef2-bce3-699ae1bccfaa'] Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913'} Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:40:22.750997 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913 does not exist Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46918cdc-389f-4ef2-bce3-699ae1bccfaa'] Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913 does not exist Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46918cdc-389f-4ef2-bce3-699ae1bccfaa'] Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913 does not exist Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46918cdc-389f-4ef2-bce3-699ae1bccfaa'] Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913 does not exist Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46918cdc-389f-4ef2-bce3-699ae1bccfaa'] Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e014b705-1e1e-42d1-82d8-18d9803ecaa1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Returning 404 to user: Security group rule 1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913 does not exist Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-46918cdc-389f-4ef2-bce3-699ae1bccfaa'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:22.756964 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e014b705-1e1e-42d1-82d8-18d9803ecaa1 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-group-rules/1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913" status: 404 len: 199 microversion: 2.1 time: 0.731187 Jul 14 14:40:22.760390 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1497/3002] 10.222.0.81 () {58 vars in 1286 bytes} [Thu Jul 14 14:40:22 2022] DELETE /compute/v2.1/os-security-group-rules/1ae3ac3f-30f7-4a0a-aa81-bfc9f8712913 => generated 199 bytes in 738 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:40:22.770204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c7629bfe-319f-49a0-9877-f7cae1e91cad req-e94d1e74-0a7f-440a-b333-34fb4ad0d11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36db0748-9d5e-4217-a2b6-6a55efe3693b", "name": "network-vif-plugged", "status": "completed", "tag": "9fe2e47f-d953-478d-a62c-a812fde3c1b3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:22.808860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c7629bfe-319f-49a0-9877-f7cae1e91cad req-e94d1e74-0a7f-440a-b333-34fb4ad0d11d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.809411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c7629bfe-319f-49a0-9877-f7cae1e91cad req-e94d1e74-0a7f-440a-b333-34fb4ad0d11d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.835958 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c7629bfe-319f-49a0-9877-f7cae1e91cad req-e94d1e74-0a7f-440a-b333-34fb4ad0d11d service nova] Creating event network-vif-plugged:9fe2e47f-d953-478d-a62c-a812fde3c1b3 for instance 36db0748-9d5e-4217-a2b6-6a55efe3693b on n-h2-767704-28 Jul 14 14:40:22.854001 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c7629bfe-319f-49a0-9877-f7cae1e91cad req-e94d1e74-0a7f-440a-b333-34fb4ad0d11d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093391 Jul 14 14:40:22.854800 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1498/3003] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:22.866571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5ca9e6f1-2c89-462a-9e8d-6f78f2eb2db6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:22.868069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5ca9e6f1-2c89-462a-9e8d-6f78f2eb2db6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:22.879806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ca9e6f1-2c89-462a-9e8d-6f78f2eb2db6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.885808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ca9e6f1-2c89-462a-9e8d-6f78f2eb2db6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.887143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ca9e6f1-2c89-462a-9e8d-6f78f2eb2db6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.887850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ca9e6f1-2c89-462a-9e8d-6f78f2eb2db6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:23.107950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ae5231de-6b3f-4872-9ade-83b0136dcc82 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:23.121542 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ae5231de-6b3f-4872-9ade-83b0136dcc82 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b" status: 200 len: 1319 microversion: 2.1 time: 1.194883 Jul 14 14:40:23.137711 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1506/3004] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:21 2022] GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b => generated 1319 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:23.151817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9d41bad3-7fc9-4f4f-aa9f-9d51458d12e9 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Calling method '.version_select at 0x7fd6c4fd2f70>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:23.204900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5ca9e6f1-2c89-462a-9e8d-6f78f2eb2db6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:23.215478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5ca9e6f1-2c89-462a-9e8d-6f78f2eb2db6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:23.230613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5ca9e6f1-2c89-462a-9e8d-6f78f2eb2db6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:23.237442 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5ca9e6f1-2c89-462a-9e8d-6f78f2eb2db6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1593 microversion: 2.42 time: 0.380964 Jul 14 14:40:23.238105 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1499/3005] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:22 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1593 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:24.142140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0ea3ee20-be63-48bd-be0d-f5c524010645 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:24.142781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0ea3ee20-be63-48bd-be0d-f5c524010645 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:24.199663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ea3ee20-be63-48bd-be0d-f5c524010645 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:24.205565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ea3ee20-be63-48bd-be0d-f5c524010645 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:24.207969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ea3ee20-be63-48bd-be0d-f5c524010645 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:24.212193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ea3ee20-be63-48bd-be0d-f5c524010645 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:25.325286 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9d41bad3-7fc9-4f4f-aa9f-9d51458d12e9 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/8becd470-7e2c-461b-ba25-af0f06611cbf" status: 202 len: 0 microversion: 2.1 time: 2.186035 Jul 14 14:40:25.329119 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1507/3006] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:40:23 2022] DELETE /compute/v2.1/os-security-groups/8becd470-7e2c-461b-ba25-af0f06611cbf => generated 0 bytes in 2190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:40:25.335062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1d5c3c82-3730-49f3-8fe7-28a0d9d46ba7 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:25.335727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1d5c3c82-3730-49f3-8fe7-28a0d9d46ba7 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:25.371045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d5c3c82-3730-49f3-8fe7-28a0d9d46ba7 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:25.371524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d5c3c82-3730-49f3-8fe7-28a0d9d46ba7 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:25.372370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d5c3c82-3730-49f3-8fe7-28a0d9d46ba7 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:25.372843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d5c3c82-3730-49f3-8fe7-28a0d9d46ba7 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:26.667318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1d5c3c82-3730-49f3-8fe7-28a0d9d46ba7 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:26.686181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:26.752481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1d5c3c82-3730-49f3-8fe7-28a0d9d46ba7 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:26.765054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1d5c3c82-3730-49f3-8fe7-28a0d9d46ba7 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:26.780584 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1d5c3c82-3730-49f3-8fe7-28a0d9d46ba7 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1708 microversion: 2.42 time: 1.447111 Jul 14 14:40:26.790836 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1508/3007] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:25 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1708 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:26.814229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0ea3ee20-be63-48bd-be0d-f5c524010645 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:26.825269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b682301b-6ee7-4f2c-9f62-1768e9811e0d tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Calling method '.version_select at 0x7fd6c4fd28b0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:26.838286 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0ea3ee20-be63-48bd-be0d-f5c524010645 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b" status: 200 len: 1319 microversion: 2.1 time: 2.701835 Jul 14 14:40:26.845202 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1500/3008] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:24 2022] GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b => generated 1319 bytes in 2710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:27.494576 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b682301b-6ee7-4f2c-9f62-1768e9811e0d tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/14eaf30c-c3c5-4139-8003-8272e51bedb7" status: 202 len: 0 microversion: 2.1 time: 0.698239 Jul 14 14:40:27.496126 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1509/3009] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:40:26 2022] DELETE /compute/v2.1/os-security-groups/14eaf30c-c3c5-4139-8003-8272e51bedb7 => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:40:27.504449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-43acc72b-a139-4f8e-8335-7bfc2ccb28fb tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Calling method '.version_select at 0x7fd6c5d48670>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:27.811351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7c2eaa50-ff2e-4b6c-9c94-e73f271350e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:27.811987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7c2eaa50-ff2e-4b6c-9c94-e73f271350e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:27.816707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=38 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:27.862154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c2eaa50-ff2e-4b6c-9c94-e73f271350e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:27.866300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c2eaa50-ff2e-4b6c-9c94-e73f271350e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:27.867168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c2eaa50-ff2e-4b6c-9c94-e73f271350e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:27.867660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c2eaa50-ff2e-4b6c-9c94-e73f271350e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:28.334896 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-43acc72b-a139-4f8e-8335-7bfc2ccb28fb tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/cf48dc6d-2697-41b9-ba95-346eda49c048" status: 202 len: 0 microversion: 2.1 time: 0.834125 Jul 14 14:40:28.336286 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1501/3010] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:40:27 2022] DELETE /compute/v2.1/os-security-groups/cf48dc6d-2697-41b9-ba95-346eda49c048 => generated 0 bytes in 836 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:40:28.342185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8775242b-3481-47eb-9540-32aed3edb45f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:28.343114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8775242b-3481-47eb-9540-32aed3edb45f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:28.369555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7c2eaa50-ff2e-4b6c-9c94-e73f271350e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:28.389845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8775242b-3481-47eb-9540-32aed3edb45f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:28.390367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8775242b-3481-47eb-9540-32aed3edb45f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:28.391635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8775242b-3481-47eb-9540-32aed3edb45f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:28.391945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8775242b-3481-47eb-9540-32aed3edb45f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:28.407291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7c2eaa50-ff2e-4b6c-9c94-e73f271350e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:28.421592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7c2eaa50-ff2e-4b6c-9c94-e73f271350e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:28.423021 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7c2eaa50-ff2e-4b6c-9c94-e73f271350e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1755 microversion: 2.42 time: 0.616814 Jul 14 14:40:28.445349 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1510/3011] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:27 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1755 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:28.454199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5991110d-e024-4600-b8ee-591871b03018 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Calling method '.version_select at 0x7fd6c4fd29d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:28.515463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:29.185599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8775242b-3481-47eb-9540-32aed3edb45f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:29.195474 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8775242b-3481-47eb-9540-32aed3edb45f tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b" status: 200 len: 1508 microversion: 2.1 time: 0.857848 Jul 14 14:40:29.208681 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1502/3012] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:28 2022] GET /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b => generated 1508 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:29.213965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2de8f06d-2815-4823-a149-25c37da10911 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:29.219047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2de8f06d-2815-4823-a149-25c37da10911 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: a7af3bd7-3948-4f54-acb6-feca9e054bd0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:29.229530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2de8f06d-2815-4823-a149-25c37da10911 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:29.230430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2de8f06d-2815-4823-a149-25c37da10911 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:29.231443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2de8f06d-2815-4823-a149-25c37da10911 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:29.232085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2de8f06d-2815-4823-a149-25c37da10911 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:29.847682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:29.973177 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5991110d-e024-4600-b8ee-591871b03018 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/f893e0f9-8bdd-41a1-bed9-63f199d451c7" status: 202 len: 0 microversion: 2.1 time: 1.526289 Jul 14 14:40:29.977662 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1511/3013] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:40:28 2022] DELETE /compute/v2.1/os-security-groups/f893e0f9-8bdd-41a1-bed9-63f199d451c7 => generated 0 bytes in 1532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:40:29.993212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a228ed14-f719-447e-8448-74f390f7fc71 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:29.994642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a228ed14-f719-447e-8448-74f390f7fc71 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:30.025559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a228ed14-f719-447e-8448-74f390f7fc71 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:30.026402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a228ed14-f719-447e-8448-74f390f7fc71 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:30.028135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a228ed14-f719-447e-8448-74f390f7fc71 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:30.028973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a228ed14-f719-447e-8448-74f390f7fc71 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:30.413025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2de8f06d-2815-4823-a149-25c37da10911 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:30.424558 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2de8f06d-2815-4823-a149-25c37da10911 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/a7af3bd7-3948-4f54-acb6-feca9e054bd0" status: 200 len: 1507 microversion: 2.1 time: 1.214312 Jul 14 14:40:30.425492 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1503/3014] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:29 2022] GET /compute/v2.1/servers/a7af3bd7-3948-4f54-acb6-feca9e054bd0 => generated 1507 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:30.431750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-65ebef3a-b5bc-4fc7-89d9-24f1aab4a346 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] Calling method '.version_select at 0x7fd6c5a2aee0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:30.597437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a228ed14-f719-447e-8448-74f390f7fc71 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:30.624751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a228ed14-f719-447e-8448-74f390f7fc71 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:30.626698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a228ed14-f719-447e-8448-74f390f7fc71 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:30.636768 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a228ed14-f719-447e-8448-74f390f7fc71 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1802 microversion: 2.42 time: 0.655862 Jul 14 14:40:30.640086 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1512/3015] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:29 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1802 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:30.671347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f61c543-9446-4ba5-9c54-9a9cf6a2b801 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:30.676831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f61c543-9446-4ba5-9c54-9a9cf6a2b801 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: a7af3bd7-3948-4f54-acb6-feca9e054bd0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:30.696437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f61c543-9446-4ba5-9c54-9a9cf6a2b801 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:30.710699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f61c543-9446-4ba5-9c54-9a9cf6a2b801 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:30.712718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f61c543-9446-4ba5-9c54-9a9cf6a2b801 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:30.713481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f61c543-9446-4ba5-9c54-9a9cf6a2b801 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:31.106467 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-65ebef3a-b5bc-4fc7-89d9-24f1aab4a346 tempest-SecurityGroupRulesNegativeTestJSON-1565024526 tempest-SecurityGroupRulesNegativeTestJSON-1565024526-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/278e6f20-f857-4f27-b5b8-de58e23f9724" status: 202 len: 0 microversion: 2.1 time: 0.679508 Jul 14 14:40:31.110482 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1504/3016] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:40:30 2022] DELETE /compute/v2.1/os-security-groups/278e6f20-f857-4f27-b5b8-de58e23f9724 => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:40:31.137133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f61c543-9446-4ba5-9c54-9a9cf6a2b801 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: a7af3bd7-3948-4f54-acb6-feca9e054bd0] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:40:31.339476 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f61c543-9446-4ba5-9c54-9a9cf6a2b801 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a7af3bd7-3948-4f54-acb6-feca9e054bd0" status: 204 len: 0 microversion: 2.1 time: 0.693165 Jul 14 14:40:31.345504 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1513/3017] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:40:30 2022] DELETE /compute/v2.1/servers/a7af3bd7-3948-4f54-acb6-feca9e054bd0 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:40:31.350998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-33285795-f5e2-4619-85b4-69394a35776c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:31.352547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-33285795-f5e2-4619-85b4-69394a35776c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:31.378976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33285795-f5e2-4619-85b4-69394a35776c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:31.379697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33285795-f5e2-4619-85b4-69394a35776c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:31.380712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33285795-f5e2-4619-85b4-69394a35776c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:31.383897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33285795-f5e2-4619-85b4-69394a35776c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:31.441078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-33285795-f5e2-4619-85b4-69394a35776c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 36db0748-9d5e-4217-a2b6-6a55efe3693b] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:40:31.588855 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-33285795-f5e2-4619-85b4-69394a35776c tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "DELETE /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b" status: 204 len: 0 microversion: 2.1 time: 0.240600 Jul 14 14:40:31.589719 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1505/3018] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:40:31 2022] DELETE /compute/v2.1/servers/36db0748-9d5e-4217-a2b6-6a55efe3693b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:40:31.661292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-04a1a66a-ee2a-4a18-8546-b2f67b277acd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:31.662726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-04a1a66a-ee2a-4a18-8546-b2f67b277acd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:31.670096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04a1a66a-ee2a-4a18-8546-b2f67b277acd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:31.679674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04a1a66a-ee2a-4a18-8546-b2f67b277acd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:31.681335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04a1a66a-ee2a-4a18-8546-b2f67b277acd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:31.689444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04a1a66a-ee2a-4a18-8546-b2f67b277acd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:31.737689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1317294038", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8c448ce4-e55f-491a-840c-8d1ab5d30cec"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:31.951815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] validate_networks() for [('8c448ce4-e55f-491a-840c-8d1ab5d30cec', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:40:32.639436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04a1a66a-ee2a-4a18-8546-b2f67b277acd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:32.661273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04a1a66a-ee2a-4a18-8546-b2f67b277acd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:32.663436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04a1a66a-ee2a-4a18-8546-b2f67b277acd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:32.665262 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-04a1a66a-ee2a-4a18-8546-b2f67b277acd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1802 microversion: 2.42 time: 1.008425 Jul 14 14:40:32.679065 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1514/3019] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:31 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1802 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:33.696923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-76d204f1-b594-4c86-a873-c411e6736a04 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:33.707449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-76d204f1-b594-4c86-a873-c411e6736a04 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:33.752613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-76d204f1-b594-4c86-a873-c411e6736a04 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:33.753234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-76d204f1-b594-4c86-a873-c411e6736a04 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:33.754084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-76d204f1-b594-4c86-a873-c411e6736a04 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:33.754654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-76d204f1-b594-4c86-a873-c411e6736a04 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:34.551090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:40:34.551806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:40:34.554220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:40:34.554980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:40:34.555727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:40:34.594762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:34.597323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:34.598512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:34.601840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:34.655189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Getting quotas for project bfc4a794988d4bfd9e3566a815233828. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:40:34.672873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Getting quotas for user 5ea6d3737ade48b28caa4de080a83bea and project bfc4a794988d4bfd9e3566a815233828. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:40:34.701513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Going to run 2 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:40:34.707682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: e7c3ddd2-01d9-4408-8a2e-202c81d52163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:40:34.802618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=e7c3ddd2-01d9-4408-8a2e-202c81d52163,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:40:35.029616 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a04e6f67-d0f5-41ae-b56e-030000d5cd07 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.315653 Jul 14 14:40:35.038176 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1506/3020] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:40:31 2022] POST /compute/v2.1/servers => generated 32 bytes in 3325 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:40:35.047047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-76d204f1-b594-4c86-a873-c411e6736a04 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:35.050768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-68d04366-86e0-4597-be39-d38444baf98d tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:35.060398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-68d04366-86e0-4597-be39-d38444baf98d tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:35.063049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-68d04366-86e0-4597-be39-d38444baf98d tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Searching by: {'deleted': False, 'project_id': 'bfc4a794988d4bfd9e3566a815233828'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:40:35.069698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-76d204f1-b594-4c86-a873-c411e6736a04 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:35.071276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-76d204f1-b594-4c86-a873-c411e6736a04 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:35.072523 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-76d204f1-b594-4c86-a873-c411e6736a04 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1849 microversion: 2.42 time: 1.388333 Jul 14 14:40:35.086343 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1515/3021] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:33 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1849 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:35.120069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68d04366-86e0-4597-be39-d38444baf98d tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:35.121586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68d04366-86e0-4597-be39-d38444baf98d tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:35.124501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68d04366-86e0-4597-be39-d38444baf98d tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:35.125432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68d04366-86e0-4597-be39-d38444baf98d tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:35.185886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-68d04366-86e0-4597-be39-d38444baf98d tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:40:35.300288 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-68d04366-86e0-4597-be39-d38444baf98d tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.259569 Jul 14 14:40:35.310497 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1507/3022] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 14:40:35 2022] GET /compute/v2.1/servers => generated 1335 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:35.314842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-56189078-a635-43ff-8448-f4e92c1cbd8e tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:35.315459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-56189078-a635-43ff-8448-f4e92c1cbd8e tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:35.904057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0f024f3d-9a28-4c06-8a94-2854fb679c9b req-8a34a0cf-fd54-4c8d-af14-4d63fa8e8d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7af3bd7-3948-4f54-acb6-feca9e054bd0", "name": "network-vif-unplugged", "status": "completed", "tag": "bbec25dc-296a-418f-a1b8-1b9cdb568441"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:35.956285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0f024f3d-9a28-4c06-8a94-2854fb679c9b req-8a34a0cf-fd54-4c8d-af14-4d63fa8e8d0e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:35.962923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0f024f3d-9a28-4c06-8a94-2854fb679c9b req-8a34a0cf-fd54-4c8d-af14-4d63fa8e8d0e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:36.023807 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0f024f3d-9a28-4c06-8a94-2854fb679c9b req-8a34a0cf-fd54-4c8d-af14-4d63fa8e8d0e service nova] Creating event network-vif-unplugged:bbec25dc-296a-418f-a1b8-1b9cdb568441 for instance a7af3bd7-3948-4f54-acb6-feca9e054bd0 on n-h1-767704-28 Jul 14 14:40:36.042153 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0f024f3d-9a28-4c06-8a94-2854fb679c9b req-8a34a0cf-fd54-4c8d-af14-4d63fa8e8d0e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142751 Jul 14 14:40:36.043388 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1508/3023] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:36.119394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a469c33b-92e1-42be-b7b4-acd3d5d53060 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:36.121389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a469c33b-92e1-42be-b7b4-acd3d5d53060 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:36.150921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a469c33b-92e1-42be-b7b4-acd3d5d53060 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:36.152741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a469c33b-92e1-42be-b7b4-acd3d5d53060 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:36.161306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a469c33b-92e1-42be-b7b4-acd3d5d53060 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:36.166862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a469c33b-92e1-42be-b7b4-acd3d5d53060 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:36.171148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-56189078-a635-43ff-8448-f4e92c1cbd8e tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:36.184207 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-56189078-a635-43ff-8448-f4e92c1cbd8e tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1218 microversion: 2.1 time: 0.874193 Jul 14 14:40:36.190362 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1516/3024] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:35 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1218 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:37.111254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5eab9534-0e91-4342-8293-f5354fbbb6c0 req-f75559d5-5da2-46e9-9940-d87bfe3d5860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7af3bd7-3948-4f54-acb6-feca9e054bd0", "name": "network-vif-deleted", "tag": "bbec25dc-296a-418f-a1b8-1b9cdb568441"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:37.151134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5eab9534-0e91-4342-8293-f5354fbbb6c0 req-f75559d5-5da2-46e9-9940-d87bfe3d5860 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:37.151747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5eab9534-0e91-4342-8293-f5354fbbb6c0 req-f75559d5-5da2-46e9-9940-d87bfe3d5860 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:37.227129 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5eab9534-0e91-4342-8293-f5354fbbb6c0 req-f75559d5-5da2-46e9-9940-d87bfe3d5860 service nova] Creating event network-vif-deleted:bbec25dc-296a-418f-a1b8-1b9cdb568441 for instance a7af3bd7-3948-4f54-acb6-feca9e054bd0 on n-h1-767704-28 Jul 14 14:40:37.259958 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5eab9534-0e91-4342-8293-f5354fbbb6c0 req-f75559d5-5da2-46e9-9940-d87bfe3d5860 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152883 Jul 14 14:40:37.260623 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1517/3025] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:40:37.302888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-25b63095-b1f9-4adb-96c6-808fe67e9f42 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:37.306206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-25b63095-b1f9-4adb-96c6-808fe67e9f42 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:37.356278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25b63095-b1f9-4adb-96c6-808fe67e9f42 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:37.357480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25b63095-b1f9-4adb-96c6-808fe67e9f42 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:37.358326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25b63095-b1f9-4adb-96c6-808fe67e9f42 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:37.358777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25b63095-b1f9-4adb-96c6-808fe67e9f42 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:37.832755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a469c33b-92e1-42be-b7b4-acd3d5d53060 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:37.867822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a469c33b-92e1-42be-b7b4-acd3d5d53060 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:37.871139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a469c33b-92e1-42be-b7b4-acd3d5d53060 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:37.877389 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a469c33b-92e1-42be-b7b4-acd3d5d53060 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1849 microversion: 2.42 time: 1.763290 Jul 14 14:40:37.893879 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1509/3026] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:36 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1849 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:40:37.921805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-95b673a5-999b-4d60-a024-b99573e9a5ba tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:37.936570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-95b673a5-999b-4d60-a024-b99573e9a5ba tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:37.972435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-95b673a5-999b-4d60-a024-b99573e9a5ba tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Searching by: {'deleted': False, 'project_id': '991226f89eee4c4dbc3ec5870984d61d'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:40:37.996079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95b673a5-999b-4d60-a024-b99573e9a5ba tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:37.997690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95b673a5-999b-4d60-a024-b99573e9a5ba tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:38.000427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95b673a5-999b-4d60-a024-b99573e9a5ba tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:38.001539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95b673a5-999b-4d60-a024-b99573e9a5ba tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:38.075394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-95b673a5-999b-4d60-a024-b99573e9a5ba tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:40:38.078833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-25b63095-b1f9-4adb-96c6-808fe67e9f42 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:38.088751 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-25b63095-b1f9-4adb-96c6-808fe67e9f42 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1222 microversion: 2.1 time: 0.815455 Jul 14 14:40:38.099043 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1518/3027] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:37 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1222 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:38.111465 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-95b673a5-999b-4d60-a024-b99573e9a5ba tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.215666 Jul 14 14:40:38.113520 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1510/3028] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 14:40:37 2022] GET /compute/v2.1/servers => generated 344 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:38.141803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ffc17bc9-5fca-43ca-b99c-c72dd3931b58 req-7de30282-15d5-47c4-822b-90bfa43a0853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "tag": "555c0602-6141-4525-b74a-9dd96ba32274"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:38.156884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4d5510c-5cd2-4ebe-83b1-5ba9a2c23b2b tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:38.166777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b4d5510c-5cd2-4ebe-83b1-5ba9a2c23b2b tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:38.169617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b4d5510c-5cd2-4ebe-83b1-5ba9a2c23b2b tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Searching by: {'deleted': False, 'project_id': '991226f89eee4c4dbc3ec5870984d61d'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:40:38.195439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4d5510c-5cd2-4ebe-83b1-5ba9a2c23b2b tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:38.198207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4d5510c-5cd2-4ebe-83b1-5ba9a2c23b2b tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:38.203720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ffc17bc9-5fca-43ca-b99c-c72dd3931b58 req-7de30282-15d5-47c4-822b-90bfa43a0853 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:38.204504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4d5510c-5cd2-4ebe-83b1-5ba9a2c23b2b tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:38.204656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ffc17bc9-5fca-43ca-b99c-c72dd3931b58 req-7de30282-15d5-47c4-822b-90bfa43a0853 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:38.207345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4d5510c-5cd2-4ebe-83b1-5ba9a2c23b2b tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:38.289210 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ffc17bc9-5fca-43ca-b99c-c72dd3931b58 req-7de30282-15d5-47c4-822b-90bfa43a0853 service nova] Creating event network-changed:555c0602-6141-4525-b74a-9dd96ba32274 for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:40:38.297148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-b4d5510c-5cd2-4ebe-83b1-5ba9a2c23b2b tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:40:38.309954 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ffc17bc9-5fca-43ca-b99c-c72dd3931b58 req-7de30282-15d5-47c4-822b-90bfa43a0853 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199375 Jul 14 14:40:38.323382 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1519/3029] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:38.407863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b4d5510c-5cd2-4ebe-83b1-5ba9a2c23b2b tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:38.431417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4d5510c-5cd2-4ebe-83b1-5ba9a2c23b2b tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:38.433482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4d5510c-5cd2-4ebe-83b1-5ba9a2c23b2b tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:38.451993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:38.913694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c7991aac-1d62-4fc5-88a7-2d35aeadeb72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:38.914490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c7991aac-1d62-4fc5-88a7-2d35aeadeb72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:38.944606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7991aac-1d62-4fc5-88a7-2d35aeadeb72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:38.945256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7991aac-1d62-4fc5-88a7-2d35aeadeb72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:38.946107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7991aac-1d62-4fc5-88a7-2d35aeadeb72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:38.946568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7991aac-1d62-4fc5-88a7-2d35aeadeb72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:39.331728 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b4d5510c-5cd2-4ebe-83b1-5ba9a2c23b2b tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 1.194017 Jul 14 14:40:39.335501 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1511/3030] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:40:38 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:39.341352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e71deb6b-5f74-4c6d-a9eb-33980a114e84 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:39.341997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e71deb6b-5f74-4c6d-a9eb-33980a114e84 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:39.358203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e71deb6b-5f74-4c6d-a9eb-33980a114e84 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:39.358779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e71deb6b-5f74-4c6d-a9eb-33980a114e84 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:39.367664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e71deb6b-5f74-4c6d-a9eb-33980a114e84 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:39.368194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e71deb6b-5f74-4c6d-a9eb-33980a114e84 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:39.811720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e71deb6b-5f74-4c6d-a9eb-33980a114e84 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:39.824112 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e71deb6b-5f74-4c6d-a9eb-33980a114e84 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1278 microversion: 2.1 time: 0.486940 Jul 14 14:40:39.825700 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1512/3031] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:39 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1278 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:39.836425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-2f9005f5-55e1-4ba4-addc-9911e52b2efd req-a52ee852-159b-4286-b346-8711d10132bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36db0748-9d5e-4217-a2b6-6a55efe3693b", "name": "network-vif-deleted", "tag": "9fe2e47f-d953-478d-a62c-a812fde3c1b3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:39.909086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2f9005f5-55e1-4ba4-addc-9911e52b2efd req-a52ee852-159b-4286-b346-8711d10132bc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:39.913664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2f9005f5-55e1-4ba4-addc-9911e52b2efd req-a52ee852-159b-4286-b346-8711d10132bc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:39.955230 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-2f9005f5-55e1-4ba4-addc-9911e52b2efd req-a52ee852-159b-4286-b346-8711d10132bc service nova] Creating event network-vif-deleted:9fe2e47f-d953-478d-a62c-a812fde3c1b3 for instance 36db0748-9d5e-4217-a2b6-6a55efe3693b on n-h2-767704-28 Jul 14 14:40:39.968386 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-2f9005f5-55e1-4ba4-addc-9911e52b2efd req-a52ee852-159b-4286-b346-8711d10132bc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137259 Jul 14 14:40:39.971520 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1513/3032] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:39.985726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4c6accc1-b002-4a72-9719-3159eec5dbb8 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:40.001917 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4c6accc1-b002-4a72-9719-3159eec5dbb8 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027592 Jul 14 14:40:40.002930 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1514/3033] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:40:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:40.335249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2a11796a-1d01-435b-b382-1b4af4efe519 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:40.336590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2a11796a-1d01-435b-b382-1b4af4efe519 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:40.361131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a11796a-1d01-435b-b382-1b4af4efe519 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:40.361504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a11796a-1d01-435b-b382-1b4af4efe519 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:40.362306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a11796a-1d01-435b-b382-1b4af4efe519 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:40.362773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a11796a-1d01-435b-b382-1b4af4efe519 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:40.448448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2a11796a-1d01-435b-b382-1b4af4efe519 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:40:40.817240 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2a11796a-1d01-435b-b382-1b4af4efe519 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 204 len: 0 microversion: 2.1 time: 0.481153 Jul 14 14:40:40.819141 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1515/3034] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:40:40 2022] DELETE /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:40:40.835840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3bdb2f7b-55b4-46ba-b9a4-0487fbc86a4a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:40.836896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3bdb2f7b-55b4-46ba-b9a4-0487fbc86a4a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:40.857259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bdb2f7b-55b4-46ba-b9a4-0487fbc86a4a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:40.858060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bdb2f7b-55b4-46ba-b9a4-0487fbc86a4a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:40.862249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bdb2f7b-55b4-46ba-b9a4-0487fbc86a4a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:40.863056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bdb2f7b-55b4-46ba-b9a4-0487fbc86a4a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:40.905397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c7991aac-1d62-4fc5-88a7-2d35aeadeb72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:40.929686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c7991aac-1d62-4fc5-88a7-2d35aeadeb72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:40.938582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c7991aac-1d62-4fc5-88a7-2d35aeadeb72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:40.947054 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c7991aac-1d62-4fc5-88a7-2d35aeadeb72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1849 microversion: 2.42 time: 2.035540 Jul 14 14:40:40.950023 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1520/3035] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:38 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1849 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:40.985987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c1051ea7-69e2-4d2f-af65-fce448bd2092 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:40.988925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c1051ea7-69e2-4d2f-af65-fce448bd2092 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:41.022973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c1051ea7-69e2-4d2f-af65-fce448bd2092 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:41.023436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c1051ea7-69e2-4d2f-af65-fce448bd2092 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:41.024235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c1051ea7-69e2-4d2f-af65-fce448bd2092 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:41.024896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c1051ea7-69e2-4d2f-af65-fce448bd2092 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:42.670686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c1051ea7-69e2-4d2f-af65-fce448bd2092 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:42.698498 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c1051ea7-69e2-4d2f-af65-fce448bd2092 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1276 microversion: 2.1 time: 1.745116 Jul 14 14:40:42.699737 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1521/3036] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:40 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1276 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:42.719290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-275b0e34-0ca4-4697-ac69-a37299ee394e req-1d4e8956-e644-4252-92f2-d197f88438e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "tag": "6d8c96b9-5962-4646-ba07-34e1518619fa"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:42.751420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-275b0e34-0ca4-4697-ac69-a37299ee394e req-1d4e8956-e644-4252-92f2-d197f88438e7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:42.752133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-275b0e34-0ca4-4697-ac69-a37299ee394e req-1d4e8956-e644-4252-92f2-d197f88438e7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:42.792618 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-275b0e34-0ca4-4697-ac69-a37299ee394e req-1d4e8956-e644-4252-92f2-d197f88438e7 service nova] Creating event network-changed:6d8c96b9-5962-4646-ba07-34e1518619fa for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:40:42.819430 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-275b0e34-0ca4-4697-ac69-a37299ee394e req-1d4e8956-e644-4252-92f2-d197f88438e7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118127 Jul 14 14:40:42.829366 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1522/3037] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:42.835242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-26ddcb17-df21-4c78-88be-9a527b06c1de tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:42.841292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-26ddcb17-df21-4c78-88be-9a527b06c1de tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:42.861674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26ddcb17-df21-4c78-88be-9a527b06c1de tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:42.862142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26ddcb17-df21-4c78-88be-9a527b06c1de tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:42.870140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26ddcb17-df21-4c78-88be-9a527b06c1de tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:42.870866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26ddcb17-df21-4c78-88be-9a527b06c1de tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:42.990059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3bdb2f7b-55b4-46ba-b9a4-0487fbc86a4a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:43.032524 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3bdb2f7b-55b4-46ba-b9a4-0487fbc86a4a tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1609 microversion: 2.1 time: 2.207976 Jul 14 14:40:43.089410 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1516/3038] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:40 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1609 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:43.716439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cab0a8a0-9153-4b3e-ad60-74b4e1d2c4e1 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:43.717218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cab0a8a0-9153-4b3e-ad60-74b4e1d2c4e1 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:43.719683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:43.766569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cab0a8a0-9153-4b3e-ad60-74b4e1d2c4e1 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:43.767277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cab0a8a0-9153-4b3e-ad60-74b4e1d2c4e1 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:43.768068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cab0a8a0-9153-4b3e-ad60-74b4e1d2c4e1 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:43.777768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cab0a8a0-9153-4b3e-ad60-74b4e1d2c4e1 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:44.303888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cab0a8a0-9153-4b3e-ad60-74b4e1d2c4e1 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:44.312558 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cab0a8a0-9153-4b3e-ad60-74b4e1d2c4e1 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1276 microversion: 2.1 time: 0.600445 Jul 14 14:40:44.342884 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1517/3039] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:43 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1276 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:44.348624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ef68c012-a351-41a5-a179-134bece5cec7 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:44.352717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ef68c012-a351-41a5-a179-134bece5cec7 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:44.376571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef68c012-a351-41a5-a179-134bece5cec7 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:44.377531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef68c012-a351-41a5-a179-134bece5cec7 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:44.378674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef68c012-a351-41a5-a179-134bece5cec7 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:44.384929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef68c012-a351-41a5-a179-134bece5cec7 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:46.183302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:46.212727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-26ddcb17-df21-4c78-88be-9a527b06c1de tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:46.228457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-26ddcb17-df21-4c78-88be-9a527b06c1de tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:46.240713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-26ddcb17-df21-4c78-88be-9a527b06c1de tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:46.254619 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-26ddcb17-df21-4c78-88be-9a527b06c1de tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1870 microversion: 2.42 time: 3.423577 Jul 14 14:40:46.256153 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1523/3040] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:42 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1870 bytes in 3426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:46.417262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-94ea955b-0117-490a-9b64-67904b5cd9b6 req-d5364e9b-4017-4719-94ab-cd4d99a8bf62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "tag": "7014e99c-e595-47e8-980b-489824ecb7f8"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:46.436573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-94ea955b-0117-490a-9b64-67904b5cd9b6 req-d5364e9b-4017-4719-94ab-cd4d99a8bf62 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:46.437238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-94ea955b-0117-490a-9b64-67904b5cd9b6 req-d5364e9b-4017-4719-94ab-cd4d99a8bf62 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:46.470925 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-94ea955b-0117-490a-9b64-67904b5cd9b6 req-d5364e9b-4017-4719-94ab-cd4d99a8bf62 service nova] Creating event network-changed:7014e99c-e595-47e8-980b-489824ecb7f8 for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:40:46.487179 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-94ea955b-0117-490a-9b64-67904b5cd9b6 req-d5364e9b-4017-4719-94ab-cd4d99a8bf62 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227267 Jul 14 14:40:46.488149 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1524/3041] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:46.501196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2bc4557b-c9aa-4c8c-b992-8a5e8a84d894 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:46.502912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2bc4557b-c9aa-4c8c-b992-8a5e8a84d894 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:46.536682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2bc4557b-c9aa-4c8c-b992-8a5e8a84d894 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:46.539586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2bc4557b-c9aa-4c8c-b992-8a5e8a84d894 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:46.545459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2bc4557b-c9aa-4c8c-b992-8a5e8a84d894 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:46.548210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2bc4557b-c9aa-4c8c-b992-8a5e8a84d894 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:46.674338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ef68c012-a351-41a5-a179-134bece5cec7 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:46.686105 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ef68c012-a351-41a5-a179-134bece5cec7 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1609 microversion: 2.1 time: 2.341914 Jul 14 14:40:46.698718 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1518/3042] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:44 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1609 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:46.708330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-77cb4dc8-2505-4e3d-ad4b-4abd065c5c97 req-330d0961-ea8e-43f4-a679-609371ffbe80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de27ce5-f75f-47eb-8dee-2a9d98e103f5", "name": "network-vif-unplugged", "status": "completed", "tag": "63549d3b-cf27-4f40-93e4-ba05e71f3d8f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:46.745423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-77cb4dc8-2505-4e3d-ad4b-4abd065c5c97 req-330d0961-ea8e-43f4-a679-609371ffbe80 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:46.748878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-77cb4dc8-2505-4e3d-ad4b-4abd065c5c97 req-330d0961-ea8e-43f4-a679-609371ffbe80 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:46.800433 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-77cb4dc8-2505-4e3d-ad4b-4abd065c5c97 req-330d0961-ea8e-43f4-a679-609371ffbe80 service nova] Creating event network-vif-unplugged:63549d3b-cf27-4f40-93e4-ba05e71f3d8f for instance 7de27ce5-f75f-47eb-8dee-2a9d98e103f5 on n-h1-767704-28 Jul 14 14:40:46.826815 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-77cb4dc8-2505-4e3d-ad4b-4abd065c5c97 req-330d0961-ea8e-43f4-a679-609371ffbe80 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125391 Jul 14 14:40:46.834191 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1519/3043] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:47.178524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2bc4557b-c9aa-4c8c-b992-8a5e8a84d894 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:47.205920 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2bc4557b-c9aa-4c8c-b992-8a5e8a84d894 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1276 microversion: 2.1 time: 0.715522 Jul 14 14:40:47.209354 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1525/3044] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:46 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1276 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:47.278766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6d3952cc-d7a2-4743-87fe-7c3acd6aac4a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:47.279693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6d3952cc-d7a2-4743-87fe-7c3acd6aac4a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:47.291445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d3952cc-d7a2-4743-87fe-7c3acd6aac4a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:47.292739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d3952cc-d7a2-4743-87fe-7c3acd6aac4a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:47.295849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d3952cc-d7a2-4743-87fe-7c3acd6aac4a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:47.297583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d3952cc-d7a2-4743-87fe-7c3acd6aac4a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:47.477558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7b6e9cd1-0119-4b0b-8360-ce32a4ebd484 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Action: 'create', calling method: .version_select at 0x7fd6c5e55310>, body: {"keypair": {"name": "tempest-keypair-2079767053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJue1ybVlEqkht4VwBxOUos8ONLElSmUmcI2wgNoZ6onzhuRS9VtUR843886qlExFA/g5EH3UpoAOi+xgLxue2fxnyyJ+KYhXKOCDkEdo6TuoE5wNQQGl7UKr9OCGXqgiQ=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:47.501882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-7b6e9cd1-0119-4b0b-8360-ce32a4ebd484 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Getting quotas for project d21ace546ee1440786c7ad443ef9f073. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:40:47.509993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-7b6e9cd1-0119-4b0b-8360-ce32a4ebd484 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Getting quotas for user ccbcfbd80adf4d67ba342133f5b2a946 and project d21ace546ee1440786c7ad443ef9f073. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:40:47.559062 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7b6e9cd1-0119-4b0b-8360-ce32a4ebd484 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.429470 Jul 14 14:40:47.560933 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1520/3045] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:40:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:47.716067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-61e4bd48-853f-411e-870e-b635246a235c tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:47.717707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-61e4bd48-853f-411e-870e-b635246a235c tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:47.730907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61e4bd48-853f-411e-870e-b635246a235c tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:47.732021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61e4bd48-853f-411e-870e-b635246a235c tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:47.733137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61e4bd48-853f-411e-870e-b635246a235c tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:47.733839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61e4bd48-853f-411e-870e-b635246a235c tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:47.980311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-61e4bd48-853f-411e-870e-b635246a235c tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:47.993688 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-61e4bd48-853f-411e-870e-b635246a235c tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1541 microversion: 2.1 time: 0.282927 Jul 14 14:40:48.000461 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1521/3046] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:47 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1541 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:48.235066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5666e71-33e2-46ec-b508-9ff194d2ad26 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:48.237310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d5666e71-33e2-46ec-b508-9ff194d2ad26 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:48.256540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:48.259288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5666e71-33e2-46ec-b508-9ff194d2ad26 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:48.260389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5666e71-33e2-46ec-b508-9ff194d2ad26 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:48.263120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5666e71-33e2-46ec-b508-9ff194d2ad26 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:48.265030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5666e71-33e2-46ec-b508-9ff194d2ad26 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:49.214622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6d3952cc-d7a2-4743-87fe-7c3acd6aac4a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:49.244848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6d3952cc-d7a2-4743-87fe-7c3acd6aac4a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:49.247080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6d3952cc-d7a2-4743-87fe-7c3acd6aac4a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:49.251276 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6d3952cc-d7a2-4743-87fe-7c3acd6aac4a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1891 microversion: 2.42 time: 1.976639 Jul 14 14:40:49.265977 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1526/3047] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:47 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1891 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:49.289508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b30f69c4-4d8c-4bb3-8d5d-d2ccec76d9fb req-9bf71361-e5f8-40c3-910b-574f3f1a51a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "tag": "ea32addf-3ddd-4645-a6d7-a3e1e322e40c"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:49.306562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b30f69c4-4d8c-4bb3-8d5d-d2ccec76d9fb req-9bf71361-e5f8-40c3-910b-574f3f1a51a2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:49.307111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b30f69c4-4d8c-4bb3-8d5d-d2ccec76d9fb req-9bf71361-e5f8-40c3-910b-574f3f1a51a2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:49.336089 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b30f69c4-4d8c-4bb3-8d5d-d2ccec76d9fb req-9bf71361-e5f8-40c3-910b-574f3f1a51a2 service nova] Creating event network-changed:ea32addf-3ddd-4645-a6d7-a3e1e322e40c for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:40:49.350932 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b30f69c4-4d8c-4bb3-8d5d-d2ccec76d9fb req-9bf71361-e5f8-40c3-910b-574f3f1a51a2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082706 Jul 14 14:40:49.352084 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1527/3048] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:49.359957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f57241e-ea3a-4fe2-b84d-b3e2ae685fd3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:49.367615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f57241e-ea3a-4fe2-b84d-b3e2ae685fd3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:49.373897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d5666e71-33e2-46ec-b508-9ff194d2ad26 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:49.383216 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d5666e71-33e2-46ec-b508-9ff194d2ad26 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1318 microversion: 2.1 time: 1.154813 Jul 14 14:40:49.387322 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1522/3049] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:48 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1318 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:49.395135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f57241e-ea3a-4fe2-b84d-b3e2ae685fd3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:49.399656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f57241e-ea3a-4fe2-b84d-b3e2ae685fd3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:49.401498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f57241e-ea3a-4fe2-b84d-b3e2ae685fd3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:49.406361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f57241e-ea3a-4fe2-b84d-b3e2ae685fd3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:49.470626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:49.897000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f57241e-ea3a-4fe2-b84d-b3e2ae685fd3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:49.913884 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f57241e-ea3a-4fe2-b84d-b3e2ae685fd3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1541 microversion: 2.1 time: 0.559990 Jul 14 14:40:49.916874 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1528/3050] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:49 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1541 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:50.065007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-32f25608-513a-470c-be42-6573642ed070 req-eca17265-2191-40b1-86dd-2f037baff651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de27ce5-f75f-47eb-8dee-2a9d98e103f5", "name": "network-vif-deleted", "tag": "63549d3b-cf27-4f40-93e4-ba05e71f3d8f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:50.082562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-32f25608-513a-470c-be42-6573642ed070 req-eca17265-2191-40b1-86dd-2f037baff651 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:50.102943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-32f25608-513a-470c-be42-6573642ed070 req-eca17265-2191-40b1-86dd-2f037baff651 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:50.126481 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-32f25608-513a-470c-be42-6573642ed070 req-eca17265-2191-40b1-86dd-2f037baff651 service nova] Creating event network-vif-deleted:63549d3b-cf27-4f40-93e4-ba05e71f3d8f for instance 7de27ce5-f75f-47eb-8dee-2a9d98e103f5 on n-h1-767704-28 Jul 14 14:40:50.135617 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-32f25608-513a-470c-be42-6573642ed070 req-eca17265-2191-40b1-86dd-2f037baff651 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074528 Jul 14 14:40:50.138372 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1523/3051] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:50.271857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3ffcf200-3bc9-4e8c-9258-026de1745878 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:50.273337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3ffcf200-3bc9-4e8c-9258-026de1745878 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:50.288862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ffcf200-3bc9-4e8c-9258-026de1745878 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:50.291128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ffcf200-3bc9-4e8c-9258-026de1745878 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:50.315363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ffcf200-3bc9-4e8c-9258-026de1745878 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:50.317524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ffcf200-3bc9-4e8c-9258-026de1745878 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:50.409191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9801fc25-df17-4653-90df-9e209fca3c81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:50.410899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9801fc25-df17-4653-90df-9e209fca3c81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:50.431012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9801fc25-df17-4653-90df-9e209fca3c81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:50.433742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9801fc25-df17-4653-90df-9e209fca3c81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:50.434594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9801fc25-df17-4653-90df-9e209fca3c81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:50.435048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9801fc25-df17-4653-90df-9e209fca3c81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.150057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3ffcf200-3bc9-4e8c-9258-026de1745878 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:51.164003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3ffcf200-3bc9-4e8c-9258-026de1745878 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:51.166033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3ffcf200-3bc9-4e8c-9258-026de1745878 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:51.172449 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3ffcf200-3bc9-4e8c-9258-026de1745878 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1891 microversion: 2.42 time: 0.905260 Jul 14 14:40:51.173553 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1529/3052] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:50 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1891 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:51.179247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8c9cdbd4-9d12-4e55-9336-0b5a3126ccd4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:51.190029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8c9cdbd4-9d12-4e55-9336-0b5a3126ccd4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:51.203475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c9cdbd4-9d12-4e55-9336-0b5a3126ccd4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.204245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c9cdbd4-9d12-4e55-9336-0b5a3126ccd4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.205262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c9cdbd4-9d12-4e55-9336-0b5a3126ccd4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.205869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c9cdbd4-9d12-4e55-9336-0b5a3126ccd4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.450609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9801fc25-df17-4653-90df-9e209fca3c81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:51.456140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8c9cdbd4-9d12-4e55-9336-0b5a3126ccd4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:51.476977 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9801fc25-df17-4653-90df-9e209fca3c81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1318 microversion: 2.1 time: 1.071428 Jul 14 14:40:51.477173 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8c9cdbd4-9d12-4e55-9336-0b5a3126ccd4 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1252 microversion: 2.1 time: 0.297929 Jul 14 14:40:51.478169 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1530/3053] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:51 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1252 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:51.491033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9d03b5c5-1a48-41df-8607-a7713242b3f9 req-b5b63d48-ec84-4e90-b107-b87378a98c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "tag": "f0e13cb7-0e32-476b-8c7b-9b4030d305fc"}, {"name": "network-changed", "server_uuid": "034c7ae4-bae3-4c4b-89ce-1385b8789042", "tag": "d7cf7f63-773d-4a4f-8265-e97e901a0053"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:51.492073 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1524/3054] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:50 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1318 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:51.516861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9d03b5c5-1a48-41df-8607-a7713242b3f9 req-b5b63d48-ec84-4e90-b107-b87378a98c7e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.518578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9d03b5c5-1a48-41df-8607-a7713242b3f9 req-b5b63d48-ec84-4e90-b107-b87378a98c7e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.544213 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9d03b5c5-1a48-41df-8607-a7713242b3f9 req-b5b63d48-ec84-4e90-b107-b87378a98c7e service nova] Creating event network-changed:f0e13cb7-0e32-476b-8c7b-9b4030d305fc for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:40:51.545178 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9d03b5c5-1a48-41df-8607-a7713242b3f9 req-b5b63d48-ec84-4e90-b107-b87378a98c7e service nova] Creating event network-changed:d7cf7f63-773d-4a4f-8265-e97e901a0053 for instance 034c7ae4-bae3-4c4b-89ce-1385b8789042 on n-h1-767704-28 Jul 14 14:40:51.555475 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9d03b5c5-1a48-41df-8607-a7713242b3f9 req-b5b63d48-ec84-4e90-b107-b87378a98c7e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075572 Jul 14 14:40:51.558741 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1531/3055] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:51.921535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fb6df86b-f284-4567-97d7-e5358e2f544c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:51.922225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fb6df86b-f284-4567-97d7-e5358e2f544c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:51.932028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb6df86b-f284-4567-97d7-e5358e2f544c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.932540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb6df86b-f284-4567-97d7-e5358e2f544c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.933432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb6df86b-f284-4567-97d7-e5358e2f544c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.938861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb6df86b-f284-4567-97d7-e5358e2f544c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:52.193213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ba128229-99f9-4db4-9551-9ad6db7931c1 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:52.193933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ba128229-99f9-4db4-9551-9ad6db7931c1 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:52.213146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba128229-99f9-4db4-9551-9ad6db7931c1 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:52.214585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba128229-99f9-4db4-9551-9ad6db7931c1 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:52.215908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba128229-99f9-4db4-9551-9ad6db7931c1 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:52.216553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba128229-99f9-4db4-9551-9ad6db7931c1 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:53.071284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fb6df86b-f284-4567-97d7-e5358e2f544c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:53.134366 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fb6df86b-f284-4567-97d7-e5358e2f544c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 1.218127 Jul 14 14:40:53.152392 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1525/3056] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:51 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:53.161799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39c4d6be-178a-44af-a231-50c2e8c590aa tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:53.162852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-39c4d6be-178a-44af-a231-50c2e8c590aa tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:53.179064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39c4d6be-178a-44af-a231-50c2e8c590aa tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:53.180048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39c4d6be-178a-44af-a231-50c2e8c590aa tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:53.185300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39c4d6be-178a-44af-a231-50c2e8c590aa tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:53.185998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39c4d6be-178a-44af-a231-50c2e8c590aa tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:53.246341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba128229-99f9-4db4-9551-9ad6db7931c1 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:53.264237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba128229-99f9-4db4-9551-9ad6db7931c1 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:53.266387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba128229-99f9-4db4-9551-9ad6db7931c1 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:53.267883 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ba128229-99f9-4db4-9551-9ad6db7931c1 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1891 microversion: 2.42 time: 1.079814 Jul 14 14:40:53.269133 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1532/3057] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:52 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1891 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:40:53.276318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-243ed0ed-f779-4469-97ed-82c16b09d266 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:53.277229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-243ed0ed-f779-4469-97ed-82c16b09d266 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:53.284036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-243ed0ed-f779-4469-97ed-82c16b09d266 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:53.284733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-243ed0ed-f779-4469-97ed-82c16b09d266 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:53.285744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-243ed0ed-f779-4469-97ed-82c16b09d266 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:53.287633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-243ed0ed-f779-4469-97ed-82c16b09d266 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:53.594009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-39c4d6be-178a-44af-a231-50c2e8c590aa tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:53.607850 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-39c4d6be-178a-44af-a231-50c2e8c590aa tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1252 microversion: 2.1 time: 0.452379 Jul 14 14:40:53.608397 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1526/3058] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:53 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1252 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:53.614258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-601f104a-2ae4-4e03-8823-c7a392b1d385 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:53.616143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-601f104a-2ae4-4e03-8823-c7a392b1d385 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:53.624346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-601f104a-2ae4-4e03-8823-c7a392b1d385 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:53.626061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-601f104a-2ae4-4e03-8823-c7a392b1d385 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:53.627057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-601f104a-2ae4-4e03-8823-c7a392b1d385 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:53.627673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-601f104a-2ae4-4e03-8823-c7a392b1d385 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.128496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-243ed0ed-f779-4469-97ed-82c16b09d266 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:54.141133 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-243ed0ed-f779-4469-97ed-82c16b09d266 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1318 microversion: 2.1 time: 0.870404 Jul 14 14:40:54.153280 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1533/3059] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:53 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1318 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:54.159305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-10e98a3b-495b-41d6-81ed-d31556723986 req-6ab855ab-1fa2-42ef-9723-b145017429a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "tag": "bf4979db-bc34-41d1-9d82-f5fc2ab71553"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:54.170932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-10e98a3b-495b-41d6-81ed-d31556723986 req-6ab855ab-1fa2-42ef-9723-b145017429a5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.171877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-10e98a3b-495b-41d6-81ed-d31556723986 req-6ab855ab-1fa2-42ef-9723-b145017429a5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.190248 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-10e98a3b-495b-41d6-81ed-d31556723986 req-6ab855ab-1fa2-42ef-9723-b145017429a5 service nova] Creating event network-changed:bf4979db-bc34-41d1-9d82-f5fc2ab71553 for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:40:54.196426 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-10e98a3b-495b-41d6-81ed-d31556723986 req-6ab855ab-1fa2-42ef-9723-b145017429a5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041376 Jul 14 14:40:54.197525 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1534/3060] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:54.238243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-601f104a-2ae4-4e03-8823-c7a392b1d385 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:54.248544 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-601f104a-2ae4-4e03-8823-c7a392b1d385 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.638545 Jul 14 14:40:54.249431 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1527/3061] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:53 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:54.266752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0bc59af8-9987-4f64-85e6-0974c95d612e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:54.268195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0bc59af8-9987-4f64-85e6-0974c95d612e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:54.277391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bc59af8-9987-4f64-85e6-0974c95d612e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.278274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bc59af8-9987-4f64-85e6-0974c95d612e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.279308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bc59af8-9987-4f64-85e6-0974c95d612e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.279974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bc59af8-9987-4f64-85e6-0974c95d612e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.287503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5ec582bd-e9c6-48e3-a5b0-7aeffa0ba3b3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:54.288691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5ec582bd-e9c6-48e3-a5b0-7aeffa0ba3b3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:54.300168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ec582bd-e9c6-48e3-a5b0-7aeffa0ba3b3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.301140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ec582bd-e9c6-48e3-a5b0-7aeffa0ba3b3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.306083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ec582bd-e9c6-48e3-a5b0-7aeffa0ba3b3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.308857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ec582bd-e9c6-48e3-a5b0-7aeffa0ba3b3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.997526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0bc59af8-9987-4f64-85e6-0974c95d612e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:55.010554 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0bc59af8-9987-4f64-85e6-0974c95d612e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.747991 Jul 14 14:40:55.011628 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1535/3062] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:54 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:55.017942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1501174879", "imageRef": "80c45543-9ac5-4ade-87af-c9451dc9cc49", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e91acb63-7cc4-408e-ba35-a7e03b385b0c"}], "security_groups": [{"name": "tempest-securitygroup--641490684"}], "key_name": "tempest-keypair-2079767053", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:55.076799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5ec582bd-e9c6-48e3-a5b0-7aeffa0ba3b3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:55.091176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5ec582bd-e9c6-48e3-a5b0-7aeffa0ba3b3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:55.096931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5ec582bd-e9c6-48e3-a5b0-7aeffa0ba3b3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:55.102459 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5ec582bd-e9c6-48e3-a5b0-7aeffa0ba3b3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1891 microversion: 2.42 time: 0.817449 Jul 14 14:40:55.105534 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1528/3063] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:54 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1891 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:55.116928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-581cce90-1a1e-4f4e-a04e-587ecc1fe99f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:55.117816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-581cce90-1a1e-4f4e-a04e-587ecc1fe99f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:55.134728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-581cce90-1a1e-4f4e-a04e-587ecc1fe99f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:55.134864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-581cce90-1a1e-4f4e-a04e-587ecc1fe99f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:55.135756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-581cce90-1a1e-4f4e-a04e-587ecc1fe99f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:55.136101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-581cce90-1a1e-4f4e-a04e-587ecc1fe99f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:55.493148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] validate_networks() for [('e91acb63-7cc4-408e-ba35-a7e03b385b0c', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:40:55.867888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-581cce90-1a1e-4f4e-a04e-587ecc1fe99f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:55.877388 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-581cce90-1a1e-4f4e-a04e-587ecc1fe99f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1252 microversion: 2.1 time: 0.770347 Jul 14 14:40:55.889212 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1529/3064] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:55 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1252 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:55.897570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f58342bf-8ed0-4979-97f1-cbb3e78bd159 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-359613473"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:55.899447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f58342bf-8ed0-4979-97f1-cbb3e78bd159 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:55.909989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f58342bf-8ed0-4979-97f1-cbb3e78bd159 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:55.910576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f58342bf-8ed0-4979-97f1-cbb3e78bd159 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:55.913055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f58342bf-8ed0-4979-97f1-cbb3e78bd159 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:55.913969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f58342bf-8ed0-4979-97f1-cbb3e78bd159 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:55.955998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:56.416987 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f58342bf-8ed0-4979-97f1-cbb3e78bd159 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.524638 Jul 14 14:40:56.418868 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1530/3065] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:40:55 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 14 14:40:56.439162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-4a4c2397-c339-4fca-8964-f9a1af23ed23 req-bb4fc068-08a6-46e5-83ac-20296af0800a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c3ddd2-01d9-4408-8a2e-202c81d52163", "tag": "3c75219c-59f7-42d2-af35-e764b0455ad5"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:56.458825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4a4c2397-c339-4fca-8964-f9a1af23ed23 req-bb4fc068-08a6-46e5-83ac-20296af0800a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:56.459684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4a4c2397-c339-4fca-8964-f9a1af23ed23 req-bb4fc068-08a6-46e5-83ac-20296af0800a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:56.477335 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-4a4c2397-c339-4fca-8964-f9a1af23ed23 req-bb4fc068-08a6-46e5-83ac-20296af0800a service nova] Creating event network-changed:3c75219c-59f7-42d2-af35-e764b0455ad5 for instance e7c3ddd2-01d9-4408-8a2e-202c81d52163 on n-h2-767704-28 Jul 14 14:40:56.483732 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-4a4c2397-c339-4fca-8964-f9a1af23ed23 req-bb4fc068-08a6-46e5-83ac-20296af0800a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055928 Jul 14 14:40:56.485160 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1531/3066] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:56.491251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fe39cfa6-a41f-4e0b-a1fb-2d10ce38e616 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:56.493722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fe39cfa6-a41f-4e0b-a1fb-2d10ce38e616 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:56.508571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe39cfa6-a41f-4e0b-a1fb-2d10ce38e616 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:56.517516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe39cfa6-a41f-4e0b-a1fb-2d10ce38e616 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:56.518800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe39cfa6-a41f-4e0b-a1fb-2d10ce38e616 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:56.521282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe39cfa6-a41f-4e0b-a1fb-2d10ce38e616 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.008310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fe39cfa6-a41f-4e0b-a1fb-2d10ce38e616 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:57.018152 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fe39cfa6-a41f-4e0b-a1fb-2d10ce38e616 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1318 microversion: 2.1 time: 0.531623 Jul 14 14:40:57.019077 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1532/3067] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:56 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:57.024938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-add111d0-263a-4ad3-b6db-c3a948fdeadd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:57.025954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-add111d0-263a-4ad3-b6db-c3a948fdeadd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:57.033699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-add111d0-263a-4ad3-b6db-c3a948fdeadd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.034581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-add111d0-263a-4ad3-b6db-c3a948fdeadd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.035606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-add111d0-263a-4ad3-b6db-c3a948fdeadd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.036305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-add111d0-263a-4ad3-b6db-c3a948fdeadd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.526670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:57.683627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-add111d0-263a-4ad3-b6db-c3a948fdeadd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:57.707363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-add111d0-263a-4ad3-b6db-c3a948fdeadd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:57.713203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-add111d0-263a-4ad3-b6db-c3a948fdeadd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:57.729651 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-add111d0-263a-4ad3-b6db-c3a948fdeadd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1891 microversion: 2.42 time: 0.708053 Jul 14 14:40:57.731814 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1533/3068] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:57 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1891 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:57.746304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c243aa38-9c9c-40c7-9263-6b9d26f50fda req-9f654ea2-2814-49c0-943e-894828ee799a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "tag": "46b5d0bb-9885-4003-8ee6-a5ad6d903ef9"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:57.784413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c243aa38-9c9c-40c7-9263-6b9d26f50fda req-9f654ea2-2814-49c0-943e-894828ee799a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.787811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:40:57.788300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:40:57.788714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:40:57.789415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:40:57.789841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:40:57.793457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c243aa38-9c9c-40c7-9263-6b9d26f50fda req-9f654ea2-2814-49c0-943e-894828ee799a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.811381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.811875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.812657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.813149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.822028 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c243aa38-9c9c-40c7-9263-6b9d26f50fda req-9f654ea2-2814-49c0-943e-894828ee799a service nova] Creating event network-changed:46b5d0bb-9885-4003-8ee6-a5ad6d903ef9 for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:40:57.829392 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c243aa38-9c9c-40c7-9263-6b9d26f50fda req-9f654ea2-2814-49c0-943e-894828ee799a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095026 Jul 14 14:40:57.832032 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1534/3069] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:57.839308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d18f501-32df-459d-952c-783e7aff053f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:57.840450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d18f501-32df-459d-952c-783e7aff053f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:57.849424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d18f501-32df-459d-952c-783e7aff053f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.850305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d18f501-32df-459d-952c-783e7aff053f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.852113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d18f501-32df-459d-952c-783e7aff053f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.852803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d18f501-32df-459d-952c-783e7aff053f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.854134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:57.866661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Getting quotas for project d21ace546ee1440786c7ad443ef9f073. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:40:57.874694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Getting quotas for user ccbcfbd80adf4d67ba342133f5b2a946 and project d21ace546ee1440786c7ad443ef9f073. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:40:57.889859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:40:57.894371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80c45543-9ac5-4ade-87af-c9451dc9cc49',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:40:57.956321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7d18f501-32df-459d-952c-783e7aff053f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:57.972381 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d18f501-32df-459d-952c-783e7aff053f tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1252 microversion: 2.1 time: 0.138001 Jul 14 14:40:57.974069 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1535/3070] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:57 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1252 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:57.992685 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6a46e597-377a-4871-b3a1-d6dc071e9f6a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.979535 Jul 14 14:40:58.003583 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1536/3071] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:40:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 2991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:40:58.009626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4fe24860-3f4c-434e-847b-f3fec680ae25 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:58.010674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4fe24860-3f4c-434e-847b-f3fec680ae25 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:58.128900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4fe24860-3f4c-434e-847b-f3fec680ae25 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:58.138282 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4fe24860-3f4c-434e-847b-f3fec680ae25 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1246 microversion: 2.1 time: 0.132782 Jul 14 14:40:58.150012 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1537/3072] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:58 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1246 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:58.158150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-56762c44-17b3-480e-8eea-bef4cc67e751 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:58.159104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-56762c44-17b3-480e-8eea-bef4cc67e751 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:58.173542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56762c44-17b3-480e-8eea-bef4cc67e751 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.175694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56762c44-17b3-480e-8eea-bef4cc67e751 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.176568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56762c44-17b3-480e-8eea-bef4cc67e751 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.177081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56762c44-17b3-480e-8eea-bef4cc67e751 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.388542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b97531ec-c84f-433b-a26d-85d1a7bb1f4c req-ba7b6f5e-b0d3-4f92-a3dd-666988e05d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034c7ae4-bae3-4c4b-89ce-1385b8789042", "name": "network-vif-plugged", "status": "completed", "tag": "d7cf7f63-773d-4a4f-8265-e97e901a0053"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:58.404573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b97531ec-c84f-433b-a26d-85d1a7bb1f4c req-ba7b6f5e-b0d3-4f92-a3dd-666988e05d30 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.411716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b97531ec-c84f-433b-a26d-85d1a7bb1f4c req-ba7b6f5e-b0d3-4f92-a3dd-666988e05d30 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.428068 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b97531ec-c84f-433b-a26d-85d1a7bb1f4c req-ba7b6f5e-b0d3-4f92-a3dd-666988e05d30 service nova] Creating event network-vif-plugged:d7cf7f63-773d-4a4f-8265-e97e901a0053 for instance 034c7ae4-bae3-4c4b-89ce-1385b8789042 on n-h1-767704-28 Jul 14 14:40:58.435342 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b97531ec-c84f-433b-a26d-85d1a7bb1f4c req-ba7b6f5e-b0d3-4f92-a3dd-666988e05d30 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.459272 Jul 14 14:40:58.436643 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1536/3073] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:58.450935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-56762c44-17b3-480e-8eea-bef4cc67e751 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:58.463888 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-56762c44-17b3-480e-8eea-bef4cc67e751 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1318 microversion: 2.1 time: 0.311809 Jul 14 14:40:58.481257 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1538/3074] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:58 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:58.752839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dad9d99d-516b-4c50-b0d9-41fe4f042323 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:58.754026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dad9d99d-516b-4c50-b0d9-41fe4f042323 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:58.781626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dad9d99d-516b-4c50-b0d9-41fe4f042323 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.784624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dad9d99d-516b-4c50-b0d9-41fe4f042323 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.791762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dad9d99d-516b-4c50-b0d9-41fe4f042323 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.793578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dad9d99d-516b-4c50-b0d9-41fe4f042323 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.993770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-da2e6f23-7b0a-4637-9e7c-029919998f77 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:58.994398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-da2e6f23-7b0a-4637-9e7c-029919998f77 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:59.006636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da2e6f23-7b0a-4637-9e7c-029919998f77 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.007302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da2e6f23-7b0a-4637-9e7c-029919998f77 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.008596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da2e6f23-7b0a-4637-9e7c-029919998f77 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.009238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da2e6f23-7b0a-4637-9e7c-029919998f77 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.220286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-da2e6f23-7b0a-4637-9e7c-029919998f77 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.242822 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-da2e6f23-7b0a-4637-9e7c-029919998f77 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1252 microversion: 2.1 time: 0.245337 Jul 14 14:40:59.243752 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1539/3075] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:58 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1252 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:59.260067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a33dc5e-7c25-4735-97dd-05d7ccfa0d10 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:59.262547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2a33dc5e-7c25-4735-97dd-05d7ccfa0d10 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:59.280853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a33dc5e-7c25-4735-97dd-05d7ccfa0d10 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.281350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a33dc5e-7c25-4735-97dd-05d7ccfa0d10 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.282497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a33dc5e-7c25-4735-97dd-05d7ccfa0d10 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.282951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a33dc5e-7c25-4735-97dd-05d7ccfa0d10 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.390235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dad9d99d-516b-4c50-b0d9-41fe4f042323 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.399954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dad9d99d-516b-4c50-b0d9-41fe4f042323 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.401497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dad9d99d-516b-4c50-b0d9-41fe4f042323 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.402679 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dad9d99d-516b-4c50-b0d9-41fe4f042323 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1891 microversion: 2.42 time: 0.655334 Jul 14 14:40:59.425344 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1537/3076] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:58 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1891 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:59.466732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2a33dc5e-7c25-4735-97dd-05d7ccfa0d10 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.483219 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a33dc5e-7c25-4735-97dd-05d7ccfa0d10 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1250 microversion: 2.1 time: 0.236934 Jul 14 14:40:59.484695 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1540/3077] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:59 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1250 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:59.486590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f26c5eb0-46ac-46cf-ae8b-77daa64a8fed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:59.487214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f26c5eb0-46ac-46cf-ae8b-77daa64a8fed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:59.502329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f26c5eb0-46ac-46cf-ae8b-77daa64a8fed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.502329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f26c5eb0-46ac-46cf-ae8b-77daa64a8fed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.503043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f26c5eb0-46ac-46cf-ae8b-77daa64a8fed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.503485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f26c5eb0-46ac-46cf-ae8b-77daa64a8fed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.838656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f26c5eb0-46ac-46cf-ae8b-77daa64a8fed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.863395 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f26c5eb0-46ac-46cf-ae8b-77daa64a8fed tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1318 microversion: 2.1 time: 0.380529 Jul 14 14:40:59.867442 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1538/3078] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:59 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:41:00.261501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a006172c-af56-4e64-82ce-60298734e2d3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:00.274334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a006172c-af56-4e64-82ce-60298734e2d3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:00.298977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a006172c-af56-4e64-82ce-60298734e2d3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:00.300184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a006172c-af56-4e64-82ce-60298734e2d3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:00.303005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a006172c-af56-4e64-82ce-60298734e2d3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:00.309497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a006172c-af56-4e64-82ce-60298734e2d3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:00.422307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f2cf59db-15bd-4eab-8265-bf9e5d14cc0b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:00.423001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f2cf59db-15bd-4eab-8265-bf9e5d14cc0b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:00.432057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2cf59db-15bd-4eab-8265-bf9e5d14cc0b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:00.432535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2cf59db-15bd-4eab-8265-bf9e5d14cc0b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:00.433402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2cf59db-15bd-4eab-8265-bf9e5d14cc0b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:00.433855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2cf59db-15bd-4eab-8265-bf9e5d14cc0b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:00.847327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a006172c-af56-4e64-82ce-60298734e2d3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03af57d274df4507b3d350194128502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991226f89eee4c4dbc3ec5870984d61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:00.858438 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a006172c-af56-4e64-82ce-60298734e2d3 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 200 len: 1252 microversion: 2.1 time: 0.602150 Jul 14 14:41:00.859061 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1541/3079] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:00 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 1252 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:00.897615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-908794df-3193-47c2-aba3-5bc9282583c6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:00.898449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-908794df-3193-47c2-aba3-5bc9282583c6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:00.927967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-908794df-3193-47c2-aba3-5bc9282583c6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:00.937260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-908794df-3193-47c2-aba3-5bc9282583c6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:00.938397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-908794df-3193-47c2-aba3-5bc9282583c6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:00.938993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-908794df-3193-47c2-aba3-5bc9282583c6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:01.967067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-908794df-3193-47c2-aba3-5bc9282583c6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:02.017893 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-908794df-3193-47c2-aba3-5bc9282583c6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1304 microversion: 2.1 time: 1.134427 Jul 14 14:41:02.021330 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1542/3080] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:00 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1304 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:02.029256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3e004ddb-42f5-4f34-9f12-c4408095ba72 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:02.031007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3e004ddb-42f5-4f34-9f12-c4408095ba72 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:02.040535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e004ddb-42f5-4f34-9f12-c4408095ba72 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:02.041688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e004ddb-42f5-4f34-9f12-c4408095ba72 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:02.043015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e004ddb-42f5-4f34-9f12-c4408095ba72 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:02.044172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e004ddb-42f5-4f34-9f12-c4408095ba72 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:02.725142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f2cf59db-15bd-4eab-8265-bf9e5d14cc0b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:02.744474 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f2cf59db-15bd-4eab-8265-bf9e5d14cc0b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:02.750097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f2cf59db-15bd-4eab-8265-bf9e5d14cc0b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:02.758472 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f2cf59db-15bd-4eab-8265-bf9e5d14cc0b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1891 microversion: 2.42 time: 2.340551 Jul 14 14:41:02.774384 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1539/3081] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:00 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1891 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:02.781187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b11938f0-1d38-4a8d-a003-29ca97ce5732 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:02.795951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b11938f0-1d38-4a8d-a003-29ca97ce5732 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] [instance: 7de27ce5-f75f-47eb-8dee-2a9d98e103f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:02.814935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b11938f0-1d38-4a8d-a003-29ca97ce5732 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:02.820547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b11938f0-1d38-4a8d-a003-29ca97ce5732 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:02.837434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b11938f0-1d38-4a8d-a003-29ca97ce5732 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:02.838055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b11938f0-1d38-4a8d-a003-29ca97ce5732 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:02.896251 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b11938f0-1d38-4a8d-a003-29ca97ce5732 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] HTTP exception thrown: Instance 7de27ce5-f75f-47eb-8dee-2a9d98e103f5 could not be found. Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b11938f0-1d38-4a8d-a003-29ca97ce5732 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Request method failure captured: Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 HTTP/1.1 Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CpizJCYdXp1-vQ6s8LBlWaGU82eXIm6NK81j4jmpsBhrZvgE6JAsTcix83LmbZjTkbQm6KkQiGXQKz-3uq-ZCqICNTyCobtlmWzeTYsZMyUpFE-e4VbyKebSHqIicCQr7YpE9iwqBbmS7EdFXOJOdvMVaHjOvKHnw2MR7Yo1eOHe0c Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 991226f89eee4c4dbc3ec5870984d61d Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestBootFromVolume-1494593284 Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/991226f89eee4c4dbc3ec5870984d61d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/991226f89eee4c4dbc3ec5870984d61d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_991226f89eee4c4dbc3ec5870984d61d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/991226f89eee4c4dbc3ec5870984d61d"}]}] Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestBootFromVolume-1494593284 Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 991226f89eee4c4dbc3ec5870984d61d Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1494593284 Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestBootFromVolume-1494593284-project Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 03af57d274df4507b3d350194128502e Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestBootFromVolume-1494593284-project Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 7de27ce5-f75f-47eb-8dee-2a9d98e103f5 could not be found. Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '7de27ce5-f75f-47eb-8dee-2a9d98e103f5'} Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de27ce5-f75f-47eb-8dee-2a9d98e103f5 could not be found. Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de27ce5-f75f-47eb-8dee-2a9d98e103f5 could not be found. Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:02.898012 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:02.903313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:02.903313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:02.903313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:02.903313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:41:02.903313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:41:02.903313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de27ce5-f75f-47eb-8dee-2a9d98e103f5 could not be found. Jul 14 14:41:02.903313 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:02.903313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b11938f0-1d38-4a8d-a003-29ca97ce5732 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Returning 404 to user: Instance 7de27ce5-f75f-47eb-8dee-2a9d98e103f5 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:02.911453 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b11938f0-1d38-4a8d-a003-29ca97ce5732 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5" status: 404 len: 111 microversion: 2.1 time: 0.123687 Jul 14 14:41:02.912092 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1540/3082] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:02 2022] GET /compute/v2.1/servers/7de27ce5-f75f-47eb-8dee-2a9d98e103f5 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:41:02.931070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98606333-fdb1-43c6-86c2-3351ead82947 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] Calling method '.version_select at 0x7fd6c62ac430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:02.992939 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98606333-fdb1-43c6-86c2-3351ead82947 tempest-ServersTestBootFromVolume-1494593284 tempest-ServersTestBootFromVolume-1494593284-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-438563365" status: 202 len: 0 microversion: 2.1 time: 0.074994 Jul 14 14:41:03.005235 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1541/3083] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jul 14 14:41:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-438563365 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:41:03.039143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-416919e3-6c7c-4e01-ab7a-b1facae8c483 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:03.039873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-416919e3-6c7c-4e01-ab7a-b1facae8c483 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:03.048826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-416919e3-6c7c-4e01-ab7a-b1facae8c483 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:03.052892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-416919e3-6c7c-4e01-ab7a-b1facae8c483 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:03.054026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-416919e3-6c7c-4e01-ab7a-b1facae8c483 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:03.055987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-416919e3-6c7c-4e01-ab7a-b1facae8c483 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:03.215582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3e004ddb-42f5-4f34-9f12-c4408095ba72 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:03.256372 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3e004ddb-42f5-4f34-9f12-c4408095ba72 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 200 len: 1507 microversion: 2.1 time: 1.230932 Jul 14 14:41:03.257523 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1543/3084] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:02 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 1507 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:03.288674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dfcd70f9-2250-4aef-8abe-16a3d6fd14df tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:03.289341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dfcd70f9-2250-4aef-8abe-16a3d6fd14df tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: e7c3ddd2-01d9-4408-8a2e-202c81d52163] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:03.322562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfcd70f9-2250-4aef-8abe-16a3d6fd14df tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:03.324913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfcd70f9-2250-4aef-8abe-16a3d6fd14df tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:03.328718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfcd70f9-2250-4aef-8abe-16a3d6fd14df tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:03.336832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfcd70f9-2250-4aef-8abe-16a3d6fd14df tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:03.353318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-416919e3-6c7c-4e01-ab7a-b1facae8c483 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:03.378054 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-416919e3-6c7c-4e01-ab7a-b1facae8c483 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1304 microversion: 2.1 time: 0.344312 Jul 14 14:41:03.382928 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1542/3085] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:03 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1304 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:41:03.791738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6a4cbff5-45d0-48e0-b715-c82ec45aa5d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:03.793372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6a4cbff5-45d0-48e0-b715-c82ec45aa5d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:03.813818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a4cbff5-45d0-48e0-b715-c82ec45aa5d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:03.814722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a4cbff5-45d0-48e0-b715-c82ec45aa5d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:03.816372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a4cbff5-45d0-48e0-b715-c82ec45aa5d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:03.817691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a4cbff5-45d0-48e0-b715-c82ec45aa5d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:06.569742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dfcd70f9-2250-4aef-8abe-16a3d6fd14df tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:06.595861 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dfcd70f9-2250-4aef-8abe-16a3d6fd14df tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163" status: 200 len: 1318 microversion: 2.1 time: 3.300362 Jul 14 14:41:06.596598 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1544/3086] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:03 2022] GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163 => generated 1318 bytes in 3313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:41:06.625443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-afb8548c-e72a-4a6c-8754-f1bb6c416e48 req-c0cdaa34-33e1-42f5-a963-4a713a99945d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c3ddd2-01d9-4408-8a2e-202c81d52163", "name": "network-vif-plugged", "status": "completed", "tag": "3c75219c-59f7-42d2-af35-e764b0455ad5"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:06.657174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-afb8548c-e72a-4a6c-8754-f1bb6c416e48 req-c0cdaa34-33e1-42f5-a963-4a713a99945d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:06.657545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-afb8548c-e72a-4a6c-8754-f1bb6c416e48 req-c0cdaa34-33e1-42f5-a963-4a713a99945d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:06.714354 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-afb8548c-e72a-4a6c-8754-f1bb6c416e48 req-c0cdaa34-33e1-42f5-a963-4a713a99945d service nova] Creating event network-vif-plugged:3c75219c-59f7-42d2-af35-e764b0455ad5 for instance e7c3ddd2-01d9-4408-8a2e-202c81d52163 on n-h2-767704-28 Jul 14 14:41:06.743764 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-afb8548c-e72a-4a6c-8754-f1bb6c416e48 req-c0cdaa34-33e1-42f5-a963-4a713a99945d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145815 Jul 14 14:41:06.746323 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1545/3087] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:06.796260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-299b8614-d165-439c-8f79-ef17de603160 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:06.797486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-299b8614-d165-439c-8f79-ef17de603160 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:06.836039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-299b8614-d165-439c-8f79-ef17de603160 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:06.836503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-299b8614-d165-439c-8f79-ef17de603160 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:06.837380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-299b8614-d165-439c-8f79-ef17de603160 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:06.837834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-299b8614-d165-439c-8f79-ef17de603160 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:07.019707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6a4cbff5-45d0-48e0-b715-c82ec45aa5d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:07.070177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6a4cbff5-45d0-48e0-b715-c82ec45aa5d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:07.084391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6a4cbff5-45d0-48e0-b715-c82ec45aa5d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:07.093995 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6a4cbff5-45d0-48e0-b715-c82ec45aa5d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1891 microversion: 2.42 time: 3.303593 Jul 14 14:41:07.097689 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1543/3088] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:03 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1891 bytes in 3313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:07.616544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7dba9aa0-ec1f-4359-a26d-9a6fa1638a81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:07.617528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7dba9aa0-ec1f-4359-a26d-9a6fa1638a81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: e7c3ddd2-01d9-4408-8a2e-202c81d52163] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:07.633091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7dba9aa0-ec1f-4359-a26d-9a6fa1638a81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:07.637671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7dba9aa0-ec1f-4359-a26d-9a6fa1638a81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:07.655869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7dba9aa0-ec1f-4359-a26d-9a6fa1638a81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:07.662665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7dba9aa0-ec1f-4359-a26d-9a6fa1638a81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:07.839680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:08.032748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-299b8614-d165-439c-8f79-ef17de603160 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:08.073230 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-299b8614-d165-439c-8f79-ef17de603160 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 1.312301 Jul 14 14:41:08.087626 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1546/3089] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:06 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:08.131540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a2cd145-995a-498a-b485-198245b9e6a9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:08.132291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3a2cd145-995a-498a-b485-198245b9e6a9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:08.149673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:08.154602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a2cd145-995a-498a-b485-198245b9e6a9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:08.156500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a2cd145-995a-498a-b485-198245b9e6a9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:08.164558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a2cd145-995a-498a-b485-198245b9e6a9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:08.165852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a2cd145-995a-498a-b485-198245b9e6a9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:09.058884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3a2cd145-995a-498a-b485-198245b9e6a9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:09.103801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3a2cd145-995a-498a-b485-198245b9e6a9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:09.109515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3a2cd145-995a-498a-b485-198245b9e6a9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:09.126814 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3a2cd145-995a-498a-b485-198245b9e6a9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 1.000195 Jul 14 14:41:09.135218 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1547/3090] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:08 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:09.148695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-fe452e30-677d-48e1-9746-b36a3a07a84b req-12fa03cd-0436-45f9-b386-e353717f7cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b55c122-95db-42f1-95a9-ae5bbb4ff958", "name": "network-vif-plugged", "status": "completed", "tag": "b14caf9c-97a3-483c-92a9-d43af26af98c"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:09.172477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-fe452e30-677d-48e1-9746-b36a3a07a84b req-12fa03cd-0436-45f9-b386-e353717f7cf0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:09.177125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-fe452e30-677d-48e1-9746-b36a3a07a84b req-12fa03cd-0436-45f9-b386-e353717f7cf0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:09.279062 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-fe452e30-677d-48e1-9746-b36a3a07a84b req-12fa03cd-0436-45f9-b386-e353717f7cf0 service nova] Creating event network-vif-plugged:b14caf9c-97a3-483c-92a9-d43af26af98c for instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 on n-h2-767704-28 Jul 14 14:41:09.308706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7dba9aa0-ec1f-4359-a26d-9a6fa1638a81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:09.320713 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-fe452e30-677d-48e1-9746-b36a3a07a84b req-12fa03cd-0436-45f9-b386-e353717f7cf0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174193 Jul 14 14:41:09.321964 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1548/3091] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:09.327475 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7dba9aa0-ec1f-4359-a26d-9a6fa1638a81 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163" status: 200 len: 1318 microversion: 2.1 time: 1.714954 Jul 14 14:41:09.330626 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1544/3092] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:07 2022] GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163 => generated 1318 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:09.380994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9af28c37-98ad-4ebf-bfd8-a8e4503ba8b3 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:09.385813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9af28c37-98ad-4ebf-bfd8-a8e4503ba8b3 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:09.435725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9af28c37-98ad-4ebf-bfd8-a8e4503ba8b3 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:09.439039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9af28c37-98ad-4ebf-bfd8-a8e4503ba8b3 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:09.441281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9af28c37-98ad-4ebf-bfd8-a8e4503ba8b3 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:09.444172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9af28c37-98ad-4ebf-bfd8-a8e4503ba8b3 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:09.572632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:10.152567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7c67b52b-9d7a-4e0c-bd0a-e226455352c3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:10.153359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7c67b52b-9d7a-4e0c-bd0a-e226455352c3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:10.175847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c67b52b-9d7a-4e0c-bd0a-e226455352c3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:10.177103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c67b52b-9d7a-4e0c-bd0a-e226455352c3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:10.177802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c67b52b-9d7a-4e0c-bd0a-e226455352c3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:10.192692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c67b52b-9d7a-4e0c-bd0a-e226455352c3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:10.534091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9af28c37-98ad-4ebf-bfd8-a8e4503ba8b3 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:10.546615 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9af28c37-98ad-4ebf-bfd8-a8e4503ba8b3 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 1.220933 Jul 14 14:41:10.551300 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1549/3093] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:09 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:10.574039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d1e09a5e-9fd4-43b1-9c58-bb8cfcad98a8 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:10.576409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d1e09a5e-9fd4-43b1-9c58-bb8cfcad98a8 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: e7c3ddd2-01d9-4408-8a2e-202c81d52163] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:10.599363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1e09a5e-9fd4-43b1-9c58-bb8cfcad98a8 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:10.604830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1e09a5e-9fd4-43b1-9c58-bb8cfcad98a8 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:10.606514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1e09a5e-9fd4-43b1-9c58-bb8cfcad98a8 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:10.610379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1e09a5e-9fd4-43b1-9c58-bb8cfcad98a8 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:11.869209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c67b52b-9d7a-4e0c-bd0a-e226455352c3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:11.892835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c67b52b-9d7a-4e0c-bd0a-e226455352c3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:11.913549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c67b52b-9d7a-4e0c-bd0a-e226455352c3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:11.914766 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7c67b52b-9d7a-4e0c-bd0a-e226455352c3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 1.766672 Jul 14 14:41:11.929898 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1545/3094] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:10 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:41:11.944701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5515555b-e2ed-4386-bd76-346b3f7466ed tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:11.962539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5515555b-e2ed-4386-bd76-346b3f7466ed tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:12.001083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5515555b-e2ed-4386-bd76-346b3f7466ed tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:12.001713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5515555b-e2ed-4386-bd76-346b3f7466ed tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:12.002581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5515555b-e2ed-4386-bd76-346b3f7466ed tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:12.003117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5515555b-e2ed-4386-bd76-346b3f7466ed tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:12.165244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d1e09a5e-9fd4-43b1-9c58-bb8cfcad98a8 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:12.179262 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d1e09a5e-9fd4-43b1-9c58-bb8cfcad98a8 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163" status: 200 len: 1507 microversion: 2.1 time: 1.620127 Jul 14 14:41:12.184976 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1550/3095] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:10 2022] GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163 => generated 1507 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:12.214576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b3a4d59c-564f-4d8c-b612-16e2d479f046 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:12.215145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b3a4d59c-564f-4d8c-b612-16e2d479f046 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: e7c3ddd2-01d9-4408-8a2e-202c81d52163] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:12.260137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3a4d59c-564f-4d8c-b612-16e2d479f046 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:12.263216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3a4d59c-564f-4d8c-b612-16e2d479f046 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:12.265728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3a4d59c-564f-4d8c-b612-16e2d479f046 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:12.267195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3a4d59c-564f-4d8c-b612-16e2d479f046 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:12.428303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b3a4d59c-564f-4d8c-b612-16e2d479f046 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: e7c3ddd2-01d9-4408-8a2e-202c81d52163] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:41:12.958470 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b3a4d59c-564f-4d8c-b612-16e2d479f046 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163" status: 204 len: 0 microversion: 2.1 time: 0.746723 Jul 14 14:41:12.976694 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1551/3096] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:41:12 2022] DELETE /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:41:13.000739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f30db8b7-2e82-4948-b64f-a67681967053 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:13.028576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f30db8b7-2e82-4948-b64f-a67681967053 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:13.069456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f30db8b7-2e82-4948-b64f-a67681967053 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:13.069919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f30db8b7-2e82-4948-b64f-a67681967053 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:13.070726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f30db8b7-2e82-4948-b64f-a67681967053 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:13.071169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f30db8b7-2e82-4948-b64f-a67681967053 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:13.174353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5515555b-e2ed-4386-bd76-346b3f7466ed tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:13.187490 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5515555b-e2ed-4386-bd76-346b3f7466ed tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 1.257808 Jul 14 14:41:13.188348 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1546/3097] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:11 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:13.207799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a4d8c6e6-d302-40a2-a18c-2b30f94ddc5b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:13.212760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a4d8c6e6-d302-40a2-a18c-2b30f94ddc5b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:13.242350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4d8c6e6-d302-40a2-a18c-2b30f94ddc5b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:13.257626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4d8c6e6-d302-40a2-a18c-2b30f94ddc5b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:13.258744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4d8c6e6-d302-40a2-a18c-2b30f94ddc5b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:13.263509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4d8c6e6-d302-40a2-a18c-2b30f94ddc5b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:13.400586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a4d8c6e6-d302-40a2-a18c-2b30f94ddc5b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:41:13.805316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:13.836189 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a4d8c6e6-d302-40a2-a18c-2b30f94ddc5b tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "DELETE /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 204 len: 0 microversion: 2.1 time: 0.641183 Jul 14 14:41:13.837468 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1547/3098] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:41:13 2022] DELETE /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:41:13.852452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aaac4979-8c78-4dc4-a689-a2a9b8b4b7ef tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:13.856176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aaac4979-8c78-4dc4-a689-a2a9b8b4b7ef tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: e7c3ddd2-01d9-4408-8a2e-202c81d52163] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:13.875341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aaac4979-8c78-4dc4-a689-a2a9b8b4b7ef tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:13.878169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aaac4979-8c78-4dc4-a689-a2a9b8b4b7ef tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:13.879249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aaac4979-8c78-4dc4-a689-a2a9b8b4b7ef tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:13.879931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aaac4979-8c78-4dc4-a689-a2a9b8b4b7ef tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:13.950495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:15.327207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f30db8b7-2e82-4948-b64f-a67681967053 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:15.370631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f30db8b7-2e82-4948-b64f-a67681967053 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:15.388703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f30db8b7-2e82-4948-b64f-a67681967053 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:15.394626 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f30db8b7-2e82-4948-b64f-a67681967053 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 2.415369 Jul 14 14:41:15.401330 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1552/3099] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:12 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 2424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:15.431202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b92b7b6f-e008-41ed-89a4-48222c4032ee tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:15.435086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b92b7b6f-e008-41ed-89a4-48222c4032ee tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:15.468781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b92b7b6f-e008-41ed-89a4-48222c4032ee tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:15.471961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b92b7b6f-e008-41ed-89a4-48222c4032ee tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:15.479205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b92b7b6f-e008-41ed-89a4-48222c4032ee tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:15.481314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b92b7b6f-e008-41ed-89a4-48222c4032ee tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:15.762398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aaac4979-8c78-4dc4-a689-a2a9b8b4b7ef tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:15.809114 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aaac4979-8c78-4dc4-a689-a2a9b8b4b7ef tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163" status: 200 len: 1513 microversion: 2.1 time: 1.965106 Jul 14 14:41:15.825117 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1548/3100] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:13 2022] GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163 => generated 1513 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:15.901589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-375ad303-8f5b-41c3-b7e5-a24db1febf3c req-8712cdd0-287d-44d1-bbb2-01e74d6c92fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541b73d3-64ab-41c0-89c8-2930dc27af78", "tag": "4d97ea2e-c67b-4934-8bcd-ea2649569911"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:15.963459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-375ad303-8f5b-41c3-b7e5-a24db1febf3c req-8712cdd0-287d-44d1-bbb2-01e74d6c92fb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:15.974786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-375ad303-8f5b-41c3-b7e5-a24db1febf3c req-8712cdd0-287d-44d1-bbb2-01e74d6c92fb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:16.030029 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-375ad303-8f5b-41c3-b7e5-a24db1febf3c req-8712cdd0-287d-44d1-bbb2-01e74d6c92fb service nova] Creating event network-changed:4d97ea2e-c67b-4934-8bcd-ea2649569911 for instance 541b73d3-64ab-41c0-89c8-2930dc27af78 on n-h2-767704-28 Jul 14 14:41:16.036738 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-375ad303-8f5b-41c3-b7e5-a24db1febf3c req-8712cdd0-287d-44d1-bbb2-01e74d6c92fb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209122 Jul 14 14:41:16.038970 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1549/3101] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:16.438938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d74c5f58-10a4-4d78-8e44-e5d2f5deda72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:16.440534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d74c5f58-10a4-4d78-8e44-e5d2f5deda72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:16.460110 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d74c5f58-10a4-4d78-8e44-e5d2f5deda72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:16.465354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d74c5f58-10a4-4d78-8e44-e5d2f5deda72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:16.467047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d74c5f58-10a4-4d78-8e44-e5d2f5deda72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:16.469687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d74c5f58-10a4-4d78-8e44-e5d2f5deda72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:18.773940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b92b7b6f-e008-41ed-89a4-48222c4032ee tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:18.789840 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b92b7b6f-e008-41ed-89a4-48222c4032ee tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 3.379359 Jul 14 14:41:18.807760 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1553/3102] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:15 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 3389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:18.812931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b6d966b4-0cf9-4761-8a2d-bdea30adb854 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:18.813904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b6d966b4-0cf9-4761-8a2d-bdea30adb854 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: e7c3ddd2-01d9-4408-8a2e-202c81d52163] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:18.845791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6d966b4-0cf9-4761-8a2d-bdea30adb854 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:18.846249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6d966b4-0cf9-4761-8a2d-bdea30adb854 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:18.847066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6d966b4-0cf9-4761-8a2d-bdea30adb854 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:18.847523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6d966b4-0cf9-4761-8a2d-bdea30adb854 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:19.105257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d74c5f58-10a4-4d78-8e44-e5d2f5deda72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:19.136232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d74c5f58-10a4-4d78-8e44-e5d2f5deda72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:19.142341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d74c5f58-10a4-4d78-8e44-e5d2f5deda72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:19.148120 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d74c5f58-10a4-4d78-8e44-e5d2f5deda72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 2.712978 Jul 14 14:41:19.163689 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1550/3103] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:16 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 2733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:41:19.169765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c0431b0c-690a-4118-8c4e-2c65b31597ed req-77dc8355-44f0-416f-9081-ab741979faff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034c7ae4-bae3-4c4b-89ce-1385b8789042", "name": "network-vif-unplugged", "status": "completed", "tag": "d7cf7f63-773d-4a4f-8265-e97e901a0053"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:19.181422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c0431b0c-690a-4118-8c4e-2c65b31597ed req-77dc8355-44f0-416f-9081-ab741979faff service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:19.182196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c0431b0c-690a-4118-8c4e-2c65b31597ed req-77dc8355-44f0-416f-9081-ab741979faff service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:19.200277 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c0431b0c-690a-4118-8c4e-2c65b31597ed req-77dc8355-44f0-416f-9081-ab741979faff service nova] Creating event network-vif-unplugged:d7cf7f63-773d-4a4f-8265-e97e901a0053 for instance 034c7ae4-bae3-4c4b-89ce-1385b8789042 on n-h1-767704-28 Jul 14 14:41:19.220260 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c0431b0c-690a-4118-8c4e-2c65b31597ed req-77dc8355-44f0-416f-9081-ab741979faff service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054862 Jul 14 14:41:19.226174 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1551/3104] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:19.259007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-575ddb38-f9a2-43ed-89a9-75c3c5619c0c req-3ebd933b-3b53-47b9-8041-f592a9cd6a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c3ddd2-01d9-4408-8a2e-202c81d52163", "name": "network-vif-deleted", "tag": "3c75219c-59f7-42d2-af35-e764b0455ad5"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:19.286805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-575ddb38-f9a2-43ed-89a9-75c3c5619c0c req-3ebd933b-3b53-47b9-8041-f592a9cd6a70 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:19.287580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-575ddb38-f9a2-43ed-89a9-75c3c5619c0c req-3ebd933b-3b53-47b9-8041-f592a9cd6a70 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:19.325445 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-575ddb38-f9a2-43ed-89a9-75c3c5619c0c req-3ebd933b-3b53-47b9-8041-f592a9cd6a70 service nova] Creating event network-vif-deleted:3c75219c-59f7-42d2-af35-e764b0455ad5 for instance e7c3ddd2-01d9-4408-8a2e-202c81d52163 on n-h2-767704-28 Jul 14 14:41:19.358030 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-575ddb38-f9a2-43ed-89a9-75c3c5619c0c req-3ebd933b-3b53-47b9-8041-f592a9cd6a70 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088869 Jul 14 14:41:19.364042 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1552/3105] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:19.382366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b6d966b4-0cf9-4761-8a2d-bdea30adb854 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea6d3737ade48b28caa4de080a83bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc4a794988d4bfd9e3566a815233828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:19.391429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b6d966b4-0cf9-4761-8a2d-bdea30adb854 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163" status: 200 len: 1471 microversion: 2.1 time: 0.594464 Jul 14 14:41:19.401940 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1554/3106] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:18 2022] GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163 => generated 1471 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:19.821945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ffd49fdc-8079-44e7-98c7-af8471aef6c5 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:19.834460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ffd49fdc-8079-44e7-98c7-af8471aef6c5 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:19.852716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffd49fdc-8079-44e7-98c7-af8471aef6c5 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:19.858863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffd49fdc-8079-44e7-98c7-af8471aef6c5 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:19.860912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffd49fdc-8079-44e7-98c7-af8471aef6c5 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:19.861464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffd49fdc-8079-44e7-98c7-af8471aef6c5 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:20.171739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-da1da94b-dd69-4a19-ada3-99ffa4546d02 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:20.172380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-da1da94b-dd69-4a19-ada3-99ffa4546d02 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:20.183249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da1da94b-dd69-4a19-ada3-99ffa4546d02 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:20.189818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da1da94b-dd69-4a19-ada3-99ffa4546d02 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:20.191318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da1da94b-dd69-4a19-ada3-99ffa4546d02 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:20.198781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da1da94b-dd69-4a19-ada3-99ffa4546d02 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:21.808814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ffd49fdc-8079-44e7-98c7-af8471aef6c5 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:21.860485 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ffd49fdc-8079-44e7-98c7-af8471aef6c5 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 2.047253 Jul 14 14:41:21.871673 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1553/3107] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:19 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:21.908218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45c39890-f74b-4f75-becf-a85ee9cc60a5 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:21.921423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-45c39890-f74b-4f75-becf-a85ee9cc60a5 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: e7c3ddd2-01d9-4408-8a2e-202c81d52163] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:21.938961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45c39890-f74b-4f75-becf-a85ee9cc60a5 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:21.968203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45c39890-f74b-4f75-becf-a85ee9cc60a5 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:21.972084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45c39890-f74b-4f75-becf-a85ee9cc60a5 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:21.974145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45c39890-f74b-4f75-becf-a85ee9cc60a5 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:22.045541 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-45c39890-f74b-4f75-becf-a85ee9cc60a5 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] HTTP exception thrown: Instance e7c3ddd2-01d9-4408-8a2e-202c81d52163 could not be found. Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45c39890-f74b-4f75-becf-a85ee9cc60a5 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Request method failure captured: Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163 HTTP/1.1 Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cq6rv7igKsGVDMu0ye4OMq5ANE94mTnJsMaZJzPJ8JbOS3l2uvq5eQeepwpZlTttFIeCRzUkxFRP7HOUXeTGFKKQbEERtsagLV4a7xV_Y8vCwYWinarvhghTRWpg5pAAMpQea3w0hf0MigIW6iyqP2cjSrs7FkEgLfEWjCHb5vi0uU Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: bfc4a794988d4bfd9e3566a815233828 Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-MultipleCreateTestJSON-122551120 Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bfc4a794988d4bfd9e3566a815233828"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bfc4a794988d4bfd9e3566a815233828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bfc4a794988d4bfd9e3566a815233828", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bfc4a794988d4bfd9e3566a815233828"}]}] Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-MultipleCreateTestJSON-122551120 Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: bfc4a794988d4bfd9e3566a815233828 Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-MultipleCreateTestJSON-122551120 Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-MultipleCreateTestJSON-122551120-project Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 5ea6d3737ade48b28caa4de080a83bea Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-MultipleCreateTestJSON-122551120-project Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance e7c3ddd2-01d9-4408-8a2e-202c81d52163 could not be found. Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'e7c3ddd2-01d9-4408-8a2e-202c81d52163'} Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c3ddd2-01d9-4408-8a2e-202c81d52163 could not be found. Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c3ddd2-01d9-4408-8a2e-202c81d52163 could not be found. Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:22.057913 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:22.062835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:22.062835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:22.062835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:22.062835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:41:22.062835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:41:22.062835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c3ddd2-01d9-4408-8a2e-202c81d52163 could not be found. Jul 14 14:41:22.062835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:22.067657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45c39890-f74b-4f75-becf-a85ee9cc60a5 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Returning 404 to user: Instance e7c3ddd2-01d9-4408-8a2e-202c81d52163 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:22.080818 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-45c39890-f74b-4f75-becf-a85ee9cc60a5 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163" status: 404 len: 111 microversion: 2.1 time: 0.200392 Jul 14 14:41:22.086683 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1554/3108] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:21 2022] GET /compute/v2.1/servers/e7c3ddd2-01d9-4408-8a2e-202c81d52163 => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:41:22.100365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-16a3b480-87e9-4526-a7dc-0c0e675513c9 req-f0c97adc-2a05-45f6-b528-e211ff92910a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034c7ae4-bae3-4c4b-89ce-1385b8789042", "name": "network-vif-deleted", "tag": "d7cf7f63-773d-4a4f-8265-e97e901a0053"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:22.138345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-16a3b480-87e9-4526-a7dc-0c0e675513c9 req-f0c97adc-2a05-45f6-b528-e211ff92910a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:22.139217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-16a3b480-87e9-4526-a7dc-0c0e675513c9 req-f0c97adc-2a05-45f6-b528-e211ff92910a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:22.176222 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-16a3b480-87e9-4526-a7dc-0c0e675513c9 req-f0c97adc-2a05-45f6-b528-e211ff92910a service nova] Creating event network-vif-deleted:d7cf7f63-773d-4a4f-8265-e97e901a0053 for instance 034c7ae4-bae3-4c4b-89ce-1385b8789042 on n-h1-767704-28 Jul 14 14:41:22.195027 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-16a3b480-87e9-4526-a7dc-0c0e675513c9 req-f0c97adc-2a05-45f6-b528-e211ff92910a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103657 Jul 14 14:41:22.197038 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1555/3109] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:22.208395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44784e21-5824-4957-adf7-f81b60381938 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:22.209629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-44784e21-5824-4957-adf7-f81b60381938 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] [instance: 034c7ae4-bae3-4c4b-89ce-1385b8789042] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:22.246611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44784e21-5824-4957-adf7-f81b60381938 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:22.252767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44784e21-5824-4957-adf7-f81b60381938 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:22.254107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44784e21-5824-4957-adf7-f81b60381938 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:22.265492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44784e21-5824-4957-adf7-f81b60381938 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:22.296492 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-44784e21-5824-4957-adf7-f81b60381938 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] HTTP exception thrown: Instance 034c7ae4-bae3-4c4b-89ce-1385b8789042 could not be found. Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44784e21-5824-4957-adf7-f81b60381938 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Request method failure captured: Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 HTTP/1.1 Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cq6rv7igKsGVDMu0ye4OMq5ANE94mTnJsMaZJzPJ8JbOS3l2uvq5eQeepwpZlTttFIeCRzUkxFRP7HOUXeTGFKKQbEERtsagLV4a7xV_Y8vCwYWinarvhghTRWpg5pAAMpQea3w0hf0MigIW6iyqP2cjSrs7FkEgLfEWjCHb5vi0uU Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: bfc4a794988d4bfd9e3566a815233828 Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-MultipleCreateTestJSON-122551120 Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bfc4a794988d4bfd9e3566a815233828"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bfc4a794988d4bfd9e3566a815233828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bfc4a794988d4bfd9e3566a815233828", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bfc4a794988d4bfd9e3566a815233828"}]}] Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-MultipleCreateTestJSON-122551120 Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: bfc4a794988d4bfd9e3566a815233828 Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-MultipleCreateTestJSON-122551120 Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-MultipleCreateTestJSON-122551120-project Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 5ea6d3737ade48b28caa4de080a83bea Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-MultipleCreateTestJSON-122551120-project Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 034c7ae4-bae3-4c4b-89ce-1385b8789042 could not be found. Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '034c7ae4-bae3-4c4b-89ce-1385b8789042'} Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 034c7ae4-bae3-4c4b-89ce-1385b8789042 could not be found. Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 034c7ae4-bae3-4c4b-89ce-1385b8789042 could not be found. Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:22.302236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:22.307206 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:22.307206 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:22.307206 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:22.307206 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:41:22.307206 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:41:22.307206 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 034c7ae4-bae3-4c4b-89ce-1385b8789042 could not be found. Jul 14 14:41:22.307206 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:22.313484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44784e21-5824-4957-adf7-f81b60381938 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] Returning 404 to user: Instance 034c7ae4-bae3-4c4b-89ce-1385b8789042 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:22.317470 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-44784e21-5824-4957-adf7-f81b60381938 tempest-MultipleCreateTestJSON-122551120 tempest-MultipleCreateTestJSON-122551120-project] 10.222.0.81 "GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042" status: 404 len: 111 microversion: 2.1 time: 0.118796 Jul 14 14:41:22.324635 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1556/3110] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:22 2022] GET /compute/v2.1/servers/034c7ae4-bae3-4c4b-89ce-1385b8789042 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:41:22.597301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-da1da94b-dd69-4a19-ada3-99ffa4546d02 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:22.646697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-da1da94b-dd69-4a19-ada3-99ffa4546d02 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:22.654315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-da1da94b-dd69-4a19-ada3-99ffa4546d02 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:22.659286 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-da1da94b-dd69-4a19-ada3-99ffa4546d02 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 2.492264 Jul 14 14:41:22.670039 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1555/3111] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:20 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 2503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:41:22.883358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-53ae2668-5fc6-4959-96da-cbb1025b4b3e tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:22.885516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-53ae2668-5fc6-4959-96da-cbb1025b4b3e tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:22.925718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53ae2668-5fc6-4959-96da-cbb1025b4b3e tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:22.926910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53ae2668-5fc6-4959-96da-cbb1025b4b3e tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:22.939083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53ae2668-5fc6-4959-96da-cbb1025b4b3e tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:22.943373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53ae2668-5fc6-4959-96da-cbb1025b4b3e tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:23.700104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ea163e2c-7d75-47f7-b366-d7e27b29b410 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:23.702602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ea163e2c-7d75-47f7-b366-d7e27b29b410 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:23.745736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea163e2c-7d75-47f7-b366-d7e27b29b410 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:23.746671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea163e2c-7d75-47f7-b366-d7e27b29b410 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:23.747810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea163e2c-7d75-47f7-b366-d7e27b29b410 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:23.748513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea163e2c-7d75-47f7-b366-d7e27b29b410 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:25.244453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-53ae2668-5fc6-4959-96da-cbb1025b4b3e tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:25.253356 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-53ae2668-5fc6-4959-96da-cbb1025b4b3e tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 2.374569 Jul 14 14:41:25.258870 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1557/3112] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:22 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 2381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:25.462621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ea163e2c-7d75-47f7-b366-d7e27b29b410 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:25.491344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ea163e2c-7d75-47f7-b366-d7e27b29b410 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:25.498288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ea163e2c-7d75-47f7-b366-d7e27b29b410 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:25.510090 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ea163e2c-7d75-47f7-b366-d7e27b29b410 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 1.825474 Jul 14 14:41:25.514429 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1556/3113] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:23 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:26.276715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-51cd761f-1008-47df-8661-3e77bde7cd0d tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:26.278224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-51cd761f-1008-47df-8661-3e77bde7cd0d tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:26.374447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51cd761f-1008-47df-8661-3e77bde7cd0d tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.383816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51cd761f-1008-47df-8661-3e77bde7cd0d tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:26.394433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51cd761f-1008-47df-8661-3e77bde7cd0d tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.400033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51cd761f-1008-47df-8661-3e77bde7cd0d tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:26.534132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6c558b52-9ee2-48e9-95d9-245a4dfb7579 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:26.534780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6c558b52-9ee2-48e9-95d9-245a4dfb7579 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:26.593120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c558b52-9ee2-48e9-95d9-245a4dfb7579 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.593912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c558b52-9ee2-48e9-95d9-245a4dfb7579 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:26.602405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c558b52-9ee2-48e9-95d9-245a4dfb7579 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.604069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c558b52-9ee2-48e9-95d9-245a4dfb7579 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:28.759771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-51cd761f-1008-47df-8661-3e77bde7cd0d tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:28.781917 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-51cd761f-1008-47df-8661-3e77bde7cd0d tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 2.512085 Jul 14 14:41:28.783114 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1558/3114] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:26 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:28.803185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af3c1bcc-490c-4c63-b8e6-1b8d8d39cebe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:28.803821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-af3c1bcc-490c-4c63-b8e6-1b8d8d39cebe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:28.833857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af3c1bcc-490c-4c63-b8e6-1b8d8d39cebe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:28.834325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af3c1bcc-490c-4c63-b8e6-1b8d8d39cebe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:28.835155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af3c1bcc-490c-4c63-b8e6-1b8d8d39cebe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:28.835606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af3c1bcc-490c-4c63-b8e6-1b8d8d39cebe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:28.919586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6c558b52-9ee2-48e9-95d9-245a4dfb7579 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:28.946746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6c558b52-9ee2-48e9-95d9-245a4dfb7579 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:28.966197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6c558b52-9ee2-48e9-95d9-245a4dfb7579 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:28.967167 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6c558b52-9ee2-48e9-95d9-245a4dfb7579 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 2.439255 Jul 14 14:41:28.972932 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1557/3115] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:26 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 2445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:41:30.072267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1254765756", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "cc301344-a301-4077-a825-4e6e510942f4"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:30.092312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-af3c1bcc-490c-4c63-b8e6-1b8d8d39cebe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:30.094261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:30.120160 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-af3c1bcc-490c-4c63-b8e6-1b8d8d39cebe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 1.320456 Jul 14 14:41:30.146028 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1559/3116] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:28 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:30.182728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-076b89a0-a722-448b-b74e-d2c934377125 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:30.186493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-076b89a0-a722-448b-b74e-d2c934377125 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:30.203141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-076b89a0-a722-448b-b74e-d2c934377125 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.207415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-076b89a0-a722-448b-b74e-d2c934377125 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.234563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-076b89a0-a722-448b-b74e-d2c934377125 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.235893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-076b89a0-a722-448b-b74e-d2c934377125 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.298359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] validate_networks() for [('cc301344-a301-4077-a825-4e6e510942f4', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:41:31.356372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-076b89a0-a722-448b-b74e-d2c934377125 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:31.369135 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-076b89a0-a722-448b-b74e-d2c934377125 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 1.220492 Jul 14 14:41:31.369885 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1560/3117] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:30 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:31.387203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f1f9ca64-d7a8-4e29-9c9b-5879375c151b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:31.407215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f1f9ca64-d7a8-4e29-9c9b-5879375c151b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:31.431308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1f9ca64-d7a8-4e29-9c9b-5879375c151b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:31.431782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1f9ca64-d7a8-4e29-9c9b-5879375c151b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:31.432567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1f9ca64-d7a8-4e29-9c9b-5879375c151b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:31.433076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1f9ca64-d7a8-4e29-9c9b-5879375c151b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:32.284470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f1f9ca64-d7a8-4e29-9c9b-5879375c151b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:32.303920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f1f9ca64-d7a8-4e29-9c9b-5879375c151b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:32.310346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f1f9ca64-d7a8-4e29-9c9b-5879375c151b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:32.311588 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f1f9ca64-d7a8-4e29-9c9b-5879375c151b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 0.928526 Jul 14 14:41:32.312180 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1561/3118] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:31 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:32.328927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b3c8aaf1-6157-4fbc-9b30-10fb818c99f1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1679075139"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:32.330190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b3c8aaf1-6157-4fbc-9b30-10fb818c99f1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:32.340574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3c8aaf1-6157-4fbc-9b30-10fb818c99f1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:32.346513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3c8aaf1-6157-4fbc-9b30-10fb818c99f1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:32.348263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3c8aaf1-6157-4fbc-9b30-10fb818c99f1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:32.348593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3c8aaf1-6157-4fbc-9b30-10fb818c99f1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:32.951487 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b3c8aaf1-6157-4fbc-9b30-10fb818c99f1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.637603 Jul 14 14:41:32.952574 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1562/3119] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:41:32 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 14 14:41:32.986324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9cb872f7-5454-48fe-8f51-29fca22c5720 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:32.995180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9cb872f7-5454-48fe-8f51-29fca22c5720 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:33.015573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cb872f7-5454-48fe-8f51-29fca22c5720 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:33.016130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cb872f7-5454-48fe-8f51-29fca22c5720 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:33.017318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cb872f7-5454-48fe-8f51-29fca22c5720 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:33.017972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cb872f7-5454-48fe-8f51-29fca22c5720 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:33.043147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:41:33.043666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:41:33.044056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:41:33.044471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:41:33.044893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:41:33.072469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:33.073903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:33.075086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:33.075809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:33.106120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Getting quotas for project e1f5313420424f2c86ee5643b63b182a. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:41:33.117354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Getting quotas for user abe96b5619004d64a52d09c2ea48448d and project e1f5313420424f2c86ee5643b63b182a. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:41:33.135385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:41:33.139992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:41:33.235494 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2434acfb-53a0-470b-a86d-d2769197c1bb tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.604186 Jul 14 14:41:33.242222 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1558/3120] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:41:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:41:33.255623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e7f666f7-c052-452e-9f28-e999dd8b96e7 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:33.256804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e7f666f7-c052-452e-9f28-e999dd8b96e7 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:33.597614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e7f666f7-c052-452e-9f28-e999dd8b96e7 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:33.609171 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e7f666f7-c052-452e-9f28-e999dd8b96e7 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1217 microversion: 2.1 time: 0.363292 Jul 14 14:41:33.614262 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1559/3121] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:33 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1217 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:33.626490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-374bc9fc-7e1e-4f12-8047-a4a10d866af0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:33.628066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-374bc9fc-7e1e-4f12-8047-a4a10d866af0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:33.647405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-374bc9fc-7e1e-4f12-8047-a4a10d866af0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:33.648055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-374bc9fc-7e1e-4f12-8047-a4a10d866af0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:33.649196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-374bc9fc-7e1e-4f12-8047-a4a10d866af0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:33.650019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-374bc9fc-7e1e-4f12-8047-a4a10d866af0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:34.195889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9cb872f7-5454-48fe-8f51-29fca22c5720 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:34.215037 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9cb872f7-5454-48fe-8f51-29fca22c5720 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 1.258608 Jul 14 14:41:34.216888 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1563/3122] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:32 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:34.241826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d56e7743-0461-4c38-a702-4dcd5a320edd req-9f044d22-7e28-4b10-8ae4-b384b3432201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b55c122-95db-42f1-95a9-ae5bbb4ff958", "name": "network-vif-unplugged", "status": "completed", "tag": "b14caf9c-97a3-483c-92a9-d43af26af98c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:34.267329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d56e7743-0461-4c38-a702-4dcd5a320edd req-9f044d22-7e28-4b10-8ae4-b384b3432201 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:34.268087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d56e7743-0461-4c38-a702-4dcd5a320edd req-9f044d22-7e28-4b10-8ae4-b384b3432201 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:34.292170 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d56e7743-0461-4c38-a702-4dcd5a320edd req-9f044d22-7e28-4b10-8ae4-b384b3432201 service nova] Creating event network-vif-unplugged:b14caf9c-97a3-483c-92a9-d43af26af98c for instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 on n-h2-767704-28 Jul 14 14:41:34.311948 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d56e7743-0461-4c38-a702-4dcd5a320edd req-9f044d22-7e28-4b10-8ae4-b384b3432201 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092809 Jul 14 14:41:34.313984 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1564/3123] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:34.614898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-374bc9fc-7e1e-4f12-8047-a4a10d866af0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:34.633845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-36ba7a54-0b93-49c9-9f26-9a6cde7c7208 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:34.634883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-36ba7a54-0b93-49c9-9f26-9a6cde7c7208 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:34.663616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36ba7a54-0b93-49c9-9f26-9a6cde7c7208 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:34.663920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36ba7a54-0b93-49c9-9f26-9a6cde7c7208 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:34.673213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36ba7a54-0b93-49c9-9f26-9a6cde7c7208 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:34.673696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36ba7a54-0b93-49c9-9f26-9a6cde7c7208 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:34.684141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-374bc9fc-7e1e-4f12-8047-a4a10d866af0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:34.698137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-374bc9fc-7e1e-4f12-8047-a4a10d866af0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:34.706877 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-374bc9fc-7e1e-4f12-8047-a4a10d866af0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 1.090202 Jul 14 14:41:34.724647 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1560/3124] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:33 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:34.990670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-36ba7a54-0b93-49c9-9f26-9a6cde7c7208 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:35.003638 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-36ba7a54-0b93-49c9-9f26-9a6cde7c7208 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1269 microversion: 2.1 time: 0.377273 Jul 14 14:41:35.006993 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1565/3125] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:34 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1269 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:41:35.234998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ec57da2a-21d3-49d1-80ca-df3dffac1295 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:35.235632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ec57da2a-21d3-49d1-80ca-df3dffac1295 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:35.252504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec57da2a-21d3-49d1-80ca-df3dffac1295 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:35.260800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec57da2a-21d3-49d1-80ca-df3dffac1295 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:35.263983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec57da2a-21d3-49d1-80ca-df3dffac1295 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:35.267697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec57da2a-21d3-49d1-80ca-df3dffac1295 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:35.731233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b2ae3642-2f91-4293-be6b-d5cd687930c9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:35.732709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b2ae3642-2f91-4293-be6b-d5cd687930c9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:35.753459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2ae3642-2f91-4293-be6b-d5cd687930c9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:35.756175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2ae3642-2f91-4293-be6b-d5cd687930c9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:35.758021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2ae3642-2f91-4293-be6b-d5cd687930c9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:35.758966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2ae3642-2f91-4293-be6b-d5cd687930c9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:37.304505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ec57da2a-21d3-49d1-80ca-df3dffac1295 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:37.341528 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ec57da2a-21d3-49d1-80ca-df3dffac1295 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 2.108473 Jul 14 14:41:37.345825 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1561/3126] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:35 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:41:37.361268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d67dfc6e-3814-4e63-a6ae-88aac379e4d2 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:37.367811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d67dfc6e-3814-4e63-a6ae-88aac379e4d2 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:37.379884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b2ae3642-2f91-4293-be6b-d5cd687930c9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:37.415621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d67dfc6e-3814-4e63-a6ae-88aac379e4d2 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:37.416591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d67dfc6e-3814-4e63-a6ae-88aac379e4d2 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:37.418003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d67dfc6e-3814-4e63-a6ae-88aac379e4d2 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:37.418613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d67dfc6e-3814-4e63-a6ae-88aac379e4d2 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:37.418949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b2ae3642-2f91-4293-be6b-d5cd687930c9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:37.424979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b2ae3642-2f91-4293-be6b-d5cd687930c9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:37.427570 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b2ae3642-2f91-4293-be6b-d5cd687930c9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 1.700356 Jul 14 14:41:37.428406 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1566/3127] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:35 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:41:37.578181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d67dfc6e-3814-4e63-a6ae-88aac379e4d2 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:37.602033 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d67dfc6e-3814-4e63-a6ae-88aac379e4d2 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1275 microversion: 2.1 time: 0.252543 Jul 14 14:41:37.603485 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1562/3128] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:37 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:38.378776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-da9e32c8-6c9a-4980-826b-546392618fba tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:38.379475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-da9e32c8-6c9a-4980-826b-546392618fba tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:38.393749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da9e32c8-6c9a-4980-826b-546392618fba tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:38.395092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da9e32c8-6c9a-4980-826b-546392618fba tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:38.395705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da9e32c8-6c9a-4980-826b-546392618fba tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:38.396162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da9e32c8-6c9a-4980-826b-546392618fba tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:38.460723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-87302b64-961e-4a78-88ea-6258f279789d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:38.461436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-87302b64-961e-4a78-88ea-6258f279789d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:38.483424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-87302b64-961e-4a78-88ea-6258f279789d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:38.483993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-87302b64-961e-4a78-88ea-6258f279789d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:38.484845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-87302b64-961e-4a78-88ea-6258f279789d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:38.491663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-87302b64-961e-4a78-88ea-6258f279789d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:39.172243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-da9e32c8-6c9a-4980-826b-546392618fba tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:39.182728 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-da9e32c8-6c9a-4980-826b-546392618fba tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 0.808276 Jul 14 14:41:39.190171 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1567/3129] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:38 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:39.198015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-64884bf2-e4a0-4a85-b1d9-c9fb796ddbae tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:39.200625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-64884bf2-e4a0-4a85-b1d9-c9fb796ddbae tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:39.217833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64884bf2-e4a0-4a85-b1d9-c9fb796ddbae tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:39.220347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64884bf2-e4a0-4a85-b1d9-c9fb796ddbae tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:39.221525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64884bf2-e4a0-4a85-b1d9-c9fb796ddbae tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:39.225485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64884bf2-e4a0-4a85-b1d9-c9fb796ddbae tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:39.234817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:39.399930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-87302b64-961e-4a78-88ea-6258f279789d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:39.416995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-87302b64-961e-4a78-88ea-6258f279789d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:39.423809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-87302b64-961e-4a78-88ea-6258f279789d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:39.425482 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-87302b64-961e-4a78-88ea-6258f279789d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 0.968808 Jul 14 14:41:39.435040 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1563/3130] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:38 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:39.465138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-64884bf2-e4a0-4a85-b1d9-c9fb796ddbae tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:39.478850 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-64884bf2-e4a0-4a85-b1d9-c9fb796ddbae tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1275 microversion: 2.1 time: 0.287216 Jul 14 14:41:39.484924 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1568/3131] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:39 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1275 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:40.205406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a8ce7350-a3da-42e1-b07c-0179e2cad253 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:40.206047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a8ce7350-a3da-42e1-b07c-0179e2cad253 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:40.225309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8ce7350-a3da-42e1-b07c-0179e2cad253 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:40.225861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8ce7350-a3da-42e1-b07c-0179e2cad253 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:40.227097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8ce7350-a3da-42e1-b07c-0179e2cad253 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:40.229277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8ce7350-a3da-42e1-b07c-0179e2cad253 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:40.241289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:40.454689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f7d13516-2d4f-4a6a-9f9e-7c746f33cdf5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:40.455935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f7d13516-2d4f-4a6a-9f9e-7c746f33cdf5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:40.473889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7d13516-2d4f-4a6a-9f9e-7c746f33cdf5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:40.474910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7d13516-2d4f-4a6a-9f9e-7c746f33cdf5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:40.478247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7d13516-2d4f-4a6a-9f9e-7c746f33cdf5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:40.478960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7d13516-2d4f-4a6a-9f9e-7c746f33cdf5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:40.839290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a8ce7350-a3da-42e1-b07c-0179e2cad253 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:40.861835 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a8ce7350-a3da-42e1-b07c-0179e2cad253 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 0.661795 Jul 14 14:41:40.873044 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1564/3132] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:40 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:40.886989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6207a06d-bc23-4915-9313-97756c5a2901 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:40.889400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6207a06d-bc23-4915-9313-97756c5a2901 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:40.899908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6207a06d-bc23-4915-9313-97756c5a2901 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:40.900675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6207a06d-bc23-4915-9313-97756c5a2901 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:40.901879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6207a06d-bc23-4915-9313-97756c5a2901 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:40.902605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6207a06d-bc23-4915-9313-97756c5a2901 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:41.561006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f7d13516-2d4f-4a6a-9f9e-7c746f33cdf5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:41.606825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f7d13516-2d4f-4a6a-9f9e-7c746f33cdf5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:41.610087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f7d13516-2d4f-4a6a-9f9e-7c746f33cdf5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:41.612761 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f7d13516-2d4f-4a6a-9f9e-7c746f33cdf5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 1.164851 Jul 14 14:41:41.618530 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1569/3133] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:40 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:41:41.651564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6207a06d-bc23-4915-9313-97756c5a2901 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:41.719208 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6207a06d-bc23-4915-9313-97756c5a2901 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1317 microversion: 2.1 time: 0.844103 Jul 14 14:41:41.720242 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1565/3134] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:40 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1317 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:41.720535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f27360f3-5168-4de2-be28-ad05289550c2 req-2afe198c-c733-49b4-81e8-860686c2980d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "name": "network-vif-plugged", "status": "completed", "tag": "6d8c96b9-5962-4646-ba07-34e1518619fa"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:41.740336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f27360f3-5168-4de2-be28-ad05289550c2 req-2afe198c-c733-49b4-81e8-860686c2980d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:41.743691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f27360f3-5168-4de2-be28-ad05289550c2 req-2afe198c-c733-49b4-81e8-860686c2980d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:41.784475 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f27360f3-5168-4de2-be28-ad05289550c2 req-2afe198c-c733-49b4-81e8-860686c2980d service nova] Creating event network-vif-plugged:6d8c96b9-5962-4646-ba07-34e1518619fa for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:41:41.805775 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f27360f3-5168-4de2-be28-ad05289550c2 req-2afe198c-c733-49b4-81e8-860686c2980d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088532 Jul 14 14:41:41.811606 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1570/3135] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:41:41.884411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a50f2039-c343-4eda-88e9-067496f1324b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:41.885182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a50f2039-c343-4eda-88e9-067496f1324b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:41.896678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a50f2039-c343-4eda-88e9-067496f1324b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:41.905555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a50f2039-c343-4eda-88e9-067496f1324b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:41.905555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a50f2039-c343-4eda-88e9-067496f1324b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:41.905555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a50f2039-c343-4eda-88e9-067496f1324b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:42.431750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a50f2039-c343-4eda-88e9-067496f1324b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:42.446995 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a50f2039-c343-4eda-88e9-067496f1324b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 0.565321 Jul 14 14:41:42.451068 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1566/3136] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:41 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:42.661004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4117e58-cd77-4176-8437-14cfbfa80496 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:42.671011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b4117e58-cd77-4176-8437-14cfbfa80496 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:42.710990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4117e58-cd77-4176-8437-14cfbfa80496 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:42.712807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4117e58-cd77-4176-8437-14cfbfa80496 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:42.714535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4117e58-cd77-4176-8437-14cfbfa80496 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:42.716512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4117e58-cd77-4176-8437-14cfbfa80496 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:42.747467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9d9d0be7-bec5-4ab9-9b38-066ba1a74625 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:42.749801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9d9d0be7-bec5-4ab9-9b38-066ba1a74625 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:42.767028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d9d0be7-bec5-4ab9-9b38-066ba1a74625 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:42.767843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d9d0be7-bec5-4ab9-9b38-066ba1a74625 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:42.768927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d9d0be7-bec5-4ab9-9b38-066ba1a74625 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:42.773949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d9d0be7-bec5-4ab9-9b38-066ba1a74625 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:43.087692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:43.603267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:43.844364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b4117e58-cd77-4176-8437-14cfbfa80496 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:43.870945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b4117e58-cd77-4176-8437-14cfbfa80496 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:43.885740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b4117e58-cd77-4176-8437-14cfbfa80496 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:43.887721 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b4117e58-cd77-4176-8437-14cfbfa80496 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 1.246040 Jul 14 14:41:43.891886 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1571/3137] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:42 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:43.951259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9d9d0be7-bec5-4ab9-9b38-066ba1a74625 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:43.962126 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9d9d0be7-bec5-4ab9-9b38-066ba1a74625 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1317 microversion: 2.1 time: 1.220922 Jul 14 14:41:43.963364 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1567/3138] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:42 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1317 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:43.985465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-75a9319f-cbb5-4350-8750-72348c4f4ca7 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:43.986759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-75a9319f-cbb5-4350-8750-72348c4f4ca7 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:43.998158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75a9319f-cbb5-4350-8750-72348c4f4ca7 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:43.998895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75a9319f-cbb5-4350-8750-72348c4f4ca7 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:44.002381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75a9319f-cbb5-4350-8750-72348c4f4ca7 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:44.003961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75a9319f-cbb5-4350-8750-72348c4f4ca7 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:44.390288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3e18a355-6dfd-49f8-877b-59b9260fc7d7 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1826850498", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:44.393254 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-3e18a355-6dfd-49f8-877b-59b9260fc7d7 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] HTTP exception thrown: min_count must be <= max_count Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3e18a355-6dfd-49f8-877b-59b9260fc7d7 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Request method failure captured: Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 184 Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Csmu_2EF7F5Pi9sPAtIxpi6yHI3V2rRZnEtPL6g4wR3ajTz_uP2t_1vHbtC3Pi20AboLbfxV4IznC3w_4rSrL-avVLFp3qi_GdB0i4J3ND-PbezKpmL56wUBA0MnFGKhLKhNFn-uZimQ57Q10Fz_Kxo3nuPyJbbO_rUyYjy_eUlcVM Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 9635a024f57249958ac743cfe2d589a8 Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9635a024f57249958ac743cfe2d589a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9635a024f57249958ac743cfe2d589a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9635a024f57249958ac743cfe2d589a8", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9635a024f57249958ac743cfe2d589a8"}]}] Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 9635a024f57249958ac743cfe2d589a8 Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-MultipleCreateNegativeTestJSON-470936616-project Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9c7a0523eac840ca97a60d2a2b6f3f8e Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-470936616-project Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1826850498", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: exception: min_count must be <= max_count Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1826850498', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 728, in create Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 14 14:41:44.396614 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.404116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3e18a355-6dfd-49f8-877b-59b9260fc7d7 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Returning 400 to user: min_count must be <= max_count {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:44.406766 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3e18a355-6dfd-49f8-877b-59b9260fc7d7 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.512369 Jul 14 14:41:44.410583 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1572/3139] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:41:43 2022] POST /compute/v2.1/servers => generated 74 bytes in 517 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:41:44.478286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1fc06180-3b27-463e-ad1d-a1e2645f7e8b req-fba55f2b-176c-4c68-b874-58f0f40afd01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "name": "network-vif-plugged", "status": "completed", "tag": "ea32addf-3ddd-4645-a6d7-a3e1e322e40c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:44.495614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:44.501966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1fc06180-3b27-463e-ad1d-a1e2645f7e8b req-fba55f2b-176c-4c68-b874-58f0f40afd01 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:44.502847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1fc06180-3b27-463e-ad1d-a1e2645f7e8b req-fba55f2b-176c-4c68-b874-58f0f40afd01 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:44.565848 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1fc06180-3b27-463e-ad1d-a1e2645f7e8b req-fba55f2b-176c-4c68-b874-58f0f40afd01 service nova] Creating event network-vif-plugged:ea32addf-3ddd-4645-a6d7-a3e1e322e40c for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:41:44.579383 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1fc06180-3b27-463e-ad1d-a1e2645f7e8b req-fba55f2b-176c-4c68-b874-58f0f40afd01 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106944 Jul 14 14:41:44.585743 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1573/3140] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:41:44.600483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-61bad2cb-ac93-4469-b6b0-3f134301f8ff tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-384687307", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "max_count": 0}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-61bad2cb-ac93-4469-b6b0-3f134301f8ff tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Request method failure captured: Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 167 Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Csmu_2EF7F5Pi9sPAtIxpi6yHI3V2rRZnEtPL6g4wR3ajTz_uP2t_1vHbtC3Pi20AboLbfxV4IznC3w_4rSrL-avVLFp3qi_GdB0i4J3ND-PbezKpmL56wUBA0MnFGKhLKhNFn-uZimQ57Q10Fz_Kxo3nuPyJbbO_rUyYjy_eUlcVM Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 9635a024f57249958ac743cfe2d589a8 Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9635a024f57249958ac743cfe2d589a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9635a024f57249958ac743cfe2d589a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9635a024f57249958ac743cfe2d589a8", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9635a024f57249958ac743cfe2d589a8"}]}] Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 9635a024f57249958ac743cfe2d589a8 Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-MultipleCreateNegativeTestJSON-470936616-project Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9c7a0523eac840ca97a60d2a2b6f3f8e Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-470936616-project Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-384687307", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "max_count": 0}} Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-384687307', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'max_count': 0}}} Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 0 Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:41:44.609950 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 14 14:41:44.615204 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.620568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-61bad2cb-ac93-4469-b6b0-3f134301f8ff tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:44.626054 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-61bad2cb-ac93-4469-b6b0-3f134301f8ff tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.037342 Jul 14 14:41:44.632248 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1574/3141] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:41:44 2022] POST /compute/v2.1/servers => generated 130 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:41:44.770558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-75a9319f-cbb5-4350-8750-72348c4f4ca7 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:44.786152 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-75a9319f-cbb5-4350-8750-72348c4f4ca7 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 0.820265 Jul 14 14:41:44.786790 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1568/3142] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:43 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:44.871578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15032c63-8c0e-4a50-8c7e-55ce98ccec5e tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-720636474", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "max_count": 2.5}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15032c63-8c0e-4a50-8c7e-55ce98ccec5e tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Request method failure captured: Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 169 Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Csmu_2EF7F5Pi9sPAtIxpi6yHI3V2rRZnEtPL6g4wR3ajTz_uP2t_1vHbtC3Pi20AboLbfxV4IznC3w_4rSrL-avVLFp3qi_GdB0i4J3ND-PbezKpmL56wUBA0MnFGKhLKhNFn-uZimQ57Q10Fz_Kxo3nuPyJbbO_rUyYjy_eUlcVM Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 9635a024f57249958ac743cfe2d589a8 Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9635a024f57249958ac743cfe2d589a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9635a024f57249958ac743cfe2d589a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9635a024f57249958ac743cfe2d589a8", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9635a024f57249958ac743cfe2d589a8"}]}] Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 9635a024f57249958ac743cfe2d589a8 Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-MultipleCreateNegativeTestJSON-470936616-project Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9c7a0523eac840ca97a60d2a2b6f3f8e Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-470936616-project Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-720636474", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "max_count": 2.5}} Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-720636474', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'max_count': 2.5}}} Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 2.5 Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:41:44.875511 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15032c63-8c0e-4a50-8c7e-55ce98ccec5e tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-15032c63-8c0e-4a50-8c7e-55ce98ccec5e tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010745 Jul 14 14:41:44.881835 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1575/3143] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:41:44 2022] POST /compute/v2.1/servers => generated 139 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:41:44.928061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e7984d68-9b9e-4819-abe6-a6f7c9f20c1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:44.928727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e7984d68-9b9e-4819-abe6-a6f7c9f20c1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:44.967727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7984d68-9b9e-4819-abe6-a6f7c9f20c1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:44.975112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7984d68-9b9e-4819-abe6-a6f7c9f20c1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:44.976933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-aefe07f4-a3c8-4a3f-b180-8ea965e66931 req-bd5afcc6-5c5e-4ca7-960e-69d957af35fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e824346f-eb0a-40e3-98b8-1e6ff9289b32", "tag": "cc2d5c2f-2377-4d8f-800b-fb47b7b92198"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:44.979728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7984d68-9b9e-4819-abe6-a6f7c9f20c1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:44.991261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7984d68-9b9e-4819-abe6-a6f7c9f20c1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:45.016606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-aefe07f4-a3c8-4a3f-b180-8ea965e66931 req-bd5afcc6-5c5e-4ca7-960e-69d957af35fc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:45.017295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-aefe07f4-a3c8-4a3f-b180-8ea965e66931 req-bd5afcc6-5c5e-4ca7-960e-69d957af35fc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:45.057559 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-aefe07f4-a3c8-4a3f-b180-8ea965e66931 req-bd5afcc6-5c5e-4ca7-960e-69d957af35fc service nova] Creating event network-changed:cc2d5c2f-2377-4d8f-800b-fb47b7b92198 for instance e824346f-eb0a-40e3-98b8-1e6ff9289b32 on n-h1-767704-28 Jul 14 14:41:45.075093 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-aefe07f4-a3c8-4a3f-b180-8ea965e66931 req-bd5afcc6-5c5e-4ca7-960e-69d957af35fc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102174 Jul 14 14:41:45.083935 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1576/3144] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:45.113814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-76e6dfb8-5812-4737-a0e9-37a5a4b43988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:45.115160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-76e6dfb8-5812-4737-a0e9-37a5a4b43988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:45.138967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76e6dfb8-5812-4737-a0e9-37a5a4b43988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:45.145072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76e6dfb8-5812-4737-a0e9-37a5a4b43988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:45.146055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76e6dfb8-5812-4737-a0e9-37a5a4b43988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:45.146558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76e6dfb8-5812-4737-a0e9-37a5a4b43988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:46.542476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-76e6dfb8-5812-4737-a0e9-37a5a4b43988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:46.585738 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-76e6dfb8-5812-4737-a0e9-37a5a4b43988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1317 microversion: 2.1 time: 1.493760 Jul 14 14:41:46.589802 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1577/3145] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:45 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1317 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:46.609061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3e899235-cb78-4ee2-abd9-20fe05f91c86 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1042099810", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "min_count": 0}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3e899235-cb78-4ee2-abd9-20fe05f91c86 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Request method failure captured: Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 168 Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Csmu_2EF7F5Pi9sPAtIxpi6yHI3V2rRZnEtPL6g4wR3ajTz_uP2t_1vHbtC3Pi20AboLbfxV4IznC3w_4rSrL-avVLFp3qi_GdB0i4J3ND-PbezKpmL56wUBA0MnFGKhLKhNFn-uZimQ57Q10Fz_Kxo3nuPyJbbO_rUyYjy_eUlcVM Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 9635a024f57249958ac743cfe2d589a8 Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9635a024f57249958ac743cfe2d589a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9635a024f57249958ac743cfe2d589a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9635a024f57249958ac743cfe2d589a8", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9635a024f57249958ac743cfe2d589a8"}]}] Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 9635a024f57249958ac743cfe2d589a8 Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-MultipleCreateNegativeTestJSON-470936616-project Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9c7a0523eac840ca97a60d2a2b6f3f8e Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-470936616-project Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1042099810", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "min_count": 0}} Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1042099810', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'min_count': 0}}} Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 0 Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:41:46.626174 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3e899235-cb78-4ee2-abd9-20fe05f91c86 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3e899235-cb78-4ee2-abd9-20fe05f91c86 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.040603 Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1578/3146] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:41:46 2022] POST /compute/v2.1/servers => generated 130 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7a6711d9-df1e-4105-9969-5e390ecacaa4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:46.668242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7a6711d9-df1e-4105-9969-5e390ecacaa4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:46.699039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a6711d9-df1e-4105-9969-5e390ecacaa4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:46.699675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a6711d9-df1e-4105-9969-5e390ecacaa4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:46.701114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a6711d9-df1e-4105-9969-5e390ecacaa4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:46.701888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a6711d9-df1e-4105-9969-5e390ecacaa4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:46.977141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e7984d68-9b9e-4819-abe6-a6f7c9f20c1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:46.998491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e7984d68-9b9e-4819-abe6-a6f7c9f20c1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:47.000618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e7984d68-9b9e-4819-abe6-a6f7c9f20c1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:47.010690 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e7984d68-9b9e-4819-abe6-a6f7c9f20c1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 2.083517 Jul 14 14:41:47.012226 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1569/3147] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:44 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:47.022131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d70e1e91-5d4e-4032-863e-1e2ad04917e9 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1510022322", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "min_count": 2.5}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d70e1e91-5d4e-4032-863e-1e2ad04917e9 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Request method failure captured: Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 170 Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Csmu_2EF7F5Pi9sPAtIxpi6yHI3V2rRZnEtPL6g4wR3ajTz_uP2t_1vHbtC3Pi20AboLbfxV4IznC3w_4rSrL-avVLFp3qi_GdB0i4J3ND-PbezKpmL56wUBA0MnFGKhLKhNFn-uZimQ57Q10Fz_Kxo3nuPyJbbO_rUyYjy_eUlcVM Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 9635a024f57249958ac743cfe2d589a8 Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9635a024f57249958ac743cfe2d589a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9635a024f57249958ac743cfe2d589a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9635a024f57249958ac743cfe2d589a8", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9635a024f57249958ac743cfe2d589a8"}]}] Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 9635a024f57249958ac743cfe2d589a8 Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-470936616 Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-MultipleCreateNegativeTestJSON-470936616-project Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9c7a0523eac840ca97a60d2a2b6f3f8e Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-470936616-project Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1510022322", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "min_count": 2.5}} Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1510022322', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'min_count': 2.5}}} Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 2.5 Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:41:47.031507 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 14 14:41:47.042297 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:41:47.048982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d70e1e91-5d4e-4032-863e-1e2ad04917e9 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:47.053425 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d70e1e91-5d4e-4032-863e-1e2ad04917e9 tempest-MultipleCreateNegativeTestJSON-470936616 tempest-MultipleCreateNegativeTestJSON-470936616-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035452 Jul 14 14:41:47.054297 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1570/3148] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:41:47 2022] POST /compute/v2.1/servers => generated 139 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:41:47.075187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-72311662-6bbe-42b6-af6b-b2f27a85663e req-1ab1c898-e086-495e-8d5c-5b21c049ff32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541b73d3-64ab-41c0-89c8-2930dc27af78", "name": "network-vif-plugged", "status": "completed", "tag": "4d97ea2e-c67b-4934-8bcd-ea2649569911"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:47.115750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-72311662-6bbe-42b6-af6b-b2f27a85663e req-1ab1c898-e086-495e-8d5c-5b21c049ff32 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:47.122830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-72311662-6bbe-42b6-af6b-b2f27a85663e req-1ab1c898-e086-495e-8d5c-5b21c049ff32 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:47.165968 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-72311662-6bbe-42b6-af6b-b2f27a85663e req-1ab1c898-e086-495e-8d5c-5b21c049ff32 service nova] Creating event network-vif-plugged:4d97ea2e-c67b-4934-8bcd-ea2649569911 for instance 541b73d3-64ab-41c0-89c8-2930dc27af78 on n-h2-767704-28 Jul 14 14:41:47.179134 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-72311662-6bbe-42b6-af6b-b2f27a85663e req-1ab1c898-e086-495e-8d5c-5b21c049ff32 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115190 Jul 14 14:41:47.184765 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1571/3149] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:47.610972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1bcaaa80-dd0f-4827-a1f3-7bfbda3f2618 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:47.611806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1bcaaa80-dd0f-4827-a1f3-7bfbda3f2618 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:47.634184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa80-dd0f-4827-a1f3-7bfbda3f2618 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:47.641466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa80-dd0f-4827-a1f3-7bfbda3f2618 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:47.647546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa80-dd0f-4827-a1f3-7bfbda3f2618 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:47.649313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa80-dd0f-4827-a1f3-7bfbda3f2618 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:48.858108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7a6711d9-df1e-4105-9969-5e390ecacaa4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:48.871821 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7a6711d9-df1e-4105-9969-5e390ecacaa4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 2.237428 Jul 14 14:41:48.873785 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1579/3150] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:46 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 2239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:48.883175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-96c4103a-36cd-4042-8779-afb03703a117 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:48.883808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-96c4103a-36cd-4042-8779-afb03703a117 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:48.901774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96c4103a-36cd-4042-8779-afb03703a117 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:48.906919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96c4103a-36cd-4042-8779-afb03703a117 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:48.908808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96c4103a-36cd-4042-8779-afb03703a117 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:48.909491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96c4103a-36cd-4042-8779-afb03703a117 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:49.431378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1bcaaa80-dd0f-4827-a1f3-7bfbda3f2618 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:49.464596 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1bcaaa80-dd0f-4827-a1f3-7bfbda3f2618 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1317 microversion: 2.1 time: 1.857794 Jul 14 14:41:49.469020 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1572/3151] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:47 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1317 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:49.540369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3457bc27-df36-4a8f-9032-20f43d96ee98 req-b1ef977a-db67-40d4-8c8c-cde1ead6ea80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "name": "network-vif-plugged", "status": "completed", "tag": "f0e13cb7-0e32-476b-8c7b-9b4030d305fc"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:49.555075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3457bc27-df36-4a8f-9032-20f43d96ee98 req-b1ef977a-db67-40d4-8c8c-cde1ead6ea80 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:49.555524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3457bc27-df36-4a8f-9032-20f43d96ee98 req-b1ef977a-db67-40d4-8c8c-cde1ead6ea80 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:49.600829 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3457bc27-df36-4a8f-9032-20f43d96ee98 req-b1ef977a-db67-40d4-8c8c-cde1ead6ea80 service nova] Creating event network-vif-plugged:f0e13cb7-0e32-476b-8c7b-9b4030d305fc for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:41:49.631993 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3457bc27-df36-4a8f-9032-20f43d96ee98 req-b1ef977a-db67-40d4-8c8c-cde1ead6ea80 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090240 Jul 14 14:41:49.636728 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1573/3152] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:49.915289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-990c9daf-54b8-453f-ae4d-ef0a48501ed4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:49.919964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-990c9daf-54b8-453f-ae4d-ef0a48501ed4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:49.971275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-990c9daf-54b8-453f-ae4d-ef0a48501ed4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:49.972016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-990c9daf-54b8-453f-ae4d-ef0a48501ed4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:49.974241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-990c9daf-54b8-453f-ae4d-ef0a48501ed4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:49.974919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-990c9daf-54b8-453f-ae4d-ef0a48501ed4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:50.369492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-96c4103a-36cd-4042-8779-afb03703a117 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:50.391367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-96c4103a-36cd-4042-8779-afb03703a117 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:50.398840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-96c4103a-36cd-4042-8779-afb03703a117 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:50.401443 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-96c4103a-36cd-4042-8779-afb03703a117 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 1.526536 Jul 14 14:41:50.405156 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1580/3153] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:48 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:50.490134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba75581a-e5d4-4393-b3e5-cfb5c59b1545 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:50.491214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ba75581a-e5d4-4393-b3e5-cfb5c59b1545 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:50.509517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba75581a-e5d4-4393-b3e5-cfb5c59b1545 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:50.510428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba75581a-e5d4-4393-b3e5-cfb5c59b1545 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:50.512205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba75581a-e5d4-4393-b3e5-cfb5c59b1545 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:50.513004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba75581a-e5d4-4393-b3e5-cfb5c59b1545 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:51.943478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-990c9daf-54b8-453f-ae4d-ef0a48501ed4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:51.984118 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-990c9daf-54b8-453f-ae4d-ef0a48501ed4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1371 microversion: 2.1 time: 2.090100 Jul 14 14:41:51.992193 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1574/3154] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:49 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1371 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:52.020724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab87f0ac-a782-4134-ae4d-d12e80ffacaa tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:52.022437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ab87f0ac-a782-4134-ae4d-d12e80ffacaa tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:52.043709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab87f0ac-a782-4134-ae4d-d12e80ffacaa tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:52.044815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab87f0ac-a782-4134-ae4d-d12e80ffacaa tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:52.046760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab87f0ac-a782-4134-ae4d-d12e80ffacaa tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:52.048494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab87f0ac-a782-4134-ae4d-d12e80ffacaa tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:52.158227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ba75581a-e5d4-4393-b3e5-cfb5c59b1545 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:52.188746 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ba75581a-e5d4-4393-b3e5-cfb5c59b1545 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1317 microversion: 2.1 time: 1.703335 Jul 14 14:41:52.194748 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1581/3155] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:50 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1317 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:52.214197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-cae98e5b-105e-4c1a-8cab-409a99ae9962 req-d7862deb-99da-4c18-913f-291c5b19a3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b55c122-95db-42f1-95a9-ae5bbb4ff958", "name": "network-vif-plugged", "status": "completed", "tag": "b14caf9c-97a3-483c-92a9-d43af26af98c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:52.276479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cae98e5b-105e-4c1a-8cab-409a99ae9962 req-d7862deb-99da-4c18-913f-291c5b19a3ee service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:52.278814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cae98e5b-105e-4c1a-8cab-409a99ae9962 req-d7862deb-99da-4c18-913f-291c5b19a3ee service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:52.362020 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-cae98e5b-105e-4c1a-8cab-409a99ae9962 req-d7862deb-99da-4c18-913f-291c5b19a3ee service nova] Creating event network-vif-plugged:b14caf9c-97a3-483c-92a9-d43af26af98c for instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 on n-h2-767704-28 Jul 14 14:41:52.405671 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-cae98e5b-105e-4c1a-8cab-409a99ae9962 req-d7862deb-99da-4c18-913f-291c5b19a3ee service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199251 Jul 14 14:41:52.408669 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1582/3156] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:53.012055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af21ae1d-2ab6-4c88-a10e-0bb8cbeebaa1 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:53.013063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-af21ae1d-2ab6-4c88-a10e-0bb8cbeebaa1 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:53.032810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af21ae1d-2ab6-4c88-a10e-0bb8cbeebaa1 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:53.033801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af21ae1d-2ab6-4c88-a10e-0bb8cbeebaa1 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:53.036782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af21ae1d-2ab6-4c88-a10e-0bb8cbeebaa1 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:53.039121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af21ae1d-2ab6-4c88-a10e-0bb8cbeebaa1 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:53.206437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab87f0ac-a782-4134-ae4d-d12e80ffacaa tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:53.224554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab87f0ac-a782-4134-ae4d-d12e80ffacaa tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:53.231655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab87f0ac-a782-4134-ae4d-d12e80ffacaa tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:53.233428 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ab87f0ac-a782-4134-ae4d-d12e80ffacaa tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 1.238054 Jul 14 14:41:53.235711 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1575/3157] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:51 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:53.245611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05ec3b59-bfba-43e6-a280-4f106f2b401f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:53.254297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-05ec3b59-bfba-43e6-a280-4f106f2b401f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:53.272340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05ec3b59-bfba-43e6-a280-4f106f2b401f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:53.273078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05ec3b59-bfba-43e6-a280-4f106f2b401f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:53.274588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05ec3b59-bfba-43e6-a280-4f106f2b401f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:53.277438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05ec3b59-bfba-43e6-a280-4f106f2b401f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:53.826114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-af21ae1d-2ab6-4c88-a10e-0bb8cbeebaa1 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:53.838787 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-af21ae1d-2ab6-4c88-a10e-0bb8cbeebaa1 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1558 microversion: 2.1 time: 0.830721 Jul 14 14:41:53.850377 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1583/3158] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:53 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1558 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:53.866520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6e0029b8-5c06-4a11-8aef-c8b5c2a88e1b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:53.867028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6e0029b8-5c06-4a11-8aef-c8b5c2a88e1b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:53.896781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e0029b8-5c06-4a11-8aef-c8b5c2a88e1b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:53.902506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e0029b8-5c06-4a11-8aef-c8b5c2a88e1b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:53.903988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e0029b8-5c06-4a11-8aef-c8b5c2a88e1b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:53.904642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e0029b8-5c06-4a11-8aef-c8b5c2a88e1b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:54.077309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-05ec3b59-bfba-43e6-a280-4f106f2b401f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:54.104009 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-05ec3b59-bfba-43e6-a280-4f106f2b401f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1317 microversion: 2.1 time: 0.866771 Jul 14 14:41:54.104889 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1576/3159] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:53 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1317 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:54.121631 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6e0029b8-5c06-4a11-8aef-c8b5c2a88e1b tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.265498 Jul 14 14:41:54.166485 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1584/3160] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:41:53 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78/os-interface => generated 285 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:54.255863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-789bb625-e64a-4949-ba2a-2a205e66e6d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:54.256500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-789bb625-e64a-4949-ba2a-2a205e66e6d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:54.275430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-789bb625-e64a-4949-ba2a-2a205e66e6d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:54.275895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-789bb625-e64a-4949-ba2a-2a205e66e6d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:54.276705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-789bb625-e64a-4949-ba2a-2a205e66e6d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:54.277212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-789bb625-e64a-4949-ba2a-2a205e66e6d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:54.572287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-44924577-b5b1-4166-ab17-a29fccf6a2df req-1a321658-079f-4ee4-9cf4-66c2417d26ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "name": "network-vif-plugged", "status": "completed", "tag": "555c0602-6141-4525-b74a-9dd96ba32274"}, {"server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "name": "network-vif-plugged", "status": "completed", "tag": "46b5d0bb-9885-4003-8ee6-a5ad6d903ef9"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:54.600902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-44924577-b5b1-4166-ab17-a29fccf6a2df req-1a321658-079f-4ee4-9cf4-66c2417d26ef service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:54.609986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-44924577-b5b1-4166-ab17-a29fccf6a2df req-1a321658-079f-4ee4-9cf4-66c2417d26ef service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:54.664086 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-44924577-b5b1-4166-ab17-a29fccf6a2df req-1a321658-079f-4ee4-9cf4-66c2417d26ef service nova] Creating event network-vif-plugged:555c0602-6141-4525-b74a-9dd96ba32274 for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:41:54.665929 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-44924577-b5b1-4166-ab17-a29fccf6a2df req-1a321658-079f-4ee4-9cf4-66c2417d26ef service nova] Creating event network-vif-plugged:46b5d0bb-9885-4003-8ee6-a5ad6d903ef9 for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:41:54.688402 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-44924577-b5b1-4166-ab17-a29fccf6a2df req-1a321658-079f-4ee4-9cf4-66c2417d26ef service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.120260 Jul 14 14:41:54.698784 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1585/3161] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:55.044068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-789bb625-e64a-4949-ba2a-2a205e66e6d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:55.063137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-789bb625-e64a-4949-ba2a-2a205e66e6d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:55.071437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-789bb625-e64a-4949-ba2a-2a205e66e6d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:55.073647 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-789bb625-e64a-4949-ba2a-2a205e66e6d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 0.823614 Jul 14 14:41:55.076270 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1577/3162] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:54 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:55.124500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7a6b6574-ee0d-4800-9e7e-040151318694 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:55.128181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7a6b6574-ee0d-4800-9e7e-040151318694 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:55.150875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a6b6574-ee0d-4800-9e7e-040151318694 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:55.151353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a6b6574-ee0d-4800-9e7e-040151318694 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:55.153993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a6b6574-ee0d-4800-9e7e-040151318694 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:55.154673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a6b6574-ee0d-4800-9e7e-040151318694 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:56.096319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7a6b6574-ee0d-4800-9e7e-040151318694 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:56.106465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-684be7f3-147a-41ed-9d04-56d51d45e1e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:56.111763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-684be7f3-147a-41ed-9d04-56d51d45e1e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:56.148294 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7a6b6574-ee0d-4800-9e7e-040151318694 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1317 microversion: 2.1 time: 1.018282 Jul 14 14:41:56.168957 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1586/3163] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:55 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1317 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:56.169508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-684be7f3-147a-41ed-9d04-56d51d45e1e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:56.170191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-684be7f3-147a-41ed-9d04-56d51d45e1e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:56.173771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-684be7f3-147a-41ed-9d04-56d51d45e1e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:56.174621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-684be7f3-147a-41ed-9d04-56d51d45e1e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:56.723018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-8cb3594d-fe1f-4a12-a84d-618a025194f3 req-7a25882a-344f-4446-a636-80f45bcb1184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541b73d3-64ab-41c0-89c8-2930dc27af78", "tag": "4d97ea2e-c67b-4934-8bcd-ea2649569911"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:56.740173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8cb3594d-fe1f-4a12-a84d-618a025194f3 req-7a25882a-344f-4446-a636-80f45bcb1184 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:56.740777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8cb3594d-fe1f-4a12-a84d-618a025194f3 req-7a25882a-344f-4446-a636-80f45bcb1184 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:56.772686 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8cb3594d-fe1f-4a12-a84d-618a025194f3 req-7a25882a-344f-4446-a636-80f45bcb1184 service nova] Creating event network-changed:4d97ea2e-c67b-4934-8bcd-ea2649569911 for instance 541b73d3-64ab-41c0-89c8-2930dc27af78 on n-h2-767704-28 Jul 14 14:41:56.795064 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-8cb3594d-fe1f-4a12-a84d-618a025194f3 req-7a25882a-344f-4446-a636-80f45bcb1184 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068421 Jul 14 14:41:56.800895 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1587/3164] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:56.847307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b409a452-e6c5-47ce-bf63-cd3afdf69beb req-c37cf0f3-8d5a-4ba0-89fd-c7b62a24c5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "name": "network-vif-plugged", "status": "completed", "tag": "bf4979db-bc34-41d1-9d82-f5fc2ab71553"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:56.865815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b409a452-e6c5-47ce-bf63-cd3afdf69beb req-c37cf0f3-8d5a-4ba0-89fd-c7b62a24c5a7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:56.866814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b409a452-e6c5-47ce-bf63-cd3afdf69beb req-c37cf0f3-8d5a-4ba0-89fd-c7b62a24c5a7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:56.894015 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b409a452-e6c5-47ce-bf63-cd3afdf69beb req-c37cf0f3-8d5a-4ba0-89fd-c7b62a24c5a7 service nova] Creating event network-vif-plugged:bf4979db-bc34-41d1-9d82-f5fc2ab71553 for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:41:56.912726 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b409a452-e6c5-47ce-bf63-cd3afdf69beb req-c37cf0f3-8d5a-4ba0-89fd-c7b62a24c5a7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068888 Jul 14 14:41:56.915508 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1588/3165] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:57.105535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-684be7f3-147a-41ed-9d04-56d51d45e1e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:57.127833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-684be7f3-147a-41ed-9d04-56d51d45e1e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:57.141453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-684be7f3-147a-41ed-9d04-56d51d45e1e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:57.143164 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-684be7f3-147a-41ed-9d04-56d51d45e1e5 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 1.051824 Jul 14 14:41:57.153594 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1578/3166] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:56 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:41:57.172399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dd38ba60-7b7a-47e3-8eed-ec552f397dc6 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:57.173182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dd38ba60-7b7a-47e3-8eed-ec552f397dc6 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:57.188127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd38ba60-7b7a-47e3-8eed-ec552f397dc6 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:57.188749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd38ba60-7b7a-47e3-8eed-ec552f397dc6 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:57.189693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd38ba60-7b7a-47e3-8eed-ec552f397dc6 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:57.195075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd38ba60-7b7a-47e3-8eed-ec552f397dc6 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:58.168572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8af87c0a-9af9-45c3-b642-719386f1b325 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:58.170204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8af87c0a-9af9-45c3-b642-719386f1b325 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:58.186688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8af87c0a-9af9-45c3-b642-719386f1b325 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:58.189175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8af87c0a-9af9-45c3-b642-719386f1b325 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:58.191837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8af87c0a-9af9-45c3-b642-719386f1b325 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:58.192743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8af87c0a-9af9-45c3-b642-719386f1b325 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:59.237730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dd38ba60-7b7a-47e3-8eed-ec552f397dc6 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:59.281138 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dd38ba60-7b7a-47e3-8eed-ec552f397dc6 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1317 microversion: 2.1 time: 2.100254 Jul 14 14:41:59.288790 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1589/3167] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:57 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1317 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:59.330392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-89e48f5a-702f-4852-906a-f0ba8b644f9b req-1151e800-15f4-4671-ac3d-f5ad4a4c846e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "name": "network-vif-plugged", "status": "completed", "tag": "7014e99c-e595-47e8-980b-489824ecb7f8"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:59.375949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-89e48f5a-702f-4852-906a-f0ba8b644f9b req-1151e800-15f4-4671-ac3d-f5ad4a4c846e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:59.379106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-89e48f5a-702f-4852-906a-f0ba8b644f9b req-1151e800-15f4-4671-ac3d-f5ad4a4c846e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:59.434406 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-89e48f5a-702f-4852-906a-f0ba8b644f9b req-1151e800-15f4-4671-ac3d-f5ad4a4c846e service nova] Creating event network-vif-plugged:7014e99c-e595-47e8-980b-489824ecb7f8 for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:41:59.449629 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-89e48f5a-702f-4852-906a-f0ba8b644f9b req-1151e800-15f4-4671-ac3d-f5ad4a4c846e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149558 Jul 14 14:41:59.453642 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1590/3168] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:59.637942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8af87c0a-9af9-45c3-b642-719386f1b325 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:59.656432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8af87c0a-9af9-45c3-b642-719386f1b325 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:59.662499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8af87c0a-9af9-45c3-b642-719386f1b325 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:59.665642 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8af87c0a-9af9-45c3-b642-719386f1b325 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 1.502444 Jul 14 14:41:59.681501 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1579/3169] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:58 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:42:00.309271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c1a801eb-fa85-48c8-a730-3d3b5c4e8e25 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:00.310643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c1a801eb-fa85-48c8-a730-3d3b5c4e8e25 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:00.326421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1a801eb-fa85-48c8-a730-3d3b5c4e8e25 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:00.327549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1a801eb-fa85-48c8-a730-3d3b5c4e8e25 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:00.328894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1a801eb-fa85-48c8-a730-3d3b5c4e8e25 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:00.329584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1a801eb-fa85-48c8-a730-3d3b5c4e8e25 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:00.688354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-008242d9-bb26-49a8-83c6-1fe6d36a4f1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:00.690172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-008242d9-bb26-49a8-83c6-1fe6d36a4f1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:00.699601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:00.710516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-008242d9-bb26-49a8-83c6-1fe6d36a4f1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:00.713017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-008242d9-bb26-49a8-83c6-1fe6d36a4f1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:00.714922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-008242d9-bb26-49a8-83c6-1fe6d36a4f1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:00.715959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-008242d9-bb26-49a8-83c6-1fe6d36a4f1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:00.971391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c1a801eb-fa85-48c8-a730-3d3b5c4e8e25 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:00.985563 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c1a801eb-fa85-48c8-a730-3d3b5c4e8e25 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1317 microversion: 2.1 time: 0.683188 Jul 14 14:42:00.995536 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1591/3170] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:00 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:01.496041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-8828b7da-6a20-40cf-a179-0f2a92aba645 req-b14ffc99-b851-49c1-9660-f66217eabefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e824346f-eb0a-40e3-98b8-1e6ff9289b32", "name": "network-vif-plugged", "status": "completed", "tag": "cc2d5c2f-2377-4d8f-800b-fb47b7b92198"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:01.540323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8828b7da-6a20-40cf-a179-0f2a92aba645 req-b14ffc99-b851-49c1-9660-f66217eabefd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:01.540845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8828b7da-6a20-40cf-a179-0f2a92aba645 req-b14ffc99-b851-49c1-9660-f66217eabefd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:01.569602 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8828b7da-6a20-40cf-a179-0f2a92aba645 req-b14ffc99-b851-49c1-9660-f66217eabefd service nova] Creating event network-vif-plugged:cc2d5c2f-2377-4d8f-800b-fb47b7b92198 for instance e824346f-eb0a-40e3-98b8-1e6ff9289b32 on n-h1-767704-28 Jul 14 14:42:01.582873 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-8828b7da-6a20-40cf-a179-0f2a92aba645 req-b14ffc99-b851-49c1-9660-f66217eabefd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090759 Jul 14 14:42:01.585757 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1592/3171] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:02.005293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98b0a843-3bba-4db4-bd7f-3dcd3e49f011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:02.006433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-98b0a843-3bba-4db4-bd7f-3dcd3e49f011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:02.025929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98b0a843-3bba-4db4-bd7f-3dcd3e49f011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.030068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98b0a843-3bba-4db4-bd7f-3dcd3e49f011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.033344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98b0a843-3bba-4db4-bd7f-3dcd3e49f011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.036337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98b0a843-3bba-4db4-bd7f-3dcd3e49f011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.231325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-008242d9-bb26-49a8-83c6-1fe6d36a4f1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:02.266175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-008242d9-bb26-49a8-83c6-1fe6d36a4f1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:02.269974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-008242d9-bb26-49a8-83c6-1fe6d36a4f1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:02.275408 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-008242d9-bb26-49a8-83c6-1fe6d36a4f1b tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1879 microversion: 2.42 time: 1.588844 Jul 14 14:42:02.276839 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1580/3172] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:00 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1879 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:42:03.317127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7e72a156-73d1-482f-844f-c6a0193d95d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:03.319208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7e72a156-73d1-482f-844f-c6a0193d95d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:03.343067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e72a156-73d1-482f-844f-c6a0193d95d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:03.343537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e72a156-73d1-482f-844f-c6a0193d95d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:03.349780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e72a156-73d1-482f-844f-c6a0193d95d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:03.350360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e72a156-73d1-482f-844f-c6a0193d95d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:04.212039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-98b0a843-3bba-4db4-bd7f-3dcd3e49f011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:04.228390 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98b0a843-3bba-4db4-bd7f-3dcd3e49f011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1317 microversion: 2.1 time: 2.229460 Jul 14 14:42:04.229818 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1593/3173] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:01 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1317 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:05.250882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-228d097b-b43b-4ae0-8ffa-c06bbfdb3988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:05.251851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-228d097b-b43b-4ae0-8ffa-c06bbfdb3988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:05.292387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-228d097b-b43b-4ae0-8ffa-c06bbfdb3988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.292991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-228d097b-b43b-4ae0-8ffa-c06bbfdb3988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.294517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-228d097b-b43b-4ae0-8ffa-c06bbfdb3988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.295532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-228d097b-b43b-4ae0-8ffa-c06bbfdb3988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.402216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7e72a156-73d1-482f-844f-c6a0193d95d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:05.447894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7e72a156-73d1-482f-844f-c6a0193d95d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:05.480758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7e72a156-73d1-482f-844f-c6a0193d95d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:05.482331 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7e72a156-73d1-482f-844f-c6a0193d95d6 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 2835 microversion: 2.42 time: 2.190799 Jul 14 14:42:05.483268 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1581/3174] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:03 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 2835 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:05.510697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d699332a-81d1-4a20-a50c-53d5b503b2f0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:05.511421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d699332a-81d1-4a20-a50c-53d5b503b2f0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:05.532513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d699332a-81d1-4a20-a50c-53d5b503b2f0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.533224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d699332a-81d1-4a20-a50c-53d5b503b2f0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.534193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d699332a-81d1-4a20-a50c-53d5b503b2f0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.535471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d699332a-81d1-4a20-a50c-53d5b503b2f0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.855177 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d699332a-81d1-4a20-a50c-53d5b503b2f0 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.353446 Jul 14 14:42:05.859001 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1582/3175] 10.222.0.81 () {60 vars in 1315 bytes} [Thu Jul 14 14:42:05 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971/os-interface => generated 1831 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:07.352404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-228d097b-b43b-4ae0-8ffa-c06bbfdb3988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:07.365411 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-228d097b-b43b-4ae0-8ffa-c06bbfdb3988 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1505 microversion: 2.1 time: 2.122836 Jul 14 14:42:07.367929 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1594/3176] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:05 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1505 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:07.385596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37a1499a-5fed-43bd-96bd-9df376019058 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:07.387017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-37a1499a-5fed-43bd-96bd-9df376019058 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:07.401927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37a1499a-5fed-43bd-96bd-9df376019058 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:07.405243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37a1499a-5fed-43bd-96bd-9df376019058 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:07.407584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37a1499a-5fed-43bd-96bd-9df376019058 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:07.408375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37a1499a-5fed-43bd-96bd-9df376019058 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:07.454197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:07.502150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-37a1499a-5fed-43bd-96bd-9df376019058 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:07.506412 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-37a1499a-5fed-43bd-96bd-9df376019058 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32/os-instance-actions/req-2434acfb-53a0-470b-a86d-d2769197c1bb" status: 200 len: 313 microversion: 2.1 time: 0.125580 Jul 14 14:42:07.508959 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1583/3177] 10.222.0.81 () {58 vars in 1418 bytes} [Thu Jul 14 14:42:07 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32/os-instance-actions/req-2434acfb-53a0-470b-a86d-d2769197c1bb => generated 313 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:07.524903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1c7def5e-4b38-4a82-9c57-cc61247ec55a tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:07.526459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1c7def5e-4b38-4a82-9c57-cc61247ec55a tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:07.543105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c7def5e-4b38-4a82-9c57-cc61247ec55a tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:07.544230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c7def5e-4b38-4a82-9c57-cc61247ec55a tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:07.546330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c7def5e-4b38-4a82-9c57-cc61247ec55a tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:07.549301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c7def5e-4b38-4a82-9c57-cc61247ec55a tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:07.611660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:07.753717 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1c7def5e-4b38-4a82-9c57-cc61247ec55a tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "POST /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32/action" status: 202 len: 0 microversion: 2.1 time: 0.232639 Jul 14 14:42:07.756152 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1595/3178] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:42:07 2022] POST /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:42:07.766739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a852aba-02af-45c2-b63e-2a9e3c07558b tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:07.767867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2a852aba-02af-45c2-b63e-2a9e3c07558b tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:07.780966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a852aba-02af-45c2-b63e-2a9e3c07558b tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:07.782662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a852aba-02af-45c2-b63e-2a9e3c07558b tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:07.786333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a852aba-02af-45c2-b63e-2a9e3c07558b tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:07.787130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a852aba-02af-45c2-b63e-2a9e3c07558b tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:08.598356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2a852aba-02af-45c2-b63e-2a9e3c07558b tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:08.613450 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a852aba-02af-45c2-b63e-2a9e3c07558b tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1507 microversion: 2.1 time: 0.846452 Jul 14 14:42:08.618035 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1584/3179] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:07 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1507 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:09.634785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6c481156-cf41-4541-8a66-e94ccdc53017 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:09.636127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6c481156-cf41-4541-8a66-e94ccdc53017 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:09.663488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6c481156-cf41-4541-8a66-e94ccdc53017 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:09.665208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6c481156-cf41-4541-8a66-e94ccdc53017 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:09.666317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6c481156-cf41-4541-8a66-e94ccdc53017 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:09.667014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6c481156-cf41-4541-8a66-e94ccdc53017 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:12.404628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6c481156-cf41-4541-8a66-e94ccdc53017 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:12.418823 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6c481156-cf41-4541-8a66-e94ccdc53017 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1507 microversion: 2.1 time: 2.790513 Jul 14 14:42:12.437723 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1596/3180] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:09 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1507 bytes in 2810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:12.439619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c6f0f6dd-9033-4223-8f4f-f765f5ec2e4f req-85d66568-f6b0-4738-9ef2-8dde7c6ff821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "tag": "555c0602-6141-4525-b74a-9dd96ba32274"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:12.461044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c6f0f6dd-9033-4223-8f4f-f765f5ec2e4f req-85d66568-f6b0-4738-9ef2-8dde7c6ff821 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:12.461890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c6f0f6dd-9033-4223-8f4f-f765f5ec2e4f req-85d66568-f6b0-4738-9ef2-8dde7c6ff821 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:12.494256 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c6f0f6dd-9033-4223-8f4f-f765f5ec2e4f req-85d66568-f6b0-4738-9ef2-8dde7c6ff821 service nova] Creating event network-changed:555c0602-6141-4525-b74a-9dd96ba32274 for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:42:12.502916 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c6f0f6dd-9033-4223-8f4f-f765f5ec2e4f req-85d66568-f6b0-4738-9ef2-8dde7c6ff821 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066971 Jul 14 14:42:12.504394 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1585/3181] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:13.462321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44fcf7d9-933a-474f-a9fa-2b93184dcce8 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:13.464613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-44fcf7d9-933a-474f-a9fa-2b93184dcce8 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:13.480704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44fcf7d9-933a-474f-a9fa-2b93184dcce8 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:13.482111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44fcf7d9-933a-474f-a9fa-2b93184dcce8 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:13.485456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44fcf7d9-933a-474f-a9fa-2b93184dcce8 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:13.486938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44fcf7d9-933a-474f-a9fa-2b93184dcce8 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:14.837449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dea8e35d-75b1-4767-b48a-76a8866aadfd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:14.839088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dea8e35d-75b1-4767-b48a-76a8866aadfd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:14.857935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dea8e35d-75b1-4767-b48a-76a8866aadfd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:14.859186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dea8e35d-75b1-4767-b48a-76a8866aadfd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:14.860254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dea8e35d-75b1-4767-b48a-76a8866aadfd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:14.860993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dea8e35d-75b1-4767-b48a-76a8866aadfd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:15.047518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-44fcf7d9-933a-474f-a9fa-2b93184dcce8 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:15.096153 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-44fcf7d9-933a-474f-a9fa-2b93184dcce8 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1505 microversion: 2.1 time: 1.639166 Jul 14 14:42:15.122911 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1597/3182] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:13 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1505 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:15.135187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c5f84171-815e-40ff-bffd-61743521c011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '.version_select at 0x7fd6c5373790>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:15.136865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c5f84171-815e-40ff-bffd-61743521c011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:15.149977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=44 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:15.158197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5f84171-815e-40ff-bffd-61743521c011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:15.158716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5f84171-815e-40ff-bffd-61743521c011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:15.160591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5f84171-815e-40ff-bffd-61743521c011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:15.161298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5f84171-815e-40ff-bffd-61743521c011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:15.257909 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c5f84171-815e-40ff-bffd-61743521c011 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.130408 Jul 14 14:42:15.274443 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1598/3183] 10.222.0.81 () {58 vars in 1295 bytes} [Thu Jul 14 14:42:15 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32/os-instance-actions => generated 611 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:15.281454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0242625f-7da2-4035-bdde-e82a78b9132f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:15.282274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0242625f-7da2-4035-bdde-e82a78b9132f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:15.295429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0242625f-7da2-4035-bdde-e82a78b9132f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:15.296185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0242625f-7da2-4035-bdde-e82a78b9132f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:15.298294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0242625f-7da2-4035-bdde-e82a78b9132f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:15.298767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0242625f-7da2-4035-bdde-e82a78b9132f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:15.397430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0242625f-7da2-4035-bdde-e82a78b9132f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:42:15.467018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dea8e35d-75b1-4767-b48a-76a8866aadfd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:15.475917 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dea8e35d-75b1-4767-b48a-76a8866aadfd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.644745 Jul 14 14:42:15.476522 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1586/3184] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:14 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:15.507277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-86eec47d-077d-4540-943c-ffe21f95c74d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-212736814"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:15.509048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-86eec47d-077d-4540-943c-ffe21f95c74d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:15.530687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86eec47d-077d-4540-943c-ffe21f95c74d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:15.532347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86eec47d-077d-4540-943c-ffe21f95c74d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:15.534026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86eec47d-077d-4540-943c-ffe21f95c74d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:15.536088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86eec47d-077d-4540-943c-ffe21f95c74d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:15.660599 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0242625f-7da2-4035-bdde-e82a78b9132f tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 204 len: 0 microversion: 2.1 time: 0.384431 Jul 14 14:42:15.661656 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1599/3185] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:42:15 2022] DELETE /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:42:15.673427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eef42aa9-c03b-43ed-8eae-ec246fac1b20 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:15.678213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eef42aa9-c03b-43ed-8eae-ec246fac1b20 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:15.713088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eef42aa9-c03b-43ed-8eae-ec246fac1b20 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:15.714336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eef42aa9-c03b-43ed-8eae-ec246fac1b20 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:15.717527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eef42aa9-c03b-43ed-8eae-ec246fac1b20 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:15.718225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eef42aa9-c03b-43ed-8eae-ec246fac1b20 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:16.142359 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-86eec47d-077d-4540-943c-ffe21f95c74d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.645128 Jul 14 14:42:16.155759 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1587/3186] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:42:15 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 14 14:42:16.168643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65b2a82b-08aa-4812-a7c6-370cea689cb3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:16.169565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-65b2a82b-08aa-4812-a7c6-370cea689cb3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:16.190005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65b2a82b-08aa-4812-a7c6-370cea689cb3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:16.190753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65b2a82b-08aa-4812-a7c6-370cea689cb3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:16.191693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65b2a82b-08aa-4812-a7c6-370cea689cb3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:16.201092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65b2a82b-08aa-4812-a7c6-370cea689cb3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:16.553045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eef42aa9-c03b-43ed-8eae-ec246fac1b20 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:16.568450 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eef42aa9-c03b-43ed-8eae-ec246fac1b20 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1511 microversion: 2.1 time: 0.900177 Jul 14 14:42:16.573774 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1600/3187] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:15 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1511 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:17.228748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-65b2a82b-08aa-4812-a7c6-370cea689cb3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:17.236992 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65b2a82b-08aa-4812-a7c6-370cea689cb3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1681 microversion: 2.1 time: 1.079822 Jul 14 14:42:17.243561 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1588/3188] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:16 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1681 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:17.590830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ad424c58-fdfd-4d6b-967a-2cc36fc922c5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:17.592622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ad424c58-fdfd-4d6b-967a-2cc36fc922c5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:17.610857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad424c58-fdfd-4d6b-967a-2cc36fc922c5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:17.611772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad424c58-fdfd-4d6b-967a-2cc36fc922c5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:17.615354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad424c58-fdfd-4d6b-967a-2cc36fc922c5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:17.615798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad424c58-fdfd-4d6b-967a-2cc36fc922c5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:18.265496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1989c5f3-0536-4873-96c7-286efe0824d7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:18.268162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1989c5f3-0536-4873-96c7-286efe0824d7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:18.292891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1989c5f3-0536-4873-96c7-286efe0824d7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:18.293402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1989c5f3-0536-4873-96c7-286efe0824d7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:18.294233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1989c5f3-0536-4873-96c7-286efe0824d7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:18.294666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1989c5f3-0536-4873-96c7-286efe0824d7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:19.255742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ad424c58-fdfd-4d6b-967a-2cc36fc922c5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:19.283014 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ad424c58-fdfd-4d6b-967a-2cc36fc922c5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1511 microversion: 2.1 time: 1.696102 Jul 14 14:42:19.289495 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1601/3189] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:17 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1511 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:19.429775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1989c5f3-0536-4873-96c7-286efe0824d7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:19.465961 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1989c5f3-0536-4873-96c7-286efe0824d7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1689 microversion: 2.1 time: 1.206100 Jul 14 14:42:19.471540 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1589/3190] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:18 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1689 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:19.525374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ca94f330-c0ff-4ee5-b333-8927165e4b42 req-893f5e62-cb4e-4254-b210-9634ca99aa70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b55c122-95db-42f1-95a9-ae5bbb4ff958", "name": "network-vif-unplugged", "status": "completed", "tag": "b14caf9c-97a3-483c-92a9-d43af26af98c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:19.589810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ca94f330-c0ff-4ee5-b333-8927165e4b42 req-893f5e62-cb4e-4254-b210-9634ca99aa70 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:19.593146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ca94f330-c0ff-4ee5-b333-8927165e4b42 req-893f5e62-cb4e-4254-b210-9634ca99aa70 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:19.656030 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ca94f330-c0ff-4ee5-b333-8927165e4b42 req-893f5e62-cb4e-4254-b210-9634ca99aa70 service nova] Creating event network-vif-unplugged:b14caf9c-97a3-483c-92a9-d43af26af98c for instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 on n-h2-767704-28 Jul 14 14:42:19.680410 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ca94f330-c0ff-4ee5-b333-8927165e4b42 req-893f5e62-cb4e-4254-b210-9634ca99aa70 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161461 Jul 14 14:42:19.695683 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1602/3191] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:20.306966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cb23f9c3-1f12-4fc9-b59d-4cc2ed3838d5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:20.307408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cb23f9c3-1f12-4fc9-b59d-4cc2ed3838d5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:20.324504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb23f9c3-1f12-4fc9-b59d-4cc2ed3838d5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:20.325003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb23f9c3-1f12-4fc9-b59d-4cc2ed3838d5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:20.325831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb23f9c3-1f12-4fc9-b59d-4cc2ed3838d5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:20.326613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb23f9c3-1f12-4fc9-b59d-4cc2ed3838d5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:20.496928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cb637b6b-e7f7-4b65-a314-cf2dade7aa64 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:20.497777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cb637b6b-e7f7-4b65-a314-cf2dade7aa64 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:20.523415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb637b6b-e7f7-4b65-a314-cf2dade7aa64 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:20.523415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb637b6b-e7f7-4b65-a314-cf2dade7aa64 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:20.525438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb637b6b-e7f7-4b65-a314-cf2dade7aa64 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:20.526116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb637b6b-e7f7-4b65-a314-cf2dade7aa64 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:20.730457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cb23f9c3-1f12-4fc9-b59d-4cc2ed3838d5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe96b5619004d64a52d09c2ea48448d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f5313420424f2c86ee5643b63b182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:20.740752 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cb23f9c3-1f12-4fc9-b59d-4cc2ed3838d5 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 200 len: 1469 microversion: 2.1 time: 0.437900 Jul 14 14:42:20.741817 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1590/3192] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:20 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 1469 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:20.749686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4ec28902-1150-4f9d-b499-48b053f61fe7 req-3963a715-ba66-47a6-8185-cd0c229d307b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e824346f-eb0a-40e3-98b8-1e6ff9289b32", "name": "network-vif-deleted", "tag": "cc2d5c2f-2377-4d8f-800b-fb47b7b92198"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:20.780920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4ec28902-1150-4f9d-b499-48b053f61fe7 req-3963a715-ba66-47a6-8185-cd0c229d307b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:20.786389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4ec28902-1150-4f9d-b499-48b053f61fe7 req-3963a715-ba66-47a6-8185-cd0c229d307b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:20.816078 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4ec28902-1150-4f9d-b499-48b053f61fe7 req-3963a715-ba66-47a6-8185-cd0c229d307b service nova] Creating event network-vif-deleted:cc2d5c2f-2377-4d8f-800b-fb47b7b92198 for instance e824346f-eb0a-40e3-98b8-1e6ff9289b32 on n-h1-767704-28 Jul 14 14:42:20.823618 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4ec28902-1150-4f9d-b499-48b053f61fe7 req-3963a715-ba66-47a6-8185-cd0c229d307b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080274 Jul 14 14:42:20.824839 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1591/3193] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:21.761968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd6bd718-b19f-40c7-acdd-feff5d7ed989 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:21.762943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bd6bd718-b19f-40c7-acdd-feff5d7ed989 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] [instance: e824346f-eb0a-40e3-98b8-1e6ff9289b32] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:21.777774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cb637b6b-e7f7-4b65-a314-cf2dade7aa64 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:21.799161 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cb637b6b-e7f7-4b65-a314-cf2dade7aa64 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 1.301494 Jul 14 14:42:21.809833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd6bd718-b19f-40c7-acdd-feff5d7ed989 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:21.809833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd6bd718-b19f-40c7-acdd-feff5d7ed989 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:21.809833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd6bd718-b19f-40c7-acdd-feff5d7ed989 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:21.809833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd6bd718-b19f-40c7-acdd-feff5d7ed989 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:21.814351 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1603/3194] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:20 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:21.876351 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-bd6bd718-b19f-40c7-acdd-feff5d7ed989 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] HTTP exception thrown: Instance e824346f-eb0a-40e3-98b8-1e6ff9289b32 could not be found. Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd6bd718-b19f-40c7-acdd-feff5d7ed989 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Request method failure captured: Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 HTTP/1.1 Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CsZTq0tp6lOyXbKlAAmSav5fQykDB5RfTjK1TBvaeHHw5gi7vyJHzhZjJrJylYYbwFbssF6_RIS-gWk3xYnR9HAo7rCOwVWPVCHjFckefSd4TlP9b0lC5oLyLVAVLpNkx1PwP81iW9GTE5UEUxLgTtSGVhEXglP2cNzCNUxzt2iJlk Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: e1f5313420424f2c86ee5643b63b182a Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-InstanceActionsTestJSON-2087745993 Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e1f5313420424f2c86ee5643b63b182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e1f5313420424f2c86ee5643b63b182a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e1f5313420424f2c86ee5643b63b182a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e1f5313420424f2c86ee5643b63b182a"}]}] Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-InstanceActionsTestJSON-2087745993 Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: e1f5313420424f2c86ee5643b63b182a Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2087745993 Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-InstanceActionsTestJSON-2087745993-project Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: abe96b5619004d64a52d09c2ea48448d Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-InstanceActionsTestJSON-2087745993-project Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance e824346f-eb0a-40e3-98b8-1e6ff9289b32 could not be found. Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'e824346f-eb0a-40e3-98b8-1e6ff9289b32'} Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e824346f-eb0a-40e3-98b8-1e6ff9289b32 could not be found. Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e824346f-eb0a-40e3-98b8-1e6ff9289b32 could not be found. Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:21.882645 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:42:21.901435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:21.901435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:21.901435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:21.901435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:21.901435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:21.901435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e824346f-eb0a-40e3-98b8-1e6ff9289b32 could not be found. Jul 14 14:42:21.901435 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:42:21.901435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd6bd718-b19f-40c7-acdd-feff5d7ed989 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] Returning 404 to user: Instance e824346f-eb0a-40e3-98b8-1e6ff9289b32 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:21.901435 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bd6bd718-b19f-40c7-acdd-feff5d7ed989 tempest-InstanceActionsTestJSON-2087745993 tempest-InstanceActionsTestJSON-2087745993-project] 10.222.0.81 "GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32" status: 404 len: 111 microversion: 2.1 time: 0.134195 Jul 14 14:42:21.901435 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1592/3195] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:21 2022] GET /compute/v2.1/servers/e824346f-eb0a-40e3-98b8-1e6ff9289b32 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:22.839934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc784311-cf63-4742-a5ef-956dc0b06a52 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:22.842243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cc784311-cf63-4742-a5ef-956dc0b06a52 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:22.867809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc784311-cf63-4742-a5ef-956dc0b06a52 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:22.879392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc784311-cf63-4742-a5ef-956dc0b06a52 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:22.888441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc784311-cf63-4742-a5ef-956dc0b06a52 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:22.895543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc784311-cf63-4742-a5ef-956dc0b06a52 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.053163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1438524955", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "c004775b-fb1b-4e77-866f-a8d89612abcc"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:23.241630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] validate_networks() for [('c004775b-fb1b-4e77-866f-a8d89612abcc', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:42:25.490655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cc784311-cf63-4742-a5ef-956dc0b06a52 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:25.508031 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc784311-cf63-4742-a5ef-956dc0b06a52 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 2.681592 Jul 14 14:42:25.509094 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1593/3196] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:22 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 2683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:26.527505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-57b4061a-b015-45d9-afc5-5730e50737dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:26.528511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-57b4061a-b015-45d9-afc5-5730e50737dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:26.556485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57b4061a-b015-45d9-afc5-5730e50737dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:26.567655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57b4061a-b015-45d9-afc5-5730e50737dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:26.570995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57b4061a-b015-45d9-afc5-5730e50737dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:26.579036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57b4061a-b015-45d9-afc5-5730e50737dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:28.162632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-57b4061a-b015-45d9-afc5-5730e50737dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:28.183491 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-57b4061a-b015-45d9-afc5-5730e50737dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 1.660130 Jul 14 14:42:28.197190 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1594/3197] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:26 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:29.211351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8c3a2862-0c7d-495d-b4dc-4ed5c064d3ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:29.212041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8c3a2862-0c7d-495d-b4dc-4ed5c064d3ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:29.228128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c3a2862-0c7d-495d-b4dc-4ed5c064d3ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:29.228924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c3a2862-0c7d-495d-b4dc-4ed5c064d3ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:29.231195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c3a2862-0c7d-495d-b4dc-4ed5c064d3ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:29.231972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c3a2862-0c7d-495d-b4dc-4ed5c064d3ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:29.369930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:42:29.371567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:42:29.372368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:42:29.373269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:42:29.374332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:42:29.420059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:29.421770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:29.426097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:29.428288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:29.501040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Getting quotas for project 857efc7b6be942fc9d5442d42f391cd0. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:42:29.537013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Getting quotas for user 22f095ab83f944b3a47e357784a6ad04 and project 857efc7b6be942fc9d5442d42f391cd0. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:42:29.598722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:42:29.613550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:42:29.631671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8c3a2862-0c7d-495d-b4dc-4ed5c064d3ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:29.665097 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8c3a2862-0c7d-495d-b4dc-4ed5c064d3ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 0.455479 Jul 14 14:42:29.667866 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1595/3198] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:29 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:29.794829 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cfd90edb-65e8-43c9-b2a3-befc5ba6a535 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.192599 Jul 14 14:42:29.795894 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1604/3199] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:42:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 7195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:42:29.806861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-85da6092-998c-4b8f-8e0a-3eae973f70e8 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:29.807595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-85da6092-998c-4b8f-8e0a-3eae973f70e8 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:30.164170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-85da6092-998c-4b8f-8e0a-3eae973f70e8 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:30.178206 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-85da6092-998c-4b8f-8e0a-3eae973f70e8 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1217 microversion: 2.1 time: 0.370322 Jul 14 14:42:30.180460 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1596/3200] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:29 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1217 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:30.571695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a71b7699-0456-4933-a722-0572a4a8bc31 req-fb7228d9-1228-4367-9c8d-c212231354d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b55c122-95db-42f1-95a9-ae5bbb4ff958", "name": "network-vif-plugged", "status": "completed", "tag": "b14caf9c-97a3-483c-92a9-d43af26af98c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:30.591055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a71b7699-0456-4933-a722-0572a4a8bc31 req-fb7228d9-1228-4367-9c8d-c212231354d3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:30.591508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a71b7699-0456-4933-a722-0572a4a8bc31 req-fb7228d9-1228-4367-9c8d-c212231354d3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:30.621439 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a71b7699-0456-4933-a722-0572a4a8bc31 req-fb7228d9-1228-4367-9c8d-c212231354d3 service nova] Creating event network-vif-plugged:b14caf9c-97a3-483c-92a9-d43af26af98c for instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 on n-h2-767704-28 Jul 14 14:42:30.635887 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a71b7699-0456-4933-a722-0572a4a8bc31 req-fb7228d9-1228-4367-9c8d-c212231354d3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075059 Jul 14 14:42:30.639916 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1605/3201] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:30.700563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-16941480-67d1-4a4d-9021-9b25d6acd3c2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:30.705371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-16941480-67d1-4a4d-9021-9b25d6acd3c2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:30.778049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=36 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:30.797716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16941480-67d1-4a4d-9021-9b25d6acd3c2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:30.802476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16941480-67d1-4a4d-9021-9b25d6acd3c2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:30.809628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16941480-67d1-4a4d-9021-9b25d6acd3c2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:30.816401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-16941480-67d1-4a4d-9021-9b25d6acd3c2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:31.199909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5962e480-f408-4b49-ad86-585fe08a0b24 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:31.200824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5962e480-f408-4b49-ad86-585fe08a0b24 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:31.673350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5962e480-f408-4b49-ad86-585fe08a0b24 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:31.687185 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5962e480-f408-4b49-ad86-585fe08a0b24 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1217 microversion: 2.1 time: 0.487609 Jul 14 14:42:31.706978 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1606/3202] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:31 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1217 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:32.611830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-16941480-67d1-4a4d-9021-9b25d6acd3c2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:32.624732 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-16941480-67d1-4a4d-9021-9b25d6acd3c2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 1.938895 Jul 14 14:42:32.642491 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1597/3203] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:30 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:32.718309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cd5115c7-4aa3-4ccb-a1bf-d3b2e90437b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:32.719910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cd5115c7-4aa3-4ccb-a1bf-d3b2e90437b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:32.756444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd5115c7-4aa3-4ccb-a1bf-d3b2e90437b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:32.759544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd5115c7-4aa3-4ccb-a1bf-d3b2e90437b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:32.763741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd5115c7-4aa3-4ccb-a1bf-d3b2e90437b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:32.768302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd5115c7-4aa3-4ccb-a1bf-d3b2e90437b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:33.078056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cd5115c7-4aa3-4ccb-a1bf-d3b2e90437b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:33.094658 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cd5115c7-4aa3-4ccb-a1bf-d3b2e90437b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1269 microversion: 2.1 time: 0.380508 Jul 14 14:42:33.101284 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1607/3204] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:32 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1269 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:33.661543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24124a5e-d289-40fa-939a-66bf33f17798 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:33.662160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-24124a5e-d289-40fa-939a-66bf33f17798 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:33.681531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24124a5e-d289-40fa-939a-66bf33f17798 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:33.681995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24124a5e-d289-40fa-939a-66bf33f17798 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:33.682791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24124a5e-d289-40fa-939a-66bf33f17798 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:33.683239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24124a5e-d289-40fa-939a-66bf33f17798 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:34.117066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a6520025-cfbb-49d2-954b-6ee7decc3f1b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:34.117697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a6520025-cfbb-49d2-954b-6ee7decc3f1b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:34.144304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6520025-cfbb-49d2-954b-6ee7decc3f1b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:34.151362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6520025-cfbb-49d2-954b-6ee7decc3f1b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:34.152060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6520025-cfbb-49d2-954b-6ee7decc3f1b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:34.152563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6520025-cfbb-49d2-954b-6ee7decc3f1b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:34.464180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a6520025-cfbb-49d2-954b-6ee7decc3f1b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:34.474244 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a6520025-cfbb-49d2-954b-6ee7decc3f1b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1275 microversion: 2.1 time: 0.362222 Jul 14 14:42:34.474977 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1608/3205] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:34 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1275 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:34.504754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-24124a5e-d289-40fa-939a-66bf33f17798 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:34.516427 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-24124a5e-d289-40fa-939a-66bf33f17798 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 0.859848 Jul 14 14:42:34.519728 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1598/3206] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:33 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:35.319171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8cc9e8f4-378c-44ca-b79e-bbd8c935da27 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a529f0e8-abe2-462c-be25-24c15b1328f7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:35.321940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8cc9e8f4-378c-44ca-b79e-bbd8c935da27 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:35.338268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8cc9e8f4-378c-44ca-b79e-bbd8c935da27 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.338730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8cc9e8f4-378c-44ca-b79e-bbd8c935da27 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:35.339576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8cc9e8f4-378c-44ca-b79e-bbd8c935da27 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.339957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8cc9e8f4-378c-44ca-b79e-bbd8c935da27 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:35.492794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e38854b1-211c-47cc-9338-de08fc8649b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:35.494860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e38854b1-211c-47cc-9338-de08fc8649b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:35.511028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e38854b1-211c-47cc-9338-de08fc8649b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.518288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e38854b1-211c-47cc-9338-de08fc8649b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:35.523192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e38854b1-211c-47cc-9338-de08fc8649b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.523948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e38854b1-211c-47cc-9338-de08fc8649b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:35.733333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e38854b1-211c-47cc-9338-de08fc8649b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:35.747862 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e38854b1-211c-47cc-9338-de08fc8649b4 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1275 microversion: 2.1 time: 0.257810 Jul 14 14:42:35.755077 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1599/3207] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:35 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1275 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:35.769689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c5f62f3b-2fc1-443e-b128-23a21eb702e7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:35.773412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c5f62f3b-2fc1-443e-b128-23a21eb702e7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:35.798128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5f62f3b-2fc1-443e-b128-23a21eb702e7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.798646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5f62f3b-2fc1-443e-b128-23a21eb702e7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:35.804183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5f62f3b-2fc1-443e-b128-23a21eb702e7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.807085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5f62f3b-2fc1-443e-b128-23a21eb702e7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:36.012229 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8cc9e8f4-378c-44ca-b79e-bbd8c935da27 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "POST /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.697075 Jul 14 14:42:36.014286 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1609/3208] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:42:35 2022] POST /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:36.387365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c5f62f3b-2fc1-443e-b128-23a21eb702e7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:36.405163 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c5f62f3b-2fc1-443e-b128-23a21eb702e7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 0.648810 Jul 14 14:42:36.406021 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1600/3209] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:35 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:36.774456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-84de7afa-2691-437c-ab0f-8e5c999709ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:36.776127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-84de7afa-2691-437c-ab0f-8e5c999709ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:36.795365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84de7afa-2691-437c-ab0f-8e5c999709ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:36.799391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84de7afa-2691-437c-ab0f-8e5c999709ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:36.804038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84de7afa-2691-437c-ab0f-8e5c999709ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:36.804926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84de7afa-2691-437c-ab0f-8e5c999709ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:37.006844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-84de7afa-2691-437c-ab0f-8e5c999709ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:37.029597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:37.038667 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-84de7afa-2691-437c-ab0f-8e5c999709ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1275 microversion: 2.1 time: 0.270567 Jul 14 14:42:37.044286 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1610/3210] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:36 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1275 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:37.426871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af314850-6ad5-490c-899b-de11e0e80eef tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:37.428133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-af314850-6ad5-490c-899b-de11e0e80eef tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:37.447687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af314850-6ad5-490c-899b-de11e0e80eef tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:37.448140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af314850-6ad5-490c-899b-de11e0e80eef tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:37.456665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af314850-6ad5-490c-899b-de11e0e80eef tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:37.462228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af314850-6ad5-490c-899b-de11e0e80eef tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:37.515429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:37.874279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-af314850-6ad5-490c-899b-de11e0e80eef tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:37.890280 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af314850-6ad5-490c-899b-de11e0e80eef tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 0.470643 Jul 14 14:42:37.891138 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1601/3211] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:37 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:38.069704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-41f5c306-49a6-4715-ab4e-401d611af655 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:38.070230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-41f5c306-49a6-4715-ab4e-401d611af655 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:38.126280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41f5c306-49a6-4715-ab4e-401d611af655 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:38.126754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41f5c306-49a6-4715-ab4e-401d611af655 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:38.138179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41f5c306-49a6-4715-ab4e-401d611af655 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:38.138670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41f5c306-49a6-4715-ab4e-401d611af655 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:38.788395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-41f5c306-49a6-4715-ab4e-401d611af655 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:38.807468 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-41f5c306-49a6-4715-ab4e-401d611af655 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1317 microversion: 2.1 time: 0.751502 Jul 14 14:42:38.817749 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1611/3212] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:38 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1317 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:38.914934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2c8789f8-b098-4f98-9ad2-d539e897a0b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:38.917195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2c8789f8-b098-4f98-9ad2-d539e897a0b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:38.934561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c8789f8-b098-4f98-9ad2-d539e897a0b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:38.936103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c8789f8-b098-4f98-9ad2-d539e897a0b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:38.938771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c8789f8-b098-4f98-9ad2-d539e897a0b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:38.942331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c8789f8-b098-4f98-9ad2-d539e897a0b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:39.824920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9984fc26-2af1-4965-8259-409db8433712 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:39.826301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9984fc26-2af1-4965-8259-409db8433712 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:39.840254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:39.853192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9984fc26-2af1-4965-8259-409db8433712 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:39.853643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9984fc26-2af1-4965-8259-409db8433712 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:39.855894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9984fc26-2af1-4965-8259-409db8433712 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:39.858427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9984fc26-2af1-4965-8259-409db8433712 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:40.172615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:40.661775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9984fc26-2af1-4965-8259-409db8433712 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:40.676052 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9984fc26-2af1-4965-8259-409db8433712 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1317 microversion: 2.1 time: 0.854551 Jul 14 14:42:40.679405 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1612/3213] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:39 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1317 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:41.186660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2c8789f8-b098-4f98-9ad2-d539e897a0b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:41.196139 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2c8789f8-b098-4f98-9ad2-d539e897a0b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 2.290201 Jul 14 14:42:41.196737 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1602/3214] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:38 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:41.693783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:41.701270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8a195e1-5c5b-4a78-92f4-1db4d5905c23 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:41.702756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b8a195e1-5c5b-4a78-92f4-1db4d5905c23 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:41.742106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8a195e1-5c5b-4a78-92f4-1db4d5905c23 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:41.746592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8a195e1-5c5b-4a78-92f4-1db4d5905c23 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:41.750623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8a195e1-5c5b-4a78-92f4-1db4d5905c23 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:41.754470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8a195e1-5c5b-4a78-92f4-1db4d5905c23 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:42.216754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8c81af2-7452-4f49-b95b-7992916346dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:42.218806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8c81af2-7452-4f49-b95b-7992916346dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:42.251260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8c81af2-7452-4f49-b95b-7992916346dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:42.251749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8c81af2-7452-4f49-b95b-7992916346dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:42.252555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8c81af2-7452-4f49-b95b-7992916346dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:42.254341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8c81af2-7452-4f49-b95b-7992916346dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:42.803183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b8a195e1-5c5b-4a78-92f4-1db4d5905c23 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:42.821151 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b8a195e1-5c5b-4a78-92f4-1db4d5905c23 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1317 microversion: 2.1 time: 1.120514 Jul 14 14:42:42.823044 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1613/3215] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:41 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1317 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:43.138419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f8c81af2-7452-4f49-b95b-7992916346dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:43.175435 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8c81af2-7452-4f49-b95b-7992916346dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 0.964578 Jul 14 14:42:43.178227 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1603/3216] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:42 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:43.839431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5f2d93a-3b77-450d-82d9-917bf5379b6a tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:43.841858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d5f2d93a-3b77-450d-82d9-917bf5379b6a tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:43.856086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5f2d93a-3b77-450d-82d9-917bf5379b6a tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:43.857172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5f2d93a-3b77-450d-82d9-917bf5379b6a tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:43.862536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5f2d93a-3b77-450d-82d9-917bf5379b6a tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:43.863416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5f2d93a-3b77-450d-82d9-917bf5379b6a tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:43.875707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4937be54-819d-42ba-9207-9df6bf4e6dbf req-fa5f8286-8371-462f-b424-4e3d8acaba49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b778f69c-31a5-4e80-ad4b-f9ab1250bc72", "tag": "7fbad970-4229-422e-937a-3950b6ef02e9"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:43.917944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4937be54-819d-42ba-9207-9df6bf4e6dbf req-fa5f8286-8371-462f-b424-4e3d8acaba49 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:43.919550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4937be54-819d-42ba-9207-9df6bf4e6dbf req-fa5f8286-8371-462f-b424-4e3d8acaba49 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:43.948126 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4937be54-819d-42ba-9207-9df6bf4e6dbf req-fa5f8286-8371-462f-b424-4e3d8acaba49 service nova] Creating event network-changed:7fbad970-4229-422e-937a-3950b6ef02e9 for instance b778f69c-31a5-4e80-ad4b-f9ab1250bc72 on n-h1-767704-28 Jul 14 14:42:43.957005 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4937be54-819d-42ba-9207-9df6bf4e6dbf req-fa5f8286-8371-462f-b424-4e3d8acaba49 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085688 Jul 14 14:42:43.966770 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1604/3217] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:44.198515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0aef10fb-7cb2-4bc4-a5e8-9df613298fd0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:44.200096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0aef10fb-7cb2-4bc4-a5e8-9df613298fd0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:44.247916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0aef10fb-7cb2-4bc4-a5e8-9df613298fd0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:44.249527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0aef10fb-7cb2-4bc4-a5e8-9df613298fd0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:44.254894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0aef10fb-7cb2-4bc4-a5e8-9df613298fd0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:44.256400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0aef10fb-7cb2-4bc4-a5e8-9df613298fd0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:44.558379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d5f2d93a-3b77-450d-82d9-917bf5379b6a tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:44.573168 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d5f2d93a-3b77-450d-82d9-917bf5379b6a tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1317 microversion: 2.1 time: 0.737611 Jul 14 14:42:44.579250 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1614/3218] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:43 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1317 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:44.894627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0aef10fb-7cb2-4bc4-a5e8-9df613298fd0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:44.935244 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0aef10fb-7cb2-4bc4-a5e8-9df613298fd0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 0.744459 Jul 14 14:42:44.940210 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1605/3219] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:44 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:45.599897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6e8d014c-1656-4dd6-b36c-1cff4e1fc86f tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:45.601546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6e8d014c-1656-4dd6-b36c-1cff4e1fc86f tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:45.619561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:45.640167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e8d014c-1656-4dd6-b36c-1cff4e1fc86f tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:45.647648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e8d014c-1656-4dd6-b36c-1cff4e1fc86f tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:45.650631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e8d014c-1656-4dd6-b36c-1cff4e1fc86f tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:45.651232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e8d014c-1656-4dd6-b36c-1cff4e1fc86f tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:45.966593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-777d35f8-6c71-4d8f-9b2d-9836404d1700 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:45.968094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-777d35f8-6c71-4d8f-9b2d-9836404d1700 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:45.992417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-777d35f8-6c71-4d8f-9b2d-9836404d1700 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:45.993284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-777d35f8-6c71-4d8f-9b2d-9836404d1700 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:45.994422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-777d35f8-6c71-4d8f-9b2d-9836404d1700 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:45.995188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-777d35f8-6c71-4d8f-9b2d-9836404d1700 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:46.151466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6e8d014c-1656-4dd6-b36c-1cff4e1fc86f tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:46.170963 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6e8d014c-1656-4dd6-b36c-1cff4e1fc86f tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1317 microversion: 2.1 time: 0.573835 Jul 14 14:42:46.172194 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1615/3220] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:45 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:46.402271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-777d35f8-6c71-4d8f-9b2d-9836404d1700 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:46.420824 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-777d35f8-6c71-4d8f-9b2d-9836404d1700 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 0.465439 Jul 14 14:42:46.422465 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1606/3221] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:45 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:47.194308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8419fe2d-e860-4520-b0f1-3254c7175982 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:47.195687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8419fe2d-e860-4520-b0f1-3254c7175982 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:47.236421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8419fe2d-e860-4520-b0f1-3254c7175982 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:47.242235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8419fe2d-e860-4520-b0f1-3254c7175982 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:47.246691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8419fe2d-e860-4520-b0f1-3254c7175982 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:47.251818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8419fe2d-e860-4520-b0f1-3254c7175982 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:47.442873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b5ae4b85-8557-4b27-8184-23208b75ca2a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:47.443720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b5ae4b85-8557-4b27-8184-23208b75ca2a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:47.479949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5ae4b85-8557-4b27-8184-23208b75ca2a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:47.480695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5ae4b85-8557-4b27-8184-23208b75ca2a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:47.497135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5ae4b85-8557-4b27-8184-23208b75ca2a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:47.500485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5ae4b85-8557-4b27-8184-23208b75ca2a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:48.273102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b5ae4b85-8557-4b27-8184-23208b75ca2a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:48.311553 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b5ae4b85-8557-4b27-8184-23208b75ca2a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 0.872424 Jul 14 14:42:48.325207 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1607/3222] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:47 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:48.338884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8419fe2d-e860-4520-b0f1-3254c7175982 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:48.349929 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8419fe2d-e860-4520-b0f1-3254c7175982 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1317 microversion: 2.1 time: 1.164494 Jul 14 14:42:48.350408 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1616/3223] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:47 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1317 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:49.339693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d0a4e612-f08b-42c1-9557-65c2a4cc517b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:49.340568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d0a4e612-f08b-42c1-9557-65c2a4cc517b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:49.356449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0a4e612-f08b-42c1-9557-65c2a4cc517b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:49.356926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0a4e612-f08b-42c1-9557-65c2a4cc517b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:49.361823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0a4e612-f08b-42c1-9557-65c2a4cc517b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:49.363518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0a4e612-f08b-42c1-9557-65c2a4cc517b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:49.371372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5a6f5f28-a68b-41a5-b7fd-ee67763aa02b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:49.372153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5a6f5f28-a68b-41a5-b7fd-ee67763aa02b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:49.427131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a6f5f28-a68b-41a5-b7fd-ee67763aa02b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:49.427890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a6f5f28-a68b-41a5-b7fd-ee67763aa02b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:49.447510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a6f5f28-a68b-41a5-b7fd-ee67763aa02b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:49.448619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a6f5f28-a68b-41a5-b7fd-ee67763aa02b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:50.587637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5a6f5f28-a68b-41a5-b7fd-ee67763aa02b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:50.599359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d0a4e612-f08b-42c1-9557-65c2a4cc517b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:50.602655 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5a6f5f28-a68b-41a5-b7fd-ee67763aa02b tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1317 microversion: 2.1 time: 1.233633 Jul 14 14:42:50.616018 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1617/3224] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:49 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1317 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:50.618968 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d0a4e612-f08b-42c1-9557-65c2a4cc517b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 1.284298 Jul 14 14:42:50.619983 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1608/3225] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:49 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:51.623113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a5a8a04b-512c-42dc-929d-2e3f0d005261 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:51.623113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a5a8a04b-512c-42dc-929d-2e3f0d005261 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:51.635370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5a8a04b-512c-42dc-929d-2e3f0d005261 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:51.635840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5a8a04b-512c-42dc-929d-2e3f0d005261 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:51.636895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5a8a04b-512c-42dc-929d-2e3f0d005261 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:51.637363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5a8a04b-512c-42dc-929d-2e3f0d005261 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:51.639773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a39b602-7537-449c-84a9-16d03034d5ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:51.640404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2a39b602-7537-449c-84a9-16d03034d5ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:51.677316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a39b602-7537-449c-84a9-16d03034d5ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:51.678184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a39b602-7537-449c-84a9-16d03034d5ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:51.679015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a39b602-7537-449c-84a9-16d03034d5ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:51.679456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a39b602-7537-449c-84a9-16d03034d5ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:52.304308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a5a8a04b-512c-42dc-929d-2e3f0d005261 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:52.326630 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a5a8a04b-512c-42dc-929d-2e3f0d005261 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1317 microversion: 2.1 time: 0.709733 Jul 14 14:42:52.327643 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1618/3226] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:51 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:52.337209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-59d11535-a630-46d0-8dbb-758424eff851 req-e03ba267-0691-4f33-a540-8cc36d8b082a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b778f69c-31a5-4e80-ad4b-f9ab1250bc72", "name": "network-vif-plugged", "status": "completed", "tag": "7fbad970-4229-422e-937a-3950b6ef02e9"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:52.358902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-59d11535-a630-46d0-8dbb-758424eff851 req-e03ba267-0691-4f33-a540-8cc36d8b082a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:52.359723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-59d11535-a630-46d0-8dbb-758424eff851 req-e03ba267-0691-4f33-a540-8cc36d8b082a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:52.379305 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-59d11535-a630-46d0-8dbb-758424eff851 req-e03ba267-0691-4f33-a540-8cc36d8b082a service nova] Creating event network-vif-plugged:7fbad970-4229-422e-937a-3950b6ef02e9 for instance b778f69c-31a5-4e80-ad4b-f9ab1250bc72 on n-h1-767704-28 Jul 14 14:42:52.405467 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-59d11535-a630-46d0-8dbb-758424eff851 req-e03ba267-0691-4f33-a540-8cc36d8b082a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075638 Jul 14 14:42:52.413872 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1619/3227] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:52.536802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2a39b602-7537-449c-84a9-16d03034d5ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:52.554915 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a39b602-7537-449c-84a9-16d03034d5ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 0.920344 Jul 14 14:42:52.567090 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1609/3228] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:51 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:53.353120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-95bdaa39-379b-4a88-85be-81b7279ed6d0 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:53.353843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-95bdaa39-379b-4a88-85be-81b7279ed6d0 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:53.369472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95bdaa39-379b-4a88-85be-81b7279ed6d0 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:53.370223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95bdaa39-379b-4a88-85be-81b7279ed6d0 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:53.373906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95bdaa39-379b-4a88-85be-81b7279ed6d0 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:53.375086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95bdaa39-379b-4a88-85be-81b7279ed6d0 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:53.575997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6bea995d-e951-4cab-8614-2be807b588d1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:53.578575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6bea995d-e951-4cab-8614-2be807b588d1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:53.590914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6bea995d-e951-4cab-8614-2be807b588d1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:53.591471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6bea995d-e951-4cab-8614-2be807b588d1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:53.592340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6bea995d-e951-4cab-8614-2be807b588d1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:53.593769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6bea995d-e951-4cab-8614-2be807b588d1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:54.069334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-95bdaa39-379b-4a88-85be-81b7279ed6d0 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:54.136472 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-95bdaa39-379b-4a88-85be-81b7279ed6d0 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1317 microversion: 2.1 time: 0.779651 Jul 14 14:42:54.141055 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1620/3229] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:53 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1317 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:54.370644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6bea995d-e951-4cab-8614-2be807b588d1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:54.395166 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6bea995d-e951-4cab-8614-2be807b588d1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1684 microversion: 2.1 time: 0.824052 Jul 14 14:42:54.406020 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1610/3230] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:53 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1684 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:54.645397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bedc0f85-111c-4d9d-8293-24fbb4aca183 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:54.646017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bedc0f85-111c-4d9d-8293-24fbb4aca183 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:54.653282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bedc0f85-111c-4d9d-8293-24fbb4aca183 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:54.654030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bedc0f85-111c-4d9d-8293-24fbb4aca183 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:54.654987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bedc0f85-111c-4d9d-8293-24fbb4aca183 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:54.655593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bedc0f85-111c-4d9d-8293-24fbb4aca183 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:55.165311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1817eb0-c1a4-4ee0-b3bf-45cb299181b7 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:55.167176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f1817eb0-c1a4-4ee0-b3bf-45cb299181b7 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:55.186332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1817eb0-c1a4-4ee0-b3bf-45cb299181b7 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:55.187042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1817eb0-c1a4-4ee0-b3bf-45cb299181b7 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:55.188279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1817eb0-c1a4-4ee0-b3bf-45cb299181b7 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:55.190591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1817eb0-c1a4-4ee0-b3bf-45cb299181b7 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:55.739863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bedc0f85-111c-4d9d-8293-24fbb4aca183 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:55.753384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bedc0f85-111c-4d9d-8293-24fbb4aca183 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:55.755362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bedc0f85-111c-4d9d-8293-24fbb4aca183 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:55.756713 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bedc0f85-111c-4d9d-8293-24fbb4aca183 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 2954 microversion: 2.42 time: 1.116354 Jul 14 14:42:55.757963 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1621/3231] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:54 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 2954 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:55.767531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c63fab71-5c6d-44bf-a60b-0843e071cfed tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:55.768682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c63fab71-5c6d-44bf-a60b-0843e071cfed tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:55.778241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c63fab71-5c6d-44bf-a60b-0843e071cfed tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:55.779130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c63fab71-5c6d-44bf-a60b-0843e071cfed tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:55.780264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c63fab71-5c6d-44bf-a60b-0843e071cfed tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:55.780915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c63fab71-5c6d-44bf-a60b-0843e071cfed tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:55.834739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f1817eb0-c1a4-4ee0-b3bf-45cb299181b7 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:55.843341 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f1817eb0-c1a4-4ee0-b3bf-45cb299181b7 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1506 microversion: 2.1 time: 0.687037 Jul 14 14:42:55.849277 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1611/3232] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:55 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:55.863638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5d10f586-9ded-4950-b887-aad3c554f381 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:55.864409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5d10f586-9ded-4950-b887-aad3c554f381 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:55.874536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d10f586-9ded-4950-b887-aad3c554f381 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:55.875262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d10f586-9ded-4950-b887-aad3c554f381 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:55.876256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d10f586-9ded-4950-b887-aad3c554f381 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:55.876705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d10f586-9ded-4950-b887-aad3c554f381 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.168737 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5d10f586-9ded-4950-b887-aad3c554f381 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.318043 Jul 14 14:42:56.178504 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1612/3233] 10.222.0.81 () {60 vars in 1315 bytes} [Thu Jul 14 14:42:55 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971/os-interface => generated 1831 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:56.183671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3d125a96-37f0-4795-9318-fa4a8d642e08 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:56.184410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3d125a96-37f0-4795-9318-fa4a8d642e08 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:56.191730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d125a96-37f0-4795-9318-fa4a8d642e08 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.192463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d125a96-37f0-4795-9318-fa4a8d642e08 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.193564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d125a96-37f0-4795-9318-fa4a8d642e08 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.194178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d125a96-37f0-4795-9318-fa4a8d642e08 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.223831 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3d125a96-37f0-4795-9318-fa4a8d642e08 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72/ips" status: 200 len: 109 microversion: 2.1 time: 0.043672 Jul 14 14:42:56.232261 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1613/3234] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 14:42:56 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72/ips => generated 109 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:56.233463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c63fab71-5c6d-44bf-a60b-0843e071cfed tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:56.238340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b3552101-3ac2-4d72-802d-c4dc34ad0942 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:56.239107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b3552101-3ac2-4d72-802d-c4dc34ad0942 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:56.246298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3552101-3ac2-4d72-802d-c4dc34ad0942 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.246947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3552101-3ac2-4d72-802d-c4dc34ad0942 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.247931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3552101-3ac2-4d72-802d-c4dc34ad0942 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.248546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3552101-3ac2-4d72-802d-c4dc34ad0942 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.259106 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c63fab71-5c6d-44bf-a60b-0843e071cfed tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.498924 Jul 14 14:42:56.262573 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1622/3235] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:55 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:56.311659 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b3552101-3ac2-4d72-802d-c4dc34ad0942 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72/ips" status: 200 len: 109 microversion: 2.1 time: 0.077858 Jul 14 14:42:56.313084 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1614/3236] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 14:42:56 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72/ips => generated 109 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:56.327882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-990df1f1-35a0-4da6-95f6-654de44116dd tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:56.328528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-990df1f1-35a0-4da6-95f6-654de44116dd tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:56.336267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-990df1f1-35a0-4da6-95f6-654de44116dd tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.337131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-990df1f1-35a0-4da6-95f6-654de44116dd tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.337930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-990df1f1-35a0-4da6-95f6-654de44116dd tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.338468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-990df1f1-35a0-4da6-95f6-654de44116dd tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.375728 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-990df1f1-35a0-4da6-95f6-654de44116dd tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72/ips/tempest-ServerAddressesTestJSON-2098998221-network" status: 200 len: 94 microversion: 2.1 time: 0.053609 Jul 14 14:42:56.383216 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1623/3237] 10.222.0.81 () {58 vars in 1400 bytes} [Thu Jul 14 14:42:56 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72/ips/tempest-ServerAddressesTestJSON-2098998221-network => generated 94 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:42:56.390879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f7bfaf2b-6004-4a32-8ff7-3dcbec0423e1 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:56.391397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f7bfaf2b-6004-4a32-8ff7-3dcbec0423e1 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:56.398878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7bfaf2b-6004-4a32-8ff7-3dcbec0423e1 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.399330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7bfaf2b-6004-4a32-8ff7-3dcbec0423e1 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.400693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7bfaf2b-6004-4a32-8ff7-3dcbec0423e1 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.401337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7bfaf2b-6004-4a32-8ff7-3dcbec0423e1 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.453072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f7bfaf2b-6004-4a32-8ff7-3dcbec0423e1 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:42:56.694911 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f7bfaf2b-6004-4a32-8ff7-3dcbec0423e1 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 204 len: 0 microversion: 2.1 time: 0.308516 Jul 14 14:42:56.699632 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1615/3238] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:42:56 2022] DELETE /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:42:56.709115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ef4dece-e3c1-4309-8b95-a293afc238a5 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:56.710033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ef4dece-e3c1-4309-8b95-a293afc238a5 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:56.719640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ef4dece-e3c1-4309-8b95-a293afc238a5 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.723038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ef4dece-e3c1-4309-8b95-a293afc238a5 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.724362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ef4dece-e3c1-4309-8b95-a293afc238a5 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.725178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ef4dece-e3c1-4309-8b95-a293afc238a5 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:57.396128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ef4dece-e3c1-4309-8b95-a293afc238a5 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:57.408753 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ef4dece-e3c1-4309-8b95-a293afc238a5 tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1512 microversion: 2.1 time: 0.707512 Jul 14 14:42:57.420846 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1624/3239] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:56 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1512 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:57.603084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fa75a08c-b69e-48b9-bfec-4efa15db4843 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:57.604766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fa75a08c-b69e-48b9-bfec-4efa15db4843 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:57.612449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-34558bae-391d-42dd-9a07-57eaead668f0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:57.613652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-34558bae-391d-42dd-9a07-57eaead668f0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:57.618362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa75a08c-b69e-48b9-bfec-4efa15db4843 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:57.630244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa75a08c-b69e-48b9-bfec-4efa15db4843 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:57.631303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa75a08c-b69e-48b9-bfec-4efa15db4843 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:57.633325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34558bae-391d-42dd-9a07-57eaead668f0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:57.634126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34558bae-391d-42dd-9a07-57eaead668f0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:57.636196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34558bae-391d-42dd-9a07-57eaead668f0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:57.636990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34558bae-391d-42dd-9a07-57eaead668f0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:57.637767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa75a08c-b69e-48b9-bfec-4efa15db4843 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:57.746528 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fa75a08c-b69e-48b9-bfec-4efa15db4843 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146881 Jul 14 14:42:57.747512 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1625/3240] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:57 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:57.760927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d6c310af-5c76-4c32-86cf-8afd908cf62a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:57.761414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d6c310af-5c76-4c32-86cf-8afd908cf62a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:57.770206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6c310af-5c76-4c32-86cf-8afd908cf62a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:57.771272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6c310af-5c76-4c32-86cf-8afd908cf62a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:57.772559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6c310af-5c76-4c32-86cf-8afd908cf62a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:57.773325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6c310af-5c76-4c32-86cf-8afd908cf62a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:57.927340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-d6c310af-5c76-4c32-86cf-8afd908cf62a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lazy-loading 'services' on Instance uuid 541b73d3-64ab-41c0-89c8-2930dc27af78 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:42:58.025483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-34558bae-391d-42dd-9a07-57eaead668f0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:58.035355 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-34558bae-391d-42dd-9a07-57eaead668f0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.434101 Jul 14 14:42:58.040928 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1616/3241] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:57 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:58.134062 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d6c310af-5c76-4c32-86cf-8afd908cf62a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "DELETE /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78/os-volume_attachments/a529f0e8-abe2-462c-be25-24c15b1328f7" status: 202 len: 0 microversion: 2.1 time: 0.377938 Jul 14 14:42:58.135115 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1626/3242] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 14:42:57 2022] DELETE /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78/os-volume_attachments/a529f0e8-abe2-462c-be25-24c15b1328f7 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:42:58.428997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9d93750-0036-4ca2-a70b-937a1983b15d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:58.428997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b9d93750-0036-4ca2-a70b-937a1983b15d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:58.442065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9d93750-0036-4ca2-a70b-937a1983b15d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:58.447108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9d93750-0036-4ca2-a70b-937a1983b15d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:58.449666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9d93750-0036-4ca2-a70b-937a1983b15d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:58.451690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9d93750-0036-4ca2-a70b-937a1983b15d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:58.958203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b9d93750-0036-4ca2-a70b-937a1983b15d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:58.966721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:58.986578 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b9d93750-0036-4ca2-a70b-937a1983b15d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1512 microversion: 2.1 time: 0.553794 Jul 14 14:42:58.987863 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1617/3243] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:58 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1512 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:59.670354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e663d4a3-c2d2-4378-881f-15a81dc63901 req-b4c870fa-d5b1-4154-8cec-f0bd0560d389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b55c122-95db-42f1-95a9-ae5bbb4ff958", "name": "network-vif-unplugged", "status": "completed", "tag": "b14caf9c-97a3-483c-92a9-d43af26af98c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:59.705757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e663d4a3-c2d2-4378-881f-15a81dc63901 req-b4c870fa-d5b1-4154-8cec-f0bd0560d389 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:59.706368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e663d4a3-c2d2-4378-881f-15a81dc63901 req-b4c870fa-d5b1-4154-8cec-f0bd0560d389 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:59.762830 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e663d4a3-c2d2-4378-881f-15a81dc63901 req-b4c870fa-d5b1-4154-8cec-f0bd0560d389 service nova] Creating event network-vif-unplugged:b14caf9c-97a3-483c-92a9-d43af26af98c for instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 on n-h2-767704-28 Jul 14 14:42:59.787102 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e663d4a3-c2d2-4378-881f-15a81dc63901 req-b4c870fa-d5b1-4154-8cec-f0bd0560d389 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122164 Jul 14 14:42:59.789224 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1627/3244] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:00.011794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a9bd83f5-f52f-407a-89ff-03d97a35a1ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:00.012923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a9bd83f5-f52f-407a-89ff-03d97a35a1ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:00.039508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9bd83f5-f52f-407a-89ff-03d97a35a1ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:00.039976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9bd83f5-f52f-407a-89ff-03d97a35a1ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:00.040826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9bd83f5-f52f-407a-89ff-03d97a35a1ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:00.041345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9bd83f5-f52f-407a-89ff-03d97a35a1ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:00.218036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1aa6bcaa-4784-44bf-8e8d-035b64e99ebc req-f7e4609c-c418-4dbb-b279-244a5d1c6566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b778f69c-31a5-4e80-ad4b-f9ab1250bc72", "name": "network-vif-deleted", "tag": "7fbad970-4229-422e-937a-3950b6ef02e9"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:00.253064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1aa6bcaa-4784-44bf-8e8d-035b64e99ebc req-f7e4609c-c418-4dbb-b279-244a5d1c6566 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:00.253064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1aa6bcaa-4784-44bf-8e8d-035b64e99ebc req-f7e4609c-c418-4dbb-b279-244a5d1c6566 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:00.325463 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1aa6bcaa-4784-44bf-8e8d-035b64e99ebc req-f7e4609c-c418-4dbb-b279-244a5d1c6566 service nova] Creating event network-vif-deleted:7fbad970-4229-422e-937a-3950b6ef02e9 for instance b778f69c-31a5-4e80-ad4b-f9ab1250bc72 on n-h1-767704-28 Jul 14 14:43:00.345316 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1aa6bcaa-4784-44bf-8e8d-035b64e99ebc req-f7e4609c-c418-4dbb-b279-244a5d1c6566 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137531 Jul 14 14:43:00.354964 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1628/3245] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:43:00.418980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a9bd83f5-f52f-407a-89ff-03d97a35a1ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f095ab83f944b3a47e357784a6ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857efc7b6be942fc9d5442d42f391cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:00.433119 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a9bd83f5-f52f-407a-89ff-03d97a35a1ff tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 200 len: 1470 microversion: 2.1 time: 0.427918 Jul 14 14:43:00.434401 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1618/3246] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:59 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 1470 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:01.460479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f179046c-5be7-4943-a530-9b71168d833d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:01.462672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f179046c-5be7-4943-a530-9b71168d833d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] [instance: b778f69c-31a5-4e80-ad4b-f9ab1250bc72] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:01.474051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f179046c-5be7-4943-a530-9b71168d833d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:01.475927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f179046c-5be7-4943-a530-9b71168d833d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:01.477937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f179046c-5be7-4943-a530-9b71168d833d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:01.478795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f179046c-5be7-4943-a530-9b71168d833d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:01.501803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:01.506530 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f179046c-5be7-4943-a530-9b71168d833d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] HTTP exception thrown: Instance b778f69c-31a5-4e80-ad4b-f9ab1250bc72 could not be found. Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f179046c-5be7-4943-a530-9b71168d833d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Request method failure captured: Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 HTTP/1.1 Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CtO-udl0jbsQLNeccGF_tylFUzLycr8FmZhc2mkFx3DxXeaXT62o-jr7BmGUHWu7CuFZeh0Vc_7-Z_zgoR5O0guc6x7FICNeG3u-0T2H6KdDncxv3cqgfkqqItqoMnDKvQLgsM9675XIjYCDEuZioMAl740UeX_PIE5bgKJYSzOJZk Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 857efc7b6be942fc9d5442d42f391cd0 Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerAddressesTestJSON-2077004440 Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/857efc7b6be942fc9d5442d42f391cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/857efc7b6be942fc9d5442d42f391cd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_857efc7b6be942fc9d5442d42f391cd0", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/857efc7b6be942fc9d5442d42f391cd0"}]}] Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerAddressesTestJSON-2077004440 Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 857efc7b6be942fc9d5442d42f391cd0 Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2077004440 Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerAddressesTestJSON-2077004440-project Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 22f095ab83f944b3a47e357784a6ad04 Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerAddressesTestJSON-2077004440-project Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance b778f69c-31a5-4e80-ad4b-f9ab1250bc72 could not be found. Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'b778f69c-31a5-4e80-ad4b-f9ab1250bc72'} Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b778f69c-31a5-4e80-ad4b-f9ab1250bc72 could not be found. Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b778f69c-31a5-4e80-ad4b-f9ab1250bc72 could not be found. Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:01.510015 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:43:01.514912 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:01.514912 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:01.514912 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:01.514912 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:01.514912 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:01.514912 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b778f69c-31a5-4e80-ad4b-f9ab1250bc72 could not be found. Jul 14 14:43:01.514912 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:43:01.539491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-30d1fa85-7687-43f8-8d0d-8370d9879b7b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:01.540678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-30d1fa85-7687-43f8-8d0d-8370d9879b7b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:01.552045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f179046c-5be7-4943-a530-9b71168d833d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] Returning 404 to user: Instance b778f69c-31a5-4e80-ad4b-f9ab1250bc72 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:01.555200 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f179046c-5be7-4943-a530-9b71168d833d tempest-ServerAddressesTestJSON-2077004440 tempest-ServerAddressesTestJSON-2077004440-project] 10.222.0.81 "GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72" status: 404 len: 111 microversion: 2.1 time: 0.107095 Jul 14 14:43:01.556594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:01.563947 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1629/3247] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:01 2022] GET /compute/v2.1/servers/b778f69c-31a5-4e80-ad4b-f9ab1250bc72 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:43:01.572769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30d1fa85-7687-43f8-8d0d-8370d9879b7b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:01.584188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30d1fa85-7687-43f8-8d0d-8370d9879b7b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:01.585115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30d1fa85-7687-43f8-8d0d-8370d9879b7b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:01.585581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30d1fa85-7687-43f8-8d0d-8370d9879b7b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:02.781728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-30d1fa85-7687-43f8-8d0d-8370d9879b7b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:02.819433 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-30d1fa85-7687-43f8-8d0d-8370d9879b7b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 1.283553 Jul 14 14:43:02.843963 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1619/3248] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:01 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:02.872060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4af002c9-161c-46fd-8441-d0b976aeac93 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:02.872766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4af002c9-161c-46fd-8441-d0b976aeac93 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:02.908082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4af002c9-161c-46fd-8441-d0b976aeac93 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:02.911159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4af002c9-161c-46fd-8441-d0b976aeac93 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:02.914097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4af002c9-161c-46fd-8441-d0b976aeac93 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:02.915986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4af002c9-161c-46fd-8441-d0b976aeac93 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:03.748484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4af002c9-161c-46fd-8441-d0b976aeac93 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:03.759373 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4af002c9-161c-46fd-8441-d0b976aeac93 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.900474 Jul 14 14:43:03.771223 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1630/3249] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:02 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:03.780441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1ca3df3-0fe8-4922-9869-d235c7c2bf60 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:03.781564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f1ca3df3-0fe8-4922-9869-d235c7c2bf60 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:03.819490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1ca3df3-0fe8-4922-9869-d235c7c2bf60 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:03.820116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1ca3df3-0fe8-4922-9869-d235c7c2bf60 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:03.820776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1ca3df3-0fe8-4922-9869-d235c7c2bf60 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:03.833124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1ca3df3-0fe8-4922-9869-d235c7c2bf60 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:04.313971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f1ca3df3-0fe8-4922-9869-d235c7c2bf60 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:04.328978 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f1ca3df3-0fe8-4922-9869-d235c7c2bf60 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.551772 Jul 14 14:43:04.330980 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1620/3250] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:03 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:04.349756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb771630-a18b-4159-ad7a-55db9824db4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:04.351652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bb771630-a18b-4159-ad7a-55db9824db4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:04.380231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb771630-a18b-4159-ad7a-55db9824db4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:04.380985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb771630-a18b-4159-ad7a-55db9824db4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:04.390013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb771630-a18b-4159-ad7a-55db9824db4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:04.390395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb771630-a18b-4159-ad7a-55db9824db4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:04.410461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-260037660", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:04.527453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] validate_networks() for [('615d6491-3181-44c2-a83d-36216d6c989f', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:43:04.797468 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bb771630-a18b-4159-ad7a-55db9824db4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.453227 Jul 14 14:43:04.805518 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1621/3251] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:43:04 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:43:04.854007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7a4428cc-d0d8-4340-b19b-93790bb87d34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:04.858266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7a4428cc-d0d8-4340-b19b-93790bb87d34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:04.883767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a4428cc-d0d8-4340-b19b-93790bb87d34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:04.885843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a4428cc-d0d8-4340-b19b-93790bb87d34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:04.889710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a4428cc-d0d8-4340-b19b-93790bb87d34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:04.890696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a4428cc-d0d8-4340-b19b-93790bb87d34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:07.621248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7a4428cc-d0d8-4340-b19b-93790bb87d34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:07.649578 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7a4428cc-d0d8-4340-b19b-93790bb87d34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1673 microversion: 2.1 time: 2.821444 Jul 14 14:43:07.663626 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1622/3252] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:04 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1673 bytes in 2857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:07.774637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:43:07.775294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:43:07.775987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:43:07.776589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:43:07.777384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:43:07.789067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:07.789862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:07.791572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:07.797891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:07.826449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Getting quotas for project b249f360cfda495fa5bcad6223474c17. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:07.834816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Getting quotas for user b845134b8fd14382b1c46ad78e5effa2 and project b249f360cfda495fa5bcad6223474c17. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:07.856766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:43:07.861268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:43:08.014888 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-253b51f1-63f9-40b1-8108-18011a65f82e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.098486 Jul 14 14:43:08.020525 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1631/3253] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:43:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 4106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:43:08.040361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-92038e7c-d80a-4b0f-a8ee-f2b188e4a7b2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:08.041638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-92038e7c-d80a-4b0f-a8ee-f2b188e4a7b2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:08.278589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-92038e7c-d80a-4b0f-a8ee-f2b188e4a7b2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:08.306776 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-92038e7c-d80a-4b0f-a8ee-f2b188e4a7b2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1213 microversion: 2.1 time: 0.272783 Jul 14 14:43:08.307418 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1623/3254] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:08 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1213 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:08.670109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6148ccc5-6cb1-4d6a-95f0-bb50892b7213 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:08.671145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6148ccc5-6cb1-4d6a-95f0-bb50892b7213 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:08.686456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6148ccc5-6cb1-4d6a-95f0-bb50892b7213 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:08.688694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6148ccc5-6cb1-4d6a-95f0-bb50892b7213 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:08.690482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6148ccc5-6cb1-4d6a-95f0-bb50892b7213 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:08.693511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6148ccc5-6cb1-4d6a-95f0-bb50892b7213 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:09.059455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6148ccc5-6cb1-4d6a-95f0-bb50892b7213 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:09.083892 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6148ccc5-6cb1-4d6a-95f0-bb50892b7213 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1673 microversion: 2.1 time: 0.417849 Jul 14 14:43:09.087878 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1632/3255] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:08 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1673 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:09.325124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-657a4d8e-a296-43f5-89eb-22faccadff63 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:09.326635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-657a4d8e-a296-43f5-89eb-22faccadff63 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:09.342878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-657a4d8e-a296-43f5-89eb-22faccadff63 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:09.348397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-657a4d8e-a296-43f5-89eb-22faccadff63 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:09.350857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-657a4d8e-a296-43f5-89eb-22faccadff63 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:09.351635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-657a4d8e-a296-43f5-89eb-22faccadff63 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:09.601207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-657a4d8e-a296-43f5-89eb-22faccadff63 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:09.611416 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-657a4d8e-a296-43f5-89eb-22faccadff63 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1217 microversion: 2.1 time: 0.290912 Jul 14 14:43:09.621144 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1624/3256] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:09 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1217 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:10.106332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a2e20b69-cbfd-41b0-af7b-a03880070d41 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:10.107001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a2e20b69-cbfd-41b0-af7b-a03880070d41 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:10.137220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2e20b69-cbfd-41b0-af7b-a03880070d41 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:10.137916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2e20b69-cbfd-41b0-af7b-a03880070d41 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:10.145271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2e20b69-cbfd-41b0-af7b-a03880070d41 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:10.147185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2e20b69-cbfd-41b0-af7b-a03880070d41 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:10.581362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a2e20b69-cbfd-41b0-af7b-a03880070d41 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:10.590068 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a2e20b69-cbfd-41b0-af7b-a03880070d41 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.488104 Jul 14 14:43:10.595202 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1633/3257] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:10 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:10.612504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6194e6a9-d222-4c56-9e1f-5969b3ed02e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:10.613774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6194e6a9-d222-4c56-9e1f-5969b3ed02e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:10.628207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6194e6a9-d222-4c56-9e1f-5969b3ed02e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:10.628669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6194e6a9-d222-4c56-9e1f-5969b3ed02e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:10.639503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a6c22e4e-b0d2-4532-b0a1-15b50f84b524 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:10.640161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a6c22e4e-b0d2-4532-b0a1-15b50f84b524 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:10.659637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6194e6a9-d222-4c56-9e1f-5969b3ed02e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:10.660116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6194e6a9-d222-4c56-9e1f-5969b3ed02e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:10.671100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6c22e4e-b0d2-4532-b0a1-15b50f84b524 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:10.678560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6c22e4e-b0d2-4532-b0a1-15b50f84b524 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:10.679431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6c22e4e-b0d2-4532-b0a1-15b50f84b524 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:10.686033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6c22e4e-b0d2-4532-b0a1-15b50f84b524 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:10.849540 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6194e6a9-d222-4c56-9e1f-5969b3ed02e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 200 len: 322 microversion: 2.1 time: 0.241529 Jul 14 14:43:10.850206 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1625/3258] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:43:10 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:10.868044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-56ec56d4-1f25-406f-862f-44a45b8055e1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:10.870775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-56ec56d4-1f25-406f-862f-44a45b8055e1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:10.890270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56ec56d4-1f25-406f-862f-44a45b8055e1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:10.893607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56ec56d4-1f25-406f-862f-44a45b8055e1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:10.897069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56ec56d4-1f25-406f-862f-44a45b8055e1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:10.906327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56ec56d4-1f25-406f-862f-44a45b8055e1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:10.959120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a6c22e4e-b0d2-4532-b0a1-15b50f84b524 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:10.976120 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a6c22e4e-b0d2-4532-b0a1-15b50f84b524 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1283 microversion: 2.1 time: 0.340295 Jul 14 14:43:10.976745 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1634/3259] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:10 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1283 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:11.341881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-56ec56d4-1f25-406f-862f-44a45b8055e1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:11.352163 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-56ec56d4-1f25-406f-862f-44a45b8055e1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.496032 Jul 14 14:43:11.362142 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1626/3260] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:10 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:11.379872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aae9a00a-9c33-4798-bbbc-da19f00e70e3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:11.380660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aae9a00a-9c33-4798-bbbc-da19f00e70e3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:11.392041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aae9a00a-9c33-4798-bbbc-da19f00e70e3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:11.402980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aae9a00a-9c33-4798-bbbc-da19f00e70e3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:11.404120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aae9a00a-9c33-4798-bbbc-da19f00e70e3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:11.404751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aae9a00a-9c33-4798-bbbc-da19f00e70e3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:11.802364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aae9a00a-9c33-4798-bbbc-da19f00e70e3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:11.819886 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aae9a00a-9c33-4798-bbbc-da19f00e70e3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.444408 Jul 14 14:43:11.820523 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1635/3261] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:11 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:11.844478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-06cdbc63-90c9-434a-83a1-a5d05fab0a1e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:11.845177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-06cdbc63-90c9-434a-83a1-a5d05fab0a1e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:11.855398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06cdbc63-90c9-434a-83a1-a5d05fab0a1e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:11.855863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06cdbc63-90c9-434a-83a1-a5d05fab0a1e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:11.856676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06cdbc63-90c9-434a-83a1-a5d05fab0a1e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:11.857164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06cdbc63-90c9-434a-83a1-a5d05fab0a1e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:11.995855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-82f4dab1-aff9-45fb-ba8f-d940173062fd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:11.996491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-82f4dab1-aff9-45fb-ba8f-d940173062fd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:12.008616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82f4dab1-aff9-45fb-ba8f-d940173062fd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:12.009177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82f4dab1-aff9-45fb-ba8f-d940173062fd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:12.016637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82f4dab1-aff9-45fb-ba8f-d940173062fd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:12.017172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82f4dab1-aff9-45fb-ba8f-d940173062fd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:12.324032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-82f4dab1-aff9-45fb-ba8f-d940173062fd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:12.330632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-06cdbc63-90c9-434a-83a1-a5d05fab0a1e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:12.339762 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-82f4dab1-aff9-45fb-ba8f-d940173062fd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1271 microversion: 2.1 time: 0.347130 Jul 14 14:43:12.341972 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-06cdbc63-90c9-434a-83a1-a5d05fab0a1e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.507401 Jul 14 14:43:12.343110 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1636/3262] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:11 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1271 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:12.345401 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1627/3263] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:11 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:12.382015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-74182b81-c574-40b1-8189-8e9d6bf9b75e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:12.383488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-74182b81-c574-40b1-8189-8e9d6bf9b75e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:12.391962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74182b81-c574-40b1-8189-8e9d6bf9b75e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:12.392728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74182b81-c574-40b1-8189-8e9d6bf9b75e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:12.394525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74182b81-c574-40b1-8189-8e9d6bf9b75e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:12.395222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74182b81-c574-40b1-8189-8e9d6bf9b75e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:12.824151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-74182b81-c574-40b1-8189-8e9d6bf9b75e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:12.842764 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-74182b81-c574-40b1-8189-8e9d6bf9b75e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.484590 Jul 14 14:43:12.855442 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1637/3264] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:12 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:13.165560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2123597016", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "05e588dd-ea85-4edc-9918-44620e736097"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:13.327427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] validate_networks() for [('05e588dd-ea85-4edc-9918-44620e736097', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:43:13.359663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-76b461b2-401c-413e-b36a-51416a09a339 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:13.360474 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-76b461b2-401c-413e-b36a-51416a09a339 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:13.372936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76b461b2-401c-413e-b36a-51416a09a339 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:13.374719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76b461b2-401c-413e-b36a-51416a09a339 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:13.375696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76b461b2-401c-413e-b36a-51416a09a339 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:13.379019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76b461b2-401c-413e-b36a-51416a09a339 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:14.274191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-76b461b2-401c-413e-b36a-51416a09a339 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:14.287891 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-76b461b2-401c-413e-b36a-51416a09a339 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1313 microversion: 2.1 time: 0.931433 Jul 14 14:43:14.289474 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1638/3265] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:13 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1313 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:14.888244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8af5e4de-4805-4540-81eb-85d9aa020519 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:14.890087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8af5e4de-4805-4540-81eb-85d9aa020519 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:14.900497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8af5e4de-4805-4540-81eb-85d9aa020519 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:14.901413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8af5e4de-4805-4540-81eb-85d9aa020519 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:14.902670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8af5e4de-4805-4540-81eb-85d9aa020519 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:14.904143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8af5e4de-4805-4540-81eb-85d9aa020519 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:14.946964 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8af5e4de-4805-4540-81eb-85d9aa020519 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062956 Jul 14 14:43:14.949013 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1639/3266] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:43:14 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 14:43:15.043160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-35b8e5b0-78cc-47b4-bae3-2ff7320ff9ea tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:15.046547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-35b8e5b0-78cc-47b4-bae3-2ff7320ff9ea tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:15.075619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-35b8e5b0-78cc-47b4-bae3-2ff7320ff9ea tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.076451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-35b8e5b0-78cc-47b4-bae3-2ff7320ff9ea tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.077988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-35b8e5b0-78cc-47b4-bae3-2ff7320ff9ea tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.078749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-35b8e5b0-78cc-47b4-bae3-2ff7320ff9ea tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.103373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:43:15.103373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:43:15.103373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:43:15.103373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:43:15.103373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:43:15.143763 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-35b8e5b0-78cc-47b4-bae3-2ff7320ff9ea tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107564 Jul 14 14:43:15.145992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.150864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.157716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.159155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.177352 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1640/3267] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:43:15 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 14:43:15.262232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3a36a911-8d82-4597-be81-11e9be1c8080 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:15.264262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3a36a911-8d82-4597-be81-11e9be1c8080 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:15.280739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a36a911-8d82-4597-be81-11e9be1c8080 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.282337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a36a911-8d82-4597-be81-11e9be1c8080 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.286239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a36a911-8d82-4597-be81-11e9be1c8080 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.287002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a36a911-8d82-4597-be81-11e9be1c8080 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.292897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Getting quotas for project 1933006fa13c44ae9128f00267210152. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:15.324689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Getting quotas for user f157150edd1d441aa2c7335dbb2363ca and project 1933006fa13c44ae9128f00267210152. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:15.353580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3a36a911-8d82-4597-be81-11e9be1c8080 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:43:15.410300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:43:15.426484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:43:15.531936 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3a36a911-8d82-4597-be81-11e9be1c8080 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "DELETE /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 204 len: 0 microversion: 2.1 time: 0.277105 Jul 14 14:43:15.536989 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1641/3268] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:43:15 2022] DELETE /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:43:15.550199 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-831d1cc5-4c5f-4bdb-9ae3-62a4383438dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.389117 Jul 14 14:43:15.551996 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1628/3269] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:43:15.565131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5c4f4ae0-894f-469b-8bfe-203d35974f7e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:15.571005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5c4f4ae0-894f-469b-8bfe-203d35974f7e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:15.584203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e9b255f8-b3eb-46c7-b5da-1f00926794e6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:15.585275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e9b255f8-b3eb-46c7-b5da-1f00926794e6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:15.589948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c4f4ae0-894f-469b-8bfe-203d35974f7e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.590732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c4f4ae0-894f-469b-8bfe-203d35974f7e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.592197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c4f4ae0-894f-469b-8bfe-203d35974f7e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.595403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c4f4ae0-894f-469b-8bfe-203d35974f7e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.603926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9b255f8-b3eb-46c7-b5da-1f00926794e6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.604712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9b255f8-b3eb-46c7-b5da-1f00926794e6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.606018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9b255f8-b3eb-46c7-b5da-1f00926794e6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.607376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9b255f8-b3eb-46c7-b5da-1f00926794e6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:16.348430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5c4f4ae0-894f-469b-8bfe-203d35974f7e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:16.365974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e9b255f8-b3eb-46c7-b5da-1f00926794e6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:16.380580 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e9b255f8-b3eb-46c7-b5da-1f00926794e6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1683 microversion: 2.1 time: 0.824248 Jul 14 14:43:16.382118 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1629/3270] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:15 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1683 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:16.391297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a82d978e-ec5e-4faa-aafd-c803ac285f32 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:16.392443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a82d978e-ec5e-4faa-aafd-c803ac285f32 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:16.396575 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5c4f4ae0-894f-469b-8bfe-203d35974f7e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1313 microversion: 2.1 time: 0.855929 Jul 14 14:43:16.397897 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1642/3271] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:15 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1313 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:16.524393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a82d978e-ec5e-4faa-aafd-c803ac285f32 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:16.561967 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a82d978e-ec5e-4faa-aafd-c803ac285f32 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1215 microversion: 2.1 time: 0.175472 Jul 14 14:43:16.574745 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1630/3272] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:16 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:17.399831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2f6d6ce3-c2e2-4e82-bfda-3286434c5135 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:17.401122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2f6d6ce3-c2e2-4e82-bfda-3286434c5135 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:17.403847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:17.427864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4a5723ea-f992-4246-9ed6-3ef9f98c1274 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:17.428530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f6d6ce3-c2e2-4e82-bfda-3286434c5135 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:17.428530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f6d6ce3-c2e2-4e82-bfda-3286434c5135 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:17.429139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f6d6ce3-c2e2-4e82-bfda-3286434c5135 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:17.429771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f6d6ce3-c2e2-4e82-bfda-3286434c5135 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:17.432281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4a5723ea-f992-4246-9ed6-3ef9f98c1274 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:17.452862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a5723ea-f992-4246-9ed6-3ef9f98c1274 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:17.459767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a5723ea-f992-4246-9ed6-3ef9f98c1274 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:17.461976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a5723ea-f992-4246-9ed6-3ef9f98c1274 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:17.466470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a5723ea-f992-4246-9ed6-3ef9f98c1274 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:17.760139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2f6d6ce3-c2e2-4e82-bfda-3286434c5135 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:17.783382 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2f6d6ce3-c2e2-4e82-bfda-3286434c5135 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1683 microversion: 2.1 time: 0.387082 Jul 14 14:43:17.785879 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1643/3273] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:17 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1683 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:17.804048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b0b5dd77-cd9d-48f9-a161-a490ed5209e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:17.815480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b0b5dd77-cd9d-48f9-a161-a490ed5209e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:17.825949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:17.851019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0b5dd77-cd9d-48f9-a161-a490ed5209e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:17.852225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0b5dd77-cd9d-48f9-a161-a490ed5209e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:17.855131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0b5dd77-cd9d-48f9-a161-a490ed5209e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:17.858256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0b5dd77-cd9d-48f9-a161-a490ed5209e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:17.859965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:17.910377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4a5723ea-f992-4246-9ed6-3ef9f98c1274 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:17.924429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4a5723ea-f992-4246-9ed6-3ef9f98c1274 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1313 microversion: 2.1 time: 0.502424 Jul 14 14:43:17.940242 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1631/3274] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:17 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:17.985182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b0b5dd77-cd9d-48f9-a161-a490ed5209e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:17.995012 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b0b5dd77-cd9d-48f9-a161-a490ed5209e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1267 microversion: 2.1 time: 0.204605 Jul 14 14:43:18.010325 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1644/3275] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:17 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:18.828927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-42e4af99-32e0-4aed-9e6e-f89c5ee45ba8 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:18.833111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-42e4af99-32e0-4aed-9e6e-f89c5ee45ba8 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:18.883841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42e4af99-32e0-4aed-9e6e-f89c5ee45ba8 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:18.887432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42e4af99-32e0-4aed-9e6e-f89c5ee45ba8 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:18.890957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42e4af99-32e0-4aed-9e6e-f89c5ee45ba8 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:18.893875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42e4af99-32e0-4aed-9e6e-f89c5ee45ba8 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:18.961463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-57310616-ee2f-44f6-8394-1d5745b171e7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:18.962525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-57310616-ee2f-44f6-8394-1d5745b171e7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:18.991520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57310616-ee2f-44f6-8394-1d5745b171e7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:18.992646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57310616-ee2f-44f6-8394-1d5745b171e7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:18.994294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57310616-ee2f-44f6-8394-1d5745b171e7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:18.997020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57310616-ee2f-44f6-8394-1d5745b171e7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:19.085707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:19.953992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-42e4af99-32e0-4aed-9e6e-f89c5ee45ba8 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:19.969799 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-42e4af99-32e0-4aed-9e6e-f89c5ee45ba8 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1683 microversion: 2.1 time: 1.170918 Jul 14 14:43:19.970883 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1632/3276] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:18 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1683 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:19.984763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e479a74-7b3a-4803-a3e2-5ea95df02f34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:19.985421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0e479a74-7b3a-4803-a3e2-5ea95df02f34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:19.999434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e479a74-7b3a-4803-a3e2-5ea95df02f34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:20.000310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e479a74-7b3a-4803-a3e2-5ea95df02f34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:20.001349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e479a74-7b3a-4803-a3e2-5ea95df02f34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:20.002685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e479a74-7b3a-4803-a3e2-5ea95df02f34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:20.208619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-57310616-ee2f-44f6-8394-1d5745b171e7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:20.222292 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-57310616-ee2f-44f6-8394-1d5745b171e7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1313 microversion: 2.1 time: 1.267831 Jul 14 14:43:20.223031 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1645/3277] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:18 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1313 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:20.265720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0e479a74-7b3a-4803-a3e2-5ea95df02f34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:20.276750 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0e479a74-7b3a-4803-a3e2-5ea95df02f34 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1273 microversion: 2.1 time: 0.304022 Jul 14 14:43:20.288925 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1633/3278] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:19 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1273 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:20.454847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-22d5e6ea-fe4b-4f49-a2c3-433c076a2841 req-988c595c-17e4-4d0d-a272-8815b194d07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a334338-1793-4d18-9c76-ffebb97a8983", "tag": "2ebaa6b5-5402-47de-b6da-92d432f2d61c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:20.475649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-22d5e6ea-fe4b-4f49-a2c3-433c076a2841 req-988c595c-17e4-4d0d-a272-8815b194d07c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:20.476319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-22d5e6ea-fe4b-4f49-a2c3-433c076a2841 req-988c595c-17e4-4d0d-a272-8815b194d07c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:20.498162 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-22d5e6ea-fe4b-4f49-a2c3-433c076a2841 req-988c595c-17e4-4d0d-a272-8815b194d07c service nova] Creating event network-changed:2ebaa6b5-5402-47de-b6da-92d432f2d61c for instance 9a334338-1793-4d18-9c76-ffebb97a8983 on n-h1-767704-28 Jul 14 14:43:20.505836 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-22d5e6ea-fe4b-4f49-a2c3-433c076a2841 req-988c595c-17e4-4d0d-a272-8815b194d07c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058005 Jul 14 14:43:20.507191 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1646/3279] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:43:21.008121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-48e1b2b6-5966-4551-bd51-044008ce383c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:21.009316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-48e1b2b6-5966-4551-bd51-044008ce383c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:21.045466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48e1b2b6-5966-4551-bd51-044008ce383c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:21.045957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48e1b2b6-5966-4551-bd51-044008ce383c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:21.048986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48e1b2b6-5966-4551-bd51-044008ce383c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:21.049934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48e1b2b6-5966-4551-bd51-044008ce383c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:21.246604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-acbd3d48-6987-4059-a306-fa0448623c0e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:21.250870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-acbd3d48-6987-4059-a306-fa0448623c0e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:21.265913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acbd3d48-6987-4059-a306-fa0448623c0e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:21.266620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acbd3d48-6987-4059-a306-fa0448623c0e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:21.268518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acbd3d48-6987-4059-a306-fa0448623c0e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:21.269406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acbd3d48-6987-4059-a306-fa0448623c0e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:21.293783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-48e1b2b6-5966-4551-bd51-044008ce383c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:21.311868 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-48e1b2b6-5966-4551-bd51-044008ce383c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1616 microversion: 2.1 time: 0.308098 Jul 14 14:43:21.326389 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1634/3280] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:20 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1616 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:21.337934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8671296e-ece5-4605-9edf-bc9abf89a28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:21.339692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8671296e-ece5-4605-9edf-bc9abf89a28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:21.353917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8671296e-ece5-4605-9edf-bc9abf89a28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:21.354496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8671296e-ece5-4605-9edf-bc9abf89a28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:21.356150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8671296e-ece5-4605-9edf-bc9abf89a28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:21.356673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8671296e-ece5-4605-9edf-bc9abf89a28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:22.532969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-acbd3d48-6987-4059-a306-fa0448623c0e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:22.568613 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-acbd3d48-6987-4059-a306-fa0448623c0e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1313 microversion: 2.1 time: 1.332674 Jul 14 14:43:22.569615 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1647/3281] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:21 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1313 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:22.586747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-784a262c-38cf-470f-9a22-03cdce02220a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:22.587863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-784a262c-38cf-470f-9a22-03cdce02220a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:22.603455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-784a262c-38cf-470f-9a22-03cdce02220a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:22.604467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-784a262c-38cf-470f-9a22-03cdce02220a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:22.605600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-784a262c-38cf-470f-9a22-03cdce02220a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:22.606061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-784a262c-38cf-470f-9a22-03cdce02220a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:22.943258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-784a262c-38cf-470f-9a22-03cdce02220a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbcfbd80adf4d67ba342133f5b2a946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd21ace546ee1440786c7ad443ef9f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:22.970394 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-784a262c-38cf-470f-9a22-03cdce02220a tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 200 len: 1616 microversion: 2.1 time: 0.398560 Jul 14 14:43:22.972303 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1648/3282] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:22 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 1616 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:22.989844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-7ba9ed25-744b-47a1-8499-95b0f9105cf4 req-52dc24ba-b9b1-48e5-ab3b-e802298bffa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541b73d3-64ab-41c0-89c8-2930dc27af78", "name": "network-vif-deleted", "tag": "4d97ea2e-c67b-4934-8bcd-ea2649569911"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:23.008315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7ba9ed25-744b-47a1-8499-95b0f9105cf4 req-52dc24ba-b9b1-48e5-ab3b-e802298bffa0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:23.009532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7ba9ed25-744b-47a1-8499-95b0f9105cf4 req-52dc24ba-b9b1-48e5-ab3b-e802298bffa0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:23.058749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8671296e-ece5-4605-9edf-bc9abf89a28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:23.070756 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-7ba9ed25-744b-47a1-8499-95b0f9105cf4 req-52dc24ba-b9b1-48e5-ab3b-e802298bffa0 service nova] Creating event network-vif-deleted:4d97ea2e-c67b-4934-8bcd-ea2649569911 for instance 541b73d3-64ab-41c0-89c8-2930dc27af78 on n-h2-767704-28 Jul 14 14:43:23.075673 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8671296e-ece5-4605-9edf-bc9abf89a28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1315 microversion: 2.1 time: 1.743591 Jul 14 14:43:23.077778 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1635/3283] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:21 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1315 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:23.089451 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-7ba9ed25-744b-47a1-8499-95b0f9105cf4 req-52dc24ba-b9b1-48e5-ab3b-e802298bffa0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114470 Jul 14 14:43:23.091111 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1649/3284] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:23.586482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8a43e8ce-f327-4ff1-b766-233a29c16598 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:23.587116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8a43e8ce-f327-4ff1-b766-233a29c16598 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:23.601979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a43e8ce-f327-4ff1-b766-233a29c16598 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:23.605793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a43e8ce-f327-4ff1-b766-233a29c16598 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:23.608193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a43e8ce-f327-4ff1-b766-233a29c16598 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:23.609233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a43e8ce-f327-4ff1-b766-233a29c16598 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:23.664474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:23.993690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c000b02e-6a21-4f52-bb3b-3562d756cde4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:23.995189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c000b02e-6a21-4f52-bb3b-3562d756cde4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:24.011314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c000b02e-6a21-4f52-bb3b-3562d756cde4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:24.011314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c000b02e-6a21-4f52-bb3b-3562d756cde4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:24.011724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c000b02e-6a21-4f52-bb3b-3562d756cde4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:24.012211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c000b02e-6a21-4f52-bb3b-3562d756cde4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:24.031637 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c000b02e-6a21-4f52-bb3b-3562d756cde4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] HTTP exception thrown: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c000b02e-6a21-4f52-bb3b-3562d756cde4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Request method failure captured: Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 HTTP/1.1 Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CqoPCIOt-gmU-0xWehqWLHh1pix_VdYDKemT_G2JSbInKN8l1oUWvYfnV-KiDSs-uDy9T-dL_-2NH-5bCcq4ipu6nGL57SFpaZYOCdI1Z0ZJ5og-8Eq6glf5VWOLTSW6tYqQisY1JszJuuPp46WbNHyNL6ztM06qK5SXs-eEVSNQdY Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d21ace546ee1440786c7ad443ef9f073 Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-502741774 Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d21ace546ee1440786c7ad443ef9f073"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d21ace546ee1440786c7ad443ef9f073"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d21ace546ee1440786c7ad443ef9f073", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d21ace546ee1440786c7ad443ef9f073"}]}] Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-502741774 Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d21ace546ee1440786c7ad443ef9f073 Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-502741774 Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachSCSIVolumeTestJSON-502741774-project Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: ccbcfbd80adf4d67ba342133f5b2a946 Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-502741774-project Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '541b73d3-64ab-41c0-89c8-2930dc27af78'} Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:24.034408 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:43:24.041195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:24.041195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:24.041195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:24.041195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:24.041195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:24.041195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:24.041195 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:43:24.043605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c000b02e-6a21-4f52-bb3b-3562d756cde4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Returning 404 to user: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:24.045060 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c000b02e-6a21-4f52-bb3b-3562d756cde4 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 404 len: 111 microversion: 2.1 time: 0.057571 Jul 14 14:43:24.053130 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1650/3285] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:23 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:43:24.069330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8681be9e-1bb1-4d74-ad09-2f9560f26dfd tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '.version_select at 0x7fd6c4696a60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:24.078741 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8681be9e-1bb1-4d74-ad09-2f9560f26dfd tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [dc42b563-e4b2-4de7-822e-cf9b03c28017] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 14:43:24.657484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8a43e8ce-f327-4ff1-b766-233a29c16598 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:24.689348 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8a43e8ce-f327-4ff1-b766-233a29c16598 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1313 microversion: 2.1 time: 1.107280 Jul 14 14:43:24.691506 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1636/3286] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:23 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1313 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:24.710405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6f11630e-419c-44ad-8e75-9b56ac21049b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:24.711288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6f11630e-419c-44ad-8e75-9b56ac21049b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:24.733619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f11630e-419c-44ad-8e75-9b56ac21049b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:24.734677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f11630e-419c-44ad-8e75-9b56ac21049b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:24.735731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f11630e-419c-44ad-8e75-9b56ac21049b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:24.736562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f11630e-419c-44ad-8e75-9b56ac21049b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.097967 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [None req-8681be9e-1bb1-4d74-ad09-2f9560f26dfd tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [dc42b563-e4b2-4de7-822e-cf9b03c28017] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 38438. Jul 14 14:43:25.134641 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8681be9e-1bb1-4d74-ad09-2f9560f26dfd tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079767053" status: 202 len: 0 microversion: 2.1 time: 1.078130 Jul 14 14:43:25.135618 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1651/3287] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 14:43:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079767053 => generated 0 bytes in 1080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:43:25.199747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:25.517300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6f11630e-419c-44ad-8e75-9b56ac21049b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:25.536636 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6f11630e-419c-44ad-8e75-9b56ac21049b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1315 microversion: 2.1 time: 0.840501 Jul 14 14:43:25.537305 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1637/3288] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:24 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:25.707464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-056a412b-d8e8-4d2e-8012-5c98183a3942 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:25.708188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-056a412b-d8e8-4d2e-8012-5c98183a3942 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:25.718020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-056a412b-d8e8-4d2e-8012-5c98183a3942 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:25.718559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-056a412b-d8e8-4d2e-8012-5c98183a3942 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.719270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-056a412b-d8e8-4d2e-8012-5c98183a3942 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:25.719715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-056a412b-d8e8-4d2e-8012-5c98183a3942 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:26.553942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=10 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:26.615275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-7a467346-65a9-4883-a09b-d326e232ff7c req-77d72252-9a58-4867-987a-9d38dd3d2ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121e8067-40e4-49a7-a760-22b98d0aa082", "tag": "38cd84ce-e6fe-4f97-994b-685ac4a8eb52"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:26.658068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7a467346-65a9-4883-a09b-d326e232ff7c req-77d72252-9a58-4867-987a-9d38dd3d2ea1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:26.660351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7a467346-65a9-4883-a09b-d326e232ff7c req-77d72252-9a58-4867-987a-9d38dd3d2ea1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:26.732510 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-7a467346-65a9-4883-a09b-d326e232ff7c req-77d72252-9a58-4867-987a-9d38dd3d2ea1 service nova] Creating event network-changed:38cd84ce-e6fe-4f97-994b-685ac4a8eb52 for instance 121e8067-40e4-49a7-a760-22b98d0aa082 on n-h2-767704-28 Jul 14 14:43:26.749044 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-7a467346-65a9-4883-a09b-d326e232ff7c req-77d72252-9a58-4867-987a-9d38dd3d2ea1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.563464 Jul 14 14:43:26.754775 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1638/3289] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:26.805279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ce41a3b4-c654-49d4-bd30-ea0b6546ee50 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:26.832388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ce41a3b4-c654-49d4-bd30-ea0b6546ee50 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:26.856668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce41a3b4-c654-49d4-bd30-ea0b6546ee50 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:26.859614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce41a3b4-c654-49d4-bd30-ea0b6546ee50 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:26.863626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce41a3b4-c654-49d4-bd30-ea0b6546ee50 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:26.864603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce41a3b4-c654-49d4-bd30-ea0b6546ee50 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:28.139505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-056a412b-d8e8-4d2e-8012-5c98183a3942 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:28.154199 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-056a412b-d8e8-4d2e-8012-5c98183a3942 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1313 microversion: 2.1 time: 2.450512 Jul 14 14:43:28.165127 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1652/3290] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:25 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1313 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:28.772923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ce41a3b4-c654-49d4-bd30-ea0b6546ee50 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:28.809631 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ce41a3b4-c654-49d4-bd30-ea0b6546ee50 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1315 microversion: 2.1 time: 2.038072 Jul 14 14:43:28.811097 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1639/3291] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:26 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1315 bytes in 2055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:29.107171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-30abdece-a3c0-4eb4-b8dc-beab5f0eb668 req-a4c9d98e-a2ba-4958-b2ba-bad947d72fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a334338-1793-4d18-9c76-ffebb97a8983", "name": "network-vif-plugged", "status": "completed", "tag": "2ebaa6b5-5402-47de-b6da-92d432f2d61c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:29.165681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-30abdece-a3c0-4eb4-b8dc-beab5f0eb668 req-a4c9d98e-a2ba-4958-b2ba-bad947d72fdb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:29.168312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-30abdece-a3c0-4eb4-b8dc-beab5f0eb668 req-a4c9d98e-a2ba-4958-b2ba-bad947d72fdb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:29.175060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f14c7e99-aa76-42a1-ba21-5e0257eef01f tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:29.180471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f14c7e99-aa76-42a1-ba21-5e0257eef01f tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:29.195269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f14c7e99-aa76-42a1-ba21-5e0257eef01f tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:29.200027 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-30abdece-a3c0-4eb4-b8dc-beab5f0eb668 req-a4c9d98e-a2ba-4958-b2ba-bad947d72fdb service nova] Creating event network-vif-plugged:2ebaa6b5-5402-47de-b6da-92d432f2d61c for instance 9a334338-1793-4d18-9c76-ffebb97a8983 on n-h1-767704-28 Jul 14 14:43:29.200820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f14c7e99-aa76-42a1-ba21-5e0257eef01f tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:29.201872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f14c7e99-aa76-42a1-ba21-5e0257eef01f tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:29.202438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f14c7e99-aa76-42a1-ba21-5e0257eef01f tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:29.216250 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-30abdece-a3c0-4eb4-b8dc-beab5f0eb668 req-a4c9d98e-a2ba-4958-b2ba-bad947d72fdb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118687 Jul 14 14:43:29.217002 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1653/3292] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:43:29.836770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9912a0ef-6982-48af-84c1-8cee4ac6261c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:29.845253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9912a0ef-6982-48af-84c1-8cee4ac6261c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:29.867953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9912a0ef-6982-48af-84c1-8cee4ac6261c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:29.869274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9912a0ef-6982-48af-84c1-8cee4ac6261c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:29.871938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9912a0ef-6982-48af-84c1-8cee4ac6261c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:29.873056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9912a0ef-6982-48af-84c1-8cee4ac6261c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:30.420048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f14c7e99-aa76-42a1-ba21-5e0257eef01f tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:30.466138 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f14c7e99-aa76-42a1-ba21-5e0257eef01f tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1313 microversion: 2.1 time: 1.294392 Jul 14 14:43:30.470069 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1640/3293] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:29 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1313 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:31.117286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9912a0ef-6982-48af-84c1-8cee4ac6261c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:31.151694 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9912a0ef-6982-48af-84c1-8cee4ac6261c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1315 microversion: 2.1 time: 1.321538 Jul 14 14:43:31.152693 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1654/3294] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:29 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1315 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:31.488410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6a8de1a2-f70a-4786-85be-084480d71536 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:31.490070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6a8de1a2-f70a-4786-85be-084480d71536 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:31.526637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a8de1a2-f70a-4786-85be-084480d71536 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:31.534281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a8de1a2-f70a-4786-85be-084480d71536 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:31.537015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a8de1a2-f70a-4786-85be-084480d71536 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:31.537804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a8de1a2-f70a-4786-85be-084480d71536 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:32.172563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-830f6571-85e5-4d0f-bde9-8dbd6f58e533 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:32.173491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-830f6571-85e5-4d0f-bde9-8dbd6f58e533 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:32.193694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-830f6571-85e5-4d0f-bde9-8dbd6f58e533 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:32.194152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-830f6571-85e5-4d0f-bde9-8dbd6f58e533 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:32.194960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-830f6571-85e5-4d0f-bde9-8dbd6f58e533 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:32.214195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-830f6571-85e5-4d0f-bde9-8dbd6f58e533 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:35.010045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6a8de1a2-f70a-4786-85be-084480d71536 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:35.024660 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6a8de1a2-f70a-4786-85be-084480d71536 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1498 microversion: 2.1 time: 3.541893 Jul 14 14:43:35.032161 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1641/3295] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:31 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1498 bytes in 3550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:35.055931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7045dc18-3f3f-47e6-af4f-fc244db6ea6e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:35.057001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7045dc18-3f3f-47e6-af4f-fc244db6ea6e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:35.066709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-830f6571-85e5-4d0f-bde9-8dbd6f58e533 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:35.085684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:35.094543 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-830f6571-85e5-4d0f-bde9-8dbd6f58e533 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1315 microversion: 2.1 time: 2.927545 Jul 14 14:43:35.097479 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1655/3296] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:32 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1315 bytes in 2931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:35.103276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7045dc18-3f3f-47e6-af4f-fc244db6ea6e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:35.105224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7045dc18-3f3f-47e6-af4f-fc244db6ea6e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:35.106182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7045dc18-3f3f-47e6-af4f-fc244db6ea6e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:35.106649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7045dc18-3f3f-47e6-af4f-fc244db6ea6e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:35.191749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-7045dc18-3f3f-47e6-af4f-fc244db6ea6e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lazy-loading 'flavor' on Instance uuid 9a334338-1793-4d18-9c76-ffebb97a8983 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:43:35.420768 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7045dc18-3f3f-47e6-af4f-fc244db6ea6e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "POST /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983/action" status: 200 len: 32 microversion: 2.1 time: 0.379441 Jul 14 14:43:35.429217 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1642/3297] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:43:35 2022] POST /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983/action => generated 32 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:43:35.443601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f37db5d9-c44c-4654-8ddd-ea583e0b96c0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:35.446714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f37db5d9-c44c-4654-8ddd-ea583e0b96c0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:35.489327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f37db5d9-c44c-4654-8ddd-ea583e0b96c0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:35.504159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f37db5d9-c44c-4654-8ddd-ea583e0b96c0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:35.505122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f37db5d9-c44c-4654-8ddd-ea583e0b96c0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:35.505585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f37db5d9-c44c-4654-8ddd-ea583e0b96c0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:36.014834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f37db5d9-c44c-4654-8ddd-ea583e0b96c0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:36.030171 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f37db5d9-c44c-4654-8ddd-ea583e0b96c0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 0.600660 Jul 14 14:43:36.031448 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1656/3298] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:35 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:36.134214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c3af8ff3-6c9b-45dc-89c9-36bc4a787b36 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:36.135687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c3af8ff3-6c9b-45dc-89c9-36bc4a787b36 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:36.177456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3af8ff3-6c9b-45dc-89c9-36bc4a787b36 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:36.180810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3af8ff3-6c9b-45dc-89c9-36bc4a787b36 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:36.183022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3af8ff3-6c9b-45dc-89c9-36bc4a787b36 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:36.185864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3af8ff3-6c9b-45dc-89c9-36bc4a787b36 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:36.917891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c3af8ff3-6c9b-45dc-89c9-36bc4a787b36 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:36.926640 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c3af8ff3-6c9b-45dc-89c9-36bc4a787b36 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1315 microversion: 2.1 time: 0.805175 Jul 14 14:43:36.938634 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1643/3299] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:36 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:37.066381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6961c55e-92de-4083-b754-8076c264a497 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:37.067088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6961c55e-92de-4083-b754-8076c264a497 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:37.085204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6961c55e-92de-4083-b754-8076c264a497 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:37.085788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6961c55e-92de-4083-b754-8076c264a497 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:37.086664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6961c55e-92de-4083-b754-8076c264a497 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:37.087122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6961c55e-92de-4083-b754-8076c264a497 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:37.860072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6331785e-3a3d-4f97-b5e0-d07b52f93d1c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:37.860636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6331785e-3a3d-4f97-b5e0-d07b52f93d1c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:37.874097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6331785e-3a3d-4f97-b5e0-d07b52f93d1c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:37.881811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6331785e-3a3d-4f97-b5e0-d07b52f93d1c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:37.882706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6331785e-3a3d-4f97-b5e0-d07b52f93d1c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:37.883171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6331785e-3a3d-4f97-b5e0-d07b52f93d1c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:37.931126 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-6331785e-3a3d-4f97-b5e0-d07b52f93d1c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] HTTP exception thrown: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6331785e-3a3d-4f97-b5e0-d07b52f93d1c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Request method failure captured: Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 HTTP/1.1 Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CqoPCIOt-gmU-0xWehqWLHh1pix_VdYDKemT_G2JSbInKN8l1oUWvYfnV-KiDSs-uDy9T-dL_-2NH-5bCcq4ipu6nGL57SFpaZYOCdI1Z0ZJ5og-8Eq6glf5VWOLTSW6tYqQisY1JszJuuPp46WbNHyNL6ztM06qK5SXs-eEVSNQdY Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d21ace546ee1440786c7ad443ef9f073 Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-502741774 Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d21ace546ee1440786c7ad443ef9f073"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d21ace546ee1440786c7ad443ef9f073"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d21ace546ee1440786c7ad443ef9f073", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d21ace546ee1440786c7ad443ef9f073"}]}] Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-502741774 Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d21ace546ee1440786c7ad443ef9f073 Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-502741774 Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachSCSIVolumeTestJSON-502741774-project Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: ccbcfbd80adf4d67ba342133f5b2a946 Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-502741774-project Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '541b73d3-64ab-41c0-89c8-2930dc27af78'} Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:43:37.932964 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6331785e-3a3d-4f97-b5e0-d07b52f93d1c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Returning 404 to user: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:37.938325 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6331785e-3a3d-4f97-b5e0-d07b52f93d1c tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "DELETE /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 404 len: 111 microversion: 2.1 time: 0.079812 Jul 14 14:43:37.946070 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1644/3300] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:43:37 2022] DELETE /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:43:37.951908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8b4dd6a-b879-4916-8038-a743083f73d6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:37.952555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8b4dd6a-b879-4916-8038-a743083f73d6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] [instance: 541b73d3-64ab-41c0-89c8-2930dc27af78] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:37.972241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8b4dd6a-b879-4916-8038-a743083f73d6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:37.973549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8b4dd6a-b879-4916-8038-a743083f73d6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:37.974906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8b4dd6a-b879-4916-8038-a743083f73d6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:37.975562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8b4dd6a-b879-4916-8038-a743083f73d6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:38.023030 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-f8b4dd6a-b879-4916-8038-a743083f73d6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] HTTP exception thrown: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8b4dd6a-b879-4916-8038-a743083f73d6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Request method failure captured: Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 HTTP/1.1 Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CqoPCIOt-gmU-0xWehqWLHh1pix_VdYDKemT_G2JSbInKN8l1oUWvYfnV-KiDSs-uDy9T-dL_-2NH-5bCcq4ipu6nGL57SFpaZYOCdI1Z0ZJ5og-8Eq6glf5VWOLTSW6tYqQisY1JszJuuPp46WbNHyNL6ztM06qK5SXs-eEVSNQdY Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d21ace546ee1440786c7ad443ef9f073 Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-502741774 Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d21ace546ee1440786c7ad443ef9f073"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d21ace546ee1440786c7ad443ef9f073"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d21ace546ee1440786c7ad443ef9f073", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d21ace546ee1440786c7ad443ef9f073"}]}] Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-502741774 Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d21ace546ee1440786c7ad443ef9f073 Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-502741774 Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachSCSIVolumeTestJSON-502741774-project Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: ccbcfbd80adf4d67ba342133f5b2a946 Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-502741774-project Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '541b73d3-64ab-41c0-89c8-2930dc27af78'} Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:38.024737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:43:38.031612 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:38.031612 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:38.031612 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:38.031612 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:38.031612 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:38.031612 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. Jul 14 14:43:38.031612 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:43:38.031612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8b4dd6a-b879-4916-8038-a743083f73d6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] Returning 404 to user: Instance 541b73d3-64ab-41c0-89c8-2930dc27af78 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:38.031612 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8b4dd6a-b879-4916-8038-a743083f73d6 tempest-AttachSCSIVolumeTestJSON-502741774 tempest-AttachSCSIVolumeTestJSON-502741774-project] 10.222.0.81 "GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78" status: 404 len: 111 microversion: 2.1 time: 0.079080 Jul 14 14:43:38.031612 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1645/3301] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:37 2022] GET /compute/v2.1/servers/541b73d3-64ab-41c0-89c8-2930dc27af78 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:43:38.038882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ae778616-8964-453f-8b05-86efbe3ec7fc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:38.039513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ae778616-8964-453f-8b05-86efbe3ec7fc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:38.066924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6961c55e-92de-4083-b754-8076c264a497 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:38.107226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae778616-8964-453f-8b05-86efbe3ec7fc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:38.108225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae778616-8964-453f-8b05-86efbe3ec7fc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:38.119781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae778616-8964-453f-8b05-86efbe3ec7fc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:38.122085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae778616-8964-453f-8b05-86efbe3ec7fc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:38.129916 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6961c55e-92de-4083-b754-8076c264a497 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 1.082000 Jul 14 14:43:38.130535 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1657/3302] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:37 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:39.473209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1490325208", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:39.571814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] validate_networks() for [('2269736e-ca28-48a4-8f12-df659c6b1651', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:43:39.918123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ae778616-8964-453f-8b05-86efbe3ec7fc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:39.940440 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ae778616-8964-453f-8b05-86efbe3ec7fc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1315 microversion: 2.1 time: 1.908421 Jul 14 14:43:39.957001 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1646/3303] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:38 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1315 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:39.957001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-23fbc4ff-0044-4b88-a869-b97b28371025 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:39.957001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-23fbc4ff-0044-4b88-a869-b97b28371025 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:39.972743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23fbc4ff-0044-4b88-a869-b97b28371025 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:39.974920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23fbc4ff-0044-4b88-a869-b97b28371025 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:39.976126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23fbc4ff-0044-4b88-a869-b97b28371025 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:39.988214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23fbc4ff-0044-4b88-a869-b97b28371025 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:41.016736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-23fbc4ff-0044-4b88-a869-b97b28371025 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:41.032326 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-23fbc4ff-0044-4b88-a869-b97b28371025 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 1.089330 Jul 14 14:43:41.034166 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1647/3304] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:39 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:41.041760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2df2843f-208f-4191-8671-3ca04d0a2375 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Action: 'create', calling method: .version_select at 0x7fd6c5881d30>, body: {"keypair": {"name": "tempest-keypair-183356282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXah8/B9g4hzw84jkF1mzjuqM2t7eCOROS4xeAy2oCiE27XyeySmWTnzYd6edjLcOXzyvlxnhaJPXvYUFRRVpZdWtbueo5Pzwlqvjjifgq/CMrXPU/x407LcMga3M1D4w=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:41.063370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2df2843f-208f-4191-8671-3ca04d0a2375 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Getting quotas for project 2821fd7634094e7ea51fbfe49987597b. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:41.076867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2df2843f-208f-4191-8671-3ca04d0a2375 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Getting quotas for user a152e24f38fd45ce87c92fb73581ec93 and project 2821fd7634094e7ea51fbfe49987597b. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:41.122859 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2df2843f-208f-4191-8671-3ca04d0a2375 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.086284 Jul 14 14:43:41.132321 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1648/3305] 10.222.0.81 () {62 vars in 1199 bytes} [Thu Jul 14 14:43:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:43:41.142745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-cde3f293-87c5-4e32-bdd3-4857fee29b35 req-74b425f4-bbfd-413e-871f-1b845f7c15ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121e8067-40e4-49a7-a760-22b98d0aa082", "name": "network-vif-plugged", "status": "completed", "tag": "38cd84ce-e6fe-4f97-994b-685ac4a8eb52"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:41.159429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-cde3f293-87c5-4e32-bdd3-4857fee29b35 req-74b425f4-bbfd-413e-871f-1b845f7c15ec service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:41.161938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-cde3f293-87c5-4e32-bdd3-4857fee29b35 req-74b425f4-bbfd-413e-871f-1b845f7c15ec service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:41.223303 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-cde3f293-87c5-4e32-bdd3-4857fee29b35 req-74b425f4-bbfd-413e-871f-1b845f7c15ec service nova] Creating event network-vif-plugged:38cd84ce-e6fe-4f97-994b-685ac4a8eb52 for instance 121e8067-40e4-49a7-a760-22b98d0aa082 on n-h2-767704-28 Jul 14 14:43:41.239867 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-cde3f293-87c5-4e32-bdd3-4857fee29b35 req-74b425f4-bbfd-413e-871f-1b845f7c15ec service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105734 Jul 14 14:43:41.240511 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1649/3306] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:41.260228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-89a4b541-6fb0-43b8-abda-e6122639e0b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:41.265207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-89a4b541-6fb0-43b8-abda-e6122639e0b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:41.287611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-89a4b541-6fb0-43b8-abda-e6122639e0b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:41.288085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-89a4b541-6fb0-43b8-abda-e6122639e0b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:41.292091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-89a4b541-6fb0-43b8-abda-e6122639e0b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:41.292716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-89a4b541-6fb0-43b8-abda-e6122639e0b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.555725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-89a4b541-6fb0-43b8-abda-e6122639e0b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:42.571936 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-89a4b541-6fb0-43b8-abda-e6122639e0b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1315 microversion: 2.1 time: 1.325674 Jul 14 14:43:42.582514 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1650/3307] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:41 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1315 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:42.596226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8ef637f9-af71-4036-9ef2-610b86654dcd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:42.597132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8ef637f9-af71-4036-9ef2-610b86654dcd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:42.604382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ef637f9-af71-4036-9ef2-610b86654dcd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.605047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ef637f9-af71-4036-9ef2-610b86654dcd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.606139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ef637f9-af71-4036-9ef2-610b86654dcd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.606711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ef637f9-af71-4036-9ef2-610b86654dcd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.537289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:43:43.538034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:43:43.538372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:43:43.540060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:43:43.540718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:43:43.570380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.573948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.575023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.577010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.630098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Getting quotas for project 7e9f01277aa24f0fbe464ff8a5378d64. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:43.637492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Getting quotas for user 377b67baeabd4588a1945effc9b19113 and project 7e9f01277aa24f0fbe464ff8a5378d64. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:43.658908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:43:43.663051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:43:43.745665 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-48a1641e-a14d-48e7-8731-738fc900b55e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.618886 Jul 14 14:43:43.755118 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1658/3308] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:43:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 4622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:43:43.756180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8e72c06e-d2ee-4da4-b03f-5d1903a6ab35 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:43.757058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8e72c06e-d2ee-4da4-b03f-5d1903a6ab35 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:43.773088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e72c06e-d2ee-4da4-b03f-5d1903a6ab35 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.773735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e72c06e-d2ee-4da4-b03f-5d1903a6ab35 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.774547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e72c06e-d2ee-4da4-b03f-5d1903a6ab35 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.775345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e72c06e-d2ee-4da4-b03f-5d1903a6ab35 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:44.057150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8ef637f9-af71-4036-9ef2-610b86654dcd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:44.106143 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8ef637f9-af71-4036-9ef2-610b86654dcd tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 1.521940 Jul 14 14:43:44.119886 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1651/3309] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:42 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:44.123569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cf3ffda9-a7d2-4a5d-8542-80dc91894d01 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:44.129770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cf3ffda9-a7d2-4a5d-8542-80dc91894d01 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:44.401360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cf3ffda9-a7d2-4a5d-8542-80dc91894d01 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:44.425262 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cf3ffda9-a7d2-4a5d-8542-80dc91894d01 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1222 microversion: 2.1 time: 0.315576 Jul 14 14:43:44.426747 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1652/3310] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:44 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1222 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:44.598955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-779773339", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:44.703728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8e72c06e-d2ee-4da4-b03f-5d1903a6ab35 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:44.713413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] validate_networks() for [('2269736e-ca28-48a4-8f12-df659c6b1651', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:43:44.715299 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8e72c06e-d2ee-4da4-b03f-5d1903a6ab35 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1503 microversion: 2.1 time: 0.966681 Jul 14 14:43:44.735235 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1659/3311] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:43 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1503 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:44.753654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-906394268", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "31de3e15-e62f-4518-8b37-19c7fb8328ee"}, {"port": "4d42836a-fc38-4944-9647-fb492b209832", "tag": "port-1"}, {"port": "e724799c-54b2-4910-bf13-c3ceedda7f4a", "tag": "port-2"}, {"uuid": "5ea4471c-6922-4633-bb00-668d25e036c5", "tag": "net-1"}, {"uuid": "5ea4471c-6922-4633-bb00-668d25e036c5"}, {"uuid": "98c87806-52d2-49aa-b47f-aa870f36125d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "98c87806-52d2-49aa-b47f-aa870f36125d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "42568704-cce3-4630-a930-b42ca15c8950", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "19089578-c4ba-430b-83dd-6ec45006542e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fbe6f359-35dd-4c8a-9ede-acf5c85fabce", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--299967314"}], "key_name": "tempest-keypair-183356282", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:45.080906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] validate_networks() for [('31de3e15-e62f-4518-8b37-19c7fb8328ee', None, None, None, None, None), (None, None, '4d42836a-fc38-4944-9647-fb492b209832', None, None, None), (None, None, 'e724799c-54b2-4910-bf13-c3ceedda7f4a', None, None, None), ('5ea4471c-6922-4633-bb00-668d25e036c5', None, None, None, None, None), ('5ea4471c-6922-4633-bb00-668d25e036c5', None, None, None, None, None), ('98c87806-52d2-49aa-b47f-aa870f36125d', '10.2.2.100', None, None, None, None), ('98c87806-52d2-49aa-b47f-aa870f36125d', '10.2.2.200', None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:43:46.888137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:43:46.888607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:43:46.889120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:43:46.889531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:43:46.889946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:43:46.901111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:46.901679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:46.902364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:46.902810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:46.928414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Getting quotas for project 7e9f01277aa24f0fbe464ff8a5378d64. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:46.939317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Getting quotas for user 377b67baeabd4588a1945effc9b19113 and project 7e9f01277aa24f0fbe464ff8a5378d64. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:46.956450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:43:46.966101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:43:47.030724 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ab94dcae-7ea4-473b-8af1-fec77a0bd7fb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.442593 Jul 14 14:43:47.031409 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1653/3312] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:43:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:43:47.038124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-265cf58b-dc39-495e-9b17-2e620061abf8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:47.051253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-265cf58b-dc39-495e-9b17-2e620061abf8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:47.052015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-265cf58b-dc39-495e-9b17-2e620061abf8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:47.082372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-265cf58b-dc39-495e-9b17-2e620061abf8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Going to try to stop instance {{(pid=119512) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:43:47.147835 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-265cf58b-dc39-495e-9b17-2e620061abf8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082/action" status: 202 len: 0 microversion: 2.1 time: 0.114036 Jul 14 14:43:47.150422 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1654/3313] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:43:47 2022] POST /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:43:47.158938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0f273f90-4fe3-46e0-9529-449ced601acc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:47.160243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0f273f90-4fe3-46e0-9529-449ced601acc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:47.179177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f273f90-4fe3-46e0-9529-449ced601acc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:47.179990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f273f90-4fe3-46e0-9529-449ced601acc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:47.181238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f273f90-4fe3-46e0-9529-449ced601acc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:47.182088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0f273f90-4fe3-46e0-9529-449ced601acc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:47.209123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:47.779194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0f273f90-4fe3-46e0-9529-449ced601acc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:47.790037 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0f273f90-4fe3-46e0-9529-449ced601acc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 0.637094 Jul 14 14:43:47.790750 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1655/3314] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:47 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:47.796261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-14dda872-b83a-4753-a160-b6b6448320f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:47.797287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-14dda872-b83a-4753-a160-b6b6448320f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:47.805535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14dda872-b83a-4753-a160-b6b6448320f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:47.806095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14dda872-b83a-4753-a160-b6b6448320f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:47.806980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14dda872-b83a-4753-a160-b6b6448320f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:47.807502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14dda872-b83a-4753-a160-b6b6448320f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:48.352176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-14dda872-b83a-4753-a160-b6b6448320f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:48.367741 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-14dda872-b83a-4753-a160-b6b6448320f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1273 microversion: 2.1 time: 0.575870 Jul 14 14:43:48.386578 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1656/3315] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:47 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1273 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:48.386578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b32adbcd-3fdf-4892-bd2a-5cb4bdeb4cd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:48.386578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b32adbcd-3fdf-4892-bd2a-5cb4bdeb4cd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:48.393960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b32adbcd-3fdf-4892-bd2a-5cb4bdeb4cd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:48.394290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b32adbcd-3fdf-4892-bd2a-5cb4bdeb4cd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:48.395026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b32adbcd-3fdf-4892-bd2a-5cb4bdeb4cd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:48.395474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b32adbcd-3fdf-4892-bd2a-5cb4bdeb4cd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:48.991819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b32adbcd-3fdf-4892-bd2a-5cb4bdeb4cd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:49.017022 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b32adbcd-3fdf-4892-bd2a-5cb4bdeb4cd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.646667 Jul 14 14:43:49.028465 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1657/3316] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:48 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:49.044218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2ecfd364-8da4-47aa-8d64-6c2fbb253c27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:49.045467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2ecfd364-8da4-47aa-8d64-6c2fbb253c27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:49.060681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ecfd364-8da4-47aa-8d64-6c2fbb253c27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:49.061977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ecfd364-8da4-47aa-8d64-6c2fbb253c27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:49.063525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ecfd364-8da4-47aa-8d64-6c2fbb253c27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:49.064789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ecfd364-8da4-47aa-8d64-6c2fbb253c27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:49.652813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2ecfd364-8da4-47aa-8d64-6c2fbb253c27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:49.669156 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2ecfd364-8da4-47aa-8d64-6c2fbb253c27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 0.637064 Jul 14 14:43:49.685262 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1658/3317] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:49 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:49.701932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ae756cb9-2d50-440c-926e-233194ead0d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:49.706426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ae756cb9-2d50-440c-926e-233194ead0d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:49.723148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae756cb9-2d50-440c-926e-233194ead0d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:49.723528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae756cb9-2d50-440c-926e-233194ead0d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:49.731078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae756cb9-2d50-440c-926e-233194ead0d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:49.731972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae756cb9-2d50-440c-926e-233194ead0d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.108642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ae756cb9-2d50-440c-926e-233194ead0d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:50.139767 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ae756cb9-2d50-440c-926e-233194ead0d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1279 microversion: 2.1 time: 0.452918 Jul 14 14:43:50.143218 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1659/3318] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:49 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1279 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:50.152912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f5290f49-e496-4f80-ae83-c3ef7a2d5f89 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:50.154574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f5290f49-e496-4f80-ae83-c3ef7a2d5f89 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:50.179799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5290f49-e496-4f80-ae83-c3ef7a2d5f89 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.186861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5290f49-e496-4f80-ae83-c3ef7a2d5f89 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.190420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5290f49-e496-4f80-ae83-c3ef7a2d5f89 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.191801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5290f49-e496-4f80-ae83-c3ef7a2d5f89 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.779747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f5290f49-e496-4f80-ae83-c3ef7a2d5f89 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:50.794471 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f5290f49-e496-4f80-ae83-c3ef7a2d5f89 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.649298 Jul 14 14:43:50.806139 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1660/3319] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:50 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:50.815697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c3e70d7f-8b02-4e00-baba-6cd8c1d2c723 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:50.816769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c3e70d7f-8b02-4e00-baba-6cd8c1d2c723 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:50.827623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3e70d7f-8b02-4e00-baba-6cd8c1d2c723 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.828095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3e70d7f-8b02-4e00-baba-6cd8c1d2c723 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.829090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3e70d7f-8b02-4e00-baba-6cd8c1d2c723 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.829548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3e70d7f-8b02-4e00-baba-6cd8c1d2c723 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:51.730238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c3e70d7f-8b02-4e00-baba-6cd8c1d2c723 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:51.740743 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c3e70d7f-8b02-4e00-baba-6cd8c1d2c723 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 0.931652 Jul 14 14:43:51.755376 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1661/3320] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:50 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:51.755376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-212dd84d-0ccf-4c7f-b2b5-231faeda93fd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:51.755376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-212dd84d-0ccf-4c7f-b2b5-231faeda93fd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:51.774795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-212dd84d-0ccf-4c7f-b2b5-231faeda93fd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:51.775282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-212dd84d-0ccf-4c7f-b2b5-231faeda93fd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:51.776105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-212dd84d-0ccf-4c7f-b2b5-231faeda93fd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:51.776554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-212dd84d-0ccf-4c7f-b2b5-231faeda93fd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:52.865372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-212dd84d-0ccf-4c7f-b2b5-231faeda93fd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:52.879194 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-212dd84d-0ccf-4c7f-b2b5-231faeda93fd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1321 microversion: 2.1 time: 1.135318 Jul 14 14:43:52.883391 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1662/3321] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:51 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1321 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:52.888501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-02b7f69a-a2fc-4cc5-94fb-f3cf2ff19c13 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:52.890444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-02b7f69a-a2fc-4cc5-94fb-f3cf2ff19c13 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:52.907501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02b7f69a-a2fc-4cc5-94fb-f3cf2ff19c13 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:52.909565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02b7f69a-a2fc-4cc5-94fb-f3cf2ff19c13 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:52.910653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02b7f69a-a2fc-4cc5-94fb-f3cf2ff19c13 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:52.911289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02b7f69a-a2fc-4cc5-94fb-f3cf2ff19c13 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:53.499078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-02b7f69a-a2fc-4cc5-94fb-f3cf2ff19c13 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:53.523113 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-02b7f69a-a2fc-4cc5-94fb-f3cf2ff19c13 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.638433 Jul 14 14:43:53.535598 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1663/3322] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:52 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:53.535598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f798fb39-2048-4bf4-989d-197cb19dc9c5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:53.535598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f798fb39-2048-4bf4-989d-197cb19dc9c5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:53.547586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f798fb39-2048-4bf4-989d-197cb19dc9c5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:53.549260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f798fb39-2048-4bf4-989d-197cb19dc9c5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:53.550405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f798fb39-2048-4bf4-989d-197cb19dc9c5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:53.551468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f798fb39-2048-4bf4-989d-197cb19dc9c5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:53.614700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:53.650177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:54.287013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f798fb39-2048-4bf4-989d-197cb19dc9c5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:54.297223 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f798fb39-2048-4bf4-989d-197cb19dc9c5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 0.771213 Jul 14 14:43:54.318084 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1664/3323] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:53 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:54.340509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4f527a45-4b30-4fad-ace4-6697c7e3d74c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:54.362950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4f527a45-4b30-4fad-ace4-6697c7e3d74c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:54.427454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f527a45-4b30-4fad-ace4-6697c7e3d74c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:54.427925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f527a45-4b30-4fad-ace4-6697c7e3d74c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:54.428747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f527a45-4b30-4fad-ace4-6697c7e3d74c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:54.429240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f527a45-4b30-4fad-ace4-6697c7e3d74c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:54.708362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=60 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:55.352592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4f527a45-4b30-4fad-ace4-6697c7e3d74c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:55.373423 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4f527a45-4b30-4fad-ace4-6697c7e3d74c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1321 microversion: 2.1 time: 1.053208 Jul 14 14:43:55.374066 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1665/3324] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:54 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1321 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:55.380281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0f14d2b0-66f3-4d28-a15e-55f08a447236 req-2e3fb602-c82a-4ce8-b1b1-64f103f1672d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91067647-7704-49c5-a1c2-efcfe1474e01", "tag": "8f48bd43-add0-4af7-8116-106406af3cf8"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:55.415512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0f14d2b0-66f3-4d28-a15e-55f08a447236 req-2e3fb602-c82a-4ce8-b1b1-64f103f1672d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:55.415932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0f14d2b0-66f3-4d28-a15e-55f08a447236 req-2e3fb602-c82a-4ce8-b1b1-64f103f1672d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:55.434716 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0f14d2b0-66f3-4d28-a15e-55f08a447236 req-2e3fb602-c82a-4ce8-b1b1-64f103f1672d service nova] Creating event network-changed:8f48bd43-add0-4af7-8116-106406af3cf8 for instance 91067647-7704-49c5-a1c2-efcfe1474e01 on n-h1-767704-28 Jul 14 14:43:55.443296 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0f14d2b0-66f3-4d28-a15e-55f08a447236 req-2e3fb602-c82a-4ce8-b1b1-64f103f1672d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067783 Jul 14 14:43:55.445047 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1666/3325] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:55.463096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-56ab8a78-aacb-451c-917d-4f858302376f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:55.463096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-56ab8a78-aacb-451c-917d-4f858302376f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:55.482010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56ab8a78-aacb-451c-917d-4f858302376f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:55.482625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56ab8a78-aacb-451c-917d-4f858302376f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:55.483846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56ab8a78-aacb-451c-917d-4f858302376f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:55.484407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56ab8a78-aacb-451c-917d-4f858302376f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:55.701829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:43:55.702594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:43:55.703266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:43:55.703945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:43:55.704556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:43:55.707804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:55.717267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:55.718600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:55.720018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:55.720777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:55.746241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Getting quotas for project 2821fd7634094e7ea51fbfe49987597b. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:55.754826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Getting quotas for user a152e24f38fd45ce87c92fb73581ec93 and project 2821fd7634094e7ea51fbfe49987597b. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:55.981852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:43:55.986430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='42568704-cce3-4630-a930-b42ca15c8950',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='19089578-c4ba-430b-83dd-6ec45006542e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbe6f359-35dd-4c8a-9ede-acf5c85fabce',volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:43:56.373428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-56ab8a78-aacb-451c-917d-4f858302376f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:56.393803 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-56ab8a78-aacb-451c-917d-4f858302376f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.943177 Jul 14 14:43:56.394529 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1667/3326] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:55 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:56.415126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e9e92319-6aa8-4dcf-809b-3b93557d9fd1 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:56.417968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e9e92319-6aa8-4dcf-809b-3b93557d9fd1 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:56.434922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9e92319-6aa8-4dcf-809b-3b93557d9fd1 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:56.437388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9e92319-6aa8-4dcf-809b-3b93557d9fd1 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:56.439759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9e92319-6aa8-4dcf-809b-3b93557d9fd1 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:56.440612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9e92319-6aa8-4dcf-809b-3b93557d9fd1 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:56.698655 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-37aada33-c1a9-4386-a1d5-3635f20181e1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 11.959848 Jul 14 14:43:56.700050 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1660/3327] 10.222.0.81 () {62 vars in 1188 bytes} [Thu Jul 14 14:43:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 11964 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:43:56.706592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c2347083-9651-4fdb-b6f2-5343194751a0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:56.707494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c2347083-9651-4fdb-b6f2-5343194751a0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:56.714367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2347083-9651-4fdb-b6f2-5343194751a0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:56.715142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2347083-9651-4fdb-b6f2-5343194751a0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:56.716374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2347083-9651-4fdb-b6f2-5343194751a0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:56.717307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2347083-9651-4fdb-b6f2-5343194751a0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:56.914140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:56.965949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=12 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:57.700495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e9e92319-6aa8-4dcf-809b-3b93557d9fd1 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:57.710776 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e9e92319-6aa8-4dcf-809b-3b93557d9fd1 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 1.305161 Jul 14 14:43:57.720850 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1668/3328] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:56 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:57.720850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c0b0d409-81ed-4a54-9b17-69aff70d00be tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:57.720850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c0b0d409-81ed-4a54-9b17-69aff70d00be tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:57.726278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0b0d409-81ed-4a54-9b17-69aff70d00be tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:57.726739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0b0d409-81ed-4a54-9b17-69aff70d00be tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:57.727831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0b0d409-81ed-4a54-9b17-69aff70d00be tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:57.728856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0b0d409-81ed-4a54-9b17-69aff70d00be tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:57.772097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c2347083-9651-4fdb-b6f2-5343194751a0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:57.779888 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c2347083-9651-4fdb-b6f2-5343194751a0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1321 microversion: 2.1 time: 1.078481 Jul 14 14:43:57.780480 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1661/3329] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:56 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1321 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:57.785224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac29735c-3806-46b5-8f07-bfc8c1b71f33 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:57.786204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ac29735c-3806-46b5-8f07-bfc8c1b71f33 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:57.792371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac29735c-3806-46b5-8f07-bfc8c1b71f33 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:57.793178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac29735c-3806-46b5-8f07-bfc8c1b71f33 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:57.794012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac29735c-3806-46b5-8f07-bfc8c1b71f33 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:57.794456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac29735c-3806-46b5-8f07-bfc8c1b71f33 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:57.857112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c0b0d409-81ed-4a54-9b17-69aff70d00be tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:57.867577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c0b0d409-81ed-4a54-9b17-69aff70d00be tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:57.869195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c0b0d409-81ed-4a54-9b17-69aff70d00be tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:57.870899 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c0b0d409-81ed-4a54-9b17-69aff70d00be tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1526 microversion: 2.32 time: 0.157692 Jul 14 14:43:57.871053 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1669/3330] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:57 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:57.876162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6df55fd8-443f-433d-b8e2-d24efedfc91b req-33d32ee0-adae-4175-b3d3-1ccd81dbf455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d83f75ff-3ed3-406d-9e13-695407c179a3", "tag": "280185ac-7091-47cb-a2fa-c06391e9b6cf"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:57.888588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6df55fd8-443f-433d-b8e2-d24efedfc91b req-33d32ee0-adae-4175-b3d3-1ccd81dbf455 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:57.888588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6df55fd8-443f-433d-b8e2-d24efedfc91b req-33d32ee0-adae-4175-b3d3-1ccd81dbf455 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:57.902665 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6df55fd8-443f-433d-b8e2-d24efedfc91b req-33d32ee0-adae-4175-b3d3-1ccd81dbf455 service nova] Creating event network-changed:280185ac-7091-47cb-a2fa-c06391e9b6cf for instance d83f75ff-3ed3-406d-9e13-695407c179a3 on n-h2-767704-28 Jul 14 14:43:57.914868 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6df55fd8-443f-433d-b8e2-d24efedfc91b req-33d32ee0-adae-4175-b3d3-1ccd81dbf455 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041295 Jul 14 14:43:57.914868 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1670/3331] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:58.294785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ac29735c-3806-46b5-8f07-bfc8c1b71f33 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:58.305225 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ac29735c-3806-46b5-8f07-bfc8c1b71f33 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.523357 Jul 14 14:43:58.305944 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1662/3332] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:57 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:58.730271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d72dc659-b692-4cd7-b96b-f223a358524b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:58.730999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d72dc659-b692-4cd7-b96b-f223a358524b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:58.755514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d72dc659-b692-4cd7-b96b-f223a358524b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:58.760469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d72dc659-b692-4cd7-b96b-f223a358524b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:58.761774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d72dc659-b692-4cd7-b96b-f223a358524b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:58.762398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d72dc659-b692-4cd7-b96b-f223a358524b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:58.798161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c1d55098-cc01-41f9-9805-e44fd8892166 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:58.800189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c1d55098-cc01-41f9-9805-e44fd8892166 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:58.816613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1d55098-cc01-41f9-9805-e44fd8892166 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:58.823821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1d55098-cc01-41f9-9805-e44fd8892166 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:58.825926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1d55098-cc01-41f9-9805-e44fd8892166 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:58.828475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1d55098-cc01-41f9-9805-e44fd8892166 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:59.225430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d72dc659-b692-4cd7-b96b-f223a358524b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:59.240145 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d72dc659-b692-4cd7-b96b-f223a358524b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 0.515911 Jul 14 14:43:59.254064 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1671/3333] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:58 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:59.260960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bcc75ebd-d613-4c6c-b859-d4310322fb38 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:59.262659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bcc75ebd-d613-4c6c-b859-d4310322fb38 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:59.274856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcc75ebd-d613-4c6c-b859-d4310322fb38 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:59.275698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcc75ebd-d613-4c6c-b859-d4310322fb38 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:59.278248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcc75ebd-d613-4c6c-b859-d4310322fb38 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:59.279601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcc75ebd-d613-4c6c-b859-d4310322fb38 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:59.454155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c1d55098-cc01-41f9-9805-e44fd8892166 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:59.463596 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c1d55098-cc01-41f9-9805-e44fd8892166 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1321 microversion: 2.1 time: 0.670105 Jul 14 14:43:59.474821 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1663/3334] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:58 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1321 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:59.480783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3474c0fa-d6d0-4c21-9d06-84ef553f04fd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:59.481715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3474c0fa-d6d0-4c21-9d06-84ef553f04fd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:59.490989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3474c0fa-d6d0-4c21-9d06-84ef553f04fd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:59.495176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3474c0fa-d6d0-4c21-9d06-84ef553f04fd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:59.496305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3474c0fa-d6d0-4c21-9d06-84ef553f04fd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:59.498488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3474c0fa-d6d0-4c21-9d06-84ef553f04fd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:59.531205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bcc75ebd-d613-4c6c-b859-d4310322fb38 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:59.547629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bcc75ebd-d613-4c6c-b859-d4310322fb38 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:59.557322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bcc75ebd-d613-4c6c-b859-d4310322fb38 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:59.558895 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bcc75ebd-d613-4c6c-b859-d4310322fb38 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1582 microversion: 2.32 time: 0.303599 Jul 14 14:43:59.560851 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1672/3335] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:59 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1582 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:00.215535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3474c0fa-d6d0-4c21-9d06-84ef553f04fd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:00.227042 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3474c0fa-d6d0-4c21-9d06-84ef553f04fd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.750654 Jul 14 14:44:00.235296 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1664/3336] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:59 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:00.266722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-49e29541-b121-413a-8c91-cb728181f42d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:00.268040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-49e29541-b121-413a-8c91-cb728181f42d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:00.287686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49e29541-b121-413a-8c91-cb728181f42d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:00.288599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49e29541-b121-413a-8c91-cb728181f42d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:00.289778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49e29541-b121-413a-8c91-cb728181f42d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:00.290470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49e29541-b121-413a-8c91-cb728181f42d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:00.324348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:00.487050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44e49328-2973-4223-982c-fe163417b82a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:00.488167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-44e49328-2973-4223-982c-fe163417b82a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:00.527379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44e49328-2973-4223-982c-fe163417b82a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:00.531143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44e49328-2973-4223-982c-fe163417b82a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:00.534399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44e49328-2973-4223-982c-fe163417b82a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:00.535100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44e49328-2973-4223-982c-fe163417b82a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:02.309037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-49e29541-b121-413a-8c91-cb728181f42d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:02.342031 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-49e29541-b121-413a-8c91-cb728181f42d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 2.080897 Jul 14 14:44:02.352224 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1673/3337] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:00 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:02.369690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9d0b5ec0-2cb1-4fe2-b14a-710f5b47c21d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:02.370344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9d0b5ec0-2cb1-4fe2-b14a-710f5b47c21d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:02.404856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d0b5ec0-2cb1-4fe2-b14a-710f5b47c21d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:02.405350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d0b5ec0-2cb1-4fe2-b14a-710f5b47c21d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:02.406158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d0b5ec0-2cb1-4fe2-b14a-710f5b47c21d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:02.406605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d0b5ec0-2cb1-4fe2-b14a-710f5b47c21d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:03.117953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-44e49328-2973-4223-982c-fe163417b82a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:03.126446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9d0b5ec0-2cb1-4fe2-b14a-710f5b47c21d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:03.142387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9d0b5ec0-2cb1-4fe2-b14a-710f5b47c21d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:03.144109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9d0b5ec0-2cb1-4fe2-b14a-710f5b47c21d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:03.147059 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-44e49328-2973-4223-982c-fe163417b82a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1321 microversion: 2.1 time: 2.665357 Jul 14 14:44:03.156469 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9d0b5ec0-2cb1-4fe2-b14a-710f5b47c21d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1592 microversion: 2.32 time: 0.805908 Jul 14 14:44:03.161068 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1665/3338] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:00 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1321 bytes in 2683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:03.161646 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1674/3339] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:02 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1592 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:03.183783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1c7f9510-086f-4ed8-afcf-f6b2b80b9ad8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:03.186205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1c7f9510-086f-4ed8-afcf-f6b2b80b9ad8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:03.198593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c7f9510-086f-4ed8-afcf-f6b2b80b9ad8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:03.199262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c7f9510-086f-4ed8-afcf-f6b2b80b9ad8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:03.200294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c7f9510-086f-4ed8-afcf-f6b2b80b9ad8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:03.200925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c7f9510-086f-4ed8-afcf-f6b2b80b9ad8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:03.361873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8a2f8de7-bc90-4bc0-8d91-94016946073b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:03.363744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8a2f8de7-bc90-4bc0-8d91-94016946073b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:03.401081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a2f8de7-bc90-4bc0-8d91-94016946073b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:03.402676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a2f8de7-bc90-4bc0-8d91-94016946073b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:03.406060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a2f8de7-bc90-4bc0-8d91-94016946073b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:03.410045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a2f8de7-bc90-4bc0-8d91-94016946073b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:04.354013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1c7f9510-086f-4ed8-afcf-f6b2b80b9ad8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:04.380254 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1c7f9510-086f-4ed8-afcf-f6b2b80b9ad8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 1.203447 Jul 14 14:44:04.382748 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1666/3340] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:03 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:04.393677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f477eb4a-e406-412e-8456-8996322bbbbc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:04.398254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f477eb4a-e406-412e-8456-8996322bbbbc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:04.416199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f477eb4a-e406-412e-8456-8996322bbbbc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:04.416985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f477eb4a-e406-412e-8456-8996322bbbbc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:04.418124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f477eb4a-e406-412e-8456-8996322bbbbc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:04.420334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f477eb4a-e406-412e-8456-8996322bbbbc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:04.494803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8a2f8de7-bc90-4bc0-8d91-94016946073b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:04.511601 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8a2f8de7-bc90-4bc0-8d91-94016946073b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 1.152213 Jul 14 14:44:04.517957 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1675/3341] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:03 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:04.530678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f6fda18b-0065-4046-9c4c-ac7235f637cf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:04.547106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f6fda18b-0065-4046-9c4c-ac7235f637cf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:04.581600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6fda18b-0065-4046-9c4c-ac7235f637cf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:04.584121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6fda18b-0065-4046-9c4c-ac7235f637cf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:04.590987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6fda18b-0065-4046-9c4c-ac7235f637cf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:04.591747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6fda18b-0065-4046-9c4c-ac7235f637cf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:04.915546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f477eb4a-e406-412e-8456-8996322bbbbc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:04.928303 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f477eb4a-e406-412e-8456-8996322bbbbc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1321 microversion: 2.1 time: 0.539199 Jul 14 14:44:04.930685 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1667/3342] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:04 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1321 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:04.942958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0a089466-f31e-4ab2-b667-337c6997e837 req-2fe3fb7e-37be-432e-b3a7-13c1db1aa183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91067647-7704-49c5-a1c2-efcfe1474e01", "name": "network-vif-plugged", "status": "completed", "tag": "8f48bd43-add0-4af7-8116-106406af3cf8"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:04.967027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0a089466-f31e-4ab2-b667-337c6997e837 req-2fe3fb7e-37be-432e-b3a7-13c1db1aa183 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:04.977399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0a089466-f31e-4ab2-b667-337c6997e837 req-2fe3fb7e-37be-432e-b3a7-13c1db1aa183 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:05.009794 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0a089466-f31e-4ab2-b667-337c6997e837 req-2fe3fb7e-37be-432e-b3a7-13c1db1aa183 service nova] Creating event network-vif-plugged:8f48bd43-add0-4af7-8116-106406af3cf8 for instance 91067647-7704-49c5-a1c2-efcfe1474e01 on n-h1-767704-28 Jul 14 14:44:05.044600 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0a089466-f31e-4ab2-b667-337c6997e837 req-2fe3fb7e-37be-432e-b3a7-13c1db1aa183 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110868 Jul 14 14:44:05.046717 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1668/3343] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:05.265118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6fda18b-0065-4046-9c4c-ac7235f637cf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:05.281615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6fda18b-0065-4046-9c4c-ac7235f637cf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:05.286520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6fda18b-0065-4046-9c4c-ac7235f637cf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:05.289772 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f6fda18b-0065-4046-9c4c-ac7235f637cf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1659 microversion: 2.32 time: 0.769730 Jul 14 14:44:05.305836 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1676/3344] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:04 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1659 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:05.400849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-de613cd2-a06d-42aa-a23c-690c3d015475 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:05.418321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-de613cd2-a06d-42aa-a23c-690c3d015475 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:05.444705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de613cd2-a06d-42aa-a23c-690c3d015475 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:05.455904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de613cd2-a06d-42aa-a23c-690c3d015475 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:05.457800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de613cd2-a06d-42aa-a23c-690c3d015475 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:05.462121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de613cd2-a06d-42aa-a23c-690c3d015475 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:05.534847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-084f8a4a-3475-4276-b9a9-44f2a8125a20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:05.535701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-084f8a4a-3475-4276-b9a9-44f2a8125a20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:05.538948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:05.575500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-084f8a4a-3475-4276-b9a9-44f2a8125a20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:05.596154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-084f8a4a-3475-4276-b9a9-44f2a8125a20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:05.598830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-084f8a4a-3475-4276-b9a9-44f2a8125a20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:05.600157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-084f8a4a-3475-4276-b9a9-44f2a8125a20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:05.738291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:05.765723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:06.565730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-de613cd2-a06d-42aa-a23c-690c3d015475 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:06.587232 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-de613cd2-a06d-42aa-a23c-690c3d015475 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 1.190954 Jul 14 14:44:06.588508 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1669/3345] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:05 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:06.593863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f018f3a-d399-4b09-bc55-186f3e4bb2d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:06.594683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8f018f3a-d399-4b09-bc55-186f3e4bb2d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:06.602312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f018f3a-d399-4b09-bc55-186f3e4bb2d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:06.603074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f018f3a-d399-4b09-bc55-186f3e4bb2d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:06.604310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f018f3a-d399-4b09-bc55-186f3e4bb2d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:06.605022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f018f3a-d399-4b09-bc55-186f3e4bb2d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:06.628136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-084f8a4a-3475-4276-b9a9-44f2a8125a20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:06.636406 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-084f8a4a-3475-4276-b9a9-44f2a8125a20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 1.106520 Jul 14 14:44:06.637022 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1677/3346] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:05 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:06.653323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-34b9c4ab-c39a-4dee-a4d1-5ba4b9c21e0b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:06.654113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-34b9c4ab-c39a-4dee-a4d1-5ba4b9c21e0b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:06.672596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34b9c4ab-c39a-4dee-a4d1-5ba4b9c21e0b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:06.673072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34b9c4ab-c39a-4dee-a4d1-5ba4b9c21e0b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:06.674481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34b9c4ab-c39a-4dee-a4d1-5ba4b9c21e0b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:06.674957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34b9c4ab-c39a-4dee-a4d1-5ba4b9c21e0b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:06.993289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f018f3a-d399-4b09-bc55-186f3e4bb2d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:07.017144 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8f018f3a-d399-4b09-bc55-186f3e4bb2d3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1321 microversion: 2.1 time: 0.419883 Jul 14 14:44:07.019831 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1670/3347] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:06 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:07.097742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d3141b6b-3274-4621-b906-629e758c83cb req-aa42e320-a399-4947-a2f8-5df067af3750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83f75ff-3ed3-406d-9e13-695407c179a3", "name": "network-vif-plugged", "status": "completed", "tag": "280185ac-7091-47cb-a2fa-c06391e9b6cf"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:07.113986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d3141b6b-3274-4621-b906-629e758c83cb req-aa42e320-a399-4947-a2f8-5df067af3750 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.123430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d3141b6b-3274-4621-b906-629e758c83cb req-aa42e320-a399-4947-a2f8-5df067af3750 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.162330 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d3141b6b-3274-4621-b906-629e758c83cb req-aa42e320-a399-4947-a2f8-5df067af3750 service nova] Creating event network-vif-plugged:280185ac-7091-47cb-a2fa-c06391e9b6cf for instance d83f75ff-3ed3-406d-9e13-695407c179a3 on n-h2-767704-28 Jul 14 14:44:07.179270 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d3141b6b-3274-4621-b906-629e758c83cb req-aa42e320-a399-4947-a2f8-5df067af3750 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084610 Jul 14 14:44:07.180524 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1671/3348] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:07.336760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-34b9c4ab-c39a-4dee-a4d1-5ba4b9c21e0b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:07.355588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-34b9c4ab-c39a-4dee-a4d1-5ba4b9c21e0b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:07.357332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-34b9c4ab-c39a-4dee-a4d1-5ba4b9c21e0b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:07.358651 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-34b9c4ab-c39a-4dee-a4d1-5ba4b9c21e0b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1705 microversion: 2.32 time: 0.720694 Jul 14 14:44:07.370747 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1678/3349] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:06 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1705 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:07.607365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e836b4a2-5dc2-4534-8921-47e3e9981f39 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:07.607932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e836b4a2-5dc2-4534-8921-47e3e9981f39 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:07.625885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e836b4a2-5dc2-4534-8921-47e3e9981f39 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.627208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e836b4a2-5dc2-4534-8921-47e3e9981f39 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.634870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e836b4a2-5dc2-4534-8921-47e3e9981f39 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.645717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e836b4a2-5dc2-4534-8921-47e3e9981f39 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.653364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ed107a9-68f3-4922-95d0-bac9aa9de881 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:07.654654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6ed107a9-68f3-4922-95d0-bac9aa9de881 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:07.664018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ed107a9-68f3-4922-95d0-bac9aa9de881 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.669706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ed107a9-68f3-4922-95d0-bac9aa9de881 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.678769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ed107a9-68f3-4922-95d0-bac9aa9de881 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.679419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ed107a9-68f3-4922-95d0-bac9aa9de881 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.563659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e836b4a2-5dc2-4534-8921-47e3e9981f39 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:08.564400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6ed107a9-68f3-4922-95d0-bac9aa9de881 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:08.573990 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e836b4a2-5dc2-4534-8921-47e3e9981f39 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.971674 Jul 14 14:44:08.584125 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6ed107a9-68f3-4922-95d0-bac9aa9de881 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1504 microversion: 2.1 time: 0.926436 Jul 14 14:44:08.584125 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1679/3350] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:07 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1504 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:08.584529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b679ad8-ff34-41a5-b7ff-54dc6e2da2f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:08.590962 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1672/3351] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:07 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:08.598932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b679ad8-ff34-41a5-b7ff-54dc6e2da2f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:08.601649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e9205156-9fe9-475b-8326-9abba71d1d3a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:08.604404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e9205156-9fe9-475b-8326-9abba71d1d3a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:08.607294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b679ad8-ff34-41a5-b7ff-54dc6e2da2f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.608209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b679ad8-ff34-41a5-b7ff-54dc6e2da2f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.609163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b679ad8-ff34-41a5-b7ff-54dc6e2da2f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.609746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b679ad8-ff34-41a5-b7ff-54dc6e2da2f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.614468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e9205156-9fe9-475b-8326-9abba71d1d3a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.616370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e9205156-9fe9-475b-8326-9abba71d1d3a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.617438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e9205156-9fe9-475b-8326-9abba71d1d3a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.618235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e9205156-9fe9-475b-8326-9abba71d1d3a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.209455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e9205156-9fe9-475b-8326-9abba71d1d3a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:09.229787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e9205156-9fe9-475b-8326-9abba71d1d3a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:09.235023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e9205156-9fe9-475b-8326-9abba71d1d3a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:09.236384 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e9205156-9fe9-475b-8326-9abba71d1d3a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1751 microversion: 2.32 time: 0.642888 Jul 14 14:44:09.237870 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1673/3352] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:08 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1751 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:09.312797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2b679ad8-ff34-41a5-b7ff-54dc6e2da2f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:09.323779 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b679ad8-ff34-41a5-b7ff-54dc6e2da2f7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1321 microversion: 2.1 time: 0.744027 Jul 14 14:44:09.331347 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1680/3353] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:08 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1321 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:09.591440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98de240e-9fb0-4a8e-a653-cf7ff0eab6b5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:09.592429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-98de240e-9fb0-4a8e-a653-cf7ff0eab6b5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:09.600193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98de240e-9fb0-4a8e-a653-cf7ff0eab6b5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:09.606809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-725e13c1-b028-4bfe-b35a-066109e676c7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:09.607805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-725e13c1-b028-4bfe-b35a-066109e676c7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:09.609313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98de240e-9fb0-4a8e-a653-cf7ff0eab6b5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.611203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98de240e-9fb0-4a8e-a653-cf7ff0eab6b5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:09.612119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98de240e-9fb0-4a8e-a653-cf7ff0eab6b5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.624939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-725e13c1-b028-4bfe-b35a-066109e676c7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:09.625569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-725e13c1-b028-4bfe-b35a-066109e676c7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.627190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-725e13c1-b028-4bfe-b35a-066109e676c7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:09.627805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-725e13c1-b028-4bfe-b35a-066109e676c7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.922249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-98de240e-9fb0-4a8e-a653-cf7ff0eab6b5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:09.925054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-725e13c1-b028-4bfe-b35a-066109e676c7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:09.942463 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98de240e-9fb0-4a8e-a653-cf7ff0eab6b5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.354698 Jul 14 14:44:09.971965 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1674/3354] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:09 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:09.975779 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-725e13c1-b028-4bfe-b35a-066109e676c7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1484 microversion: 2.1 time: 0.373312 Jul 14 14:44:09.981086 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1681/3355] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:09 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1484 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:10.158017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-343418031", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:10.263374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f20b6ed2-2b6e-4c44-ae1c-c8de344f6a6f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:10.264294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f20b6ed2-2b6e-4c44-ae1c-c8de344f6a6f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:10.273560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f20b6ed2-2b6e-4c44-ae1c-c8de344f6a6f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:10.274965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f20b6ed2-2b6e-4c44-ae1c-c8de344f6a6f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:10.277152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f20b6ed2-2b6e-4c44-ae1c-c8de344f6a6f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:10.281785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f20b6ed2-2b6e-4c44-ae1c-c8de344f6a6f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:10.299063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] validate_networks() for [('615d6491-3181-44c2-a83d-36216d6c989f', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:44:10.710180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f20b6ed2-2b6e-4c44-ae1c-c8de344f6a6f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:10.730421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f20b6ed2-2b6e-4c44-ae1c-c8de344f6a6f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:10.733638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f20b6ed2-2b6e-4c44-ae1c-c8de344f6a6f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:10.737211 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f20b6ed2-2b6e-4c44-ae1c-c8de344f6a6f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1751 microversion: 2.32 time: 0.485171 Jul 14 14:44:10.752843 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1682/3356] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:10 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1751 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:10.768817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7aa72e1c-b134-409d-a194-e8d1d55e0eb0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:10.769482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7aa72e1c-b134-409d-a194-e8d1d55e0eb0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:10.784756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7aa72e1c-b134-409d-a194-e8d1d55e0eb0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:10.785253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7aa72e1c-b134-409d-a194-e8d1d55e0eb0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:10.786056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7aa72e1c-b134-409d-a194-e8d1d55e0eb0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:10.786509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7aa72e1c-b134-409d-a194-e8d1d55e0eb0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.193536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7aa72e1c-b134-409d-a194-e8d1d55e0eb0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:11.205690 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7aa72e1c-b134-409d-a194-e8d1d55e0eb0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1516 microversion: 2.1 time: 0.450823 Jul 14 14:44:11.206300 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1683/3357] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:10 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1516 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:11.224980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c4a27bfe-24d9-445d-984c-429ab132f5c4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:11.225966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c4a27bfe-24d9-445d-984c-429ab132f5c4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:11.233389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c4a27bfe-24d9-445d-984c-429ab132f5c4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.234239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c4a27bfe-24d9-445d-984c-429ab132f5c4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.235308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c4a27bfe-24d9-445d-984c-429ab132f5c4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.236612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c4a27bfe-24d9-445d-984c-429ab132f5c4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.240768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:44:11.241932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:44:11.242621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:44:11.243235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:44:11.243849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:44:11.257711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.269061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.270299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.270973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.308868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Getting quotas for project b249f360cfda495fa5bcad6223474c17. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:11.316672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Getting quotas for user b845134b8fd14382b1c46ad78e5effa2 and project b249f360cfda495fa5bcad6223474c17. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:11.332369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:44:11.335069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:44:11.403284 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0139b4c8-6254-4492-a584-548760777008 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.250464 Jul 14 14:44:11.403944 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1675/3358] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:44:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:44:11.420284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a4a523c7-f846-44d3-b2aa-9658192b77c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:11.421809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a4a523c7-f846-44d3-b2aa-9658192b77c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:11.429553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4a523c7-f846-44d3-b2aa-9658192b77c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.433771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4a523c7-f846-44d3-b2aa-9658192b77c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.435140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4a523c7-f846-44d3-b2aa-9658192b77c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.437668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4a523c7-f846-44d3-b2aa-9658192b77c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.491732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c4a27bfe-24d9-445d-984c-429ab132f5c4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:11.493448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-a4a523c7-f846-44d3-b2aa-9658192b77c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lazy-loading 'flavor' on Instance uuid d83f75ff-3ed3-406d-9e13-695407c179a3 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:44:11.505910 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c4a27bfe-24d9-445d-984c-429ab132f5c4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.287120 Jul 14 14:44:11.507154 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1684/3359] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:11 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:11.512706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c8cad07a-3e63-40bc-80c1-da4619c8459c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:11.513743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c8cad07a-3e63-40bc-80c1-da4619c8459c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:11.631040 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a4a523c7-f846-44d3-b2aa-9658192b77c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3/action" status: 200 len: 32 microversion: 2.1 time: 0.225584 Jul 14 14:44:11.631684 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1676/3360] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:11 2022] POST /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:44:11.654423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f7659237-67ef-49be-9b58-5e1f7a3a89e6 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:11.655157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f7659237-67ef-49be-9b58-5e1f7a3a89e6 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:11.690990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7659237-67ef-49be-9b58-5e1f7a3a89e6 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.691465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7659237-67ef-49be-9b58-5e1f7a3a89e6 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.692270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7659237-67ef-49be-9b58-5e1f7a3a89e6 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.692719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7659237-67ef-49be-9b58-5e1f7a3a89e6 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.705072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:12.093699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c8cad07a-3e63-40bc-80c1-da4619c8459c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:12.131522 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c8cad07a-3e63-40bc-80c1-da4619c8459c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1213 microversion: 2.1 time: 0.622668 Jul 14 14:44:12.147120 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1685/3361] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:11 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1213 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:12.172996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4cf2ee4c-10af-42c8-99f1-dbaa73dee793 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:12.175060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4cf2ee4c-10af-42c8-99f1-dbaa73dee793 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:12.214368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cf2ee4c-10af-42c8-99f1-dbaa73dee793 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:12.214864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cf2ee4c-10af-42c8-99f1-dbaa73dee793 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:12.216924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cf2ee4c-10af-42c8-99f1-dbaa73dee793 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:12.217467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cf2ee4c-10af-42c8-99f1-dbaa73dee793 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:12.643368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f7659237-67ef-49be-9b58-5e1f7a3a89e6 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:12.661137 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f7659237-67ef-49be-9b58-5e1f7a3a89e6 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 1.017069 Jul 14 14:44:12.661839 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1677/3362] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:11 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:12.692098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d8c55b5-bd23-40cb-806f-edc5d7665b09 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:12.696393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d8c55b5-bd23-40cb-806f-edc5d7665b09 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:12.725285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d8c55b5-bd23-40cb-806f-edc5d7665b09 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:12.725754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d8c55b5-bd23-40cb-806f-edc5d7665b09 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:12.726564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d8c55b5-bd23-40cb-806f-edc5d7665b09 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:12.731778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d8c55b5-bd23-40cb-806f-edc5d7665b09 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:12.981285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4cf2ee4c-10af-42c8-99f1-dbaa73dee793 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:13.001245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4cf2ee4c-10af-42c8-99f1-dbaa73dee793 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:13.002812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4cf2ee4c-10af-42c8-99f1-dbaa73dee793 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:13.004043 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4cf2ee4c-10af-42c8-99f1-dbaa73dee793 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1797 microversion: 2.32 time: 0.855830 Jul 14 14:44:13.017126 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1686/3363] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:12 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1797 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:13.090294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7d8c55b5-bd23-40cb-806f-edc5d7665b09 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:13.152146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-26f46840-7958-4394-a8dd-13612b87e007 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:13.153004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-26f46840-7958-4394-a8dd-13612b87e007 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:13.155400 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d8c55b5-bd23-40cb-806f-edc5d7665b09 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.467469 Jul 14 14:44:13.166663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26f46840-7958-4394-a8dd-13612b87e007 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:13.167903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26f46840-7958-4394-a8dd-13612b87e007 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:13.168880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26f46840-7958-4394-a8dd-13612b87e007 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:13.169636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26f46840-7958-4394-a8dd-13612b87e007 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:13.172128 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1678/3364] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:12 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:13.355120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-26f46840-7958-4394-a8dd-13612b87e007 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:13.366883 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-26f46840-7958-4394-a8dd-13612b87e007 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1265 microversion: 2.1 time: 0.219016 Jul 14 14:44:13.367719 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1687/3365] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:13 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:13.679951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eea5de04-912a-4e9e-813a-f6af7d3ad87e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:13.681480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eea5de04-912a-4e9e-813a-f6af7d3ad87e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:13.691931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eea5de04-912a-4e9e-813a-f6af7d3ad87e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:13.692655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eea5de04-912a-4e9e-813a-f6af7d3ad87e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:13.693787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eea5de04-912a-4e9e-813a-f6af7d3ad87e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:13.694481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eea5de04-912a-4e9e-813a-f6af7d3ad87e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.024935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f6cafc79-e160-49f2-8d5b-dbbe921e2998 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:14.026226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f6cafc79-e160-49f2-8d5b-dbbe921e2998 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:14.043923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6cafc79-e160-49f2-8d5b-dbbe921e2998 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.049574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6cafc79-e160-49f2-8d5b-dbbe921e2998 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.051289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6cafc79-e160-49f2-8d5b-dbbe921e2998 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.052708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6cafc79-e160-49f2-8d5b-dbbe921e2998 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.080501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eea5de04-912a-4e9e-813a-f6af7d3ad87e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:14.104385 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eea5de04-912a-4e9e-813a-f6af7d3ad87e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.428226 Jul 14 14:44:14.117775 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1679/3366] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:13 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:14.194927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-71f211bc-f75d-4a32-830c-8bb721b98039 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:14.195562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-71f211bc-f75d-4a32-830c-8bb721b98039 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:14.210259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71f211bc-f75d-4a32-830c-8bb721b98039 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.210717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71f211bc-f75d-4a32-830c-8bb721b98039 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.211510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71f211bc-f75d-4a32-830c-8bb721b98039 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.216205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71f211bc-f75d-4a32-830c-8bb721b98039 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.451067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6cafc79-e160-49f2-8d5b-dbbe921e2998 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:14.467481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6cafc79-e160-49f2-8d5b-dbbe921e2998 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:14.469120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6cafc79-e160-49f2-8d5b-dbbe921e2998 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:14.470658 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f6cafc79-e160-49f2-8d5b-dbbe921e2998 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1797 microversion: 2.32 time: 0.451296 Jul 14 14:44:14.489686 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1688/3367] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:14 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1797 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:14.500221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f322ca2b-bb82-4373-8a7a-1f769e79ed4e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:14.503513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f322ca2b-bb82-4373-8a7a-1f769e79ed4e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:14.525038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f322ca2b-bb82-4373-8a7a-1f769e79ed4e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.526282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f322ca2b-bb82-4373-8a7a-1f769e79ed4e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.528200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f322ca2b-bb82-4373-8a7a-1f769e79ed4e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.529423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f322ca2b-bb82-4373-8a7a-1f769e79ed4e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.586210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-71f211bc-f75d-4a32-830c-8bb721b98039 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:14.595642 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-71f211bc-f75d-4a32-830c-8bb721b98039 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.406385 Jul 14 14:44:14.596886 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1680/3368] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:14 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:14.628221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f322ca2b-bb82-4373-8a7a-1f769e79ed4e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:14.639790 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f322ca2b-bb82-4373-8a7a-1f769e79ed4e tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1271 microversion: 2.1 time: 0.160121 Jul 14 14:44:14.640542 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1689/3369] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:14 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:15.123311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7f3a3311-7ff8-44c0-abfd-2ce2bc9cb231 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:15.124101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7f3a3311-7ff8-44c0-abfd-2ce2bc9cb231 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:15.151879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f3a3311-7ff8-44c0-abfd-2ce2bc9cb231 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.158416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f3a3311-7ff8-44c0-abfd-2ce2bc9cb231 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.159769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f3a3311-7ff8-44c0-abfd-2ce2bc9cb231 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.160549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f3a3311-7ff8-44c0-abfd-2ce2bc9cb231 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.496648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f6b2fe38-e8f3-466c-a9df-e22b1faa1ad9 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:15.497738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f6b2fe38-e8f3-466c-a9df-e22b1faa1ad9 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:15.514120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6b2fe38-e8f3-466c-a9df-e22b1faa1ad9 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.514661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6b2fe38-e8f3-466c-a9df-e22b1faa1ad9 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.515678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6b2fe38-e8f3-466c-a9df-e22b1faa1ad9 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.516296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6b2fe38-e8f3-466c-a9df-e22b1faa1ad9 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.570315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7f3a3311-7ff8-44c0-abfd-2ce2bc9cb231 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:15.585909 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7f3a3311-7ff8-44c0-abfd-2ce2bc9cb231 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.464924 Jul 14 14:44:15.587055 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1681/3370] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:15 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:15.628939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ce1b1c41-8878-42d4-a399-7a0fdc8ed327 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:15.629595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ce1b1c41-8878-42d4-a399-7a0fdc8ed327 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:15.661653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce1b1c41-8878-42d4-a399-7a0fdc8ed327 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.662218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce1b1c41-8878-42d4-a399-7a0fdc8ed327 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.663068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce1b1c41-8878-42d4-a399-7a0fdc8ed327 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.663515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce1b1c41-8878-42d4-a399-7a0fdc8ed327 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:16.238063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ce1b1c41-8878-42d4-a399-7a0fdc8ed327 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:16.247344 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ce1b1c41-8878-42d4-a399-7a0fdc8ed327 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.635547 Jul 14 14:44:16.252483 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1682/3371] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:15 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:16.265634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1b4670cd-48fd-46f0-8dbf-8ecabbd044b2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:16.266268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1b4670cd-48fd-46f0-8dbf-8ecabbd044b2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:16.281707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b4670cd-48fd-46f0-8dbf-8ecabbd044b2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:16.282187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b4670cd-48fd-46f0-8dbf-8ecabbd044b2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:16.283044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b4670cd-48fd-46f0-8dbf-8ecabbd044b2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:16.283681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b4670cd-48fd-46f0-8dbf-8ecabbd044b2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:16.325779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6b2fe38-e8f3-466c-a9df-e22b1faa1ad9 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:16.345144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6b2fe38-e8f3-466c-a9df-e22b1faa1ad9 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:16.347804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6b2fe38-e8f3-466c-a9df-e22b1faa1ad9 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:16.352986 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f6b2fe38-e8f3-466c-a9df-e22b1faa1ad9 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1843 microversion: 2.32 time: 0.860562 Jul 14 14:44:16.354568 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1690/3372] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:15 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1843 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:16.604267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-23856695-6e8b-4e9e-8df5-501aacf9133d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:16.605806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-23856695-6e8b-4e9e-8df5-501aacf9133d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:16.620208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23856695-6e8b-4e9e-8df5-501aacf9133d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:16.620671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23856695-6e8b-4e9e-8df5-501aacf9133d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:16.622704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23856695-6e8b-4e9e-8df5-501aacf9133d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:16.625374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23856695-6e8b-4e9e-8df5-501aacf9133d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:16.674520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:16.704161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1b4670cd-48fd-46f0-8dbf-8ecabbd044b2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:16.721589 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1b4670cd-48fd-46f0-8dbf-8ecabbd044b2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1313 microversion: 2.1 time: 0.463455 Jul 14 14:44:16.732278 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1683/3373] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:16 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:17.061758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-23856695-6e8b-4e9e-8df5-501aacf9133d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:17.075324 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-23856695-6e8b-4e9e-8df5-501aacf9133d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.473962 Jul 14 14:44:17.086685 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1691/3374] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:16 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:17.282253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-28fb4e83-c05f-4fca-994d-08e1219cb4c3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:17.283139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-28fb4e83-c05f-4fca-994d-08e1219cb4c3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:17.304919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28fb4e83-c05f-4fca-994d-08e1219cb4c3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:17.305695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28fb4e83-c05f-4fca-994d-08e1219cb4c3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:17.317745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28fb4e83-c05f-4fca-994d-08e1219cb4c3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:17.318479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28fb4e83-c05f-4fca-994d-08e1219cb4c3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:17.378802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ed3abc41-b498-41d6-ae68-c30b5f408aff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:17.380042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ed3abc41-b498-41d6-ae68-c30b5f408aff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:17.393163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed3abc41-b498-41d6-ae68-c30b5f408aff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:17.394333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed3abc41-b498-41d6-ae68-c30b5f408aff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:17.395389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed3abc41-b498-41d6-ae68-c30b5f408aff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:17.397170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed3abc41-b498-41d6-ae68-c30b5f408aff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:18.160769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-28fb4e83-c05f-4fca-994d-08e1219cb4c3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:18.178976 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-28fb4e83-c05f-4fca-994d-08e1219cb4c3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1513 microversion: 2.1 time: 0.901614 Jul 14 14:44:18.185028 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1684/3375] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:17 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1513 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:18.195327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-fdacb12c-b05b-44d7-95ab-874840904973 req-820909d6-e09c-4f15-94cf-f43e8635e82a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "tag": "e821f371-f015-4b58-8a2e-a1611a49246a"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:18.215692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-fdacb12c-b05b-44d7-95ab-874840904973 req-820909d6-e09c-4f15-94cf-f43e8635e82a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:18.216134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-fdacb12c-b05b-44d7-95ab-874840904973 req-820909d6-e09c-4f15-94cf-f43e8635e82a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:18.253819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ed3abc41-b498-41d6-ae68-c30b5f408aff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:18.261999 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-fdacb12c-b05b-44d7-95ab-874840904973 req-820909d6-e09c-4f15-94cf-f43e8635e82a service nova] Creating event network-changed:e821f371-f015-4b58-8a2e-a1611a49246a for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:44:18.273495 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-fdacb12c-b05b-44d7-95ab-874840904973 req-820909d6-e09c-4f15-94cf-f43e8635e82a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086163 Jul 14 14:44:18.281431 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1685/3376] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:18.287792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ab650ea-4ffa-49e6-8e86-ed3e9e9a5111 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:18.288499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ab650ea-4ffa-49e6-8e86-ed3e9e9a5111 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:18.315692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ed3abc41-b498-41d6-ae68-c30b5f408aff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:18.326745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ed3abc41-b498-41d6-ae68-c30b5f408aff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:18.328348 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ed3abc41-b498-41d6-ae68-c30b5f408aff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1843 microversion: 2.32 time: 0.958999 Jul 14 14:44:18.333410 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1692/3377] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:17 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1843 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:18.342983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ab650ea-4ffa-49e6-8e86-ed3e9e9a5111 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:18.347309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ab650ea-4ffa-49e6-8e86-ed3e9e9a5111 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:18.348333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ab650ea-4ffa-49e6-8e86-ed3e9e9a5111 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:18.348791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ab650ea-4ffa-49e6-8e86-ed3e9e9a5111 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:18.358196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c7617dda-20a6-4c30-bd4a-554ad40860a3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:18.359711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c7617dda-20a6-4c30-bd4a-554ad40860a3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:18.377942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7617dda-20a6-4c30-bd4a-554ad40860a3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:18.378412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7617dda-20a6-4c30-bd4a-554ad40860a3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:18.379227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7617dda-20a6-4c30-bd4a-554ad40860a3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:18.383816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7617dda-20a6-4c30-bd4a-554ad40860a3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:19.726607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ab650ea-4ffa-49e6-8e86-ed3e9e9a5111 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:19.774279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c7617dda-20a6-4c30-bd4a-554ad40860a3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:19.848122 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c7617dda-20a6-4c30-bd4a-554ad40860a3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 1.512605 Jul 14 14:44:19.848744 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1693/3378] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:18 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:19.849973 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ab650ea-4ffa-49e6-8e86-ed3e9e9a5111 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1313 microversion: 2.1 time: 1.558567 Jul 14 14:44:19.851415 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1686/3379] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:18 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1313 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:19.866769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d36ab78d-15af-441b-80ed-5dbc35ab80cb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:19.869661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d36ab78d-15af-441b-80ed-5dbc35ab80cb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:19.873619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2dd9803c-4016-4e72-8faf-32bb2e03098e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:19.875941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2dd9803c-4016-4e72-8faf-32bb2e03098e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:19.887061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d36ab78d-15af-441b-80ed-5dbc35ab80cb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:19.887530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d36ab78d-15af-441b-80ed-5dbc35ab80cb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:19.890176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dd9803c-4016-4e72-8faf-32bb2e03098e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:19.890641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dd9803c-4016-4e72-8faf-32bb2e03098e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:19.891447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dd9803c-4016-4e72-8faf-32bb2e03098e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:19.892614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d36ab78d-15af-441b-80ed-5dbc35ab80cb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:19.893878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d36ab78d-15af-441b-80ed-5dbc35ab80cb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:19.894587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dd9803c-4016-4e72-8faf-32bb2e03098e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:20.910371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2dd9803c-4016-4e72-8faf-32bb2e03098e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:20.947907 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2dd9803c-4016-4e72-8faf-32bb2e03098e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1490 microversion: 2.1 time: 1.097926 Jul 14 14:44:20.948928 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1694/3380] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:19 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1490 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:20.969010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f3fce253-7cb1-451c-aa04-ceab2f36c730 req-e6a25fd3-8aaa-4d68-916f-df7a1e4e85fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f00f28d-b2fb-4ac4-a270-762d7df7b33f", "tag": "d4bf6708-6a09-43b5-892b-99707899b5e3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:20.980496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f3fce253-7cb1-451c-aa04-ceab2f36c730 req-e6a25fd3-8aaa-4d68-916f-df7a1e4e85fb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:20.981556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f3fce253-7cb1-451c-aa04-ceab2f36c730 req-e6a25fd3-8aaa-4d68-916f-df7a1e4e85fb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:21.014576 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f3fce253-7cb1-451c-aa04-ceab2f36c730 req-e6a25fd3-8aaa-4d68-916f-df7a1e4e85fb service nova] Creating event network-changed:d4bf6708-6a09-43b5-892b-99707899b5e3 for instance 3f00f28d-b2fb-4ac4-a270-762d7df7b33f on n-h2-767704-28 Jul 14 14:44:21.027045 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f3fce253-7cb1-451c-aa04-ceab2f36c730 req-e6a25fd3-8aaa-4d68-916f-df7a1e4e85fb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064824 Jul 14 14:44:21.030703 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1695/3381] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:21.046206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f3eae697-e74e-4c46-8dad-d7b88b779441 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:21.047699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f3eae697-e74e-4c46-8dad-d7b88b779441 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:21.070884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3eae697-e74e-4c46-8dad-d7b88b779441 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:21.072403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3eae697-e74e-4c46-8dad-d7b88b779441 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:21.076529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3eae697-e74e-4c46-8dad-d7b88b779441 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:21.077705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3eae697-e74e-4c46-8dad-d7b88b779441 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:21.287110 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:21.326855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:21.677406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d36ab78d-15af-441b-80ed-5dbc35ab80cb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:21.701556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d36ab78d-15af-441b-80ed-5dbc35ab80cb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:21.703991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d36ab78d-15af-441b-80ed-5dbc35ab80cb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:21.707093 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d36ab78d-15af-441b-80ed-5dbc35ab80cb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1864 microversion: 2.32 time: 1.854585 Jul 14 14:44:21.717996 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1687/3382] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:19 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1864 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:21.735247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-936a09ed-2012-4af3-bf40-c58204309c21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:21.740616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-936a09ed-2012-4af3-bf40-c58204309c21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:21.747454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-936a09ed-2012-4af3-bf40-c58204309c21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:21.747925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-936a09ed-2012-4af3-bf40-c58204309c21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:21.748722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-936a09ed-2012-4af3-bf40-c58204309c21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:21.749194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-936a09ed-2012-4af3-bf40-c58204309c21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:21.822823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f3eae697-e74e-4c46-8dad-d7b88b779441 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:21.831232 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f3eae697-e74e-4c46-8dad-d7b88b779441 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.799162 Jul 14 14:44:21.831834 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1696/3383] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:21 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:21.851183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f7515ddc-1d6f-4c8f-9eae-a69ec14bb86b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:21.852940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f7515ddc-1d6f-4c8f-9eae-a69ec14bb86b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:21.863450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7515ddc-1d6f-4c8f-9eae-a69ec14bb86b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:21.864384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7515ddc-1d6f-4c8f-9eae-a69ec14bb86b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:21.865441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7515ddc-1d6f-4c8f-9eae-a69ec14bb86b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:21.866532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7515ddc-1d6f-4c8f-9eae-a69ec14bb86b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:21.979771 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f7515ddc-1d6f-4c8f-9eae-a69ec14bb86b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 200 len: 147 microversion: 2.1 time: 0.132698 Jul 14 14:44:21.991683 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1697/3384] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:21 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 147 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:22.016513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6aa0cc87-af51-4833-9f35-858afd6a2256 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:22.021043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6aa0cc87-af51-4833-9f35-858afd6a2256 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:22.041090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6aa0cc87-af51-4833-9f35-858afd6a2256 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.042093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6aa0cc87-af51-4833-9f35-858afd6a2256 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.043559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6aa0cc87-af51-4833-9f35-858afd6a2256 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.047374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6aa0cc87-af51-4833-9f35-858afd6a2256 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.139946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:22.178035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-936a09ed-2012-4af3-bf40-c58204309c21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:22.188921 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-936a09ed-2012-4af3-bf40-c58204309c21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1313 microversion: 2.1 time: 0.468646 Jul 14 14:44:22.197148 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1688/3385] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:21 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:22.552838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6aa0cc87-af51-4833-9f35-858afd6a2256 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:22.568103 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6aa0cc87-af51-4833-9f35-858afd6a2256 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.572376 Jul 14 14:44:22.569050 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1698/3386] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:21 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:22.589867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7fbcbbab-4fb3-4bee-8020-d07740241efd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:22.591064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7fbcbbab-4fb3-4bee-8020-d07740241efd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:22.622062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fbcbbab-4fb3-4bee-8020-d07740241efd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.622606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fbcbbab-4fb3-4bee-8020-d07740241efd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.623651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fbcbbab-4fb3-4bee-8020-d07740241efd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.624174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fbcbbab-4fb3-4bee-8020-d07740241efd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.741764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-84322aea-2dc6-4c50-9fa0-b7711e7359fd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:22.742408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-84322aea-2dc6-4c50-9fa0-b7711e7359fd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:22.758230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84322aea-2dc6-4c50-9fa0-b7711e7359fd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.758707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84322aea-2dc6-4c50-9fa0-b7711e7359fd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.759518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84322aea-2dc6-4c50-9fa0-b7711e7359fd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.763593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84322aea-2dc6-4c50-9fa0-b7711e7359fd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:23.316354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7fbcbbab-4fb3-4bee-8020-d07740241efd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:23.324897 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7fbcbbab-4fb3-4bee-8020-d07740241efd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.740263 Jul 14 14:44:23.334073 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1689/3387] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:22 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:23.349520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-84322aea-2dc6-4c50-9fa0-b7711e7359fd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:23.350121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3b5eb15a-637c-44ca-907b-332a8c455672 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:23.351338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3b5eb15a-637c-44ca-907b-332a8c455672 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:23.373918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-84322aea-2dc6-4c50-9fa0-b7711e7359fd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:23.382219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-84322aea-2dc6-4c50-9fa0-b7711e7359fd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:23.383798 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-84322aea-2dc6-4c50-9fa0-b7711e7359fd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1885 microversion: 2.32 time: 0.648087 Jul 14 14:44:23.385954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b5eb15a-637c-44ca-907b-332a8c455672 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:23.386514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b5eb15a-637c-44ca-907b-332a8c455672 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:23.387681 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1699/3388] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:22 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1885 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:23.388540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b5eb15a-637c-44ca-907b-332a8c455672 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:23.389039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b5eb15a-637c-44ca-907b-332a8c455672 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:23.393732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ed0929c2-da46-43d1-87fe-4ecaf49740ad req-0759d814-a4d1-404d-bb9a-8b27a22c76c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "tag": "4d42836a-fc38-4944-9647-fb492b209832"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:23.419063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ed0929c2-da46-43d1-87fe-4ecaf49740ad req-0759d814-a4d1-404d-bb9a-8b27a22c76c3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:23.419813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ed0929c2-da46-43d1-87fe-4ecaf49740ad req-0759d814-a4d1-404d-bb9a-8b27a22c76c3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:23.448070 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ed0929c2-da46-43d1-87fe-4ecaf49740ad req-0759d814-a4d1-404d-bb9a-8b27a22c76c3 service nova] Creating event network-changed:4d42836a-fc38-4944-9647-fb492b209832 for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:44:23.468813 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ed0929c2-da46-43d1-87fe-4ecaf49740ad req-0759d814-a4d1-404d-bb9a-8b27a22c76c3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077976 Jul 14 14:44:23.470774 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1700/3389] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:23.478941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d2134c0a-45c8-4def-8071-3085b886cf82 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:23.480272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d2134c0a-45c8-4def-8071-3085b886cf82 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:23.495738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d2134c0a-45c8-4def-8071-3085b886cf82 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:23.498766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d2134c0a-45c8-4def-8071-3085b886cf82 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:23.499808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d2134c0a-45c8-4def-8071-3085b886cf82 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:23.500492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d2134c0a-45c8-4def-8071-3085b886cf82 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:24.272538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d2134c0a-45c8-4def-8071-3085b886cf82 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:24.291123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3b5eb15a-637c-44ca-907b-332a8c455672 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:24.292866 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d2134c0a-45c8-4def-8071-3085b886cf82 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1313 microversion: 2.1 time: 0.819838 Jul 14 14:44:24.294589 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1701/3390] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:23 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1313 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:24.306998 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3b5eb15a-637c-44ca-907b-332a8c455672 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.970978 Jul 14 14:44:24.307985 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1690/3391] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:23 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:24.320627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-51801278-a789-4cd6-99bf-8189f30d64d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:24.321723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-51801278-a789-4cd6-99bf-8189f30d64d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:24.337335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51801278-a789-4cd6-99bf-8189f30d64d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:24.341680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51801278-a789-4cd6-99bf-8189f30d64d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:24.342918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51801278-a789-4cd6-99bf-8189f30d64d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:24.344089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51801278-a789-4cd6-99bf-8189f30d64d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:24.408848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b7b996df-58d9-41a4-8d50-eb10233c90d8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:24.409549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b7b996df-58d9-41a4-8d50-eb10233c90d8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:24.428465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7b996df-58d9-41a4-8d50-eb10233c90d8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:24.430700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7b996df-58d9-41a4-8d50-eb10233c90d8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:24.433753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7b996df-58d9-41a4-8d50-eb10233c90d8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:24.435177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7b996df-58d9-41a4-8d50-eb10233c90d8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:25.971760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-51801278-a789-4cd6-99bf-8189f30d64d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:26.010293 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-51801278-a789-4cd6-99bf-8189f30d64d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 1.713765 Jul 14 14:44:26.034437 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1702/3392] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:24 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:26.049825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8643a807-1517-4779-b148-0e2c702297db tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:26.052833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8643a807-1517-4779-b148-0e2c702297db tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:26.074250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8643a807-1517-4779-b148-0e2c702297db tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:26.075146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8643a807-1517-4779-b148-0e2c702297db tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:26.076425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8643a807-1517-4779-b148-0e2c702297db tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:26.077130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8643a807-1517-4779-b148-0e2c702297db tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:26.361997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b7b996df-58d9-41a4-8d50-eb10233c90d8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:26.392778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b7b996df-58d9-41a4-8d50-eb10233c90d8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:26.400867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b7b996df-58d9-41a4-8d50-eb10233c90d8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:26.405645 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b7b996df-58d9-41a4-8d50-eb10233c90d8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1885 microversion: 2.32 time: 2.003825 Jul 14 14:44:26.421920 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1691/3393] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:24 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1885 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:26.439820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e86f12b0-1159-48d6-b819-c915feee79bb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:26.444157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e86f12b0-1159-48d6-b819-c915feee79bb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:26.456085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:26.461630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e86f12b0-1159-48d6-b819-c915feee79bb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:26.468970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e86f12b0-1159-48d6-b819-c915feee79bb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:26.471841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e86f12b0-1159-48d6-b819-c915feee79bb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:26.472644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e86f12b0-1159-48d6-b819-c915feee79bb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:26.604828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8643a807-1517-4779-b148-0e2c702297db tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:26.618878 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8643a807-1517-4779-b148-0e2c702297db tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1313 microversion: 2.1 time: 0.582501 Jul 14 14:44:26.624906 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1703/3394] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:26 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1313 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:26.630027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f18857c1-26f9-4032-9175-855a274d661e req-a0f18fa1-0034-4a29-b443-ab152244fe07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "tag": "e724799c-54b2-4910-bf13-c3ceedda7f4a"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:26.652469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f18857c1-26f9-4032-9175-855a274d661e req-a0f18fa1-0034-4a29-b443-ab152244fe07 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:26.653121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f18857c1-26f9-4032-9175-855a274d661e req-a0f18fa1-0034-4a29-b443-ab152244fe07 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:26.682829 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f18857c1-26f9-4032-9175-855a274d661e req-a0f18fa1-0034-4a29-b443-ab152244fe07 service nova] Creating event network-changed:e724799c-54b2-4910-bf13-c3ceedda7f4a for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:44:26.697279 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f18857c1-26f9-4032-9175-855a274d661e req-a0f18fa1-0034-4a29-b443-ab152244fe07 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070624 Jul 14 14:44:26.698846 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1704/3395] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:27.112624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b7d6d172-7e70-4ae4-a314-133613802514 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:27.114744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b7d6d172-7e70-4ae4-a314-133613802514 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:27.123703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7d6d172-7e70-4ae4-a314-133613802514 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:27.124485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7d6d172-7e70-4ae4-a314-133613802514 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:27.126554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7d6d172-7e70-4ae4-a314-133613802514 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:27.127268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7d6d172-7e70-4ae4-a314-133613802514 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:27.282090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e86f12b0-1159-48d6-b819-c915feee79bb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:27.324280 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e86f12b0-1159-48d6-b819-c915feee79bb tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.887524 Jul 14 14:44:27.334287 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1692/3396] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:26 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:27.351132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-5342807a-5568-4d20-bc43-5da1c0537716 req-69b9dbff-cd99-45ef-923a-cdb6547d3bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f00f28d-b2fb-4ac4-a270-762d7df7b33f", "name": "network-vif-plugged", "status": "completed", "tag": "d4bf6708-6a09-43b5-892b-99707899b5e3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:27.406038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5342807a-5568-4d20-bc43-5da1c0537716 req-69b9dbff-cd99-45ef-923a-cdb6547d3bea service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:27.407119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5342807a-5568-4d20-bc43-5da1c0537716 req-69b9dbff-cd99-45ef-923a-cdb6547d3bea service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:27.463843 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-5342807a-5568-4d20-bc43-5da1c0537716 req-69b9dbff-cd99-45ef-923a-cdb6547d3bea service nova] Creating event network-vif-plugged:d4bf6708-6a09-43b5-892b-99707899b5e3 for instance 3f00f28d-b2fb-4ac4-a270-762d7df7b33f on n-h2-767704-28 Jul 14 14:44:27.492366 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-5342807a-5568-4d20-bc43-5da1c0537716 req-69b9dbff-cd99-45ef-923a-cdb6547d3bea service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156298 Jul 14 14:44:27.495054 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1693/3397] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:27.536201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-73ba9dd2-49ce-4c0d-a88d-9a2dd7d91fe7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:27.540994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-73ba9dd2-49ce-4c0d-a88d-9a2dd7d91fe7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:27.569645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73ba9dd2-49ce-4c0d-a88d-9a2dd7d91fe7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:27.570991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73ba9dd2-49ce-4c0d-a88d-9a2dd7d91fe7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:27.572675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73ba9dd2-49ce-4c0d-a88d-9a2dd7d91fe7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:27.573749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73ba9dd2-49ce-4c0d-a88d-9a2dd7d91fe7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:28.089472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b7d6d172-7e70-4ae4-a314-133613802514 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:28.123500 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b7d6d172-7e70-4ae4-a314-133613802514 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 1.422069 Jul 14 14:44:28.126461 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1705/3398] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:26 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:28.146818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5baf6665-eb9e-4eee-929c-38dfb85a3b20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:28.149870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5baf6665-eb9e-4eee-929c-38dfb85a3b20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:28.180086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5baf6665-eb9e-4eee-929c-38dfb85a3b20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:28.181471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5baf6665-eb9e-4eee-929c-38dfb85a3b20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:28.183926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5baf6665-eb9e-4eee-929c-38dfb85a3b20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:28.186781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5baf6665-eb9e-4eee-929c-38dfb85a3b20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:29.062507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-73ba9dd2-49ce-4c0d-a88d-9a2dd7d91fe7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:29.077249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-73ba9dd2-49ce-4c0d-a88d-9a2dd7d91fe7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:29.085417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-73ba9dd2-49ce-4c0d-a88d-9a2dd7d91fe7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:29.086875 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-73ba9dd2-49ce-4c0d-a88d-9a2dd7d91fe7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1885 microversion: 2.32 time: 1.586656 Jul 14 14:44:29.087488 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1694/3399] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:27 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1885 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:29.105264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2109785326", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "05e588dd-ea85-4edc-9918-44620e736097"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:29.302259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] validate_networks() for [('05e588dd-ea85-4edc-9918-44620e736097', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:44:29.586894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5baf6665-eb9e-4eee-929c-38dfb85a3b20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:29.603485 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5baf6665-eb9e-4eee-929c-38dfb85a3b20 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1313 microversion: 2.1 time: 1.474501 Jul 14 14:44:29.611683 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1706/3400] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:28 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1313 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:29.623841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd4cc954-0dc7-43a6-98a1-847a222a35ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:29.624882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cd4cc954-0dc7-43a6-98a1-847a222a35ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:29.639315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd4cc954-0dc7-43a6-98a1-847a222a35ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:29.640375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd4cc954-0dc7-43a6-98a1-847a222a35ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:29.641498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd4cc954-0dc7-43a6-98a1-847a222a35ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:29.644301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd4cc954-0dc7-43a6-98a1-847a222a35ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:30.176029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cd4cc954-0dc7-43a6-98a1-847a222a35ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:30.207919 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cd4cc954-0dc7-43a6-98a1-847a222a35ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.594427 Jul 14 14:44:30.211948 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1707/3401] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:29 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:30.244985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab1a0fee-6228-46aa-b991-7cb2280bcce0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:30.245947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ab1a0fee-6228-46aa-b991-7cb2280bcce0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:30.264576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab1a0fee-6228-46aa-b991-7cb2280bcce0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:30.270231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab1a0fee-6228-46aa-b991-7cb2280bcce0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:30.272188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab1a0fee-6228-46aa-b991-7cb2280bcce0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:30.273116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab1a0fee-6228-46aa-b991-7cb2280bcce0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.139028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab1a0fee-6228-46aa-b991-7cb2280bcce0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:31.159106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab1a0fee-6228-46aa-b991-7cb2280bcce0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:31.160464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab1a0fee-6228-46aa-b991-7cb2280bcce0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:31.164393 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ab1a0fee-6228-46aa-b991-7cb2280bcce0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1885 microversion: 2.32 time: 0.942421 Jul 14 14:44:31.165846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:44:31.166818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:44:31.167466 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1708/3402] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:30 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1885 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:31.167655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:44:31.168301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:44:31.168877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:44:31.172631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-43a9b892-c860-45e0-bcba-d8871c618ed1 req-f9bc74df-bddd-4118-9ba0-79408f5254e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "tag": "5f2e657b-30cc-4497-a912-7f7416056eb1"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:31.187699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.197545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-43a9b892-c860-45e0-bcba-d8871c618ed1 req-f9bc74df-bddd-4118-9ba0-79408f5254e7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.197835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.198720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.199167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.201266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-43a9b892-c860-45e0-bcba-d8871c618ed1 req-f9bc74df-bddd-4118-9ba0-79408f5254e7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.231835 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-43a9b892-c860-45e0-bcba-d8871c618ed1 req-f9bc74df-bddd-4118-9ba0-79408f5254e7 service nova] Creating event network-changed:5f2e657b-30cc-4497-a912-7f7416056eb1 for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:44:31.242000 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-43a9b892-c860-45e0-bcba-d8871c618ed1 req-f9bc74df-bddd-4118-9ba0-79408f5254e7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072975 Jul 14 14:44:31.248423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:31.257304 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1709/3403] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:31.269459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aece063f-0337-4cbc-9d8b-1abd2716e55b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:31.270617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aece063f-0337-4cbc-9d8b-1abd2716e55b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:31.286999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aece063f-0337-4cbc-9d8b-1abd2716e55b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.290020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aece063f-0337-4cbc-9d8b-1abd2716e55b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.291428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aece063f-0337-4cbc-9d8b-1abd2716e55b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.298509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aece063f-0337-4cbc-9d8b-1abd2716e55b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.300090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Getting quotas for project 1933006fa13c44ae9128f00267210152. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:31.325757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Getting quotas for user f157150edd1d441aa2c7335dbb2363ca and project 1933006fa13c44ae9128f00267210152. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:31.393374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:44:31.399449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:44:31.547358 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a81bb3cf-0af4-4af3-a602-5e77909ff584 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.450270 Jul 14 14:44:31.548695 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1695/3404] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:44:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:44:31.561577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3695ef22-e278-4916-9e29-1cd29c13ac1a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:31.564580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3695ef22-e278-4916-9e29-1cd29c13ac1a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:31.592307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3695ef22-e278-4916-9e29-1cd29c13ac1a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.593055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3695ef22-e278-4916-9e29-1cd29c13ac1a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.593841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3695ef22-e278-4916-9e29-1cd29c13ac1a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.594261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3695ef22-e278-4916-9e29-1cd29c13ac1a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:32.045239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-aece063f-0337-4cbc-9d8b-1abd2716e55b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:32.059319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:32.069676 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aece063f-0337-4cbc-9d8b-1abd2716e55b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1313 microversion: 2.1 time: 0.808084 Jul 14 14:44:32.070321 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1710/3405] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:31 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1313 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:32.107590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4f3b8c0-9444-4f68-81dc-ab09cc2a9ae3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:32.108320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d4f3b8c0-9444-4f68-81dc-ab09cc2a9ae3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:32.266480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3695ef22-e278-4916-9e29-1cd29c13ac1a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:32.294202 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3695ef22-e278-4916-9e29-1cd29c13ac1a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.740721 Jul 14 14:44:32.296435 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1696/3406] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:31 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:32.330551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-daac1c80-8375-4c07-b89d-cce72bcd8fba tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:32.331481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-daac1c80-8375-4c07-b89d-cce72bcd8fba tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:32.353083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daac1c80-8375-4c07-b89d-cce72bcd8fba tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:32.353544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daac1c80-8375-4c07-b89d-cce72bcd8fba tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:32.356275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daac1c80-8375-4c07-b89d-cce72bcd8fba tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:32.356734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daac1c80-8375-4c07-b89d-cce72bcd8fba tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:32.608650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d4f3b8c0-9444-4f68-81dc-ab09cc2a9ae3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:32.625883 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d4f3b8c0-9444-4f68-81dc-ab09cc2a9ae3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1215 microversion: 2.1 time: 0.540718 Jul 14 14:44:32.627082 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1711/3407] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:32 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1215 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:33.091795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e47eed6e-f1ee-44e6-bb43-d0f49e557640 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:33.092875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e47eed6e-f1ee-44e6-bb43-d0f49e557640 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:33.117877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e47eed6e-f1ee-44e6-bb43-d0f49e557640 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.120785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e47eed6e-f1ee-44e6-bb43-d0f49e557640 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.122522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e47eed6e-f1ee-44e6-bb43-d0f49e557640 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.132561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e47eed6e-f1ee-44e6-bb43-d0f49e557640 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.295715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-daac1c80-8375-4c07-b89d-cce72bcd8fba tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:33.323979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-daac1c80-8375-4c07-b89d-cce72bcd8fba tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:33.339622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-daac1c80-8375-4c07-b89d-cce72bcd8fba tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:33.343667 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-daac1c80-8375-4c07-b89d-cce72bcd8fba tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1885 microversion: 2.32 time: 1.039911 Jul 14 14:44:33.363703 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1697/3408] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:32 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1885 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:33.373818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39e5c607-6e3c-450d-a0a4-cdd9936446a4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:33.374477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-39e5c607-6e3c-450d-a0a4-cdd9936446a4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:33.404499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39e5c607-6e3c-450d-a0a4-cdd9936446a4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.405265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39e5c607-6e3c-450d-a0a4-cdd9936446a4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.406236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39e5c607-6e3c-450d-a0a4-cdd9936446a4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.406863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39e5c607-6e3c-450d-a0a4-cdd9936446a4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.688682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e47eed6e-f1ee-44e6-bb43-d0f49e557640 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:33.699864 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e47eed6e-f1ee-44e6-bb43-d0f49e557640 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1498 microversion: 2.1 time: 0.615358 Jul 14 14:44:33.702382 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1712/3409] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:33 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1498 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:33.716610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4c5130aa-2d07-415b-85b3-be09901b6f53 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:33.718245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4c5130aa-2d07-415b-85b3-be09901b6f53 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:33.738027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c5130aa-2d07-415b-85b3-be09901b6f53 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.738807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c5130aa-2d07-415b-85b3-be09901b6f53 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.742601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c5130aa-2d07-415b-85b3-be09901b6f53 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.743312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4c5130aa-2d07-415b-85b3-be09901b6f53 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.867074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4c5130aa-2d07-415b-85b3-be09901b6f53 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:33.883592 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4c5130aa-2d07-415b-85b3-be09901b6f53 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1285 microversion: 2.1 time: 0.178592 Jul 14 14:44:33.884882 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1713/3410] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:33 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:33.894038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6e0fd27f-9b68-4c75-9bb6-ecbb3f4a1717 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:33.895489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6e0fd27f-9b68-4c75-9bb6-ecbb3f4a1717 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:33.914413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e0fd27f-9b68-4c75-9bb6-ecbb3f4a1717 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.915077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e0fd27f-9b68-4c75-9bb6-ecbb3f4a1717 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.915949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e0fd27f-9b68-4c75-9bb6-ecbb3f4a1717 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.916550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e0fd27f-9b68-4c75-9bb6-ecbb3f4a1717 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.928654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-39e5c607-6e3c-450d-a0a4-cdd9936446a4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:33.942223 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-39e5c607-6e3c-450d-a0a4-cdd9936446a4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.576984 Jul 14 14:44:33.945813 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1698/3411] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:33 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:33.989409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-6e0fd27f-9b68-4c75-9bb6-ecbb3f4a1717 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lazy-loading 'flavor' on Instance uuid 3f00f28d-b2fb-4ac4-a270-762d7df7b33f {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:44:34.134236 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6e0fd27f-9b68-4c75-9bb6-ecbb3f4a1717 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "POST /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f/action" status: 200 len: 32 microversion: 2.1 time: 0.247361 Jul 14 14:44:34.135560 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1714/3412] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:33 2022] POST /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f/action => generated 32 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:44:34.146120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f011f2e7-e4d2-4b65-a438-b1ae60519e21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:34.146950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f011f2e7-e4d2-4b65-a438-b1ae60519e21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:34.164237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f011f2e7-e4d2-4b65-a438-b1ae60519e21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:34.165238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f011f2e7-e4d2-4b65-a438-b1ae60519e21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:34.166133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f011f2e7-e4d2-4b65-a438-b1ae60519e21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:34.170762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f011f2e7-e4d2-4b65-a438-b1ae60519e21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:34.350163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b722c97d-ca24-41a6-b0cc-24b6839b64ef tempest-FloatingIPDetailsNegativeTestJSON-390224159 tempest-FloatingIPDetailsNegativeTestJSON-390224159-project] Calling method '.version_select at 0x7fd6c5f19ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:34.469357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG neutronclient.v2_0.client [None req-b722c97d-ca24-41a6-b0cc-24b6839b64ef tempest-FloatingIPDetailsNegativeTestJSON-390224159 tempest-FloatingIPDetailsNegativeTestJSON-390224159-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c32c64ef-f0c7-4fda-8574-46f0eb1f748b could not be found", "detail": ""}} {{(pid=119512) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:44:34.473879 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-b722c97d-ca24-41a6-b0cc-24b6839b64ef tempest-FloatingIPDetailsNegativeTestJSON-390224159 tempest-FloatingIPDetailsNegativeTestJSON-390224159-project] HTTP exception thrown: Floating IP not found for ID c32c64ef-f0c7-4fda-8574-46f0eb1f748b Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b722c97d-ca24-41a6-b0cc-24b6839b64ef tempest-FloatingIPDetailsNegativeTestJSON-390224159 tempest-FloatingIPDetailsNegativeTestJSON-390224159-project] Request method failure captured: Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-floating-ips/c32c64ef-f0c7-4fda-8574-46f0eb1f748b HTTP/1.1 Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CvSV_OkhnOwOuVO1rKs9z4dnr4sQzABV-EUCUuDl2pxAaf9mPviVJprkz8xg9iGOCqu0flUSuxbLj8bEi5IZk2NHCeq_NhdtE9nEbjXm2pzFYeuz_6TKpzqN2Sdg3dSokKphrX3N_bv66kkN9QJIUuqi5cVVjcqGx80Itu-F9BBDmQ Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 6b2e90b90dd24a608737a28f95b94ce3 Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-390224159 Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6b2e90b90dd24a608737a28f95b94ce3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6b2e90b90dd24a608737a28f95b94ce3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6b2e90b90dd24a608737a28f95b94ce3", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6b2e90b90dd24a608737a28f95b94ce3"}]}] Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-390224159 Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 6b2e90b90dd24a608737a28f95b94ce3 Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-390224159 Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-390224159-project Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 5488ce72c46043f58b33015cb0f15469 Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-390224159-project Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: exception: Floating IP not found for ID c32c64ef-f0c7-4fda-8574-46f0eb1f748b Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'c32c64ef-f0c7-4fda-8574-46f0eb1f748b'} Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c32c64ef-f0c7-4fda-8574-46f0eb1f748b could not be found Jul 14 14:44:34.479214 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4531f23a-c239-430b-acdb-a3b475f2656c'] Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c32c64ef-f0c7-4fda-8574-46f0eb1f748b. Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c32c64ef-f0c7-4fda-8574-46f0eb1f748b Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c32c64ef-f0c7-4fda-8574-46f0eb1f748b Jul 14 14:44:34.488705 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:44:34.503247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b722c97d-ca24-41a6-b0cc-24b6839b64ef tempest-FloatingIPDetailsNegativeTestJSON-390224159 tempest-FloatingIPDetailsNegativeTestJSON-390224159-project] Returning 404 to user: Floating IP not found for ID c32c64ef-f0c7-4fda-8574-46f0eb1f748b {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:44:34.504412 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b722c97d-ca24-41a6-b0cc-24b6839b64ef tempest-FloatingIPDetailsNegativeTestJSON-390224159 tempest-FloatingIPDetailsNegativeTestJSON-390224159-project] 10.222.0.81 "GET /compute/v2.1/os-floating-ips/c32c64ef-f0c7-4fda-8574-46f0eb1f748b" status: 404 len: 111 microversion: 2.1 time: 0.257758 Jul 14 14:44:34.505281 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1715/3413] 10.222.0.81 () {58 vars in 1259 bytes} [Thu Jul 14 14:44:34 2022] GET /compute/v2.1/os-floating-ips/c32c64ef-f0c7-4fda-8574-46f0eb1f748b => generated 111 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:44:34.516808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-86926b69-45f7-4c8d-bbd9-65a220ed1c9c req-ee57e082-1bbf-4fc5-964a-eabdd62df1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "tag": "69dae4af-3029-468a-89e3-6dde860957cb"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:34.534050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-86926b69-45f7-4c8d-bbd9-65a220ed1c9c req-ee57e082-1bbf-4fc5-964a-eabdd62df1c0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:34.541350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-86926b69-45f7-4c8d-bbd9-65a220ed1c9c req-ee57e082-1bbf-4fc5-964a-eabdd62df1c0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:34.556826 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-86926b69-45f7-4c8d-bbd9-65a220ed1c9c req-ee57e082-1bbf-4fc5-964a-eabdd62df1c0 service nova] Creating event network-changed:69dae4af-3029-468a-89e3-6dde860957cb for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:44:34.569149 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-86926b69-45f7-4c8d-bbd9-65a220ed1c9c req-ee57e082-1bbf-4fc5-964a-eabdd62df1c0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062271 Jul 14 14:44:34.570120 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1716/3414] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:34.582878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ddf7c25b-a03a-457f-8c04-7c82531b844a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:34.583603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ddf7c25b-a03a-457f-8c04-7c82531b844a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:34.592235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddf7c25b-a03a-457f-8c04-7c82531b844a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:34.592730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddf7c25b-a03a-457f-8c04-7c82531b844a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:34.593643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddf7c25b-a03a-457f-8c04-7c82531b844a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:34.594234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddf7c25b-a03a-457f-8c04-7c82531b844a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:35.716790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f011f2e7-e4d2-4b65-a438-b1ae60519e21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:35.733274 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f011f2e7-e4d2-4b65-a438-b1ae60519e21 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 1.590115 Jul 14 14:44:35.735107 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1699/3415] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:34 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:35.747863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f692fefd-8f18-400d-bbaf-5c3f9d3ab424 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:35.754293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ddf7c25b-a03a-457f-8c04-7c82531b844a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:35.756547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f692fefd-8f18-400d-bbaf-5c3f9d3ab424 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:35.773251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f692fefd-8f18-400d-bbaf-5c3f9d3ab424 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:35.776848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f692fefd-8f18-400d-bbaf-5c3f9d3ab424 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:35.777809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f692fefd-8f18-400d-bbaf-5c3f9d3ab424 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:35.778278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f692fefd-8f18-400d-bbaf-5c3f9d3ab424 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:35.799208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ddf7c25b-a03a-457f-8c04-7c82531b844a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:35.811441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ddf7c25b-a03a-457f-8c04-7c82531b844a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:35.812641 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ddf7c25b-a03a-457f-8c04-7c82531b844a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 1.239784 Jul 14 14:44:35.813117 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1717/3416] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:34 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:35.832547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7314fdb9-a3eb-41b1-b78f-a680e44296ad tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:35.833783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7314fdb9-a3eb-41b1-b78f-a680e44296ad tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:35.846438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=84 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:35.848395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7314fdb9-a3eb-41b1-b78f-a680e44296ad tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:35.852226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7314fdb9-a3eb-41b1-b78f-a680e44296ad tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:35.853446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7314fdb9-a3eb-41b1-b78f-a680e44296ad tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:35.854337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7314fdb9-a3eb-41b1-b78f-a680e44296ad tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:36.222753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f692fefd-8f18-400d-bbaf-5c3f9d3ab424 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:36.238240 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f692fefd-8f18-400d-bbaf-5c3f9d3ab424 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1273 microversion: 2.1 time: 0.499498 Jul 14 14:44:36.239788 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1700/3417] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:35 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1273 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:36.477599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7314fdb9-a3eb-41b1-b78f-a680e44296ad tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:36.487815 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7314fdb9-a3eb-41b1-b78f-a680e44296ad tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.669094 Jul 14 14:44:36.488429 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1718/3418] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:35 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:36.753924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c5cd3122-8baf-4d0f-a0c1-211ef52f8831 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:36.755301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c5cd3122-8baf-4d0f-a0c1-211ef52f8831 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:36.772538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5cd3122-8baf-4d0f-a0c1-211ef52f8831 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:36.773184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5cd3122-8baf-4d0f-a0c1-211ef52f8831 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:36.773946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5cd3122-8baf-4d0f-a0c1-211ef52f8831 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:36.774417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5cd3122-8baf-4d0f-a0c1-211ef52f8831 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:36.838947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-652018d8-a8d0-4123-a5d7-098c98597b4b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:36.840139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-652018d8-a8d0-4123-a5d7-098c98597b4b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:36.854200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-652018d8-a8d0-4123-a5d7-098c98597b4b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:36.854668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-652018d8-a8d0-4123-a5d7-098c98597b4b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:36.855471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-652018d8-a8d0-4123-a5d7-098c98597b4b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:36.855925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-652018d8-a8d0-4123-a5d7-098c98597b4b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.263921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c5cd3122-8baf-4d0f-a0c1-211ef52f8831 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:37.278225 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c5cd3122-8baf-4d0f-a0c1-211ef52f8831 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.528172 Jul 14 14:44:37.284991 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1701/3419] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:36 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:37.286949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-652018d8-a8d0-4123-a5d7-098c98597b4b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:37.290801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-499e462c-f7ad-4e85-a14f-65e29788d839 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:37.291680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-499e462c-f7ad-4e85-a14f-65e29788d839 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:37.301422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-652018d8-a8d0-4123-a5d7-098c98597b4b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:37.302952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-499e462c-f7ad-4e85-a14f-65e29788d839 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.303618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-499e462c-f7ad-4e85-a14f-65e29788d839 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.304720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-499e462c-f7ad-4e85-a14f-65e29788d839 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.305393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-499e462c-f7ad-4e85-a14f-65e29788d839 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.312975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-652018d8-a8d0-4123-a5d7-098c98597b4b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:37.315782 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-652018d8-a8d0-4123-a5d7-098c98597b4b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.486660 Jul 14 14:44:37.320385 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1719/3420] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:36 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:37.390588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-499e462c-f7ad-4e85-a14f-65e29788d839 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:37.400272 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-499e462c-f7ad-4e85-a14f-65e29788d839 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1273 microversion: 2.1 time: 0.113883 Jul 14 14:44:37.400880 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1702/3421] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:37 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:37.507133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2fcbb04e-7f7b-4fbb-b57f-bc9e17237177 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:37.509654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2fcbb04e-7f7b-4fbb-b57f-bc9e17237177 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:37.518560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fcbb04e-7f7b-4fbb-b57f-bc9e17237177 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.519314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fcbb04e-7f7b-4fbb-b57f-bc9e17237177 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.520279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fcbb04e-7f7b-4fbb-b57f-bc9e17237177 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.520887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fcbb04e-7f7b-4fbb-b57f-bc9e17237177 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.777041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2fcbb04e-7f7b-4fbb-b57f-bc9e17237177 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:37.777041 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2fcbb04e-7f7b-4fbb-b57f-bc9e17237177 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.266782 Jul 14 14:44:37.777041 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1720/3422] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:37 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:38.303204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b9bd5bce-5259-49b8-8aad-04bf8ee2c66d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:38.304550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b9bd5bce-5259-49b8-8aad-04bf8ee2c66d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:38.318920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9bd5bce-5259-49b8-8aad-04bf8ee2c66d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.320094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9bd5bce-5259-49b8-8aad-04bf8ee2c66d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.321440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9bd5bce-5259-49b8-8aad-04bf8ee2c66d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.322094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9bd5bce-5259-49b8-8aad-04bf8ee2c66d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.337582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b318464-aaae-4179-a055-a1cbffce8020 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:38.338700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1b318464-aaae-4179-a055-a1cbffce8020 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:38.352577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b318464-aaae-4179-a055-a1cbffce8020 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.353531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b318464-aaae-4179-a055-a1cbffce8020 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.354755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b318464-aaae-4179-a055-a1cbffce8020 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.356625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b318464-aaae-4179-a055-a1cbffce8020 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.754928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b9bd5bce-5259-49b8-8aad-04bf8ee2c66d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:38.769095 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b9bd5bce-5259-49b8-8aad-04bf8ee2c66d tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.469767 Jul 14 14:44:38.785931 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1703/3423] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:38 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:38.797159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d35ff7f6-0f62-4ada-8a2f-21b2a159bdcf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:38.797933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d35ff7f6-0f62-4ada-8a2f-21b2a159bdcf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:38.808807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d35ff7f6-0f62-4ada-8a2f-21b2a159bdcf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.809676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d35ff7f6-0f62-4ada-8a2f-21b2a159bdcf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.810816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d35ff7f6-0f62-4ada-8a2f-21b2a159bdcf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.811341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d35ff7f6-0f62-4ada-8a2f-21b2a159bdcf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.835974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1b318464-aaae-4179-a055-a1cbffce8020 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:38.853800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1b318464-aaae-4179-a055-a1cbffce8020 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:38.855596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1b318464-aaae-4179-a055-a1cbffce8020 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:38.859253 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1b318464-aaae-4179-a055-a1cbffce8020 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.525393 Jul 14 14:44:38.861554 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1721/3424] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:38 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:38.866551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6418808a-21bc-4555-bd1d-84b667bc79b9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:38.874706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6418808a-21bc-4555-bd1d-84b667bc79b9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:38.883376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6418808a-21bc-4555-bd1d-84b667bc79b9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.884256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6418808a-21bc-4555-bd1d-84b667bc79b9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.885376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6418808a-21bc-4555-bd1d-84b667bc79b9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.886039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6418808a-21bc-4555-bd1d-84b667bc79b9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:39.073106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d35ff7f6-0f62-4ada-8a2f-21b2a159bdcf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:39.118833 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d35ff7f6-0f62-4ada-8a2f-21b2a159bdcf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1315 microversion: 2.1 time: 0.330685 Jul 14 14:44:39.121501 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1704/3425] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:38 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:39.136320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-af85403a-2285-4d6b-9ecf-d1deca711688 req-d4dc3b4d-528d-481c-becd-6212d123430c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "tag": "e86e4d9f-79ef-4b60-93ad-9741fa882539"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:39.143442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6418808a-21bc-4555-bd1d-84b667bc79b9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:39.157432 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6418808a-21bc-4555-bd1d-84b667bc79b9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.294428 Jul 14 14:44:39.167581 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1722/3426] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:38 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:39.171133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-af85403a-2285-4d6b-9ecf-d1deca711688 req-d4dc3b4d-528d-481c-becd-6212d123430c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:39.174045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-af85403a-2285-4d6b-9ecf-d1deca711688 req-d4dc3b4d-528d-481c-becd-6212d123430c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:39.190017 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-af85403a-2285-4d6b-9ecf-d1deca711688 req-d4dc3b4d-528d-481c-becd-6212d123430c service nova] Creating event network-changed:e86e4d9f-79ef-4b60-93ad-9741fa882539 for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:44:39.196679 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-af85403a-2285-4d6b-9ecf-d1deca711688 req-d4dc3b4d-528d-481c-becd-6212d123430c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066293 Jul 14 14:44:39.198171 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1705/3427] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:39.791701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4300cf8f-3dbf-44b2-b01d-54e4efc7ff81 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:39.792233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4300cf8f-3dbf-44b2-b01d-54e4efc7ff81 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:39.801841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4300cf8f-3dbf-44b2-b01d-54e4efc7ff81 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:39.802297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4300cf8f-3dbf-44b2-b01d-54e4efc7ff81 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:39.803076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4300cf8f-3dbf-44b2-b01d-54e4efc7ff81 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:39.803891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4300cf8f-3dbf-44b2-b01d-54e4efc7ff81 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:39.890019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9e4d27f3-a988-4140-90c9-74794058499f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:39.891633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9e4d27f3-a988-4140-90c9-74794058499f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:39.903258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e4d27f3-a988-4140-90c9-74794058499f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:39.909666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e4d27f3-a988-4140-90c9-74794058499f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:39.910749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e4d27f3-a988-4140-90c9-74794058499f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:39.911391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e4d27f3-a988-4140-90c9-74794058499f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:40.017976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4300cf8f-3dbf-44b2-b01d-54e4efc7ff81 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:40.028106 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4300cf8f-3dbf-44b2-b01d-54e4efc7ff81 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.240203 Jul 14 14:44:40.029749 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1723/3428] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:39 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:40.136912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d6c29c9a-90ae-4c16-a3be-aa0816c8a2e6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:40.137553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d6c29c9a-90ae-4c16-a3be-aa0816c8a2e6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:40.147030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6c29c9a-90ae-4c16-a3be-aa0816c8a2e6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:40.147908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6c29c9a-90ae-4c16-a3be-aa0816c8a2e6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:40.148997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6c29c9a-90ae-4c16-a3be-aa0816c8a2e6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:40.150328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6c29c9a-90ae-4c16-a3be-aa0816c8a2e6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:40.175132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e4d27f3-a988-4140-90c9-74794058499f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:40.185678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e4d27f3-a988-4140-90c9-74794058499f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:40.188570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e4d27f3-a988-4140-90c9-74794058499f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:40.190706 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9e4d27f3-a988-4140-90c9-74794058499f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.312081 Jul 14 14:44:40.191825 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1706/3429] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:39 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:40.196815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-55a5bbdd-8cf4-415d-b15e-361b9673b4c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:40.197734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-55a5bbdd-8cf4-415d-b15e-361b9673b4c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:40.205482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-55a5bbdd-8cf4-415d-b15e-361b9673b4c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:40.206561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-55a5bbdd-8cf4-415d-b15e-361b9673b4c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:40.207864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-55a5bbdd-8cf4-415d-b15e-361b9673b4c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:40.216151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-55a5bbdd-8cf4-415d-b15e-361b9673b4c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:40.448137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d6c29c9a-90ae-4c16-a3be-aa0816c8a2e6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:40.456421 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d6c29c9a-90ae-4c16-a3be-aa0816c8a2e6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1315 microversion: 2.1 time: 0.323763 Jul 14 14:44:40.462413 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1724/3430] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:40 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:40.556909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-55a5bbdd-8cf4-415d-b15e-361b9673b4c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:40.571810 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-55a5bbdd-8cf4-415d-b15e-361b9673b4c8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.377514 Jul 14 14:44:40.577021 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1707/3431] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:40 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:41.047121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6f158de2-04d3-48db-8ad0-6efa135cc75b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:41.049828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6f158de2-04d3-48db-8ad0-6efa135cc75b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:41.057140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f158de2-04d3-48db-8ad0-6efa135cc75b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:41.057595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f158de2-04d3-48db-8ad0-6efa135cc75b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:41.058492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f158de2-04d3-48db-8ad0-6efa135cc75b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:41.059093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f158de2-04d3-48db-8ad0-6efa135cc75b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:41.209128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6f158de2-04d3-48db-8ad0-6efa135cc75b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:41.215535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5004bcb-d216-4607-abe7-4a5e1aedb56d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:41.217232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e5004bcb-d216-4607-abe7-4a5e1aedb56d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:41.223692 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6f158de2-04d3-48db-8ad0-6efa135cc75b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.180428 Jul 14 14:44:41.224935 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1725/3432] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:41 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:41.233478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5004bcb-d216-4607-abe7-4a5e1aedb56d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:41.234298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5004bcb-d216-4607-abe7-4a5e1aedb56d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:41.235910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5004bcb-d216-4607-abe7-4a5e1aedb56d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:41.236482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5004bcb-d216-4607-abe7-4a5e1aedb56d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:41.259184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:41.358806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:41.480467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b2861d1c-7aa8-4a71-a7e1-8fe3e95a5893 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:41.481835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b2861d1c-7aa8-4a71-a7e1-8fe3e95a5893 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:41.491492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e5004bcb-d216-4607-abe7-4a5e1aedb56d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:41.497320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2861d1c-7aa8-4a71-a7e1-8fe3e95a5893 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:41.498126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2861d1c-7aa8-4a71-a7e1-8fe3e95a5893 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:41.499748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2861d1c-7aa8-4a71-a7e1-8fe3e95a5893 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:41.500525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2861d1c-7aa8-4a71-a7e1-8fe3e95a5893 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:41.505673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e5004bcb-d216-4607-abe7-4a5e1aedb56d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:41.507628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e5004bcb-d216-4607-abe7-4a5e1aedb56d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:41.508930 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e5004bcb-d216-4607-abe7-4a5e1aedb56d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.298578 Jul 14 14:44:41.509860 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1708/3433] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:41 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:41.592443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f8deb2de-4c8c-4db5-941d-7afde08c730c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:41.593135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f8deb2de-4c8c-4db5-941d-7afde08c730c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:41.619778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8deb2de-4c8c-4db5-941d-7afde08c730c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:41.620182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8deb2de-4c8c-4db5-941d-7afde08c730c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:41.621001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8deb2de-4c8c-4db5-941d-7afde08c730c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:41.621486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8deb2de-4c8c-4db5-941d-7afde08c730c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:41.771999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b2861d1c-7aa8-4a71-a7e1-8fe3e95a5893 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:41.789645 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b2861d1c-7aa8-4a71-a7e1-8fe3e95a5893 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1315 microversion: 2.1 time: 0.313879 Jul 14 14:44:41.800186 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1726/3434] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:41 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:41.877766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f8deb2de-4c8c-4db5-941d-7afde08c730c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:41.890204 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f8deb2de-4c8c-4db5-941d-7afde08c730c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1522 microversion: 2.1 time: 0.303676 Jul 14 14:44:41.890803 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1709/3435] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:41 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:42.242566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-300d4794-4fcc-46bb-bd03-75836001ecdc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:42.243215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-300d4794-4fcc-46bb-bd03-75836001ecdc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:42.253506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-300d4794-4fcc-46bb-bd03-75836001ecdc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:42.253983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-300d4794-4fcc-46bb-bd03-75836001ecdc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:42.256862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-300d4794-4fcc-46bb-bd03-75836001ecdc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:42.257697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-300d4794-4fcc-46bb-bd03-75836001ecdc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:42.286461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6e71a3e4-7725-40b1-8495-daaacbccf471 req-02d0c003-5d3c-4f99-a5b4-4ed5bde40157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46286b84-e2d7-4622-b9aa-ee7c39d620c5", "tag": "9dfe359a-880d-4967-b327-8cb1189e1d0b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:42.321291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6e71a3e4-7725-40b1-8495-daaacbccf471 req-02d0c003-5d3c-4f99-a5b4-4ed5bde40157 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:42.322822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6e71a3e4-7725-40b1-8495-daaacbccf471 req-02d0c003-5d3c-4f99-a5b4-4ed5bde40157 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:42.342323 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6e71a3e4-7725-40b1-8495-daaacbccf471 req-02d0c003-5d3c-4f99-a5b4-4ed5bde40157 service nova] Creating event network-changed:9dfe359a-880d-4967-b327-8cb1189e1d0b for instance 46286b84-e2d7-4622-b9aa-ee7c39d620c5 on n-h2-767704-28 Jul 14 14:44:42.350554 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6e71a3e4-7725-40b1-8495-daaacbccf471 req-02d0c003-5d3c-4f99-a5b4-4ed5bde40157 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079070 Jul 14 14:44:42.352244 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1710/3436] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:42.491081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-300d4794-4fcc-46bb-bd03-75836001ecdc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:42.500431 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-300d4794-4fcc-46bb-bd03-75836001ecdc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.262086 Jul 14 14:44:42.502210 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1727/3437] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:42 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:42.531891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4adb36b1-c681-470f-8187-4d7f2964f06d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:42.533424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4adb36b1-c681-470f-8187-4d7f2964f06d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:42.542056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4adb36b1-c681-470f-8187-4d7f2964f06d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:42.543175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4adb36b1-c681-470f-8187-4d7f2964f06d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:42.544258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4adb36b1-c681-470f-8187-4d7f2964f06d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:42.544852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4adb36b1-c681-470f-8187-4d7f2964f06d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:42.807319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-53d83f18-19b8-4124-beeb-15a190f3afd1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:42.808144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-53d83f18-19b8-4124-beeb-15a190f3afd1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:42.829842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:42.852150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-53d83f18-19b8-4124-beeb-15a190f3afd1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:42.852830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-53d83f18-19b8-4124-beeb-15a190f3afd1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:42.854440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-53d83f18-19b8-4124-beeb-15a190f3afd1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:42.855473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-53d83f18-19b8-4124-beeb-15a190f3afd1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:42.870672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:43.160627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4adb36b1-c681-470f-8187-4d7f2964f06d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:43.177047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4adb36b1-c681-470f-8187-4d7f2964f06d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:43.192041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4adb36b1-c681-470f-8187-4d7f2964f06d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:43.198460 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4adb36b1-c681-470f-8187-4d7f2964f06d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.669222 Jul 14 14:44:43.199657 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1711/3438] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:42 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:43.209404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-92a85eef-634e-44cd-9f31-2ed9a653bcd9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:43.210375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-92a85eef-634e-44cd-9f31-2ed9a653bcd9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:43.233389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92a85eef-634e-44cd-9f31-2ed9a653bcd9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:43.234190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92a85eef-634e-44cd-9f31-2ed9a653bcd9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:43.235773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92a85eef-634e-44cd-9f31-2ed9a653bcd9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:43.236443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92a85eef-634e-44cd-9f31-2ed9a653bcd9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:43.550390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-92a85eef-634e-44cd-9f31-2ed9a653bcd9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:43.566786 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-92a85eef-634e-44cd-9f31-2ed9a653bcd9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1502 microversion: 2.1 time: 0.363364 Jul 14 14:44:43.567657 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1712/3439] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:43 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1502 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:43.578486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-53d83f18-19b8-4124-beeb-15a190f3afd1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:43.579643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cd429dec-c75f-4e5c-8c6b-a642a55864d7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:43.580380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cd429dec-c75f-4e5c-8c6b-a642a55864d7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:43.602987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd429dec-c75f-4e5c-8c6b-a642a55864d7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:43.603246 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-53d83f18-19b8-4124-beeb-15a190f3afd1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1315 microversion: 2.1 time: 0.797524 Jul 14 14:44:43.603466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd429dec-c75f-4e5c-8c6b-a642a55864d7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:43.604540 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1728/3440] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:42 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:43.613432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd429dec-c75f-4e5c-8c6b-a642a55864d7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:43.613432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd429dec-c75f-4e5c-8c6b-a642a55864d7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:43.625002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bdcdf0f7-6517-4860-86bc-631e74c6574a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:43.630081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bdcdf0f7-6517-4860-86bc-631e74c6574a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:43.639044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bdcdf0f7-6517-4860-86bc-631e74c6574a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:43.643585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bdcdf0f7-6517-4860-86bc-631e74c6574a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:43.644847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bdcdf0f7-6517-4860-86bc-631e74c6574a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:43.645362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bdcdf0f7-6517-4860-86bc-631e74c6574a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:44.329780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bdcdf0f7-6517-4860-86bc-631e74c6574a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:44.339903 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bdcdf0f7-6517-4860-86bc-631e74c6574a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1516 microversion: 2.1 time: 0.721135 Jul 14 14:44:44.343028 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1729/3441] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:43 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1516 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:44.354708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9af284b3-c203-4064-b353-509d238da666 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:44.355613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9af284b3-c203-4064-b353-509d238da666 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:44.356334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cd429dec-c75f-4e5c-8c6b-a642a55864d7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:44.371057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9af284b3-c203-4064-b353-509d238da666 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:44.373598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9af284b3-c203-4064-b353-509d238da666 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:44.374612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9af284b3-c203-4064-b353-509d238da666 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:44.375211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9af284b3-c203-4064-b353-509d238da666 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:44.393358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:44.399906 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cd429dec-c75f-4e5c-8c6b-a642a55864d7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.829515 Jul 14 14:44:44.402123 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1713/3442] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:43 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:44.410275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d03bdcb-38af-46bd-bc02-fcb26e8109c7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:44.412184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0d03bdcb-38af-46bd-bc02-fcb26e8109c7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 317805e7-4d44-4787-ae24-3cdab4db31b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:44.428632 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-0d03bdcb-38af-46bd-bc02-fcb26e8109c7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] HTTP exception thrown: Instance 317805e7-4d44-4787-ae24-3cdab4db31b9 could not be found. Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d03bdcb-38af-46bd-bc02-fcb26e8109c7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Request method failure captured: Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/317805e7-4d44-4787-ae24-3cdab4db31b9/action HTTP/1.1 Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 14 Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cuaek8QP7ZzyqAnXJWPN7lHiUWz0TNXX6f0nS0pfbQcbYmqHrTXe0rZ97jdQ3uNxUa0EPbwBicPZsDlqLUuoGtatVHJtwILzwCBFVthrwMveMSoYFbetP1TjjR3-iLZvN4xQUw5cjtI-hjvoXzpdUd0pTNdhqPPjM935R8S2VQJlOY Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e9f01277aa24f0fbe464ff8a5378d64", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}] Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 377b67baeabd4588a1945effc9b19113 Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: {"rescue": {}} Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 317805e7-4d44-4787-ae24-3cdab4db31b9 could not be found. Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '317805e7-4d44-4787-ae24-3cdab4db31b9', 'body': {'rescue': {}}} Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317805e7-4d44-4787-ae24-3cdab4db31b9 could not be found. Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317805e7-4d44-4787-ae24-3cdab4db31b9 could not be found. Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:44:44.453249 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:44.457993 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:44.457993 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:44.457993 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:44:44.457993 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:44:44.457993 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317805e7-4d44-4787-ae24-3cdab4db31b9 could not be found. Jul 14 14:44:44.457993 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:44:44.462313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d03bdcb-38af-46bd-bc02-fcb26e8109c7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Returning 404 to user: Instance 317805e7-4d44-4787-ae24-3cdab4db31b9 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:44:44.463459 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0d03bdcb-38af-46bd-bc02-fcb26e8109c7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/317805e7-4d44-4787-ae24-3cdab4db31b9/action" status: 404 len: 111 microversion: 2.1 time: 0.059914 Jul 14 14:44:44.465595 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1714/3443] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:44 2022] POST /compute/v2.1/servers/317805e7-4d44-4787-ae24-3cdab4db31b9/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:44:44.482066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b429ad1b-e39c-47e2-bc76-c4347a32164d req-9bad5ee8-b89c-4ec5-9c0f-c2ab33c8159d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "tag": "847e25f0-cf0b-4884-a99c-bc72592ab04e"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:44.499193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b429ad1b-e39c-47e2-bc76-c4347a32164d req-9bad5ee8-b89c-4ec5-9c0f-c2ab33c8159d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:44.500083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b429ad1b-e39c-47e2-bc76-c4347a32164d req-9bad5ee8-b89c-4ec5-9c0f-c2ab33c8159d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:44.518462 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b429ad1b-e39c-47e2-bc76-c4347a32164d req-9bad5ee8-b89c-4ec5-9c0f-c2ab33c8159d service nova] Creating event network-changed:847e25f0-cf0b-4884-a99c-bc72592ab04e for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:44:44.526903 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b429ad1b-e39c-47e2-bc76-c4347a32164d req-9bad5ee8-b89c-4ec5-9c0f-c2ab33c8159d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059613 Jul 14 14:44:44.527523 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1715/3444] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:44.536149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-db9eacd9-df13-4418-8ab6-c468920555ac tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:44.537067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-db9eacd9-df13-4418-8ab6-c468920555ac tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:44.546989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db9eacd9-df13-4418-8ab6-c468920555ac tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:44.548526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db9eacd9-df13-4418-8ab6-c468920555ac tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:44.551001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db9eacd9-df13-4418-8ab6-c468920555ac tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:44.552853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db9eacd9-df13-4418-8ab6-c468920555ac tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:44.748540 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-db9eacd9-df13-4418-8ab6-c468920555ac tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/action" status: 202 len: 0 microversion: 2.1 time: 0.218550 Jul 14 14:44:44.756820 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1716/3445] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:44 2022] POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:44:44.768892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9cdf6e8-0cdf-4c83-a580-430086ad7594 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:44.770742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c9cdf6e8-0cdf-4c83-a580-430086ad7594 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:44.784427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9cdf6e8-0cdf-4c83-a580-430086ad7594 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:44.785519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9cdf6e8-0cdf-4c83-a580-430086ad7594 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:44.788635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9cdf6e8-0cdf-4c83-a580-430086ad7594 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:44.789929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9cdf6e8-0cdf-4c83-a580-430086ad7594 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.099571 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9af284b3-c203-4064-b353-509d238da666 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:45.119945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9af284b3-c203-4064-b353-509d238da666 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:45.123928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9af284b3-c203-4064-b353-509d238da666 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:45.128086 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9af284b3-c203-4064-b353-509d238da666 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.780928 Jul 14 14:44:45.128740 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1730/3446] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:44 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:45.143405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b8ea3cdc-a3aa-4ddb-8c7e-51a430ec671a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:45.144689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b8ea3cdc-a3aa-4ddb-8c7e-51a430ec671a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:45.161128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8ea3cdc-a3aa-4ddb-8c7e-51a430ec671a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.161835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8ea3cdc-a3aa-4ddb-8c7e-51a430ec671a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.167633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8ea3cdc-a3aa-4ddb-8c7e-51a430ec671a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.168526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8ea3cdc-a3aa-4ddb-8c7e-51a430ec671a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.318508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c9cdf6e8-0cdf-4c83-a580-430086ad7594 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:45.329365 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c9cdf6e8-0cdf-4c83-a580-430086ad7594 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1315 microversion: 2.1 time: 0.569837 Jul 14 14:44:45.331043 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1717/3447] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:44 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:45.390901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b8ea3cdc-a3aa-4ddb-8c7e-51a430ec671a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:45.406533 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b8ea3cdc-a3aa-4ddb-8c7e-51a430ec671a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1501 microversion: 2.1 time: 0.271425 Jul 14 14:44:45.408700 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1731/3448] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:45 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1501 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:45.418430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f7f6f497-5c8f-4e43-b340-eb21dae24865 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:45.419035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f7f6f497-5c8f-4e43-b340-eb21dae24865 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:45.426574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7f6f497-5c8f-4e43-b340-eb21dae24865 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.427229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7f6f497-5c8f-4e43-b340-eb21dae24865 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.428143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7f6f497-5c8f-4e43-b340-eb21dae24865 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.428716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7f6f497-5c8f-4e43-b340-eb21dae24865 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.459122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3baf5fe7-22e8-4e48-bf2d-3a770ab5a6ce tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:45.462064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3baf5fe7-22e8-4e48-bf2d-3a770ab5a6ce tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:45.470537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3baf5fe7-22e8-4e48-bf2d-3a770ab5a6ce tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.472820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3baf5fe7-22e8-4e48-bf2d-3a770ab5a6ce tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.475193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3baf5fe7-22e8-4e48-bf2d-3a770ab5a6ce tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.476455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3baf5fe7-22e8-4e48-bf2d-3a770ab5a6ce tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.559229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-3baf5fe7-22e8-4e48-bf2d-3a770ab5a6ce tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lazy-loading 'flavor' on Instance uuid 91067647-7704-49c5-a1c2-efcfe1474e01 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:44:45.602857 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3baf5fe7-22e8-4e48-bf2d-3a770ab5a6ce tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] HTTP exception thrown: Cannot 'rescue' instance 91067647-7704-49c5-a1c2-efcfe1474e01 while it is in vm_state paused Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3baf5fe7-22e8-4e48-bf2d-3a770ab5a6ce tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Request method failure captured: Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/action HTTP/1.1 Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 14 Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cuaek8QP7ZzyqAnXJWPN7lHiUWz0TNXX6f0nS0pfbQcbYmqHrTXe0rZ97jdQ3uNxUa0EPbwBicPZsDlqLUuoGtatVHJtwILzwCBFVthrwMveMSoYFbetP1TjjR3-iLZvN4xQUw5cjtI-hjvoXzpdUd0pTNdhqPPjM935R8S2VQJlOY Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e9f01277aa24f0fbe464ff8a5378d64", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}] Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 377b67baeabd4588a1945effc9b19113 Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: {"rescue": {}} Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: exception: Cannot 'rescue' instance 91067647-7704-49c5-a1c2-efcfe1474e01 while it is in vm_state paused Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '91067647-7704-49c5-a1c2-efcfe1474e01', 'body': {'rescue': {}}} Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 91067647-7704-49c5-a1c2-efcfe1474e01 in vm_state paused. Cannot rescue while the instance is in this state. Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 91067647-7704-49c5-a1c2-efcfe1474e01 while it is in vm_state paused Jul 14 14:44:45.607927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:44:45.612340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:45.612340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:44:45.612340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:45.612340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:45.612340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:45.612340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:44:45.612340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:44:45.612340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 91067647-7704-49c5-a1c2-efcfe1474e01 while it is in vm_state paused Jul 14 14:44:45.612340 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:44:45.612340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3baf5fe7-22e8-4e48-bf2d-3a770ab5a6ce tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Returning 409 to user: Cannot 'rescue' instance 91067647-7704-49c5-a1c2-efcfe1474e01 while it is in vm_state paused {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:44:45.613391 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3baf5fe7-22e8-4e48-bf2d-3a770ab5a6ce tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/action" status: 409 len: 144 microversion: 2.1 time: 0.187815 Jul 14 14:44:45.616040 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1732/3449] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:45 2022] POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/action => generated 144 bytes in 191 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:44:45.631505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-99a40a6e-fce9-41a2-a1d4-2e345b03e59c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:45.636669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-99a40a6e-fce9-41a2-a1d4-2e345b03e59c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:45.654465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99a40a6e-fce9-41a2-a1d4-2e345b03e59c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.655100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99a40a6e-fce9-41a2-a1d4-2e345b03e59c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.657446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99a40a6e-fce9-41a2-a1d4-2e345b03e59c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.658496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99a40a6e-fce9-41a2-a1d4-2e345b03e59c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.670965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f7f6f497-5c8f-4e43-b340-eb21dae24865 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:45.684676 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f7f6f497-5c8f-4e43-b340-eb21dae24865 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.269632 Jul 14 14:44:45.686736 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1718/3450] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:45 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:45.772994 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-99a40a6e-fce9-41a2-a1d4-2e345b03e59c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/action" status: 202 len: 0 microversion: 2.1 time: 0.151782 Jul 14 14:44:45.773797 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1733/3451] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:45 2022] POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:44:45.791310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-816567f7-1152-4203-b5da-4fd5c0a58500 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:45.794207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-816567f7-1152-4203-b5da-4fd5c0a58500 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:45.811596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-816567f7-1152-4203-b5da-4fd5c0a58500 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.813088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-816567f7-1152-4203-b5da-4fd5c0a58500 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.814266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-816567f7-1152-4203-b5da-4fd5c0a58500 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.814903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-816567f7-1152-4203-b5da-4fd5c0a58500 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.991739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-816567f7-1152-4203-b5da-4fd5c0a58500 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:45.999716 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-816567f7-1152-4203-b5da-4fd5c0a58500 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1508 microversion: 2.1 time: 0.220681 Jul 14 14:44:46.000409 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1719/3452] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:45 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:46.154430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-95bb1fab-39af-469b-bdc5-dcbbab74925c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:46.155298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-95bb1fab-39af-469b-bdc5-dcbbab74925c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:46.162767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95bb1fab-39af-469b-bdc5-dcbbab74925c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:46.163231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95bb1fab-39af-469b-bdc5-dcbbab74925c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:46.164041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95bb1fab-39af-469b-bdc5-dcbbab74925c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:46.164477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95bb1fab-39af-469b-bdc5-dcbbab74925c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:46.348310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2becffae-065d-45cd-8d34-6290e25ac8a6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:46.349149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2becffae-065d-45cd-8d34-6290e25ac8a6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:46.355700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2becffae-065d-45cd-8d34-6290e25ac8a6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:46.356274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2becffae-065d-45cd-8d34-6290e25ac8a6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:46.357838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2becffae-065d-45cd-8d34-6290e25ac8a6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:46.358599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2becffae-065d-45cd-8d34-6290e25ac8a6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:46.369120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-95bb1fab-39af-469b-bdc5-dcbbab74925c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:46.380497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-95bb1fab-39af-469b-bdc5-dcbbab74925c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:46.382188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-95bb1fab-39af-469b-bdc5-dcbbab74925c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:46.383377 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-95bb1fab-39af-469b-bdc5-dcbbab74925c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.233696 Jul 14 14:44:46.384185 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1734/3453] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:46 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:46.506476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2becffae-065d-45cd-8d34-6290e25ac8a6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:46.514602 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2becffae-065d-45cd-8d34-6290e25ac8a6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1315 microversion: 2.1 time: 0.170695 Jul 14 14:44:46.515214 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1720/3454] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:46 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:46.707781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4abd145e-672f-40b6-8526-ca165d5d4408 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:46.708691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4abd145e-672f-40b6-8526-ca165d5d4408 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:46.716107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4abd145e-672f-40b6-8526-ca165d5d4408 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:46.716711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4abd145e-672f-40b6-8526-ca165d5d4408 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:46.717706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4abd145e-672f-40b6-8526-ca165d5d4408 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:46.718317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4abd145e-672f-40b6-8526-ca165d5d4408 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:46.888767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4abd145e-672f-40b6-8526-ca165d5d4408 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:46.899140 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4abd145e-672f-40b6-8526-ca165d5d4408 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.196092 Jul 14 14:44:46.913399 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1735/3455] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:46 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:47.018148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bca7d549-14d5-477f-b1ea-7982c6d4b956 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:47.018778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bca7d549-14d5-477f-b1ea-7982c6d4b956 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:47.029898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bca7d549-14d5-477f-b1ea-7982c6d4b956 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:47.034280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bca7d549-14d5-477f-b1ea-7982c6d4b956 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:47.035218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bca7d549-14d5-477f-b1ea-7982c6d4b956 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:47.035682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bca7d549-14d5-477f-b1ea-7982c6d4b956 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:47.339100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bca7d549-14d5-477f-b1ea-7982c6d4b956 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:47.351247 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bca7d549-14d5-477f-b1ea-7982c6d4b956 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1516 microversion: 2.1 time: 0.335990 Jul 14 14:44:47.351867 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1721/3456] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:47 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1516 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:47.402348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d9141056-12b8-422e-8f36-7f7b25a76870 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:47.402946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d9141056-12b8-422e-8f36-7f7b25a76870 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:47.414352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9141056-12b8-422e-8f36-7f7b25a76870 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:47.416690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9141056-12b8-422e-8f36-7f7b25a76870 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:47.417572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9141056-12b8-422e-8f36-7f7b25a76870 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:47.418028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9141056-12b8-422e-8f36-7f7b25a76870 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:47.536874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7333b799-a8cd-4009-93ba-c9ba83df5ee1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:47.537597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7333b799-a8cd-4009-93ba-c9ba83df5ee1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:47.559966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7333b799-a8cd-4009-93ba-c9ba83df5ee1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:47.568224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7333b799-a8cd-4009-93ba-c9ba83df5ee1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:47.576221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7333b799-a8cd-4009-93ba-c9ba83df5ee1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:47.582878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7333b799-a8cd-4009-93ba-c9ba83df5ee1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:48.154983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d9141056-12b8-422e-8f36-7f7b25a76870 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:48.186660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d9141056-12b8-422e-8f36-7f7b25a76870 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:48.191916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d9141056-12b8-422e-8f36-7f7b25a76870 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:48.193979 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d9141056-12b8-422e-8f36-7f7b25a76870 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.795536 Jul 14 14:44:48.207173 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1736/3457] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:47 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:48.216711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-71e88bb0-c0a8-4eab-8936-bf9c95344dae tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:48.217515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-71e88bb0-c0a8-4eab-8936-bf9c95344dae tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:48.231026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71e88bb0-c0a8-4eab-8936-bf9c95344dae tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:48.231542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71e88bb0-c0a8-4eab-8936-bf9c95344dae tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:48.233201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71e88bb0-c0a8-4eab-8936-bf9c95344dae tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:48.234207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71e88bb0-c0a8-4eab-8936-bf9c95344dae tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:48.303407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7333b799-a8cd-4009-93ba-c9ba83df5ee1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:48.317457 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7333b799-a8cd-4009-93ba-c9ba83df5ee1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1315 microversion: 2.1 time: 0.788202 Jul 14 14:44:48.318342 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1722/3458] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:47 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:48.710470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-71e88bb0-c0a8-4eab-8936-bf9c95344dae tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:48.719157 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-71e88bb0-c0a8-4eab-8936-bf9c95344dae tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.510736 Jul 14 14:44:48.721484 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1737/3459] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:48 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:49.214736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2b4bdc0b-6dcc-4f90-841e-1cbf4a99764c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:49.215632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2b4bdc0b-6dcc-4f90-841e-1cbf4a99764c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:49.229421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b4bdc0b-6dcc-4f90-841e-1cbf4a99764c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:49.230112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b4bdc0b-6dcc-4f90-841e-1cbf4a99764c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:49.232693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b4bdc0b-6dcc-4f90-841e-1cbf4a99764c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:49.233384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b4bdc0b-6dcc-4f90-841e-1cbf4a99764c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:49.347519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7a7bba07-c972-47c3-96f4-95f03941e6fb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:49.348567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7a7bba07-c972-47c3-96f4-95f03941e6fb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:49.364858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a7bba07-c972-47c3-96f4-95f03941e6fb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:49.365541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a7bba07-c972-47c3-96f4-95f03941e6fb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:49.366379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a7bba07-c972-47c3-96f4-95f03941e6fb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:49.366880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a7bba07-c972-47c3-96f4-95f03941e6fb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:50.170101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2b4bdc0b-6dcc-4f90-841e-1cbf4a99764c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:50.180331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2b4bdc0b-6dcc-4f90-841e-1cbf4a99764c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:50.181846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2b4bdc0b-6dcc-4f90-841e-1cbf4a99764c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:50.183133 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2b4bdc0b-6dcc-4f90-841e-1cbf4a99764c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.973395 Jul 14 14:44:50.183712 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1723/3460] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:49 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:50.189885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f3de488-9859-4043-9969-4a69fd10aa1a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:50.190621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3f3de488-9859-4043-9969-4a69fd10aa1a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:50.206483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f3de488-9859-4043-9969-4a69fd10aa1a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:50.206946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f3de488-9859-4043-9969-4a69fd10aa1a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:50.207930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f3de488-9859-4043-9969-4a69fd10aa1a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:50.208524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f3de488-9859-4043-9969-4a69fd10aa1a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:50.291106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7a7bba07-c972-47c3-96f4-95f03941e6fb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:50.300326 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7a7bba07-c972-47c3-96f4-95f03941e6fb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1315 microversion: 2.1 time: 0.961208 Jul 14 14:44:50.301373 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1738/3461] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:49 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1315 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:50.510972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e82c1f0-e4e4-4b94-a90a-73ed1f8284b7 tempest-ListImagesTestJSON-2073881107 tempest-ListImagesTestJSON-2073881107-project] Calling method '.version_select at 0x7fd6c5af20d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:50.514671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3f3de488-9859-4043-9969-4a69fd10aa1a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:50.523793 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3f3de488-9859-4043-9969-4a69fd10aa1a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.338762 Jul 14 14:44:50.524486 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1724/3462] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:50 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:50.539816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e018607a-5795-4b8b-ac6a-7994a1155fd4 req-79c8c7aa-cac9-4554-a988-be056905cf4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46286b84-e2d7-4622-b9aa-ee7c39d620c5", "name": "network-vif-plugged", "status": "completed", "tag": "9dfe359a-880d-4967-b327-8cb1189e1d0b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:50.550618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e018607a-5795-4b8b-ac6a-7994a1155fd4 req-79c8c7aa-cac9-4554-a988-be056905cf4f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:50.552406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e018607a-5795-4b8b-ac6a-7994a1155fd4 req-79c8c7aa-cac9-4554-a988-be056905cf4f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:50.568312 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0e82c1f0-e4e4-4b94-a90a-73ed1f8284b7 tempest-ListImagesTestJSON-2073881107 tempest-ListImagesTestJSON-2073881107-project] 10.222.0.81 "GET /compute/v2.1/images/4f5e5af0-d72c-4006-a62b-d41e489facb7" status: 200 len: 784 microversion: 2.1 time: 0.265515 Jul 14 14:44:50.569458 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1739/3463] 10.222.0.81 () {58 vars in 1232 bytes} [Thu Jul 14 14:44:50 2022] GET /compute/v2.1/images/4f5e5af0-d72c-4006-a62b-d41e489facb7 => generated 784 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:50.569951 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e018607a-5795-4b8b-ac6a-7994a1155fd4 req-79c8c7aa-cac9-4554-a988-be056905cf4f service nova] Creating event network-vif-plugged:9dfe359a-880d-4967-b327-8cb1189e1d0b for instance 46286b84-e2d7-4622-b9aa-ee7c39d620c5 on n-h2-767704-28 Jul 14 14:44:50.577153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b331b8c0-37a5-456b-8687-84481e090eab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:50.578271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b331b8c0-37a5-456b-8687-84481e090eab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:50.579643 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e018607a-5795-4b8b-ac6a-7994a1155fd4 req-79c8c7aa-cac9-4554-a988-be056905cf4f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052538 Jul 14 14:44:50.580498 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1725/3464] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:50.588573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b331b8c0-37a5-456b-8687-84481e090eab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:50.589250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b331b8c0-37a5-456b-8687-84481e090eab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:50.590315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b331b8c0-37a5-456b-8687-84481e090eab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:50.590878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b331b8c0-37a5-456b-8687-84481e090eab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:50.591107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7acf5ef4-2496-4b30-ad8c-3fd6b9852a49 tempest-ListImagesTestJSON-2073881107 tempest-ListImagesTestJSON-2073881107-project] Calling method '.version_select at 0x7fd6c464e820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:50.648792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-b331b8c0-37a5-456b-8687-84481e090eab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lazy-loading 'flavor' on Instance uuid 91067647-7704-49c5-a1c2-efcfe1474e01 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:44:50.700630 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7acf5ef4-2496-4b30-ad8c-3fd6b9852a49 tempest-ListImagesTestJSON-2073881107 tempest-ListImagesTestJSON-2073881107-project] 10.222.0.81 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.117354 Jul 14 14:44:50.708839 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1726/3465] 10.222.0.81 () {58 vars in 1121 bytes} [Thu Jul 14 14:44:50 2022] GET /compute/v2.1/images => generated 445 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:50.716129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea453672-ce05-408d-ad2a-1d952711c443 tempest-ListImagesTestJSON-2073881107 tempest-ListImagesTestJSON-2073881107-project] Calling method '.version_select at 0x7fd6c4652700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:50.780676 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ea453672-ce05-408d-ad2a-1d952711c443 tempest-ListImagesTestJSON-2073881107 tempest-ListImagesTestJSON-2073881107-project] 10.222.0.81 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.070166 Jul 14 14:44:50.781955 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1727/3466] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:44:50 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:50.783550 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b331b8c0-37a5-456b-8687-84481e090eab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/action" status: 200 len: 32 microversion: 2.1 time: 0.212382 Jul 14 14:44:50.784114 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1740/3467] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:50 2022] POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:44:50.800685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5c27140c-8b24-4d75-975c-8673e98e2878 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:50.801481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5c27140c-8b24-4d75-975c-8673e98e2878 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:50.808808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c27140c-8b24-4d75-975c-8673e98e2878 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:50.809302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c27140c-8b24-4d75-975c-8673e98e2878 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:50.810318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c27140c-8b24-4d75-975c-8673e98e2878 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:50.810820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c27140c-8b24-4d75-975c-8673e98e2878 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:51.097372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5c27140c-8b24-4d75-975c-8673e98e2878 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:51.108280 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5c27140c-8b24-4d75-975c-8673e98e2878 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.318852 Jul 14 14:44:51.121723 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1728/3468] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:50 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:51.206245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2075f182-b68d-4c89-8401-d6dc50f5f396 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:51.207406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2075f182-b68d-4c89-8401-d6dc50f5f396 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:51.227324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2075f182-b68d-4c89-8401-d6dc50f5f396 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:51.228152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2075f182-b68d-4c89-8401-d6dc50f5f396 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:51.230298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2075f182-b68d-4c89-8401-d6dc50f5f396 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:51.233623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2075f182-b68d-4c89-8401-d6dc50f5f396 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:51.319464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e0606881-f98f-43b5-8842-dc393212c808 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:51.320292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e0606881-f98f-43b5-8842-dc393212c808 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:51.329493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e0606881-f98f-43b5-8842-dc393212c808 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:51.329950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e0606881-f98f-43b5-8842-dc393212c808 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:51.330747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e0606881-f98f-43b5-8842-dc393212c808 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:51.331190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e0606881-f98f-43b5-8842-dc393212c808 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:51.711222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2075f182-b68d-4c89-8401-d6dc50f5f396 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:51.732337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2075f182-b68d-4c89-8401-d6dc50f5f396 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:51.735671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2075f182-b68d-4c89-8401-d6dc50f5f396 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:51.739063 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2075f182-b68d-4c89-8401-d6dc50f5f396 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.536934 Jul 14 14:44:51.740670 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1741/3469] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:51 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:51.750054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b38d659e-5dc5-4f7c-8237-a1b44c521edb tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:51.752714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b38d659e-5dc5-4f7c-8237-a1b44c521edb tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:51.764457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b38d659e-5dc5-4f7c-8237-a1b44c521edb tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:51.765614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b38d659e-5dc5-4f7c-8237-a1b44c521edb tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:51.767845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b38d659e-5dc5-4f7c-8237-a1b44c521edb tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:51.768822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b38d659e-5dc5-4f7c-8237-a1b44c521edb tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:51.791510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e0606881-f98f-43b5-8842-dc393212c808 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:51.807443 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e0606881-f98f-43b5-8842-dc393212c808 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1315 microversion: 2.1 time: 0.491840 Jul 14 14:44:51.808736 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1729/3470] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:51 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:52.114174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b38d659e-5dc5-4f7c-8237-a1b44c521edb tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:52.117127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:52.129382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fcb410f6-1d8a-49bf-8f06-ad1672d01f83 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:52.130002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fcb410f6-1d8a-49bf-8f06-ad1672d01f83 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:52.131095 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b38d659e-5dc5-4f7c-8237-a1b44c521edb tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.388585 Jul 14 14:44:52.132619 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1742/3471] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:51 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:52.139777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fcb410f6-1d8a-49bf-8f06-ad1672d01f83 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:52.140756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fcb410f6-1d8a-49bf-8f06-ad1672d01f83 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:52.145770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fcb410f6-1d8a-49bf-8f06-ad1672d01f83 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:52.146382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fcb410f6-1d8a-49bf-8f06-ad1672d01f83 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:52.425114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fcb410f6-1d8a-49bf-8f06-ad1672d01f83 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:52.437608 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fcb410f6-1d8a-49bf-8f06-ad1672d01f83 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.312096 Jul 14 14:44:52.442312 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1730/3472] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:52 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:52.759572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-619f350d-d675-41ba-b526-eaee5d3e6354 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:52.761043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-619f350d-d675-41ba-b526-eaee5d3e6354 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:52.769204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-619f350d-d675-41ba-b526-eaee5d3e6354 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:52.769994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-619f350d-d675-41ba-b526-eaee5d3e6354 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:52.771049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-619f350d-d675-41ba-b526-eaee5d3e6354 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:52.771712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-619f350d-d675-41ba-b526-eaee5d3e6354 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:52.834155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1aee9125-c3e0-4781-bf44-02c024fde6b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:52.834767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1aee9125-c3e0-4781-bf44-02c024fde6b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:52.841932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1aee9125-c3e0-4781-bf44-02c024fde6b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:52.842738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1aee9125-c3e0-4781-bf44-02c024fde6b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:52.843739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1aee9125-c3e0-4781-bf44-02c024fde6b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:52.844366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1aee9125-c3e0-4781-bf44-02c024fde6b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.089322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-619f350d-d675-41ba-b526-eaee5d3e6354 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:53.108563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-619f350d-d675-41ba-b526-eaee5d3e6354 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:53.114927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-619f350d-d675-41ba-b526-eaee5d3e6354 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:53.117141 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-619f350d-d675-41ba-b526-eaee5d3e6354 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.361824 Jul 14 14:44:53.123163 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1743/3473] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:52 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:53.138911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1aee9125-c3e0-4781-bf44-02c024fde6b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:53.148665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65392bf2-594d-4231-a051-8964319518d0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:53.149120 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1aee9125-c3e0-4781-bf44-02c024fde6b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1503 microversion: 2.1 time: 0.318880 Jul 14 14:44:53.150100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-65392bf2-594d-4231-a051-8964319518d0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:53.150232 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1731/3474] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:52 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:53.169166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9ba72f24-25f4-40d8-a45d-af952039ab4a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:53.169605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65392bf2-594d-4231-a051-8964319518d0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.170166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9ba72f24-25f4-40d8-a45d-af952039ab4a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:53.170279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65392bf2-594d-4231-a051-8964319518d0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.171162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65392bf2-594d-4231-a051-8964319518d0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.171721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65392bf2-594d-4231-a051-8964319518d0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.180026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ba72f24-25f4-40d8-a45d-af952039ab4a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.180488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ba72f24-25f4-40d8-a45d-af952039ab4a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.181333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ba72f24-25f4-40d8-a45d-af952039ab4a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.181787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ba72f24-25f4-40d8-a45d-af952039ab4a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.253704 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9ba72f24-25f4-40d8-a45d-af952039ab4a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action" status: 200 len: 14 microversion: 2.1 time: 0.085424 Jul 14 14:44:53.254514 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1732/3475] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:53 2022] POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:44:53.396053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-65392bf2-594d-4231-a051-8964319518d0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:53.405618 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65392bf2-594d-4231-a051-8964319518d0 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.260783 Jul 14 14:44:53.407418 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1744/3476] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:53 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:53.455927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9dda8338-a6fd-4337-b192-25866cdabb6f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:53.456782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9dda8338-a6fd-4337-b192-25866cdabb6f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:53.463232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dda8338-a6fd-4337-b192-25866cdabb6f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.464181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dda8338-a6fd-4337-b192-25866cdabb6f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.465181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dda8338-a6fd-4337-b192-25866cdabb6f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.465776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9dda8338-a6fd-4337-b192-25866cdabb6f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.534399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e748dd8-0025-412a-a4dd-5f95ad264087 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Action: 'create', calling method: .version_select at 0x7fd6c463b8b0>, body: {"keypair": {"name": "tempest-keypair-1418753352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeG+kTw/X02Vp6jcxPWDigu2rS//sV1FygklZugEy4kj+1q7IL9N2bto3mv3DSqPCp2xOp+pUe9YTN8qua8jj61PCJlt2Lzrvvwx3GTxzOqqXaaeS9TsbY8E/BKaivGDQ=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:53.550003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-4e748dd8-0025-412a-a4dd-5f95ad264087 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:53.556405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-4e748dd8-0025-412a-a4dd-5f95ad264087 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for user c410df49d08d4a6197dcf6509f8de9b3 and project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:53.572285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:53.596872 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e748dd8-0025-412a-a4dd-5f95ad264087 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.245983 Jul 14 14:44:53.598366 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1733/3477] 10.222.0.81 () {62 vars in 1198 bytes} [Thu Jul 14 14:44:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 248 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:44:53.609597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0e3482ac-d9f8-4ad9-974f-5c851b6de0c2 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c5363ca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:53.619693 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0e3482ac-d9f8-4ad9-974f-5c851b6de0c2 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs/tempest-keypair-1418753352" status: 200 len: 513 microversion: 2.2 time: 0.013787 Jul 14 14:44:53.621143 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1734/3478] 10.222.0.81 () {60 vars in 1257 bytes} [Thu Jul 14 14:44:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1418753352 => generated 513 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:53.635074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1dfbedd7-eb33-4c70-9e9b-884da968ff67 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c533be50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:53.647633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9dda8338-a6fd-4337-b192-25866cdabb6f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:53.656359 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9dda8338-a6fd-4337-b192-25866cdabb6f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.204517 Jul 14 14:44:53.657456 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1745/3479] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:53 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:53.658307 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1dfbedd7-eb33-4c70-9e9b-884da968ff67 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418753352" status: 204 len: 0 microversion: 2.2 time: 0.028011 Jul 14 14:44:53.658922 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1735/3480] 10.222.0.81 () {60 vars in 1260 bytes} [Thu Jul 14 14:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418753352 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:44:53.670730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2e827b05-c1c9-4bbb-b2e3-515491926bb1 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Action: 'create', calling method: .version_select at 0x7fd6c5df9a60>, body: {"keypair": {"name": "tempest-keypair-890033622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3AZwIcqG+ynR1GxRMlhy9y7xKsexUriazi4kwHoghlCAFLZv6EIHWkQEC4TLoajt6pT7+l3QrxGM/7TkNhbZaHG9TB6jeT4itxRwDNa7LLKYWO2U1WTJJboJ1I77VliQ=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:53.687498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2e827b05-c1c9-4bbb-b2e3-515491926bb1 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:53.695558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2e827b05-c1c9-4bbb-b2e3-515491926bb1 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for user c410df49d08d4a6197dcf6509f8de9b3 and project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:53.722631 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2e827b05-c1c9-4bbb-b2e3-515491926bb1 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.056077 Jul 14 14:44:53.723526 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1746/3481] 10.222.0.81 () {62 vars in 1198 bytes} [Thu Jul 14 14:44:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 14 14:44:53.733291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-06e13a06-8d2c-41d7-a726-5c3fb4af3333 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c46521f0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:53.754302 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-06e13a06-8d2c-41d7-a726-5c3fb4af3333 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-890033622" status: 204 len: 0 microversion: 2.2 time: 0.024982 Jul 14 14:44:53.754938 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1736/3482] 10.222.0.81 () {60 vars in 1257 bytes} [Thu Jul 14 14:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-890033622 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:44:53.764514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-da863ce0-994b-4ad3-85bb-24539e523c1e tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Action: 'create', calling method: .version_select at 0x7fd6c4f1ab80>, body: {"keypair": {"name": "tempest-keypair-1496696237", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:53.781603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-da863ce0-994b-4ad3-85bb-24539e523c1e tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:53.787382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-da863ce0-994b-4ad3-85bb-24539e523c1e tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for user c410df49d08d4a6197dcf6509f8de9b3 and project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:53.813634 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-da863ce0-994b-4ad3-85bb-24539e523c1e tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.053253 Jul 14 14:44:53.819029 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1747/3483] 10.222.0.81 () {62 vars in 1198 bytes} [Thu Jul 14 14:44:53 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:44:53.824278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e753becf-689a-49f8-8315-523e3b14928d tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c4652d30>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:53.843177 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e753becf-689a-49f8-8315-523e3b14928d tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496696237" status: 204 len: 0 microversion: 2.2 time: 0.023008 Jul 14 14:44:53.843744 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1737/3484] 10.222.0.81 () {60 vars in 1260 bytes} [Thu Jul 14 14:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496696237 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:44:53.857618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-07a25fe5-25e5-463e-9664-6c53537e544d tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Action: 'create', calling method: .version_select at 0x7fd6c4f6b0d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1261617545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPu2IRDGRODXzhSDTSZszVUy8umWVtLVokr/6SmWR7ittMzCPR/HBDty2+k5xJofgNLswx6lnOcgrSUrXn3jQd8J7FGeoJChAp5QPlr2N3FyT1GOWiP4FffuUeS7zYZ8FA=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:53.875153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-07a25fe5-25e5-463e-9664-6c53537e544d tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:53.881981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-07a25fe5-25e5-463e-9664-6c53537e544d tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for user c410df49d08d4a6197dcf6509f8de9b3 and project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:53.913464 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-07a25fe5-25e5-463e-9664-6c53537e544d tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.060524 Jul 14 14:44:53.914057 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1748/3485] 10.222.0.81 () {62 vars in 1198 bytes} [Thu Jul 14 14:44:53 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:44:53.927888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-953c44e7-5e96-475d-8115-e18ae85a4e97 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Action: 'create', calling method: .version_select at 0x7fd6c53631f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2081208781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfUPftpeOHQiQcQEiI2/LIXD8vAmXuclznqYUoXEqslGBr1d/J8qaVz4eeLcJHAPDUaKYd1oNAOqOUHwYeTnYZGqGtYZH5/ledDfRCNR6xVSDl/0DcDxZz4Vu7i4KmjRQ=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:53.943726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-953c44e7-5e96-475d-8115-e18ae85a4e97 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:53.951677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-953c44e7-5e96-475d-8115-e18ae85a4e97 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for user c410df49d08d4a6197dcf6509f8de9b3 and project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:53.994590 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-953c44e7-5e96-475d-8115-e18ae85a4e97 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.071799 Jul 14 14:44:54.003308 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1738/3486] 10.222.0.81 () {62 vars in 1198 bytes} [Thu Jul 14 14:44:53 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:44:54.009131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9efc982b-748d-4033-96a1-124ec058f8ff tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Action: 'create', calling method: .version_select at 0x7fd6c56f1430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1761949382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDJPdgFa/n4xiAjvBU8CMiZAm80+jtvY1iSOjF9LFt1RbGTygSpX/ORmpHRLaoLc+n+qEFw75RY6GGgpzre/8EM5CuetHqcoraUod90yc3xFHYw4pUZPE5utPejmZ71qQ=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:54.028474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-9efc982b-748d-4033-96a1-124ec058f8ff tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:54.037030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-9efc982b-748d-4033-96a1-124ec058f8ff tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for user c410df49d08d4a6197dcf6509f8de9b3 and project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:54.062493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:54.072212 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9efc982b-748d-4033-96a1-124ec058f8ff tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.067168 Jul 14 14:44:54.073309 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1749/3487] 10.222.0.81 () {62 vars in 1198 bytes} [Thu Jul 14 14:44:54 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:44:54.082966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-12851040-7b3f-49da-b5f7-d0e41c1da351 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c460f160>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:54.085777 n-d-767704-28 devstack@n-api.service[119511]: WARNING oslo_db.sqlalchemy.utils [None req-12851040-7b3f-49da-b5f7-d0e41c1da351 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 14 14:44:54.091575 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-12851040-7b3f-49da-b5f7-d0e41c1da351 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.013052 Jul 14 14:44:54.095080 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1739/3488] 10.222.0.81 () {60 vars in 1176 bytes} [Thu Jul 14 14:44:54 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:54.102970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a7859fdd-c431-44be-80e2-5db10f8a8a1f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c5af6670>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:54.127013 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a7859fdd-c431-44be-80e2-5db10f8a8a1f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1761949382" status: 204 len: 0 microversion: 2.2 time: 0.027745 Jul 14 14:44:54.133017 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1750/3489] 10.222.0.81 () {60 vars in 1320 bytes} [Thu Jul 14 14:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1761949382 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:44:54.138918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-782c0667-3764-4698-8f8d-488372e0efef tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:54.139572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3dfc1093-6325-4e70-a116-1cf1019f5dc4 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c50053a0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:54.139691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-782c0667-3764-4698-8f8d-488372e0efef tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:54.158209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-782c0667-3764-4698-8f8d-488372e0efef tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:54.159123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-782c0667-3764-4698-8f8d-488372e0efef tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:54.160620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-782c0667-3764-4698-8f8d-488372e0efef tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:54.161331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-782c0667-3764-4698-8f8d-488372e0efef tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:54.164881 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3dfc1093-6325-4e70-a116-1cf1019f5dc4 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2081208781" status: 204 len: 0 microversion: 2.2 time: 0.030227 Jul 14 14:44:54.165662 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1751/3490] 10.222.0.81 () {60 vars in 1320 bytes} [Thu Jul 14 14:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2081208781 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:44:54.181836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1bf7b93-a469-47a7-b539-ab3d5938ae26 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c5681dc0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:54.206392 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f1bf7b93-a469-47a7-b539-ab3d5938ae26 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1261617545" status: 204 len: 0 microversion: 2.2 time: 0.029537 Jul 14 14:44:54.207171 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1752/3491] 10.222.0.81 () {60 vars in 1320 bytes} [Thu Jul 14 14:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1261617545 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:44:54.221291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-40a7de45-4f53-4250-abc2-adbc0df73aa1 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Action: 'create', calling method: .version_select at 0x7fd6c4f6bca0>, body: {"keypair": {"name": "tempest-keypair-1226656538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmj2cBb/Gnk9S75AIy7woSISRjj45poB4Ggw/r6k3AE/5bUBRRy7/gfwRoC3RIvpJPCQ1Ms8NMg4mHS3IjWvQIHOPeC04WDFZdD1eVkBK6YeQxxIThCT68xEa2GCqo3qg=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:54.239897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-40a7de45-4f53-4250-abc2-adbc0df73aa1 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:54.246682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-40a7de45-4f53-4250-abc2-adbc0df73aa1 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for user c410df49d08d4a6197dcf6509f8de9b3 and project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:54.277914 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-40a7de45-4f53-4250-abc2-adbc0df73aa1 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.061182 Jul 14 14:44:54.285573 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1753/3492] 10.222.0.81 () {62 vars in 1198 bytes} [Thu Jul 14 14:44:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:44:54.292588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0d4314af-f586-43dc-baf0-ae29e12c0afd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:54.294116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0d4314af-f586-43dc-baf0-ae29e12c0afd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:54.303725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d4314af-f586-43dc-baf0-ae29e12c0afd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:54.304241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d4314af-f586-43dc-baf0-ae29e12c0afd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:54.305471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d4314af-f586-43dc-baf0-ae29e12c0afd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:54.306054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d4314af-f586-43dc-baf0-ae29e12c0afd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:54.353354 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0d4314af-f586-43dc-baf0-ae29e12c0afd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action" status: 200 len: 14 microversion: 2.1 time: 0.066289 Jul 14 14:44:54.354832 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1754/3493] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:54 2022] POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:44:54.361023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-41142a9c-f563-4b09-aa2c-0df53696758a tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c5af6160>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:54.369931 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-41142a9c-f563-4b09-aa2c-0df53696758a tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs/tempest-keypair-1226656538" status: 200 len: 513 microversion: 2.2 time: 0.013865 Jul 14 14:44:54.375531 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1755/3494] 10.222.0.81 () {60 vars in 1257 bytes} [Thu Jul 14 14:44:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1226656538 => generated 513 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:54.386061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ce7562e-2e56-47bf-b5e5-88eb30959b4f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c5a64a60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:54.394280 n-d-767704-28 devstack@n-api.service[119512]: WARNING oslo_db.sqlalchemy.utils [None req-7ce7562e-2e56-47bf-b5e5-88eb30959b4f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 14 14:44:54.403896 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ce7562e-2e56-47bf-b5e5-88eb30959b4f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.025259 Jul 14 14:44:54.411917 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1756/3495] 10.222.0.81 () {60 vars in 1176 bytes} [Thu Jul 14 14:44:54 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:54.419213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-03628cee-d4d6-4c91-b0aa-e74387c9744d tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c4f1a1f0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:54.429528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-782c0667-3764-4698-8f8d-488372e0efef tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:54.445383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-782c0667-3764-4698-8f8d-488372e0efef tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:54.446920 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-03628cee-d4d6-4c91-b0aa-e74387c9744d tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226656538" status: 204 len: 0 microversion: 2.2 time: 0.033505 Jul 14 14:44:54.447893 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1757/3496] 10.222.0.81 () {60 vars in 1260 bytes} [Thu Jul 14 14:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226656538 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:44:54.449388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-782c0667-3764-4698-8f8d-488372e0efef tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:54.450748 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-782c0667-3764-4698-8f8d-488372e0efef tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.317075 Jul 14 14:44:54.453341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6211a0a3-807f-4272-b427-e4abbd503805 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:54.457385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6211a0a3-807f-4272-b427-e4abbd503805 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:54.465255 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1740/3497] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:54 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:54.465412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6211a0a3-807f-4272-b427-e4abbd503805 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:54.465722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6211a0a3-807f-4272-b427-e4abbd503805 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:54.466787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6211a0a3-807f-4272-b427-e4abbd503805 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:54.467272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6211a0a3-807f-4272-b427-e4abbd503805 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:54.471410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9a8d7dd9-6caf-4b2c-9379-a50468c85e1f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Action: 'create', calling method: .version_select at 0x7fd6c5363af0>, body: {"keypair": {"name": "tempest-keypair-1370223171", "type": "x509"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:54.487861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-9a8d7dd9-6caf-4b2c-9379-a50468c85e1f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:54.494678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-9a8d7dd9-6caf-4b2c-9379-a50468c85e1f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for user c410df49d08d4a6197dcf6509f8de9b3 and project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:54.514742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.processutils [None req-9a8d7dd9-6caf-4b2c-9379-a50468c85e1f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp_oypbhct/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp_oypbhct/temp.key -subj /CN=c410df49d08d4a6197dcf6509f8de9b3 -extensions v3_req_client {{(pid=119511) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 14 14:44:54.629600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6211a0a3-807f-4272-b427-e4abbd503805 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:54.637782 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6211a0a3-807f-4272-b427-e4abbd503805 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.188603 Jul 14 14:44:54.638788 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1758/3498] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:54 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:54.674057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9387eceb-2b67-4397-8a11-8d16d282b7fc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:54.675821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9387eceb-2b67-4397-8a11-8d16d282b7fc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:54.684437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9387eceb-2b67-4397-8a11-8d16d282b7fc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:54.685215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9387eceb-2b67-4397-8a11-8d16d282b7fc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:54.686633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9387eceb-2b67-4397-8a11-8d16d282b7fc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:54.687088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9387eceb-2b67-4397-8a11-8d16d282b7fc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:54.843680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.processutils [None req-9a8d7dd9-6caf-4b2c-9379-a50468c85e1f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp_oypbhct/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp_oypbhct/temp.key -subj /CN=c410df49d08d4a6197dcf6509f8de9b3 -extensions v3_req_client" returned: 0 in 0.325s {{(pid=119511) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 14 14:44:54.846240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.processutils [None req-9a8d7dd9-6caf-4b2c-9379-a50468c85e1f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp_oypbhct/temp.key -password pass: {{(pid=119511) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 14 14:44:54.852020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9387eceb-2b67-4397-8a11-8d16d282b7fc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:54.861280 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9387eceb-2b67-4397-8a11-8d16d282b7fc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.191543 Jul 14 14:44:54.862565 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1759/3499] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:54 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:54.891021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.processutils [None req-9a8d7dd9-6caf-4b2c-9379-a50468c85e1f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp_oypbhct/temp.key -password pass:" returned: 0 in 0.044s {{(pid=119511) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 14 14:44:54.974678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-9a8d7dd9-6caf-4b2c-9379-a50468c85e1f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:54.982834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-9a8d7dd9-6caf-4b2c-9379-a50468c85e1f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Getting quotas for user c410df49d08d4a6197dcf6509f8de9b3 and project d45e1c9fa0c14b60af4bbf9a06974063. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:55.002947 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9a8d7dd9-6caf-4b2c-9379-a50468c85e1f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.535565 Jul 14 14:44:55.004115 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1741/3500] 10.222.0.81 () {62 vars in 1197 bytes} [Thu Jul 14 14:44:54 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 538 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:44:55.013736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a89dc155-c36a-4be4-9100-77e3f9bce9d7 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c57171f0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:55.021581 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a89dc155-c36a-4be4-9100-77e3f9bce9d7 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs/tempest-keypair-1370223171" status: 200 len: 1534 microversion: 2.2 time: 0.011800 Jul 14 14:44:55.022400 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1760/3501] 10.222.0.81 () {60 vars in 1257 bytes} [Thu Jul 14 14:44:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1370223171 => generated 1534 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:55.034315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b22b05ca-5cd9-4c2a-a7f7-151bf75ddd68 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c56ad1f0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:55.037243 n-d-767704-28 devstack@n-api.service[119511]: WARNING oslo_db.sqlalchemy.utils [None req-b22b05ca-5cd9-4c2a-a7f7-151bf75ddd68 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 14 14:44:55.042946 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b22b05ca-5cd9-4c2a-a7f7-151bf75ddd68 tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.013948 Jul 14 14:44:55.043764 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1742/3502] 10.222.0.81 () {60 vars in 1176 bytes} [Thu Jul 14 14:44:55 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:55.064854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-884dbfc9-3af6-48ca-b168-34b2c7335f3f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] Calling method '.version_select at 0x7fd6c5c46af0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:55.089999 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-884dbfc9-3af6-48ca-b168-34b2c7335f3f tempest-KeyPairsV22TestJSON-1738574195 tempest-KeyPairsV22TestJSON-1738574195-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370223171" status: 204 len: 0 microversion: 2.2 time: 0.039361 Jul 14 14:44:55.090494 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1761/3503] 10.222.0.81 () {60 vars in 1260 bytes} [Thu Jul 14 14:44:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370223171 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:44:55.365153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21e5a48c-6f53-490c-b9e1-022d29fc7a2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:55.366465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-21e5a48c-6f53-490c-b9e1-022d29fc7a2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:55.377547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21e5a48c-6f53-490c-b9e1-022d29fc7a2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:55.378424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21e5a48c-6f53-490c-b9e1-022d29fc7a2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:55.381577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21e5a48c-6f53-490c-b9e1-022d29fc7a2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:55.383897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21e5a48c-6f53-490c-b9e1-022d29fc7a2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:55.419635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:55.453955 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21e5a48c-6f53-490c-b9e1-022d29fc7a2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action" status: 200 len: 14 microversion: 2.1 time: 0.093570 Jul 14 14:44:55.462784 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1743/3504] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:55 2022] POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:44:55.473119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b196a2f-50fe-4039-b50d-bd1c11167c02 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:55.473768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3b196a2f-50fe-4039-b50d-bd1c11167c02 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:55.482420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b196a2f-50fe-4039-b50d-bd1c11167c02 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:55.482912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b196a2f-50fe-4039-b50d-bd1c11167c02 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:55.483756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b196a2f-50fe-4039-b50d-bd1c11167c02 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:55.484213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b196a2f-50fe-4039-b50d-bd1c11167c02 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:55.656885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99d63ffa-20da-49ba-be12-8513d989b2ff tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:55.658544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-99d63ffa-20da-49ba-be12-8513d989b2ff tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:55.674396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99d63ffa-20da-49ba-be12-8513d989b2ff tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:55.675137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99d63ffa-20da-49ba-be12-8513d989b2ff tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:55.676600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99d63ffa-20da-49ba-be12-8513d989b2ff tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:55.677307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99d63ffa-20da-49ba-be12-8513d989b2ff tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:55.858012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b196a2f-50fe-4039-b50d-bd1c11167c02 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:55.870028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b196a2f-50fe-4039-b50d-bd1c11167c02 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:55.871247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b196a2f-50fe-4039-b50d-bd1c11167c02 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:55.872750 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b196a2f-50fe-4039-b50d-bd1c11167c02 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.404519 Jul 14 14:44:55.885971 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1762/3505] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:55 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:55.892560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-57d29d03-b8d3-4578-abbd-65c9a774ef0f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:55.893645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-57d29d03-b8d3-4578-abbd-65c9a774ef0f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:55.911301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57d29d03-b8d3-4578-abbd-65c9a774ef0f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:55.912156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57d29d03-b8d3-4578-abbd-65c9a774ef0f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:55.915886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57d29d03-b8d3-4578-abbd-65c9a774ef0f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:55.916681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57d29d03-b8d3-4578-abbd-65c9a774ef0f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:56.030942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-99d63ffa-20da-49ba-be12-8513d989b2ff tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:56.042487 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99d63ffa-20da-49ba-be12-8513d989b2ff tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.391093 Jul 14 14:44:56.053169 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1744/3506] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:55 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:56.209986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-57d29d03-b8d3-4578-abbd-65c9a774ef0f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:56.223688 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-57d29d03-b8d3-4578-abbd-65c9a774ef0f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.336364 Jul 14 14:44:56.224498 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1763/3507] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:55 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:56.476737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e8db25dc-3e5b-42aa-afc6-7678d81185aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:56.478922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e8db25dc-3e5b-42aa-afc6-7678d81185aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:56.502775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8db25dc-3e5b-42aa-afc6-7678d81185aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:56.503533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8db25dc-3e5b-42aa-afc6-7678d81185aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:56.505002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8db25dc-3e5b-42aa-afc6-7678d81185aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:56.507963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8db25dc-3e5b-42aa-afc6-7678d81185aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:56.587106 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e8db25dc-3e5b-42aa-afc6-7678d81185aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action" status: 200 len: 14 microversion: 2.1 time: 0.115852 Jul 14 14:44:56.588583 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1745/3508] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:56 2022] POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:44:56.900795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-307690bd-ae9e-4c7a-a573-b000b0a05fa0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:56.901568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-307690bd-ae9e-4c7a-a573-b000b0a05fa0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:56.915056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-307690bd-ae9e-4c7a-a573-b000b0a05fa0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:56.920844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-307690bd-ae9e-4c7a-a573-b000b0a05fa0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:56.923104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-307690bd-ae9e-4c7a-a573-b000b0a05fa0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:56.924593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-307690bd-ae9e-4c7a-a573-b000b0a05fa0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:57.060700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-49865f39-50ea-4f41-bc6c-828b34573323 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:57.062309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-49865f39-50ea-4f41-bc6c-828b34573323 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:57.076840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49865f39-50ea-4f41-bc6c-828b34573323 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:57.087065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49865f39-50ea-4f41-bc6c-828b34573323 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:57.093966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49865f39-50ea-4f41-bc6c-828b34573323 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:57.098108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49865f39-50ea-4f41-bc6c-828b34573323 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:57.430940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-307690bd-ae9e-4c7a-a573-b000b0a05fa0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:57.448556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-307690bd-ae9e-4c7a-a573-b000b0a05fa0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:57.457068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-307690bd-ae9e-4c7a-a573-b000b0a05fa0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:57.458694 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-307690bd-ae9e-4c7a-a573-b000b0a05fa0 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.567181 Jul 14 14:44:57.472567 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1764/3509] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:56 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:57.480395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-86302065-a554-4ddc-80dc-9219f08cda41 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:57.482376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-86302065-a554-4ddc-80dc-9219f08cda41 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:57.502681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86302065-a554-4ddc-80dc-9219f08cda41 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:57.503560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86302065-a554-4ddc-80dc-9219f08cda41 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:57.505943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86302065-a554-4ddc-80dc-9219f08cda41 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:57.506230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-49865f39-50ea-4f41-bc6c-828b34573323 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:57.507637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86302065-a554-4ddc-80dc-9219f08cda41 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:57.530238 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-49865f39-50ea-4f41-bc6c-828b34573323 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.473885 Jul 14 14:44:57.530850 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1746/3510] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:57 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:57.601793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e04a2a2c-9d65-448e-92d5-a75de793a805 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:57.603078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e04a2a2c-9d65-448e-92d5-a75de793a805 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:57.614259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e04a2a2c-9d65-448e-92d5-a75de793a805 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:57.614710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e04a2a2c-9d65-448e-92d5-a75de793a805 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:57.615609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e04a2a2c-9d65-448e-92d5-a75de793a805 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:57.616018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e04a2a2c-9d65-448e-92d5-a75de793a805 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:57.694449 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e04a2a2c-9d65-448e-92d5-a75de793a805 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action" status: 200 len: 14 microversion: 2.1 time: 0.097253 Jul 14 14:44:57.695680 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1747/3511] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:57 2022] POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:44:57.773248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-86302065-a554-4ddc-80dc-9219f08cda41 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:57.782512 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-86302065-a554-4ddc-80dc-9219f08cda41 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.307222 Jul 14 14:44:57.783781 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1765/3512] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:57 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:58.481353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ffdeb67b-9a2a-4a4a-a7dc-3d81d9c7bf08 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:58.482390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ffdeb67b-9a2a-4a4a-a7dc-3d81d9c7bf08 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:58.494463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffdeb67b-9a2a-4a4a-a7dc-3d81d9c7bf08 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:58.499852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffdeb67b-9a2a-4a4a-a7dc-3d81d9c7bf08 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:58.506309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffdeb67b-9a2a-4a4a-a7dc-3d81d9c7bf08 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:58.506953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffdeb67b-9a2a-4a4a-a7dc-3d81d9c7bf08 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:58.548615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e10f4e1c-cb93-4841-b1b4-87fa488f674b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:58.549270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e10f4e1c-cb93-4841-b1b4-87fa488f674b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:58.563596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e10f4e1c-cb93-4841-b1b4-87fa488f674b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:58.564395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e10f4e1c-cb93-4841-b1b4-87fa488f674b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:58.577380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e10f4e1c-cb93-4841-b1b4-87fa488f674b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:58.578625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e10f4e1c-cb93-4841-b1b4-87fa488f674b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:58.981530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e10f4e1c-cb93-4841-b1b4-87fa488f674b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:58.999858 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e10f4e1c-cb93-4841-b1b4-87fa488f674b tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.456131 Jul 14 14:44:59.017010 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1766/3513] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:58 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:59.022856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c8445e7f-2086-470d-8069-e5d1f18a982d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:59.024643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c8445e7f-2086-470d-8069-e5d1f18a982d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:59.039022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8445e7f-2086-470d-8069-e5d1f18a982d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:59.041097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8445e7f-2086-470d-8069-e5d1f18a982d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:59.042130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8445e7f-2086-470d-8069-e5d1f18a982d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:59.042661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8445e7f-2086-470d-8069-e5d1f18a982d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:59.128380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ffdeb67b-9a2a-4a4a-a7dc-3d81d9c7bf08 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:59.139679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c8445e7f-2086-470d-8069-e5d1f18a982d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action" status: 200 len: 14 microversion: 2.1 time: 0.123158 Jul 14 14:44:59.141680 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1767/3514] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:59 2022] POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:44:59.150177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a0172c0c-3620-4e5a-917c-f264b5b04667 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:59.151142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a0172c0c-3620-4e5a-917c-f264b5b04667 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:59.160587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ffdeb67b-9a2a-4a4a-a7dc-3d81d9c7bf08 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:59.162284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ffdeb67b-9a2a-4a4a-a7dc-3d81d9c7bf08 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:59.165183 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ffdeb67b-9a2a-4a4a-a7dc-3d81d9c7bf08 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.688269 Jul 14 14:44:59.167736 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1748/3515] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:58 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:59.171869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0172c0c-3620-4e5a-917c-f264b5b04667 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:59.177298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0172c0c-3620-4e5a-917c-f264b5b04667 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:59.178516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0172c0c-3620-4e5a-917c-f264b5b04667 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:59.179132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0172c0c-3620-4e5a-917c-f264b5b04667 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:59.545809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a0172c0c-3620-4e5a-917c-f264b5b04667 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:59.568354 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a0172c0c-3620-4e5a-917c-f264b5b04667 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.424229 Jul 14 14:44:59.570585 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1768/3516] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:59 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:00.033362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8ed6115-96e9-49c0-9563-dd27fdd3593c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:00.035384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b8ed6115-96e9-49c0-9563-dd27fdd3593c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:00.052716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8ed6115-96e9-49c0-9563-dd27fdd3593c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:00.055991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8ed6115-96e9-49c0-9563-dd27fdd3593c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:00.058540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8ed6115-96e9-49c0-9563-dd27fdd3593c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:00.059380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8ed6115-96e9-49c0-9563-dd27fdd3593c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:00.151692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e7562ca5-8dcf-43b8-b779-5c0080b6fc30 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:00.152771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e7562ca5-8dcf-43b8-b779-5c0080b6fc30 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:00.166600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7562ca5-8dcf-43b8-b779-5c0080b6fc30 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:00.167059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7562ca5-8dcf-43b8-b779-5c0080b6fc30 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:00.167939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7562ca5-8dcf-43b8-b779-5c0080b6fc30 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:00.168303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7562ca5-8dcf-43b8-b779-5c0080b6fc30 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:00.241858 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e7562ca5-8dcf-43b8-b779-5c0080b6fc30 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action" status: 200 len: 14 microversion: 2.1 time: 0.094109 Jul 14 14:45:00.242902 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1769/3517] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:00 2022] POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:45:00.248181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2d90e365-182d-4894-86ae-042c2f2f1a58 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:00.248899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2d90e365-182d-4894-86ae-042c2f2f1a58 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:00.257332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d90e365-182d-4894-86ae-042c2f2f1a58 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:00.258030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d90e365-182d-4894-86ae-042c2f2f1a58 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:00.259008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d90e365-182d-4894-86ae-042c2f2f1a58 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:00.259608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d90e365-182d-4894-86ae-042c2f2f1a58 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:00.911776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b8ed6115-96e9-49c0-9563-dd27fdd3593c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:00.925720 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b8ed6115-96e9-49c0-9563-dd27fdd3593c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.897956 Jul 14 14:45:00.926892 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1749/3518] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:00 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:00.937591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6bd54ea9-8cb8-4eec-aa15-64933406a2a8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:00.939880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6bd54ea9-8cb8-4eec-aa15-64933406a2a8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:00.947915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2d90e365-182d-4894-86ae-042c2f2f1a58 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:00.948424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6bd54ea9-8cb8-4eec-aa15-64933406a2a8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:00.949427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6bd54ea9-8cb8-4eec-aa15-64933406a2a8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:00.950611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6bd54ea9-8cb8-4eec-aa15-64933406a2a8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:00.951358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6bd54ea9-8cb8-4eec-aa15-64933406a2a8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:00.971190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2d90e365-182d-4894-86ae-042c2f2f1a58 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:00.973127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2d90e365-182d-4894-86ae-042c2f2f1a58 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:00.975192 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2d90e365-182d-4894-86ae-042c2f2f1a58 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.730561 Jul 14 14:45:00.976309 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1770/3519] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:00 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:01.252818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a4be654c-0d49-4e3b-8bfe-f80cc1c678c7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:01.254035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a4be654c-0d49-4e3b-8bfe-f80cc1c678c7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:01.276829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4be654c-0d49-4e3b-8bfe-f80cc1c678c7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:01.277218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4be654c-0d49-4e3b-8bfe-f80cc1c678c7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:01.294300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4be654c-0d49-4e3b-8bfe-f80cc1c678c7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:01.295006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4be654c-0d49-4e3b-8bfe-f80cc1c678c7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:01.362183 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a4be654c-0d49-4e3b-8bfe-f80cc1c678c7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action" status: 200 len: 14 microversion: 2.1 time: 0.112823 Jul 14 14:45:01.363673 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1771/3520] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:01 2022] POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:45:01.578568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6bd54ea9-8cb8-4eec-aa15-64933406a2a8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:01.591420 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6bd54ea9-8cb8-4eec-aa15-64933406a2a8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.661839 Jul 14 14:45:01.592372 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1750/3521] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:00 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:01.948280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a0e522b-e681-49b2-a9f0-70d150f6daa2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:01.949027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0a0e522b-e681-49b2-a9f0-70d150f6daa2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:01.973284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a0e522b-e681-49b2-a9f0-70d150f6daa2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:01.986928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a0e522b-e681-49b2-a9f0-70d150f6daa2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:01.988252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a0e522b-e681-49b2-a9f0-70d150f6daa2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:01.988873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a0e522b-e681-49b2-a9f0-70d150f6daa2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:01.999935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9a6affe8-7abd-4e2f-b05d-ccdffb0f2304 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:02.000993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9a6affe8-7abd-4e2f-b05d-ccdffb0f2304 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:02.018646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a6affe8-7abd-4e2f-b05d-ccdffb0f2304 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:02.019302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a6affe8-7abd-4e2f-b05d-ccdffb0f2304 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:02.020324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a6affe8-7abd-4e2f-b05d-ccdffb0f2304 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:02.020935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a6affe8-7abd-4e2f-b05d-ccdffb0f2304 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:02.453277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0a0e522b-e681-49b2-a9f0-70d150f6daa2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:02.473294 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0a0e522b-e681-49b2-a9f0-70d150f6daa2 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.520464 Jul 14 14:45:02.474133 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1772/3522] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:01 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:02.489405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f06296c1-8b3a-4c76-b50d-b18fc0114af0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:02.490967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f06296c1-8b3a-4c76-b50d-b18fc0114af0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:02.506951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f06296c1-8b3a-4c76-b50d-b18fc0114af0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:02.511854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f06296c1-8b3a-4c76-b50d-b18fc0114af0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:02.513043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f06296c1-8b3a-4c76-b50d-b18fc0114af0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:02.513707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f06296c1-8b3a-4c76-b50d-b18fc0114af0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:02.544547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9a6affe8-7abd-4e2f-b05d-ccdffb0f2304 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:02.557595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9a6affe8-7abd-4e2f-b05d-ccdffb0f2304 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:02.560557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9a6affe8-7abd-4e2f-b05d-ccdffb0f2304 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:02.564149 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9a6affe8-7abd-4e2f-b05d-ccdffb0f2304 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.572332 Jul 14 14:45:02.564986 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1751/3523] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:01 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:02.614609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ff149b5a-0996-449e-aa28-73788c4e8b24 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:02.616274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ff149b5a-0996-449e-aa28-73788c4e8b24 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:02.634113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff149b5a-0996-449e-aa28-73788c4e8b24 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:02.634902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff149b5a-0996-449e-aa28-73788c4e8b24 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:02.636706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff149b5a-0996-449e-aa28-73788c4e8b24 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:02.638861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff149b5a-0996-449e-aa28-73788c4e8b24 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:02.791596 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f06296c1-8b3a-4c76-b50d-b18fc0114af0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action" status: 200 len: 14 microversion: 2.1 time: 0.306885 Jul 14 14:45:02.792253 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1773/3524] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:02 2022] POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action => generated 14 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:45:03.056163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ff149b5a-0996-449e-aa28-73788c4e8b24 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:03.068936 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ff149b5a-0996-449e-aa28-73788c4e8b24 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.462054 Jul 14 14:45:03.069511 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1752/3525] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:02 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:45:03.495517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a4720424-4ba3-4b62-b88a-30da317c7473 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:03.496833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a4720424-4ba3-4b62-b88a-30da317c7473 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:03.513243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4720424-4ba3-4b62-b88a-30da317c7473 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:03.518638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4720424-4ba3-4b62-b88a-30da317c7473 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:03.519503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4720424-4ba3-4b62-b88a-30da317c7473 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:03.519950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4720424-4ba3-4b62-b88a-30da317c7473 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:03.525949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:03.584155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-277f24b6-0a3c-4811-a3e3-7004adffcfea tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:03.584695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-277f24b6-0a3c-4811-a3e3-7004adffcfea tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:03.594084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-277f24b6-0a3c-4811-a3e3-7004adffcfea tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:03.594883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-277f24b6-0a3c-4811-a3e3-7004adffcfea tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:03.598126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-277f24b6-0a3c-4811-a3e3-7004adffcfea tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:03.598805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-277f24b6-0a3c-4811-a3e3-7004adffcfea tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:03.990939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a4720424-4ba3-4b62-b88a-30da317c7473 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:04.010708 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a4720424-4ba3-4b62-b88a-30da317c7473 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.523556 Jul 14 14:45:04.018822 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1774/3526] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:03 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:04.023990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f65f487e-26b8-464c-b510-9a751e2e55e8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:04.034435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f65f487e-26b8-464c-b510-9a751e2e55e8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:04.053764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f65f487e-26b8-464c-b510-9a751e2e55e8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:04.054327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f65f487e-26b8-464c-b510-9a751e2e55e8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:04.055227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f65f487e-26b8-464c-b510-9a751e2e55e8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:04.055746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f65f487e-26b8-464c-b510-9a751e2e55e8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:04.114364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-277f24b6-0a3c-4811-a3e3-7004adffcfea tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:04.133544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-277f24b6-0a3c-4811-a3e3-7004adffcfea tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:04.145710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-277f24b6-0a3c-4811-a3e3-7004adffcfea tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:04.147978 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-277f24b6-0a3c-4811-a3e3-7004adffcfea tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.568017 Jul 14 14:45:04.152665 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1753/3527] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:03 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:04.163079 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f65f487e-26b8-464c-b510-9a751e2e55e8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action" status: 200 len: 14 microversion: 2.1 time: 0.142311 Jul 14 14:45:04.166900 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1775/3528] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:04 2022] POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:45:04.192743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4e28653b-9db2-4603-9cfc-38bd0054302c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:04.194964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4e28653b-9db2-4603-9cfc-38bd0054302c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:04.209923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4e28653b-9db2-4603-9cfc-38bd0054302c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:04.210706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4e28653b-9db2-4603-9cfc-38bd0054302c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:04.212420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4e28653b-9db2-4603-9cfc-38bd0054302c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:04.215115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4e28653b-9db2-4603-9cfc-38bd0054302c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:04.272002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=20 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:04.523732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-363ec637-a82b-4c7e-ab95-d79ea0116f5d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:04.524686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-363ec637-a82b-4c7e-ab95-d79ea0116f5d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:04.544084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-363ec637-a82b-4c7e-ab95-d79ea0116f5d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:04.544638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-363ec637-a82b-4c7e-ab95-d79ea0116f5d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:04.545589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-363ec637-a82b-4c7e-ab95-d79ea0116f5d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:04.546083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-363ec637-a82b-4c7e-ab95-d79ea0116f5d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:04.607326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4e28653b-9db2-4603-9cfc-38bd0054302c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:04.637360 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4e28653b-9db2-4603-9cfc-38bd0054302c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.464365 Jul 14 14:45:04.638931 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1776/3529] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:04 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:04.668531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-363ec637-a82b-4c7e-ab95-d79ea0116f5d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:04.986238 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-363ec637-a82b-4c7e-ab95-d79ea0116f5d tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 204 len: 0 microversion: 2.42 time: 0.825215 Jul 14 14:45:04.987076 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1754/3530] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:45:04 2022] DELETE /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:45:04.999691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-46fe1fc8-33a7-4d53-b43b-b871acf7f884 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:05.000654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-46fe1fc8-33a7-4d53-b43b-b871acf7f884 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:05.022668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46fe1fc8-33a7-4d53-b43b-b871acf7f884 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:05.025687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46fe1fc8-33a7-4d53-b43b-b871acf7f884 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:05.029636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46fe1fc8-33a7-4d53-b43b-b871acf7f884 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:05.030188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46fe1fc8-33a7-4d53-b43b-b871acf7f884 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:05.037569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f7aa7aac-9990-4e0a-afe7-64479bda6280 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:05.038589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f7aa7aac-9990-4e0a-afe7-64479bda6280 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:05.054625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=16 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:05.060931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7aa7aac-9990-4e0a-afe7-64479bda6280 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:05.065764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7aa7aac-9990-4e0a-afe7-64479bda6280 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:05.066803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7aa7aac-9990-4e0a-afe7-64479bda6280 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:05.067365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7aa7aac-9990-4e0a-afe7-64479bda6280 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:05.967853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-46fe1fc8-33a7-4d53-b43b-b871acf7f884 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:05.992835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-46fe1fc8-33a7-4d53-b43b-b871acf7f884 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:05.996827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-46fe1fc8-33a7-4d53-b43b-b871acf7f884 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:05.998494 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-46fe1fc8-33a7-4d53-b43b-b871acf7f884 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 2960 microversion: 2.42 time: 1.006307 Jul 14 14:45:05.999485 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1777/3531] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:04 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 2960 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:06.022234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1554dfbf-4748-4c63-b8dd-dca453e0747d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:06.025120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1554dfbf-4748-4c63-b8dd-dca453e0747d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:06.039273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1554dfbf-4748-4c63-b8dd-dca453e0747d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:06.040211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1554dfbf-4748-4c63-b8dd-dca453e0747d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:06.041373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1554dfbf-4748-4c63-b8dd-dca453e0747d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:06.042032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1554dfbf-4748-4c63-b8dd-dca453e0747d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:06.065692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f7aa7aac-9990-4e0a-afe7-64479bda6280 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:06.078445 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f7aa7aac-9990-4e0a-afe7-64479bda6280 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1484 microversion: 2.1 time: 1.047449 Jul 14 14:45:06.082933 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1755/3532] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:05 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1484 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:06.096921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f6f2fd46-98c8-4699-8d14-ed17334c11eb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:06.099326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f6f2fd46-98c8-4699-8d14-ed17334c11eb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:06.118060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6f2fd46-98c8-4699-8d14-ed17334c11eb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:06.119679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6f2fd46-98c8-4699-8d14-ed17334c11eb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:06.121664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6f2fd46-98c8-4699-8d14-ed17334c11eb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:06.122964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6f2fd46-98c8-4699-8d14-ed17334c11eb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:06.213523 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f6f2fd46-98c8-4699-8d14-ed17334c11eb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action" status: 200 len: 8204 microversion: 2.1 time: 0.127706 Jul 14 14:45:06.228732 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1756/3533] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:06 2022] POST /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5/action => generated 8204 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:06.247304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7a5363a1-7d26-4d46-8e67-ab959ba5b018 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:06.250656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7a5363a1-7d26-4d46-8e67-ab959ba5b018 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:06.268466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a5363a1-7d26-4d46-8e67-ab959ba5b018 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:06.268907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a5363a1-7d26-4d46-8e67-ab959ba5b018 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:06.269992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a5363a1-7d26-4d46-8e67-ab959ba5b018 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:06.270203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a5363a1-7d26-4d46-8e67-ab959ba5b018 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:06.677838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1554dfbf-4748-4c63-b8dd-dca453e0747d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:06.693438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1554dfbf-4748-4c63-b8dd-dca453e0747d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:06.699616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1554dfbf-4748-4c63-b8dd-dca453e0747d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:06.700911 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1554dfbf-4748-4c63-b8dd-dca453e0747d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.700186 Jul 14 14:45:06.701547 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1778/3534] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:05 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:06.716559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b59eb08-d336-4a15-b07e-1bf6f6f32b0c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:06.716748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5b59eb08-d336-4a15-b07e-1bf6f6f32b0c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:06.741131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b59eb08-d336-4a15-b07e-1bf6f6f32b0c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:06.741877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b59eb08-d336-4a15-b07e-1bf6f6f32b0c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:06.743514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b59eb08-d336-4a15-b07e-1bf6f6f32b0c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:06.743977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b59eb08-d336-4a15-b07e-1bf6f6f32b0c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:06.863737 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b59eb08-d336-4a15-b07e-1bf6f6f32b0c tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "POST /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f/action" status: 202 len: 0 microversion: 2.1 time: 0.156936 Jul 14 14:45:06.865038 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1779/3535] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:06 2022] POST /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:06.872338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-93cf6045-20d4-4de4-a6ff-62182c36197d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:06.873272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-93cf6045-20d4-4de4-a6ff-62182c36197d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:06.883188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93cf6045-20d4-4de4-a6ff-62182c36197d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:06.884087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93cf6045-20d4-4de4-a6ff-62182c36197d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:06.885563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93cf6045-20d4-4de4-a6ff-62182c36197d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:06.886783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93cf6045-20d4-4de4-a6ff-62182c36197d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:06.922431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7a5363a1-7d26-4d46-8e67-ab959ba5b018 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:06.930499 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7a5363a1-7d26-4d46-8e67-ab959ba5b018 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.699540 Jul 14 14:45:06.931315 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1757/3536] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:06 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:06.942382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-31a0989b-48ab-49c3-8776-52fb9a117647 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:06.943065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-31a0989b-48ab-49c3-8776-52fb9a117647 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:06.962540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-31a0989b-48ab-49c3-8776-52fb9a117647 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:06.963002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-31a0989b-48ab-49c3-8776-52fb9a117647 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:06.963885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-31a0989b-48ab-49c3-8776-52fb9a117647 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:06.964221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-31a0989b-48ab-49c3-8776-52fb9a117647 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:07.379529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-93cf6045-20d4-4de4-a6ff-62182c36197d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:07.397479 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-93cf6045-20d4-4de4-a6ff-62182c36197d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.531138 Jul 14 14:45:07.398077 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1780/3537] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:06 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:07.404250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-723e429f-5380-43c6-9fb9-bb84d433820e tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:07.404863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-723e429f-5380-43c6-9fb9-bb84d433820e tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:07.427190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-723e429f-5380-43c6-9fb9-bb84d433820e tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:07.427660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-723e429f-5380-43c6-9fb9-bb84d433820e tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:07.428467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-723e429f-5380-43c6-9fb9-bb84d433820e tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:07.428910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-723e429f-5380-43c6-9fb9-bb84d433820e tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:07.520531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-31a0989b-48ab-49c3-8776-52fb9a117647 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:07.533405 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-31a0989b-48ab-49c3-8776-52fb9a117647 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1492 microversion: 2.1 time: 0.601112 Jul 14 14:45:07.534086 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1758/3538] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:06 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1492 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:07.546970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cccd93ad-60ca-4e88-ae60-d227a6a54c75 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:07.547844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cccd93ad-60ca-4e88-ae60-d227a6a54c75 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:07.558921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cccd93ad-60ca-4e88-ae60-d227a6a54c75 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:07.559383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cccd93ad-60ca-4e88-ae60-d227a6a54c75 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:07.560182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cccd93ad-60ca-4e88-ae60-d227a6a54c75 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:07.560621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cccd93ad-60ca-4e88-ae60-d227a6a54c75 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:07.589759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:08.061116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-723e429f-5380-43c6-9fb9-bb84d433820e tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:08.077432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-723e429f-5380-43c6-9fb9-bb84d433820e tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:08.079676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-723e429f-5380-43c6-9fb9-bb84d433820e tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:08.085956 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-723e429f-5380-43c6-9fb9-bb84d433820e tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 2960 microversion: 2.42 time: 0.683717 Jul 14 14:45:08.089976 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1781/3539] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:07 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 2960 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:08.098546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc1e40a9-0148-4f93-b095-cd21524b6995 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:08.102102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc1e40a9-0148-4f93-b095-cd21524b6995 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:08.109311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc1e40a9-0148-4f93-b095-cd21524b6995 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:08.110646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc1e40a9-0148-4f93-b095-cd21524b6995 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:08.111649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc1e40a9-0148-4f93-b095-cd21524b6995 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:08.112447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc1e40a9-0148-4f93-b095-cd21524b6995 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:08.226501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cccd93ad-60ca-4e88-ae60-d227a6a54c75 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:08.235960 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cccd93ad-60ca-4e88-ae60-d227a6a54c75 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.691834 Jul 14 14:45:08.248350 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1759/3540] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:07 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:08.254597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e48a9ed8-ff77-453c-aa5d-f0d32098047b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:08.255606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e48a9ed8-ff77-453c-aa5d-f0d32098047b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:08.262601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e48a9ed8-ff77-453c-aa5d-f0d32098047b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:08.264452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e48a9ed8-ff77-453c-aa5d-f0d32098047b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:08.265579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e48a9ed8-ff77-453c-aa5d-f0d32098047b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:08.266271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e48a9ed8-ff77-453c-aa5d-f0d32098047b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:08.675159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc1e40a9-0148-4f93-b095-cd21524b6995 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:08.698517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc1e40a9-0148-4f93-b095-cd21524b6995 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:08.704566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc1e40a9-0148-4f93-b095-cd21524b6995 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:08.709673 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc1e40a9-0148-4f93-b095-cd21524b6995 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.618851 Jul 14 14:45:08.712932 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1782/3541] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:08 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:08.740206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05b7f966-740d-4ef3-84f1-5c3b22fe1985 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:08.742004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-05b7f966-740d-4ef3-84f1-5c3b22fe1985 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:08.763675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05b7f966-740d-4ef3-84f1-5c3b22fe1985 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:08.765603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05b7f966-740d-4ef3-84f1-5c3b22fe1985 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:08.771981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05b7f966-740d-4ef3-84f1-5c3b22fe1985 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:08.771981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05b7f966-740d-4ef3-84f1-5c3b22fe1985 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:08.808516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e48a9ed8-ff77-453c-aa5d-f0d32098047b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:08.823305 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e48a9ed8-ff77-453c-aa5d-f0d32098047b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.573353 Jul 14 14:45:08.823916 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1760/3542] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:08 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:08.829653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c5afd44a-85ef-433c-a7a5-b415741fc7d6 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:08.831917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c5afd44a-85ef-433c-a7a5-b415741fc7d6 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:08.838380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:08.848605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5afd44a-85ef-433c-a7a5-b415741fc7d6 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:08.849200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5afd44a-85ef-433c-a7a5-b415741fc7d6 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:08.850066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5afd44a-85ef-433c-a7a5-b415741fc7d6 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:08.853881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5afd44a-85ef-433c-a7a5-b415741fc7d6 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:09.454350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-05b7f966-740d-4ef3-84f1-5c3b22fe1985 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:09.467218 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-05b7f966-740d-4ef3-84f1-5c3b22fe1985 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.737731 Jul 14 14:45:09.473711 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1783/3543] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:08 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:09.483096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-50ddecb8-304c-47ac-9ad8-f3bc24cbc0a8 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:09.484522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-50ddecb8-304c-47ac-9ad8-f3bc24cbc0a8 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:09.492511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50ddecb8-304c-47ac-9ad8-f3bc24cbc0a8 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:09.493180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50ddecb8-304c-47ac-9ad8-f3bc24cbc0a8 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:09.494041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50ddecb8-304c-47ac-9ad8-f3bc24cbc0a8 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:09.494416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50ddecb8-304c-47ac-9ad8-f3bc24cbc0a8 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:09.510092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c5afd44a-85ef-433c-a7a5-b415741fc7d6 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:09.523376 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c5afd44a-85ef-433c-a7a5-b415741fc7d6 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1492 microversion: 2.1 time: 0.696406 Jul 14 14:45:09.534080 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1761/3544] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:08 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1492 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:09.540182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7fa535d4-aa43-4e3b-948a-e7be96311423 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:09.541030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7fa535d4-aa43-4e3b-948a-e7be96311423 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:09.567627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fa535d4-aa43-4e3b-948a-e7be96311423 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:09.568102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fa535d4-aa43-4e3b-948a-e7be96311423 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:09.568899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fa535d4-aa43-4e3b-948a-e7be96311423 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:09.570979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fa535d4-aa43-4e3b-948a-e7be96311423 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:10.036159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-50ddecb8-304c-47ac-9ad8-f3bc24cbc0a8 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:10.039579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7fa535d4-aa43-4e3b-948a-e7be96311423 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:10.066846 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7fa535d4-aa43-4e3b-948a-e7be96311423 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.530171 Jul 14 14:45:10.067680 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1762/3545] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:09 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:10.067933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-50ddecb8-304c-47ac-9ad8-f3bc24cbc0a8 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:10.073174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-50ddecb8-304c-47ac-9ad8-f3bc24cbc0a8 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:10.074789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-50ddecb8-304c-47ac-9ad8-f3bc24cbc0a8 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 2960 microversion: 2.42 time: 0.605639 Jul 14 14:45:10.078246 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1784/3546] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:09 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 2960 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:10.081035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b3e34bfd-b42b-405e-86b9-70529c052593 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:10.082613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b3e34bfd-b42b-405e-86b9-70529c052593 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:10.108233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3e34bfd-b42b-405e-86b9-70529c052593 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:10.109195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3e34bfd-b42b-405e-86b9-70529c052593 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:10.110923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3e34bfd-b42b-405e-86b9-70529c052593 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:10.112075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3e34bfd-b42b-405e-86b9-70529c052593 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:10.442365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-99ea3064-f3ee-43b9-b5a9-be355a5db9bf tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c4eb8280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1091280789", "description": "tempest-description-1304087626"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:10.474674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b3e34bfd-b42b-405e-86b9-70529c052593 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:10.491907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b3e34bfd-b42b-405e-86b9-70529c052593 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:10.493465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b3e34bfd-b42b-405e-86b9-70529c052593 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:10.494891 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b3e34bfd-b42b-405e-86b9-70529c052593 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.424850 Jul 14 14:45:10.496184 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1763/3547] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:10 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:10.504424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d0e46f63-70ee-48f2-8dee-15c695f2617b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:10.509930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d0e46f63-70ee-48f2-8dee-15c695f2617b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:10.528227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0e46f63-70ee-48f2-8dee-15c695f2617b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:10.528821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0e46f63-70ee-48f2-8dee-15c695f2617b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:10.529707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0e46f63-70ee-48f2-8dee-15c695f2617b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:10.530329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0e46f63-70ee-48f2-8dee-15c695f2617b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:10.857766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d0e46f63-70ee-48f2-8dee-15c695f2617b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:10.888200 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d0e46f63-70ee-48f2-8dee-15c695f2617b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.383064 Jul 14 14:45:10.910386 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-99ea3064-f3ee-43b9-b5a9-be355a5db9bf tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.830272 Jul 14 14:45:10.918216 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1764/3548] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:10 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:10.926839 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1785/3549] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:45:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:10.930708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-020bb054-d261-4a74-8c51-2e9500addbcc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:10.932008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-28fe7b89-5195-4b9a-97ce-6c3aac956ff1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:10.932620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-28fe7b89-5195-4b9a-97ce-6c3aac956ff1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:10.933196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-020bb054-d261-4a74-8c51-2e9500addbcc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:10.945160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-020bb054-d261-4a74-8c51-2e9500addbcc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:10.946442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-020bb054-d261-4a74-8c51-2e9500addbcc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:10.948895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-020bb054-d261-4a74-8c51-2e9500addbcc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:10.949629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-020bb054-d261-4a74-8c51-2e9500addbcc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:10.966691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28fe7b89-5195-4b9a-97ce-6c3aac956ff1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:10.967156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28fe7b89-5195-4b9a-97ce-6c3aac956ff1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:10.967957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28fe7b89-5195-4b9a-97ce-6c3aac956ff1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:10.971014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28fe7b89-5195-4b9a-97ce-6c3aac956ff1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:11.082874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-28fe7b89-5195-4b9a-97ce-6c3aac956ff1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Locking {{(pid=119511) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 14 14:45:11.311487 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-28fe7b89-5195-4b9a-97ce-6c3aac956ff1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.383332 Jul 14 14:45:11.316608 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1765/3550] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:10 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:11.328138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bb841dcb-7011-49d1-904e-0fc3adb7b0a0 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c5da69d0>, body: {"security_group_rule": {"parent_group_id": "ae7d5bb6-d010-47c2-8590-e60571b212f2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:11.355332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-020bb054-d261-4a74-8c51-2e9500addbcc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:11.366792 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-020bb054-d261-4a74-8c51-2e9500addbcc tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1492 microversion: 2.1 time: 0.445324 Jul 14 14:45:11.371596 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1786/3551] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:10 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1492 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:11.380317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c1572133-50be-4f0c-a98a-80846093cd06 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:11.386778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c1572133-50be-4f0c-a98a-80846093cd06 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:11.406404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c1572133-50be-4f0c-a98a-80846093cd06 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:11.408508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c1572133-50be-4f0c-a98a-80846093cd06 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:11.409617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c1572133-50be-4f0c-a98a-80846093cd06 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:11.410297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c1572133-50be-4f0c-a98a-80846093cd06 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:11.938002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c1572133-50be-4f0c-a98a-80846093cd06 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:11.965935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c1572133-50be-4f0c-a98a-80846093cd06 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:11.967943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c1572133-50be-4f0c-a98a-80846093cd06 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:11.970078 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c1572133-50be-4f0c-a98a-80846093cd06 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 2960 microversion: 2.42 time: 0.596546 Jul 14 14:45:11.970999 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1787/3552] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:11 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 2960 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:11.977695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c512b314-b26b-4c1e-b958-497cc8193397 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:11.978740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c512b314-b26b-4c1e-b958-497cc8193397 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:11.986645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c512b314-b26b-4c1e-b958-497cc8193397 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:11.989538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c512b314-b26b-4c1e-b958-497cc8193397 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:11.991082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c512b314-b26b-4c1e-b958-497cc8193397 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:11.991748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c512b314-b26b-4c1e-b958-497cc8193397 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.009720 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bb841dcb-7011-49d1-904e-0fc3adb7b0a0 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.694705 Jul 14 14:45:12.019509 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1766/3553] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:45:11 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:12.025127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f5f2f9f7-b2ce-414a-b528-b93b8525304f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:12.026223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f5f2f9f7-b2ce-414a-b528-b93b8525304f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:12.041817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5f2f9f7-b2ce-414a-b528-b93b8525304f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.042568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5f2f9f7-b2ce-414a-b528-b93b8525304f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.043559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5f2f9f7-b2ce-414a-b528-b93b8525304f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.044166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5f2f9f7-b2ce-414a-b528-b93b8525304f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.366456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c512b314-b26b-4c1e-b958-497cc8193397 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:12.375584 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c512b314-b26b-4c1e-b958-497cc8193397 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.403035 Jul 14 14:45:12.378740 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1788/3554] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:11 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:12.388586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2885e91d-a113-4449-8654-96ad8701aa20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:12.390143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2885e91d-a113-4449-8654-96ad8701aa20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:12.403546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2885e91d-a113-4449-8654-96ad8701aa20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.408047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2885e91d-a113-4449-8654-96ad8701aa20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.410277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2885e91d-a113-4449-8654-96ad8701aa20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.410880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2885e91d-a113-4449-8654-96ad8701aa20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.479058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f5f2f9f7-b2ce-414a-b528-b93b8525304f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:12.495134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f5f2f9f7-b2ce-414a-b528-b93b8525304f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:12.496739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f5f2f9f7-b2ce-414a-b528-b93b8525304f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:12.498018 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f5f2f9f7-b2ce-414a-b528-b93b8525304f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.477131 Jul 14 14:45:12.500361 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1767/3555] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:12 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:12.521932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4fedfba4-59b2-4148-abdb-8d95ab9d45c0 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c460f3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-786571285", "description": "tempest-description-1342744992"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:12.748679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2885e91d-a113-4449-8654-96ad8701aa20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:12.764863 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2885e91d-a113-4449-8654-96ad8701aa20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1502 microversion: 2.1 time: 0.383624 Jul 14 14:45:12.771060 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1789/3556] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:12 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1502 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:12.780829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-04e82362-319c-4175-bf8f-85f0caa6e424 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:12.790747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-04e82362-319c-4175-bf8f-85f0caa6e424 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:12.812846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=93,nova_api:DELETE=5 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:12.819660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04e82362-319c-4175-bf8f-85f0caa6e424 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.820432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04e82362-319c-4175-bf8f-85f0caa6e424 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.822409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04e82362-319c-4175-bf8f-85f0caa6e424 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.824930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04e82362-319c-4175-bf8f-85f0caa6e424 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:13.316098 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4fedfba4-59b2-4148-abdb-8d95ab9d45c0 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.799680 Jul 14 14:45:13.316714 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1768/3557] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:45:12 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:13.322155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-209c6630-9c7f-4aaa-b155-4e2086623e51 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:13.333792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-209c6630-9c7f-4aaa-b155-4e2086623e51 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:13.341398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-209c6630-9c7f-4aaa-b155-4e2086623e51 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:13.369328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04e82362-319c-4175-bf8f-85f0caa6e424 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:13.383852 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-04e82362-319c-4175-bf8f-85f0caa6e424 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1498 microversion: 2.1 time: 0.609704 Jul 14 14:45:13.387977 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1790/3558] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:12 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1498 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:13.398274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-463a9431-51fc-461b-8bde-ea36711e4893 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2821c63b-14de-48cb-bfda-750d6226f527"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:13.399783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-463a9431-51fc-461b-8bde-ea36711e4893 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:13.408803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-463a9431-51fc-461b-8bde-ea36711e4893 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:13.409702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-463a9431-51fc-461b-8bde-ea36711e4893 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:13.410914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-463a9431-51fc-461b-8bde-ea36711e4893 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:13.411520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-463a9431-51fc-461b-8bde-ea36711e4893 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:13.418629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:13.425138 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-209c6630-9c7f-4aaa-b155-4e2086623e51 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] HTTP exception thrown: Instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 is locked Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-209c6630-9c7f-4aaa-b155-4e2086623e51 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Request method failure captured: Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action HTTP/1.1 Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 15 Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CqeTHaua1mrAoMsWalZYpPqmTQ-DcKvLbCsfPO7qDbpKBxxTx4n3bTPRxjIsY87FdmdIpxDuFpmylNVxXWu7O4aKHski9z6vXFgUEATmO5T5a4xVEdgMgmRCGrZRc-L7A0A1cYH36dJi-2mZ9w6VAAL7DBepATCUrn7iOaopLMMuR0 Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1933006fa13c44ae9128f00267210152 Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1933006fa13c44ae9128f00267210152"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1933006fa13c44ae9128f00267210152"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1933006fa13c44ae9128f00267210152", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1933006fa13c44ae9128f00267210152"}]}] Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1933006fa13c44ae9128f00267210152 Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-1472511591-project Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f157150edd1d441aa2c7335dbb2363ca Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-1472511591-project Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: {"os-stop": {}} Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 is locked Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '2b55c122-95db-42f1-95a9-ae5bbb4ff958', 'body': {'os-stop': {}}} Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 is locked Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1450, in _stop_server Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 is locked Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 is locked Jul 14 14:45:13.427487 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:13.433081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-209c6630-9c7f-4aaa-b155-4e2086623e51 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Returning 409 to user: Instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 is locked {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:13.434289 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-209c6630-9c7f-4aaa-b155-4e2086623e51 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 409 len: 107 microversion: 2.1 time: 0.116430 Jul 14 14:45:13.435622 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1769/3559] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:13 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 107 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:45:13.442783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f0f1c7ca-6cdb-4157-842b-6403946d4011 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:13.445379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f0f1c7ca-6cdb-4157-842b-6403946d4011 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:13.455649 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-463a9431-51fc-461b-8bde-ea36711e4893 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] HTTP exception thrown: Cannot 'attach_volume' instance 91067647-7704-49c5-a1c2-efcfe1474e01 while it is in vm_state rescued Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-463a9431-51fc-461b-8bde-ea36711e4893 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Request method failure captured: Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/os-volume_attachments HTTP/1.1 Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 74 Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cuaek8QP7ZzyqAnXJWPN7lHiUWz0TNXX6f0nS0pfbQcbYmqHrTXe0rZ97jdQ3uNxUa0EPbwBicPZsDlqLUuoGtatVHJtwILzwCBFVthrwMveMSoYFbetP1TjjR3-iLZvN4xQUw5cjtI-hjvoXzpdUd0pTNdhqPPjM935R8S2VQJlOY Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e9f01277aa24f0fbe464ff8a5378d64", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}] Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 377b67baeabd4588a1945effc9b19113 Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: {"volumeAttachment": {"volumeId": "2821c63b-14de-48cb-bfda-750d6226f527"}} Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: exception: Cannot 'attach_volume' instance 91067647-7704-49c5-a1c2-efcfe1474e01 while it is in vm_state rescued Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'server_id': '91067647-7704-49c5-a1c2-efcfe1474e01', 'body': {'volumeAttachment': {'volumeId': '2821c63b-14de-48cb-bfda-750d6226f527'}}} Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 91067647-7704-49c5-a1c2-efcfe1474e01 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 14:45:13.457888 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 91067647-7704-49c5-a1c2-efcfe1474e01 while it is in vm_state rescued Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 91067647-7704-49c5-a1c2-efcfe1474e01 while it is in vm_state rescued Jul 14 14:45:13.461931 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:13.463480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0f1c7ca-6cdb-4157-842b-6403946d4011 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:13.463741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-463a9431-51fc-461b-8bde-ea36711e4893 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Returning 409 to user: Cannot 'attach_volume' instance 91067647-7704-49c5-a1c2-efcfe1474e01 while it is in vm_state rescued {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:13.465235 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-463a9431-51fc-461b-8bde-ea36711e4893 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.075372 Jul 14 14:45:13.465816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0f1c7ca-6cdb-4157-842b-6403946d4011 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:13.466720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0f1c7ca-6cdb-4157-842b-6403946d4011 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:13.469951 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1791/3560] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:45:13 2022] POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/os-volume_attachments => generated 152 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:45:13.470541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0f1c7ca-6cdb-4157-842b-6403946d4011 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:13.478507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9d3c58b5-3c2b-4062-b850-ca1f68f56f49 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c5aae550>, body: {"security_group_rule": {"parent_group_id": "a5769bc8-ce1e-4db1-ad30-ae3ddf59e6e1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:13.978700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f0f1c7ca-6cdb-4157-842b-6403946d4011 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:13.995687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f0f1c7ca-6cdb-4157-842b-6403946d4011 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:13.999281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f0f1c7ca-6cdb-4157-842b-6403946d4011 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:14.008471 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f0f1c7ca-6cdb-4157-842b-6403946d4011 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 2939 microversion: 2.42 time: 0.571475 Jul 14 14:45:14.009252 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1770/3561] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:13 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 2939 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:14.027210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80dbca17-f50b-45a3-9e37-cf34f6081d3a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:14.027210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80dbca17-f50b-45a3-9e37-cf34f6081d3a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:14.045477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80dbca17-f50b-45a3-9e37-cf34f6081d3a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:14.045946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80dbca17-f50b-45a3-9e37-cf34f6081d3a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:14.046756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80dbca17-f50b-45a3-9e37-cf34f6081d3a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:14.046863 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9d3c58b5-3c2b-4062-b850-ca1f68f56f49 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.575270 Jul 14 14:45:14.047213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80dbca17-f50b-45a3-9e37-cf34f6081d3a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:14.048203 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1792/3562] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:45:13 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:14.057876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-78b53e7a-9666-4329-b0fa-76bbbf525652 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:14.058801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-78b53e7a-9666-4329-b0fa-76bbbf525652 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:14.073218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78b53e7a-9666-4329-b0fa-76bbbf525652 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:14.074033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78b53e7a-9666-4329-b0fa-76bbbf525652 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:14.075065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78b53e7a-9666-4329-b0fa-76bbbf525652 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:14.075666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78b53e7a-9666-4329-b0fa-76bbbf525652 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:14.105816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80dbca17-f50b-45a3-9e37-cf34f6081d3a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:14.259376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-78b53e7a-9666-4329-b0fa-76bbbf525652 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Unlocking {{(pid=119512) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 14 14:45:14.268747 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80dbca17-f50b-45a3-9e37-cf34f6081d3a tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 204 len: 0 microversion: 2.1 time: 0.245796 Jul 14 14:45:14.269394 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1771/3563] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:45:14 2022] DELETE /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:45:14.286624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a6092031-017f-4edb-a50c-3f3c07222e3c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:14.287730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a6092031-017f-4edb-a50c-3f3c07222e3c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:14.301727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6092031-017f-4edb-a50c-3f3c07222e3c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:14.303423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6092031-017f-4edb-a50c-3f3c07222e3c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:14.306737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6092031-017f-4edb-a50c-3f3c07222e3c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:14.308535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6092031-017f-4edb-a50c-3f3c07222e3c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:14.398173 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-78b53e7a-9666-4329-b0fa-76bbbf525652 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.348381 Jul 14 14:45:14.398878 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1793/3564] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:14 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:14.417990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-938e2dc3-058c-4ffe-ad6a-f0a0d9d41eff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:14.423860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-938e2dc3-058c-4ffe-ad6a-f0a0d9d41eff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:14.434298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-938e2dc3-058c-4ffe-ad6a-f0a0d9d41eff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:14.435169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-938e2dc3-058c-4ffe-ad6a-f0a0d9d41eff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:14.436139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-938e2dc3-058c-4ffe-ad6a-f0a0d9d41eff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:14.436727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-938e2dc3-058c-4ffe-ad6a-f0a0d9d41eff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:14.540203 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a6092031-017f-4edb-a50c-3f3c07222e3c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/action" status: 202 len: 0 microversion: 2.1 time: 0.265541 Jul 14 14:45:14.549815 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1772/3565] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:14 2022] POST /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:14.575517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e8d1bc30-9846-401b-8ac5-bb2daf6340ed tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c5e7e940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-297918127", "description": "tempest-description-1960352287"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:15.141813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-938e2dc3-058c-4ffe-ad6a-f0a0d9d41eff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:15.165645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-938e2dc3-058c-4ffe-ad6a-f0a0d9d41eff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:15.177288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-938e2dc3-058c-4ffe-ad6a-f0a0d9d41eff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:15.182175 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-938e2dc3-058c-4ffe-ad6a-f0a0d9d41eff tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.770010 Jul 14 14:45:15.183405 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1794/3566] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:14 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:15.196424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1e1a13b3-7666-4603-b2b7-6b5c77d50807 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:15.197420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1e1a13b3-7666-4603-b2b7-6b5c77d50807 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:15.216780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e1a13b3-7666-4603-b2b7-6b5c77d50807 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:15.217349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e1a13b3-7666-4603-b2b7-6b5c77d50807 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:15.218473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e1a13b3-7666-4603-b2b7-6b5c77d50807 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:15.218935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e1a13b3-7666-4603-b2b7-6b5c77d50807 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:15.819543 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e8d1bc30-9846-401b-8ac5-bb2daf6340ed tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.266181 Jul 14 14:45:15.827041 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1773/3567] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:45:14 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:15.832837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aa5585c5-af52-471b-ba67-80732890f2ad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:15.847803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa5585c5-af52-471b-ba67-80732890f2ad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:15.848277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa5585c5-af52-471b-ba67-80732890f2ad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:15.894180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:15.934819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aa5585c5-af52-471b-ba67-80732890f2ad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Going to try to stop instance {{(pid=119511) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:45:16.056459 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aa5585c5-af52-471b-ba67-80732890f2ad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.227660 Jul 14 14:45:16.060563 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1774/3568] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:15 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:16.076180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-713cd41c-8c00-4929-8edc-bf3f66ec4c9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:16.095520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-713cd41c-8c00-4929-8edc-bf3f66ec4c9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:16.113340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-713cd41c-8c00-4929-8edc-bf3f66ec4c9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:16.115775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-713cd41c-8c00-4929-8edc-bf3f66ec4c9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:16.116766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-713cd41c-8c00-4929-8edc-bf3f66ec4c9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:16.120250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-713cd41c-8c00-4929-8edc-bf3f66ec4c9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:16.797363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-713cd41c-8c00-4929-8edc-bf3f66ec4c9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:16.806342 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-713cd41c-8c00-4929-8edc-bf3f66ec4c9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1510 microversion: 2.1 time: 0.740775 Jul 14 14:45:16.819994 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1775/3569] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:16 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1510 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:16.825272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aefb511f-cece-4562-8ff4-09f2f400de1f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:16.833895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aefb511f-cece-4562-8ff4-09f2f400de1f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:16.848322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aefb511f-cece-4562-8ff4-09f2f400de1f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:16.851446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aefb511f-cece-4562-8ff4-09f2f400de1f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:16.852694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aefb511f-cece-4562-8ff4-09f2f400de1f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:16.853810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aefb511f-cece-4562-8ff4-09f2f400de1f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:16.886528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1e1a13b3-7666-4603-b2b7-6b5c77d50807 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:16.900213 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1e1a13b3-7666-4603-b2b7-6b5c77d50807 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 1.711954 Jul 14 14:45:16.901447 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1795/3570] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:15 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:16.914475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-df8820ae-3ac0-4edc-839e-05f54735180e tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c4eb99d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-32213465", "description": "tempest-description-1023832651"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:17.302704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aefb511f-cece-4562-8ff4-09f2f400de1f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:17.312689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aefb511f-cece-4562-8ff4-09f2f400de1f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:17.314815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aefb511f-cece-4562-8ff4-09f2f400de1f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:17.316137 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aefb511f-cece-4562-8ff4-09f2f400de1f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 2871 microversion: 2.42 time: 0.494903 Jul 14 14:45:17.316726 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1776/3571] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:16 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 2871 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:17.338707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e411a506-d4bd-48ed-b69f-168e602824e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:17.344652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e411a506-d4bd-48ed-b69f-168e602824e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:17.367063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e411a506-d4bd-48ed-b69f-168e602824e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:17.367772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e411a506-d4bd-48ed-b69f-168e602824e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:17.368742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e411a506-d4bd-48ed-b69f-168e602824e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:17.369367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e411a506-d4bd-48ed-b69f-168e602824e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:17.723095 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-df8820ae-3ac0-4edc-839e-05f54735180e tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.820403 Jul 14 14:45:17.724207 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1796/3572] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:45:16 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:17.730227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9fe77664-fc6d-4642-a3a1-54a92605dda8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:17.731196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9fe77664-fc6d-4642-a3a1-54a92605dda8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:17.743967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9fe77664-fc6d-4642-a3a1-54a92605dda8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:17.744698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9fe77664-fc6d-4642-a3a1-54a92605dda8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:17.745324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9fe77664-fc6d-4642-a3a1-54a92605dda8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:17.745766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9fe77664-fc6d-4642-a3a1-54a92605dda8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:17.761000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e411a506-d4bd-48ed-b69f-168e602824e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:17.773694 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e411a506-d4bd-48ed-b69f-168e602824e4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1681 microversion: 2.1 time: 0.439415 Jul 14 14:45:17.774301 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1777/3573] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:17 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1681 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:17.779547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d0f208c8-ccbd-4fe9-afb0-400c7743ce35 req-b2bab1df-de6c-4fc8-806b-922f5b4344e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "name": "network-vif-deleted", "tag": "555c0602-6141-4525-b74a-9dd96ba32274"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:17.803663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d0f208c8-ccbd-4fe9-afb0-400c7743ce35 req-b2bab1df-de6c-4fc8-806b-922f5b4344e3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:17.805942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d0f208c8-ccbd-4fe9-afb0-400c7743ce35 req-b2bab1df-de6c-4fc8-806b-922f5b4344e3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:17.838359 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d0f208c8-ccbd-4fe9-afb0-400c7743ce35 req-b2bab1df-de6c-4fc8-806b-922f5b4344e3 service nova] Creating event network-vif-deleted:555c0602-6141-4525-b74a-9dd96ba32274 for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:45:17.846533 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d0f208c8-ccbd-4fe9-afb0-400c7743ce35 req-b2bab1df-de6c-4fc8-806b-922f5b4344e3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070259 Jul 14 14:45:17.853212 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1778/3574] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:17.860679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-876a1af0-ae09-433d-9ecb-38a0f65ab3e5 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c533b1f0>, body: {"security_group_rule": {"parent_group_id": "0ccf6aaa-7d07-449c-9ecd-f8e7695d6edb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2284ca3f-8719-49d7-a8ca-d3188487ed88"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:18.486225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9fe77664-fc6d-4642-a3a1-54a92605dda8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:18.521226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9fe77664-fc6d-4642-a3a1-54a92605dda8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:18.525256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9fe77664-fc6d-4642-a3a1-54a92605dda8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:18.528878 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9fe77664-fc6d-4642-a3a1-54a92605dda8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.801524 Jul 14 14:45:18.548611 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1797/3575] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:17 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:18.559222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc522e01-ace8-409f-b959-0f4d841ffd3b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:18.560063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc522e01-ace8-409f-b959-0f4d841ffd3b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:18.569851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc522e01-ace8-409f-b959-0f4d841ffd3b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:18.570635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc522e01-ace8-409f-b959-0f4d841ffd3b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:18.574954 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc522e01-ace8-409f-b959-0f4d841ffd3b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:18.575707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc522e01-ace8-409f-b959-0f4d841ffd3b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:19.037803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc522e01-ace8-409f-b959-0f4d841ffd3b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:19.049214 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc522e01-ace8-409f-b959-0f4d841ffd3b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1516 microversion: 2.1 time: 0.497310 Jul 14 14:45:19.062651 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1798/3576] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:18 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1516 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:19.092692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4f963ed3-ef97-4ffc-b6d5-1bf40f36c6d5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:19.094701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4f963ed3-ef97-4ffc-b6d5-1bf40f36c6d5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:19.115195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f963ed3-ef97-4ffc-b6d5-1bf40f36c6d5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:19.116050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f963ed3-ef97-4ffc-b6d5-1bf40f36c6d5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:19.118582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f963ed3-ef97-4ffc-b6d5-1bf40f36c6d5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:19.119288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f963ed3-ef97-4ffc-b6d5-1bf40f36c6d5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:19.741296 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-876a1af0-ae09-433d-9ecb-38a0f65ab3e5 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 1.886486 Jul 14 14:45:19.745892 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1779/3577] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:45:17 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:19.881290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1983972223", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "c5c75cd1-78c7-413a-b7fd-8df6de0b186f"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:19.943231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4f963ed3-ef97-4ffc-b6d5-1bf40f36c6d5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:19.970490 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4f963ed3-ef97-4ffc-b6d5-1bf40f36c6d5 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 200 len: 1504 microversion: 2.1 time: 0.904772 Jul 14 14:45:19.993549 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1799/3578] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:19 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 1504 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:20.003855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] validate_networks() for [('c5c75cd1-78c7-413a-b7fd-8df6de0b186f', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:45:20.020259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5cfcd725-a090-48d8-8d91-96cef20044d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:20.020888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5cfcd725-a090-48d8-8d91-96cef20044d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:20.033809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5cfcd725-a090-48d8-8d91-96cef20044d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:20.034509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5cfcd725-a090-48d8-8d91-96cef20044d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:20.035481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5cfcd725-a090-48d8-8d91-96cef20044d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:20.036070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5cfcd725-a090-48d8-8d91-96cef20044d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:20.507916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5cfcd725-a090-48d8-8d91-96cef20044d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:20.523947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5cfcd725-a090-48d8-8d91-96cef20044d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:20.526857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5cfcd725-a090-48d8-8d91-96cef20044d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:20.528311 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5cfcd725-a090-48d8-8d91-96cef20044d9 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 2485 microversion: 2.42 time: 0.518650 Jul 14 14:45:20.533602 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1800/3579] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:20 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 2485 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:20.544854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2891efe2-b4ba-4a46-af0e-a7c5b8498898 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:20.548095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2891efe2-b4ba-4a46-af0e-a7c5b8498898 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:20.575069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2891efe2-b4ba-4a46-af0e-a7c5b8498898 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:20.575626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2891efe2-b4ba-4a46-af0e-a7c5b8498898 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:20.576465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2891efe2-b4ba-4a46-af0e-a7c5b8498898 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:20.578319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2891efe2-b4ba-4a46-af0e-a7c5b8498898 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.071053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:45:21.072147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:45:21.072967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:45:21.074685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:45:21.084707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:45:21.122980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:21.125102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.127373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:21.133380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.180512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2891efe2-b4ba-4a46-af0e-a7c5b8498898 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:21.196374 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2891efe2-b4ba-4a46-af0e-a7c5b8498898 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1681 microversion: 2.1 time: 0.660605 Jul 14 14:45:21.197224 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1801/3580] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:20 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1681 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:21.202674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-97add462-daf2-4413-b1f4-01de785ee7f8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:21.203811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-97add462-daf2-4413-b1f4-01de785ee7f8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:21.210268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97add462-daf2-4413-b1f4-01de785ee7f8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:21.211012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97add462-daf2-4413-b1f4-01de785ee7f8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.212307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97add462-daf2-4413-b1f4-01de785ee7f8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:21.213012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97add462-daf2-4413-b1f4-01de785ee7f8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.231004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Getting quotas for project fca3ec59ac7c4c17a2fb8cad1a8e4431. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:45:21.245036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Getting quotas for user 98c70eaa4d904ac5ada24fb99a45027d and project fca3ec59ac7c4c17a2fb8cad1a8e4431. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:45:21.290618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:45:21.300143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:45:21.421353 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-651f2873-43d1-491d-9f7d-88d94da9d86f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.673079 Jul 14 14:45:21.424896 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1780/3581] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:45:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:45:21.436626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c35a7bb5-67b1-4c63-82ba-81c37c040d80 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c61a4430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-28971950", "description": "tempest-description-475056600"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:22.294996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-97add462-daf2-4413-b1f4-01de785ee7f8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:22.312215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-97add462-daf2-4413-b1f4-01de785ee7f8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:22.330963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-97add462-daf2-4413-b1f4-01de785ee7f8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:22.332980 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-97add462-daf2-4413-b1f4-01de785ee7f8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 1.134207 Jul 14 14:45:22.345224 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1802/3582] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:21 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:22.350717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5625bff2-18b3-4b8d-a692-c1e20af73b90 req-1ec14460-e968-491b-998a-f11cac291b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f00f28d-b2fb-4ac4-a270-762d7df7b33f", "name": "network-vif-deleted", "tag": "d4bf6708-6a09-43b5-892b-99707899b5e3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:22.384263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5625bff2-18b3-4b8d-a692-c1e20af73b90 req-1ec14460-e968-491b-998a-f11cac291b43 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:22.384731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5625bff2-18b3-4b8d-a692-c1e20af73b90 req-1ec14460-e968-491b-998a-f11cac291b43 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:22.409938 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5625bff2-18b3-4b8d-a692-c1e20af73b90 req-1ec14460-e968-491b-998a-f11cac291b43 service nova] Creating event network-vif-deleted:d4bf6708-6a09-43b5-892b-99707899b5e3 for instance 3f00f28d-b2fb-4ac4-a270-762d7df7b33f on n-h2-767704-28 Jul 14 14:45:22.416265 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5625bff2-18b3-4b8d-a692-c1e20af73b90 req-1ec14460-e968-491b-998a-f11cac291b43 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069357 Jul 14 14:45:22.418463 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1803/3583] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:22.426123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0a1e706f-ddaa-4f31-9de4-c804e5b5da3e req-f4cf4816-4850-41c5-a008-46351d15e49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "name": "network-vif-deleted", "tag": "bf4979db-bc34-41d1-9d82-f5fc2ab71553"}, {"server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "name": "network-vif-deleted", "tag": "ea32addf-3ddd-4645-a6d7-a3e1e322e40c"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:22.436392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0a1e706f-ddaa-4f31-9de4-c804e5b5da3e req-f4cf4816-4850-41c5-a008-46351d15e49c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:22.437130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0a1e706f-ddaa-4f31-9de4-c804e5b5da3e req-f4cf4816-4850-41c5-a008-46351d15e49c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:22.465495 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0a1e706f-ddaa-4f31-9de4-c804e5b5da3e req-f4cf4816-4850-41c5-a008-46351d15e49c service nova] Creating event network-vif-deleted:bf4979db-bc34-41d1-9d82-f5fc2ab71553 for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:45:22.467704 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0a1e706f-ddaa-4f31-9de4-c804e5b5da3e req-f4cf4816-4850-41c5-a008-46351d15e49c service nova] Creating event network-vif-deleted:ea32addf-3ddd-4645-a6d7-a3e1e322e40c for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:45:22.478249 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0a1e706f-ddaa-4f31-9de4-c804e5b5da3e req-f4cf4816-4850-41c5-a008-46351d15e49c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057424 Jul 14 14:45:22.483073 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1804/3584] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:22.497418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac74b592-d2c5-4c9b-bf52-26bc999303c4 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:22.498744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac74b592-d2c5-4c9b-bf52-26bc999303c4 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 3f00f28d-b2fb-4ac4-a270-762d7df7b33f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:22.515459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac74b592-d2c5-4c9b-bf52-26bc999303c4 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:22.519546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac74b592-d2c5-4c9b-bf52-26bc999303c4 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:22.520587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac74b592-d2c5-4c9b-bf52-26bc999303c4 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:22.523074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac74b592-d2c5-4c9b-bf52-26bc999303c4 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:22.575360 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-ac74b592-d2c5-4c9b-bf52-26bc999303c4 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] HTTP exception thrown: Instance 3f00f28d-b2fb-4ac4-a270-762d7df7b33f could not be found. Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac74b592-d2c5-4c9b-bf52-26bc999303c4 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Request method failure captured: Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f HTTP/1.1 Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Ct3dfJKMhEaJvfvxVQgXaVKMivAWyTo7O71BWUSO5XO7d_4ZZ0vXiNNQH9xo2-sS5zXFg8jK_zBFq6x8POILj5udTTLnLTq_Q71inB-xJDVRPBBh-bk4A_1QGwt0yLfRUZC39xLiJc8U3oFI1y15epkGWQb63etE0kzsxKRE__neC8 Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: b249f360cfda495fa5bcad6223474c17 Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerRescueTestJSON-651389370 Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b249f360cfda495fa5bcad6223474c17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b249f360cfda495fa5bcad6223474c17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b249f360cfda495fa5bcad6223474c17", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b249f360cfda495fa5bcad6223474c17"}]}] Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerRescueTestJSON-651389370 Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: b249f360cfda495fa5bcad6223474c17 Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerRescueTestJSON-651389370 Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerRescueTestJSON-651389370-project Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: b845134b8fd14382b1c46ad78e5effa2 Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerRescueTestJSON-651389370-project Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 3f00f28d-b2fb-4ac4-a270-762d7df7b33f could not be found. Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '3f00f28d-b2fb-4ac4-a270-762d7df7b33f'} Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f00f28d-b2fb-4ac4-a270-762d7df7b33f could not be found. Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f00f28d-b2fb-4ac4-a270-762d7df7b33f could not be found. Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:22.582835 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:22.586878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:22.586878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:22.586878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:22.586878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:22.586878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:22.586878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f00f28d-b2fb-4ac4-a270-762d7df7b33f could not be found. Jul 14 14:45:22.586878 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:22.588364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac74b592-d2c5-4c9b-bf52-26bc999303c4 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Returning 404 to user: Instance 3f00f28d-b2fb-4ac4-a270-762d7df7b33f could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:22.589354 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac74b592-d2c5-4c9b-bf52-26bc999303c4 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f" status: 404 len: 111 microversion: 2.1 time: 0.105070 Jul 14 14:45:22.593250 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1805/3585] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:22 2022] GET /compute/v2.1/servers/3f00f28d-b2fb-4ac4-a270-762d7df7b33f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:45:22.599230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-92bb35be-c6a0-421a-92b6-f6ad2b212058 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:22.599954 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-92bb35be-c6a0-421a-92b6-f6ad2b212058 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:22.607722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92bb35be-c6a0-421a-92b6-f6ad2b212058 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:22.608308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92bb35be-c6a0-421a-92b6-f6ad2b212058 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:22.609371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92bb35be-c6a0-421a-92b6-f6ad2b212058 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:22.610486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92bb35be-c6a0-421a-92b6-f6ad2b212058 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.097006 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c35a7bb5-67b1-4c63-82ba-81c37c040d80 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.670561 Jul 14 14:45:23.099889 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1781/3586] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:45:21 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:23.107445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-132e3ec0-b28d-4387-a3b7-1c7f7a4a4495 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:23.108295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-132e3ec0-b28d-4387-a3b7-1c7f7a4a4495 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:23.115234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-92bb35be-c6a0-421a-92b6-f6ad2b212058 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:23.123633 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-92bb35be-c6a0-421a-92b6-f6ad2b212058 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1267 microversion: 2.1 time: 0.529145 Jul 14 14:45:23.127233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-132e3ec0-b28d-4387-a3b7-1c7f7a4a4495 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.128172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-132e3ec0-b28d-4387-a3b7-1c7f7a4a4495 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.128571 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1806/3587] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:22 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1267 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:23.129473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-132e3ec0-b28d-4387-a3b7-1c7f7a4a4495 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.130122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-132e3ec0-b28d-4387-a3b7-1c7f7a4a4495 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.138437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f7e23198-969c-4c26-bfa3-b768b08c7d54 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'create', calling method: .version_select at 0x7fd6c4e675e0>, body: {"keypair": {"name": "tempest-keypair-54351309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF25Rdy3Q4ORz9o2Q8G0kOXQk/+s+ucDCuOQSzHs8vh/SvP6KKqy7fSLuQNNzAuXWDSNGHjqjDfm2+9sNgmYq/nds/QXALEBgwEnN4Uk6qZ1Ycyy4EDT6XRlPn/jwoUhQ=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:23.193400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f7e23198-969c-4c26-bfa3-b768b08c7d54 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Getting quotas for project 7e9f01277aa24f0fbe464ff8a5378d64. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:45:23.199601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f7e23198-969c-4c26-bfa3-b768b08c7d54 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Getting quotas for user 377b67baeabd4588a1945effc9b19113 and project 7e9f01277aa24f0fbe464ff8a5378d64. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:45:23.248395 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f7e23198-969c-4c26-bfa3-b768b08c7d54 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.118509 Jul 14 14:45:23.254860 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1807/3588] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:45:23 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:23.259955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2283ebb0-c911-4748-819f-a12a86eb8fcc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:23.260593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2283ebb0-c911-4748-819f-a12a86eb8fcc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:23.270309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-132e3ec0-b28d-4387-a3b7-1c7f7a4a4495 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:23.272705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2283ebb0-c911-4748-819f-a12a86eb8fcc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.273464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2283ebb0-c911-4748-819f-a12a86eb8fcc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.274533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2283ebb0-c911-4748-819f-a12a86eb8fcc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.275884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2283ebb0-c911-4748-819f-a12a86eb8fcc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.287357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-132e3ec0-b28d-4387-a3b7-1c7f7a4a4495 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:23.291504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-132e3ec0-b28d-4387-a3b7-1c7f7a4a4495 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:23.296084 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-132e3ec0-b28d-4387-a3b7-1c7f7a4a4495 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1604 microversion: 2.42 time: 0.194419 Jul 14 14:45:23.300843 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1782/3589] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:23 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1604 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:23.307009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ca9fa0dc-b0ba-4a5d-9851-d27537d48907 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:23.312772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ca9fa0dc-b0ba-4a5d-9851-d27537d48907 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:23.326687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca9fa0dc-b0ba-4a5d-9851-d27537d48907 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.327468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca9fa0dc-b0ba-4a5d-9851-d27537d48907 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.329860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca9fa0dc-b0ba-4a5d-9851-d27537d48907 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.331895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca9fa0dc-b0ba-4a5d-9851-d27537d48907 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.383390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ca9fa0dc-b0ba-4a5d-9851-d27537d48907 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:23.533016 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ca9fa0dc-b0ba-4a5d-9851-d27537d48907 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 204 len: 0 microversion: 2.1 time: 0.225732 Jul 14 14:45:23.534666 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1783/3590] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:45:23 2022] DELETE /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:45:23.543273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9e18e843-0263-433d-bf81-4c5cf073f093 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c63d0550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-205801117", "description": "tempest-description-1705042442"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:23.649915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2283ebb0-c911-4748-819f-a12a86eb8fcc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:23.665731 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2283ebb0-c911-4748-819f-a12a86eb8fcc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1681 microversion: 2.1 time: 0.409652 Jul 14 14:45:23.667674 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1808/3591] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:23 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1681 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:23.680317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-903f554c-5227-442e-a4ad-158a897c5b0c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:23.684779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-903f554c-5227-442e-a4ad-158a897c5b0c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:23.696757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-903f554c-5227-442e-a4ad-158a897c5b0c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.700884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-903f554c-5227-442e-a4ad-158a897c5b0c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.702824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-903f554c-5227-442e-a4ad-158a897c5b0c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.705434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-903f554c-5227-442e-a4ad-158a897c5b0c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:24.202112 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9e18e843-0263-433d-bf81-4c5cf073f093 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.665463 Jul 14 14:45:24.208912 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1784/3592] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:45:23 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:24.214400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1535a534-856b-4ee4-a356-5f0009eda3b7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:24.215250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1535a534-856b-4ee4-a356-5f0009eda3b7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:24.237552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1535a534-856b-4ee4-a356-5f0009eda3b7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:24.238115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1535a534-856b-4ee4-a356-5f0009eda3b7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:24.238992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1535a534-856b-4ee4-a356-5f0009eda3b7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:24.239500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1535a534-856b-4ee4-a356-5f0009eda3b7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:24.545320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-903f554c-5227-442e-a4ad-158a897c5b0c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:24.564473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-903f554c-5227-442e-a4ad-158a897c5b0c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:24.570338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-903f554c-5227-442e-a4ad-158a897c5b0c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:24.571846 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-903f554c-5227-442e-a4ad-158a897c5b0c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.901271 Jul 14 14:45:24.586436 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1809/3593] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:23 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:24.593503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc130c81-9f1e-4c3a-a1bb-5a6e56b830b3 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:24.595263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cc130c81-9f1e-4c3a-a1bb-5a6e56b830b3 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:24.614579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc130c81-9f1e-4c3a-a1bb-5a6e56b830b3 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:24.615546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc130c81-9f1e-4c3a-a1bb-5a6e56b830b3 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:24.617107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc130c81-9f1e-4c3a-a1bb-5a6e56b830b3 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:24.618026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc130c81-9f1e-4c3a-a1bb-5a6e56b830b3 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:24.674244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:24.755265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1535a534-856b-4ee4-a356-5f0009eda3b7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:24.768579 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1535a534-856b-4ee4-a356-5f0009eda3b7 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1490 microversion: 2.1 time: 0.558403 Jul 14 14:45:24.786781 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1785/3594] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:24 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1490 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:24.792262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e6072e6d-be0b-48dc-adfc-7d47e0eb8636 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c63ba5e0>, body: {"security_group_rule": {"parent_group_id": "a558acfa-194f-40c4-968e-19f2acf8f7c9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "92622fb9-3ced-46c4-967a-087ae740425b"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:24.879515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cc130c81-9f1e-4c3a-a1bb-5a6e56b830b3 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:24.893701 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc130c81-9f1e-4c3a-a1bb-5a6e56b830b3 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1273 microversion: 2.1 time: 0.304770 Jul 14 14:45:24.895480 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1810/3595] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:24 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1273 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:24.909909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd55468c-187a-4f2f-9b57-c42b7c1a63dd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:24.910593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bd55468c-187a-4f2f-9b57-c42b7c1a63dd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:24.938776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd55468c-187a-4f2f-9b57-c42b7c1a63dd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:24.939258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd55468c-187a-4f2f-9b57-c42b7c1a63dd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:24.943613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd55468c-187a-4f2f-9b57-c42b7c1a63dd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:24.946621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd55468c-187a-4f2f-9b57-c42b7c1a63dd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:25.285801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bd55468c-187a-4f2f-9b57-c42b7c1a63dd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:25.303748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bd55468c-187a-4f2f-9b57-c42b7c1a63dd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:25.310733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bd55468c-187a-4f2f-9b57-c42b7c1a63dd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:25.319514 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bd55468c-187a-4f2f-9b57-c42b7c1a63dd tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1604 microversion: 2.42 time: 0.414153 Jul 14 14:45:25.341539 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1811/3596] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:24 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1604 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:25.351015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-7f2516c7-7cd4-46c7-89b2-3f28e257322e req-55421e29-cfb3-4e76-902e-ff49bdd86b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "name": "network-vif-deleted", "tag": "f0e13cb7-0e32-476b-8c7b-9b4030d305fc"}, {"server_uuid": "0e55a647-8a5e-48e1-9cfb-2c26ed55e971", "name": "network-vif-deleted", "tag": "46b5d0bb-9885-4003-8ee6-a5ad6d903ef9"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:25.363624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7f2516c7-7cd4-46c7-89b2-3f28e257322e req-55421e29-cfb3-4e76-902e-ff49bdd86b92 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:25.364639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7f2516c7-7cd4-46c7-89b2-3f28e257322e req-55421e29-cfb3-4e76-902e-ff49bdd86b92 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:25.383716 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-7f2516c7-7cd4-46c7-89b2-3f28e257322e req-55421e29-cfb3-4e76-902e-ff49bdd86b92 service nova] Creating event network-vif-deleted:f0e13cb7-0e32-476b-8c7b-9b4030d305fc for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:45:25.385544 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-7f2516c7-7cd4-46c7-89b2-3f28e257322e req-55421e29-cfb3-4e76-902e-ff49bdd86b92 service nova] Creating event network-vif-deleted:46b5d0bb-9885-4003-8ee6-a5ad6d903ef9 for instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 on n-h1-767704-28 Jul 14 14:45:25.396289 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-7f2516c7-7cd4-46c7-89b2-3f28e257322e req-55421e29-cfb3-4e76-902e-ff49bdd86b92 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052953 Jul 14 14:45:25.397511 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1812/3597] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:25.405842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d6c15b6b-ae24-44a9-a52a-5d131e8fe007 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:25.406837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d6c15b6b-ae24-44a9-a52a-5d131e8fe007 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:25.435033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6c15b6b-ae24-44a9-a52a-5d131e8fe007 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:25.435606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6c15b6b-ae24-44a9-a52a-5d131e8fe007 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:25.436642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6c15b6b-ae24-44a9-a52a-5d131e8fe007 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:25.438102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6c15b6b-ae24-44a9-a52a-5d131e8fe007 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:25.802164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d6c15b6b-ae24-44a9-a52a-5d131e8fe007 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:25.810961 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d6c15b6b-ae24-44a9-a52a-5d131e8fe007 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1681 microversion: 2.1 time: 0.412051 Jul 14 14:45:25.830169 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1813/3598] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:25 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1681 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:25.830169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7caeab20-185e-419a-b8f2-a6b9c9c1874a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:25.830169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7caeab20-185e-419a-b8f2-a6b9c9c1874a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:25.841341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7caeab20-185e-419a-b8f2-a6b9c9c1874a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:25.846124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7caeab20-185e-419a-b8f2-a6b9c9c1874a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:25.847558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7caeab20-185e-419a-b8f2-a6b9c9c1874a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:25.847924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7caeab20-185e-419a-b8f2-a6b9c9c1874a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:26.312213 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e6072e6d-be0b-48dc-adfc-7d47e0eb8636 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.523932 Jul 14 14:45:26.313742 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1786/3599] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:45:24 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:26.318709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4968f0dd-a798-4c11-a5a1-9696f01fda27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:26.319869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4968f0dd-a798-4c11-a5a1-9696f01fda27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:26.354421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4968f0dd-a798-4c11-a5a1-9696f01fda27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:26.355441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4968f0dd-a798-4c11-a5a1-9696f01fda27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:26.356425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4968f0dd-a798-4c11-a5a1-9696f01fda27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:26.357085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4968f0dd-a798-4c11-a5a1-9696f01fda27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:26.666385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7caeab20-185e-419a-b8f2-a6b9c9c1874a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:26.679765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7caeab20-185e-419a-b8f2-a6b9c9c1874a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:26.681251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7caeab20-185e-419a-b8f2-a6b9c9c1874a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:26.682429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7caeab20-185e-419a-b8f2-a6b9c9c1874a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.860876 Jul 14 14:45:26.705372 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1814/3600] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:25 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:26.710504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c8c28e05-d9dd-4733-89b8-cea70818140f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:26.711135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c8c28e05-d9dd-4733-89b8-cea70818140f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:26.728895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8c28e05-d9dd-4733-89b8-cea70818140f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:26.729393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8c28e05-d9dd-4733-89b8-cea70818140f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:26.730457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8c28e05-d9dd-4733-89b8-cea70818140f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:26.731003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8c28e05-d9dd-4733-89b8-cea70818140f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:27.574381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4968f0dd-a798-4c11-a5a1-9696f01fda27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b845134b8fd14382b1c46ad78e5effa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b249f360cfda495fa5bcad6223474c17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:27.606027 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4968f0dd-a798-4c11-a5a1-9696f01fda27 tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 200 len: 1490 microversion: 2.1 time: 1.290838 Jul 14 14:45:27.609149 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1787/3601] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:26 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 1490 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:27.616938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-921615466", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2269736e-ca28-48a4-8f12-df659c6b1651"}], "security_groups": [{"name": "tempest-securitygroup--392020565"}], "key_name": "tempest-keypair-54351309", "user_data": "}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:27.685479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c8c28e05-d9dd-4733-89b8-cea70818140f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:27.701565 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c8c28e05-d9dd-4733-89b8-cea70818140f tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1315 microversion: 2.1 time: 0.990122 Jul 14 14:45:27.702854 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1815/3602] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:26 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1315 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:27.713636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e37ae828-fc09-4b7d-8509-dbd7b7702c76 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Calling method '.version_select at 0x7fd6c4e92f70>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:28.374147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] validate_networks() for [('2269736e-ca28-48a4-8f12-df659c6b1651', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:45:29.225161 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e37ae828-fc09-4b7d-8509-dbd7b7702c76 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/92622fb9-3ced-46c4-967a-087ae740425b" status: 202 len: 0 microversion: 2.1 time: 1.518322 Jul 14 14:45:29.227786 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1816/3603] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:45:27 2022] DELETE /compute/v2.1/os-security-groups/92622fb9-3ced-46c4-967a-087ae740425b => generated 0 bytes in 1524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:29.246634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e423a160-ea52-4278-9b7c-68cb337ebc72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:29.258270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e423a160-ea52-4278-9b7c-68cb337ebc72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:29.296479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e423a160-ea52-4278-9b7c-68cb337ebc72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:29.299390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e423a160-ea52-4278-9b7c-68cb337ebc72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:29.300588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e423a160-ea52-4278-9b7c-68cb337ebc72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:29.301491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e423a160-ea52-4278-9b7c-68cb337ebc72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:29.433062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e423a160-ea52-4278-9b7c-68cb337ebc72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:29.444938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e423a160-ea52-4278-9b7c-68cb337ebc72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:29.447088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e423a160-ea52-4278-9b7c-68cb337ebc72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:29.449051 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e423a160-ea52-4278-9b7c-68cb337ebc72 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1604 microversion: 2.42 time: 0.219601 Jul 14 14:45:29.461477 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1817/3604] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:29 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1604 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:29.467567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7aaf03ee-e06e-4596-9ff1-7d788e7d4a24 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:29.468503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7aaf03ee-e06e-4596-9ff1-7d788e7d4a24 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:29.476653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7aaf03ee-e06e-4596-9ff1-7d788e7d4a24 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:29.477558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7aaf03ee-e06e-4596-9ff1-7d788e7d4a24 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:29.478552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7aaf03ee-e06e-4596-9ff1-7d788e7d4a24 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:29.479331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7aaf03ee-e06e-4596-9ff1-7d788e7d4a24 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:29.958605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:45:29.959129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:45:29.959744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:45:29.960322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:45:29.960857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:45:30.004696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.006341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.010707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.011902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.016676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7aaf03ee-e06e-4596-9ff1-7d788e7d4a24 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:30.033890 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7aaf03ee-e06e-4596-9ff1-7d788e7d4a24 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1658 microversion: 2.1 time: 0.571016 Jul 14 14:45:30.034469 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1818/3605] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:29 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1658 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:30.044333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a5c2d8ab-d54d-4765-a930-4124ada5633e req-8f474c85-0035-4b31-85d5-e99e2a694a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a334338-1793-4d18-9c76-ffebb97a8983", "name": "network-vif-deleted", "tag": "2ebaa6b5-5402-47de-b6da-92d432f2d61c"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:30.063155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a5c2d8ab-d54d-4765-a930-4124ada5633e req-8f474c85-0035-4b31-85d5-e99e2a694a69 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.063935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a5c2d8ab-d54d-4765-a930-4124ada5633e req-8f474c85-0035-4b31-85d5-e99e2a694a69 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.066537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Getting quotas for project 7e9f01277aa24f0fbe464ff8a5378d64. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:45:30.081562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Getting quotas for user 377b67baeabd4588a1945effc9b19113 and project 7e9f01277aa24f0fbe464ff8a5378d64. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:45:30.088376 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a5c2d8ab-d54d-4765-a930-4124ada5633e req-8f474c85-0035-4b31-85d5-e99e2a694a69 service nova] Creating event network-vif-deleted:2ebaa6b5-5402-47de-b6da-92d432f2d61c for instance 9a334338-1793-4d18-9c76-ffebb97a8983 on n-h1-767704-28 Jul 14 14:45:30.102905 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a5c2d8ab-d54d-4765-a930-4124ada5633e req-8f474c85-0035-4b31-85d5-e99e2a694a69 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067007 Jul 14 14:45:30.103531 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1819/3606] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:30.119686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:45:30.121424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e5fde043-c029-448c-80cf-3551507130c1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:30.122136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e5fde043-c029-448c-80cf-3551507130c1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:30.122791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:45:30.137668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5fde043-c029-448c-80cf-3551507130c1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.138130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5fde043-c029-448c-80cf-3551507130c1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.138929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5fde043-c029-448c-80cf-3551507130c1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.139369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5fde043-c029-448c-80cf-3551507130c1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.296555 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-419f0976-0712-45f1-b8d5-509e279504e7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.685038 Jul 14 14:45:30.299030 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1788/3607] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:45:27 2022] POST /compute/v2.1/servers => generated 408 bytes in 2689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:45:30.307263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1fbd0bea-d304-49d4-b1be-fb29163a3a94 req-a44c262b-ec7b-4264-a727-61a4e793e782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9881e309-0999-4b05-aff0-32b4c56cc2a2", "tag": "6eeee992-9c9c-43b8-9322-852bb5d18ad9"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:30.331684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1fbd0bea-d304-49d4-b1be-fb29163a3a94 req-a44c262b-ec7b-4264-a727-61a4e793e782 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.332084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1fbd0bea-d304-49d4-b1be-fb29163a3a94 req-a44c262b-ec7b-4264-a727-61a4e793e782 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.368535 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1fbd0bea-d304-49d4-b1be-fb29163a3a94 req-a44c262b-ec7b-4264-a727-61a4e793e782 service nova] Creating event network-changed:6eeee992-9c9c-43b8-9322-852bb5d18ad9 for instance 9881e309-0999-4b05-aff0-32b4c56cc2a2 on n-h2-767704-28 Jul 14 14:45:30.374965 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1fbd0bea-d304-49d4-b1be-fb29163a3a94 req-a44c262b-ec7b-4264-a727-61a4e793e782 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074365 Jul 14 14:45:30.375959 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1789/3608] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:30.403767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-820546d7-7a9a-44fd-90b9-0cb6572daaac tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:30.411556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-820546d7-7a9a-44fd-90b9-0cb6572daaac tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] [instance: 9a334338-1793-4d18-9c76-ffebb97a8983] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:30.425359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-820546d7-7a9a-44fd-90b9-0cb6572daaac tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.425840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-820546d7-7a9a-44fd-90b9-0cb6572daaac tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.426723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-820546d7-7a9a-44fd-90b9-0cb6572daaac tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.427235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-820546d7-7a9a-44fd-90b9-0cb6572daaac tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.474757 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-820546d7-7a9a-44fd-90b9-0cb6572daaac tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] HTTP exception thrown: Instance 9a334338-1793-4d18-9c76-ffebb97a8983 could not be found. Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-820546d7-7a9a-44fd-90b9-0cb6572daaac tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Request method failure captured: Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 HTTP/1.1 Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Ct3dfJKMhEaJvfvxVQgXaVKMivAWyTo7O71BWUSO5XO7d_4ZZ0vXiNNQH9xo2-sS5zXFg8jK_zBFq6x8POILj5udTTLnLTq_Q71inB-xJDVRPBBh-bk4A_1QGwt0yLfRUZC39xLiJc8U3oFI1y15epkGWQb63etE0kzsxKRE__neC8 Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: b249f360cfda495fa5bcad6223474c17 Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerRescueTestJSON-651389370 Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b249f360cfda495fa5bcad6223474c17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b249f360cfda495fa5bcad6223474c17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b249f360cfda495fa5bcad6223474c17", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b249f360cfda495fa5bcad6223474c17"}]}] Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerRescueTestJSON-651389370 Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: b249f360cfda495fa5bcad6223474c17 Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerRescueTestJSON-651389370 Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerRescueTestJSON-651389370-project Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: b845134b8fd14382b1c46ad78e5effa2 Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerRescueTestJSON-651389370-project Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 9a334338-1793-4d18-9c76-ffebb97a8983 could not be found. Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '9a334338-1793-4d18-9c76-ffebb97a8983'} Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a334338-1793-4d18-9c76-ffebb97a8983 could not be found. Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a334338-1793-4d18-9c76-ffebb97a8983 could not be found. Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:30.541448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:30.545849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:30.545849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:30.545849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:30.545849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:30.545849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:30.545849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a334338-1793-4d18-9c76-ffebb97a8983 could not be found. Jul 14 14:45:30.545849 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:30.545849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-820546d7-7a9a-44fd-90b9-0cb6572daaac tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] Returning 404 to user: Instance 9a334338-1793-4d18-9c76-ffebb97a8983 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:30.549492 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-820546d7-7a9a-44fd-90b9-0cb6572daaac tempest-ServerRescueTestJSON-651389370 tempest-ServerRescueTestJSON-651389370-project] 10.222.0.81 "GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983" status: 404 len: 111 microversion: 2.1 time: 0.156216 Jul 14 14:45:30.553483 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1790/3609] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:30 2022] GET /compute/v2.1/servers/9a334338-1793-4d18-9c76-ffebb97a8983 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:45:30.583014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-930bc73e-b842-4b09-9aa0-bb451b4b1f37 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:30.583563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-930bc73e-b842-4b09-9aa0-bb451b4b1f37 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:30.605959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-930bc73e-b842-4b09-9aa0-bb451b4b1f37 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.606895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-930bc73e-b842-4b09-9aa0-bb451b4b1f37 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.607239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-930bc73e-b842-4b09-9aa0-bb451b4b1f37 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.607682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-930bc73e-b842-4b09-9aa0-bb451b4b1f37 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.615626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e5fde043-c029-448c-80cf-3551507130c1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:30.632673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e5fde043-c029-448c-80cf-3551507130c1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:30.634380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e5fde043-c029-448c-80cf-3551507130c1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:30.635608 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e5fde043-c029-448c-80cf-3551507130c1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.529350 Jul 14 14:45:30.652237 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1820/3610] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:30 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:30.670240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-1d378508-3a29-433d-b6ea-9c6364dbb085 req-c259840f-546c-4c47-b8d2-7c94be8c8140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-plugged", "status": "completed", "tag": "847e25f0-cf0b-4884-a99c-bc72592ab04e"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:30.715461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1d378508-3a29-433d-b6ea-9c6364dbb085 req-c259840f-546c-4c47-b8d2-7c94be8c8140 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.716043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1d378508-3a29-433d-b6ea-9c6364dbb085 req-c259840f-546c-4c47-b8d2-7c94be8c8140 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.731746 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-1d378508-3a29-433d-b6ea-9c6364dbb085 req-c259840f-546c-4c47-b8d2-7c94be8c8140 service nova] Creating event network-vif-plugged:847e25f0-cf0b-4884-a99c-bc72592ab04e for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:45:30.745243 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-1d378508-3a29-433d-b6ea-9c6364dbb085 req-c259840f-546c-4c47-b8d2-7c94be8c8140 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091326 Jul 14 14:45:30.761723 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1821/3611] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:30.767769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5d4a00f2-2114-4b46-8454-9b1b82a04b32 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Calling method '.version_select at 0x7fd6c4e27f70>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:31.105865 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5d4a00f2-2114-4b46-8454-9b1b82a04b32 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/a558acfa-194f-40c4-968e-19f2acf8f7c9" status: 200 len: 245 microversion: 2.1 time: 0.342815 Jul 14 14:45:31.106470 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1822/3612] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:45:30 2022] GET /compute/v2.1/os-security-groups/a558acfa-194f-40c4-968e-19f2acf8f7c9 => generated 245 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:31.112145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-91879d21-1ec3-4fe8-9029-f223882c4803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:31.132866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91879d21-1ec3-4fe8-9029-f223882c4803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.133560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91879d21-1ec3-4fe8-9029-f223882c4803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.189251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-91879d21-1ec3-4fe8-9029-f223882c4803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Going to try to start instance {{(pid=119512) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 14:45:31.239914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-930bc73e-b842-4b09-9aa0-bb451b4b1f37 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:31.258477 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-930bc73e-b842-4b09-9aa0-bb451b4b1f37 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1315 microversion: 2.1 time: 0.687953 Jul 14 14:45:31.269104 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1791/3613] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:30 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:31.282554 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-91879d21-1ec3-4fe8-9029-f223882c4803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.174418 Jul 14 14:45:31.282780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eb5debd0-5220-4916-905a-0daa62a5b613 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:31.283925 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1823/3614] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:31 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:31.284587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eb5debd0-5220-4916-905a-0daa62a5b613 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:31.289671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-95603067-6e9a-48a6-aaa6-0662e883bf4f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:31.302074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-95603067-6e9a-48a6-aaa6-0662e883bf4f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:31.303555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb5debd0-5220-4916-905a-0daa62a5b613 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.304022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb5debd0-5220-4916-905a-0daa62a5b613 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.304817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb5debd0-5220-4916-905a-0daa62a5b613 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.310022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95603067-6e9a-48a6-aaa6-0662e883bf4f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.310267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb5debd0-5220-4916-905a-0daa62a5b613 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.310874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95603067-6e9a-48a6-aaa6-0662e883bf4f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.312043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95603067-6e9a-48a6-aaa6-0662e883bf4f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.317277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95603067-6e9a-48a6-aaa6-0662e883bf4f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.461597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eb5debd0-5220-4916-905a-0daa62a5b613 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:31.478658 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eb5debd0-5220-4916-905a-0daa62a5b613 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1247 microversion: 2.1 time: 0.207308 Jul 14 14:45:31.479328 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1792/3615] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:31 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1247 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:31.496578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4d90088d-4b4b-476d-8600-a83555d1a22d tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c6362a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-866725660", "description": "tempest-description-1388194018"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:31.526314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-95603067-6e9a-48a6-aaa6-0662e883bf4f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:31.543577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-95603067-6e9a-48a6-aaa6-0662e883bf4f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:31.545535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-95603067-6e9a-48a6-aaa6-0662e883bf4f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:31.547697 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-95603067-6e9a-48a6-aaa6-0662e883bf4f tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1604 microversion: 2.42 time: 0.261705 Jul 14 14:45:31.549361 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1824/3616] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:31 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:31.571595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc0e270b-e973-4a8f-b1a8-0b0b19300433 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:31.575974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc0e270b-e973-4a8f-b1a8-0b0b19300433 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:31.586506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc0e270b-e973-4a8f-b1a8-0b0b19300433 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.589075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc0e270b-e973-4a8f-b1a8-0b0b19300433 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.594839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc0e270b-e973-4a8f-b1a8-0b0b19300433 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.595543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc0e270b-e973-4a8f-b1a8-0b0b19300433 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.223001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc0e270b-e973-4a8f-b1a8-0b0b19300433 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:32.232410 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc0e270b-e973-4a8f-b1a8-0b0b19300433 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1667 microversion: 2.1 time: 0.668169 Jul 14 14:45:32.238105 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1825/3617] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:31 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1667 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:32.250292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f63cad70-1dce-48bc-b4c5-96872e0bc6b2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:32.251673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f63cad70-1dce-48bc-b4c5-96872e0bc6b2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:32.267544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f63cad70-1dce-48bc-b4c5-96872e0bc6b2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.268008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f63cad70-1dce-48bc-b4c5-96872e0bc6b2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.274887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f63cad70-1dce-48bc-b4c5-96872e0bc6b2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.275393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f63cad70-1dce-48bc-b4c5-96872e0bc6b2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.936515 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4d90088d-4b4b-476d-8600-a83555d1a22d tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.444625 Jul 14 14:45:32.942359 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1793/3618] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:45:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:32.953605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-95ffe060-6937-422f-9e74-2921299c1048 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:32.956255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-95ffe060-6937-422f-9e74-2921299c1048 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:32.984273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95ffe060-6937-422f-9e74-2921299c1048 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.985650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95ffe060-6937-422f-9e74-2921299c1048 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.986445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95ffe060-6937-422f-9e74-2921299c1048 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.993732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95ffe060-6937-422f-9e74-2921299c1048 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.995766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f63cad70-1dce-48bc-b4c5-96872e0bc6b2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:33.012546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f63cad70-1dce-48bc-b4c5-96872e0bc6b2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:33.015242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f63cad70-1dce-48bc-b4c5-96872e0bc6b2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:33.018412 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f63cad70-1dce-48bc-b4c5-96872e0bc6b2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.778829 Jul 14 14:45:33.019887 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1826/3619] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:32 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:33.025018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65cdbbc4-66c7-4177-b2e5-764e0b2c6ea5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:33.025882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-65cdbbc4-66c7-4177-b2e5-764e0b2c6ea5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:33.034202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65cdbbc4-66c7-4177-b2e5-764e0b2c6ea5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.035037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65cdbbc4-66c7-4177-b2e5-764e0b2c6ea5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.036674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65cdbbc4-66c7-4177-b2e5-764e0b2c6ea5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.037390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65cdbbc4-66c7-4177-b2e5-764e0b2c6ea5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.206033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-65cdbbc4-66c7-4177-b2e5-764e0b2c6ea5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:33.215396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:33.235210 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65cdbbc4-66c7-4177-b2e5-764e0b2c6ea5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1301 microversion: 2.1 time: 0.213403 Jul 14 14:45:33.237374 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1827/3620] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:33 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1301 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:33.247089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-266c6b46-d660-4aca-9863-18ff6d01dc32 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:33.252912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-266c6b46-d660-4aca-9863-18ff6d01dc32 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:33.267029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-266c6b46-d660-4aca-9863-18ff6d01dc32 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.267720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-266c6b46-d660-4aca-9863-18ff6d01dc32 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.269225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-266c6b46-d660-4aca-9863-18ff6d01dc32 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.269828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-266c6b46-d660-4aca-9863-18ff6d01dc32 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.475992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-95ffe060-6937-422f-9e74-2921299c1048 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:33.485661 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-95ffe060-6937-422f-9e74-2921299c1048 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1315 microversion: 2.1 time: 0.541900 Jul 14 14:45:33.487815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-266c6b46-d660-4aca-9863-18ff6d01dc32 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:33.495678 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1794/3621] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:32 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:33.502549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-8ee7b549-7ad8-4646-9b34-7b756e3fbe94 req-44e36524-5517-4c5a-af39-80715d52c913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-plugged", "status": "completed", "tag": "69dae4af-3029-468a-89e3-6dde860957cb"}, {"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-plugged", "status": "completed", "tag": "e86e4d9f-79ef-4b60-93ad-9741fa882539"}, {"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-plugged", "status": "completed", "tag": "e724799c-54b2-4910-bf13-c3ceedda7f4a"}, {"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-plugged", "status": "completed", "tag": "5f2e657b-30cc-4497-a912-7f7416056eb1"}, {"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-plugged", "status": "completed", "tag": "4d42836a-fc38-4944-9647-fb492b209832"}, {"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-plugged", "status": "completed", "tag": "e821f371-f015-4b58-8a2e-a1611a49246a"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:33.510102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-266c6b46-d660-4aca-9863-18ff6d01dc32 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:33.512811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8ee7b549-7ad8-4646-9b34-7b756e3fbe94 req-44e36524-5517-4c5a-af39-80715d52c913 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.513477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8ee7b549-7ad8-4646-9b34-7b756e3fbe94 req-44e36524-5517-4c5a-af39-80715d52c913 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.519816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-266c6b46-d660-4aca-9863-18ff6d01dc32 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:33.522516 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-266c6b46-d660-4aca-9863-18ff6d01dc32 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1604 microversion: 2.42 time: 0.282642 Jul 14 14:45:33.524918 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1828/3622] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:33 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1604 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:33.527626 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8ee7b549-7ad8-4646-9b34-7b756e3fbe94 req-44e36524-5517-4c5a-af39-80715d52c913 service nova] Creating event network-vif-plugged:69dae4af-3029-468a-89e3-6dde860957cb for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:45:33.528348 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8ee7b549-7ad8-4646-9b34-7b756e3fbe94 req-44e36524-5517-4c5a-af39-80715d52c913 service nova] Creating event network-vif-plugged:e86e4d9f-79ef-4b60-93ad-9741fa882539 for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:45:33.529101 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8ee7b549-7ad8-4646-9b34-7b756e3fbe94 req-44e36524-5517-4c5a-af39-80715d52c913 service nova] Creating event network-vif-plugged:e724799c-54b2-4910-bf13-c3ceedda7f4a for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:45:33.529739 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8ee7b549-7ad8-4646-9b34-7b756e3fbe94 req-44e36524-5517-4c5a-af39-80715d52c913 service nova] Creating event network-vif-plugged:5f2e657b-30cc-4497-a912-7f7416056eb1 for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:45:33.530386 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8ee7b549-7ad8-4646-9b34-7b756e3fbe94 req-44e36524-5517-4c5a-af39-80715d52c913 service nova] Creating event network-vif-plugged:4d42836a-fc38-4944-9647-fb492b209832 for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:45:33.531029 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8ee7b549-7ad8-4646-9b34-7b756e3fbe94 req-44e36524-5517-4c5a-af39-80715d52c913 service nova] Creating event network-vif-plugged:e821f371-f015-4b58-8a2e-a1611a49246a for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:45:33.538511 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-8ee7b549-7ad8-4646-9b34-7b756e3fbe94 req-44e36524-5517-4c5a-af39-80715d52c913 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.041238 Jul 14 14:45:33.543366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b1fee6a-5fea-4db8-98b2-18bef74566f6 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c4e3e430>, body: {"security_group_rule": {"parent_group_id": "b08f4721-d23f-4b9d-b6f8-c8743a0d7fd9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:33.544094 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1795/3623] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:33.551275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-daa15d38-ec7b-49b8-97b4-9307884e18cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:33.552235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-daa15d38-ec7b-49b8-97b4-9307884e18cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:33.559366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daa15d38-ec7b-49b8-97b4-9307884e18cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.560066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daa15d38-ec7b-49b8-97b4-9307884e18cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.561083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daa15d38-ec7b-49b8-97b4-9307884e18cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.561724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daa15d38-ec7b-49b8-97b4-9307884e18cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:34.315764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-daa15d38-ec7b-49b8-97b4-9307884e18cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:34.340972 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-daa15d38-ec7b-49b8-97b4-9307884e18cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1667 microversion: 2.1 time: 0.795277 Jul 14 14:45:34.353787 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1796/3624] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:33 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1667 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:34.366682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1a6813c8-6805-422c-b2c2-2f46ddba13c8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:34.367530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1a6813c8-6805-422c-b2c2-2f46ddba13c8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:34.380261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1a6813c8-6805-422c-b2c2-2f46ddba13c8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.380911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1a6813c8-6805-422c-b2c2-2f46ddba13c8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:34.381883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1a6813c8-6805-422c-b2c2-2f46ddba13c8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.382478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1a6813c8-6805-422c-b2c2-2f46ddba13c8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:34.436450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:34.774210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1a6813c8-6805-422c-b2c2-2f46ddba13c8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:34.801998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1a6813c8-6805-422c-b2c2-2f46ddba13c8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:34.803808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1a6813c8-6805-422c-b2c2-2f46ddba13c8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:34.805435 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1a6813c8-6805-422c-b2c2-2f46ddba13c8 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1873 microversion: 2.32 time: 0.450559 Jul 14 14:45:34.820463 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1797/3625] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:34 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1873 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:34.836165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3b9eea0f-49a0-457a-8499-29403f7dbd89 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:34.837171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3b9eea0f-49a0-457a-8499-29403f7dbd89 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:34.843461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:34.849142 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b1fee6a-5fea-4db8-98b2-18bef74566f6 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.322526 Jul 14 14:45:34.851687 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1829/3626] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:45:33 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:34.857684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1174f5f5-3c99-4d81-a5f1-b1c6d8f11cf1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:34.858196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b9eea0f-49a0-457a-8499-29403f7dbd89 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.858528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1174f5f5-3c99-4d81-a5f1-b1c6d8f11cf1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:34.858987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b9eea0f-49a0-457a-8499-29403f7dbd89 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:34.873736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b9eea0f-49a0-457a-8499-29403f7dbd89 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.874254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b9eea0f-49a0-457a-8499-29403f7dbd89 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:34.878056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1174f5f5-3c99-4d81-a5f1-b1c6d8f11cf1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.880739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1174f5f5-3c99-4d81-a5f1-b1c6d8f11cf1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:34.883037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1174f5f5-3c99-4d81-a5f1-b1c6d8f11cf1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.883746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1174f5f5-3c99-4d81-a5f1-b1c6d8f11cf1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:35.384440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3b9eea0f-49a0-457a-8499-29403f7dbd89 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:35.392990 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3b9eea0f-49a0-457a-8499-29403f7dbd89 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1368 microversion: 2.1 time: 0.571043 Jul 14 14:45:35.395952 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1798/3627] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:34 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1368 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:35.407909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-94853ffc-18ea-4b08-9f3b-86014c3acb42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:35.408845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-94853ffc-18ea-4b08-9f3b-86014c3acb42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:35.423783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94853ffc-18ea-4b08-9f3b-86014c3acb42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:35.426005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94853ffc-18ea-4b08-9f3b-86014c3acb42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:35.426932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94853ffc-18ea-4b08-9f3b-86014c3acb42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:35.428601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94853ffc-18ea-4b08-9f3b-86014c3acb42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:35.474031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1174f5f5-3c99-4d81-a5f1-b1c6d8f11cf1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:35.486632 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1174f5f5-3c99-4d81-a5f1-b1c6d8f11cf1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1315 microversion: 2.1 time: 0.633129 Jul 14 14:45:35.488740 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1830/3628] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:34 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:35.498921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e62fe04d-3bd7-450c-9642-1a8a078f338c tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Action: 'create', calling method: .version_select at 0x7fd6c4f1c700>, body: {"security_group_rule": {"parent_group_id": "b08f4721-d23f-4b9d-b6f8-c8743a0d7fd9", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:35.715186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-94853ffc-18ea-4b08-9f3b-86014c3acb42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:35.739580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-94853ffc-18ea-4b08-9f3b-86014c3acb42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:35.746362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-94853ffc-18ea-4b08-9f3b-86014c3acb42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:35.750301 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-94853ffc-18ea-4b08-9f3b-86014c3acb42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1604 microversion: 2.42 time: 0.352582 Jul 14 14:45:35.752034 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1799/3629] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:35 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1604 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:35.758796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7c54c6bd-c24c-456d-b318-11c4182e3215 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:35.759714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7c54c6bd-c24c-456d-b318-11c4182e3215 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:35.793340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c54c6bd-c24c-456d-b318-11c4182e3215 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:35.794864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c54c6bd-c24c-456d-b318-11c4182e3215 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:35.795748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c54c6bd-c24c-456d-b318-11c4182e3215 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:35.799763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c54c6bd-c24c-456d-b318-11c4182e3215 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:36.678289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c54c6bd-c24c-456d-b318-11c4182e3215 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:36.700460 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e62fe04d-3bd7-450c-9642-1a8a078f338c tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.210426 Jul 14 14:45:36.701293 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7c54c6bd-c24c-456d-b318-11c4182e3215 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.946208 Jul 14 14:45:36.706583 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1831/3630] 10.222.0.81 () {60 vars in 1194 bytes} [Thu Jul 14 14:45:35 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:36.708434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-67c152d7-08f0-4e3f-9f79-e9ef07c16532 req-63aeba20-4c4a-4c6a-99fe-c3eb4a35bea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9881e309-0999-4b05-aff0-32b4c56cc2a2", "name": "network-vif-plugged", "status": "completed", "tag": "6eeee992-9c9c-43b8-9322-852bb5d18ad9"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:36.739925 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1800/3631] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:35 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:36.752912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-67c152d7-08f0-4e3f-9f79-e9ef07c16532 req-63aeba20-4c4a-4c6a-99fe-c3eb4a35bea1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:36.753780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-67c152d7-08f0-4e3f-9f79-e9ef07c16532 req-63aeba20-4c4a-4c6a-99fe-c3eb4a35bea1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:36.759032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:36.788348 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-67c152d7-08f0-4e3f-9f79-e9ef07c16532 req-63aeba20-4c4a-4c6a-99fe-c3eb4a35bea1 service nova] Creating event network-vif-plugged:6eeee992-9c9c-43b8-9322-852bb5d18ad9 for instance 9881e309-0999-4b05-aff0-32b4c56cc2a2 on n-h2-767704-28 Jul 14 14:45:36.796284 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-67c152d7-08f0-4e3f-9f79-e9ef07c16532 req-63aeba20-4c4a-4c6a-99fe-c3eb4a35bea1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092773 Jul 14 14:45:36.797845 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1832/3632] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:36.805110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-38f7bf3d-cfbd-45f5-bdf6-f212559c736d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:36.806703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-38f7bf3d-cfbd-45f5-bdf6-f212559c736d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:36.813982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38f7bf3d-cfbd-45f5-bdf6-f212559c736d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:36.814620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38f7bf3d-cfbd-45f5-bdf6-f212559c736d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:36.815618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38f7bf3d-cfbd-45f5-bdf6-f212559c736d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:36.816221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38f7bf3d-cfbd-45f5-bdf6-f212559c736d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:36.837710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-adeb90c5-567d-41b8-97b2-5357b5120e1b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:36.850710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-adeb90c5-567d-41b8-97b2-5357b5120e1b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:36.867415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adeb90c5-567d-41b8-97b2-5357b5120e1b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:36.867872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adeb90c5-567d-41b8-97b2-5357b5120e1b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:36.881572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adeb90c5-567d-41b8-97b2-5357b5120e1b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:36.883734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adeb90c5-567d-41b8-97b2-5357b5120e1b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:37.999919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-38f7bf3d-cfbd-45f5-bdf6-f212559c736d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:38.016507 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-38f7bf3d-cfbd-45f5-bdf6-f212559c736d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1368 microversion: 2.1 time: 1.216818 Jul 14 14:45:38.026027 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1833/3633] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:36 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1368 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:38.045879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0eeace95-be72-4c72-a658-153b7a8ea16c tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:38.046661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0eeace95-be72-4c72-a658-153b7a8ea16c tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:38.067230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eeace95-be72-4c72-a658-153b7a8ea16c tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.067791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eeace95-be72-4c72-a658-153b7a8ea16c tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.075183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eeace95-be72-4c72-a658-153b7a8ea16c tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.075908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eeace95-be72-4c72-a658-153b7a8ea16c tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.102421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-adeb90c5-567d-41b8-97b2-5357b5120e1b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:38.126627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-adeb90c5-567d-41b8-97b2-5357b5120e1b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:38.128431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-adeb90c5-567d-41b8-97b2-5357b5120e1b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:38.137904 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-adeb90c5-567d-41b8-97b2-5357b5120e1b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2825 microversion: 2.32 time: 1.395057 Jul 14 14:45:38.159140 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1801/3634] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:36 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2825 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:38.169982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-48c35639-858a-45c4-bf09-8aa78a370520 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Calling method '.version_select at 0x7fd6c579d940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:38.330054 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-48c35639-858a-45c4-bf09-8aa78a370520 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "GET /compute/v2.1/os-security-groups/b08f4721-d23f-4b9d-b6f8-c8743a0d7fd9" status: 200 len: 664 microversion: 2.1 time: 0.169674 Jul 14 14:45:38.330911 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1802/3635] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:45:38 2022] GET /compute/v2.1/os-security-groups/b08f4721-d23f-4b9d-b6f8-c8743a0d7fd9 => generated 664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:38.337755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0e49dea2-6051-4fa5-822c-39f1facce1cc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:38.345181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0e49dea2-6051-4fa5-822c-39f1facce1cc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:38.357310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e49dea2-6051-4fa5-822c-39f1facce1cc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.358016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e49dea2-6051-4fa5-822c-39f1facce1cc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.361211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e49dea2-6051-4fa5-822c-39f1facce1cc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.361844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e49dea2-6051-4fa5-822c-39f1facce1cc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.565190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0eeace95-be72-4c72-a658-153b7a8ea16c tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:38.583386 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0eeace95-be72-4c72-a658-153b7a8ea16c tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1315 microversion: 2.1 time: 0.555783 Jul 14 14:45:38.593190 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1834/3636] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:38 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:38.597741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a02a3b80-3424-4fdf-9f99-810800baef42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:38.598367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a02a3b80-3424-4fdf-9f99-810800baef42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:38.615446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a02a3b80-3424-4fdf-9f99-810800baef42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.615915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a02a3b80-3424-4fdf-9f99-810800baef42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.616706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a02a3b80-3424-4fdf-9f99-810800baef42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.617181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a02a3b80-3424-4fdf-9f99-810800baef42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.051337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a02a3b80-3424-4fdf-9f99-810800baef42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:39.073250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a02a3b80-3424-4fdf-9f99-810800baef42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:39.074799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a02a3b80-3424-4fdf-9f99-810800baef42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:39.076027 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a02a3b80-3424-4fdf-9f99-810800baef42 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1604 microversion: 2.42 time: 0.485825 Jul 14 14:45:39.076606 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1835/3637] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:38 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1604 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:39.092399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-1d50607d-bfaa-415d-ba7d-80f0cac5bff8 req-8e297cb1-98fe-442c-940e-cd192f4537bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9fadee3-2871-4c8e-adda-e95d99e56a1a", "tag": "83a28852-1f2f-4d1f-b2b4-075a5434ee65"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:39.102400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1d50607d-bfaa-415d-ba7d-80f0cac5bff8 req-8e297cb1-98fe-442c-940e-cd192f4537bc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:39.103096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1d50607d-bfaa-415d-ba7d-80f0cac5bff8 req-8e297cb1-98fe-442c-940e-cd192f4537bc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.123893 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-1d50607d-bfaa-415d-ba7d-80f0cac5bff8 req-8e297cb1-98fe-442c-940e-cd192f4537bc service nova] Creating event network-changed:83a28852-1f2f-4d1f-b2b4-075a5434ee65 for instance a9fadee3-2871-4c8e-adda-e95d99e56a1a on n-h1-767704-28 Jul 14 14:45:39.131644 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-1d50607d-bfaa-415d-ba7d-80f0cac5bff8 req-8e297cb1-98fe-442c-940e-cd192f4537bc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042801 Jul 14 14:45:39.136283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0e49dea2-6051-4fa5-822c-39f1facce1cc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:39.143906 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1836/3638] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:39.148928 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0e49dea2-6051-4fa5-822c-39f1facce1cc tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.816571 Jul 14 14:45:39.167225 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1803/3639] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:38 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:39.173369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-093508f7-8a85-4756-8a24-91bcf403a612 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Calling method '.version_select at 0x7fd6c5bd91f0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:39.178937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a9182010-3636-4237-8703-bc1f6cdbcf69 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:39.179743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a9182010-3636-4237-8703-bc1f6cdbcf69 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:39.187890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9182010-3636-4237-8703-bc1f6cdbcf69 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:39.188710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9182010-3636-4237-8703-bc1f6cdbcf69 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.189723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9182010-3636-4237-8703-bc1f6cdbcf69 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:39.190907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9182010-3636-4237-8703-bc1f6cdbcf69 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.514343 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a9182010-3636-4237-8703-bc1f6cdbcf69 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.368896 Jul 14 14:45:39.528802 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1837/3640] 10.222.0.81 () {60 vars in 1315 bytes} [Thu Jul 14 14:45:39 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c/os-interface => generated 1830 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:39.535113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-38a7c37f-1f70-47cf-9742-9dc8912f0529 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:39.535968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-38a7c37f-1f70-47cf-9742-9dc8912f0529 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:39.543018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38a7c37f-1f70-47cf-9742-9dc8912f0529 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:39.543710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38a7c37f-1f70-47cf-9742-9dc8912f0529 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.546452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38a7c37f-1f70-47cf-9742-9dc8912f0529 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:39.547131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38a7c37f-1f70-47cf-9742-9dc8912f0529 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.024694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:40.083682 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-093508f7-8a85-4756-8a24-91bcf403a612 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-group-rules/4de68cd1-08e3-43c5-b682-1310f3a3a1da" status: 202 len: 0 microversion: 2.1 time: 0.914715 Jul 14 14:45:40.085713 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1804/3641] 10.222.0.81 () {58 vars in 1286 bytes} [Thu Jul 14 14:45:39 2022] DELETE /compute/v2.1/os-security-group-rules/4de68cd1-08e3-43c5-b682-1310f3a3a1da => generated 0 bytes in 918 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:40.095020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c7698e4e-2658-44f4-8f84-0cf6d80fa60d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:40.096045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c7698e4e-2658-44f4-8f84-0cf6d80fa60d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:40.110552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:40.125544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-38a7c37f-1f70-47cf-9742-9dc8912f0529 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:40.138889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7698e4e-2658-44f4-8f84-0cf6d80fa60d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.139463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7698e4e-2658-44f4-8f84-0cf6d80fa60d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.140516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7698e4e-2658-44f4-8f84-0cf6d80fa60d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.143619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7698e4e-2658-44f4-8f84-0cf6d80fa60d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.144547 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-38a7c37f-1f70-47cf-9742-9dc8912f0529 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1368 microversion: 2.1 time: 0.612018 Jul 14 14:45:40.145968 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1838/3642] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:39 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1368 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:40.152651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b8f403d8-2c7e-4ac2-8ae1-0f5f25776580 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:40.154720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b8f403d8-2c7e-4ac2-8ae1-0f5f25776580 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:40.164746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8f403d8-2c7e-4ac2-8ae1-0f5f25776580 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.165570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8f403d8-2c7e-4ac2-8ae1-0f5f25776580 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.166597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8f403d8-2c7e-4ac2-8ae1-0f5f25776580 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.167260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8f403d8-2c7e-4ac2-8ae1-0f5f25776580 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.287143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c7698e4e-2658-44f4-8f84-0cf6d80fa60d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Unlocking {{(pid=119511) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 14 14:45:40.405120 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c7698e4e-2658-44f4-8f84-0cf6d80fa60d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.317585 Jul 14 14:45:40.407400 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1805/3643] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:40 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:40.418593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b829828c-5884-4ffa-8c23-0ae573dbaef9 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Calling method '.version_select at 0x7fd6cabb4040>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:40.840224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b8f403d8-2c7e-4ac2-8ae1-0f5f25776580 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:40.853454 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b8f403d8-2c7e-4ac2-8ae1-0f5f25776580 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1502 microversion: 2.1 time: 0.702641 Jul 14 14:45:40.854705 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1839/3644] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:40 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1502 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:40.864896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e8702b2b-1049-4e99-9a9d-340a4594127a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:40.867076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e8702b2b-1049-4e99-9a9d-340a4594127a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:40.879931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8702b2b-1049-4e99-9a9d-340a4594127a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.882610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8702b2b-1049-4e99-9a9d-340a4594127a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.883584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8702b2b-1049-4e99-9a9d-340a4594127a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.883986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8702b2b-1049-4e99-9a9d-340a4594127a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.040457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e8702b2b-1049-4e99-9a9d-340a4594127a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:41.081293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e8702b2b-1049-4e99-9a9d-340a4594127a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:41.083315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e8702b2b-1049-4e99-9a9d-340a4594127a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:41.085329 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e8702b2b-1049-4e99-9a9d-340a4594127a tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1604 microversion: 2.42 time: 0.228531 Jul 14 14:45:41.086588 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1840/3645] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:40 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1604 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:41.092802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1e7eebed-af45-430c-8db6-48b4993e69b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:41.113795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1e7eebed-af45-430c-8db6-48b4993e69b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:41.124550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:41.137966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e7eebed-af45-430c-8db6-48b4993e69b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:41.138649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e7eebed-af45-430c-8db6-48b4993e69b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.142370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e7eebed-af45-430c-8db6-48b4993e69b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:41.142841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e7eebed-af45-430c-8db6-48b4993e69b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.880980 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b829828c-5884-4ffa-8c23-0ae573dbaef9 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/b08f4721-d23f-4b9d-b6f8-c8743a0d7fd9" status: 202 len: 0 microversion: 2.1 time: 1.472122 Jul 14 14:45:41.881717 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1806/3646] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:45:40 2022] DELETE /compute/v2.1/os-security-groups/b08f4721-d23f-4b9d-b6f8-c8743a0d7fd9 => generated 0 bytes in 1474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:41.891095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b5c9aa1a-0bd9-44c7-9618-e4ae9f8f35d1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:41.891873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5c9aa1a-0bd9-44c7-9618-e4ae9f8f35d1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:41.910634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5c9aa1a-0bd9-44c7-9618-e4ae9f8f35d1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:41.912002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5c9aa1a-0bd9-44c7-9618-e4ae9f8f35d1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.913584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5c9aa1a-0bd9-44c7-9618-e4ae9f8f35d1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:41.915182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5c9aa1a-0bd9-44c7-9618-e4ae9f8f35d1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.930233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1e7eebed-af45-430c-8db6-48b4993e69b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:41.957775 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1e7eebed-af45-430c-8db6-48b4993e69b2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.862942 Jul 14 14:45:41.959752 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1841/3647] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:41 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:41.972483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8d1e7982-6be5-420e-b0cf-fbdc03f63254 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:41.973206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8d1e7982-6be5-420e-b0cf-fbdc03f63254 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:41.986696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d1e7982-6be5-420e-b0cf-fbdc03f63254 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:41.989732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d1e7982-6be5-420e-b0cf-fbdc03f63254 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.991243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d1e7982-6be5-420e-b0cf-fbdc03f63254 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:41.992693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d1e7982-6be5-420e-b0cf-fbdc03f63254 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.300008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b5c9aa1a-0bd9-44c7-9618-e4ae9f8f35d1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:42.308122 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b5c9aa1a-0bd9-44c7-9618-e4ae9f8f35d1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1502 microversion: 2.1 time: 0.422346 Jul 14 14:45:42.317542 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1807/3648] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:41 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1502 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:42.317542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f1e0063-519e-4b19-a8e9-b9e82050fdab tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Calling method '.version_select at 0x7fd6c4652f70>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:42.383239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG neutronclient.v2_0.client [None req-3f1e0063-519e-4b19-a8e9-b9e82050fdab tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 92622fb9-3ced-46c4-967a-087ae740425b does not exist", "detail": ""}} {{(pid=119511) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:45:42.385008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.security_group_api [None req-3f1e0063-519e-4b19-a8e9-b9e82050fdab tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Neutron security group 92622fb9-3ced-46c4-967a-087ae740425b not found {{(pid=119511) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:45:42.385858 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-3f1e0063-519e-4b19-a8e9-b9e82050fdab tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] HTTP exception thrown: Security group 92622fb9-3ced-46c4-967a-087ae740425b does not exist Jul 14 14:45:42.385858 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-5168d670-7a49-4d96-ac14-1520efcde443'] Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f1e0063-519e-4b19-a8e9-b9e82050fdab tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Request method failure captured: Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-security-groups/92622fb9-3ced-46c4-967a-087ae740425b HTTP/1.1 Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cv1_7BzjPwyCrendoTN9DPkwqICsqtrvJeJaBVCMHy2XOdhck3wSwL0APuCvahqd_ZE9i5GX196j0NS7eQm2Qr8RnXFTlIAGf4hXo9Dr_fsjRtAxteDCEs_uDB6Rfm1lBUAstShpYfcokFF_3IBNGxJ4-iLo_s2H7srJZvFRAFusXw Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 8569c5440ea74e76ac6302ffd659ef61 Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1056077252 Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8569c5440ea74e76ac6302ffd659ef61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8569c5440ea74e76ac6302ffd659ef61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8569c5440ea74e76ac6302ffd659ef61", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8569c5440ea74e76ac6302ffd659ef61"}]}] Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1056077252 Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 8569c5440ea74e76ac6302ffd659ef61 Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1056077252 Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-SecurityGroupRulesTestJSON-1056077252-project Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 71a11739cb1d46678fbec0ba7a6d9029 Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1056077252-project Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: exception: Security group 92622fb9-3ced-46c4-967a-087ae740425b does not exist Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-5168d670-7a49-4d96-ac14-1520efcde443'] Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '92622fb9-3ced-46c4-967a-087ae740425b'} Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:45:42.389133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 92622fb9-3ced-46c4-967a-087ae740425b does not exist Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5168d670-7a49-4d96-ac14-1520efcde443'] Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 92622fb9-3ced-46c4-967a-087ae740425b does not exist Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5168d670-7a49-4d96-ac14-1520efcde443'] Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 92622fb9-3ced-46c4-967a-087ae740425b does not exist Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5168d670-7a49-4d96-ac14-1520efcde443'] Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 92622fb9-3ced-46c4-967a-087ae740425b does not exist Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5168d670-7a49-4d96-ac14-1520efcde443'] Jul 14 14:45:42.394220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:42.401203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f1e0063-519e-4b19-a8e9-b9e82050fdab tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Returning 404 to user: Security group 92622fb9-3ced-46c4-967a-087ae740425b does not exist Jul 14 14:45:42.401203 n-d-767704-28 devstack@n-api.service[119511]: Neutron server returns request_ids: ['req-5168d670-7a49-4d96-ac14-1520efcde443'] {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:42.401203 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3f1e0063-519e-4b19-a8e9-b9e82050fdab tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/92622fb9-3ced-46c4-967a-087ae740425b" status: 404 len: 194 microversion: 2.1 time: 0.091222 Jul 14 14:45:42.401628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8d1e7982-6be5-420e-b0cf-fbdc03f63254 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:42.405708 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1808/3649] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:45:42 2022] DELETE /compute/v2.1/os-security-groups/92622fb9-3ced-46c4-967a-087ae740425b => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:45:42.413872 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8d1e7982-6be5-420e-b0cf-fbdc03f63254 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1368 microversion: 2.1 time: 0.452664 Jul 14 14:45:42.423589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39ecd209-dd91-4ef9-a8ab-814ef2cdca57 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:42.423846 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1842/3650] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:41 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1368 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:42.423940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-39ecd209-dd91-4ef9-a8ab-814ef2cdca57 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:42.426160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-40d47e88-43e9-441a-845a-2060cf5d4473 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:42.426784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-40d47e88-43e9-441a-845a-2060cf5d4473 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:42.427107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39ecd209-dd91-4ef9-a8ab-814ef2cdca57 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.427790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39ecd209-dd91-4ef9-a8ab-814ef2cdca57 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.430723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39ecd209-dd91-4ef9-a8ab-814ef2cdca57 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.431294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39ecd209-dd91-4ef9-a8ab-814ef2cdca57 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.439283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40d47e88-43e9-441a-845a-2060cf5d4473 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.439743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40d47e88-43e9-441a-845a-2060cf5d4473 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.440537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40d47e88-43e9-441a-845a-2060cf5d4473 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.440989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40d47e88-43e9-441a-845a-2060cf5d4473 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.592407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-40d47e88-43e9-441a-845a-2060cf5d4473 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:42.612205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-40d47e88-43e9-441a-845a-2060cf5d4473 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:42.613834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-40d47e88-43e9-441a-845a-2060cf5d4473 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:42.615209 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-40d47e88-43e9-441a-845a-2060cf5d4473 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1604 microversion: 2.42 time: 0.197220 Jul 14 14:45:42.615790 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1843/3651] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:42 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1604 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:42.622199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2a3250da-bdf4-46e7-83c1-5a57662f2b48 req-9ce7c097-2a68-4ece-bbcc-ec7944b8f9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "tag": "e821f371-f015-4b58-8a2e-a1611a49246a"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:42.633928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2a3250da-bdf4-46e7-83c1-5a57662f2b48 req-9ce7c097-2a68-4ece-bbcc-ec7944b8f9c7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.634624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2a3250da-bdf4-46e7-83c1-5a57662f2b48 req-9ce7c097-2a68-4ece-bbcc-ec7944b8f9c7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.653418 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2a3250da-bdf4-46e7-83c1-5a57662f2b48 req-9ce7c097-2a68-4ece-bbcc-ec7944b8f9c7 service nova] Creating event network-changed:e821f371-f015-4b58-8a2e-a1611a49246a for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:45:42.666543 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2a3250da-bdf4-46e7-83c1-5a57662f2b48 req-9ce7c097-2a68-4ece-bbcc-ec7944b8f9c7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047636 Jul 14 14:45:42.671028 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1844/3652] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:42.720685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-39ecd209-dd91-4ef9-a8ab-814ef2cdca57 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:42.737728 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-39ecd209-dd91-4ef9-a8ab-814ef2cdca57 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.330743 Jul 14 14:45:42.742754 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1809/3653] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:42 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:42.765318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24086c1c-96d4-4bfc-817a-c7af7a314ebe tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:42.765318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-24086c1c-96d4-4bfc-817a-c7af7a314ebe tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:42.778382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24086c1c-96d4-4bfc-817a-c7af7a314ebe tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.778850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24086c1c-96d4-4bfc-817a-c7af7a314ebe tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.779661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24086c1c-96d4-4bfc-817a-c7af7a314ebe tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.780105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24086c1c-96d4-4bfc-817a-c7af7a314ebe tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.836295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-24086c1c-96d4-4bfc-817a-c7af7a314ebe tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lazy-loading 'flavor' on Instance uuid 9881e309-0999-4b05-aff0-32b4c56cc2a2 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:45:42.925641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1917641373", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": "none"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:43.010604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:45:43.011049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:45:43.011526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:45:43.011933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:45:43.012341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:45:43.018449 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-24086c1c-96d4-4bfc-817a-c7af7a314ebe tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "POST /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2/action" status: 202 len: 0 microversion: 2.1 time: 0.273762 Jul 14 14:45:43.019953 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1810/3654] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:42 2022] POST /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:43.026202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3752fa3e-5ad4-4b02-b586-2a0f5a211b82 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Calling method '.version_select at 0x7fd6c464e430>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:43.054475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:43.054850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:43.055667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:43.056088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:43.103443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Getting quotas for project e534e8517f514078988df401f9d6bec7. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:45:43.110317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Getting quotas for user d56db16b8418478499b4163e8de66b38 and project e534e8517f514078988df401f9d6bec7. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:45:43.142580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:45:43.144814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: f13a0dbf-ac6b-4144-85e7-53277b8472e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:45:43.246266 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-112068d7-d8b8-43bc-8093-c3ad2b81c3ed tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.574154 Jul 14 14:45:43.247314 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1845/3655] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:45:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:45:43.264668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-47718312-9914-4834-badd-a357e8f7d679 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:43.265330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-47718312-9914-4834-badd-a357e8f7d679 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:43.292653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47718312-9914-4834-badd-a357e8f7d679 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:43.293213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47718312-9914-4834-badd-a357e8f7d679 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:43.294040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47718312-9914-4834-badd-a357e8f7d679 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:43.294496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47718312-9914-4834-badd-a357e8f7d679 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:43.891724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-47718312-9914-4834-badd-a357e8f7d679 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:43.924836 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-47718312-9914-4834-badd-a357e8f7d679 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.674384 Jul 14 14:45:43.945778 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1846/3656] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:43 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:43.972044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05a4bd65-92fd-4be5-8bf4-6bd18a9ac4a1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:43.973716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-05a4bd65-92fd-4be5-8bf4-6bd18a9ac4a1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:43.995546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05a4bd65-92fd-4be5-8bf4-6bd18a9ac4a1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:43.996790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05a4bd65-92fd-4be5-8bf4-6bd18a9ac4a1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:43.998628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05a4bd65-92fd-4be5-8bf4-6bd18a9ac4a1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.001169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05a4bd65-92fd-4be5-8bf4-6bd18a9ac4a1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.443267 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3752fa3e-5ad4-4b02-b586-2a0f5a211b82 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/a558acfa-194f-40c4-968e-19f2acf8f7c9" status: 202 len: 0 microversion: 2.1 time: 1.420403 Jul 14 14:45:44.444469 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1811/3657] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:45:43 2022] DELETE /compute/v2.1/os-security-groups/a558acfa-194f-40c4-968e-19f2acf8f7c9 => generated 0 bytes in 1424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:44.450413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fe186521-da58-4903-8041-d1b613d2e064 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:44.451594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fe186521-da58-4903-8041-d1b613d2e064 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: f13a0dbf-ac6b-4144-85e7-53277b8472e7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:44.487104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe186521-da58-4903-8041-d1b613d2e064 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.489183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe186521-da58-4903-8041-d1b613d2e064 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.489183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe186521-da58-4903-8041-d1b613d2e064 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.489955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe186521-da58-4903-8041-d1b613d2e064 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.576334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-05a4bd65-92fd-4be5-8bf4-6bd18a9ac4a1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.604769 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-05a4bd65-92fd-4be5-8bf4-6bd18a9ac4a1 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1493 microversion: 2.1 time: 0.652333 Jul 14 14:45:44.621715 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1847/3658] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:43 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1493 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:44.631258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fe186521-da58-4903-8041-d1b613d2e064 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.637685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b076b058-4348-441a-8118-c857763bb160 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:44.638371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b076b058-4348-441a-8118-c857763bb160 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:44.641041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fe186521-da58-4903-8041-d1b613d2e064 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.651153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fe186521-da58-4903-8041-d1b613d2e064 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.651635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b076b058-4348-441a-8118-c857763bb160 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.652848 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fe186521-da58-4903-8041-d1b613d2e064 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7" status: 200 len: 1274 microversion: 2.47 time: 0.207207 Jul 14 14:45:44.655430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b076b058-4348-441a-8118-c857763bb160 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.655952 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1812/3659] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:44 2022] GET /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:44.668995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b076b058-4348-441a-8118-c857763bb160 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.668995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b076b058-4348-441a-8118-c857763bb160 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.689406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:44.702391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:44.719061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.726275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.727702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.728357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.784391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.785131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.785894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lazy-loading 'fault' on Instance uuid 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:45:44.864892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.874048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.876254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dc8a2925ac47dfa2b9518242f99370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb8f7dedbf34c44922ce681e837045d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.877623 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a4cca685-386b-4242-849c-108eb96007cc tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 200 len: 1609 microversion: 2.42 time: 0.207241 Jul 14 14:45:44.878395 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1813/3660] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:44 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 1609 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:44.889070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98a3e287-a634-4d26-9fb4-0514620811c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:44.889070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-98a3e287-a634-4d26-9fb4-0514620811c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:44.894835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98a3e287-a634-4d26-9fb4-0514620811c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.895306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98a3e287-a634-4d26-9fb4-0514620811c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.896155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98a3e287-a634-4d26-9fb4-0514620811c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.896538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98a3e287-a634-4d26-9fb4-0514620811c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.925347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:44.987770 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98a3e287-a634-4d26-9fb4-0514620811c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.106874 Jul 14 14:45:44.988474 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1814/3661] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:44 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:44.993978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2c37e34d-386f-4910-abc0-3c94bb3d03b4 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Calling method '.version_select at 0x7fd6c5f9f700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:45.085678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b076b058-4348-441a-8118-c857763bb160 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:45.099912 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b076b058-4348-441a-8118-c857763bb160 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1368 microversion: 2.1 time: 0.474018 Jul 14 14:45:45.103118 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1848/3662] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:44 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1368 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:45.112701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8da89b81-541a-4f24-b1f7-f49f53968629 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:45.113632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8da89b81-541a-4f24-b1f7-f49f53968629 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:45.121040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8da89b81-541a-4f24-b1f7-f49f53968629 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.121878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8da89b81-541a-4f24-b1f7-f49f53968629 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.122984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8da89b81-541a-4f24-b1f7-f49f53968629 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.123672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8da89b81-541a-4f24-b1f7-f49f53968629 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.228444 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8da89b81-541a-4f24-b1f7-f49f53968629 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "POST /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2/action" status: 202 len: 0 microversion: 2.1 time: 0.122548 Jul 14 14:45:45.228444 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1849/3663] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:45 2022] POST /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:45.234121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1479310950", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": "none"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:45.336904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:45:45.337396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:45:45.338435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:45:45.338870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:45:45.340110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:45:45.370191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.375937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.377340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.378054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.426964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Getting quotas for project e534e8517f514078988df401f9d6bec7. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:45:45.434707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Getting quotas for user d56db16b8418478499b4163e8de66b38 and project e534e8517f514078988df401f9d6bec7. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:45:45.455077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:45:45.458039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:45:45.533223 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8f74cfb-c653-4c21-9eb2-dcfef7bc95d2 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.303300 Jul 14 14:45:45.534497 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1850/3664] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:45:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 305 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:45:45.540374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-498793a7-81fa-4f90-97a4-7c8d3b90cffe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:45.541374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-498793a7-81fa-4f90-97a4-7c8d3b90cffe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:45.549840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-498793a7-81fa-4f90-97a4-7c8d3b90cffe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.550674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-498793a7-81fa-4f90-97a4-7c8d3b90cffe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.551710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-498793a7-81fa-4f90-97a4-7c8d3b90cffe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.552368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-498793a7-81fa-4f90-97a4-7c8d3b90cffe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.581073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:45.912134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-498793a7-81fa-4f90-97a4-7c8d3b90cffe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:45.920202 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-498793a7-81fa-4f90-97a4-7c8d3b90cffe tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1656 microversion: 2.1 time: 0.384391 Jul 14 14:45:45.925992 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1851/3665] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:45 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1656 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:45.925992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-341b0e64-4f7f-457c-97ba-ef6ee3ad19af tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:45.925992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-341b0e64-4f7f-457c-97ba-ef6ee3ad19af tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:45.955481 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2c37e34d-386f-4910-abc0-3c94bb3d03b4 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/2284ca3f-8719-49d7-a8ca-d3188487ed88" status: 202 len: 0 microversion: 2.1 time: 0.965715 Jul 14 14:45:45.956795 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1815/3666] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:45:44 2022] DELETE /compute/v2.1/os-security-groups/2284ca3f-8719-49d7-a8ca-d3188487ed88 => generated 0 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:45.962431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8031c051-225b-402c-b781-860b4750ef33 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:45.973787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8031c051-225b-402c-b781-860b4750ef33 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:45.979645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-341b0e64-4f7f-457c-97ba-ef6ee3ad19af tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.980102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-341b0e64-4f7f-457c-97ba-ef6ee3ad19af tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.988222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-341b0e64-4f7f-457c-97ba-ef6ee3ad19af tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.988755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-341b0e64-4f7f-457c-97ba-ef6ee3ad19af tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.046462 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8031c051-225b-402c-b781-860b4750ef33 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "PUT /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 992 microversion: 2.47 time: 0.088085 Jul 14 14:45:46.049151 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1816/3667] 10.222.0.81 () {62 vars in 1296 bytes} [Thu Jul 14 14:45:45 2022] PUT /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 992 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:45:46.054449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8f5e93d-bc0b-4b57-9cf3-ed68cb39bc41 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.055376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b8f5e93d-bc0b-4b57-9cf3-ed68cb39bc41 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:46.067251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8f5e93d-bc0b-4b57-9cf3-ed68cb39bc41 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.071866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8f5e93d-bc0b-4b57-9cf3-ed68cb39bc41 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.073042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8f5e93d-bc0b-4b57-9cf3-ed68cb39bc41 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.073724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8f5e93d-bc0b-4b57-9cf3-ed68cb39bc41 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.093202 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b8f5e93d-bc0b-4b57-9cf3-ed68cb39bc41 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] HTTP exception thrown: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8f5e93d-bc0b-4b57-9cf3-ed68cb39bc41 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Request method failure captured: Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 HTTP/1.1 Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CphzeAB7__tVDuw9No0ry0Aec0fclIE560Z_oDkAsFD4zgjaK9wuz8B7c8CS2DNEalTM4lhcNs_o5PLcv5NbsUYrDkeE3Z32tRyfgRI-a-T0GBOWAgzzDeMh7smUm7JXkt-ZUZlTgsxeuk6fmIPaxPoqq9iNzVheaygor0UIpGfvm0 Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.42 Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 5eb8f7dedbf34c44922ce681e837045d Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1300140070 Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eb8f7dedbf34c44922ce681e837045d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5eb8f7dedbf34c44922ce681e837045d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5eb8f7dedbf34c44922ce681e837045d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eb8f7dedbf34c44922ce681e837045d"}]}] Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1300140070 Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 5eb8f7dedbf34c44922ce681e837045d Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1300140070 Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TaggedBootDevicesTest_v242-1300140070-project Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 53dc8a2925ac47dfa2b9518242f99370 Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1300140070-project Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0e55a647-8a5e-48e1-9cfb-2c26ed55e971'} Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:46.096804 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:46.100728 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:46.100728 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:46.100728 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:46.100728 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:46.100728 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:46.100728 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:46.100728 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:46.100728 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:46.103207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8f5e93d-bc0b-4b57-9cf3-ed68cb39bc41 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Returning 404 to user: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:46.104305 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b8f5e93d-bc0b-4b57-9cf3-ed68cb39bc41 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 404 len: 111 microversion: 2.42 time: 0.053912 Jul 14 14:45:46.105789 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1817/3668] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:46 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:45:46.113401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2e6e0bcb-ca16-4f5e-91ab-c92a7ca3a2ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:46.114605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2e6e0bcb-ca16-4f5e-91ab-c92a7ca3a2ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:46.121710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e6e0bcb-ca16-4f5e-91ab-c92a7ca3a2ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.122563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e6e0bcb-ca16-4f5e-91ab-c92a7ca3a2ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.123818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e6e0bcb-ca16-4f5e-91ab-c92a7ca3a2ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.124448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e6e0bcb-ca16-4f5e-91ab-c92a7ca3a2ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.270752 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2e6e0bcb-ca16-4f5e-91ab-c92a7ca3a2ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.161761 Jul 14 14:45:46.271218 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1818/3669] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:46 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:46.280457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1e5d0db4-a59f-4558-8621-499e11c9f575 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Calling method '.version_select at 0x7fd6c5bc29d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.310977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-341b0e64-4f7f-457c-97ba-ef6ee3ad19af tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:46.323007 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-341b0e64-4f7f-457c-97ba-ef6ee3ad19af tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1499 microversion: 2.1 time: 0.387368 Jul 14 14:45:46.324334 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1852/3670] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:45 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1499 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:46.335912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-87119ece-e6fb-4d1e-925e-18866a78bff8 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.338322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-87119ece-e6fb-4d1e-925e-18866a78bff8 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:46.351008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-87119ece-e6fb-4d1e-925e-18866a78bff8 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.352387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-87119ece-e6fb-4d1e-925e-18866a78bff8 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.354610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-87119ece-e6fb-4d1e-925e-18866a78bff8 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.357590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-87119ece-e6fb-4d1e-925e-18866a78bff8 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.477119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-87119ece-e6fb-4d1e-925e-18866a78bff8 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:46.491765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-87119ece-e6fb-4d1e-925e-18866a78bff8 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:46.493665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-87119ece-e6fb-4d1e-925e-18866a78bff8 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:46.497355 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-87119ece-e6fb-4d1e-925e-18866a78bff8 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1282 microversion: 2.47 time: 0.170385 Jul 14 14:45:46.499293 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1853/3671] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:46 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:46.518694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-50a45623-71c9-49fa-8cb1-d85731d851c4 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '.version_select at 0x7fd6c4e52280>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.552815 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-50a45623-71c9-49fa-8cb1-d85731d851c4 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318752447" status: 204 len: 0 microversion: 2.42 time: 0.051179 Jul 14 14:45:46.553554 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1854/3672] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 14:45:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318752447 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:45:46.567518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9bc32f4a-b41a-4d5a-b8a0-d3f780576d2a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.572737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9bc32f4a-b41a-4d5a-b8a0-d3f780576d2a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:46.613461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9bc32f4a-b41a-4d5a-b8a0-d3f780576d2a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.616529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9bc32f4a-b41a-4d5a-b8a0-d3f780576d2a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.620104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9bc32f4a-b41a-4d5a-b8a0-d3f780576d2a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.646699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9bc32f4a-b41a-4d5a-b8a0-d3f780576d2a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.740605 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1e5d0db4-a59f-4558-8621-499e11c9f575 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/0ccf6aaa-7d07-449c-9ecd-f8e7695d6edb" status: 202 len: 0 microversion: 2.1 time: 0.467434 Jul 14 14:45:46.742677 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1819/3673] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:45:46 2022] DELETE /compute/v2.1/os-security-groups/0ccf6aaa-7d07-449c-9ecd-f8e7695d6edb => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:46.755750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7b2ba687-c5f3-4092-8bd2-fb88463674b6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.757918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7b2ba687-c5f3-4092-8bd2-fb88463674b6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:46.779352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b2ba687-c5f3-4092-8bd2-fb88463674b6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.779748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b2ba687-c5f3-4092-8bd2-fb88463674b6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.784356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b2ba687-c5f3-4092-8bd2-fb88463674b6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.784667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b2ba687-c5f3-4092-8bd2-fb88463674b6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:47.207082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7b2ba687-c5f3-4092-8bd2-fb88463674b6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:47.225505 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7b2ba687-c5f3-4092-8bd2-fb88463674b6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1663 microversion: 2.1 time: 0.476881 Jul 14 14:45:47.227727 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1820/3674] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:46 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1663 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:47.236568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a79ea97f-a523-438a-9f98-adbb0e789324 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Calling method '.version_select at 0x7fd6c59a1310>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:47.367167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9bc32f4a-b41a-4d5a-b8a0-d3f780576d2a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:47.381673 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9bc32f4a-b41a-4d5a-b8a0-d3f780576d2a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1368 microversion: 2.1 time: 0.826113 Jul 14 14:45:47.382699 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1855/3675] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:46 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1368 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:47.403734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8b4f36b7-0d98-4067-96e8-a46a08cfbecc tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:47.405995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8b4f36b7-0d98-4067-96e8-a46a08cfbecc tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:47.451687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8b4f36b7-0d98-4067-96e8-a46a08cfbecc tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:47.452717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8b4f36b7-0d98-4067-96e8-a46a08cfbecc tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:47.452932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8b4f36b7-0d98-4067-96e8-a46a08cfbecc tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:47.453581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8b4f36b7-0d98-4067-96e8-a46a08cfbecc tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:47.732258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8b4f36b7-0d98-4067-96e8-a46a08cfbecc tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:47.751518 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8b4f36b7-0d98-4067-96e8-a46a08cfbecc tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1499 microversion: 2.1 time: 0.366421 Jul 14 14:45:47.768089 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1856/3676] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:47 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1499 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:47.778137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b4a3601e-c28b-471b-a69c-f31154114b24 req-f77d32c0-05f0-42c1-8e6b-eaad613978e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9fadee3-2871-4c8e-adda-e95d99e56a1a", "name": "network-vif-plugged", "status": "completed", "tag": "83a28852-1f2f-4d1f-b2b4-075a5434ee65"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:47.794104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b4a3601e-c28b-471b-a69c-f31154114b24 req-f77d32c0-05f0-42c1-8e6b-eaad613978e1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:47.794886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b4a3601e-c28b-471b-a69c-f31154114b24 req-f77d32c0-05f0-42c1-8e6b-eaad613978e1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:47.817494 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b4a3601e-c28b-471b-a69c-f31154114b24 req-f77d32c0-05f0-42c1-8e6b-eaad613978e1 service nova] Creating event network-vif-plugged:83a28852-1f2f-4d1f-b2b4-075a5434ee65 for instance a9fadee3-2871-4c8e-adda-e95d99e56a1a on n-h1-767704-28 Jul 14 14:45:47.824289 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b4a3601e-c28b-471b-a69c-f31154114b24 req-f77d32c0-05f0-42c1-8e6b-eaad613978e1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052924 Jul 14 14:45:47.825744 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1857/3677] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:47.835699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b93f5de5-a4b9-4f1d-9570-eb8471424b9c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:47.836649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b93f5de5-a4b9-4f1d-9570-eb8471424b9c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:47.845281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b93f5de5-a4b9-4f1d-9570-eb8471424b9c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:47.845870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b93f5de5-a4b9-4f1d-9570-eb8471424b9c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:47.847203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b93f5de5-a4b9-4f1d-9570-eb8471424b9c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:47.847805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b93f5de5-a4b9-4f1d-9570-eb8471424b9c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:47.897116 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a79ea97f-a523-438a-9f98-adbb0e789324 tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/a5769bc8-ce1e-4db1-ad30-ae3ddf59e6e1" status: 202 len: 0 microversion: 2.1 time: 0.667010 Jul 14 14:45:47.898926 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1821/3678] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:45:47 2022] DELETE /compute/v2.1/os-security-groups/a5769bc8-ce1e-4db1-ad30-ae3ddf59e6e1 => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:47.906558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9506951-28f8-4a6a-924c-d8d957d7f3ff tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] Calling method '.version_select at 0x7fd6c5e7e5e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:48.051885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b93f5de5-a4b9-4f1d-9570-eb8471424b9c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:48.079450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b93f5de5-a4b9-4f1d-9570-eb8471424b9c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:48.086636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b93f5de5-a4b9-4f1d-9570-eb8471424b9c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:48.093642 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b93f5de5-a4b9-4f1d-9570-eb8471424b9c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1336 microversion: 2.47 time: 0.261352 Jul 14 14:45:48.108057 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1858/3679] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:47 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1336 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:48.254928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-30ac1181-8855-491a-996d-1966d6aa79d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:48.256304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-30ac1181-8855-491a-996d-1966d6aa79d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:48.301818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30ac1181-8855-491a-996d-1966d6aa79d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.302860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30ac1181-8855-491a-996d-1966d6aa79d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.304353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30ac1181-8855-491a-996d-1966d6aa79d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.305441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30ac1181-8855-491a-996d-1966d6aa79d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.424376 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c9506951-28f8-4a6a-924c-d8d957d7f3ff tempest-SecurityGroupRulesTestJSON-1056077252 tempest-SecurityGroupRulesTestJSON-1056077252-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/ae7d5bb6-d010-47c2-8590-e60571b212f2" status: 202 len: 0 microversion: 2.1 time: 0.521614 Jul 14 14:45:48.428590 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1822/3680] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:45:47 2022] DELETE /compute/v2.1/os-security-groups/ae7d5bb6-d010-47c2-8590-e60571b212f2 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:45:48.439119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-568d8cf7-a663-4f4d-a598-f447e757d14b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:48.440886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-568d8cf7-a663-4f4d-a598-f447e757d14b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:48.456012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-568d8cf7-a663-4f4d-a598-f447e757d14b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.457234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-568d8cf7-a663-4f4d-a598-f447e757d14b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.462295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-568d8cf7-a663-4f4d-a598-f447e757d14b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.463175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-568d8cf7-a663-4f4d-a598-f447e757d14b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.590378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-30ac1181-8855-491a-996d-1966d6aa79d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:48.602812 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-30ac1181-8855-491a-996d-1966d6aa79d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.354517 Jul 14 14:45:48.611634 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1859/3681] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:48 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:48.628631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a584226f-4260-4f4a-8f62-c0ec56bec615 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:48.629385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a584226f-4260-4f4a-8f62-c0ec56bec615 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:48.637166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a584226f-4260-4f4a-8f62-c0ec56bec615 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.637754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a584226f-4260-4f4a-8f62-c0ec56bec615 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.639077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a584226f-4260-4f4a-8f62-c0ec56bec615 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.639412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a584226f-4260-4f4a-8f62-c0ec56bec615 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.675234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-568d8cf7-a663-4f4d-a598-f447e757d14b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:48.683779 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-568d8cf7-a663-4f4d-a598-f447e757d14b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1368 microversion: 2.1 time: 0.253521 Jul 14 14:45:48.694607 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1823/3682] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:48 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:48.770673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fe80954b-37c5-4803-8da2-88773e97b006 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:48.771632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fe80954b-37c5-4803-8da2-88773e97b006 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:48.778977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe80954b-37c5-4803-8da2-88773e97b006 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.779705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe80954b-37c5-4803-8da2-88773e97b006 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.780748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe80954b-37c5-4803-8da2-88773e97b006 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.781966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe80954b-37c5-4803-8da2-88773e97b006 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.852825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a584226f-4260-4f4a-8f62-c0ec56bec615 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:48.865627 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a584226f-4260-4f4a-8f62-c0ec56bec615 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.243319 Jul 14 14:45:48.880454 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1860/3683] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:48 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:45:48.890786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-726e50d1-2035-4892-b47d-84249bc46171 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:48.892241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-726e50d1-2035-4892-b47d-84249bc46171 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:48.899236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-726e50d1-2035-4892-b47d-84249bc46171 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.900543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-726e50d1-2035-4892-b47d-84249bc46171 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.901763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-726e50d1-2035-4892-b47d-84249bc46171 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.902360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-726e50d1-2035-4892-b47d-84249bc46171 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.101170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fe80954b-37c5-4803-8da2-88773e97b006 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:49.123012 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fe80954b-37c5-4803-8da2-88773e97b006 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1499 microversion: 2.1 time: 0.355003 Jul 14 14:45:49.131432 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1824/3684] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:48 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1499 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:45:49.143562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-324b7747-bf66-4c73-becb-98442f71ce22 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:49.144202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-324b7747-bf66-4c73-becb-98442f71ce22 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:49.152338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-324b7747-bf66-4c73-becb-98442f71ce22 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.152800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-324b7747-bf66-4c73-becb-98442f71ce22 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.153634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-324b7747-bf66-4c73-becb-98442f71ce22 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.154244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-324b7747-bf66-4c73-becb-98442f71ce22 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.162533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-726e50d1-2035-4892-b47d-84249bc46171 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:49.171120 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-726e50d1-2035-4892-b47d-84249bc46171 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.288921 Jul 14 14:45:49.172068 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1861/3685] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:48 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:49.188754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e8ac3e76-19d3-45e5-939b-31aa93f6aabb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:49.189794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e8ac3e76-19d3-45e5-939b-31aa93f6aabb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:49.196095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8ac3e76-19d3-45e5-939b-31aa93f6aabb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.196855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8ac3e76-19d3-45e5-939b-31aa93f6aabb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.197915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8ac3e76-19d3-45e5-939b-31aa93f6aabb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.198579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8ac3e76-19d3-45e5-939b-31aa93f6aabb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.235272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-324b7747-bf66-4c73-becb-98442f71ce22 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:49.245402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-324b7747-bf66-4c73-becb-98442f71ce22 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:49.247579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-324b7747-bf66-4c73-becb-98442f71ce22 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:49.249420 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-324b7747-bf66-4c73-becb-98442f71ce22 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1336 microversion: 2.47 time: 0.116882 Jul 14 14:45:49.257492 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1825/3686] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:49 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1336 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:49.373609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e8ac3e76-19d3-45e5-939b-31aa93f6aabb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:49.382052 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e8ac3e76-19d3-45e5-939b-31aa93f6aabb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.197409 Jul 14 14:45:49.382655 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1862/3687] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:49 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:45:49.400509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6119e466-c694-4936-8771-769f8a69624d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:49.401930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6119e466-c694-4936-8771-769f8a69624d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:49.411179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6119e466-c694-4936-8771-769f8a69624d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.411767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6119e466-c694-4936-8771-769f8a69624d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.412697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6119e466-c694-4936-8771-769f8a69624d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.413254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6119e466-c694-4936-8771-769f8a69624d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.574253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6119e466-c694-4936-8771-769f8a69624d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:49.583284 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6119e466-c694-4936-8771-769f8a69624d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.187574 Jul 14 14:45:49.583898 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1826/3688] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:49 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:49.600445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b3257fdd-dbe8-427d-838d-f90e8e45623a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:49.601329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b3257fdd-dbe8-427d-838d-f90e8e45623a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:49.607995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3257fdd-dbe8-427d-838d-f90e8e45623a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.608515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3257fdd-dbe8-427d-838d-f90e8e45623a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.609260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3257fdd-dbe8-427d-838d-f90e8e45623a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.610879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3257fdd-dbe8-427d-838d-f90e8e45623a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.703336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5c0833e-fc7e-496a-95b9-f5610debfe5c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:49.704837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e5c0833e-fc7e-496a-95b9-f5610debfe5c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:49.711956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5c0833e-fc7e-496a-95b9-f5610debfe5c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.712511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5c0833e-fc7e-496a-95b9-f5610debfe5c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.713404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5c0833e-fc7e-496a-95b9-f5610debfe5c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.714037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5c0833e-fc7e-496a-95b9-f5610debfe5c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.751820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b3257fdd-dbe8-427d-838d-f90e8e45623a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:49.765194 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b3257fdd-dbe8-427d-838d-f90e8e45623a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.167225 Jul 14 14:45:49.767068 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1863/3689] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:49 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:49.856546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e5c0833e-fc7e-496a-95b9-f5610debfe5c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:49.865864 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e5c0833e-fc7e-496a-95b9-f5610debfe5c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1368 microversion: 2.1 time: 0.166421 Jul 14 14:45:49.866480 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1827/3690] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:49 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:45:50.144095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8593b14a-d454-4f23-8052-15727245411d tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:50.144912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8593b14a-d454-4f23-8052-15727245411d tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:50.151179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8593b14a-d454-4f23-8052-15727245411d tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.151721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8593b14a-d454-4f23-8052-15727245411d tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.152582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8593b14a-d454-4f23-8052-15727245411d tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.153139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8593b14a-d454-4f23-8052-15727245411d tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.268773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed1ff09b-95f3-432f-8339-e64fe598fba3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:50.269809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ed1ff09b-95f3-432f-8339-e64fe598fba3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:50.276599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed1ff09b-95f3-432f-8339-e64fe598fba3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.276599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed1ff09b-95f3-432f-8339-e64fe598fba3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.278039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed1ff09b-95f3-432f-8339-e64fe598fba3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.278583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed1ff09b-95f3-432f-8339-e64fe598fba3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.301506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8593b14a-d454-4f23-8052-15727245411d tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:50.310920 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8593b14a-d454-4f23-8052-15727245411d tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1502 microversion: 2.1 time: 0.171266 Jul 14 14:45:50.311715 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1864/3691] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:50 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:50.328220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-97c0a63c-5bc0-4a2f-b44c-d6c13e2c0a92 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:50.329626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-97c0a63c-5bc0-4a2f-b44c-d6c13e2c0a92 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:50.336050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97c0a63c-5bc0-4a2f-b44c-d6c13e2c0a92 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.336545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97c0a63c-5bc0-4a2f-b44c-d6c13e2c0a92 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.337375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97c0a63c-5bc0-4a2f-b44c-d6c13e2c0a92 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.337821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97c0a63c-5bc0-4a2f-b44c-d6c13e2c0a92 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.355688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ed1ff09b-95f3-432f-8339-e64fe598fba3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:50.365150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ed1ff09b-95f3-432f-8339-e64fe598fba3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:50.366255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-97c0a63c-5bc0-4a2f-b44c-d6c13e2c0a92 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lazy-loading 'flavor' on Instance uuid 9881e309-0999-4b05-aff0-32b4c56cc2a2 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:45:50.366935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ed1ff09b-95f3-432f-8339-e64fe598fba3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:50.368238 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed1ff09b-95f3-432f-8339-e64fe598fba3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1336 microversion: 2.47 time: 0.104409 Jul 14 14:45:50.369286 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1828/3692] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:50 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:45:50.457230 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-97c0a63c-5bc0-4a2f-b44c-d6c13e2c0a92 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "POST /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2/action" status: 202 len: 0 microversion: 2.1 time: 0.133116 Jul 14 14:45:50.458260 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1865/3693] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:50 2022] POST /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:50.466117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2375ed73-107c-4b00-b9db-200a82dc2370 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:50.466832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2375ed73-107c-4b00-b9db-200a82dc2370 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:50.474261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2375ed73-107c-4b00-b9db-200a82dc2370 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.475092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2375ed73-107c-4b00-b9db-200a82dc2370 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.476084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2375ed73-107c-4b00-b9db-200a82dc2370 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.476733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2375ed73-107c-4b00-b9db-200a82dc2370 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.638940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2375ed73-107c-4b00-b9db-200a82dc2370 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:50.648545 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2375ed73-107c-4b00-b9db-200a82dc2370 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1510 microversion: 2.1 time: 0.185681 Jul 14 14:45:50.648545 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1829/3694] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:50 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:50.885154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b67fd25b-4daa-48b5-a93e-6fc7a56cbedc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:50.885782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b67fd25b-4daa-48b5-a93e-6fc7a56cbedc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:50.898569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b67fd25b-4daa-48b5-a93e-6fc7a56cbedc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.899034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b67fd25b-4daa-48b5-a93e-6fc7a56cbedc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.899824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b67fd25b-4daa-48b5-a93e-6fc7a56cbedc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.900268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b67fd25b-4daa-48b5-a93e-6fc7a56cbedc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.394638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1d423f00-dc05-476b-8cf8-6eb29636daf0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:51.396497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1d423f00-dc05-476b-8cf8-6eb29636daf0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:51.413081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d423f00-dc05-476b-8cf8-6eb29636daf0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.413774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d423f00-dc05-476b-8cf8-6eb29636daf0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.414864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d423f00-dc05-476b-8cf8-6eb29636daf0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.415662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d423f00-dc05-476b-8cf8-6eb29636daf0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.545765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1d423f00-dc05-476b-8cf8-6eb29636daf0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:51.555998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1d423f00-dc05-476b-8cf8-6eb29636daf0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:51.557390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1d423f00-dc05-476b-8cf8-6eb29636daf0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:51.558639 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1d423f00-dc05-476b-8cf8-6eb29636daf0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1357 microversion: 2.47 time: 0.173779 Jul 14 14:45:51.565180 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1830/3695] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:51 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:51.578996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:51.581238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:51.588052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.588660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.594621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.595227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.683452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:45:51.684187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:45:51.684397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b67fd25b-4daa-48b5-a93e-6fc7a56cbedc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:51.684658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:45:51.685333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:45:51.685962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:45:51.703134 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b67fd25b-4daa-48b5-a93e-6fc7a56cbedc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1368 microversion: 2.1 time: 0.822980 Jul 14 14:45:51.714635 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1866/3696] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:50 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1368 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:51.720907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8e871d2f-6f7d-41e0-9eb1-640ce1dca9ce tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:51.721871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8e871d2f-6f7d-41e0-9eb1-640ce1dca9ce tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:51.730591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e871d2f-6f7d-41e0-9eb1-640ce1dca9ce tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.732336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e871d2f-6f7d-41e0-9eb1-640ce1dca9ce tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.733531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e871d2f-6f7d-41e0-9eb1-640ce1dca9ce tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.735701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8e871d2f-6f7d-41e0-9eb1-640ce1dca9ce tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.776368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:51.784099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.784859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.785813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.786396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.832501 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6fd6e349-db47-45f5-847d-0516da251e8f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "POST /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165/action" status: 202 len: 1079 microversion: 2.47 time: 0.257455 Jul 14 14:45:51.833832 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1831/3697] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 14:45:51 2022] POST /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165/action => generated 1079 bytes in 259 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 14 14:45:51.848852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80eb8d84-8657-461c-b58b-84e5bd94ea0f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:51.850178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80eb8d84-8657-461c-b58b-84e5bd94ea0f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:51.857820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80eb8d84-8657-461c-b58b-84e5bd94ea0f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.858656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80eb8d84-8657-461c-b58b-84e5bd94ea0f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.861521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80eb8d84-8657-461c-b58b-84e5bd94ea0f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.862193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80eb8d84-8657-461c-b58b-84e5bd94ea0f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:52.013482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-80eb8d84-8657-461c-b58b-84e5bd94ea0f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:52.018171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:52.032922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-80eb8d84-8657-461c-b58b-84e5bd94ea0f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:52.035006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-80eb8d84-8657-461c-b58b-84e5bd94ea0f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:52.037220 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80eb8d84-8657-461c-b58b-84e5bd94ea0f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.191591 Jul 14 14:45:52.037988 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1832/3698] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:51 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:52.059123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8e871d2f-6f7d-41e0-9eb1-640ce1dca9ce tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:52.068301 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8e871d2f-6f7d-41e0-9eb1-640ce1dca9ce tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1493 microversion: 2.1 time: 0.352203 Jul 14 14:45:52.069023 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1867/3699] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:51 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1493 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:52.086440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-597d5794-6d30-4c54-938f-a4a584d9c431 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:52.087123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-597d5794-6d30-4c54-938f-a4a584d9c431 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:52.096132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-597d5794-6d30-4c54-938f-a4a584d9c431 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:52.096732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-597d5794-6d30-4c54-938f-a4a584d9c431 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:52.097657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-597d5794-6d30-4c54-938f-a4a584d9c431 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:52.098210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-597d5794-6d30-4c54-938f-a4a584d9c431 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:52.186742 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-597d5794-6d30-4c54-938f-a4a584d9c431 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "POST /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2/action" status: 202 len: 0 microversion: 2.1 time: 0.104161 Jul 14 14:45:52.188189 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1833/3700] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:52 2022] POST /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:45:52.196973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dec3a267-9dcd-4f5c-bba8-30d1e3eac8da tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:52.197778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dec3a267-9dcd-4f5c-bba8-30d1e3eac8da tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:52.207193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dec3a267-9dcd-4f5c-bba8-30d1e3eac8da tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:52.207829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dec3a267-9dcd-4f5c-bba8-30d1e3eac8da tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:52.208772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dec3a267-9dcd-4f5c-bba8-30d1e3eac8da tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:52.209336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dec3a267-9dcd-4f5c-bba8-30d1e3eac8da tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:52.214816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:52.677456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dec3a267-9dcd-4f5c-bba8-30d1e3eac8da tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:52.692401 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dec3a267-9dcd-4f5c-bba8-30d1e3eac8da tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1499 microversion: 2.1 time: 0.497084 Jul 14 14:45:52.708272 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1868/3701] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:52 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1499 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:45:52.726013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8a7838c8-3e17-4524-ad2f-e2962d1d9be2 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:52.727441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8a7838c8-3e17-4524-ad2f-e2962d1d9be2 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:52.742012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a7838c8-3e17-4524-ad2f-e2962d1d9be2 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:52.742889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a7838c8-3e17-4524-ad2f-e2962d1d9be2 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:52.749352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a7838c8-3e17-4524-ad2f-e2962d1d9be2 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:52.750562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a7838c8-3e17-4524-ad2f-e2962d1d9be2 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.057695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3030a4dd-f4c9-4dde-a3cf-c66efa4e4aac tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:53.058317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3030a4dd-f4c9-4dde-a3cf-c66efa4e4aac tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:53.080932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3030a4dd-f4c9-4dde-a3cf-c66efa4e4aac tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.082535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3030a4dd-f4c9-4dde-a3cf-c66efa4e4aac tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.084371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3030a4dd-f4c9-4dde-a3cf-c66efa4e4aac tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.093656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3030a4dd-f4c9-4dde-a3cf-c66efa4e4aac tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.264792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3030a4dd-f4c9-4dde-a3cf-c66efa4e4aac tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:53.278608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3030a4dd-f4c9-4dde-a3cf-c66efa4e4aac tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:53.281758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3030a4dd-f4c9-4dde-a3cf-c66efa4e4aac tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:53.283763 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3030a4dd-f4c9-4dde-a3cf-c66efa4e4aac tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.230339 Jul 14 14:45:53.296283 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1869/3702] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:53 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:45:53.372575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8a7838c8-3e17-4524-ad2f-e2962d1d9be2 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:53.382072 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8a7838c8-3e17-4524-ad2f-e2962d1d9be2 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1562 microversion: 2.1 time: 0.665056 Jul 14 14:45:53.383018 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1834/3703] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:52 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1562 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:53.401093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0eac6c19-28a4-41ec-82c9-dc295460a77c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:53.401607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0eac6c19-28a4-41ec-82c9-dc295460a77c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:53.410768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eac6c19-28a4-41ec-82c9-dc295460a77c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.414426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eac6c19-28a4-41ec-82c9-dc295460a77c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.416360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eac6c19-28a4-41ec-82c9-dc295460a77c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.417118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eac6c19-28a4-41ec-82c9-dc295460a77c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.604212 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0eac6c19-28a4-41ec-82c9-dc295460a77c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207423 Jul 14 14:45:53.605663 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1870/3704] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:45:53 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:53.715169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cf5280be-5a88-471c-aa2b-16efb4935eb6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:53.715811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cf5280be-5a88-471c-aa2b-16efb4935eb6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:53.732508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf5280be-5a88-471c-aa2b-16efb4935eb6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.733128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf5280be-5a88-471c-aa2b-16efb4935eb6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.733806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf5280be-5a88-471c-aa2b-16efb4935eb6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.737754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf5280be-5a88-471c-aa2b-16efb4935eb6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:54.155291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cf5280be-5a88-471c-aa2b-16efb4935eb6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:54.166270 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cf5280be-5a88-471c-aa2b-16efb4935eb6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1499 microversion: 2.1 time: 0.456310 Jul 14 14:45:54.171471 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1835/3705] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:53 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1499 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:54.303658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-230ff69a-0426-4f9c-9a79-af6d3b2fc669 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:54.306179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-230ff69a-0426-4f9c-9a79-af6d3b2fc669 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:54.313523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-230ff69a-0426-4f9c-9a79-af6d3b2fc669 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:54.315543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-230ff69a-0426-4f9c-9a79-af6d3b2fc669 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:54.318860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-230ff69a-0426-4f9c-9a79-af6d3b2fc669 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:54.319553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-230ff69a-0426-4f9c-9a79-af6d3b2fc669 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:54.407128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-230ff69a-0426-4f9c-9a79-af6d3b2fc669 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:54.415712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-230ff69a-0426-4f9c-9a79-af6d3b2fc669 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:54.417570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-230ff69a-0426-4f9c-9a79-af6d3b2fc669 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:54.418940 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-230ff69a-0426-4f9c-9a79-af6d3b2fc669 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.119304 Jul 14 14:45:54.419995 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1871/3706] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:54 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:55.187867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3a3fddb6-f333-4cdb-a0f9-9f600c5fde6b tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:55.191988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3a3fddb6-f333-4cdb-a0f9-9f600c5fde6b tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:55.201972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a3fddb6-f333-4cdb-a0f9-9f600c5fde6b tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:55.202473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a3fddb6-f333-4cdb-a0f9-9f600c5fde6b tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:55.203940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a3fddb6-f333-4cdb-a0f9-9f600c5fde6b tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:55.204632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3a3fddb6-f333-4cdb-a0f9-9f600c5fde6b tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:55.446309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5152ab2f-15c3-43eb-bc6b-7263e9783683 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:55.447818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5152ab2f-15c3-43eb-bc6b-7263e9783683 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:55.455463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:55.456181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=12 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:55.461640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5152ab2f-15c3-43eb-bc6b-7263e9783683 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:55.462124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5152ab2f-15c3-43eb-bc6b-7263e9783683 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:55.462913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5152ab2f-15c3-43eb-bc6b-7263e9783683 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:55.463355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5152ab2f-15c3-43eb-bc6b-7263e9783683 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:55.577143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3a3fddb6-f333-4cdb-a0f9-9f600c5fde6b tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:55.585991 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3a3fddb6-f333-4cdb-a0f9-9f600c5fde6b tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1502 microversion: 2.1 time: 0.402188 Jul 14 14:45:55.597904 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1836/3707] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:55 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1502 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:55.598571 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5152ab2f-15c3-43eb-bc6b-7263e9783683 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:55.603267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-51ee9001-8488-44ec-b1d0-796d556d67ba tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:55.604089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-51ee9001-8488-44ec-b1d0-796d556d67ba tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:55.610957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51ee9001-8488-44ec-b1d0-796d556d67ba tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:55.611646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51ee9001-8488-44ec-b1d0-796d556d67ba tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:55.612590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51ee9001-8488-44ec-b1d0-796d556d67ba tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:55.613217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51ee9001-8488-44ec-b1d0-796d556d67ba tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:55.614824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5152ab2f-15c3-43eb-bc6b-7263e9783683 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:55.621888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5152ab2f-15c3-43eb-bc6b-7263e9783683 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:55.627700 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5152ab2f-15c3-43eb-bc6b-7263e9783683 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.187545 Jul 14 14:45:55.628703 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1872/3708] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:55 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:55.641712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-51ee9001-8488-44ec-b1d0-796d556d67ba tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:55.763614 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-51ee9001-8488-44ec-b1d0-796d556d67ba tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 204 len: 0 microversion: 2.1 time: 0.163854 Jul 14 14:45:55.768584 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1837/3709] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:45:55 2022] DELETE /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:45:55.776482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c629fc59-0838-4e44-a0c0-7f35d1208a55 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:55.777203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c629fc59-0838-4e44-a0c0-7f35d1208a55 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:55.784613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c629fc59-0838-4e44-a0c0-7f35d1208a55 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:55.785337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c629fc59-0838-4e44-a0c0-7f35d1208a55 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:55.786291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c629fc59-0838-4e44-a0c0-7f35d1208a55 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:55.786739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c629fc59-0838-4e44-a0c0-7f35d1208a55 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:56.505216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c629fc59-0838-4e44-a0c0-7f35d1208a55 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:56.518152 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c629fc59-0838-4e44-a0c0-7f35d1208a55 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1508 microversion: 2.1 time: 0.745814 Jul 14 14:45:56.519949 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1873/3710] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:55 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1508 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:56.647678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6a70fe08-0dc1-4119-b6bf-e22dc951d77d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:56.648272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6a70fe08-0dc1-4119-b6bf-e22dc951d77d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:56.661162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a70fe08-0dc1-4119-b6bf-e22dc951d77d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:56.661630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a70fe08-0dc1-4119-b6bf-e22dc951d77d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:56.662431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a70fe08-0dc1-4119-b6bf-e22dc951d77d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:56.662929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a70fe08-0dc1-4119-b6bf-e22dc951d77d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:56.722583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-da5d7cb7-87fb-4eda-9d38-5f2493a8bafe req-a9bbbd37-6b2d-4b4b-8df5-05f5015ce0bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9fadee3-2871-4c8e-adda-e95d99e56a1a", "tag": "83a28852-1f2f-4d1f-b2b4-075a5434ee65"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:56.736004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-da5d7cb7-87fb-4eda-9d38-5f2493a8bafe req-a9bbbd37-6b2d-4b4b-8df5-05f5015ce0bc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:56.736508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-da5d7cb7-87fb-4eda-9d38-5f2493a8bafe req-a9bbbd37-6b2d-4b4b-8df5-05f5015ce0bc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:56.753932 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-da5d7cb7-87fb-4eda-9d38-5f2493a8bafe req-a9bbbd37-6b2d-4b4b-8df5-05f5015ce0bc service nova] Creating event network-changed:83a28852-1f2f-4d1f-b2b4-075a5434ee65 for instance a9fadee3-2871-4c8e-adda-e95d99e56a1a on n-h1-767704-28 Jul 14 14:45:56.761050 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-da5d7cb7-87fb-4eda-9d38-5f2493a8bafe req-a9bbbd37-6b2d-4b4b-8df5-05f5015ce0bc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151933 Jul 14 14:45:56.762458 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1838/3711] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:56.963333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6a70fe08-0dc1-4119-b6bf-e22dc951d77d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:56.997358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6a70fe08-0dc1-4119-b6bf-e22dc951d77d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:57.005231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6a70fe08-0dc1-4119-b6bf-e22dc951d77d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:57.008485 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6a70fe08-0dc1-4119-b6bf-e22dc951d77d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.364719 Jul 14 14:45:57.011649 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1874/3712] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:56 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:57.097873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f2fe46c0-2c17-47eb-b2cf-31b339215a69 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:57.099444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f2fe46c0-2c17-47eb-b2cf-31b339215a69 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:57.129997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2fe46c0-2c17-47eb-b2cf-31b339215a69 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:57.130484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2fe46c0-2c17-47eb-b2cf-31b339215a69 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:57.145426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2fe46c0-2c17-47eb-b2cf-31b339215a69 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:57.146264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2fe46c0-2c17-47eb-b2cf-31b339215a69 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:57.169897 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f2fe46c0-2c17-47eb-b2cf-31b339215a69 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] HTTP exception thrown: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f2fe46c0-2c17-47eb-b2cf-31b339215a69 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Request method failure captured: Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 HTTP/1.1 Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CphzeAB7__tVDuw9No0ry0Aec0fclIE560Z_oDkAsFD4zgjaK9wuz8B7c8CS2DNEalTM4lhcNs_o5PLcv5NbsUYrDkeE3Z32tRyfgRI-a-T0GBOWAgzzDeMh7smUm7JXkt-ZUZlTgsxeuk6fmIPaxPoqq9iNzVheaygor0UIpGfvm0 Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.42 Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 5eb8f7dedbf34c44922ce681e837045d Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1300140070 Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eb8f7dedbf34c44922ce681e837045d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5eb8f7dedbf34c44922ce681e837045d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5eb8f7dedbf34c44922ce681e837045d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eb8f7dedbf34c44922ce681e837045d"}]}] Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1300140070 Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 5eb8f7dedbf34c44922ce681e837045d Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1300140070 Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TaggedBootDevicesTest_v242-1300140070-project Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 53dc8a2925ac47dfa2b9518242f99370 Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1300140070-project Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0e55a647-8a5e-48e1-9cfb-2c26ed55e971'} Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:45:57.171671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f2fe46c0-2c17-47eb-b2cf-31b339215a69 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Returning 404 to user: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f2fe46c0-2c17-47eb-b2cf-31b339215a69 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 404 len: 111 microversion: 2.42 time: 0.085427 Jul 14 14:45:57.176448 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1839/3713] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:45:57 2022] DELETE /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:45:57.184658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3cd9475d-a422-4ecc-bd2d-78f5343566f3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:57.186672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3cd9475d-a422-4ecc-bd2d-78f5343566f3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] [instance: 0e55a647-8a5e-48e1-9cfb-2c26ed55e971] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:57.206811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cd9475d-a422-4ecc-bd2d-78f5343566f3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:57.207642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cd9475d-a422-4ecc-bd2d-78f5343566f3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:57.209049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cd9475d-a422-4ecc-bd2d-78f5343566f3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:57.210156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cd9475d-a422-4ecc-bd2d-78f5343566f3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:57.260140 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3cd9475d-a422-4ecc-bd2d-78f5343566f3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] HTTP exception thrown: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3cd9475d-a422-4ecc-bd2d-78f5343566f3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Request method failure captured: Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 HTTP/1.1 Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CphzeAB7__tVDuw9No0ry0Aec0fclIE560Z_oDkAsFD4zgjaK9wuz8B7c8CS2DNEalTM4lhcNs_o5PLcv5NbsUYrDkeE3Z32tRyfgRI-a-T0GBOWAgzzDeMh7smUm7JXkt-ZUZlTgsxeuk6fmIPaxPoqq9iNzVheaygor0UIpGfvm0 Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.42 Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 5eb8f7dedbf34c44922ce681e837045d Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1300140070 Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eb8f7dedbf34c44922ce681e837045d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5eb8f7dedbf34c44922ce681e837045d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5eb8f7dedbf34c44922ce681e837045d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5eb8f7dedbf34c44922ce681e837045d"}]}] Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1300140070 Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 5eb8f7dedbf34c44922ce681e837045d Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1300140070 Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TaggedBootDevicesTest_v242-1300140070-project Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 53dc8a2925ac47dfa2b9518242f99370 Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1300140070-project Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '0e55a647-8a5e-48e1-9cfb-2c26ed55e971'} Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:57.262328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:57.266315 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:57.266315 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:57.266315 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:57.266315 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:57.266315 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:57.266315 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:57.266315 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. Jul 14 14:45:57.266315 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:45:57.270507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3cd9475d-a422-4ecc-bd2d-78f5343566f3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] Returning 404 to user: Instance 0e55a647-8a5e-48e1-9cfb-2c26ed55e971 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:57.273414 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3cd9475d-a422-4ecc-bd2d-78f5343566f3 tempest-TaggedBootDevicesTest_v242-1300140070 tempest-TaggedBootDevicesTest_v242-1300140070-project] 10.222.0.81 "GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971" status: 404 len: 111 microversion: 2.42 time: 0.093644 Jul 14 14:45:57.275229 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1875/3714] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:57 2022] GET /compute/v2.1/servers/0e55a647-8a5e-48e1-9cfb-2c26ed55e971 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:45:57.537659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d63fe4cd-75bf-4d96-a363-0832fc6113aa tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:57.538616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d63fe4cd-75bf-4d96-a363-0832fc6113aa tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:57.551595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d63fe4cd-75bf-4d96-a363-0832fc6113aa tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:57.554170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d63fe4cd-75bf-4d96-a363-0832fc6113aa tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:57.557454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d63fe4cd-75bf-4d96-a363-0832fc6113aa tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:57.558198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d63fe4cd-75bf-4d96-a363-0832fc6113aa tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:58.034168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1d687e7b-3862-4a9e-94fd-df2ce6f5481b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:58.035691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1d687e7b-3862-4a9e-94fd-df2ce6f5481b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:58.039965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:58.072105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d687e7b-3862-4a9e-94fd-df2ce6f5481b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:58.074377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d687e7b-3862-4a9e-94fd-df2ce6f5481b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:58.076248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d687e7b-3862-4a9e-94fd-df2ce6f5481b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:58.077114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d687e7b-3862-4a9e-94fd-df2ce6f5481b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:58.077233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d63fe4cd-75bf-4d96-a363-0832fc6113aa tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:58.094476 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d63fe4cd-75bf-4d96-a363-0832fc6113aa tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1508 microversion: 2.1 time: 0.562032 Jul 14 14:45:58.099353 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1840/3715] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:57 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1508 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:58.561919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1d687e7b-3862-4a9e-94fd-df2ce6f5481b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:58.589601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1d687e7b-3862-4a9e-94fd-df2ce6f5481b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:58.591130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1d687e7b-3862-4a9e-94fd-df2ce6f5481b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:58.602973 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1d687e7b-3862-4a9e-94fd-df2ce6f5481b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.574998 Jul 14 14:45:58.605192 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1876/3716] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:58 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:45:58.784630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6697ed3a-aae2-4a83-8bd9-8b159a24f32c req-2118aa38-a221-48c7-9d2b-5e77cd8305d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9881e309-0999-4b05-aff0-32b4c56cc2a2", "name": "network-vif-deleted", "tag": "6eeee992-9c9c-43b8-9322-852bb5d18ad9"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:58.802537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6697ed3a-aae2-4a83-8bd9-8b159a24f32c req-2118aa38-a221-48c7-9d2b-5e77cd8305d8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:58.804399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6697ed3a-aae2-4a83-8bd9-8b159a24f32c req-2118aa38-a221-48c7-9d2b-5e77cd8305d8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:58.824045 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6697ed3a-aae2-4a83-8bd9-8b159a24f32c req-2118aa38-a221-48c7-9d2b-5e77cd8305d8 service nova] Creating event network-vif-deleted:6eeee992-9c9c-43b8-9322-852bb5d18ad9 for instance 9881e309-0999-4b05-aff0-32b4c56cc2a2 on n-h2-767704-28 Jul 14 14:45:58.842867 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6697ed3a-aae2-4a83-8bd9-8b159a24f32c req-2118aa38-a221-48c7-9d2b-5e77cd8305d8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062737 Jul 14 14:45:58.848268 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1841/3717] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:59.113494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a981d6b0-913c-417f-a3c1-7ccd572c77e8 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:59.114947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a981d6b0-913c-417f-a3c1-7ccd572c77e8 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:59.126640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a981d6b0-913c-417f-a3c1-7ccd572c77e8 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:59.127428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a981d6b0-913c-417f-a3c1-7ccd572c77e8 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:59.129183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a981d6b0-913c-417f-a3c1-7ccd572c77e8 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:59.129865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a981d6b0-913c-417f-a3c1-7ccd572c77e8 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:59.201784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a981d6b0-913c-417f-a3c1-7ccd572c77e8 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:59.202696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a981d6b0-913c-417f-a3c1-7ccd572c77e8 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:59.205854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-a981d6b0-913c-417f-a3c1-7ccd572c77e8 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lazy-loading 'fault' on Instance uuid 9881e309-0999-4b05-aff0-32b4c56cc2a2 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:45:59.264506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a981d6b0-913c-417f-a3c1-7ccd572c77e8 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c70eaa4d904ac5ada24fb99a45027d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fca3ec59ac7c4c17a2fb8cad1a8e4431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:59.274812 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a981d6b0-913c-417f-a3c1-7ccd572c77e8 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 200 len: 1305 microversion: 2.1 time: 0.166044 Jul 14 14:45:59.276201 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1877/3718] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:59 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 1305 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:59.633952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be2cc300-5df4-4b8f-b840-c8f090698c7b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:59.634774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-be2cc300-5df4-4b8f-b840-c8f090698c7b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:59.654192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be2cc300-5df4-4b8f-b840-c8f090698c7b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:59.654666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be2cc300-5df4-4b8f-b840-c8f090698c7b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:59.655475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be2cc300-5df4-4b8f-b840-c8f090698c7b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:59.656117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be2cc300-5df4-4b8f-b840-c8f090698c7b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:59.848213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-be2cc300-5df4-4b8f-b840-c8f090698c7b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:59.859008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-be2cc300-5df4-4b8f-b840-c8f090698c7b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:59.861365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-be2cc300-5df4-4b8f-b840-c8f090698c7b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:59.863208 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-be2cc300-5df4-4b8f-b840-c8f090698c7b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.236382 Jul 14 14:45:59.874929 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1842/3719] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:59 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:00.293717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fe20bfbe-8666-4ea2-959b-8fc0dc097ec6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:00.295128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fe20bfbe-8666-4ea2-959b-8fc0dc097ec6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] [instance: 9881e309-0999-4b05-aff0-32b4c56cc2a2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:00.303924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe20bfbe-8666-4ea2-959b-8fc0dc097ec6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:00.304720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe20bfbe-8666-4ea2-959b-8fc0dc097ec6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:00.305816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe20bfbe-8666-4ea2-959b-8fc0dc097ec6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:00.306486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe20bfbe-8666-4ea2-959b-8fc0dc097ec6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:00.332346 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-fe20bfbe-8666-4ea2-959b-8fc0dc097ec6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] HTTP exception thrown: Instance 9881e309-0999-4b05-aff0-32b4c56cc2a2 could not be found. Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fe20bfbe-8666-4ea2-959b-8fc0dc097ec6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Request method failure captured: Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 HTTP/1.1 Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cv5CAB1uCHo-BLU_l385SwUSmkp6hG_-bE1ZP_ifBqmLD8L3laGEv9j5U4-6fjjraLg0mBi3r_-FF-IzPgee1m5LMBTuVh__ZN2k0g2s9JZ5SR019Z8iRlwoCL9MqE2iKQLipNSJKt0DZHpA8vXC9Law4sxt-Yznf04jXO4miWTA20 Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: fca3ec59ac7c4c17a2fb8cad1a8e4431 Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestServerAdvancedOps-1530756776 Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fca3ec59ac7c4c17a2fb8cad1a8e4431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fca3ec59ac7c4c17a2fb8cad1a8e4431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fca3ec59ac7c4c17a2fb8cad1a8e4431", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fca3ec59ac7c4c17a2fb8cad1a8e4431"}]}] Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestServerAdvancedOps-1530756776 Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: fca3ec59ac7c4c17a2fb8cad1a8e4431 Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestServerAdvancedOps-1530756776 Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestServerAdvancedOps-1530756776-project Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 98c70eaa4d904ac5ada24fb99a45027d Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestServerAdvancedOps-1530756776-project Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 9881e309-0999-4b05-aff0-32b4c56cc2a2 could not be found. Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '9881e309-0999-4b05-aff0-32b4c56cc2a2'} Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9881e309-0999-4b05-aff0-32b4c56cc2a2 could not be found. Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9881e309-0999-4b05-aff0-32b4c56cc2a2 could not be found. Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:00.335553 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:46:00.339086 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:00.339086 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:00.339086 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:00.339086 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:46:00.339086 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:46:00.339086 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9881e309-0999-4b05-aff0-32b4c56cc2a2 could not be found. Jul 14 14:46:00.339086 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:46:00.340907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fe20bfbe-8666-4ea2-959b-8fc0dc097ec6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] Returning 404 to user: Instance 9881e309-0999-4b05-aff0-32b4c56cc2a2 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:46:00.342379 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fe20bfbe-8666-4ea2-959b-8fc0dc097ec6 tempest-TestServerAdvancedOps-1530756776 tempest-TestServerAdvancedOps-1530756776-project] 10.222.0.81 "GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2" status: 404 len: 111 microversion: 2.1 time: 0.052794 Jul 14 14:46:00.345477 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1878/3720] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:00 2022] GET /compute/v2.1/servers/9881e309-0999-4b05-aff0-32b4c56cc2a2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:46:00.884474 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c698f1f8-60f1-4c08-904c-7b6811ee9bfd tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:00.885267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c698f1f8-60f1-4c08-904c-7b6811ee9bfd tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:00.906157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c698f1f8-60f1-4c08-904c-7b6811ee9bfd tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:00.906873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c698f1f8-60f1-4c08-904c-7b6811ee9bfd tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:00.908033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c698f1f8-60f1-4c08-904c-7b6811ee9bfd tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:00.908718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c698f1f8-60f1-4c08-904c-7b6811ee9bfd tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:01.085370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c698f1f8-60f1-4c08-904c-7b6811ee9bfd tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:01.102533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c698f1f8-60f1-4c08-904c-7b6811ee9bfd tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:01.104213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c698f1f8-60f1-4c08-904c-7b6811ee9bfd tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:01.108149 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c698f1f8-60f1-4c08-904c-7b6811ee9bfd tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.227063 Jul 14 14:46:01.108810 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1843/3721] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:00 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:02.128615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5dec1422-80f9-41cc-8b28-366219566c3c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:02.129856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5dec1422-80f9-41cc-8b28-366219566c3c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:02.139948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5dec1422-80f9-41cc-8b28-366219566c3c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:02.141208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5dec1422-80f9-41cc-8b28-366219566c3c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:02.142434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5dec1422-80f9-41cc-8b28-366219566c3c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:02.143089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5dec1422-80f9-41cc-8b28-366219566c3c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:02.337965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5dec1422-80f9-41cc-8b28-366219566c3c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:02.349294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5dec1422-80f9-41cc-8b28-366219566c3c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:02.351559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5dec1422-80f9-41cc-8b28-366219566c3c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:02.353316 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5dec1422-80f9-41cc-8b28-366219566c3c tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.229408 Jul 14 14:46:02.365544 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1879/3722] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:02 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:03.381859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8408603b-3228-417d-a0be-253b297d085f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:03.382489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8408603b-3228-417d-a0be-253b297d085f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:03.397423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8408603b-3228-417d-a0be-253b297d085f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:03.398018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8408603b-3228-417d-a0be-253b297d085f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:03.406109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8408603b-3228-417d-a0be-253b297d085f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:03.406582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8408603b-3228-417d-a0be-253b297d085f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:03.620305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8408603b-3228-417d-a0be-253b297d085f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:03.647531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8408603b-3228-417d-a0be-253b297d085f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:03.649732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8408603b-3228-417d-a0be-253b297d085f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:03.651459 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8408603b-3228-417d-a0be-253b297d085f tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.273643 Jul 14 14:46:03.672495 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1844/3723] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:03 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:04.673113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2364ee3c-eece-4f3b-ae98-80c312c1b2ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:04.674575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2364ee3c-eece-4f3b-ae98-80c312c1b2ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:04.717733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2364ee3c-eece-4f3b-ae98-80c312c1b2ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:04.725015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2364ee3c-eece-4f3b-ae98-80c312c1b2ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:04.736265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2364ee3c-eece-4f3b-ae98-80c312c1b2ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:04.736721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2364ee3c-eece-4f3b-ae98-80c312c1b2ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:05.165167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2364ee3c-eece-4f3b-ae98-80c312c1b2ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:05.228352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2364ee3c-eece-4f3b-ae98-80c312c1b2ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:05.233446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2364ee3c-eece-4f3b-ae98-80c312c1b2ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:05.236483 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2364ee3c-eece-4f3b-ae98-80c312c1b2ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.568652 Jul 14 14:46:05.238637 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1880/3724] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:04 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:06.257908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bb1fb7db-703a-4a34-bf00-da54dd6f5a6d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:06.259199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bb1fb7db-703a-4a34-bf00-da54dd6f5a6d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:06.273862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:06.279756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb1fb7db-703a-4a34-bf00-da54dd6f5a6d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:06.281663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb1fb7db-703a-4a34-bf00-da54dd6f5a6d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:06.282582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb1fb7db-703a-4a34-bf00-da54dd6f5a6d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:06.283122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb1fb7db-703a-4a34-bf00-da54dd6f5a6d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:06.524497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bb1fb7db-703a-4a34-bf00-da54dd6f5a6d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:06.549037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bb1fb7db-703a-4a34-bf00-da54dd6f5a6d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:06.550524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bb1fb7db-703a-4a34-bf00-da54dd6f5a6d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:06.551762 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bb1fb7db-703a-4a34-bf00-da54dd6f5a6d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.299047 Jul 14 14:46:06.566837 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1845/3725] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:06 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:07.581404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9a655efe-5dd1-447e-ab4b-cf7444f5f781 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:07.582026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9a655efe-5dd1-447e-ab4b-cf7444f5f781 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:07.598520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9a655efe-5dd1-447e-ab4b-cf7444f5f781 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:07.600428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9a655efe-5dd1-447e-ab4b-cf7444f5f781 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:07.602684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9a655efe-5dd1-447e-ab4b-cf7444f5f781 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:07.605961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9a655efe-5dd1-447e-ab4b-cf7444f5f781 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:07.878953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9a655efe-5dd1-447e-ab4b-cf7444f5f781 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:07.894522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9a655efe-5dd1-447e-ab4b-cf7444f5f781 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:07.900963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9a655efe-5dd1-447e-ab4b-cf7444f5f781 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:07.908808 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9a655efe-5dd1-447e-ab4b-cf7444f5f781 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.331033 Jul 14 14:46:07.913680 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1881/3726] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:07 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:08.933683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-11d69abc-76d9-45aa-8b97-726af5daa220 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:08.934924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-11d69abc-76d9-45aa-8b97-726af5daa220 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:08.961135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11d69abc-76d9-45aa-8b97-726af5daa220 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:08.961804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11d69abc-76d9-45aa-8b97-726af5daa220 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:08.966101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11d69abc-76d9-45aa-8b97-726af5daa220 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:08.967238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11d69abc-76d9-45aa-8b97-726af5daa220 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:09.163096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-11d69abc-76d9-45aa-8b97-726af5daa220 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:09.188209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-11d69abc-76d9-45aa-8b97-726af5daa220 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:09.200599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-11d69abc-76d9-45aa-8b97-726af5daa220 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:09.202575 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-11d69abc-76d9-45aa-8b97-726af5daa220 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.272576 Jul 14 14:46:09.222821 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1846/3727] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:08 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:09.294058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b670985a-0478-4f5f-a722-6f112bdd07aa tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Action: 'create', calling method: .version_select at 0x7fd6c4e67280>, body: {"keypair": {"name": "tempest-keypair-850479952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMRiD6Zaa+wquTlcVBRM5l09tYM3fI5GVAP4RMivzdYbHnYYa+EFpbyDKKHnbunzpB0fJeTMeJ8CL+7aCb0drSiAebNRTWk/EWcuDtbt37owW+NNIFg6KzSKT7i20NYQw=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:09.341451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-b670985a-0478-4f5f-a722-6f112bdd07aa tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Getting quotas for project 637fe6bfb48642b5b2ac60a5e03e26ef. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:09.351868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-b670985a-0478-4f5f-a722-6f112bdd07aa tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Getting quotas for user b720e745e38745938de5898f5fad4afb and project 637fe6bfb48642b5b2ac60a5e03e26ef. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:09.401543 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b670985a-0478-4f5f-a722-6f112bdd07aa tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.446249 Jul 14 14:46:09.402589 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1882/3728] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:46:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:10.227993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d0e80413-c7b8-40a9-8299-91b998afa30d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:10.229436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d0e80413-c7b8-40a9-8299-91b998afa30d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:10.253574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0e80413-c7b8-40a9-8299-91b998afa30d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:10.256343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0e80413-c7b8-40a9-8299-91b998afa30d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:10.258108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0e80413-c7b8-40a9-8299-91b998afa30d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:10.261022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0e80413-c7b8-40a9-8299-91b998afa30d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:10.949399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d0e80413-c7b8-40a9-8299-91b998afa30d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:10.961445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d0e80413-c7b8-40a9-8299-91b998afa30d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:10.965348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d0e80413-c7b8-40a9-8299-91b998afa30d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:10.971497 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d0e80413-c7b8-40a9-8299-91b998afa30d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.748228 Jul 14 14:46:10.983936 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1847/3729] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:10 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:11.990225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5675fe0c-a8ae-4ddb-bd7f-7f06f37137d3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:11.991493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5675fe0c-a8ae-4ddb-bd7f-7f06f37137d3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:12.003045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5675fe0c-a8ae-4ddb-bd7f-7f06f37137d3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:12.005136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5675fe0c-a8ae-4ddb-bd7f-7f06f37137d3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:12.008278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5675fe0c-a8ae-4ddb-bd7f-7f06f37137d3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:12.009385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5675fe0c-a8ae-4ddb-bd7f-7f06f37137d3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:12.280583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5675fe0c-a8ae-4ddb-bd7f-7f06f37137d3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:12.306734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5675fe0c-a8ae-4ddb-bd7f-7f06f37137d3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:12.308975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5675fe0c-a8ae-4ddb-bd7f-7f06f37137d3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:12.316325 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5675fe0c-a8ae-4ddb-bd7f-7f06f37137d3 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.330772 Jul 14 14:46:12.334515 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1883/3730] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:11 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:13.349167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6e2e437-12e0-407f-ba0f-51f523022fcf tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:13.353104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b6e2e437-12e0-407f-ba0f-51f523022fcf tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:13.383711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6e2e437-12e0-407f-ba0f-51f523022fcf tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:13.384192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6e2e437-12e0-407f-ba0f-51f523022fcf tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:13.385023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6e2e437-12e0-407f-ba0f-51f523022fcf tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:13.385472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6e2e437-12e0-407f-ba0f-51f523022fcf tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:13.593316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cdf5d04a-3070-4bc8-9eba-10952013c282 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:13.594738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cdf5d04a-3070-4bc8-9eba-10952013c282 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:13.616922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdf5d04a-3070-4bc8-9eba-10952013c282 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:13.617412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdf5d04a-3070-4bc8-9eba-10952013c282 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:13.631817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdf5d04a-3070-4bc8-9eba-10952013c282 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:13.631817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdf5d04a-3070-4bc8-9eba-10952013c282 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:13.661913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b6e2e437-12e0-407f-ba0f-51f523022fcf tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:13.670512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:13.681038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b6e2e437-12e0-407f-ba0f-51f523022fcf tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:13.690250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b6e2e437-12e0-407f-ba0f-51f523022fcf tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:13.691908 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b6e2e437-12e0-407f-ba0f-51f523022fcf tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.353899 Jul 14 14:46:13.692964 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1848/3731] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:13 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:13.719045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-355658252", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b474df9a-e129-4c4d-9e27-815651630970"}], "security_groups": [{"name": "tempest-securitygroup--1831709191"}], "key_name": "tempest-keypair-850479952", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:13.913699 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cdf5d04a-3070-4bc8-9eba-10952013c282 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.325450 Jul 14 14:46:13.917669 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1884/3732] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:46:13 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:46:13.947868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-179a4e4b-e74e-4b37-b3c7-278caf8136ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:13.949144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-179a4e4b-e74e-4b37-b3c7-278caf8136ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:13.977248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-179a4e4b-e74e-4b37-b3c7-278caf8136ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:13.978105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-179a4e4b-e74e-4b37-b3c7-278caf8136ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:13.981153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-179a4e4b-e74e-4b37-b3c7-278caf8136ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:13.982289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-179a4e4b-e74e-4b37-b3c7-278caf8136ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:14.149387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] validate_networks() for [('b474df9a-e129-4c4d-9e27-815651630970', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:46:14.519548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-179a4e4b-e74e-4b37-b3c7-278caf8136ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:14.533293 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-179a4e4b-e74e-4b37-b3c7-278caf8136ac tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1673 microversion: 2.1 time: 0.607382 Jul 14 14:46:14.534260 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1885/3733] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:13 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1673 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:46:14.710997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f9dde77-e643-49d1-afd0-68caff50431d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:14.711628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f9dde77-e643-49d1-afd0-68caff50431d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:14.726673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f9dde77-e643-49d1-afd0-68caff50431d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:14.727127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f9dde77-e643-49d1-afd0-68caff50431d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:14.728086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f9dde77-e643-49d1-afd0-68caff50431d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:14.728530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f9dde77-e643-49d1-afd0-68caff50431d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:14.745710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:15.049086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f9dde77-e643-49d1-afd0-68caff50431d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:15.066758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f9dde77-e643-49d1-afd0-68caff50431d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:15.068804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f9dde77-e643-49d1-afd0-68caff50431d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:15.072733 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f9dde77-e643-49d1-afd0-68caff50431d tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.365620 Jul 14 14:46:15.075733 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1886/3734] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:14 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:46:15.554090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc90aa90-f10c-44d0-89c2-f64ed82068aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:15.554806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cc90aa90-f10c-44d0-89c2-f64ed82068aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:15.565498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc90aa90-f10c-44d0-89c2-f64ed82068aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:15.567084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc90aa90-f10c-44d0-89c2-f64ed82068aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:15.570516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc90aa90-f10c-44d0-89c2-f64ed82068aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:15.571781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc90aa90-f10c-44d0-89c2-f64ed82068aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:16.046791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Getting quotas for project 637fe6bfb48642b5b2ac60a5e03e26ef. Resources: dict_keys(['metadata_items']) {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:16.060430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Getting quotas for user b720e745e38745938de5898f5fad4afb and project 637fe6bfb48642b5b2ac60a5e03e26ef. Resources: dict_keys(['metadata_items']) {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:16.129318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:16.129755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:16.131483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:16.131923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:16.137995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:16.158955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cc90aa90-f10c-44d0-89c2-f64ed82068aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:16.184053 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc90aa90-f10c-44d0-89c2-f64ed82068aa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1673 microversion: 2.1 time: 0.635775 Jul 14 14:46:16.187014 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1887/3735] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:15 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1673 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:16.206846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b74209c-d058-409e-abad-901841452434 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:16.212388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:16.213073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:16.214058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:16.214604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b74209c-d058-409e-abad-901841452434 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:16.217804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:16.241035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b74209c-d058-409e-abad-901841452434 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:16.241619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b74209c-d058-409e-abad-901841452434 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:16.244288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b74209c-d058-409e-abad-901841452434 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:16.244769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b74209c-d058-409e-abad-901841452434 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:16.245718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Getting quotas for project 637fe6bfb48642b5b2ac60a5e03e26ef. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:16.253931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Getting quotas for user b720e745e38745938de5898f5fad4afb and project 637fe6bfb48642b5b2ac60a5e03e26ef. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:16.272352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:46:16.275517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:46:16.391980 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b1338a98-4086-40b3-b58d-ea9674b9761b tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.679254 Jul 14 14:46:16.401632 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1849/3736] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:46:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 2689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:46:16.407569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2b74209c-d058-409e-abad-901841452434 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:16.420651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-75baaf6d-96b9-4a33-96ab-9075aca1583c tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:16.424883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-75baaf6d-96b9-4a33-96ab-9075aca1583c tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:16.426464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2b74209c-d058-409e-abad-901841452434 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:16.438321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2b74209c-d058-409e-abad-901841452434 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:16.441702 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b74209c-d058-409e-abad-901841452434 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.251535 Jul 14 14:46:16.444249 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1888/3737] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:16 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:16.608610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-75baaf6d-96b9-4a33-96ab-9075aca1583c tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:16.622245 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-75baaf6d-96b9-4a33-96ab-9075aca1583c tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1276 microversion: 2.1 time: 0.216047 Jul 14 14:46:16.623049 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1850/3738] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:16 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:17.207000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c9ebafc2-a9a7-4c05-8e61-122003750225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:17.208897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c9ebafc2-a9a7-4c05-8e61-122003750225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:17.225907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9ebafc2-a9a7-4c05-8e61-122003750225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:17.228671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9ebafc2-a9a7-4c05-8e61-122003750225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:17.229810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9ebafc2-a9a7-4c05-8e61-122003750225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:17.233711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9ebafc2-a9a7-4c05-8e61-122003750225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:17.460837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b78f3fd8-90a3-49ff-ad5f-679db7e57c2e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:17.461523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b78f3fd8-90a3-49ff-ad5f-679db7e57c2e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:17.478106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b78f3fd8-90a3-49ff-ad5f-679db7e57c2e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:17.478581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b78f3fd8-90a3-49ff-ad5f-679db7e57c2e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:17.482230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b78f3fd8-90a3-49ff-ad5f-679db7e57c2e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:17.483686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b78f3fd8-90a3-49ff-ad5f-679db7e57c2e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:18.106625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b78f3fd8-90a3-49ff-ad5f-679db7e57c2e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:18.116083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b78f3fd8-90a3-49ff-ad5f-679db7e57c2e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:18.117682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b78f3fd8-90a3-49ff-ad5f-679db7e57c2e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:18.132562 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b78f3fd8-90a3-49ff-ad5f-679db7e57c2e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.662513 Jul 14 14:46:18.133267 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1851/3739] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:17 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:46:18.142918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a979e2ad-2e9d-4bb7-a830-3963fa2fc786 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:18.150443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a979e2ad-2e9d-4bb7-a830-3963fa2fc786 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:18.168693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a979e2ad-2e9d-4bb7-a830-3963fa2fc786 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:18.169191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a979e2ad-2e9d-4bb7-a830-3963fa2fc786 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:18.170001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a979e2ad-2e9d-4bb7-a830-3963fa2fc786 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:18.170441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a979e2ad-2e9d-4bb7-a830-3963fa2fc786 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:18.360278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c9ebafc2-a9a7-4c05-8e61-122003750225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:18.366327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a979e2ad-2e9d-4bb7-a830-3963fa2fc786 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:18.373591 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c9ebafc2-a9a7-4c05-8e61-122003750225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 1.171169 Jul 14 14:46:18.375231 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1889/3740] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:17 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:18.376261 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a979e2ad-2e9d-4bb7-a830-3963fa2fc786 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1328 microversion: 2.1 time: 0.241681 Jul 14 14:46:18.380887 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1852/3741] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:18 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1328 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:19.155490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d5ed7811-979e-4ca0-9b60-773f3967583b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:19.157443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d5ed7811-979e-4ca0-9b60-773f3967583b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:19.164807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d5ed7811-979e-4ca0-9b60-773f3967583b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:19.165535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d5ed7811-979e-4ca0-9b60-773f3967583b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:19.166501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d5ed7811-979e-4ca0-9b60-773f3967583b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:19.167110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d5ed7811-979e-4ca0-9b60-773f3967583b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:19.329753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d5ed7811-979e-4ca0-9b60-773f3967583b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:19.349790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d5ed7811-979e-4ca0-9b60-773f3967583b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:19.381353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d5ed7811-979e-4ca0-9b60-773f3967583b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:19.386756 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d5ed7811-979e-4ca0-9b60-773f3967583b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.233864 Jul 14 14:46:19.389639 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1890/3742] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:19 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:19.401359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5a63fdcb-c19e-495c-83a8-b63af4ad894a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:19.402055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5a63fdcb-c19e-495c-83a8-b63af4ad894a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:19.416833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a63fdcb-c19e-495c-83a8-b63af4ad894a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:19.417331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a63fdcb-c19e-495c-83a8-b63af4ad894a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:19.418194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a63fdcb-c19e-495c-83a8-b63af4ad894a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:19.418733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a63fdcb-c19e-495c-83a8-b63af4ad894a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:19.656869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5a63fdcb-c19e-495c-83a8-b63af4ad894a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:19.667922 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5a63fdcb-c19e-495c-83a8-b63af4ad894a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1334 microversion: 2.1 time: 0.270576 Jul 14 14:46:19.669120 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1853/3743] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:19 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1334 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:20.421653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2bc9a012-1ace-4580-af2e-5ebb7c2f0b01 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:20.430608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2bc9a012-1ace-4580-af2e-5ebb7c2f0b01 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:20.444603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:20.448276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2bc9a012-1ace-4580-af2e-5ebb7c2f0b01 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:20.448739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2bc9a012-1ace-4580-af2e-5ebb7c2f0b01 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:20.449564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2bc9a012-1ace-4580-af2e-5ebb7c2f0b01 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:20.450276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2bc9a012-1ace-4580-af2e-5ebb7c2f0b01 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:20.636146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2bc9a012-1ace-4580-af2e-5ebb7c2f0b01 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:20.654029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2bc9a012-1ace-4580-af2e-5ebb7c2f0b01 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:20.655820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2bc9a012-1ace-4580-af2e-5ebb7c2f0b01 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:20.657235 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2bc9a012-1ace-4580-af2e-5ebb7c2f0b01 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.247415 Jul 14 14:46:20.658023 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1891/3744] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:20 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:20.686256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c7dfa528-7121-475e-98f1-cdcb442975cd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:20.688313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c7dfa528-7121-475e-98f1-cdcb442975cd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:20.696666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7dfa528-7121-475e-98f1-cdcb442975cd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:20.697392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7dfa528-7121-475e-98f1-cdcb442975cd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:20.698341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7dfa528-7121-475e-98f1-cdcb442975cd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:20.698946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7dfa528-7121-475e-98f1-cdcb442975cd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:21.159811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c7dfa528-7121-475e-98f1-cdcb442975cd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:21.169286 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c7dfa528-7121-475e-98f1-cdcb442975cd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1402 microversion: 2.1 time: 0.486973 Jul 14 14:46:21.169900 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1854/3745] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:20 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1402 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:21.628530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ac753ef7-6f8b-45c3-a6b3-e06242e9ceee req-c1572506-961e-4944-a342-7b3dd65b1b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250e7cb6-ef8b-473e-9970-fac746383e79", "tag": "a025cf07-45d2-4d40-84e6-40195c60a368"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:21.652653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ac753ef7-6f8b-45c3-a6b3-e06242e9ceee req-c1572506-961e-4944-a342-7b3dd65b1b22 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:21.653148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ac753ef7-6f8b-45c3-a6b3-e06242e9ceee req-c1572506-961e-4944-a342-7b3dd65b1b22 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:21.678113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e7eb059d-358a-4e3e-bb3d-ee997afc7afe tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:21.679000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e7eb059d-358a-4e3e-bb3d-ee997afc7afe tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:21.691170 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ac753ef7-6f8b-45c3-a6b3-e06242e9ceee req-c1572506-961e-4944-a342-7b3dd65b1b22 service nova] Creating event network-changed:a025cf07-45d2-4d40-84e6-40195c60a368 for instance 250e7cb6-ef8b-473e-9970-fac746383e79 on n-h2-767704-28 Jul 14 14:46:21.704056 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ac753ef7-6f8b-45c3-a6b3-e06242e9ceee req-c1572506-961e-4944-a342-7b3dd65b1b22 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081921 Jul 14 14:46:21.707254 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1892/3746] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:21.721663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7eb059d-358a-4e3e-bb3d-ee997afc7afe tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:21.722900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7eb059d-358a-4e3e-bb3d-ee997afc7afe tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:21.726792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7eb059d-358a-4e3e-bb3d-ee997afc7afe tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:21.727735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7eb059d-358a-4e3e-bb3d-ee997afc7afe tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:21.883780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e7eb059d-358a-4e3e-bb3d-ee997afc7afe tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:21.923930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e7eb059d-358a-4e3e-bb3d-ee997afc7afe tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:21.935746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e7eb059d-358a-4e3e-bb3d-ee997afc7afe tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:21.945715 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e7eb059d-358a-4e3e-bb3d-ee997afc7afe tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.270688 Jul 14 14:46:21.962856 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1855/3747] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:21 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:46:22.188794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9e6df72c-881c-4d03-91d8-c5a88b142282 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:22.189776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9e6df72c-881c-4d03-91d8-c5a88b142282 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:22.210142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e6df72c-881c-4d03-91d8-c5a88b142282 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:22.213068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e6df72c-881c-4d03-91d8-c5a88b142282 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:22.214244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e6df72c-881c-4d03-91d8-c5a88b142282 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:22.215896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e6df72c-881c-4d03-91d8-c5a88b142282 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:22.799961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9e6df72c-881c-4d03-91d8-c5a88b142282 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:22.816733 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9e6df72c-881c-4d03-91d8-c5a88b142282 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1402 microversion: 2.1 time: 0.633306 Jul 14 14:46:22.819383 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1893/3748] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:22 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1402 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:22.973005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7c18d5db-54ef-4115-b10b-bc2afca8a43e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:22.974451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7c18d5db-54ef-4115-b10b-bc2afca8a43e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:22.987069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c18d5db-54ef-4115-b10b-bc2afca8a43e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:22.988012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c18d5db-54ef-4115-b10b-bc2afca8a43e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:22.989186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c18d5db-54ef-4115-b10b-bc2afca8a43e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:22.989907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c18d5db-54ef-4115-b10b-bc2afca8a43e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:23.105519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c18d5db-54ef-4115-b10b-bc2afca8a43e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:23.124878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c18d5db-54ef-4115-b10b-bc2afca8a43e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:23.131995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c18d5db-54ef-4115-b10b-bc2afca8a43e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:23.134132 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7c18d5db-54ef-4115-b10b-bc2afca8a43e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.169745 Jul 14 14:46:23.148502 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1856/3749] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:22 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:23.835509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a5c84fc9-0197-4f1b-8165-7b6aca5ca65a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:23.836137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a5c84fc9-0197-4f1b-8165-7b6aca5ca65a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:23.850455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5c84fc9-0197-4f1b-8165-7b6aca5ca65a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:23.850918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5c84fc9-0197-4f1b-8165-7b6aca5ca65a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:23.852986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5c84fc9-0197-4f1b-8165-7b6aca5ca65a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:23.856769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5c84fc9-0197-4f1b-8165-7b6aca5ca65a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:24.156538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-27a1b429-c6ef-41eb-854b-ae6ea6e71fd4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:24.157262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-27a1b429-c6ef-41eb-854b-ae6ea6e71fd4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:24.178245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27a1b429-c6ef-41eb-854b-ae6ea6e71fd4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:24.178929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27a1b429-c6ef-41eb-854b-ae6ea6e71fd4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:24.181666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27a1b429-c6ef-41eb-854b-ae6ea6e71fd4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:24.182180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27a1b429-c6ef-41eb-854b-ae6ea6e71fd4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:24.510491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-27a1b429-c6ef-41eb-854b-ae6ea6e71fd4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:24.526150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-27a1b429-c6ef-41eb-854b-ae6ea6e71fd4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:24.528848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-27a1b429-c6ef-41eb-854b-ae6ea6e71fd4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:24.532253 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-27a1b429-c6ef-41eb-854b-ae6ea6e71fd4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1366 microversion: 2.47 time: 0.380363 Jul 14 14:46:24.535166 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1857/3750] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:24 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:46:24.625758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a5c84fc9-0197-4f1b-8165-7b6aca5ca65a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:24.673166 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a5c84fc9-0197-4f1b-8165-7b6aca5ca65a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1402 microversion: 2.1 time: 0.841331 Jul 14 14:46:24.678003 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1894/3751] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:23 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1402 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:25.553331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a1d66605-8347-45d7-80fd-52f5e2bab49b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:25.554071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a1d66605-8347-45d7-80fd-52f5e2bab49b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:25.576494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1d66605-8347-45d7-80fd-52f5e2bab49b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:25.577209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1d66605-8347-45d7-80fd-52f5e2bab49b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:25.578945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1d66605-8347-45d7-80fd-52f5e2bab49b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:25.579440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1d66605-8347-45d7-80fd-52f5e2bab49b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:25.695425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-43ce5a00-ed9e-4973-bbab-c8d7092c437d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:25.695958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-43ce5a00-ed9e-4973-bbab-c8d7092c437d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:25.711607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43ce5a00-ed9e-4973-bbab-c8d7092c437d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:25.713314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43ce5a00-ed9e-4973-bbab-c8d7092c437d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:25.714161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43ce5a00-ed9e-4973-bbab-c8d7092c437d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:25.714961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43ce5a00-ed9e-4973-bbab-c8d7092c437d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:25.736756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a1d66605-8347-45d7-80fd-52f5e2bab49b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:25.772342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a1d66605-8347-45d7-80fd-52f5e2bab49b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:25.777557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a1d66605-8347-45d7-80fd-52f5e2bab49b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:25.783196 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a1d66605-8347-45d7-80fd-52f5e2bab49b tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1372 microversion: 2.47 time: 0.233906 Jul 14 14:46:25.801814 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1858/3752] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:25 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:26.308915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-43ce5a00-ed9e-4973-bbab-c8d7092c437d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:26.323825 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-43ce5a00-ed9e-4973-bbab-c8d7092c437d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1402 microversion: 2.1 time: 0.632788 Jul 14 14:46:26.324881 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1895/3753] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:25 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1402 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:26.732501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-693d928f-ecc8-462c-a3bd-22500c590210 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:26.733634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-693d928f-ecc8-462c-a3bd-22500c590210 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:26.749180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:26.751986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:26.754589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-693d928f-ecc8-462c-a3bd-22500c590210 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:26.755212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-693d928f-ecc8-462c-a3bd-22500c590210 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:26.756149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-693d928f-ecc8-462c-a3bd-22500c590210 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:26.756595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-693d928f-ecc8-462c-a3bd-22500c590210 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:26.814220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b6fda0e8-3dbf-4649-9e7e-76b5b75f6ee7 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:26.815468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b6fda0e8-3dbf-4649-9e7e-76b5b75f6ee7 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:26.837180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6fda0e8-3dbf-4649-9e7e-76b5b75f6ee7 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:26.839516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6fda0e8-3dbf-4649-9e7e-76b5b75f6ee7 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:26.840664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6fda0e8-3dbf-4649-9e7e-76b5b75f6ee7 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:26.845072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6fda0e8-3dbf-4649-9e7e-76b5b75f6ee7 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.046911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b6fda0e8-3dbf-4649-9e7e-76b5b75f6ee7 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.064493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b6fda0e8-3dbf-4649-9e7e-76b5b75f6ee7 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.067974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b6fda0e8-3dbf-4649-9e7e-76b5b75f6ee7 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.069427 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b6fda0e8-3dbf-4649-9e7e-76b5b75f6ee7 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1372 microversion: 2.47 time: 0.265888 Jul 14 14:46:27.073198 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1896/3754] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:26 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1372 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:27.226925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-693d928f-ecc8-462c-a3bd-22500c590210 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.243500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-693d928f-ecc8-462c-a3bd-22500c590210 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.246967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-693d928f-ecc8-462c-a3bd-22500c590210 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.251456 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-693d928f-ecc8-462c-a3bd-22500c590210 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2943 microversion: 2.32 time: 0.522835 Jul 14 14:46:27.254696 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1859/3755] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:26 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2943 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:27.280349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4dc364c1-1197-4a42-bdbd-e1026b3837f1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:27.281515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4dc364c1-1197-4a42-bdbd-e1026b3837f1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:27.302908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4dc364c1-1197-4a42-bdbd-e1026b3837f1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.303373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4dc364c1-1197-4a42-bdbd-e1026b3837f1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.304202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4dc364c1-1197-4a42-bdbd-e1026b3837f1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.314512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4dc364c1-1197-4a42-bdbd-e1026b3837f1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.346177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c11cc74c-6d32-4a66-bca0-2e8a8e0e5ecd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:27.346832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c11cc74c-6d32-4a66-bca0-2e8a8e0e5ecd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:27.362113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c11cc74c-6d32-4a66-bca0-2e8a8e0e5ecd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.362958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c11cc74c-6d32-4a66-bca0-2e8a8e0e5ecd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.364416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c11cc74c-6d32-4a66-bca0-2e8a8e0e5ecd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.366169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c11cc74c-6d32-4a66-bca0-2e8a8e0e5ecd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.700513 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4dc364c1-1197-4a42-bdbd-e1026b3837f1 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.428385 Jul 14 14:46:27.701687 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1897/3756] 10.222.0.81 () {60 vars in 1315 bytes} [Thu Jul 14 14:46:27 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c/os-interface => generated 1830 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:27.799054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c11cc74c-6d32-4a66-bca0-2e8a8e0e5ecd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.816911 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c11cc74c-6d32-4a66-bca0-2e8a8e0e5ecd tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1402 microversion: 2.1 time: 0.475939 Jul 14 14:46:27.817775 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1860/3757] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:27 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1402 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:46:28.097744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4593c7d4-04b3-4f7c-b150-6d48bf510af1 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:28.100368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4593c7d4-04b3-4f7c-b150-6d48bf510af1 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:28.107769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:28.112815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4593c7d4-04b3-4f7c-b150-6d48bf510af1 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.113590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4593c7d4-04b3-4f7c-b150-6d48bf510af1 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:28.116105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4593c7d4-04b3-4f7c-b150-6d48bf510af1 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.116832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4593c7d4-04b3-4f7c-b150-6d48bf510af1 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:28.619436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4593c7d4-04b3-4f7c-b150-6d48bf510af1 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:28.630887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4593c7d4-04b3-4f7c-b150-6d48bf510af1 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:28.636803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4593c7d4-04b3-4f7c-b150-6d48bf510af1 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:28.638127 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4593c7d4-04b3-4f7c-b150-6d48bf510af1 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1357 microversion: 2.47 time: 0.549656 Jul 14 14:46:28.638708 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1898/3758] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:28 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1357 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:46:28.658897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:28.663124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:28.669126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Searching by: {'deleted': False, 'project_id': 'e534e8517f514078988df401f9d6bec7'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:46:28.681363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.681973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:28.684105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.686694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:28.722180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-feb0cb5f-80a6-4a22-988f-72fd7498f2a8 req-a9c2b074-0cdc-47d2-b757-1b07e6ee5904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250e7cb6-ef8b-473e-9970-fac746383e79", "name": "network-vif-plugged", "status": "completed", "tag": "a025cf07-45d2-4d40-84e6-40195c60a368"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:28.747455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-feb0cb5f-80a6-4a22-988f-72fd7498f2a8 req-a9c2b074-0cdc-47d2-b757-1b07e6ee5904 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.749078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-feb0cb5f-80a6-4a22-988f-72fd7498f2a8 req-a9c2b074-0cdc-47d2-b757-1b07e6ee5904 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:28.779069 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-feb0cb5f-80a6-4a22-988f-72fd7498f2a8 req-a9c2b074-0cdc-47d2-b757-1b07e6ee5904 service nova] Creating event network-vif-plugged:a025cf07-45d2-4d40-84e6-40195c60a368 for instance 250e7cb6-ef8b-473e-9970-fac746383e79 on n-h2-767704-28 Jul 14 14:46:28.790535 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-feb0cb5f-80a6-4a22-988f-72fd7498f2a8 req-a9c2b074-0cdc-47d2-b757-1b07e6ee5904 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285606 Jul 14 14:46:28.795971 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1861/3759] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:46:28.834926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0910380f-09b8-4088-a296-6631f40d0cc7 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:28.835726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0910380f-09b8-4088-a296-6631f40d0cc7 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:28.849984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0910380f-09b8-4088-a296-6631f40d0cc7 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.850515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0910380f-09b8-4088-a296-6631f40d0cc7 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:28.854044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0910380f-09b8-4088-a296-6631f40d0cc7 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.854695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0910380f-09b8-4088-a296-6631f40d0cc7 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:28.955334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:46:29.061963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:29.070553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:29.071288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:29.086026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:29.088430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:29.286150 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-42b5e89e-170d-41e8-8a96-f4522eba0a5e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.632019 Jul 14 14:46:29.287502 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1899/3760] 10.222.0.81 () {60 vars in 1186 bytes} [Thu Jul 14 14:46:28 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:46:29.327400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b542dae1-6aed-4026-891f-ee633a1f93d0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:29.328807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b542dae1-6aed-4026-891f-ee633a1f93d0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:29.340382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0910380f-09b8-4088-a296-6631f40d0cc7 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:29.343919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b542dae1-6aed-4026-891f-ee633a1f93d0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:29.345232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b542dae1-6aed-4026-891f-ee633a1f93d0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:29.346166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b542dae1-6aed-4026-891f-ee633a1f93d0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:29.347009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b542dae1-6aed-4026-891f-ee633a1f93d0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:29.354751 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0910380f-09b8-4088-a296-6631f40d0cc7 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1402 microversion: 2.1 time: 0.521782 Jul 14 14:46:29.370385 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1862/3761] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:28 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1402 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:46:29.386940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b542dae1-6aed-4026-891f-ee633a1f93d0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:46:29.519614 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b542dae1-6aed-4026-891f-ee633a1f93d0 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "DELETE /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 204 len: 0 microversion: 2.47 time: 0.205318 Jul 14 14:46:29.523705 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1900/3762] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:46:29 2022] DELETE /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:46:29.528893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4355ba68-2efd-487c-b624-625e60ad72ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:29.530252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4355ba68-2efd-487c-b624-625e60ad72ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:29.544352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4355ba68-2efd-487c-b624-625e60ad72ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:29.545972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4355ba68-2efd-487c-b624-625e60ad72ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:29.547373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4355ba68-2efd-487c-b624-625e60ad72ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:29.547373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4355ba68-2efd-487c-b624-625e60ad72ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:29.645663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4355ba68-2efd-487c-b624-625e60ad72ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:29.657043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4355ba68-2efd-487c-b624-625e60ad72ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:29.659869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4355ba68-2efd-487c-b624-625e60ad72ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:29.661317 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4355ba68-2efd-487c-b624-625e60ad72ca tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1363 microversion: 2.47 time: 0.136549 Jul 14 14:46:29.662466 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1863/3763] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:29 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1363 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:46:30.374881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a495a58-04a6-4f07-97f6-5ece2885c022 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:30.375601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0a495a58-04a6-4f07-97f6-5ece2885c022 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:30.382996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a495a58-04a6-4f07-97f6-5ece2885c022 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:30.383453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a495a58-04a6-4f07-97f6-5ece2885c022 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:30.384434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a495a58-04a6-4f07-97f6-5ece2885c022 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:30.385078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a495a58-04a6-4f07-97f6-5ece2885c022 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:30.412932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:30.569247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0a495a58-04a6-4f07-97f6-5ece2885c022 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:30.584376 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0a495a58-04a6-4f07-97f6-5ece2885c022 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1402 microversion: 2.1 time: 0.215130 Jul 14 14:46:30.588035 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1901/3764] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:30 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1402 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:30.680845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f6132a66-5e18-4128-b85b-69dde4431f13 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:30.681633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f6132a66-5e18-4128-b85b-69dde4431f13 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:30.692582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6132a66-5e18-4128-b85b-69dde4431f13 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:30.694103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6132a66-5e18-4128-b85b-69dde4431f13 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:30.695286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6132a66-5e18-4128-b85b-69dde4431f13 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:30.695946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6132a66-5e18-4128-b85b-69dde4431f13 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:30.785736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f6132a66-5e18-4128-b85b-69dde4431f13 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:30.795143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f6132a66-5e18-4128-b85b-69dde4431f13 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:30.797338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f6132a66-5e18-4128-b85b-69dde4431f13 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:30.798870 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f6132a66-5e18-4128-b85b-69dde4431f13 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1363 microversion: 2.47 time: 0.122567 Jul 14 14:46:30.799723 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1864/3765] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:30 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1363 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:31.606036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1ed8f9b5-a27c-4f34-9752-3522cf60ba5d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:31.607119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1ed8f9b5-a27c-4f34-9752-3522cf60ba5d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:31.629567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ed8f9b5-a27c-4f34-9752-3522cf60ba5d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:31.630031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ed8f9b5-a27c-4f34-9752-3522cf60ba5d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:31.630843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ed8f9b5-a27c-4f34-9752-3522cf60ba5d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:31.632460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ed8f9b5-a27c-4f34-9752-3522cf60ba5d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:31.820058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0a5fab5a-22b7-4677-8637-1ecf5e41306e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:31.820677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0a5fab5a-22b7-4677-8637-1ecf5e41306e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:31.836363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a5fab5a-22b7-4677-8637-1ecf5e41306e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:31.837814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a5fab5a-22b7-4677-8637-1ecf5e41306e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:31.840983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a5fab5a-22b7-4677-8637-1ecf5e41306e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:31.842678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a5fab5a-22b7-4677-8637-1ecf5e41306e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:32.019838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0a5fab5a-22b7-4677-8637-1ecf5e41306e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:32.056386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0a5fab5a-22b7-4677-8637-1ecf5e41306e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:32.061492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0a5fab5a-22b7-4677-8637-1ecf5e41306e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:32.064257 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0a5fab5a-22b7-4677-8637-1ecf5e41306e tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 200 len: 1363 microversion: 2.47 time: 0.248707 Jul 14 14:46:32.065633 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1865/3766] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:31 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:46:32.103942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1ed8f9b5-a27c-4f34-9752-3522cf60ba5d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:32.115334 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1ed8f9b5-a27c-4f34-9752-3522cf60ba5d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1588 microversion: 2.1 time: 0.518039 Jul 14 14:46:32.121365 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1902/3767] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:31 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1588 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:32.142019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-37914eab-c363-4d73-aa43-dbb4003716e6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:32.142932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-37914eab-c363-4d73-aa43-dbb4003716e6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:32.151303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37914eab-c363-4d73-aa43-dbb4003716e6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:32.152920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37914eab-c363-4d73-aa43-dbb4003716e6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:32.154639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37914eab-c363-4d73-aa43-dbb4003716e6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:32.155491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-37914eab-c363-4d73-aa43-dbb4003716e6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:32.276776 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-37914eab-c363-4d73-aa43-dbb4003716e6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143579 Jul 14 14:46:32.283767 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1866/3768] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:46:32 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:33.084673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c5128e4-95fb-48bf-a1c8-25bceb66115a tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:33.085409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1c5128e4-95fb-48bf-a1c8-25bceb66115a tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:33.105140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c5128e4-95fb-48bf-a1c8-25bceb66115a tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:33.105641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c5128e4-95fb-48bf-a1c8-25bceb66115a tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:33.106710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c5128e4-95fb-48bf-a1c8-25bceb66115a tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:33.107160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c5128e4-95fb-48bf-a1c8-25bceb66115a tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:33.133724 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-1c5128e4-95fb-48bf-a1c8-25bceb66115a tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] HTTP exception thrown: Instance 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 could not be found. Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c5128e4-95fb-48bf-a1c8-25bceb66115a tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Request method failure captured: Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 HTTP/1.1 Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CwW4VwRIUuKF4P0wHZbxDo7Mac5QsOEwglCDP0Yn8_QlxAvkA-WvmFL4-SG-1R8mZwkKBzYKd4Q7y0MuZE_U_eF9O-RSwvnaL-i2ChiNh7UMZcIaU4ANtYZe0G7NwysuYCS1nfXFUUEghELEUSWJPW5wNSVtEt21HluZ1e15UHoUwo Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.47 Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: e534e8517f514078988df401f9d6bec7 Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerShowV247Test-2072680612 Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e534e8517f514078988df401f9d6bec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e534e8517f514078988df401f9d6bec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e534e8517f514078988df401f9d6bec7", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e534e8517f514078988df401f9d6bec7"}]}] Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerShowV247Test-2072680612 Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: e534e8517f514078988df401f9d6bec7 Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerShowV247Test-2072680612 Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerShowV247Test-2072680612-project Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: d56db16b8418478499b4163e8de66b38 Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerShowV247Test-2072680612-project Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 could not be found. Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '49b2abf3-2bd7-496f-be0a-9b2d9d8a5165'} Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 could not be found. Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 could not be found. Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:33.135471 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:46:33.142816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:33.142816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:33.142816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:33.142816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:46:33.142816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:46:33.142816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 could not be found. Jul 14 14:46:33.142816 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:46:33.142816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c5128e4-95fb-48bf-a1c8-25bceb66115a tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Returning 404 to user: Instance 49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:46:33.142816 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1c5128e4-95fb-48bf-a1c8-25bceb66115a tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165" status: 404 len: 111 microversion: 2.47 time: 0.056945 Jul 14 14:46:33.147778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-805308d0-a669-46e3-a40a-2dc0e4f27c24 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:33.148285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-805308d0-a669-46e3-a40a-2dc0e4f27c24 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: f13a0dbf-ac6b-4144-85e7-53277b8472e7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:33.150405 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1903/3769] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:33 2022] GET /compute/v2.1/servers/49b2abf3-2bd7-496f-be0a-9b2d9d8a5165 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:46:33.155444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-805308d0-a669-46e3-a40a-2dc0e4f27c24 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:33.157027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-805308d0-a669-46e3-a40a-2dc0e4f27c24 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:33.158031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-805308d0-a669-46e3-a40a-2dc0e4f27c24 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:33.158647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-805308d0-a669-46e3-a40a-2dc0e4f27c24 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:33.191244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-805308d0-a669-46e3-a40a-2dc0e4f27c24 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: f13a0dbf-ac6b-4144-85e7-53277b8472e7] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:46:33.259181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:33.338105 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-805308d0-a669-46e3-a40a-2dc0e4f27c24 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7" status: 204 len: 0 microversion: 2.47 time: 0.193233 Jul 14 14:46:33.344123 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1867/3770] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:46:33 2022] DELETE /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:46:33.350687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ce7af1f9-8559-48c4-80c0-16c0299b7e34 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:33.352021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ce7af1f9-8559-48c4-80c0-16c0299b7e34 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: f13a0dbf-ac6b-4144-85e7-53277b8472e7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:33.370978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce7af1f9-8559-48c4-80c0-16c0299b7e34 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:33.371587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce7af1f9-8559-48c4-80c0-16c0299b7e34 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:33.373650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce7af1f9-8559-48c4-80c0-16c0299b7e34 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:33.377222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce7af1f9-8559-48c4-80c0-16c0299b7e34 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:33.390888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e3a509b4-5f23-47b8-96c0-3c4aafc3a82d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7e30b86-f9cc-4b8f-8c90-4a8af44af5c6"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:33.392487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e3a509b4-5f23-47b8-96c0-3c4aafc3a82d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:33.400594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3a509b4-5f23-47b8-96c0-3c4aafc3a82d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:33.401346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3a509b4-5f23-47b8-96c0-3c4aafc3a82d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:33.407220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3a509b4-5f23-47b8-96c0-3c4aafc3a82d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:33.408023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3a509b4-5f23-47b8-96c0-3c4aafc3a82d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:33.775205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ce7af1f9-8559-48c4-80c0-16c0299b7e34 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:33.787099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ce7af1f9-8559-48c4-80c0-16c0299b7e34 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:33.790903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ce7af1f9-8559-48c4-80c0-16c0299b7e34 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:33.792135 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ce7af1f9-8559-48c4-80c0-16c0299b7e34 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7" status: 200 len: 1363 microversion: 2.47 time: 0.447210 Jul 14 14:46:33.805991 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1904/3771] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:33 2022] GET /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7 => generated 1363 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:33.916855 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e3a509b4-5f23-47b8-96c0-3c4aafc3a82d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.528755 Jul 14 14:46:33.918243 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1868/3772] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:46:33 2022] POST /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments => generated 194 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:46:34.811003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-47d5109f-ac99-4359-84d6-1bd98af364b4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:34.812764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-47d5109f-ac99-4359-84d6-1bd98af364b4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: f13a0dbf-ac6b-4144-85e7-53277b8472e7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:34.842063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47d5109f-ac99-4359-84d6-1bd98af364b4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:34.842546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47d5109f-ac99-4359-84d6-1bd98af364b4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:34.843496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47d5109f-ac99-4359-84d6-1bd98af364b4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:34.843949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47d5109f-ac99-4359-84d6-1bd98af364b4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:35.240005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-47d5109f-ac99-4359-84d6-1bd98af364b4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:35.268175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-47d5109f-ac99-4359-84d6-1bd98af364b4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:35.269848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-47d5109f-ac99-4359-84d6-1bd98af364b4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:35.271066 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-47d5109f-ac99-4359-84d6-1bd98af364b4 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7" status: 200 len: 1363 microversion: 2.47 time: 0.464301 Jul 14 14:46:35.271642 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1905/3773] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:34 2022] GET /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7 => generated 1363 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:36.301646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:36.304383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: f13a0dbf-ac6b-4144-85e7-53277b8472e7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:36.332787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:36.377766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:36.377766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:36.389783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:36.390834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:36.567378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:36.570178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:36.571304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lazy-loading 'fault' on Instance uuid f13a0dbf-ac6b-4144-85e7-53277b8472e7 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:46:36.930461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:36.946517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:36.948785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd56db16b8418478499b4163e8de66b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e534e8517f514078988df401f9d6bec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:36.955987 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-abda3797-2a67-4353-92b1-48f1a89d43f9 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7" status: 200 len: 1368 microversion: 2.47 time: 0.666568 Jul 14 14:46:36.961502 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1869/3774] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:36 2022] GET /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7 => generated 1368 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:46:37.635833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a22caaa-dd99-4349-bb24-c9c8e98b59d8 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:37.642378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-00bb2d28-32dd-42c6-9eb7-37c5b2a8e70b req-c9997957-e093-47fe-877f-6f45b9d565a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250e7cb6-ef8b-473e-9970-fac746383e79", "tag": "a025cf07-45d2-4d40-84e6-40195c60a368"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:37.643206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2a22caaa-dd99-4349-bb24-c9c8e98b59d8 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:37.667073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a22caaa-dd99-4349-bb24-c9c8e98b59d8 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:37.667535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a22caaa-dd99-4349-bb24-c9c8e98b59d8 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:37.668330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a22caaa-dd99-4349-bb24-c9c8e98b59d8 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:37.668771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a22caaa-dd99-4349-bb24-c9c8e98b59d8 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:37.673267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-00bb2d28-32dd-42c6-9eb7-37c5b2a8e70b req-c9997957-e093-47fe-877f-6f45b9d565a2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:37.673722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-00bb2d28-32dd-42c6-9eb7-37c5b2a8e70b req-c9997957-e093-47fe-877f-6f45b9d565a2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:37.711419 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-00bb2d28-32dd-42c6-9eb7-37c5b2a8e70b req-c9997957-e093-47fe-877f-6f45b9d565a2 service nova] Creating event network-changed:a025cf07-45d2-4d40-84e6-40195c60a368 for instance 250e7cb6-ef8b-473e-9970-fac746383e79 on n-h2-767704-28 Jul 14 14:46:37.728525 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-00bb2d28-32dd-42c6-9eb7-37c5b2a8e70b req-c9997957-e093-47fe-877f-6f45b9d565a2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090819 Jul 14 14:46:37.730666 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1870/3775] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:46:37.977938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bdd5e4b3-91d2-4eb1-beae-04dee7bfe771 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:37.978318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bdd5e4b3-91d2-4eb1-beae-04dee7bfe771 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] [instance: f13a0dbf-ac6b-4144-85e7-53277b8472e7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:37.994874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdd5e4b3-91d2-4eb1-beae-04dee7bfe771 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:37.995335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdd5e4b3-91d2-4eb1-beae-04dee7bfe771 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:37.996130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdd5e4b3-91d2-4eb1-beae-04dee7bfe771 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:37.996573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdd5e4b3-91d2-4eb1-beae-04dee7bfe771 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:38.049350 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-bdd5e4b3-91d2-4eb1-beae-04dee7bfe771 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] HTTP exception thrown: Instance f13a0dbf-ac6b-4144-85e7-53277b8472e7 could not be found. Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bdd5e4b3-91d2-4eb1-beae-04dee7bfe771 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Request method failure captured: Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7 HTTP/1.1 Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CwW4VwRIUuKF4P0wHZbxDo7Mac5QsOEwglCDP0Yn8_QlxAvkA-WvmFL4-SG-1R8mZwkKBzYKd4Q7y0MuZE_U_eF9O-RSwvnaL-i2ChiNh7UMZcIaU4ANtYZe0G7NwysuYCS1nfXFUUEghELEUSWJPW5wNSVtEt21HluZ1e15UHoUwo Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.47 Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: e534e8517f514078988df401f9d6bec7 Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerShowV247Test-2072680612 Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e534e8517f514078988df401f9d6bec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e534e8517f514078988df401f9d6bec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e534e8517f514078988df401f9d6bec7", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e534e8517f514078988df401f9d6bec7"}]}] Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerShowV247Test-2072680612 Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: e534e8517f514078988df401f9d6bec7 Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerShowV247Test-2072680612 Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerShowV247Test-2072680612-project Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d56db16b8418478499b4163e8de66b38 Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerShowV247Test-2072680612-project Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance f13a0dbf-ac6b-4144-85e7-53277b8472e7 could not be found. Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'f13a0dbf-ac6b-4144-85e7-53277b8472e7'} Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f13a0dbf-ac6b-4144-85e7-53277b8472e7 could not be found. Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f13a0dbf-ac6b-4144-85e7-53277b8472e7 could not be found. Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:38.062626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:46:38.067038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:38.067038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:38.067038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:38.067038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:46:38.067038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:46:38.067038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f13a0dbf-ac6b-4144-85e7-53277b8472e7 could not be found. Jul 14 14:46:38.067038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:46:38.067886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bdd5e4b3-91d2-4eb1-beae-04dee7bfe771 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] Returning 404 to user: Instance f13a0dbf-ac6b-4144-85e7-53277b8472e7 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:46:38.069261 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bdd5e4b3-91d2-4eb1-beae-04dee7bfe771 tempest-ServerShowV247Test-2072680612 tempest-ServerShowV247Test-2072680612-project] 10.222.0.81 "GET /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7" status: 404 len: 111 microversion: 2.47 time: 0.097220 Jul 14 14:46:38.070066 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1871/3776] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:37 2022] GET /compute/v2.1/servers/f13a0dbf-ac6b-4144-85e7-53277b8472e7 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:46:38.325551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2a22caaa-dd99-4349-bb24-c9c8e98b59d8 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:38.340084 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a22caaa-dd99-4349-bb24-c9c8e98b59d8 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1588 microversion: 2.1 time: 0.708106 Jul 14 14:46:38.344653 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1906/3777] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:37 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1588 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:43.468160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1997155070", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": "none"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:43.573369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:43.573880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:43.575508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:43.576008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:43.576502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:43.588781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:43.589582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:43.590622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:43.591319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:43.622707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Getting quotas for project 3a1dabca5b794a448dcf0819d47664ea. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:43.632184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Getting quotas for user f6e383a0355b45e2ad96fb193cf49860 and project 3a1dabca5b794a448dcf0819d47664ea. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:43.649920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:46:43.652765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:46:43.777379 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-40ee5815-8fa4-4560-bf8b-9a3f7e220364 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.966483 Jul 14 14:46:43.781420 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1872/3778] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:46:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:46:43.799018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bff73ce8-d82e-4a91-aa0b-a131e02e3fd7 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:43.802341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bff73ce8-d82e-4a91-aa0b-a131e02e3fd7 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:43.808677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:43.813849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:43.961878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bff73ce8-d82e-4a91-aa0b-a131e02e3fd7 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:43.971291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bff73ce8-d82e-4a91-aa0b-a131e02e3fd7 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:43.983230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bff73ce8-d82e-4a91-aa0b-a131e02e3fd7 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:43.988146 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bff73ce8-d82e-4a91-aa0b-a131e02e3fd7 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1278 microversion: 2.54 time: 0.198333 Jul 14 14:46:43.995819 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1907/3779] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:43 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1278 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:45.012733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2fda598f-ef6d-404a-9bbe-f11bd3f91d84 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:45.014113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2fda598f-ef6d-404a-9bbe-f11bd3f91d84 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:45.034566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fda598f-ef6d-404a-9bbe-f11bd3f91d84 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:45.036484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fda598f-ef6d-404a-9bbe-f11bd3f91d84 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:45.038280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fda598f-ef6d-404a-9bbe-f11bd3f91d84 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:45.040672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fda598f-ef6d-404a-9bbe-f11bd3f91d84 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:45.291092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2fda598f-ef6d-404a-9bbe-f11bd3f91d84 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:45.300828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2fda598f-ef6d-404a-9bbe-f11bd3f91d84 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:45.313674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2fda598f-ef6d-404a-9bbe-f11bd3f91d84 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:45.318428 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2fda598f-ef6d-404a-9bbe-f11bd3f91d84 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1282 microversion: 2.54 time: 0.310781 Jul 14 14:46:45.319883 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1873/3780] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:45 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1282 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:46.340578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a2b8cec6-0677-4f3c-8489-fc3e4b9d7e9e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:46.341821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a2b8cec6-0677-4f3c-8489-fc3e4b9d7e9e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:46.385720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2b8cec6-0677-4f3c-8489-fc3e4b9d7e9e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:46.386175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2b8cec6-0677-4f3c-8489-fc3e4b9d7e9e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:46.387340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2b8cec6-0677-4f3c-8489-fc3e4b9d7e9e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:46.387792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2b8cec6-0677-4f3c-8489-fc3e4b9d7e9e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:46.478606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a2b8cec6-0677-4f3c-8489-fc3e4b9d7e9e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:46.493227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a2b8cec6-0677-4f3c-8489-fc3e4b9d7e9e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:46.494754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a2b8cec6-0677-4f3c-8489-fc3e4b9d7e9e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:46.499145 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a2b8cec6-0677-4f3c-8489-fc3e4b9d7e9e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1336 microversion: 2.54 time: 0.162988 Jul 14 14:46:46.502554 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1908/3781] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:46 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1336 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:47.532252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8464f3d9-b200-4f37-94dd-da3bfa3e4ee8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:47.534235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8464f3d9-b200-4f37-94dd-da3bfa3e4ee8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:47.565042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8464f3d9-b200-4f37-94dd-da3bfa3e4ee8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:47.568281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8464f3d9-b200-4f37-94dd-da3bfa3e4ee8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:47.570598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8464f3d9-b200-4f37-94dd-da3bfa3e4ee8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:47.572407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8464f3d9-b200-4f37-94dd-da3bfa3e4ee8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:47.782701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8464f3d9-b200-4f37-94dd-da3bfa3e4ee8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:47.803329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8464f3d9-b200-4f37-94dd-da3bfa3e4ee8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:47.804934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8464f3d9-b200-4f37-94dd-da3bfa3e4ee8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:47.809614 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8464f3d9-b200-4f37-94dd-da3bfa3e4ee8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1336 microversion: 2.54 time: 0.292261 Jul 14 14:46:47.810214 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1874/3782] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:47 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1336 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:48.833329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ba4f74ee-7eee-4235-8cb4-26198bc51c7b tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:48.838747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ba4f74ee-7eee-4235-8cb4-26198bc51c7b tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:48.857186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba4f74ee-7eee-4235-8cb4-26198bc51c7b tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:48.858048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba4f74ee-7eee-4235-8cb4-26198bc51c7b tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:48.861236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba4f74ee-7eee-4235-8cb4-26198bc51c7b tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:48.861991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba4f74ee-7eee-4235-8cb4-26198bc51c7b tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:49.006883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba4f74ee-7eee-4235-8cb4-26198bc51c7b tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:49.019709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba4f74ee-7eee-4235-8cb4-26198bc51c7b tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:49.026878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba4f74ee-7eee-4235-8cb4-26198bc51c7b tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:49.032636 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ba4f74ee-7eee-4235-8cb4-26198bc51c7b tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1357 microversion: 2.54 time: 0.208697 Jul 14 14:46:49.038350 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1909/3783] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:48 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:49.057793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f7387fcf-345b-4649-9619-5052a04285f7 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Action: 'create', calling method: .version_select at 0x7fd6c5da69d0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-2120089158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcWUq38+Buxbc3S3fVMjPeAl+O3+i2LYkr3o19KwBQVAYTmet2X+6p6B0cU6dGgBKca1i5cjBO0nejNnVOhKo412bXPanxGPC2FPE2sbrl0VMD7mwTjcKmjqWWOQ623ow=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:49.098536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f7387fcf-345b-4649-9619-5052a04285f7 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Getting quotas for project 3a1dabca5b794a448dcf0819d47664ea. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:49.118852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f7387fcf-345b-4649-9619-5052a04285f7 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Getting quotas for user f6e383a0355b45e2ad96fb193cf49860 and project 3a1dabca5b794a448dcf0819d47664ea. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:49.174857 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f7387fcf-345b-4649-9619-5052a04285f7 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.121232 Jul 14 14:46:49.181353 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1875/3784] 10.222.0.81 () {62 vars in 1199 bytes} [Thu Jul 14 14:46:49 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:46:49.187449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-2120089158", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:49.189512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:49.200146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:49.201521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:49.204350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:49.205736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:49.326586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:49.327960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:49.328850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:49.329709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:49.330443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:49.503893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:49.517887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:49.521199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:49.528557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:49.531793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:49.605742 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-748fb1b8-2582-442a-9e44-e631baacb275 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "POST /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754/action" status: 202 len: 1140 microversion: 2.54 time: 0.423211 Jul 14 14:46:49.611008 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1910/3785] 10.222.0.81 () {62 vars in 1319 bytes} [Thu Jul 14 14:46:49 2022] POST /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754/action => generated 1140 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 14 14:46:49.628412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e82b8fd6-e68a-47cc-833c-bc317d5cf029 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:49.630161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e82b8fd6-e68a-47cc-833c-bc317d5cf029 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:49.646445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e82b8fd6-e68a-47cc-833c-bc317d5cf029 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:49.646943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e82b8fd6-e68a-47cc-833c-bc317d5cf029 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:49.653707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e82b8fd6-e68a-47cc-833c-bc317d5cf029 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:49.655966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e82b8fd6-e68a-47cc-833c-bc317d5cf029 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:49.847641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e82b8fd6-e68a-47cc-833c-bc317d5cf029 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:49.866042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e82b8fd6-e68a-47cc-833c-bc317d5cf029 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:49.868182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e82b8fd6-e68a-47cc-833c-bc317d5cf029 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:49.869834 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e82b8fd6-e68a-47cc-833c-bc317d5cf029 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.246668 Jul 14 14:46:49.883023 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1876/3786] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:49 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:50.893119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3dabcf96-ad5b-4fe9-8a70-365b336a20fb tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:50.894637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3dabcf96-ad5b-4fe9-8a70-365b336a20fb tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:50.909983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3dabcf96-ad5b-4fe9-8a70-365b336a20fb tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:50.916751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3dabcf96-ad5b-4fe9-8a70-365b336a20fb tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:50.921766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3dabcf96-ad5b-4fe9-8a70-365b336a20fb tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:50.932554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3dabcf96-ad5b-4fe9-8a70-365b336a20fb tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:51.248937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3dabcf96-ad5b-4fe9-8a70-365b336a20fb tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:51.267481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3dabcf96-ad5b-4fe9-8a70-365b336a20fb tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:51.275713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3dabcf96-ad5b-4fe9-8a70-365b336a20fb tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:51.278839 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3dabcf96-ad5b-4fe9-8a70-365b336a20fb tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.390449 Jul 14 14:46:51.279468 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1911/3787] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:50 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:52.300359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1e6d01f3-edb9-4c80-b1b8-668150237cae tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:52.302204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1e6d01f3-edb9-4c80-b1b8-668150237cae tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:52.315232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e6d01f3-edb9-4c80-b1b8-668150237cae tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:52.321649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e6d01f3-edb9-4c80-b1b8-668150237cae tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:52.323281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e6d01f3-edb9-4c80-b1b8-668150237cae tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:52.323898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e6d01f3-edb9-4c80-b1b8-668150237cae tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:52.892200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1e6d01f3-edb9-4c80-b1b8-668150237cae tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:52.920273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1e6d01f3-edb9-4c80-b1b8-668150237cae tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:52.923033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1e6d01f3-edb9-4c80-b1b8-668150237cae tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:52.924536 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1e6d01f3-edb9-4c80-b1b8-668150237cae tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.630021 Jul 14 14:46:52.926325 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1877/3788] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:52 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:53.115879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-731269454", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "89eb577c-0684-494b-84d5-c6d4ce688beb"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:53.227851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] validate_networks() for [('89eb577c-0684-494b-84d5-c6d4ce688beb', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:46:53.452398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6619fd64-feba-4c1f-bd2c-186978123ee2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:53.453771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6619fd64-feba-4c1f-bd2c-186978123ee2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:53.461538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6619fd64-feba-4c1f-bd2c-186978123ee2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:53.465294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6619fd64-feba-4c1f-bd2c-186978123ee2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:53.466413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6619fd64-feba-4c1f-bd2c-186978123ee2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:53.467020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6619fd64-feba-4c1f-bd2c-186978123ee2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:53.603080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:53.885180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6619fd64-feba-4c1f-bd2c-186978123ee2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:53.899764 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6619fd64-feba-4c1f-bd2c-186978123ee2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.451208 Jul 14 14:46:53.913239 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1878/3789] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:53 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:53.920024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-88e224c8-b388-4660-8f8f-636f096670b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:53.920648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-88e224c8-b388-4660-8f8f-636f096670b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:53.946663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88e224c8-b388-4660-8f8f-636f096670b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:53.947580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88e224c8-b388-4660-8f8f-636f096670b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:53.948705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88e224c8-b388-4660-8f8f-636f096670b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:53.949687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88e224c8-b388-4660-8f8f-636f096670b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:53.966606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:54.339232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:54.339742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:54.340197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:54.340676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:54.341201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:54.353024 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:54.353595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:54.354628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:54.355365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:54.392587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Getting quotas for project 50f8ea81533f4e1e8c98b5c46718f29f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:54.399362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Getting quotas for user 55bc09bf29a243dfa43fa12663cfada8 and project 50f8ea81533f4e1e8c98b5c46718f29f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:54.418046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-88e224c8-b388-4660-8f8f-636f096670b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:54.422874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:46:54.429582 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-88e224c8-b388-4660-8f8f-636f096670b4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.514942 Jul 14 14:46:54.430894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:46:54.431159 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1879/3790] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:53 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:54.436825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eff9463f-2008-4eae-99ee-d4e41455f5f4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:54.437908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eff9463f-2008-4eae-99ee-d4e41455f5f4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:54.452879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eff9463f-2008-4eae-99ee-d4e41455f5f4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:54.454389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eff9463f-2008-4eae-99ee-d4e41455f5f4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:54.455425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eff9463f-2008-4eae-99ee-d4e41455f5f4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:54.456089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eff9463f-2008-4eae-99ee-d4e41455f5f4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:54.494581 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a4f9f90c-b610-4acc-9efe-e0568158359e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.610036 Jul 14 14:46:54.500709 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1912/3791] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:46:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:46:54.506981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9c2e6836-19f1-497c-98ba-1e6615c56901 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:54.508369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9c2e6836-19f1-497c-98ba-1e6615c56901 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:54.516465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9c2e6836-19f1-497c-98ba-1e6615c56901 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:54.516908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9c2e6836-19f1-497c-98ba-1e6615c56901 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:54.518014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9c2e6836-19f1-497c-98ba-1e6615c56901 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:54.518469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9c2e6836-19f1-497c-98ba-1e6615c56901 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:54.565541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-9c2e6836-19f1-497c-98ba-1e6615c56901 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lazy-loading 'flavor' on Instance uuid a9fadee3-2871-4c8e-adda-e95d99e56a1a {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:46:54.637699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eff9463f-2008-4eae-99ee-d4e41455f5f4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:54.664419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eff9463f-2008-4eae-99ee-d4e41455f5f4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:54.666499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eff9463f-2008-4eae-99ee-d4e41455f5f4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:54.675119 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eff9463f-2008-4eae-99ee-d4e41455f5f4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.242616 Jul 14 14:46:54.687489 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1880/3792] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:54 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:54.708125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d5b9396-37d6-4c06-a9fb-8397add500bf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:54.711357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0d5b9396-37d6-4c06-a9fb-8397add500bf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:54.745811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d5b9396-37d6-4c06-a9fb-8397add500bf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:54.747660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d5b9396-37d6-4c06-a9fb-8397add500bf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:54.754618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d5b9396-37d6-4c06-a9fb-8397add500bf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:54.755535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d5b9396-37d6-4c06-a9fb-8397add500bf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:54.841088 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9c2e6836-19f1-497c-98ba-1e6615c56901 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/action" status: 200 len: 32 microversion: 2.1 time: 0.338669 Jul 14 14:46:54.841906 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1913/3793] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:46:54 2022] POST /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/action => generated 32 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:46:54.856376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-87628110-f50b-426a-ad20-489414af6006 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:54.858237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-87628110-f50b-426a-ad20-489414af6006 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:55.017766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-87628110-f50b-426a-ad20-489414af6006 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:55.053350 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-87628110-f50b-426a-ad20-489414af6006 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1217 microversion: 2.1 time: 0.201560 Jul 14 14:46:55.056106 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1914/3794] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:54 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1217 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:55.069956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-72a10925-6da9-4fd8-a7b2-0992654350cc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:55.075890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-72a10925-6da9-4fd8-a7b2-0992654350cc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:55.090659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72a10925-6da9-4fd8-a7b2-0992654350cc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:55.091128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72a10925-6da9-4fd8-a7b2-0992654350cc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:55.105420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72a10925-6da9-4fd8-a7b2-0992654350cc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:55.109779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72a10925-6da9-4fd8-a7b2-0992654350cc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:55.166251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0d5b9396-37d6-4c06-a9fb-8397add500bf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:55.183995 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0d5b9396-37d6-4c06-a9fb-8397add500bf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.493679 Jul 14 14:46:55.199648 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1881/3795] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:54 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:55.208101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-934ec440-f237-4f1b-bcac-95a5b2abb641 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:55.209517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-934ec440-f237-4f1b-bcac-95a5b2abb641 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:55.231031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-934ec440-f237-4f1b-bcac-95a5b2abb641 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:55.231498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-934ec440-f237-4f1b-bcac-95a5b2abb641 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:55.232568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-934ec440-f237-4f1b-bcac-95a5b2abb641 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:55.233033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-934ec440-f237-4f1b-bcac-95a5b2abb641 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:55.679798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-72a10925-6da9-4fd8-a7b2-0992654350cc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:55.699494 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-72a10925-6da9-4fd8-a7b2-0992654350cc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.642290 Jul 14 14:46:55.714015 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1915/3796] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:55 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:55.722079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-934ec440-f237-4f1b-bcac-95a5b2abb641 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:55.732720 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-934ec440-f237-4f1b-bcac-95a5b2abb641 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.531359 Jul 14 14:46:55.734407 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1882/3797] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:55 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:55.737315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-72fa22cf-a286-4267-a322-70b810e716df tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:55.737944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-72fa22cf-a286-4267-a322-70b810e716df tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:55.765877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72fa22cf-a286-4267-a322-70b810e716df tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:55.767207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72fa22cf-a286-4267-a322-70b810e716df tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:55.768330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72fa22cf-a286-4267-a322-70b810e716df tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:55.768927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72fa22cf-a286-4267-a322-70b810e716df tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:55.903343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-72fa22cf-a286-4267-a322-70b810e716df tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:55.917586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-72fa22cf-a286-4267-a322-70b810e716df tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:55.923161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-72fa22cf-a286-4267-a322-70b810e716df tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:55.924791 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-72fa22cf-a286-4267-a322-70b810e716df tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.209453 Jul 14 14:46:55.929038 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1916/3798] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:55 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:55.957839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1959990926", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "05e588dd-ea85-4edc-9918-44620e736097"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:56.051004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] validate_networks() for [('05e588dd-ea85-4edc-9918-44620e736097', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:46:56.079573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0550e131-3e23-4640-a8a6-d689d3db0b4a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:56.080737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0550e131-3e23-4640-a8a6-d689d3db0b4a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:56.088748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0550e131-3e23-4640-a8a6-d689d3db0b4a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:56.089745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0550e131-3e23-4640-a8a6-d689d3db0b4a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:56.092431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0550e131-3e23-4640-a8a6-d689d3db0b4a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:56.106453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0550e131-3e23-4640-a8a6-d689d3db0b4a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:56.122846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:56.275231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0550e131-3e23-4640-a8a6-d689d3db0b4a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:56.290584 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0550e131-3e23-4640-a8a6-d689d3db0b4a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1269 microversion: 2.1 time: 0.221271 Jul 14 14:46:56.291487 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1917/3799] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:56 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1269 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:46:56.719820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d5d2b4ef-f2a2-4222-9b1b-b4922a2e9fa9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:56.721173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d5d2b4ef-f2a2-4222-9b1b-b4922a2e9fa9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:56.732157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d5d2b4ef-f2a2-4222-9b1b-b4922a2e9fa9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:56.734214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d5d2b4ef-f2a2-4222-9b1b-b4922a2e9fa9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:56.735808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d5d2b4ef-f2a2-4222-9b1b-b4922a2e9fa9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:56.736418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d5d2b4ef-f2a2-4222-9b1b-b4922a2e9fa9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.180733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:57.181382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:57.181775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:57.182246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:57.183208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:57.183502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d5d2b4ef-f2a2-4222-9b1b-b4922a2e9fa9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:57.195671 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d5d2b4ef-f2a2-4222-9b1b-b4922a2e9fa9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.480202 Jul 14 14:46:57.203310 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1918/3800] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:56 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:46:57.210019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.212364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.213357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.213817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.219362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-00d12277-435c-4008-811a-78522343791f tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:57.225233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-00d12277-435c-4008-811a-78522343791f tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:57.238349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00d12277-435c-4008-811a-78522343791f tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.243013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00d12277-435c-4008-811a-78522343791f tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.244654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00d12277-435c-4008-811a-78522343791f tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.257118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00d12277-435c-4008-811a-78522343791f tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.267843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Getting quotas for project 1933006fa13c44ae9128f00267210152. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:57.284396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Getting quotas for user f157150edd1d441aa2c7335dbb2363ca and project 1933006fa13c44ae9128f00267210152. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:57.305649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:46:57.307864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:46:57.411748 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a9dde0cb-4689-4f54-82f1-ab1e947fc95c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.461146 Jul 14 14:46:57.418357 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1883/3801] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:46:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:46:57.426475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a6627c37-a435-41c8-8b14-4b464f0c106e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:57.428645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a6627c37-a435-41c8-8b14-4b464f0c106e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:57.446693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6627c37-a435-41c8-8b14-4b464f0c106e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.452525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6627c37-a435-41c8-8b14-4b464f0c106e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.453411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6627c37-a435-41c8-8b14-4b464f0c106e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.453870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6627c37-a435-41c8-8b14-4b464f0c106e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.466992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-00d12277-435c-4008-811a-78522343791f tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:57.477363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-00d12277-435c-4008-811a-78522343791f tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:57.494101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-00d12277-435c-4008-811a-78522343791f tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:57.510057 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-00d12277-435c-4008-811a-78522343791f tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.305245 Jul 14 14:46:57.514193 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1919/3802] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:57 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:57.539384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e3fc45fe-38b6-4c4a-a8ea-ffd6b56e4c83 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:57.540325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e3fc45fe-38b6-4c4a-a8ea-ffd6b56e4c83 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:57.570123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a6627c37-a435-41c8-8b14-4b464f0c106e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:57.580228 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a6627c37-a435-41c8-8b14-4b464f0c106e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1275 microversion: 2.1 time: 0.157768 Jul 14 14:46:57.581046 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1884/3803] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:57 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:57.689444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e3fc45fe-38b6-4c4a-a8ea-ffd6b56e4c83 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:57.705282 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e3fc45fe-38b6-4c4a-a8ea-ffd6b56e4c83 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1215 microversion: 2.1 time: 0.187348 Jul 14 14:46:57.706620 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1920/3804] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:57 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1215 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:58.220295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-53a6503a-a6c5-4813-a4dd-f75b5c435ce1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:58.224399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-53a6503a-a6c5-4813-a4dd-f75b5c435ce1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:58.248363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53a6503a-a6c5-4813-a4dd-f75b5c435ce1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:58.250292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53a6503a-a6c5-4813-a4dd-f75b5c435ce1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:58.252925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53a6503a-a6c5-4813-a4dd-f75b5c435ce1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:58.254029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53a6503a-a6c5-4813-a4dd-f75b5c435ce1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:58.259806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:58.534587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2ab72409-84d3-4aaa-902f-d84b25ca2d55 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:58.535317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2ab72409-84d3-4aaa-902f-d84b25ca2d55 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:58.542377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:58.632182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-53a6503a-a6c5-4813-a4dd-f75b5c435ce1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:58.649015 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-53a6503a-a6c5-4813-a4dd-f75b5c435ce1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.433331 Jul 14 14:46:58.659868 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1885/3805] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:58 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:58.673852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d14453a-5608-4ff9-8b9d-be2297c2d76e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:58.674789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6d14453a-5608-4ff9-8b9d-be2297c2d76e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:58.690700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d14453a-5608-4ff9-8b9d-be2297c2d76e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:58.691434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d14453a-5608-4ff9-8b9d-be2297c2d76e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:58.692456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d14453a-5608-4ff9-8b9d-be2297c2d76e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:58.693077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d14453a-5608-4ff9-8b9d-be2297c2d76e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.141559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ab72409-84d3-4aaa-902f-d84b25ca2d55 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.142269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ab72409-84d3-4aaa-902f-d84b25ca2d55 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.143793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ab72409-84d3-4aaa-902f-d84b25ca2d55 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.144406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ab72409-84d3-4aaa-902f-d84b25ca2d55 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.247918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2ab72409-84d3-4aaa-902f-d84b25ca2d55 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:59.257968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2ab72409-84d3-4aaa-902f-d84b25ca2d55 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:59.259573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2ab72409-84d3-4aaa-902f-d84b25ca2d55 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:59.271166 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2ab72409-84d3-4aaa-902f-d84b25ca2d55 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.740447 Jul 14 14:46:59.273163 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1921/3806] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:58 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:59.282865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f79c20f3-e2b2-4a44-9976-732566dfbcd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:59.285929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f79c20f3-e2b2-4a44-9976-732566dfbcd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:59.300934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f79c20f3-e2b2-4a44-9976-732566dfbcd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.301426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f79c20f3-e2b2-4a44-9976-732566dfbcd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.302218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f79c20f3-e2b2-4a44-9976-732566dfbcd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.302664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f79c20f3-e2b2-4a44-9976-732566dfbcd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.399492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6d14453a-5608-4ff9-8b9d-be2297c2d76e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:59.420282 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6d14453a-5608-4ff9-8b9d-be2297c2d76e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1317 microversion: 2.1 time: 0.758883 Jul 14 14:46:59.427308 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1886/3807] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:58 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1317 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:59.586768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f79c20f3-e2b2-4a44-9976-732566dfbcd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:59.597974 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f79c20f3-e2b2-4a44-9976-732566dfbcd5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1285 microversion: 2.1 time: 0.323545 Jul 14 14:46:59.599067 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1922/3808] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:59 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1285 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:59.668873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-708c9a07-fabe-41f9-adfe-a66c63f1c85a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:59.673341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-708c9a07-fabe-41f9-adfe-a66c63f1c85a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:59.686024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-708c9a07-fabe-41f9-adfe-a66c63f1c85a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.686495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-708c9a07-fabe-41f9-adfe-a66c63f1c85a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.687929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-708c9a07-fabe-41f9-adfe-a66c63f1c85a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.688376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-708c9a07-fabe-41f9-adfe-a66c63f1c85a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.881177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c0f9f867-fbfe-4aa6-85a5-7676b1f9ff21 req-7046b674-128c-470f-ae1b-045c9f38c515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9f94f5-3d27-4f76-b948-c390f05bc81c", "tag": "deef751d-da5b-41a2-b224-542470608e30"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:59.904653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c0f9f867-fbfe-4aa6-85a5-7676b1f9ff21 req-7046b674-128c-470f-ae1b-045c9f38c515 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.907692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c0f9f867-fbfe-4aa6-85a5-7676b1f9ff21 req-7046b674-128c-470f-ae1b-045c9f38c515 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.937063 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c0f9f867-fbfe-4aa6-85a5-7676b1f9ff21 req-7046b674-128c-470f-ae1b-045c9f38c515 service nova] Creating event network-changed:deef751d-da5b-41a2-b224-542470608e30 for instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c on n-h1-767704-28 Jul 14 14:46:59.955262 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c0f9f867-fbfe-4aa6-85a5-7676b1f9ff21 req-7046b674-128c-470f-ae1b-045c9f38c515 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078519 Jul 14 14:46:59.956480 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1923/3809] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:00.300330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5e2b69b3-6359-443b-bf01-ac0ad62dab2e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:00.301527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5e2b69b3-6359-443b-bf01-ac0ad62dab2e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:00.320324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e2b69b3-6359-443b-bf01-ac0ad62dab2e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:00.322833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e2b69b3-6359-443b-bf01-ac0ad62dab2e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:00.323993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e2b69b3-6359-443b-bf01-ac0ad62dab2e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:00.326688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e2b69b3-6359-443b-bf01-ac0ad62dab2e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:00.583751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5e2b69b3-6359-443b-bf01-ac0ad62dab2e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:00.601089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5e2b69b3-6359-443b-bf01-ac0ad62dab2e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:00.610058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5e2b69b3-6359-443b-bf01-ac0ad62dab2e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:00.617353 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5e2b69b3-6359-443b-bf01-ac0ad62dab2e tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.328770 Jul 14 14:47:00.634317 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1924/3810] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:00 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:47:00.644158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-708c9a07-fabe-41f9-adfe-a66c63f1c85a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:00.647120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aa3f1755-6800-4098-80f3-6ac65fd90e4f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:00.654851 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-708c9a07-fabe-41f9-adfe-a66c63f1c85a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.991452 Jul 14 14:47:00.656318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aa3f1755-6800-4098-80f3-6ac65fd90e4f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:00.657474 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1887/3811] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:59 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:00.663015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-275a357b-83a5-4c31-9ca5-6883cf54c8e2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:00.663926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-275a357b-83a5-4c31-9ca5-6883cf54c8e2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:00.674332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-275a357b-83a5-4c31-9ca5-6883cf54c8e2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:00.675029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-275a357b-83a5-4c31-9ca5-6883cf54c8e2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:00.676068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-275a357b-83a5-4c31-9ca5-6883cf54c8e2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:00.676361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa3f1755-6800-4098-80f3-6ac65fd90e4f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:00.676844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa3f1755-6800-4098-80f3-6ac65fd90e4f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:00.677404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-275a357b-83a5-4c31-9ca5-6883cf54c8e2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:00.677650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa3f1755-6800-4098-80f3-6ac65fd90e4f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:00.688034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa3f1755-6800-4098-80f3-6ac65fd90e4f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:00.930900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-275a357b-83a5-4c31-9ca5-6883cf54c8e2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:00.957661 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-275a357b-83a5-4c31-9ca5-6883cf54c8e2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1273 microversion: 2.1 time: 0.298618 Jul 14 14:47:00.967175 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1888/3812] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:00 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1273 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:01.424683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-aa3f1755-6800-4098-80f3-6ac65fd90e4f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:01.433063 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aa3f1755-6800-4098-80f3-6ac65fd90e4f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1317 microversion: 2.1 time: 0.797346 Jul 14 14:47:01.435956 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1925/3813] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:00 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1317 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:01.637259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c13c25b-8c2f-43fc-971d-e1fa0a338bc8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:01.638019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3c13c25b-8c2f-43fc-971d-e1fa0a338bc8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:01.648678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c13c25b-8c2f-43fc-971d-e1fa0a338bc8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:01.651260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c13c25b-8c2f-43fc-971d-e1fa0a338bc8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:01.652793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c13c25b-8c2f-43fc-971d-e1fa0a338bc8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:01.655917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c13c25b-8c2f-43fc-971d-e1fa0a338bc8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:01.675066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb1b2754-011b-4f9b-b159-ef0eb4650f09 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:01.681664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bb1b2754-011b-4f9b-b159-ef0eb4650f09 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:01.693115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb1b2754-011b-4f9b-b159-ef0eb4650f09 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:01.696816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb1b2754-011b-4f9b-b159-ef0eb4650f09 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:01.699096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb1b2754-011b-4f9b-b159-ef0eb4650f09 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:01.702334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb1b2754-011b-4f9b-b159-ef0eb4650f09 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:01.876296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3c13c25b-8c2f-43fc-971d-e1fa0a338bc8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:01.890844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3c13c25b-8c2f-43fc-971d-e1fa0a338bc8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:01.896714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3c13c25b-8c2f-43fc-971d-e1fa0a338bc8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:01.901037 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3c13c25b-8c2f-43fc-971d-e1fa0a338bc8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.268166 Jul 14 14:47:01.914634 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1889/3814] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:01 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:01.984794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4683086-1cfd-434d-bada-5994ca3bc803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:01.985460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b4683086-1cfd-434d-bada-5994ca3bc803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:01.998043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4683086-1cfd-434d-bada-5994ca3bc803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:01.999931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4683086-1cfd-434d-bada-5994ca3bc803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:02.003958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4683086-1cfd-434d-bada-5994ca3bc803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:02.004457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4683086-1cfd-434d-bada-5994ca3bc803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:02.146434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bb1b2754-011b-4f9b-b159-ef0eb4650f09 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:02.158858 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bb1b2754-011b-4f9b-b159-ef0eb4650f09 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.486847 Jul 14 14:47:02.164186 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1926/3815] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:01 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:02.396527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b4683086-1cfd-434d-bada-5994ca3bc803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:02.418681 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b4683086-1cfd-434d-bada-5994ca3bc803 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1315 microversion: 2.1 time: 0.438726 Jul 14 14:47:02.428607 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1890/3816] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:01 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:02.451774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d361df41-5e89-46fe-b9d0-02ebe68cdf44 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:02.453650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d361df41-5e89-46fe-b9d0-02ebe68cdf44 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:02.464098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d361df41-5e89-46fe-b9d0-02ebe68cdf44 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:02.477568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d361df41-5e89-46fe-b9d0-02ebe68cdf44 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:02.479232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d361df41-5e89-46fe-b9d0-02ebe68cdf44 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:02.479941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d361df41-5e89-46fe-b9d0-02ebe68cdf44 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:02.790885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d361df41-5e89-46fe-b9d0-02ebe68cdf44 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:02.810212 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d361df41-5e89-46fe-b9d0-02ebe68cdf44 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1317 microversion: 2.1 time: 0.353378 Jul 14 14:47:02.811268 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1927/3817] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:02 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:02.920901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-feb09ef3-1b06-4d44-8f96-78bfb6ea8018 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:02.922235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-feb09ef3-1b06-4d44-8f96-78bfb6ea8018 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:02.937861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-feb09ef3-1b06-4d44-8f96-78bfb6ea8018 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:02.938480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-feb09ef3-1b06-4d44-8f96-78bfb6ea8018 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:02.950488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-feb09ef3-1b06-4d44-8f96-78bfb6ea8018 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:02.952121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-feb09ef3-1b06-4d44-8f96-78bfb6ea8018 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.178180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e362e4af-4aed-417a-af56-e43f704f3a9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:03.178999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e362e4af-4aed-417a-af56-e43f704f3a9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:03.191264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e362e4af-4aed-417a-af56-e43f704f3a9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.198461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e362e4af-4aed-417a-af56-e43f704f3a9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.200972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e362e4af-4aed-417a-af56-e43f704f3a9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.205495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e362e4af-4aed-417a-af56-e43f704f3a9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.247552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-feb09ef3-1b06-4d44-8f96-78bfb6ea8018 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:03.265840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-feb09ef3-1b06-4d44-8f96-78bfb6ea8018 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:03.269054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-feb09ef3-1b06-4d44-8f96-78bfb6ea8018 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:03.272754 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-feb09ef3-1b06-4d44-8f96-78bfb6ea8018 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.356820 Jul 14 14:47:03.274249 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1891/3818] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:02 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:03.438151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e13df65b-846f-44fa-9885-fc4f8eed50b1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:03.439170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e13df65b-846f-44fa-9885-fc4f8eed50b1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:03.454897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e13df65b-846f-44fa-9885-fc4f8eed50b1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.455877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e13df65b-846f-44fa-9885-fc4f8eed50b1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.457027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e13df65b-846f-44fa-9885-fc4f8eed50b1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.458732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e13df65b-846f-44fa-9885-fc4f8eed50b1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.733035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e362e4af-4aed-417a-af56-e43f704f3a9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:03.752565 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e362e4af-4aed-417a-af56-e43f704f3a9d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.579807 Jul 14 14:47:03.761113 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1928/3819] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:03 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:03.842694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e13df65b-846f-44fa-9885-fc4f8eed50b1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:03.852576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f9646b53-0fc2-4690-8362-3eb6baa0637d req-041014bc-03f0-4045-99d0-1c9055c194b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b455b809-78bb-47e3-993c-0e61f7445cc5", "tag": "ef61f614-4fff-4035-8c7e-c8670ff31aad"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:03.854962 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e13df65b-846f-44fa-9885-fc4f8eed50b1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1315 microversion: 2.1 time: 0.422753 Jul 14 14:47:03.861310 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1892/3820] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:03 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:03.869987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f9646b53-0fc2-4690-8362-3eb6baa0637d req-041014bc-03f0-4045-99d0-1c9055c194b5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.871246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cd1550de-aea4-45ff-bce0-6431e0f98039 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:03.872149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cd1550de-aea4-45ff-bce0-6431e0f98039 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:03.877077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f9646b53-0fc2-4690-8362-3eb6baa0637d req-041014bc-03f0-4045-99d0-1c9055c194b5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.891786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd1550de-aea4-45ff-bce0-6431e0f98039 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.892516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd1550de-aea4-45ff-bce0-6431e0f98039 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.893519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd1550de-aea4-45ff-bce0-6431e0f98039 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.894884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd1550de-aea4-45ff-bce0-6431e0f98039 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.929975 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f9646b53-0fc2-4690-8362-3eb6baa0637d req-041014bc-03f0-4045-99d0-1c9055c194b5 service nova] Creating event network-changed:ef61f614-4fff-4035-8c7e-c8670ff31aad for instance b455b809-78bb-47e3-993c-0e61f7445cc5 on n-h2-767704-28 Jul 14 14:47:03.955696 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f9646b53-0fc2-4690-8362-3eb6baa0637d req-041014bc-03f0-4045-99d0-1c9055c194b5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148615 Jul 14 14:47:03.970601 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1929/3821] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:04.285753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cd1550de-aea4-45ff-bce0-6431e0f98039 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:04.298065 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cd1550de-aea4-45ff-bce0-6431e0f98039 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1317 microversion: 2.1 time: 0.432993 Jul 14 14:47:04.298627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8dccd81-0a2f-4ff8-9c2b-dadd8ad9ec72 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:04.299643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8dccd81-0a2f-4ff8-9c2b-dadd8ad9ec72 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:04.301819 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1893/3822] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:03 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:04.307138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8dccd81-0a2f-4ff8-9c2b-dadd8ad9ec72 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:04.307926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8dccd81-0a2f-4ff8-9c2b-dadd8ad9ec72 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:04.308965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8dccd81-0a2f-4ff8-9c2b-dadd8ad9ec72 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:04.309709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8dccd81-0a2f-4ff8-9c2b-dadd8ad9ec72 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:04.379096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:04.397460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d8dccd81-0a2f-4ff8-9c2b-dadd8ad9ec72 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:04.417164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d8dccd81-0a2f-4ff8-9c2b-dadd8ad9ec72 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:04.423680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d8dccd81-0a2f-4ff8-9c2b-dadd8ad9ec72 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:04.428606 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8dccd81-0a2f-4ff8-9c2b-dadd8ad9ec72 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.136248 Jul 14 14:47:04.430095 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1930/3823] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:04 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:47:04.779749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8df0add3-0e20-448e-b739-e26e362a890b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:04.780620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8df0add3-0e20-448e-b739-e26e362a890b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:04.789172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8df0add3-0e20-448e-b739-e26e362a890b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:04.789867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8df0add3-0e20-448e-b739-e26e362a890b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:04.790469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8df0add3-0e20-448e-b739-e26e362a890b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:04.790933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8df0add3-0e20-448e-b739-e26e362a890b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:04.880500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b86142e9-fe03-44b6-ad1e-494625895c54 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:04.882302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b86142e9-fe03-44b6-ad1e-494625895c54 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:04.895622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b86142e9-fe03-44b6-ad1e-494625895c54 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:04.896300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b86142e9-fe03-44b6-ad1e-494625895c54 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:04.909612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b86142e9-fe03-44b6-ad1e-494625895c54 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:04.910757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b86142e9-fe03-44b6-ad1e-494625895c54 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:04.970028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8df0add3-0e20-448e-b739-e26e362a890b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:04.983477 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8df0add3-0e20-448e-b739-e26e362a890b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.208794 Jul 14 14:47:04.984736 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1894/3824] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:04 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:05.120554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b86142e9-fe03-44b6-ad1e-494625895c54 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:05.131048 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b86142e9-fe03-44b6-ad1e-494625895c54 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1315 microversion: 2.1 time: 0.254927 Jul 14 14:47:05.131776 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1931/3825] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:04 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:05.323255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4857f4a7-3b52-43b5-b6d3-df273af52351 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:05.323897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4857f4a7-3b52-43b5-b6d3-df273af52351 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:05.332367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4857f4a7-3b52-43b5-b6d3-df273af52351 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.332896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4857f4a7-3b52-43b5-b6d3-df273af52351 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.333786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4857f4a7-3b52-43b5-b6d3-df273af52351 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.334244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4857f4a7-3b52-43b5-b6d3-df273af52351 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.449285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7da9f33c-9f30-49ba-912e-483d5f62ab22 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:05.450053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7da9f33c-9f30-49ba-912e-483d5f62ab22 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:05.457309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7da9f33c-9f30-49ba-912e-483d5f62ab22 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.458063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7da9f33c-9f30-49ba-912e-483d5f62ab22 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.459049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7da9f33c-9f30-49ba-912e-483d5f62ab22 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.459685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7da9f33c-9f30-49ba-912e-483d5f62ab22 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.565978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4857f4a7-3b52-43b5-b6d3-df273af52351 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:05.587838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7da9f33c-9f30-49ba-912e-483d5f62ab22 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:05.589767 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4857f4a7-3b52-43b5-b6d3-df273af52351 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1317 microversion: 2.1 time: 0.263180 Jul 14 14:47:05.596659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7da9f33c-9f30-49ba-912e-483d5f62ab22 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:05.599399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7da9f33c-9f30-49ba-912e-483d5f62ab22 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:05.599970 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1895/3826] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:05 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:05.601183 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7da9f33c-9f30-49ba-912e-483d5f62ab22 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.155998 Jul 14 14:47:05.601747 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1932/3827] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:05 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:05.686123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a573b498-26ca-4ea9-a61e-39165b1b91da req-64b729af-76bb-412d-a1cb-a55bee414862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9f94f5-3d27-4f76-b948-c390f05bc81c", "name": "network-vif-plugged", "status": "completed", "tag": "deef751d-da5b-41a2-b224-542470608e30"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:05.696840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a573b498-26ca-4ea9-a61e-39165b1b91da req-64b729af-76bb-412d-a1cb-a55bee414862 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.697608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a573b498-26ca-4ea9-a61e-39165b1b91da req-64b729af-76bb-412d-a1cb-a55bee414862 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.738144 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a573b498-26ca-4ea9-a61e-39165b1b91da req-64b729af-76bb-412d-a1cb-a55bee414862 service nova] Creating event network-vif-plugged:deef751d-da5b-41a2-b224-542470608e30 for instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c on n-h1-767704-28 Jul 14 14:47:05.751276 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a573b498-26ca-4ea9-a61e-39165b1b91da req-64b729af-76bb-412d-a1cb-a55bee414862 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068158 Jul 14 14:47:05.757164 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1896/3828] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:06.004476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ecb8767f-b2b2-440a-9554-e55efcf6f1f0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:06.005176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ecb8767f-b2b2-440a-9554-e55efcf6f1f0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:06.017305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ecb8767f-b2b2-440a-9554-e55efcf6f1f0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:06.018156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ecb8767f-b2b2-440a-9554-e55efcf6f1f0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:06.019231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ecb8767f-b2b2-440a-9554-e55efcf6f1f0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:06.019917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ecb8767f-b2b2-440a-9554-e55efcf6f1f0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:06.151364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cc762470-e153-410e-8efe-1762ae0c43d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:06.152118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cc762470-e153-410e-8efe-1762ae0c43d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:06.165587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc762470-e153-410e-8efe-1762ae0c43d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:06.166776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc762470-e153-410e-8efe-1762ae0c43d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:06.168649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc762470-e153-410e-8efe-1762ae0c43d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:06.169600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc762470-e153-410e-8efe-1762ae0c43d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:06.357873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ecb8767f-b2b2-440a-9554-e55efcf6f1f0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:06.367842 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ecb8767f-b2b2-440a-9554-e55efcf6f1f0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.368275 Jul 14 14:47:06.368526 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1933/3829] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:05 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:06.425362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cc762470-e153-410e-8efe-1762ae0c43d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:06.433359 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cc762470-e153-410e-8efe-1762ae0c43d3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1315 microversion: 2.1 time: 0.287515 Jul 14 14:47:06.433951 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1897/3830] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:06 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:06.606401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8ae54af1-b73c-4b4e-baff-23716b8c44e7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:06.607609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8ae54af1-b73c-4b4e-baff-23716b8c44e7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:06.614454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ae54af1-b73c-4b4e-baff-23716b8c44e7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:06.615260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ae54af1-b73c-4b4e-baff-23716b8c44e7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:06.616253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ae54af1-b73c-4b4e-baff-23716b8c44e7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:06.616906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ae54af1-b73c-4b4e-baff-23716b8c44e7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:06.624609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a204d3c6-d289-4419-8b7a-91ac02635a6a tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:06.625331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a204d3c6-d289-4419-8b7a-91ac02635a6a tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:06.630057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:06.647780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a204d3c6-d289-4419-8b7a-91ac02635a6a tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:06.650056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a204d3c6-d289-4419-8b7a-91ac02635a6a tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:06.651654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a204d3c6-d289-4419-8b7a-91ac02635a6a tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:06.652119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a204d3c6-d289-4419-8b7a-91ac02635a6a tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:06.758961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a204d3c6-d289-4419-8b7a-91ac02635a6a tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:06.788626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a204d3c6-d289-4419-8b7a-91ac02635a6a tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:06.792643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a204d3c6-d289-4419-8b7a-91ac02635a6a tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:06.798511 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a204d3c6-d289-4419-8b7a-91ac02635a6a tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.179653 Jul 14 14:47:06.799358 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1898/3831] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:06 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:06.863706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8ae54af1-b73c-4b4e-baff-23716b8c44e7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:06.887278 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8ae54af1-b73c-4b4e-baff-23716b8c44e7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1317 microversion: 2.1 time: 0.284620 Jul 14 14:47:06.894118 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1934/3832] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:06 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:07.386781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-977e7774-d98d-4e81-91ee-45f70778b6ec tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:07.387414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-977e7774-d98d-4e81-91ee-45f70778b6ec tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:07.391454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:07.392149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=16 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:07.399755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-977e7774-d98d-4e81-91ee-45f70778b6ec tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:07.400291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-977e7774-d98d-4e81-91ee-45f70778b6ec tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:07.401257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-977e7774-d98d-4e81-91ee-45f70778b6ec tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:07.401743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-977e7774-d98d-4e81-91ee-45f70778b6ec tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:07.451894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-563c1a01-a0a3-4de6-b1ad-4c4c3ac3de70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:07.453958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-563c1a01-a0a3-4de6-b1ad-4c4c3ac3de70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:07.463965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-563c1a01-a0a3-4de6-b1ad-4c4c3ac3de70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:07.464783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-563c1a01-a0a3-4de6-b1ad-4c4c3ac3de70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:07.465861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-563c1a01-a0a3-4de6-b1ad-4c4c3ac3de70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:07.466532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-563c1a01-a0a3-4de6-b1ad-4c4c3ac3de70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:07.699670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=10 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:07.786460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-977e7774-d98d-4e81-91ee-45f70778b6ec tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:07.805435 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-977e7774-d98d-4e81-91ee-45f70778b6ec tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.421917 Jul 14 14:47:07.806861 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1899/3833] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:07 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:07.822142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-df70f434-1f1a-4ac4-a2d9-f29f529fba2d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:07.823058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-df70f434-1f1a-4ac4-a2d9-f29f529fba2d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:07.831216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df70f434-1f1a-4ac4-a2d9-f29f529fba2d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:07.833466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df70f434-1f1a-4ac4-a2d9-f29f529fba2d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:07.834488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df70f434-1f1a-4ac4-a2d9-f29f529fba2d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:07.835323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df70f434-1f1a-4ac4-a2d9-f29f529fba2d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:07.878919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-563c1a01-a0a3-4de6-b1ad-4c4c3ac3de70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:07.888542 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-563c1a01-a0a3-4de6-b1ad-4c4c3ac3de70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1315 microversion: 2.1 time: 0.440981 Jul 14 14:47:07.894315 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1935/3834] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:07 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:07.911713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8fb06f4a-d762-44fc-87f2-ee1fe46e20db tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:07.912620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8fb06f4a-d762-44fc-87f2-ee1fe46e20db tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:07.919984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8fb06f4a-d762-44fc-87f2-ee1fe46e20db tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:07.920735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8fb06f4a-d762-44fc-87f2-ee1fe46e20db tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:07.922511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8fb06f4a-d762-44fc-87f2-ee1fe46e20db tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:07.923135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8fb06f4a-d762-44fc-87f2-ee1fe46e20db tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:07.928676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:07.963367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-df70f434-1f1a-4ac4-a2d9-f29f529fba2d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:07.974727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-df70f434-1f1a-4ac4-a2d9-f29f529fba2d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:07.976483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-df70f434-1f1a-4ac4-a2d9-f29f529fba2d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:07.977923 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-df70f434-1f1a-4ac4-a2d9-f29f529fba2d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.163995 Jul 14 14:47:07.978497 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1900/3835] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:07 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:47:08.104707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8fb06f4a-d762-44fc-87f2-ee1fe46e20db tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:08.118747 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8fb06f4a-d762-44fc-87f2-ee1fe46e20db tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1508 microversion: 2.1 time: 0.210945 Jul 14 14:47:08.120462 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1936/3836] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:07 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:08.135989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2adcf23e-9589-4153-ab14-5ba1c3318bfe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:08.136518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2adcf23e-9589-4153-ab14-5ba1c3318bfe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:08.146044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2adcf23e-9589-4153-ab14-5ba1c3318bfe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.147260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2adcf23e-9589-4153-ab14-5ba1c3318bfe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.148603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2adcf23e-9589-4153-ab14-5ba1c3318bfe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.149096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2adcf23e-9589-4153-ab14-5ba1c3318bfe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.315845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2adcf23e-9589-4153-ab14-5ba1c3318bfe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:08.331063 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2adcf23e-9589-4153-ab14-5ba1c3318bfe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1508 microversion: 2.1 time: 0.198883 Jul 14 14:47:08.331907 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1901/3837] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:08 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:08.348194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:08.350085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:08.357477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.357941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.359395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.360036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.446415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:47:08.446847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:47:08.447686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:47:08.448338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:47:08.448976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:47:08.529816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:08.542949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.543622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.544709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.545363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.583342 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-06ddbde6-87fa-4cf0-bf5e-28bbf27a0bea tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "POST /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c/action" status: 202 len: 1110 microversion: 2.1 time: 0.238907 Jul 14 14:47:08.584107 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1937/3838] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:47:08 2022] POST /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c/action => generated 1110 bytes in 241 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 14:47:08.599922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be51f81e-cb73-4c68-8d1b-8a62b07f9efe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:08.601003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-be51f81e-cb73-4c68-8d1b-8a62b07f9efe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:08.612595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be51f81e-cb73-4c68-8d1b-8a62b07f9efe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.613695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be51f81e-cb73-4c68-8d1b-8a62b07f9efe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.614960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be51f81e-cb73-4c68-8d1b-8a62b07f9efe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.616311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be51f81e-cb73-4c68-8d1b-8a62b07f9efe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.639155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:08.809403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a6fe2446-e32c-4f2a-893f-736e20e6aad7 req-3fb838c1-d4de-4b1a-8430-3a6c3646c8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b455b809-78bb-47e3-993c-0e61f7445cc5", "name": "network-vif-plugged", "status": "completed", "tag": "ef61f614-4fff-4035-8c7e-c8670ff31aad"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:08.827265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-be51f81e-cb73-4c68-8d1b-8a62b07f9efe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:08.828744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a6fe2446-e32c-4f2a-893f-736e20e6aad7 req-3fb838c1-d4de-4b1a-8430-3a6c3646c8d1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.830428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a6fe2446-e32c-4f2a-893f-736e20e6aad7 req-3fb838c1-d4de-4b1a-8430-3a6c3646c8d1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.851311 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-be51f81e-cb73-4c68-8d1b-8a62b07f9efe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.255845 Jul 14 14:47:08.852298 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1902/3839] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:08 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:08.861806 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a6fe2446-e32c-4f2a-893f-736e20e6aad7 req-3fb838c1-d4de-4b1a-8430-3a6c3646c8d1 service nova] Creating event network-vif-plugged:ef61f614-4fff-4035-8c7e-c8670ff31aad for instance b455b809-78bb-47e3-993c-0e61f7445cc5 on n-h2-767704-28 Jul 14 14:47:08.872002 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a6fe2446-e32c-4f2a-893f-736e20e6aad7 req-3fb838c1-d4de-4b1a-8430-3a6c3646c8d1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067513 Jul 14 14:47:08.873545 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1938/3840] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:47:08.875662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8a802e70-ac6f-4610-809a-8e9f83a2defc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:08.883419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8a802e70-ac6f-4610-809a-8e9f83a2defc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:08.896061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a802e70-ac6f-4610-809a-8e9f83a2defc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.901174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a802e70-ac6f-4610-809a-8e9f83a2defc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.902071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a802e70-ac6f-4610-809a-8e9f83a2defc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.902645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a802e70-ac6f-4610-809a-8e9f83a2defc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.914070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-99bcb2fd-45ae-4424-8de5-1e80cb504900 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:08.914923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-99bcb2fd-45ae-4424-8de5-1e80cb504900 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:08.933472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99bcb2fd-45ae-4424-8de5-1e80cb504900 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.934002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99bcb2fd-45ae-4424-8de5-1e80cb504900 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.934835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99bcb2fd-45ae-4424-8de5-1e80cb504900 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.935286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99bcb2fd-45ae-4424-8de5-1e80cb504900 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:09.306242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8a802e70-ac6f-4610-809a-8e9f83a2defc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:09.318943 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8a802e70-ac6f-4610-809a-8e9f83a2defc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.463785 Jul 14 14:47:09.322453 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1903/3841] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:08 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:09.329795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15309194-7d1d-4294-980a-f1e58e410bf8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:09.330793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-15309194-7d1d-4294-980a-f1e58e410bf8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:09.340091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15309194-7d1d-4294-980a-f1e58e410bf8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:09.340717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15309194-7d1d-4294-980a-f1e58e410bf8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:09.341948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15309194-7d1d-4294-980a-f1e58e410bf8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:09.342187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-99bcb2fd-45ae-4424-8de5-1e80cb504900 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:09.343521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15309194-7d1d-4294-980a-f1e58e410bf8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:09.357781 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-99bcb2fd-45ae-4424-8de5-1e80cb504900 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1315 microversion: 2.1 time: 0.450094 Jul 14 14:47:09.360132 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1939/3842] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:08 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:09.428051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-15309194-7d1d-4294-980a-f1e58e410bf8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:09.436362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-15309194-7d1d-4294-980a-f1e58e410bf8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:09.437924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-15309194-7d1d-4294-980a-f1e58e410bf8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:09.439123 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-15309194-7d1d-4294-980a-f1e58e410bf8 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.114890 Jul 14 14:47:09.439699 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1904/3843] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:09 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:09.875363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b797d7e-2b92-4e44-aa9f-20db9c10a031 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:09.876087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5b797d7e-2b92-4e44-aa9f-20db9c10a031 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:09.883839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b797d7e-2b92-4e44-aa9f-20db9c10a031 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:09.884592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b797d7e-2b92-4e44-aa9f-20db9c10a031 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:09.885540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b797d7e-2b92-4e44-aa9f-20db9c10a031 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:09.885984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b797d7e-2b92-4e44-aa9f-20db9c10a031 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:10.064146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5b797d7e-2b92-4e44-aa9f-20db9c10a031 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:10.072631 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b797d7e-2b92-4e44-aa9f-20db9c10a031 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.202308 Jul 14 14:47:10.073485 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1940/3844] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:09 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:10.339513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-27f3a1ed-a44f-44d1-a810-941dbf1a7817 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:10.340314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-27f3a1ed-a44f-44d1-a810-941dbf1a7817 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:10.348703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27f3a1ed-a44f-44d1-a810-941dbf1a7817 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:10.349416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27f3a1ed-a44f-44d1-a810-941dbf1a7817 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:10.350336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27f3a1ed-a44f-44d1-a810-941dbf1a7817 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:10.351100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27f3a1ed-a44f-44d1-a810-941dbf1a7817 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:10.381457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d55348a5-a70d-4e07-a0e1-3212cc3c55ab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:10.382546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d55348a5-a70d-4e07-a0e1-3212cc3c55ab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:10.391713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d55348a5-a70d-4e07-a0e1-3212cc3c55ab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:10.392676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d55348a5-a70d-4e07-a0e1-3212cc3c55ab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:10.394113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d55348a5-a70d-4e07-a0e1-3212cc3c55ab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:10.394725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d55348a5-a70d-4e07-a0e1-3212cc3c55ab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:10.585099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-27f3a1ed-a44f-44d1-a810-941dbf1a7817 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:10.598397 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-27f3a1ed-a44f-44d1-a810-941dbf1a7817 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.262888 Jul 14 14:47:10.601253 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1905/3845] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:10 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:10.609129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bea099aa-bb68-443c-8b87-1fc39c404c7d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:10.610153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bea099aa-bb68-443c-8b87-1fc39c404c7d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:10.615151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d55348a5-a70d-4e07-a0e1-3212cc3c55ab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:10.619604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bea099aa-bb68-443c-8b87-1fc39c404c7d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:10.620291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bea099aa-bb68-443c-8b87-1fc39c404c7d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:10.621646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bea099aa-bb68-443c-8b87-1fc39c404c7d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:10.622309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bea099aa-bb68-443c-8b87-1fc39c404c7d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:10.623657 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d55348a5-a70d-4e07-a0e1-3212cc3c55ab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1315 microversion: 2.1 time: 0.247221 Jul 14 14:47:10.625428 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1941/3846] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:10 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:10.710725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bea099aa-bb68-443c-8b87-1fc39c404c7d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:10.728075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bea099aa-bb68-443c-8b87-1fc39c404c7d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:10.730079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bea099aa-bb68-443c-8b87-1fc39c404c7d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:10.731371 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bea099aa-bb68-443c-8b87-1fc39c404c7d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.128775 Jul 14 14:47:10.732479 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1906/3847] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:10 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:11.090995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-71ea750f-6af1-4364-8e81-38bbf9ee424b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:11.091705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-71ea750f-6af1-4364-8e81-38bbf9ee424b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:11.099960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71ea750f-6af1-4364-8e81-38bbf9ee424b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:11.101110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71ea750f-6af1-4364-8e81-38bbf9ee424b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:11.101986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71ea750f-6af1-4364-8e81-38bbf9ee424b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:11.102504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71ea750f-6af1-4364-8e81-38bbf9ee424b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:11.309532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-71ea750f-6af1-4364-8e81-38bbf9ee424b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:11.317552 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-71ea750f-6af1-4364-8e81-38bbf9ee424b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.230348 Jul 14 14:47:11.318293 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1942/3848] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:11 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:11.619569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f8c0c88-e22a-42a3-9638-4182091400ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:11.620184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1f8c0c88-e22a-42a3-9638-4182091400ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:11.628250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f8c0c88-e22a-42a3-9638-4182091400ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:11.628779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f8c0c88-e22a-42a3-9638-4182091400ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:11.629653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f8c0c88-e22a-42a3-9638-4182091400ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:11.630402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f8c0c88-e22a-42a3-9638-4182091400ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:11.642584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c5c25609-cb65-47e1-a786-877ce13eb507 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:11.643202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c5c25609-cb65-47e1-a786-877ce13eb507 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:11.660702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5c25609-cb65-47e1-a786-877ce13eb507 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:11.661830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5c25609-cb65-47e1-a786-877ce13eb507 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:11.662599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5c25609-cb65-47e1-a786-877ce13eb507 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:11.663072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5c25609-cb65-47e1-a786-877ce13eb507 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:12.250158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1f8c0c88-e22a-42a3-9638-4182091400ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:12.259411 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f8c0c88-e22a-42a3-9638-4182091400ba tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.644034 Jul 14 14:47:12.260237 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1907/3849] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:11 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:12.271644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b0a5500-a1f8-423a-a7bc-2e985e7ac1c2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:12.272701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8b0a5500-a1f8-423a-a7bc-2e985e7ac1c2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:12.275257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c5c25609-cb65-47e1-a786-877ce13eb507 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:12.281894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b0a5500-a1f8-423a-a7bc-2e985e7ac1c2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:12.282619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b0a5500-a1f8-423a-a7bc-2e985e7ac1c2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:12.284392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b0a5500-a1f8-423a-a7bc-2e985e7ac1c2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:12.285030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b0a5500-a1f8-423a-a7bc-2e985e7ac1c2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:12.286228 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c5c25609-cb65-47e1-a786-877ce13eb507 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1503 microversion: 2.1 time: 0.648083 Jul 14 14:47:12.297748 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1943/3850] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:11 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1503 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:12.304756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5465ee9a-4c82-492f-b25d-13fa75fba80c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:12.305357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5465ee9a-4c82-492f-b25d-13fa75fba80c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:12.313658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5465ee9a-4c82-492f-b25d-13fa75fba80c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:12.314412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5465ee9a-4c82-492f-b25d-13fa75fba80c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:12.315471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5465ee9a-4c82-492f-b25d-13fa75fba80c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:12.316167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5465ee9a-4c82-492f-b25d-13fa75fba80c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:12.397519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8b0a5500-a1f8-423a-a7bc-2e985e7ac1c2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:12.409501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8b0a5500-a1f8-423a-a7bc-2e985e7ac1c2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:12.411580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8b0a5500-a1f8-423a-a7bc-2e985e7ac1c2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:12.413359 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8b0a5500-a1f8-423a-a7bc-2e985e7ac1c2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.146935 Jul 14 14:47:12.415721 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1908/3851] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:12 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:12.425380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b122fd22-4b74-404a-ae6c-cdea3a54cba0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:12.425380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b122fd22-4b74-404a-ae6c-cdea3a54cba0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:12.428369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b122fd22-4b74-404a-ae6c-cdea3a54cba0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:12.428903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b122fd22-4b74-404a-ae6c-cdea3a54cba0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:12.429842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b122fd22-4b74-404a-ae6c-cdea3a54cba0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:12.430357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b122fd22-4b74-404a-ae6c-cdea3a54cba0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:12.546579 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.network.security_group_api [None req-5465ee9a-4c82-492f-b25d-13fa75fba80c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Removing security group 737d94c7-ebf4-4ea8-8eb5-be3edae9e9f1 from port ef61f614-4fff-4035-8c7e-c8670ff31aad Jul 14 14:47:12.711276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b122fd22-4b74-404a-ae6c-cdea3a54cba0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:12.725813 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b122fd22-4b74-404a-ae6c-cdea3a54cba0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.310114 Jul 14 14:47:12.726844 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1909/3852] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:12 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:13.088641 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5465ee9a-4c82-492f-b25d-13fa75fba80c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5/action" status: 202 len: 0 microversion: 2.1 time: 0.788180 Jul 14 14:47:13.090045 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1944/3853] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:47:12 2022] POST /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5/action => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:47:13.115782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c23a64e9-391a-4e16-99a2-b510d4ca5ad9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:13.116321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c23a64e9-391a-4e16-99a2-b510d4ca5ad9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:13.119403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a766c8a2-731f-4f71-91d2-3154b088f2e7 req-bac10124-2d3d-4129-9b43-74c9ba721556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b455b809-78bb-47e3-993c-0e61f7445cc5", "tag": "ef61f614-4fff-4035-8c7e-c8670ff31aad"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:13.157153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c23a64e9-391a-4e16-99a2-b510d4ca5ad9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.160316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c23a64e9-391a-4e16-99a2-b510d4ca5ad9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.164150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c23a64e9-391a-4e16-99a2-b510d4ca5ad9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.168697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c23a64e9-391a-4e16-99a2-b510d4ca5ad9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.181612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a766c8a2-731f-4f71-91d2-3154b088f2e7 req-bac10124-2d3d-4129-9b43-74c9ba721556 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.182494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a766c8a2-731f-4f71-91d2-3154b088f2e7 req-bac10124-2d3d-4129-9b43-74c9ba721556 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.213926 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a766c8a2-731f-4f71-91d2-3154b088f2e7 req-bac10124-2d3d-4129-9b43-74c9ba721556 service nova] Creating event network-changed:ef61f614-4fff-4035-8c7e-c8670ff31aad for instance b455b809-78bb-47e3-993c-0e61f7445cc5 on n-h2-767704-28 Jul 14 14:47:13.220056 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a766c8a2-731f-4f71-91d2-3154b088f2e7 req-bac10124-2d3d-4129-9b43-74c9ba721556 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113351 Jul 14 14:47:13.225019 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1945/3854] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:13.279202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-33581fd5-9d1b-4578-8cd3-6538df2b6ce3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:13.280114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-33581fd5-9d1b-4578-8cd3-6538df2b6ce3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:13.295486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33581fd5-9d1b-4578-8cd3-6538df2b6ce3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.296683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33581fd5-9d1b-4578-8cd3-6538df2b6ce3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.297689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33581fd5-9d1b-4578-8cd3-6538df2b6ce3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.301820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33581fd5-9d1b-4578-8cd3-6538df2b6ce3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.472460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c23a64e9-391a-4e16-99a2-b510d4ca5ad9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:13.493195 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c23a64e9-391a-4e16-99a2-b510d4ca5ad9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1461 microversion: 2.1 time: 0.394152 Jul 14 14:47:13.494464 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1910/3855] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:13 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1461 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:13.500657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b17c758b-0e16-4228-aeb1-65835fd28f38 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:13.502336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b17c758b-0e16-4228-aeb1-65835fd28f38 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:13.509218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b17c758b-0e16-4228-aeb1-65835fd28f38 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.509689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b17c758b-0e16-4228-aeb1-65835fd28f38 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.510545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b17c758b-0e16-4228-aeb1-65835fd28f38 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.510990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b17c758b-0e16-4228-aeb1-65835fd28f38 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.630575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b17c758b-0e16-4228-aeb1-65835fd28f38 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:13.640790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b17c758b-0e16-4228-aeb1-65835fd28f38 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:13.642385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b17c758b-0e16-4228-aeb1-65835fd28f38 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:13.643547 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b17c758b-0e16-4228-aeb1-65835fd28f38 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.147738 Jul 14 14:47:13.644121 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1911/3856] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:13 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:13.649126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9116cf02-0a99-4a38-9c5b-22a940d05fd7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:13.650059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9116cf02-0a99-4a38-9c5b-22a940d05fd7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:13.657126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9116cf02-0a99-4a38-9c5b-22a940d05fd7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.657675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9116cf02-0a99-4a38-9c5b-22a940d05fd7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.658561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9116cf02-0a99-4a38-9c5b-22a940d05fd7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.659066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9116cf02-0a99-4a38-9c5b-22a940d05fd7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.684083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-33581fd5-9d1b-4578-8cd3-6538df2b6ce3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:13.696017 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-33581fd5-9d1b-4578-8cd3-6538df2b6ce3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.421647 Jul 14 14:47:13.696653 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1946/3857] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:13 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:13.744304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b357fd47-0fb4-46ab-84b1-9d2df984ac24 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:13.745675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b357fd47-0fb4-46ab-84b1-9d2df984ac24 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:13.752196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b357fd47-0fb4-46ab-84b1-9d2df984ac24 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.752650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b357fd47-0fb4-46ab-84b1-9d2df984ac24 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.753467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b357fd47-0fb4-46ab-84b1-9d2df984ac24 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.753910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b357fd47-0fb4-46ab-84b1-9d2df984ac24 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.990962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9116cf02-0a99-4a38-9c5b-22a940d05fd7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.005591 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9116cf02-0a99-4a38-9c5b-22a940d05fd7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.360191 Jul 14 14:47:14.007813 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1912/3858] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:13 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:14.027865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bc8e0a46-a791-4c49-a138-32debde0697c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:14.028772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bc8e0a46-a791-4c49-a138-32debde0697c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:14.037188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc8e0a46-a791-4c49-a138-32debde0697c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.037706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc8e0a46-a791-4c49-a138-32debde0697c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.038750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc8e0a46-a791-4c49-a138-32debde0697c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.039347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc8e0a46-a791-4c49-a138-32debde0697c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.120293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b357fd47-0fb4-46ab-84b1-9d2df984ac24 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.129020 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b357fd47-0fb4-46ab-84b1-9d2df984ac24 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.389314 Jul 14 14:47:14.132996 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1947/3859] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:13 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:14.288010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bc8e0a46-a791-4c49-a138-32debde0697c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.297064 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bc8e0a46-a791-4c49-a138-32debde0697c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.273210 Jul 14 14:47:14.297984 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1913/3860] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:14 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:14.314846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fea7a55d-1758-4fd5-8d86-368b8904d56e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:14.315494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fea7a55d-1758-4fd5-8d86-368b8904d56e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:14.321699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fea7a55d-1758-4fd5-8d86-368b8904d56e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.322150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fea7a55d-1758-4fd5-8d86-368b8904d56e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.322928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fea7a55d-1758-4fd5-8d86-368b8904d56e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.323370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fea7a55d-1758-4fd5-8d86-368b8904d56e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.476379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fea7a55d-1758-4fd5-8d86-368b8904d56e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.485823 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fea7a55d-1758-4fd5-8d86-368b8904d56e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.175553 Jul 14 14:47:14.501501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-db1df5ee-1f27-4302-90f6-d80a5782dc0d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:14.503606 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1948/3861] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:14 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:14.509418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e8a8d0fd-f496-4852-a61d-918838724a6a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:14.510132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e8a8d0fd-f496-4852-a61d-918838724a6a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:14.511177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-db1df5ee-1f27-4302-90f6-d80a5782dc0d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.512270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-db1df5ee-1f27-4302-90f6-d80a5782dc0d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Searching by: {'deleted': False, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:47:14.517288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8a8d0fd-f496-4852-a61d-918838724a6a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.517869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8a8d0fd-f496-4852-a61d-918838724a6a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.518675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8a8d0fd-f496-4852-a61d-918838724a6a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.519151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8a8d0fd-f496-4852-a61d-918838724a6a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.520736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db1df5ee-1f27-4302-90f6-d80a5782dc0d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.521212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db1df5ee-1f27-4302-90f6-d80a5782dc0d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.522065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db1df5ee-1f27-4302-90f6-d80a5782dc0d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.524439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db1df5ee-1f27-4302-90f6-d80a5782dc0d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.561144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-db1df5ee-1f27-4302-90f6-d80a5782dc0d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:47:14.597744 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-db1df5ee-1f27-4302-90f6-d80a5782dc0d tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.099993 Jul 14 14:47:14.599378 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1914/3862] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 14:47:14 2022] GET /compute/v2.1/servers => generated 339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:14.617602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5ad630bb-ff9d-4fb6-817e-b6fc4f510d57 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:14.623052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5ad630bb-ff9d-4fb6-817e-b6fc4f510d57 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.624650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5ad630bb-ff9d-4fb6-817e-b6fc4f510d57 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Searching by: {'deleted': False, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:47:14.630391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ad630bb-ff9d-4fb6-817e-b6fc4f510d57 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.630970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ad630bb-ff9d-4fb6-817e-b6fc4f510d57 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.632017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ad630bb-ff9d-4fb6-817e-b6fc4f510d57 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.632560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ad630bb-ff9d-4fb6-817e-b6fc4f510d57 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.672994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-5ad630bb-ff9d-4fb6-817e-b6fc4f510d57 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:47:14.680618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e8a8d0fd-f496-4852-a61d-918838724a6a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.691140 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e8a8d0fd-f496-4852-a61d-918838724a6a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.186186 Jul 14 14:47:14.692995 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1949/3863] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:14 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:14.697807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-71f240c7-d117-4c78-961b-c2986f4e58a2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:14.698610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-71f240c7-d117-4c78-961b-c2986f4e58a2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:14.715455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71f240c7-d117-4c78-961b-c2986f4e58a2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.716729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71f240c7-d117-4c78-961b-c2986f4e58a2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.718149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71f240c7-d117-4c78-961b-c2986f4e58a2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.718841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71f240c7-d117-4c78-961b-c2986f4e58a2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.728328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5ad630bb-ff9d-4fb6-817e-b6fc4f510d57 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.736192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ad630bb-ff9d-4fb6-817e-b6fc4f510d57 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.736738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5ad630bb-ff9d-4fb6-817e-b6fc4f510d57 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.822476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-71f240c7-d117-4c78-961b-c2986f4e58a2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.831490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-71f240c7-d117-4c78-961b-c2986f4e58a2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.833590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-71f240c7-d117-4c78-961b-c2986f4e58a2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.835161 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-71f240c7-d117-4c78-961b-c2986f4e58a2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.140897 Jul 14 14:47:14.835954 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1950/3864] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:14 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:14.840736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4569c94-abb0-4ca4-8d00-e001dd4a2502 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:14.841674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d4569c94-abb0-4ca4-8d00-e001dd4a2502 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:14.853937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4569c94-abb0-4ca4-8d00-e001dd4a2502 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.854904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4569c94-abb0-4ca4-8d00-e001dd4a2502 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.856191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4569c94-abb0-4ca4-8d00-e001dd4a2502 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.856735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4569c94-abb0-4ca4-8d00-e001dd4a2502 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.912575 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5ad630bb-ff9d-4fb6-817e-b6fc4f510d57 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.301587 Jul 14 14:47:14.913174 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1915/3865] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:47:14 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:14.921758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2056406636", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "05e588dd-ea85-4edc-9918-44620e736097"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:14.996022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] validate_networks() for [('05e588dd-ea85-4edc-9918-44620e736097', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:47:15.121631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d4569c94-abb0-4ca4-8d00-e001dd4a2502 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:15.133111 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d4569c94-abb0-4ca4-8d00-e001dd4a2502 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.295841 Jul 14 14:47:15.147894 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1951/3866] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:14 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:15.172369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-74732165-b784-40d9-8f56-ef685b06741a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:15.185311 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-74732165-b784-40d9-8f56-ef685b06741a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035887 Jul 14 14:47:15.188004 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1952/3867] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:47:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:15.197006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-358a54e3-edb7-4f8c-8c68-9774f1c8ed14 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:15.203037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-358a54e3-edb7-4f8c-8c68-9774f1c8ed14 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:15.211549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-358a54e3-edb7-4f8c-8c68-9774f1c8ed14 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.212390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-358a54e3-edb7-4f8c-8c68-9774f1c8ed14 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.213422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-358a54e3-edb7-4f8c-8c68-9774f1c8ed14 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.214718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-358a54e3-edb7-4f8c-8c68-9774f1c8ed14 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.240538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:15.463704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-358a54e3-edb7-4f8c-8c68-9774f1c8ed14 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:15.472440 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-358a54e3-edb7-4f8c-8c68-9774f1c8ed14 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.283233 Jul 14 14:47:15.473246 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1953/3868] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:15 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:15.496895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-01420277-d092-4bea-8686-da0fa4f89eb6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:15.497696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-01420277-d092-4bea-8686-da0fa4f89eb6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:15.506418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01420277-d092-4bea-8686-da0fa4f89eb6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.506879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01420277-d092-4bea-8686-da0fa4f89eb6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.507660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01420277-d092-4bea-8686-da0fa4f89eb6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.508144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01420277-d092-4bea-8686-da0fa4f89eb6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.540651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-01420277-d092-4bea-8686-da0fa4f89eb6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:47:15.650537 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-01420277-d092-4bea-8686-da0fa4f89eb6 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "DELETE /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 204 len: 0 microversion: 2.1 time: 0.156722 Jul 14 14:47:15.653032 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1954/3869] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:47:15 2022] DELETE /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:47:15.658994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:47:15.659424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:47:15.659934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:47:15.660379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:47:15.660793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:47:15.661120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f9fd7fc-1ab5-4dbb-a59d-d533314f2616 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:15.662008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f9fd7fc-1ab5-4dbb-a59d-d533314f2616 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:15.669055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f9fd7fc-1ab5-4dbb-a59d-d533314f2616 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.669642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f9fd7fc-1ab5-4dbb-a59d-d533314f2616 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.670547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f9fd7fc-1ab5-4dbb-a59d-d533314f2616 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.671742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f9fd7fc-1ab5-4dbb-a59d-d533314f2616 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.672282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.672739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.673582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.674027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.692665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Getting quotas for project 1933006fa13c44ae9128f00267210152. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:15.698763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Getting quotas for user f157150edd1d441aa2c7335dbb2363ca and project 1933006fa13c44ae9128f00267210152. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:15.713131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:47:15.715855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:47:15.773445 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7e9defc6-2976-49f8-bca9-d075bbefab8f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.858877 Jul 14 14:47:15.774672 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1916/3870] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:47:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:47:15.785077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-666bd47d-1987-4fe1-ad68-bf2a57eb2d65 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:15.785712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-666bd47d-1987-4fe1-ad68-bf2a57eb2d65 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:15.886943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-666bd47d-1987-4fe1-ad68-bf2a57eb2d65 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:15.904603 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-666bd47d-1987-4fe1-ad68-bf2a57eb2d65 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1215 microversion: 2.1 time: 0.117417 Jul 14 14:47:15.911091 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1917/3871] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:15 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:15.932411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f9fd7fc-1ab5-4dbb-a59d-d533314f2616 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:15.934775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1a647609-09ea-463f-a714-6670d143cecd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:15.935532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1a647609-09ea-463f-a714-6670d143cecd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:15.943046 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f9fd7fc-1ab5-4dbb-a59d-d533314f2616 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1713 microversion: 2.1 time: 0.287163 Jul 14 14:47:15.945981 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1955/3872] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:15 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1713 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:15.946843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1a647609-09ea-463f-a714-6670d143cecd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.948113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1a647609-09ea-463f-a714-6670d143cecd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.949144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1a647609-09ea-463f-a714-6670d143cecd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.949719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1a647609-09ea-463f-a714-6670d143cecd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.038279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1a647609-09ea-463f-a714-6670d143cecd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:16.060002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1a647609-09ea-463f-a714-6670d143cecd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:16.061973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1a647609-09ea-463f-a714-6670d143cecd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:16.063533 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1a647609-09ea-463f-a714-6670d143cecd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.153216 Jul 14 14:47:16.064581 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1918/3873] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:15 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:16.153814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-63244026-a299-415e-b99b-754544664b22 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:16.154484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-63244026-a299-415e-b99b-754544664b22 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:16.162683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63244026-a299-415e-b99b-754544664b22 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.163190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63244026-a299-415e-b99b-754544664b22 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.164040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63244026-a299-415e-b99b-754544664b22 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.164477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63244026-a299-415e-b99b-754544664b22 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.346673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-63244026-a299-415e-b99b-754544664b22 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:16.356179 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-63244026-a299-415e-b99b-754544664b22 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.208368 Jul 14 14:47:16.356658 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1956/3874] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:16 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:16.492081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-639df3c9-f79d-419e-bfd0-db844eb793e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:16.492999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-639df3c9-f79d-419e-bfd0-db844eb793e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:16.504298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-639df3c9-f79d-419e-bfd0-db844eb793e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.505319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-639df3c9-f79d-419e-bfd0-db844eb793e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.506872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-639df3c9-f79d-419e-bfd0-db844eb793e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.507868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-639df3c9-f79d-419e-bfd0-db844eb793e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.739783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-639df3c9-f79d-419e-bfd0-db844eb793e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:16.753445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:16.757337 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-639df3c9-f79d-419e-bfd0-db844eb793e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.271068 Jul 14 14:47:16.763425 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1919/3875] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:16 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:16.923322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7121a4ed-85c0-41ae-9bd1-d298c19477dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:16.924006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7121a4ed-85c0-41ae-9bd1-d298c19477dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:16.930231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7121a4ed-85c0-41ae-9bd1-d298c19477dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.930876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7121a4ed-85c0-41ae-9bd1-d298c19477dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.932000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7121a4ed-85c0-41ae-9bd1-d298c19477dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.932609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7121a4ed-85c0-41ae-9bd1-d298c19477dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.969259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba720117-a103-43fd-98fa-33347ebeac02 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:16.970130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ba720117-a103-43fd-98fa-33347ebeac02 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:16.977429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba720117-a103-43fd-98fa-33347ebeac02 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.978093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba720117-a103-43fd-98fa-33347ebeac02 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.979225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba720117-a103-43fd-98fa-33347ebeac02 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.979828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba720117-a103-43fd-98fa-33347ebeac02 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.010812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7121a4ed-85c0-41ae-9bd1-d298c19477dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:17.022695 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7121a4ed-85c0-41ae-9bd1-d298c19477dd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1219 microversion: 2.1 time: 0.103807 Jul 14 14:47:17.023587 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1957/3876] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:16 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:17.083144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-03f170b3-2e40-43c1-aa03-0a0237b6a707 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:17.084073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-03f170b3-2e40-43c1-aa03-0a0237b6a707 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:17.094552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03f170b3-2e40-43c1-aa03-0a0237b6a707 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:17.095356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03f170b3-2e40-43c1-aa03-0a0237b6a707 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.097637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03f170b3-2e40-43c1-aa03-0a0237b6a707 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:17.099126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03f170b3-2e40-43c1-aa03-0a0237b6a707 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.198982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-03f170b3-2e40-43c1-aa03-0a0237b6a707 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:17.211947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-03f170b3-2e40-43c1-aa03-0a0237b6a707 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:17.214435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-03f170b3-2e40-43c1-aa03-0a0237b6a707 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:17.216271 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-03f170b3-2e40-43c1-aa03-0a0237b6a707 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.137187 Jul 14 14:47:17.231423 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1958/3877] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:17 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:17.291456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ba720117-a103-43fd-98fa-33347ebeac02 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:17.301790 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ba720117-a103-43fd-98fa-33347ebeac02 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1713 microversion: 2.1 time: 0.336316 Jul 14 14:47:17.302998 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1920/3878] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:16 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1713 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:17.375588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ba3ad4d7-5f65-4549-b05b-be1bdc272753 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:17.376496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ba3ad4d7-5f65-4549-b05b-be1bdc272753 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:17.384444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba3ad4d7-5f65-4549-b05b-be1bdc272753 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:17.385035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba3ad4d7-5f65-4549-b05b-be1bdc272753 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.385855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba3ad4d7-5f65-4549-b05b-be1bdc272753 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:17.386363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba3ad4d7-5f65-4549-b05b-be1bdc272753 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.568821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba3ad4d7-5f65-4549-b05b-be1bdc272753 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:17.578415 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ba3ad4d7-5f65-4549-b05b-be1bdc272753 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.206939 Jul 14 14:47:17.579333 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1959/3879] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:17 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:17.778712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a67f2ed3-f24b-4c95-8e57-3caecbcc4dcc tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:17.780834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a67f2ed3-f24b-4c95-8e57-3caecbcc4dcc tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:17.794204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a67f2ed3-f24b-4c95-8e57-3caecbcc4dcc tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:17.804673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a67f2ed3-f24b-4c95-8e57-3caecbcc4dcc tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.808711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a67f2ed3-f24b-4c95-8e57-3caecbcc4dcc tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:17.817639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a67f2ed3-f24b-4c95-8e57-3caecbcc4dcc tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.039916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a751241-a2e0-478f-9ae1-2f16d589452e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:18.040608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0a751241-a2e0-478f-9ae1-2f16d589452e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:18.053464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a751241-a2e0-478f-9ae1-2f16d589452e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.053996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a751241-a2e0-478f-9ae1-2f16d589452e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.057438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a751241-a2e0-478f-9ae1-2f16d589452e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.057963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a751241-a2e0-478f-9ae1-2f16d589452e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.164103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0a751241-a2e0-478f-9ae1-2f16d589452e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:18.168590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a67f2ed3-f24b-4c95-8e57-3caecbcc4dcc tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:18.178939 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a67f2ed3-f24b-4c95-8e57-3caecbcc4dcc tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.405118 Jul 14 14:47:18.184176 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1921/3880] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:17 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:18.188884 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0a751241-a2e0-478f-9ae1-2f16d589452e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1273 microversion: 2.1 time: 0.152690 Jul 14 14:47:18.190169 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1960/3881] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:18 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:18.241136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6343d3e9-4382-4488-b799-fb348d5ae1dd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:18.242366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6343d3e9-4382-4488-b799-fb348d5ae1dd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:18.256450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6343d3e9-4382-4488-b799-fb348d5ae1dd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.257243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6343d3e9-4382-4488-b799-fb348d5ae1dd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.258268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6343d3e9-4382-4488-b799-fb348d5ae1dd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.258872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6343d3e9-4382-4488-b799-fb348d5ae1dd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.320516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-01ce261f-36a0-4a80-8da0-062cfc41dd59 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:18.321556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-01ce261f-36a0-4a80-8da0-062cfc41dd59 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:18.329319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01ce261f-36a0-4a80-8da0-062cfc41dd59 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.330140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01ce261f-36a0-4a80-8da0-062cfc41dd59 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.331162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01ce261f-36a0-4a80-8da0-062cfc41dd59 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.331824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01ce261f-36a0-4a80-8da0-062cfc41dd59 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.358404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6343d3e9-4382-4488-b799-fb348d5ae1dd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:18.373401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6343d3e9-4382-4488-b799-fb348d5ae1dd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:18.375340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6343d3e9-4382-4488-b799-fb348d5ae1dd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:18.377574 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6343d3e9-4382-4488-b799-fb348d5ae1dd tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.142699 Jul 14 14:47:18.390411 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1922/3882] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:18 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:18.552498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-01ce261f-36a0-4a80-8da0-062cfc41dd59 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:18.562483 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-01ce261f-36a0-4a80-8da0-062cfc41dd59 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1713 microversion: 2.1 time: 0.245989 Jul 14 14:47:18.565673 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1961/3883] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:18 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1713 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:18.597959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7749ca67-5a7d-4dc6-8b88-5b70bea81ccc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:18.599281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7749ca67-5a7d-4dc6-8b88-5b70bea81ccc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:18.623195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7749ca67-5a7d-4dc6-8b88-5b70bea81ccc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.642875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7749ca67-5a7d-4dc6-8b88-5b70bea81ccc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.645137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7749ca67-5a7d-4dc6-8b88-5b70bea81ccc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.649264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7749ca67-5a7d-4dc6-8b88-5b70bea81ccc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.059904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7749ca67-5a7d-4dc6-8b88-5b70bea81ccc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:19.082002 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7749ca67-5a7d-4dc6-8b88-5b70bea81ccc tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.489724 Jul 14 14:47:19.082772 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1923/3884] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:18 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:19.122630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-743a1c79-27b0-4e9f-83d5-6aa192202321 req-64a7a457-8952-458f-b643-f4c73917e0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250e7cb6-ef8b-473e-9970-fac746383e79", "name": "network-vif-deleted", "tag": "a025cf07-45d2-4d40-84e6-40195c60a368"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:19.154482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-743a1c79-27b0-4e9f-83d5-6aa192202321 req-64a7a457-8952-458f-b643-f4c73917e0c8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.155346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-743a1c79-27b0-4e9f-83d5-6aa192202321 req-64a7a457-8952-458f-b643-f4c73917e0c8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.175589 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-743a1c79-27b0-4e9f-83d5-6aa192202321 req-64a7a457-8952-458f-b643-f4c73917e0c8 service nova] Creating event network-vif-deleted:a025cf07-45d2-4d40-84e6-40195c60a368 for instance 250e7cb6-ef8b-473e-9970-fac746383e79 on n-h2-767704-28 Jul 14 14:47:19.183707 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-743a1c79-27b0-4e9f-83d5-6aa192202321 req-64a7a457-8952-458f-b643-f4c73917e0c8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065473 Jul 14 14:47:19.185434 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1962/3885] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:19.201017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aa81dad6-7961-42a0-b27d-0319f156f844 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:19.201017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aa81dad6-7961-42a0-b27d-0319f156f844 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:19.210056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2d780165-e8a6-419e-a8bc-18a2a8d7c78e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:19.211112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2d780165-e8a6-419e-a8bc-18a2a8d7c78e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:19.213726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa81dad6-7961-42a0-b27d-0319f156f844 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.220037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa81dad6-7961-42a0-b27d-0319f156f844 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.220915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa81dad6-7961-42a0-b27d-0319f156f844 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.222014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d780165-e8a6-419e-a8bc-18a2a8d7c78e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.222630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d780165-e8a6-419e-a8bc-18a2a8d7c78e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.223579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d780165-e8a6-419e-a8bc-18a2a8d7c78e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.224175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d780165-e8a6-419e-a8bc-18a2a8d7c78e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.224741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa81dad6-7961-42a0-b27d-0319f156f844 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.761411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aa81dad6-7961-42a0-b27d-0319f156f844 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:19.775559 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aa81dad6-7961-42a0-b27d-0319f156f844 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.579624 Jul 14 14:47:19.777322 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1924/3886] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:19 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:19.782436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2d780165-e8a6-419e-a8bc-18a2a8d7c78e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:19.805780 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2d780165-e8a6-419e-a8bc-18a2a8d7c78e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1315 microversion: 2.1 time: 0.600577 Jul 14 14:47:19.806387 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1963/3887] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:19 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:19.819864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-008804b8-ce0f-4462-9c86-f6a752ebbe0a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:19.820487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-008804b8-ce0f-4462-9c86-f6a752ebbe0a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:19.821220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1804ccbe-7440-407f-917f-d24f35ec3ec1 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:19.822613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1804ccbe-7440-407f-917f-d24f35ec3ec1 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:19.842816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-008804b8-ce0f-4462-9c86-f6a752ebbe0a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.843509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-008804b8-ce0f-4462-9c86-f6a752ebbe0a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.844309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-008804b8-ce0f-4462-9c86-f6a752ebbe0a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.846519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1804ccbe-7440-407f-917f-d24f35ec3ec1 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.846976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1804ccbe-7440-407f-917f-d24f35ec3ec1 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.847910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1804ccbe-7440-407f-917f-d24f35ec3ec1 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.848214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1804ccbe-7440-407f-917f-d24f35ec3ec1 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.859593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-008804b8-ce0f-4462-9c86-f6a752ebbe0a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.002900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-008804b8-ce0f-4462-9c86-f6a752ebbe0a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.015188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-008804b8-ce0f-4462-9c86-f6a752ebbe0a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.015734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-008804b8-ce0f-4462-9c86-f6a752ebbe0a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lazy-loading 'fault' on Instance uuid 250e7cb6-ef8b-473e-9970-fac746383e79 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:47:20.086288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1804ccbe-7440-407f-917f-d24f35ec3ec1 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:20.102460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1804ccbe-7440-407f-917f-d24f35ec3ec1 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:20.109146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1804ccbe-7440-407f-917f-d24f35ec3ec1 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:20.112325 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1804ccbe-7440-407f-917f-d24f35ec3ec1 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.332853 Jul 14 14:47:20.116271 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1925/3888] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:19 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:20.127757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-5ef9d1c7-4571-4b22-a1a0-31187bde2af8 req-8e9a0857-e1cf-4278-b555-b495c6d138f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be684ea-99fc-4c45-86e4-52e39f39a2b6", "tag": "b7327c3d-0492-4493-b434-a4db3c983c3d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:20.142473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-008804b8-ce0f-4462-9c86-f6a752ebbe0a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720e745e38745938de5898f5fad4afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637fe6bfb48642b5b2ac60a5e03e26ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:20.148321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5ef9d1c7-4571-4b22-a1a0-31187bde2af8 req-8e9a0857-e1cf-4278-b555-b495c6d138f5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.149600 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-008804b8-ce0f-4462-9c86-f6a752ebbe0a tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 200 len: 1366 microversion: 2.1 time: 0.333936 Jul 14 14:47:20.150554 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1964/3889] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:19 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:20.157621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5ef9d1c7-4571-4b22-a1a0-31187bde2af8 req-8e9a0857-e1cf-4278-b555-b495c6d138f5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.164479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-981b2267-080b-48d7-8347-a9f54204a62f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.165373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-981b2267-080b-48d7-8347-a9f54204a62f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:20.169020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:20.184009 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-5ef9d1c7-4571-4b22-a1a0-31187bde2af8 req-8e9a0857-e1cf-4278-b555-b495c6d138f5 service nova] Creating event network-changed:b7327c3d-0492-4493-b434-a4db3c983c3d for instance 4be684ea-99fc-4c45-86e4-52e39f39a2b6 on n-h2-767704-28 Jul 14 14:47:20.184872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-981b2267-080b-48d7-8347-a9f54204a62f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.186209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-981b2267-080b-48d7-8347-a9f54204a62f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.187885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-981b2267-080b-48d7-8347-a9f54204a62f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.188332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-981b2267-080b-48d7-8347-a9f54204a62f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.203187 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-5ef9d1c7-4571-4b22-a1a0-31187bde2af8 req-8e9a0857-e1cf-4278-b555-b495c6d138f5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084972 Jul 14 14:47:20.208822 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1926/3890] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:20.439519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-981b2267-080b-48d7-8347-a9f54204a62f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:20.449350 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-981b2267-080b-48d7-8347-a9f54204a62f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.297147 Jul 14 14:47:20.449940 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1965/3891] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:20 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:20.794764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1750298f-d91e-4ee2-a2db-6f02687cdb3a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.796873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1750298f-d91e-4ee2-a2db-6f02687cdb3a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:20.804545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1750298f-d91e-4ee2-a2db-6f02687cdb3a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.805011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1750298f-d91e-4ee2-a2db-6f02687cdb3a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.806095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1750298f-d91e-4ee2-a2db-6f02687cdb3a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.806725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1750298f-d91e-4ee2-a2db-6f02687cdb3a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.837885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f3c97bd4-34bb-4948-b393-789f9425ff2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.851769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f3c97bd4-34bb-4948-b393-789f9425ff2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:20.859822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3c97bd4-34bb-4948-b393-789f9425ff2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.860566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3c97bd4-34bb-4948-b393-789f9425ff2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.861612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3c97bd4-34bb-4948-b393-789f9425ff2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.862255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3c97bd4-34bb-4948-b393-789f9425ff2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.128786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1750298f-d91e-4ee2-a2db-6f02687cdb3a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:21.137856 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1750298f-d91e-4ee2-a2db-6f02687cdb3a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.348379 Jul 14 14:47:21.142376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f3c97bd4-34bb-4948-b393-789f9425ff2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:21.146884 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1927/3892] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:20 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:21.152373 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f3c97bd4-34bb-4948-b393-789f9425ff2e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1315 microversion: 2.1 time: 0.332386 Jul 14 14:47:21.153188 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1966/3893] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:20 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:21.160090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2c746db2-07f6-4ad8-8a9f-fcd0a8f30d23 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:21.160788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2c746db2-07f6-4ad8-8a9f-fcd0a8f30d23 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:21.167627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ca0f00e-00eb-4710-85cf-0ca362781ea5 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:21.168595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6ca0f00e-00eb-4710-85cf-0ca362781ea5 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] [instance: 250e7cb6-ef8b-473e-9970-fac746383e79] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:21.170157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c746db2-07f6-4ad8-8a9f-fcd0a8f30d23 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.170745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c746db2-07f6-4ad8-8a9f-fcd0a8f30d23 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.172179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c746db2-07f6-4ad8-8a9f-fcd0a8f30d23 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.172829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c746db2-07f6-4ad8-8a9f-fcd0a8f30d23 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.177395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ca0f00e-00eb-4710-85cf-0ca362781ea5 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.177860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ca0f00e-00eb-4710-85cf-0ca362781ea5 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.179144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ca0f00e-00eb-4710-85cf-0ca362781ea5 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.179770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ca0f00e-00eb-4710-85cf-0ca362781ea5 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.204286 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-6ca0f00e-00eb-4710-85cf-0ca362781ea5 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] HTTP exception thrown: Instance 250e7cb6-ef8b-473e-9970-fac746383e79 could not be found. Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ca0f00e-00eb-4710-85cf-0ca362781ea5 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Request method failure captured: Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 HTTP/1.1 Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cwwghq_owbdB-gcqTPZ46_kp_rXNaYRhELHBBJTibowZ5Y2Tc-9SlZ2rejfATyI-RRcpR7wbPGB02XTaZ1vA4Tc0g5ncKGce9CgOke7VwNxbZwZu3oQWgc_blGCdWt7gHN-AzQoRDU8M_9Z_6YGkqRFMdOsWRXgjazAjl8KgOGbB3Y Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 637fe6bfb48642b5b2ac60a5e03e26ef Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestManualDisk-199550976 Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/637fe6bfb48642b5b2ac60a5e03e26ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/637fe6bfb48642b5b2ac60a5e03e26ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_637fe6bfb48642b5b2ac60a5e03e26ef", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/637fe6bfb48642b5b2ac60a5e03e26ef"}]}] Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestManualDisk-199550976 Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 637fe6bfb48642b5b2ac60a5e03e26ef Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestManualDisk-199550976 Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestManualDisk-199550976-project Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: b720e745e38745938de5898f5fad4afb Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestManualDisk-199550976-project Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 250e7cb6-ef8b-473e-9970-fac746383e79 could not be found. Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '250e7cb6-ef8b-473e-9970-fac746383e79'} Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250e7cb6-ef8b-473e-9970-fac746383e79 could not be found. Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250e7cb6-ef8b-473e-9970-fac746383e79 could not be found. Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:21.206406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:47:21.211247 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:21.211247 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:21.211247 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:21.211247 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:21.211247 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:21.211247 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250e7cb6-ef8b-473e-9970-fac746383e79 could not be found. Jul 14 14:47:21.211247 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:47:21.212727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ca0f00e-00eb-4710-85cf-0ca362781ea5 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Returning 404 to user: Instance 250e7cb6-ef8b-473e-9970-fac746383e79 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:21.213944 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6ca0f00e-00eb-4710-85cf-0ca362781ea5 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79" status: 404 len: 111 microversion: 2.1 time: 0.050231 Jul 14 14:47:21.218690 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1967/3894] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:21 2022] GET /compute/v2.1/servers/250e7cb6-ef8b-473e-9970-fac746383e79 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:47:21.226942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4c9528cc-cd1a-4fa5-b1b5-4be2b07b6f21 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] Calling method '.version_select at 0x7fd6c4ec7700>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:21.251754 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4c9528cc-cd1a-4fa5-b1b5-4be2b07b6f21 tempest-ServersTestManualDisk-199550976 tempest-ServersTestManualDisk-199550976-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-850479952" status: 202 len: 0 microversion: 2.1 time: 0.028550 Jul 14 14:47:21.254647 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1968/3895] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jul 14 14:47:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-850479952 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:47:21.264299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2c746db2-07f6-4ad8-8a9f-fcd0a8f30d23 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:21.278790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2c746db2-07f6-4ad8-8a9f-fcd0a8f30d23 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:21.281194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2c746db2-07f6-4ad8-8a9f-fcd0a8f30d23 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:21.282673 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2c746db2-07f6-4ad8-8a9f-fcd0a8f30d23 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.135180 Jul 14 14:47:21.283244 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1928/3896] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:21 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:21.467336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ee38c51d-ba83-4e31-b32a-0251b0858d20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:21.468529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ee38c51d-ba83-4e31-b32a-0251b0858d20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:21.477160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee38c51d-ba83-4e31-b32a-0251b0858d20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.477619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee38c51d-ba83-4e31-b32a-0251b0858d20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.478588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee38c51d-ba83-4e31-b32a-0251b0858d20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.479271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee38c51d-ba83-4e31-b32a-0251b0858d20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.647483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ee38c51d-ba83-4e31-b32a-0251b0858d20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:21.656908 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ee38c51d-ba83-4e31-b32a-0251b0858d20 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.193558 Jul 14 14:47:21.657774 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1969/3897] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:21 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:22.168081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed6bc207-3764-440d-8494-1b04130299c7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:22.168081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ed6bc207-3764-440d-8494-1b04130299c7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:22.170772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0d362136-1f2c-4899-8aba-d30a1d3d9aad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:22.171241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0d362136-1f2c-4899-8aba-d30a1d3d9aad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:22.180136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed6bc207-3764-440d-8494-1b04130299c7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.180603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed6bc207-3764-440d-8494-1b04130299c7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.181472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed6bc207-3764-440d-8494-1b04130299c7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.181883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed6bc207-3764-440d-8494-1b04130299c7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.187416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d362136-1f2c-4899-8aba-d30a1d3d9aad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.188173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d362136-1f2c-4899-8aba-d30a1d3d9aad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.189190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d362136-1f2c-4899-8aba-d30a1d3d9aad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.189802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d362136-1f2c-4899-8aba-d30a1d3d9aad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.228876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:22.648739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d362136-1f2c-4899-8aba-d30a1d3d9aad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:22.651263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ed6bc207-3764-440d-8494-1b04130299c7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:22.659869 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0d362136-1f2c-4899-8aba-d30a1d3d9aad tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1315 microversion: 2.1 time: 0.493117 Jul 14 14:47:22.660449 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed6bc207-3764-440d-8494-1b04130299c7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.507064 Jul 14 14:47:22.663957 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1929/3898] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:22 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:22.669895 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1970/3899] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:22 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:22.670456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dab972ea-33d4-4cca-8718-009050822cd6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:22.676718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05d3bc23-d69b-47e0-9324-e50aaed19ada tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:22.677555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-05d3bc23-d69b-47e0-9324-e50aaed19ada tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:22.681466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dab972ea-33d4-4cca-8718-009050822cd6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:22.683909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05d3bc23-d69b-47e0-9324-e50aaed19ada tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.684633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05d3bc23-d69b-47e0-9324-e50aaed19ada tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.685673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05d3bc23-d69b-47e0-9324-e50aaed19ada tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.686321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05d3bc23-d69b-47e0-9324-e50aaed19ada tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.694799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dab972ea-33d4-4cca-8718-009050822cd6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.696862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dab972ea-33d4-4cca-8718-009050822cd6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.698007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dab972ea-33d4-4cca-8718-009050822cd6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.698456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dab972ea-33d4-4cca-8718-009050822cd6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:23.338160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dab972ea-33d4-4cca-8718-009050822cd6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:23.364533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dab972ea-33d4-4cca-8718-009050822cd6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:23.369663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dab972ea-33d4-4cca-8718-009050822cd6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:23.371567 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dab972ea-33d4-4cca-8718-009050822cd6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1409 microversion: 2.54 time: 0.704925 Jul 14 14:47:23.376797 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1930/3900] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:22 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1409 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:23.413698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-05d3bc23-d69b-47e0-9324-e50aaed19ada tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:23.428253 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-05d3bc23-d69b-47e0-9324-e50aaed19ada tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.755291 Jul 14 14:47:23.428869 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1971/3901] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:22 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:23.681436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d9c4773a-bd08-499b-8c9f-930d6392b5cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:23.681692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-59fb3b01-6da1-4aec-bcb0-6a3fd5b592b7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:23.682145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-59fb3b01-6da1-4aec-bcb0-6a3fd5b592b7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:23.683174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d9c4773a-bd08-499b-8c9f-930d6392b5cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:23.692720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59fb3b01-6da1-4aec-bcb0-6a3fd5b592b7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:23.693211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59fb3b01-6da1-4aec-bcb0-6a3fd5b592b7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:23.695365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9c4773a-bd08-499b-8c9f-930d6392b5cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:23.696758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9c4773a-bd08-499b-8c9f-930d6392b5cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:23.697976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59fb3b01-6da1-4aec-bcb0-6a3fd5b592b7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:23.698757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59fb3b01-6da1-4aec-bcb0-6a3fd5b592b7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:23.699589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9c4773a-bd08-499b-8c9f-930d6392b5cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:23.700277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9c4773a-bd08-499b-8c9f-930d6392b5cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:23.974937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-59fb3b01-6da1-4aec-bcb0-6a3fd5b592b7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:23.986958 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-59fb3b01-6da1-4aec-bcb0-6a3fd5b592b7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.309439 Jul 14 14:47:23.987548 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1972/3902] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:23 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:24.010925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d9c4773a-bd08-499b-8c9f-930d6392b5cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:24.022630 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d9c4773a-bd08-499b-8c9f-930d6392b5cf tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1315 microversion: 2.1 time: 0.347119 Jul 14 14:47:24.023236 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1931/3903] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:23 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:24.401468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5cb7ffbf-da38-4573-a314-bbae23d72725 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:24.402328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5cb7ffbf-da38-4573-a314-bbae23d72725 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:24.414337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5cb7ffbf-da38-4573-a314-bbae23d72725 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:24.415027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5cb7ffbf-da38-4573-a314-bbae23d72725 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:24.415763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5cb7ffbf-da38-4573-a314-bbae23d72725 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:24.416912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5cb7ffbf-da38-4573-a314-bbae23d72725 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:24.447166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9116368f-1a3b-42b5-989e-1e1acf888e79 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:24.448564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9116368f-1a3b-42b5-989e-1e1acf888e79 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:24.472194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9116368f-1a3b-42b5-989e-1e1acf888e79 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:24.476294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9116368f-1a3b-42b5-989e-1e1acf888e79 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:24.478055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9116368f-1a3b-42b5-989e-1e1acf888e79 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:24.479805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9116368f-1a3b-42b5-989e-1e1acf888e79 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:24.528645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5cb7ffbf-da38-4573-a314-bbae23d72725 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:24.540420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5cb7ffbf-da38-4573-a314-bbae23d72725 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:24.541976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5cb7ffbf-da38-4573-a314-bbae23d72725 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:24.547728 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5cb7ffbf-da38-4573-a314-bbae23d72725 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1415 microversion: 2.54 time: 0.158969 Jul 14 14:47:24.548315 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1973/3904] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:24 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1415 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:24.881000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9116368f-1a3b-42b5-989e-1e1acf888e79 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:24.895695 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9116368f-1a3b-42b5-989e-1e1acf888e79 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.451261 Jul 14 14:47:24.897734 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1932/3905] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:24 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:25.004114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2af6756e-d5c1-4321-9e60-a2d7e0e3b968 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:25.004973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2af6756e-d5c1-4321-9e60-a2d7e0e3b968 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:25.023360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2af6756e-d5c1-4321-9e60-a2d7e0e3b968 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.024148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2af6756e-d5c1-4321-9e60-a2d7e0e3b968 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.025190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2af6756e-d5c1-4321-9e60-a2d7e0e3b968 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.027060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2af6756e-d5c1-4321-9e60-a2d7e0e3b968 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.040367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bb411c55-a28f-4ec2-9eb8-b7e613c2ebfb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:25.041203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bb411c55-a28f-4ec2-9eb8-b7e613c2ebfb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:25.056247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb411c55-a28f-4ec2-9eb8-b7e613c2ebfb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.057014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb411c55-a28f-4ec2-9eb8-b7e613c2ebfb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.060888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb411c55-a28f-4ec2-9eb8-b7e613c2ebfb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.063281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb411c55-a28f-4ec2-9eb8-b7e613c2ebfb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.438378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2af6756e-d5c1-4321-9e60-a2d7e0e3b968 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:25.447776 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2af6756e-d5c1-4321-9e60-a2d7e0e3b968 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.447402 Jul 14 14:47:25.461552 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1974/3906] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:24 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:25.485046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bb411c55-a28f-4ec2-9eb8-b7e613c2ebfb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:25.488457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-96106ddc-9ba4-4102-a9e4-898957200370 req-850d687a-d70a-4c5a-ac25-99d5a6f08f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be684ea-99fc-4c45-86e4-52e39f39a2b6", "name": "network-vif-plugged", "status": "completed", "tag": "b7327c3d-0492-4493-b434-a4db3c983c3d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:25.497916 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bb411c55-a28f-4ec2-9eb8-b7e613c2ebfb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1315 microversion: 2.1 time: 0.460806 Jul 14 14:47:25.498538 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1933/3907] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:25 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:25.509480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-96106ddc-9ba4-4102-a9e4-898957200370 req-850d687a-d70a-4c5a-ac25-99d5a6f08f66 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.510159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-96106ddc-9ba4-4102-a9e4-898957200370 req-850d687a-d70a-4c5a-ac25-99d5a6f08f66 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.536849 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-96106ddc-9ba4-4102-a9e4-898957200370 req-850d687a-d70a-4c5a-ac25-99d5a6f08f66 service nova] Creating event network-vif-plugged:b7327c3d-0492-4493-b434-a4db3c983c3d for instance 4be684ea-99fc-4c45-86e4-52e39f39a2b6 on n-h2-767704-28 Jul 14 14:47:25.542348 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-96106ddc-9ba4-4102-a9e4-898957200370 req-850d687a-d70a-4c5a-ac25-99d5a6f08f66 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078328 Jul 14 14:47:25.543767 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1975/3908] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:25.566895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fd857d19-1cc1-49c1-8d93-1d5ac165f905 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:25.567515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fd857d19-1cc1-49c1-8d93-1d5ac165f905 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:25.579917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd857d19-1cc1-49c1-8d93-1d5ac165f905 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.580374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd857d19-1cc1-49c1-8d93-1d5ac165f905 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.581192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd857d19-1cc1-49c1-8d93-1d5ac165f905 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.581637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd857d19-1cc1-49c1-8d93-1d5ac165f905 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.681977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:25.696008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fd857d19-1cc1-49c1-8d93-1d5ac165f905 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:25.713497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fd857d19-1cc1-49c1-8d93-1d5ac165f905 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:25.715238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fd857d19-1cc1-49c1-8d93-1d5ac165f905 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:25.716466 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fd857d19-1cc1-49c1-8d93-1d5ac165f905 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1415 microversion: 2.54 time: 0.153583 Jul 14 14:47:25.717381 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1934/3909] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:25 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1415 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:25.915717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-791b856a-27b2-4a9c-a47b-b044982065e3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:25.916429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-791b856a-27b2-4a9c-a47b-b044982065e3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:25.938238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-791b856a-27b2-4a9c-a47b-b044982065e3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.938939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-791b856a-27b2-4a9c-a47b-b044982065e3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.940721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-791b856a-27b2-4a9c-a47b-b044982065e3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.941208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-791b856a-27b2-4a9c-a47b-b044982065e3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:26.255788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-791b856a-27b2-4a9c-a47b-b044982065e3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:26.279204 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-791b856a-27b2-4a9c-a47b-b044982065e3 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.368397 Jul 14 14:47:26.291700 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1976/3910] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:25 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:26.466420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cbc3ac61-105e-4c46-a586-e6cfa4319860 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:26.467819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cbc3ac61-105e-4c46-a586-e6cfa4319860 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:26.472798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=10 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:26.484839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cbc3ac61-105e-4c46-a586-e6cfa4319860 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:26.485328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cbc3ac61-105e-4c46-a586-e6cfa4319860 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:26.486122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cbc3ac61-105e-4c46-a586-e6cfa4319860 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:26.486955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cbc3ac61-105e-4c46-a586-e6cfa4319860 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:26.527884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-677274de-379b-4953-a441-89ca1fa8b28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:26.528532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-677274de-379b-4953-a441-89ca1fa8b28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:26.545258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-677274de-379b-4953-a441-89ca1fa8b28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:26.545818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-677274de-379b-4953-a441-89ca1fa8b28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:26.547089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-677274de-379b-4953-a441-89ca1fa8b28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:26.547537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-677274de-379b-4953-a441-89ca1fa8b28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:26.894694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-677274de-379b-4953-a441-89ca1fa8b28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:26.898881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cbc3ac61-105e-4c46-a586-e6cfa4319860 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:26.902917 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-677274de-379b-4953-a441-89ca1fa8b28d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1315 microversion: 2.1 time: 0.388918 Jul 14 14:47:26.903504 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1977/3911] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:26 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:26.917217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-51abdd75-049b-4dae-9319-e8be075165ec tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:26.918746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-51abdd75-049b-4dae-9319-e8be075165ec tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:26.924234 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cbc3ac61-105e-4c46-a586-e6cfa4319860 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.461856 Jul 14 14:47:26.926667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51abdd75-049b-4dae-9319-e8be075165ec tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:26.927366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51abdd75-049b-4dae-9319-e8be075165ec tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:26.928368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51abdd75-049b-4dae-9319-e8be075165ec tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:26.929031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51abdd75-049b-4dae-9319-e8be075165ec tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:26.939074 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1935/3912] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:26 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:27.012343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-51abdd75-049b-4dae-9319-e8be075165ec tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:27.022245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-51abdd75-049b-4dae-9319-e8be075165ec tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:27.024042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-51abdd75-049b-4dae-9319-e8be075165ec tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:27.025323 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-51abdd75-049b-4dae-9319-e8be075165ec tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1400 microversion: 2.54 time: 0.120668 Jul 14 14:47:27.025861 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1978/3913] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:26 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1400 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:27.043890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bbda5ff1-54c7-43d7-9169-c915700c04f2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '.version_select at 0x7fd6c8311c10>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:27.097685 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bbda5ff1-54c7-43d7-9169-c915700c04f2 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2120089158" status: 204 len: 0 microversion: 2.54 time: 0.057644 Jul 14 14:47:27.103058 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1936/3914] 10.222.0.81 () {60 vars in 1318 bytes} [Thu Jul 14 14:47:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2120089158 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:47:27.121794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ed9afdb2-8020-454e-bd29-92a8c9558e6d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:27.122453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ed9afdb2-8020-454e-bd29-92a8c9558e6d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:27.140382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed9afdb2-8020-454e-bd29-92a8c9558e6d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.141293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed9afdb2-8020-454e-bd29-92a8c9558e6d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.142786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed9afdb2-8020-454e-bd29-92a8c9558e6d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.145208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed9afdb2-8020-454e-bd29-92a8c9558e6d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.226417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ed9afdb2-8020-454e-bd29-92a8c9558e6d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:47:27.299983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-79a46762-a100-4fde-8527-a0d4407f7a74 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:27.301482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-79a46762-a100-4fde-8527-a0d4407f7a74 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:27.323980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79a46762-a100-4fde-8527-a0d4407f7a74 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.324643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79a46762-a100-4fde-8527-a0d4407f7a74 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.328291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79a46762-a100-4fde-8527-a0d4407f7a74 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.329034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79a46762-a100-4fde-8527-a0d4407f7a74 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.346319 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ed9afdb2-8020-454e-bd29-92a8c9558e6d tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "DELETE /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 204 len: 0 microversion: 2.54 time: 0.228598 Jul 14 14:47:27.351972 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1979/3915] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:47:27 2022] DELETE /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:47:27.359810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f734a021-d30f-46c0-8786-dbc455229233 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:27.360907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f734a021-d30f-46c0-8786-dbc455229233 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:27.370147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f734a021-d30f-46c0-8786-dbc455229233 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.371122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f734a021-d30f-46c0-8786-dbc455229233 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.372810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f734a021-d30f-46c0-8786-dbc455229233 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.374351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f734a021-d30f-46c0-8786-dbc455229233 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.501286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f734a021-d30f-46c0-8786-dbc455229233 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:27.514890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f734a021-d30f-46c0-8786-dbc455229233 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:27.517603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f734a021-d30f-46c0-8786-dbc455229233 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:27.518852 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f734a021-d30f-46c0-8786-dbc455229233 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1406 microversion: 2.54 time: 0.164834 Jul 14 14:47:27.522735 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1980/3916] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:27 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:27.820713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-79a46762-a100-4fde-8527-a0d4407f7a74 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:27.856527 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-79a46762-a100-4fde-8527-a0d4407f7a74 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.564067 Jul 14 14:47:27.863199 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1937/3917] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:27 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:27.919911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b50c748-e7df-4445-9072-8b83e15ef926 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:27.920514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3b50c748-e7df-4445-9072-8b83e15ef926 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:27.936286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b50c748-e7df-4445-9072-8b83e15ef926 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.936877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b50c748-e7df-4445-9072-8b83e15ef926 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.938355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b50c748-e7df-4445-9072-8b83e15ef926 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.938807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b50c748-e7df-4445-9072-8b83e15ef926 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.942393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-85a8605a-958b-4e85-b16c-0421dfb4fa67 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:27.943207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-85a8605a-958b-4e85-b16c-0421dfb4fa67 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:27.946655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:27.978203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85a8605a-958b-4e85-b16c-0421dfb4fa67 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.978667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85a8605a-958b-4e85-b16c-0421dfb4fa67 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.979503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85a8605a-958b-4e85-b16c-0421dfb4fa67 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.986983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85a8605a-958b-4e85-b16c-0421dfb4fa67 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:28.065141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:28.627965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-85a8605a-958b-4e85-b16c-0421dfb4fa67 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:28.637405 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-85a8605a-958b-4e85-b16c-0421dfb4fa67 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.699220 Jul 14 14:47:28.641931 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1938/3918] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:27 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:28.647432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6f6fbbd9-bd8d-485d-8317-356b36b312f6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:28.656398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6f6fbbd9-bd8d-485d-8317-356b36b312f6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:28.673392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f6fbbd9-bd8d-485d-8317-356b36b312f6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:28.674302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f6fbbd9-bd8d-485d-8317-356b36b312f6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:28.675274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f6fbbd9-bd8d-485d-8317-356b36b312f6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:28.675870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f6fbbd9-bd8d-485d-8317-356b36b312f6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:28.698802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b50c748-e7df-4445-9072-8b83e15ef926 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:28.716004 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b50c748-e7df-4445-9072-8b83e15ef926 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1503 microversion: 2.1 time: 0.800031 Jul 14 14:47:28.719366 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1981/3919] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:27 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1503 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:28.739423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bcfe1c21-54f7-487c-9109-d155485647ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:28.742069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bcfe1c21-54f7-487c-9109-d155485647ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:28.766814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcfe1c21-54f7-487c-9109-d155485647ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:28.767594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcfe1c21-54f7-487c-9109-d155485647ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:28.770916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcfe1c21-54f7-487c-9109-d155485647ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:28.771529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcfe1c21-54f7-487c-9109-d155485647ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:28.888816 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bcfe1c21-54f7-487c-9109-d155485647ee tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6/action" status: 202 len: 0 microversion: 2.1 time: 0.156137 Jul 14 14:47:28.889547 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1982/3920] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:47:28 2022] POST /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:47:28.918300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6f6fbbd9-bd8d-485d-8317-356b36b312f6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:28.929093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6f6fbbd9-bd8d-485d-8317-356b36b312f6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:28.940786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-46387fc7-9807-4299-ac2f-16df99027cd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:28.948526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6f6fbbd9-bd8d-485d-8317-356b36b312f6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:28.962574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-46387fc7-9807-4299-ac2f-16df99027cd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:28.972093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46387fc7-9807-4299-ac2f-16df99027cd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:28.973078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46387fc7-9807-4299-ac2f-16df99027cd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:28.974124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46387fc7-9807-4299-ac2f-16df99027cd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:28.975665 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6f6fbbd9-bd8d-485d-8317-356b36b312f6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1406 microversion: 2.54 time: 0.331885 Jul 14 14:47:28.976330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-46387fc7-9807-4299-ac2f-16df99027cd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:28.993064 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1939/3921] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:28 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:29.002235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-840313d9-e3f9-41aa-8751-1c4957e2c1bd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:29.003399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-840313d9-e3f9-41aa-8751-1c4957e2c1bd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:29.019238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-840313d9-e3f9-41aa-8751-1c4957e2c1bd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:29.019954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-840313d9-e3f9-41aa-8751-1c4957e2c1bd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:29.022328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-840313d9-e3f9-41aa-8751-1c4957e2c1bd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:29.022779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-840313d9-e3f9-41aa-8751-1c4957e2c1bd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:29.423718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-46387fc7-9807-4299-ac2f-16df99027cd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:29.438658 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-46387fc7-9807-4299-ac2f-16df99027cd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.508209 Jul 14 14:47:29.440505 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1983/3922] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:28 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:29.453949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-840313d9-e3f9-41aa-8751-1c4957e2c1bd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:29.464035 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-840313d9-e3f9-41aa-8751-1c4957e2c1bd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1508 microversion: 2.1 time: 0.467979 Jul 14 14:47:29.475580 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1940/3923] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:28 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1508 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:29.659195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18ee783c-e7a9-4c7e-9dde-31484ab61659 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:29.660161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-18ee783c-e7a9-4c7e-9dde-31484ab61659 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:29.680363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18ee783c-e7a9-4c7e-9dde-31484ab61659 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:29.681678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18ee783c-e7a9-4c7e-9dde-31484ab61659 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:29.684774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18ee783c-e7a9-4c7e-9dde-31484ab61659 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:29.687587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18ee783c-e7a9-4c7e-9dde-31484ab61659 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:29.898441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18ee783c-e7a9-4c7e-9dde-31484ab61659 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:29.909231 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-18ee783c-e7a9-4c7e-9dde-31484ab61659 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.254473 Jul 14 14:47:29.910350 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1984/3924] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:29 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:30.001460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d60d4f6-386c-4a35-b118-8395a390a03c tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:30.002086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8d60d4f6-386c-4a35-b118-8395a390a03c tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:30.009392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d60d4f6-386c-4a35-b118-8395a390a03c tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.009854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d60d4f6-386c-4a35-b118-8395a390a03c tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.011344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d60d4f6-386c-4a35-b118-8395a390a03c tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.012759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d60d4f6-386c-4a35-b118-8395a390a03c tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.116393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8d60d4f6-386c-4a35-b118-8395a390a03c tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:30.154745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8d60d4f6-386c-4a35-b118-8395a390a03c tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:30.158884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8d60d4f6-386c-4a35-b118-8395a390a03c tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:30.161237 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8d60d4f6-386c-4a35-b118-8395a390a03c tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1406 microversion: 2.54 time: 0.165237 Jul 14 14:47:30.163146 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1941/3925] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:29 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:30.460186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6913ed07-604a-400a-92a5-77cf06cd46d5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:30.460917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6913ed07-604a-400a-92a5-77cf06cd46d5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:30.473432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6913ed07-604a-400a-92a5-77cf06cd46d5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.476883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6913ed07-604a-400a-92a5-77cf06cd46d5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.478032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6913ed07-604a-400a-92a5-77cf06cd46d5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.479229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6913ed07-604a-400a-92a5-77cf06cd46d5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.481461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bc799189-9384-4762-901f-a2d2cf779816 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:30.482089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bc799189-9384-4762-901f-a2d2cf779816 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:30.490894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:30.495135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc799189-9384-4762-901f-a2d2cf779816 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.495607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc799189-9384-4762-901f-a2d2cf779816 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.496410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc799189-9384-4762-901f-a2d2cf779816 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.496865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc799189-9384-4762-901f-a2d2cf779816 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.814069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bc799189-9384-4762-901f-a2d2cf779816 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:30.821938 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bc799189-9384-4762-901f-a2d2cf779816 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1488 microversion: 2.1 time: 0.344226 Jul 14 14:47:30.826898 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1942/3926] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:30 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1488 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:30.843939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80a1ea00-7986-4642-8747-bcb0c239e596 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:30.844513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80a1ea00-7986-4642-8747-bcb0c239e596 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:30.863651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a1ea00-7986-4642-8747-bcb0c239e596 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.864130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a1ea00-7986-4642-8747-bcb0c239e596 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.864956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a1ea00-7986-4642-8747-bcb0c239e596 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.866272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a1ea00-7986-4642-8747-bcb0c239e596 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.911260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-80a1ea00-7986-4642-8747-bcb0c239e596 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lazy-loading 'flavor' on Instance uuid 4be684ea-99fc-4c45-86e4-52e39f39a2b6 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:47:30.939985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6913ed07-604a-400a-92a5-77cf06cd46d5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:30.979920 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6913ed07-604a-400a-92a5-77cf06cd46d5 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1733 microversion: 2.1 time: 0.519292 Jul 14 14:47:30.980677 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1985/3927] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:30 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1733 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:31.003855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb11be60-68f2-426b-804f-fde2c8c62723 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:31.004932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bb11be60-68f2-426b-804f-fde2c8c62723 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:31.022059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb11be60-68f2-426b-804f-fde2c8c62723 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:31.026384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb11be60-68f2-426b-804f-fde2c8c62723 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:31.028403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb11be60-68f2-426b-804f-fde2c8c62723 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:31.029239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb11be60-68f2-426b-804f-fde2c8c62723 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:31.282230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bb11be60-68f2-426b-804f-fde2c8c62723 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:31.293735 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bb11be60-68f2-426b-804f-fde2c8c62723 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.310883 Jul 14 14:47:31.295006 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1986/3928] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:30 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:31.301701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3ffe5ce6-904a-4606-abb0-876af68b6bc6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:31.302688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3ffe5ce6-904a-4606-abb0-876af68b6bc6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:31.311005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ffe5ce6-904a-4606-abb0-876af68b6bc6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:31.313243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ffe5ce6-904a-4606-abb0-876af68b6bc6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:31.314374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ffe5ce6-904a-4606-abb0-876af68b6bc6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:31.315230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ffe5ce6-904a-4606-abb0-876af68b6bc6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:31.450513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3ffe5ce6-904a-4606-abb0-876af68b6bc6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:31.466151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3ffe5ce6-904a-4606-abb0-876af68b6bc6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:31.469746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3ffe5ce6-904a-4606-abb0-876af68b6bc6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6e383a0355b45e2ad96fb193cf49860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1dabca5b794a448dcf0819d47664ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:31.471368 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3ffe5ce6-904a-4606-abb0-876af68b6bc6 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 200 len: 1406 microversion: 2.54 time: 0.174569 Jul 14 14:47:31.477404 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1987/3929] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:31 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:31.486723 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80a1ea00-7986-4642-8747-bcb0c239e596 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6/action" status: 202 len: 0 microversion: 2.1 time: 0.646884 Jul 14 14:47:31.496919 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1943/3930] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:47:30 2022] POST /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:47:31.499836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9eb6312f-b85b-4326-9448-fff21f40b992 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:31.501085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9eb6312f-b85b-4326-9448-fff21f40b992 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:31.512135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9eb6312f-b85b-4326-9448-fff21f40b992 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:31.514002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9eb6312f-b85b-4326-9448-fff21f40b992 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:31.515888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9eb6312f-b85b-4326-9448-fff21f40b992 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:31.516605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9eb6312f-b85b-4326-9448-fff21f40b992 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:31.710569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9eb6312f-b85b-4326-9448-fff21f40b992 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:31.720906 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9eb6312f-b85b-4326-9448-fff21f40b992 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1494 microversion: 2.1 time: 0.227012 Jul 14 14:47:31.722247 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1988/3931] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:31 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1494 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:32.014064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7c453561-3404-40cd-8aba-2fdd5aa708db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:32.015272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7c453561-3404-40cd-8aba-2fdd5aa708db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:32.056879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c453561-3404-40cd-8aba-2fdd5aa708db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.058944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c453561-3404-40cd-8aba-2fdd5aa708db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.064332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c453561-3404-40cd-8aba-2fdd5aa708db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.065524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c453561-3404-40cd-8aba-2fdd5aa708db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.312831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d799e681-67c2-42ce-a72f-57fb581935b4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:32.313496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d799e681-67c2-42ce-a72f-57fb581935b4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:32.330784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d799e681-67c2-42ce-a72f-57fb581935b4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.331253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d799e681-67c2-42ce-a72f-57fb581935b4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.343798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d799e681-67c2-42ce-a72f-57fb581935b4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.344275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d799e681-67c2-42ce-a72f-57fb581935b4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.415398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c453561-3404-40cd-8aba-2fdd5aa708db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:32.425668 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7c453561-3404-40cd-8aba-2fdd5aa708db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1713 microversion: 2.1 time: 0.422037 Jul 14 14:47:32.428215 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1944/3932] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:32 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1713 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:32.493162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf3b4309-6890-4815-b96f-fb2920934db4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:32.495535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bf3b4309-6890-4815-b96f-fb2920934db4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] [instance: 000a30b0-7cd8-419c-bf0a-38544efaa754] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:32.522717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf3b4309-6890-4815-b96f-fb2920934db4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.523595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf3b4309-6890-4815-b96f-fb2920934db4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.529092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf3b4309-6890-4815-b96f-fb2920934db4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.532698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf3b4309-6890-4815-b96f-fb2920934db4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.581079 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-bf3b4309-6890-4815-b96f-fb2920934db4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] HTTP exception thrown: Instance 000a30b0-7cd8-419c-bf0a-38544efaa754 could not be found. Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf3b4309-6890-4815-b96f-fb2920934db4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Request method failure captured: Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 HTTP/1.1 Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CxSTZ1ZI9vla7xLu1pW1qmDN94ZQKNTnqmzuKSgqiGLA0X3_k4JMXTbifsQhytJUB3diTY4OgV10VYkeuyI1jMfwDXIX8lgbyNbCXhvg_PZUX9i9anqQFDpF-yr_TS6WQSywXdQW5y_Pg4yKFByUZo3_19gEMczLkY93rqm4bk8DcI Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.54 Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3a1dabca5b794a448dcf0819d47664ea Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerShowV254Test-674361619 Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3a1dabca5b794a448dcf0819d47664ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3a1dabca5b794a448dcf0819d47664ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3a1dabca5b794a448dcf0819d47664ea", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3a1dabca5b794a448dcf0819d47664ea"}]}] Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerShowV254Test-674361619 Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3a1dabca5b794a448dcf0819d47664ea Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerShowV254Test-674361619 Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerShowV254Test-674361619-project Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f6e383a0355b45e2ad96fb193cf49860 Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerShowV254Test-674361619-project Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 000a30b0-7cd8-419c-bf0a-38544efaa754 could not be found. Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '000a30b0-7cd8-419c-bf0a-38544efaa754'} Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000a30b0-7cd8-419c-bf0a-38544efaa754 could not be found. Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000a30b0-7cd8-419c-bf0a-38544efaa754 could not be found. Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:32.586371 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:47:32.590978 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:32.590978 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:32.590978 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:32.590978 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:32.590978 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:32.590978 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000a30b0-7cd8-419c-bf0a-38544efaa754 could not be found. Jul 14 14:47:32.590978 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:47:32.591957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf3b4309-6890-4815-b96f-fb2920934db4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] Returning 404 to user: Instance 000a30b0-7cd8-419c-bf0a-38544efaa754 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:32.595171 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf3b4309-6890-4815-b96f-fb2920934db4 tempest-ServerShowV254Test-674361619 tempest-ServerShowV254Test-674361619-project] 10.222.0.81 "GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754" status: 404 len: 111 microversion: 2.54 time: 0.108016 Jul 14 14:47:32.597374 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1945/3933] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:32 2022] GET /compute/v2.1/servers/000a30b0-7cd8-419c-bf0a-38544efaa754 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:47:32.662723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d9c2c78-249d-4677-bd46-d9bf265a5afa tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:32.663674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0d9c2c78-249d-4677-bd46-d9bf265a5afa tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:32.679070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d9c2c78-249d-4677-bd46-d9bf265a5afa tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.679793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d9c2c78-249d-4677-bd46-d9bf265a5afa tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.681258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d9c2c78-249d-4677-bd46-d9bf265a5afa tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.681930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d9c2c78-249d-4677-bd46-d9bf265a5afa tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.693707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d799e681-67c2-42ce-a72f-57fb581935b4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:32.708670 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d799e681-67c2-42ce-a72f-57fb581935b4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.400714 Jul 14 14:47:32.712053 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1989/3934] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:32 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:32.739325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6c564c67-4d3a-4876-b087-6a7dc94ef9f4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:32.740114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6c564c67-4d3a-4876-b087-6a7dc94ef9f4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:32.748630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c564c67-4d3a-4876-b087-6a7dc94ef9f4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.750170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c564c67-4d3a-4876-b087-6a7dc94ef9f4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.756609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c564c67-4d3a-4876-b087-6a7dc94ef9f4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.756609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c564c67-4d3a-4876-b087-6a7dc94ef9f4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.861604 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-0d9c2c78-249d-4677-bd46-d9bf265a5afa tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] HTTP exception thrown: Cannot 'detach_volume' instance a9fadee3-2871-4c8e-adda-e95d99e56a1a while it is in vm_state rescued Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d9c2c78-249d-4677-bd46-d9bf265a5afa tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Request method failure captured: Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments/e7e30b86-f9cc-4b8f-8c90-4a8af44af5c6 HTTP/1.1 Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cuaek8QP7ZzyqAnXJWPN7lHiUWz0TNXX6f0nS0pfbQcbYmqHrTXe0rZ97jdQ3uNxUa0EPbwBicPZsDlqLUuoGtatVHJtwILzwCBFVthrwMveMSoYFbetP1TjjR3-iLZvN4xQUw5cjtI-hjvoXzpdUd0pTNdhqPPjM935R8S2VQJlOY Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e9f01277aa24f0fbe464ff8a5378d64", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}] Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 377b67baeabd4588a1945effc9b19113 Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: exception: Cannot 'detach_volume' instance a9fadee3-2871-4c8e-adda-e95d99e56a1a while it is in vm_state rescued Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'server_id': 'a9fadee3-2871-4c8e-adda-e95d99e56a1a', 'id': 'e7e30b86-f9cc-4b8f-8c90-4a8af44af5c6'} Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9fadee3-2871-4c8e-adda-e95d99e56a1a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a9fadee3-2871-4c8e-adda-e95d99e56a1a while it is in vm_state rescued Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:47:32.869236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:32.873222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:32.873222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:32.873222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:32.873222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:32.873222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a9fadee3-2871-4c8e-adda-e95d99e56a1a while it is in vm_state rescued Jul 14 14:47:32.873222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:47:32.875034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d9c2c78-249d-4677-bd46-d9bf265a5afa tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Returning 409 to user: Cannot 'detach_volume' instance a9fadee3-2871-4c8e-adda-e95d99e56a1a while it is in vm_state rescued {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:32.883307 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0d9c2c78-249d-4677-bd46-d9bf265a5afa tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments/e7e30b86-f9cc-4b8f-8c90-4a8af44af5c6" status: 409 len: 152 microversion: 2.1 time: 0.225005 Jul 14 14:47:32.892771 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1946/3935] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 14:47:32 2022] DELETE /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments/e7e30b86-f9cc-4b8f-8c90-4a8af44af5c6 => generated 152 bytes in 232 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:47:32.928206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d56bc660-5566-4087-9094-d95c493f0dd7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:32.929531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d56bc660-5566-4087-9094-d95c493f0dd7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:32.951691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d56bc660-5566-4087-9094-d95c493f0dd7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.955211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d56bc660-5566-4087-9094-d95c493f0dd7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.957303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d56bc660-5566-4087-9094-d95c493f0dd7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.958285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d56bc660-5566-4087-9094-d95c493f0dd7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:33.174398 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d56bc660-5566-4087-9094-d95c493f0dd7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/action" status: 202 len: 0 microversion: 2.1 time: 0.278239 Jul 14 14:47:33.179219 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1947/3936] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:47:32 2022] POST /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:47:33.198777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-59036902-294b-4468-8daa-67b648f8f946 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:33.201856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-59036902-294b-4468-8daa-67b648f8f946 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:33.234385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6c564c67-4d3a-4876-b087-6a7dc94ef9f4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:33.242397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59036902-294b-4468-8daa-67b648f8f946 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:33.245067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59036902-294b-4468-8daa-67b648f8f946 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:33.247043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59036902-294b-4468-8daa-67b648f8f946 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:33.247745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59036902-294b-4468-8daa-67b648f8f946 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:33.252063 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6c564c67-4d3a-4876-b087-6a7dc94ef9f4 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1515 microversion: 2.1 time: 0.515702 Jul 14 14:47:33.254655 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1990/3937] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:32 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1515 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:33.562535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-59036902-294b-4468-8daa-67b648f8f946 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:33.580427 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-59036902-294b-4468-8daa-67b648f8f946 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1721 microversion: 2.1 time: 0.395629 Jul 14 14:47:33.590185 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1948/3938] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:33 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1721 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:33.730987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-96b520f2-8584-4da2-a6fc-679d76a81b04 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:33.731615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-96b520f2-8584-4da2-a6fc-679d76a81b04 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:33.769397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96b520f2-8584-4da2-a6fc-679d76a81b04 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:33.770355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96b520f2-8584-4da2-a6fc-679d76a81b04 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:33.771404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96b520f2-8584-4da2-a6fc-679d76a81b04 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:33.772020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96b520f2-8584-4da2-a6fc-679d76a81b04 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:34.271670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6195151a-ba78-44ba-9593-38645e461741 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:34.272427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6195151a-ba78-44ba-9593-38645e461741 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:34.289717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-96b520f2-8584-4da2-a6fc-679d76a81b04 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:34.317120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6195151a-ba78-44ba-9593-38645e461741 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:34.318902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6195151a-ba78-44ba-9593-38645e461741 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:34.321667 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-96b520f2-8584-4da2-a6fc-679d76a81b04 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.588805 Jul 14 14:47:34.322358 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1991/3939] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:33 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:34.326727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6195151a-ba78-44ba-9593-38645e461741 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:34.328404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6195151a-ba78-44ba-9593-38645e461741 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:34.599379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d7afc553-fc60-4d3b-8e13-fb7f2d636ae1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:34.600245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d7afc553-fc60-4d3b-8e13-fb7f2d636ae1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:34.613130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d7afc553-fc60-4d3b-8e13-fb7f2d636ae1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:34.615353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d7afc553-fc60-4d3b-8e13-fb7f2d636ae1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:34.617249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d7afc553-fc60-4d3b-8e13-fb7f2d636ae1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:34.619290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d7afc553-fc60-4d3b-8e13-fb7f2d636ae1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:34.728400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6195151a-ba78-44ba-9593-38645e461741 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:34.771001 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6195151a-ba78-44ba-9593-38645e461741 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1515 microversion: 2.1 time: 0.502283 Jul 14 14:47:34.774550 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1949/3940] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:34 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1515 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:35.010097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d7afc553-fc60-4d3b-8e13-fb7f2d636ae1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:35.033760 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d7afc553-fc60-4d3b-8e13-fb7f2d636ae1 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1721 microversion: 2.1 time: 0.439431 Jul 14 14:47:35.040186 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1992/3941] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:34 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1721 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:35.340134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-47a4a705-e3ce-4d06-91d8-5f8ee29b6a38 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:35.341190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-47a4a705-e3ce-4d06-91d8-5f8ee29b6a38 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:35.361113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47a4a705-e3ce-4d06-91d8-5f8ee29b6a38 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:35.363484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47a4a705-e3ce-4d06-91d8-5f8ee29b6a38 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:35.367279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47a4a705-e3ce-4d06-91d8-5f8ee29b6a38 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:35.369427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47a4a705-e3ce-4d06-91d8-5f8ee29b6a38 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:35.749917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-47a4a705-e3ce-4d06-91d8-5f8ee29b6a38 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:35.781364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6f29fff1-9dab-4934-a929-4a162b0c2586 req-b164aaac-0890-4b45-a326-79689c41e502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be684ea-99fc-4c45-86e4-52e39f39a2b6", "name": "network-vif-plugged", "status": "completed", "tag": "b7327c3d-0492-4493-b434-a4db3c983c3d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:35.798505 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-47a4a705-e3ce-4d06-91d8-5f8ee29b6a38 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.463792 Jul 14 14:47:35.816285 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1950/3942] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:35 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:35.835718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6f29fff1-9dab-4934-a929-4a162b0c2586 req-b164aaac-0890-4b45-a326-79689c41e502 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:35.838210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6f29fff1-9dab-4934-a929-4a162b0c2586 req-b164aaac-0890-4b45-a326-79689c41e502 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:35.839729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2b5dabb1-b378-4433-aa6f-41aa1c606b9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:35.843829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2b5dabb1-b378-4433-aa6f-41aa1c606b9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:35.874864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b5dabb1-b378-4433-aa6f-41aa1c606b9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:35.875480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b5dabb1-b378-4433-aa6f-41aa1c606b9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:35.891217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b5dabb1-b378-4433-aa6f-41aa1c606b9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:35.891767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b5dabb1-b378-4433-aa6f-41aa1c606b9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:35.911040 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6f29fff1-9dab-4934-a929-4a162b0c2586 req-b164aaac-0890-4b45-a326-79689c41e502 service nova] Creating event network-vif-plugged:b7327c3d-0492-4493-b434-a4db3c983c3d for instance 4be684ea-99fc-4c45-86e4-52e39f39a2b6 on n-h2-767704-28 Jul 14 14:47:35.918647 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6f29fff1-9dab-4934-a929-4a162b0c2586 req-b164aaac-0890-4b45-a326-79689c41e502 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146667 Jul 14 14:47:35.919513 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1993/3943] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:47:36.064501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-38afe428-7058-40af-b8ca-2252fe17d47b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:36.066084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-38afe428-7058-40af-b8ca-2252fe17d47b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:36.080452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38afe428-7058-40af-b8ca-2252fe17d47b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:36.082299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38afe428-7058-40af-b8ca-2252fe17d47b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:36.085225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38afe428-7058-40af-b8ca-2252fe17d47b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:36.085991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38afe428-7058-40af-b8ca-2252fe17d47b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:36.570930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2b5dabb1-b378-4433-aa6f-41aa1c606b9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:36.582086 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2b5dabb1-b378-4433-aa6f-41aa1c606b9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 0.764594 Jul 14 14:47:36.590052 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1951/3944] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:35 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:36.662101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-38afe428-7058-40af-b8ca-2252fe17d47b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:36.675038 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-38afe428-7058-40af-b8ca-2252fe17d47b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1721 microversion: 2.1 time: 0.615016 Jul 14 14:47:36.678008 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1994/3945] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:36 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1721 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:36.826349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5f002433-5475-4f98-83ef-e6fc0936d173 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:36.828896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5f002433-5475-4f98-83ef-e6fc0936d173 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:36.838782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f002433-5475-4f98-83ef-e6fc0936d173 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:36.839607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f002433-5475-4f98-83ef-e6fc0936d173 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:36.840683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f002433-5475-4f98-83ef-e6fc0936d173 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:36.841548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f002433-5475-4f98-83ef-e6fc0936d173 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:36.871697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:37.311169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5f002433-5475-4f98-83ef-e6fc0936d173 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:37.322324 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5f002433-5475-4f98-83ef-e6fc0936d173 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 0.502450 Jul 14 14:47:37.334672 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1952/3946] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:36 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:37.621844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-62d292b2-f530-4e5f-a128-7b029eba3532 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:37.622690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-62d292b2-f530-4e5f-a128-7b029eba3532 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:37.679333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62d292b2-f530-4e5f-a128-7b029eba3532 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:37.680037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62d292b2-f530-4e5f-a128-7b029eba3532 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:37.681042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62d292b2-f530-4e5f-a128-7b029eba3532 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:37.681755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62d292b2-f530-4e5f-a128-7b029eba3532 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:37.697014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99e7f0cc-d8f3-4174-bf49-d4db4151cda9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:37.697832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-99e7f0cc-d8f3-4174-bf49-d4db4151cda9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:37.714180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99e7f0cc-d8f3-4174-bf49-d4db4151cda9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:37.715018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99e7f0cc-d8f3-4174-bf49-d4db4151cda9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:37.716036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99e7f0cc-d8f3-4174-bf49-d4db4151cda9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:37.719016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99e7f0cc-d8f3-4174-bf49-d4db4151cda9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:38.614545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-62d292b2-f530-4e5f-a128-7b029eba3532 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:38.627230 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-62d292b2-f530-4e5f-a128-7b029eba3532 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 1.020497 Jul 14 14:47:38.631357 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1995/3947] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:37 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:38.637861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-99e7f0cc-d8f3-4174-bf49-d4db4151cda9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:38.654049 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99e7f0cc-d8f3-4174-bf49-d4db4151cda9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1721 microversion: 2.1 time: 0.961494 Jul 14 14:47:38.666144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9469f972-afad-4374-9c61-c8bd8c4379b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:38.668034 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1953/3948] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:37 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1721 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:38.669578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9469f972-afad-4374-9c61-c8bd8c4379b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:38.700795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9469f972-afad-4374-9c61-c8bd8c4379b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:38.703365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9469f972-afad-4374-9c61-c8bd8c4379b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:38.707783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9469f972-afad-4374-9c61-c8bd8c4379b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:38.709522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9469f972-afad-4374-9c61-c8bd8c4379b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:39.649022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b9552292-55ac-4f51-b266-756941de26bb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:39.650584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b9552292-55ac-4f51-b266-756941de26bb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:39.671291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9552292-55ac-4f51-b266-756941de26bb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:39.672462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9552292-55ac-4f51-b266-756941de26bb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:39.674096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9552292-55ac-4f51-b266-756941de26bb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:39.677834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9552292-55ac-4f51-b266-756941de26bb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:40.712816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9469f972-afad-4374-9c61-c8bd8c4379b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:40.727324 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9469f972-afad-4374-9c61-c8bd8c4379b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 2.083562 Jul 14 14:47:40.741983 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1996/3949] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:38 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:40.755651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7420394e-926f-4a83-8dda-7cf2375aa757 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:40.767479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7420394e-926f-4a83-8dda-7cf2375aa757 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:40.788878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7420394e-926f-4a83-8dda-7cf2375aa757 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:40.791916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7420394e-926f-4a83-8dda-7cf2375aa757 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:40.794169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7420394e-926f-4a83-8dda-7cf2375aa757 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:40.795162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7420394e-926f-4a83-8dda-7cf2375aa757 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:41.525230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b9552292-55ac-4f51-b266-756941de26bb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:41.542073 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b9552292-55ac-4f51-b266-756941de26bb tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 1.897216 Jul 14 14:47:41.553831 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1954/3950] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:39 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:41.746919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-808e024f-0cc2-48b4-90f8-273632a30388 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:41.747812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-808e024f-0cc2-48b4-90f8-273632a30388 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:41.770987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-808e024f-0cc2-48b4-90f8-273632a30388 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:41.780874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-808e024f-0cc2-48b4-90f8-273632a30388 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:41.792929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-808e024f-0cc2-48b4-90f8-273632a30388 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:41.798908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-808e024f-0cc2-48b4-90f8-273632a30388 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:41.835593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7420394e-926f-4a83-8dda-7cf2375aa757 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:41.848147 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7420394e-926f-4a83-8dda-7cf2375aa757 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1727 microversion: 2.1 time: 1.104701 Jul 14 14:47:41.853045 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1997/3951] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:40 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1727 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:41.873784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9def36cd-a152-4713-ab4a-7b8a27de908c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:41.875401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9def36cd-a152-4713-ab4a-7b8a27de908c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:41.897767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9def36cd-a152-4713-ab4a-7b8a27de908c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:41.901429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9def36cd-a152-4713-ab4a-7b8a27de908c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:41.905066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9def36cd-a152-4713-ab4a-7b8a27de908c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:41.907089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9def36cd-a152-4713-ab4a-7b8a27de908c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:42.391857 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9def36cd-a152-4713-ab4a-7b8a27de908c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.522410 Jul 14 14:47:42.397067 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1998/3952] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:47:41 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-interface => generated 284 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:42.570275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a9a09fd-266d-420d-a6cb-5a75794f47f3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:42.572158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0a9a09fd-266d-420d-a6cb-5a75794f47f3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:42.587030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a9a09fd-266d-420d-a6cb-5a75794f47f3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:42.587667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a9a09fd-266d-420d-a6cb-5a75794f47f3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:42.588633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a9a09fd-266d-420d-a6cb-5a75794f47f3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:42.589307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a9a09fd-266d-420d-a6cb-5a75794f47f3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:42.791475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-808e024f-0cc2-48b4-90f8-273632a30388 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:42.804382 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-808e024f-0cc2-48b4-90f8-273632a30388 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1515 microversion: 2.1 time: 1.062120 Jul 14 14:47:42.807362 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1955/3953] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:41 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1515 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:43.407737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0a9a09fd-266d-420d-a6cb-5a75794f47f3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:43.415768 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0a9a09fd-266d-420d-a6cb-5a75794f47f3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 0.854540 Jul 14 14:47:43.430078 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 1999/3954] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:42 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:43.825562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c71cbfea-458f-49df-a354-d63bb8c5211f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:43.827693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c71cbfea-458f-49df-a354-d63bb8c5211f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:43.846229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c71cbfea-458f-49df-a354-d63bb8c5211f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:43.853031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c71cbfea-458f-49df-a354-d63bb8c5211f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:43.854220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c71cbfea-458f-49df-a354-d63bb8c5211f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:43.862589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c71cbfea-458f-49df-a354-d63bb8c5211f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:44.443861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab20d91b-e9cd-4a53-b195-a9ee8a3d153d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:44.444489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ab20d91b-e9cd-4a53-b195-a9ee8a3d153d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:44.465709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab20d91b-e9cd-4a53-b195-a9ee8a3d153d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:44.477561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab20d91b-e9cd-4a53-b195-a9ee8a3d153d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:44.484099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab20d91b-e9cd-4a53-b195-a9ee8a3d153d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:44.486246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab20d91b-e9cd-4a53-b195-a9ee8a3d153d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:45.113463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c71cbfea-458f-49df-a354-d63bb8c5211f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:45.129211 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c71cbfea-458f-49df-a354-d63bb8c5211f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1521 microversion: 2.1 time: 1.308007 Jul 14 14:47:45.130052 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1956/3955] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:43 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1521 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:45.969641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab20d91b-e9cd-4a53-b195-a9ee8a3d153d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:45.982041 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ab20d91b-e9cd-4a53-b195-a9ee8a3d153d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 1.542083 Jul 14 14:47:45.985440 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2000/3956] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:44 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:46.146516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f4371a1-034a-4bc8-87a2-3feec014ad0e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:46.147780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9f4371a1-034a-4bc8-87a2-3feec014ad0e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:46.162911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f4371a1-034a-4bc8-87a2-3feec014ad0e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:46.165127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f4371a1-034a-4bc8-87a2-3feec014ad0e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:46.167352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f4371a1-034a-4bc8-87a2-3feec014ad0e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:46.169705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f4371a1-034a-4bc8-87a2-3feec014ad0e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:46.478327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9fca902c-2cf1-4336-8d7e-f51aa513ed0d req-bd337c32-2095-4135-8b89-1944f35303b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9fadee3-2871-4c8e-adda-e95d99e56a1a", "tag": "83a28852-1f2f-4d1f-b2b4-075a5434ee65"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:46.507868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9fca902c-2cf1-4336-8d7e-f51aa513ed0d req-bd337c32-2095-4135-8b89-1944f35303b5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:46.508728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9fca902c-2cf1-4336-8d7e-f51aa513ed0d req-bd337c32-2095-4135-8b89-1944f35303b5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:46.534280 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9fca902c-2cf1-4336-8d7e-f51aa513ed0d req-bd337c32-2095-4135-8b89-1944f35303b5 service nova] Creating event network-changed:83a28852-1f2f-4d1f-b2b4-075a5434ee65 for instance a9fadee3-2871-4c8e-adda-e95d99e56a1a on n-h1-767704-28 Jul 14 14:47:46.549654 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9fca902c-2cf1-4336-8d7e-f51aa513ed0d req-bd337c32-2095-4135-8b89-1944f35303b5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076467 Jul 14 14:47:46.550560 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2001/3957] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:47:47.005164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f9d8190e-ad21-448c-9048-235bc9c23b4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:47.005869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f9d8190e-ad21-448c-9048-235bc9c23b4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:47.019272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f9d8190e-ad21-448c-9048-235bc9c23b4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:47.021116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f9d8190e-ad21-448c-9048-235bc9c23b4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:47.021990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f9d8190e-ad21-448c-9048-235bc9c23b4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:47.022452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f9d8190e-ad21-448c-9048-235bc9c23b4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:47.080643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9f4371a1-034a-4bc8-87a2-3feec014ad0e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:47.095891 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9f4371a1-034a-4bc8-87a2-3feec014ad0e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1521 microversion: 2.1 time: 0.953584 Jul 14 14:47:47.113304 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1957/3958] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:46 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1521 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:47.509523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d9ef8f0d-28aa-44f8-85ea-9cdd3ab87e23 req-de8fd405-aeaa-4d8a-ac03-d002db60cf69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9f94f5-3d27-4f76-b948-c390f05bc81c", "name": "network-vif-unplugged", "status": "completed", "tag": "deef751d-da5b-41a2-b224-542470608e30"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:47.535201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d9ef8f0d-28aa-44f8-85ea-9cdd3ab87e23 req-de8fd405-aeaa-4d8a-ac03-d002db60cf69 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:47.566340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d9ef8f0d-28aa-44f8-85ea-9cdd3ab87e23 req-de8fd405-aeaa-4d8a-ac03-d002db60cf69 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:47.608768 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d9ef8f0d-28aa-44f8-85ea-9cdd3ab87e23 req-de8fd405-aeaa-4d8a-ac03-d002db60cf69 service nova] Creating event network-vif-unplugged:deef751d-da5b-41a2-b224-542470608e30 for instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c on n-h1-767704-28 Jul 14 14:47:47.626914 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d9ef8f0d-28aa-44f8-85ea-9cdd3ab87e23 req-de8fd405-aeaa-4d8a-ac03-d002db60cf69 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125512 Jul 14 14:47:47.633074 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1958/3959] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:47.781258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f9d8190e-ad21-448c-9048-235bc9c23b4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:47.793726 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f9d8190e-ad21-448c-9048-235bc9c23b4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 0.795534 Jul 14 14:47:47.798708 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2002/3960] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:46 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:48.120908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bd95d58a-c5f7-408e-9a63-37578eabe21a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:48.122207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bd95d58a-c5f7-408e-9a63-37578eabe21a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:48.136331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd95d58a-c5f7-408e-9a63-37578eabe21a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.145784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd95d58a-c5f7-408e-9a63-37578eabe21a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.152211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd95d58a-c5f7-408e-9a63-37578eabe21a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.156968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd95d58a-c5f7-408e-9a63-37578eabe21a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.647006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ea4a48c1-9152-4993-8f1b-5b7a81fd21dd req-3f4b0b61-bd26-4408-8b8f-688a903e9857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9fadee3-2871-4c8e-adda-e95d99e56a1a", "tag": "83a28852-1f2f-4d1f-b2b4-075a5434ee65"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:48.672098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ea4a48c1-9152-4993-8f1b-5b7a81fd21dd req-3f4b0b61-bd26-4408-8b8f-688a903e9857 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.676788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ea4a48c1-9152-4993-8f1b-5b7a81fd21dd req-3f4b0b61-bd26-4408-8b8f-688a903e9857 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.735931 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ea4a48c1-9152-4993-8f1b-5b7a81fd21dd req-3f4b0b61-bd26-4408-8b8f-688a903e9857 service nova] Creating event network-changed:83a28852-1f2f-4d1f-b2b4-075a5434ee65 for instance a9fadee3-2871-4c8e-adda-e95d99e56a1a on n-h1-767704-28 Jul 14 14:47:48.760902 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ea4a48c1-9152-4993-8f1b-5b7a81fd21dd req-3f4b0b61-bd26-4408-8b8f-688a903e9857 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118247 Jul 14 14:47:48.767138 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2003/3961] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:48.815753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-63d5d06e-16dc-44d2-9a04-4719fa2be9a7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:48.817310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-63d5d06e-16dc-44d2-9a04-4719fa2be9a7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:48.849910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63d5d06e-16dc-44d2-9a04-4719fa2be9a7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.853448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63d5d06e-16dc-44d2-9a04-4719fa2be9a7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.854707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63d5d06e-16dc-44d2-9a04-4719fa2be9a7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.855323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63d5d06e-16dc-44d2-9a04-4719fa2be9a7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.871834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:48.877628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bd95d58a-c5f7-408e-9a63-37578eabe21a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:48.887151 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bd95d58a-c5f7-408e-9a63-37578eabe21a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1521 microversion: 2.1 time: 0.771160 Jul 14 14:47:48.894743 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1959/3962] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:48 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1521 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:49.911704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9693929a-d116-47f2-a5ff-869d12495a4b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:49.912351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9693929a-d116-47f2-a5ff-869d12495a4b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:49.928025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9693929a-d116-47f2-a5ff-869d12495a4b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:49.938919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9693929a-d116-47f2-a5ff-869d12495a4b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:49.945302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9693929a-d116-47f2-a5ff-869d12495a4b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:49.946328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9693929a-d116-47f2-a5ff-869d12495a4b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:50.414042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-63d5d06e-16dc-44d2-9a04-4719fa2be9a7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:50.422827 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-63d5d06e-16dc-44d2-9a04-4719fa2be9a7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 1.611773 Jul 14 14:47:50.435419 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2004/3963] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:48 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:50.938427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9693929a-d116-47f2-a5ff-869d12495a4b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:50.955393 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9693929a-d116-47f2-a5ff-869d12495a4b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1521 microversion: 2.1 time: 1.048205 Jul 14 14:47:50.966889 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1960/3964] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:49 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1521 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:51.440986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1a75cf2a-2b01-4676-a6ab-c6f87282f1f7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:51.443034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1a75cf2a-2b01-4676-a6ab-c6f87282f1f7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:51.446105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:51.473150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a75cf2a-2b01-4676-a6ab-c6f87282f1f7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:51.481613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a75cf2a-2b01-4676-a6ab-c6f87282f1f7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:51.484874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a75cf2a-2b01-4676-a6ab-c6f87282f1f7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:51.485648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a75cf2a-2b01-4676-a6ab-c6f87282f1f7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:51.985255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-da21d99b-9221-45c7-8c4f-15c8424b6b46 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:51.988298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-da21d99b-9221-45c7-8c4f-15c8424b6b46 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:52.004256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da21d99b-9221-45c7-8c4f-15c8424b6b46 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.012677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da21d99b-9221-45c7-8c4f-15c8424b6b46 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.014188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da21d99b-9221-45c7-8c4f-15c8424b6b46 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.015145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-da21d99b-9221-45c7-8c4f-15c8424b6b46 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.088364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a75cf2a-2b01-4676-a6ab-c6f87282f1f7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:52.103067 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1a75cf2a-2b01-4676-a6ab-c6f87282f1f7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 0.662585 Jul 14 14:47:52.103725 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2005/3965] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:51 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:52.273085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-840444513", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "2adaa01b-3ea3-4a8b-9b5c-5004fd256dbd"}, {"uuid": "b441f2e9-349f-481c-a6d6-b7a5725f82ad"}, {"uuid": "2adaa01b-3ea3-4a8b-9b5c-5004fd256dbd"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:52.382072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] validate_networks() for [('2adaa01b-3ea3-4a8b-9b5c-5004fd256dbd', None, None, None, None, None), ('b441f2e9-349f-481c-a6d6-b7a5725f82ad', None, None, None, None, None), ('2adaa01b-3ea3-4a8b-9b5c-5004fd256dbd', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:47:53.803604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-da21d99b-9221-45c7-8c4f-15c8424b6b46 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:53.821039 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-da21d99b-9221-45c7-8c4f-15c8424b6b46 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1521 microversion: 2.1 time: 1.831709 Jul 14 14:47:53.822658 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1961/3966] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:51 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1521 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:53.848706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d469c7fb-441b-481d-8634-527553d16bb6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:53.849543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d469c7fb-441b-481d-8634-527553d16bb6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:53.881424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d469c7fb-441b-481d-8634-527553d16bb6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:53.881879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d469c7fb-441b-481d-8634-527553d16bb6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:53.882661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d469c7fb-441b-481d-8634-527553d16bb6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:53.883101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d469c7fb-441b-481d-8634-527553d16bb6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:54.619539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d469c7fb-441b-481d-8634-527553d16bb6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:54.631023 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d469c7fb-441b-481d-8634-527553d16bb6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 0.802314 Jul 14 14:47:54.633404 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1962/3967] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:53 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:54.838787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-254c5095-d840-4e6a-b854-688060ea9414 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:54.840355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-254c5095-d840-4e6a-b854-688060ea9414 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:54.851857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-254c5095-d840-4e6a-b854-688060ea9414 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:54.852758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-254c5095-d840-4e6a-b854-688060ea9414 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:54.853859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-254c5095-d840-4e6a-b854-688060ea9414 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:54.862872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-254c5095-d840-4e6a-b854-688060ea9414 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:55.314777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-254c5095-d840-4e6a-b854-688060ea9414 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:55.327227 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-254c5095-d840-4e6a-b854-688060ea9414 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1521 microversion: 2.1 time: 0.492075 Jul 14 14:47:55.330044 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1963/3968] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:54 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:55.651541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45ecbfbf-a15e-4cc3-8905-24b8435f90d9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:55.652420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-45ecbfbf-a15e-4cc3-8905-24b8435f90d9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:55.681172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45ecbfbf-a15e-4cc3-8905-24b8435f90d9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:55.681919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45ecbfbf-a15e-4cc3-8905-24b8435f90d9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:55.682902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45ecbfbf-a15e-4cc3-8905-24b8435f90d9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:55.683501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45ecbfbf-a15e-4cc3-8905-24b8435f90d9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:55.940249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:47:55.940747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:47:55.941643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:47:55.942162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:47:55.942703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:47:55.973529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:55.974015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:55.975097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:55.976725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:56.023296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Getting quotas for project 1bf20852acdd4cea9ed6e96934097280. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:56.042932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Getting quotas for user 35abcadc35964a9d8df499c4d987e056 and project 1bf20852acdd4cea9ed6e96934097280. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:56.079573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:47:56.083719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:47:56.242279 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a4fac0ba-b6d8-427d-9269-d28b424ae576 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.973090 Jul 14 14:47:56.249426 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2006/3969] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:47:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:47:56.267850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3d1679bf-6aaf-478b-9bdd-c155b2b54a08 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:56.268495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3d1679bf-6aaf-478b-9bdd-c155b2b54a08 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:56.466350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3d1679bf-6aaf-478b-9bdd-c155b2b54a08 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:56.497971 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3d1679bf-6aaf-478b-9bdd-c155b2b54a08 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1212 microversion: 2.1 time: 0.247118 Jul 14 14:47:56.498607 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2007/3970] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:56 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1212 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:56.521820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-452048e0-364a-4908-b6e6-9c1190667fcd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:56.522888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-452048e0-364a-4908-b6e6-9c1190667fcd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:56.552829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-452048e0-364a-4908-b6e6-9c1190667fcd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:56.553467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-452048e0-364a-4908-b6e6-9c1190667fcd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:56.554547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-452048e0-364a-4908-b6e6-9c1190667fcd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:56.555475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-452048e0-364a-4908-b6e6-9c1190667fcd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:56.653572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-45ecbfbf-a15e-4cc3-8905-24b8435f90d9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:56.666212 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-45ecbfbf-a15e-4cc3-8905-24b8435f90d9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 1.019324 Jul 14 14:47:56.668857 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1964/3971] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:55 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:56.892886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-452048e0-364a-4908-b6e6-9c1190667fcd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:56.910154 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-452048e0-364a-4908-b6e6-9c1190667fcd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1521 microversion: 2.1 time: 0.396800 Jul 14 14:47:56.912432 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2008/3972] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:56 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:57.074551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-afa461a3-7b67-43be-a5bd-63316bd751cf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: .version_select at 0x7fd6c474d700>, body: {"keypair": {"name": "tempest-keypair-1088790826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtsfL9vPFs7ALYa7w95UJ9LUQVkwCJ0y0gjml1kWhlItjWA6IA0vw+GVtKEj+R6OYFSSeYuBQ19nl1rEAhEue3h+lE0NvR5uuAW/vLr608sd4b/tYRJncaoFsXswW/Row=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:57.090373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-afa461a3-7b67-43be-a5bd-63316bd751cf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:57.098655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-afa461a3-7b67-43be-a5bd-63316bd751cf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for user 9260cbc32f1e423ab8ea4d06058b4050 and project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:57.141565 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-afa461a3-7b67-43be-a5bd-63316bd751cf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.361004 Jul 14 14:47:57.142137 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1965/3973] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:47:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:57.521013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5d640a34-f750-4c03-b62b-6c69ab227a79 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:57.525182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5d640a34-f750-4c03-b62b-6c69ab227a79 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:57.549639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d640a34-f750-4c03-b62b-6c69ab227a79 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:57.550273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d640a34-f750-4c03-b62b-6c69ab227a79 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:57.551530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d640a34-f750-4c03-b62b-6c69ab227a79 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:57.552251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d640a34-f750-4c03-b62b-6c69ab227a79 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:57.689412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0139a92d-522d-4f67-8524-15714a5ce48b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:57.690980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0139a92d-522d-4f67-8524-15714a5ce48b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:57.698106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0139a92d-522d-4f67-8524-15714a5ce48b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:57.698904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0139a92d-522d-4f67-8524-15714a5ce48b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:57.699926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0139a92d-522d-4f67-8524-15714a5ce48b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:57.700525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0139a92d-522d-4f67-8524-15714a5ce48b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:57.759058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5d640a34-f750-4c03-b62b-6c69ab227a79 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:57.789053 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5d640a34-f750-4c03-b62b-6c69ab227a79 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1216 microversion: 2.1 time: 0.277335 Jul 14 14:47:57.805001 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2009/3974] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:57 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1216 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:57.929495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18bdd50e-cee4-45c7-b28a-9328b99bc35b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:57.930033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-18bdd50e-cee4-45c7-b28a-9328b99bc35b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:57.943274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18bdd50e-cee4-45c7-b28a-9328b99bc35b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:57.947442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18bdd50e-cee4-45c7-b28a-9328b99bc35b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:57.948560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18bdd50e-cee4-45c7-b28a-9328b99bc35b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:57.957799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18bdd50e-cee4-45c7-b28a-9328b99bc35b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:58.238423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0139a92d-522d-4f67-8524-15714a5ce48b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:58.261264 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0139a92d-522d-4f67-8524-15714a5ce48b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 0.572503 Jul 14 14:47:58.275673 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1966/3975] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:57 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:58.414369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18bdd50e-cee4-45c7-b28a-9328b99bc35b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:58.443933 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-18bdd50e-cee4-45c7-b28a-9328b99bc35b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1521 microversion: 2.1 time: 0.519339 Jul 14 14:47:58.445935 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2010/3976] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:57 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:58.814438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-17cdf489-e608-42aa-a790-44f955b0a700 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:58.815573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-17cdf489-e608-42aa-a790-44f955b0a700 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:58.817870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:58.832621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17cdf489-e608-42aa-a790-44f955b0a700 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:58.843940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17cdf489-e608-42aa-a790-44f955b0a700 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:58.845163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17cdf489-e608-42aa-a790-44f955b0a700 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:58.849612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17cdf489-e608-42aa-a790-44f955b0a700 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:59.119825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-17cdf489-e608-42aa-a790-44f955b0a700 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:59.139911 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-17cdf489-e608-42aa-a790-44f955b0a700 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1270 microversion: 2.1 time: 0.331321 Jul 14 14:47:59.140625 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1967/3977] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:58 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1270 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:59.279621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6f204421-d2bb-44c7-a5d9-65b097e42a1c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:59.282090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6f204421-d2bb-44c7-a5d9-65b097e42a1c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:59.298931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f204421-d2bb-44c7-a5d9-65b097e42a1c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:59.299403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f204421-d2bb-44c7-a5d9-65b097e42a1c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:59.300222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f204421-d2bb-44c7-a5d9-65b097e42a1c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:59.300673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f204421-d2bb-44c7-a5d9-65b097e42a1c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:59.464719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8bbf094a-0dfa-444c-a6fa-1c294cf6bf6d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:59.465375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8bbf094a-0dfa-444c-a6fa-1c294cf6bf6d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:59.486649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bbf094a-0dfa-444c-a6fa-1c294cf6bf6d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:59.487380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bbf094a-0dfa-444c-a6fa-1c294cf6bf6d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:59.488336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bbf094a-0dfa-444c-a6fa-1c294cf6bf6d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:59.488922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bbf094a-0dfa-444c-a6fa-1c294cf6bf6d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:59.860201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6f204421-d2bb-44c7-a5d9-65b097e42a1c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:59.920359 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6f204421-d2bb-44c7-a5d9-65b097e42a1c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 0.639509 Jul 14 14:47:59.932783 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2011/3978] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:59 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:59.954029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3d1b1592-32ab-4723-aa59-4baabee1f8cd req-66a508a2-e94e-4581-bd98-e441a84acdbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9f94f5-3d27-4f76-b948-c390f05bc81c", "name": "network-vif-plugged", "status": "completed", "tag": "deef751d-da5b-41a2-b224-542470608e30"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:00.007662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3d1b1592-32ab-4723-aa59-4baabee1f8cd req-66a508a2-e94e-4581-bd98-e441a84acdbe service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:00.007911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8bbf094a-0dfa-444c-a6fa-1c294cf6bf6d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:00.009760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3d1b1592-32ab-4723-aa59-4baabee1f8cd req-66a508a2-e94e-4581-bd98-e441a84acdbe service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:00.020063 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8bbf094a-0dfa-444c-a6fa-1c294cf6bf6d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1521 microversion: 2.1 time: 0.559325 Jul 14 14:48:00.028123 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1968/3979] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:59 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1521 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:00.064822 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3d1b1592-32ab-4723-aa59-4baabee1f8cd req-66a508a2-e94e-4581-bd98-e441a84acdbe service nova] Creating event network-vif-plugged:deef751d-da5b-41a2-b224-542470608e30 for instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c on n-h1-767704-28 Jul 14 14:48:00.083710 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3d1b1592-32ab-4723-aa59-4baabee1f8cd req-66a508a2-e94e-4581-bd98-e441a84acdbe service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148197 Jul 14 14:48:00.094943 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2012/3980] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:00.159271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dfdb0a82-e37c-47a4-a48f-fa6f3050e741 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:00.160167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dfdb0a82-e37c-47a4-a48f-fa6f3050e741 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:00.173833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dfdb0a82-e37c-47a4-a48f-fa6f3050e741 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:00.174606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dfdb0a82-e37c-47a4-a48f-fa6f3050e741 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:00.175575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dfdb0a82-e37c-47a4-a48f-fa6f3050e741 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:00.178673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dfdb0a82-e37c-47a4-a48f-fa6f3050e741 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:00.316084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dfdb0a82-e37c-47a4-a48f-fa6f3050e741 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:00.332924 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dfdb0a82-e37c-47a4-a48f-fa6f3050e741 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1270 microversion: 2.1 time: 0.170732 Jul 14 14:48:00.333989 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1969/3981] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:00 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:00.944299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ba4b965-ffa6-4b04-bf40-d8f3f50a4f22 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:00.949371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6ba4b965-ffa6-4b04-bf40-d8f3f50a4f22 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:00.987629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ba4b965-ffa6-4b04-bf40-d8f3f50a4f22 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:00.993358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ba4b965-ffa6-4b04-bf40-d8f3f50a4f22 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:00.994393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ba4b965-ffa6-4b04-bf40-d8f3f50a4f22 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:00.996333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ba4b965-ffa6-4b04-bf40-d8f3f50a4f22 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:01.046614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-effcaf37-8281-4a57-b1c4-117019ce0a93 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:01.050579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-effcaf37-8281-4a57-b1c4-117019ce0a93 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:01.091915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-effcaf37-8281-4a57-b1c4-117019ce0a93 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:01.093676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-effcaf37-8281-4a57-b1c4-117019ce0a93 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:01.098689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-effcaf37-8281-4a57-b1c4-117019ce0a93 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:01.102864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-effcaf37-8281-4a57-b1c4-117019ce0a93 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:01.808375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6ba4b965-ffa6-4b04-bf40-d8f3f50a4f22 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:01.825226 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6ba4b965-ffa6-4b04-bf40-d8f3f50a4f22 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 0.884134 Jul 14 14:48:01.840399 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2013/3982] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:00 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:01.860743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-effcaf37-8281-4a57-b1c4-117019ce0a93 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:01.864615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:01.870608 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-effcaf37-8281-4a57-b1c4-117019ce0a93 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1521 microversion: 2.1 time: 0.832947 Jul 14 14:48:01.873090 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1970/3983] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:01 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1521 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:01.888227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9e7f4e5-5f9b-4a62-8b70-57c213c893d1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:01.888997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b9e7f4e5-5f9b-4a62-8b70-57c213c893d1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:01.915091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9e7f4e5-5f9b-4a62-8b70-57c213c893d1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:01.915548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9e7f4e5-5f9b-4a62-8b70-57c213c893d1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:01.925146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9e7f4e5-5f9b-4a62-8b70-57c213c893d1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:01.925714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9e7f4e5-5f9b-4a62-8b70-57c213c893d1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:02.246385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b9e7f4e5-5f9b-4a62-8b70-57c213c893d1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:02.260589 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b9e7f4e5-5f9b-4a62-8b70-57c213c893d1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1312 microversion: 2.1 time: 0.418038 Jul 14 14:48:02.263928 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2014/3984] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:01 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1312 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:02.844215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b55fb591-339e-4332-be24-6e83a69467e0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:02.844843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b55fb591-339e-4332-be24-6e83a69467e0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:02.859831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b55fb591-339e-4332-be24-6e83a69467e0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:02.860308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b55fb591-339e-4332-be24-6e83a69467e0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:02.869542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b55fb591-339e-4332-be24-6e83a69467e0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:02.871958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b55fb591-339e-4332-be24-6e83a69467e0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:02.896754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9581bd5f-6351-4899-ae8f-6379604bccbf tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:02.897596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9581bd5f-6351-4899-ae8f-6379604bccbf tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:02.927773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9581bd5f-6351-4899-ae8f-6379604bccbf tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:02.930774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9581bd5f-6351-4899-ae8f-6379604bccbf tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:02.935304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9581bd5f-6351-4899-ae8f-6379604bccbf tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:02.935920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9581bd5f-6351-4899-ae8f-6379604bccbf tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:03.443712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b55fb591-339e-4332-be24-6e83a69467e0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:03.459200 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b55fb591-339e-4332-be24-6e83a69467e0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 0.619399 Jul 14 14:48:03.465379 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1971/3985] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:02 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:03.490807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9581bd5f-6351-4899-ae8f-6379604bccbf tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:03.494843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5a86c3ec-5b5c-454b-911d-41d700a4b03b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:03.500294 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9581bd5f-6351-4899-ae8f-6379604bccbf tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1506 microversion: 2.1 time: 0.614707 Jul 14 14:48:03.502158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5a86c3ec-5b5c-454b-911d-41d700a4b03b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:03.508105 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2015/3986] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:02 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1506 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:03.533056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a86c3ec-5b5c-454b-911d-41d700a4b03b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:03.536521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e57d9e0f-06c1-4660-aec8-155c0f839206 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:03.538308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a86c3ec-5b5c-454b-911d-41d700a4b03b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:03.540614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e57d9e0f-06c1-4660-aec8-155c0f839206 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:03.546628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a86c3ec-5b5c-454b-911d-41d700a4b03b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:03.549563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a86c3ec-5b5c-454b-911d-41d700a4b03b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:03.588884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e57d9e0f-06c1-4660-aec8-155c0f839206 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:03.594909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e57d9e0f-06c1-4660-aec8-155c0f839206 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:03.599111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e57d9e0f-06c1-4660-aec8-155c0f839206 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:03.603449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e57d9e0f-06c1-4660-aec8-155c0f839206 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:04.001828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5a86c3ec-5b5c-454b-911d-41d700a4b03b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:04.012514 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5a86c3ec-5b5c-454b-911d-41d700a4b03b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1312 microversion: 2.1 time: 0.542389 Jul 14 14:48:04.018563 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1972/3987] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:03 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1312 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:04.027570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e57d9e0f-06c1-4660-aec8-155c0f839206 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:04.034220 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e57d9e0f-06c1-4660-aec8-155c0f839206 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 200 len: 1506 microversion: 2.1 time: 0.511127 Jul 14 14:48:04.047842 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2016/3988] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:03 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:04.060753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-41c44d43-5eaa-4488-b179-5b4aad344656 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:04.063227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-41c44d43-5eaa-4488-b179-5b4aad344656 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:04.074923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41c44d43-5eaa-4488-b179-5b4aad344656 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:04.075549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41c44d43-5eaa-4488-b179-5b4aad344656 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:04.080616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41c44d43-5eaa-4488-b179-5b4aad344656 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:04.082746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-41c44d43-5eaa-4488-b179-5b4aad344656 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:04.175927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-41c44d43-5eaa-4488-b179-5b4aad344656 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:48:04.490109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dabc65e3-b8cd-45f4-8bd6-302fbd28b908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:04.499341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dabc65e3-b8cd-45f4-8bd6-302fbd28b908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:04.519295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dabc65e3-b8cd-45f4-8bd6-302fbd28b908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:04.521366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dabc65e3-b8cd-45f4-8bd6-302fbd28b908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:04.522523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dabc65e3-b8cd-45f4-8bd6-302fbd28b908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:04.523337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dabc65e3-b8cd-45f4-8bd6-302fbd28b908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:04.540880 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-41c44d43-5eaa-4488-b179-5b4aad344656 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 204 len: 0 microversion: 2.1 time: 0.483735 Jul 14 14:48:04.553962 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1973/3989] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:48:04 2022] DELETE /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:48:04.812443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dabc65e3-b8cd-45f4-8bd6-302fbd28b908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:04.833180 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dabc65e3-b8cd-45f4-8bd6-302fbd28b908 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 0.353617 Jul 14 14:48:04.844466 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2017/3990] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:04 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:04.890971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-965607250", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "89eb577c-0684-494b-84d5-c6d4ce688beb"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:04.906356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-92076877", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19a7ef92-3b71-4a1b-b101-91e7276e71cb"}], "security_groups": [{"name": "tempest-securitygroup--1015827441"}], "key_name": "tempest-keypair-1088790826", "user_data": "}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:05.064063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] validate_networks() for [('89eb577c-0684-494b-84d5-c6d4ce688beb', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:48:05.091380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] validate_networks() for [('19a7ef92-3b71-4a1b-b101-91e7276e71cb', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:48:06.001772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:06.495416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:07.106623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:08.265765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:48:08.266271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:48:08.266820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:48:08.267244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:48:08.267651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:48:08.287082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:08.287822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:08.288800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:08.289445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:08.343627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:48:08.367816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for user 9260cbc32f1e423ab8ea4d06058b4050 and project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:48:08.411859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:48:08.414275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:48:08.565305 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-37c60b98-5ca7-46f5-8493-704180fee81d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.669904 Jul 14 14:48:08.571231 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2018/3991] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:48:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 3679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:48:08.584462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-54a3f8d2-05d3-42ba-a2f6-68f9a7624ff9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:08.586595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-54a3f8d2-05d3-42ba-a2f6-68f9a7624ff9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:08.612095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54a3f8d2-05d3-42ba-a2f6-68f9a7624ff9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:08.613730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54a3f8d2-05d3-42ba-a2f6-68f9a7624ff9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:08.617432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54a3f8d2-05d3-42ba-a2f6-68f9a7624ff9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:08.617974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54a3f8d2-05d3-42ba-a2f6-68f9a7624ff9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:09.495472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-54a3f8d2-05d3-42ba-a2f6-68f9a7624ff9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:09.519131 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-54a3f8d2-05d3-42ba-a2f6-68f9a7624ff9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.944873 Jul 14 14:48:09.523322 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2019/3992] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:08 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:09.543745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-09d59553-f0db-400a-a365-47b5879a74b3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.555210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-09d59553-f0db-400a-a365-47b5879a74b3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:09.573749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09d59553-f0db-400a-a365-47b5879a74b3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:09.578748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09d59553-f0db-400a-a365-47b5879a74b3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:09.582111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09d59553-f0db-400a-a365-47b5879a74b3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:09.584527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09d59553-f0db-400a-a365-47b5879a74b3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.150388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:48:10.150388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:48:10.150860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:48:10.151254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:48:10.151884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:48:10.188371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:10.188765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.189587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:10.190036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.274177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Getting quotas for project 50f8ea81533f4e1e8c98b5c46718f29f. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:48:10.296183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Getting quotas for user 55bc09bf29a243dfa43fa12663cfada8 and project 50f8ea81533f4e1e8c98b5c46718f29f. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:48:10.354779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:48:10.372231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:48:10.391954 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-09d59553-f0db-400a-a365-47b5879a74b3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:10.400659 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-09d59553-f0db-400a-a365-47b5879a74b3 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 0.875700 Jul 14 14:48:10.405393 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2020/3993] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:10.405393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e2b994a-ce7d-4413-a00d-316d24b2ec7c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:10.415554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0e2b994a-ce7d-4413-a00d-316d24b2ec7c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:10.437686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e2b994a-ce7d-4413-a00d-316d24b2ec7c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:10.439332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e2b994a-ce7d-4413-a00d-316d24b2ec7c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.440319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e2b994a-ce7d-4413-a00d-316d24b2ec7c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:10.444856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e2b994a-ce7d-4413-a00d-316d24b2ec7c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.530541 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-925dc62c-cb44-445a-a66e-004eab57f3c6 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.644115 Jul 14 14:48:10.541165 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1974/3994] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:48:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 5654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:48:10.547233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-4dc7c9ff-9e4c-47ce-be03-a91ac6d34a2c req-58d65cff-d64d-4644-8311-332e0afa7bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9f94f5-3d27-4f76-b948-c390f05bc81c", "name": "network-vif-deleted", "tag": "deef751d-da5b-41a2-b224-542470608e30"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:10.576071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4dc7c9ff-9e4c-47ce-be03-a91ac6d34a2c req-58d65cff-d64d-4644-8311-332e0afa7bbd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:10.579578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4dc7c9ff-9e4c-47ce-be03-a91ac6d34a2c req-58d65cff-d64d-4644-8311-332e0afa7bbd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.611847 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-4dc7c9ff-9e4c-47ce-be03-a91ac6d34a2c req-58d65cff-d64d-4644-8311-332e0afa7bbd service nova] Creating event network-vif-deleted:deef751d-da5b-41a2-b224-542470608e30 for instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c on n-h1-767704-28 Jul 14 14:48:10.613314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0e2b994a-ce7d-4413-a00d-316d24b2ec7c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:10.628641 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0e2b994a-ce7d-4413-a00d-316d24b2ec7c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1236 microversion: 2.1 time: 0.220119 Jul 14 14:48:10.629793 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2021/3995] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:10 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1236 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:10.640150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-edd60bdd-f90f-45f1-ae82-0f2bb6905dde tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:10.642015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-edd60bdd-f90f-45f1-ae82-0f2bb6905dde tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:10.644007 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-4dc7c9ff-9e4c-47ce-be03-a91ac6d34a2c req-58d65cff-d64d-4644-8311-332e0afa7bbd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094879 Jul 14 14:48:10.647456 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1975/3996] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:10.668099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-18b2028c-ebad-416f-944c-2c2fad1c872a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:10.671722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-18b2028c-ebad-416f-944c-2c2fad1c872a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:10.680174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-edd60bdd-f90f-45f1-ae82-0f2bb6905dde tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:10.682676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-edd60bdd-f90f-45f1-ae82-0f2bb6905dde tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.686097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-edd60bdd-f90f-45f1-ae82-0f2bb6905dde tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:10.687898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-edd60bdd-f90f-45f1-ae82-0f2bb6905dde tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.800901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-18b2028c-ebad-416f-944c-2c2fad1c872a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:10.808246 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-18b2028c-ebad-416f-944c-2c2fad1c872a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1217 microversion: 2.1 time: 0.157851 Jul 14 14:48:10.817816 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1976/3997] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:10 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:11.019145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-edd60bdd-f90f-45f1-ae82-0f2bb6905dde tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:11.040713 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-edd60bdd-f90f-45f1-ae82-0f2bb6905dde tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.409427 Jul 14 14:48:11.041801 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2022/3998] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:10 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:11.422531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e4e0f20-97a5-49c1-8cd7-7672db7274ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:11.423148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5e4e0f20-97a5-49c1-8cd7-7672db7274ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:11.442289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e4e0f20-97a5-49c1-8cd7-7672db7274ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.442794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e4e0f20-97a5-49c1-8cd7-7672db7274ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.443646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e4e0f20-97a5-49c1-8cd7-7672db7274ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.444086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e4e0f20-97a5-49c1-8cd7-7672db7274ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.646420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c3be043f-e831-40d8-9bc7-357858765476 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:11.647082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c3be043f-e831-40d8-9bc7-357858765476 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:11.662316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3be043f-e831-40d8-9bc7-357858765476 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.662772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3be043f-e831-40d8-9bc7-357858765476 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.663566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3be043f-e831-40d8-9bc7-357858765476 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.664011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3be043f-e831-40d8-9bc7-357858765476 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.850714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c3be043f-e831-40d8-9bc7-357858765476 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:11.854667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:11.869675 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c3be043f-e831-40d8-9bc7-357858765476 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1298 microversion: 2.1 time: 0.226976 Jul 14 14:48:11.870618 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2023/3999] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:11 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1298 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:11.882885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b4d03ce-1f9b-490c-a1c6-2180cf1a5563 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:11.886877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b4d03ce-1f9b-490c-a1c6-2180cf1a5563 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:11.903107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5e4e0f20-97a5-49c1-8cd7-7672db7274ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:11.917143 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5e4e0f20-97a5-49c1-8cd7-7672db7274ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1507 microversion: 2.1 time: 0.498960 Jul 14 14:48:11.917743 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1977/4000] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:11 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:11.922731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b4d03ce-1f9b-490c-a1c6-2180cf1a5563 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.923191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b4d03ce-1f9b-490c-a1c6-2180cf1a5563 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.932193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b4d03ce-1f9b-490c-a1c6-2180cf1a5563 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.932670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b4d03ce-1f9b-490c-a1c6-2180cf1a5563 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:12.047093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9b4d03ce-1f9b-490c-a1c6-2180cf1a5563 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:12.060091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d64a98fb-0410-406b-bbdc-4c8c35e28bb9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:12.060719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d64a98fb-0410-406b-bbdc-4c8c35e28bb9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:12.071702 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9b4d03ce-1f9b-490c-a1c6-2180cf1a5563 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1213 microversion: 2.1 time: 0.196284 Jul 14 14:48:12.072971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d64a98fb-0410-406b-bbdc-4c8c35e28bb9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:12.073438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d64a98fb-0410-406b-bbdc-4c8c35e28bb9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:12.074355 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2024/4001] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:11 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:12.075545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d64a98fb-0410-406b-bbdc-4c8c35e28bb9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:12.076182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d64a98fb-0410-406b-bbdc-4c8c35e28bb9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:12.415337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d64a98fb-0410-406b-bbdc-4c8c35e28bb9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:12.433687 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d64a98fb-0410-406b-bbdc-4c8c35e28bb9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.378733 Jul 14 14:48:12.440382 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1978/4002] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:12 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:12.788567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b7f84d26-6262-4052-8f75-28c121cf04d7 req-58d02144-1c04-43a9-9e4c-7aefa4a62271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2c99c7-5253-4416-80df-b1350d634e9d", "tag": "86ca3bdc-6ff5-4dd9-b14c-2c27098964ee"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:12.847879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b7f84d26-6262-4052-8f75-28c121cf04d7 req-58d02144-1c04-43a9-9e4c-7aefa4a62271 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:12.848581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b7f84d26-6262-4052-8f75-28c121cf04d7 req-58d02144-1c04-43a9-9e4c-7aefa4a62271 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:12.854213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-8e6f4533-c7d3-451d-a43b-bb459b4252bf req-24c5ea2d-dfb7-45d1-ac38-75c6276bac3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2c99c7-5253-4416-80df-b1350d634e9d", "tag": "9ebca414-fe51-4e00-8c95-42f3e92de3c7"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:12.884130 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b7f84d26-6262-4052-8f75-28c121cf04d7 req-58d02144-1c04-43a9-9e4c-7aefa4a62271 service nova] Creating event network-changed:86ca3bdc-6ff5-4dd9-b14c-2c27098964ee for instance 8e2c99c7-5253-4416-80df-b1350d634e9d on n-h2-767704-28 Jul 14 14:48:12.894864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8e6f4533-c7d3-451d-a43b-bb459b4252bf req-24c5ea2d-dfb7-45d1-ac38-75c6276bac3b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:12.895426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8e6f4533-c7d3-451d-a43b-bb459b4252bf req-24c5ea2d-dfb7-45d1-ac38-75c6276bac3b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:12.900003 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b7f84d26-6262-4052-8f75-28c121cf04d7 req-58d02144-1c04-43a9-9e4c-7aefa4a62271 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120668 Jul 14 14:48:12.900969 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2025/4003] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:12.913595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b200980a-1232-4747-9d94-0d8e3c2594ff tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:12.917887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b200980a-1232-4747-9d94-0d8e3c2594ff tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:12.918622 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8e6f4533-c7d3-451d-a43b-bb459b4252bf req-24c5ea2d-dfb7-45d1-ac38-75c6276bac3b service nova] Creating event network-changed:9ebca414-fe51-4e00-8c95-42f3e92de3c7 for instance 8e2c99c7-5253-4416-80df-b1350d634e9d on n-h2-767704-28 Jul 14 14:48:12.927245 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-8e6f4533-c7d3-451d-a43b-bb459b4252bf req-24c5ea2d-dfb7-45d1-ac38-75c6276bac3b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089741 Jul 14 14:48:12.928689 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1979/4004] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:12.932288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b200980a-1232-4747-9d94-0d8e3c2594ff tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:12.933971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b200980a-1232-4747-9d94-0d8e3c2594ff tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:12.936753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b200980a-1232-4747-9d94-0d8e3c2594ff tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:12.937364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b200980a-1232-4747-9d94-0d8e3c2594ff tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:12.939250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0152d13d-64fd-4783-a141-9b1e6a148ecd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:12.940201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0152d13d-64fd-4783-a141-9b1e6a148ecd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:12.949788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0152d13d-64fd-4783-a141-9b1e6a148ecd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:12.950875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0152d13d-64fd-4783-a141-9b1e6a148ecd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:12.953320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0152d13d-64fd-4783-a141-9b1e6a148ecd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:12.954693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0152d13d-64fd-4783-a141-9b1e6a148ecd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:13.177267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b200980a-1232-4747-9d94-0d8e3c2594ff tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:13.197462 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b200980a-1232-4747-9d94-0d8e3c2594ff tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1298 microversion: 2.1 time: 0.290779 Jul 14 14:48:13.198198 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2026/4005] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:12 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1298 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:13.221361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f66c22d-a481-4f14-b25b-527d99343ec5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:13.222145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3f66c22d-a481-4f14-b25b-527d99343ec5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:13.232008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f66c22d-a481-4f14-b25b-527d99343ec5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:13.236857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f66c22d-a481-4f14-b25b-527d99343ec5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:13.239110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f66c22d-a481-4f14-b25b-527d99343ec5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:13.239683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f66c22d-a481-4f14-b25b-527d99343ec5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:13.352503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0152d13d-64fd-4783-a141-9b1e6a148ecd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:13.362827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3f66c22d-a481-4f14-b25b-527d99343ec5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:13.365203 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0152d13d-64fd-4783-a141-9b1e6a148ecd tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1507 microversion: 2.1 time: 0.433964 Jul 14 14:48:13.366436 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1980/4006] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:12 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1507 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:13.375715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f0d32996-9d42-4394-a3db-9537307fcca7 req-df2a2f3b-0aa8-4bd3-b4bf-85beed12808d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be684ea-99fc-4c45-86e4-52e39f39a2b6", "name": "network-vif-unplugged", "status": "completed", "tag": "b7327c3d-0492-4493-b434-a4db3c983c3d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:13.383199 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f66c22d-a481-4f14-b25b-527d99343ec5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1275 microversion: 2.1 time: 0.179268 Jul 14 14:48:13.384219 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2027/4007] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:13 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:13.391452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f0d32996-9d42-4394-a3db-9537307fcca7 req-df2a2f3b-0aa8-4bd3-b4bf-85beed12808d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:13.392145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f0d32996-9d42-4394-a3db-9537307fcca7 req-df2a2f3b-0aa8-4bd3-b4bf-85beed12808d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:13.407673 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f0d32996-9d42-4394-a3db-9537307fcca7 req-df2a2f3b-0aa8-4bd3-b4bf-85beed12808d service nova] Creating event network-vif-unplugged:b7327c3d-0492-4493-b434-a4db3c983c3d for instance 4be684ea-99fc-4c45-86e4-52e39f39a2b6 on n-h2-767704-28 Jul 14 14:48:13.413309 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f0d32996-9d42-4394-a3db-9537307fcca7 req-df2a2f3b-0aa8-4bd3-b4bf-85beed12808d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044983 Jul 14 14:48:13.414541 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1981/4008] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:13.462546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-960b8c62-9929-4803-8336-ceb695721f43 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:13.463765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-960b8c62-9929-4803-8336-ceb695721f43 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:13.472393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-960b8c62-9929-4803-8336-ceb695721f43 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:13.473344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-960b8c62-9929-4803-8336-ceb695721f43 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:13.474377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-960b8c62-9929-4803-8336-ceb695721f43 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:13.475538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-960b8c62-9929-4803-8336-ceb695721f43 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:13.754208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-960b8c62-9929-4803-8336-ceb695721f43 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:13.762610 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-960b8c62-9929-4803-8336-ceb695721f43 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.310615 Jul 14 14:48:13.772298 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2028/4009] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:13 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:14.216851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e15fbce9-cad5-4ad1-9ad2-e37d69280264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:14.221590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e15fbce9-cad5-4ad1-9ad2-e37d69280264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:14.236902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e15fbce9-cad5-4ad1-9ad2-e37d69280264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:14.237832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e15fbce9-cad5-4ad1-9ad2-e37d69280264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.238930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e15fbce9-cad5-4ad1-9ad2-e37d69280264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:14.239735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e15fbce9-cad5-4ad1-9ad2-e37d69280264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.384614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f36580c1-0b43-4448-86b2-3447957f9225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:14.385297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f36580c1-0b43-4448-86b2-3447957f9225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:14.400386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f36580c1-0b43-4448-86b2-3447957f9225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:14.402613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f36580c1-0b43-4448-86b2-3447957f9225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.412061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f36580c1-0b43-4448-86b2-3447957f9225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:14.412707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f36580c1-0b43-4448-86b2-3447957f9225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.542532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e15fbce9-cad5-4ad1-9ad2-e37d69280264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:14.562337 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e15fbce9-cad5-4ad1-9ad2-e37d69280264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1366 microversion: 2.1 time: 0.351172 Jul 14 14:48:14.565014 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1982/4010] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:14 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:14.569754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-657773a4-9d80-4d8c-aee8-68f47319596d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:14.570506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-657773a4-9d80-4d8c-aee8-68f47319596d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:14.578454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-657773a4-9d80-4d8c-aee8-68f47319596d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:14.579062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-657773a4-9d80-4d8c-aee8-68f47319596d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.580114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-657773a4-9d80-4d8c-aee8-68f47319596d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:14.580827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-657773a4-9d80-4d8c-aee8-68f47319596d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.629851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f36580c1-0b43-4448-86b2-3447957f9225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:14.657171 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f36580c1-0b43-4448-86b2-3447957f9225 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1507 microversion: 2.1 time: 0.276351 Jul 14 14:48:14.657777 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2029/4011] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:14 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:14.783829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a2a05573-a837-4dba-849b-dc4d3f521567 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:14.785462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a2a05573-a837-4dba-849b-dc4d3f521567 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:14.795361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2a05573-a837-4dba-849b-dc4d3f521567 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:14.796585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2a05573-a837-4dba-849b-dc4d3f521567 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.797710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2a05573-a837-4dba-849b-dc4d3f521567 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:14.798308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2a05573-a837-4dba-849b-dc4d3f521567 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.857251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-657773a4-9d80-4d8c-aee8-68f47319596d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:14.868872 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-657773a4-9d80-4d8c-aee8-68f47319596d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.303448 Jul 14 14:48:14.869853 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1983/4012] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:14 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:15.580768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a3138387-3a70-4303-a45e-d89bf50b84aa tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:15.581492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a3138387-3a70-4303-a45e-d89bf50b84aa tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:15.609015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3138387-3a70-4303-a45e-d89bf50b84aa tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:15.609486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3138387-3a70-4303-a45e-d89bf50b84aa tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:15.610299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3138387-3a70-4303-a45e-d89bf50b84aa tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:15.610753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3138387-3a70-4303-a45e-d89bf50b84aa tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:15.917785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a2a05573-a837-4dba-849b-dc4d3f521567 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:15.935964 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a2a05573-a837-4dba-849b-dc4d3f521567 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 1.154138 Jul 14 14:48:15.939465 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2030/4013] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:14 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:15.975476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f658a84-6de0-45de-a479-e6905fbdf937 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:15.976396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f658a84-6de0-45de-a479-e6905fbdf937 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:15.995832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f658a84-6de0-45de-a479-e6905fbdf937 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:15.996291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f658a84-6de0-45de-a479-e6905fbdf937 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:15.998143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f658a84-6de0-45de-a479-e6905fbdf937 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.001570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f658a84-6de0-45de-a479-e6905fbdf937 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:16.319311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a3138387-3a70-4303-a45e-d89bf50b84aa tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:16.330090 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a3138387-3a70-4303-a45e-d89bf50b84aa tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1366 microversion: 2.1 time: 0.754223 Jul 14 14:48:16.330651 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1984/4014] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:15 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1366 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:16.360334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f26b413-41bc-4c36-bf77-c72b20406800 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:16.364510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8f26b413-41bc-4c36-bf77-c72b20406800 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:16.399226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f26b413-41bc-4c36-bf77-c72b20406800 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.401273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f26b413-41bc-4c36-bf77-c72b20406800 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:16.402148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f26b413-41bc-4c36-bf77-c72b20406800 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.402607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f26b413-41bc-4c36-bf77-c72b20406800 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:16.633844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f658a84-6de0-45de-a479-e6905fbdf937 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:16.649331 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f658a84-6de0-45de-a479-e6905fbdf937 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 200 len: 1510 microversion: 2.1 time: 0.699286 Jul 14 14:48:16.649969 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2031/4015] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:15 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 1510 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:16.676660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-db21eed2-9e06-454a-991e-ce016ec5ab25 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:16.677375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-db21eed2-9e06-454a-991e-ce016ec5ab25 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:16.697498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db21eed2-9e06-454a-991e-ce016ec5ab25 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.697966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db21eed2-9e06-454a-991e-ce016ec5ab25 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:16.704225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db21eed2-9e06-454a-991e-ce016ec5ab25 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.704934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db21eed2-9e06-454a-991e-ce016ec5ab25 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:16.919457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f26b413-41bc-4c36-bf77-c72b20406800 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:16.933467 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8f26b413-41bc-4c36-bf77-c72b20406800 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.586682 Jul 14 14:48:16.942973 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1985/4016] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:16 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:16.955692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-28102440-c804-44eb-a16b-6e533ad99e54 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:16.956332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-28102440-c804-44eb-a16b-6e533ad99e54 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:16.986382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28102440-c804-44eb-a16b-6e533ad99e54 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.987606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28102440-c804-44eb-a16b-6e533ad99e54 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:16.989517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28102440-c804-44eb-a16b-6e533ad99e54 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.990227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28102440-c804-44eb-a16b-6e533ad99e54 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:17.445203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-db21eed2-9e06-454a-991e-ce016ec5ab25 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:17.457479 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-db21eed2-9e06-454a-991e-ce016ec5ab25 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.785520 Jul 14 14:48:17.458675 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2032/4017] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:16 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:17.463673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-924a68aa-0e66-4d3f-8415-6081205ce07a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:17.480633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-924a68aa-0e66-4d3f-8415-6081205ce07a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:17.501889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-924a68aa-0e66-4d3f-8415-6081205ce07a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:17.503050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-924a68aa-0e66-4d3f-8415-6081205ce07a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:17.504049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-924a68aa-0e66-4d3f-8415-6081205ce07a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:17.504667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-924a68aa-0e66-4d3f-8415-6081205ce07a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:17.619971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-28102440-c804-44eb-a16b-6e533ad99e54 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:17.630653 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-28102440-c804-44eb-a16b-6e533ad99e54 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.679019 Jul 14 14:48:17.631995 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1986/4018] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:16 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:17.662053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-26e1bddc-2a2d-4878-86f7-e17f93663da0 req-93f445e8-3e9a-479d-bab5-d97ce064db9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2c99c7-5253-4416-80df-b1350d634e9d", "tag": "5a927ba1-7c5a-4bd4-b273-0b9328af2241"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:17.689845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-26e1bddc-2a2d-4878-86f7-e17f93663da0 req-93f445e8-3e9a-479d-bab5-d97ce064db9e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:17.690583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-26e1bddc-2a2d-4878-86f7-e17f93663da0 req-93f445e8-3e9a-479d-bab5-d97ce064db9e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:17.718720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-924a68aa-0e66-4d3f-8415-6081205ce07a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lazy-loading 'services' on Instance uuid a9fadee3-2871-4c8e-adda-e95d99e56a1a {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:48:17.737494 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-26e1bddc-2a2d-4878-86f7-e17f93663da0 req-93f445e8-3e9a-479d-bab5-d97ce064db9e service nova] Creating event network-changed:5a927ba1-7c5a-4bd4-b273-0b9328af2241 for instance 8e2c99c7-5253-4416-80df-b1350d634e9d on n-h2-767704-28 Jul 14 14:48:17.752271 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-26e1bddc-2a2d-4878-86f7-e17f93663da0 req-93f445e8-3e9a-479d-bab5-d97ce064db9e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118408 Jul 14 14:48:17.753658 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1987/4019] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:17.775041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3fc1322f-c2c1-4376-a320-e5680642d46b req-15409bb2-bd41-4262-9742-e28cf78861ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fba14e7e-dbff-47d0-9515-3acd4c797b52", "tag": "2b8329e6-84df-4e45-8111-31bbe81da945"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:17.807719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3fc1322f-c2c1-4376-a320-e5680642d46b req-15409bb2-bd41-4262-9742-e28cf78861ea service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:17.808189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3fc1322f-c2c1-4376-a320-e5680642d46b req-15409bb2-bd41-4262-9742-e28cf78861ea service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:17.836928 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3fc1322f-c2c1-4376-a320-e5680642d46b req-15409bb2-bd41-4262-9742-e28cf78861ea service nova] Creating event network-changed:2b8329e6-84df-4e45-8111-31bbe81da945 for instance fba14e7e-dbff-47d0-9515-3acd4c797b52 on n-h1-767704-28 Jul 14 14:48:17.845658 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3fc1322f-c2c1-4376-a320-e5680642d46b req-15409bb2-bd41-4262-9742-e28cf78861ea service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089441 Jul 14 14:48:17.846466 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1988/4020] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:17.864161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cf3208a3-c0e3-4f10-b4de-415936434820 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:17.865128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cf3208a3-c0e3-4f10-b4de-415936434820 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:17.879801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf3208a3-c0e3-4f10-b4de-415936434820 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:17.880290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf3208a3-c0e3-4f10-b4de-415936434820 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:17.881122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf3208a3-c0e3-4f10-b4de-415936434820 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:17.881568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf3208a3-c0e3-4f10-b4de-415936434820 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:17.911630 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-924a68aa-0e66-4d3f-8415-6081205ce07a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments/e7e30b86-f9cc-4b8f-8c90-4a8af44af5c6" status: 202 len: 0 microversion: 2.1 time: 0.451493 Jul 14 14:48:17.923072 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2033/4021] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 14:48:17 2022] DELETE /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments/e7e30b86-f9cc-4b8f-8c90-4a8af44af5c6 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:48:17.946560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-55021b44-c5cf-4143-ba45-9a39059e30ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:17.948829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-55021b44-c5cf-4143-ba45-9a39059e30ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:17.990914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55021b44-c5cf-4143-ba45-9a39059e30ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:17.991742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55021b44-c5cf-4143-ba45-9a39059e30ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:17.995888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55021b44-c5cf-4143-ba45-9a39059e30ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:17.996834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55021b44-c5cf-4143-ba45-9a39059e30ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.311857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:18.388816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cf3208a3-c0e3-4f10-b4de-415936434820 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:18.390361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:18.397354 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cf3208a3-c0e3-4f10-b4de-415936434820 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1366 microversion: 2.1 time: 0.543844 Jul 14 14:48:18.398654 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1989/4022] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:17 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1366 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:18.403787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fa6dd861-871a-4bf7-aa91-b2f112eb7a55 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:18.405751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fa6dd861-871a-4bf7-aa91-b2f112eb7a55 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:18.414356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-55021b44-c5cf-4143-ba45-9a39059e30ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:18.422657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa6dd861-871a-4bf7-aa91-b2f112eb7a55 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.427244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa6dd861-871a-4bf7-aa91-b2f112eb7a55 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.429196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa6dd861-871a-4bf7-aa91-b2f112eb7a55 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.430400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa6dd861-871a-4bf7-aa91-b2f112eb7a55 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.439202 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-55021b44-c5cf-4143-ba45-9a39059e30ba tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.511892 Jul 14 14:48:18.440296 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2034/4023] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:17 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:18.453687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c64a9c3c-e8bc-465e-bf17-d8e3f79f18fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:18.459430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c64a9c3c-e8bc-465e-bf17-d8e3f79f18fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:18.471952 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c64a9c3c-e8bc-465e-bf17-d8e3f79f18fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.472420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c64a9c3c-e8bc-465e-bf17-d8e3f79f18fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.478111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c64a9c3c-e8bc-465e-bf17-d8e3f79f18fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.479245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c64a9c3c-e8bc-465e-bf17-d8e3f79f18fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.487659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:18.494267 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fa6dd861-871a-4bf7-aa91-b2f112eb7a55 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094095 Jul 14 14:48:18.499229 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1990/4024] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:48:18 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:18.505601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6235ff58-003b-4aa6-9bb0-adc6bdd2e95e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:18.506473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6235ff58-003b-4aa6-9bb0-adc6bdd2e95e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:18.515640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6235ff58-003b-4aa6-9bb0-adc6bdd2e95e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.520920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6235ff58-003b-4aa6-9bb0-adc6bdd2e95e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.521798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6235ff58-003b-4aa6-9bb0-adc6bdd2e95e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.522237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6235ff58-003b-4aa6-9bb0-adc6bdd2e95e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.884098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c64a9c3c-e8bc-465e-bf17-d8e3f79f18fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:18.910506 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c64a9c3c-e8bc-465e-bf17-d8e3f79f18fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.466089 Jul 14 14:48:18.912591 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2035/4025] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:18 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:18.922317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6235ff58-003b-4aa6-9bb0-adc6bdd2e95e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:18.928248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bf95fe57-479d-4233-9295-29eeeb247536 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:18.929059 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6235ff58-003b-4aa6-9bb0-adc6bdd2e95e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.428282 Jul 14 14:48:18.929470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bf95fe57-479d-4233-9295-29eeeb247536 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:18.934970 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1991/4026] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:18 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:18.938483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf95fe57-479d-4233-9295-29eeeb247536 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.938971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf95fe57-479d-4233-9295-29eeeb247536 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.939994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf95fe57-479d-4233-9295-29eeeb247536 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.940475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf95fe57-479d-4233-9295-29eeeb247536 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.950528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a224b228-1342-402a-a59c-ffb275a8a04f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:18.951664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a224b228-1342-402a-a59c-ffb275a8a04f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:18.959323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a224b228-1342-402a-a59c-ffb275a8a04f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.963677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a224b228-1342-402a-a59c-ffb275a8a04f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.964806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a224b228-1342-402a-a59c-ffb275a8a04f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.965508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a224b228-1342-402a-a59c-ffb275a8a04f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:19.613081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a224b228-1342-402a-a59c-ffb275a8a04f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:19.621894 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a224b228-1342-402a-a59c-ffb275a8a04f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.676940 Jul 14 14:48:19.631765 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1992/4027] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:18 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:19.631765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d66729f4-c322-41ef-b00b-645e903e7880 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:19.631765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d66729f4-c322-41ef-b00b-645e903e7880 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:19.635046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d66729f4-c322-41ef-b00b-645e903e7880 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:19.636037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d66729f4-c322-41ef-b00b-645e903e7880 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:19.637004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d66729f4-c322-41ef-b00b-645e903e7880 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:19.637594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d66729f4-c322-41ef-b00b-645e903e7880 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:19.649496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bf95fe57-479d-4233-9295-29eeeb247536 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:19.662730 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bf95fe57-479d-4233-9295-29eeeb247536 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.738227 Jul 14 14:48:19.663352 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2036/4028] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:18 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:19.669394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2e736385-8e2e-4d3c-99c3-7c2bfad55b0d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:19.671180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2e736385-8e2e-4d3c-99c3-7c2bfad55b0d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:19.678164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e736385-8e2e-4d3c-99c3-7c2bfad55b0d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:19.678890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e736385-8e2e-4d3c-99c3-7c2bfad55b0d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:19.680251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e736385-8e2e-4d3c-99c3-7c2bfad55b0d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:19.680910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e736385-8e2e-4d3c-99c3-7c2bfad55b0d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:19.718553 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2e736385-8e2e-4d3c-99c3-7c2bfad55b0d tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053476 Jul 14 14:48:19.725894 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2037/4029] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:48:19 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:19.731427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e44a41f7-9ad6-4532-aa11-80db87fd89d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:19.739527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e44a41f7-9ad6-4532-aa11-80db87fd89d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:19.740279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e44a41f7-9ad6-4532-aa11-80db87fd89d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:19.766109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e44a41f7-9ad6-4532-aa11-80db87fd89d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Going to try to stop instance {{(pid=119512) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:48:19.849326 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e44a41f7-9ad6-4532-aa11-80db87fd89d2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.121242 Jul 14 14:48:19.850041 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2038/4030] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:48:19 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:48:19.859150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f37e41c-03c9-463a-b872-68a999c7754a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:19.864657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f37e41c-03c9-463a-b872-68a999c7754a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:19.881479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:19.883300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f37e41c-03c9-463a-b872-68a999c7754a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:19.883760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f37e41c-03c9-463a-b872-68a999c7754a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:19.884562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f37e41c-03c9-463a-b872-68a999c7754a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:19.885032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f37e41c-03c9-463a-b872-68a999c7754a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:19.932698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:20.050126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d66729f4-c322-41ef-b00b-645e903e7880 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:20.063806 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d66729f4-c322-41ef-b00b-645e903e7880 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1366 microversion: 2.1 time: 0.439677 Jul 14 14:48:20.064845 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1993/4031] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:19 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1366 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:20.079162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-60ae6530-aad9-4025-b4a6-960995cf8ff7 req-44b87c91-fb97-4d9b-9168-bb2593ea8907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5", "tag": "8bf12488-bd78-4a9f-82af-678062508fea"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:20.088617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-60ae6530-aad9-4025-b4a6-960995cf8ff7 req-44b87c91-fb97-4d9b-9168-bb2593ea8907 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:20.089361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-60ae6530-aad9-4025-b4a6-960995cf8ff7 req-44b87c91-fb97-4d9b-9168-bb2593ea8907 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:20.103519 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-60ae6530-aad9-4025-b4a6-960995cf8ff7 req-44b87c91-fb97-4d9b-9168-bb2593ea8907 service nova] Creating event network-changed:8bf12488-bd78-4a9f-82af-678062508fea for instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 on n-h1-767704-28 Jul 14 14:48:20.110964 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-60ae6530-aad9-4025-b4a6-960995cf8ff7 req-44b87c91-fb97-4d9b-9168-bb2593ea8907 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044042 Jul 14 14:48:20.112127 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1994/4032] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:20.117674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7a4e3ca1-8cfc-428a-b28f-c594bc30bd58 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:20.118625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7a4e3ca1-8cfc-428a-b28f-c594bc30bd58 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:20.126592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a4e3ca1-8cfc-428a-b28f-c594bc30bd58 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:20.127365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a4e3ca1-8cfc-428a-b28f-c594bc30bd58 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:20.128505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a4e3ca1-8cfc-428a-b28f-c594bc30bd58 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:20.129306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a4e3ca1-8cfc-428a-b28f-c594bc30bd58 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:20.231162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:20.498325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f37e41c-03c9-463a-b872-68a999c7754a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:20.507079 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f37e41c-03c9-463a-b872-68a999c7754a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1681 microversion: 2.1 time: 0.652674 Jul 14 14:48:20.510365 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2039/4033] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:19 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1681 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:20.539462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7a4e3ca1-8cfc-428a-b28f-c594bc30bd58 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:20.554215 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7a4e3ca1-8cfc-428a-b28f-c594bc30bd58 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.440677 Jul 14 14:48:20.555708 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1995/4034] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:20 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:20.685371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a4a4e562-7e95-4eb7-bba9-c685dffa98d8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:20.687785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a4a4e562-7e95-4eb7-bba9-c685dffa98d8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:20.701347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4a4e562-7e95-4eb7-bba9-c685dffa98d8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:20.702135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4a4e562-7e95-4eb7-bba9-c685dffa98d8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:20.703001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4a4e562-7e95-4eb7-bba9-c685dffa98d8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:20.703452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4a4e562-7e95-4eb7-bba9-c685dffa98d8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:20.731438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-480da8ae-c1fe-4254-af65-7d8099b10d8b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:20.732440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-480da8ae-c1fe-4254-af65-7d8099b10d8b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:20.754572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-480da8ae-c1fe-4254-af65-7d8099b10d8b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:20.755064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-480da8ae-c1fe-4254-af65-7d8099b10d8b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:20.755900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-480da8ae-c1fe-4254-af65-7d8099b10d8b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:20.756350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-480da8ae-c1fe-4254-af65-7d8099b10d8b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:20.805009 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-480da8ae-c1fe-4254-af65-7d8099b10d8b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072146 Jul 14 14:48:20.805009 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1996/4035] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:48:20 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:48:21.082929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5adae874-adf5-41d8-8ab6-e128fa12e0af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:21.083574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5adae874-adf5-41d8-8ab6-e128fa12e0af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:21.095203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:21.100982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5adae874-adf5-41d8-8ab6-e128fa12e0af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:21.101557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5adae874-adf5-41d8-8ab6-e128fa12e0af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:21.102415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5adae874-adf5-41d8-8ab6-e128fa12e0af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:21.102865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5adae874-adf5-41d8-8ab6-e128fa12e0af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:21.111946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a4a4e562-7e95-4eb7-bba9-c685dffa98d8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:21.130461 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a4a4e562-7e95-4eb7-bba9-c685dffa98d8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.449316 Jul 14 14:48:21.139070 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2040/4036] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:20 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:21.364712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5adae874-adf5-41d8-8ab6-e128fa12e0af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:21.372683 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5adae874-adf5-41d8-8ab6-e128fa12e0af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1366 microversion: 2.1 time: 0.295453 Jul 14 14:48:21.373296 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1997/4037] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:21 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:21.528293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-51b4b257-7360-4862-aa75-ae59acd99b1b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:21.530552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-51b4b257-7360-4862-aa75-ae59acd99b1b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:21.542443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51b4b257-7360-4862-aa75-ae59acd99b1b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:21.543723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51b4b257-7360-4862-aa75-ae59acd99b1b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:21.546722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51b4b257-7360-4862-aa75-ae59acd99b1b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:21.547553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51b4b257-7360-4862-aa75-ae59acd99b1b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:21.574081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-94d45ebc-0ff0-48e0-bc11-039a0e9544c4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:21.575775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-94d45ebc-0ff0-48e0-bc11-039a0e9544c4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:21.588673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94d45ebc-0ff0-48e0-bc11-039a0e9544c4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:21.589512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94d45ebc-0ff0-48e0-bc11-039a0e9544c4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:21.590596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94d45ebc-0ff0-48e0-bc11-039a0e9544c4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:21.591413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94d45ebc-0ff0-48e0-bc11-039a0e9544c4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:21.831862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-51b4b257-7360-4862-aa75-ae59acd99b1b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:21.839445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-94d45ebc-0ff0-48e0-bc11-039a0e9544c4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:21.843136 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-51b4b257-7360-4862-aa75-ae59acd99b1b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1681 microversion: 2.1 time: 0.320319 Jul 14 14:48:21.844340 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2041/4038] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:21 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1681 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:21.850908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8a6c1538-a1ac-4215-9d17-70bdaf2cb891 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:21.854127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8a6c1538-a1ac-4215-9d17-70bdaf2cb891 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:21.860043 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-94d45ebc-0ff0-48e0-bc11-039a0e9544c4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.291362 Jul 14 14:48:21.861788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a6c1538-a1ac-4215-9d17-70bdaf2cb891 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:21.862309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a6c1538-a1ac-4215-9d17-70bdaf2cb891 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:21.863076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a6c1538-a1ac-4215-9d17-70bdaf2cb891 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:21.863529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a6c1538-a1ac-4215-9d17-70bdaf2cb891 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:21.864971 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1998/4039] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:21 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:21.922689 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8a6c1538-a1ac-4215-9d17-70bdaf2cb891 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076784 Jul 14 14:48:21.924192 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2042/4040] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:48:21 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:22.156470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-16f6ab2c-d6ba-4f93-9213-cca85fe83bc2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:22.157176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-16f6ab2c-d6ba-4f93-9213-cca85fe83bc2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:22.168519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16f6ab2c-d6ba-4f93-9213-cca85fe83bc2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:22.169122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16f6ab2c-d6ba-4f93-9213-cca85fe83bc2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:22.169799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16f6ab2c-d6ba-4f93-9213-cca85fe83bc2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:22.170301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16f6ab2c-d6ba-4f93-9213-cca85fe83bc2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:22.392704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c0fbc96a-4b7f-460a-88e1-100dc35f9d09 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:22.394281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c0fbc96a-4b7f-460a-88e1-100dc35f9d09 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:22.407339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0fbc96a-4b7f-460a-88e1-100dc35f9d09 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:22.410874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0fbc96a-4b7f-460a-88e1-100dc35f9d09 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:22.411976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0fbc96a-4b7f-460a-88e1-100dc35f9d09 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:22.412632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0fbc96a-4b7f-460a-88e1-100dc35f9d09 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:22.554450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-16f6ab2c-d6ba-4f93-9213-cca85fe83bc2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:22.601222 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-16f6ab2c-d6ba-4f93-9213-cca85fe83bc2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.434144 Jul 14 14:48:22.604756 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 1999/4041] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:22 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:22.728074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c0fbc96a-4b7f-460a-88e1-100dc35f9d09 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:22.753253 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c0fbc96a-4b7f-460a-88e1-100dc35f9d09 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1366 microversion: 2.1 time: 0.366822 Jul 14 14:48:22.764410 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2043/4042] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:22 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:22.872085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f596d011-b1dd-48d2-84b8-05ee4c551b82 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:22.874703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f596d011-b1dd-48d2-84b8-05ee4c551b82 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:22.890309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f596d011-b1dd-48d2-84b8-05ee4c551b82 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:22.891746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f596d011-b1dd-48d2-84b8-05ee4c551b82 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:22.893360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f596d011-b1dd-48d2-84b8-05ee4c551b82 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:22.894462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f596d011-b1dd-48d2-84b8-05ee4c551b82 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:22.898252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac352c5b-e8b6-4fa8-98df-17ecde28a022 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:22.899318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac352c5b-e8b6-4fa8-98df-17ecde28a022 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:22.914971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac352c5b-e8b6-4fa8-98df-17ecde28a022 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:22.915465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac352c5b-e8b6-4fa8-98df-17ecde28a022 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:22.916390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac352c5b-e8b6-4fa8-98df-17ecde28a022 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:22.916886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac352c5b-e8b6-4fa8-98df-17ecde28a022 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:23.385790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac352c5b-e8b6-4fa8-98df-17ecde28a022 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:23.397435 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac352c5b-e8b6-4fa8-98df-17ecde28a022 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.502825 Jul 14 14:48:23.398040 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2044/4043] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:22 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:23.414567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f596d011-b1dd-48d2-84b8-05ee4c551b82 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:23.416009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f7178780-b301-4f1f-a293-016d13a3bdd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:23.417253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f7178780-b301-4f1f-a293-016d13a3bdd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:23.425312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7178780-b301-4f1f-a293-016d13a3bdd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:23.426069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7178780-b301-4f1f-a293-016d13a3bdd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:23.426967 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f596d011-b1dd-48d2-84b8-05ee4c551b82 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1681 microversion: 2.1 time: 0.560306 Jul 14 14:48:23.427199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7178780-b301-4f1f-a293-016d13a3bdd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:23.427802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7178780-b301-4f1f-a293-016d13a3bdd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:23.428529 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2000/4044] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:22 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1681 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:23.473329 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f7178780-b301-4f1f-a293-016d13a3bdd8 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061184 Jul 14 14:48:23.474520 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2045/4045] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:48:23 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:23.628751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e533e036-2a35-4dcf-b9b0-62881d581176 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:23.629669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e533e036-2a35-4dcf-b9b0-62881d581176 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:23.647145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e533e036-2a35-4dcf-b9b0-62881d581176 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:23.652203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e533e036-2a35-4dcf-b9b0-62881d581176 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:23.653535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e533e036-2a35-4dcf-b9b0-62881d581176 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:23.654252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e533e036-2a35-4dcf-b9b0-62881d581176 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:23.774331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc085e47-342b-4fd1-b73e-439e63e8a4fe tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:23.775093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cc085e47-342b-4fd1-b73e-439e63e8a4fe tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:23.810417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc085e47-342b-4fd1-b73e-439e63e8a4fe tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:23.812032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc085e47-342b-4fd1-b73e-439e63e8a4fe tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:23.825375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc085e47-342b-4fd1-b73e-439e63e8a4fe tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:23.826296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc085e47-342b-4fd1-b73e-439e63e8a4fe tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:24.033309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e533e036-2a35-4dcf-b9b0-62881d581176 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:24.044584 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e533e036-2a35-4dcf-b9b0-62881d581176 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.428110 Jul 14 14:48:24.047332 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2001/4046] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:23 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:24.242444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cc085e47-342b-4fd1-b73e-439e63e8a4fe tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:24.259014 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc085e47-342b-4fd1-b73e-439e63e8a4fe tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1366 microversion: 2.1 time: 0.491391 Jul 14 14:48:24.259947 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2046/4047] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:23 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1366 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:24.415214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6058d769-cace-4244-bb4f-e8e4da9092a0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:24.416366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6058d769-cace-4244-bb4f-e8e4da9092a0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:24.432250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6058d769-cace-4244-bb4f-e8e4da9092a0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:24.434344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6058d769-cace-4244-bb4f-e8e4da9092a0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:24.435432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6058d769-cace-4244-bb4f-e8e4da9092a0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:24.437400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6058d769-cace-4244-bb4f-e8e4da9092a0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:24.447899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-80d5bf88-2aeb-4994-9f63-f38b341d92ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:24.448782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-80d5bf88-2aeb-4994-9f63-f38b341d92ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:24.461306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80d5bf88-2aeb-4994-9f63-f38b341d92ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:24.463971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80d5bf88-2aeb-4994-9f63-f38b341d92ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:24.466174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80d5bf88-2aeb-4994-9f63-f38b341d92ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:24.466819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80d5bf88-2aeb-4994-9f63-f38b341d92ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:24.901111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6058d769-cace-4244-bb4f-e8e4da9092a0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:24.910598 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6058d769-cace-4244-bb4f-e8e4da9092a0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.500236 Jul 14 14:48:24.913590 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2002/4048] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:24 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:24.921298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f55c4ff-c2c7-4a4d-8991-26a0f5fdb34a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:24.930902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-80d5bf88-2aeb-4994-9f63-f38b341d92ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:24.940928 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-80d5bf88-2aeb-4994-9f63-f38b341d92ff tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1681 microversion: 2.1 time: 0.497996 Jul 14 14:48:24.941611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3f55c4ff-c2c7-4a4d-8991-26a0f5fdb34a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:24.948982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f55c4ff-c2c7-4a4d-8991-26a0f5fdb34a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:24.949744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f55c4ff-c2c7-4a4d-8991-26a0f5fdb34a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:24.957000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f55c4ff-c2c7-4a4d-8991-26a0f5fdb34a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:24.957000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f55c4ff-c2c7-4a4d-8991-26a0f5fdb34a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:24.957309 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2047/4049] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:24 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1681 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:25.052351 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3f55c4ff-c2c7-4a4d-8991-26a0f5fdb34a tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137141 Jul 14 14:48:25.058649 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2003/4050] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:48:24 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:25.063269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ebc0abfe-c8a4-40bb-b508-71e459500e9b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:25.063895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ebc0abfe-c8a4-40bb-b508-71e459500e9b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:25.076247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebc0abfe-c8a4-40bb-b508-71e459500e9b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.077889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebc0abfe-c8a4-40bb-b508-71e459500e9b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.080914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebc0abfe-c8a4-40bb-b508-71e459500e9b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.081427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebc0abfe-c8a4-40bb-b508-71e459500e9b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.276710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-185846cc-2f7e-4454-9331-38fc92dfd4a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:25.277567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-185846cc-2f7e-4454-9331-38fc92dfd4a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:25.289544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-185846cc-2f7e-4454-9331-38fc92dfd4a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.293033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-185846cc-2f7e-4454-9331-38fc92dfd4a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.294032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-185846cc-2f7e-4454-9331-38fc92dfd4a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.296629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-185846cc-2f7e-4454-9331-38fc92dfd4a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.360133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ebc0abfe-c8a4-40bb-b508-71e459500e9b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:25.371054 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ebc0abfe-c8a4-40bb-b508-71e459500e9b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.312077 Jul 14 14:48:25.373157 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2048/4051] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:25 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:25.527679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-185846cc-2f7e-4454-9331-38fc92dfd4a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:25.539731 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-185846cc-2f7e-4454-9331-38fc92dfd4a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1366 microversion: 2.1 time: 0.267458 Jul 14 14:48:25.540991 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2004/4052] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:25 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:25.930152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77db2fd9-c300-4bae-a546-4b8ca09cd576 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:25.930780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-77db2fd9-c300-4bae-a546-4b8ca09cd576 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:25.944168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77db2fd9-c300-4bae-a546-4b8ca09cd576 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.944630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77db2fd9-c300-4bae-a546-4b8ca09cd576 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.945875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77db2fd9-c300-4bae-a546-4b8ca09cd576 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.946329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77db2fd9-c300-4bae-a546-4b8ca09cd576 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.969264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5817c77c-15b8-4b07-98d7-6b68618d97c1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:25.970258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5817c77c-15b8-4b07-98d7-6b68618d97c1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:25.980227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5817c77c-15b8-4b07-98d7-6b68618d97c1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.984782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5817c77c-15b8-4b07-98d7-6b68618d97c1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.989138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5817c77c-15b8-4b07-98d7-6b68618d97c1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.990026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5817c77c-15b8-4b07-98d7-6b68618d97c1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:26.401893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-77db2fd9-c300-4bae-a546-4b8ca09cd576 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:26.414438 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-77db2fd9-c300-4bae-a546-4b8ca09cd576 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.488098 Jul 14 14:48:26.421644 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2049/4053] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:25 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:26.432427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4a8147d9-b1be-407a-9945-f2334ed3f52b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:26.433602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4a8147d9-b1be-407a-9945-f2334ed3f52b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:26.454980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a8147d9-b1be-407a-9945-f2334ed3f52b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:26.455564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a8147d9-b1be-407a-9945-f2334ed3f52b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:26.456423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a8147d9-b1be-407a-9945-f2334ed3f52b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:26.456869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a8147d9-b1be-407a-9945-f2334ed3f52b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:26.492027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5817c77c-15b8-4b07-98d7-6b68618d97c1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:26.504393 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5817c77c-15b8-4b07-98d7-6b68618d97c1 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1681 microversion: 2.1 time: 0.539367 Jul 14 14:48:26.511039 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2005/4054] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:25 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1681 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:26.528628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-82d81384-4c7a-4617-abe2-6de2c1715057 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:26.534779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-82d81384-4c7a-4617-abe2-6de2c1715057 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:26.540597 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4a8147d9-b1be-407a-9945-f2334ed3f52b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117261 Jul 14 14:48:26.541449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:26.541822 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2050/4055] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:48:26 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:26.558319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b1495eb-75c4-4cf2-9c58-d1c7ca23da04 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:26.559953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82d81384-4c7a-4617-abe2-6de2c1715057 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:26.560437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82d81384-4c7a-4617-abe2-6de2c1715057 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:26.561882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0b1495eb-75c4-4cf2-9c58-d1c7ca23da04 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:26.562533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82d81384-4c7a-4617-abe2-6de2c1715057 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:26.562533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82d81384-4c7a-4617-abe2-6de2c1715057 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:26.578894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b1495eb-75c4-4cf2-9c58-d1c7ca23da04 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:26.588116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b1495eb-75c4-4cf2-9c58-d1c7ca23da04 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:26.589262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b1495eb-75c4-4cf2-9c58-d1c7ca23da04 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:26.589878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b1495eb-75c4-4cf2-9c58-d1c7ca23da04 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.036396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0b1495eb-75c4-4cf2-9c58-d1c7ca23da04 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:27.047369 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0b1495eb-75c4-4cf2-9c58-d1c7ca23da04 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1366 microversion: 2.1 time: 0.492307 Jul 14 14:48:27.047983 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2051/4056] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:26 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1366 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:27.146894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-82d81384-4c7a-4617-abe2-6de2c1715057 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:27.158682 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-82d81384-4c7a-4617-abe2-6de2c1715057 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.639837 Jul 14 14:48:27.159293 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2006/4057] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:26 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:27.437428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f5d754df-afc0-4f24-8a1e-493a58871254 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:27.438801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f5d754df-afc0-4f24-8a1e-493a58871254 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:27.449470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5d754df-afc0-4f24-8a1e-493a58871254 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.450186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5d754df-afc0-4f24-8a1e-493a58871254 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.451430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5d754df-afc0-4f24-8a1e-493a58871254 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.453993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5d754df-afc0-4f24-8a1e-493a58871254 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.462790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6ddabd85-66f2-4119-bce5-2bc96cf804d9 req-a4b83ced-3d1b-4af0-a69c-06cfa284643e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fba14e7e-dbff-47d0-9515-3acd4c797b52", "name": "network-vif-plugged", "status": "completed", "tag": "2b8329e6-84df-4e45-8111-31bbe81da945"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:27.487386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6ddabd85-66f2-4119-bce5-2bc96cf804d9 req-a4b83ced-3d1b-4af0-a69c-06cfa284643e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.494231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6ddabd85-66f2-4119-bce5-2bc96cf804d9 req-a4b83ced-3d1b-4af0-a69c-06cfa284643e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.539452 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6ddabd85-66f2-4119-bce5-2bc96cf804d9 req-a4b83ced-3d1b-4af0-a69c-06cfa284643e service nova] Creating event network-vif-plugged:2b8329e6-84df-4e45-8111-31bbe81da945 for instance fba14e7e-dbff-47d0-9515-3acd4c797b52 on n-h1-767704-28 Jul 14 14:48:27.552047 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6ddabd85-66f2-4119-bce5-2bc96cf804d9 req-a4b83ced-3d1b-4af0-a69c-06cfa284643e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092694 Jul 14 14:48:27.562381 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2007/4058] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:48:27.568099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-901ef8db-bc22-4880-a028-2593ad9edc12 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:27.569030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-901ef8db-bc22-4880-a028-2593ad9edc12 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:27.578498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-901ef8db-bc22-4880-a028-2593ad9edc12 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.579634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-901ef8db-bc22-4880-a028-2593ad9edc12 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.580741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-901ef8db-bc22-4880-a028-2593ad9edc12 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.581440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-901ef8db-bc22-4880-a028-2593ad9edc12 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.783101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f5d754df-afc0-4f24-8a1e-493a58871254 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:27.791810 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f5d754df-afc0-4f24-8a1e-493a58871254 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.358397 Jul 14 14:48:27.805248 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2052/4059] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:27 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:27.806944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fca73f07-4d8a-4f12-84df-20c199d8b636 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:27.808049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fca73f07-4d8a-4f12-84df-20c199d8b636 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:27.824015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fca73f07-4d8a-4f12-84df-20c199d8b636 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.824581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fca73f07-4d8a-4f12-84df-20c199d8b636 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.827929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fca73f07-4d8a-4f12-84df-20c199d8b636 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.828478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fca73f07-4d8a-4f12-84df-20c199d8b636 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.914854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-901ef8db-bc22-4880-a028-2593ad9edc12 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:27.926072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:27.927074 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fca73f07-4d8a-4f12-84df-20c199d8b636 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128016 Jul 14 14:48:27.927929 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2053/4060] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:48:27 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:27.934307 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-901ef8db-bc22-4880-a028-2593ad9edc12 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1681 microversion: 2.1 time: 0.369772 Jul 14 14:48:27.947961 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2008/4061] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:27 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1681 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:28.064210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b585f907-e548-4244-8f2d-b16712a01d5c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:28.064831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b585f907-e548-4244-8f2d-b16712a01d5c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:28.080073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b585f907-e548-4244-8f2d-b16712a01d5c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:28.080531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b585f907-e548-4244-8f2d-b16712a01d5c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:28.081357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b585f907-e548-4244-8f2d-b16712a01d5c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:28.081804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b585f907-e548-4244-8f2d-b16712a01d5c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:28.180837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4105249-8e7f-470f-a919-f7611ad7ba2b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:28.181607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d4105249-8e7f-470f-a919-f7611ad7ba2b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:28.189553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4105249-8e7f-470f-a919-f7611ad7ba2b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:28.190237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4105249-8e7f-470f-a919-f7611ad7ba2b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:28.191658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4105249-8e7f-470f-a919-f7611ad7ba2b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:28.192117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4105249-8e7f-470f-a919-f7611ad7ba2b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:28.337390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b585f907-e548-4244-8f2d-b16712a01d5c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:28.355231 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b585f907-e548-4244-8f2d-b16712a01d5c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1366 microversion: 2.1 time: 0.295381 Jul 14 14:48:28.356115 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2054/4062] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:28 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:28.479599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d4105249-8e7f-470f-a919-f7611ad7ba2b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:28.494554 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d4105249-8e7f-470f-a919-f7611ad7ba2b tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.320060 Jul 14 14:48:28.513058 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2009/4063] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:28 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:28.822493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a4572b47-0196-4ae5-8503-e46fff9512d9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:28.823851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a4572b47-0196-4ae5-8503-e46fff9512d9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:28.831805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4572b47-0196-4ae5-8503-e46fff9512d9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:28.832603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4572b47-0196-4ae5-8503-e46fff9512d9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:28.833639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4572b47-0196-4ae5-8503-e46fff9512d9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:28.834303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4572b47-0196-4ae5-8503-e46fff9512d9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:28.943144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99b20cc9-7de6-4e56-84d1-a2d5754c7802 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:28.944348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-99b20cc9-7de6-4e56-84d1-a2d5754c7802 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:28.959958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99b20cc9-7de6-4e56-84d1-a2d5754c7802 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:28.960433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99b20cc9-7de6-4e56-84d1-a2d5754c7802 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:28.961937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99b20cc9-7de6-4e56-84d1-a2d5754c7802 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:28.966691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99b20cc9-7de6-4e56-84d1-a2d5754c7802 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:28.992320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a4572b47-0196-4ae5-8503-e46fff9512d9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:29.001968 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a4572b47-0196-4ae5-8503-e46fff9512d9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.192578 Jul 14 14:48:29.002780 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2055/4064] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:28 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:29.007677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-595e5733-c1ce-472b-b343-8082ffbd7971 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:29.008362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-595e5733-c1ce-472b-b343-8082ffbd7971 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:29.016012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-595e5733-c1ce-472b-b343-8082ffbd7971 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.016470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-595e5733-c1ce-472b-b343-8082ffbd7971 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.017431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-595e5733-c1ce-472b-b343-8082ffbd7971 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.017883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-595e5733-c1ce-472b-b343-8082ffbd7971 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.025949 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99b20cc9-7de6-4e56-84d1-a2d5754c7802 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087276 Jul 14 14:48:29.029433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:29.066152 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2010/4065] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:48:28 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 14:48:29.256215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5bc6a9a-3be5-456b-bbb3-ac38d5cce19c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:29.257693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e5bc6a9a-3be5-456b-bbb3-ac38d5cce19c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:29.267999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5bc6a9a-3be5-456b-bbb3-ac38d5cce19c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.268839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5bc6a9a-3be5-456b-bbb3-ac38d5cce19c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.269914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5bc6a9a-3be5-456b-bbb3-ac38d5cce19c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.270565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5bc6a9a-3be5-456b-bbb3-ac38d5cce19c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.302671 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-e5bc6a9a-3be5-456b-bbb3-ac38d5cce19c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] HTTP exception thrown: Cannot 'reboot' instance d83f75ff-3ed3-406d-9e13-695407c179a3 while it is in vm_state rescued Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5bc6a9a-3be5-456b-bbb3-ac38d5cce19c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Request method failure captured: Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3/action HTTP/1.1 Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 28 Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cuaek8QP7ZzyqAnXJWPN7lHiUWz0TNXX6f0nS0pfbQcbYmqHrTXe0rZ97jdQ3uNxUa0EPbwBicPZsDlqLUuoGtatVHJtwILzwCBFVthrwMveMSoYFbetP1TjjR3-iLZvN4xQUw5cjtI-hjvoXzpdUd0pTNdhqPPjM935R8S2VQJlOY Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e9f01277aa24f0fbe464ff8a5378d64", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}] Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 377b67baeabd4588a1945effc9b19113 Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: {"reboot": {"type": "HARD"}} Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: exception: Cannot 'reboot' instance d83f75ff-3ed3-406d-9e13-695407c179a3 while it is in vm_state rescued Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'd83f75ff-3ed3-406d-9e13-695407c179a3', 'body': {'reboot': {'type': 'HARD'}}} Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1038, in _action_reboot Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d83f75ff-3ed3-406d-9e13-695407c179a3 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1042, in _action_reboot Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:48:29.305179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:48:29.309658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance d83f75ff-3ed3-406d-9e13-695407c179a3 while it is in vm_state rescued Jul 14 14:48:29.309658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:29.309658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:29.309658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:29.309658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:29.309658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:29.309658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:29.309658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:48:29.309658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:48:29.309658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance d83f75ff-3ed3-406d-9e13-695407c179a3 while it is in vm_state rescued Jul 14 14:48:29.309658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:29.313292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5bc6a9a-3be5-456b-bbb3-ac38d5cce19c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Returning 409 to user: Cannot 'reboot' instance d83f75ff-3ed3-406d-9e13-695407c179a3 while it is in vm_state rescued {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:48:29.314436 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e5bc6a9a-3be5-456b-bbb3-ac38d5cce19c tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3/action" status: 409 len: 145 microversion: 2.1 time: 0.063238 Jul 14 14:48:29.319726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-595e5733-c1ce-472b-b343-8082ffbd7971 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:29.320307 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2011/4066] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:48:29 2022] POST /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3/action => generated 145 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:48:29.329546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15a08312-15b5-4ace-a361-24ed0c53b6d9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:29.331427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-15a08312-15b5-4ace-a361-24ed0c53b6d9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:29.337825 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-595e5733-c1ce-472b-b343-8082ffbd7971 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1681 microversion: 2.1 time: 0.334074 Jul 14 14:48:29.340001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15a08312-15b5-4ace-a361-24ed0c53b6d9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.340439 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2056/4067] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:29 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1681 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:29.340689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15a08312-15b5-4ace-a361-24ed0c53b6d9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.343280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15a08312-15b5-4ace-a361-24ed0c53b6d9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.343393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15a08312-15b5-4ace-a361-24ed0c53b6d9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.381238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5f78ed62-1200-4c12-8a7a-f4462f1861ed tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:29.385368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5f78ed62-1200-4c12-8a7a-f4462f1861ed tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:29.410600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f78ed62-1200-4c12-8a7a-f4462f1861ed tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.412258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f78ed62-1200-4c12-8a7a-f4462f1861ed tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.414149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f78ed62-1200-4c12-8a7a-f4462f1861ed tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.414917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f78ed62-1200-4c12-8a7a-f4462f1861ed tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.452612 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-15a08312-15b5-4ace-a361-24ed0c53b6d9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] HTTP exception thrown: Cannot 'rebuild' instance d83f75ff-3ed3-406d-9e13-695407c179a3 while it is in vm_state rescued Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15a08312-15b5-4ace-a361-24ed0c53b6d9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Request method failure captured: Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3/action HTTP/1.1 Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 65 Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cuaek8QP7ZzyqAnXJWPN7lHiUWz0TNXX6f0nS0pfbQcbYmqHrTXe0rZ97jdQ3uNxUa0EPbwBicPZsDlqLUuoGtatVHJtwILzwCBFVthrwMveMSoYFbetP1TjjR3-iLZvN4xQUw5cjtI-hjvoXzpdUd0pTNdhqPPjM935R8S2VQJlOY Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e9f01277aa24f0fbe464ff8a5378d64", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}] Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 377b67baeabd4588a1945effc9b19113 Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: exception: Cannot 'rebuild' instance d83f75ff-3ed3-406d-9e13-695407c179a3 while it is in vm_state rescued Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'd83f75ff-3ed3-406d-9e13-695407c179a3', 'body': {'rebuild': {'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7'}}} Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1222, in _action_rebuild Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d83f75ff-3ed3-406d-9e13-695407c179a3 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:48:29.454580 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1230, in _action_rebuild Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance d83f75ff-3ed3-406d-9e13-695407c179a3 while it is in vm_state rescued Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance d83f75ff-3ed3-406d-9e13-695407c179a3 while it is in vm_state rescued Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15a08312-15b5-4ace-a361-24ed0c53b6d9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Returning 409 to user: Cannot 'rebuild' instance d83f75ff-3ed3-406d-9e13-695407c179a3 while it is in vm_state rescued {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:48:29.458856 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-15a08312-15b5-4ace-a361-24ed0c53b6d9 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "POST /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3/action" status: 409 len: 146 microversion: 2.1 time: 0.134434 Jul 14 14:48:29.461230 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2012/4068] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:48:29 2022] POST /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3/action => generated 146 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:48:29.478753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-54fe3cf2-06d1-4165-9c79-2e47d1facbf7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:29.479382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-54fe3cf2-06d1-4165-9c79-2e47d1facbf7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:29.494033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54fe3cf2-06d1-4165-9c79-2e47d1facbf7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.496346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54fe3cf2-06d1-4165-9c79-2e47d1facbf7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.497271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54fe3cf2-06d1-4165-9c79-2e47d1facbf7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.497739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54fe3cf2-06d1-4165-9c79-2e47d1facbf7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.576709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-54fe3cf2-06d1-4165-9c79-2e47d1facbf7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:48:29.819548 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-54fe3cf2-06d1-4165-9c79-2e47d1facbf7 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 204 len: 0 microversion: 2.1 time: 0.351591 Jul 14 14:48:29.822203 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2013/4069] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:48:29 2022] DELETE /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:48:29.851032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5f78ed62-1200-4c12-8a7a-f4462f1861ed tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:29.884156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3dc51062-faa6-458d-b66b-d88dfbc861c9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:29.889872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3dc51062-faa6-458d-b66b-d88dfbc861c9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:29.892774 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5f78ed62-1200-4c12-8a7a-f4462f1861ed tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1556 microversion: 2.1 time: 0.523009 Jul 14 14:48:29.894015 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2057/4070] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:29 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1556 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:29.903822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3dc51062-faa6-458d-b66b-d88dfbc861c9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.904290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3dc51062-faa6-458d-b66b-d88dfbc861c9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.905783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3dc51062-faa6-458d-b66b-d88dfbc861c9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.906297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3dc51062-faa6-458d-b66b-d88dfbc861c9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.917375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-44b213e2-2606-4a65-8398-22aae6b502ab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:29.920151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-44b213e2-2606-4a65-8398-22aae6b502ab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:29.935065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44b213e2-2606-4a65-8398-22aae6b502ab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.947319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44b213e2-2606-4a65-8398-22aae6b502ab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.948501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44b213e2-2606-4a65-8398-22aae6b502ab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.949279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44b213e2-2606-4a65-8398-22aae6b502ab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.343390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3dc51062-faa6-458d-b66b-d88dfbc861c9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:30.373787 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3dc51062-faa6-458d-b66b-d88dfbc861c9 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.544868 Jul 14 14:48:30.376045 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2014/4071] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:29 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:30.386374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2faf1b64-bc67-4fc3-8eb3-5b988f969ec2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:30.397894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-44b213e2-2606-4a65-8398-22aae6b502ab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:30.413787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2faf1b64-bc67-4fc3-8eb3-5b988f969ec2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:30.421324 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-44b213e2-2606-4a65-8398-22aae6b502ab tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1687 microversion: 2.1 time: 0.524197 Jul 14 14:48:30.422625 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2058/4072] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:29 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1687 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:30.434290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2faf1b64-bc67-4fc3-8eb3-5b988f969ec2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.434290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2faf1b64-bc67-4fc3-8eb3-5b988f969ec2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.434290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2faf1b64-bc67-4fc3-8eb3-5b988f969ec2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.434290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2faf1b64-bc67-4fc3-8eb3-5b988f969ec2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.476453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a58acba5-ebc4-4fc0-a870-bb0ac157d953 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:30.480191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a58acba5-ebc4-4fc0-a870-bb0ac157d953 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:30.495289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a58acba5-ebc4-4fc0-a870-bb0ac157d953 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.495882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a58acba5-ebc4-4fc0-a870-bb0ac157d953 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.497403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a58acba5-ebc4-4fc0-a870-bb0ac157d953 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.498205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a58acba5-ebc4-4fc0-a870-bb0ac157d953 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.695168 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2faf1b64-bc67-4fc3-8eb3-5b988f969ec2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.314736 Jul 14 14:48:30.695833 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2015/4073] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:48:30 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-interface => generated 284 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:30.702774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-bacf0fd8-0f22-4a9f-8a5b-dcde2b9d791f req-c92cdc21-1aa1-4a98-a866-5b9cd3840ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2c99c7-5253-4416-80df-b1350d634e9d", "name": "network-vif-plugged", "status": "completed", "tag": "9ebca414-fe51-4e00-8c95-42f3e92de3c7"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:30.719878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-bacf0fd8-0f22-4a9f-8a5b-dcde2b9d791f req-c92cdc21-1aa1-4a98-a866-5b9cd3840ee5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.720760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-bacf0fd8-0f22-4a9f-8a5b-dcde2b9d791f req-c92cdc21-1aa1-4a98-a866-5b9cd3840ee5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.737895 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-bacf0fd8-0f22-4a9f-8a5b-dcde2b9d791f req-c92cdc21-1aa1-4a98-a866-5b9cd3840ee5 service nova] Creating event network-vif-plugged:9ebca414-fe51-4e00-8c95-42f3e92de3c7 for instance 8e2c99c7-5253-4416-80df-b1350d634e9d on n-h2-767704-28 Jul 14 14:48:30.744897 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-bacf0fd8-0f22-4a9f-8a5b-dcde2b9d791f req-c92cdc21-1aa1-4a98-a866-5b9cd3840ee5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047650 Jul 14 14:48:30.745767 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2016/4074] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:30.754167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b07e58e3-5e60-4ef1-aa0b-b35ff871f8f5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:30.755071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b07e58e3-5e60-4ef1-aa0b-b35ff871f8f5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:30.764106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b07e58e3-5e60-4ef1-aa0b-b35ff871f8f5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.769118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b07e58e3-5e60-4ef1-aa0b-b35ff871f8f5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.770051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b07e58e3-5e60-4ef1-aa0b-b35ff871f8f5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.770715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b07e58e3-5e60-4ef1-aa0b-b35ff871f8f5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.975612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a58acba5-ebc4-4fc0-a870-bb0ac157d953 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:31.000425 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a58acba5-ebc4-4fc0-a870-bb0ac157d953 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.576426 Jul 14 14:48:31.001141 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2059/4075] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:30 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:31.171920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b07e58e3-5e60-4ef1-aa0b-b35ff871f8f5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:31.185209 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b07e58e3-5e60-4ef1-aa0b-b35ff871f8f5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1658 microversion: 2.1 time: 0.438103 Jul 14 14:48:31.199104 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2017/4076] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:30 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1658 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:31.205351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3ff5de70-85c4-43e8-bcd2-ff022e92907f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:31.213656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ff5de70-85c4-43e8-bcd2-ff022e92907f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:31.214544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ff5de70-85c4-43e8-bcd2-ff022e92907f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:31.243751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3ff5de70-85c4-43e8-bcd2-ff022e92907f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Going to try to start instance {{(pid=119512) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 14:48:31.311494 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3ff5de70-85c4-43e8-bcd2-ff022e92907f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.107153 Jul 14 14:48:31.318338 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2060/4077] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:48:31 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:48:31.338735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-19491658-dc38-4566-896b-236af8e72f5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:31.339359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-19491658-dc38-4566-896b-236af8e72f5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:31.352759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19491658-dc38-4566-896b-236af8e72f5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:31.353261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19491658-dc38-4566-896b-236af8e72f5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:31.354075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19491658-dc38-4566-896b-236af8e72f5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:31.354522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19491658-dc38-4566-896b-236af8e72f5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:31.410159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b8a1e9b-25d9-4ee1-86e5-a6bfd26d5fd4 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:31.411304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b8a1e9b-25d9-4ee1-86e5-a6bfd26d5fd4 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:31.444268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b8a1e9b-25d9-4ee1-86e5-a6bfd26d5fd4 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:31.450829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b8a1e9b-25d9-4ee1-86e5-a6bfd26d5fd4 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:31.458347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b8a1e9b-25d9-4ee1-86e5-a6bfd26d5fd4 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:31.459483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b8a1e9b-25d9-4ee1-86e5-a6bfd26d5fd4 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:31.728856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-19491658-dc38-4566-896b-236af8e72f5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:31.751712 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-19491658-dc38-4566-896b-236af8e72f5c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1667 microversion: 2.1 time: 0.425070 Jul 14 14:48:31.752882 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2018/4078] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:31 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1667 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:31.758679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8e7133ff-67a7-4bd9-9f28-aa7f633c814b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:31.759305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8e7133ff-67a7-4bd9-9f28-aa7f633c814b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:31.776515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e7133ff-67a7-4bd9-9f28-aa7f633c814b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:31.776995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e7133ff-67a7-4bd9-9f28-aa7f633c814b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:31.777800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e7133ff-67a7-4bd9-9f28-aa7f633c814b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:31.778248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e7133ff-67a7-4bd9-9f28-aa7f633c814b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:32.062899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8e7133ff-67a7-4bd9-9f28-aa7f633c814b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:32.074545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9b8a1e9b-25d9-4ee1-86e5-a6bfd26d5fd4 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:32.084994 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9b8a1e9b-25d9-4ee1-86e5-a6bfd26d5fd4 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.680580 Jul 14 14:48:32.097038 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8e7133ff-67a7-4bd9-9f28-aa7f633c814b tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1687 microversion: 2.1 time: 0.342733 Jul 14 14:48:32.106556 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2061/4079] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:31 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:32.106785 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2019/4080] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:31 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1687 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:32.106874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d34f0f53-afe0-48c0-a69b-84a23ce5a0e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:32.106874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d34f0f53-afe0-48c0-a69b-84a23ce5a0e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:32.110759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d34f0f53-afe0-48c0-a69b-84a23ce5a0e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:32.111227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d34f0f53-afe0-48c0-a69b-84a23ce5a0e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:32.112019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d34f0f53-afe0-48c0-a69b-84a23ce5a0e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:32.112466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d34f0f53-afe0-48c0-a69b-84a23ce5a0e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:32.433081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d34f0f53-afe0-48c0-a69b-84a23ce5a0e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:32.441470 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d34f0f53-afe0-48c0-a69b-84a23ce5a0e5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.342138 Jul 14 14:48:32.453287 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2062/4081] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:32 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:32.771292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9305d963-538c-489f-bb6a-763922d244ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:32.772550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9305d963-538c-489f-bb6a-763922d244ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:32.794001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9305d963-538c-489f-bb6a-763922d244ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:32.794673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9305d963-538c-489f-bb6a-763922d244ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:32.795743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9305d963-538c-489f-bb6a-763922d244ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:32.796775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9305d963-538c-489f-bb6a-763922d244ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:32.820808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-93804f47-c9ce-4c3f-a40a-7489992aba43 req-36ba9bcd-3290-4a86-abcf-5004b5453018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5", "name": "network-vif-plugged", "status": "completed", "tag": "8bf12488-bd78-4a9f-82af-678062508fea"}, {"server_uuid": "8e2c99c7-5253-4416-80df-b1350d634e9d", "name": "network-vif-plugged", "status": "completed", "tag": "5a927ba1-7c5a-4bd4-b273-0b9328af2241"}, {"server_uuid": "8e2c99c7-5253-4416-80df-b1350d634e9d", "name": "network-vif-plugged", "status": "completed", "tag": "86ca3bdc-6ff5-4dd9-b14c-2c27098964ee"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:32.857681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-93804f47-c9ce-4c3f-a40a-7489992aba43 req-36ba9bcd-3290-4a86-abcf-5004b5453018 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:32.858103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-93804f47-c9ce-4c3f-a40a-7489992aba43 req-36ba9bcd-3290-4a86-abcf-5004b5453018 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:32.896164 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-93804f47-c9ce-4c3f-a40a-7489992aba43 req-36ba9bcd-3290-4a86-abcf-5004b5453018 service nova] Creating event network-vif-plugged:8bf12488-bd78-4a9f-82af-678062508fea for instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 on n-h1-767704-28 Jul 14 14:48:32.897058 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-93804f47-c9ce-4c3f-a40a-7489992aba43 req-36ba9bcd-3290-4a86-abcf-5004b5453018 service nova] Creating event network-vif-plugged:5a927ba1-7c5a-4bd4-b273-0b9328af2241 for instance 8e2c99c7-5253-4416-80df-b1350d634e9d on n-h2-767704-28 Jul 14 14:48:32.905351 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-93804f47-c9ce-4c3f-a40a-7489992aba43 req-36ba9bcd-3290-4a86-abcf-5004b5453018 service nova] Creating event network-vif-plugged:86ca3bdc-6ff5-4dd9-b14c-2c27098964ee for instance 8e2c99c7-5253-4416-80df-b1350d634e9d on n-h2-767704-28 Jul 14 14:48:32.915468 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-93804f47-c9ce-4c3f-a40a-7489992aba43 req-36ba9bcd-3290-4a86-abcf-5004b5453018 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.111568 Jul 14 14:48:32.916447 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2063/4082] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:48:33.103771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-60f43848-2373-47aa-a4b8-750471131e98 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:33.104820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-60f43848-2373-47aa-a4b8-750471131e98 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:33.128067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60f43848-2373-47aa-a4b8-750471131e98 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:33.129174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60f43848-2373-47aa-a4b8-750471131e98 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:33.130036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60f43848-2373-47aa-a4b8-750471131e98 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:33.131262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60f43848-2373-47aa-a4b8-750471131e98 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:33.135699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9305d963-538c-489f-bb6a-763922d244ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:33.219578 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9305d963-538c-489f-bb6a-763922d244ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1667 microversion: 2.1 time: 0.452024 Jul 14 14:48:33.255494 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2020/4083] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:32 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1667 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:33.261990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-30d54d15-41c3-4f94-9fa8-f0ea93036743 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:33.262997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-30d54d15-41c3-4f94-9fa8-f0ea93036743 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:33.271898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30d54d15-41c3-4f94-9fa8-f0ea93036743 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:33.273388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30d54d15-41c3-4f94-9fa8-f0ea93036743 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:33.274611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30d54d15-41c3-4f94-9fa8-f0ea93036743 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:33.276268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30d54d15-41c3-4f94-9fa8-f0ea93036743 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:33.903580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-30d54d15-41c3-4f94-9fa8-f0ea93036743 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:33.921914 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-30d54d15-41c3-4f94-9fa8-f0ea93036743 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1687 microversion: 2.1 time: 0.664765 Jul 14 14:48:33.922795 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2021/4084] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:33 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1687 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:33.949146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1ab07778-3dde-43c4-86c3-b057c4ef393a req-b14bf015-3150-4df3-8c2a-3cb9e3e44c7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fba14e7e-dbff-47d0-9515-3acd4c797b52", "tag": "2b8329e6-84df-4e45-8111-31bbe81da945"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:33.990339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1ab07778-3dde-43c4-86c3-b057c4ef393a req-b14bf015-3150-4df3-8c2a-3cb9e3e44c7f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:33.990954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1ab07778-3dde-43c4-86c3-b057c4ef393a req-b14bf015-3150-4df3-8c2a-3cb9e3e44c7f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:34.000026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-60f43848-2373-47aa-a4b8-750471131e98 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:34.007310 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1ab07778-3dde-43c4-86c3-b057c4ef393a req-b14bf015-3150-4df3-8c2a-3cb9e3e44c7f service nova] Creating event network-changed:2b8329e6-84df-4e45-8111-31bbe81da945 for instance fba14e7e-dbff-47d0-9515-3acd4c797b52 on n-h1-767704-28 Jul 14 14:48:34.016000 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-60f43848-2373-47aa-a4b8-750471131e98 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.916686 Jul 14 14:48:34.018622 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1ab07778-3dde-43c4-86c3-b057c4ef393a req-b14bf015-3150-4df3-8c2a-3cb9e3e44c7f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079123 Jul 14 14:48:34.020300 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2022/4085] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:34.031191 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2064/4086] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:33 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:34.041853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a25628a1-d5bb-4ff0-a070-56a6345923e1 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:34.042887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a25628a1-d5bb-4ff0-a070-56a6345923e1 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:34.050065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a25628a1-d5bb-4ff0-a070-56a6345923e1 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:34.050602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a25628a1-d5bb-4ff0-a070-56a6345923e1 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:34.051569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a25628a1-d5bb-4ff0-a070-56a6345923e1 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:34.052073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a25628a1-d5bb-4ff0-a070-56a6345923e1 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:34.263375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-20e0f8e1-4fe8-4b2b-85ff-8ed01e44b69a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:34.265724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-20e0f8e1-4fe8-4b2b-85ff-8ed01e44b69a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:34.288238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20e0f8e1-4fe8-4b2b-85ff-8ed01e44b69a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:34.289584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20e0f8e1-4fe8-4b2b-85ff-8ed01e44b69a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:34.290429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20e0f8e1-4fe8-4b2b-85ff-8ed01e44b69a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:34.290885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20e0f8e1-4fe8-4b2b-85ff-8ed01e44b69a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:34.457813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a25628a1-d5bb-4ff0-a070-56a6345923e1 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:34.467813 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a25628a1-d5bb-4ff0-a070-56a6345923e1 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1317 microversion: 2.1 time: 0.444840 Jul 14 14:48:34.477951 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2023/4087] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:34 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:34.941536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8dde43fa-7356-46d6-8de5-9f23aa4c9144 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:34.943016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8dde43fa-7356-46d6-8de5-9f23aa4c9144 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:34.950778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dde43fa-7356-46d6-8de5-9f23aa4c9144 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:34.952176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dde43fa-7356-46d6-8de5-9f23aa4c9144 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:34.953245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dde43fa-7356-46d6-8de5-9f23aa4c9144 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:34.953911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dde43fa-7356-46d6-8de5-9f23aa4c9144 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:35.048014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-20e0f8e1-4fe8-4b2b-85ff-8ed01e44b69a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:35.065083 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-20e0f8e1-4fe8-4b2b-85ff-8ed01e44b69a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.800503 Jul 14 14:48:35.065756 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2065/4088] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:34 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:35.087714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3319544a-a61d-4e83-89b1-c94705c1d25f tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:35.095033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3319544a-a61d-4e83-89b1-c94705c1d25f tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:35.128937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3319544a-a61d-4e83-89b1-c94705c1d25f tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:35.134594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3319544a-a61d-4e83-89b1-c94705c1d25f tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:35.135790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3319544a-a61d-4e83-89b1-c94705c1d25f tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:35.142876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3319544a-a61d-4e83-89b1-c94705c1d25f tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:35.686935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8dde43fa-7356-46d6-8de5-9f23aa4c9144 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:35.704394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3319544a-a61d-4e83-89b1-c94705c1d25f tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:35.743826 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8dde43fa-7356-46d6-8de5-9f23aa4c9144 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1687 microversion: 2.1 time: 0.807888 Jul 14 14:48:35.744052 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3319544a-a61d-4e83-89b1-c94705c1d25f tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1354 microversion: 2.1 time: 0.677155 Jul 14 14:48:35.753641 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2024/4089] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:34 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1687 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:35.760903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-75946b51-568b-4d5a-87f1-e10586bce6b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:35.764577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-75946b51-568b-4d5a-87f1-e10586bce6b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:35.777723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75946b51-568b-4d5a-87f1-e10586bce6b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:35.777945 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2066/4090] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:35 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1354 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:35.783257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75946b51-568b-4d5a-87f1-e10586bce6b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:35.784402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75946b51-568b-4d5a-87f1-e10586bce6b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:35.785945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75946b51-568b-4d5a-87f1-e10586bce6b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:35.799876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-357a05ec-de9d-4ff7-abaf-579f55e2b277 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:35.801206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-357a05ec-de9d-4ff7-abaf-579f55e2b277 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:35.821656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-357a05ec-de9d-4ff7-abaf-579f55e2b277 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:35.822131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-357a05ec-de9d-4ff7-abaf-579f55e2b277 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:35.827964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-357a05ec-de9d-4ff7-abaf-579f55e2b277 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:35.835187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-357a05ec-de9d-4ff7-abaf-579f55e2b277 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:36.439315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-75946b51-568b-4d5a-87f1-e10586bce6b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:36.452295 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-75946b51-568b-4d5a-87f1-e10586bce6b8 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.703537 Jul 14 14:48:36.455027 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2025/4091] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:35 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:36.457059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-357a05ec-de9d-4ff7-abaf-579f55e2b277 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:36.469663 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-357a05ec-de9d-4ff7-abaf-579f55e2b277 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1508 microversion: 2.1 time: 0.690547 Jul 14 14:48:36.473704 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2067/4092] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:35 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1508 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:36.509166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1e2eafee-ca30-4e8f-b08e-c496ab320c6e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:36.519112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1e2eafee-ca30-4e8f-b08e-c496ab320c6e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:36.532804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e2eafee-ca30-4e8f-b08e-c496ab320c6e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:36.534345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e2eafee-ca30-4e8f-b08e-c496ab320c6e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:36.535797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e2eafee-ca30-4e8f-b08e-c496ab320c6e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:36.536467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e2eafee-ca30-4e8f-b08e-c496ab320c6e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:36.744568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-87afad3f-789c-4fde-9815-b4398dcda3b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:36.745123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-87afad3f-789c-4fde-9815-b4398dcda3b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:36.754610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87afad3f-789c-4fde-9815-b4398dcda3b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:36.755407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87afad3f-789c-4fde-9815-b4398dcda3b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:36.756704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87afad3f-789c-4fde-9815-b4398dcda3b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:36.757496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87afad3f-789c-4fde-9815-b4398dcda3b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:36.766671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:36.808668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-87afad3f-789c-4fde-9815-b4398dcda3b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:48:36.974687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1e2eafee-ca30-4e8f-b08e-c496ab320c6e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:36.985446 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1e2eafee-ca30-4e8f-b08e-c496ab320c6e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.510834 Jul 14 14:48:36.986393 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2068/4093] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:36 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:36.997829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ef4e27de-5db7-45f2-9ebc-7fe842456328 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:36.999151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ef4e27de-5db7-45f2-9ebc-7fe842456328 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:37.007138 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-87afad3f-789c-4fde-9815-b4398dcda3b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "DELETE /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 204 len: 0 microversion: 2.32 time: 0.537453 Jul 14 14:48:37.007794 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2026/4094] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:48:36 2022] DELETE /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:48:37.017477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef4e27de-5db7-45f2-9ebc-7fe842456328 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.017942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef4e27de-5db7-45f2-9ebc-7fe842456328 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.018750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef4e27de-5db7-45f2-9ebc-7fe842456328 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.019464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef4e27de-5db7-45f2-9ebc-7fe842456328 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.134399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-dee7150a-518c-486b-93da-7c5e4b81eae5 req-73c57891-12d5-4311-9f79-0d9407730bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9fadee3-2871-4c8e-adda-e95d99e56a1a", "name": "network-vif-deleted", "tag": "83a28852-1f2f-4d1f-b2b4-075a5434ee65"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:37.150295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-dee7150a-518c-486b-93da-7c5e4b81eae5 req-73c57891-12d5-4311-9f79-0d9407730bc7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.155497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-dee7150a-518c-486b-93da-7c5e4b81eae5 req-73c57891-12d5-4311-9f79-0d9407730bc7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.179036 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-dee7150a-518c-486b-93da-7c5e4b81eae5 req-73c57891-12d5-4311-9f79-0d9407730bc7 service nova] Creating event network-vif-deleted:83a28852-1f2f-4d1f-b2b4-075a5434ee65 for instance a9fadee3-2871-4c8e-adda-e95d99e56a1a on n-h1-767704-28 Jul 14 14:48:37.187560 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-dee7150a-518c-486b-93da-7c5e4b81eae5 req-73c57891-12d5-4311-9f79-0d9407730bc7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178071 Jul 14 14:48:37.195435 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2027/4095] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:37.201205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7389a256-c777-4d1c-965e-20c7416139d2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:37.202679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7389a256-c777-4d1c-965e-20c7416139d2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:37.220635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ef4e27de-5db7-45f2-9ebc-7fe842456328 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:37.221877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7389a256-c777-4d1c-965e-20c7416139d2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.222342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7389a256-c777-4d1c-965e-20c7416139d2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.225999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7389a256-c777-4d1c-965e-20c7416139d2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.226519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7389a256-c777-4d1c-965e-20c7416139d2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.235025 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ef4e27de-5db7-45f2-9ebc-7fe842456328 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1508 microversion: 2.1 time: 0.246811 Jul 14 14:48:37.251432 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2069/4096] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:36 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:37.259631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d9fb941a-3245-4a94-bcad-9b01616de207 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:37.261532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d9fb941a-3245-4a94-bcad-9b01616de207 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:37.273808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9fb941a-3245-4a94-bcad-9b01616de207 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.275084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9fb941a-3245-4a94-bcad-9b01616de207 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.276686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9fb941a-3245-4a94-bcad-9b01616de207 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.277476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9fb941a-3245-4a94-bcad-9b01616de207 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.327093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9fb941a-3245-4a94-bcad-9b01616de207 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.328017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9fb941a-3245-4a94-bcad-9b01616de207 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.328720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-d9fb941a-3245-4a94-bcad-9b01616de207 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lazy-loading 'fault' on Instance uuid a9fadee3-2871-4c8e-adda-e95d99e56a1a {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:48:37.406963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d9fb941a-3245-4a94-bcad-9b01616de207 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:37.424899 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d9fb941a-3245-4a94-bcad-9b01616de207 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1333 microversion: 2.1 time: 0.170496 Jul 14 14:48:37.429583 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2070/4097] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:37 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1333 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:37.437988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b1dc86f-7d7f-49e9-879f-9294ef5e4096 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:37.438618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5b1dc86f-7d7f-49e9-879f-9294ef5e4096 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:37.460704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b1dc86f-7d7f-49e9-879f-9294ef5e4096 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.461196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b1dc86f-7d7f-49e9-879f-9294ef5e4096 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.462004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b1dc86f-7d7f-49e9-879f-9294ef5e4096 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.462448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b1dc86f-7d7f-49e9-879f-9294ef5e4096 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.558862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7389a256-c777-4d1c-965e-20c7416139d2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:37.570486 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7389a256-c777-4d1c-965e-20c7416139d2 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1806 microversion: 2.1 time: 0.373628 Jul 14 14:48:37.571640 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2028/4098] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:37 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1806 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:37.589611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f9584263-9153-4931-830f-485839e9e74b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:37.591210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f9584263-9153-4931-830f-485839e9e74b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:37.600404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9584263-9153-4931-830f-485839e9e74b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.601173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9584263-9153-4931-830f-485839e9e74b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.602125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9584263-9153-4931-830f-485839e9e74b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.602731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9584263-9153-4931-830f-485839e9e74b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.787832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5b1dc86f-7d7f-49e9-879f-9294ef5e4096 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:37.800257 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b1dc86f-7d7f-49e9-879f-9294ef5e4096 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.369030 Jul 14 14:48:37.801703 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2071/4099] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:37 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:37.818976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b7ec4fa9-2e66-4304-a64f-bfbd0f64211c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:37.820463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b7ec4fa9-2e66-4304-a64f-bfbd0f64211c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:37.828023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7ec4fa9-2e66-4304-a64f-bfbd0f64211c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.828793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7ec4fa9-2e66-4304-a64f-bfbd0f64211c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.829813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7ec4fa9-2e66-4304-a64f-bfbd0f64211c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.830421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7ec4fa9-2e66-4304-a64f-bfbd0f64211c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.844090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:37.924930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f9584263-9153-4931-830f-485839e9e74b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:37.942884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f9584263-9153-4931-830f-485839e9e74b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:37.946885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f9584263-9153-4931-830f-485839e9e74b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:37.949119 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f9584263-9153-4931-830f-485839e9e74b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2949 microversion: 2.32 time: 0.375071 Jul 14 14:48:37.951068 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2029/4100] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:37 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2949 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:37.960115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-71cbeb7e-adb4-45d0-a7dd-40ea05e25f46 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:37.961111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-71cbeb7e-adb4-45d0-a7dd-40ea05e25f46 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:37.973401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71cbeb7e-adb4-45d0-a7dd-40ea05e25f46 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.974344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71cbeb7e-adb4-45d0-a7dd-40ea05e25f46 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.975357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71cbeb7e-adb4-45d0-a7dd-40ea05e25f46 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.976016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71cbeb7e-adb4-45d0-a7dd-40ea05e25f46 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.009179 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b7ec4fa9-2e66-4304-a64f-bfbd0f64211c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "PUT /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1080 microversion: 2.1 time: 0.193154 Jul 14 14:48:38.009179 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2072/4101] 10.222.0.81 () {60 vars in 1255 bytes} [Thu Jul 14 14:48:37 2022] PUT /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1080 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:38.013021 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-71cbeb7e-adb4-45d0-a7dd-40ea05e25f46 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d/ips" status: 200 len: 220 microversion: 2.1 time: 0.058584 Jul 14 14:48:38.013021 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2030/4102] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 14:48:37 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d/ips => generated 220 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:38.023534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d437e567-2e44-4dc2-9ce2-6db52b80851b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:38.024186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d437e567-2e44-4dc2-9ce2-6db52b80851b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:38.036217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-09564b8b-ace1-4819-987b-a88b6d519ad4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:38.036998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-09564b8b-ace1-4819-987b-a88b6d519ad4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:38.037876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d437e567-2e44-4dc2-9ce2-6db52b80851b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.038336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d437e567-2e44-4dc2-9ce2-6db52b80851b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.039151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d437e567-2e44-4dc2-9ce2-6db52b80851b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.039607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d437e567-2e44-4dc2-9ce2-6db52b80851b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.045225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09564b8b-ace1-4819-987b-a88b6d519ad4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.046527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09564b8b-ace1-4819-987b-a88b6d519ad4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.047838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09564b8b-ace1-4819-987b-a88b6d519ad4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.048272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09564b8b-ace1-4819-987b-a88b6d519ad4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.325320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-09564b8b-ace1-4819-987b-a88b6d519ad4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:38.333365 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-09564b8b-ace1-4819-987b-a88b6d519ad4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1506 microversion: 2.1 time: 0.302698 Jul 14 14:48:38.349309 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2031/4103] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:38 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:38.357270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bb907b3d-5458-4352-82c1-1b403744ff86 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:38.358474 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bb907b3d-5458-4352-82c1-1b403744ff86 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:38.360267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d437e567-2e44-4dc2-9ce2-6db52b80851b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:38.368529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb907b3d-5458-4352-82c1-1b403744ff86 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.369016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb907b3d-5458-4352-82c1-1b403744ff86 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.369736 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d437e567-2e44-4dc2-9ce2-6db52b80851b tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.359933 Jul 14 14:48:38.369868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb907b3d-5458-4352-82c1-1b403744ff86 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.370238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb907b3d-5458-4352-82c1-1b403744ff86 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.370660 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2073/4104] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:38 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:38.403905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-60b4bfee-6e29-4614-8efc-bd922bfb8a20 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:38.407232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-60b4bfee-6e29-4614-8efc-bd922bfb8a20 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:38.411219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bb907b3d-5458-4352-82c1-1b403744ff86 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:48:38.417979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60b4bfee-6e29-4614-8efc-bd922bfb8a20 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.418598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60b4bfee-6e29-4614-8efc-bd922bfb8a20 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.419919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60b4bfee-6e29-4614-8efc-bd922bfb8a20 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.421797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60b4bfee-6e29-4614-8efc-bd922bfb8a20 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.580489 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bb907b3d-5458-4352-82c1-1b403744ff86 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 204 len: 0 microversion: 2.1 time: 0.229307 Jul 14 14:48:38.585771 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2032/4105] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:48:38 2022] DELETE /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:48:38.594066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-18c510c3-d326-4227-866e-8e1a91c3acab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:38.595112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-18c510c3-d326-4227-866e-8e1a91c3acab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:38.603851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18c510c3-d326-4227-866e-8e1a91c3acab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.604311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18c510c3-d326-4227-866e-8e1a91c3acab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.605206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18c510c3-d326-4227-866e-8e1a91c3acab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.605833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18c510c3-d326-4227-866e-8e1a91c3acab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.631210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-60b4bfee-6e29-4614-8efc-bd922bfb8a20 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:38.642699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-18c510c3-d326-4227-866e-8e1a91c3acab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lazy-loading 'flavor' on Instance uuid 2b55c122-95db-42f1-95a9-ae5bbb4ff958 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:48:38.656922 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-60b4bfee-6e29-4614-8efc-bd922bfb8a20 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1506 microversion: 2.1 time: 0.281545 Jul 14 14:48:38.661411 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2074/4106] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:38 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:38.676857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-417647f3-52fb-49e8-8915-40676fb537db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:38.678100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-417647f3-52fb-49e8-8915-40676fb537db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:38.687686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-417647f3-52fb-49e8-8915-40676fb537db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.688445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-417647f3-52fb-49e8-8915-40676fb537db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.689582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-417647f3-52fb-49e8-8915-40676fb537db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.690242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-417647f3-52fb-49e8-8915-40676fb537db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.753181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-417647f3-52fb-49e8-8915-40676fb537db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.754406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-417647f3-52fb-49e8-8915-40676fb537db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.755668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-417647f3-52fb-49e8-8915-40676fb537db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lazy-loading 'fault' on Instance uuid a9fadee3-2871-4c8e-adda-e95d99e56a1a {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:48:38.783400 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-18c510c3-d326-4227-866e-8e1a91c3acab tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.195683 Jul 14 14:48:38.784389 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2033/4107] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:48:38 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:48:38.795844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-10c46a8c-b0c9-4bd9-ac46-a3dc8cd37193 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:38.796758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-10c46a8c-b0c9-4bd9-ac46-a3dc8cd37193 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:38.803998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10c46a8c-b0c9-4bd9-ac46-a3dc8cd37193 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.804471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10c46a8c-b0c9-4bd9-ac46-a3dc8cd37193 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.805335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10c46a8c-b0c9-4bd9-ac46-a3dc8cd37193 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.805772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10c46a8c-b0c9-4bd9-ac46-a3dc8cd37193 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.884113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-417647f3-52fb-49e8-8915-40676fb537db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:38.916545 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-417647f3-52fb-49e8-8915-40676fb537db tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 200 len: 1333 microversion: 2.1 time: 0.253116 Jul 14 14:48:38.930339 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2075/4108] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:38 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 1333 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:38.940138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:38.942040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:38.954081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.954925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.955956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.956645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.098075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:48:39.098680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:48:39.098962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:48:39.099380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:48:39.099803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:48:39.121823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-10c46a8c-b0c9-4bd9-ac46-a3dc8cd37193 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:39.135938 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-10c46a8c-b0c9-4bd9-ac46-a3dc8cd37193 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1812 microversion: 2.1 time: 0.348317 Jul 14 14:48:39.157691 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2034/4109] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:38 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1812 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:39.171387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-036b963d-3d78-4751-af86-77d2faae37ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:39.173422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-036b963d-3d78-4751-af86-77d2faae37ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:39.191264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-036b963d-3d78-4751-af86-77d2faae37ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:39.191264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-036b963d-3d78-4751-af86-77d2faae37ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.191264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-036b963d-3d78-4751-af86-77d2faae37ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:39.193756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-036b963d-3d78-4751-af86-77d2faae37ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.253351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:39.273421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:39.274422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.278666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:39.279604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.350279 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-30de8066-c8d8-41a2-b01c-de184bdb0fec tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "POST /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5/action" status: 202 len: 1112 microversion: 2.1 time: 0.418316 Jul 14 14:48:39.350850 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2076/4110] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:48:38 2022] POST /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5/action => generated 1112 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 14:48:39.355731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a0ff797f-0d16-4685-a6e6-3296beb835b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:39.356369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a0ff797f-0d16-4685-a6e6-3296beb835b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:39.372733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0ff797f-0d16-4685-a6e6-3296beb835b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:39.374038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0ff797f-0d16-4685-a6e6-3296beb835b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.374910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0ff797f-0d16-4685-a6e6-3296beb835b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:39.375379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0ff797f-0d16-4685-a6e6-3296beb835b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.665137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-036b963d-3d78-4751-af86-77d2faae37ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:39.676995 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-036b963d-3d78-4751-af86-77d2faae37ce tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1679 microversion: 2.1 time: 0.517029 Jul 14 14:48:39.691345 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2035/4111] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:39 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1679 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:39.703995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-94583ecd-1a80-4806-a0bb-61fba78a8e49 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:39.705305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-94583ecd-1a80-4806-a0bb-61fba78a8e49 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:39.760147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94583ecd-1a80-4806-a0bb-61fba78a8e49 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:39.760809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94583ecd-1a80-4806-a0bb-61fba78a8e49 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.761794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94583ecd-1a80-4806-a0bb-61fba78a8e49 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:39.762734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a0ff797f-0d16-4685-a6e6-3296beb835b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:39.763668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94583ecd-1a80-4806-a0bb-61fba78a8e49 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.782317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a0ff797f-0d16-4685-a6e6-3296beb835b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:39.784429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a0ff797f-0d16-4685-a6e6-3296beb835b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:39.786691 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a0ff797f-0d16-4685-a6e6-3296beb835b4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2949 microversion: 2.32 time: 0.434779 Jul 14 14:48:39.799558 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2077/4112] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:39 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2949 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:40.050961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-94583ecd-1a80-4806-a0bb-61fba78a8e49 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:40.068289 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-94583ecd-1a80-4806-a0bb-61fba78a8e49 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 0.370552 Jul 14 14:48:40.087028 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2036/4113] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:39 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:40.193563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ce52476e-fbd1-4aa4-af27-4a322e81dd2e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:40.194201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ce52476e-fbd1-4aa4-af27-4a322e81dd2e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: a9fadee3-2871-4c8e-adda-e95d99e56a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:40.195681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-88df0f7f-68f3-44b8-a794-fca7db9d64b8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:40.196750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-88df0f7f-68f3-44b8-a794-fca7db9d64b8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:40.205538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88df0f7f-68f3-44b8-a794-fca7db9d64b8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:40.206097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88df0f7f-68f3-44b8-a794-fca7db9d64b8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:40.207112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88df0f7f-68f3-44b8-a794-fca7db9d64b8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:40.207631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88df0f7f-68f3-44b8-a794-fca7db9d64b8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:40.207884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce52476e-fbd1-4aa4-af27-4a322e81dd2e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:40.208417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce52476e-fbd1-4aa4-af27-4a322e81dd2e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:40.209349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce52476e-fbd1-4aa4-af27-4a322e81dd2e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:40.215174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce52476e-fbd1-4aa4-af27-4a322e81dd2e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:40.250190 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-ce52476e-fbd1-4aa4-af27-4a322e81dd2e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] HTTP exception thrown: Instance a9fadee3-2871-4c8e-adda-e95d99e56a1a could not be found. Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ce52476e-fbd1-4aa4-af27-4a322e81dd2e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Request method failure captured: Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a HTTP/1.1 Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cuaek8QP7ZzyqAnXJWPN7lHiUWz0TNXX6f0nS0pfbQcbYmqHrTXe0rZ97jdQ3uNxUa0EPbwBicPZsDlqLUuoGtatVHJtwILzwCBFVthrwMveMSoYFbetP1TjjR3-iLZvN4xQUw5cjtI-hjvoXzpdUd0pTNdhqPPjM935R8S2VQJlOY Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e9f01277aa24f0fbe464ff8a5378d64", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}] Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 377b67baeabd4588a1945effc9b19113 Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance a9fadee3-2871-4c8e-adda-e95d99e56a1a could not be found. Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'a9fadee3-2871-4c8e-adda-e95d99e56a1a'} Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9fadee3-2871-4c8e-adda-e95d99e56a1a could not be found. Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9fadee3-2871-4c8e-adda-e95d99e56a1a could not be found. Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:48:40.252259 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:40.256886 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:48:40.256886 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:40.256886 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:40.256886 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:40.256886 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:48:40.256886 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:48:40.256886 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9fadee3-2871-4c8e-adda-e95d99e56a1a could not be found. Jul 14 14:48:40.256886 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:48:40.256886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ce52476e-fbd1-4aa4-af27-4a322e81dd2e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Returning 404 to user: Instance a9fadee3-2871-4c8e-adda-e95d99e56a1a could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:48:40.256886 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ce52476e-fbd1-4aa4-af27-4a322e81dd2e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a" status: 404 len: 111 microversion: 2.1 time: 0.322085 Jul 14 14:48:40.256886 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2078/4114] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:39 2022] GET /compute/v2.1/servers/a9fadee3-2871-4c8e-adda-e95d99e56a1a => generated 111 bytes in 325 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:48:40.265891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-55580923-4ac3-4d8d-8133-af7339e8a8e4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '.version_select at 0x7fd6c4eb8280>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:40.296493 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-55580923-4ac3-4d8d-8133-af7339e8a8e4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54351309" status: 202 len: 0 microversion: 2.1 time: 0.035289 Jul 14 14:48:40.302026 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2079/4115] 10.222.0.81 () {58 vars in 1214 bytes} [Thu Jul 14 14:48:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54351309 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:48:40.508318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-88df0f7f-68f3-44b8-a794-fca7db9d64b8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:40.520241 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-88df0f7f-68f3-44b8-a794-fca7db9d64b8 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1812 microversion: 2.1 time: 0.353148 Jul 14 14:48:40.520923 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2037/4116] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:40 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1812 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:40.701137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36e21314-b4af-44b6-a388-215f42f3ca0e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:40.702835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-36e21314-b4af-44b6-a388-215f42f3ca0e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:40.718496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36e21314-b4af-44b6-a388-215f42f3ca0e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:40.718968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36e21314-b4af-44b6-a388-215f42f3ca0e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:40.719823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36e21314-b4af-44b6-a388-215f42f3ca0e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:40.720377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36e21314-b4af-44b6-a388-215f42f3ca0e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:40.812329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44411852-fe1c-4be7-8d1f-5cdd6d9e1619 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:40.814630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-44411852-fe1c-4be7-8d1f-5cdd6d9e1619 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:40.841129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44411852-fe1c-4be7-8d1f-5cdd6d9e1619 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:40.845877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44411852-fe1c-4be7-8d1f-5cdd6d9e1619 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:40.847396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44411852-fe1c-4be7-8d1f-5cdd6d9e1619 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:40.848540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44411852-fe1c-4be7-8d1f-5cdd6d9e1619 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:41.431383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-36e21314-b4af-44b6-a388-215f42f3ca0e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:41.444768 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-36e21314-b4af-44b6-a388-215f42f3ca0e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1662 microversion: 2.1 time: 0.748514 Jul 14 14:48:41.445501 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2080/4117] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:40 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1662 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:41.459531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61fdb56c-4156-4e66-b95c-aeff0873ce36 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:41.460267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-61fdb56c-4156-4e66-b95c-aeff0873ce36 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:41.470545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61fdb56c-4156-4e66-b95c-aeff0873ce36 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:41.471382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61fdb56c-4156-4e66-b95c-aeff0873ce36 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:41.473233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61fdb56c-4156-4e66-b95c-aeff0873ce36 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:41.476000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61fdb56c-4156-4e66-b95c-aeff0873ce36 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:41.693011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-44411852-fe1c-4be7-8d1f-5cdd6d9e1619 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:41.698374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:41.710599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-44411852-fe1c-4be7-8d1f-5cdd6d9e1619 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:41.712432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-44411852-fe1c-4be7-8d1f-5cdd6d9e1619 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:41.721832 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-44411852-fe1c-4be7-8d1f-5cdd6d9e1619 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2949 microversion: 2.32 time: 0.913613 Jul 14 14:48:41.722762 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2038/4118] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:40 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2949 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:41.731827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae2c35e7-c074-4050-a57d-b92ab44d9cfa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:41.732383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae2c35e7-c074-4050-a57d-b92ab44d9cfa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:41.761510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae2c35e7-c074-4050-a57d-b92ab44d9cfa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:41.762341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae2c35e7-c074-4050-a57d-b92ab44d9cfa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:41.763355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae2c35e7-c074-4050-a57d-b92ab44d9cfa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:41.764696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae2c35e7-c074-4050-a57d-b92ab44d9cfa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:41.884317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-61fdb56c-4156-4e66-b95c-aeff0873ce36 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:41.898237 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-61fdb56c-4156-4e66-b95c-aeff0873ce36 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 0.451345 Jul 14 14:48:41.900324 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2081/4119] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:41 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:41.904869 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ae2c35e7-c074-4050-a57d-b92ab44d9cfa tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action" status: 202 len: 0 microversion: 2.1 time: 0.180082 Jul 14 14:48:41.908531 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2039/4120] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:48:41 2022] POST /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:48:41.910664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-68b32e9f-2100-4446-a6e4-9c6ef78daeb3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:41.917316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-68b32e9f-2100-4446-a6e4-9c6ef78daeb3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:41.926215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a923d574-3356-45c0-a912-325b956c5958 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:41.927356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a923d574-3356-45c0-a912-325b956c5958 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:41.940194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a923d574-3356-45c0-a912-325b956c5958 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:41.940653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a923d574-3356-45c0-a912-325b956c5958 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:41.941479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a923d574-3356-45c0-a912-325b956c5958 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:41.942726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a923d574-3356-45c0-a912-325b956c5958 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:41.944266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68b32e9f-2100-4446-a6e4-9c6ef78daeb3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:41.944986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68b32e9f-2100-4446-a6e4-9c6ef78daeb3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:41.946271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68b32e9f-2100-4446-a6e4-9c6ef78daeb3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:41.946954 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68b32e9f-2100-4446-a6e4-9c6ef78daeb3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:42.592894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-68b32e9f-2100-4446-a6e4-9c6ef78daeb3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:42.605195 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-68b32e9f-2100-4446-a6e4-9c6ef78daeb3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1812 microversion: 2.1 time: 0.702835 Jul 14 14:48:42.608829 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2082/4121] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:41 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1812 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:42.616105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a923d574-3356-45c0-a912-325b956c5958 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:42.630710 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a923d574-3356-45c0-a912-325b956c5958 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1668 microversion: 2.1 time: 0.716131 Jul 14 14:48:42.635055 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2040/4122] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:41 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1668 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:42.734850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-56a67c87-7451-478a-98cb-90fefca55e4d req-3b008591-b0bd-465f-936f-b3dd58b6f763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2c99c7-5253-4416-80df-b1350d634e9d", "name": "network-vif-deleted", "tag": "9ebca414-fe51-4e00-8c95-42f3e92de3c7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:42.744335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f3c595e-354c-4695-a601-17b5bc9f1d2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:42.745189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8f3c595e-354c-4695-a601-17b5bc9f1d2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:42.750164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-56a67c87-7451-478a-98cb-90fefca55e4d req-3b008591-b0bd-465f-936f-b3dd58b6f763 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:42.750611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-56a67c87-7451-478a-98cb-90fefca55e4d req-3b008591-b0bd-465f-936f-b3dd58b6f763 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:42.761368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f3c595e-354c-4695-a601-17b5bc9f1d2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:42.769839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f3c595e-354c-4695-a601-17b5bc9f1d2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:42.773350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f3c595e-354c-4695-a601-17b5bc9f1d2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:42.773913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f3c595e-354c-4695-a601-17b5bc9f1d2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:42.797628 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-56a67c87-7451-478a-98cb-90fefca55e4d req-3b008591-b0bd-465f-936f-b3dd58b6f763 service nova] Creating event network-vif-deleted:9ebca414-fe51-4e00-8c95-42f3e92de3c7 for instance 8e2c99c7-5253-4416-80df-b1350d634e9d on n-h2-767704-28 Jul 14 14:48:42.818568 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-56a67c87-7451-478a-98cb-90fefca55e4d req-3b008591-b0bd-465f-936f-b3dd58b6f763 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088331 Jul 14 14:48:42.819197 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2083/4123] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:48:42.922338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0eed02f2-9914-4894-97cf-4c994332ec6b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:42.923061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0eed02f2-9914-4894-97cf-4c994332ec6b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:42.925173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:42.937634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eed02f2-9914-4894-97cf-4c994332ec6b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:42.938164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eed02f2-9914-4894-97cf-4c994332ec6b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:42.939013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eed02f2-9914-4894-97cf-4c994332ec6b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:42.949746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eed02f2-9914-4894-97cf-4c994332ec6b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:44.355665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f3c595e-354c-4695-a601-17b5bc9f1d2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:44.374213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f3c595e-354c-4695-a601-17b5bc9f1d2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:44.375856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f3c595e-354c-4695-a601-17b5bc9f1d2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:44.383088 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8f3c595e-354c-4695-a601-17b5bc9f1d2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2949 microversion: 2.32 time: 1.637577 Jul 14 14:48:44.396297 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2041/4124] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:42 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2949 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:44.399647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0eed02f2-9914-4894-97cf-4c994332ec6b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:44.427682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9b6215d8-dc0d-4d9b-b201-4b2c0ca7845c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:44.428471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9b6215d8-dc0d-4d9b-b201-4b2c0ca7845c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:44.433876 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0eed02f2-9914-4894-97cf-4c994332ec6b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 1.514232 Jul 14 14:48:44.436669 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2084/4125] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:42 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:44.450805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6f62e0fe-17f2-4fb6-9b7f-031c6a7e5ec2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:44.451509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6f62e0fe-17f2-4fb6-9b7f-031c6a7e5ec2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:44.458597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b6215d8-dc0d-4d9b-b201-4b2c0ca7845c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:44.459061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b6215d8-dc0d-4d9b-b201-4b2c0ca7845c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:44.459869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b6215d8-dc0d-4d9b-b201-4b2c0ca7845c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:44.460314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b6215d8-dc0d-4d9b-b201-4b2c0ca7845c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:44.480014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f62e0fe-17f2-4fb6-9b7f-031c6a7e5ec2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:44.480471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f62e0fe-17f2-4fb6-9b7f-031c6a7e5ec2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:44.485637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f62e0fe-17f2-4fb6-9b7f-031c6a7e5ec2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:44.486127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f62e0fe-17f2-4fb6-9b7f-031c6a7e5ec2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:46.344130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9b6215d8-dc0d-4d9b-b201-4b2c0ca7845c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:46.379855 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9b6215d8-dc0d-4d9b-b201-4b2c0ca7845c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1611 microversion: 2.1 time: 1.993699 Jul 14 14:48:46.388176 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2042/4126] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:44 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1611 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:46.394997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-78a1d453-29ab-4b68-ac22-ae4cf5284e8d req-aea73a7c-6093-470f-b278-132c3c17252e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-unplugged", "status": "completed", "tag": "847e25f0-cf0b-4884-a99c-bc72592ab04e"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:46.438927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-78a1d453-29ab-4b68-ac22-ae4cf5284e8d req-aea73a7c-6093-470f-b278-132c3c17252e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:46.452125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-78a1d453-29ab-4b68-ac22-ae4cf5284e8d req-aea73a7c-6093-470f-b278-132c3c17252e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:46.538098 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-78a1d453-29ab-4b68-ac22-ae4cf5284e8d req-aea73a7c-6093-470f-b278-132c3c17252e service nova] Creating event network-vif-unplugged:847e25f0-cf0b-4884-a99c-bc72592ab04e for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:48:46.565896 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-78a1d453-29ab-4b68-ac22-ae4cf5284e8d req-aea73a7c-6093-470f-b278-132c3c17252e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.175398 Jul 14 14:48:46.566541 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2043/4127] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:46.590038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dcfedf3b-e485-43a6-a167-cbb1367758d2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:46.594215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dcfedf3b-e485-43a6-a167-cbb1367758d2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:46.615858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dcfedf3b-e485-43a6-a167-cbb1367758d2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:46.616339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dcfedf3b-e485-43a6-a167-cbb1367758d2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:46.617178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dcfedf3b-e485-43a6-a167-cbb1367758d2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:46.619538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dcfedf3b-e485-43a6-a167-cbb1367758d2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:46.774529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6f62e0fe-17f2-4fb6-9b7f-031c6a7e5ec2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:46.790435 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6f62e0fe-17f2-4fb6-9b7f-031c6a7e5ec2 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 2.349484 Jul 14 14:48:46.793032 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2085/4128] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:44 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:46.804434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a9b6785a-fb28-4dc9-b511-417661e46d29 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:46.805100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a9b6785a-fb28-4dc9-b511-417661e46d29 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:46.819520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9b6785a-fb28-4dc9-b511-417661e46d29 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:46.822825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9b6785a-fb28-4dc9-b511-417661e46d29 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:46.823785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9b6785a-fb28-4dc9-b511-417661e46d29 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:46.824249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9b6785a-fb28-4dc9-b511-417661e46d29 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:47.254881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dcfedf3b-e485-43a6-a167-cbb1367758d2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:47.270709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dcfedf3b-e485-43a6-a167-cbb1367758d2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:47.276450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dcfedf3b-e485-43a6-a167-cbb1367758d2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:47.282830 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dcfedf3b-e485-43a6-a167-cbb1367758d2 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2928 microversion: 2.32 time: 0.704326 Jul 14 14:48:47.285567 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2044/4129] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:46 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2928 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:47.304220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-76ce7e95-aa85-4861-9123-ac5eb394b480 req-e81f9a45-34ac-433c-be39-f0752373aa98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2c99c7-5253-4416-80df-b1350d634e9d", "name": "network-vif-deleted", "tag": "5a927ba1-7c5a-4bd4-b273-0b9328af2241"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:47.346886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-76ce7e95-aa85-4861-9123-ac5eb394b480 req-e81f9a45-34ac-433c-be39-f0752373aa98 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:47.348181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-76ce7e95-aa85-4861-9123-ac5eb394b480 req-e81f9a45-34ac-433c-be39-f0752373aa98 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:47.394337 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-76ce7e95-aa85-4861-9123-ac5eb394b480 req-e81f9a45-34ac-433c-be39-f0752373aa98 service nova] Creating event network-vif-deleted:5a927ba1-7c5a-4bd4-b273-0b9328af2241 for instance 8e2c99c7-5253-4416-80df-b1350d634e9d on n-h2-767704-28 Jul 14 14:48:47.402825 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-76ce7e95-aa85-4861-9123-ac5eb394b480 req-e81f9a45-34ac-433c-be39-f0752373aa98 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115703 Jul 14 14:48:47.408911 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2045/4130] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:47.419257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e85cb07-95de-4839-b4df-d5801f8a7dd9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:47.420013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4e85cb07-95de-4839-b4df-d5801f8a7dd9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:47.438220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e85cb07-95de-4839-b4df-d5801f8a7dd9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:47.439045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e85cb07-95de-4839-b4df-d5801f8a7dd9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:47.440036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e85cb07-95de-4839-b4df-d5801f8a7dd9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:47.441280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e85cb07-95de-4839-b4df-d5801f8a7dd9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:47.708063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a9b6785a-fb28-4dc9-b511-417661e46d29 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:47.720891 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a9b6785a-fb28-4dc9-b511-417661e46d29 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 0.926707 Jul 14 14:48:47.721884 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2086/4131] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:46 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:47.727394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24e34e6d-c33f-4257-a329-daef5a690bac tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:47.728282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-24e34e6d-c33f-4257-a329-daef5a690bac tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:47.750975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24e34e6d-c33f-4257-a329-daef5a690bac tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:47.753684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24e34e6d-c33f-4257-a329-daef5a690bac tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:47.759090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24e34e6d-c33f-4257-a329-daef5a690bac tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:47.760724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24e34e6d-c33f-4257-a329-daef5a690bac tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:47.803344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4e85cb07-95de-4839-b4df-d5801f8a7dd9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:47.823854 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e85cb07-95de-4839-b4df-d5801f8a7dd9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1671 microversion: 2.1 time: 0.413497 Jul 14 14:48:47.839115 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2046/4132] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:47 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1671 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:47.854796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:47.855620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:47.865791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:47.868305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:47.869020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:47.870018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:47.870834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:48.055820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:48:48.064730 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.compute.api [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Working on deleting snapshot cde77bda-bc24-44b7-8ca9-5a5c494cf2e3 from shelved instance... Jul 14 14:48:48.086786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-24e34e6d-c33f-4257-a329-daef5a690bac tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:48.116049 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-24e34e6d-c33f-4257-a329-daef5a690bac tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 200 len: 1454 microversion: 2.1 time: 0.392758 Jul 14 14:48:48.117203 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2087/4133] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:47 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 1454 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:48.307667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff3ca731-9afe-44b1-87ef-eb2a0800906f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:48.308371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ff3ca731-9afe-44b1-87ef-eb2a0800906f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:48.334403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff3ca731-9afe-44b1-87ef-eb2a0800906f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:48.335342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff3ca731-9afe-44b1-87ef-eb2a0800906f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:48.336760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff3ca731-9afe-44b1-87ef-eb2a0800906f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:48.337913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff3ca731-9afe-44b1-87ef-eb2a0800906f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:48.344338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:48.959970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ff3ca731-9afe-44b1-87ef-eb2a0800906f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:48.985149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ff3ca731-9afe-44b1-87ef-eb2a0800906f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:48.986817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ff3ca731-9afe-44b1-87ef-eb2a0800906f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:49.007476 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ff3ca731-9afe-44b1-87ef-eb2a0800906f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2907 microversion: 2.32 time: 0.690343 Jul 14 14:48:49.022543 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2088/4134] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:48 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2907 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:48:49.044548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-1af2033a-b577-4c6f-b5b0-03f298eba884 req-d58f5500-e92d-429f-8858-fb6a1915e1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-unplugged", "status": "completed", "tag": "e724799c-54b2-4910-bf13-c3ceedda7f4a"}, {"server_uuid": "8e2c99c7-5253-4416-80df-b1350d634e9d", "name": "network-vif-unplugged", "status": "completed", "tag": "86ca3bdc-6ff5-4dd9-b14c-2c27098964ee"}, {"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-unplugged", "status": "completed", "tag": "e86e4d9f-79ef-4b60-93ad-9741fa882539"}, {"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-unplugged", "status": "completed", "tag": "5f2e657b-30cc-4497-a912-7f7416056eb1"}, {"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-unplugged", "status": "completed", "tag": "e821f371-f015-4b58-8a2e-a1611a49246a"}, {"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-unplugged", "status": "completed", "tag": "69dae4af-3029-468a-89e3-6dde860957cb"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:49.060290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1af2033a-b577-4c6f-b5b0-03f298eba884 req-d58f5500-e92d-429f-8858-fb6a1915e1e1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:49.062623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1af2033a-b577-4c6f-b5b0-03f298eba884 req-d58f5500-e92d-429f-8858-fb6a1915e1e1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:49.099366 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-1af2033a-b577-4c6f-b5b0-03f298eba884 req-d58f5500-e92d-429f-8858-fb6a1915e1e1 service nova] Creating event network-vif-unplugged:e724799c-54b2-4910-bf13-c3ceedda7f4a for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:48:49.100429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-1af2033a-b577-4c6f-b5b0-03f298eba884 req-d58f5500-e92d-429f-8858-fb6a1915e1e1 service nova] Creating event network-vif-unplugged:86ca3bdc-6ff5-4dd9-b14c-2c27098964ee for instance 8e2c99c7-5253-4416-80df-b1350d634e9d on n-h2-767704-28 Jul 14 14:48:49.101310 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-1af2033a-b577-4c6f-b5b0-03f298eba884 req-d58f5500-e92d-429f-8858-fb6a1915e1e1 service nova] Creating event network-vif-unplugged:e86e4d9f-79ef-4b60-93ad-9741fa882539 for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:48:49.102115 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-1af2033a-b577-4c6f-b5b0-03f298eba884 req-d58f5500-e92d-429f-8858-fb6a1915e1e1 service nova] Creating event network-vif-unplugged:5f2e657b-30cc-4497-a912-7f7416056eb1 for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:48:49.102731 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-1af2033a-b577-4c6f-b5b0-03f298eba884 req-d58f5500-e92d-429f-8858-fb6a1915e1e1 service nova] Creating event network-vif-unplugged:e821f371-f015-4b58-8a2e-a1611a49246a for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:48:49.103588 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-1af2033a-b577-4c6f-b5b0-03f298eba884 req-d58f5500-e92d-429f-8858-fb6a1915e1e1 service nova] Creating event network-vif-unplugged:69dae4af-3029-468a-89e3-6dde860957cb for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:48:49.192902 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-1af2033a-b577-4c6f-b5b0-03f298eba884 req-d58f5500-e92d-429f-8858-fb6a1915e1e1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.155917 Jul 14 14:48:49.200988 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2089/4135] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:49.258820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-81d94137-ae38-4b07-bafc-6ffa73a21336 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:49.262720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-81d94137-ae38-4b07-bafc-6ffa73a21336 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:49.290832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81d94137-ae38-4b07-bafc-6ffa73a21336 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:49.291438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81d94137-ae38-4b07-bafc-6ffa73a21336 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:49.293514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81d94137-ae38-4b07-bafc-6ffa73a21336 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:49.295203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81d94137-ae38-4b07-bafc-6ffa73a21336 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:49.484507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Doing local delete in cell e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) {{(pid=119511) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 14 14:48:49.485732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:49.486296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:49.486838 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.compute.api [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 14 14:48:49.491204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] deallocate_for_instance() {{(pid=119511) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 14 14:48:50.462481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-81d94137-ae38-4b07-bafc-6ffa73a21336 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:50.480830 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-81d94137-ae38-4b07-bafc-6ffa73a21336 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 1.269701 Jul 14 14:48:50.483673 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2090/4136] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:49 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:50.498285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37a09b3f-c7e8-4042-873f-73d67ef89e45 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:50.501158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-37a09b3f-c7e8-4042-873f-73d67ef89e45 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:50.531094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37a09b3f-c7e8-4042-873f-73d67ef89e45 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:50.531778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37a09b3f-c7e8-4042-873f-73d67ef89e45 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:50.532800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37a09b3f-c7e8-4042-873f-73d67ef89e45 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:50.533302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37a09b3f-c7e8-4042-873f-73d67ef89e45 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:50.580116 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-37a09b3f-c7e8-4042-873f-73d67ef89e45 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] HTTP exception thrown: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37a09b3f-c7e8-4042-873f-73d67ef89e45 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Request method failure captured: Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d HTTP/1.1 Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CyPejn0tX0RC-2eybolng7tBx1MF3DZ6-deYIRCq6WpztdOVlummjYi3sGiZYTyCNHbdlg32APsQcQrf7kMPi5fGx77R_59YVXJ-T29ZvDIoByy08k9m0g_-yMSjkrzBQGFRBJxQ4IOJ5O_7o77IB_Q3ZYySmEzIyCatNOOe6ST8IU Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 1bf20852acdd4cea9ed6e96934097280 Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestMultiNic-1910901922 Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1bf20852acdd4cea9ed6e96934097280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1bf20852acdd4cea9ed6e96934097280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1bf20852acdd4cea9ed6e96934097280", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1bf20852acdd4cea9ed6e96934097280"}]}] Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestMultiNic-1910901922 Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 1bf20852acdd4cea9ed6e96934097280 Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestMultiNic-1910901922 Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestMultiNic-1910901922-project Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 35abcadc35964a9d8df499c4d987e056 Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestMultiNic-1910901922-project Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '8e2c99c7-5253-4416-80df-b1350d634e9d'} Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:50.613447 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:48:50.618420 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:50.618420 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:50.618420 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:50.618420 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:48:50.618420 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:48:50.618420 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:48:50.618420 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:48:50.619949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37a09b3f-c7e8-4042-873f-73d67ef89e45 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Returning 404 to user: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:48:50.621145 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-37a09b3f-c7e8-4042-873f-73d67ef89e45 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 404 len: 111 microversion: 2.1 time: 0.134382 Jul 14 14:48:50.622626 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2091/4137] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:50 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:48:50.635402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b5feb5de-6c47-49b8-9921-8682b0e127d5 req-b0fc45eb-ef84-47c8-beb0-08cd9aef9553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2c99c7-5253-4416-80df-b1350d634e9d", "name": "network-vif-deleted", "tag": "86ca3bdc-6ff5-4dd9-b14c-2c27098964ee"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:50.668249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b5feb5de-6c47-49b8-9921-8682b0e127d5 req-b0fc45eb-ef84-47c8-beb0-08cd9aef9553 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:50.675106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b5feb5de-6c47-49b8-9921-8682b0e127d5 req-b0fc45eb-ef84-47c8-beb0-08cd9aef9553 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:50.728901 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b5feb5de-6c47-49b8-9921-8682b0e127d5 req-b0fc45eb-ef84-47c8-beb0-08cd9aef9553 service nova] Creating event network-vif-deleted:86ca3bdc-6ff5-4dd9-b14c-2c27098964ee for instance 8e2c99c7-5253-4416-80df-b1350d634e9d on n-h2-767704-28 Jul 14 14:48:50.738711 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b5feb5de-6c47-49b8-9921-8682b0e127d5 req-b0fc45eb-ef84-47c8-beb0-08cd9aef9553 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111243 Jul 14 14:48:50.742429 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2092/4138] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:50.754418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-21cea01e-7998-4328-9400-32b2e7420ccb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:50.759891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-21cea01e-7998-4328-9400-32b2e7420ccb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:50.776859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21cea01e-7998-4328-9400-32b2e7420ccb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:50.777621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21cea01e-7998-4328-9400-32b2e7420ccb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:50.781176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21cea01e-7998-4328-9400-32b2e7420ccb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:50.785833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21cea01e-7998-4328-9400-32b2e7420ccb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:52.601445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Updating instance_info_cache with network_info: [] {{(pid=119511) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:48:52.860091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-21cea01e-7998-4328-9400-32b2e7420ccb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:52.878426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-21cea01e-7998-4328-9400-32b2e7420ccb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:52.886330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-21cea01e-7998-4328-9400-32b2e7420ccb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:52.887733 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-21cea01e-7998-4328-9400-32b2e7420ccb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2861 microversion: 2.32 time: 2.143590 Jul 14 14:48:52.889801 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2093/4139] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:50 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2861 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:52.897825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6a6aec9c-9283-4be3-895b-9f5434363fc4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:52.919097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6a6aec9c-9283-4be3-895b-9f5434363fc4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:52.939701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a6aec9c-9283-4be3-895b-9f5434363fc4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:52.942459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a6aec9c-9283-4be3-895b-9f5434363fc4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:52.944210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a6aec9c-9283-4be3-895b-9f5434363fc4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:52.944922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a6aec9c-9283-4be3-895b-9f5434363fc4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:53.803717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6a6aec9c-9283-4be3-895b-9f5434363fc4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:53.815352 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6a6aec9c-9283-4be3-895b-9f5434363fc4 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 0.924064 Jul 14 14:48:53.818489 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2094/4140] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:52 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:53.818919 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b9993658-1eee-41ec-b8bc-f638aadbe34c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 204 len: 0 microversion: 2.1 time: 5.966210 Jul 14 14:48:53.827687 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2047/4141] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:48:47 2022] DELETE /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 0 bytes in 5978 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:48:53.839410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f4b082b9-aafd-4d11-8889-4c6738dd9e69 req-08307182-9c91-4aa3-9684-b88a716ff75c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be684ea-99fc-4c45-86e4-52e39f39a2b6", "name": "network-vif-deleted", "tag": "b7327c3d-0492-4493-b434-a4db3c983c3d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:53.843808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-693f5316-59dd-4a4d-b8a9-b63c63039e5a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:53.847642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-693f5316-59dd-4a4d-b8a9-b63c63039e5a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 4be684ea-99fc-4c45-86e4-52e39f39a2b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:53.875555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f4b082b9-aafd-4d11-8889-4c6738dd9e69 req-08307182-9c91-4aa3-9684-b88a716ff75c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:53.876452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f4b082b9-aafd-4d11-8889-4c6738dd9e69 req-08307182-9c91-4aa3-9684-b88a716ff75c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:53.877206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-693f5316-59dd-4a4d-b8a9-b63c63039e5a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:53.878979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-693f5316-59dd-4a4d-b8a9-b63c63039e5a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:53.883880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-693f5316-59dd-4a4d-b8a9-b63c63039e5a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:53.885023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-693f5316-59dd-4a4d-b8a9-b63c63039e5a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:53.920629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.compute.server_external_events [req-f4b082b9-aafd-4d11-8889-4c6738dd9e69 req-08307182-9c91-4aa3-9684-b88a716ff75c service nova] Unable to find a host for instance 4be684ea-99fc-4c45-86e4-52e39f39a2b6. Dropping event network-vif-deleted {{(pid=119512) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 14:48:53.924771 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f4b082b9-aafd-4d11-8889-4c6738dd9e69 req-08307182-9c91-4aa3-9684-b88a716ff75c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.104174 Jul 14 14:48:53.928702 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2095/4142] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 109 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 14:48:53.936987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8db10c0-829f-4256-ab65-86ae46084693 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:53.938003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8db10c0-829f-4256-ab65-86ae46084693 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:53.946962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8db10c0-829f-4256-ab65-86ae46084693 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:53.947851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8db10c0-829f-4256-ab65-86ae46084693 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:53.949133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8db10c0-829f-4256-ab65-86ae46084693 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:53.950293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8db10c0-829f-4256-ab65-86ae46084693 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:53.996986 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-693f5316-59dd-4a4d-b8a9-b63c63039e5a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] HTTP exception thrown: Instance 4be684ea-99fc-4c45-86e4-52e39f39a2b6 could not be found. Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-693f5316-59dd-4a4d-b8a9-b63c63039e5a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Request method failure captured: Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 HTTP/1.1 Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CqeTHaua1mrAoMsWalZYpPqmTQ-DcKvLbCsfPO7qDbpKBxxTx4n3bTPRxjIsY87FdmdIpxDuFpmylNVxXWu7O4aKHski9z6vXFgUEATmO5T5a4xVEdgMgmRCGrZRc-L7A0A1cYH36dJi-2mZ9w6VAAL7DBepATCUrn7iOaopLMMuR0 Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1933006fa13c44ae9128f00267210152 Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1933006fa13c44ae9128f00267210152"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1933006fa13c44ae9128f00267210152"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1933006fa13c44ae9128f00267210152", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1933006fa13c44ae9128f00267210152"}]}] Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1933006fa13c44ae9128f00267210152 Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-1472511591-project Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f157150edd1d441aa2c7335dbb2363ca Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-1472511591-project Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 4be684ea-99fc-4c45-86e4-52e39f39a2b6 could not be found. Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '4be684ea-99fc-4c45-86e4-52e39f39a2b6'} Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be684ea-99fc-4c45-86e4-52e39f39a2b6 could not be found. Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be684ea-99fc-4c45-86e4-52e39f39a2b6 could not be found. Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:54.001522 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:54.013610 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:54.013610 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:54.013610 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:54.013610 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:48:54.013610 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:48:54.013610 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be684ea-99fc-4c45-86e4-52e39f39a2b6 could not be found. Jul 14 14:48:54.013610 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:48:54.015387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-693f5316-59dd-4a4d-b8a9-b63c63039e5a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Returning 404 to user: Instance 4be684ea-99fc-4c45-86e4-52e39f39a2b6 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:48:54.017420 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-693f5316-59dd-4a4d-b8a9-b63c63039e5a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6" status: 404 len: 111 microversion: 2.1 time: 0.184769 Jul 14 14:48:54.019155 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2048/4143] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:53 2022] GET /compute/v2.1/servers/4be684ea-99fc-4c45-86e4-52e39f39a2b6 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:48:54.029445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7e6ae697-00c9-4a82-a685-9750d36ddb4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:54.030821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7e6ae697-00c9-4a82-a685-9750d36ddb4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:54.041450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e6ae697-00c9-4a82-a685-9750d36ddb4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:54.042013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e6ae697-00c9-4a82-a685-9750d36ddb4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:54.043071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e6ae697-00c9-4a82-a685-9750d36ddb4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:54.043701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e6ae697-00c9-4a82-a685-9750d36ddb4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:54.086502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7e6ae697-00c9-4a82-a685-9750d36ddb4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:48:54.106998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:54.283046 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7e6ae697-00c9-4a82-a685-9750d36ddb4c tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 204 len: 0 microversion: 2.1 time: 0.259093 Jul 14 14:48:54.288135 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2049/4144] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:48:54 2022] DELETE /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:48:54.306856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-59eaf295-d3c5-4615-bc83-5ceb8c469eb7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:54.308175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-59eaf295-d3c5-4615-bc83-5ceb8c469eb7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:54.329244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59eaf295-d3c5-4615-bc83-5ceb8c469eb7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:54.331093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59eaf295-d3c5-4615-bc83-5ceb8c469eb7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:54.332528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59eaf295-d3c5-4615-bc83-5ceb8c469eb7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:54.335823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59eaf295-d3c5-4615-bc83-5ceb8c469eb7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:54.773449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d8db10c0-829f-4256-ab65-86ae46084693 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:54.797791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-59eaf295-d3c5-4615-bc83-5ceb8c469eb7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:54.836248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d8db10c0-829f-4256-ab65-86ae46084693 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:54.845905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d8db10c0-829f-4256-ab65-86ae46084693 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:54.856432 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8db10c0-829f-4256-ab65-86ae46084693 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2861 microversion: 2.32 time: 0.917980 Jul 14 14:48:54.859123 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2096/4145] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:53 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2861 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:54.879557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-00b9905d-3766-4fdf-9d97-6a7dd548c612 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:54.883968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-00b9905d-3766-4fdf-9d97-6a7dd548c612 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:54.903550 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-59eaf295-d3c5-4615-bc83-5ceb8c469eb7 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1467 microversion: 2.1 time: 0.613500 Jul 14 14:48:54.925140 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2050/4146] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:54 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1467 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:54.929517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00b9905d-3766-4fdf-9d97-6a7dd548c612 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:54.930044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00b9905d-3766-4fdf-9d97-6a7dd548c612 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:54.930890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00b9905d-3766-4fdf-9d97-6a7dd548c612 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:54.931340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00b9905d-3766-4fdf-9d97-6a7dd548c612 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:54.933487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d8613e5e-dd49-4b54-a2d8-1abb935183b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:54.934579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d8613e5e-dd49-4b54-a2d8-1abb935183b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:54.947416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8613e5e-dd49-4b54-a2d8-1abb935183b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:54.950806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8613e5e-dd49-4b54-a2d8-1abb935183b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:54.951913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8613e5e-dd49-4b54-a2d8-1abb935183b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:54.952378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8613e5e-dd49-4b54-a2d8-1abb935183b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:55.017507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-00b9905d-3766-4fdf-9d97-6a7dd548c612 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:48:55.229604 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-00b9905d-3766-4fdf-9d97-6a7dd548c612 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 204 len: 0 microversion: 2.1 time: 0.357558 Jul 14 14:48:55.239303 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2097/4147] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:48:54 2022] DELETE /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:48:55.268007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7af36262-4231-4b31-8b4f-2bff11a5500f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:55.276775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7af36262-4231-4b31-8b4f-2bff11a5500f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:55.303051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7af36262-4231-4b31-8b4f-2bff11a5500f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:55.303933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7af36262-4231-4b31-8b4f-2bff11a5500f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:55.305512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7af36262-4231-4b31-8b4f-2bff11a5500f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:55.306403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7af36262-4231-4b31-8b4f-2bff11a5500f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:55.632818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d8613e5e-dd49-4b54-a2d8-1abb935183b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:55.642076 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d8613e5e-dd49-4b54-a2d8-1abb935183b5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 0.714951 Jul 14 14:48:55.653392 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2051/4148] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:54 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:55.893156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cbea691c-b143-4be5-8edc-626100c832dd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:55.893786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cbea691c-b143-4be5-8edc-626100c832dd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:55.902870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cbea691c-b143-4be5-8edc-626100c832dd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:55.903330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cbea691c-b143-4be5-8edc-626100c832dd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:55.904122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cbea691c-b143-4be5-8edc-626100c832dd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:55.905266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cbea691c-b143-4be5-8edc-626100c832dd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:56.005295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7af36262-4231-4b31-8b4f-2bff11a5500f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:56.018146 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7af36262-4231-4b31-8b4f-2bff11a5500f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1508 microversion: 2.1 time: 0.775410 Jul 14 14:48:56.024184 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2098/4149] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:55 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1508 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:56.042449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a9ab02f-cd3e-40fd-a9f5-b02c9fe2a10a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:56.043184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3a9ab02f-cd3e-40fd-a9f5-b02c9fe2a10a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:56.054860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a9ab02f-cd3e-40fd-a9f5-b02c9fe2a10a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:56.055345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a9ab02f-cd3e-40fd-a9f5-b02c9fe2a10a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:56.063337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a9ab02f-cd3e-40fd-a9f5-b02c9fe2a10a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:56.066026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a9ab02f-cd3e-40fd-a9f5-b02c9fe2a10a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:56.371402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3a9ab02f-cd3e-40fd-a9f5-b02c9fe2a10a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:56.389337 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3a9ab02f-cd3e-40fd-a9f5-b02c9fe2a10a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1467 microversion: 2.1 time: 0.362721 Jul 14 14:48:56.405131 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2099/4150] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:56 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1467 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:56.405131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0a67a875-5351-4774-8432-de6ccdf872df req-581ee43f-abc8-4cb2-92d0-efe475cfac59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-deleted", "tag": "e821f371-f015-4b58-8a2e-a1611a49246a"}, {"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-deleted", "tag": "e86e4d9f-79ef-4b60-93ad-9741fa882539"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:56.438203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0a67a875-5351-4774-8432-de6ccdf872df req-581ee43f-abc8-4cb2-92d0-efe475cfac59 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:56.438810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0a67a875-5351-4774-8432-de6ccdf872df req-581ee43f-abc8-4cb2-92d0-efe475cfac59 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:56.480765 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0a67a875-5351-4774-8432-de6ccdf872df req-581ee43f-abc8-4cb2-92d0-efe475cfac59 service nova] Creating event network-vif-deleted:e821f371-f015-4b58-8a2e-a1611a49246a for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:48:56.484102 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0a67a875-5351-4774-8432-de6ccdf872df req-581ee43f-abc8-4cb2-92d0-efe475cfac59 service nova] Creating event network-vif-deleted:e86e4d9f-79ef-4b60-93ad-9741fa882539 for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:48:56.500671 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0a67a875-5351-4774-8432-de6ccdf872df req-581ee43f-abc8-4cb2-92d0-efe475cfac59 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104461 Jul 14 14:48:56.504105 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2100/4151] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:56.568009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cbea691c-b143-4be5-8edc-626100c832dd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:56.581173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cbea691c-b143-4be5-8edc-626100c832dd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:56.584928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cbea691c-b143-4be5-8edc-626100c832dd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:56.590180 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cbea691c-b143-4be5-8edc-626100c832dd tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2815 microversion: 2.32 time: 0.700921 Jul 14 14:48:56.593997 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2052/4152] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:55 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2815 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:48:56.681347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd41e6dd-8eb8-4f9a-b5fb-195506866bc8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:56.682202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cd41e6dd-8eb8-4f9a-b5fb-195506866bc8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:56.693122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd41e6dd-8eb8-4f9a-b5fb-195506866bc8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:56.693712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd41e6dd-8eb8-4f9a-b5fb-195506866bc8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:56.694602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd41e6dd-8eb8-4f9a-b5fb-195506866bc8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:56.695057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd41e6dd-8eb8-4f9a-b5fb-195506866bc8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:57.057348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c426f887-c7c0-4851-819c-f936099cc8d0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:57.058243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c426f887-c7c0-4851-819c-f936099cc8d0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:57.099215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c426f887-c7c0-4851-819c-f936099cc8d0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:57.102405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c426f887-c7c0-4851-819c-f936099cc8d0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:57.104328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c426f887-c7c0-4851-819c-f936099cc8d0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:57.108019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c426f887-c7c0-4851-819c-f936099cc8d0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:57.341488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cd41e6dd-8eb8-4f9a-b5fb-195506866bc8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:57.355242 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cd41e6dd-8eb8-4f9a-b5fb-195506866bc8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 0.685747 Jul 14 14:48:57.363986 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2101/4153] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:56 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:57.423761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8e0bea0-eeb6-4611-8bd4-e3893c9e9c9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:57.427330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8e0bea0-eeb6-4611-8bd4-e3893c9e9c9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:57.466256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8e0bea0-eeb6-4611-8bd4-e3893c9e9c9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:57.466731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8e0bea0-eeb6-4611-8bd4-e3893c9e9c9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:57.470696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8e0bea0-eeb6-4611-8bd4-e3893c9e9c9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:57.478625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8e0bea0-eeb6-4611-8bd4-e3893c9e9c9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:57.758593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f8e0bea0-eeb6-4611-8bd4-e3893c9e9c9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:57.774270 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8e0bea0-eeb6-4611-8bd4-e3893c9e9c9a tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1467 microversion: 2.1 time: 0.356201 Jul 14 14:48:57.780283 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2102/4154] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:57 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1467 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:57.792541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0430bfb2-c9d0-4684-8410-b0a8c24363dc tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:57.798703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0430bfb2-c9d0-4684-8410-b0a8c24363dc tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:57.817661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0430bfb2-c9d0-4684-8410-b0a8c24363dc tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:57.818121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0430bfb2-c9d0-4684-8410-b0a8c24363dc tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:57.824381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c426f887-c7c0-4851-819c-f936099cc8d0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:57.837214 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c426f887-c7c0-4851-819c-f936099cc8d0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1508 microversion: 2.1 time: 0.787504 Jul 14 14:48:57.837438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0430bfb2-c9d0-4684-8410-b0a8c24363dc tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:57.838521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0430bfb2-c9d0-4684-8410-b0a8c24363dc tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:57.842452 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2053/4155] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:57 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1508 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:58.379973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-54dabba2-9e29-46be-ab16-be7f12c49f9e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:58.381531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-54dabba2-9e29-46be-ab16-be7f12c49f9e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:58.398921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54dabba2-9e29-46be-ab16-be7f12c49f9e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:58.400245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54dabba2-9e29-46be-ab16-be7f12c49f9e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:58.406547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54dabba2-9e29-46be-ab16-be7f12c49f9e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:58.410356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-54dabba2-9e29-46be-ab16-be7f12c49f9e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:59.237757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0430bfb2-c9d0-4684-8410-b0a8c24363dc tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:59.254082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0430bfb2-c9d0-4684-8410-b0a8c24363dc tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:59.256367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0430bfb2-c9d0-4684-8410-b0a8c24363dc tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:59.270635 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0430bfb2-c9d0-4684-8410-b0a8c24363dc tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2368 microversion: 2.32 time: 1.488713 Jul 14 14:48:59.272159 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2103/4156] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:57 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2368 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:59.278669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-cf53ed9b-f3cb-46e5-b4ba-c52b1e449306 req-dbeaa8c1-5247-475e-9bc3-98e0b84a905c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-deleted", "tag": "69dae4af-3029-468a-89e3-6dde860957cb"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:59.292111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-cf53ed9b-f3cb-46e5-b4ba-c52b1e449306 req-dbeaa8c1-5247-475e-9bc3-98e0b84a905c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:59.292576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-cf53ed9b-f3cb-46e5-b4ba-c52b1e449306 req-dbeaa8c1-5247-475e-9bc3-98e0b84a905c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:59.312261 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-cf53ed9b-f3cb-46e5-b4ba-c52b1e449306 req-dbeaa8c1-5247-475e-9bc3-98e0b84a905c service nova] Creating event network-vif-deleted:69dae4af-3029-468a-89e3-6dde860957cb for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:48:59.321734 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-cf53ed9b-f3cb-46e5-b4ba-c52b1e449306 req-dbeaa8c1-5247-475e-9bc3-98e0b84a905c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047257 Jul 14 14:48:59.322420 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2104/4157] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:59.329740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-84909083-eebc-4748-a7e4-0aeea64fda23 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:59.330646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-84909083-eebc-4748-a7e4-0aeea64fda23 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:59.343647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84909083-eebc-4748-a7e4-0aeea64fda23 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:59.345940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84909083-eebc-4748-a7e4-0aeea64fda23 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:59.347698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84909083-eebc-4748-a7e4-0aeea64fda23 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:59.348630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-54dabba2-9e29-46be-ab16-be7f12c49f9e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:59.359888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84909083-eebc-4748-a7e4-0aeea64fda23 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:59.363790 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-54dabba2-9e29-46be-ab16-be7f12c49f9e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 0.985303 Jul 14 14:48:59.367251 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2054/4158] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:58 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:59.382784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-19d8244c-13bb-4088-b32a-f2a05e2e4cbd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:59.401243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-19d8244c-13bb-4088-b32a-f2a05e2e4cbd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:59.425726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19d8244c-13bb-4088-b32a-f2a05e2e4cbd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:59.427168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19d8244c-13bb-4088-b32a-f2a05e2e4cbd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:59.429666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19d8244c-13bb-4088-b32a-f2a05e2e4cbd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:59.434246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-19d8244c-13bb-4088-b32a-f2a05e2e4cbd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:59.685135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-19d8244c-13bb-4088-b32a-f2a05e2e4cbd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:59.699038 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-19d8244c-13bb-4088-b32a-f2a05e2e4cbd tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 200 len: 1466 microversion: 2.1 time: 0.326007 Jul 14 14:48:59.699744 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2055/4159] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:59 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 1466 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:59.797713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-84909083-eebc-4748-a7e4-0aeea64fda23 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:59.812580 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-84909083-eebc-4748-a7e4-0aeea64fda23 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 200 len: 1467 microversion: 2.1 time: 0.488421 Jul 14 14:48:59.818238 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2105/4160] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:59 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 1467 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:59.843875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-4661eab6-b291-4017-85c2-3c892ba693e0 req-8f488b5e-ab19-41d0-bf52-dbece2b1ce6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83f75ff-3ed3-406d-9e13-695407c179a3", "name": "network-vif-deleted", "tag": "280185ac-7091-47cb-a2fa-c06391e9b6cf"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:59.874921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4661eab6-b291-4017-85c2-3c892ba693e0 req-8f488b5e-ab19-41d0-bf52-dbece2b1ce6e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:59.875379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4661eab6-b291-4017-85c2-3c892ba693e0 req-8f488b5e-ab19-41d0-bf52-dbece2b1ce6e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:59.924365 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-4661eab6-b291-4017-85c2-3c892ba693e0 req-8f488b5e-ab19-41d0-bf52-dbece2b1ce6e service nova] Creating event network-vif-deleted:280185ac-7091-47cb-a2fa-c06391e9b6cf for instance d83f75ff-3ed3-406d-9e13-695407c179a3 on n-h2-767704-28 Jul 14 14:48:59.937726 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-4661eab6-b291-4017-85c2-3c892ba693e0 req-8f488b5e-ab19-41d0-bf52-dbece2b1ce6e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107749 Jul 14 14:48:59.943033 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2056/4161] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:00.298080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff35d8a8-980a-412d-bda1-cd624da041d4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:00.298810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ff35d8a8-980a-412d-bda1-cd624da041d4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:00.321532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff35d8a8-980a-412d-bda1-cd624da041d4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:00.322018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff35d8a8-980a-412d-bda1-cd624da041d4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:00.322903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff35d8a8-980a-412d-bda1-cd624da041d4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:00.323355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff35d8a8-980a-412d-bda1-cd624da041d4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:00.383834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8c02a2b-1319-4a58-a631-a156b6597f32 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:00.384557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b8c02a2b-1319-4a58-a631-a156b6597f32 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:00.409674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8c02a2b-1319-4a58-a631-a156b6597f32 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:00.410518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8c02a2b-1319-4a58-a631-a156b6597f32 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:00.417408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8c02a2b-1319-4a58-a631-a156b6597f32 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:00.418581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8c02a2b-1319-4a58-a631-a156b6597f32 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.185660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ff35d8a8-980a-412d-bda1-cd624da041d4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:01.230660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ff35d8a8-980a-412d-bda1-cd624da041d4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:01.231270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b8c02a2b-1319-4a58-a631-a156b6597f32 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:01.233107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ff35d8a8-980a-412d-bda1-cd624da041d4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:01.236840 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ff35d8a8-980a-412d-bda1-cd624da041d4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2209 microversion: 2.32 time: 0.949800 Jul 14 14:49:01.249030 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b8c02a2b-1319-4a58-a631-a156b6597f32 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 0.861785 Jul 14 14:49:01.251031 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2106/4162] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:00 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2209 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:01.254091 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2057/4163] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:00 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:01.267060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9b193560-c2ef-45bf-aee6-0d84aa36ec78 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:01.268275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9b193560-c2ef-45bf-aee6-0d84aa36ec78 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: d83f75ff-3ed3-406d-9e13-695407c179a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:01.277039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-559349424", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "fca67da8-4cee-4aa7-ae20-eff2b3bfcc9a"}, {"uuid": "63e90ca5-6a9c-42ae-b084-b10ce8648167"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:01.283169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b193560-c2ef-45bf-aee6-0d84aa36ec78 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.283863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b193560-c2ef-45bf-aee6-0d84aa36ec78 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.284874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b193560-c2ef-45bf-aee6-0d84aa36ec78 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.285967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b193560-c2ef-45bf-aee6-0d84aa36ec78 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.325720 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-9b193560-c2ef-45bf-aee6-0d84aa36ec78 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] HTTP exception thrown: Instance d83f75ff-3ed3-406d-9e13-695407c179a3 could not be found. Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9b193560-c2ef-45bf-aee6-0d84aa36ec78 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Request method failure captured: Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 HTTP/1.1 Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cuaek8QP7ZzyqAnXJWPN7lHiUWz0TNXX6f0nS0pfbQcbYmqHrTXe0rZ97jdQ3uNxUa0EPbwBicPZsDlqLUuoGtatVHJtwILzwCBFVthrwMveMSoYFbetP1TjjR3-iLZvN4xQUw5cjtI-hjvoXzpdUd0pTNdhqPPjM935R8S2VQJlOY Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e9f01277aa24f0fbe464ff8a5378d64", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}] Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 377b67baeabd4588a1945effc9b19113 Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance d83f75ff-3ed3-406d-9e13-695407c179a3 could not be found. Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'd83f75ff-3ed3-406d-9e13-695407c179a3'} Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d83f75ff-3ed3-406d-9e13-695407c179a3 could not be found. Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d83f75ff-3ed3-406d-9e13-695407c179a3 could not be found. Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.328429 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:01.333900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.333900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:01.333900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:01.333900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:01.333900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:01.333900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:01.333900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d83f75ff-3ed3-406d-9e13-695407c179a3 could not be found. Jul 14 14:49:01.333900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.333900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9b193560-c2ef-45bf-aee6-0d84aa36ec78 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Returning 404 to user: Instance d83f75ff-3ed3-406d-9e13-695407c179a3 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:01.333900 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9b193560-c2ef-45bf-aee6-0d84aa36ec78 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3" status: 404 len: 111 microversion: 2.1 time: 0.073972 Jul 14 14:49:01.333900 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2058/4164] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:01 2022] GET /compute/v2.1/servers/d83f75ff-3ed3-406d-9e13-695407c179a3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:01.338747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c43c1f29-6aad-4023-aa78-b6f65d33ea2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:01.339308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c43c1f29-6aad-4023-aa78-b6f65d33ea2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: b455b809-78bb-47e3-993c-0e61f7445cc5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:01.349398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c43c1f29-6aad-4023-aa78-b6f65d33ea2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.351462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c43c1f29-6aad-4023-aa78-b6f65d33ea2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.356724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c43c1f29-6aad-4023-aa78-b6f65d33ea2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.361370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c43c1f29-6aad-4023-aa78-b6f65d33ea2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.392843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] validate_networks() for [('fca67da8-4cee-4aa7-ae20-eff2b3bfcc9a', None, None, None, None, None), ('63e90ca5-6a9c-42ae-b084-b10ce8648167', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:49:01.420348 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c43c1f29-6aad-4023-aa78-b6f65d33ea2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] HTTP exception thrown: Instance b455b809-78bb-47e3-993c-0e61f7445cc5 could not be found. Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c43c1f29-6aad-4023-aa78-b6f65d33ea2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Request method failure captured: Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 HTTP/1.1 Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CqeTHaua1mrAoMsWalZYpPqmTQ-DcKvLbCsfPO7qDbpKBxxTx4n3bTPRxjIsY87FdmdIpxDuFpmylNVxXWu7O4aKHski9z6vXFgUEATmO5T5a4xVEdgMgmRCGrZRc-L7A0A1cYH36dJi-2mZ9w6VAAL7DBepATCUrn7iOaopLMMuR0 Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1933006fa13c44ae9128f00267210152 Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1933006fa13c44ae9128f00267210152"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1933006fa13c44ae9128f00267210152"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1933006fa13c44ae9128f00267210152", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1933006fa13c44ae9128f00267210152"}]}] Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1933006fa13c44ae9128f00267210152 Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-1472511591-project Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f157150edd1d441aa2c7335dbb2363ca Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-1472511591-project Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance b455b809-78bb-47e3-993c-0e61f7445cc5 could not be found. Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'b455b809-78bb-47e3-993c-0e61f7445cc5'} Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b455b809-78bb-47e3-993c-0e61f7445cc5 could not be found. Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b455b809-78bb-47e3-993c-0e61f7445cc5 could not be found. Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:01.422562 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.429254 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:01.429254 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:01.429254 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:01.429254 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:01.429254 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:01.429254 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b455b809-78bb-47e3-993c-0e61f7445cc5 could not be found. Jul 14 14:49:01.429254 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.429254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c43c1f29-6aad-4023-aa78-b6f65d33ea2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Returning 404 to user: Instance b455b809-78bb-47e3-993c-0e61f7445cc5 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:01.429254 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c43c1f29-6aad-4023-aa78-b6f65d33ea2d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5" status: 404 len: 111 microversion: 2.1 time: 0.089571 Jul 14 14:49:01.432731 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2059/4165] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:01 2022] GET /compute/v2.1/servers/b455b809-78bb-47e3-993c-0e61f7445cc5 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:01.444996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aff26594-24c1-419e-a2c8-a17f1f2ae0b0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:01.445502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aff26594-24c1-419e-a2c8-a17f1f2ae0b0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:01.472812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aff26594-24c1-419e-a2c8-a17f1f2ae0b0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.473307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aff26594-24c1-419e-a2c8-a17f1f2ae0b0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.478925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aff26594-24c1-419e-a2c8-a17f1f2ae0b0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.479673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aff26594-24c1-419e-a2c8-a17f1f2ae0b0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.558320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aff26594-24c1-419e-a2c8-a17f1f2ae0b0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:01.768571 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aff26594-24c1-419e-a2c8-a17f1f2ae0b0 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "DELETE /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 204 len: 0 microversion: 2.1 time: 0.333652 Jul 14 14:49:01.770082 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2060/4166] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:01 2022] DELETE /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:01.787181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e84f72f0-9c32-4d9f-8e83-3a545b654e00 req-f41b80c4-73d4-4870-894e-f8b46ff58e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b455b809-78bb-47e3-993c-0e61f7445cc5", "name": "network-vif-deleted", "tag": "ef61f614-4fff-4035-8c7e-c8670ff31aad"}, {"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-deleted", "tag": "847e25f0-cf0b-4884-a99c-bc72592ab04e"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:01.808321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e84f72f0-9c32-4d9f-8e83-3a545b654e00 req-f41b80c4-73d4-4870-894e-f8b46ff58e73 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.808794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e84f72f0-9c32-4d9f-8e83-3a545b654e00 req-f41b80c4-73d4-4870-894e-f8b46ff58e73 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.853273 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e84f72f0-9c32-4d9f-8e83-3a545b654e00 req-f41b80c4-73d4-4870-894e-f8b46ff58e73 service nova] Creating event network-vif-deleted:ef61f614-4fff-4035-8c7e-c8670ff31aad for instance b455b809-78bb-47e3-993c-0e61f7445cc5 on n-h2-767704-28 Jul 14 14:49:01.854395 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e84f72f0-9c32-4d9f-8e83-3a545b654e00 req-f41b80c4-73d4-4870-894e-f8b46ff58e73 service nova] Creating event network-vif-deleted:847e25f0-cf0b-4884-a99c-bc72592ab04e for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:49:01.884964 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e84f72f0-9c32-4d9f-8e83-3a545b654e00 req-f41b80c4-73d4-4870-894e-f8b46ff58e73 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.112253 Jul 14 14:49:01.886223 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2061/4167] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:01.894925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c61cb8b9-f644-45ad-b579-4615edbf93e9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:01.896317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c61cb8b9-f644-45ad-b579-4615edbf93e9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:01.904291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c61cb8b9-f644-45ad-b579-4615edbf93e9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.905871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c61cb8b9-f644-45ad-b579-4615edbf93e9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.907412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c61cb8b9-f644-45ad-b579-4615edbf93e9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.908057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c61cb8b9-f644-45ad-b579-4615edbf93e9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.984967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c61cb8b9-f644-45ad-b579-4615edbf93e9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:02.256340 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c61cb8b9-f644-45ad-b579-4615edbf93e9 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "DELETE /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 204 len: 0 microversion: 2.1 time: 0.368445 Jul 14 14:49:02.258574 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2062/4168] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:01 2022] DELETE /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:02.278209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0a04ebaa-a912-4f66-ab56-84ecb07d795f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:02.278514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0a04ebaa-a912-4f66-ab56-84ecb07d795f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:02.288458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a04ebaa-a912-4f66-ab56-84ecb07d795f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:02.288458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a04ebaa-a912-4f66-ab56-84ecb07d795f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:02.290075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a04ebaa-a912-4f66-ab56-84ecb07d795f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:02.290907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a04ebaa-a912-4f66-ab56-84ecb07d795f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:02.647562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0a04ebaa-a912-4f66-ab56-84ecb07d795f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:02.661598 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0a04ebaa-a912-4f66-ab56-84ecb07d795f tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.401026 Jul 14 14:49:02.671196 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2063/4169] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:02 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:02.688143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4344d3f4-9ddd-4a62-bb27-06b5b1730899 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:02.688913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4344d3f4-9ddd-4a62-bb27-06b5b1730899 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:02.760125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4344d3f4-9ddd-4a62-bb27-06b5b1730899 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:02.760703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4344d3f4-9ddd-4a62-bb27-06b5b1730899 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:02.762796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4344d3f4-9ddd-4a62-bb27-06b5b1730899 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:02.768298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4344d3f4-9ddd-4a62-bb27-06b5b1730899 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:02.847971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:03.000295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4344d3f4-9ddd-4a62-bb27-06b5b1730899 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:03.018134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4344d3f4-9ddd-4a62-bb27-06b5b1730899 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:03.023093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4344d3f4-9ddd-4a62-bb27-06b5b1730899 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:03.025848 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4344d3f4-9ddd-4a62-bb27-06b5b1730899 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2142 microversion: 2.32 time: 0.359568 Jul 14 14:49:03.027904 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2064/4170] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:02 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2142 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:03.038120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b47e03f9-2731-48fc-b2ac-ee59c6aaffe6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:03.047948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b47e03f9-2731-48fc-b2ac-ee59c6aaffe6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:03.069475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b47e03f9-2731-48fc-b2ac-ee59c6aaffe6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:03.070052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b47e03f9-2731-48fc-b2ac-ee59c6aaffe6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:03.071392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b47e03f9-2731-48fc-b2ac-ee59c6aaffe6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:03.072899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b47e03f9-2731-48fc-b2ac-ee59c6aaffe6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:03.522625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b47e03f9-2731-48fc-b2ac-ee59c6aaffe6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:03.537369 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b47e03f9-2731-48fc-b2ac-ee59c6aaffe6 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1509 microversion: 2.1 time: 0.508239 Jul 14 14:49:03.546416 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2065/4171] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:03 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1509 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:03.565124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f614c22f-04b0-4069-b385-31eda1d42590 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:03.566668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f614c22f-04b0-4069-b385-31eda1d42590 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:03.583425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f614c22f-04b0-4069-b385-31eda1d42590 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:03.586835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f614c22f-04b0-4069-b385-31eda1d42590 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:03.589794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f614c22f-04b0-4069-b385-31eda1d42590 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:03.599659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f614c22f-04b0-4069-b385-31eda1d42590 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:03.808712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:49:03.809380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:49:03.809897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:49:03.810323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:49:03.811535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:49:03.830450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:03.830912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:03.831741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:03.832182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:03.883893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:03.904066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Getting quotas for project 1bf20852acdd4cea9ed6e96934097280. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:49:03.913526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Getting quotas for user 35abcadc35964a9d8df499c4d987e056 and project 1bf20852acdd4cea9ed6e96934097280. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:49:03.943194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:49:03.948350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:49:04.021790 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-48743e3f-9006-4bbd-9305-25d06c668c20 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.769278 Jul 14 14:49:04.035455 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2107/4172] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:49:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:49:04.054667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-27b38166-afe0-4055-a694-58f83824f823 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:04.056864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-27b38166-afe0-4055-a694-58f83824f823 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:04.082271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-27b38166-afe0-4055-a694-58f83824f823 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.083724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-27b38166-afe0-4055-a694-58f83824f823 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.086504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-27b38166-afe0-4055-a694-58f83824f823 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.087818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-27b38166-afe0-4055-a694-58f83824f823 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.111551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f614c22f-04b0-4069-b385-31eda1d42590 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:04.128901 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f614c22f-04b0-4069-b385-31eda1d42590 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 0.580052 Jul 14 14:49:04.133066 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2066/4173] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:03 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:04.156286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1fed66ae-1c76-4183-a950-e40421826f5c req-1e1e0e40-0d06-47ab-8b7b-a947b4f43329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bf437b-873e-4466-bd62-337dc6e75b1c", "name": "network-vif-deleted", "tag": "5f2e657b-30cc-4497-a912-7f7416056eb1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:04.168568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1fed66ae-1c76-4183-a950-e40421826f5c req-1e1e0e40-0d06-47ab-8b7b-a947b4f43329 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.170546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1fed66ae-1c76-4183-a950-e40421826f5c req-1e1e0e40-0d06-47ab-8b7b-a947b4f43329 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.184730 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1fed66ae-1c76-4183-a950-e40421826f5c req-1e1e0e40-0d06-47ab-8b7b-a947b4f43329 service nova] Creating event network-vif-deleted:5f2e657b-30cc-4497-a912-7f7416056eb1 for instance 33bf437b-873e-4466-bd62-337dc6e75b1c on n-h1-767704-28 Jul 14 14:49:04.192630 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1fed66ae-1c76-4183-a950-e40421826f5c req-1e1e0e40-0d06-47ab-8b7b-a947b4f43329 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045366 Jul 14 14:49:04.193736 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2067/4174] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:04.209688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9ec3050e-a047-4a43-b9d6-ce189b51f1f6 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:04.210698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9ec3050e-a047-4a43-b9d6-ce189b51f1f6 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:04.390573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9ec3050e-a047-4a43-b9d6-ce189b51f1f6 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:04.398853 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9ec3050e-a047-4a43-b9d6-ce189b51f1f6 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1212 microversion: 2.1 time: 0.203711 Jul 14 14:49:04.400002 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2068/4175] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:04 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1212 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:04.407707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ab619d46-6e35-43c1-be6a-9c29afba4916 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:04.408749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ab619d46-6e35-43c1-be6a-9c29afba4916 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:04.417079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab619d46-6e35-43c1-be6a-9c29afba4916 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.417803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab619d46-6e35-43c1-be6a-9c29afba4916 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.418890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab619d46-6e35-43c1-be6a-9c29afba4916 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.419516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab619d46-6e35-43c1-be6a-9c29afba4916 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.535643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ab619d46-6e35-43c1-be6a-9c29afba4916 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:04.590922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ab619d46-6e35-43c1-be6a-9c29afba4916 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:04.616169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ab619d46-6e35-43c1-be6a-9c29afba4916 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:04.618675 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ab619d46-6e35-43c1-be6a-9c29afba4916 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 2142 microversion: 2.32 time: 0.217000 Jul 14 14:49:04.636480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-27b38166-afe0-4055-a694-58f83824f823 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:04.646838 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-27b38166-afe0-4055-a694-58f83824f823 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.610073 Jul 14 14:49:04.652846 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2069/4176] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:04 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 2142 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:04.663029 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2108/4177] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:04 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:04.691571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-285788bf-1d16-431a-8647-cc35e2bc2bf0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:04.697913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-285788bf-1d16-431a-8647-cc35e2bc2bf0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:04.712164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285788bf-1d16-431a-8647-cc35e2bc2bf0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.713449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285788bf-1d16-431a-8647-cc35e2bc2bf0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.715229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285788bf-1d16-431a-8647-cc35e2bc2bf0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.716701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285788bf-1d16-431a-8647-cc35e2bc2bf0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.947333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-285788bf-1d16-431a-8647-cc35e2bc2bf0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:04.964359 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-285788bf-1d16-431a-8647-cc35e2bc2bf0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 200 len: 1467 microversion: 2.1 time: 0.309592 Jul 14 14:49:04.965322 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2070/4178] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:04 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 1467 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:05.150926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1af1cc24-c193-45d8-9b8a-69f5892cb5fa tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:05.151566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1af1cc24-c193-45d8-9b8a-69f5892cb5fa tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:05.169999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1af1cc24-c193-45d8-9b8a-69f5892cb5fa tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:05.183108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1af1cc24-c193-45d8-9b8a-69f5892cb5fa tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:05.184150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1af1cc24-c193-45d8-9b8a-69f5892cb5fa tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:05.184999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1af1cc24-c193-45d8-9b8a-69f5892cb5fa tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:05.416416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d3431f0-e282-4df4-a8be-6b547df23db3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:05.417717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8d3431f0-e282-4df4-a8be-6b547df23db3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:05.441156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d3431f0-e282-4df4-a8be-6b547df23db3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:05.441630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d3431f0-e282-4df4-a8be-6b547df23db3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:05.442464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d3431f0-e282-4df4-a8be-6b547df23db3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:05.442948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d3431f0-e282-4df4-a8be-6b547df23db3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:05.803794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8d3431f0-e282-4df4-a8be-6b547df23db3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:05.823673 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8d3431f0-e282-4df4-a8be-6b547df23db3 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1264 microversion: 2.1 time: 0.407695 Jul 14 14:49:05.824553 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2071/4179] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:05 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1264 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:05.840856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a17b96d7-1a29-4631-b72c-4901ac9c4dab tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:05.841600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a17b96d7-1a29-4631-b72c-4901ac9c4dab tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:05.863693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a17b96d7-1a29-4631-b72c-4901ac9c4dab tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:05.864714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a17b96d7-1a29-4631-b72c-4901ac9c4dab tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:05.866035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a17b96d7-1a29-4631-b72c-4901ac9c4dab tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:05.866700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a17b96d7-1a29-4631-b72c-4901ac9c4dab tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.153054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a17b96d7-1a29-4631-b72c-4901ac9c4dab tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:06.175759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a17b96d7-1a29-4631-b72c-4901ac9c4dab tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:06.178285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a17b96d7-1a29-4631-b72c-4901ac9c4dab tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:06.181718 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a17b96d7-1a29-4631-b72c-4901ac9c4dab tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.352255 Jul 14 14:49:06.184861 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2072/4180] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:05 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:06.194191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-78f09782-4fbb-4fdf-8943-6cbaca034984 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:06.196933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-78f09782-4fbb-4fdf-8943-6cbaca034984 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:06.199201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1af1cc24-c193-45d8-9b8a-69f5892cb5fa tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:06.215479 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1af1cc24-c193-45d8-9b8a-69f5892cb5fa tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 1.069221 Jul 14 14:49:06.216094 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2109/4181] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:05 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:06.229661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78f09782-4fbb-4fdf-8943-6cbaca034984 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.230761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78f09782-4fbb-4fdf-8943-6cbaca034984 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.233010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78f09782-4fbb-4fdf-8943-6cbaca034984 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.234227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78f09782-4fbb-4fdf-8943-6cbaca034984 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.237627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1220befc-d4b4-4d27-93d6-2189ce6a6e70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:06.239345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1220befc-d4b4-4d27-93d6-2189ce6a6e70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 46286b84-e2d7-4622-b9aa-ee7c39d620c5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:06.254905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1220befc-d4b4-4d27-93d6-2189ce6a6e70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.255370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1220befc-d4b4-4d27-93d6-2189ce6a6e70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.256176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1220befc-d4b4-4d27-93d6-2189ce6a6e70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.256627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1220befc-d4b4-4d27-93d6-2189ce6a6e70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.307400 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-1220befc-d4b4-4d27-93d6-2189ce6a6e70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] HTTP exception thrown: Instance 46286b84-e2d7-4622-b9aa-ee7c39d620c5 could not be found. Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1220befc-d4b4-4d27-93d6-2189ce6a6e70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Request method failure captured: Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 HTTP/1.1 Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CqeTHaua1mrAoMsWalZYpPqmTQ-DcKvLbCsfPO7qDbpKBxxTx4n3bTPRxjIsY87FdmdIpxDuFpmylNVxXWu7O4aKHski9z6vXFgUEATmO5T5a4xVEdgMgmRCGrZRc-L7A0A1cYH36dJi-2mZ9w6VAAL7DBepATCUrn7iOaopLMMuR0 Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 1933006fa13c44ae9128f00267210152 Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1933006fa13c44ae9128f00267210152"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1933006fa13c44ae9128f00267210152"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1933006fa13c44ae9128f00267210152", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1933006fa13c44ae9128f00267210152"}]}] Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 1933006fa13c44ae9128f00267210152 Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerActionsTestJSON-1472511591-project Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: f157150edd1d441aa2c7335dbb2363ca Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerActionsTestJSON-1472511591-project Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 46286b84-e2d7-4622-b9aa-ee7c39d620c5 could not be found. Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '46286b84-e2d7-4622-b9aa-ee7c39d620c5'} Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46286b84-e2d7-4622-b9aa-ee7c39d620c5 could not be found. Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46286b84-e2d7-4622-b9aa-ee7c39d620c5 could not be found. Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:06.310244 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:06.315346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:06.315346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:06.315346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:06.315346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:06.315346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:06.315346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46286b84-e2d7-4622-b9aa-ee7c39d620c5 could not be found. Jul 14 14:49:06.315346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:06.315346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1220befc-d4b4-4d27-93d6-2189ce6a6e70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Returning 404 to user: Instance 46286b84-e2d7-4622-b9aa-ee7c39d620c5 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:06.315346 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1220befc-d4b4-4d27-93d6-2189ce6a6e70 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5" status: 404 len: 111 microversion: 2.1 time: 0.095519 Jul 14 14:49:06.316715 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2110/4182] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:06 2022] GET /compute/v2.1/servers/46286b84-e2d7-4622-b9aa-ee7c39d620c5 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:06.336581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5e032f9a-12d0-42a0-a2ef-f1ea3e3c0f08 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:06.337149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5e032f9a-12d0-42a0-a2ef-f1ea3e3c0f08 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:06.350108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e032f9a-12d0-42a0-a2ef-f1ea3e3c0f08 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.350579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e032f9a-12d0-42a0-a2ef-f1ea3e3c0f08 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.351396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e032f9a-12d0-42a0-a2ef-f1ea3e3c0f08 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.351851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e032f9a-12d0-42a0-a2ef-f1ea3e3c0f08 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.439608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5e032f9a-12d0-42a0-a2ef-f1ea3e3c0f08 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:06.595950 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5e032f9a-12d0-42a0-a2ef-f1ea3e3c0f08 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "DELETE /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 204 len: 0 microversion: 2.1 time: 0.274526 Jul 14 14:49:06.599826 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2111/4183] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:06 2022] DELETE /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:49:06.605689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c944eaaa-3c0a-4789-8276-dd95619bf5c1 req-669be1c1-adf9-446d-acd6-78f5361de13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46286b84-e2d7-4622-b9aa-ee7c39d620c5", "name": "network-vif-deleted", "tag": "9dfe359a-880d-4967-b327-8cb1189e1d0b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:06.615252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c944eaaa-3c0a-4789-8276-dd95619bf5c1 req-669be1c1-adf9-446d-acd6-78f5361de13f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.615916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c944eaaa-3c0a-4789-8276-dd95619bf5c1 req-669be1c1-adf9-446d-acd6-78f5361de13f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.639100 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c944eaaa-3c0a-4789-8276-dd95619bf5c1 req-669be1c1-adf9-446d-acd6-78f5361de13f service nova] Creating event network-vif-deleted:9dfe359a-880d-4967-b327-8cb1189e1d0b for instance 46286b84-e2d7-4622-b9aa-ee7c39d620c5 on n-h2-767704-28 Jul 14 14:49:06.656203 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c944eaaa-3c0a-4789-8276-dd95619bf5c1 req-669be1c1-adf9-446d-acd6-78f5361de13f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054683 Jul 14 14:49:06.658014 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2112/4184] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:06.671088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-268afafa-0f50-4a07-9ac6-27695a977653 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:06.673029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-268afafa-0f50-4a07-9ac6-27695a977653 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:06.690125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-268afafa-0f50-4a07-9ac6-27695a977653 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.690688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-268afafa-0f50-4a07-9ac6-27695a977653 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.692812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-268afafa-0f50-4a07-9ac6-27695a977653 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.693617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-268afafa-0f50-4a07-9ac6-27695a977653 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.897894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-78f09782-4fbb-4fdf-8943-6cbaca034984 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:06.909845 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-78f09782-4fbb-4fdf-8943-6cbaca034984 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1522 microversion: 2.1 time: 0.722650 Jul 14 14:49:06.911173 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2073/4185] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:06 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1522 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:06.916241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-89049117-a83c-4ef7-be49-01795e7f106e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:06.917127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-89049117-a83c-4ef7-be49-01795e7f106e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:06.925423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89049117-a83c-4ef7-be49-01795e7f106e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.926392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89049117-a83c-4ef7-be49-01795e7f106e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.927378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89049117-a83c-4ef7-be49-01795e7f106e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.927962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89049117-a83c-4ef7-be49-01795e7f106e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:07.205175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-89049117-a83c-4ef7-be49-01795e7f106e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:07.219106 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-89049117-a83c-4ef7-be49-01795e7f106e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1270 microversion: 2.1 time: 0.306481 Jul 14 14:49:07.219715 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2074/4186] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:06 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1270 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:07.224306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-426899e5-cf9a-44f6-b706-5134b6a710c5 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:07.224920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-426899e5-cf9a-44f6-b706-5134b6a710c5 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:07.244027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-426899e5-cf9a-44f6-b706-5134b6a710c5 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:07.244491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-426899e5-cf9a-44f6-b706-5134b6a710c5 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:07.251088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-268afafa-0f50-4a07-9ac6-27695a977653 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:07.256376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-426899e5-cf9a-44f6-b706-5134b6a710c5 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:07.256901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-426899e5-cf9a-44f6-b706-5134b6a710c5 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:07.260168 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-268afafa-0f50-4a07-9ac6-27695a977653 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1496 microversion: 2.1 time: 0.599420 Jul 14 14:49:07.265117 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2113/4187] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:06 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1496 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:07.280273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0be07d0c-63f4-4bb4-915b-f186e9015835 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:07.285418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0be07d0c-63f4-4bb4-915b-f186e9015835 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:07.303102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0be07d0c-63f4-4bb4-915b-f186e9015835 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:07.303878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0be07d0c-63f4-4bb4-915b-f186e9015835 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:07.304926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0be07d0c-63f4-4bb4-915b-f186e9015835 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:07.306848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0be07d0c-63f4-4bb4-915b-f186e9015835 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:07.576394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-426899e5-cf9a-44f6-b706-5134b6a710c5 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:07.588235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-426899e5-cf9a-44f6-b706-5134b6a710c5 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:07.595045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-426899e5-cf9a-44f6-b706-5134b6a710c5 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:07.602410 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-426899e5-cf9a-44f6-b706-5134b6a710c5 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.381589 Jul 14 14:49:07.604643 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2075/4188] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:07 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:07.795967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0be07d0c-63f4-4bb4-915b-f186e9015835 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:07.803462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-60fd7b3d-3fde-4603-82c3-3820c1b8a968 req-6e355658-71f9-4737-85c0-8072105355b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121e8067-40e4-49a7-a760-22b98d0aa082", "name": "network-vif-deleted", "tag": "38cd84ce-e6fe-4f97-994b-685ac4a8eb52"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:07.808106 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0be07d0c-63f4-4bb4-915b-f186e9015835 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 0.541317 Jul 14 14:49:07.809964 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2114/4189] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:07 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:07.828928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-60fd7b3d-3fde-4603-82c3-3820c1b8a968 req-6e355658-71f9-4737-85c0-8072105355b2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:07.833499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-60fd7b3d-3fde-4603-82c3-3820c1b8a968 req-6e355658-71f9-4737-85c0-8072105355b2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:07.862612 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-60fd7b3d-3fde-4603-82c3-3820c1b8a968 req-6e355658-71f9-4737-85c0-8072105355b2 service nova] Creating event network-vif-deleted:38cd84ce-e6fe-4f97-994b-685ac4a8eb52 for instance 121e8067-40e4-49a7-a760-22b98d0aa082 on n-h2-767704-28 Jul 14 14:49:07.899090 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-60fd7b3d-3fde-4603-82c3-3820c1b8a968 req-6e355658-71f9-4737-85c0-8072105355b2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106183 Jul 14 14:49:07.901122 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2076/4190] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:49:07.929146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a65d4acd-5264-4b7a-b0b7-7c42b8a3802e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:07.929727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a65d4acd-5264-4b7a-b0b7-7c42b8a3802e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:07.962486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a65d4acd-5264-4b7a-b0b7-7c42b8a3802e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:07.963286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a65d4acd-5264-4b7a-b0b7-7c42b8a3802e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:07.965812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a65d4acd-5264-4b7a-b0b7-7c42b8a3802e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:07.970613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a65d4acd-5264-4b7a-b0b7-7c42b8a3802e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.083849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a65d4acd-5264-4b7a-b0b7-7c42b8a3802e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.084314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a65d4acd-5264-4b7a-b0b7-7c42b8a3802e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.085244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-a65d4acd-5264-4b7a-b0b7-7c42b8a3802e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lazy-loading 'fault' on Instance uuid 91067647-7704-49c5-a1c2-efcfe1474e01 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:49:08.239060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a65d4acd-5264-4b7a-b0b7-7c42b8a3802e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b67baeabd4588a1945effc9b19113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9f01277aa24f0fbe464ff8a5378d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:08.244292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-14eb79f7-c29a-4658-a791-02983bf8211a tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:08.245119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-14eb79f7-c29a-4658-a791-02983bf8211a tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:08.258461 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a65d4acd-5264-4b7a-b0b7-7c42b8a3802e tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 200 len: 1312 microversion: 2.1 time: 0.333770 Jul 14 14:49:08.271873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14eb79f7-c29a-4658-a791-02983bf8211a tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.272935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14eb79f7-c29a-4658-a791-02983bf8211a tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.274581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14eb79f7-c29a-4658-a791-02983bf8211a tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.275554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14eb79f7-c29a-4658-a791-02983bf8211a tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.283123 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2115/4191] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:07 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 1312 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:08.291004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b0e9659-ae43-415c-aaed-d401510b8a4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:08.292607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b0e9659-ae43-415c-aaed-d401510b8a4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:08.303337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b0e9659-ae43-415c-aaed-d401510b8a4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.304384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b0e9659-ae43-415c-aaed-d401510b8a4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.306006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b0e9659-ae43-415c-aaed-d401510b8a4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.306828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b0e9659-ae43-415c-aaed-d401510b8a4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.386778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b0e9659-ae43-415c-aaed-d401510b8a4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.387321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b0e9659-ae43-415c-aaed-d401510b8a4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.387802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-9b0e9659-ae43-415c-aaed-d401510b8a4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lazy-loading 'fault' on Instance uuid 121e8067-40e4-49a7-a760-22b98d0aa082 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:49:08.423646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-14eb79f7-c29a-4658-a791-02983bf8211a tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:08.453155 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-14eb79f7-c29a-4658-a791-02983bf8211a tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1270 microversion: 2.1 time: 0.219734 Jul 14 14:49:08.453863 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2077/4192] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:08 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1270 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:08.502717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9b0e9659-ae43-415c-aaed-d401510b8a4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:08.520988 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9b0e9659-ae43-415c-aaed-d401510b8a4e tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 200 len: 1305 microversion: 2.1 time: 0.237514 Jul 14 14:49:08.524421 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2116/4193] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:08 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 1305 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:08.625376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dcca58e4-0c5b-48f5-8f80-869b779c7a8f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:08.626127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dcca58e4-0c5b-48f5-8f80-869b779c7a8f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:08.651577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dcca58e4-0c5b-48f5-8f80-869b779c7a8f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.652050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dcca58e4-0c5b-48f5-8f80-869b779c7a8f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.679998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dcca58e4-0c5b-48f5-8f80-869b779c7a8f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.686637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dcca58e4-0c5b-48f5-8f80-869b779c7a8f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.688640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a13449c5-977d-4c6b-b70a-8b594af14c42 req-cdd7cd5f-7cae-4b9f-8153-5a4ca95c4831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91067647-7704-49c5-a1c2-efcfe1474e01", "name": "network-vif-deleted", "tag": "8f48bd43-add0-4af7-8116-106406af3cf8"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:08.715370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a13449c5-977d-4c6b-b70a-8b594af14c42 req-cdd7cd5f-7cae-4b9f-8153-5a4ca95c4831 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.716869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a13449c5-977d-4c6b-b70a-8b594af14c42 req-cdd7cd5f-7cae-4b9f-8153-5a4ca95c4831 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.747748 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a13449c5-977d-4c6b-b70a-8b594af14c42 req-cdd7cd5f-7cae-4b9f-8153-5a4ca95c4831 service nova] Creating event network-vif-deleted:8f48bd43-add0-4af7-8116-106406af3cf8 for instance 91067647-7704-49c5-a1c2-efcfe1474e01 on n-h1-767704-28 Jul 14 14:49:08.763289 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a13449c5-977d-4c6b-b70a-8b594af14c42 req-cdd7cd5f-7cae-4b9f-8153-5a4ca95c4831 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079945 Jul 14 14:49:08.766494 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2117/4194] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:08.829951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1ab2b23f-142a-438d-add0-e66b7619e437 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:08.832673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1ab2b23f-142a-438d-add0-e66b7619e437 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:08.850278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ab2b23f-142a-438d-add0-e66b7619e437 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.854769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ab2b23f-142a-438d-add0-e66b7619e437 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.855806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ab2b23f-142a-438d-add0-e66b7619e437 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.857427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ab2b23f-142a-438d-add0-e66b7619e437 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.872743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dcca58e4-0c5b-48f5-8f80-869b779c7a8f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:08.889546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dcca58e4-0c5b-48f5-8f80-869b779c7a8f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:08.891801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dcca58e4-0c5b-48f5-8f80-869b779c7a8f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:08.893075 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dcca58e4-0c5b-48f5-8f80-869b779c7a8f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.273865 Jul 14 14:49:08.910101 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2078/4195] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:08 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:09.241829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1ab2b23f-142a-438d-add0-e66b7619e437 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:09.252682 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1ab2b23f-142a-438d-add0-e66b7619e437 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 0.427873 Jul 14 14:49:09.254388 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2118/4196] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:08 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:09.293269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-04127f9b-eb25-481d-81c0-cc7b2408d6e4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:09.293889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-04127f9b-eb25-481d-81c0-cc7b2408d6e4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] [instance: 91067647-7704-49c5-a1c2-efcfe1474e01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:09.312862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04127f9b-eb25-481d-81c0-cc7b2408d6e4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.314096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04127f9b-eb25-481d-81c0-cc7b2408d6e4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.317303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04127f9b-eb25-481d-81c0-cc7b2408d6e4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.319017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04127f9b-eb25-481d-81c0-cc7b2408d6e4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.368341 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-04127f9b-eb25-481d-81c0-cc7b2408d6e4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] HTTP exception thrown: Instance 91067647-7704-49c5-a1c2-efcfe1474e01 could not be found. Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-04127f9b-eb25-481d-81c0-cc7b2408d6e4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Request method failure captured: Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 HTTP/1.1 Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cuaek8QP7ZzyqAnXJWPN7lHiUWz0TNXX6f0nS0pfbQcbYmqHrTXe0rZ97jdQ3uNxUa0EPbwBicPZsDlqLUuoGtatVHJtwILzwCBFVthrwMveMSoYFbetP1TjjR3-iLZvN4xQUw5cjtI-hjvoXzpdUd0pTNdhqPPjM935R8S2VQJlOY Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7e9f01277aa24f0fbe464ff8a5378d64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7e9f01277aa24f0fbe464ff8a5378d64", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7e9f01277aa24f0fbe464ff8a5378d64"}]}] Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 7e9f01277aa24f0fbe464ff8a5378d64 Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1546443219 Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 377b67baeabd4588a1945effc9b19113 Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1546443219-project Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 91067647-7704-49c5-a1c2-efcfe1474e01 could not be found. Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '91067647-7704-49c5-a1c2-efcfe1474e01'} Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91067647-7704-49c5-a1c2-efcfe1474e01 could not be found. Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91067647-7704-49c5-a1c2-efcfe1474e01 could not be found. Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:09.372922 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:09.392749 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:09.392749 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:09.392749 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:09.392749 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:09.392749 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:09.392749 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:09.392749 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91067647-7704-49c5-a1c2-efcfe1474e01 could not be found. Jul 14 14:49:09.392749 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:09.392749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-04127f9b-eb25-481d-81c0-cc7b2408d6e4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] Returning 404 to user: Instance 91067647-7704-49c5-a1c2-efcfe1474e01 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:09.392749 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-04127f9b-eb25-481d-81c0-cc7b2408d6e4 tempest-ServerRescueNegativeTestJSON-1546443219 tempest-ServerRescueNegativeTestJSON-1546443219-project] 10.222.0.81 "GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01" status: 404 len: 111 microversion: 2.1 time: 0.094817 Jul 14 14:49:09.392749 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2079/4197] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:09 2022] GET /compute/v2.1/servers/91067647-7704-49c5-a1c2-efcfe1474e01 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:09.475547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-db2c20de-c8e2-4522-a00f-042540165138 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:09.479387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-db2c20de-c8e2-4522-a00f-042540165138 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:09.483947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:09.516584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db2c20de-c8e2-4522-a00f-042540165138 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.520020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db2c20de-c8e2-4522-a00f-042540165138 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.521527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db2c20de-c8e2-4522-a00f-042540165138 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.522263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db2c20de-c8e2-4522-a00f-042540165138 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.543925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e177cc47-739a-40a2-8baa-cd1a39b69287 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:09.545484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e177cc47-739a-40a2-8baa-cd1a39b69287 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 121e8067-40e4-49a7-a760-22b98d0aa082] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:09.560366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e177cc47-739a-40a2-8baa-cd1a39b69287 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.565049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e177cc47-739a-40a2-8baa-cd1a39b69287 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.566360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e177cc47-739a-40a2-8baa-cd1a39b69287 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.567037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e177cc47-739a-40a2-8baa-cd1a39b69287 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.604501 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-e177cc47-739a-40a2-8baa-cd1a39b69287 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] HTTP exception thrown: Instance 121e8067-40e4-49a7-a760-22b98d0aa082 could not be found. Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e177cc47-739a-40a2-8baa-cd1a39b69287 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Request method failure captured: Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 HTTP/1.1 Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CqeTHaua1mrAoMsWalZYpPqmTQ-DcKvLbCsfPO7qDbpKBxxTx4n3bTPRxjIsY87FdmdIpxDuFpmylNVxXWu7O4aKHski9z6vXFgUEATmO5T5a4xVEdgMgmRCGrZRc-L7A0A1cYH36dJi-2mZ9w6VAAL7DBepATCUrn7iOaopLMMuR0 Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1933006fa13c44ae9128f00267210152 Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1933006fa13c44ae9128f00267210152"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1933006fa13c44ae9128f00267210152"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1933006fa13c44ae9128f00267210152", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1933006fa13c44ae9128f00267210152"}]}] Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1933006fa13c44ae9128f00267210152 Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-1472511591-project Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f157150edd1d441aa2c7335dbb2363ca Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-1472511591-project Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 121e8067-40e4-49a7-a760-22b98d0aa082 could not be found. Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '121e8067-40e4-49a7-a760-22b98d0aa082'} Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121e8067-40e4-49a7-a760-22b98d0aa082 could not be found. Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121e8067-40e4-49a7-a760-22b98d0aa082 could not be found. Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:09.608127 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:09.612775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:09.612775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:09.612775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:09.612775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:09.612775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:09.612775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121e8067-40e4-49a7-a760-22b98d0aa082 could not be found. Jul 14 14:49:09.612775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:09.618965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e177cc47-739a-40a2-8baa-cd1a39b69287 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Returning 404 to user: Instance 121e8067-40e4-49a7-a760-22b98d0aa082 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:09.620184 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e177cc47-739a-40a2-8baa-cd1a39b69287 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082" status: 404 len: 111 microversion: 2.1 time: 0.081533 Jul 14 14:49:09.626523 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2080/4198] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:09 2022] GET /compute/v2.1/servers/121e8067-40e4-49a7-a760-22b98d0aa082 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:09.639302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-83d62381-29e8-4d88-843e-1ab5f0c7f517 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:09.640190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-83d62381-29e8-4d88-843e-1ab5f0c7f517 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:09.657606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83d62381-29e8-4d88-843e-1ab5f0c7f517 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.658412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83d62381-29e8-4d88-843e-1ab5f0c7f517 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.659422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83d62381-29e8-4d88-843e-1ab5f0c7f517 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.660085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83d62381-29e8-4d88-843e-1ab5f0c7f517 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.691132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-83d62381-29e8-4d88-843e-1ab5f0c7f517 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:09.825045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:09.856442 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-83d62381-29e8-4d88-843e-1ab5f0c7f517 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 204 len: 0 microversion: 2.1 time: 0.227211 Jul 14 14:49:09.859119 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2081/4199] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:09 2022] DELETE /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:09.874466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-68b9049c-2547-44d0-99f9-8acb7867631f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:09.877216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-68b9049c-2547-44d0-99f9-8acb7867631f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:09.909238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68b9049c-2547-44d0-99f9-8acb7867631f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.910483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68b9049c-2547-44d0-99f9-8acb7867631f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.914728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68b9049c-2547-44d0-99f9-8acb7867631f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.915843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-68b9049c-2547-44d0-99f9-8acb7867631f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:10.765046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-db2c20de-c8e2-4522-a00f-042540165138 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:10.784883 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-db2c20de-c8e2-4522-a00f-042540165138 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1312 microversion: 2.1 time: 1.318298 Jul 14 14:49:10.788167 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2119/4200] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:09 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1312 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:10.802294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-03b11572-b130-403a-9b1d-7949bd8be52a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:10.813090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-03b11572-b130-403a-9b1d-7949bd8be52a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:10.839296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03b11572-b130-403a-9b1d-7949bd8be52a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:10.839906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03b11572-b130-403a-9b1d-7949bd8be52a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:10.840825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03b11572-b130-403a-9b1d-7949bd8be52a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:10.841564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03b11572-b130-403a-9b1d-7949bd8be52a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:10.851467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-68b9049c-2547-44d0-99f9-8acb7867631f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:10.860778 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-68b9049c-2547-44d0-99f9-8acb7867631f tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1677 microversion: 2.1 time: 0.996387 Jul 14 14:49:10.861995 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2082/4201] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:09 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1677 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:10.866904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-71bfa2df-5ac7-456e-80f9-cdd13b08265d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:10.867807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-71bfa2df-5ac7-456e-80f9-cdd13b08265d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:10.880817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71bfa2df-5ac7-456e-80f9-cdd13b08265d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:10.882806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71bfa2df-5ac7-456e-80f9-cdd13b08265d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:10.883828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71bfa2df-5ac7-456e-80f9-cdd13b08265d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:10.887458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71bfa2df-5ac7-456e-80f9-cdd13b08265d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:10.910085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:11.047986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-03b11572-b130-403a-9b1d-7949bd8be52a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:11.064621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-03b11572-b130-403a-9b1d-7949bd8be52a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:11.066690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-03b11572-b130-403a-9b1d-7949bd8be52a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:11.069088 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-03b11572-b130-403a-9b1d-7949bd8be52a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.275072 Jul 14 14:49:11.070452 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2120/4202] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:10 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:11.438996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-71bfa2df-5ac7-456e-80f9-cdd13b08265d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:11.448814 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-71bfa2df-5ac7-456e-80f9-cdd13b08265d tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1517 microversion: 2.1 time: 0.585548 Jul 14 14:49:11.449552 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2083/4203] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:10 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1517 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:11.804517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-558a0bf9-652b-4bc2-b959-13ff84859510 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:11.805469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-558a0bf9-652b-4bc2-b959-13ff84859510 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:11.816637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-558a0bf9-652b-4bc2-b959-13ff84859510 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:11.820930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-558a0bf9-652b-4bc2-b959-13ff84859510 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:11.829649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-558a0bf9-652b-4bc2-b959-13ff84859510 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:11.830348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-558a0bf9-652b-4bc2-b959-13ff84859510 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:11.890141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b5581dc6-f03a-4994-892b-81c4e955eb90 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:11.891393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5581dc6-f03a-4994-892b-81c4e955eb90 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:11.916309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5581dc6-f03a-4994-892b-81c4e955eb90 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:11.916794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5581dc6-f03a-4994-892b-81c4e955eb90 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:11.917657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5581dc6-f03a-4994-892b-81c4e955eb90 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:11.918104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5581dc6-f03a-4994-892b-81c4e955eb90 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:12.560265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-558a0bf9-652b-4bc2-b959-13ff84859510 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:12.573699 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-558a0bf9-652b-4bc2-b959-13ff84859510 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 0.773432 Jul 14 14:49:12.581292 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2121/4204] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:11 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:12.596425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a591d46-8b57-47af-ba15-592f44eb4c1e tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:12.597740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3a591d46-8b57-47af-ba15-592f44eb4c1e tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:12.612502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a591d46-8b57-47af-ba15-592f44eb4c1e tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:12.614037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a591d46-8b57-47af-ba15-592f44eb4c1e tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:12.616856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a591d46-8b57-47af-ba15-592f44eb4c1e tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:12.619781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a591d46-8b57-47af-ba15-592f44eb4c1e tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:12.709196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b5581dc6-f03a-4994-892b-81c4e955eb90 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:12.719605 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b5581dc6-f03a-4994-892b-81c4e955eb90 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1677 microversion: 2.1 time: 0.833798 Jul 14 14:49:12.721505 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2084/4205] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:11 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1677 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:12.730116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-655ed6f6-f5fd-456a-91b1-84f7f14f0e41 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:12.731509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-655ed6f6-f5fd-456a-91b1-84f7f14f0e41 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:12.740438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-655ed6f6-f5fd-456a-91b1-84f7f14f0e41 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:12.741743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-655ed6f6-f5fd-456a-91b1-84f7f14f0e41 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:12.743170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-655ed6f6-f5fd-456a-91b1-84f7f14f0e41 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:12.743841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-655ed6f6-f5fd-456a-91b1-84f7f14f0e41 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:12.754613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3a591d46-8b57-47af-ba15-592f44eb4c1e tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:12.790898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3a591d46-8b57-47af-ba15-592f44eb4c1e tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:12.802747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3a591d46-8b57-47af-ba15-592f44eb4c1e tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:12.804023 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3a591d46-8b57-47af-ba15-592f44eb4c1e tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.221309 Jul 14 14:49:12.807400 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2122/4206] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:12 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:13.055518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a698c328-a0c6-4f42-9781-07c6f05ce0c5 req-07419778-92e8-45f4-b32e-82b9451947d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b55c122-95db-42f1-95a9-ae5bbb4ff958", "name": "network-vif-deleted", "tag": "b14caf9c-97a3-483c-92a9-d43af26af98c"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:13.079926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a698c328-a0c6-4f42-9781-07c6f05ce0c5 req-07419778-92e8-45f4-b32e-82b9451947d9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:13.080387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a698c328-a0c6-4f42-9781-07c6f05ce0c5 req-07419778-92e8-45f4-b32e-82b9451947d9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:13.147605 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a698c328-a0c6-4f42-9781-07c6f05ce0c5 req-07419778-92e8-45f4-b32e-82b9451947d9 service nova] Creating event network-vif-deleted:b14caf9c-97a3-483c-92a9-d43af26af98c for instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 on n-h2-767704-28 Jul 14 14:49:13.157988 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a698c328-a0c6-4f42-9781-07c6f05ce0c5 req-07419778-92e8-45f4-b32e-82b9451947d9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107171 Jul 14 14:49:13.160630 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2123/4207] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:13.529940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-655ed6f6-f5fd-456a-91b1-84f7f14f0e41 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:13.544268 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-655ed6f6-f5fd-456a-91b1-84f7f14f0e41 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1523 microversion: 2.1 time: 0.821037 Jul 14 14:49:13.549548 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2085/4208] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:12 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1523 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:13.595628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6c0c97cf-cb81-496b-b56f-024ce05d8f2d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:13.595840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6c0c97cf-cb81-496b-b56f-024ce05d8f2d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:13.607030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c0c97cf-cb81-496b-b56f-024ce05d8f2d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:13.609479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c0c97cf-cb81-496b-b56f-024ce05d8f2d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:13.613234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c0c97cf-cb81-496b-b56f-024ce05d8f2d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:13.614936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c0c97cf-cb81-496b-b56f-024ce05d8f2d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:13.740047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f6c989e2-571c-4405-b270-263cfe17139d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:13.741307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f6c989e2-571c-4405-b270-263cfe17139d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:13.758972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6c989e2-571c-4405-b270-263cfe17139d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:13.759859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6c989e2-571c-4405-b270-263cfe17139d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:13.771116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6c989e2-571c-4405-b270-263cfe17139d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:13.774297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6c989e2-571c-4405-b270-263cfe17139d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:13.857340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6c989e2-571c-4405-b270-263cfe17139d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:13.857844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6c989e2-571c-4405-b270-263cfe17139d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:13.858605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-f6c989e2-571c-4405-b270-263cfe17139d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lazy-loading 'fault' on Instance uuid 2b55c122-95db-42f1-95a9-ae5bbb4ff958 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:49:13.882687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:13.934276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:13.984392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f6c989e2-571c-4405-b270-263cfe17139d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157150edd1d441aa2c7335dbb2363ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1933006fa13c44ae9128f00267210152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:13.995407 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f6c989e2-571c-4405-b270-263cfe17139d tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 200 len: 1329 microversion: 2.1 time: 0.260619 Jul 14 14:49:13.997280 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2086/4209] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:13 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 1329 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:14.005272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-26ccc470-9fd5-4f00-8e00-89990f4a107c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:14.006262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-26ccc470-9fd5-4f00-8e00-89990f4a107c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:14.020317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26ccc470-9fd5-4f00-8e00-89990f4a107c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:14.025818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6c0c97cf-cb81-496b-b56f-024ce05d8f2d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:14.034778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26ccc470-9fd5-4f00-8e00-89990f4a107c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:14.036802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:14.040690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26ccc470-9fd5-4f00-8e00-89990f4a107c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:14.042835 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6c0c97cf-cb81-496b-b56f-024ce05d8f2d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 0.454762 Jul 14 14:49:14.043333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-26ccc470-9fd5-4f00-8e00-89990f4a107c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:14.046122 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2124/4210] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:13 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:14.062027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-7109edc5-1ff4-45a0-a2f7-70ca55c494cc req-60080c2e-712b-47fb-84bd-dda31d02739f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e9e65c9-2b74-402b-8cd5-05f2110a7641", "tag": "9337ad8b-b5f8-4c77-a426-765668104fa0"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:14.101533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7109edc5-1ff4-45a0-a2f7-70ca55c494cc req-60080c2e-712b-47fb-84bd-dda31d02739f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:14.103308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7109edc5-1ff4-45a0-a2f7-70ca55c494cc req-60080c2e-712b-47fb-84bd-dda31d02739f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:14.140605 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-7109edc5-1ff4-45a0-a2f7-70ca55c494cc req-60080c2e-712b-47fb-84bd-dda31d02739f service nova] Creating event network-changed:9337ad8b-b5f8-4c77-a426-765668104fa0 for instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 on n-h2-767704-28 Jul 14 14:49:14.160580 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-7109edc5-1ff4-45a0-a2f7-70ca55c494cc req-60080c2e-712b-47fb-84bd-dda31d02739f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106588 Jul 14 14:49:14.164111 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2125/4211] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:14.398974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:14.459323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-26ccc470-9fd5-4f00-8e00-89990f4a107c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:14.486914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-26ccc470-9fd5-4f00-8e00-89990f4a107c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:14.488861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-26ccc470-9fd5-4f00-8e00-89990f4a107c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:14.490996 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-26ccc470-9fd5-4f00-8e00-89990f4a107c tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.491623 Jul 14 14:49:14.492104 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2087/4212] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:13 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:14.572372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fbb29673-793a-4ac4-8549-7024c139358c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:14.573577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fbb29673-793a-4ac4-8549-7024c139358c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:14.621457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fbb29673-793a-4ac4-8549-7024c139358c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:14.626163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fbb29673-793a-4ac4-8549-7024c139358c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:14.641096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fbb29673-793a-4ac4-8549-7024c139358c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:14.641825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fbb29673-793a-4ac4-8549-7024c139358c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:15.015389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea11cb9d-5e43-4008-b3b1-95f93f6801c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:15.016795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ea11cb9d-5e43-4008-b3b1-95f93f6801c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] [instance: 2b55c122-95db-42f1-95a9-ae5bbb4ff958] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:15.027848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea11cb9d-5e43-4008-b3b1-95f93f6801c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:15.030019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea11cb9d-5e43-4008-b3b1-95f93f6801c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:15.031841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea11cb9d-5e43-4008-b3b1-95f93f6801c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:15.034083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea11cb9d-5e43-4008-b3b1-95f93f6801c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:15.088040 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-ea11cb9d-5e43-4008-b3b1-95f93f6801c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] HTTP exception thrown: Instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 could not be found. Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea11cb9d-5e43-4008-b3b1-95f93f6801c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Request method failure captured: Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 HTTP/1.1 Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CqeTHaua1mrAoMsWalZYpPqmTQ-DcKvLbCsfPO7qDbpKBxxTx4n3bTPRxjIsY87FdmdIpxDuFpmylNVxXWu7O4aKHski9z6vXFgUEATmO5T5a4xVEdgMgmRCGrZRc-L7A0A1cYH36dJi-2mZ9w6VAAL7DBepATCUrn7iOaopLMMuR0 Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1933006fa13c44ae9128f00267210152 Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1933006fa13c44ae9128f00267210152"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1933006fa13c44ae9128f00267210152"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1933006fa13c44ae9128f00267210152", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1933006fa13c44ae9128f00267210152"}]}] Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1933006fa13c44ae9128f00267210152 Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-1472511591 Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-1472511591-project Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: f157150edd1d441aa2c7335dbb2363ca Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-1472511591-project Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 could not be found. Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '2b55c122-95db-42f1-95a9-ae5bbb4ff958'} Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 could not be found. Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 could not be found. Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:15.095780 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:15.105881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:15.105881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:15.105881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:15.105881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:15.105881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:15.105881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 could not be found. Jul 14 14:49:15.105881 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:15.105881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea11cb9d-5e43-4008-b3b1-95f93f6801c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Returning 404 to user: Instance 2b55c122-95db-42f1-95a9-ae5bbb4ff958 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:15.105881 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ea11cb9d-5e43-4008-b3b1-95f93f6801c5 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958" status: 404 len: 111 microversion: 2.1 time: 0.087825 Jul 14 14:49:15.105881 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2088/4213] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:15 2022] GET /compute/v2.1/servers/2b55c122-95db-42f1-95a9-ae5bbb4ff958 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:15.120441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-08793a62-6cc1-4de9-ae95-ee154aaa05e5 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:15.121344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-08793a62-6cc1-4de9-ae95-ee154aaa05e5 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:15.129575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08793a62-6cc1-4de9-ae95-ee154aaa05e5 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:15.130033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08793a62-6cc1-4de9-ae95-ee154aaa05e5 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:15.131310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08793a62-6cc1-4de9-ae95-ee154aaa05e5 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:15.132120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08793a62-6cc1-4de9-ae95-ee154aaa05e5 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:15.197026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fbb29673-793a-4ac4-8549-7024c139358c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:15.209438 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fbb29673-793a-4ac4-8549-7024c139358c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1523 microversion: 2.1 time: 0.645532 Jul 14 14:49:15.210048 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2126/4214] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:14 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1523 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:15.220585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dd2a9cd5-9e20-4720-ba23-80f8a53617a0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] Calling method '.version_select at 0x7fd6c4d5cca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:15.266697 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dd2a9cd5-9e20-4720-ba23-80f8a53617a0 tempest-ServerActionsTestJSON-1472511591 tempest-ServerActionsTestJSON-1472511591-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735912081" status: 202 len: 0 microversion: 2.1 time: 0.053030 Jul 14 14:49:15.269137 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2127/4215] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 14:49:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735912081 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:49:15.525142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-74c3c775-cffd-4edb-a0fa-c8182c93b403 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:15.526321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-74c3c775-cffd-4edb-a0fa-c8182c93b403 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:15.548540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74c3c775-cffd-4edb-a0fa-c8182c93b403 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:15.549653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74c3c775-cffd-4edb-a0fa-c8182c93b403 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:15.551297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74c3c775-cffd-4edb-a0fa-c8182c93b403 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:15.553992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74c3c775-cffd-4edb-a0fa-c8182c93b403 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:15.838235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-08793a62-6cc1-4de9-ae95-ee154aaa05e5 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:15.847911 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-08793a62-6cc1-4de9-ae95-ee154aaa05e5 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 0.744448 Jul 14 14:49:15.862434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-74c3c775-cffd-4edb-a0fa-c8182c93b403 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:15.866825 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2089/4216] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:15 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:15.881432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-74c3c775-cffd-4edb-a0fa-c8182c93b403 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:15.883024 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-74c3c775-cffd-4edb-a0fa-c8182c93b403 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:15.884742 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-74c3c775-cffd-4edb-a0fa-c8182c93b403 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.364213 Jul 14 14:49:15.884866 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2128/4217] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:15 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:49:16.229090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4083b232-0b3b-440d-8cf2-ff6da9cc1482 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:16.231216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-004736d4-7cdf-49af-a0ee-f771fcdb4f63 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:16.231721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-004736d4-7cdf-49af-a0ee-f771fcdb4f63 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:16.231947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4083b232-0b3b-440d-8cf2-ff6da9cc1482 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:16.255357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-004736d4-7cdf-49af-a0ee-f771fcdb4f63 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:16.255929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-004736d4-7cdf-49af-a0ee-f771fcdb4f63 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:16.259698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4083b232-0b3b-440d-8cf2-ff6da9cc1482 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:16.260165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4083b232-0b3b-440d-8cf2-ff6da9cc1482 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:16.277320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-004736d4-7cdf-49af-a0ee-f771fcdb4f63 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:16.280628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-004736d4-7cdf-49af-a0ee-f771fcdb4f63 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:16.283193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4083b232-0b3b-440d-8cf2-ff6da9cc1482 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:16.284720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4083b232-0b3b-440d-8cf2-ff6da9cc1482 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:16.353948 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-004736d4-7cdf-49af-a0ee-f771fcdb4f63 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/ips" status: 200 len: 150 microversion: 2.1 time: 0.133691 Jul 14 14:49:16.357470 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2090/4218] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 14:49:16 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/ips => generated 150 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:16.482029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d129c018-1c84-4d8f-bff9-7ba12ba75942 req-4bb5bf7c-c486-43f1-bb67-6b253e08e662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5", "name": "network-vif-plugged", "status": "completed", "tag": "8bf12488-bd78-4a9f-82af-678062508fea"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:16.509540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d129c018-1c84-4d8f-bff9-7ba12ba75942 req-4bb5bf7c-c486-43f1-bb67-6b253e08e662 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:16.510430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d129c018-1c84-4d8f-bff9-7ba12ba75942 req-4bb5bf7c-c486-43f1-bb67-6b253e08e662 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:16.550016 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d129c018-1c84-4d8f-bff9-7ba12ba75942 req-4bb5bf7c-c486-43f1-bb67-6b253e08e662 service nova] Creating event network-vif-plugged:8bf12488-bd78-4a9f-82af-678062508fea for instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 on n-h1-767704-28 Jul 14 14:49:16.558245 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d129c018-1c84-4d8f-bff9-7ba12ba75942 req-4bb5bf7c-c486-43f1-bb67-6b253e08e662 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084925 Jul 14 14:49:16.559408 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2091/4219] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:49:16.885246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf313f65-95d6-43c9-92e3-c4dfeebaeece tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:16.886240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bf313f65-95d6-43c9-92e3-c4dfeebaeece tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:16.911060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf313f65-95d6-43c9-92e3-c4dfeebaeece tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:16.911771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf313f65-95d6-43c9-92e3-c4dfeebaeece tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:16.913656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf313f65-95d6-43c9-92e3-c4dfeebaeece tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:16.914876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf313f65-95d6-43c9-92e3-c4dfeebaeece tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:17.627746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bf313f65-95d6-43c9-92e3-c4dfeebaeece tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:17.648413 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf313f65-95d6-43c9-92e3-c4dfeebaeece tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 0.770017 Jul 14 14:49:17.649295 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2092/4220] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:16 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:17.656212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d163cdc4-7c61-4847-b5b3-c0c5866f89f4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:17.659050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d163cdc4-7c61-4847-b5b3-c0c5866f89f4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:17.675050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d163cdc4-7c61-4847-b5b3-c0c5866f89f4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:17.679605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d163cdc4-7c61-4847-b5b3-c0c5866f89f4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:17.680740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d163cdc4-7c61-4847-b5b3-c0c5866f89f4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:17.681412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d163cdc4-7c61-4847-b5b3-c0c5866f89f4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:17.974660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d163cdc4-7c61-4847-b5b3-c0c5866f89f4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:18.002902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4083b232-0b3b-440d-8cf2-ff6da9cc1482 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:18.023023 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4083b232-0b3b-440d-8cf2-ff6da9cc1482 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1523 microversion: 2.1 time: 1.799049 Jul 14 14:49:18.035786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d163cdc4-7c61-4847-b5b3-c0c5866f89f4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:18.043579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d163cdc4-7c61-4847-b5b3-c0c5866f89f4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:18.046436 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2129/4221] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:16 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1523 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:18.053319 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d163cdc4-7c61-4847-b5b3-c0c5866f89f4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.400109 Jul 14 14:49:18.071856 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2093/4222] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:17 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:18.314916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-74f6ea38-d100-40b6-a7f6-16668db1d44c req-81a56363-059a-4669-9fd4-029587f57540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e9e65c9-2b74-402b-8cd5-05f2110a7641", "tag": "162934c5-4b4a-462d-a3d1-08df032a2097"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:18.334989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-74f6ea38-d100-40b6-a7f6-16668db1d44c req-81a56363-059a-4669-9fd4-029587f57540 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:18.337401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-74f6ea38-d100-40b6-a7f6-16668db1d44c req-81a56363-059a-4669-9fd4-029587f57540 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:18.377965 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-74f6ea38-d100-40b6-a7f6-16668db1d44c req-81a56363-059a-4669-9fd4-029587f57540 service nova] Creating event network-changed:162934c5-4b4a-462d-a3d1-08df032a2097 for instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 on n-h2-767704-28 Jul 14 14:49:18.383690 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-74f6ea38-d100-40b6-a7f6-16668db1d44c req-81a56363-059a-4669-9fd4-029587f57540 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088674 Jul 14 14:49:18.385189 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2130/4223] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:18.666968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bed1ab07-a72c-49da-8d1f-7bfb14320db0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:18.667580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bed1ab07-a72c-49da-8d1f-7bfb14320db0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:18.707061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bed1ab07-a72c-49da-8d1f-7bfb14320db0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:18.707679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bed1ab07-a72c-49da-8d1f-7bfb14320db0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:18.719261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bed1ab07-a72c-49da-8d1f-7bfb14320db0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:18.727245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bed1ab07-a72c-49da-8d1f-7bfb14320db0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:19.066313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-970aee82-2461-4539-bb1f-2bcc210eaa09 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:19.086174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-970aee82-2461-4539-bb1f-2bcc210eaa09 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:19.119604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-970aee82-2461-4539-bb1f-2bcc210eaa09 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:19.125305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-970aee82-2461-4539-bb1f-2bcc210eaa09 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:19.129901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-970aee82-2461-4539-bb1f-2bcc210eaa09 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:19.131219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-970aee82-2461-4539-bb1f-2bcc210eaa09 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:19.490908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bed1ab07-a72c-49da-8d1f-7bfb14320db0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:19.500610 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bed1ab07-a72c-49da-8d1f-7bfb14320db0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 0.837553 Jul 14 14:49:19.505637 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2094/4224] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:18 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:19.530438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9e364f5a-508e-4d80-969f-c6ca66f5b158 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:19.532161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9e364f5a-508e-4d80-969f-c6ca66f5b158 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:19.561392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e364f5a-508e-4d80-969f-c6ca66f5b158 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:19.561819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e364f5a-508e-4d80-969f-c6ca66f5b158 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:19.569555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e364f5a-508e-4d80-969f-c6ca66f5b158 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:19.570785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e364f5a-508e-4d80-969f-c6ca66f5b158 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:19.776440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e364f5a-508e-4d80-969f-c6ca66f5b158 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:19.792049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e364f5a-508e-4d80-969f-c6ca66f5b158 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:19.799639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e364f5a-508e-4d80-969f-c6ca66f5b158 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:19.801160 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9e364f5a-508e-4d80-969f-c6ca66f5b158 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.292317 Jul 14 14:49:19.802183 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2095/4225] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:19 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:19.817863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-64b23c2f-9ab9-4703-85ea-b38f005cd55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "341d7c82-1fa4-4680-abec-d85c687b801a"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:19.819574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-64b23c2f-9ab9-4703-85ea-b38f005cd55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:19.821844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-970aee82-2461-4539-bb1f-2bcc210eaa09 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:19.833229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64b23c2f-9ab9-4703-85ea-b38f005cd55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:19.834110 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64b23c2f-9ab9-4703-85ea-b38f005cd55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:19.835601 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-970aee82-2461-4539-bb1f-2bcc210eaa09 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1508 microversion: 2.1 time: 0.775234 Jul 14 14:49:19.836203 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2131/4226] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:19 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1508 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:19.845175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64b23c2f-9ab9-4703-85ea-b38f005cd55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:19.845175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64b23c2f-9ab9-4703-85ea-b38f005cd55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:19.853841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-894b3fdf-e675-496b-bc1f-0c205e991785 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:19.862437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-894b3fdf-e675-496b-bc1f-0c205e991785 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:19.880265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-894b3fdf-e675-496b-bc1f-0c205e991785 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:19.881143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-894b3fdf-e675-496b-bc1f-0c205e991785 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:19.882328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-894b3fdf-e675-496b-bc1f-0c205e991785 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:19.883635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-894b3fdf-e675-496b-bc1f-0c205e991785 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:20.286440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-894b3fdf-e675-496b-bc1f-0c205e991785 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:20.303258 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-894b3fdf-e675-496b-bc1f-0c205e991785 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 200 len: 1508 microversion: 2.1 time: 0.451658 Jul 14 14:49:20.305379 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2132/4227] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:19 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 1508 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:20.322151 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-64b23c2f-9ab9-4703-85ea-b38f005cd55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.517289 Jul 14 14:49:20.324154 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2096/4228] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:49:19 2022] POST /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments => generated 194 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:20.329250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1a5359aa-d37a-463f-bf03-f09450c4b853 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:20.329250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1a5359aa-d37a-463f-bf03-f09450c4b853 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:20.351256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a5359aa-d37a-463f-bf03-f09450c4b853 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:20.353823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a5359aa-d37a-463f-bf03-f09450c4b853 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:20.355011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a5359aa-d37a-463f-bf03-f09450c4b853 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:20.356772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a5359aa-d37a-463f-bf03-f09450c4b853 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:20.433727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1a5359aa-d37a-463f-bf03-f09450c4b853 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:20.532404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eedd2253-1ac8-4eea-b05f-05afeee2ac81 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:20.534070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eedd2253-1ac8-4eea-b05f-05afeee2ac81 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:20.544650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eedd2253-1ac8-4eea-b05f-05afeee2ac81 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:20.545943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eedd2253-1ac8-4eea-b05f-05afeee2ac81 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:20.547012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eedd2253-1ac8-4eea-b05f-05afeee2ac81 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:20.547617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eedd2253-1ac8-4eea-b05f-05afeee2ac81 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:20.595466 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1a5359aa-d37a-463f-bf03-f09450c4b853 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 204 len: 0 microversion: 2.1 time: 0.276603 Jul 14 14:49:20.596392 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2133/4229] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:20 2022] DELETE /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:20.820430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-00182236-2899-4fb9-9569-839df20938eb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:20.821587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-00182236-2899-4fb9-9569-839df20938eb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:20.844715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00182236-2899-4fb9-9569-839df20938eb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:20.851191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00182236-2899-4fb9-9569-839df20938eb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:20.855908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00182236-2899-4fb9-9569-839df20938eb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:20.856592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00182236-2899-4fb9-9569-839df20938eb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:21.088747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-00182236-2899-4fb9-9569-839df20938eb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:21.113409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-00182236-2899-4fb9-9569-839df20938eb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:21.115022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-00182236-2899-4fb9-9569-839df20938eb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:21.119470 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-00182236-2899-4fb9-9569-839df20938eb tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.303276 Jul 14 14:49:21.136565 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2134/4230] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:20 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:49:21.158022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1976988265", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "89eb577c-0684-494b-84d5-c6d4ce688beb"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:21.271401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] validate_networks() for [('89eb577c-0684-494b-84d5-c6d4ce688beb', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:49:21.314856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eedd2253-1ac8-4eea-b05f-05afeee2ac81 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:21.333672 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eedd2253-1ac8-4eea-b05f-05afeee2ac81 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 0.808528 Jul 14 14:49:21.334287 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2097/4231] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:20 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:22.140008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-511a5747-46f4-4131-a405-5112539e5390 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:22.140922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-511a5747-46f4-4131-a405-5112539e5390 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:22.159566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-511a5747-46f4-4131-a405-5112539e5390 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:22.160308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-511a5747-46f4-4131-a405-5112539e5390 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:22.161289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-511a5747-46f4-4131-a405-5112539e5390 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:22.161910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-511a5747-46f4-4131-a405-5112539e5390 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:22.413269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-511a5747-46f4-4131-a405-5112539e5390 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:22.427715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-511a5747-46f4-4131-a405-5112539e5390 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:22.440074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-511a5747-46f4-4131-a405-5112539e5390 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:22.452232 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-511a5747-46f4-4131-a405-5112539e5390 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.316634 Jul 14 14:49:22.469346 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2098/4232] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:22 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:49:22.482147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2b7c98aa-99a7-413a-a461-067e4afef1da tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:22.486792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2b7c98aa-99a7-413a-a461-067e4afef1da tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:22.510423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b7c98aa-99a7-413a-a461-067e4afef1da tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:22.511247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b7c98aa-99a7-413a-a461-067e4afef1da tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:22.512296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b7c98aa-99a7-413a-a461-067e4afef1da tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:22.513005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b7c98aa-99a7-413a-a461-067e4afef1da tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:23.004894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:49:23.005474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:49:23.006183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:49:23.006707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:49:23.007526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:49:23.035706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:23.036453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:23.041850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:23.044207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:23.082996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Getting quotas for project 50f8ea81533f4e1e8c98b5c46718f29f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:49:23.090912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Getting quotas for user 55bc09bf29a243dfa43fa12663cfada8 and project 50f8ea81533f4e1e8c98b5c46718f29f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:49:23.106444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:49:23.120167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:49:23.245847 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-11effb3b-4acd-4cb6-88a1-b7501db6e549 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.103837 Jul 14 14:49:23.251527 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2135/4233] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:49:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:49:23.258541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b11b6fd9-63a1-47cc-91c4-49ea1589599c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:23.270008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b11b6fd9-63a1-47cc-91c4-49ea1589599c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:24.034744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2b7c98aa-99a7-413a-a461-067e4afef1da tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:24.039715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:24.056376 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2b7c98aa-99a7-413a-a461-067e4afef1da tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 1.582774 Jul 14 14:49:24.059741 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2099/4234] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:22 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:24.074531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-677ba203-3c91-49ff-b9e1-1eadb5dc1658 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:24.079616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-677ba203-3c91-49ff-b9e1-1eadb5dc1658 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:24.104543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-677ba203-3c91-49ff-b9e1-1eadb5dc1658 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:24.105053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-677ba203-3c91-49ff-b9e1-1eadb5dc1658 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:24.109805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-677ba203-3c91-49ff-b9e1-1eadb5dc1658 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:24.110568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-677ba203-3c91-49ff-b9e1-1eadb5dc1658 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:24.495963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b11b6fd9-63a1-47cc-91c4-49ea1589599c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:24.505616 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b11b6fd9-63a1-47cc-91c4-49ea1589599c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1218 microversion: 2.1 time: 1.250616 Jul 14 14:49:24.507375 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2136/4235] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:23 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1218 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:24.702087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-677ba203-3c91-49ff-b9e1-1eadb5dc1658 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:24.727810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-677ba203-3c91-49ff-b9e1-1eadb5dc1658 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:24.734746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-677ba203-3c91-49ff-b9e1-1eadb5dc1658 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:24.739609 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-677ba203-3c91-49ff-b9e1-1eadb5dc1658 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.675101 Jul 14 14:49:24.742111 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2100/4236] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:24 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:24.993694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-74eb56c4-adc7-4ba5-b108-a4f83ffe1fcc req-1b806261-c177-462c-8b9c-6192d13beab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5", "name": "network-vif-deleted", "tag": "8bf12488-bd78-4a9f-82af-678062508fea"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:25.021064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-74eb56c4-adc7-4ba5-b108-a4f83ffe1fcc req-1b806261-c177-462c-8b9c-6192d13beab2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:25.021659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-74eb56c4-adc7-4ba5-b108-a4f83ffe1fcc req-1b806261-c177-462c-8b9c-6192d13beab2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:25.063906 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-74eb56c4-adc7-4ba5-b108-a4f83ffe1fcc req-1b806261-c177-462c-8b9c-6192d13beab2 service nova] Creating event network-vif-deleted:8bf12488-bd78-4a9f-82af-678062508fea for instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 on n-h1-767704-28 Jul 14 14:49:25.079106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf891daf-f11f-4263-b1e2-47d2923f2307 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:25.079621 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-74eb56c4-adc7-4ba5-b108-a4f83ffe1fcc req-1b806261-c177-462c-8b9c-6192d13beab2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091165 Jul 14 14:49:25.079710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bf891daf-f11f-4263-b1e2-47d2923f2307 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:25.080233 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2137/4237] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:49:25.120841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf891daf-f11f-4263-b1e2-47d2923f2307 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:25.121454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf891daf-f11f-4263-b1e2-47d2923f2307 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:25.125445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf891daf-f11f-4263-b1e2-47d2923f2307 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:25.128101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf891daf-f11f-4263-b1e2-47d2923f2307 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:25.525668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0c99eceb-e833-4ec4-a4b0-da37ae035b78 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:25.526398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0c99eceb-e833-4ec4-a4b0-da37ae035b78 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:25.539022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0c99eceb-e833-4ec4-a4b0-da37ae035b78 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:25.539763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0c99eceb-e833-4ec4-a4b0-da37ae035b78 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:25.541810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0c99eceb-e833-4ec4-a4b0-da37ae035b78 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:25.543618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0c99eceb-e833-4ec4-a4b0-da37ae035b78 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:25.799011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0c99eceb-e833-4ec4-a4b0-da37ae035b78 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:25.838234 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0c99eceb-e833-4ec4-a4b0-da37ae035b78 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1288 microversion: 2.1 time: 0.316750 Jul 14 14:49:25.853333 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2138/4238] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:25 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1288 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:25.859962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-efb44f17-f22f-48dd-a20c-88fb914f8e2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:25.861267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-efb44f17-f22f-48dd-a20c-88fb914f8e2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:25.867271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bf891daf-f11f-4263-b1e2-47d2923f2307 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:25.875256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efb44f17-f22f-48dd-a20c-88fb914f8e2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:25.878960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efb44f17-f22f-48dd-a20c-88fb914f8e2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:25.880178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efb44f17-f22f-48dd-a20c-88fb914f8e2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:25.880920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efb44f17-f22f-48dd-a20c-88fb914f8e2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:25.892425 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf891daf-f11f-4263-b1e2-47d2923f2307 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 0.819540 Jul 14 14:49:25.894395 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2101/4239] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:25 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:26.046951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-efb44f17-f22f-48dd-a20c-88fb914f8e2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:26.080919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-efb44f17-f22f-48dd-a20c-88fb914f8e2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:26.096395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-efb44f17-f22f-48dd-a20c-88fb914f8e2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:26.098681 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-efb44f17-f22f-48dd-a20c-88fb914f8e2f tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.243690 Jul 14 14:49:26.104008 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2139/4240] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:25 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:26.862644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-426dc565-3ecf-4c25-a509-8f5558c690d8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:26.863538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-426dc565-3ecf-4c25-a509-8f5558c690d8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:26.879634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-426dc565-3ecf-4c25-a509-8f5558c690d8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:26.891042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-426dc565-3ecf-4c25-a509-8f5558c690d8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:26.893425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-426dc565-3ecf-4c25-a509-8f5558c690d8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:26.894109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-426dc565-3ecf-4c25-a509-8f5558c690d8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:26.920201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5f4dd82d-68da-4547-9016-74f86951a767 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:26.935955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5f4dd82d-68da-4547-9016-74f86951a767 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:26.963976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f4dd82d-68da-4547-9016-74f86951a767 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:26.964630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f4dd82d-68da-4547-9016-74f86951a767 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:26.965673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f4dd82d-68da-4547-9016-74f86951a767 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:26.966293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f4dd82d-68da-4547-9016-74f86951a767 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:27.010200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-426dc565-3ecf-4c25-a509-8f5558c690d8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:27.022573 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-426dc565-3ecf-4c25-a509-8f5558c690d8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1276 microversion: 2.1 time: 0.165238 Jul 14 14:49:27.031154 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2102/4241] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:26 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:27.125761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-47285f75-d20a-4dac-b4e1-b73852698c89 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:27.126005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-47285f75-d20a-4dac-b4e1-b73852698c89 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:27.141747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47285f75-d20a-4dac-b4e1-b73852698c89 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:27.142847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47285f75-d20a-4dac-b4e1-b73852698c89 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:27.144135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47285f75-d20a-4dac-b4e1-b73852698c89 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:27.144751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47285f75-d20a-4dac-b4e1-b73852698c89 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:27.282042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-47285f75-d20a-4dac-b4e1-b73852698c89 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:27.297760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-47285f75-d20a-4dac-b4e1-b73852698c89 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:27.300457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-47285f75-d20a-4dac-b4e1-b73852698c89 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:27.304999 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-47285f75-d20a-4dac-b4e1-b73852698c89 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.184719 Jul 14 14:49:27.306751 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2103/4242] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:27 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:27.361997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5f4dd82d-68da-4547-9016-74f86951a767 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:27.382154 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5f4dd82d-68da-4547-9016-74f86951a767 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 0.468981 Jul 14 14:49:27.383575 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2140/4243] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:26 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:28.043197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aa987441-16a3-4cfb-818b-7eb23fe06cc7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:28.043805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aa987441-16a3-4cfb-818b-7eb23fe06cc7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:28.083329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa987441-16a3-4cfb-818b-7eb23fe06cc7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.083852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa987441-16a3-4cfb-818b-7eb23fe06cc7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:28.084712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa987441-16a3-4cfb-818b-7eb23fe06cc7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.096874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa987441-16a3-4cfb-818b-7eb23fe06cc7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:28.330965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31fdd343-cd12-4197-8b92-506f73401674 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:28.332636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-31fdd343-cd12-4197-8b92-506f73401674 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:28.366158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31fdd343-cd12-4197-8b92-506f73401674 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.367168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31fdd343-cd12-4197-8b92-506f73401674 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:28.368283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31fdd343-cd12-4197-8b92-506f73401674 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.371101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31fdd343-cd12-4197-8b92-506f73401674 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:28.538201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-31fdd343-cd12-4197-8b92-506f73401674 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:28.580585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-31fdd343-cd12-4197-8b92-506f73401674 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:28.612185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-31fdd343-cd12-4197-8b92-506f73401674 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:28.619644 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-31fdd343-cd12-4197-8b92-506f73401674 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.292351 Jul 14 14:49:28.620891 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2141/4244] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:28 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:28.648908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c4e06819-5ac0-4b39-be91-cc72a1c06ed1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:28.653965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c4e06819-5ac0-4b39-be91-cc72a1c06ed1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:28.657135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aa987441-16a3-4cfb-818b-7eb23fe06cc7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:28.670526 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aa987441-16a3-4cfb-818b-7eb23fe06cc7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1318 microversion: 2.1 time: 0.632418 Jul 14 14:49:28.671242 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2104/4245] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:28 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:28.678429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c4e06819-5ac0-4b39-be91-cc72a1c06ed1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.682207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c4e06819-5ac0-4b39-be91-cc72a1c06ed1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:28.683325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c4e06819-5ac0-4b39-be91-cc72a1c06ed1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.686901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c4e06819-5ac0-4b39-be91-cc72a1c06ed1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:28.793004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-9942e3c5-e067-4fa2-8922-bf19b0670839 req-aa51e9ef-316a-4449-8854-b7c91ca03e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96235c02-0a5a-451c-8ef7-6836c9040ebd", "tag": "4d29a768-43bf-4896-8877-969600e9c380"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:28.803316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9942e3c5-e067-4fa2-8922-bf19b0670839 req-aa51e9ef-316a-4449-8854-b7c91ca03e6c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.804044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9942e3c5-e067-4fa2-8922-bf19b0670839 req-aa51e9ef-316a-4449-8854-b7c91ca03e6c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:28.837349 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-9942e3c5-e067-4fa2-8922-bf19b0670839 req-aa51e9ef-316a-4449-8854-b7c91ca03e6c service nova] Creating event network-changed:4d29a768-43bf-4896-8877-969600e9c380 for instance 96235c02-0a5a-451c-8ef7-6836c9040ebd on n-h2-767704-28 Jul 14 14:49:28.852339 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-9942e3c5-e067-4fa2-8922-bf19b0670839 req-aa51e9ef-316a-4449-8854-b7c91ca03e6c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064018 Jul 14 14:49:28.853580 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2105/4246] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:49:29.204078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c4e06819-5ac0-4b39-be91-cc72a1c06ed1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:29.212410 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c4e06819-5ac0-4b39-be91-cc72a1c06ed1 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 0.589340 Jul 14 14:49:29.219133 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2142/4247] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:28 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:29.502292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-595c4255-605e-4ec9-8c99-43a3e834140f req-8a08619b-ad6c-4b5e-8e6a-ebaa9d4a9625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9e65c9-2b74-402b-8cd5-05f2110a7641", "name": "network-vif-plugged", "status": "completed", "tag": "9337ad8b-b5f8-4c77-a426-765668104fa0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:29.529160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-595c4255-605e-4ec9-8c99-43a3e834140f req-8a08619b-ad6c-4b5e-8e6a-ebaa9d4a9625 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:29.530774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-595c4255-605e-4ec9-8c99-43a3e834140f req-8a08619b-ad6c-4b5e-8e6a-ebaa9d4a9625 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:29.551439 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-595c4255-605e-4ec9-8c99-43a3e834140f req-8a08619b-ad6c-4b5e-8e6a-ebaa9d4a9625 service nova] Creating event network-vif-plugged:9337ad8b-b5f8-4c77-a426-765668104fa0 for instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 on n-h2-767704-28 Jul 14 14:49:29.558930 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-595c4255-605e-4ec9-8c99-43a3e834140f req-8a08619b-ad6c-4b5e-8e6a-ebaa9d4a9625 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063427 Jul 14 14:49:29.559758 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2106/4248] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:29.643886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e0bf256d-aaca-4d3a-85a1-25fcbad3feee tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:29.643886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e0bf256d-aaca-4d3a-85a1-25fcbad3feee tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:29.662165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e0bf256d-aaca-4d3a-85a1-25fcbad3feee tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:29.662893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e0bf256d-aaca-4d3a-85a1-25fcbad3feee tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:29.663956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e0bf256d-aaca-4d3a-85a1-25fcbad3feee tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:29.669567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e0bf256d-aaca-4d3a-85a1-25fcbad3feee tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:29.693369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3bce82e0-a7a1-4731-9b3f-3ab80b5ec534 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:29.711108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3bce82e0-a7a1-4731-9b3f-3ab80b5ec534 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:29.732406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bce82e0-a7a1-4731-9b3f-3ab80b5ec534 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:29.733286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bce82e0-a7a1-4731-9b3f-3ab80b5ec534 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:29.734751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bce82e0-a7a1-4731-9b3f-3ab80b5ec534 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:29.735827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3bce82e0-a7a1-4731-9b3f-3ab80b5ec534 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:30.105911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e0bf256d-aaca-4d3a-85a1-25fcbad3feee tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:30.129420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e0bf256d-aaca-4d3a-85a1-25fcbad3feee tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:30.133383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e0bf256d-aaca-4d3a-85a1-25fcbad3feee tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:30.136103 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e0bf256d-aaca-4d3a-85a1-25fcbad3feee tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.499652 Jul 14 14:49:30.150800 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2143/4249] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:29 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:30.240084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1bf44f2-dec3-4e5b-b078-5bb38ad7d39e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:30.240901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f1bf44f2-dec3-4e5b-b078-5bb38ad7d39e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:30.254644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1bf44f2-dec3-4e5b-b078-5bb38ad7d39e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:30.256151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1bf44f2-dec3-4e5b-b078-5bb38ad7d39e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:30.257409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1bf44f2-dec3-4e5b-b078-5bb38ad7d39e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:30.258268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1bf44f2-dec3-4e5b-b078-5bb38ad7d39e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:30.301233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:30.533853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3bce82e0-a7a1-4731-9b3f-3ab80b5ec534 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:30.558407 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3bce82e0-a7a1-4731-9b3f-3ab80b5ec534 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1318 microversion: 2.1 time: 0.873328 Jul 14 14:49:30.559508 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2107/4250] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:29 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1318 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:30.866289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f1bf44f2-dec3-4e5b-b078-5bb38ad7d39e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:30.883185 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f1bf44f2-dec3-4e5b-b078-5bb38ad7d39e tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 0.648007 Jul 14 14:49:30.885057 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2144/4251] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:30 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:31.165366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-621999af-220e-4df8-b33a-ca37460887c7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:31.166747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-621999af-220e-4df8-b33a-ca37460887c7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:31.183970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-621999af-220e-4df8-b33a-ca37460887c7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.184472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-621999af-220e-4df8-b33a-ca37460887c7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.185391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-621999af-220e-4df8-b33a-ca37460887c7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.186036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-621999af-220e-4df8-b33a-ca37460887c7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.339851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-621999af-220e-4df8-b33a-ca37460887c7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:31.353628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-621999af-220e-4df8-b33a-ca37460887c7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:31.356172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-621999af-220e-4df8-b33a-ca37460887c7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:31.360063 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-621999af-220e-4df8-b33a-ca37460887c7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.202222 Jul 14 14:49:31.366286 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2108/4252] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:31 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:31.584984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b7f23980-9fd5-4061-b249-13c7e3fce99b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:31.585634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b7f23980-9fd5-4061-b249-13c7e3fce99b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:31.595018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7f23980-9fd5-4061-b249-13c7e3fce99b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.595736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7f23980-9fd5-4061-b249-13c7e3fce99b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.598005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7f23980-9fd5-4061-b249-13c7e3fce99b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.598455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7f23980-9fd5-4061-b249-13c7e3fce99b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.883299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b7f23980-9fd5-4061-b249-13c7e3fce99b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:31.893506 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b7f23980-9fd5-4061-b249-13c7e3fce99b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1318 microversion: 2.1 time: 0.312652 Jul 14 14:49:31.901048 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2145/4253] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:31 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:31.909350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-057a4b93-eb40-4630-90c7-40152343e568 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:31.910341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-057a4b93-eb40-4630-90c7-40152343e568 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:31.920202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-057a4b93-eb40-4630-90c7-40152343e568 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.920497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-057a4b93-eb40-4630-90c7-40152343e568 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.922260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-057a4b93-eb40-4630-90c7-40152343e568 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.923524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-057a4b93-eb40-4630-90c7-40152343e568 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.976091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e9faa962-d55d-4e32-af2a-f1f1e27ab38f req-5a1af761-d3b9-4cac-b497-97514a5615f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9e65c9-2b74-402b-8cd5-05f2110a7641", "name": "network-vif-plugged", "status": "completed", "tag": "162934c5-4b4a-462d-a3d1-08df032a2097"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:31.988056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e9faa962-d55d-4e32-af2a-f1f1e27ab38f req-5a1af761-d3b9-4cac-b497-97514a5615f4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.989475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e9faa962-d55d-4e32-af2a-f1f1e27ab38f req-5a1af761-d3b9-4cac-b497-97514a5615f4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:32.004789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e9faa962-d55d-4e32-af2a-f1f1e27ab38f req-5a1af761-d3b9-4cac-b497-97514a5615f4 service nova] Creating event network-vif-plugged:162934c5-4b4a-462d-a3d1-08df032a2097 for instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 on n-h2-767704-28 Jul 14 14:49:32.010905 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e9faa962-d55d-4e32-af2a-f1f1e27ab38f req-5a1af761-d3b9-4cac-b497-97514a5615f4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038346 Jul 14 14:49:32.016159 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2146/4254] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:32.195648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-057a4b93-eb40-4630-90c7-40152343e568 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:32.206069 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-057a4b93-eb40-4630-90c7-40152343e568 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 0.303474 Jul 14 14:49:32.206951 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2109/4255] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:31 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:32.390279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e3088916-62b4-4e92-96b4-ffc108dea7e4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:32.391312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e3088916-62b4-4e92-96b4-ffc108dea7e4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:32.399505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3088916-62b4-4e92-96b4-ffc108dea7e4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:32.400581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3088916-62b4-4e92-96b4-ffc108dea7e4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:32.401859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3088916-62b4-4e92-96b4-ffc108dea7e4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:32.402764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3088916-62b4-4e92-96b4-ffc108dea7e4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:32.519980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e3088916-62b4-4e92-96b4-ffc108dea7e4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:32.532125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e3088916-62b4-4e92-96b4-ffc108dea7e4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:32.535272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e3088916-62b4-4e92-96b4-ffc108dea7e4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:32.536846 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e3088916-62b4-4e92-96b4-ffc108dea7e4 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.153045 Jul 14 14:49:32.537858 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2147/4256] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:32 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:32.911187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e827d74c-0269-468c-9e8f-dcffa5a2d6c2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:32.911954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e827d74c-0269-468c-9e8f-dcffa5a2d6c2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:32.924068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e827d74c-0269-468c-9e8f-dcffa5a2d6c2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:32.924534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e827d74c-0269-468c-9e8f-dcffa5a2d6c2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:32.925387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e827d74c-0269-468c-9e8f-dcffa5a2d6c2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:32.925840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e827d74c-0269-468c-9e8f-dcffa5a2d6c2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:33.181464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e827d74c-0269-468c-9e8f-dcffa5a2d6c2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:33.191000 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e827d74c-0269-468c-9e8f-dcffa5a2d6c2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1318 microversion: 2.1 time: 0.284144 Jul 14 14:49:33.200402 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2110/4257] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:32 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:33.221673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:33.226560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2be2e812-7019-481f-81f4-7a0ed79e0f85 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:33.227445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2be2e812-7019-481f-81f4-7a0ed79e0f85 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:33.244066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2be2e812-7019-481f-81f4-7a0ed79e0f85 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:33.249630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2be2e812-7019-481f-81f4-7a0ed79e0f85 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:33.250730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2be2e812-7019-481f-81f4-7a0ed79e0f85 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:33.251351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2be2e812-7019-481f-81f4-7a0ed79e0f85 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:33.528029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2be2e812-7019-481f-81f4-7a0ed79e0f85 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:33.546252 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2be2e812-7019-481f-81f4-7a0ed79e0f85 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1333 microversion: 2.1 time: 0.325949 Jul 14 14:49:33.546781 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2148/4258] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:33 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1333 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:33.560302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-06a3fff3-fd51-4d9e-b83b-21c08408ac95 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:33.561465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-06a3fff3-fd51-4d9e-b83b-21c08408ac95 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:33.582549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06a3fff3-fd51-4d9e-b83b-21c08408ac95 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:33.584485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06a3fff3-fd51-4d9e-b83b-21c08408ac95 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:33.585563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06a3fff3-fd51-4d9e-b83b-21c08408ac95 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:33.588546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06a3fff3-fd51-4d9e-b83b-21c08408ac95 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:33.721235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-06a3fff3-fd51-4d9e-b83b-21c08408ac95 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:33.739497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-06a3fff3-fd51-4d9e-b83b-21c08408ac95 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:33.741378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-06a3fff3-fd51-4d9e-b83b-21c08408ac95 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:33.742628 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-06a3fff3-fd51-4d9e-b83b-21c08408ac95 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.186515 Jul 14 14:49:33.765341 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2111/4259] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:33 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:34.208677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bdabe381-b7e0-4fcc-8eba-47f2420bcfb2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:34.209352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bdabe381-b7e0-4fcc-8eba-47f2420bcfb2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:34.219255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bdabe381-b7e0-4fcc-8eba-47f2420bcfb2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:34.219983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bdabe381-b7e0-4fcc-8eba-47f2420bcfb2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:34.221579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bdabe381-b7e0-4fcc-8eba-47f2420bcfb2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:34.225761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bdabe381-b7e0-4fcc-8eba-47f2420bcfb2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:34.441050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bdabe381-b7e0-4fcc-8eba-47f2420bcfb2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:34.452425 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bdabe381-b7e0-4fcc-8eba-47f2420bcfb2 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1318 microversion: 2.1 time: 0.246269 Jul 14 14:49:34.463383 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2149/4260] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:34 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:34.563999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6a5dd4cc-d40b-4fa9-b033-9bfecc0c1190 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:34.564615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6a5dd4cc-d40b-4fa9-b033-9bfecc0c1190 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:34.580625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a5dd4cc-d40b-4fa9-b033-9bfecc0c1190 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:34.585546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a5dd4cc-d40b-4fa9-b033-9bfecc0c1190 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:34.586713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a5dd4cc-d40b-4fa9-b033-9bfecc0c1190 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:34.587314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a5dd4cc-d40b-4fa9-b033-9bfecc0c1190 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:34.759186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:34.764033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-628039b6-a5b5-47bc-a3df-de7a15768589 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:34.764744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-628039b6-a5b5-47bc-a3df-de7a15768589 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:34.774940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-628039b6-a5b5-47bc-a3df-de7a15768589 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:34.775786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-628039b6-a5b5-47bc-a3df-de7a15768589 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:34.776971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-628039b6-a5b5-47bc-a3df-de7a15768589 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:34.777641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-628039b6-a5b5-47bc-a3df-de7a15768589 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.047260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6a5dd4cc-d40b-4fa9-b033-9bfecc0c1190 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:35.057701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-628039b6-a5b5-47bc-a3df-de7a15768589 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:35.063859 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6a5dd4cc-d40b-4fa9-b033-9bfecc0c1190 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1666 microversion: 2.1 time: 0.503964 Jul 14 14:49:35.064938 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2112/4261] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:34 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1666 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:35.076529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-628039b6-a5b5-47bc-a3df-de7a15768589 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:35.078883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-628039b6-a5b5-47bc-a3df-de7a15768589 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:35.083786 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-628039b6-a5b5-47bc-a3df-de7a15768589 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.325324 Jul 14 14:49:35.087149 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2150/4262] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:34 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:49:35.104144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f08055a0-56be-491b-9541-19b4cea08f8c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:35.106889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f08055a0-56be-491b-9541-19b4cea08f8c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:35.121133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f08055a0-56be-491b-9541-19b4cea08f8c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.121958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f08055a0-56be-491b-9541-19b4cea08f8c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.123706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f08055a0-56be-491b-9541-19b4cea08f8c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.124374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f08055a0-56be-491b-9541-19b4cea08f8c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.129487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-1f484b9c-d4a9-4dcd-8dcd-6beaec16a240 req-586f73a8-684f-40ae-a372-dda5b8791c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96235c02-0a5a-451c-8ef7-6836c9040ebd", "name": "network-vif-plugged", "status": "completed", "tag": "4d29a768-43bf-4896-8877-969600e9c380"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:35.176664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1f484b9c-d4a9-4dcd-8dcd-6beaec16a240 req-586f73a8-684f-40ae-a372-dda5b8791c4a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.178633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1f484b9c-d4a9-4dcd-8dcd-6beaec16a240 req-586f73a8-684f-40ae-a372-dda5b8791c4a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.185143 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f08055a0-56be-491b-9541-19b4cea08f8c tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641/ips" status: 200 len: 177 microversion: 2.1 time: 0.106147 Jul 14 14:49:35.190011 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2113/4263] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 14:49:35 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641/ips => generated 177 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:35.205937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d992a7ea-cebe-456f-83a1-1483cf8e3b0d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:35.206848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d992a7ea-cebe-456f-83a1-1483cf8e3b0d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:35.211015 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-1f484b9c-d4a9-4dcd-8dcd-6beaec16a240 req-586f73a8-684f-40ae-a372-dda5b8791c4a service nova] Creating event network-vif-plugged:4d29a768-43bf-4896-8877-969600e9c380 for instance 96235c02-0a5a-451c-8ef7-6836c9040ebd on n-h2-767704-28 Jul 14 14:49:35.214627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d992a7ea-cebe-456f-83a1-1483cf8e3b0d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.215386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d992a7ea-cebe-456f-83a1-1483cf8e3b0d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.216418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d992a7ea-cebe-456f-83a1-1483cf8e3b0d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.217670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d992a7ea-cebe-456f-83a1-1483cf8e3b0d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.224456 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-1f484b9c-d4a9-4dcd-8dcd-6beaec16a240 req-586f73a8-684f-40ae-a372-dda5b8791c4a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106930 Jul 14 14:49:35.226741 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2151/4264] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:35.348572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d992a7ea-cebe-456f-83a1-1483cf8e3b0d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:35.472816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1123fb43-69a6-4c79-85cf-ad8fe466aa88 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:35.475160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1123fb43-69a6-4c79-85cf-ad8fe466aa88 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:35.486554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1123fb43-69a6-4c79-85cf-ad8fe466aa88 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.487287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1123fb43-69a6-4c79-85cf-ad8fe466aa88 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.488413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1123fb43-69a6-4c79-85cf-ad8fe466aa88 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.489666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1123fb43-69a6-4c79-85cf-ad8fe466aa88 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.633346 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d992a7ea-cebe-456f-83a1-1483cf8e3b0d tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 204 len: 0 microversion: 2.1 time: 0.431793 Jul 14 14:49:35.637486 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2114/4265] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:35 2022] DELETE /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:49:35.666530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4c068a9d-c9ba-424c-93e8-84490bde7bd0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:35.666530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4c068a9d-c9ba-424c-93e8-84490bde7bd0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:35.679541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c068a9d-c9ba-424c-93e8-84490bde7bd0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.683788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c068a9d-c9ba-424c-93e8-84490bde7bd0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.684716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c068a9d-c9ba-424c-93e8-84490bde7bd0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.685927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c068a9d-c9ba-424c-93e8-84490bde7bd0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.862221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1123fb43-69a6-4c79-85cf-ad8fe466aa88 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:35.877589 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1123fb43-69a6-4c79-85cf-ad8fe466aa88 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1318 microversion: 2.1 time: 0.410719 Jul 14 14:49:35.878187 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2152/4266] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:35 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:36.066804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4c068a9d-c9ba-424c-93e8-84490bde7bd0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:36.080025 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4c068a9d-c9ba-424c-93e8-84490bde7bd0 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1672 microversion: 2.1 time: 0.437882 Jul 14 14:49:36.080625 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2115/4267] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:35 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1672 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:36.115893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9e7bf1ba-e606-4863-b82e-0140f4a23239 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:36.116656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9e7bf1ba-e606-4863-b82e-0140f4a23239 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:36.123718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e7bf1ba-e606-4863-b82e-0140f4a23239 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.124441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e7bf1ba-e606-4863-b82e-0140f4a23239 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.125625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e7bf1ba-e606-4863-b82e-0140f4a23239 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.126226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e7bf1ba-e606-4863-b82e-0140f4a23239 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.134691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1155319437", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:36.158714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:36.220524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e7bf1ba-e606-4863-b82e-0140f4a23239 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:36.221880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] validate_networks() for [('9f42908f-fe9e-412f-a1db-27c1d0d33291', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:49:36.231478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e7bf1ba-e606-4863-b82e-0140f4a23239 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:36.233130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e7bf1ba-e606-4863-b82e-0140f4a23239 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:36.234361 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9e7bf1ba-e606-4863-b82e-0140f4a23239 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.123389 Jul 14 14:49:36.245523 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2116/4268] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:36 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:49:36.711456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:49:36.711943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:49:36.712455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:49:36.712937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:49:36.713552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:49:36.738075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.740778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.742707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.743784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.773914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Getting quotas for project 14a2d361c8364c908f6147aa58322173. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:49:36.783927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Getting quotas for user 918848bbb5f1490aa4f348037735e758 and project 14a2d361c8364c908f6147aa58322173. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:49:36.789550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:36.803422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:49:36.805933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:49:36.869031 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1c183032-c901-4684-b0a7-bcac0fd5f6d9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.966714 Jul 14 14:49:36.869696 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2153/4269] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:49:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:49:36.881772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-06146382-afd5-42ad-9eaf-d09da7c57664 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:36.891259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-06146382-afd5-42ad-9eaf-d09da7c57664 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:36.895215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5d7b9135-9971-4060-bd76-1db5cbf7c46f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:36.895841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5d7b9135-9971-4060-bd76-1db5cbf7c46f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:36.919029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d7b9135-9971-4060-bd76-1db5cbf7c46f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.919375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d7b9135-9971-4060-bd76-1db5cbf7c46f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.923079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d7b9135-9971-4060-bd76-1db5cbf7c46f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.923539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d7b9135-9971-4060-bd76-1db5cbf7c46f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.186340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-06146382-afd5-42ad-9eaf-d09da7c57664 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:37.210566 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-06146382-afd5-42ad-9eaf-d09da7c57664 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1223 microversion: 2.1 time: 0.329939 Jul 14 14:49:37.213922 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2117/4270] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:36 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1223 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:37.228278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6ca2daa7-4eba-4946-8544-34cfcda19404 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:37.234171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6ca2daa7-4eba-4946-8544-34cfcda19404 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:37.256516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ca2daa7-4eba-4946-8544-34cfcda19404 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.258586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ca2daa7-4eba-4946-8544-34cfcda19404 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.265278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ca2daa7-4eba-4946-8544-34cfcda19404 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.267556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ca2daa7-4eba-4946-8544-34cfcda19404 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.354944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5d7b9135-9971-4060-bd76-1db5cbf7c46f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:37.372206 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5d7b9135-9971-4060-bd76-1db5cbf7c46f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1318 microversion: 2.1 time: 0.481258 Jul 14 14:49:37.374859 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2154/4271] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:36 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1318 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:37.380359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-73ab2133-d824-4187-aec4-5032e707c577 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:37.381812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-73ab2133-d824-4187-aec4-5032e707c577 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:37.396438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73ab2133-d824-4187-aec4-5032e707c577 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.397649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73ab2133-d824-4187-aec4-5032e707c577 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.399048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73ab2133-d824-4187-aec4-5032e707c577 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.399735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73ab2133-d824-4187-aec4-5032e707c577 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.667735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6ca2daa7-4eba-4946-8544-34cfcda19404 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:37.670585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-73ab2133-d824-4187-aec4-5032e707c577 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:37.688228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-73ab2133-d824-4187-aec4-5032e707c577 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:37.688693 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6ca2daa7-4eba-4946-8544-34cfcda19404 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1672 microversion: 2.1 time: 0.471911 Jul 14 14:49:37.690005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-73ab2133-d824-4187-aec4-5032e707c577 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:37.693242 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-73ab2133-d824-4187-aec4-5032e707c577 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.317113 Jul 14 14:49:37.706392 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2118/4272] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:37 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1672 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:37.709321 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2155/4273] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:37 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:38.230990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2b9769ba-edb8-454c-9521-3f95bc46ba35 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:38.231608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2b9769ba-edb8-454c-9521-3f95bc46ba35 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:38.257759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b9769ba-edb8-454c-9521-3f95bc46ba35 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.265747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b9769ba-edb8-454c-9521-3f95bc46ba35 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.266982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b9769ba-edb8-454c-9521-3f95bc46ba35 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.268551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b9769ba-edb8-454c-9521-3f95bc46ba35 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.397109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3fe5b8be-2e6a-49d1-b9da-4d66a4eed0fb tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:38.398367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3fe5b8be-2e6a-49d1-b9da-4d66a4eed0fb tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:38.413008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3fe5b8be-2e6a-49d1-b9da-4d66a4eed0fb tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.413712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3fe5b8be-2e6a-49d1-b9da-4d66a4eed0fb tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.416419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3fe5b8be-2e6a-49d1-b9da-4d66a4eed0fb tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.418682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3fe5b8be-2e6a-49d1-b9da-4d66a4eed0fb tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.423140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2b9769ba-edb8-454c-9521-3f95bc46ba35 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:38.431833 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2b9769ba-edb8-454c-9521-3f95bc46ba35 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1275 microversion: 2.1 time: 0.204333 Jul 14 14:49:38.433381 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2119/4274] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:38 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:38.713367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ef5729f3-358f-4bbe-8215-837c758b63fa tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:38.713999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ef5729f3-358f-4bbe-8215-837c758b63fa tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:38.740968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef5729f3-358f-4bbe-8215-837c758b63fa tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.741625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef5729f3-358f-4bbe-8215-837c758b63fa tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.743455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef5729f3-358f-4bbe-8215-837c758b63fa tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.743914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef5729f3-358f-4bbe-8215-837c758b63fa tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.893353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3fe5b8be-2e6a-49d1-b9da-4d66a4eed0fb tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:38.918200 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3fe5b8be-2e6a-49d1-b9da-4d66a4eed0fb tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1508 microversion: 2.1 time: 0.525532 Jul 14 14:49:38.918529 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2156/4275] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:38 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1508 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:38.974785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0ce81db2-7f7b-4d4d-96ff-fcbb7bae5860 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:38.975533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0ce81db2-7f7b-4d4d-96ff-fcbb7bae5860 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:39.001209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ce81db2-7f7b-4d4d-96ff-fcbb7bae5860 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.008711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ce81db2-7f7b-4d4d-96ff-fcbb7bae5860 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.010492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ce81db2-7f7b-4d4d-96ff-fcbb7bae5860 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.011219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ce81db2-7f7b-4d4d-96ff-fcbb7bae5860 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.474925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0ce81db2-7f7b-4d4d-96ff-fcbb7bae5860 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:39.474925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0ce81db2-7f7b-4d4d-96ff-fcbb7bae5860 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:39.474925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0ce81db2-7f7b-4d4d-96ff-fcbb7bae5860 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:39.474925 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0ce81db2-7f7b-4d4d-96ff-fcbb7bae5860 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.408767 Jul 14 14:49:39.474925 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2157/4276] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:38 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:39.474925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-99f9f6b2-df82-4d3c-bf0a-a4ef16a65b1f req-4135b85e-1ff2-4494-8156-ff435e3c96d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9e65c9-2b74-402b-8cd5-05f2110a7641", "name": "network-vif-deleted", "tag": "162934c5-4b4a-462d-a3d1-08df032a2097"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:39.474925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-99f9f6b2-df82-4d3c-bf0a-a4ef16a65b1f req-4135b85e-1ff2-4494-8156-ff435e3c96d5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.474925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-99f9f6b2-df82-4d3c-bf0a-a4ef16a65b1f req-4135b85e-1ff2-4494-8156-ff435e3c96d5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.474925 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-99f9f6b2-df82-4d3c-bf0a-a4ef16a65b1f req-4135b85e-1ff2-4494-8156-ff435e3c96d5 service nova] Creating event network-vif-deleted:162934c5-4b4a-462d-a3d1-08df032a2097 for instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 on n-h2-767704-28 Jul 14 14:49:39.487925 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-99f9f6b2-df82-4d3c-bf0a-a4ef16a65b1f req-4135b85e-1ff2-4494-8156-ff435e3c96d5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124769 Jul 14 14:49:39.489026 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2158/4277] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:39.510054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1ea83466-9d79-4f88-bdc2-df4b352576f8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:39.510811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1ea83466-9d79-4f88-bdc2-df4b352576f8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:39.532389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ea83466-9d79-4f88-bdc2-df4b352576f8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.532882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ea83466-9d79-4f88-bdc2-df4b352576f8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.536232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ea83466-9d79-4f88-bdc2-df4b352576f8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.536697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ea83466-9d79-4f88-bdc2-df4b352576f8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.604277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ef5729f3-358f-4bbe-8215-837c758b63fa tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35abcadc35964a9d8df499c4d987e056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf20852acdd4cea9ed6e96934097280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:39.615571 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ef5729f3-358f-4bbe-8215-837c758b63fa tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 200 len: 1651 microversion: 2.1 time: 0.912479 Jul 14 14:49:39.626345 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2120/4278] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:38 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 1651 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:39.640499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98c392f0-3c4c-4e50-a361-2bb1d5bd23f4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:39.641156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-98c392f0-3c4c-4e50-a361-2bb1d5bd23f4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:39.663035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98c392f0-3c4c-4e50-a361-2bb1d5bd23f4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.665275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98c392f0-3c4c-4e50-a361-2bb1d5bd23f4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.666424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98c392f0-3c4c-4e50-a361-2bb1d5bd23f4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.668407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98c392f0-3c4c-4e50-a361-2bb1d5bd23f4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:40.913012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-98c392f0-3c4c-4e50-a361-2bb1d5bd23f4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:40.937072 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98c392f0-3c4c-4e50-a361-2bb1d5bd23f4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1281 microversion: 2.1 time: 1.300439 Jul 14 14:49:40.938110 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2121/4279] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:39 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1281 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:40.943539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f578a62a-7bcf-4e02-b589-632c3c834559 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:40.944374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f578a62a-7bcf-4e02-b589-632c3c834559 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:40.951142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:40.953534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f578a62a-7bcf-4e02-b589-632c3c834559 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.954392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f578a62a-7bcf-4e02-b589-632c3c834559 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:40.955649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f578a62a-7bcf-4e02-b589-632c3c834559 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.956268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f578a62a-7bcf-4e02-b589-632c3c834559 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.113125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f578a62a-7bcf-4e02-b589-632c3c834559 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:41.133185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f578a62a-7bcf-4e02-b589-632c3c834559 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:41.138664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f578a62a-7bcf-4e02-b589-632c3c834559 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:41.145568 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f578a62a-7bcf-4e02-b589-632c3c834559 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.206220 Jul 14 14:49:41.147580 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2122/4280] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:40 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:41.153457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1dd8cfc9-0d9d-4c2b-bc6c-8d00b324e2ec tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:41.154915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1dd8cfc9-0d9d-4c2b-bc6c-8d00b324e2ec tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:41.198935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1dd8cfc9-0d9d-4c2b-bc6c-8d00b324e2ec tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.201496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1ea83466-9d79-4f88-bdc2-df4b352576f8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:41.202513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1dd8cfc9-0d9d-4c2b-bc6c-8d00b324e2ec tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.203493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1dd8cfc9-0d9d-4c2b-bc6c-8d00b324e2ec tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.208705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1dd8cfc9-0d9d-4c2b-bc6c-8d00b324e2ec tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.214187 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1ea83466-9d79-4f88-bdc2-df4b352576f8 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1508 microversion: 2.1 time: 1.724258 Jul 14 14:49:41.225345 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2159/4281] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:39 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1508 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:41.233624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ae1b4fc6-ce4f-45b0-bac1-62d88f649cb7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:41.235022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ae1b4fc6-ce4f-45b0-bac1-62d88f649cb7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:41.247729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae1b4fc6-ce4f-45b0-bac1-62d88f649cb7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.248206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae1b4fc6-ce4f-45b0-bac1-62d88f649cb7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.252635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae1b4fc6-ce4f-45b0-bac1-62d88f649cb7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.270142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae1b4fc6-ce4f-45b0-bac1-62d88f649cb7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.311921 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-1dd8cfc9-0d9d-4c2b-bc6c-8d00b324e2ec tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] HTTP exception thrown: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1dd8cfc9-0d9d-4c2b-bc6c-8d00b324e2ec tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Request method failure captured: Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 HTTP/1.1 Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CyPejn0tX0RC-2eybolng7tBx1MF3DZ6-deYIRCq6WpztdOVlummjYi3sGiZYTyCNHbdlg32APsQcQrf7kMPi5fGx77R_59YVXJ-T29ZvDIoByy08k9m0g_-yMSjkrzBQGFRBJxQ4IOJ5O_7o77IB_Q3ZYySmEzIyCatNOOe6ST8IU Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1bf20852acdd4cea9ed6e96934097280 Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1bf20852acdd4cea9ed6e96934097280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1bf20852acdd4cea9ed6e96934097280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1bf20852acdd4cea9ed6e96934097280", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1bf20852acdd4cea9ed6e96934097280"}]}] Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1bf20852acdd4cea9ed6e96934097280 Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestMultiNic-1910901922-project Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 35abcadc35964a9d8df499c4d987e056 Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestMultiNic-1910901922-project Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0e9e65c9-2b74-402b-8cd5-05f2110a7641'} Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:41.320500 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:41.325677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:41.325677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:41.325677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:41.325677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:41.325677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:41.325677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:41.325677 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:41.331879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1dd8cfc9-0d9d-4c2b-bc6c-8d00b324e2ec tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Returning 404 to user: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:41.336935 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1dd8cfc9-0d9d-4c2b-bc6c-8d00b324e2ec tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 404 len: 111 microversion: 2.1 time: 0.187297 Jul 14 14:49:41.339163 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2123/4282] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:41 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:41.420938 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ae1b4fc6-ce4f-45b0-bac1-62d88f649cb7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "PUT /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1080 microversion: 2.1 time: 0.191939 Jul 14 14:49:41.424516 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2160/4283] 10.222.0.81 () {60 vars in 1255 bytes} [Thu Jul 14 14:49:41 2022] PUT /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1080 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:41.435558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-20ee6108-dbf9-424e-92c8-b18483c8515e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:41.436507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-20ee6108-dbf9-424e-92c8-b18483c8515e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:41.445076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20ee6108-dbf9-424e-92c8-b18483c8515e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.451521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20ee6108-dbf9-424e-92c8-b18483c8515e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.460547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20ee6108-dbf9-424e-92c8-b18483c8515e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.465046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20ee6108-dbf9-424e-92c8-b18483c8515e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.721620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-20ee6108-dbf9-424e-92c8-b18483c8515e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:41.733515 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-20ee6108-dbf9-424e-92c8-b18483c8515e tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1506 microversion: 2.1 time: 0.299665 Jul 14 14:49:41.749749 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2124/4284] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:41 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:41.757801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b97e2a58-c018-401e-84e7-b93e510f108f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:41.758785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b97e2a58-c018-401e-84e7-b93e510f108f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:41.799484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b97e2a58-c018-401e-84e7-b93e510f108f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.823164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b97e2a58-c018-401e-84e7-b93e510f108f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.823559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6e5debe9-e0da-4b1f-925c-06807d6bf76e req-ab0ad4ad-5d71-4ed8-bd2b-df27db532543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9e65c9-2b74-402b-8cd5-05f2110a7641", "name": "network-vif-deleted", "tag": "9337ad8b-b5f8-4c77-a426-765668104fa0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:41.824783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b97e2a58-c018-401e-84e7-b93e510f108f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.825451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b97e2a58-c018-401e-84e7-b93e510f108f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.842674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6e5debe9-e0da-4b1f-925c-06807d6bf76e req-ab0ad4ad-5d71-4ed8-bd2b-df27db532543 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.848452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6e5debe9-e0da-4b1f-925c-06807d6bf76e req-ab0ad4ad-5d71-4ed8-bd2b-df27db532543 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.866158 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6e5debe9-e0da-4b1f-925c-06807d6bf76e req-ab0ad4ad-5d71-4ed8-bd2b-df27db532543 service nova] Creating event network-vif-deleted:9337ad8b-b5f8-4c77-a426-765668104fa0 for instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 on n-h2-767704-28 Jul 14 14:49:41.882741 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6e5debe9-e0da-4b1f-925c-06807d6bf76e req-ab0ad4ad-5d71-4ed8-bd2b-df27db532543 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063975 Jul 14 14:49:41.883920 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2125/4285] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:49:41.955859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ca07f97-b31f-4293-8595-a5cb75e53663 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:41.956674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ca07f97-b31f-4293-8595-a5cb75e53663 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:41.972299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ca07f97-b31f-4293-8595-a5cb75e53663 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.973501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ca07f97-b31f-4293-8595-a5cb75e53663 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.976345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ca07f97-b31f-4293-8595-a5cb75e53663 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.977667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ca07f97-b31f-4293-8595-a5cb75e53663 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:42.992548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b97e2a58-c018-401e-84e7-b93e510f108f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:43.016045 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b97e2a58-c018-401e-84e7-b93e510f108f tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1506 microversion: 2.1 time: 1.264898 Jul 14 14:49:43.017366 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2161/4286] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:41 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1506 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:43.023921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e9ac82dc-4b4a-451e-a70c-14fb0f5da1e7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:43.025282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e9ac82dc-4b4a-451e-a70c-14fb0f5da1e7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:43.045355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9ac82dc-4b4a-451e-a70c-14fb0f5da1e7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:43.045917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9ac82dc-4b4a-451e-a70c-14fb0f5da1e7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:43.046749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9ac82dc-4b4a-451e-a70c-14fb0f5da1e7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:43.047204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9ac82dc-4b4a-451e-a70c-14fb0f5da1e7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:43.107804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ca07f97-b31f-4293-8595-a5cb75e53663 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:43.133325 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ca07f97-b31f-4293-8595-a5cb75e53663 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1323 microversion: 2.1 time: 1.180668 Jul 14 14:49:43.135828 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2126/4287] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:41 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1323 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:43.153235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c29d1b89-17d7-48f1-9646-db4d0415a4c5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:43.155392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c29d1b89-17d7-48f1-9646-db4d0415a4c5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:43.180680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c29d1b89-17d7-48f1-9646-db4d0415a4c5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:43.186475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c29d1b89-17d7-48f1-9646-db4d0415a4c5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:43.187518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c29d1b89-17d7-48f1-9646-db4d0415a4c5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:43.187771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c29d1b89-17d7-48f1-9646-db4d0415a4c5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:43.239067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e9ac82dc-4b4a-451e-a70c-14fb0f5da1e7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:43.252812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e9ac82dc-4b4a-451e-a70c-14fb0f5da1e7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:43.254414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e9ac82dc-4b4a-451e-a70c-14fb0f5da1e7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:43.263035 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e9ac82dc-4b4a-451e-a70c-14fb0f5da1e7 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.244326 Jul 14 14:49:43.265804 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2162/4288] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:43 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:43.407316 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c29d1b89-17d7-48f1-9646-db4d0415a4c5 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "PUT /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1082 microversion: 2.1 time: 0.267545 Jul 14 14:49:43.418243 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2127/4289] 10.222.0.81 () {60 vars in 1255 bytes} [Thu Jul 14 14:49:43 2022] PUT /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1082 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:43.422986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-40c13c77-3b81-45ea-90e9-cd06f234d5ca tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:43.423776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-40c13c77-3b81-45ea-90e9-cd06f234d5ca tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:43.439180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40c13c77-3b81-45ea-90e9-cd06f234d5ca tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:43.439902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40c13c77-3b81-45ea-90e9-cd06f234d5ca tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:43.441030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40c13c77-3b81-45ea-90e9-cd06f234d5ca tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:43.441733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40c13c77-3b81-45ea-90e9-cd06f234d5ca tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:43.452594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:44.154892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f01bdc3-334b-42ba-bf56-a2ab0daeca44 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:44.156253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1f01bdc3-334b-42ba-bf56-a2ab0daeca44 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:44.168763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f01bdc3-334b-42ba-bf56-a2ab0daeca44 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:44.169281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f01bdc3-334b-42ba-bf56-a2ab0daeca44 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:44.171185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f01bdc3-334b-42ba-bf56-a2ab0daeca44 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:44.171748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f01bdc3-334b-42ba-bf56-a2ab0daeca44 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:44.750142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-40c13c77-3b81-45ea-90e9-cd06f234d5ca tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:44.780136 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-40c13c77-3b81-45ea-90e9-cd06f234d5ca tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1508 microversion: 2.1 time: 1.361978 Jul 14 14:49:44.837024 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2163/4290] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:43 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1508 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:44.878606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4c8cf69-22dd-494b-9361-5288a168b098 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:44.879011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d4c8cf69-22dd-494b-9361-5288a168b098 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:44.936370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4c8cf69-22dd-494b-9361-5288a168b098 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:44.936855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4c8cf69-22dd-494b-9361-5288a168b098 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:44.938344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4c8cf69-22dd-494b-9361-5288a168b098 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:44.940294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4c8cf69-22dd-494b-9361-5288a168b098 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.107994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1f01bdc3-334b-42ba-bf56-a2ab0daeca44 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:45.129523 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f01bdc3-334b-42ba-bf56-a2ab0daeca44 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1323 microversion: 2.1 time: 0.968305 Jul 14 14:49:45.130193 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2128/4291] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:44 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1323 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:45.159138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-400f5a2d-c728-4130-84e1-204855d6513a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:45.159781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-400f5a2d-c728-4130-84e1-204855d6513a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:45.190276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-400f5a2d-c728-4130-84e1-204855d6513a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.192637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-400f5a2d-c728-4130-84e1-204855d6513a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.194066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-400f5a2d-c728-4130-84e1-204855d6513a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.201110 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-400f5a2d-c728-4130-84e1-204855d6513a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.334320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d4c8cf69-22dd-494b-9361-5288a168b098 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:45.351408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d4c8cf69-22dd-494b-9361-5288a168b098 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:45.363164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d4c8cf69-22dd-494b-9361-5288a168b098 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:45.371184 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d4c8cf69-22dd-494b-9361-5288a168b098 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.532916 Jul 14 14:49:45.371962 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2164/4292] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:44 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:45.803768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-520f1ead-669e-4174-b346-a2b26053b7db req-a0249752-b3e9-40fe-9129-be5eb7d9fb2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c804f5-bc58-41f2-97a5-c19ce7cb7538", "tag": "4dff7900-44ff-4bb2-97ea-1e108de17c71"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:45.826920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-520f1ead-669e-4174-b346-a2b26053b7db req-a0249752-b3e9-40fe-9129-be5eb7d9fb2d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.827543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-520f1ead-669e-4174-b346-a2b26053b7db req-a0249752-b3e9-40fe-9129-be5eb7d9fb2d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.831113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-400f5a2d-c728-4130-84e1-204855d6513a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:45.849346 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-400f5a2d-c728-4130-84e1-204855d6513a tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1508 microversion: 2.1 time: 0.708266 Jul 14 14:49:45.849346 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2129/4293] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:45 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1508 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:45.851559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f3806b5-8e45-4e96-9132-cebba0d49764 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:45.855295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1f3806b5-8e45-4e96-9132-cebba0d49764 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:45.863449 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-520f1ead-669e-4174-b346-a2b26053b7db req-a0249752-b3e9-40fe-9129-be5eb7d9fb2d service nova] Creating event network-changed:4dff7900-44ff-4bb2-97ea-1e108de17c71 for instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 on n-h1-767704-28 Jul 14 14:49:45.871149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f3806b5-8e45-4e96-9132-cebba0d49764 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.878063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f3806b5-8e45-4e96-9132-cebba0d49764 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.878920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f3806b5-8e45-4e96-9132-cebba0d49764 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.879371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f3806b5-8e45-4e96-9132-cebba0d49764 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.885452 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-520f1ead-669e-4174-b346-a2b26053b7db req-a0249752-b3e9-40fe-9129-be5eb7d9fb2d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081540 Jul 14 14:49:45.910829 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-1f3806b5-8e45-4e96-9132-cebba0d49764 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] HTTP exception thrown: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:45.911025 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2165/4294] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f3806b5-8e45-4e96-9132-cebba0d49764 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Request method failure captured: Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 HTTP/1.1 Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CyPejn0tX0RC-2eybolng7tBx1MF3DZ6-deYIRCq6WpztdOVlummjYi3sGiZYTyCNHbdlg32APsQcQrf7kMPi5fGx77R_59YVXJ-T29ZvDIoByy08k9m0g_-yMSjkrzBQGFRBJxQ4IOJ5O_7o77IB_Q3ZYySmEzIyCatNOOe6ST8IU Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1bf20852acdd4cea9ed6e96934097280 Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1bf20852acdd4cea9ed6e96934097280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1bf20852acdd4cea9ed6e96934097280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1bf20852acdd4cea9ed6e96934097280", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1bf20852acdd4cea9ed6e96934097280"}]}] Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1bf20852acdd4cea9ed6e96934097280 Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestMultiNic-1910901922-project Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 35abcadc35964a9d8df499c4d987e056 Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestMultiNic-1910901922-project Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0e9e65c9-2b74-402b-8cd5-05f2110a7641'} Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:45.912546 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:45.917538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:45.917538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.917538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:45.917538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.917538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:45.917538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:45.917538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:45.917538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:45.917538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:45.917538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:45.917538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.924912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f3806b5-8e45-4e96-9132-cebba0d49764 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Returning 404 to user: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:45.926009 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f3806b5-8e45-4e96-9132-cebba0d49764 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 404 len: 111 microversion: 2.1 time: 0.082479 Jul 14 14:49:45.927113 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2130/4295] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:45 2022] DELETE /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:45.949916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2348bb37-0d99-4f5f-a15f-61a923819a07 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:45.950527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2348bb37-0d99-4f5f-a15f-61a923819a07 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:45.962773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5bd8cc3a-2ebf-4383-808e-5901d69f2229 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:45.963006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5bd8cc3a-2ebf-4383-808e-5901d69f2229 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 0e9e65c9-2b74-402b-8cd5-05f2110a7641] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:45.988352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2348bb37-0d99-4f5f-a15f-61a923819a07 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.995316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bd8cc3a-2ebf-4383-808e-5901d69f2229 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.995786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bd8cc3a-2ebf-4383-808e-5901d69f2229 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.996591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bd8cc3a-2ebf-4383-808e-5901d69f2229 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.997149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bd8cc3a-2ebf-4383-808e-5901d69f2229 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.003705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2348bb37-0d99-4f5f-a15f-61a923819a07 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.026501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2348bb37-0d99-4f5f-a15f-61a923819a07 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.029202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2348bb37-0d99-4f5f-a15f-61a923819a07 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.057239 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-5bd8cc3a-2ebf-4383-808e-5901d69f2229 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] HTTP exception thrown: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5bd8cc3a-2ebf-4383-808e-5901d69f2229 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Request method failure captured: Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 HTTP/1.1 Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CyPejn0tX0RC-2eybolng7tBx1MF3DZ6-deYIRCq6WpztdOVlummjYi3sGiZYTyCNHbdlg32APsQcQrf7kMPi5fGx77R_59YVXJ-T29ZvDIoByy08k9m0g_-yMSjkrzBQGFRBJxQ4IOJ5O_7o77IB_Q3ZYySmEzIyCatNOOe6ST8IU Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1bf20852acdd4cea9ed6e96934097280 Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1bf20852acdd4cea9ed6e96934097280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1bf20852acdd4cea9ed6e96934097280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1bf20852acdd4cea9ed6e96934097280", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1bf20852acdd4cea9ed6e96934097280"}]}] Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1bf20852acdd4cea9ed6e96934097280 Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestMultiNic-1910901922-project Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 35abcadc35964a9d8df499c4d987e056 Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestMultiNic-1910901922-project Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0e9e65c9-2b74-402b-8cd5-05f2110a7641'} Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:46.058992 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.069521 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:46.069521 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:46.069521 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:46.069521 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:46.069521 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:46.069521 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. Jul 14 14:49:46.069521 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.069521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5bd8cc3a-2ebf-4383-808e-5901d69f2229 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Returning 404 to user: Instance 0e9e65c9-2b74-402b-8cd5-05f2110a7641 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:46.069521 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5bd8cc3a-2ebf-4383-808e-5901d69f2229 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641" status: 404 len: 111 microversion: 2.1 time: 0.125917 Jul 14 14:49:46.069521 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2131/4296] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:45 2022] GET /compute/v2.1/servers/0e9e65c9-2b74-402b-8cd5-05f2110a7641 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:46.070540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b9d9c2a9-3323-4d60-846d-52450719e8a7 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:46.070540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b9d9c2a9-3323-4d60-846d-52450719e8a7 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:46.090208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9d9c2a9-3323-4d60-846d-52450719e8a7 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.090677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9d9c2a9-3323-4d60-846d-52450719e8a7 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.091527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9d9c2a9-3323-4d60-846d-52450719e8a7 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.092491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9d9c2a9-3323-4d60-846d-52450719e8a7 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.100853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2348bb37-0d99-4f5f-a15f-61a923819a07 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:46.128829 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b9d9c2a9-3323-4d60-846d-52450719e8a7 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] HTTP exception thrown: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b9d9c2a9-3323-4d60-846d-52450719e8a7 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Request method failure captured: Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d HTTP/1.1 Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CyPejn0tX0RC-2eybolng7tBx1MF3DZ6-deYIRCq6WpztdOVlummjYi3sGiZYTyCNHbdlg32APsQcQrf7kMPi5fGx77R_59YVXJ-T29ZvDIoByy08k9m0g_-yMSjkrzBQGFRBJxQ4IOJ5O_7o77IB_Q3ZYySmEzIyCatNOOe6ST8IU Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1bf20852acdd4cea9ed6e96934097280 Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1bf20852acdd4cea9ed6e96934097280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1bf20852acdd4cea9ed6e96934097280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1bf20852acdd4cea9ed6e96934097280", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1bf20852acdd4cea9ed6e96934097280"}]}] Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1bf20852acdd4cea9ed6e96934097280 Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestMultiNic-1910901922-project Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 35abcadc35964a9d8df499c4d987e056 Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestMultiNic-1910901922-project Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '8e2c99c7-5253-4416-80df-b1350d634e9d'} Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:46.130481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:46.135165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:49:46.135165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.135165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:46.135165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.135165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:46.135165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:46.135165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:46.135165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:46.135165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:46.135165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:49:46.135165 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.137265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b9d9c2a9-3323-4d60-846d-52450719e8a7 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Returning 404 to user: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:46.138139 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b9d9c2a9-3323-4d60-846d-52450719e8a7 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 404 len: 111 microversion: 2.1 time: 0.072150 Jul 14 14:49:46.144305 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2132/4297] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:46 2022] DELETE /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:46.151055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7b7c4f63-061e-4270-87f4-86317b06ec7e tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:46.159616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7b7c4f63-061e-4270-87f4-86317b06ec7e tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:46.172940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b7c4f63-061e-4270-87f4-86317b06ec7e tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.177501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b7c4f63-061e-4270-87f4-86317b06ec7e tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.179318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b7c4f63-061e-4270-87f4-86317b06ec7e tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.179977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7b7c4f63-061e-4270-87f4-86317b06ec7e tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.340267 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2348bb37-0d99-4f5f-a15f-61a923819a07 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "DELETE /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 204 len: 0 microversion: 2.1 time: 0.419261 Jul 14 14:49:46.349944 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2166/4298] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:45 2022] DELETE /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:46.393363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dfb9c576-8003-4c37-9ad1-b6b0c1da7d16 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:46.395897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dfb9c576-8003-4c37-9ad1-b6b0c1da7d16 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] [instance: 8e2c99c7-5253-4416-80df-b1350d634e9d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:46.414433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfb9c576-8003-4c37-9ad1-b6b0c1da7d16 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.453770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfb9c576-8003-4c37-9ad1-b6b0c1da7d16 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.454745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfb9c576-8003-4c37-9ad1-b6b0c1da7d16 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.455213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfb9c576-8003-4c37-9ad1-b6b0c1da7d16 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.534512 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-dfb9c576-8003-4c37-9ad1-b6b0c1da7d16 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] HTTP exception thrown: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dfb9c576-8003-4c37-9ad1-b6b0c1da7d16 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Request method failure captured: Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d HTTP/1.1 Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CyPejn0tX0RC-2eybolng7tBx1MF3DZ6-deYIRCq6WpztdOVlummjYi3sGiZYTyCNHbdlg32APsQcQrf7kMPi5fGx77R_59YVXJ-T29ZvDIoByy08k9m0g_-yMSjkrzBQGFRBJxQ4IOJ5O_7o77IB_Q3ZYySmEzIyCatNOOe6ST8IU Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 1bf20852acdd4cea9ed6e96934097280 Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1bf20852acdd4cea9ed6e96934097280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1bf20852acdd4cea9ed6e96934097280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1bf20852acdd4cea9ed6e96934097280", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1bf20852acdd4cea9ed6e96934097280"}]}] Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 1bf20852acdd4cea9ed6e96934097280 Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestMultiNic-1910901922 Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestMultiNic-1910901922-project Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 35abcadc35964a9d8df499c4d987e056 Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestMultiNic-1910901922-project Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '8e2c99c7-5253-4416-80df-b1350d634e9d'} Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:46.540269 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.546077 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:46.546077 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:46.546077 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:46.546077 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:46.546077 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:46.546077 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. Jul 14 14:49:46.546077 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:46.550878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dfb9c576-8003-4c37-9ad1-b6b0c1da7d16 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] Returning 404 to user: Instance 8e2c99c7-5253-4416-80df-b1350d634e9d could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:46.553630 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dfb9c576-8003-4c37-9ad1-b6b0c1da7d16 tempest-ServersTestMultiNic-1910901922 tempest-ServersTestMultiNic-1910901922-project] 10.222.0.81 "GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d" status: 404 len: 111 microversion: 2.1 time: 0.184274 Jul 14 14:49:46.557634 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2167/4299] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:46 2022] GET /compute/v2.1/servers/8e2c99c7-5253-4416-80df-b1350d634e9d => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:46.569176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7b7c4f63-061e-4270-87f4-86317b06ec7e tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:46.576581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-040ae144-fa64-4be3-af73-21c4c34a41f0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:46.577246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-040ae144-fa64-4be3-af73-21c4c34a41f0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:46.584143 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7b7c4f63-061e-4270-87f4-86317b06ec7e tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1323 microversion: 2.1 time: 0.438415 Jul 14 14:49:46.586372 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2133/4300] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:46 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1323 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:46.593673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-040ae144-fa64-4be3-af73-21c4c34a41f0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.596435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-040ae144-fa64-4be3-af73-21c4c34a41f0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.603211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-040ae144-fa64-4be3-af73-21c4c34a41f0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.604361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23f547fe-e238-4a6c-b901-dd3cbb0c802d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:46.605037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-040ae144-fa64-4be3-af73-21c4c34a41f0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.605503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-23f547fe-e238-4a6c-b901-dd3cbb0c802d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:46.626542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23f547fe-e238-4a6c-b901-dd3cbb0c802d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.627658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23f547fe-e238-4a6c-b901-dd3cbb0c802d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.628704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23f547fe-e238-4a6c-b901-dd3cbb0c802d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.629380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23f547fe-e238-4a6c-b901-dd3cbb0c802d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.705593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-040ae144-fa64-4be3-af73-21c4c34a41f0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:46.768541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:46.840726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:46.861818 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.compute.api [None req-040ae144-fa64-4be3-af73-21c4c34a41f0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Instance is already in deleting state, ignoring this request Jul 14 14:49:46.875261 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-040ae144-fa64-4be3-af73-21c4c34a41f0 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "DELETE /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 204 len: 0 microversion: 2.1 time: 0.307710 Jul 14 14:49:46.877412 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2168/4301] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:46 2022] DELETE /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:46.892349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ebdb2980-06a0-4ed9-a5db-f3adfd16a6d7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:46.893570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ebdb2980-06a0-4ed9-a5db-f3adfd16a6d7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:46.916073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebdb2980-06a0-4ed9-a5db-f3adfd16a6d7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.917502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebdb2980-06a0-4ed9-a5db-f3adfd16a6d7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.919260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebdb2980-06a0-4ed9-a5db-f3adfd16a6d7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.920067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebdb2980-06a0-4ed9-a5db-f3adfd16a6d7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:47.012370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-23f547fe-e238-4a6c-b901-dd3cbb0c802d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:47.071674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-23f547fe-e238-4a6c-b901-dd3cbb0c802d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:47.074412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-23f547fe-e238-4a6c-b901-dd3cbb0c802d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:47.076660 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-23f547fe-e238-4a6c-b901-dd3cbb0c802d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.488436 Jul 14 14:49:47.077904 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2134/4302] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:46 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:47.355767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ebdb2980-06a0-4ed9-a5db-f3adfd16a6d7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:47.374760 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ebdb2980-06a0-4ed9-a5db-f3adfd16a6d7 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1514 microversion: 2.1 time: 0.492913 Jul 14 14:49:47.375558 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2169/4303] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:46 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1514 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:47.492549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-06ee5df0-0610-4a98-a027-2b1fcc516472 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: .version_select at 0x7fd6c4540160>, body: {"keypair": {"name": "tempest-keypair-1441659292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhxkGwqJAX4Ac+PHCQ9+V7xpO0yqdyvigBick6/65HSQr4kBSA6D02ZFtMl3Da7tybzak9A8N3TyZQIMgEBZjblrMRhbLIqpcxR8L6LkFRb+OtMJsmRiYan9zMRQbgLaQ=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:47.503726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:47.549593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-06ee5df0-0610-4a98-a027-2b1fcc516472 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:49:47.565224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-06ee5df0-0610-4a98-a027-2b1fcc516472 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for user 9260cbc32f1e423ab8ea4d06058b4050 and project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:49:47.603406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dd0f0490-cc9e-49d0-8fc4-c10ec4cb83e4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:47.604028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dd0f0490-cc9e-49d0-8fc4-c10ec4cb83e4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:47.620536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd0f0490-cc9e-49d0-8fc4-c10ec4cb83e4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:47.621207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd0f0490-cc9e-49d0-8fc4-c10ec4cb83e4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:47.622175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd0f0490-cc9e-49d0-8fc4-c10ec4cb83e4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:47.622962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd0f0490-cc9e-49d0-8fc4-c10ec4cb83e4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:47.641297 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-06ee5df0-0610-4a98-a027-2b1fcc516472 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153247 Jul 14 14:49:47.648780 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2135/4304] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:49:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:48.108658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cf274740-4335-4755-9151-225c11c8f608 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:48.109207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cf274740-4335-4755-9151-225c11c8f608 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:48.142099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf274740-4335-4755-9151-225c11c8f608 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:48.142561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf274740-4335-4755-9151-225c11c8f608 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:48.143439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf274740-4335-4755-9151-225c11c8f608 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:48.160636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf274740-4335-4755-9151-225c11c8f608 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:48.182456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dd0f0490-cc9e-49d0-8fc4-c10ec4cb83e4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:48.209109 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dd0f0490-cc9e-49d0-8fc4-c10ec4cb83e4 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1323 microversion: 2.1 time: 0.608985 Jul 14 14:49:48.227367 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2170/4305] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:47 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1323 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:48.394442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6b704e9c-10bb-43d2-a564-966b0235799c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:48.395972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6b704e9c-10bb-43d2-a564-966b0235799c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:48.415604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b704e9c-10bb-43d2-a564-966b0235799c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:48.416674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b704e9c-10bb-43d2-a564-966b0235799c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:48.417807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b704e9c-10bb-43d2-a564-966b0235799c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:48.418517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b704e9c-10bb-43d2-a564-966b0235799c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:48.513241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cf274740-4335-4755-9151-225c11c8f608 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:48.530516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cf274740-4335-4755-9151-225c11c8f608 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:48.532283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cf274740-4335-4755-9151-225c11c8f608 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:48.533691 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cf274740-4335-4755-9151-225c11c8f608 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.434763 Jul 14 14:49:48.542977 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2136/4306] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:48 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:49:49.075260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6b704e9c-10bb-43d2-a564-966b0235799c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:49.090494 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6b704e9c-10bb-43d2-a564-966b0235799c tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1514 microversion: 2.1 time: 0.700941 Jul 14 14:49:49.102492 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2171/4307] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:48 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1514 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:49.246988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bd1d9788-9942-4a51-a56b-80af9c8f819d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:49.248423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bd1d9788-9942-4a51-a56b-80af9c8f819d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:49.273309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd1d9788-9942-4a51-a56b-80af9c8f819d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:49.274363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd1d9788-9942-4a51-a56b-80af9c8f819d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:49.281646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd1d9788-9942-4a51-a56b-80af9c8f819d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:49.282449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd1d9788-9942-4a51-a56b-80af9c8f819d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:49.589210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9a5c8e95-423c-4d33-9259-4460cf8bf38a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:49.592326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9a5c8e95-423c-4d33-9259-4460cf8bf38a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:49.626198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9a5c8e95-423c-4d33-9259-4460cf8bf38a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:49.626577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9a5c8e95-423c-4d33-9259-4460cf8bf38a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:49.627402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9a5c8e95-423c-4d33-9259-4460cf8bf38a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:49.641704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9a5c8e95-423c-4d33-9259-4460cf8bf38a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:49.745740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bd1d9788-9942-4a51-a56b-80af9c8f819d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:49.751246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:49.756911 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bd1d9788-9942-4a51-a56b-80af9c8f819d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1323 microversion: 2.1 time: 0.515538 Jul 14 14:49:49.773598 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2137/4308] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:49 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1323 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:49.862369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9a5c8e95-423c-4d33-9259-4460cf8bf38a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:49.885201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9a5c8e95-423c-4d33-9259-4460cf8bf38a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:49.927229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9a5c8e95-423c-4d33-9259-4460cf8bf38a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:49.939389 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9a5c8e95-423c-4d33-9259-4460cf8bf38a tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1603 microversion: 2.32 time: 0.368517 Jul 14 14:49:49.945633 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2172/4309] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:49 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1603 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:49:50.115101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-baf0498d-290c-4b52-9cfe-1a212b9136bd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:50.115735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-baf0498d-290c-4b52-9cfe-1a212b9136bd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:50.127624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baf0498d-290c-4b52-9cfe-1a212b9136bd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:50.128091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baf0498d-290c-4b52-9cfe-1a212b9136bd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:50.128881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baf0498d-290c-4b52-9cfe-1a212b9136bd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:50.140397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baf0498d-290c-4b52-9cfe-1a212b9136bd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:50.199251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-eeaa682f-c81e-453f-9a2a-b563712ad03f req-cb119b0a-0c07-485b-8f15-9b04ea7c9876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96235c02-0a5a-451c-8ef7-6836c9040ebd", "name": "network-vif-deleted", "tag": "4d29a768-43bf-4896-8877-969600e9c380"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:50.266761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-eeaa682f-c81e-453f-9a2a-b563712ad03f req-cb119b0a-0c07-485b-8f15-9b04ea7c9876 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:50.285986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-eeaa682f-c81e-453f-9a2a-b563712ad03f req-cb119b0a-0c07-485b-8f15-9b04ea7c9876 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:50.329924 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-eeaa682f-c81e-453f-9a2a-b563712ad03f req-cb119b0a-0c07-485b-8f15-9b04ea7c9876 service nova] Creating event network-vif-deleted:4d29a768-43bf-4896-8877-969600e9c380 for instance 96235c02-0a5a-451c-8ef7-6836c9040ebd on n-h2-767704-28 Jul 14 14:49:50.367897 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-eeaa682f-c81e-453f-9a2a-b563712ad03f req-cb119b0a-0c07-485b-8f15-9b04ea7c9876 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175439 Jul 14 14:49:50.368725 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2173/4310] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:50.394120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-baf0498d-290c-4b52-9cfe-1a212b9136bd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bc09bf29a243dfa43fa12663cfada8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f8ea81533f4e1e8c98b5c46718f29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:50.405954 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-baf0498d-290c-4b52-9cfe-1a212b9136bd tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 200 len: 1472 microversion: 2.1 time: 0.298791 Jul 14 14:49:50.406575 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2138/4311] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:50 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:50.787999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5f465eb4-16cf-40d1-9a5a-f045f4e1fd3a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:50.788808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5f465eb4-16cf-40d1-9a5a-f045f4e1fd3a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:50.796760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f465eb4-16cf-40d1-9a5a-f045f4e1fd3a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:50.797556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f465eb4-16cf-40d1-9a5a-f045f4e1fd3a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:50.798600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f465eb4-16cf-40d1-9a5a-f045f4e1fd3a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:50.799446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f465eb4-16cf-40d1-9a5a-f045f4e1fd3a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:50.972199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:50.972841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:51.002955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.005287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.006307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.009516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.153288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.153891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.155657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lazy-loading 'fault' on Instance uuid 33bf437b-873e-4466-bd62-337dc6e75b1c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:49:51.281956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:51.322926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:51.338739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a152e24f38fd45ce87c92fb73581ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2821fd7634094e7ea51fbfe49987597b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:51.354605 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dc67eab8-c9e1-4a01-a7c9-f2cac9e2d30d tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 200 len: 1608 microversion: 2.32 time: 0.390004 Jul 14 14:49:51.357401 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2139/4312] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:50 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 1608 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:49:51.401639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5f465eb4-16cf-40d1-9a5a-f045f4e1fd3a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:51.417188 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5f465eb4-16cf-40d1-9a5a-f045f4e1fd3a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1323 microversion: 2.1 time: 0.633625 Jul 14 14:49:51.418616 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2174/4313] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:50 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1323 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:51.423908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e47dee34-e4f7-4686-ad3e-da04228ed4f9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:51.424543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e47dee34-e4f7-4686-ad3e-da04228ed4f9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 96235c02-0a5a-451c-8ef7-6836c9040ebd] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:51.443211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e47dee34-e4f7-4686-ad3e-da04228ed4f9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.443670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e47dee34-e4f7-4686-ad3e-da04228ed4f9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.444479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e47dee34-e4f7-4686-ad3e-da04228ed4f9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.444927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e47dee34-e4f7-4686-ad3e-da04228ed4f9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.475561 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-e47dee34-e4f7-4686-ad3e-da04228ed4f9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] HTTP exception thrown: Instance 96235c02-0a5a-451c-8ef7-6836c9040ebd could not be found. Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e47dee34-e4f7-4686-ad3e-da04228ed4f9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Request method failure captured: Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd HTTP/1.1 Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cxc4ht4d-VzdL6StuP5TF1kFsB-K_ILgDeUjIuEU5Sm2eyEVz2MKRgN_2TK08iBQ6YA-su9NomlpSDTVFkPf4RIWIJ_nlGnZfx4zABMBilRJ18Gpn_UZUxshtrIvaQyWaABuo2LvSoMaiXBgiK37uOtWAiMYMvSFL_vhGdm0ZMGy0k Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 50f8ea81533f4e1e8c98b5c46718f29f Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50f8ea81533f4e1e8c98b5c46718f29f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/50f8ea81533f4e1e8c98b5c46718f29f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_50f8ea81533f4e1e8c98b5c46718f29f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50f8ea81533f4e1e8c98b5c46718f29f"}]}] Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 50f8ea81533f4e1e8c98b5c46718f29f Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerDiskConfigTestJSON-1325339587-project Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 55bc09bf29a243dfa43fa12663cfada8 Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerDiskConfigTestJSON-1325339587-project Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 96235c02-0a5a-451c-8ef7-6836c9040ebd could not be found. Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '96235c02-0a5a-451c-8ef7-6836c9040ebd'} Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96235c02-0a5a-451c-8ef7-6836c9040ebd could not be found. Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96235c02-0a5a-451c-8ef7-6836c9040ebd could not be found. Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:51.477599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.483133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.483133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:51.483133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:51.483133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:51.483133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:51.483133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96235c02-0a5a-451c-8ef7-6836c9040ebd could not be found. Jul 14 14:49:51.483133 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.487890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e47dee34-e4f7-4686-ad3e-da04228ed4f9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Returning 404 to user: Instance 96235c02-0a5a-451c-8ef7-6836c9040ebd could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:51.489119 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e47dee34-e4f7-4686-ad3e-da04228ed4f9 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd" status: 404 len: 111 microversion: 2.1 time: 0.070213 Jul 14 14:49:51.489870 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2140/4314] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:51 2022] GET /compute/v2.1/servers/96235c02-0a5a-451c-8ef7-6836c9040ebd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:49:51.501025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6b60eb37-9710-4e04-8ce0-0a99a804a700 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:51.501484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6b60eb37-9710-4e04-8ce0-0a99a804a700 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:51.512262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b60eb37-9710-4e04-8ce0-0a99a804a700 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.513087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b60eb37-9710-4e04-8ce0-0a99a804a700 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.514648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b60eb37-9710-4e04-8ce0-0a99a804a700 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.515559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6b60eb37-9710-4e04-8ce0-0a99a804a700 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.564894 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-6b60eb37-9710-4e04-8ce0-0a99a804a700 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] HTTP exception thrown: Instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 could not be found. Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6b60eb37-9710-4e04-8ce0-0a99a804a700 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Request method failure captured: Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 HTTP/1.1 Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cxc4ht4d-VzdL6StuP5TF1kFsB-K_ILgDeUjIuEU5Sm2eyEVz2MKRgN_2TK08iBQ6YA-su9NomlpSDTVFkPf4RIWIJ_nlGnZfx4zABMBilRJ18Gpn_UZUxshtrIvaQyWaABuo2LvSoMaiXBgiK37uOtWAiMYMvSFL_vhGdm0ZMGy0k Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 50f8ea81533f4e1e8c98b5c46718f29f Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50f8ea81533f4e1e8c98b5c46718f29f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/50f8ea81533f4e1e8c98b5c46718f29f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_50f8ea81533f4e1e8c98b5c46718f29f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50f8ea81533f4e1e8c98b5c46718f29f"}]}] Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 50f8ea81533f4e1e8c98b5c46718f29f Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerDiskConfigTestJSON-1325339587-project Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 55bc09bf29a243dfa43fa12663cfada8 Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerDiskConfigTestJSON-1325339587-project Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 could not be found. Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5'} Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 could not be found. Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:51.570725 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:51.575013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 could not be found. Jul 14 14:49:51.575013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.575013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:51.575013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.575013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.575013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:51.575013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:51.575013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:51.575013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:51.575013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 could not be found. Jul 14 14:49:51.575013 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.577815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6b60eb37-9710-4e04-8ce0-0a99a804a700 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Returning 404 to user: Instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:51.594258 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6b60eb37-9710-4e04-8ce0-0a99a804a700 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 404 len: 111 microversion: 2.1 time: 0.084610 Jul 14 14:49:51.597758 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2175/4315] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:51 2022] DELETE /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:51.605535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-846d0d9d-fb69-4ed1-9fb9-64a0323d1a5b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:51.606482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-846d0d9d-fb69-4ed1-9fb9-64a0323d1a5b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:51.620726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-846d0d9d-fb69-4ed1-9fb9-64a0323d1a5b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.629636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-846d0d9d-fb69-4ed1-9fb9-64a0323d1a5b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.631666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-846d0d9d-fb69-4ed1-9fb9-64a0323d1a5b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.632542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-846d0d9d-fb69-4ed1-9fb9-64a0323d1a5b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.692336 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-846d0d9d-fb69-4ed1-9fb9-64a0323d1a5b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] HTTP exception thrown: Instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 could not be found. Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-846d0d9d-fb69-4ed1-9fb9-64a0323d1a5b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Request method failure captured: Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 HTTP/1.1 Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cxc4ht4d-VzdL6StuP5TF1kFsB-K_ILgDeUjIuEU5Sm2eyEVz2MKRgN_2TK08iBQ6YA-su9NomlpSDTVFkPf4RIWIJ_nlGnZfx4zABMBilRJ18Gpn_UZUxshtrIvaQyWaABuo2LvSoMaiXBgiK37uOtWAiMYMvSFL_vhGdm0ZMGy0k Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 50f8ea81533f4e1e8c98b5c46718f29f Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50f8ea81533f4e1e8c98b5c46718f29f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/50f8ea81533f4e1e8c98b5c46718f29f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_50f8ea81533f4e1e8c98b5c46718f29f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50f8ea81533f4e1e8c98b5c46718f29f"}]}] Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 50f8ea81533f4e1e8c98b5c46718f29f Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerDiskConfigTestJSON-1325339587-project Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 55bc09bf29a243dfa43fa12663cfada8 Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerDiskConfigTestJSON-1325339587-project Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 could not be found. Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5'} Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 could not be found. Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 could not be found. Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:51.695220 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.699453 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.699453 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:51.699453 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:51.699453 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:51.699453 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:51.699453 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 could not be found. Jul 14 14:49:51.699453 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.704271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-846d0d9d-fb69-4ed1-9fb9-64a0323d1a5b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Returning 404 to user: Instance 6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:51.716635 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-846d0d9d-fb69-4ed1-9fb9-64a0323d1a5b tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5" status: 404 len: 111 microversion: 2.1 time: 0.109928 Jul 14 14:49:51.720852 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2141/4316] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:51 2022] GET /compute/v2.1/servers/6f52e6fa-5361-4bc4-a2a5-3a6a366c15f5 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:51.732311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-feb88827-8f59-4dbf-9d19-4a47eadafb54 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:51.732893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-feb88827-8f59-4dbf-9d19-4a47eadafb54 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:51.753104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-feb88827-8f59-4dbf-9d19-4a47eadafb54 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.753577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-feb88827-8f59-4dbf-9d19-4a47eadafb54 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.754565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-feb88827-8f59-4dbf-9d19-4a47eadafb54 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.755032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-feb88827-8f59-4dbf-9d19-4a47eadafb54 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.820015 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-feb88827-8f59-4dbf-9d19-4a47eadafb54 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] HTTP exception thrown: Instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c could not be found. Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-feb88827-8f59-4dbf-9d19-4a47eadafb54 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Request method failure captured: Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c HTTP/1.1 Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cxc4ht4d-VzdL6StuP5TF1kFsB-K_ILgDeUjIuEU5Sm2eyEVz2MKRgN_2TK08iBQ6YA-su9NomlpSDTVFkPf4RIWIJ_nlGnZfx4zABMBilRJ18Gpn_UZUxshtrIvaQyWaABuo2LvSoMaiXBgiK37uOtWAiMYMvSFL_vhGdm0ZMGy0k Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 50f8ea81533f4e1e8c98b5c46718f29f Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50f8ea81533f4e1e8c98b5c46718f29f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/50f8ea81533f4e1e8c98b5c46718f29f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_50f8ea81533f4e1e8c98b5c46718f29f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50f8ea81533f4e1e8c98b5c46718f29f"}]}] Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 50f8ea81533f4e1e8c98b5c46718f29f Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerDiskConfigTestJSON-1325339587-project Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 55bc09bf29a243dfa43fa12663cfada8 Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerDiskConfigTestJSON-1325339587-project Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c could not be found. Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6a9f94f5-3d27-4f76-b948-c390f05bc81c'} Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c could not be found. Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:51.825287 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c could not be found. Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c could not be found. Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-feb88827-8f59-4dbf-9d19-4a47eadafb54 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Returning 404 to user: Instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:51.832092 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-feb88827-8f59-4dbf-9d19-4a47eadafb54 tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 404 len: 111 microversion: 2.1 time: 0.107396 Jul 14 14:49:51.833907 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2176/4317] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:51 2022] DELETE /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:51.841430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9b88d7da-ad1d-428d-8d03-184fe42869fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:51.842295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9b88d7da-ad1d-428d-8d03-184fe42869fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] [instance: 6a9f94f5-3d27-4f76-b948-c390f05bc81c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:51.853185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b88d7da-ad1d-428d-8d03-184fe42869fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.860548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b88d7da-ad1d-428d-8d03-184fe42869fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.862912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b88d7da-ad1d-428d-8d03-184fe42869fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.863556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b88d7da-ad1d-428d-8d03-184fe42869fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.897358 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-9b88d7da-ad1d-428d-8d03-184fe42869fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] HTTP exception thrown: Instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c could not be found. Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9b88d7da-ad1d-428d-8d03-184fe42869fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Request method failure captured: Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c HTTP/1.1 Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cxc4ht4d-VzdL6StuP5TF1kFsB-K_ILgDeUjIuEU5Sm2eyEVz2MKRgN_2TK08iBQ6YA-su9NomlpSDTVFkPf4RIWIJ_nlGnZfx4zABMBilRJ18Gpn_UZUxshtrIvaQyWaABuo2LvSoMaiXBgiK37uOtWAiMYMvSFL_vhGdm0ZMGy0k Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 50f8ea81533f4e1e8c98b5c46718f29f Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50f8ea81533f4e1e8c98b5c46718f29f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/50f8ea81533f4e1e8c98b5c46718f29f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_50f8ea81533f4e1e8c98b5c46718f29f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/50f8ea81533f4e1e8c98b5c46718f29f"}]}] Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 50f8ea81533f4e1e8c98b5c46718f29f Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1325339587 Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerDiskConfigTestJSON-1325339587-project Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 55bc09bf29a243dfa43fa12663cfada8 Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerDiskConfigTestJSON-1325339587-project Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c could not be found. Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6a9f94f5-3d27-4f76-b948-c390f05bc81c'} Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c could not be found. Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c could not be found. Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:51.901078 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.906937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:51.906937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:51.906937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:51.906937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:51.906937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:51.906937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c could not be found. Jul 14 14:49:51.906937 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:49:51.912382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9b88d7da-ad1d-428d-8d03-184fe42869fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] Returning 404 to user: Instance 6a9f94f5-3d27-4f76-b948-c390f05bc81c could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:51.913042 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9b88d7da-ad1d-428d-8d03-184fe42869fe tempest-ServerDiskConfigTestJSON-1325339587 tempest-ServerDiskConfigTestJSON-1325339587-project] 10.222.0.81 "GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c" status: 404 len: 111 microversion: 2.1 time: 0.075482 Jul 14 14:49:51.921124 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2142/4318] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:51 2022] GET /compute/v2.1/servers/6a9f94f5-3d27-4f76-b948-c390f05bc81c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:52.380300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-722f66d1-2b4d-4fd6-b59a-52336988eb90 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:52.381196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-722f66d1-2b4d-4fd6-b59a-52336988eb90 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:52.396151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-722f66d1-2b4d-4fd6-b59a-52336988eb90 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:52.396619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-722f66d1-2b4d-4fd6-b59a-52336988eb90 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:52.397448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-722f66d1-2b4d-4fd6-b59a-52336988eb90 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:52.397896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-722f66d1-2b4d-4fd6-b59a-52336988eb90 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:52.436303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f94d3a2b-0ff5-4787-a7ce-cb0a7888a33d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:52.438241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f94d3a2b-0ff5-4787-a7ce-cb0a7888a33d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:52.446766 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-722f66d1-2b4d-4fd6-b59a-52336988eb90 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] HTTP exception thrown: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:49:52.455396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f94d3a2b-0ff5-4787-a7ce-cb0a7888a33d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-722f66d1-2b4d-4fd6-b59a-52336988eb90 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Request method failure captured: Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c HTTP/1.1 Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cs8iq7sQhrhfBogz1M5nGZWojgcR4Im-YplralwHXdoEj_a94lTrYkigtTuxC8C-Hz8AC4E_lXvxPYLu8ZkjOShXC8HwwCgX2VRMlpLnM5TCtO1Un5oMYG5a9DgHfDkkPbAGi3e3IIKLQD2c_aezs7bjbaVdgi-bFUTAWnT65J7k5k Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.32 Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 2821fd7634094e7ea51fbfe49987597b Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TaggedBootDevicesTest-420665834 Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2821fd7634094e7ea51fbfe49987597b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2821fd7634094e7ea51fbfe49987597b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2821fd7634094e7ea51fbfe49987597b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2821fd7634094e7ea51fbfe49987597b"}]}] Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TaggedBootDevicesTest-420665834 Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 2821fd7634094e7ea51fbfe49987597b Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TaggedBootDevicesTest-420665834 Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TaggedBootDevicesTest-420665834-project Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: a152e24f38fd45ce87c92fb73581ec93 Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TaggedBootDevicesTest-420665834-project Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '33bf437b-873e-4466-bd62-337dc6e75b1c'} Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:52.457150 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:52.463024 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:52.463024 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:52.463024 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:52.463024 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:52.463024 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:52.463024 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:49:52.463024 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:49:52.463024 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-722f66d1-2b4d-4fd6-b59a-52336988eb90 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Returning 404 to user: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:52.463024 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-722f66d1-2b4d-4fd6-b59a-52336988eb90 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 404 len: 111 microversion: 2.32 time: 0.083888 Jul 14 14:49:52.468975 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2177/4319] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:52 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:49:52.470078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f94d3a2b-0ff5-4787-a7ce-cb0a7888a33d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:52.471132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f94d3a2b-0ff5-4787-a7ce-cb0a7888a33d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:52.471745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f94d3a2b-0ff5-4787-a7ce-cb0a7888a33d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:52.478529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e280146-ac22-4e03-b592-36ffb761980b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '.version_select at 0x7fd6c5b5caf0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:52.536336 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0e280146-ac22-4e03-b592-36ffb761980b tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-183356282" status: 204 len: 0 microversion: 2.32 time: 0.062551 Jul 14 14:49:52.536987 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2178/4320] 10.222.0.81 () {60 vars in 1258 bytes} [Thu Jul 14 14:49:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-183356282 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:49:52.839541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f94d3a2b-0ff5-4787-a7ce-cb0a7888a33d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:52.851907 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f94d3a2b-0ff5-4787-a7ce-cb0a7888a33d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1323 microversion: 2.1 time: 0.420241 Jul 14 14:49:52.869635 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2143/4321] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:52 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:52.948365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2041331202", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19a7ef92-3b71-4a1b-b101-91e7276e71cb"}], "security_groups": [{"name": "tempest-securitygroup--612622729"}], "key_name": "tempest-keypair-1441659292", "user_data": "}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:53.337087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] validate_networks() for [('19a7ef92-3b71-4a1b-b101-91e7276e71cb', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:49:53.883887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c6cfba9c-7413-4bd2-9612-66277184a3e5 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:53.886458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c6cfba9c-7413-4bd2-9612-66277184a3e5 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:53.939999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6cfba9c-7413-4bd2-9612-66277184a3e5 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:53.941561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6cfba9c-7413-4bd2-9612-66277184a3e5 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:53.981516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6cfba9c-7413-4bd2-9612-66277184a3e5 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:53.982053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6cfba9c-7413-4bd2-9612-66277184a3e5 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:54.562880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c6cfba9c-7413-4bd2-9612-66277184a3e5 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:54.597292 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c6cfba9c-7413-4bd2-9612-66277184a3e5 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1323 microversion: 2.1 time: 0.717853 Jul 14 14:49:54.598855 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2144/4322] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:53 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1323 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:54.974860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:49:54.982281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:49:54.983063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:49:54.983652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:49:54.984076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:49:55.022775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:55.023631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:55.025165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:55.026141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:55.085867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:49:55.116825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for user 9260cbc32f1e423ab8ea4d06058b4050 and project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:49:55.176034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:49:55.185933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:49:55.373478 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e16af445-bf8b-4c39-8b16-8dbf57e0b22c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.429643 Jul 14 14:49:55.374590 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2179/4323] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:49:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 2432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:49:55.386470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ecabeb1f-773d-4a8c-86d2-68a63af481e8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:55.387443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ecabeb1f-773d-4a8c-86d2-68a63af481e8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:55.621062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f35b8b3a-6b15-4943-8d84-0385c3123812 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:55.621686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f35b8b3a-6b15-4943-8d84-0385c3123812 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:55.631373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f35b8b3a-6b15-4943-8d84-0385c3123812 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:55.631828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f35b8b3a-6b15-4943-8d84-0385c3123812 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:55.633415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f35b8b3a-6b15-4943-8d84-0385c3123812 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:55.634261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f35b8b3a-6b15-4943-8d84-0385c3123812 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:56.165238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ecabeb1f-773d-4a8c-86d2-68a63af481e8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:56.206706 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ecabeb1f-773d-4a8c-86d2-68a63af481e8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1242 microversion: 2.1 time: 0.825871 Jul 14 14:49:56.219976 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2145/4324] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:55 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1242 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:56.558065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f35b8b3a-6b15-4943-8d84-0385c3123812 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:56.586805 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f35b8b3a-6b15-4943-8d84-0385c3123812 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1323 microversion: 2.1 time: 0.966208 Jul 14 14:49:56.590588 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2180/4325] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:55 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1323 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:57.067935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6ad32a4e-5e60-4edb-ae10-e6d045950c5e req-72834f90-cea4-4824-a9a3-7a2b7b103b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c804f5-bc58-41f2-97a5-c19ce7cb7538", "name": "network-vif-plugged", "status": "completed", "tag": "4dff7900-44ff-4bb2-97ea-1e108de17c71"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:57.116122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6ad32a4e-5e60-4edb-ae10-e6d045950c5e req-72834f90-cea4-4824-a9a3-7a2b7b103b02 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:57.116583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6ad32a4e-5e60-4edb-ae10-e6d045950c5e req-72834f90-cea4-4824-a9a3-7a2b7b103b02 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:57.163543 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6ad32a4e-5e60-4edb-ae10-e6d045950c5e req-72834f90-cea4-4824-a9a3-7a2b7b103b02 service nova] Creating event network-vif-plugged:4dff7900-44ff-4bb2-97ea-1e108de17c71 for instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 on n-h1-767704-28 Jul 14 14:49:57.202435 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6ad32a4e-5e60-4edb-ae10-e6d045950c5e req-72834f90-cea4-4824-a9a3-7a2b7b103b02 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138209 Jul 14 14:49:57.205858 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2146/4326] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:57.228115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fc48cd4b-5635-4c36-a57f-b47c21ff96a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:57.229158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fc48cd4b-5635-4c36-a57f-b47c21ff96a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:57.258869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc48cd4b-5635-4c36-a57f-b47c21ff96a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:57.262035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc48cd4b-5635-4c36-a57f-b47c21ff96a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:57.263521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc48cd4b-5635-4c36-a57f-b47c21ff96a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:57.264659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc48cd4b-5635-4c36-a57f-b47c21ff96a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:57.495433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fc48cd4b-5635-4c36-a57f-b47c21ff96a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:57.516657 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fc48cd4b-5635-4c36-a57f-b47c21ff96a8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1238 microversion: 2.1 time: 0.293040 Jul 14 14:49:57.525451 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2181/4327] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:57 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1238 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:57.631104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d143c89d-588e-4ac3-8fb6-f3ac67ffaf88 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:57.635810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d143c89d-588e-4ac3-8fb6-f3ac67ffaf88 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:57.660622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d143c89d-588e-4ac3-8fb6-f3ac67ffaf88 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:57.661541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d143c89d-588e-4ac3-8fb6-f3ac67ffaf88 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:57.674767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d143c89d-588e-4ac3-8fb6-f3ac67ffaf88 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:57.677329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d143c89d-588e-4ac3-8fb6-f3ac67ffaf88 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:58.264810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d143c89d-588e-4ac3-8fb6-f3ac67ffaf88 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:58.315928 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d143c89d-588e-4ac3-8fb6-f3ac67ffaf88 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1323 microversion: 2.1 time: 0.701865 Jul 14 14:49:58.319555 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2147/4328] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:57 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1323 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:58.558735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-da505840-1484-4d79-89a2-6ce36809551d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:58.560263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-da505840-1484-4d79-89a2-6ce36809551d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:58.584539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da505840-1484-4d79-89a2-6ce36809551d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:58.585793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da505840-1484-4d79-89a2-6ce36809551d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:58.598375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da505840-1484-4d79-89a2-6ce36809551d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:58.603541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da505840-1484-4d79-89a2-6ce36809551d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:58.659636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:58.818256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-da505840-1484-4d79-89a2-6ce36809551d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:58.848518 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-da505840-1484-4d79-89a2-6ce36809551d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1300 microversion: 2.1 time: 0.294453 Jul 14 14:49:58.849897 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2182/4329] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:58 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1300 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:59.336156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-847bede4-c006-43fe-a6f6-94f9c7c6e6dd tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:59.336790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-847bede4-c006-43fe-a6f6-94f9c7c6e6dd tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:59.352411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-847bede4-c006-43fe-a6f6-94f9c7c6e6dd tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:59.352867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-847bede4-c006-43fe-a6f6-94f9c7c6e6dd tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:59.353901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-847bede4-c006-43fe-a6f6-94f9c7c6e6dd tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:59.354353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-847bede4-c006-43fe-a6f6-94f9c7c6e6dd tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:59.698109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-847bede4-c006-43fe-a6f6-94f9c7c6e6dd tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:59.725565 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-847bede4-c006-43fe-a6f6-94f9c7c6e6dd tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1323 microversion: 2.1 time: 0.393328 Jul 14 14:49:59.741302 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2148/4330] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:59 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1323 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:59.870441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18f6b68f-efaa-4608-98cd-c72ce8dee134 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:59.871059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-18f6b68f-efaa-4608-98cd-c72ce8dee134 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:59.891439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18f6b68f-efaa-4608-98cd-c72ce8dee134 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:59.891898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18f6b68f-efaa-4608-98cd-c72ce8dee134 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:59.892702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18f6b68f-efaa-4608-98cd-c72ce8dee134 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:59.893184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18f6b68f-efaa-4608-98cd-c72ce8dee134 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:00.067676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18f6b68f-efaa-4608-98cd-c72ce8dee134 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:00.076813 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-18f6b68f-efaa-4608-98cd-c72ce8dee134 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1300 microversion: 2.1 time: 0.209462 Jul 14 14:50:00.105036 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2183/4331] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:59 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1300 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:00.755771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5c022ac7-0ef5-40e0-b01f-d19aec810976 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:00.756650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5c022ac7-0ef5-40e0-b01f-d19aec810976 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:00.830908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c022ac7-0ef5-40e0-b01f-d19aec810976 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:00.831471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c022ac7-0ef5-40e0-b01f-d19aec810976 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:00.832409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c022ac7-0ef5-40e0-b01f-d19aec810976 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:00.837062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c022ac7-0ef5-40e0-b01f-d19aec810976 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:01.096526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1a48dffa-595c-4b7b-92a5-431c909e60a2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:01.097881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1a48dffa-595c-4b7b-92a5-431c909e60a2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:01.133130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a48dffa-595c-4b7b-92a5-431c909e60a2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:01.133648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a48dffa-595c-4b7b-92a5-431c909e60a2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:01.150302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a48dffa-595c-4b7b-92a5-431c909e60a2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:01.163966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a48dffa-595c-4b7b-92a5-431c909e60a2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:02.183376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a48dffa-595c-4b7b-92a5-431c909e60a2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:02.196912 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1a48dffa-595c-4b7b-92a5-431c909e60a2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1367 microversion: 2.1 time: 1.106892 Jul 14 14:50:02.198020 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2184/4332] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:01 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1367 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:02.210930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5c022ac7-0ef5-40e0-b01f-d19aec810976 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:02.228083 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5c022ac7-0ef5-40e0-b01f-d19aec810976 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1518 microversion: 2.1 time: 1.485007 Jul 14 14:50:02.240070 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2149/4333] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:00 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1518 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:02.253118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b46c6d5-6cef-4814-9ff6-13c8b7f7109d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:02.255094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5b46c6d5-6cef-4814-9ff6-13c8b7f7109d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:02.273788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b46c6d5-6cef-4814-9ff6-13c8b7f7109d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:02.274324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b46c6d5-6cef-4814-9ff6-13c8b7f7109d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:02.275204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b46c6d5-6cef-4814-9ff6-13c8b7f7109d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:02.275713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b46c6d5-6cef-4814-9ff6-13c8b7f7109d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:02.335908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-5b46c6d5-6cef-4814-9ff6-13c8b7f7109d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lazy-loading 'flavor' on Instance uuid 18c804f5-bc58-41f2-97a5-c19ce7cb7538 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:50:02.602501 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b46c6d5-6cef-4814-9ff6-13c8b7f7109d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "POST /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538/action" status: 200 len: 32 microversion: 2.1 time: 0.360878 Jul 14 14:50:02.607516 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2185/4334] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:50:02 2022] POST /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538/action => generated 32 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 14:50:02.622398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d876a249-81a1-4925-bce1-77d3962becb3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:02.627169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d876a249-81a1-4925-bce1-77d3962becb3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:02.661345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d876a249-81a1-4925-bce1-77d3962becb3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:02.661908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d876a249-81a1-4925-bce1-77d3962becb3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:02.675383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d876a249-81a1-4925-bce1-77d3962becb3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:02.675383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d876a249-81a1-4925-bce1-77d3962becb3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:03.218156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b5429788-ce02-472c-ba1b-5f8efde59d1e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:03.219466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b5429788-ce02-472c-ba1b-5f8efde59d1e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:03.231216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5429788-ce02-472c-ba1b-5f8efde59d1e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:03.231678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5429788-ce02-472c-ba1b-5f8efde59d1e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:03.233053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5429788-ce02-472c-ba1b-5f8efde59d1e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:03.233624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5429788-ce02-472c-ba1b-5f8efde59d1e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:04.757289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d876a249-81a1-4925-bce1-77d3962becb3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:04.762669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b5429788-ce02-472c-ba1b-5f8efde59d1e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:04.787825 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b5429788-ce02-472c-ba1b-5f8efde59d1e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1367 microversion: 2.1 time: 1.576479 Jul 14 14:50:04.790128 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d876a249-81a1-4925-bce1-77d3962becb3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 2.176728 Jul 14 14:50:04.791307 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2186/4335] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:03 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1367 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:04.795758 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2150/4336] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:02 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:04.798622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c2f7ab72-a14d-4cda-b0a6-2eb3080c2ccf req-0ceada2d-eb99-43e2-999c-a6546f0e972c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b770b7b-68e4-45a2-b7c0-8a6361470c46", "tag": "fa1b883e-e59f-4f69-92c5-19b2c1e020e8"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:04.811051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c2f7ab72-a14d-4cda-b0a6-2eb3080c2ccf req-0ceada2d-eb99-43e2-999c-a6546f0e972c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:04.812380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c2f7ab72-a14d-4cda-b0a6-2eb3080c2ccf req-0ceada2d-eb99-43e2-999c-a6546f0e972c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:04.845253 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c2f7ab72-a14d-4cda-b0a6-2eb3080c2ccf req-0ceada2d-eb99-43e2-999c-a6546f0e972c service nova] Creating event network-changed:fa1b883e-e59f-4f69-92c5-19b2c1e020e8 for instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 on n-h2-767704-28 Jul 14 14:50:04.854107 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c2f7ab72-a14d-4cda-b0a6-2eb3080c2ccf req-0ceada2d-eb99-43e2-999c-a6546f0e972c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061179 Jul 14 14:50:04.858201 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2187/4337] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:05.807803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a976f308-4fe3-4b4d-b945-7b710775a295 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:05.809330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a976f308-4fe3-4b4d-b945-7b710775a295 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:05.818702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:05.820760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:05.828716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a976f308-4fe3-4b4d-b945-7b710775a295 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:05.829433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a976f308-4fe3-4b4d-b945-7b710775a295 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:05.830415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a976f308-4fe3-4b4d-b945-7b710775a295 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:05.832205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a976f308-4fe3-4b4d-b945-7b710775a295 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:05.834940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ae84222c-397a-4b7c-84cb-e2addbbfa39e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:05.836244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ae84222c-397a-4b7c-84cb-e2addbbfa39e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:05.843132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:05.855122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae84222c-397a-4b7c-84cb-e2addbbfa39e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:05.858097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae84222c-397a-4b7c-84cb-e2addbbfa39e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:05.860478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae84222c-397a-4b7c-84cb-e2addbbfa39e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:05.861616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae84222c-397a-4b7c-84cb-e2addbbfa39e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:06.205969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:06.345418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ae84222c-397a-4b7c-84cb-e2addbbfa39e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:06.357430 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ae84222c-397a-4b7c-84cb-e2addbbfa39e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1367 microversion: 2.1 time: 0.537148 Jul 14 14:50:06.364302 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2188/4338] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:05 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1367 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:06.606246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a976f308-4fe3-4b4d-b945-7b710775a295 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:06.616873 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a976f308-4fe3-4b4d-b945-7b710775a295 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 0.813080 Jul 14 14:50:06.639779 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2151/4339] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:05 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:07.383828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9df48756-8312-4eb5-8968-726e42be9a41 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:07.386405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9df48756-8312-4eb5-8968-726e42be9a41 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:07.412720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9df48756-8312-4eb5-8968-726e42be9a41 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:07.413433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9df48756-8312-4eb5-8968-726e42be9a41 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:07.414421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9df48756-8312-4eb5-8968-726e42be9a41 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:07.415423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9df48756-8312-4eb5-8968-726e42be9a41 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:07.646689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-efa7c460-ac02-4fe2-9e54-e1b9c879f3a6 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:07.647328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-efa7c460-ac02-4fe2-9e54-e1b9c879f3a6 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:07.663422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efa7c460-ac02-4fe2-9e54-e1b9c879f3a6 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:07.663893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efa7c460-ac02-4fe2-9e54-e1b9c879f3a6 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:07.667511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efa7c460-ac02-4fe2-9e54-e1b9c879f3a6 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:07.667979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efa7c460-ac02-4fe2-9e54-e1b9c879f3a6 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:07.757419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9df48756-8312-4eb5-8968-726e42be9a41 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:07.786013 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9df48756-8312-4eb5-8968-726e42be9a41 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1367 microversion: 2.1 time: 0.406053 Jul 14 14:50:07.800371 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2189/4340] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:07 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1367 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:07.815227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-df27f500-0e25-4c93-b2c0-55e55b04dfdf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:07.815868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-df27f500-0e25-4c93-b2c0-55e55b04dfdf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:07.839485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df27f500-0e25-4c93-b2c0-55e55b04dfdf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:07.839949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df27f500-0e25-4c93-b2c0-55e55b04dfdf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:07.840876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df27f500-0e25-4c93-b2c0-55e55b04dfdf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:07.841199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df27f500-0e25-4c93-b2c0-55e55b04dfdf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:07.882015 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-df27f500-0e25-4c93-b2c0-55e55b04dfdf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] HTTP exception thrown: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-df27f500-0e25-4c93-b2c0-55e55b04dfdf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Request method failure captured: Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c HTTP/1.1 Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cs8iq7sQhrhfBogz1M5nGZWojgcR4Im-YplralwHXdoEj_a94lTrYkigtTuxC8C-Hz8AC4E_lXvxPYLu8ZkjOShXC8HwwCgX2VRMlpLnM5TCtO1Un5oMYG5a9DgHfDkkPbAGi3e3IIKLQD2c_aezs7bjbaVdgi-bFUTAWnT65J7k5k Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.32 Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 2821fd7634094e7ea51fbfe49987597b Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TaggedBootDevicesTest-420665834 Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2821fd7634094e7ea51fbfe49987597b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2821fd7634094e7ea51fbfe49987597b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2821fd7634094e7ea51fbfe49987597b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2821fd7634094e7ea51fbfe49987597b"}]}] Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TaggedBootDevicesTest-420665834 Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 2821fd7634094e7ea51fbfe49987597b Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TaggedBootDevicesTest-420665834 Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TaggedBootDevicesTest-420665834-project Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: a152e24f38fd45ce87c92fb73581ec93 Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TaggedBootDevicesTest-420665834-project Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '33bf437b-873e-4466-bd62-337dc6e75b1c'} Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:07.890745 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:07.896045 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:50:07.896045 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:07.896045 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:07.896045 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:07.896045 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:07.896045 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:07.896045 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:07.896045 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:07.896045 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:07.896045 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:50:07.896045 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:07.900355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-df27f500-0e25-4c93-b2c0-55e55b04dfdf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Returning 404 to user: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:07.901818 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-df27f500-0e25-4c93-b2c0-55e55b04dfdf tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "DELETE /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 404 len: 111 microversion: 2.32 time: 0.100345 Jul 14 14:50:07.906207 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2190/4341] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:50:07 2022] DELETE /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:50:07.920012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e87411b-ea32-482b-bda5-7ed6af26d867 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:07.921896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0e87411b-ea32-482b-bda5-7ed6af26d867 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] [instance: 33bf437b-873e-4466-bd62-337dc6e75b1c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:07.935813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e87411b-ea32-482b-bda5-7ed6af26d867 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:07.940447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e87411b-ea32-482b-bda5-7ed6af26d867 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:07.941533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e87411b-ea32-482b-bda5-7ed6af26d867 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:07.942150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e87411b-ea32-482b-bda5-7ed6af26d867 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:07.958521 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-0e87411b-ea32-482b-bda5-7ed6af26d867 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] HTTP exception thrown: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e87411b-ea32-482b-bda5-7ed6af26d867 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Request method failure captured: Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c HTTP/1.1 Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cs8iq7sQhrhfBogz1M5nGZWojgcR4Im-YplralwHXdoEj_a94lTrYkigtTuxC8C-Hz8AC4E_lXvxPYLu8ZkjOShXC8HwwCgX2VRMlpLnM5TCtO1Un5oMYG5a9DgHfDkkPbAGi3e3IIKLQD2c_aezs7bjbaVdgi-bFUTAWnT65J7k5k Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.32 Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 2821fd7634094e7ea51fbfe49987597b Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TaggedBootDevicesTest-420665834 Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2821fd7634094e7ea51fbfe49987597b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2821fd7634094e7ea51fbfe49987597b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2821fd7634094e7ea51fbfe49987597b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2821fd7634094e7ea51fbfe49987597b"}]}] Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TaggedBootDevicesTest-420665834 Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 2821fd7634094e7ea51fbfe49987597b Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TaggedBootDevicesTest-420665834 Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TaggedBootDevicesTest-420665834-project Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: a152e24f38fd45ce87c92fb73581ec93 Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TaggedBootDevicesTest-420665834-project Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '33bf437b-873e-4466-bd62-337dc6e75b1c'} Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:07.961647 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:07.965883 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:07.965883 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:07.965883 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:07.965883 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:07.965883 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:07.965883 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. Jul 14 14:50:07.965883 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:07.969381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e87411b-ea32-482b-bda5-7ed6af26d867 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] Returning 404 to user: Instance 33bf437b-873e-4466-bd62-337dc6e75b1c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:07.970732 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0e87411b-ea32-482b-bda5-7ed6af26d867 tempest-TaggedBootDevicesTest-420665834 tempest-TaggedBootDevicesTest-420665834-project] 10.222.0.81 "GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c" status: 404 len: 111 microversion: 2.32 time: 0.062939 Jul 14 14:50:07.971485 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2191/4342] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:50:07 2022] GET /compute/v2.1/servers/33bf437b-873e-4466-bd62-337dc6e75b1c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:50:08.239754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-efa7c460-ac02-4fe2-9e54-e1b9c879f3a6 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:08.251942 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-efa7c460-ac02-4fe2-9e54-e1b9c879f3a6 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 0.609828 Jul 14 14:50:08.265183 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2152/4343] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:07 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:08.805465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7df8b7a4-e6c0-4614-80ca-bc24b1b8f611 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:08.807249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7df8b7a4-e6c0-4614-80ca-bc24b1b8f611 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:08.823335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7df8b7a4-e6c0-4614-80ca-bc24b1b8f611 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:08.828310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7df8b7a4-e6c0-4614-80ca-bc24b1b8f611 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:08.829531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7df8b7a4-e6c0-4614-80ca-bc24b1b8f611 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:08.830426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7df8b7a4-e6c0-4614-80ca-bc24b1b8f611 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:09.068552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7df8b7a4-e6c0-4614-80ca-bc24b1b8f611 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:09.082615 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7df8b7a4-e6c0-4614-80ca-bc24b1b8f611 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1367 microversion: 2.1 time: 0.279518 Jul 14 14:50:09.084498 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2192/4344] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:08 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:09.270874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a38e027a-134a-46c6-b3de-ac907ab7677d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:09.271861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a38e027a-134a-46c6-b3de-ac907ab7677d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:09.286470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a38e027a-134a-46c6-b3de-ac907ab7677d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:09.296929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a38e027a-134a-46c6-b3de-ac907ab7677d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:09.299331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a38e027a-134a-46c6-b3de-ac907ab7677d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:09.301349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a38e027a-134a-46c6-b3de-ac907ab7677d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:09.602496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a38e027a-134a-46c6-b3de-ac907ab7677d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:09.615381 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a38e027a-134a-46c6-b3de-ac907ab7677d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 0.346220 Jul 14 14:50:09.618145 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2153/4345] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:09 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:10.101730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b37f4684-e30f-4507-8384-9dd04d8ff1f5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:10.103580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b37f4684-e30f-4507-8384-9dd04d8ff1f5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:10.123903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b37f4684-e30f-4507-8384-9dd04d8ff1f5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:10.124233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b37f4684-e30f-4507-8384-9dd04d8ff1f5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:10.125109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b37f4684-e30f-4507-8384-9dd04d8ff1f5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:10.131170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b37f4684-e30f-4507-8384-9dd04d8ff1f5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:10.580470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b37f4684-e30f-4507-8384-9dd04d8ff1f5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:10.598722 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b37f4684-e30f-4507-8384-9dd04d8ff1f5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1367 microversion: 2.1 time: 0.501283 Jul 14 14:50:10.599578 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2193/4346] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:10 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1367 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:10.636593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-66aca03b-34c8-4a8f-92a0-c85fed073702 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:10.637309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-66aca03b-34c8-4a8f-92a0-c85fed073702 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:10.660577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66aca03b-34c8-4a8f-92a0-c85fed073702 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:10.661105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66aca03b-34c8-4a8f-92a0-c85fed073702 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:10.661903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66aca03b-34c8-4a8f-92a0-c85fed073702 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:10.681067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66aca03b-34c8-4a8f-92a0-c85fed073702 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:11.203516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-66aca03b-34c8-4a8f-92a0-c85fed073702 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:11.215427 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-66aca03b-34c8-4a8f-92a0-c85fed073702 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 0.580785 Jul 14 14:50:11.216272 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2154/4347] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:10 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:11.615989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a8c467a3-4ac0-4bd6-ba63-4321e09eade9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:11.616821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a8c467a3-4ac0-4bd6-ba63-4321e09eade9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:11.620384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:11.646524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8c467a3-4ac0-4bd6-ba63-4321e09eade9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:11.651489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8c467a3-4ac0-4bd6-ba63-4321e09eade9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:11.652682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8c467a3-4ac0-4bd6-ba63-4321e09eade9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:11.663477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8c467a3-4ac0-4bd6-ba63-4321e09eade9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:11.714236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-586598544", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": "none"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:11.839128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:50:11.839559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:50:11.840261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:50:11.840843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:50:11.841494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:50:11.891415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:11.901282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:11.902412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:11.902878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:11.969562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a8c467a3-4ac0-4bd6-ba63-4321e09eade9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:11.977651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Getting quotas for project c14c1f617c834545a7fc8afd5723d932. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:50:11.989450 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a8c467a3-4ac0-4bd6-ba63-4321e09eade9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1367 microversion: 2.1 time: 0.375916 Jul 14 14:50:11.992403 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2155/4348] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:11 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:12.004104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Getting quotas for user 436e50f24dc04a16a6b37d6400d38624 and project c14c1f617c834545a7fc8afd5723d932. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:50:12.048023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:50:12.050408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:50:12.175372 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-231b6c51-a326-4dd4-93ca-55a8ec5574ac tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.718491 Jul 14 14:50:12.179282 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2194/4349] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:50:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:50:12.190606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-949adf52-ae68-4c3b-83ff-574a1f7d8ae0 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:12.191310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-949adf52-ae68-4c3b-83ff-574a1f7d8ae0 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:12.234075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-531c8ef0-2385-450a-a614-d50282f36500 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:12.235985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-531c8ef0-2385-450a-a614-d50282f36500 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:12.260480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-531c8ef0-2385-450a-a614-d50282f36500 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:12.261589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-531c8ef0-2385-450a-a614-d50282f36500 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:12.262753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-531c8ef0-2385-450a-a614-d50282f36500 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:12.263488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-531c8ef0-2385-450a-a614-d50282f36500 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:12.309282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-949adf52-ae68-4c3b-83ff-574a1f7d8ae0 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:12.327755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-949adf52-ae68-4c3b-83ff-574a1f7d8ae0 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:12.335022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-949adf52-ae68-4c3b-83ff-574a1f7d8ae0 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:12.336640 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-949adf52-ae68-4c3b-83ff-574a1f7d8ae0 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] 10.222.0.81 "GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199" status: 200 len: 1280 microversion: 2.47 time: 0.151608 Jul 14 14:50:12.339873 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2156/4350] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:50:12 2022] GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199 => generated 1280 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:50:12.526570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-531c8ef0-2385-450a-a614-d50282f36500 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:12.538907 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-531c8ef0-2385-450a-a614-d50282f36500 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 0.308055 Jul 14 14:50:12.542538 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2195/4351] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:12 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:13.012017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d2d5698d-73dd-4bc6-b9d8-4c80a42c341c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:13.014091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d2d5698d-73dd-4bc6-b9d8-4c80a42c341c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:13.029115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-28cf6f92-0ffb-447d-a1a1-76815dab6bbd req-59ac64d4-5716-4312-b511-6baffff5be7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b770b7b-68e4-45a2-b7c0-8a6361470c46", "name": "network-vif-plugged", "status": "completed", "tag": "fa1b883e-e59f-4f69-92c5-19b2c1e020e8"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:13.044977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2d5698d-73dd-4bc6-b9d8-4c80a42c341c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:13.045833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2d5698d-73dd-4bc6-b9d8-4c80a42c341c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:13.046667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2d5698d-73dd-4bc6-b9d8-4c80a42c341c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:13.047143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2d5698d-73dd-4bc6-b9d8-4c80a42c341c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:13.058155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-28cf6f92-0ffb-447d-a1a1-76815dab6bbd req-59ac64d4-5716-4312-b511-6baffff5be7c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:13.058620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-28cf6f92-0ffb-447d-a1a1-76815dab6bbd req-59ac64d4-5716-4312-b511-6baffff5be7c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:13.132046 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-28cf6f92-0ffb-447d-a1a1-76815dab6bbd req-59ac64d4-5716-4312-b511-6baffff5be7c service nova] Creating event network-vif-plugged:fa1b883e-e59f-4f69-92c5-19b2c1e020e8 for instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 on n-h2-767704-28 Jul 14 14:50:13.146660 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-28cf6f92-0ffb-447d-a1a1-76815dab6bbd req-59ac64d4-5716-4312-b511-6baffff5be7c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119459 Jul 14 14:50:13.152050 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2196/4352] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:50:13.361531 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:50:13.362131 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 14:50:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 (ip 10.222.0.81) !!! Jul 14 14:50:13.370759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ce057ead-2403-473f-a439-a43cfb112e34 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:13.371494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ce057ead-2403-473f-a439-a43cfb112e34 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:13.398638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce057ead-2403-473f-a439-a43cfb112e34 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:13.405941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce057ead-2403-473f-a439-a43cfb112e34 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:13.407182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce057ead-2403-473f-a439-a43cfb112e34 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:13.413767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce057ead-2403-473f-a439-a43cfb112e34 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:13.733389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ce057ead-2403-473f-a439-a43cfb112e34 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:13.747293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ce057ead-2403-473f-a439-a43cfb112e34 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:13.823703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ce057ead-2403-473f-a439-a43cfb112e34 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:13.836205 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ce057ead-2403-473f-a439-a43cfb112e34 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] 10.222.0.81 "GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199" status: 200 len: 1284 microversion: 2.47 time: 0.472742 Jul 14 14:50:13.845164 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2197/4353] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:50:13 2022] GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199 => generated 1284 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:50:13.884502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ef9ff34a-1e6c-4dbd-806d-761ad96afbe2 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:13.891782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ef9ff34a-1e6c-4dbd-806d-761ad96afbe2 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:13.928869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef9ff34a-1e6c-4dbd-806d-761ad96afbe2 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:13.941629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef9ff34a-1e6c-4dbd-806d-761ad96afbe2 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:13.947226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef9ff34a-1e6c-4dbd-806d-761ad96afbe2 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:13.949668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef9ff34a-1e6c-4dbd-806d-761ad96afbe2 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:14.702836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d2d5698d-73dd-4bc6-b9d8-4c80a42c341c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:14.718548 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d2d5698d-73dd-4bc6-b9d8-4c80a42c341c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1367 microversion: 2.1 time: 1.713201 Jul 14 14:50:14.724475 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2157/4354] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:13 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1367 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:14.784692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ef9ff34a-1e6c-4dbd-806d-761ad96afbe2 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:14.798862 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ef9ff34a-1e6c-4dbd-806d-761ad96afbe2 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 0.945870 Jul 14 14:50:14.802035 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2198/4355] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:13 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:14.867140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8626c530-7a3b-4f62-b6bc-3a192cac347f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:14.867628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8626c530-7a3b-4f62-b6bc-3a192cac347f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:14.879333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8626c530-7a3b-4f62-b6bc-3a192cac347f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:14.879703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8626c530-7a3b-4f62-b6bc-3a192cac347f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:14.880631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8626c530-7a3b-4f62-b6bc-3a192cac347f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:14.882801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8626c530-7a3b-4f62-b6bc-3a192cac347f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:15.744697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d202b577-ab14-4c74-a70c-95b09b7c8ff0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:15.745402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d202b577-ab14-4c74-a70c-95b09b7c8ff0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:15.767336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d202b577-ab14-4c74-a70c-95b09b7c8ff0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:15.768404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d202b577-ab14-4c74-a70c-95b09b7c8ff0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:15.806042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d202b577-ab14-4c74-a70c-95b09b7c8ff0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:15.807164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d202b577-ab14-4c74-a70c-95b09b7c8ff0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:16.009990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8626c530-7a3b-4f62-b6bc-3a192cac347f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:16.021446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:16.032121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8626c530-7a3b-4f62-b6bc-3a192cac347f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:16.043021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8626c530-7a3b-4f62-b6bc-3a192cac347f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:16.047599 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8626c530-7a3b-4f62-b6bc-3a192cac347f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] 10.222.0.81 "GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199" status: 200 len: 1276 microversion: 2.47 time: 1.183353 Jul 14 14:50:16.050275 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2158/4356] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:50:14 2022] GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199 => generated 1276 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:50:16.085041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-81d082c9-9840-4c7c-b56a-6c664debb178 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:16.090056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-81d082c9-9840-4c7c-b56a-6c664debb178 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:16.128971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81d082c9-9840-4c7c-b56a-6c664debb178 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:16.129337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81d082c9-9840-4c7c-b56a-6c664debb178 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:16.133504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81d082c9-9840-4c7c-b56a-6c664debb178 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:16.134136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81d082c9-9840-4c7c-b56a-6c664debb178 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:16.778960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-81d082c9-9840-4c7c-b56a-6c664debb178 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:16.796903 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-81d082c9-9840-4c7c-b56a-6c664debb178 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 0.729755 Jul 14 14:50:16.798359 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2159/4357] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:16 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:17.015854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d202b577-ab14-4c74-a70c-95b09b7c8ff0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:17.032455 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d202b577-ab14-4c74-a70c-95b09b7c8ff0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1558 microversion: 2.1 time: 1.292155 Jul 14 14:50:17.033518 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2199/4358] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:15 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1558 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:17.050113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d65b1ae0-63c2-48ab-8c16-b24db93e6ee2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:17.051267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d65b1ae0-63c2-48ab-8c16-b24db93e6ee2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:17.066069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d65b1ae0-63c2-48ab-8c16-b24db93e6ee2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.073285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2681f926-b7da-4daf-a8be-0f03192667bd tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:17.073529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d65b1ae0-63c2-48ab-8c16-b24db93e6ee2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.073912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2681f926-b7da-4daf-a8be-0f03192667bd tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:17.074224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d65b1ae0-63c2-48ab-8c16-b24db93e6ee2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.079231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d65b1ae0-63c2-48ab-8c16-b24db93e6ee2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.087981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2681f926-b7da-4daf-a8be-0f03192667bd tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.088443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2681f926-b7da-4daf-a8be-0f03192667bd tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.089269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2681f926-b7da-4daf-a8be-0f03192667bd tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.089716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2681f926-b7da-4daf-a8be-0f03192667bd tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.181110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:17.323340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2681f926-b7da-4daf-a8be-0f03192667bd tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:17.337457 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d65b1ae0-63c2-48ab-8c16-b24db93e6ee2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.291756 Jul 14 14:50:17.337759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2681f926-b7da-4daf-a8be-0f03192667bd tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:17.338071 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2160/4359] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:50:17 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46/os-interface => generated 285 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:17.343430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2681f926-b7da-4daf-a8be-0f03192667bd tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:17.348429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2681f926-b7da-4daf-a8be-0f03192667bd tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] 10.222.0.81 "GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199" status: 200 len: 1338 microversion: 2.47 time: 0.278287 Jul 14 14:50:17.350935 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2200/4360] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:50:17 2022] GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199 => generated 1338 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:50:17.815299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cac2473b-a45c-411b-b476-ffe3a5b467ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:17.822872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cac2473b-a45c-411b-b476-ffe3a5b467ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:17.842634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cac2473b-a45c-411b-b476-ffe3a5b467ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.845790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cac2473b-a45c-411b-b476-ffe3a5b467ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.855956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cac2473b-a45c-411b-b476-ffe3a5b467ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.857639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cac2473b-a45c-411b-b476-ffe3a5b467ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:18.375514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d82039b0-9bbe-40a6-b26d-bf65ee1b063f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:18.376159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d82039b0-9bbe-40a6-b26d-bf65ee1b063f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:18.389539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d82039b0-9bbe-40a6-b26d-bf65ee1b063f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:18.390195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d82039b0-9bbe-40a6-b26d-bf65ee1b063f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:18.391890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d82039b0-9bbe-40a6-b26d-bf65ee1b063f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:18.407963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d82039b0-9bbe-40a6-b26d-bf65ee1b063f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:18.596043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d82039b0-9bbe-40a6-b26d-bf65ee1b063f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:18.611830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d82039b0-9bbe-40a6-b26d-bf65ee1b063f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:18.621206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d82039b0-9bbe-40a6-b26d-bf65ee1b063f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:18.627545 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d82039b0-9bbe-40a6-b26d-bf65ee1b063f tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] 10.222.0.81 "GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199" status: 200 len: 1359 microversion: 2.47 time: 0.259466 Jul 14 14:50:18.629318 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2201/4361] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:50:18 2022] GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199 => generated 1359 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:50:18.644369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cac2473b-a45c-411b-b476-ffe3a5b467ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:18.649502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-49f56dc4-9303-4eb8-9a5b-49dd96b21b5c tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-883787032"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:18.651420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-49f56dc4-9303-4eb8-9a5b-49dd96b21b5c tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:18.665770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49f56dc4-9303-4eb8-9a5b-49dd96b21b5c tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:18.667570 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cac2473b-a45c-411b-b476-ffe3a5b467ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 0.854851 Jul 14 14:50:18.672123 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2161/4362] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:17 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:18.679468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49f56dc4-9303-4eb8-9a5b-49dd96b21b5c tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:18.680557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49f56dc4-9303-4eb8-9a5b-49dd96b21b5c tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:18.681080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49f56dc4-9303-4eb8-9a5b-49dd96b21b5c tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:19.467214 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-49f56dc4-9303-4eb8-9a5b-49dd96b21b5c tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] 10.222.0.81 "POST /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199/action" status: 202 len: 52 microversion: 2.47 time: 0.817256 Jul 14 14:50:19.472871 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2202/4363] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 14:50:18 2022] POST /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199/action => generated 52 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:50:19.485412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c182d9ea-bcdd-4186-b417-ca8959057d92 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:19.485915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c182d9ea-bcdd-4186-b417-ca8959057d92 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:19.499031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c182d9ea-bcdd-4186-b417-ca8959057d92 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:19.503838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c182d9ea-bcdd-4186-b417-ca8959057d92 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:19.507846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c182d9ea-bcdd-4186-b417-ca8959057d92 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:19.508355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c182d9ea-bcdd-4186-b417-ca8959057d92 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:19.595700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c182d9ea-bcdd-4186-b417-ca8959057d92 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:50:19.689800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-951a3491-0fcb-4875-8826-c903cbaa9f19 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:19.690808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-951a3491-0fcb-4875-8826-c903cbaa9f19 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:19.708069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-951a3491-0fcb-4875-8826-c903cbaa9f19 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:19.709342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-951a3491-0fcb-4875-8826-c903cbaa9f19 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:19.712858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-951a3491-0fcb-4875-8826-c903cbaa9f19 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:19.713871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-951a3491-0fcb-4875-8826-c903cbaa9f19 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:19.898012 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c182d9ea-bcdd-4186-b417-ca8959057d92 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199" status: 204 len: 0 microversion: 2.47 time: 0.414517 Jul 14 14:50:19.906226 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2162/4364] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:50:19 2022] DELETE /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:50:19.925437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e57a817-64aa-4683-b7d4-7a67c411e62a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:19.926258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4e57a817-64aa-4683-b7d4-7a67c411e62a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:19.941249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e57a817-64aa-4683-b7d4-7a67c411e62a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:19.946004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e57a817-64aa-4683-b7d4-7a67c411e62a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:19.948664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e57a817-64aa-4683-b7d4-7a67c411e62a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:19.953714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e57a817-64aa-4683-b7d4-7a67c411e62a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:20.224616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4e57a817-64aa-4683-b7d4-7a67c411e62a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:20.257806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4e57a817-64aa-4683-b7d4-7a67c411e62a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:20.268081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4e57a817-64aa-4683-b7d4-7a67c411e62a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:20.277849 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e57a817-64aa-4683-b7d4-7a67c411e62a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] 10.222.0.81 "GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199" status: 200 len: 1365 microversion: 2.47 time: 0.364875 Jul 14 14:50:20.279964 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2163/4365] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:50:19 2022] GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199 => generated 1365 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:50:20.339810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-951a3491-0fcb-4875-8826-c903cbaa9f19 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:20.370613 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-951a3491-0fcb-4875-8826-c903cbaa9f19 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 0.687887 Jul 14 14:50:20.378592 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2203/4366] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:19 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:20.776576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1905983893", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "b713f58d-6341-42f9-b54b-e1b7aa0cf36d"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:20.926952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] validate_networks() for [('b713f58d-6341-42f9-b54b-e1b7aa0cf36d', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:50:21.302745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b2f8a3ac-e9ce-4749-a829-f2184b4e387a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:21.304895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b2f8a3ac-e9ce-4749-a829-f2184b4e387a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:21.323537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2f8a3ac-e9ce-4749-a829-f2184b4e387a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:21.330331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2f8a3ac-e9ce-4749-a829-f2184b4e387a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:21.331567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2f8a3ac-e9ce-4749-a829-f2184b4e387a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:21.332186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2f8a3ac-e9ce-4749-a829-f2184b4e387a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:21.606231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b2f8a3ac-e9ce-4749-a829-f2184b4e387a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:21.643828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b2f8a3ac-e9ce-4749-a829-f2184b4e387a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:21.649730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b2f8a3ac-e9ce-4749-a829-f2184b4e387a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:21.656787 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b2f8a3ac-e9ce-4749-a829-f2184b4e387a tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] 10.222.0.81 "GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199" status: 200 len: 1365 microversion: 2.47 time: 0.361932 Jul 14 14:50:21.674305 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2204/4367] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:50:21 2022] GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199 => generated 1365 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:50:21.687356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-88ecb5cd-c9f6-4a71-8612-359b40e14dae tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:21.687997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-88ecb5cd-c9f6-4a71-8612-359b40e14dae tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:21.725586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88ecb5cd-c9f6-4a71-8612-359b40e14dae tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:21.726207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88ecb5cd-c9f6-4a71-8612-359b40e14dae tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:21.727133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88ecb5cd-c9f6-4a71-8612-359b40e14dae tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:21.729690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88ecb5cd-c9f6-4a71-8612-359b40e14dae tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:21.920929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:22.033497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:22.315192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:22.415637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-88ecb5cd-c9f6-4a71-8612-359b40e14dae tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:22.431332 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-88ecb5cd-c9f6-4a71-8612-359b40e14dae tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 0.755777 Jul 14 14:50:22.432849 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2205/4368] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:21 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:22.448270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cda74ec5-8d44-4c26-9468-5bd37f06e172 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Action: 'create', calling method: .version_select at 0x7fd6c5b5ce50>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2039688813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFiZye/LoFcBiLKXVku2TNV7m+krhrzuAJxJApIaHtuabCfNSIBBBCYyUf5DZaaGsfJg00U1+DB62tTSNUvABcFGy6kDb7Uom1n9wOACjybQPTjKFNwFLokuD4dt522Sw=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:22.484853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-cda74ec5-8d44-4c26-9468-5bd37f06e172 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Getting quotas for project 06a2de8e491f4b5daedac0a4bf1244f5. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:50:22.496038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-cda74ec5-8d44-4c26-9468-5bd37f06e172 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Getting quotas for user b0d1a695f8bc434c8cc488936c88f634 and project 06a2de8e491f4b5daedac0a4bf1244f5. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:50:22.541221 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cda74ec5-8d44-4c26-9468-5bd37f06e172 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.104944 Jul 14 14:50:22.542666 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2206/4369] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:50:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:22.658689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b0e12350-2806-4d75-9b2c-cc334442bee7 tempest-PortsAdminExtendedAttrsTestJSON-484415802 tempest-PortsAdminExtendedAttrsTestJSON-484415802-project-admin] Calling method '.version_select at 0x7fd6c5b8a940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:22.659570 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:50:22.659570 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:50:22.661421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0e12350-2806-4d75-9b2c-cc334442bee7 tempest-PortsAdminExtendedAttrsTestJSON-484415802 tempest-PortsAdminExtendedAttrsTestJSON-484415802-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:22.661883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0e12350-2806-4d75-9b2c-cc334442bee7 tempest-PortsAdminExtendedAttrsTestJSON-484415802 tempest-PortsAdminExtendedAttrsTestJSON-484415802-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:22.696739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0e12350-2806-4d75-9b2c-cc334442bee7 tempest-PortsAdminExtendedAttrsTestJSON-484415802 tempest-PortsAdminExtendedAttrsTestJSON-484415802-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:22.697153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0e12350-2806-4d75-9b2c-cc334442bee7 tempest-PortsAdminExtendedAttrsTestJSON-484415802 tempest-PortsAdminExtendedAttrsTestJSON-484415802-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:22.722841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0e12350-2806-4d75-9b2c-cc334442bee7 tempest-PortsAdminExtendedAttrsTestJSON-484415802 tempest-PortsAdminExtendedAttrsTestJSON-484415802-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:22.723300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0e12350-2806-4d75-9b2c-cc334442bee7 tempest-PortsAdminExtendedAttrsTestJSON-484415802 tempest-PortsAdminExtendedAttrsTestJSON-484415802-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:22.739821 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b0e12350-2806-4d75-9b2c-cc334442bee7 tempest-PortsAdminExtendedAttrsTestJSON-484415802 tempest-PortsAdminExtendedAttrsTestJSON-484415802-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.195758 Jul 14 14:50:22.740682 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2207/4370] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:50:22 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:22.761945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c5e5a2ec-958d-484e-bdfe-c0131f3a6931 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:22.762832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c5e5a2ec-958d-484e-bdfe-c0131f3a6931 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:22.773939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5e5a2ec-958d-484e-bdfe-c0131f3a6931 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:22.780060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5e5a2ec-958d-484e-bdfe-c0131f3a6931 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:22.781631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5e5a2ec-958d-484e-bdfe-c0131f3a6931 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:22.783933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5e5a2ec-958d-484e-bdfe-c0131f3a6931 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:23.250058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c5e5a2ec-958d-484e-bdfe-c0131f3a6931 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:23.268572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c5e5a2ec-958d-484e-bdfe-c0131f3a6931 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:23.279423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c5e5a2ec-958d-484e-bdfe-c0131f3a6931 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '436e50f24dc04a16a6b37d6400d38624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14c1f617c834545a7fc8afd5723d932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:23.283845 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c5e5a2ec-958d-484e-bdfe-c0131f3a6931 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] 10.222.0.81 "GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199" status: 200 len: 1365 microversion: 2.47 time: 0.534390 Jul 14 14:50:23.287909 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2208/4371] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:50:22 2022] GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199 => generated 1365 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:50:23.352075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-21d95eda-b6a2-4022-8782-0ad177107cd5 req-8cfd0edd-2173-4ca8-84a1-18c65642264b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b770b7b-68e4-45a2-b7c0-8a6361470c46", "tag": "fa1b883e-e59f-4f69-92c5-19b2c1e020e8"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:23.369478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-21d95eda-b6a2-4022-8782-0ad177107cd5 req-8cfd0edd-2173-4ca8-84a1-18c65642264b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:23.369918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-21d95eda-b6a2-4022-8782-0ad177107cd5 req-8cfd0edd-2173-4ca8-84a1-18c65642264b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:23.449386 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-21d95eda-b6a2-4022-8782-0ad177107cd5 req-8cfd0edd-2173-4ca8-84a1-18c65642264b service nova] Creating event network-changed:fa1b883e-e59f-4f69-92c5-19b2c1e020e8 for instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 on n-h2-767704-28 Jul 14 14:50:23.472272 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-21d95eda-b6a2-4022-8782-0ad177107cd5 req-8cfd0edd-2173-4ca8-84a1-18c65642264b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126956 Jul 14 14:50:23.473757 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2209/4372] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:50:23.483539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-54a518d6-7e0e-4c74-bb41-cecf70aba83a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:23.484686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-54a518d6-7e0e-4c74-bb41-cecf70aba83a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:23.494135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54a518d6-7e0e-4c74-bb41-cecf70aba83a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:23.494986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54a518d6-7e0e-4c74-bb41-cecf70aba83a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:23.497669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54a518d6-7e0e-4c74-bb41-cecf70aba83a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:23.498556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54a518d6-7e0e-4c74-bb41-cecf70aba83a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:23.829435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:50:23.830006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:50:23.831054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:50:23.831689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:50:23.832388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:50:23.852874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:23.858023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:23.859826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:23.860298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:23.910530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Getting quotas for project bffe657f18ef47f7ac5ca5e1af866b1f. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:50:23.911384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-54a518d6-7e0e-4c74-bb41-cecf70aba83a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:23.929443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Getting quotas for user 87a17c8fbc9946eba3ac613ee006aac1 and project bffe657f18ef47f7ac5ca5e1af866b1f. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:50:23.931925 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-54a518d6-7e0e-4c74-bb41-cecf70aba83a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 0.452421 Jul 14 14:50:23.942943 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2210/4373] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:23 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:23.969109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Going to run 3 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:50:23.971805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 1862a1d7-e79f-43fc-9004-4201bf86833a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:50:24.111319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 2d9e551c-4faa-4c2d-ad28-eda57a1ac938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=1862a1d7-e79f-43fc-9004-4201bf86833a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:50:24.204223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=2d9e551c-4faa-4c2d-ad28-eda57a1ac938,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:50:24.304753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dfd928db-4c42-4bf6-ae4e-0d753e642ef4 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:24.305920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dfd928db-4c42-4bf6-ae4e-0d753e642ef4 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] [instance: 4890ffd6-0354-49b2-a01d-3343ce9b8199] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:24.340704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfd928db-4c42-4bf6-ae4e-0d753e642ef4 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:24.346076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfd928db-4c42-4bf6-ae4e-0d753e642ef4 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:24.356270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfd928db-4c42-4bf6-ae4e-0d753e642ef4 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:24.358712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dfd928db-4c42-4bf6-ae4e-0d753e642ef4 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:24.390391 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cba648dc-e48b-4f30-8d53-52ab56874423 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.054991 Jul 14 14:50:24.409674 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2164/4374] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:50:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:50:24.427535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c811584c-f81e-460f-a839-d98ff8f40d41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:24.440044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c811584c-f81e-460f-a839-d98ff8f40d41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:24.445085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c811584c-f81e-460f-a839-d98ff8f40d41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Searching by: {'deleted': False, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:50:24.449029 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-dfd928db-4c42-4bf6-ae4e-0d753e642ef4 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] HTTP exception thrown: Instance 4890ffd6-0354-49b2-a01d-3343ce9b8199 could not be found. Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dfd928db-4c42-4bf6-ae4e-0d753e642ef4 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Request method failure captured: Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199 HTTP/1.1 Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C0jl8dgaeVJBdZAnPPqe7_lV8RSIj-SHRP1haJSKwP7hDsXPJm4gDn4EIQuk9mUggQmR_j0WYhyU-joimQ5pgHHGgHzq315EtIsjq_0jYFljBKC-Kk6-St4-nJ2Q5MnzZltWYtNs8sYLy6qtSLxCrs5BIO4TC4abitc39JZqvDyalI Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.47 Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: c14c1f617c834545a7fc8afd5723d932 Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersAaction247Test-1195809164 Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c14c1f617c834545a7fc8afd5723d932"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c14c1f617c834545a7fc8afd5723d932"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c14c1f617c834545a7fc8afd5723d932", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c14c1f617c834545a7fc8afd5723d932"}]}] Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersAaction247Test-1195809164 Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: c14c1f617c834545a7fc8afd5723d932 Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersAaction247Test-1195809164 Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersAaction247Test-1195809164-project Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 436e50f24dc04a16a6b37d6400d38624 Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersAaction247Test-1195809164-project Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 4890ffd6-0354-49b2-a01d-3343ce9b8199 could not be found. Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '4890ffd6-0354-49b2-a01d-3343ce9b8199'} Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4890ffd6-0354-49b2-a01d-3343ce9b8199 could not be found. Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4890ffd6-0354-49b2-a01d-3343ce9b8199 could not be found. Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:24.461307 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:24.466618 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:24.466618 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:24.466618 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:24.466618 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:24.466618 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:24.466618 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4890ffd6-0354-49b2-a01d-3343ce9b8199 could not be found. Jul 14 14:50:24.466618 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:24.471376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dfd928db-4c42-4bf6-ae4e-0d753e642ef4 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] Returning 404 to user: Instance 4890ffd6-0354-49b2-a01d-3343ce9b8199 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:24.476381 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dfd928db-4c42-4bf6-ae4e-0d753e642ef4 tempest-ServersAaction247Test-1195809164 tempest-ServersAaction247Test-1195809164-project] 10.222.0.81 "GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199" status: 404 len: 111 microversion: 2.47 time: 0.177063 Jul 14 14:50:24.505487 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2211/4375] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:50:24 2022] GET /compute/v2.1/servers/4890ffd6-0354-49b2-a01d-3343ce9b8199 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:50:24.577167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c811584c-f81e-460f-a839-d98ff8f40d41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:24.579745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c811584c-f81e-460f-a839-d98ff8f40d41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:24.586315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c811584c-f81e-460f-a839-d98ff8f40d41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:24.596529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c811584c-f81e-460f-a839-d98ff8f40d41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:24.662680 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c811584c-f81e-460f-a839-d98ff8f40d41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.246374 Jul 14 14:50:24.689270 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2165/4376] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 14:50:24 2022] GET /compute/v2.1/servers => generated 1018 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:24.698180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-45da918b-31a7-4189-b18a-637dce7a8518 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:24.699060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-45da918b-31a7-4189-b18a-637dce7a8518 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:24.950898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea5a7678-ddc6-4968-b793-0bf6f2e105cf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:24.952337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ea5a7678-ddc6-4968-b793-0bf6f2e105cf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:24.962939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-45da918b-31a7-4189-b18a-637dce7a8518 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:24.971048 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-45da918b-31a7-4189-b18a-637dce7a8518 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1223 microversion: 2.1 time: 0.282242 Jul 14 14:50:24.973409 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2212/4377] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:24 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1223 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:24.979389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea5a7678-ddc6-4968-b793-0bf6f2e105cf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:24.988487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea5a7678-ddc6-4968-b793-0bf6f2e105cf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:24.991512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea5a7678-ddc6-4968-b793-0bf6f2e105cf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:24.992252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea5a7678-ddc6-4968-b793-0bf6f2e105cf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:25.991582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0c12b0d0-8636-456a-a751-7b08d1efd86a tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:25.992863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0c12b0d0-8636-456a-a751-7b08d1efd86a tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:26.111913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ea5a7678-ddc6-4968-b793-0bf6f2e105cf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:26.145962 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ea5a7678-ddc6-4968-b793-0bf6f2e105cf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 1.199634 Jul 14 14:50:26.156345 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2166/4378] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:24 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:26.324656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0c12b0d0-8636-456a-a751-7b08d1efd86a tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:26.333646 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0c12b0d0-8636-456a-a751-7b08d1efd86a tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1223 microversion: 2.1 time: 0.346743 Jul 14 14:50:26.336772 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2213/4379] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:25 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1223 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:27.164371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b9be3b99-15d6-4053-8bb1-7d30f007e803 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:27.165888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b9be3b99-15d6-4053-8bb1-7d30f007e803 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:27.189173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9be3b99-15d6-4053-8bb1-7d30f007e803 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:27.209414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9be3b99-15d6-4053-8bb1-7d30f007e803 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:27.210471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9be3b99-15d6-4053-8bb1-7d30f007e803 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:27.219961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9be3b99-15d6-4053-8bb1-7d30f007e803 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:27.360022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f6f92272-7cca-46fc-a94d-568f90b3c23c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:27.361369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f6f92272-7cca-46fc-a94d-568f90b3c23c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:27.372199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6f92272-7cca-46fc-a94d-568f90b3c23c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:27.373718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6f92272-7cca-46fc-a94d-568f90b3c23c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:27.374524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6f92272-7cca-46fc-a94d-568f90b3c23c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:27.375134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6f92272-7cca-46fc-a94d-568f90b3c23c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:27.614806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6f92272-7cca-46fc-a94d-568f90b3c23c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:27.637739 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f6f92272-7cca-46fc-a94d-568f90b3c23c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1275 microversion: 2.1 time: 0.284115 Jul 14 14:50:27.649296 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2214/4380] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:27 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:28.656586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-28007be4-3ff3-4dbc-93ff-4994669f452f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:28.657284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-28007be4-3ff3-4dbc-93ff-4994669f452f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:28.676744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28007be4-3ff3-4dbc-93ff-4994669f452f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:28.683014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28007be4-3ff3-4dbc-93ff-4994669f452f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:28.684004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28007be4-3ff3-4dbc-93ff-4994669f452f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:28.684465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28007be4-3ff3-4dbc-93ff-4994669f452f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:28.905504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-28007be4-3ff3-4dbc-93ff-4994669f452f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:28.918148 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-28007be4-3ff3-4dbc-93ff-4994669f452f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1281 microversion: 2.1 time: 0.265991 Jul 14 14:50:28.918766 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2215/4381] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:28 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1281 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:29.274321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b9be3b99-15d6-4053-8bb1-7d30f007e803 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:29.282853 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b9be3b99-15d6-4053-8bb1-7d30f007e803 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 2.123625 Jul 14 14:50:29.283593 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2167/4382] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:27 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:29.939805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bfdd40d7-78f5-49cb-8958-bfe4344f1a3f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:29.940622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bfdd40d7-78f5-49cb-8958-bfe4344f1a3f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:29.959101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfdd40d7-78f5-49cb-8958-bfe4344f1a3f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:29.960179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-989535577", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c49b854e-41eb-45e0-a747-0d8bdaf5d3ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2039688813", "security_groups": [{"name": "tempest-secgroup-smoke-751940573"}], "networks": [{"uuid": "87e6d95f-d84e-4225-939c-54553d2c5249"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:29.964409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfdd40d7-78f5-49cb-8958-bfe4344f1a3f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:29.970389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfdd40d7-78f5-49cb-8958-bfe4344f1a3f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:29.971198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfdd40d7-78f5-49cb-8958-bfe4344f1a3f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:30.302980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bfdd40d7-78f5-49cb-8958-bfe4344f1a3f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:30.332382 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bfdd40d7-78f5-49cb-8958-bfe4344f1a3f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1281 microversion: 2.1 time: 0.395595 Jul 14 14:50:30.333700 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2216/4383] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:29 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1281 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:30.339066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b396d73e-f244-404b-8290-4b214da01832 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:30.346050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b396d73e-f244-404b-8290-4b214da01832 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:30.386583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b396d73e-f244-404b-8290-4b214da01832 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:30.387041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b396d73e-f244-404b-8290-4b214da01832 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:30.387843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b396d73e-f244-404b-8290-4b214da01832 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:30.392850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b396d73e-f244-404b-8290-4b214da01832 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:30.594801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] validate_networks() for [('87e6d95f-d84e-4225-939c-54553d2c5249', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:50:31.322570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b396d73e-f244-404b-8290-4b214da01832 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:31.343290 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b396d73e-f244-404b-8290-4b214da01832 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 1.008173 Jul 14 14:50:31.344531 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2217/4384] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:30 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:31.359006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a1e00d85-6bb3-4865-a2b8-e471c3c4971d tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:31.360069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a1e00d85-6bb3-4865-a2b8-e471c3c4971d tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:31.374451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1e00d85-6bb3-4865-a2b8-e471c3c4971d tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:31.374918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1e00d85-6bb3-4865-a2b8-e471c3c4971d tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:31.375721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1e00d85-6bb3-4865-a2b8-e471c3c4971d tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:31.376222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1e00d85-6bb3-4865-a2b8-e471c3c4971d tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:32.187561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:50:32.198007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:50:32.199378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:50:32.202940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:50:32.205835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:50:32.229683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:32.232613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:32.235313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:32.238332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:32.270455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a1e00d85-6bb3-4865-a2b8-e471c3c4971d tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:32.279203 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a1e00d85-6bb3-4865-a2b8-e471c3c4971d tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1281 microversion: 2.1 time: 0.932068 Jul 14 14:50:32.280043 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2218/4385] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:31 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1281 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:32.285767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Getting quotas for project 06a2de8e491f4b5daedac0a4bf1244f5. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:50:32.305568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Getting quotas for user b0d1a695f8bc434c8cc488936c88f634 and project 06a2de8e491f4b5daedac0a4bf1244f5. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:50:32.371221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4ff5593b-9398-4dec-809b-d5837bae785d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:32.372529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4ff5593b-9398-4dec-809b-d5837bae785d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:32.388989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ff5593b-9398-4dec-809b-d5837bae785d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:32.390827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ff5593b-9398-4dec-809b-d5837bae785d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:32.401659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ff5593b-9398-4dec-809b-d5837bae785d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:32.402386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ff5593b-9398-4dec-809b-d5837bae785d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:32.487498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:50:32.489945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c49b854e-41eb-45e0-a747-0d8bdaf5d3ea',volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:50:32.797969 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fc657300-4238-4fa1-a1f8-4de4c74cb5cc tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.847678 Jul 14 14:50:32.803328 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2168/4386] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:50:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 2854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:50:32.820451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3df8f3e5-d71d-43f9-87aa-17b166e4f841 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:32.821514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3df8f3e5-d71d-43f9-87aa-17b166e4f841 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:33.089672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3df8f3e5-d71d-43f9-87aa-17b166e4f841 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:33.108147 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3df8f3e5-d71d-43f9-87aa-17b166e4f841 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1098 microversion: 2.1 time: 0.293893 Jul 14 14:50:33.110010 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2169/4387] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:32 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1098 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:33.136143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4ff5593b-9398-4dec-809b-d5837bae785d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:33.149299 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4ff5593b-9398-4dec-809b-d5837bae785d tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1524 microversion: 2.1 time: 0.788631 Jul 14 14:50:33.155720 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2219/4388] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:32 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1524 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:33.298045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bdb1d726-667c-4cbb-8786-c82d2c82e0f9 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:33.300462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bdb1d726-667c-4cbb-8786-c82d2c82e0f9 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:33.347843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdb1d726-667c-4cbb-8786-c82d2c82e0f9 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:33.350148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdb1d726-667c-4cbb-8786-c82d2c82e0f9 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:33.357784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdb1d726-667c-4cbb-8786-c82d2c82e0f9 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:33.367035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdb1d726-667c-4cbb-8786-c82d2c82e0f9 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:33.931972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bdb1d726-667c-4cbb-8786-c82d2c82e0f9 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:33.956444 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bdb1d726-667c-4cbb-8786-c82d2c82e0f9 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1323 microversion: 2.1 time: 0.663454 Jul 14 14:50:33.969289 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2170/4389] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:33 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1323 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:34.127923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-78504822-b380-4a1d-af83-e52b43d2e9af tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:34.128548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-78504822-b380-4a1d-af83-e52b43d2e9af tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:34.139265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78504822-b380-4a1d-af83-e52b43d2e9af tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:34.139725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78504822-b380-4a1d-af83-e52b43d2e9af tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:34.140567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78504822-b380-4a1d-af83-e52b43d2e9af tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:34.141038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78504822-b380-4a1d-af83-e52b43d2e9af tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:34.171698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e38d5bec-68c9-468c-a83f-9e3f8976e59c tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:34.172320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e38d5bec-68c9-468c-a83f-9e3f8976e59c tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:34.175231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:34.193004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e38d5bec-68c9-468c-a83f-9e3f8976e59c tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:34.202173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e38d5bec-68c9-468c-a83f-9e3f8976e59c tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:34.203326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e38d5bec-68c9-468c-a83f-9e3f8976e59c tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:34.209757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e38d5bec-68c9-468c-a83f-9e3f8976e59c tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:34.689531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-78504822-b380-4a1d-af83-e52b43d2e9af tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:34.710387 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-78504822-b380-4a1d-af83-e52b43d2e9af tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1140 microversion: 2.1 time: 0.586437 Jul 14 14:50:34.711004 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2220/4390] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:34 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1140 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:34.986073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ebf5ce5-34fe-4b6c-b3db-f6cb8541725f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:34.987213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ebf5ce5-34fe-4b6c-b3db-f6cb8541725f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:35.008235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ebf5ce5-34fe-4b6c-b3db-f6cb8541725f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:35.014353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ebf5ce5-34fe-4b6c-b3db-f6cb8541725f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:35.015507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ebf5ce5-34fe-4b6c-b3db-f6cb8541725f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:35.017343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ebf5ce5-34fe-4b6c-b3db-f6cb8541725f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:35.782584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e38d5bec-68c9-468c-a83f-9e3f8976e59c tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:35.813277 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e38d5bec-68c9-468c-a83f-9e3f8976e59c tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1504 microversion: 2.1 time: 1.643912 Jul 14 14:50:35.814220 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2171/4391] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:34 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1504 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:35.824936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a5827ed7-c53f-41f4-94ca-b5e183d336ce req-5105e608-ba46-42d3-954a-a6d8d722ac62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1862a1d7-e79f-43fc-9004-4201bf86833a", "tag": "e6b27a24-1ac1-4774-a404-bd1719ffbe21"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:35.854245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a5827ed7-c53f-41f4-94ca-b5e183d336ce req-5105e608-ba46-42d3-954a-a6d8d722ac62 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:35.856543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a5827ed7-c53f-41f4-94ca-b5e183d336ce req-5105e608-ba46-42d3-954a-a6d8d722ac62 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:35.899784 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a5827ed7-c53f-41f4-94ca-b5e183d336ce req-5105e608-ba46-42d3-954a-a6d8d722ac62 service nova] Creating event network-changed:e6b27a24-1ac1-4774-a404-bd1719ffbe21 for instance 1862a1d7-e79f-43fc-9004-4201bf86833a on n-h2-767704-28 Jul 14 14:50:35.918854 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a5827ed7-c53f-41f4-94ca-b5e183d336ce req-5105e608-ba46-42d3-954a-a6d8d722ac62 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102497 Jul 14 14:50:35.922885 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2172/4392] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:35.946848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-baf68f00-ed9f-42a4-9d36-5f2b948870fa tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:35.952226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-baf68f00-ed9f-42a4-9d36-5f2b948870fa tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:35.989520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baf68f00-ed9f-42a4-9d36-5f2b948870fa tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:35.993809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baf68f00-ed9f-42a4-9d36-5f2b948870fa tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:36.001751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baf68f00-ed9f-42a4-9d36-5f2b948870fa tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:36.015802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baf68f00-ed9f-42a4-9d36-5f2b948870fa tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:36.282103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ebf5ce5-34fe-4b6c-b3db-f6cb8541725f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:36.294440 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ebf5ce5-34fe-4b6c-b3db-f6cb8541725f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1323 microversion: 2.1 time: 1.312935 Jul 14 14:50:36.299632 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2221/4393] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:34 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1323 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:36.308205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1281afa3-72a0-4e63-ac8f-f7f6091a6b0a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Action: 'create', calling method: .version_select at 0x7fd6c571c700>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2054561323", "description": "tempest-description-1918505183"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:36.332218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:36.386155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-baf68f00-ed9f-42a4-9d36-5f2b948870fa tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:36.400018 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-baf68f00-ed9f-42a4-9d36-5f2b948870fa tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1214 microversion: 2.1 time: 0.475594 Jul 14 14:50:36.402085 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2173/4394] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:35 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1214 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:37.316198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-749f3994-5f5e-4008-930a-5ec98502209b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:37.317004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-749f3994-5f5e-4008-930a-5ec98502209b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:37.332999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-749f3994-5f5e-4008-930a-5ec98502209b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:37.337567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-749f3994-5f5e-4008-930a-5ec98502209b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:37.338575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-749f3994-5f5e-4008-930a-5ec98502209b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:37.342257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-749f3994-5f5e-4008-930a-5ec98502209b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:38.834499 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1281afa3-72a0-4e63-ac8f-f7f6091a6b0a tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 2.533395 Jul 14 14:50:38.835235 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2222/4395] 10.222.0.81 () {60 vars in 1179 bytes} [Thu Jul 14 14:50:36 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 2535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:38.841572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0dc2636d-da93-4e7c-8b54-ff5f1d7ee4e3 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:38.841572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0dc2636d-da93-4e7c-8b54-ff5f1d7ee4e3 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:38.853119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:38.858921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0dc2636d-da93-4e7c-8b54-ff5f1d7ee4e3 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:38.859529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0dc2636d-da93-4e7c-8b54-ff5f1d7ee4e3 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:38.860451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0dc2636d-da93-4e7c-8b54-ff5f1d7ee4e3 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:38.862635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0dc2636d-da93-4e7c-8b54-ff5f1d7ee4e3 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:39.205530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0dc2636d-da93-4e7c-8b54-ff5f1d7ee4e3 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:39.214098 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0dc2636d-da93-4e7c-8b54-ff5f1d7ee4e3 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1214 microversion: 2.1 time: 0.377759 Jul 14 14:50:39.226456 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2223/4396] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:38 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1214 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:39.237101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f0ec5783-2bb2-4ddd-a40e-4d540e32b652 req-0a09c0c0-6219-4162-bb7d-adec30269665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9e551c-4faa-4c2d-ad28-eda57a1ac938", "tag": "38395a6d-0a57-4fce-b5e0-3f15cedc9d3f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:39.258971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f0ec5783-2bb2-4ddd-a40e-4d540e32b652 req-0a09c0c0-6219-4162-bb7d-adec30269665 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:39.265224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f0ec5783-2bb2-4ddd-a40e-4d540e32b652 req-0a09c0c0-6219-4162-bb7d-adec30269665 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:39.291466 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f0ec5783-2bb2-4ddd-a40e-4d540e32b652 req-0a09c0c0-6219-4162-bb7d-adec30269665 service nova] Creating event network-changed:38395a6d-0a57-4fce-b5e0-3f15cedc9d3f for instance 2d9e551c-4faa-4c2d-ad28-eda57a1ac938 on n-h1-767704-28 Jul 14 14:50:39.301954 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f0ec5783-2bb2-4ddd-a40e-4d540e32b652 req-0a09c0c0-6219-4162-bb7d-adec30269665 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073171 Jul 14 14:50:39.305006 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2224/4397] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:39.314623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-bcee541a-1849-454a-9679-53987b73c991 req-7fe937d3-535b-46c0-83bb-31228f322c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "082e1d34-2688-4533-9c47-2ac47840b2a3", "tag": "04bd9d17-5883-497e-acba-aa0a7f666d1d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:39.337259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bcee541a-1849-454a-9679-53987b73c991 req-7fe937d3-535b-46c0-83bb-31228f322c4e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:39.339692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bcee541a-1849-454a-9679-53987b73c991 req-7fe937d3-535b-46c0-83bb-31228f322c4e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:39.372206 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-bcee541a-1849-454a-9679-53987b73c991 req-7fe937d3-535b-46c0-83bb-31228f322c4e service nova] Creating event network-changed:04bd9d17-5883-497e-acba-aa0a7f666d1d for instance 082e1d34-2688-4533-9c47-2ac47840b2a3 on n-h2-767704-28 Jul 14 14:50:39.381648 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-bcee541a-1849-454a-9679-53987b73c991 req-7fe937d3-535b-46c0-83bb-31228f322c4e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071602 Jul 14 14:50:39.385535 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2225/4398] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:39.401429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d6e965a5-2beb-4416-9933-78301234fbb9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2054561323"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:39.402464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d6e965a5-2beb-4416-9933-78301234fbb9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:39.412168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6e965a5-2beb-4416-9933-78301234fbb9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:39.414640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6e965a5-2beb-4416-9933-78301234fbb9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:39.421465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-749f3994-5f5e-4008-930a-5ec98502209b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:39.426722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6e965a5-2beb-4416-9933-78301234fbb9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:39.431330 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-749f3994-5f5e-4008-930a-5ec98502209b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1323 microversion: 2.1 time: 2.119528 Jul 14 14:50:39.432241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6e965a5-2beb-4416-9933-78301234fbb9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:39.437161 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2174/4399] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:37 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1323 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:40.195307 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.network.security_group_api [None req-d6e965a5-2beb-4416-9933-78301234fbb9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Adding security group 422b676a-16a3-41f6-bd40-44de8e088429 to port 4dff7900-44ff-4bb2-97ea-1e108de17c71 Jul 14 14:50:40.233565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed4eb106-a534-4912-ae50-e5c7bfbd09ea tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:40.234210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ed4eb106-a534-4912-ae50-e5c7bfbd09ea tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:40.249953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed4eb106-a534-4912-ae50-e5c7bfbd09ea tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:40.250738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed4eb106-a534-4912-ae50-e5c7bfbd09ea tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:40.251926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed4eb106-a534-4912-ae50-e5c7bfbd09ea tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:40.252543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed4eb106-a534-4912-ae50-e5c7bfbd09ea tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:40.554567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ed4eb106-a534-4912-ae50-e5c7bfbd09ea tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:40.568241 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed4eb106-a534-4912-ae50-e5c7bfbd09ea tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1214 microversion: 2.1 time: 0.338919 Jul 14 14:50:40.570906 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2175/4400] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:40 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1214 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:40.589038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5bda908f-14f1-4ad3-a2a6-55c2a314708e tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:40.589768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5bda908f-14f1-4ad3-a2a6-55c2a314708e tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:40.616389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bda908f-14f1-4ad3-a2a6-55c2a314708e tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:40.616853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bda908f-14f1-4ad3-a2a6-55c2a314708e tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:40.617710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bda908f-14f1-4ad3-a2a6-55c2a314708e tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:40.628919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bda908f-14f1-4ad3-a2a6-55c2a314708e tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:41.808909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5bda908f-14f1-4ad3-a2a6-55c2a314708e tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:41.826576 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5bda908f-14f1-4ad3-a2a6-55c2a314708e tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1323 microversion: 2.1 time: 1.253688 Jul 14 14:50:41.830216 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2176/4401] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:40 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1323 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:41.840833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c72cb43c-1347-4364-bb94-db33a0a58e1d tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:41.854217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c72cb43c-1347-4364-bb94-db33a0a58e1d tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:41.858879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:41.879813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c72cb43c-1347-4364-bb94-db33a0a58e1d tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:41.880278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c72cb43c-1347-4364-bb94-db33a0a58e1d tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:41.885565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c72cb43c-1347-4364-bb94-db33a0a58e1d tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:41.886094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c72cb43c-1347-4364-bb94-db33a0a58e1d tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:42.253465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:43.101923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=14 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:43.756248 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d6e965a5-2beb-4416-9933-78301234fbb9 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "POST /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538/action" status: 202 len: 0 microversion: 2.1 time: 4.369101 Jul 14 14:50:43.757510 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2226/4402] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:50:39 2022] POST /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538/action => generated 0 bytes in 4371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:50:43.762787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-96987583-d514-4c24-a7fc-24be28ccc71f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:43.764297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-96987583-d514-4c24-a7fc-24be28ccc71f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:43.787193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96987583-d514-4c24-a7fc-24be28ccc71f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:43.793731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96987583-d514-4c24-a7fc-24be28ccc71f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:43.795639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96987583-d514-4c24-a7fc-24be28ccc71f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:43.796301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96987583-d514-4c24-a7fc-24be28ccc71f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:44.289681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c72cb43c-1347-4364-bb94-db33a0a58e1d tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:44.295051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:44.308770 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c72cb43c-1347-4364-bb94-db33a0a58e1d tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1281 microversion: 2.1 time: 2.472600 Jul 14 14:50:44.312869 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2177/4403] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:41 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1281 bytes in 2480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:44.330516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-90645699-ce23-4381-8184-5ddd860efabc tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2054561323"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:44.331186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-90645699-ce23-4381-8184-5ddd860efabc tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:44.355172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90645699-ce23-4381-8184-5ddd860efabc tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:44.358479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90645699-ce23-4381-8184-5ddd860efabc tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:44.376451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90645699-ce23-4381-8184-5ddd860efabc tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:44.381340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90645699-ce23-4381-8184-5ddd860efabc tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:44.990631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-96987583-d514-4c24-a7fc-24be28ccc71f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:45.003120 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-96987583-d514-4c24-a7fc-24be28ccc71f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1323 microversion: 2.1 time: 1.244233 Jul 14 14:50:45.003936 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2227/4404] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:43 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1323 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:45.020034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-30374eac-631e-4dad-92af-7c2c675bfd27 req-e73a553b-3ce3-4f82-9a41-dd3c9b3d4dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c804f5-bc58-41f2-97a5-c19ce7cb7538", "tag": "4dff7900-44ff-4bb2-97ea-1e108de17c71"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:45.048552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-30374eac-631e-4dad-92af-7c2c675bfd27 req-e73a553b-3ce3-4f82-9a41-dd3c9b3d4dd0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:45.049033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-30374eac-631e-4dad-92af-7c2c675bfd27 req-e73a553b-3ce3-4f82-9a41-dd3c9b3d4dd0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:45.086848 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-30374eac-631e-4dad-92af-7c2c675bfd27 req-e73a553b-3ce3-4f82-9a41-dd3c9b3d4dd0 service nova] Creating event network-changed:4dff7900-44ff-4bb2-97ea-1e108de17c71 for instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 on n-h1-767704-28 Jul 14 14:50:45.113502 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-30374eac-631e-4dad-92af-7c2c675bfd27 req-e73a553b-3ce3-4f82-9a41-dd3c9b3d4dd0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105234 Jul 14 14:50:45.119881 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2228/4405] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:45.133501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-7fa9b76d-1020-46b7-97a2-0ceaa6ffcb89 req-cb1b20dd-df51-45ac-9a31-8a0ccb74686a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1862a1d7-e79f-43fc-9004-4201bf86833a", "name": "network-vif-plugged", "status": "completed", "tag": "e6b27a24-1ac1-4774-a404-bd1719ffbe21"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:45.166072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7fa9b76d-1020-46b7-97a2-0ceaa6ffcb89 req-cb1b20dd-df51-45ac-9a31-8a0ccb74686a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:45.179575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7fa9b76d-1020-46b7-97a2-0ceaa6ffcb89 req-cb1b20dd-df51-45ac-9a31-8a0ccb74686a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:45.222383 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-7fa9b76d-1020-46b7-97a2-0ceaa6ffcb89 req-cb1b20dd-df51-45ac-9a31-8a0ccb74686a service nova] Creating event network-vif-plugged:e6b27a24-1ac1-4774-a404-bd1719ffbe21 for instance 1862a1d7-e79f-43fc-9004-4201bf86833a on n-h2-767704-28 Jul 14 14:50:45.238942 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-7fa9b76d-1020-46b7-97a2-0ceaa6ffcb89 req-cb1b20dd-df51-45ac-9a31-8a0ccb74686a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116852 Jul 14 14:50:45.243128 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2229/4406] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:45.331036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f0dda03-d109-4fc0-83fe-57bedba51add tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:45.332002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3f0dda03-d109-4fc0-83fe-57bedba51add tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:45.351251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f0dda03-d109-4fc0-83fe-57bedba51add tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:45.360542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f0dda03-d109-4fc0-83fe-57bedba51add tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:45.361734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f0dda03-d109-4fc0-83fe-57bedba51add tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:45.362599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f0dda03-d109-4fc0-83fe-57bedba51add tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:45.583562 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.network.security_group_api [None req-90645699-ce23-4381-8184-5ddd860efabc tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Removing security group 422b676a-16a3-41f6-bd40-44de8e088429 from port 4dff7900-44ff-4bb2-97ea-1e108de17c71 Jul 14 14:50:46.546802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3f0dda03-d109-4fc0-83fe-57bedba51add tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:46.564926 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f0dda03-d109-4fc0-83fe-57bedba51add tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1269 microversion: 2.1 time: 1.233013 Jul 14 14:50:46.569421 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2230/4407] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:45 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1269 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:46.580833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5f90f729-c349-4faf-8a8d-7f0b91452cff tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:46.586659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5f90f729-c349-4faf-8a8d-7f0b91452cff tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:46.603795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f90f729-c349-4faf-8a8d-7f0b91452cff tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:46.605674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f90f729-c349-4faf-8a8d-7f0b91452cff tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:46.607787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f90f729-c349-4faf-8a8d-7f0b91452cff tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:46.609737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f90f729-c349-4faf-8a8d-7f0b91452cff tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:46.760806 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-90645699-ce23-4381-8184-5ddd860efabc tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "POST /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538/action" status: 202 len: 0 microversion: 2.1 time: 2.444088 Jul 14 14:50:46.766386 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2178/4408] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:50:44 2022] POST /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538/action => generated 0 bytes in 2448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:50:46.772143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e4939374-875b-4864-9176-587ef42e601b tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Action: 'create', calling method: .version_select at 0x7fd6c4540790>, body: {"pool": null} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:48.864349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5f90f729-c349-4faf-8a8d-7f0b91452cff tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:48.878695 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5f90f729-c349-4faf-8a8d-7f0b91452cff tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1323 microversion: 2.1 time: 2.306478 Jul 14 14:50:48.879727 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2231/4409] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:46 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1323 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:48.885245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9d560f03-4446-456e-a410-85504dedb710 req-b492e24a-2eac-4acb-a68a-94474022b633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c804f5-bc58-41f2-97a5-c19ce7cb7538", "tag": "4dff7900-44ff-4bb2-97ea-1e108de17c71"}, {"name": "network-changed", "server_uuid": "cb68e36c-3f0c-4567-bf71-cee172d26584", "tag": "b740bd7f-b45f-434b-b252-0a0b8ca2850b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:48.899828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9d560f03-4446-456e-a410-85504dedb710 req-b492e24a-2eac-4acb-a68a-94474022b633 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:48.900526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9d560f03-4446-456e-a410-85504dedb710 req-b492e24a-2eac-4acb-a68a-94474022b633 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:48.945046 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9d560f03-4446-456e-a410-85504dedb710 req-b492e24a-2eac-4acb-a68a-94474022b633 service nova] Creating event network-changed:4dff7900-44ff-4bb2-97ea-1e108de17c71 for instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 on n-h1-767704-28 Jul 14 14:50:48.945844 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9d560f03-4446-456e-a410-85504dedb710 req-b492e24a-2eac-4acb-a68a-94474022b633 service nova] Creating event network-changed:b740bd7f-b45f-434b-b252-0a0b8ca2850b for instance cb68e36c-3f0c-4567-bf71-cee172d26584 on n-h1-767704-28 Jul 14 14:50:48.986867 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9d560f03-4446-456e-a410-85504dedb710 req-b492e24a-2eac-4acb-a68a-94474022b633 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.105413 Jul 14 14:50:48.988151 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2232/4410] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:48.998467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-fc9cd1bd-8b9d-4dc5-a0ad-47dbdc97cf5f req-f47e194d-81ec-4115-9a78-4854380fcc6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9e551c-4faa-4c2d-ad28-eda57a1ac938", "name": "network-vif-plugged", "status": "completed", "tag": "38395a6d-0a57-4fce-b5e0-3f15cedc9d3f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:49.025182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-fc9cd1bd-8b9d-4dc5-a0ad-47dbdc97cf5f req-f47e194d-81ec-4115-9a78-4854380fcc6f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:49.025865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-fc9cd1bd-8b9d-4dc5-a0ad-47dbdc97cf5f req-f47e194d-81ec-4115-9a78-4854380fcc6f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:49.042079 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-fc9cd1bd-8b9d-4dc5-a0ad-47dbdc97cf5f req-f47e194d-81ec-4115-9a78-4854380fcc6f service nova] Creating event network-vif-plugged:38395a6d-0a57-4fce-b5e0-3f15cedc9d3f for instance 2d9e551c-4faa-4c2d-ad28-eda57a1ac938 on n-h1-767704-28 Jul 14 14:50:49.048934 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-fc9cd1bd-8b9d-4dc5-a0ad-47dbdc97cf5f req-f47e194d-81ec-4115-9a78-4854380fcc6f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057476 Jul 14 14:50:49.054319 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2233/4411] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:49.062507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3391e079-3e19-4c40-93c2-3d416ea20a14 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:49.063244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3391e079-3e19-4c40-93c2-3d416ea20a14 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:49.070495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3391e079-3e19-4c40-93c2-3d416ea20a14 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:49.071235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3391e079-3e19-4c40-93c2-3d416ea20a14 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:49.072190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3391e079-3e19-4c40-93c2-3d416ea20a14 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:49.072808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3391e079-3e19-4c40-93c2-3d416ea20a14 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:49.773750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3391e079-3e19-4c40-93c2-3d416ea20a14 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:49.786234 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3391e079-3e19-4c40-93c2-3d416ea20a14 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1269 microversion: 2.1 time: 0.730154 Jul 14 14:50:49.787423 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2234/4412] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:49 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1269 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:49.904705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d1406700-733c-48df-9900-2127bd65e2be tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:49.905610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d1406700-733c-48df-9900-2127bd65e2be tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:49.919044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1406700-733c-48df-9900-2127bd65e2be tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:49.921145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1406700-733c-48df-9900-2127bd65e2be tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:49.923054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1406700-733c-48df-9900-2127bd65e2be tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:49.925193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1406700-733c-48df-9900-2127bd65e2be tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:50.486190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d1406700-733c-48df-9900-2127bd65e2be tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:50.504767 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d1406700-733c-48df-9900-2127bd65e2be tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1323 microversion: 2.1 time: 0.609844 Jul 14 14:50:50.505611 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2235/4413] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:49 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1323 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:50.805145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-736d981e-d542-4f05-bd43-63b44e08e1fd tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:50.806203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-736d981e-d542-4f05-bd43-63b44e08e1fd tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:50.820864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-736d981e-d542-4f05-bd43-63b44e08e1fd tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:50.822016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-736d981e-d542-4f05-bd43-63b44e08e1fd tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:50.823413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-736d981e-d542-4f05-bd43-63b44e08e1fd tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:50.826352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-736d981e-d542-4f05-bd43-63b44e08e1fd tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:51.464628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-736d981e-d542-4f05-bd43-63b44e08e1fd tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:51.495707 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-736d981e-d542-4f05-bd43-63b44e08e1fd tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1269 microversion: 2.1 time: 0.692733 Jul 14 14:50:51.497759 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2236/4414] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:50 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1269 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:51.504302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-19b2ec23-7d7d-40de-aa83-a32046a1ea3d req-a1044355-7d12-4d63-8372-1ffe055055af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082e1d34-2688-4533-9c47-2ac47840b2a3", "name": "network-vif-plugged", "status": "completed", "tag": "04bd9d17-5883-497e-acba-aa0a7f666d1d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:51.513508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-19b2ec23-7d7d-40de-aa83-a32046a1ea3d req-a1044355-7d12-4d63-8372-1ffe055055af service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:51.514319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-19b2ec23-7d7d-40de-aa83-a32046a1ea3d req-a1044355-7d12-4d63-8372-1ffe055055af service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:51.532470 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-19b2ec23-7d7d-40de-aa83-a32046a1ea3d req-a1044355-7d12-4d63-8372-1ffe055055af service nova] Creating event network-vif-plugged:04bd9d17-5883-497e-acba-aa0a7f666d1d for instance 082e1d34-2688-4533-9c47-2ac47840b2a3 on n-h2-767704-28 Jul 14 14:50:51.545516 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-19b2ec23-7d7d-40de-aa83-a32046a1ea3d req-a1044355-7d12-4d63-8372-1ffe055055af service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044693 Jul 14 14:50:51.552187 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2237/4415] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:51.565784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-70777142-60f3-4ae0-a392-32f7a3d665ab tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:51.567552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-70777142-60f3-4ae0-a392-32f7a3d665ab tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:51.574814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70777142-60f3-4ae0-a392-32f7a3d665ab tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:51.575632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70777142-60f3-4ae0-a392-32f7a3d665ab tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:51.577352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70777142-60f3-4ae0-a392-32f7a3d665ab tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:51.577981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70777142-60f3-4ae0-a392-32f7a3d665ab tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:52.584326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-70777142-60f3-4ae0-a392-32f7a3d665ab tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:52.609933 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-70777142-60f3-4ae0-a392-32f7a3d665ab tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1323 microversion: 2.1 time: 1.051930 Jul 14 14:50:52.611476 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2238/4416] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:51 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1323 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:52.619357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-12135ffc-b61f-4788-90cb-8116590825ce tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:52.620339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-12135ffc-b61f-4788-90cb-8116590825ce tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:52.637771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-12135ffc-b61f-4788-90cb-8116590825ce tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:52.639957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-12135ffc-b61f-4788-90cb-8116590825ce tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:52.641935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-12135ffc-b61f-4788-90cb-8116590825ce tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:52.646330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-12135ffc-b61f-4788-90cb-8116590825ce tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:53.246637 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e4939374-875b-4864-9176-587ef42e601b tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.478339 Jul 14 14:50:53.248773 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2179/4417] 10.222.0.81 () {60 vars in 1169 bytes} [Thu Jul 14 14:50:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:50:53.252470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-12135ffc-b61f-4788-90cb-8116590825ce tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:53.259824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5683967f-7e4c-4312-9285-2dcd921ab2bf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.107"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:53.262636 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-12135ffc-b61f-4788-90cb-8116590825ce tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1269 microversion: 2.1 time: 0.649575 Jul 14 14:50:53.263921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5683967f-7e4c-4312-9285-2dcd921ab2bf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:53.273784 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2239/4418] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:52 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1269 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:53.283738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5683967f-7e4c-4312-9285-2dcd921ab2bf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:53.284426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5683967f-7e4c-4312-9285-2dcd921ab2bf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:53.287296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5683967f-7e4c-4312-9285-2dcd921ab2bf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:53.287818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5683967f-7e4c-4312-9285-2dcd921ab2bf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:53.331735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5683967f-7e4c-4312-9285-2dcd921ab2bf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Acquired lock "refresh_cache-18c804f5-bc58-41f2-97a5-c19ce7cb7538" {{(pid=119511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:50:53.630321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7fd52917-0907-4cad-ba56-4e7edae12a42 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:53.630943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7fd52917-0907-4cad-ba56-4e7edae12a42 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:53.656519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7fd52917-0907-4cad-ba56-4e7edae12a42 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:53.657213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7fd52917-0907-4cad-ba56-4e7edae12a42 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:53.658570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7fd52917-0907-4cad-ba56-4e7edae12a42 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:53.661332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7fd52917-0907-4cad-ba56-4e7edae12a42 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:53.973437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7fd52917-0907-4cad-ba56-4e7edae12a42 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:53.985786 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7fd52917-0907-4cad-ba56-4e7edae12a42 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 200 len: 1516 microversion: 2.1 time: 0.359931 Jul 14 14:50:53.986635 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2240/4419] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:53 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 1516 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:54.002432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-10f0754b-37fd-4ad4-b115-56ec2084ef9c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:54.003357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-10f0754b-37fd-4ad4-b115-56ec2084ef9c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 2d9e551c-4faa-4c2d-ad28-eda57a1ac938] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:54.010413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10f0754b-37fd-4ad4-b115-56ec2084ef9c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:54.010783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10f0754b-37fd-4ad4-b115-56ec2084ef9c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:54.011577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10f0754b-37fd-4ad4-b115-56ec2084ef9c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:54.012019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10f0754b-37fd-4ad4-b115-56ec2084ef9c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:54.623279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-10f0754b-37fd-4ad4-b115-56ec2084ef9c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:54.637252 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-10f0754b-37fd-4ad4-b115-56ec2084ef9c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938" status: 200 len: 1516 microversion: 2.1 time: 0.638502 Jul 14 14:50:54.651569 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2241/4420] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:53 2022] GET /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938 => generated 1516 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:54.912486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-551191542", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "525f1693-8842-4191-b231-7d2db21bdaf8"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:55.020760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] validate_networks() for [('525f1693-8842-4191-b231-7d2db21bdaf8', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:50:56.445560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:50:56.446292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:50:56.447176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:50:56.448068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:50:56.449339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:50:56.484893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:56.486261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:56.490984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:56.493619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:56.543788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:50:56.564645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for user 4e3af45ec76c4a0b8dd03dcff6802f3c and project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:50:56.593071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:50:56.596691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:50:56.669950 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fb266a3e-5975-4c3c-88a4-4f44462b7bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.015622 Jul 14 14:50:56.672341 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2242/4421] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:50:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:50:56.679744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e93502d4-0308-4598-9b08-633124cb2a93 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:56.680735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e93502d4-0308-4598-9b08-633124cb2a93 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:56.692290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e93502d4-0308-4598-9b08-633124cb2a93 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:56.693522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e93502d4-0308-4598-9b08-633124cb2a93 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:56.695279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e93502d4-0308-4598-9b08-633124cb2a93 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:56.696628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e93502d4-0308-4598-9b08-633124cb2a93 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:56.725179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:57.207003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e93502d4-0308-4598-9b08-633124cb2a93 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:57.230789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e93502d4-0308-4598-9b08-633124cb2a93 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1269 microversion: 2.1 time: 0.546440 Jul 14 14:50:57.234188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-5683967f-7e4c-4312-9285-2dcd921ab2bf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Building network info cache for instance {{(pid=119511) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:50:57.234882 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2243/4422] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:56 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1269 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:57.251168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-865a98d8-d991-4987-99c8-5567256d0164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:57.251802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-865a98d8-d991-4987-99c8-5567256d0164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 1862a1d7-e79f-43fc-9004-4201bf86833a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:57.276743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-865a98d8-d991-4987-99c8-5567256d0164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:57.277164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-865a98d8-d991-4987-99c8-5567256d0164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:57.277914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-865a98d8-d991-4987-99c8-5567256d0164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:57.278362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-865a98d8-d991-4987-99c8-5567256d0164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:57.782328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-865a98d8-d991-4987-99c8-5567256d0164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:57.796722 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-865a98d8-d991-4987-99c8-5567256d0164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a" status: 200 len: 1517 microversion: 2.1 time: 0.560558 Jul 14 14:50:57.801750 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2244/4423] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:57 2022] GET /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a => generated 1517 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:57.825580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2eae9e4e-00fc-46a8-8ede-3040d0e82720 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:57.828216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2eae9e4e-00fc-46a8-8ede-3040d0e82720 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:57.846461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2eae9e4e-00fc-46a8-8ede-3040d0e82720 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:57.848748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2eae9e4e-00fc-46a8-8ede-3040d0e82720 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:57.853023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2eae9e4e-00fc-46a8-8ede-3040d0e82720 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:57.857821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2eae9e4e-00fc-46a8-8ede-3040d0e82720 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:57.942932 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2eae9e4e-00fc-46a8-8ede-3040d0e82720 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46/ips" status: 200 len: 151 microversion: 2.1 time: 0.126978 Jul 14 14:50:57.944271 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2245/4424] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 14:50:57 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46/ips => generated 151 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:57.955173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6a561258-91d6-417f-8912-3517e64fabcd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:57.958147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6a561258-91d6-417f-8912-3517e64fabcd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:57.976169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a561258-91d6-417f-8912-3517e64fabcd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:57.977530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a561258-91d6-417f-8912-3517e64fabcd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:57.979938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a561258-91d6-417f-8912-3517e64fabcd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:57.980416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a561258-91d6-417f-8912-3517e64fabcd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:58.254974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6a561258-91d6-417f-8912-3517e64fabcd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:58.280639 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6a561258-91d6-417f-8912-3517e64fabcd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 200 len: 1244 microversion: 2.1 time: 0.334893 Jul 14 14:50:58.296818 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2246/4425] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:57 2022] GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 1244 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:58.305777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-23cb13ee-0364-4246-b003-32c9da6d0de1 req-9d2b24e1-188b-4d9c-827d-337d5980c09e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c804f5-bc58-41f2-97a5-c19ce7cb7538", "tag": "4dff7900-44ff-4bb2-97ea-1e108de17c71"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:58.334013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-23cb13ee-0364-4246-b003-32c9da6d0de1 req-9d2b24e1-188b-4d9c-827d-337d5980c09e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:58.334473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-23cb13ee-0364-4246-b003-32c9da6d0de1 req-9d2b24e1-188b-4d9c-827d-337d5980c09e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:58.468367 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-23cb13ee-0364-4246-b003-32c9da6d0de1 req-9d2b24e1-188b-4d9c-827d-337d5980c09e service nova] Creating event network-changed:4dff7900-44ff-4bb2-97ea-1e108de17c71 for instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 on n-h1-767704-28 Jul 14 14:50:58.498467 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-23cb13ee-0364-4246-b003-32c9da6d0de1 req-9d2b24e1-188b-4d9c-827d-337d5980c09e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199993 Jul 14 14:50:58.499991 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2247/4426] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:58.517395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0c606808-5b8f-402d-842d-d96a6537d266 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:58.518765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0c606808-5b8f-402d-842d-d96a6537d266 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 1862a1d7-e79f-43fc-9004-4201bf86833a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:58.553005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0c606808-5b8f-402d-842d-d96a6537d266 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:58.556565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0c606808-5b8f-402d-842d-d96a6537d266 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:58.557322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0c606808-5b8f-402d-842d-d96a6537d266 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:58.575962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0c606808-5b8f-402d-842d-d96a6537d266 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:58.627754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0c606808-5b8f-402d-842d-d96a6537d266 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 1862a1d7-e79f-43fc-9004-4201bf86833a] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:50:58.809141 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0c606808-5b8f-402d-842d-d96a6537d266 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a" status: 204 len: 0 microversion: 2.1 time: 0.302254 Jul 14 14:50:58.820208 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2248/4427] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:50:58 2022] DELETE /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:50:58.831887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-175cb253-ee33-4e14-a81d-310e6db99ce5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "341d7c82-1fa4-4680-abec-d85c687b801a"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:58.840117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-175cb253-ee33-4e14-a81d-310e6db99ce5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:58.870067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-175cb253-ee33-4e14-a81d-310e6db99ce5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:58.870528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-175cb253-ee33-4e14-a81d-310e6db99ce5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:58.871338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-175cb253-ee33-4e14-a81d-310e6db99ce5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:58.871783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-175cb253-ee33-4e14-a81d-310e6db99ce5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:59.226898 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-175cb253-ee33-4e14-a81d-310e6db99ce5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Invalid volume: volume 341d7c82-1fa4-4680-abec-d85c687b801a is already attached to instances: fba14e7e-dbff-47d0-9515-3acd4c797b52 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-175cb253-ee33-4e14-a81d-310e6db99ce5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46/os-volume_attachments HTTP/1.1 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 74 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: {"volumeAttachment": {"volumeId": "341d7c82-1fa4-4680-abec-d85c687b801a"}} Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid volume: volume 341d7c82-1fa4-4680-abec-d85c687b801a is already attached to instances: fba14e7e-dbff-47d0-9515-3acd4c797b52 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'server_id': '6b770b7b-68e4-45a2-b7c0-8a6361470c46', 'body': {'volumeAttachment': {'volumeId': '341d7c82-1fa4-4680-abec-d85c687b801a'}}} Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 341d7c82-1fa4-4680-abec-d85c687b801a is already attached to instances: fba14e7e-dbff-47d0-9515-3acd4c797b52 Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:59.228846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 341d7c82-1fa4-4680-abec-d85c687b801a is already attached to instances: fba14e7e-dbff-47d0-9515-3acd4c797b52 Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 341d7c82-1fa4-4680-abec-d85c687b801a is already attached to instances: fba14e7e-dbff-47d0-9515-3acd4c797b52 Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-175cb253-ee33-4e14-a81d-310e6db99ce5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 400 to user: Invalid volume: volume 341d7c82-1fa4-4680-abec-d85c687b801a is already attached to instances: fba14e7e-dbff-47d0-9515-3acd4c797b52 {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-175cb253-ee33-4e14-a81d-310e6db99ce5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.407828 Jul 14 14:50:59.233815 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2249/4428] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:50:58 2022] POST /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46/os-volume_attachments => generated 174 bytes in 410 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:50:59.259155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e08b1c4f-b5c9-430d-9e90-42e3ed52dab1 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:59.262243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e08b1c4f-b5c9-430d-9e90-42e3ed52dab1 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:59.279970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e08b1c4f-b5c9-430d-9e90-42e3ed52dab1 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:59.280688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e08b1c4f-b5c9-430d-9e90-42e3ed52dab1 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:59.284818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e08b1c4f-b5c9-430d-9e90-42e3ed52dab1 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:59.286672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e08b1c4f-b5c9-430d-9e90-42e3ed52dab1 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:59.334644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-5683967f-7e4c-4312-9285-2dcd921ab2bf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Updating instance_info_cache with network_info: [{"id": "4dff7900-44ff-4bb2-97ea-1e108de17c71", "address": "fa:16:3e:bd:72:7d", "network": {"id": "9f42908f-fe9e-412f-a1db-27c1d0d33291", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1249473036-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14a2d361c8364c908f6147aa58322173", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4dff7900-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119511) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:50:59.353756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5683967f-7e4c-4312-9285-2dcd921ab2bf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Releasing lock "refresh_cache-18c804f5-bc58-41f2-97a5-c19ce7cb7538" {{(pid=119511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:50:59.355031 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5683967f-7e4c-4312-9285-2dcd921ab2bf tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "POST /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538/action" status: 202 len: 0 microversion: 2.1 time: 6.099201 Jul 14 14:50:59.361809 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2180/4429] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:50:53 2022] POST /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538/action => generated 0 bytes in 6106 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 14 14:50:59.381913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-09a3ce99-8f6c-41e3-98e0-7a5ff4c2a577 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:59.384613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-09a3ce99-8f6c-41e3-98e0-7a5ff4c2a577 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 1862a1d7-e79f-43fc-9004-4201bf86833a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:59.409172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09a3ce99-8f6c-41e3-98e0-7a5ff4c2a577 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:59.409869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09a3ce99-8f6c-41e3-98e0-7a5ff4c2a577 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:59.410830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09a3ce99-8f6c-41e3-98e0-7a5ff4c2a577 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:59.411443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09a3ce99-8f6c-41e3-98e0-7a5ff4c2a577 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:00.252578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e08b1c4f-b5c9-430d-9e90-42e3ed52dab1 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:00.269136 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e08b1c4f-b5c9-430d-9e90-42e3ed52dab1 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1269 microversion: 2.1 time: 1.020319 Jul 14 14:51:00.269988 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2250/4430] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:59 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1269 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:00.281953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8e9c2e0-42ee-4542-b5eb-f2ef45a66433 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:00.282760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8e9c2e0-42ee-4542-b5eb-f2ef45a66433 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:00.299711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-09a3ce99-8f6c-41e3-98e0-7a5ff4c2a577 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:00.312771 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-09a3ce99-8f6c-41e3-98e0-7a5ff4c2a577 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a" status: 200 len: 1523 microversion: 2.1 time: 0.948513 Jul 14 14:51:00.315020 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2181/4431] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:59 2022] GET /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a => generated 1523 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:00.318573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8e9c2e0-42ee-4542-b5eb-f2ef45a66433 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:00.320259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8e9c2e0-42ee-4542-b5eb-f2ef45a66433 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:00.327102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b19d4e5-684f-421e-8046-5a9615acd170 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:00.328180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8e9c2e0-42ee-4542-b5eb-f2ef45a66433 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:00.328863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8e9c2e0-42ee-4542-b5eb-f2ef45a66433 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:00.330045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8b19d4e5-684f-421e-8046-5a9615acd170 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:00.357749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b19d4e5-684f-421e-8046-5a9615acd170 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:00.358991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b19d4e5-684f-421e-8046-5a9615acd170 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:00.360008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b19d4e5-684f-421e-8046-5a9615acd170 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:00.360686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b19d4e5-684f-421e-8046-5a9615acd170 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:00.424687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8e9c2e0-42ee-4542-b5eb-f2ef45a66433 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:51:00.609211 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8e9c2e0-42ee-4542-b5eb-f2ef45a66433 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 204 len: 0 microversion: 2.1 time: 0.337478 Jul 14 14:51:00.611196 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2251/4432] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:00 2022] DELETE /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:00.637122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5079d5e9-c33b-4d03-80e3-665c4ed720b7 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.107"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:00.660141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8b19d4e5-684f-421e-8046-5a9615acd170 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:00.668481 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8b19d4e5-684f-421e-8046-5a9615acd170 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 200 len: 1250 microversion: 2.1 time: 0.352043 Jul 14 14:51:00.674615 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2182/4433] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:00 2022] GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 1250 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:00.690507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-79ad9f32-a6f5-4421-895e-ad8e894a8a42 req-b25ec73e-b50f-4171-b375-c8cc2dcad05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb68e36c-3f0c-4567-bf71-cee172d26584", "name": "network-vif-plugged", "status": "completed", "tag": "b740bd7f-b45f-434b-b252-0a0b8ca2850b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:00.706852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-79ad9f32-a6f5-4421-895e-ad8e894a8a42 req-b25ec73e-b50f-4171-b375-c8cc2dcad05b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:00.709120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-79ad9f32-a6f5-4421-895e-ad8e894a8a42 req-b25ec73e-b50f-4171-b375-c8cc2dcad05b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:00.725098 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-79ad9f32-a6f5-4421-895e-ad8e894a8a42 req-b25ec73e-b50f-4171-b375-c8cc2dcad05b service nova] Creating event network-vif-plugged:b740bd7f-b45f-434b-b252-0a0b8ca2850b for instance cb68e36c-3f0c-4567-bf71-cee172d26584 on n-h1-767704-28 Jul 14 14:51:00.731943 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-79ad9f32-a6f5-4421-895e-ad8e894a8a42 req-b25ec73e-b50f-4171-b375-c8cc2dcad05b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055462 Jul 14 14:51:00.736900 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2183/4434] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:00.752358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-996125ba-c3b2-423d-adf6-ab059168de6f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:00.753139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-996125ba-c3b2-423d-adf6-ab059168de6f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:00.811704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-996125ba-c3b2-423d-adf6-ab059168de6f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:00.813299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-996125ba-c3b2-423d-adf6-ab059168de6f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:00.827497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-996125ba-c3b2-423d-adf6-ab059168de6f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:00.827958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-996125ba-c3b2-423d-adf6-ab059168de6f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:01.038060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5079d5e9-c33b-4d03-80e3-665c4ed720b7 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:01.045209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5079d5e9-c33b-4d03-80e3-665c4ed720b7 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:01.045869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5079d5e9-c33b-4d03-80e3-665c4ed720b7 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:01.046690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5079d5e9-c33b-4d03-80e3-665c4ed720b7 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:01.047139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5079d5e9-c33b-4d03-80e3-665c4ed720b7 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:01.523557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-996125ba-c3b2-423d-adf6-ab059168de6f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:01.544140 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-996125ba-c3b2-423d-adf6-ab059168de6f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1683 microversion: 2.1 time: 0.805389 Jul 14 14:51:01.546209 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2184/4435] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:00 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1683 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:01.560490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f2e04b04-a6d3-425e-9393-4a42e1ef4ce8 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:01.561706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f2e04b04-a6d3-425e-9393-4a42e1ef4ce8 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:01.578219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2e04b04-a6d3-425e-9393-4a42e1ef4ce8 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:01.579154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2e04b04-a6d3-425e-9393-4a42e1ef4ce8 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:01.580370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2e04b04-a6d3-425e-9393-4a42e1ef4ce8 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:01.581783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f2e04b04-a6d3-425e-9393-4a42e1ef4ce8 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:01.876985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5079d5e9-c33b-4d03-80e3-665c4ed720b7 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Acquired lock "refresh_cache-18c804f5-bc58-41f2-97a5-c19ce7cb7538" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:51:03.840161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f2e04b04-a6d3-425e-9393-4a42e1ef4ce8 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:03.851222 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f2e04b04-a6d3-425e-9393-4a42e1ef4ce8 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1269 microversion: 2.1 time: 2.302335 Jul 14 14:51:03.854839 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2185/4436] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:01 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1269 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:03.879287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f158a32c-3a65-447b-a9e8-e74c74f1197b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:03.890254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f158a32c-3a65-447b-a9e8-e74c74f1197b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 1862a1d7-e79f-43fc-9004-4201bf86833a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:03.903374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f158a32c-3a65-447b-a9e8-e74c74f1197b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:03.903861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f158a32c-3a65-447b-a9e8-e74c74f1197b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:03.904657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f158a32c-3a65-447b-a9e8-e74c74f1197b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:03.914000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f158a32c-3a65-447b-a9e8-e74c74f1197b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:05.219172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f158a32c-3a65-447b-a9e8-e74c74f1197b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:05.229898 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f158a32c-3a65-447b-a9e8-e74c74f1197b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a" status: 200 len: 1523 microversion: 2.1 time: 1.355412 Jul 14 14:51:05.232742 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2186/4437] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:03 2022] GET /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a => generated 1523 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:05.248180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e546488-e7d7-4e2d-b032-3f593d47b563 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:05.253467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4e546488-e7d7-4e2d-b032-3f593d47b563 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:05.269670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e546488-e7d7-4e2d-b032-3f593d47b563 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:05.272894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e546488-e7d7-4e2d-b032-3f593d47b563 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:05.274088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e546488-e7d7-4e2d-b032-3f593d47b563 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:05.274713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e546488-e7d7-4e2d-b032-3f593d47b563 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.082445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4e546488-e7d7-4e2d-b032-3f593d47b563 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:06.096528 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e546488-e7d7-4e2d-b032-3f593d47b563 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 200 len: 1292 microversion: 2.1 time: 0.861170 Jul 14 14:51:06.101267 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2187/4438] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:05 2022] GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 1292 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:06.110322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-678723f4-aaed-4db6-aff2-4a2470d239b8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:06.111357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-678723f4-aaed-4db6-aff2-4a2470d239b8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:06.133277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-678723f4-aaed-4db6-aff2-4a2470d239b8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:06.133765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-678723f4-aaed-4db6-aff2-4a2470d239b8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.134571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-678723f4-aaed-4db6-aff2-4a2470d239b8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:06.135018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-678723f4-aaed-4db6-aff2-4a2470d239b8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.386981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-678723f4-aaed-4db6-aff2-4a2470d239b8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:06.396101 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-678723f4-aaed-4db6-aff2-4a2470d239b8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 200 len: 1616 microversion: 2.1 time: 0.293547 Jul 14 14:51:06.407125 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2188/4439] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:06 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 1616 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:06.518274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:06.585684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:06.720886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-db3a33e3-f3a0-4f8d-a23b-774a496ced7b req-1185bd28-b0b4-4633-830b-ee4b3b4d0958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc099f7a-cc72-418f-a1ab-34040ebb0275", "tag": "7cf26e3d-566a-483e-9cdb-ae816129726c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:06.753438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-db3a33e3-f3a0-4f8d-a23b-774a496ced7b req-1185bd28-b0b4-4633-830b-ee4b3b4d0958 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:06.756805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-db3a33e3-f3a0-4f8d-a23b-774a496ced7b req-1185bd28-b0b4-4633-830b-ee4b3b4d0958 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.782236 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-db3a33e3-f3a0-4f8d-a23b-774a496ced7b req-1185bd28-b0b4-4633-830b-ee4b3b4d0958 service nova] Creating event network-changed:7cf26e3d-566a-483e-9cdb-ae816129726c for instance bc099f7a-cc72-418f-a1ab-34040ebb0275 on n-h2-767704-28 Jul 14 14:51:06.796837 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-db3a33e3-f3a0-4f8d-a23b-774a496ced7b req-1185bd28-b0b4-4633-830b-ee4b3b4d0958 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.387774 Jul 14 14:51:06.799389 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2189/4440] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:06.813295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b942356-c3a8-45c0-b0de-6afcd1b0d0eb tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:06.816749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0b942356-c3a8-45c0-b0de-6afcd1b0d0eb tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:06.830951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b942356-c3a8-45c0-b0de-6afcd1b0d0eb tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:06.831798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b942356-c3a8-45c0-b0de-6afcd1b0d0eb tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.844771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b942356-c3a8-45c0-b0de-6afcd1b0d0eb tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:06.845325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b942356-c3a8-45c0-b0de-6afcd1b0d0eb tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:07.481399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0b942356-c3a8-45c0-b0de-6afcd1b0d0eb tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:07.504191 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0b942356-c3a8-45c0-b0de-6afcd1b0d0eb tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1457 microversion: 2.1 time: 0.702755 Jul 14 14:51:07.508119 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2190/4441] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:06 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1457 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:07.520581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-696bc3ba-44a1-46ea-85f8-de1673bb7fc4 req-81603f1e-2108-4d6d-80af-7b86a3b7bb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1862a1d7-e79f-43fc-9004-4201bf86833a", "name": "network-vif-deleted", "tag": "e6b27a24-1ac1-4774-a404-bd1719ffbe21"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:07.549145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-696bc3ba-44a1-46ea-85f8-de1673bb7fc4 req-81603f1e-2108-4d6d-80af-7b86a3b7bb31 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:07.555226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-696bc3ba-44a1-46ea-85f8-de1673bb7fc4 req-81603f1e-2108-4d6d-80af-7b86a3b7bb31 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:07.578744 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-696bc3ba-44a1-46ea-85f8-de1673bb7fc4 req-81603f1e-2108-4d6d-80af-7b86a3b7bb31 service nova] Creating event network-vif-deleted:e6b27a24-1ac1-4774-a404-bd1719ffbe21 for instance 1862a1d7-e79f-43fc-9004-4201bf86833a on n-h2-767704-28 Jul 14 14:51:07.587187 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-696bc3ba-44a1-46ea-85f8-de1673bb7fc4 req-81603f1e-2108-4d6d-80af-7b86a3b7bb31 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076729 Jul 14 14:51:07.589364 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2191/4442] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:07.597353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4bd0c50c-071c-4972-b78c-e962b40f17f5 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:07.598318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4bd0c50c-071c-4972-b78c-e962b40f17f5 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 1862a1d7-e79f-43fc-9004-4201bf86833a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:07.609545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4bd0c50c-071c-4972-b78c-e962b40f17f5 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:07.635509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4bd0c50c-071c-4972-b78c-e962b40f17f5 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:07.636846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4bd0c50c-071c-4972-b78c-e962b40f17f5 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:07.641946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4bd0c50c-071c-4972-b78c-e962b40f17f5 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:07.693448 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-4bd0c50c-071c-4972-b78c-e962b40f17f5 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] HTTP exception thrown: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4bd0c50c-071c-4972-b78c-e962b40f17f5 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Request method failure captured: Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a HTTP/1.1 Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C0r6uZyuMywDqKG6jub132IiQk4HUBPLsPBejCIKTt7npEa7nhvZ38Mezaogm4YreEBYQgUgQTcnCRruriIXwzloDtbNV_AO7MRmSLt0qcQWPmg7cuP7orKoaOi8UyBY6hBNzWGRz0fpoWctmdcBJEQMOGule9XeYPtCXEbpNRo_g8 Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bffe657f18ef47f7ac5ca5e1af866b1f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}] Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87a17c8fbc9946eba3ac613ee006aac1 Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '1862a1d7-e79f-43fc-9004-4201bf86833a'} Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:07.700901 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:07.706191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:07.706191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:07.706191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:07.706191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:07.706191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:07.706191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:07.706191 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:07.710761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4bd0c50c-071c-4972-b78c-e962b40f17f5 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Returning 404 to user: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:07.719632 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4bd0c50c-071c-4972-b78c-e962b40f17f5 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a" status: 404 len: 111 microversion: 2.1 time: 0.128453 Jul 14 14:51:07.720748 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2192/4443] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:07 2022] GET /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:07.731355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5b5ef5d8-368c-4f9c-9284-43ef752f43d1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:07.733898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5b5ef5d8-368c-4f9c-9284-43ef752f43d1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:07.751475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b5ef5d8-368c-4f9c-9284-43ef752f43d1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:07.756100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b5ef5d8-368c-4f9c-9284-43ef752f43d1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:07.760900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b5ef5d8-368c-4f9c-9284-43ef752f43d1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:07.762589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b5ef5d8-368c-4f9c-9284-43ef752f43d1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:08.305203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-5079d5e9-c33b-4d03-80e3-665c4ed720b7 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Building network info cache for instance {{(pid=119512) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:51:08.982584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5b5ef5d8-368c-4f9c-9284-43ef752f43d1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:08.997904 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5b5ef5d8-368c-4f9c-9284-43ef752f43d1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 200 len: 1292 microversion: 2.1 time: 1.274567 Jul 14 14:51:09.000320 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2193/4444] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:07 2022] GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 1292 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:09.015488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0a9a53eb-54f3-45ec-b9ff-f780d4629fad tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:09.016292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0a9a53eb-54f3-45ec-b9ff-f780d4629fad tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:09.030783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a9a53eb-54f3-45ec-b9ff-f780d4629fad tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:09.031254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a9a53eb-54f3-45ec-b9ff-f780d4629fad tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:09.032052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a9a53eb-54f3-45ec-b9ff-f780d4629fad tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:09.034870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a9a53eb-54f3-45ec-b9ff-f780d4629fad tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:09.088898 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-0a9a53eb-54f3-45ec-b9ff-f780d4629fad tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0a9a53eb-54f3-45ec-b9ff-f780d4629fad tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 HTTP/1.1 Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6b770b7b-68e4-45a2-b7c0-8a6361470c46'} Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:09.121341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:09.126164 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:09.126164 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:09.126164 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:09.126164 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:09.126164 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:09.126164 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:51:09.126164 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:09.126164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0a9a53eb-54f3-45ec-b9ff-f780d4629fad tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 404 to user: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:09.126780 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0a9a53eb-54f3-45ec-b9ff-f780d4629fad tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 404 len: 111 microversion: 2.1 time: 0.122907 Jul 14 14:51:09.128170 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2194/4445] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:09 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:09.135450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-332c0082-5084-428a-8648-030ea1ed47b6 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:09.136090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-332c0082-5084-428a-8648-030ea1ed47b6 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:09.166540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-332c0082-5084-428a-8648-030ea1ed47b6 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:09.168626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-332c0082-5084-428a-8648-030ea1ed47b6 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:09.169435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-332c0082-5084-428a-8648-030ea1ed47b6 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:09.170513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-332c0082-5084-428a-8648-030ea1ed47b6 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:09.660575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-332c0082-5084-428a-8648-030ea1ed47b6 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:09.674942 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-332c0082-5084-428a-8648-030ea1ed47b6 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1457 microversion: 2.1 time: 0.543694 Jul 14 14:51:09.676851 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2195/4446] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:09 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1457 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:09.694093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eab4cc4c-fbd9-480b-ae03-61475f82339f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:09.705578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eab4cc4c-fbd9-480b-ae03-61475f82339f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:09.710918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eab4cc4c-fbd9-480b-ae03-61475f82339f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:51:09.722453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eab4cc4c-fbd9-480b-ae03-61475f82339f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:09.726278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eab4cc4c-fbd9-480b-ae03-61475f82339f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:09.727167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eab4cc4c-fbd9-480b-ae03-61475f82339f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:09.727622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eab4cc4c-fbd9-480b-ae03-61475f82339f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:09.970429 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eab4cc4c-fbd9-480b-ae03-61475f82339f tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.292168 Jul 14 14:51:09.971107 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2196/4447] 10.222.0.81 () {58 vars in 1229 bytes} [Thu Jul 14 14:51:09 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:51:09.987159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-72046f91-ceb9-4210-9d0e-2c3677d0d9f3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '.version_select at 0x7fd6c4592280>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:10.029815 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-72046f91-ceb9-4210-9d0e-2c3677d0d9f3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441659292" status: 202 len: 0 microversion: 2.1 time: 0.048340 Jul 14 14:51:10.031159 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2197/4448] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 14:51:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441659292 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:10.040586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-36361e54-8224-42cd-b2ac-b78605f9d359 req-c8c25fb4-eea8-425d-a31c-33c41629e027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b770b7b-68e4-45a2-b7c0-8a6361470c46", "name": "network-vif-deleted", "tag": "fa1b883e-e59f-4f69-92c5-19b2c1e020e8"}, {"name": "network-changed", "server_uuid": "18c804f5-bc58-41f2-97a5-c19ce7cb7538", "tag": "4dff7900-44ff-4bb2-97ea-1e108de17c71"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:10.063183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-36361e54-8224-42cd-b2ac-b78605f9d359 req-c8c25fb4-eea8-425d-a31c-33c41629e027 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:10.064616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-36361e54-8224-42cd-b2ac-b78605f9d359 req-c8c25fb4-eea8-425d-a31c-33c41629e027 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:10.096134 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-36361e54-8224-42cd-b2ac-b78605f9d359 req-c8c25fb4-eea8-425d-a31c-33c41629e027 service nova] Creating event network-vif-deleted:fa1b883e-e59f-4f69-92c5-19b2c1e020e8 for instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 on n-h2-767704-28 Jul 14 14:51:10.097553 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-36361e54-8224-42cd-b2ac-b78605f9d359 req-c8c25fb4-eea8-425d-a31c-33c41629e027 service nova] Creating event network-changed:4dff7900-44ff-4bb2-97ea-1e108de17c71 for instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 on n-h1-767704-28 Jul 14 14:51:10.110815 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-36361e54-8224-42cd-b2ac-b78605f9d359 req-c8c25fb4-eea8-425d-a31c-33c41629e027 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077771 Jul 14 14:51:10.112114 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2198/4449] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:10.119640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b6887b8-225e-4e7d-81de-453936830ef3 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b6887b8-225e-4e7d-81de-453936830ef3 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Request method failure captured: Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C0r6uZyuMywDqKG6jub132IiQk4HUBPLsPBejCIKTt7npEa7nhvZ38Mezaogm4YreEBYQgUgQTcnCRruriIXwzloDtbNV_AO7MRmSLt0qcQWPmg7cuP7orKoaOi8UyBY6hBNzWGRz0fpoWctmdcBJEQMOGule9XeYPtCXEbpNRo_g8 Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bffe657f18ef47f7ac5ca5e1af866b1f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}] Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87a17c8fbc9946eba3ac613ee006aac1 Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: action_args: {} Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 14 14:51:10.124494 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 14 14:51:10.128900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:10.131477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b6887b8-225e-4e7d-81de-453936830ef3 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:10.132669 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0b6887b8-225e-4e7d-81de-453936830ef3 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.018858 Jul 14 14:51:10.139512 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2199/4450] 10.222.0.81 () {58 vars in 1181 bytes} [Thu Jul 14 14:51:10 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:51:10.145415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7165bcb0-6075-4713-ab72-9ccaa50e0844 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:10.146442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7165bcb0-6075-4713-ab72-9ccaa50e0844 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:10.166477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7165bcb0-6075-4713-ab72-9ccaa50e0844 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:10.167134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7165bcb0-6075-4713-ab72-9ccaa50e0844 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:10.168132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7165bcb0-6075-4713-ab72-9ccaa50e0844 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:10.168740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7165bcb0-6075-4713-ab72-9ccaa50e0844 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:10.576759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-5079d5e9-c33b-4d03-80e3-665c4ed720b7 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Updating instance_info_cache with network_info: [{"id": "4dff7900-44ff-4bb2-97ea-1e108de17c71", "address": "fa:16:3e:bd:72:7d", "network": {"id": "9f42908f-fe9e-412f-a1db-27c1d0d33291", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1249473036-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14a2d361c8364c908f6147aa58322173", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4dff7900-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119512) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:51:10.594330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5079d5e9-c33b-4d03-80e3-665c4ed720b7 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Releasing lock "refresh_cache-18c804f5-bc58-41f2-97a5-c19ce7cb7538" {{(pid=119512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:51:10.595231 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5079d5e9-c33b-4d03-80e3-665c4ed720b7 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "POST /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538/action" status: 202 len: 0 microversion: 2.1 time: 9.981328 Jul 14 14:51:10.596229 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2252/4451] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:51:00 2022] POST /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538/action => generated 0 bytes in 9984 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:51:10.603721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fd282354-8490-4e72-b8f9-b09016ca5070 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:10.615702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fd282354-8490-4e72-b8f9-b09016ca5070 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:10.616531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fd282354-8490-4e72-b8f9-b09016ca5070 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Searching by: {'deleted': False, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:51:10.627473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:10.632196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fd282354-8490-4e72-b8f9-b09016ca5070 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:10.632657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fd282354-8490-4e72-b8f9-b09016ca5070 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:10.638782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fd282354-8490-4e72-b8f9-b09016ca5070 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:10.640277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fd282354-8490-4e72-b8f9-b09016ca5070 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:10.698787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-fd282354-8490-4e72-b8f9-b09016ca5070 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:51:10.746011 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fd282354-8490-4e72-b8f9-b09016ca5070 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.148612 Jul 14 14:51:10.747593 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2253/4452] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 14:51:10 2022] GET /compute/v2.1/servers => generated 683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:10.754302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-22c0ecae-08e9-46c7-ab09-6a764cde9469 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '.version_select at 0x7fd6c5b5caf0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:10.979252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7165bcb0-6075-4713-ab72-9ccaa50e0844 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:10.988023 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7165bcb0-6075-4713-ab72-9ccaa50e0844 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 200 len: 1292 microversion: 2.1 time: 0.846286 Jul 14 14:51:10.995644 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2200/4453] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:10 2022] GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 1292 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:11.007417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9ad2c7be-ca43-49da-b04b-34ccd3f93735 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:11.015730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9ad2c7be-ca43-49da-b04b-34ccd3f93735 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:11.016260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.compute.servers [None req-9ad2c7be-ca43-49da-b04b-34ccd3f93735 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Removing options 'limit' from query {{(pid=119511) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} Jul 14 14:51:11.019966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9ad2c7be-ca43-49da-b04b-34ccd3f93735 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Searching by: {'deleted': False, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:51:11.039369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ad2c7be-ca43-49da-b04b-34ccd3f93735 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:11.040298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ad2c7be-ca43-49da-b04b-34ccd3f93735 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:11.043032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ad2c7be-ca43-49da-b04b-34ccd3f93735 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:11.047673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ad2c7be-ca43-49da-b04b-34ccd3f93735 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:11.112486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-9ad2c7be-ca43-49da-b04b-34ccd3f93735 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:51:11.123311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:11.221763 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9ad2c7be-ca43-49da-b04b-34ccd3f93735 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.223152 Jul 14 14:51:11.236755 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2201/4454] 10.222.0.81 () {58 vars in 1143 bytes} [Thu Jul 14 14:51:10 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:11.249732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d5ae3f8-0ee5-4d04-ac15-a6eeed289730 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d5ae3f8-0ee5-4d04-ac15-a6eeed289730 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Request method failure captured: Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C0r6uZyuMywDqKG6jub132IiQk4HUBPLsPBejCIKTt7npEa7nhvZ38Mezaogm4YreEBYQgUgQTcnCRruriIXwzloDtbNV_AO7MRmSLt0qcQWPmg7cuP7orKoaOi8UyBY6hBNzWGRz0fpoWctmdcBJEQMOGule9XeYPtCXEbpNRo_g8 Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bffe657f18ef47f7ac5ca5e1af866b1f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}] Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87a17c8fbc9946eba3ac613ee006aac1 Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: action_args: {} Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi '-1' Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 14 14:51:11.262079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d5ae3f8-0ee5-4d04-ac15-a6eeed289730 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:11.270821 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6d5ae3f8-0ee5-4d04-ac15-a6eeed289730 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.024916 Jul 14 14:51:11.277873 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2202/4455] 10.222.0.81 () {58 vars in 1141 bytes} [Thu Jul 14 14:51:11 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:51:11.290587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-73692170-85a3-4129-8053-41e6f3b1364b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-73692170-85a3-4129-8053-41e6f3b1364b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Request method failure captured: Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C0r6uZyuMywDqKG6jub132IiQk4HUBPLsPBejCIKTt7npEa7nhvZ38Mezaogm4YreEBYQgUgQTcnCRruriIXwzloDtbNV_AO7MRmSLt0qcQWPmg7cuP7orKoaOi8UyBY6hBNzWGRz0fpoWctmdcBJEQMOGule9XeYPtCXEbpNRo_g8 Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bffe657f18ef47f7ac5ca5e1af866b1f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}] Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87a17c8fbc9946eba3ac613ee006aac1 Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: action_args: {} Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'testing' Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 14 14:51:11.299599 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 14 14:51:11.305053 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:11.313245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-73692170-85a3-4129-8053-41e6f3b1364b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:11.316404 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-73692170-85a3-4129-8053-41e6f3b1364b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.035507 Jul 14 14:51:11.325815 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2203/4456] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:51:11 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:51:11.345535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-68ba050a-7baa-4b3c-9e8b-6a4db4c5c4e8 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:11.360604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-68ba050a-7baa-4b3c-9e8b-6a4db4c5c4e8 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:11.361671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-68ba050a-7baa-4b3c-9e8b-6a4db4c5c4e8 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:51:11.382792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.compute.servers [None req-68ba050a-7baa-4b3c-9e8b-6a4db4c5c4e8 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Flavor 'non_existing_flavor' could not be found {{(pid=119511) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:338}} Jul 14 14:51:11.384369 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-68ba050a-7baa-4b3c-9e8b-6a4db4c5c4e8 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.057059 Jul 14 14:51:11.388114 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2204/4457] 10.222.0.81 () {58 vars in 1177 bytes} [Thu Jul 14 14:51:11 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:51:11.407273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-681705f5-cb89-4204-92be-a3b951f3625b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:11.420647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-681705f5-cb89-4204-92be-a3b951f3625b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:11.421621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-681705f5-cb89-4204-92be-a3b951f3625b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:51:11.439595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-681705f5-cb89-4204-92be-a3b951f3625b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:11.441446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-681705f5-cb89-4204-92be-a3b951f3625b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:11.443526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-681705f5-cb89-4204-92be-a3b951f3625b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:11.443976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-681705f5-cb89-4204-92be-a3b951f3625b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:12.265018 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-681705f5-cb89-4204-92be-a3b951f3625b tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.865000 Jul 14 14:51:12.279871 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2205/4458] 10.222.0.81 () {58 vars in 1173 bytes} [Thu Jul 14 14:51:11 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:51:12.284882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-96a73274-72cf-40f2-a65e-a27565818dfb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:12.285546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-96a73274-72cf-40f2-a65e-a27565818dfb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:12.287503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:12.307353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96a73274-72cf-40f2-a65e-a27565818dfb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:12.307819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96a73274-72cf-40f2-a65e-a27565818dfb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:12.308620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96a73274-72cf-40f2-a65e-a27565818dfb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:12.309121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96a73274-72cf-40f2-a65e-a27565818dfb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:13.646311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-96a73274-72cf-40f2-a65e-a27565818dfb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:13.661285 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-96a73274-72cf-40f2-a65e-a27565818dfb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 200 len: 1292 microversion: 2.1 time: 1.380182 Jul 14 14:51:13.662220 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2206/4459] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:12 2022] GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 1292 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:13.667058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2c4c072e-b975-4b8f-bb26-ca895ddebc41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:13.681233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2c4c072e-b975-4b8f-bb26-ca895ddebc41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:13.689593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2c4c072e-b975-4b8f-bb26-ca895ddebc41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:51:13.695288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c4c072e-b975-4b8f-bb26-ca895ddebc41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:13.695971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c4c072e-b975-4b8f-bb26-ca895ddebc41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:13.699428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c4c072e-b975-4b8f-bb26-ca895ddebc41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:13.700104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c4c072e-b975-4b8f-bb26-ca895ddebc41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:13.820463 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2c4c072e-b975-4b8f-bb26-ca895ddebc41 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.156773 Jul 14 14:51:13.821371 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2207/4460] 10.222.0.81 () {58 vars in 1183 bytes} [Thu Jul 14 14:51:13 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:51:13.827524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-04d671fc-611f-4543-aa35-51820379cd5a req-1ecde0bb-8afa-470c-a669-84576dffd1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc099f7a-cc72-418f-a1ab-34040ebb0275", "name": "network-vif-plugged", "status": "completed", "tag": "7cf26e3d-566a-483e-9cdb-ae816129726c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:13.838251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-04d671fc-611f-4543-aa35-51820379cd5a req-1ecde0bb-8afa-470c-a669-84576dffd1a3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:13.839042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-04d671fc-611f-4543-aa35-51820379cd5a req-1ecde0bb-8afa-470c-a669-84576dffd1a3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:13.852886 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-04d671fc-611f-4543-aa35-51820379cd5a req-1ecde0bb-8afa-470c-a669-84576dffd1a3 service nova] Creating event network-vif-plugged:7cf26e3d-566a-483e-9cdb-ae816129726c for instance bc099f7a-cc72-418f-a1ab-34040ebb0275 on n-h2-767704-28 Jul 14 14:51:13.861475 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-04d671fc-611f-4543-aa35-51820379cd5a req-1ecde0bb-8afa-470c-a669-84576dffd1a3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038587 Jul 14 14:51:13.866037 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2208/4461] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:13.875129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ffaafb4-e34a-40c3-ab31-055219a41a56 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:13.879710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ffaafb4-e34a-40c3-ab31-055219a41a56 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:13.880880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ffaafb4-e34a-40c3-ab31-055219a41a56 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Searching by: {'deleted': False, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:51:13.890205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ffaafb4-e34a-40c3-ab31-055219a41a56 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:13.890958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ffaafb4-e34a-40c3-ab31-055219a41a56 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:13.892883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ffaafb4-e34a-40c3-ab31-055219a41a56 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:13.893549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ffaafb4-e34a-40c3-ab31-055219a41a56 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:13.937262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-2ffaafb4-e34a-40c3-ab31-055219a41a56 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:51:14.008203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ffaafb4-e34a-40c3-ab31-055219a41a56 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:14.018562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ffaafb4-e34a-40c3-ab31-055219a41a56 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:14.019271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ffaafb4-e34a-40c3-ab31-055219a41a56 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:14.507924 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ffaafb4-e34a-40c3-ab31-055219a41a56 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.637902 Jul 14 14:51:14.510651 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2209/4462] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 14:51:13 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:14.530064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0ae000f5-b131-473d-8643-03fe9b2fc31b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:14.537886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0ae000f5-b131-473d-8643-03fe9b2fc31b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:14.565084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ae000f5-b131-473d-8643-03fe9b2fc31b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:14.567188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ae000f5-b131-473d-8643-03fe9b2fc31b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:14.580911 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-22c0ecae-08e9-46c7-ab09-6a764cde9469 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "DELETE /compute/v2.1/os-floating-ips/2db71c8d-a497-4733-b83d-969445c1b9ff" status: 202 len: 0 microversion: 2.1 time: 3.830659 Jul 14 14:51:14.583074 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2254/4463] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:51:10 2022] DELETE /compute/v2.1/os-floating-ips/2db71c8d-a497-4733-b83d-969445c1b9ff => generated 0 bytes in 3833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:14.590022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ae000f5-b131-473d-8643-03fe9b2fc31b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:14.595736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ae000f5-b131-473d-8643-03fe9b2fc31b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:14.595966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7cecdfd5-1026-4302-89bc-d40dbd2c9e02 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:14.623280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7cecdfd5-1026-4302-89bc-d40dbd2c9e02 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:14.631794 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7cecdfd5-1026-4302-89bc-d40dbd2c9e02 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.042497 Jul 14 14:51:14.635167 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2255/4464] 10.222.0.81 () {58 vars in 1177 bytes} [Thu Jul 14 14:51:14 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:51:14.648881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7352cfcc-66aa-4381-8e7e-b0961f5a0155 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '.version_select at 0x7fd6c4f92670>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:14.835431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-0ae000f5-b131-473d-8643-03fe9b2fc31b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lazy-loading 'services' on Instance uuid fba14e7e-dbff-47d0-9515-3acd4c797b52 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:51:15.004814 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0ae000f5-b131-473d-8643-03fe9b2fc31b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments/341d7c82-1fa4-4680-abec-d85c687b801a" status: 202 len: 0 microversion: 2.1 time: 0.478158 Jul 14 14:51:15.014956 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2210/4465] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 14:51:14 2022] DELETE /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments/341d7c82-1fa4-4680-abec-d85c687b801a => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:15.036030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-94d3e03a-d19b-45a8-9514-b43ec91df5bd tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:15.063099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-94d3e03a-d19b-45a8-9514-b43ec91df5bd tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:15.068344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-94d3e03a-d19b-45a8-9514-b43ec91df5bd tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Searching by: {'deleted': False, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:51:15.099673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94d3e03a-d19b-45a8-9514-b43ec91df5bd tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.100237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94d3e03a-d19b-45a8-9514-b43ec91df5bd tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.100976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94d3e03a-d19b-45a8-9514-b43ec91df5bd tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.110942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94d3e03a-d19b-45a8-9514-b43ec91df5bd tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.194369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-94d3e03a-d19b-45a8-9514-b43ec91df5bd tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:51:15.295178 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-94d3e03a-d19b-45a8-9514-b43ec91df5bd tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.277792 Jul 14 14:51:15.295839 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2211/4466] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 14:51:15 2022] GET /compute/v2.1/servers => generated 683 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:15.312591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1626390c-e4da-4a67-b72b-afd3a622e73d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:15.313803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1626390c-e4da-4a67-b72b-afd3a622e73d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:15.331793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1626390c-e4da-4a67-b72b-afd3a622e73d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.332278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1626390c-e4da-4a67-b72b-afd3a622e73d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.335920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1626390c-e4da-4a67-b72b-afd3a622e73d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.336850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1626390c-e4da-4a67-b72b-afd3a622e73d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.596016 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7352cfcc-66aa-4381-8e7e-b0961f5a0155 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "DELETE /compute/v2.1/os-security-groups/422b676a-16a3-41f6-bd40-44de8e088429" status: 202 len: 0 microversion: 2.1 time: 0.958351 Jul 14 14:51:15.596710 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2256/4467] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 14:51:14 2022] DELETE /compute/v2.1/os-security-groups/422b676a-16a3-41f6-bd40-44de8e088429 => generated 0 bytes in 960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:15.605381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-df5d1bfc-7a7a-4e6d-9b0d-b2d906adedbf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:15.606646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-df5d1bfc-7a7a-4e6d-9b0d-b2d906adedbf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:15.623692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df5d1bfc-7a7a-4e6d-9b0d-b2d906adedbf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.625415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df5d1bfc-7a7a-4e6d-9b0d-b2d906adedbf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.627847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df5d1bfc-7a7a-4e6d-9b0d-b2d906adedbf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.628566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df5d1bfc-7a7a-4e6d-9b0d-b2d906adedbf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.679935 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-df5d1bfc-7a7a-4e6d-9b0d-b2d906adedbf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079135 Jul 14 14:51:15.681185 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2257/4468] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:51:15 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:15.688320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-50df1f75-5a11-4256-9665-04401c621b89 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:15.689242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-50df1f75-5a11-4256-9665-04401c621b89 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 1862a1d7-e79f-43fc-9004-4201bf86833a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:15.699571 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50df1f75-5a11-4256-9665-04401c621b89 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.700545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50df1f75-5a11-4256-9665-04401c621b89 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.701800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50df1f75-5a11-4256-9665-04401c621b89 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.703222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50df1f75-5a11-4256-9665-04401c621b89 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.707926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1626390c-e4da-4a67-b72b-afd3a622e73d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:15.717692 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1626390c-e4da-4a67-b72b-afd3a622e73d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 200 len: 1292 microversion: 2.1 time: 0.414123 Jul 14 14:51:15.721326 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2212/4469] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:15 2022] GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 1292 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-50df1f75-5a11-4256-9665-04401c621b89 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] HTTP exception thrown: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-50df1f75-5a11-4256-9665-04401c621b89 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Request method failure captured: Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a HTTP/1.1 Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C0r6uZyuMywDqKG6jub132IiQk4HUBPLsPBejCIKTt7npEa7nhvZ38Mezaogm4YreEBYQgUgQTcnCRruriIXwzloDtbNV_AO7MRmSLt0qcQWPmg7cuP7orKoaOi8UyBY6hBNzWGRz0fpoWctmdcBJEQMOGule9XeYPtCXEbpNRo_g8 Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bffe657f18ef47f7ac5ca5e1af866b1f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}] Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87a17c8fbc9946eba3ac613ee006aac1 Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '1862a1d7-e79f-43fc-9004-4201bf86833a'} Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:51:15.730768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-50df1f75-5a11-4256-9665-04401c621b89 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Returning 404 to user: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-50df1f75-5a11-4256-9665-04401c621b89 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a" status: 404 len: 111 microversion: 2.1 time: 0.045485 Jul 14 14:51:15.738025 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2258/4470] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:15 2022] DELETE /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:15.741837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-568ea05a-43e2-4ddb-b3a5-e84cdd4e2195 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:15.744730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-568ea05a-43e2-4ddb-b3a5-e84cdd4e2195 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:15.755609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80e86c73-e661-46f9-9b38-94863c40b164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:15.756495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80e86c73-e661-46f9-9b38-94863c40b164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 2d9e551c-4faa-4c2d-ad28-eda57a1ac938] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:15.766462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-568ea05a-43e2-4ddb-b3a5-e84cdd4e2195 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.767158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-568ea05a-43e2-4ddb-b3a5-e84cdd4e2195 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.768558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-568ea05a-43e2-4ddb-b3a5-e84cdd4e2195 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.769466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-568ea05a-43e2-4ddb-b3a5-e84cdd4e2195 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.787392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80e86c73-e661-46f9-9b38-94863c40b164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.788178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80e86c73-e661-46f9-9b38-94863c40b164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.791631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80e86c73-e661-46f9-9b38-94863c40b164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.792306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80e86c73-e661-46f9-9b38-94863c40b164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.876198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80e86c73-e661-46f9-9b38-94863c40b164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 2d9e551c-4faa-4c2d-ad28-eda57a1ac938] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:51:15.889930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-568ea05a-43e2-4ddb-b3a5-e84cdd4e2195 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:51:15.980195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:16.107419 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80e86c73-e661-46f9-9b38-94863c40b164 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938" status: 204 len: 0 microversion: 2.1 time: 0.362660 Jul 14 14:51:16.109531 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2213/4471] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:15 2022] DELETE /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:16.136984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4c9af4f-0795-4f44-9264-062493c8c90c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:16.143456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b4c9af4f-0795-4f44-9264-062493c8c90c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:16.145297 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-568ea05a-43e2-4ddb-b3a5-e84cdd4e2195 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "DELETE /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 204 len: 0 microversion: 2.1 time: 0.415016 Jul 14 14:51:16.151065 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2259/4472] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:15 2022] DELETE /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:16.172315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4c9af4f-0795-4f44-9264-062493c8c90c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.172882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4c9af4f-0795-4f44-9264-062493c8c90c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:16.173899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4c9af4f-0795-4f44-9264-062493c8c90c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.174433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4c9af4f-0795-4f44-9264-062493c8c90c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:16.176214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d19616db-c0f2-4d81-b94f-428a34f289c3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:16.177411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d19616db-c0f2-4d81-b94f-428a34f289c3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:16.208908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d19616db-c0f2-4d81-b94f-428a34f289c3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.222091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d19616db-c0f2-4d81-b94f-428a34f289c3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:16.223390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d19616db-c0f2-4d81-b94f-428a34f289c3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.223851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d19616db-c0f2-4d81-b94f-428a34f289c3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:16.251173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b4c9af4f-0795-4f44-9264-062493c8c90c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:51:16.478428 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b4c9af4f-0795-4f44-9264-062493c8c90c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "DELETE /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 204 len: 0 microversion: 2.1 time: 0.362786 Jul 14 14:51:16.486588 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2214/4473] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:16 2022] DELETE /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:16.495037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e6423b17-af93-45bf-8121-70e50b7b36a1 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:16.498917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e6423b17-af93-45bf-8121-70e50b7b36a1 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 1862a1d7-e79f-43fc-9004-4201bf86833a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:16.523941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6423b17-af93-45bf-8121-70e50b7b36a1 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.526476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6423b17-af93-45bf-8121-70e50b7b36a1 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:16.530588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6423b17-af93-45bf-8121-70e50b7b36a1 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.531320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6423b17-af93-45bf-8121-70e50b7b36a1 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:16.564512 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-e6423b17-af93-45bf-8121-70e50b7b36a1 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] HTTP exception thrown: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e6423b17-af93-45bf-8121-70e50b7b36a1 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Request method failure captured: Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a HTTP/1.1 Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C0r6uZyuMywDqKG6jub132IiQk4HUBPLsPBejCIKTt7npEa7nhvZ38Mezaogm4YreEBYQgUgQTcnCRruriIXwzloDtbNV_AO7MRmSLt0qcQWPmg7cuP7orKoaOi8UyBY6hBNzWGRz0fpoWctmdcBJEQMOGule9XeYPtCXEbpNRo_g8 Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bffe657f18ef47f7ac5ca5e1af866b1f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}] Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87a17c8fbc9946eba3ac613ee006aac1 Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '1862a1d7-e79f-43fc-9004-4201bf86833a'} Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:16.569622 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:16.574965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:16.574965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:16.574965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:16.574965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:16.574965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:16.574965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. Jul 14 14:51:16.574965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:16.581806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e6423b17-af93-45bf-8121-70e50b7b36a1 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Returning 404 to user: Instance 1862a1d7-e79f-43fc-9004-4201bf86833a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:16.583122 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e6423b17-af93-45bf-8121-70e50b7b36a1 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a" status: 404 len: 111 microversion: 2.1 time: 0.094549 Jul 14 14:51:16.589258 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2215/4474] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:16 2022] GET /compute/v2.1/servers/1862a1d7-e79f-43fc-9004-4201bf86833a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:16.628809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-640907db-b35a-4004-bda9-485af004575c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:16.631765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-640907db-b35a-4004-bda9-485af004575c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 2d9e551c-4faa-4c2d-ad28-eda57a1ac938] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:16.650446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-640907db-b35a-4004-bda9-485af004575c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.651152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-640907db-b35a-4004-bda9-485af004575c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:16.656128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-640907db-b35a-4004-bda9-485af004575c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.657111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-640907db-b35a-4004-bda9-485af004575c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.221367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d19616db-c0f2-4d81-b94f-428a34f289c3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:17.230009 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d19616db-c0f2-4d81-b94f-428a34f289c3 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1510 microversion: 2.1 time: 1.077291 Jul 14 14:51:17.230534 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2260/4475] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:16 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1510 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:17.253191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c8d9a924-f7ea-4e38-946e-da1708e37aa7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:17.255642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c8d9a924-f7ea-4e38-946e-da1708e37aa7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:17.271767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8d9a924-f7ea-4e38-946e-da1708e37aa7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:17.272249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8d9a924-f7ea-4e38-946e-da1708e37aa7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.273093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8d9a924-f7ea-4e38-946e-da1708e37aa7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:17.273549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8d9a924-f7ea-4e38-946e-da1708e37aa7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.369081 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c8d9a924-f7ea-4e38-946e-da1708e37aa7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137400 Jul 14 14:51:17.369695 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2261/4476] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:51:17 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:17.385168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-053a00e3-c799-4d0b-9cee-9e6793f080b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:17.385556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-053a00e3-c799-4d0b-9cee-9e6793f080b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:17.406091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-053a00e3-c799-4d0b-9cee-9e6793f080b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:17.406812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-053a00e3-c799-4d0b-9cee-9e6793f080b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.407800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-053a00e3-c799-4d0b-9cee-9e6793f080b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:17.408419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-053a00e3-c799-4d0b-9cee-9e6793f080b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.476122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-640907db-b35a-4004-bda9-485af004575c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:17.502258 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-640907db-b35a-4004-bda9-485af004575c tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938" status: 200 len: 1522 microversion: 2.1 time: 0.894003 Jul 14 14:51:17.502870 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2216/4477] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:16 2022] GET /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938 => generated 1522 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:17.661074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f628983-1f27-4cb1-b815-48afbe7f2e69 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Action: 'create', calling method: .version_select at 0x7fd6c45cdee0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-2059525787", "policies": ["affinity"]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:17.700821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-1f628983-1f27-4cb1-b815-48afbe7f2e69 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:17.717208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-1f628983-1f27-4cb1-b815-48afbe7f2e69 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:17.846192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-1f628983-1f27-4cb1-b815-48afbe7f2e69 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:17.850547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-053a00e3-c799-4d0b-9cee-9e6793f080b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:17.855247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-1f628983-1f27-4cb1-b815-48afbe7f2e69 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:17.864578 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-053a00e3-c799-4d0b-9cee-9e6793f080b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 200 len: 1473 microversion: 2.1 time: 0.493740 Jul 14 14:51:17.869257 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2262/4478] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:17 2022] GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 1473 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:17.910632 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f628983-1f27-4cb1-b815-48afbe7f2e69 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.406630 Jul 14 14:51:17.933010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-109b8bc0-264a-49fb-b69c-0c347f241291 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Action: 'create', calling method: .version_select at 0x7fd6c5aa9550>, body: {"server_group": {"name": "tempest-server-group-1665256611", "policies": ["affinity"]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:17.939713 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2217/4479] 10.222.0.81 () {60 vars in 1173 bytes} [Thu Jul 14 14:51:17 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:17.981915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-109b8bc0-264a-49fb-b69c-0c347f241291 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:17.996880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-109b8bc0-264a-49fb-b69c-0c347f241291 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:18.128731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-109b8bc0-264a-49fb-b69c-0c347f241291 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:18.154262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-109b8bc0-264a-49fb-b69c-0c347f241291 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:18.198293 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-109b8bc0-264a-49fb-b69c-0c347f241291 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.274381 Jul 14 14:51:18.198934 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2263/4480] 10.222.0.81 () {60 vars in 1172 bytes} [Thu Jul 14 14:51:17 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:18.210728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3ff7cb04-59cf-4348-857e-2bb215fbcfc3 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Action: 'create', calling method: .version_select at 0x7fd6c567e940>, body: {"server_group": {"name": "tempest-server-group-1665256611", "policies": ["affinity"]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:18.226070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1364736071", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:18.273539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-3ff7cb04-59cf-4348-857e-2bb215fbcfc3 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:18.292973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-3ff7cb04-59cf-4348-857e-2bb215fbcfc3 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:18.365890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] validate_networks() for [('525f1693-8842-4191-b231-7d2db21bdaf8', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:18.447403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-3ff7cb04-59cf-4348-857e-2bb215fbcfc3 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:18.473396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-3ff7cb04-59cf-4348-857e-2bb215fbcfc3 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:18.508225 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3ff7cb04-59cf-4348-857e-2bb215fbcfc3 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.301651 Jul 14 14:51:18.512502 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2218/4481] 10.222.0.81 () {60 vars in 1172 bytes} [Thu Jul 14 14:51:18 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:18.517802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-78b04503-22c5-420a-ae36-9996de244343 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:18.518423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-78b04503-22c5-420a-ae36-9996de244343 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:18.539081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78b04503-22c5-420a-ae36-9996de244343 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:18.539449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78b04503-22c5-420a-ae36-9996de244343 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:18.540447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78b04503-22c5-420a-ae36-9996de244343 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:18.541085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78b04503-22c5-420a-ae36-9996de244343 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:19.200445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-78b04503-22c5-420a-ae36-9996de244343 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:19.229530 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-78b04503-22c5-420a-ae36-9996de244343 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1510 microversion: 2.1 time: 0.710585 Jul 14 14:51:19.245754 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2219/4482] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:18 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1510 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:19.281092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b9922d33-74ad-4ad4-9e2c-ea599d1cc0d6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:19.281092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b9922d33-74ad-4ad4-9e2c-ea599d1cc0d6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:19.296544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9922d33-74ad-4ad4-9e2c-ea599d1cc0d6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:19.296887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9922d33-74ad-4ad4-9e2c-ea599d1cc0d6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:19.297849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9922d33-74ad-4ad4-9e2c-ea599d1cc0d6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:19.304400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b9922d33-74ad-4ad4-9e2c-ea599d1cc0d6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:19.388492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:19.401826 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b9922d33-74ad-4ad4-9e2c-ea599d1cc0d6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139174 Jul 14 14:51:19.402518 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2220/4483] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:51:19 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:19.416895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-195279f6-1a8e-4d5a-b064-fb0ea02d7b4a tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:19.476895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:19.502238 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-195279f6-1a8e-4d5a-b064-fb0ea02d7b4a tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/0a226700-0de4-465c-8c98-c2572314a64b" status: 204 len: 0 microversion: 2.1 time: 0.094475 Jul 14 14:51:19.508742 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2221/4484] 10.222.0.81 () {58 vars in 1265 bytes} [Thu Jul 14 14:51:19 2022] DELETE /compute/v2.1/os-server-groups/0a226700-0de4-465c-8c98-c2572314a64b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:19.523915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2f7fa6a1-6784-4282-8839-0c26a3b6c846 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:19.524544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2f7fa6a1-6784-4282-8839-0c26a3b6c846 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 2d9e551c-4faa-4c2d-ad28-eda57a1ac938] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:19.544916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f7fa6a1-6784-4282-8839-0c26a3b6c846 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:19.545311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f7fa6a1-6784-4282-8839-0c26a3b6c846 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:19.550183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f7fa6a1-6784-4282-8839-0c26a3b6c846 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:19.550658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f7fa6a1-6784-4282-8839-0c26a3b6c846 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:20.669098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:20.904728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2f7fa6a1-6784-4282-8839-0c26a3b6c846 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:20.916646 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2f7fa6a1-6784-4282-8839-0c26a3b6c846 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938" status: 200 len: 1522 microversion: 2.1 time: 1.406000 Jul 14 14:51:20.925326 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2222/4485] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:19 2022] GET /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938 => generated 1522 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:20.934081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cc1b0303-9f76-4ead-b4b1-5a55b5b8a1c9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:20.970447 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cc1b0303-9f76-4ead-b4b1-5a55b5b8a1c9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.043580 Jul 14 14:51:20.974912 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2223/4486] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:51:20 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:20.987236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ddfdc21d-a20d-494d-b302-f6fcbab2ae18 req-2bd774c9-52a2-40b5-8f9f-aa9b97551972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb68e36c-3f0c-4567-bf71-cee172d26584", "tag": "b740bd7f-b45f-434b-b252-0a0b8ca2850b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:21.008939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ddfdc21d-a20d-494d-b302-f6fcbab2ae18 req-2bd774c9-52a2-40b5-8f9f-aa9b97551972 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.011115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ddfdc21d-a20d-494d-b302-f6fcbab2ae18 req-2bd774c9-52a2-40b5-8f9f-aa9b97551972 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.040168 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ddfdc21d-a20d-494d-b302-f6fcbab2ae18 req-2bd774c9-52a2-40b5-8f9f-aa9b97551972 service nova] Creating event network-changed:b740bd7f-b45f-434b-b252-0a0b8ca2850b for instance cb68e36c-3f0c-4567-bf71-cee172d26584 on n-h1-767704-28 Jul 14 14:51:21.048890 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ddfdc21d-a20d-494d-b302-f6fcbab2ae18 req-2bd774c9-52a2-40b5-8f9f-aa9b97551972 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072308 Jul 14 14:51:21.050154 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2224/4487] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:21.057250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-013864fe-ec3c-4c93-b516-9187d6793835 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:21.066784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-013864fe-ec3c-4c93-b516-9187d6793835 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:21.074842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-013864fe-ec3c-4c93-b516-9187d6793835 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.078533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-013864fe-ec3c-4c93-b516-9187d6793835 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.089307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-013864fe-ec3c-4c93-b516-9187d6793835 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.090023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-013864fe-ec3c-4c93-b516-9187d6793835 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.342561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:21.343149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:21.343634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:21.344051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:21.344468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:21.366395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.369319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.370235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.370695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.440705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:21.461760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for user 4e3af45ec76c4a0b8dd03dcff6802f3c and project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:21.492770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:21.503790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 0678eeec-7eca-4d88-900e-7eeac0ef7303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:21.579641 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c74e3d39-c056-475e-8b24-0258864b52dd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.357500 Jul 14 14:51:21.581147 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2264/4488] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:51:21.588585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b7376519-86e2-4330-9968-57ff28a084d7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:21.589836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b7376519-86e2-4330-9968-57ff28a084d7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:21.599676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7376519-86e2-4330-9968-57ff28a084d7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.600486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7376519-86e2-4330-9968-57ff28a084d7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.601505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7376519-86e2-4330-9968-57ff28a084d7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.602121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7376519-86e2-4330-9968-57ff28a084d7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.706318 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b7376519-86e2-4330-9968-57ff28a084d7 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123232 Jul 14 14:51:21.707939 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2265/4489] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:51:21 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:21.713594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dade0712-1253-49d3-99a2-150f990c7dee tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:21.762482 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dade0712-1253-49d3-99a2-150f990c7dee tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/099d415f-c604-4558-949f-52ce328f0f04" status: 204 len: 0 microversion: 2.1 time: 0.053025 Jul 14 14:51:21.764406 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2266/4490] 10.222.0.81 () {58 vars in 1265 bytes} [Thu Jul 14 14:51:21 2022] DELETE /compute/v2.1/os-server-groups/099d415f-c604-4558-949f-52ce328f0f04 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:21.773675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8df3eebf-f5f1-4724-94a2-5f7eb07c692b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:21.775624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8df3eebf-f5f1-4724-94a2-5f7eb07c692b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 0678eeec-7eca-4d88-900e-7eeac0ef7303] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:21.832804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8df3eebf-f5f1-4724-94a2-5f7eb07c692b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 0678eeec-7eca-4d88-900e-7eeac0ef7303] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:51:22.422250 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8df3eebf-f5f1-4724-94a2-5f7eb07c692b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0678eeec-7eca-4d88-900e-7eeac0ef7303" status: 204 len: 0 microversion: 2.1 time: 0.653231 Jul 14 14:51:22.425130 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2267/4491] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:21 2022] DELETE /compute/v2.1/servers/0678eeec-7eca-4d88-900e-7eeac0ef7303 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:22.451914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-87a17586-71c8-4298-962a-7643531ef238 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:22.498438 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-87a17586-71c8-4298-962a-7643531ef238 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.065375 Jul 14 14:51:22.503561 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2268/4492] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:51:22 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:22.516324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05b20a1c-0d40-4125-8c0b-90fbbda34f20 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:22.521374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-05b20a1c-0d40-4125-8c0b-90fbbda34f20 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 2d9e551c-4faa-4c2d-ad28-eda57a1ac938] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:22.553018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05b20a1c-0d40-4125-8c0b-90fbbda34f20 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:22.554771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05b20a1c-0d40-4125-8c0b-90fbbda34f20 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:22.557246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05b20a1c-0d40-4125-8c0b-90fbbda34f20 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:22.558340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05b20a1c-0d40-4125-8c0b-90fbbda34f20 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:22.640497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-013864fe-ec3c-4c93-b516-9187d6793835 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:22.655865 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-013864fe-ec3c-4c93-b516-9187d6793835 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1510 microversion: 2.1 time: 1.601286 Jul 14 14:51:22.661158 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2225/4493] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:21 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1510 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:22.679437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9d60b7e5-fccb-43ba-b5b3-6f9a91a2d36d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:22.697547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9d60b7e5-fccb-43ba-b5b3-6f9a91a2d36d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 0678eeec-7eca-4d88-900e-7eeac0ef7303] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:22.739458 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-9d60b7e5-fccb-43ba-b5b3-6f9a91a2d36d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9d60b7e5-fccb-43ba-b5b3-6f9a91a2d36d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/0678eeec-7eca-4d88-900e-7eeac0ef7303 HTTP/1.1 Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0678eeec-7eca-4d88-900e-7eeac0ef7303'} Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:22.748934 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:51:22.753668 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:22.756693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9d60b7e5-fccb-43ba-b5b3-6f9a91a2d36d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:22.757787 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9d60b7e5-fccb-43ba-b5b3-6f9a91a2d36d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/0678eeec-7eca-4d88-900e-7eeac0ef7303" status: 404 len: 111 microversion: 2.1 time: 0.092751 Jul 14 14:51:22.758959 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2226/4494] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:22 2022] GET /compute/v2.1/servers/0678eeec-7eca-4d88-900e-7eeac0ef7303 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:22.770211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-11f7540e-1aa3-40f8-9215-3b363b71799d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Action: 'create', calling method: .version_select at 0x7fd6c4586e50>, body: {"server_group": {"name": "tempest-server-group-296580900", "policies": ["affinity"]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:22.825033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-11f7540e-1aa3-40f8-9215-3b363b71799d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:22.844181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-11f7540e-1aa3-40f8-9215-3b363b71799d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:22.960288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-11f7540e-1aa3-40f8-9215-3b363b71799d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:22.980357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-11f7540e-1aa3-40f8-9215-3b363b71799d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:23.078524 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-11f7540e-1aa3-40f8-9215-3b363b71799d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.288613 Jul 14 14:51:23.082540 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2227/4495] 10.222.0.81 () {60 vars in 1172 bytes} [Thu Jul 14 14:51:22 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:23.102603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ee13dc81-143e-49d0-a286-3e47d7cc150a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:23.109993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ee13dc81-143e-49d0-a286-3e47d7cc150a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:23.126944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee13dc81-143e-49d0-a286-3e47d7cc150a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.130141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee13dc81-143e-49d0-a286-3e47d7cc150a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.132367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee13dc81-143e-49d0-a286-3e47d7cc150a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.134898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee13dc81-143e-49d0-a286-3e47d7cc150a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.225194 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ee13dc81-143e-49d0-a286-3e47d7cc150a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139748 Jul 14 14:51:23.226531 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2228/4496] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:51:23 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:23.235215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-801008977", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "525f1693-8842-4191-b231-7d2db21bdaf8"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:23.323289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] validate_networks() for [('525f1693-8842-4191-b231-7d2db21bdaf8', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:23.608753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-05b20a1c-0d40-4125-8c0b-90fbbda34f20 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87a17c8fbc9946eba3ac613ee006aac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffe657f18ef47f7ac5ca5e1af866b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:23.623377 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-05b20a1c-0d40-4125-8c0b-90fbbda34f20 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938" status: 200 len: 1522 microversion: 2.1 time: 1.117132 Jul 14 14:51:23.629838 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2269/4497] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:22 2022] GET /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938 => generated 1522 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:23.673058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a0a995e1-03cb-41eb-86bd-6f835dd8a707 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:23.738691 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a0a995e1-03cb-41eb-86bd-6f835dd8a707 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/ea859a5c-0540-4043-9f6a-68973eccfae5" status: 204 len: 0 microversion: 2.1 time: 0.105568 Jul 14 14:51:23.740035 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2270/4498] 10.222.0.81 () {58 vars in 1265 bytes} [Thu Jul 14 14:51:23 2022] DELETE /compute/v2.1/os-server-groups/ea859a5c-0540-4043-9f6a-68973eccfae5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:23.749748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-16d62409-9624-47e1-9870-c0194b56ba08 req-ee7bc1d4-f9c2-4201-ac93-03ac4d4471b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082e1d34-2688-4533-9c47-2ac47840b2a3", "name": "network-vif-deleted", "tag": "04bd9d17-5883-497e-acba-aa0a7f666d1d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:23.766852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:23.769598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-16d62409-9624-47e1-9870-c0194b56ba08 req-ee7bc1d4-f9c2-4201-ac93-03ac4d4471b5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.770255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-16d62409-9624-47e1-9870-c0194b56ba08 req-ee7bc1d4-f9c2-4201-ac93-03ac4d4471b5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.799528 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-16d62409-9624-47e1-9870-c0194b56ba08 req-ee7bc1d4-f9c2-4201-ac93-03ac4d4471b5 service nova] Creating event network-vif-deleted:04bd9d17-5883-497e-acba-aa0a7f666d1d for instance 082e1d34-2688-4533-9c47-2ac47840b2a3 on n-h2-767704-28 Jul 14 14:51:23.819332 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-16d62409-9624-47e1-9870-c0194b56ba08 req-ee7bc1d4-f9c2-4201-ac93-03ac4d4471b5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075556 Jul 14 14:51:23.823312 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2271/4499] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:23.836333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-386c9aa3-2eab-4279-b636-72bbc46a006a req-161847a2-0692-41e3-a589-36dc4e57f342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9e551c-4faa-4c2d-ad28-eda57a1ac938", "name": "network-vif-deleted", "tag": "38395a6d-0a57-4fce-b5e0-3f15cedc9d3f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:23.847193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-386c9aa3-2eab-4279-b636-72bbc46a006a req-161847a2-0692-41e3-a589-36dc4e57f342 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.847906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-386c9aa3-2eab-4279-b636-72bbc46a006a req-161847a2-0692-41e3-a589-36dc4e57f342 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.862544 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-386c9aa3-2eab-4279-b636-72bbc46a006a req-161847a2-0692-41e3-a589-36dc4e57f342 service nova] Creating event network-vif-deleted:38395a6d-0a57-4fce-b5e0-3f15cedc9d3f for instance 2d9e551c-4faa-4c2d-ad28-eda57a1ac938 on n-h1-767704-28 Jul 14 14:51:23.869934 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-386c9aa3-2eab-4279-b636-72bbc46a006a req-161847a2-0692-41e3-a589-36dc4e57f342 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044575 Jul 14 14:51:23.870855 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2272/4500] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:23.878941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-55ba1af4-dc3b-45db-9382-e24d86bb1b59 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:23.879897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-55ba1af4-dc3b-45db-9382-e24d86bb1b59 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:23.889568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55ba1af4-dc3b-45db-9382-e24d86bb1b59 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.890850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55ba1af4-dc3b-45db-9382-e24d86bb1b59 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.891993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55ba1af4-dc3b-45db-9382-e24d86bb1b59 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.892438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55ba1af4-dc3b-45db-9382-e24d86bb1b59 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.962900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55ba1af4-dc3b-45db-9382-e24d86bb1b59 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.964386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55ba1af4-dc3b-45db-9382-e24d86bb1b59 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.966059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-55ba1af4-dc3b-45db-9382-e24d86bb1b59 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lazy-loading 'fault' on Instance uuid 18c804f5-bc58-41f2-97a5-c19ce7cb7538 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:51:24.100618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-55ba1af4-dc3b-45db-9382-e24d86bb1b59 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918848bbb5f1490aa4f348037735e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a2d361c8364c908f6147aa58322173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:24.114353 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-55ba1af4-dc3b-45db-9382-e24d86bb1b59 tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 200 len: 1313 microversion: 2.1 time: 0.242061 Jul 14 14:51:24.116229 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2273/4501] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:23 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:24.125963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f10d4f69-f974-4e81-ad01-6d98b37dfb62 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:24.171321 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f10d4f69-f974-4e81-ad01-6d98b37dfb62 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.032683 Jul 14 14:51:24.171995 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2274/4502] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:51:24 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:24.193313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f93edb46-9c3b-4b03-82df-c543dfb08478 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Action: 'create', calling method: .version_select at 0x7fd6c5b3f700>, body: {"server_group": {"name": "tempest-server-group-1738155530", "policies": ["anti-affinity"]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:24.241388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f93edb46-9c3b-4b03-82df-c543dfb08478 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:24.258172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f93edb46-9c3b-4b03-82df-c543dfb08478 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:24.368862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f93edb46-9c3b-4b03-82df-c543dfb08478 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:24.382111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f93edb46-9c3b-4b03-82df-c543dfb08478 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_groups'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:24.417263 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f93edb46-9c3b-4b03-82df-c543dfb08478 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.236825 Jul 14 14:51:24.419802 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2275/4503] 10.222.0.81 () {60 vars in 1172 bytes} [Thu Jul 14 14:51:24 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:51:24.427610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31b9f6bb-6cc5-4ae3-b1ff-faaa568fe0ba tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:24.428554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-31b9f6bb-6cc5-4ae3-b1ff-faaa568fe0ba tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:24.446534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31b9f6bb-6cc5-4ae3-b1ff-faaa568fe0ba tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.449401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31b9f6bb-6cc5-4ae3-b1ff-faaa568fe0ba tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.450332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31b9f6bb-6cc5-4ae3-b1ff-faaa568fe0ba tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.450788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31b9f6bb-6cc5-4ae3-b1ff-faaa568fe0ba tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.532546 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-31b9f6bb-6cc5-4ae3-b1ff-faaa568fe0ba tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109438 Jul 14 14:51:24.533961 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2276/4504] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:51:24 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:24.549157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b4379ba5-17eb-42ae-b3a3-d06d7162d010 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:24.633776 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b4379ba5-17eb-42ae-b3a3-d06d7162d010 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/36c8faaa-469e-42a4-89a3-5dd36ef61d4b" status: 204 len: 0 microversion: 2.1 time: 0.098226 Jul 14 14:51:24.638997 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2277/4505] 10.222.0.81 () {58 vars in 1265 bytes} [Thu Jul 14 14:51:24 2022] DELETE /compute/v2.1/os-server-groups/36c8faaa-469e-42a4-89a3-5dd36ef61d4b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:24.657067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd4d52e9-8ff5-4479-9077-898856babc15 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:24.657960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cd4d52e9-8ff5-4479-9077-898856babc15 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 2d9e551c-4faa-4c2d-ad28-eda57a1ac938] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:24.682881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd4d52e9-8ff5-4479-9077-898856babc15 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.683906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd4d52e9-8ff5-4479-9077-898856babc15 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.686216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd4d52e9-8ff5-4479-9077-898856babc15 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.686859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd4d52e9-8ff5-4479-9077-898856babc15 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.716511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:24.717326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:24.717753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:24.718233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:24.718717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:24.727399 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-cd4d52e9-8ff5-4479-9077-898856babc15 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] HTTP exception thrown: Instance 2d9e551c-4faa-4c2d-ad28-eda57a1ac938 could not be found. Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd4d52e9-8ff5-4479-9077-898856babc15 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Request method failure captured: Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938 HTTP/1.1 Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C0r6uZyuMywDqKG6jub132IiQk4HUBPLsPBejCIKTt7npEa7nhvZ38Mezaogm4YreEBYQgUgQTcnCRruriIXwzloDtbNV_AO7MRmSLt0qcQWPmg7cuP7orKoaOi8UyBY6hBNzWGRz0fpoWctmdcBJEQMOGule9XeYPtCXEbpNRo_g8 Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bffe657f18ef47f7ac5ca5e1af866b1f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}] Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87a17c8fbc9946eba3ac613ee006aac1 Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 2d9e551c-4faa-4c2d-ad28-eda57a1ac938 could not be found. Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '2d9e551c-4faa-4c2d-ad28-eda57a1ac938'} Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d9e551c-4faa-4c2d-ad28-eda57a1ac938 could not be found. Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d9e551c-4faa-4c2d-ad28-eda57a1ac938 could not be found. Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:24.731291 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:24.737413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:24.737413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:24.737413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:24.737413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:24.737413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:24.737413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d9e551c-4faa-4c2d-ad28-eda57a1ac938 could not be found. Jul 14 14:51:24.737413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:24.739019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd4d52e9-8ff5-4479-9077-898856babc15 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Returning 404 to user: Instance 2d9e551c-4faa-4c2d-ad28-eda57a1ac938 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:24.742367 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cd4d52e9-8ff5-4479-9077-898856babc15 tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938" status: 404 len: 111 microversion: 2.1 time: 0.099999 Jul 14 14:51:24.742688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.743652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.745142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.745748 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2278/4506] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:24 2022] GET /compute/v2.1/servers/2d9e551c-4faa-4c2d-ad28-eda57a1ac938 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:24.751432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.761216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9a382336-99a2-477e-be0e-aeb7f0ccc1e7 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:24.783976 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9a382336-99a2-477e-be0e-aeb7f0ccc1e7 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.036382 Jul 14 14:51:24.786580 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2279/4507] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:51:24 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:24.802226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dec84b86-c577-46b8-aa21-d0b41a0257ec tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:24.817101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dec84b86-c577-46b8-aa21-d0b41a0257ec tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] [instance: 082e1d34-2688-4533-9c47-2ac47840b2a3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:24.817600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:24.839122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dec84b86-c577-46b8-aa21-d0b41a0257ec tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.840245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for user 4e3af45ec76c4a0b8dd03dcff6802f3c and project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:24.841841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dec84b86-c577-46b8-aa21-d0b41a0257ec tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.843424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dec84b86-c577-46b8-aa21-d0b41a0257ec tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.845041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dec84b86-c577-46b8-aa21-d0b41a0257ec tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.893604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:24.906457 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-dec84b86-c577-46b8-aa21-d0b41a0257ec tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] HTTP exception thrown: Instance 082e1d34-2688-4533-9c47-2ac47840b2a3 could not be found. Jul 14 14:51:24.910847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dec84b86-c577-46b8-aa21-d0b41a0257ec tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Request method failure captured: Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 HTTP/1.1 Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C0r6uZyuMywDqKG6jub132IiQk4HUBPLsPBejCIKTt7npEa7nhvZ38Mezaogm4YreEBYQgUgQTcnCRruriIXwzloDtbNV_AO7MRmSLt0qcQWPmg7cuP7orKoaOi8UyBY6hBNzWGRz0fpoWctmdcBJEQMOGule9XeYPtCXEbpNRo_g8 Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/bffe657f18ef47f7ac5ca5e1af866b1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_bffe657f18ef47f7ac5ca5e1af866b1f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/bffe657f18ef47f7ac5ca5e1af866b1f"}]}] Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: bffe657f18ef47f7ac5ca5e1af866b1f Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1394678899 Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87a17c8fbc9946eba3ac613ee006aac1 Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ListServersNegativeTestJSON-1394678899-project Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 082e1d34-2688-4533-9c47-2ac47840b2a3 could not be found. Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '082e1d34-2688-4533-9c47-2ac47840b2a3'} Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082e1d34-2688-4533-9c47-2ac47840b2a3 could not be found. Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082e1d34-2688-4533-9c47-2ac47840b2a3 could not be found. Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:24.911720 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:24.916347 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:24.916347 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:24.916347 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:24.916347 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:24.916347 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:24.916347 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082e1d34-2688-4533-9c47-2ac47840b2a3 could not be found. Jul 14 14:51:24.916347 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:24.918063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dec84b86-c577-46b8-aa21-d0b41a0257ec tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] Returning 404 to user: Instance 082e1d34-2688-4533-9c47-2ac47840b2a3 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:24.920739 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dec84b86-c577-46b8-aa21-d0b41a0257ec tempest-ListServersNegativeTestJSON-1394678899 tempest-ListServersNegativeTestJSON-1394678899-project] 10.222.0.81 "GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3" status: 404 len: 111 microversion: 2.1 time: 0.132826 Jul 14 14:51:24.928225 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2280/4508] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:24 2022] GET /compute/v2.1/servers/082e1d34-2688-4533-9c47-2ac47840b2a3 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:24.970211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1510621920", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "666c2ff3-86b9-4d54-932d-e8f877a0da24"}]}, "os:scheduler_hints": {"group": "090fdf1e-e2ac-438b-8488-d5f9c904d5fa"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:25.125082 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-148ecd14-2671-48e7-b361-d54650964e27 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.897057 Jul 14 14:51:25.126029 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2229/4509] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:51:25.144894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b334035-9dfe-4b56-8c43-5e9bc5ba15ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:25.145770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0b334035-9dfe-4b56-8c43-5e9bc5ba15ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] [instance: 18c804f5-bc58-41f2-97a5-c19ce7cb7538] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:25.178165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] validate_networks() for [('666c2ff3-86b9-4d54-932d-e8f877a0da24', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:25.187594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b334035-9dfe-4b56-8c43-5e9bc5ba15ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:25.188047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b334035-9dfe-4b56-8c43-5e9bc5ba15ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:25.193457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b334035-9dfe-4b56-8c43-5e9bc5ba15ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:25.194684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b334035-9dfe-4b56-8c43-5e9bc5ba15ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:25.241952 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-0b334035-9dfe-4b56-8c43-5e9bc5ba15ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] HTTP exception thrown: Instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 could not be found. Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b334035-9dfe-4b56-8c43-5e9bc5ba15ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Request method failure captured: Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 HTTP/1.1 Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Cz_7ZPj3qhe_id5GiJgHVEf_TxhnXxKuY84ZYAaqGJEnXRNVk_CSONjlAHS8-5sbN9nLsmjQHmckPI9cwM-uqa0t7qTvIRAB0tjFr2Ul8tsE5wNgO39TLfvjQbo3Ui4owR25pTnLymyMnG_D-q-cj-287_ufW_cBLv_3ad5ltW6S8Q Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 14a2d361c8364c908f6147aa58322173 Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-373416027 Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/14a2d361c8364c908f6147aa58322173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/14a2d361c8364c908f6147aa58322173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_14a2d361c8364c908f6147aa58322173", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/14a2d361c8364c908f6147aa58322173"}]}] Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-373416027 Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 14a2d361c8364c908f6147aa58322173 Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-373416027 Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerRescueTestJSONUnderV235-373416027-project Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 918848bbb5f1490aa4f348037735e758 Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-373416027-project Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 could not be found. Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '18c804f5-bc58-41f2-97a5-c19ce7cb7538'} Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 could not be found. Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 could not be found. Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:25.246215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:25.252180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:25.252180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:25.252180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:25.252180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:25.252180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:25.252180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:25.252180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 could not be found. Jul 14 14:51:25.252180 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:25.254755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b334035-9dfe-4b56-8c43-5e9bc5ba15ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] Returning 404 to user: Instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:25.256464 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0b334035-9dfe-4b56-8c43-5e9bc5ba15ba tempest-ServerRescueTestJSONUnderV235-373416027 tempest-ServerRescueTestJSONUnderV235-373416027-project] 10.222.0.81 "GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538" status: 404 len: 111 microversion: 2.1 time: 0.121943 Jul 14 14:51:25.257715 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2230/4510] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:25 2022] GET /compute/v2.1/servers/18c804f5-bc58-41f2-97a5-c19ce7cb7538 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:25.264348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f26cd4a4-c7f6-4c79-bc03-08c74ed90de8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:25.265472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f26cd4a4-c7f6-4c79-bc03-08c74ed90de8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:25.479725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f26cd4a4-c7f6-4c79-bc03-08c74ed90de8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:25.492634 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f26cd4a4-c7f6-4c79-bc03-08c74ed90de8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1220 microversion: 2.1 time: 0.232415 Jul 14 14:51:25.507694 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2231/4511] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:25 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1220 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:25.543946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-462b4780-6271-485e-b1df-34badafcfb4b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:25.545781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-462b4780-6271-485e-b1df-34badafcfb4b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:25.582563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-462b4780-6271-485e-b1df-34badafcfb4b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:25.583024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-462b4780-6271-485e-b1df-34badafcfb4b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:25.583831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-462b4780-6271-485e-b1df-34badafcfb4b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:25.584271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-462b4780-6271-485e-b1df-34badafcfb4b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:25.663671 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-462b4780-6271-485e-b1df-34badafcfb4b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123162 Jul 14 14:51:25.664593 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2232/4512] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:51:25 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:51:25.848670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a19b25fe-f2cb-4a3f-87c4-d8b4eaaca91f req-4b273d0f-b0be-453b-9164-b5791d5eebdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c804f5-bc58-41f2-97a5-c19ce7cb7538", "name": "network-vif-deleted", "tag": "4dff7900-44ff-4bb2-97ea-1e108de17c71"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:25.877005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a19b25fe-f2cb-4a3f-87c4-d8b4eaaca91f req-4b273d0f-b0be-453b-9164-b5791d5eebdd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:25.887444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a19b25fe-f2cb-4a3f-87c4-d8b4eaaca91f req-4b273d0f-b0be-453b-9164-b5791d5eebdd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:25.917988 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a19b25fe-f2cb-4a3f-87c4-d8b4eaaca91f req-4b273d0f-b0be-453b-9164-b5791d5eebdd service nova] Creating event network-vif-deleted:4dff7900-44ff-4bb2-97ea-1e108de17c71 for instance 18c804f5-bc58-41f2-97a5-c19ce7cb7538 on n-h1-767704-28 Jul 14 14:51:25.938144 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a19b25fe-f2cb-4a3f-87c4-d8b4eaaca91f req-4b273d0f-b0be-453b-9164-b5791d5eebdd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099734 Jul 14 14:51:25.940021 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2233/4513] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:25.978111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d8994ff1-e3ab-4752-97bb-b35d356ed81f req-29644f35-c1cc-4cfe-9414-f09b592327eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb68e36c-3f0c-4567-bf71-cee172d26584", "tag": "b740bd7f-b45f-434b-b252-0a0b8ca2850b"}, {"name": "network-changed", "server_uuid": "cb68e36c-3f0c-4567-bf71-cee172d26584", "tag": "b740bd7f-b45f-434b-b252-0a0b8ca2850b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:26.011779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d8994ff1-e3ab-4752-97bb-b35d356ed81f req-29644f35-c1cc-4cfe-9414-f09b592327eb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.012995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d8994ff1-e3ab-4752-97bb-b35d356ed81f req-29644f35-c1cc-4cfe-9414-f09b592327eb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:26.039744 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d8994ff1-e3ab-4752-97bb-b35d356ed81f req-29644f35-c1cc-4cfe-9414-f09b592327eb service nova] Creating event network-changed:b740bd7f-b45f-434b-b252-0a0b8ca2850b for instance cb68e36c-3f0c-4567-bf71-cee172d26584 on n-h1-767704-28 Jul 14 14:51:26.048876 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d8994ff1-e3ab-4752-97bb-b35d356ed81f req-29644f35-c1cc-4cfe-9414-f09b592327eb service nova] Creating event network-changed:b740bd7f-b45f-434b-b252-0a0b8ca2850b for instance cb68e36c-3f0c-4567-bf71-cee172d26584 on n-h1-767704-28 Jul 14 14:51:26.064213 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d8994ff1-e3ab-4752-97bb-b35d356ed81f req-29644f35-c1cc-4cfe-9414-f09b592327eb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.097826 Jul 14 14:51:26.071155 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2234/4514] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:51:26.511160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2e6b1f3d-57d3-4e58-90a7-65640e0e5344 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:26.512083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2e6b1f3d-57d3-4e58-90a7-65640e0e5344 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:26.533514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e6b1f3d-57d3-4e58-90a7-65640e0e5344 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.534419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e6b1f3d-57d3-4e58-90a7-65640e0e5344 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:26.535489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e6b1f3d-57d3-4e58-90a7-65640e0e5344 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.544242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e6b1f3d-57d3-4e58-90a7-65640e0e5344 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:26.612675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:26.613549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:26.613788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:26.614655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:26.615094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:26.699256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.701493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:26.703567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.704195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:26.757323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:26.766877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:26.785189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:26.788706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:26.869852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119512) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 14 14:51:26.930662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_group_members'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:26.943662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_group_members'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:26.967093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2e6b1f3d-57d3-4e58-90a7-65640e0e5344 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:26.979663 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2e6b1f3d-57d3-4e58-90a7-65640e0e5344 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1216 microversion: 2.1 time: 0.471125 Jul 14 14:51:26.980464 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2235/4515] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:26 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1216 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:26.992460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3736ff3e-3092-4201-b8d3-aeb37388d964 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:27.005000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3736ff3e-3092-4201-b8d3-aeb37388d964 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:27.020693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3736ff3e-3092-4201-b8d3-aeb37388d964 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:27.026340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3736ff3e-3092-4201-b8d3-aeb37388d964 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:27.027672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3736ff3e-3092-4201-b8d3-aeb37388d964 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:27.028553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3736ff3e-3092-4201-b8d3-aeb37388d964 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:27.129500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_group_members'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:27.147097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Getting quotas for user 28ca5d3f67a64722a19adf5ae3d1a3a0 and project 07d7fa2f739b458a8ac6c529c1fa8266. Resources: {'server_group_members'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:27.155293 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3736ff3e-3092-4201-b8d3-aeb37388d964 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.171893 Jul 14 14:51:27.159291 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2236/4516] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:51:26 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52/os-volume_attachments => generated 25 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:51:27.241944 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1f81619f-e6e5-4407-93a2-cbbe43f365dd tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.308047 Jul 14 14:51:27.247607 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2281/4517] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:51:27.254225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4b261143-7422-4767-a6cd-22322b74ebbc tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:27.255001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4b261143-7422-4767-a6cd-22322b74ebbc tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:27.286600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b34e337-99cd-4d01-9d60-184ba6a47ac4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:27.287446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0b34e337-99cd-4d01-9d60-184ba6a47ac4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:27.307948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b34e337-99cd-4d01-9d60-184ba6a47ac4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:27.315105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b34e337-99cd-4d01-9d60-184ba6a47ac4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:27.326332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b34e337-99cd-4d01-9d60-184ba6a47ac4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:27.327329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b34e337-99cd-4d01-9d60-184ba6a47ac4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:27.429955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0b34e337-99cd-4d01-9d60-184ba6a47ac4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:51:27.449900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4b261143-7422-4767-a6cd-22322b74ebbc tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:27.464380 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4b261143-7422-4767-a6cd-22322b74ebbc tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1213 microversion: 2.1 time: 0.214193 Jul 14 14:51:27.476359 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2237/4518] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:27 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1213 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:27.591293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:27.620697 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0b34e337-99cd-4d01-9d60-184ba6a47ac4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 204 len: 0 microversion: 2.1 time: 0.337852 Jul 14 14:51:27.625299 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2282/4519] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:27 2022] DELETE /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:51:27.634870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-82a9d717-203c-4a65-aee4-201cb057dd61 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:27.635960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-82a9d717-203c-4a65-aee4-201cb057dd61 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:27.649048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82a9d717-203c-4a65-aee4-201cb057dd61 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:27.649918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82a9d717-203c-4a65-aee4-201cb057dd61 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:27.653787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82a9d717-203c-4a65-aee4-201cb057dd61 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:27.658563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82a9d717-203c-4a65-aee4-201cb057dd61 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:28.006816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a0584a67-b4e9-42d5-9900-25e5c6d71dd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:28.007534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a0584a67-b4e9-42d5-9900-25e5c6d71dd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:28.026513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0584a67-b4e9-42d5-9900-25e5c6d71dd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:28.027297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0584a67-b4e9-42d5-9900-25e5c6d71dd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:28.028341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0584a67-b4e9-42d5-9900-25e5c6d71dd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:28.029493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a0584a67-b4e9-42d5-9900-25e5c6d71dd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:28.105291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-82a9d717-203c-4a65-aee4-201cb057dd61 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:28.119324 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-82a9d717-203c-4a65-aee4-201cb057dd61 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1681 microversion: 2.1 time: 0.487851 Jul 14 14:51:28.132358 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2238/4520] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:27 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1681 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:28.160189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a0584a67-b4e9-42d5-9900-25e5c6d71dd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:28.176911 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a0584a67-b4e9-42d5-9900-25e5c6d71dd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1278 microversion: 2.1 time: 0.175885 Jul 14 14:51:28.177868 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2283/4521] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:27 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:28.494644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ef4b9d19-4114-4475-bc7f-545a5ae8e2b2 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:28.496163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ef4b9d19-4114-4475-bc7f-545a5ae8e2b2 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:28.508710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef4b9d19-4114-4475-bc7f-545a5ae8e2b2 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:28.509896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef4b9d19-4114-4475-bc7f-545a5ae8e2b2 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:28.510815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef4b9d19-4114-4475-bc7f-545a5ae8e2b2 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:28.514207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef4b9d19-4114-4475-bc7f-545a5ae8e2b2 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:29.133911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ef4b9d19-4114-4475-bc7f-545a5ae8e2b2 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:29.139413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cafda2e2-c3b5-4113-a880-0643d3b3550f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:29.140840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cafda2e2-c3b5-4113-a880-0643d3b3550f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:29.146347 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ef4b9d19-4114-4475-bc7f-545a5ae8e2b2 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1217 microversion: 2.1 time: 0.660384 Jul 14 14:51:29.154715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cafda2e2-c3b5-4113-a880-0643d3b3550f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:29.155343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cafda2e2-c3b5-4113-a880-0643d3b3550f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:29.158018 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2239/4522] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:28 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1217 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:29.159993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cafda2e2-c3b5-4113-a880-0643d3b3550f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:29.162710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cafda2e2-c3b5-4113-a880-0643d3b3550f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:29.196019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e1748044-b011-4f53-b95f-3c44f8673882 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:29.196657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e1748044-b011-4f53-b95f-3c44f8673882 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:29.212867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e1748044-b011-4f53-b95f-3c44f8673882 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:29.213366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e1748044-b011-4f53-b95f-3c44f8673882 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:29.214175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e1748044-b011-4f53-b95f-3c44f8673882 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:29.214623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e1748044-b011-4f53-b95f-3c44f8673882 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:29.573205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e1748044-b011-4f53-b95f-3c44f8673882 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:29.590612 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e1748044-b011-4f53-b95f-3c44f8673882 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1278 microversion: 2.1 time: 0.398989 Jul 14 14:51:29.592385 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2240/4523] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:29 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1278 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:29.886972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cafda2e2-c3b5-4113-a880-0643d3b3550f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:29.906048 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cafda2e2-c3b5-4113-a880-0643d3b3550f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1681 microversion: 2.1 time: 0.771613 Jul 14 14:51:29.906643 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2284/4524] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:29 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1681 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:30.164049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-06328ebc-d826-4452-a1ac-9bd13066d400 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:30.164891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-06328ebc-d826-4452-a1ac-9bd13066d400 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:30.188689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06328ebc-d826-4452-a1ac-9bd13066d400 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:30.189483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06328ebc-d826-4452-a1ac-9bd13066d400 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:30.190687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06328ebc-d826-4452-a1ac-9bd13066d400 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:30.191389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06328ebc-d826-4452-a1ac-9bd13066d400 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:30.471369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-06328ebc-d826-4452-a1ac-9bd13066d400 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:30.501096 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-06328ebc-d826-4452-a1ac-9bd13066d400 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1209 microversion: 2.1 time: 0.337077 Jul 14 14:51:30.506073 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2241/4525] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:30 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1209 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:30.609491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ba81f60c-d759-47c7-bbac-005210273a15 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:30.610115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ba81f60c-d759-47c7-bbac-005210273a15 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:30.617964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba81f60c-d759-47c7-bbac-005210273a15 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:30.629973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba81f60c-d759-47c7-bbac-005210273a15 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:30.631110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba81f60c-d759-47c7-bbac-005210273a15 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:30.631912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba81f60c-d759-47c7-bbac-005210273a15 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:30.926867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dc14bac4-f6a3-47b6-973f-1fcdc64ba55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:30.927932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dc14bac4-f6a3-47b6-973f-1fcdc64ba55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:30.945124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc14bac4-f6a3-47b6-973f-1fcdc64ba55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:30.946354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc14bac4-f6a3-47b6-973f-1fcdc64ba55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:30.947526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc14bac4-f6a3-47b6-973f-1fcdc64ba55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:30.951819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc14bac4-f6a3-47b6-973f-1fcdc64ba55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:31.512898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba81f60c-d759-47c7-bbac-005210273a15 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:31.529121 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ba81f60c-d759-47c7-bbac-005210273a15 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1320 microversion: 2.1 time: 0.921208 Jul 14 14:51:31.529805 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2285/4526] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:30 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1320 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:31.548057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-de387352-0cc9-4e03-ab85-bb27778d708d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:31.548841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-de387352-0cc9-4e03-ab85-bb27778d708d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:31.556536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de387352-0cc9-4e03-ab85-bb27778d708d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:31.557021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de387352-0cc9-4e03-ab85-bb27778d708d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:31.557877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de387352-0cc9-4e03-ab85-bb27778d708d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:31.558328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de387352-0cc9-4e03-ab85-bb27778d708d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:31.576797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dc14bac4-f6a3-47b6-973f-1fcdc64ba55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:31.588678 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dc14bac4-f6a3-47b6-973f-1fcdc64ba55d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1681 microversion: 2.1 time: 0.666456 Jul 14 14:51:31.594735 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2242/4527] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:30 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1681 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:31.637559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:31.820512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-de387352-0cc9-4e03-ab85-bb27778d708d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:31.845776 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-de387352-0cc9-4e03-ab85-bb27778d708d tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1273 microversion: 2.1 time: 0.310189 Jul 14 14:51:31.856035 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2286/4528] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:31 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1273 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:32.551111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-60ca310e-67f6-41b9-b570-4ea4cf89efec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:32.551743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-60ca310e-67f6-41b9-b570-4ea4cf89efec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:32.564450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60ca310e-67f6-41b9-b570-4ea4cf89efec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:32.567035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60ca310e-67f6-41b9-b570-4ea4cf89efec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:32.570789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60ca310e-67f6-41b9-b570-4ea4cf89efec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:32.574350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60ca310e-67f6-41b9-b570-4ea4cf89efec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:32.617844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-483e4584-bd73-45dc-9d53-bbb8f994aea0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:32.618479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-483e4584-bd73-45dc-9d53-bbb8f994aea0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:32.640317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-483e4584-bd73-45dc-9d53-bbb8f994aea0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:32.641411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-483e4584-bd73-45dc-9d53-bbb8f994aea0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:32.642227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-483e4584-bd73-45dc-9d53-bbb8f994aea0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:32.654563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-483e4584-bd73-45dc-9d53-bbb8f994aea0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:33.377255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-483e4584-bd73-45dc-9d53-bbb8f994aea0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:33.390365 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-483e4584-bd73-45dc-9d53-bbb8f994aea0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1681 microversion: 2.1 time: 0.778088 Jul 14 14:51:33.391136 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2287/4529] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:32 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1681 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:33.396148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f01a9ce-9f0f-4799-ba35-d133bb01ee93 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:33.396824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f01a9ce-9f0f-4799-ba35-d133bb01ee93 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:33.418915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f01a9ce-9f0f-4799-ba35-d133bb01ee93 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:33.419572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f01a9ce-9f0f-4799-ba35-d133bb01ee93 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:33.420784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f01a9ce-9f0f-4799-ba35-d133bb01ee93 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:33.422212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f01a9ce-9f0f-4799-ba35-d133bb01ee93 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:33.452823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-60ca310e-67f6-41b9-b570-4ea4cf89efec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:33.469126 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-60ca310e-67f6-41b9-b570-4ea4cf89efec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1320 microversion: 2.1 time: 0.919633 Jul 14 14:51:33.470131 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2243/4530] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:32 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1320 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:33.570177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f01a9ce-9f0f-4799-ba35-d133bb01ee93 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:33.585504 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f01a9ce-9f0f-4799-ba35-d133bb01ee93 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1271 microversion: 2.1 time: 0.192943 Jul 14 14:51:33.586433 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2288/4531] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:33 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:34.231117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-8c8cb67d-93f5-4ff2-8491-6bf0397272ae req-94627a1f-b1a6-469c-92c6-8a3f5e858432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fba14e7e-dbff-47d0-9515-3acd4c797b52", "name": "network-vif-deleted", "tag": "2b8329e6-84df-4e45-8111-31bbe81da945"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:34.251514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8c8cb67d-93f5-4ff2-8491-6bf0397272ae req-94627a1f-b1a6-469c-92c6-8a3f5e858432 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.252290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8c8cb67d-93f5-4ff2-8491-6bf0397272ae req-94627a1f-b1a6-469c-92c6-8a3f5e858432 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.277768 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8c8cb67d-93f5-4ff2-8491-6bf0397272ae req-94627a1f-b1a6-469c-92c6-8a3f5e858432 service nova] Creating event network-vif-deleted:2b8329e6-84df-4e45-8111-31bbe81da945 for instance fba14e7e-dbff-47d0-9515-3acd4c797b52 on n-h1-767704-28 Jul 14 14:51:34.287097 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-8c8cb67d-93f5-4ff2-8491-6bf0397272ae req-94627a1f-b1a6-469c-92c6-8a3f5e858432 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059595 Jul 14 14:51:34.295802 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2244/4532] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:34.408389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7c7cfb04-ad20-4955-803c-41bbc96d5353 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:34.409697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7c7cfb04-ad20-4955-803c-41bbc96d5353 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:34.418082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c7cfb04-ad20-4955-803c-41bbc96d5353 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.419528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c7cfb04-ad20-4955-803c-41bbc96d5353 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.420779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c7cfb04-ad20-4955-803c-41bbc96d5353 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.421464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c7cfb04-ad20-4955-803c-41bbc96d5353 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.488106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d92b1cd-9556-4f23-9c5d-bba4062f5423 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:34.489149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0d92b1cd-9556-4f23-9c5d-bba4062f5423 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:34.517414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d92b1cd-9556-4f23-9c5d-bba4062f5423 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.518229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d92b1cd-9556-4f23-9c5d-bba4062f5423 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.519273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d92b1cd-9556-4f23-9c5d-bba4062f5423 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.520121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d92b1cd-9556-4f23-9c5d-bba4062f5423 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.545957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c7cfb04-ad20-4955-803c-41bbc96d5353 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.546419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7c7cfb04-ad20-4955-803c-41bbc96d5353 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.546956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-7c7cfb04-ad20-4955-803c-41bbc96d5353 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lazy-loading 'fault' on Instance uuid fba14e7e-dbff-47d0-9515-3acd4c797b52 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:51:34.722725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7c7cfb04-ad20-4955-803c-41bbc96d5353 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:34.735158 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7c7cfb04-ad20-4955-803c-41bbc96d5353 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 200 len: 1330 microversion: 2.1 time: 0.326576 Jul 14 14:51:34.739356 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2289/4533] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:34 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 1330 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:34.758102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-427cf1d7-2c28-406d-a366-411886efa464 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:34.762095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-427cf1d7-2c28-406d-a366-411886efa464 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:34.777052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=14 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:34.786733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-427cf1d7-2c28-406d-a366-411886efa464 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.787476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-427cf1d7-2c28-406d-a366-411886efa464 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.788474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-427cf1d7-2c28-406d-a366-411886efa464 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.789428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-427cf1d7-2c28-406d-a366-411886efa464 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:35.052354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-427cf1d7-2c28-406d-a366-411886efa464 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:35.065876 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-427cf1d7-2c28-406d-a366-411886efa464 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1271 microversion: 2.1 time: 0.324987 Jul 14 14:51:35.079432 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2290/4534] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:34 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1271 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:35.162922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0d92b1cd-9556-4f23-9c5d-bba4062f5423 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:35.178728 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0d92b1cd-9556-4f23-9c5d-bba4062f5423 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1320 microversion: 2.1 time: 0.695097 Jul 14 14:51:35.182801 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2245/4535] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:34 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1320 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:35.756305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-305b4a30-644b-4c2c-ad75-4eac2847b9af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:35.757494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-305b4a30-644b-4c2c-ad75-4eac2847b9af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:35.767677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-305b4a30-644b-4c2c-ad75-4eac2847b9af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:35.768220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-305b4a30-644b-4c2c-ad75-4eac2847b9af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:35.770033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-305b4a30-644b-4c2c-ad75-4eac2847b9af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:35.771772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-305b4a30-644b-4c2c-ad75-4eac2847b9af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:35.832392 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-305b4a30-644b-4c2c-ad75-4eac2847b9af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-305b4a30-644b-4c2c-ad75-4eac2847b9af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 HTTP/1.1 Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'fba14e7e-dbff-47d0-9515-3acd4c797b52'} Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:35.836635 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:35.842941 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:35.842941 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:35.842941 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:35.842941 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:35.842941 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:35.842941 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:51:35.842941 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:51:35.861593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-305b4a30-644b-4c2c-ad75-4eac2847b9af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 404 to user: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:35.862592 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-305b4a30-644b-4c2c-ad75-4eac2847b9af tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 404 len: 111 microversion: 2.1 time: 0.112643 Jul 14 14:51:35.867174 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2291/4536] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:35 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:35.875769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b93b2fd4-bf55-41ba-af5c-a7a380ec14f3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '.version_select at 0x7fd6c4586af0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:35.925451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=93,nova_api:INSERT=5 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:35.931102 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b93b2fd4-bf55-41ba-af5c-a7a380ec14f3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088790826" status: 202 len: 0 microversion: 2.1 time: 0.062435 Jul 14 14:51:35.931742 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2246/4537] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 14:51:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088790826 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:36.086406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8574796d-45a0-41a1-8759-9566b9b1e495 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:36.087195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8574796d-45a0-41a1-8759-9566b9b1e495 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:36.103476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8574796d-45a0-41a1-8759-9566b9b1e495 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:36.105060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8574796d-45a0-41a1-8759-9566b9b1e495 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:36.106123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8574796d-45a0-41a1-8759-9566b9b1e495 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:36.109312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8574796d-45a0-41a1-8759-9566b9b1e495 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:36.198144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e66085a9-9659-47b4-bff9-9cac323f8993 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:36.199086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e66085a9-9659-47b4-bff9-9cac323f8993 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:36.207684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e66085a9-9659-47b4-bff9-9cac323f8993 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:36.208397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e66085a9-9659-47b4-bff9-9cac323f8993 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:36.209508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e66085a9-9659-47b4-bff9-9cac323f8993 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:36.210211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e66085a9-9659-47b4-bff9-9cac323f8993 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:36.728354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8574796d-45a0-41a1-8759-9566b9b1e495 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:36.741992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e66085a9-9659-47b4-bff9-9cac323f8993 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:36.751305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:36.756300 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e66085a9-9659-47b4-bff9-9cac323f8993 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1320 microversion: 2.1 time: 0.561909 Jul 14 14:51:36.757470 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2247/4538] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:36 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1320 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:36.767481 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8574796d-45a0-41a1-8759-9566b9b1e495 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1313 microversion: 2.1 time: 0.684972 Jul 14 14:51:36.768374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d4f91275-8bd1-41af-91df-d54f1a6af054 req-8e1f4c31-c522-418d-84ea-8316a28c81fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f7ce841-cb1a-4bb8-8b71-b869986dedba", "tag": "2736a87c-2a3a-4ba3-9bde-a7d51d4ac83f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:36.791668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d4f91275-8bd1-41af-91df-d54f1a6af054 req-8e1f4c31-c522-418d-84ea-8316a28c81fa service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:36.792514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d4f91275-8bd1-41af-91df-d54f1a6af054 req-8e1f4c31-c522-418d-84ea-8316a28c81fa service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:36.793520 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2292/4539] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:36 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:36.815902 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d4f91275-8bd1-41af-91df-d54f1a6af054 req-8e1f4c31-c522-418d-84ea-8316a28c81fa service nova] Creating event network-changed:2736a87c-2a3a-4ba3-9bde-a7d51d4ac83f for instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba on n-h2-767704-28 Jul 14 14:51:36.835647 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d4f91275-8bd1-41af-91df-d54f1a6af054 req-8e1f4c31-c522-418d-84ea-8316a28c81fa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072650 Jul 14 14:51:36.842120 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2248/4540] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:37.781653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=38 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:37.786026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-02c821c9-f1d7-4fe9-87b5-18da36aad3e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:37.786881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-02c821c9-f1d7-4fe9-87b5-18da36aad3e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:37.798703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=36 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:37.803736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e9bed58-517e-4325-b988-121afecec93b tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:37.804471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4e9bed58-517e-4325-b988-121afecec93b tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:37.811522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02c821c9-f1d7-4fe9-87b5-18da36aad3e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:37.812177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02c821c9-f1d7-4fe9-87b5-18da36aad3e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:37.822135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02c821c9-f1d7-4fe9-87b5-18da36aad3e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:37.824187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e9bed58-517e-4325-b988-121afecec93b tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:37.824858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e9bed58-517e-4325-b988-121afecec93b tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:37.825046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02c821c9-f1d7-4fe9-87b5-18da36aad3e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:37.826139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e9bed58-517e-4325-b988-121afecec93b tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:37.826790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e9bed58-517e-4325-b988-121afecec93b tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:37.831617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:39.043165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-02c821c9-f1d7-4fe9-87b5-18da36aad3e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:39.061532 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-02c821c9-f1d7-4fe9-87b5-18da36aad3e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1320 microversion: 2.1 time: 1.282037 Jul 14 14:51:39.062506 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2293/4541] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:37 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1320 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:39.067313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-011feac2-07b2-4022-96b3-bb00da674086 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: .version_select at 0x7fd6c4ffa310>, body: {"keypair": {"name": "tempest-keypair-1126205305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnFqOszcgO/EyHsW59GK9LaySZQD34Vb0c5kSD81EXN5ForjolZyZm9+AxVRAQC6OeF+XE9DdyCysawvcHRWTvM01105EJIzlGfDrFJ0HLu2L3hdV9RncAm9HVtEVzl+Q=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:39.111292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-011feac2-07b2-4022-96b3-bb00da674086 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:39.126278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-011feac2-07b2-4022-96b3-bb00da674086 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for user 9260cbc32f1e423ab8ea4d06058b4050 and project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:39.197361 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-011feac2-07b2-4022-96b3-bb00da674086 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133605 Jul 14 14:51:39.197980 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2294/4542] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:51:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:39.207499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4f133a95-1913-4573-b991-2b4994c5e133 req-c72f9e10-1817-4e31-a749-7b895d1d72aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc2e279-dc51-42af-bd24-de3145eb9ddf", "tag": "4687dd97-9266-499e-8fab-ac989d68b907"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:39.223640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4f133a95-1913-4573-b991-2b4994c5e133 req-c72f9e10-1817-4e31-a749-7b895d1d72aa service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:39.245710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4f133a95-1913-4573-b991-2b4994c5e133 req-c72f9e10-1817-4e31-a749-7b895d1d72aa service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:39.279531 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4f133a95-1913-4573-b991-2b4994c5e133 req-c72f9e10-1817-4e31-a749-7b895d1d72aa service nova] Creating event network-changed:4687dd97-9266-499e-8fab-ac989d68b907 for instance ddc2e279-dc51-42af-bd24-de3145eb9ddf on n-h1-767704-28 Jul 14 14:51:39.286112 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4f133a95-1913-4573-b991-2b4994c5e133 req-c72f9e10-1817-4e31-a749-7b895d1d72aa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086421 Jul 14 14:51:39.286986 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2295/4543] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:39.738136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4e9bed58-517e-4325-b988-121afecec93b tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:39.760727 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e9bed58-517e-4325-b988-121afecec93b tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1313 microversion: 2.1 time: 1.960097 Jul 14 14:51:39.763813 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2249/4544] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:37 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1313 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:40.092449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c6c99afa-d4a2-4d4e-8c7e-592959e697e1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:40.094861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c6c99afa-d4a2-4d4e-8c7e-592959e697e1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:40.133854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c99afa-d4a2-4d4e-8c7e-592959e697e1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:40.134705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c99afa-d4a2-4d4e-8c7e-592959e697e1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:40.140451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c99afa-d4a2-4d4e-8c7e-592959e697e1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:40.141442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c99afa-d4a2-4d4e-8c7e-592959e697e1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:40.783312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-accd9e03-e0c8-474e-943f-cdfde34d99d9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:40.784785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-accd9e03-e0c8-474e-943f-cdfde34d99d9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:40.802749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-accd9e03-e0c8-474e-943f-cdfde34d99d9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:40.803586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-accd9e03-e0c8-474e-943f-cdfde34d99d9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:40.804734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-accd9e03-e0c8-474e-943f-cdfde34d99d9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:40.805873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-accd9e03-e0c8-474e-943f-cdfde34d99d9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:41.014600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c6c99afa-d4a2-4d4e-8c7e-592959e697e1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:41.033104 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c6c99afa-d4a2-4d4e-8c7e-592959e697e1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1320 microversion: 2.1 time: 0.946438 Jul 14 14:51:41.038350 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2296/4545] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:40 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1320 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:41.504318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-accd9e03-e0c8-474e-943f-cdfde34d99d9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:41.536598 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-accd9e03-e0c8-474e-943f-cdfde34d99d9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1313 microversion: 2.1 time: 0.758710 Jul 14 14:51:41.542039 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2250/4546] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:40 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1313 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:42.053942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e68289cd-047c-44b7-9612-2f0374df660b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:42.055957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e68289cd-047c-44b7-9612-2f0374df660b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:42.074196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e68289cd-047c-44b7-9612-2f0374df660b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:42.076988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e68289cd-047c-44b7-9612-2f0374df660b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:42.080150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e68289cd-047c-44b7-9612-2f0374df660b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:42.081341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e68289cd-047c-44b7-9612-2f0374df660b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:42.577971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e68289cd-047c-44b7-9612-2f0374df660b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:42.596258 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e68289cd-047c-44b7-9612-2f0374df660b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1320 microversion: 2.1 time: 0.547174 Jul 14 14:51:42.598475 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2297/4547] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:42 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1320 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:42.607182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b145304-5310-4f8b-9f7b-8e6736876874 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:42.609976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3b145304-5310-4f8b-9f7b-8e6736876874 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:42.637059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b145304-5310-4f8b-9f7b-8e6736876874 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:42.638585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b145304-5310-4f8b-9f7b-8e6736876874 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:42.647186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b145304-5310-4f8b-9f7b-8e6736876874 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:42.648077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b145304-5310-4f8b-9f7b-8e6736876874 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:42.770295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-7d468fc4-f161-4ec1-86dd-c6092fdf75b0 req-2cb48df2-059d-401b-86a0-731601b92452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f7ce841-cb1a-4bb8-8b71-b869986dedba", "name": "network-vif-plugged", "status": "completed", "tag": "2736a87c-2a3a-4ba3-9bde-a7d51d4ac83f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:42.780768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7d468fc4-f161-4ec1-86dd-c6092fdf75b0 req-2cb48df2-059d-401b-86a0-731601b92452 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:42.786619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7d468fc4-f161-4ec1-86dd-c6092fdf75b0 req-2cb48df2-059d-401b-86a0-731601b92452 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:42.808001 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-7d468fc4-f161-4ec1-86dd-c6092fdf75b0 req-2cb48df2-059d-401b-86a0-731601b92452 service nova] Creating event network-vif-plugged:2736a87c-2a3a-4ba3-9bde-a7d51d4ac83f for instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba on n-h2-767704-28 Jul 14 14:51:42.815715 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-7d468fc4-f161-4ec1-86dd-c6092fdf75b0 req-2cb48df2-059d-401b-86a0-731601b92452 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.474405 Jul 14 14:51:42.816367 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2251/4548] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:51:43.617469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b871febb-105f-458b-b781-d365266e79bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:43.618407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b871febb-105f-458b-b781-d365266e79bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:43.625217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b871febb-105f-458b-b781-d365266e79bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:43.625973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b871febb-105f-458b-b781-d365266e79bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:43.626934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b871febb-105f-458b-b781-d365266e79bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:43.627387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b871febb-105f-458b-b781-d365266e79bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:43.631620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b145304-5310-4f8b-9f7b-8e6736876874 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:43.642418 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b145304-5310-4f8b-9f7b-8e6736876874 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1313 microversion: 2.1 time: 1.040181 Jul 14 14:51:43.643597 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2298/4549] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:42 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1313 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:44.000625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b871febb-105f-458b-b781-d365266e79bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:44.015374 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b871febb-105f-458b-b781-d365266e79bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1320 microversion: 2.1 time: 0.402910 Jul 14 14:51:44.016445 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2252/4550] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:43 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1320 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:44.659895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-42307afb-9a20-4df8-8657-9a35d77371ea tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:44.660682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-42307afb-9a20-4df8-8657-9a35d77371ea tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:44.685600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42307afb-9a20-4df8-8657-9a35d77371ea tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:44.685600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42307afb-9a20-4df8-8657-9a35d77371ea tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:44.685600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42307afb-9a20-4df8-8657-9a35d77371ea tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:44.688522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42307afb-9a20-4df8-8657-9a35d77371ea tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:45.043624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e72c962f-8ee7-40e0-a7e7-0d4e1ac0cbfe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:45.045734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e72c962f-8ee7-40e0-a7e7-0d4e1ac0cbfe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:45.059045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e72c962f-8ee7-40e0-a7e7-0d4e1ac0cbfe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:45.059956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e72c962f-8ee7-40e0-a7e7-0d4e1ac0cbfe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:45.062390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e72c962f-8ee7-40e0-a7e7-0d4e1ac0cbfe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:45.063566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e72c962f-8ee7-40e0-a7e7-0d4e1ac0cbfe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:45.981138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-42307afb-9a20-4df8-8657-9a35d77371ea tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:45.995516 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-42307afb-9a20-4df8-8657-9a35d77371ea tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1313 microversion: 2.1 time: 1.339286 Jul 14 14:51:46.005629 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2299/4551] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:44 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1313 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:46.420100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e72c962f-8ee7-40e0-a7e7-0d4e1ac0cbfe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:46.432545 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e72c962f-8ee7-40e0-a7e7-0d4e1ac0cbfe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1502 microversion: 2.1 time: 1.399210 Jul 14 14:51:46.433463 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2253/4552] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:45 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1502 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:46.454465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-de0977de-10c2-4ca4-b8e9-1c1d0fceb6c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:46.455555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-de0977de-10c2-4ca4-b8e9-1c1d0fceb6c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:46.466964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de0977de-10c2-4ca4-b8e9-1c1d0fceb6c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:46.469722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de0977de-10c2-4ca4-b8e9-1c1d0fceb6c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:46.470700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de0977de-10c2-4ca4-b8e9-1c1d0fceb6c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:46.471241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de0977de-10c2-4ca4-b8e9-1c1d0fceb6c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:46.561155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-596687767", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19a7ef92-3b71-4a1b-b101-91e7276e71cb"}], "security_groups": [{"name": "tempest-securitygroup--172879661"}], "key_name": "tempest-keypair-1126205305", "user_data": "}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:46.796689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] validate_networks() for [('19a7ef92-3b71-4a1b-b101-91e7276e71cb', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:47.044722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-de0977de-10c2-4ca4-b8e9-1c1d0fceb6c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:47.068938 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-de0977de-10c2-4ca4-b8e9-1c1d0fceb6c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1502 microversion: 2.1 time: 0.618767 Jul 14 14:51:47.070159 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2300/4553] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:46 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1502 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:47.086284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-52f1444d-0223-4ed9-82fe-818f45f72411 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:47.087721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-52f1444d-0223-4ed9-82fe-818f45f72411 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:47.109578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52f1444d-0223-4ed9-82fe-818f45f72411 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:47.128194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52f1444d-0223-4ed9-82fe-818f45f72411 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:47.130658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52f1444d-0223-4ed9-82fe-818f45f72411 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:47.131671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52f1444d-0223-4ed9-82fe-818f45f72411 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:47.877643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-52f1444d-0223-4ed9-82fe-818f45f72411 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:47.920166 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-52f1444d-0223-4ed9-82fe-818f45f72411 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1313 microversion: 2.1 time: 0.838091 Jul 14 14:51:47.921945 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2301/4554] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:47 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1313 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:47.943498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5fc0981d-15c3-4afc-b461-90f21dc18a2c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:47.944413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5fc0981d-15c3-4afc-b461-90f21dc18a2c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:48.034725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fc0981d-15c3-4afc-b461-90f21dc18a2c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.035117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fc0981d-15c3-4afc-b461-90f21dc18a2c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.035945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fc0981d-15c3-4afc-b461-90f21dc18a2c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.053581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fc0981d-15c3-4afc-b461-90f21dc18a2c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.162589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5fc0981d-15c3-4afc-b461-90f21dc18a2c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:51:48.359029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:48.361171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:48.362755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:48.364120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:48.365785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:48.389398 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5fc0981d-15c3-4afc-b461-90f21dc18a2c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 204 len: 0 microversion: 2.1 time: 0.465294 Jul 14 14:51:48.390620 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2302/4555] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:47 2022] DELETE /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:48.401736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.402277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.403417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.405330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.411916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f50c99a-468e-4809-903c-c07a339ec77b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:48.413154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f50c99a-468e-4809-903c-c07a339ec77b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:48.428015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:48.438913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f50c99a-468e-4809-903c-c07a339ec77b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.439671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f50c99a-468e-4809-903c-c07a339ec77b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.440832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f50c99a-468e-4809-903c-c07a339ec77b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.441711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f50c99a-468e-4809-903c-c07a339ec77b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.442597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for user 9260cbc32f1e423ab8ea4d06058b4050 and project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:48.475602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:48.478760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:48.484861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:48.563383 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-557740c3-149c-4ae2-adfa-ddab96ebe68a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.007470 Jul 14 14:51:48.564369 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2254/4556] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:51:48.576611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-feb7c7b3-efa4-45be-aa9e-a8175409e0cc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:48.577576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-feb7c7b3-efa4-45be-aa9e-a8175409e0cc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:48.872780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-feb7c7b3-efa4-45be-aa9e-a8175409e0cc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:48.889090 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-feb7c7b3-efa4-45be-aa9e-a8175409e0cc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1241 microversion: 2.1 time: 0.315680 Jul 14 14:51:48.892018 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2255/4557] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:48 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1241 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:48.955878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d6d6d352-a7a0-4fe7-8a82-140f6f2094ec tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:48.974036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d6d6d352-a7a0-4fe7-8a82-140f6f2094ec tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:48.995365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6d6d352-a7a0-4fe7-8a82-140f6f2094ec tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.995823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6d6d352-a7a0-4fe7-8a82-140f6f2094ec tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.996646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6d6d352-a7a0-4fe7-8a82-140f6f2094ec tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.999959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6d6d352-a7a0-4fe7-8a82-140f6f2094ec tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:49.154946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:49.349195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f50c99a-468e-4809-903c-c07a339ec77b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:49.369817 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f50c99a-468e-4809-903c-c07a339ec77b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1508 microversion: 2.1 time: 0.971591 Jul 14 14:51:49.371082 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2303/4558] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:48 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1508 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:49.922534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-664c4d8f-9c00-454c-9681-8661ef38d250 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:49.924927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-664c4d8f-9c00-454c-9681-8661ef38d250 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:49.956661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-664c4d8f-9c00-454c-9681-8661ef38d250 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:49.957164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-664c4d8f-9c00-454c-9681-8661ef38d250 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:49.958209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-664c4d8f-9c00-454c-9681-8661ef38d250 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:49.968433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-664c4d8f-9c00-454c-9681-8661ef38d250 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:50.249175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d6d6d352-a7a0-4fe7-8a82-140f6f2094ec tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:50.276067 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d6d6d352-a7a0-4fe7-8a82-140f6f2094ec tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1313 microversion: 2.1 time: 1.324842 Jul 14 14:51:50.281846 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2256/4559] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:48 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1313 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:50.400352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-16b323bd-4b6b-4663-8b11-e5695a9a34d8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:50.401167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-16b323bd-4b6b-4663-8b11-e5695a9a34d8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:50.428327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16b323bd-4b6b-4663-8b11-e5695a9a34d8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:50.429179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16b323bd-4b6b-4663-8b11-e5695a9a34d8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:50.430516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16b323bd-4b6b-4663-8b11-e5695a9a34d8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:50.431269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16b323bd-4b6b-4663-8b11-e5695a9a34d8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:50.433958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-664c4d8f-9c00-454c-9681-8661ef38d250 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:50.464847 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-664c4d8f-9c00-454c-9681-8661ef38d250 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1237 microversion: 2.1 time: 0.558413 Jul 14 14:51:50.469670 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2304/4560] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:49 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1237 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:50.621348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9842d208-26b8-4790-8092-c286b433d710 req-96a180f3-c22f-4c94-b58b-9682ccb2be5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc2e279-dc51-42af-bd24-de3145eb9ddf", "name": "network-vif-plugged", "status": "completed", "tag": "4687dd97-9266-499e-8fab-ac989d68b907"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:50.654379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9842d208-26b8-4790-8092-c286b433d710 req-96a180f3-c22f-4c94-b58b-9682ccb2be5c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:50.657249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9842d208-26b8-4790-8092-c286b433d710 req-96a180f3-c22f-4c94-b58b-9682ccb2be5c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:50.709279 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9842d208-26b8-4790-8092-c286b433d710 req-96a180f3-c22f-4c94-b58b-9682ccb2be5c service nova] Creating event network-vif-plugged:4687dd97-9266-499e-8fab-ac989d68b907 for instance ddc2e279-dc51-42af-bd24-de3145eb9ddf on n-h1-767704-28 Jul 14 14:51:50.724085 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9842d208-26b8-4790-8092-c286b433d710 req-96a180f3-c22f-4c94-b58b-9682ccb2be5c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106420 Jul 14 14:51:50.730303 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2305/4561] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:51:51.316537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f54e4a2a-2e19-46db-9ba9-43559ba0e9b9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:51.328782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f54e4a2a-2e19-46db-9ba9-43559ba0e9b9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:51.346159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f54e4a2a-2e19-46db-9ba9-43559ba0e9b9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:51.346906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f54e4a2a-2e19-46db-9ba9-43559ba0e9b9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:51.347719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f54e4a2a-2e19-46db-9ba9-43559ba0e9b9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:51.348165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f54e4a2a-2e19-46db-9ba9-43559ba0e9b9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:52.572273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-16b323bd-4b6b-4663-8b11-e5695a9a34d8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:52.588604 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-16b323bd-4b6b-4663-8b11-e5695a9a34d8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1508 microversion: 2.1 time: 2.198481 Jul 14 14:51:52.593657 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2257/4562] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:50 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1508 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:52.605215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e8c01a83-d7ee-4d5b-98d8-a88a578c32c3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:52.607980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e8c01a83-d7ee-4d5b-98d8-a88a578c32c3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:52.630145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8c01a83-d7ee-4d5b-98d8-a88a578c32c3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:52.633185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8c01a83-d7ee-4d5b-98d8-a88a578c32c3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:52.634787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8c01a83-d7ee-4d5b-98d8-a88a578c32c3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:52.635424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8c01a83-d7ee-4d5b-98d8-a88a578c32c3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:52.739434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f54e4a2a-2e19-46db-9ba9-43559ba0e9b9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:52.763617 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f54e4a2a-2e19-46db-9ba9-43559ba0e9b9 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1313 microversion: 2.1 time: 1.466031 Jul 14 14:51:52.769305 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2306/4563] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:51 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1313 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:52.823525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e8c01a83-d7ee-4d5b-98d8-a88a578c32c3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:52.838772 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e8c01a83-d7ee-4d5b-98d8-a88a578c32c3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1299 microversion: 2.1 time: 0.242611 Jul 14 14:51:52.851778 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2258/4564] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:52 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:53.418641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3dd2d4cf-5f1a-4976-b303-494af679f610 req-7a9f8d8f-a501-41f2-9197-1cc8a9ced959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f7ce841-cb1a-4bb8-8b71-b869986dedba", "name": "network-vif-deleted", "tag": "2736a87c-2a3a-4ba3-9bde-a7d51d4ac83f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:53.469233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3dd2d4cf-5f1a-4976-b303-494af679f610 req-7a9f8d8f-a501-41f2-9197-1cc8a9ced959 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.485013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3dd2d4cf-5f1a-4976-b303-494af679f610 req-7a9f8d8f-a501-41f2-9197-1cc8a9ced959 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.511204 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3dd2d4cf-5f1a-4976-b303-494af679f610 req-7a9f8d8f-a501-41f2-9197-1cc8a9ced959 service nova] Creating event network-vif-deleted:2736a87c-2a3a-4ba3-9bde-a7d51d4ac83f for instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba on n-h2-767704-28 Jul 14 14:51:53.551822 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3dd2d4cf-5f1a-4976-b303-494af679f610 req-7a9f8d8f-a501-41f2-9197-1cc8a9ced959 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153703 Jul 14 14:51:53.555068 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2307/4565] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:53.610216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7340b568-215a-44ca-a7d6-3c415e1af88d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:53.611144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7340b568-215a-44ca-a7d6-3c415e1af88d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:53.632244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7340b568-215a-44ca-a7d6-3c415e1af88d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.636325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7340b568-215a-44ca-a7d6-3c415e1af88d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.637693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7340b568-215a-44ca-a7d6-3c415e1af88d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.638417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7340b568-215a-44ca-a7d6-3c415e1af88d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.716388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7340b568-215a-44ca-a7d6-3c415e1af88d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.717181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7340b568-215a-44ca-a7d6-3c415e1af88d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.718591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-7340b568-215a-44ca-a7d6-3c415e1af88d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lazy-loading 'fault' on Instance uuid 9f7ce841-cb1a-4bb8-8b71-b869986dedba {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:51:53.793714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-efe9df08-7ab5-476c-a839-989237935879 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:53.795236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-efe9df08-7ab5-476c-a839-989237935879 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:53.802825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efe9df08-7ab5-476c-a839-989237935879 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.803294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efe9df08-7ab5-476c-a839-989237935879 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.806235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efe9df08-7ab5-476c-a839-989237935879 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.806699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efe9df08-7ab5-476c-a839-989237935879 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.816705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7340b568-215a-44ca-a7d6-3c415e1af88d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:53.835980 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7340b568-215a-44ca-a7d6-3c415e1af88d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 200 len: 1310 microversion: 2.1 time: 0.232104 Jul 14 14:51:53.847970 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2259/4566] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:53 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 1310 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:53.864305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-04111949-a816-45f9-82b0-5a76b2aa7750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:53.866708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-04111949-a816-45f9-82b0-5a76b2aa7750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:53.880493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04111949-a816-45f9-82b0-5a76b2aa7750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.883734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04111949-a816-45f9-82b0-5a76b2aa7750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.884900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04111949-a816-45f9-82b0-5a76b2aa7750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.888208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04111949-a816-45f9-82b0-5a76b2aa7750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.164852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-04111949-a816-45f9-82b0-5a76b2aa7750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:54.181353 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-04111949-a816-45f9-82b0-5a76b2aa7750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1299 microversion: 2.1 time: 0.323865 Jul 14 14:51:54.184274 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2260/4567] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:53 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1299 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:54.331420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-efe9df08-7ab5-476c-a839-989237935879 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:54.344208 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-efe9df08-7ab5-476c-a839-989237935879 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1313 microversion: 2.1 time: 0.557588 Jul 14 14:51:54.348810 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2308/4568] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:53 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:54.860193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed3facce-30c9-4360-ba8d-54437f7e0473 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:54.860812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ed3facce-30c9-4360-ba8d-54437f7e0473 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:54.876020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed3facce-30c9-4360-ba8d-54437f7e0473 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.876502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed3facce-30c9-4360-ba8d-54437f7e0473 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.877455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed3facce-30c9-4360-ba8d-54437f7e0473 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.878073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed3facce-30c9-4360-ba8d-54437f7e0473 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.908184 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-ed3facce-30c9-4360-ba8d-54437f7e0473 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed3facce-30c9-4360-ba8d-54437f7e0473 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba HTTP/1.1 Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '9f7ce841-cb1a-4bb8-8b71-b869986dedba'} Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:54.910361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:54.915121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:54.915121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:54.915121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:54.915121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:54.915121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:51:54.915121 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:51:54.917291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed3facce-30c9-4360-ba8d-54437f7e0473 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:54.919890 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed3facce-30c9-4360-ba8d-54437f7e0473 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 404 len: 111 microversion: 2.1 time: 0.069397 Jul 14 14:51:54.936346 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2261/4569] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:54 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:54.942685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c1fe0649-7eff-45bb-a7f0-81a2f8a148e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'create', calling method: .version_select at 0x7fd6c4cda790>, body: {"keypair": {"name": "tempest-key-279403775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzEQzHVNeOorECSV7CoO8+6m2+H6FD0wZHynS6ZIdZ6P1YuRH/mQEsghuruU9MJdX6slhg/vIrTfwDvwYUn6Tsq4a9OJcPCgVS1p3tssR0/IwdKz+nqlm+R+QKcUz8bsw=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:54.994461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-c1fe0649-7eff-45bb-a7f0-81a2f8a148e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:55.015981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-c1fe0649-7eff-45bb-a7f0-81a2f8a148e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for user 4e3af45ec76c4a0b8dd03dcff6802f3c and project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:55.072885 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c1fe0649-7eff-45bb-a7f0-81a2f8a148e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.135841 Jul 14 14:51:55.074036 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2309/4570] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:51:54 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:55.092401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-333a7c2c-4a8d-44a1-84a5-258314ff053f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '.version_select at 0x7fd6c474daf0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:55.109212 n-d-767704-28 devstack@n-api.service[119511]: WARNING oslo_db.sqlalchemy.utils [None req-333a7c2c-4a8d-44a1-84a5-258314ff053f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 14 14:51:55.134472 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-333a7c2c-4a8d-44a1-84a5-258314ff053f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.053120 Jul 14 14:51:55.138856 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2262/4571] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:51:55 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:55.204154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c211daa6-1796-4bcc-9f64-0d672c130fe2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:55.204789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c211daa6-1796-4bcc-9f64-0d672c130fe2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:55.215221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c211daa6-1796-4bcc-9f64-0d672c130fe2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.217062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c211daa6-1796-4bcc-9f64-0d672c130fe2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.218601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c211daa6-1796-4bcc-9f64-0d672c130fe2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.229695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c211daa6-1796-4bcc-9f64-0d672c130fe2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.343310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c211daa6-1796-4bcc-9f64-0d672c130fe2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:55.355884 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c211daa6-1796-4bcc-9f64-0d672c130fe2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1299 microversion: 2.1 time: 0.156745 Jul 14 14:51:55.357663 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2310/4572] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:55 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1299 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:55.378155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cea36408-a98a-49d6-8e5f-425d740acc8f tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:55.378973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cea36408-a98a-49d6-8e5f-425d740acc8f tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:55.392657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cea36408-a98a-49d6-8e5f-425d740acc8f tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.394676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cea36408-a98a-49d6-8e5f-425d740acc8f tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.397714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cea36408-a98a-49d6-8e5f-425d740acc8f tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.398697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cea36408-a98a-49d6-8e5f-425d740acc8f tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.483055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-568863366", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "key_name": "tempest-key-279403775", "networks": [{"uuid": "525f1693-8842-4191-b231-7d2db21bdaf8"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:55.588357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] validate_networks() for [('525f1693-8842-4191-b231-7d2db21bdaf8', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:55.753932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cea36408-a98a-49d6-8e5f-425d740acc8f tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:55.769722 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cea36408-a98a-49d6-8e5f-425d740acc8f tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1498 microversion: 2.1 time: 0.407376 Jul 14 14:51:55.770737 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2263/4573] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:55 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1498 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:55.787641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fb9a0b55-8c95-4d89-ac50-ee1876f248c0 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:55.809196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.compute.server_groups [None req-fb9a0b55-8c95-4d89-ac50-ee1876f248c0 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Querying cell e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) for 1 instances {{(pid=119511) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 14 14:51:55.810834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb9a0b55-8c95-4d89-ac50-ee1876f248c0 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.812298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb9a0b55-8c95-4d89-ac50-ee1876f248c0 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.839208 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fb9a0b55-8c95-4d89-ac50-ee1876f248c0 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups/090fdf1e-e2ac-438b-8488-d5f9c904d5fa" status: 200 len: 222 microversion: 2.1 time: 0.055669 Jul 14 14:51:55.839430 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2264/4574] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:51:55 2022] GET /compute/v2.1/os-server-groups/090fdf1e-e2ac-438b-8488-d5f9c904d5fa => generated 222 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:51:55.849937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dd7b594a-d753-4e8c-9bb3-1487af400a26 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:55.850599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dd7b594a-d753-4e8c-9bb3-1487af400a26 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:55.858515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd7b594a-d753-4e8c-9bb3-1487af400a26 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.859152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd7b594a-d753-4e8c-9bb3-1487af400a26 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.860043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd7b594a-d753-4e8c-9bb3-1487af400a26 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.860584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd7b594a-d753-4e8c-9bb3-1487af400a26 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.923163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dd7b594a-d753-4e8c-9bb3-1487af400a26 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:51:56.073602 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dd7b594a-d753-4e8c-9bb3-1487af400a26 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 204 len: 0 microversion: 2.1 time: 0.224777 Jul 14 14:51:56.084158 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2265/4575] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:55 2022] DELETE /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:51:56.093994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf294fd2-68cd-45c1-aadd-e83956bcd59c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:56.096673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bf294fd2-68cd-45c1-aadd-e83956bcd59c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:56.108056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf294fd2-68cd-45c1-aadd-e83956bcd59c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.108743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf294fd2-68cd-45c1-aadd-e83956bcd59c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.109851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf294fd2-68cd-45c1-aadd-e83956bcd59c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.110648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf294fd2-68cd-45c1-aadd-e83956bcd59c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.409525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bf294fd2-68cd-45c1-aadd-e83956bcd59c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:57.468155 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf294fd2-68cd-45c1-aadd-e83956bcd59c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1504 microversion: 2.1 time: 1.381042 Jul 14 14:51:57.488078 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2266/4576] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:56 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1504 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:57.521534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7fe2328a-39a0-45e2-bcdf-f495cdd99045 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:57.525295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7fe2328a-39a0-45e2-bcdf-f495cdd99045 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:57.555987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fe2328a-39a0-45e2-bcdf-f495cdd99045 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.558336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fe2328a-39a0-45e2-bcdf-f495cdd99045 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.564471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fe2328a-39a0-45e2-bcdf-f495cdd99045 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.565839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fe2328a-39a0-45e2-bcdf-f495cdd99045 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.755578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:57.757620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:57.758278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:57.758836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:57.759421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:57.780354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.781129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.785727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.786702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.847080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:57.866117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for user 4e3af45ec76c4a0b8dd03dcff6802f3c and project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:57.877269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:57.922528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:57.927060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:58.070367 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dcd11ade-4bde-4818-b065-0d08a478dd93 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.591214 Jul 14 14:51:58.070969 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2311/4577] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:51:58.086017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9b5ef2c-a48f-44f0-9002-2bc452fddea2 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:58.089267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b9b5ef2c-a48f-44f0-9002-2bc452fddea2 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:58.103484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9b5ef2c-a48f-44f0-9002-2bc452fddea2 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:58.106670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9b5ef2c-a48f-44f0-9002-2bc452fddea2 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:58.107732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9b5ef2c-a48f-44f0-9002-2bc452fddea2 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:58.108844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9b5ef2c-a48f-44f0-9002-2bc452fddea2 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:58.213005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b9b5ef2c-a48f-44f0-9002-2bc452fddea2 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:51:58.413674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:58.488572 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b9b5ef2c-a48f-44f0-9002-2bc452fddea2 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 204 len: 0 microversion: 2.1 time: 0.414516 Jul 14 14:51:58.494420 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2312/4578] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:58 2022] DELETE /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:58.524563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3ea511f1-30b0-4253-be60-8d6caea0a221 req-d514f40b-04ac-4263-9ef2-5f2db7ec2049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb68e36c-3f0c-4567-bf71-cee172d26584", "tag": "b740bd7f-b45f-434b-b252-0a0b8ca2850b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:58.554930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3ea511f1-30b0-4253-be60-8d6caea0a221 req-d514f40b-04ac-4263-9ef2-5f2db7ec2049 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:58.555767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3ea511f1-30b0-4253-be60-8d6caea0a221 req-d514f40b-04ac-4263-9ef2-5f2db7ec2049 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:58.576741 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3ea511f1-30b0-4253-be60-8d6caea0a221 req-d514f40b-04ac-4263-9ef2-5f2db7ec2049 service nova] Creating event network-changed:b740bd7f-b45f-434b-b252-0a0b8ca2850b for instance cb68e36c-3f0c-4567-bf71-cee172d26584 on n-h1-767704-28 Jul 14 14:51:58.589696 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3ea511f1-30b0-4253-be60-8d6caea0a221 req-d514f40b-04ac-4263-9ef2-5f2db7ec2049 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087736 Jul 14 14:51:58.595451 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2313/4579] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:58.626785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c220263-e7ca-4c63-8627-683d60406945 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:58.628057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1c220263-e7ca-4c63-8627-683d60406945 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:58.884459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:59.008982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1c220263-e7ca-4c63-8627-683d60406945 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:59.023405 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1c220263-e7ca-4c63-8627-683d60406945 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1227 microversion: 2.1 time: 0.424692 Jul 14 14:51:59.027499 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2314/4580] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:58 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1227 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:59.039450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-240b6edc-349e-41a3-b4e1-bbbfcb00021e tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:59.040082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-240b6edc-349e-41a3-b4e1-bbbfcb00021e tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:59.055216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-240b6edc-349e-41a3-b4e1-bbbfcb00021e tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.055675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-240b6edc-349e-41a3-b4e1-bbbfcb00021e tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.056489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-240b6edc-349e-41a3-b4e1-bbbfcb00021e tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.056940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-240b6edc-349e-41a3-b4e1-bbbfcb00021e tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.827181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-240b6edc-349e-41a3-b4e1-bbbfcb00021e tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:59.838968 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-240b6edc-349e-41a3-b4e1-bbbfcb00021e tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1581 microversion: 2.1 time: 0.808579 Jul 14 14:51:59.849433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7fe2328a-39a0-45e2-bcdf-f495cdd99045 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:59.852660 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2315/4581] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:59 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1581 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:59.865742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d66cc2dc-dabe-46b1-b6e7-a3fdccf1198a tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:59.866374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d66cc2dc-dabe-46b1-b6e7-a3fdccf1198a tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:59.867009 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7fe2328a-39a0-45e2-bcdf-f495cdd99045 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1366 microversion: 2.1 time: 2.372056 Jul 14 14:51:59.877054 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2267/4582] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:57 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1366 bytes in 2380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:59.884503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d66cc2dc-dabe-46b1-b6e7-a3fdccf1198a tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.884977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d66cc2dc-dabe-46b1-b6e7-a3fdccf1198a tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.886024 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d66cc2dc-dabe-46b1-b6e7-a3fdccf1198a tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.893592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d66cc2dc-dabe-46b1-b6e7-a3fdccf1198a tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.041114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0afc0ceb-d827-4c00-b310-8ba7742c99c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:00.041752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0afc0ceb-d827-4c00-b310-8ba7742c99c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:00.056200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0afc0ceb-d827-4c00-b310-8ba7742c99c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.056668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0afc0ceb-d827-4c00-b310-8ba7742c99c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.068188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0afc0ceb-d827-4c00-b310-8ba7742c99c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.068980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0afc0ceb-d827-4c00-b310-8ba7742c99c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.161852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:00.524214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0afc0ceb-d827-4c00-b310-8ba7742c99c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:00.537892 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0afc0ceb-d827-4c00-b310-8ba7742c99c0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1279 microversion: 2.1 time: 0.501865 Jul 14 14:52:00.540825 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2268/4583] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:00 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1279 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:52:00.858913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c0dab354-a99b-4085-a4f1-5e2644650478 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:00.859687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c0dab354-a99b-4085-a4f1-5e2644650478 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:00.867365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0dab354-a99b-4085-a4f1-5e2644650478 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.868315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0dab354-a99b-4085-a4f1-5e2644650478 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.869520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0dab354-a99b-4085-a4f1-5e2644650478 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.870255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0dab354-a99b-4085-a4f1-5e2644650478 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:01.527445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d66cc2dc-dabe-46b1-b6e7-a3fdccf1198a tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:01.588216 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d66cc2dc-dabe-46b1-b6e7-a3fdccf1198a tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1504 microversion: 2.1 time: 1.729008 Jul 14 14:52:01.590097 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2316/4584] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:59 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1504 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:01.645614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05b07a25-8797-4108-9be8-26e38c513e79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:01.648605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-05b07a25-8797-4108-9be8-26e38c513e79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:01.677461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05b07a25-8797-4108-9be8-26e38c513e79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:01.682221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05b07a25-8797-4108-9be8-26e38c513e79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:01.687272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05b07a25-8797-4108-9be8-26e38c513e79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:01.688535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05b07a25-8797-4108-9be8-26e38c513e79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.338054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c0dab354-a99b-4085-a4f1-5e2644650478 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:02.376272 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c0dab354-a99b-4085-a4f1-5e2644650478 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1514 microversion: 2.1 time: 1.512835 Jul 14 14:52:02.378284 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2269/4585] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:00 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1514 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:52:02.425582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e3a7d38a-a9f6-4a05-ab2c-2f39622e2453 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:02.431288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e3a7d38a-a9f6-4a05-ab2c-2f39622e2453 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:02.456449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3a7d38a-a9f6-4a05-ab2c-2f39622e2453 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.457919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3a7d38a-a9f6-4a05-ab2c-2f39622e2453 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.460040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3a7d38a-a9f6-4a05-ab2c-2f39622e2453 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.461206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3a7d38a-a9f6-4a05-ab2c-2f39622e2453 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.380853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e3a7d38a-a9f6-4a05-ab2c-2f39622e2453 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:03.390445 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e3a7d38a-a9f6-4a05-ab2c-2f39622e2453 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1285 microversion: 2.1 time: 0.986820 Jul 14 14:52:03.391064 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2270/4586] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:02 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1285 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:03.406394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21eb940a-07b9-4a8c-ae4c-4d430d043588 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:03.407704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-21eb940a-07b9-4a8c-ae4c-4d430d043588 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:03.417179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21eb940a-07b9-4a8c-ae4c-4d430d043588 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.417874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21eb940a-07b9-4a8c-ae4c-4d430d043588 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.419378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21eb940a-07b9-4a8c-ae4c-4d430d043588 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.422544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21eb940a-07b9-4a8c-ae4c-4d430d043588 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.088352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-21eb940a-07b9-4a8c-ae4c-4d430d043588 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28ca5d3f67a64722a19adf5ae3d1a3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d7fa2f739b458a8ac6c529c1fa8266', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:04.117561 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21eb940a-07b9-4a8c-ae4c-4d430d043588 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 200 len: 1462 microversion: 2.1 time: 0.715434 Jul 14 14:52:04.119091 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2271/4587] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:03 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 1462 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:04.371598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-05b07a25-8797-4108-9be8-26e38c513e79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:04.391838 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-05b07a25-8797-4108-9be8-26e38c513e79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1366 microversion: 2.1 time: 2.790667 Jul 14 14:52:04.394606 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2317/4588] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:01 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1366 bytes in 2804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:04.420794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-358c162d-34f4-4158-ab1c-8def936c8648 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:04.430088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-358c162d-34f4-4158-ab1c-8def936c8648 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:04.460610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-358c162d-34f4-4158-ab1c-8def936c8648 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:04.466525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-358c162d-34f4-4158-ab1c-8def936c8648 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.469514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-358c162d-34f4-4158-ab1c-8def936c8648 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:04.470052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-358c162d-34f4-4158-ab1c-8def936c8648 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.724997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-86405056", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "e1c35f5b-67bf-4a66-806e-ed73ee078b8f"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:04.858985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] validate_networks() for [('e1c35f5b-67bf-4a66-806e-ed73ee078b8f', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:52:04.969130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-358c162d-34f4-4158-ab1c-8def936c8648 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:04.993497 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-358c162d-34f4-4158-ab1c-8def936c8648 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1229 microversion: 2.1 time: 0.584333 Jul 14 14:52:05.002242 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2318/4589] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:04 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1229 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:05.024920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-45685b99-0b3f-4188-83bb-fff37cc124d8 req-cf83dddf-76de-46cc-a7f0-532640d11d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb68e36c-3f0c-4567-bf71-cee172d26584", "name": "network-vif-deleted", "tag": "b740bd7f-b45f-434b-b252-0a0b8ca2850b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:05.038632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-45685b99-0b3f-4188-83bb-fff37cc124d8 req-cf83dddf-76de-46cc-a7f0-532640d11d6e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.039335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-45685b99-0b3f-4188-83bb-fff37cc124d8 req-cf83dddf-76de-46cc-a7f0-532640d11d6e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.055546 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-45685b99-0b3f-4188-83bb-fff37cc124d8 req-cf83dddf-76de-46cc-a7f0-532640d11d6e service nova] Creating event network-vif-deleted:b740bd7f-b45f-434b-b252-0a0b8ca2850b for instance cb68e36c-3f0c-4567-bf71-cee172d26584 on n-h1-767704-28 Jul 14 14:52:05.064696 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-45685b99-0b3f-4188-83bb-fff37cc124d8 req-cf83dddf-76de-46cc-a7f0-532640d11d6e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057022 Jul 14 14:52:05.068158 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2319/4590] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:05.082289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ca9cd147-7700-4cfe-b622-d6fdbe7d3316 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:05.087286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ca9cd147-7700-4cfe-b622-d6fdbe7d3316 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:05.110893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ca9cd147-7700-4cfe-b622-d6fdbe7d3316 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.111346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ca9cd147-7700-4cfe-b622-d6fdbe7d3316 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.117734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ca9cd147-7700-4cfe-b622-d6fdbe7d3316 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.119300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ca9cd147-7700-4cfe-b622-d6fdbe7d3316 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.610232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ca9cd147-7700-4cfe-b622-d6fdbe7d3316 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:05.624729 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ca9cd147-7700-4cfe-b622-d6fdbe7d3316 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1285 microversion: 2.1 time: 0.553490 Jul 14 14:52:05.625554 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2320/4591] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:05 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1285 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:05.636573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-bc0738df-69fe-4294-9618-4df5f7828128 req-37f48e40-314e-4006-9f78-675d385592c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99", "tag": "ac272c7e-fc83-4f7e-82e5-9206b48aeaeb"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:05.661745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bc0738df-69fe-4294-9618-4df5f7828128 req-37f48e40-314e-4006-9f78-675d385592c6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.662194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bc0738df-69fe-4294-9618-4df5f7828128 req-37f48e40-314e-4006-9f78-675d385592c6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.696568 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-bc0738df-69fe-4294-9618-4df5f7828128 req-37f48e40-314e-4006-9f78-675d385592c6 service nova] Creating event network-changed:ac272c7e-fc83-4f7e-82e5-9206b48aeaeb for instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 on n-h1-767704-28 Jul 14 14:52:05.714963 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-bc0738df-69fe-4294-9618-4df5f7828128 req-37f48e40-314e-4006-9f78-675d385592c6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083374 Jul 14 14:52:05.717289 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2321/4592] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:05.729694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a50b5c3d-d658-4468-abd0-24399f586b44 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:05.730005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a50b5c3d-d658-4468-abd0-24399f586b44 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:05.746616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a50b5c3d-d658-4468-abd0-24399f586b44 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.750499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a50b5c3d-d658-4468-abd0-24399f586b44 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.751368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a50b5c3d-d658-4468-abd0-24399f586b44 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.751820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a50b5c3d-d658-4468-abd0-24399f586b44 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.792922 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-a50b5c3d-d658-4468-abd0-24399f586b44 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] HTTP exception thrown: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a50b5c3d-d658-4468-abd0-24399f586b44 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Request method failure captured: Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf HTTP/1.1 Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1l_DrVDOTBxn1rnoJCyqfob6TjRQ717dpUTowQ1CsB5IOEr-H8kwf6z0WmEs2Tf--kNLs6kei4M__5mn7gWxXW2ehFHDMtMtGql0oi5So4h69mjM5BSYpg8bsuuQ9WDZITldJQ8E0JR2NljOHvxdoUcp-kwwo50nCDg1OHiLUveVg Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07d7fa2f739b458a8ac6c529c1fa8266", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}] Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 28ca5d3f67a64722a19adf5ae3d1a3a0 Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'ddc2e279-dc51-42af-bd24-de3145eb9ddf'} Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:05.799917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:05.810608 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:05.810608 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:05.810608 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:05.810608 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:05.810608 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:05.810608 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:05.810608 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:05.810608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a50b5c3d-d658-4468-abd0-24399f586b44 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Returning 404 to user: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:05.810608 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a50b5c3d-d658-4468-abd0-24399f586b44 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 404 len: 111 microversion: 2.1 time: 0.085885 Jul 14 14:52:05.810608 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2322/4593] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:05 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:05.824338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-13108eb5-e017-44eb-8018-2453f03e1612 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:05.827470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-13108eb5-e017-44eb-8018-2453f03e1612 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:05.842981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13108eb5-e017-44eb-8018-2453f03e1612 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.843450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13108eb5-e017-44eb-8018-2453f03e1612 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.844250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13108eb5-e017-44eb-8018-2453f03e1612 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.846981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13108eb5-e017-44eb-8018-2453f03e1612 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:07.330769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-13108eb5-e017-44eb-8018-2453f03e1612 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:07.358796 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-13108eb5-e017-44eb-8018-2453f03e1612 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1366 microversion: 2.1 time: 1.546379 Jul 14 14:52:07.361066 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2323/4594] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:05 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1366 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:07.373515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-677fc2fa-25c9-4443-99f7-5261387985ba tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:07.415068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.compute.server_groups [None req-677fc2fa-25c9-4443-99f7-5261387985ba tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Querying cell e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) for 1 instances {{(pid=119512) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 14 14:52:07.418073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-677fc2fa-25c9-4443-99f7-5261387985ba tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:07.427785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-677fc2fa-25c9-4443-99f7-5261387985ba tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:07.474617 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-677fc2fa-25c9-4443-99f7-5261387985ba tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.112167 Jul 14 14:52:07.478045 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2324/4595] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:52:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:07.506597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7290eca1-41d1-41eb-961b-664c70cbca02 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:07.507237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7290eca1-41d1-41eb-961b-664c70cbca02 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:07.518272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7290eca1-41d1-41eb-961b-664c70cbca02 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:07.518734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7290eca1-41d1-41eb-961b-664c70cbca02 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:07.519787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7290eca1-41d1-41eb-961b-664c70cbca02 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:07.525208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7290eca1-41d1-41eb-961b-664c70cbca02 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:07.819977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:07.989897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7290eca1-41d1-41eb-961b-664c70cbca02 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:07.993109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:08.020608 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7290eca1-41d1-41eb-961b-664c70cbca02 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1229 microversion: 2.1 time: 0.528008 Jul 14 14:52:08.021625 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2325/4596] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:07 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1229 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:08.051847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1cfa3dab-7779-42a5-9fa8-712dba62df45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:08.056912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1cfa3dab-7779-42a5-9fa8-712dba62df45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:08.082280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cfa3dab-7779-42a5-9fa8-712dba62df45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.083194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cfa3dab-7779-42a5-9fa8-712dba62df45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.094047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cfa3dab-7779-42a5-9fa8-712dba62df45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.095439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cfa3dab-7779-42a5-9fa8-712dba62df45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.538496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:52:08.539279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:52:08.539651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:52:08.540416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:52:08.541063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:52:08.547403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:08.583185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.585938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.587563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.588020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.648053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Getting quotas for project 1e7e71d44e0447b8a810fcd5d935b7c1. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:52:08.654585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Getting quotas for user c21ce7d197ab4e1894b125b230514da1 and project 1e7e71d44e0447b8a810fcd5d935b7c1. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:52:08.663446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1cfa3dab-7779-42a5-9fa8-712dba62df45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:08.675142 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1cfa3dab-7779-42a5-9fa8-712dba62df45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1327 microversion: 2.1 time: 0.650872 Jul 14 14:52:08.679381 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2326/4597] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:08 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1327 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:08.691094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f05a288d-a246-4fb0-b4ce-0c45c6bf116b req-a8f6874b-356b-48c1-8d87-e9f668c290ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc2e279-dc51-42af-bd24-de3145eb9ddf", "name": "network-vif-deleted", "tag": "4687dd97-9266-499e-8fab-ac989d68b907"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:08.701469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:52:08.703932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:52:08.715418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f05a288d-a246-4fb0-b4ce-0c45c6bf116b req-a8f6874b-356b-48c1-8d87-e9f668c290ef service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.717131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f05a288d-a246-4fb0-b4ce-0c45c6bf116b req-a8f6874b-356b-48c1-8d87-e9f668c290ef service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.755829 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f05a288d-a246-4fb0-b4ce-0c45c6bf116b req-a8f6874b-356b-48c1-8d87-e9f668c290ef service nova] Creating event network-vif-deleted:4687dd97-9266-499e-8fab-ac989d68b907 for instance ddc2e279-dc51-42af-bd24-de3145eb9ddf on n-h1-767704-28 Jul 14 14:52:08.763187 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f05a288d-a246-4fb0-b4ce-0c45c6bf116b req-a8f6874b-356b-48c1-8d87-e9f668c290ef service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081919 Jul 14 14:52:08.765456 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2327/4598] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:08.773115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a2373320-3220-485f-afbc-31884f627b19 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:08.795382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.compute.server_groups [None req-a2373320-3220-485f-afbc-31884f627b19 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Querying cell e4faef3f-6327-46a1-98b4-fcbca87641b2(cell1) for 1 instances {{(pid=119512) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 14 14:52:08.796926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2373320-3220-485f-afbc-31884f627b19 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.797688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2373320-3220-485f-afbc-31884f627b19 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.803320 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e126cc07-3315-4e4c-984a-09ee351f4aca tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.682512 Jul 14 14:52:08.803997 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2272/4599] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:52:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 4684 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:52:08.822390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7e0de0cc-5e71-47d8-9dfd-3faad84f7529 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:08.823297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7e0de0cc-5e71-47d8-9dfd-3faad84f7529 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:08.830785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e0de0cc-5e71-47d8-9dfd-3faad84f7529 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.831509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e0de0cc-5e71-47d8-9dfd-3faad84f7529 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.833900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e0de0cc-5e71-47d8-9dfd-3faad84f7529 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.834431 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a2373320-3220-485f-afbc-31884f627b19 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/os-server-groups/090fdf1e-e2ac-438b-8488-d5f9c904d5fa" status: 200 len: 184 microversion: 2.1 time: 0.066906 Jul 14 14:52:08.835946 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2328/4600] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:52:08 2022] GET /compute/v2.1/os-server-groups/090fdf1e-e2ac-438b-8488-d5f9c904d5fa => generated 184 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:08.836593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e0de0cc-5e71-47d8-9dfd-3faad84f7529 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.846532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6b31b80e-2201-4a55-bccb-c4be8ab98e9d tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:08.847553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6b31b80e-2201-4a55-bccb-c4be8ab98e9d tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:09.023106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=12 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:09.090199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6b31b80e-2201-4a55-bccb-c4be8ab98e9d tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:09.098839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6b31b80e-2201-4a55-bccb-c4be8ab98e9d tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:09.100535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6b31b80e-2201-4a55-bccb-c4be8ab98e9d tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:09.101833 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6b31b80e-2201-4a55-bccb-c4be8ab98e9d tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1260 microversion: 2.26 time: 0.262365 Jul 14 14:52:09.116259 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2329/4601] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:08 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1260 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:09.122964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-91918077-ee64-4b6c-b9e4-bb235431da63 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.123792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-91918077-ee64-4b6c-b9e4-bb235431da63 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:09.141255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91918077-ee64-4b6c-b9e4-bb235431da63 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.142013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91918077-ee64-4b6c-b9e4-bb235431da63 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.143046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91918077-ee64-4b6c-b9e4-bb235431da63 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.147311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91918077-ee64-4b6c-b9e4-bb235431da63 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.173651 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-91918077-ee64-4b6c-b9e4-bb235431da63 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] HTTP exception thrown: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-91918077-ee64-4b6c-b9e4-bb235431da63 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Request method failure captured: Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf HTTP/1.1 Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1l_DrVDOTBxn1rnoJCyqfob6TjRQ717dpUTowQ1CsB5IOEr-H8kwf6z0WmEs2Tf--kNLs6kei4M__5mn7gWxXW2ehFHDMtMtGql0oi5So4h69mjM5BSYpg8bsuuQ9WDZITldJQ8E0JR2NljOHvxdoUcp-kwwo50nCDg1OHiLUveVg Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07d7fa2f739b458a8ac6c529c1fa8266", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}] Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 28ca5d3f67a64722a19adf5ae3d1a3a0 Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'ddc2e279-dc51-42af-bd24-de3145eb9ddf'} Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:09.176610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:09.181881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:09.181881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.181881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:09.181881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.181881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.181881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:09.181881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:09.181881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:09.181881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:09.181881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:09.181881 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.185895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-91918077-ee64-4b6c-b9e4-bb235431da63 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Returning 404 to user: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:09.187047 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-91918077-ee64-4b6c-b9e4-bb235431da63 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 404 len: 111 microversion: 2.1 time: 0.069400 Jul 14 14:52:09.187826 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2330/4602] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:52:09 2022] DELETE /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:09.196663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a79af641-9fb6-48ea-a94c-d773fab81155 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.197667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a79af641-9fb6-48ea-a94c-d773fab81155 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:09.212342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a79af641-9fb6-48ea-a94c-d773fab81155 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.213014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a79af641-9fb6-48ea-a94c-d773fab81155 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.214283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a79af641-9fb6-48ea-a94c-d773fab81155 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.215068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a79af641-9fb6-48ea-a94c-d773fab81155 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.472665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a79af641-9fb6-48ea-a94c-d773fab81155 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:09.489947 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a79af641-9fb6-48ea-a94c-d773fab81155 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1229 microversion: 2.1 time: 0.297201 Jul 14 14:52:09.490559 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2331/4603] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:09 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1229 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:09.505713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-88082b0e-5024-4ce8-b946-4d5ba11c44da tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.506866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-88082b0e-5024-4ce8-b946-4d5ba11c44da tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] [instance: ddc2e279-dc51-42af-bd24-de3145eb9ddf] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:09.527770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88082b0e-5024-4ce8-b946-4d5ba11c44da tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.529155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88082b0e-5024-4ce8-b946-4d5ba11c44da tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.530062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88082b0e-5024-4ce8-b946-4d5ba11c44da tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.530580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88082b0e-5024-4ce8-b946-4d5ba11c44da tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.555445 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-88082b0e-5024-4ce8-b946-4d5ba11c44da tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] HTTP exception thrown: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:09.561798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7e0de0cc-5e71-47d8-9dfd-3faad84f7529 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-88082b0e-5024-4ce8-b946-4d5ba11c44da tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Request method failure captured: Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf HTTP/1.1 Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1l_DrVDOTBxn1rnoJCyqfob6TjRQ717dpUTowQ1CsB5IOEr-H8kwf6z0WmEs2Tf--kNLs6kei4M__5mn7gWxXW2ehFHDMtMtGql0oi5So4h69mjM5BSYpg8bsuuQ9WDZITldJQ8E0JR2NljOHvxdoUcp-kwwo50nCDg1OHiLUveVg Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07d7fa2f739b458a8ac6c529c1fa8266", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}] Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 28ca5d3f67a64722a19adf5ae3d1a3a0 Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'ddc2e279-dc51-42af-bd24-de3145eb9ddf'} Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:09.577742 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.586536 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.586536 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:09.586536 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:09.586536 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:09.586536 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:09.586536 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. Jul 14 14:52:09.586536 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.586536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-88082b0e-5024-4ce8-b946-4d5ba11c44da tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Returning 404 to user: Instance ddc2e279-dc51-42af-bd24-de3145eb9ddf could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:09.586536 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-88082b0e-5024-4ce8-b946-4d5ba11c44da tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf" status: 404 len: 111 microversion: 2.1 time: 0.077753 Jul 14 14:52:09.586536 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2332/4604] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:09 2022] GET /compute/v2.1/servers/ddc2e279-dc51-42af-bd24-de3145eb9ddf => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:09.602591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d0e508b3-7a6a-4712-8e7d-21c89c1f131c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.605618 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7e0de0cc-5e71-47d8-9dfd-3faad84f7529 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1366 microversion: 2.1 time: 0.795109 Jul 14 14:52:09.618879 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-d0e508b3-7a6a-4712-8e7d-21c89c1f131c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] HTTP exception thrown: Instance group 36c8faaa-469e-42a4-89a3-5dd36ef61d4b could not be found. Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d0e508b3-7a6a-4712-8e7d-21c89c1f131c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Request method failure captured: Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-server-groups/36c8faaa-469e-42a4-89a3-5dd36ef61d4b HTTP/1.1 Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1l_DrVDOTBxn1rnoJCyqfob6TjRQ717dpUTowQ1CsB5IOEr-H8kwf6z0WmEs2Tf--kNLs6kei4M__5mn7gWxXW2ehFHDMtMtGql0oi5So4h69mjM5BSYpg8bsuuQ9WDZITldJQ8E0JR2NljOHvxdoUcp-kwwo50nCDg1OHiLUveVg Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07d7fa2f739b458a8ac6c529c1fa8266", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}] Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 28ca5d3f67a64722a19adf5ae3d1a3a0 Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance group 36c8faaa-469e-42a4-89a3-5dd36ef61d4b could not be found. Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '36c8faaa-469e-42a4-89a3-5dd36ef61d4b'} Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 36c8faaa-469e-42a4-89a3-5dd36ef61d4b could not be found. Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 36c8faaa-469e-42a4-89a3-5dd36ef61d4b could not be found. Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.620413 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.628643 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:09.628643 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:09.628643 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:09.628643 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:09.628643 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 36c8faaa-469e-42a4-89a3-5dd36ef61d4b could not be found. Jul 14 14:52:09.628643 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.628643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d0e508b3-7a6a-4712-8e7d-21c89c1f131c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Returning 404 to user: Instance group 36c8faaa-469e-42a4-89a3-5dd36ef61d4b could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:09.628643 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d0e508b3-7a6a-4712-8e7d-21c89c1f131c tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/36c8faaa-469e-42a4-89a3-5dd36ef61d4b" status: 404 len: 117 microversion: 2.1 time: 0.031726 Jul 14 14:52:09.630009 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2273/4605] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:08 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1366 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:09.641282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-58625180-7da2-4df7-958b-1451f5788513 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.641537 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2333/4606] 10.222.0.81 () {58 vars in 1265 bytes} [Thu Jul 14 14:52:09 2022] DELETE /compute/v2.1/os-server-groups/36c8faaa-469e-42a4-89a3-5dd36ef61d4b => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:09.673179 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-58625180-7da2-4df7-958b-1451f5788513 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] HTTP exception thrown: Instance group ea859a5c-0540-4043-9f6a-68973eccfae5 could not be found. Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-58625180-7da2-4df7-958b-1451f5788513 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Request method failure captured: Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-server-groups/ea859a5c-0540-4043-9f6a-68973eccfae5 HTTP/1.1 Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1l_DrVDOTBxn1rnoJCyqfob6TjRQ717dpUTowQ1CsB5IOEr-H8kwf6z0WmEs2Tf--kNLs6kei4M__5mn7gWxXW2ehFHDMtMtGql0oi5So4h69mjM5BSYpg8bsuuQ9WDZITldJQ8E0JR2NljOHvxdoUcp-kwwo50nCDg1OHiLUveVg Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07d7fa2f739b458a8ac6c529c1fa8266", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}] Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 28ca5d3f67a64722a19adf5ae3d1a3a0 Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance group ea859a5c-0540-4043-9f6a-68973eccfae5 could not be found. Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'ea859a5c-0540-4043-9f6a-68973eccfae5'} Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ea859a5c-0540-4043-9f6a-68973eccfae5 could not be found. Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ea859a5c-0540-4043-9f6a-68973eccfae5 could not be found. Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.680747 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.687119 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:09.687119 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:09.687119 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:09.687119 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:09.687119 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ea859a5c-0540-4043-9f6a-68973eccfae5 could not be found. Jul 14 14:52:09.687119 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.691917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-58625180-7da2-4df7-958b-1451f5788513 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Returning 404 to user: Instance group ea859a5c-0540-4043-9f6a-68973eccfae5 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:09.695107 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-58625180-7da2-4df7-958b-1451f5788513 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/ea859a5c-0540-4043-9f6a-68973eccfae5" status: 404 len: 117 microversion: 2.1 time: 0.067472 Jul 14 14:52:09.697401 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2274/4607] 10.222.0.81 () {58 vars in 1265 bytes} [Thu Jul 14 14:52:09 2022] DELETE /compute/v2.1/os-server-groups/ea859a5c-0540-4043-9f6a-68973eccfae5 => generated 117 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:09.699099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aff79b42-28a7-4876-ac57-c7fc86e3205a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.702067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aff79b42-28a7-4876-ac57-c7fc86e3205a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:09.710156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aff79b42-28a7-4876-ac57-c7fc86e3205a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.710387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-958f1a16-0cf1-4d5c-afdf-6615ccf960fe tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.717725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aff79b42-28a7-4876-ac57-c7fc86e3205a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.724304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aff79b42-28a7-4876-ac57-c7fc86e3205a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.725160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aff79b42-28a7-4876-ac57-c7fc86e3205a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-958f1a16-0cf1-4d5c-afdf-6615ccf960fe tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] HTTP exception thrown: Instance group 099d415f-c604-4558-949f-52ce328f0f04 could not be found. Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-958f1a16-0cf1-4d5c-afdf-6615ccf960fe tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Request method failure captured: Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-server-groups/099d415f-c604-4558-949f-52ce328f0f04 HTTP/1.1 Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1l_DrVDOTBxn1rnoJCyqfob6TjRQ717dpUTowQ1CsB5IOEr-H8kwf6z0WmEs2Tf--kNLs6kei4M__5mn7gWxXW2ehFHDMtMtGql0oi5So4h69mjM5BSYpg8bsuuQ9WDZITldJQ8E0JR2NljOHvxdoUcp-kwwo50nCDg1OHiLUveVg Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07d7fa2f739b458a8ac6c529c1fa8266", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}] Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 28ca5d3f67a64722a19adf5ae3d1a3a0 Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance group 099d415f-c604-4558-949f-52ce328f0f04 could not be found. Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '099d415f-c604-4558-949f-52ce328f0f04'} Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 099d415f-c604-4558-949f-52ce328f0f04 could not be found. Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:09.730611 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 099d415f-c604-4558-949f-52ce328f0f04 could not be found. Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 099d415f-c604-4558-949f-52ce328f0f04 could not be found. Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-958f1a16-0cf1-4d5c-afdf-6615ccf960fe tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Returning 404 to user: Instance group 099d415f-c604-4558-949f-52ce328f0f04 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-958f1a16-0cf1-4d5c-afdf-6615ccf960fe tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/099d415f-c604-4558-949f-52ce328f0f04" status: 404 len: 117 microversion: 2.1 time: 0.029665 Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2275/4608] 10.222.0.81 () {58 vars in 1265 bytes} [Thu Jul 14 14:52:09 2022] DELETE /compute/v2.1/os-server-groups/099d415f-c604-4558-949f-52ce328f0f04 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:09.744342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f06b4db9-1883-4748-a0bb-812cdfc5a2d3 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.762156 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f06b4db9-1883-4748-a0bb-812cdfc5a2d3 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] HTTP exception thrown: Instance group 0a226700-0de4-465c-8c98-c2572314a64b could not be found. Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f06b4db9-1883-4748-a0bb-812cdfc5a2d3 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Request method failure captured: Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-server-groups/0a226700-0de4-465c-8c98-c2572314a64b HTTP/1.1 Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1l_DrVDOTBxn1rnoJCyqfob6TjRQ717dpUTowQ1CsB5IOEr-H8kwf6z0WmEs2Tf--kNLs6kei4M__5mn7gWxXW2ehFHDMtMtGql0oi5So4h69mjM5BSYpg8bsuuQ9WDZITldJQ8E0JR2NljOHvxdoUcp-kwwo50nCDg1OHiLUveVg Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07d7fa2f739b458a8ac6c529c1fa8266"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07d7fa2f739b458a8ac6c529c1fa8266", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07d7fa2f739b458a8ac6c529c1fa8266"}]}] Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 07d7fa2f739b458a8ac6c529c1fa8266 Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerGroupTestJSON-1219969351 Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 28ca5d3f67a64722a19adf5ae3d1a3a0 Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerGroupTestJSON-1219969351-project Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance group 0a226700-0de4-465c-8c98-c2572314a64b could not be found. Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0a226700-0de4-465c-8c98-c2572314a64b'} Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0a226700-0de4-465c-8c98-c2572314a64b could not be found. Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0a226700-0de4-465c-8c98-c2572314a64b could not be found. Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.771505 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:09.777118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:09.777118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:09.777118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:09.777118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:09.777118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0a226700-0de4-465c-8c98-c2572314a64b could not be found. Jul 14 14:52:09.777118 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:09.777118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f06b4db9-1883-4748-a0bb-812cdfc5a2d3 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Returning 404 to user: Instance group 0a226700-0de4-465c-8c98-c2572314a64b could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:09.777118 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f06b4db9-1883-4748-a0bb-812cdfc5a2d3 tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/0a226700-0de4-465c-8c98-c2572314a64b" status: 404 len: 117 microversion: 2.1 time: 0.034386 Jul 14 14:52:09.777118 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2276/4609] 10.222.0.81 () {58 vars in 1265 bytes} [Thu Jul 14 14:52:09 2022] DELETE /compute/v2.1/os-server-groups/0a226700-0de4-465c-8c98-c2572314a64b => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:52:09.795848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2f702978-6de5-4040-a454-7fcdb824a83e tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.912339 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2f702978-6de5-4040-a454-7fcdb824a83e tempest-ServerGroupTestJSON-1219969351 tempest-ServerGroupTestJSON-1219969351-project] 10.222.0.81 "DELETE /compute/v2.1/os-server-groups/090fdf1e-e2ac-438b-8488-d5f9c904d5fa" status: 204 len: 0 microversion: 2.1 time: 0.132190 Jul 14 14:52:09.917021 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2277/4610] 10.222.0.81 () {58 vars in 1265 bytes} [Thu Jul 14 14:52:09 2022] DELETE /compute/v2.1/os-server-groups/090fdf1e-e2ac-438b-8488-d5f9c904d5fa => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:52:10.126286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5ce53e8-ac5b-4c89-8fce-b24615bd6570 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:10.127693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d5ce53e8-ac5b-4c89-8fce-b24615bd6570 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:10.148284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5ce53e8-ac5b-4c89-8fce-b24615bd6570 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:10.151700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5ce53e8-ac5b-4c89-8fce-b24615bd6570 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:10.164015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5ce53e8-ac5b-4c89-8fce-b24615bd6570 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:10.166700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5ce53e8-ac5b-4c89-8fce-b24615bd6570 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:10.760740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d5ce53e8-ac5b-4c89-8fce-b24615bd6570 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:10.774005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d5ce53e8-ac5b-4c89-8fce-b24615bd6570 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:10.775979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d5ce53e8-ac5b-4c89-8fce-b24615bd6570 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:10.776934 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d5ce53e8-ac5b-4c89-8fce-b24615bd6570 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1264 microversion: 2.26 time: 0.659365 Jul 14 14:52:10.777597 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2278/4611] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:10 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1264 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:52:10.799191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0be14d83-a7a6-4ae7-a67d-2183de3ca62f tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:10.800057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0be14d83-a7a6-4ae7-a67d-2183de3ca62f tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:10.819310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0be14d83-a7a6-4ae7-a67d-2183de3ca62f tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:10.822929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0be14d83-a7a6-4ae7-a67d-2183de3ca62f tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:10.824643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0be14d83-a7a6-4ae7-a67d-2183de3ca62f tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:10.826132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0be14d83-a7a6-4ae7-a67d-2183de3ca62f tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:10.960597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-aff79b42-28a7-4876-ac57-c7fc86e3205a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:10.980699 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aff79b42-28a7-4876-ac57-c7fc86e3205a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1327 microversion: 2.1 time: 1.285390 Jul 14 14:52:10.982698 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2334/4612] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:09 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1327 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:52:10.996764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af74e1c2-8c4d-4e3b-8375-237e5dc5e67b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:11.010134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-af74e1c2-8c4d-4e3b-8375-237e5dc5e67b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:11.018342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af74e1c2-8c4d-4e3b-8375-237e5dc5e67b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:11.019256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af74e1c2-8c4d-4e3b-8375-237e5dc5e67b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:11.020345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af74e1c2-8c4d-4e3b-8375-237e5dc5e67b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:11.021342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af74e1c2-8c4d-4e3b-8375-237e5dc5e67b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:11.066599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0be14d83-a7a6-4ae7-a67d-2183de3ca62f tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d1a695f8bc434c8cc488936c88f634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a2de8e491f4b5daedac0a4bf1244f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:11.101307 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0be14d83-a7a6-4ae7-a67d-2183de3ca62f tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 200 len: 1229 microversion: 2.1 time: 0.321929 Jul 14 14:52:11.113965 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2279/4613] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:10 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 1229 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:11.799909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f8b90860-3f3a-4ce8-b35e-1e4a73e9b5fa tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:11.801825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f8b90860-3f3a-4ce8-b35e-1e4a73e9b5fa tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:11.822581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8b90860-3f3a-4ce8-b35e-1e4a73e9b5fa tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:11.823137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8b90860-3f3a-4ce8-b35e-1e4a73e9b5fa tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:11.824694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8b90860-3f3a-4ce8-b35e-1e4a73e9b5fa tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:11.826625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8b90860-3f3a-4ce8-b35e-1e4a73e9b5fa tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:12.468620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f8b90860-3f3a-4ce8-b35e-1e4a73e9b5fa tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:12.485560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f8b90860-3f3a-4ce8-b35e-1e4a73e9b5fa tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:12.488791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f8b90860-3f3a-4ce8-b35e-1e4a73e9b5fa tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:12.490722 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f8b90860-3f3a-4ce8-b35e-1e4a73e9b5fa tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1318 microversion: 2.26 time: 0.698746 Jul 14 14:52:12.492495 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2280/4614] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:11 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1318 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:12.497862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d1c74721-7f3e-4b38-89d8-4f2aa4044714 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:12.499811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d1c74721-7f3e-4b38-89d8-4f2aa4044714 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:12.514410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1c74721-7f3e-4b38-89d8-4f2aa4044714 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:12.515262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1c74721-7f3e-4b38-89d8-4f2aa4044714 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:12.516320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1c74721-7f3e-4b38-89d8-4f2aa4044714 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:12.517028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1c74721-7f3e-4b38-89d8-4f2aa4044714 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:12.850838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-af74e1c2-8c4d-4e3b-8375-237e5dc5e67b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:12.860110 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af74e1c2-8c4d-4e3b-8375-237e5dc5e67b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1366 microversion: 2.1 time: 1.873510 Jul 14 14:52:12.860726 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2335/4615] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:10 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1366 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:12.874155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-648ae9ea-1d5a-48d3-848f-be0de29f9a78 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:12.874787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-648ae9ea-1d5a-48d3-848f-be0de29f9a78 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] [instance: cb68e36c-3f0c-4567-bf71-cee172d26584] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:12.925399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-648ae9ea-1d5a-48d3-848f-be0de29f9a78 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:12.937425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-648ae9ea-1d5a-48d3-848f-be0de29f9a78 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:12.938815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-648ae9ea-1d5a-48d3-848f-be0de29f9a78 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:12.939292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-648ae9ea-1d5a-48d3-848f-be0de29f9a78 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:13.025154 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-648ae9ea-1d5a-48d3-848f-be0de29f9a78 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] HTTP exception thrown: Instance cb68e36c-3f0c-4567-bf71-cee172d26584 could not be found. Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-648ae9ea-1d5a-48d3-848f-be0de29f9a78 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Request method failure captured: Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 HTTP/1.1 Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Cw-W25vdXE9W5AEnjikUwpO_4XgbCw6IfPWohpMqcqM25D0ozcp49C5h5sdwut2_bw16bKN-rgKAdyGuY2r6aCmp-xVZ938M0vZSWv0ovVHBZXxLvqpEWUY5fTSO_dlN5yvP4lo5xtkESYOyzohSt-HS0BmNX2lCy1bUidqBLEjoCs Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 06a2de8e491f4b5daedac0a4bf1244f5 Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestVolumeBackupRestore-731043510 Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/06a2de8e491f4b5daedac0a4bf1244f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/06a2de8e491f4b5daedac0a4bf1244f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_06a2de8e491f4b5daedac0a4bf1244f5", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/06a2de8e491f4b5daedac0a4bf1244f5"}]}] Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestVolumeBackupRestore-731043510 Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 06a2de8e491f4b5daedac0a4bf1244f5 Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestVolumeBackupRestore-731043510 Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestVolumeBackupRestore-731043510-project Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: b0d1a695f8bc434c8cc488936c88f634 Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestVolumeBackupRestore-731043510-project Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance cb68e36c-3f0c-4567-bf71-cee172d26584 could not be found. Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'cb68e36c-3f0c-4567-bf71-cee172d26584'} Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb68e36c-3f0c-4567-bf71-cee172d26584 could not be found. Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb68e36c-3f0c-4567-bf71-cee172d26584 could not be found. Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:13.026915 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:13.037335 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:13.037335 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:13.037335 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:13.037335 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:13.037335 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:13.037335 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb68e36c-3f0c-4567-bf71-cee172d26584 could not be found. Jul 14 14:52:13.037335 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:13.037335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-648ae9ea-1d5a-48d3-848f-be0de29f9a78 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Returning 404 to user: Instance cb68e36c-3f0c-4567-bf71-cee172d26584 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:13.037335 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-648ae9ea-1d5a-48d3-848f-be0de29f9a78 tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584" status: 404 len: 111 microversion: 2.1 time: 0.166601 Jul 14 14:52:13.040572 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2336/4616] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:12 2022] GET /compute/v2.1/servers/cb68e36c-3f0c-4567-bf71-cee172d26584 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:13.059336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4cea112c-e6b1-4fa6-9f29-80f053c32e93 req-125c0631-a362-491a-b346-5df98ce4014e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465cae4c-e138-4d7f-94a6-4e5ebb016c98", "tag": "11856969-830c-44c8-9728-4d2edd02f9f5"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:13.077118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4cea112c-e6b1-4fa6-9f29-80f053c32e93 req-125c0631-a362-491a-b346-5df98ce4014e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:13.077606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4cea112c-e6b1-4fa6-9f29-80f053c32e93 req-125c0631-a362-491a-b346-5df98ce4014e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:13.094273 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4cea112c-e6b1-4fa6-9f29-80f053c32e93 req-125c0631-a362-491a-b346-5df98ce4014e service nova] Creating event network-changed:11856969-830c-44c8-9728-4d2edd02f9f5 for instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 on n-h2-767704-28 Jul 14 14:52:13.104830 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4cea112c-e6b1-4fa6-9f29-80f053c32e93 req-125c0631-a362-491a-b346-5df98ce4014e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055429 Jul 14 14:52:13.105495 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2337/4617] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:13.517564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a50ac9a3-50de-4202-8cce-d40fe805af1e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:13.518284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a50ac9a3-50de-4202-8cce-d40fe805af1e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:13.535369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a50ac9a3-50de-4202-8cce-d40fe805af1e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:13.536292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a50ac9a3-50de-4202-8cce-d40fe805af1e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:13.537549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a50ac9a3-50de-4202-8cce-d40fe805af1e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:13.538181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a50ac9a3-50de-4202-8cce-d40fe805af1e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:13.888247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a50ac9a3-50de-4202-8cce-d40fe805af1e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:13.906092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a50ac9a3-50de-4202-8cce-d40fe805af1e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:13.911817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a50ac9a3-50de-4202-8cce-d40fe805af1e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:13.915984 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a50ac9a3-50de-4202-8cce-d40fe805af1e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1318 microversion: 2.26 time: 0.402503 Jul 14 14:52:13.919300 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2338/4618] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:13 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:13.993512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d1c74721-7f3e-4b38-89d8-4f2aa4044714 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:14.019429 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d1c74721-7f3e-4b38-89d8-4f2aa4044714 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1327 microversion: 2.1 time: 1.525329 Jul 14 14:52:14.023229 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2281/4619] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:12 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1327 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:14.039928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ff5e4ea6-f754-465e-b247-1ba04ca6de0a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:14.040793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ff5e4ea6-f754-465e-b247-1ba04ca6de0a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:14.054729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff5e4ea6-f754-465e-b247-1ba04ca6de0a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:14.058545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff5e4ea6-f754-465e-b247-1ba04ca6de0a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:14.060356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff5e4ea6-f754-465e-b247-1ba04ca6de0a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:14.065150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff5e4ea6-f754-465e-b247-1ba04ca6de0a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:14.115392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-913265203", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "1632f1e7-373a-48e0-9894-094c34cc4ab6"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:14.274670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] validate_networks() for [('1632f1e7-373a-48e0-9894-094c34cc4ab6', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:52:14.745704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ff5e4ea6-f754-465e-b247-1ba04ca6de0a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:14.759917 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ff5e4ea6-f754-465e-b247-1ba04ca6de0a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1366 microversion: 2.1 time: 0.734620 Jul 14 14:52:14.771957 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2282/4620] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:14 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1366 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:14.948312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-60c3f052-41ec-47dd-8a9e-f3d655f35577 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:14.954627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-60c3f052-41ec-47dd-8a9e-f3d655f35577 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:14.984838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60c3f052-41ec-47dd-8a9e-f3d655f35577 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:14.985516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60c3f052-41ec-47dd-8a9e-f3d655f35577 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:14.989538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60c3f052-41ec-47dd-8a9e-f3d655f35577 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:14.990236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60c3f052-41ec-47dd-8a9e-f3d655f35577 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:15.846670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-60c3f052-41ec-47dd-8a9e-f3d655f35577 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:15.863489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-60c3f052-41ec-47dd-8a9e-f3d655f35577 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:15.870799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-60c3f052-41ec-47dd-8a9e-f3d655f35577 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:15.881143 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-60c3f052-41ec-47dd-8a9e-f3d655f35577 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1360 microversion: 2.26 time: 0.941803 Jul 14 14:52:15.882776 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2283/4621] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:14 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1360 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:52:15.907386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-34448a55-ac13-41ff-84da-f9c06235ef1a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:15.908018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-34448a55-ac13-41ff-84da-f9c06235ef1a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:15.921824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-34448a55-ac13-41ff-84da-f9c06235ef1a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:15.922146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-34448a55-ac13-41ff-84da-f9c06235ef1a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:15.922962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-34448a55-ac13-41ff-84da-f9c06235ef1a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:15.923410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-34448a55-ac13-41ff-84da-f9c06235ef1a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:17.255231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:52:17.256398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:52:17.257101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:52:17.257689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:52:17.259238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:52:17.272918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:17.273848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:17.283210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:17.285156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:17.347948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Getting quotas for project 850ed2d2a9384d7cbe8f1b2e6aea8bc4. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:52:17.366226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Getting quotas for user c4082011ea9b4ce2b591f131e0bc50bb and project 850ed2d2a9384d7cbe8f1b2e6aea8bc4. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:52:17.380497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-34448a55-ac13-41ff-84da-f9c06235ef1a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:17.386471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:52:17.391711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:52:17.406616 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-34448a55-ac13-41ff-84da-f9c06235ef1a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1327 microversion: 2.1 time: 1.522649 Jul 14 14:52:17.420760 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2284/4622] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:15 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1327 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:17.431943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bd876505-6a18-466c-86c7-4e77f1b195df tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] Calling method '.version_select at 0x7fd6c4bf6ca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:17.473001 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bd876505-6a18-466c-86c7-4e77f1b195df tempest-TestVolumeBackupRestore-731043510 tempest-TestVolumeBackupRestore-731043510-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2039688813" status: 202 len: 0 microversion: 2.1 time: 0.050909 Jul 14 14:52:17.473964 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2285/4623] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:52:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2039688813 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:17.494725 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e69564d6-4870-4849-89fa-92f4bec75cbe tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.573978 Jul 14 14:52:17.494962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-38b429c2-e0d2-4542-87f5-84b98f091d83 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:17.495634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-38b429c2-e0d2-4542-87f5-84b98f091d83 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:17.501442 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2339/4624] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:52:17.517169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2dda2e3a-48d1-4455-b951-373704f9f6a9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:17.518329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2dda2e3a-48d1-4455-b951-373704f9f6a9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:17.524082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38b429c2-e0d2-4542-87f5-84b98f091d83 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:17.524432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38b429c2-e0d2-4542-87f5-84b98f091d83 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:17.525277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38b429c2-e0d2-4542-87f5-84b98f091d83 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:17.525731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38b429c2-e0d2-4542-87f5-84b98f091d83 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:17.538673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dda2e3a-48d1-4455-b951-373704f9f6a9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:17.539110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dda2e3a-48d1-4455-b951-373704f9f6a9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:17.539923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dda2e3a-48d1-4455-b951-373704f9f6a9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:17.540374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dda2e3a-48d1-4455-b951-373704f9f6a9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:18.618118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:18.629960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-38b429c2-e0d2-4542-87f5-84b98f091d83 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:18.659399 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-38b429c2-e0d2-4542-87f5-84b98f091d83 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1366 microversion: 2.1 time: 1.183699 Jul 14 14:52:18.677774 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2286/4625] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:17 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1366 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:18.729515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-169f48ad-afb3-4c93-8e44-89ce52941850 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:18.737129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-169f48ad-afb3-4c93-8e44-89ce52941850 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:18.770382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:19.345030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-169f48ad-afb3-4c93-8e44-89ce52941850 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:19.383217 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-169f48ad-afb3-4c93-8e44-89ce52941850 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1223 microversion: 2.1 time: 0.703208 Jul 14 14:52:19.401060 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2287/4626] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:18 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1223 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:19.418913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f57049b4-8dcf-47b0-94fd-1b08421fb906 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:19.419753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f57049b4-8dcf-47b0-94fd-1b08421fb906 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:19.454967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f57049b4-8dcf-47b0-94fd-1b08421fb906 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:19.461339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f57049b4-8dcf-47b0-94fd-1b08421fb906 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:19.462511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f57049b4-8dcf-47b0-94fd-1b08421fb906 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:19.462883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f57049b4-8dcf-47b0-94fd-1b08421fb906 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:19.870918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2dda2e3a-48d1-4455-b951-373704f9f6a9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:19.892134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2dda2e3a-48d1-4455-b951-373704f9f6a9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:19.908254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2dda2e3a-48d1-4455-b951-373704f9f6a9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:19.924188 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2dda2e3a-48d1-4455-b951-373704f9f6a9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1360 microversion: 2.26 time: 2.410318 Jul 14 14:52:19.948580 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2340/4627] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:17 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1360 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:19.968213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-1a5a9bcc-98ab-43e9-93df-1cb829b474df req-60d16b14-9329-49ff-a708-297a2d542d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99", "name": "network-vif-plugged", "status": "completed", "tag": "ac272c7e-fc83-4f7e-82e5-9206b48aeaeb"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:19.997267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1a5a9bcc-98ab-43e9-93df-1cb829b474df req-60d16b14-9329-49ff-a708-297a2d542d37 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:19.997774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1a5a9bcc-98ab-43e9-93df-1cb829b474df req-60d16b14-9329-49ff-a708-297a2d542d37 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:20.026924 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-1a5a9bcc-98ab-43e9-93df-1cb829b474df req-60d16b14-9329-49ff-a708-297a2d542d37 service nova] Creating event network-vif-plugged:ac272c7e-fc83-4f7e-82e5-9206b48aeaeb for instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 on n-h1-767704-28 Jul 14 14:52:20.037996 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-1a5a9bcc-98ab-43e9-93df-1cb829b474df req-60d16b14-9329-49ff-a708-297a2d542d37 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087698 Jul 14 14:52:20.042549 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2341/4628] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:20.061492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-15f47737-890f-4363-adad-5e91c8a27750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:20.063787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-15f47737-890f-4363-adad-5e91c8a27750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:20.129833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-15f47737-890f-4363-adad-5e91c8a27750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:20.130406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-15f47737-890f-4363-adad-5e91c8a27750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:20.132963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-15f47737-890f-4363-adad-5e91c8a27750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:20.133674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-15f47737-890f-4363-adad-5e91c8a27750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:21.870175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-15f47737-890f-4363-adad-5e91c8a27750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:21.897337 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-15f47737-890f-4363-adad-5e91c8a27750 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1366 microversion: 2.1 time: 1.849560 Jul 14 14:52:21.899503 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2342/4629] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:20 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1366 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:21.931239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-82c14ead-2ac1-4e4a-a20f-94a34cc6f354 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:21.931908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-82c14ead-2ac1-4e4a-a20f-94a34cc6f354 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:21.956273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82c14ead-2ac1-4e4a-a20f-94a34cc6f354 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:21.956581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82c14ead-2ac1-4e4a-a20f-94a34cc6f354 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:21.957454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82c14ead-2ac1-4e4a-a20f-94a34cc6f354 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:21.957915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82c14ead-2ac1-4e4a-a20f-94a34cc6f354 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:22.200193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f57049b4-8dcf-47b0-94fd-1b08421fb906 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:22.251480 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f57049b4-8dcf-47b0-94fd-1b08421fb906 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1327 microversion: 2.1 time: 2.849014 Jul 14 14:52:22.269292 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2288/4630] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:19 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1327 bytes in 2865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:22.297534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bafef3a0-fc3e-4d45-a958-d7a01b920214 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:22.298043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bafef3a0-fc3e-4d45-a958-d7a01b920214 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:22.347698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bafef3a0-fc3e-4d45-a958-d7a01b920214 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:22.350068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bafef3a0-fc3e-4d45-a958-d7a01b920214 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:22.357517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bafef3a0-fc3e-4d45-a958-d7a01b920214 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:22.359878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bafef3a0-fc3e-4d45-a958-d7a01b920214 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:22.888465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-82c14ead-2ac1-4e4a-a20f-94a34cc6f354 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:22.911503 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-82c14ead-2ac1-4e4a-a20f-94a34cc6f354 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1281 microversion: 2.1 time: 1.010309 Jul 14 14:52:22.921169 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2343/4631] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:21 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1281 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:22.937790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-7f28318d-004a-4123-90e8-e76f143465f5 req-2cfc152d-37e6-4eba-b094-5f78e5564874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09efbb61-3d16-41bc-ba5f-cdeab10fd88c", "tag": "53d4ce0a-1cd6-4bbd-bd75-05653ff4c2a6"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:22.948321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:22.979203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7f28318d-004a-4123-90e8-e76f143465f5 req-2cfc152d-37e6-4eba-b094-5f78e5564874 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:22.987804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7f28318d-004a-4123-90e8-e76f143465f5 req-2cfc152d-37e6-4eba-b094-5f78e5564874 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:23.044423 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-7f28318d-004a-4123-90e8-e76f143465f5 req-2cfc152d-37e6-4eba-b094-5f78e5564874 service nova] Creating event network-changed:53d4ce0a-1cd6-4bbd-bd75-05653ff4c2a6 for instance 09efbb61-3d16-41bc-ba5f-cdeab10fd88c on n-h1-767704-28 Jul 14 14:52:23.081418 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-7f28318d-004a-4123-90e8-e76f143465f5 req-2cfc152d-37e6-4eba-b094-5f78e5564874 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155077 Jul 14 14:52:23.085784 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2344/4632] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:23.104141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5c5e17c9-bd4b-4128-9667-30d3dd340bb3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:23.106937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5c5e17c9-bd4b-4128-9667-30d3dd340bb3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:23.131833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c5e17c9-bd4b-4128-9667-30d3dd340bb3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:23.135977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c5e17c9-bd4b-4128-9667-30d3dd340bb3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:23.137151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c5e17c9-bd4b-4128-9667-30d3dd340bb3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:23.140834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c5e17c9-bd4b-4128-9667-30d3dd340bb3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:24.314392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bafef3a0-fc3e-4d45-a958-d7a01b920214 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:24.383355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bafef3a0-fc3e-4d45-a958-d7a01b920214 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:24.386963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bafef3a0-fc3e-4d45-a958-d7a01b920214 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:24.390829 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bafef3a0-fc3e-4d45-a958-d7a01b920214 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1360 microversion: 2.26 time: 2.118669 Jul 14 14:52:24.410704 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2289/4633] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:22 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1360 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:24.444108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-04379511-afcb-490b-9f98-f8728b7adc50 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:24.445194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-04379511-afcb-490b-9f98-f8728b7adc50 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:24.472796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04379511-afcb-490b-9f98-f8728b7adc50 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:24.473422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04379511-afcb-490b-9f98-f8728b7adc50 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:24.474344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04379511-afcb-490b-9f98-f8728b7adc50 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:24.474798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04379511-afcb-490b-9f98-f8728b7adc50 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:26.119200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-04379511-afcb-490b-9f98-f8728b7adc50 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:26.146506 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-04379511-afcb-490b-9f98-f8728b7adc50 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1327 microversion: 2.1 time: 1.733934 Jul 14 14:52:26.158795 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2290/4634] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:24 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1327 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:26.194043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5c5e17c9-bd4b-4128-9667-30d3dd340bb3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:26.206367 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5c5e17c9-bd4b-4128-9667-30d3dd340bb3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1366 microversion: 2.1 time: 3.118852 Jul 14 14:52:26.207705 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2345/4635] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:23 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1366 bytes in 3121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:26.214131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-64754e75-7c92-4b22-848b-006f75a02b28 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:26.215188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-64754e75-7c92-4b22-848b-006f75a02b28 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:26.236569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-64754e75-7c92-4b22-848b-006f75a02b28 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:26.236917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-64754e75-7c92-4b22-848b-006f75a02b28 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:26.237760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-64754e75-7c92-4b22-848b-006f75a02b28 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:26.238414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-64754e75-7c92-4b22-848b-006f75a02b28 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:26.313629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d1e6084c-d393-43a3-bff7-7c8f9194dc3e tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1254147296", "availability_zone": "foo_zone"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:26.315635 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:52:26.315635 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:52:26.318222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.aggregate [None req-d1e6084c-d393-43a3-bff7-7c8f9194dc3e tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Generated uuid 2d286fef-e704-4c77-a06c-afdc9c249201 for aggregate {{(pid=119511) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:52:26.436594 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d1e6084c-d393-43a3-bff7-7c8f9194dc3e tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.276294 Jul 14 14:52:26.447066 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2291/4636] 10.222.0.81 () {60 vars in 1163 bytes} [Thu Jul 14 14:52:26 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:26.454927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-85f5809d-a3c8-424f-a4c3-3b23695d077a tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:26.456064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-85f5809d-a3c8-424f-a4c3-3b23695d077a tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:26.473409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85f5809d-a3c8-424f-a4c3-3b23695d077a tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:26.478073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85f5809d-a3c8-424f-a4c3-3b23695d077a tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:26.479430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85f5809d-a3c8-424f-a4c3-3b23695d077a tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:26.480884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85f5809d-a3c8-424f-a4c3-3b23695d077a tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:26.583874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:27.331553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:27.378755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-64754e75-7c92-4b22-848b-006f75a02b28 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:27.402330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:27.408312 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-64754e75-7c92-4b22-848b-006f75a02b28 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1323 microversion: 2.1 time: 1.198836 Jul 14 14:52:27.415639 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2346/4637] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:26 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1323 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:27.442997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9a7a635-3bc7-4940-8c88-8bac63ddf9e8 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:27.446721 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:52:27.446721 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:52:27.535423 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b9a7a635-3bc7-4940-8c88-8bac63ddf9e8 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.117377 Jul 14 14:52:27.541838 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2347/4638] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:52:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:27.578582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff42b1d3-c7db-40bb-8078-5fce2fd85061 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:27.580675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ff42b1d3-c7db-40bb-8078-5fce2fd85061 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:27.599453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff42b1d3-c7db-40bb-8078-5fce2fd85061 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:27.606778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff42b1d3-c7db-40bb-8078-5fce2fd85061 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:27.608918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff42b1d3-c7db-40bb-8078-5fce2fd85061 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:27.617238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff42b1d3-c7db-40bb-8078-5fce2fd85061 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:27.990114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-85f5809d-a3c8-424f-a4c3-3b23695d077a tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:28.011069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-85f5809d-a3c8-424f-a4c3-3b23695d077a tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:28.013330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-85f5809d-a3c8-424f-a4c3-3b23695d077a tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:28.014580 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-85f5809d-a3c8-424f-a4c3-3b23695d077a tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1360 microversion: 2.26 time: 1.565944 Jul 14 14:52:28.020583 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2292/4639] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:26 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1360 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:28.036459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4d0f75f1-4590-461b-aeb4-0d4bbe20d86c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:28.037497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4d0f75f1-4590-461b-aeb4-0d4bbe20d86c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:28.062148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d0f75f1-4590-461b-aeb4-0d4bbe20d86c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:28.072172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d0f75f1-4590-461b-aeb4-0d4bbe20d86c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:28.073117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d0f75f1-4590-461b-aeb4-0d4bbe20d86c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:28.073713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d0f75f1-4590-461b-aeb4-0d4bbe20d86c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:28.933362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ff42b1d3-c7db-40bb-8078-5fce2fd85061 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:28.946595 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ff42b1d3-c7db-40bb-8078-5fce2fd85061 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1327 microversion: 2.1 time: 1.400466 Jul 14 14:52:28.952315 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2348/4640] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:27 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1327 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:28.962156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b13a4a0e-bef9-4bc4-9038-f3503eff9b0f tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:28.964471 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:52:28.964471 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:52:28.977982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b13a4a0e-bef9-4bc4-9038-f3503eff9b0f tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:28.984292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b13a4a0e-bef9-4bc4-9038-f3503eff9b0f tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:28.987864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b13a4a0e-bef9-4bc4-9038-f3503eff9b0f tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:28.995647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b13a4a0e-bef9-4bc4-9038-f3503eff9b0f tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:29.089950 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b13a4a0e-bef9-4bc4-9038-f3503eff9b0f tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] 10.222.0.81 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.135559 Jul 14 14:52:29.090659 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2349/4641] 10.222.0.81 () {58 vars in 1175 bytes} [Thu Jul 14 14:52:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:29.098607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-42aa6603-9d8f-47ba-b2bb-aa32c030d5a9 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:29.110381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-42aa6603-9d8f-47ba-b2bb-aa32c030d5a9 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:29.130397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42aa6603-9d8f-47ba-b2bb-aa32c030d5a9 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:29.133752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42aa6603-9d8f-47ba-b2bb-aa32c030d5a9 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:29.141805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42aa6603-9d8f-47ba-b2bb-aa32c030d5a9 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:29.142482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42aa6603-9d8f-47ba-b2bb-aa32c030d5a9 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:29.350095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:30.053683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4d0f75f1-4590-461b-aeb4-0d4bbe20d86c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:30.066133 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4d0f75f1-4590-461b-aeb4-0d4bbe20d86c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1557 microversion: 2.1 time: 2.043910 Jul 14 14:52:30.068577 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2293/4642] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:28 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1557 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:30.089209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-927eda8b-e655-45ff-bc1c-d3a7b4ed0d7d req-e4e3696d-b0f8-4c0c-bfd5-305710f74b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465cae4c-e138-4d7f-94a6-4e5ebb016c98", "name": "network-vif-plugged", "status": "completed", "tag": "11856969-830c-44c8-9728-4d2edd02f9f5"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:30.110430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-927eda8b-e655-45ff-bc1c-d3a7b4ed0d7d req-e4e3696d-b0f8-4c0c-bfd5-305710f74b8d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:30.111727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-927eda8b-e655-45ff-bc1c-d3a7b4ed0d7d req-e4e3696d-b0f8-4c0c-bfd5-305710f74b8d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:30.173583 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-927eda8b-e655-45ff-bc1c-d3a7b4ed0d7d req-e4e3696d-b0f8-4c0c-bfd5-305710f74b8d service nova] Creating event network-vif-plugged:11856969-830c-44c8-9728-4d2edd02f9f5 for instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 on n-h2-767704-28 Jul 14 14:52:30.198771 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-927eda8b-e655-45ff-bc1c-d3a7b4ed0d7d req-e4e3696d-b0f8-4c0c-bfd5-305710f74b8d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125541 Jul 14 14:52:30.201607 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2294/4643] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:30.251034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e25c507c-b657-4284-bfc0-be9afba69c58 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:30.252104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e25c507c-b657-4284-bfc0-be9afba69c58 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:30.275689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e25c507c-b657-4284-bfc0-be9afba69c58 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:30.277629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e25c507c-b657-4284-bfc0-be9afba69c58 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:30.282983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e25c507c-b657-4284-bfc0-be9afba69c58 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:30.287311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e25c507c-b657-4284-bfc0-be9afba69c58 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:31.523744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-42aa6603-9d8f-47ba-b2bb-aa32c030d5a9 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:31.545842 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-42aa6603-9d8f-47ba-b2bb-aa32c030d5a9 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1323 microversion: 2.1 time: 2.450638 Jul 14 14:52:31.547039 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2350/4644] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:29 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1323 bytes in 2453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:31.558228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6e256773-14d3-42db-8ffd-2cd561486d92 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:31.564248 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:52:31.564248 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:52:31.579804 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6e256773-14d3-42db-8ffd-2cd561486d92 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.031307 Jul 14 14:52:31.587587 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2351/4645] 10.222.0.81 () {58 vars in 1142 bytes} [Thu Jul 14 14:52:31 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:31.602854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4cddb154-011f-463e-87f6-4eebedbe659b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:31.614149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4cddb154-011f-463e-87f6-4eebedbe659b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:31.624374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cddb154-011f-463e-87f6-4eebedbe659b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:31.632046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cddb154-011f-463e-87f6-4eebedbe659b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:31.633404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cddb154-011f-463e-87f6-4eebedbe659b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:31.634580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cddb154-011f-463e-87f6-4eebedbe659b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:31.938343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e25c507c-b657-4284-bfc0-be9afba69c58 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:31.953045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e25c507c-b657-4284-bfc0-be9afba69c58 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:31.964614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e25c507c-b657-4284-bfc0-be9afba69c58 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:31.966913 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e25c507c-b657-4284-bfc0-be9afba69c58 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1360 microversion: 2.26 time: 1.750443 Jul 14 14:52:31.968295 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2295/4646] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:30 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1360 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:31.973567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b441b821-4a1a-4010-9256-722fac62abd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:31.974518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b441b821-4a1a-4010-9256-722fac62abd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:31.982756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b441b821-4a1a-4010-9256-722fac62abd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:31.983397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b441b821-4a1a-4010-9256-722fac62abd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:31.984566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b441b821-4a1a-4010-9256-722fac62abd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:31.985221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b441b821-4a1a-4010-9256-722fac62abd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:32.259275 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b441b821-4a1a-4010-9256-722fac62abd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.289112 Jul 14 14:52:32.260631 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2296/4647] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:52:31 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-interface => generated 285 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:32.272587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f4b6640d-626a-4a74-9030-a5705009d9b0 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-767704-28"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:32.274311 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:52:32.274311 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:52:32.297087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4b6640d-626a-4a74-9030-a5705009d9b0 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:32.299841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4b6640d-626a-4a74-9030-a5705009d9b0 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:32.322182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4cddb154-011f-463e-87f6-4eebedbe659b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:32.342605 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4cddb154-011f-463e-87f6-4eebedbe659b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1327 microversion: 2.1 time: 0.746769 Jul 14 14:52:32.344563 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2352/4648] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:31 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1327 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:32.568632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5fdef97d-cd90-4693-ad93-ec5bf25afa81 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:32.569391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5fdef97d-cd90-4693-ad93-ec5bf25afa81 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:32.583775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fdef97d-cd90-4693-ad93-ec5bf25afa81 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:32.584334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fdef97d-cd90-4693-ad93-ec5bf25afa81 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:32.585479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fdef97d-cd90-4693-ad93-ec5bf25afa81 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:32.586030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fdef97d-cd90-4693-ad93-ec5bf25afa81 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:32.608568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:32.714778 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f4b6640d-626a-4a74-9030-a5705009d9b0 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.452478 Jul 14 14:52:32.716777 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2297/4649] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:52:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:32.732042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-69f355ba-0fad-4987-ab06-4d1c2e1e5187 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:32.733962 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:52:32.733962 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:52:32.746048 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-69f355ba-0fad-4987-ab06-4d1c2e1e5187 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.023098 Jul 14 14:52:32.749559 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2298/4650] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:52:32 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:32.761495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-16642519-67fb-4d12-9764-0cc7f74b834b tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-573644042", "availability_zone": "foo_zone"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:32.892378 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:52:32.892378 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:52:32.959403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:32.973656 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-16642519-67fb-4d12-9764-0cc7f74b834b tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] 10.222.0.81 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.219077 Jul 14 14:52:32.980176 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2299/4651] 10.222.0.81 () {60 vars in 1172 bytes} [Thu Jul 14 14:52:32 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:33.006617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b9c2749f-888e-4f7b-adfb-b3bf4db9a181 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:33.014474 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:52:33.014474 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:52:33.062611 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b9c2749f-888e-4f7b-adfb-b3bf4db9a181 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.070694 Jul 14 14:52:33.063772 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2300/4652] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:52:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:33.077338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fa2dcfef-d0b9-48d1-9b45-35dc61ed8462 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:33.078032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fa2dcfef-d0b9-48d1-9b45-35dc61ed8462 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:33.088899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa2dcfef-d0b9-48d1-9b45-35dc61ed8462 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:33.089422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa2dcfef-d0b9-48d1-9b45-35dc61ed8462 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:33.091291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa2dcfef-d0b9-48d1-9b45-35dc61ed8462 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:33.091936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa2dcfef-d0b9-48d1-9b45-35dc61ed8462 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:33.352715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5fdef97d-cd90-4693-ad93-ec5bf25afa81 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:33.370535 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5fdef97d-cd90-4693-ad93-ec5bf25afa81 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1323 microversion: 2.1 time: 0.806366 Jul 14 14:52:33.374724 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2353/4653] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:32 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1323 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:52:33.388891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-98a29522-84e3-49a4-b731-dd5ad3bbedc3 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:33.390067 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:52:33.390067 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 14:52:33.400854 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-98a29522-84e3-49a4-b731-dd5ad3bbedc3 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] 10.222.0.81 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.023978 Jul 14 14:52:33.401551 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2354/4654] 10.222.0.81 () {58 vars in 1151 bytes} [Thu Jul 14 14:52:33 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:33.418405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ba0330ff-9387-4dbe-bcd3-7ae985c437b2 req-8aaaaf8b-df6c-4fe8-9adc-2af97277d59f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7148982-49b4-4147-b082-63692fd18868", "tag": "0542a439-f512-4965-ad58-2ad6b62e2471"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:33.454628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ba0330ff-9387-4dbe-bcd3-7ae985c437b2 req-8aaaaf8b-df6c-4fe8-9adc-2af97277d59f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:33.455087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ba0330ff-9387-4dbe-bcd3-7ae985c437b2 req-8aaaaf8b-df6c-4fe8-9adc-2af97277d59f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:33.473834 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ba0330ff-9387-4dbe-bcd3-7ae985c437b2 req-8aaaaf8b-df6c-4fe8-9adc-2af97277d59f service nova] Creating event network-changed:0542a439-f512-4965-ad58-2ad6b62e2471 for instance c7148982-49b4-4147-b082-63692fd18868 on n-h1-767704-28 Jul 14 14:52:33.480265 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ba0330ff-9387-4dbe-bcd3-7ae985c437b2 req-8aaaaf8b-df6c-4fe8-9adc-2af97277d59f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076988 Jul 14 14:52:33.481275 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2355/4655] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:33.488115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bad73c48-5286-457b-8492-ea8222aa39f1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:33.488868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bad73c48-5286-457b-8492-ea8222aa39f1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:33.497589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bad73c48-5286-457b-8492-ea8222aa39f1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:33.498216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bad73c48-5286-457b-8492-ea8222aa39f1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:33.499140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bad73c48-5286-457b-8492-ea8222aa39f1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:33.499593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bad73c48-5286-457b-8492-ea8222aa39f1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:33.629779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fa2dcfef-d0b9-48d1-9b45-35dc61ed8462 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:33.640685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fa2dcfef-d0b9-48d1-9b45-35dc61ed8462 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:33.642273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fa2dcfef-d0b9-48d1-9b45-35dc61ed8462 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:33.643471 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fa2dcfef-d0b9-48d1-9b45-35dc61ed8462 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1360 microversion: 2.26 time: 0.578375 Jul 14 14:52:33.653810 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2301/4656] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:33 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1360 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:33.666217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2eb69166-d893-47fe-9edb-ad1f88ecd9d9 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-767704-28"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:33.667536 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:52:33.667536 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:52:33.698261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2eb69166-d893-47fe-9edb-ad1f88ecd9d9 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:33.699163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2eb69166-d893-47fe-9edb-ad1f88ecd9d9 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:33.912177 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2eb69166-d893-47fe-9edb-ad1f88ecd9d9 tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] 10.222.0.81 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.253712 Jul 14 14:52:33.914028 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2302/4657] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jul 14 14:52:33 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:33.924434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dcad71a1-af44-4662-b7cd-ee8a31e8bcaf tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:33.928305 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:52:33.928305 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 14:52:33.975387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bad73c48-5286-457b-8492-ea8222aa39f1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:33.991475 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bad73c48-5286-457b-8492-ea8222aa39f1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1512 microversion: 2.1 time: 0.508162 Jul 14 14:52:34.003372 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2356/4658] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:33 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1512 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:34.015927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-39dd4506-ad02-423a-99f0-68d97dd00d41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:34.016488 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dcad71a1-af44-4662-b7cd-ee8a31e8bcaf tempest-TestAggregatesBasicOps-1284629841 tempest-TestAggregatesBasicOps-1284629841-project-admin] 10.222.0.81 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.094681 Jul 14 14:52:34.017019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-39dd4506-ad02-423a-99f0-68d97dd00d41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:34.025666 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2303/4659] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 14:52:33 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:52:34.034876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39dd4506-ad02-423a-99f0-68d97dd00d41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:34.035339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39dd4506-ad02-423a-99f0-68d97dd00d41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:34.036144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39dd4506-ad02-423a-99f0-68d97dd00d41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:34.036592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39dd4506-ad02-423a-99f0-68d97dd00d41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:34.297345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d56d0e2d-425b-4a5c-a67f-955a24f4bd5f req-95393a81-296b-44b5-a383-629091bbf9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09efbb61-3d16-41bc-ba5f-cdeab10fd88c", "name": "network-vif-plugged", "status": "completed", "tag": "53d4ce0a-1cd6-4bbd-bd75-05653ff4c2a6"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:34.340075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d56d0e2d-425b-4a5c-a67f-955a24f4bd5f req-95393a81-296b-44b5-a383-629091bbf9f3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:34.341468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d56d0e2d-425b-4a5c-a67f-955a24f4bd5f req-95393a81-296b-44b5-a383-629091bbf9f3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:34.371797 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d56d0e2d-425b-4a5c-a67f-955a24f4bd5f req-95393a81-296b-44b5-a383-629091bbf9f3 service nova] Creating event network-vif-plugged:53d4ce0a-1cd6-4bbd-bd75-05653ff4c2a6 for instance 09efbb61-3d16-41bc-ba5f-cdeab10fd88c on n-h1-767704-28 Jul 14 14:52:34.387022 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d56d0e2d-425b-4a5c-a67f-955a24f4bd5f req-95393a81-296b-44b5-a383-629091bbf9f3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122934 Jul 14 14:52:34.388329 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2304/4660] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:52:34.417254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44662a4d-6dc7-4d61-baa5-fc3bb5ea9e4e tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:34.418278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-44662a4d-6dc7-4d61-baa5-fc3bb5ea9e4e tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:34.456997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44662a4d-6dc7-4d61-baa5-fc3bb5ea9e4e tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:34.482982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44662a4d-6dc7-4d61-baa5-fc3bb5ea9e4e tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:34.486342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44662a4d-6dc7-4d61-baa5-fc3bb5ea9e4e tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:34.489625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44662a4d-6dc7-4d61-baa5-fc3bb5ea9e4e tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.313768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-39dd4506-ad02-423a-99f0-68d97dd00d41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:35.341463 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-39dd4506-ad02-423a-99f0-68d97dd00d41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1508 microversion: 2.1 time: 1.335749 Jul 14 14:52:35.343278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-44662a4d-6dc7-4d61-baa5-fc3bb5ea9e4e tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:35.360991 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2357/4661] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:34 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1508 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:35.361359 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-44662a4d-6dc7-4d61-baa5-fc3bb5ea9e4e tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1323 microversion: 2.1 time: 0.961204 Jul 14 14:52:35.361359 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2305/4662] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:34 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1323 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:35.361588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6f7b26d9-e013-4bec-8fcf-d667ed740735 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:35.362238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6f7b26d9-e013-4bec-8fcf-d667ed740735 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:35.366512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4097531c-dbb2-44c0-adb4-cf89734c66c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:35.367015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4097531c-dbb2-44c0-adb4-cf89734c66c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:35.371494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f7b26d9-e013-4bec-8fcf-d667ed740735 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.374036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f7b26d9-e013-4bec-8fcf-d667ed740735 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.375988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f7b26d9-e013-4bec-8fcf-d667ed740735 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.377300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f7b26d9-e013-4bec-8fcf-d667ed740735 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.385642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4097531c-dbb2-44c0-adb4-cf89734c66c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.385642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4097531c-dbb2-44c0-adb4-cf89734c66c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.386269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4097531c-dbb2-44c0-adb4-cf89734c66c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.386551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4097531c-dbb2-44c0-adb4-cf89734c66c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.443389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4097531c-dbb2-44c0-adb4-cf89734c66c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:52:35.576021 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4097531c-dbb2-44c0-adb4-cf89734c66c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 204 len: 0 microversion: 2.1 time: 0.212476 Jul 14 14:52:35.577059 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2306/4663] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:52:35 2022] DELETE /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:52:35.588370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6b051021-eadc-40aa-b63d-695ddb0520b7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:35.589795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6b051021-eadc-40aa-b63d-695ddb0520b7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:35.611285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b051021-eadc-40aa-b63d-695ddb0520b7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.622186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b051021-eadc-40aa-b63d-695ddb0520b7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.623135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b051021-eadc-40aa-b63d-695ddb0520b7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.623596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b051021-eadc-40aa-b63d-695ddb0520b7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.777019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6f7b26d9-e013-4bec-8fcf-d667ed740735 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:35.794277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6f7b26d9-e013-4bec-8fcf-d667ed740735 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:35.796063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6f7b26d9-e013-4bec-8fcf-d667ed740735 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:35.797528 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6f7b26d9-e013-4bec-8fcf-d667ed740735 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1360 microversion: 2.26 time: 0.444738 Jul 14 14:52:35.798534 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2358/4664] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:35 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1360 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:36.299875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6b051021-eadc-40aa-b63d-695ddb0520b7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:36.310938 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6b051021-eadc-40aa-b63d-695ddb0520b7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1514 microversion: 2.1 time: 0.728726 Jul 14 14:52:36.313164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-13f286ff-7aa6-4da4-a9e1-8d1cb6b8ec0b req-233397b1-59d8-41ef-83fd-3a33bd44b8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99", "tag": "ac272c7e-fc83-4f7e-82e5-9206b48aeaeb"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:36.325279 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2307/4665] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:35 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1514 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:36.330570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-13f286ff-7aa6-4da4-a9e1-8d1cb6b8ec0b req-233397b1-59d8-41ef-83fd-3a33bd44b8d6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:36.333772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-13f286ff-7aa6-4da4-a9e1-8d1cb6b8ec0b req-233397b1-59d8-41ef-83fd-3a33bd44b8d6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:36.350023 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-13f286ff-7aa6-4da4-a9e1-8d1cb6b8ec0b req-233397b1-59d8-41ef-83fd-3a33bd44b8d6 service nova] Creating event network-changed:ac272c7e-fc83-4f7e-82e5-9206b48aeaeb for instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 on n-h1-767704-28 Jul 14 14:52:36.374505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-84964ef3-7d86-4f32-9eb9-cae0f2c96675 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:36.375309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-84964ef3-7d86-4f32-9eb9-cae0f2c96675 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:36.379808 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-13f286ff-7aa6-4da4-a9e1-8d1cb6b8ec0b req-233397b1-59d8-41ef-83fd-3a33bd44b8d6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070933 Jul 14 14:52:36.380889 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2359/4666] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:52:36.388768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84964ef3-7d86-4f32-9eb9-cae0f2c96675 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:36.393414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84964ef3-7d86-4f32-9eb9-cae0f2c96675 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:36.394927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84964ef3-7d86-4f32-9eb9-cae0f2c96675 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:36.395377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84964ef3-7d86-4f32-9eb9-cae0f2c96675 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:36.732087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-84964ef3-7d86-4f32-9eb9-cae0f2c96675 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:36.752073 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-84964ef3-7d86-4f32-9eb9-cae0f2c96675 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1323 microversion: 2.1 time: 0.382098 Jul 14 14:52:36.754104 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2308/4667] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:36 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1323 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:36.830568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-63a9aab2-83eb-432f-b13f-0ef363f6078e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:36.832606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-63a9aab2-83eb-432f-b13f-0ef363f6078e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:36.851233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63a9aab2-83eb-432f-b13f-0ef363f6078e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:36.852170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63a9aab2-83eb-432f-b13f-0ef363f6078e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:36.854424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63a9aab2-83eb-432f-b13f-0ef363f6078e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:36.855705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63a9aab2-83eb-432f-b13f-0ef363f6078e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:37.333049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-828fef0b-10fc-4bd9-8c08-e15aa40fc6e3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:37.333939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-828fef0b-10fc-4bd9-8c08-e15aa40fc6e3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:37.367456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-828fef0b-10fc-4bd9-8c08-e15aa40fc6e3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:37.376201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-828fef0b-10fc-4bd9-8c08-e15aa40fc6e3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:37.378107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-828fef0b-10fc-4bd9-8c08-e15aa40fc6e3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:37.378866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-828fef0b-10fc-4bd9-8c08-e15aa40fc6e3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:38.597355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-63a9aab2-83eb-432f-b13f-0ef363f6078e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:38.613047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-63a9aab2-83eb-432f-b13f-0ef363f6078e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:38.620804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-63a9aab2-83eb-432f-b13f-0ef363f6078e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:38.623505 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-63a9aab2-83eb-432f-b13f-0ef363f6078e tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1360 microversion: 2.26 time: 1.805104 Jul 14 14:52:38.624105 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2360/4668] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:36 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1360 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:38.639088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3112d84c-1716-4fe0-81a6-5aa35d81d061 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:38.643843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3112d84c-1716-4fe0-81a6-5aa35d81d061 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:38.687126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3112d84c-1716-4fe0-81a6-5aa35d81d061 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:38.687594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3112d84c-1716-4fe0-81a6-5aa35d81d061 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:38.694341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3112d84c-1716-4fe0-81a6-5aa35d81d061 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:38.698266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3112d84c-1716-4fe0-81a6-5aa35d81d061 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:39.030623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:39.310925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-828fef0b-10fc-4bd9-8c08-e15aa40fc6e3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:39.334141 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-828fef0b-10fc-4bd9-8c08-e15aa40fc6e3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1514 microversion: 2.1 time: 2.005494 Jul 14 14:52:39.334639 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2309/4669] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:37 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1514 bytes in 2007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:39.649064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-311aa890-4cd9-49b4-b98c-79b498202eaa tempest-QuotasTestJSON-487717416 tempest-QuotasTestJSON-487717416-project] Calling method '.version_select at 0x7fd6c56fff70>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:39.807310 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-311aa890-4cd9-49b4-b98c-79b498202eaa tempest-QuotasTestJSON-487717416 tempest-QuotasTestJSON-487717416-project] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/6753ad12630b47b9a5bdbc5b50f2d202/defaults" status: 200 len: 371 microversion: 2.1 time: 0.467300 Jul 14 14:52:39.808902 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2310/4670] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:52:39 2022] GET /compute/v2.1/os-quota-sets/6753ad12630b47b9a5bdbc5b50f2d202/defaults => generated 371 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:39.816570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2fcb6541-9dc3-4f46-91dd-e13ff44d6f32 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:39.817657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2fcb6541-9dc3-4f46-91dd-e13ff44d6f32 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:39.830297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fcb6541-9dc3-4f46-91dd-e13ff44d6f32 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:39.831149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fcb6541-9dc3-4f46-91dd-e13ff44d6f32 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:39.834524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fcb6541-9dc3-4f46-91dd-e13ff44d6f32 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:39.836112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2fcb6541-9dc3-4f46-91dd-e13ff44d6f32 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:39.858862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3112d84c-1716-4fe0-81a6-5aa35d81d061 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:39.870020 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3112d84c-1716-4fe0-81a6-5aa35d81d061 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1323 microversion: 2.1 time: 1.242229 Jul 14 14:52:39.870994 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2361/4671] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:38 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1323 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:39.876968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8515021-b616-4112-9601-b66a807970a2 tempest-QuotasTestJSON-487717416 tempest-QuotasTestJSON-487717416-project] Calling method '.version_select at 0x7fd6c4c66af0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:40.009285 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8515021-b616-4112-9601-b66a807970a2 tempest-QuotasTestJSON-487717416 tempest-QuotasTestJSON-487717416-project] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/6753ad12630b47b9a5bdbc5b50f2d202" status: 200 len: 371 microversion: 2.1 time: 0.136134 Jul 14 14:52:40.010523 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2362/4672] 10.222.0.81 () {58 vars in 1241 bytes} [Thu Jul 14 14:52:39 2022] GET /compute/v2.1/os-quota-sets/6753ad12630b47b9a5bdbc5b50f2d202 => generated 371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:40.030035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bdcb57f4-8a62-4c81-8eda-5fe7bc35f42a tempest-QuotasTestJSON-487717416 tempest-QuotasTestJSON-487717416-project] Calling method '.version_select at 0x7fd6c4e04dc0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:40.136269 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bdcb57f4-8a62-4c81-8eda-5fe7bc35f42a tempest-QuotasTestJSON-487717416 tempest-QuotasTestJSON-487717416-project] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/6753ad12630b47b9a5bdbc5b50f2d202/defaults" status: 200 len: 371 microversion: 2.1 time: 0.112021 Jul 14 14:52:40.141697 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2363/4673] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:52:40 2022] GET /compute/v2.1/os-quota-sets/6753ad12630b47b9a5bdbc5b50f2d202/defaults => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:40.159171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-676cadca-edc0-4e61-98a7-3fe2693023b2 tempest-QuotasTestJSON-487717416 tempest-QuotasTestJSON-487717416-project] Calling method '.version_select at 0x7fd6c4c54310>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:40.355012 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-676cadca-edc0-4e61-98a7-3fe2693023b2 tempest-QuotasTestJSON-487717416 tempest-QuotasTestJSON-487717416-project] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/6753ad12630b47b9a5bdbc5b50f2d202" status: 200 len: 371 microversion: 2.1 time: 0.204675 Jul 14 14:52:40.355623 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2364/4674] 10.222.0.81 () {58 vars in 1241 bytes} [Thu Jul 14 14:52:40 2022] GET /compute/v2.1/os-quota-sets/6753ad12630b47b9a5bdbc5b50f2d202 => generated 371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:40.379355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1344fe40-27b0-43fc-ab4b-b7c0d7e99db5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:40.380570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1344fe40-27b0-43fc-ab4b-b7c0d7e99db5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:40.404764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1344fe40-27b0-43fc-ab4b-b7c0d7e99db5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:40.406011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1344fe40-27b0-43fc-ab4b-b7c0d7e99db5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:40.410207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1344fe40-27b0-43fc-ab4b-b7c0d7e99db5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:40.410928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1344fe40-27b0-43fc-ab4b-b7c0d7e99db5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:40.682330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2fcb6541-9dc3-4f46-91dd-e13ff44d6f32 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:40.705129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2fcb6541-9dc3-4f46-91dd-e13ff44d6f32 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:40.710977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2fcb6541-9dc3-4f46-91dd-e13ff44d6f32 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:40.713597 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2fcb6541-9dc3-4f46-91dd-e13ff44d6f32 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1543 microversion: 2.26 time: 0.901975 Jul 14 14:52:40.715058 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2311/4675] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:39 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1543 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:40.725271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77763086-800a-434c-a4dd-cdc62e7b9eef tempest-QuotasTestJSON-487717416 tempest-QuotasTestJSON-487717416-project] Calling method '.version_select at 0x7fd6c65459d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:40.959751 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-77763086-800a-434c-a4dd-cdc62e7b9eef tempest-QuotasTestJSON-487717416 tempest-QuotasTestJSON-487717416-project] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/6753ad12630b47b9a5bdbc5b50f2d202?user_id=2bcc2924890942479787a60373615ad9" status: 200 len: 371 microversion: 2.1 time: 0.237372 Jul 14 14:52:40.960460 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2312/4676] 10.222.0.81 () {58 vars in 1322 bytes} [Thu Jul 14 14:52:40 2022] GET /compute/v2.1/os-quota-sets/6753ad12630b47b9a5bdbc5b50f2d202?user_id=2bcc2924890942479787a60373615ad9 => generated 371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:40.968331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6cad22af0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:40.990627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:40.991363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:40.992220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:41.002699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:41.003435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:41.004556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:41.005531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:41.051232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:41.052790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:41.096169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:41.098626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:41.160136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:41.175790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:41.205379 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-48eb09f2-39a1-443e-ba72-2201bbe89ef0 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-123645292" status: 201 len: 0 microversion: 2.26 time: 0.243253 Jul 14 14:52:41.207043 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2313/4677] 10.222.0.81 () {62 vars in 1376 bytes} [Thu Jul 14 14:52:40 2022] PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-123645292 => generated 0 bytes in 246 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 14 14:52:41.214381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-62e7b2b6-b3c9-4d8f-891a-e03cb7d2d932 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:41.215209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-62e7b2b6-b3c9-4d8f-891a-e03cb7d2d932 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:41.228001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62e7b2b6-b3c9-4d8f-891a-e03cb7d2d932 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:41.228908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62e7b2b6-b3c9-4d8f-891a-e03cb7d2d932 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:41.229937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62e7b2b6-b3c9-4d8f-891a-e03cb7d2d932 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:41.230560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62e7b2b6-b3c9-4d8f-891a-e03cb7d2d932 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:41.924510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1344fe40-27b0-43fc-ab4b-b7c0d7e99db5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:41.947828 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1344fe40-27b0-43fc-ab4b-b7c0d7e99db5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 200 len: 1514 microversion: 2.1 time: 1.588182 Jul 14 14:52:41.949012 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2365/4678] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:40 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 1514 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:41.961027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a75e57c6-697d-4c4b-a757-e48e823d14bb tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c4e04af0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:41.973917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a75e57c6-697d-4c4b-a757-e48e823d14bb tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:41.975529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a75e57c6-697d-4c4b-a757-e48e823d14bb tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.010462 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a75e57c6-697d-4c4b-a757-e48e823d14bb tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-123645292" status: 204 len: 0 microversion: 2.26 time: 0.056278 Jul 14 14:52:42.011729 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2366/4679] 10.222.0.81 () {60 vars in 1357 bytes} [Thu Jul 14 14:52:41 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-123645292 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:52:42.020079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5ea3bc6d-f2d5-490f-88e1-2b9e817805f1 req-880aa896-5b7f-4c02-915e-144aca828139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465cae4c-e138-4d7f-94a6-4e5ebb016c98", "name": "network-vif-deleted", "tag": "11856969-830c-44c8-9728-4d2edd02f9f5"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:42.033338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5ea3bc6d-f2d5-490f-88e1-2b9e817805f1 req-880aa896-5b7f-4c02-915e-144aca828139 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.034109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5ea3bc6d-f2d5-490f-88e1-2b9e817805f1 req-880aa896-5b7f-4c02-915e-144aca828139 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.069638 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5ea3bc6d-f2d5-490f-88e1-2b9e817805f1 req-880aa896-5b7f-4c02-915e-144aca828139 service nova] Creating event network-vif-deleted:11856969-830c-44c8-9728-4d2edd02f9f5 for instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 on n-h2-767704-28 Jul 14 14:52:42.079681 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5ea3bc6d-f2d5-490f-88e1-2b9e817805f1 req-880aa896-5b7f-4c02-915e-144aca828139 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064481 Jul 14 14:52:42.081777 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2367/4680] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:42.091409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4869a8fb-ec09-4ccb-9c51-18cba6230621 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c4c54310>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:42.101543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4869a8fb-ec09-4ccb-9c51-18cba6230621 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.102305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4869a8fb-ec09-4ccb-9c51-18cba6230621 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.103976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4869a8fb-ec09-4ccb-9c51-18cba6230621 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:42.112316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4869a8fb-ec09-4ccb-9c51-18cba6230621 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.113221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4869a8fb-ec09-4ccb-9c51-18cba6230621 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.114925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4869a8fb-ec09-4ccb-9c51-18cba6230621 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.115995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4869a8fb-ec09-4ccb-9c51-18cba6230621 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.203146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4869a8fb-ec09-4ccb-9c51-18cba6230621 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.203993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4869a8fb-ec09-4ccb-9c51-18cba6230621 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.230958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-62e7b2b6-b3c9-4d8f-891a-e03cb7d2d932 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:42.246381 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-62e7b2b6-b3c9-4d8f-891a-e03cb7d2d932 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1323 microversion: 2.1 time: 1.037766 Jul 14 14:52:42.249309 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2314/4681] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:41 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1323 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:42.255022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-4869a8fb-ec09-4ccb-9c51-18cba6230621 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:42.267577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-16405944-9fc1-4c95-bb55-7cd65462156c req-3b5885e6-b3cb-4a31-9749-470af58c0294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7148982-49b4-4147-b082-63692fd18868", "name": "network-vif-plugged", "status": "completed", "tag": "0542a439-f512-4965-ad58-2ad6b62e2471"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:42.300190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-16405944-9fc1-4c95-bb55-7cd65462156c req-3b5885e6-b3cb-4a31-9749-470af58c0294 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.300638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-16405944-9fc1-4c95-bb55-7cd65462156c req-3b5885e6-b3cb-4a31-9749-470af58c0294 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.311724 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4869a8fb-ec09-4ccb-9c51-18cba6230621 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags" status: 204 len: 0 microversion: 2.26 time: 0.228217 Jul 14 14:52:42.313608 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2368/4682] 10.222.0.81 () {60 vars in 1294 bytes} [Thu Jul 14 14:52:42 2022] DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:52:42.347800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f4206d98-5db6-4bd6-a52d-3bc0512843ba tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c4c41af0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:42.348651 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-16405944-9fc1-4c95-bb55-7cd65462156c req-3b5885e6-b3cb-4a31-9749-470af58c0294 service nova] Creating event network-vif-plugged:0542a439-f512-4965-ad58-2ad6b62e2471 for instance c7148982-49b4-4147-b082-63692fd18868 on n-h1-767704-28 Jul 14 14:52:42.366903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4206d98-5db6-4bd6-a52d-3bc0512843ba tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.367688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4206d98-5db6-4bd6-a52d-3bc0512843ba tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.376569 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-16405944-9fc1-4c95-bb55-7cd65462156c req-3b5885e6-b3cb-4a31-9749-470af58c0294 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125461 Jul 14 14:52:42.377232 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2315/4683] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:42.384024 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f4206d98-5db6-4bd6-a52d-3bc0512843ba tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags" status: 200 len: 12 microversion: 2.26 time: 0.065222 Jul 14 14:52:42.387875 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2369/4684] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jul 14 14:52:42 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags => generated 12 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:42.399641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c52e5040>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:42.427483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.430320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.431975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:42.462680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.466481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.467657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.468327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.532101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.532658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.543148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.543631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.613459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:42.666955 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-db78b880-d3ee-4bea-ad25-b8094e611968 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-449818182" status: 201 len: 0 microversion: 2.26 time: 0.272970 Jul 14 14:52:42.667530 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2316/4685] 10.222.0.81 () {62 vars in 1376 bytes} [Thu Jul 14 14:52:42 2022] PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-449818182 => generated 0 bytes in 275 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 14 14:52:42.678658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff9e9202-8613-4bb4-abe8-c49517e5cb37 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c4c54b80>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:42.689575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff9e9202-8613-4bb4-abe8-c49517e5cb37 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.690568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff9e9202-8613-4bb4-abe8-c49517e5cb37 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.702792 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ff9e9202-8613-4bb4-abe8-c49517e5cb37 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags" status: 200 len: 35 microversion: 2.26 time: 0.029746 Jul 14 14:52:42.704201 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2370/4686] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jul 14 14:52:42 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags => generated 35 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:42.714274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b3f97081-0001-4e86-95d7-654812d6a048 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6cac2ec10>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:42.724518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3f97081-0001-4e86-95d7-654812d6a048 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.725220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3f97081-0001-4e86-95d7-654812d6a048 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.726425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b3f97081-0001-4e86-95d7-654812d6a048 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:42.737200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3f97081-0001-4e86-95d7-654812d6a048 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.737978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3f97081-0001-4e86-95d7-654812d6a048 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.739645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3f97081-0001-4e86-95d7-654812d6a048 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.740397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3f97081-0001-4e86-95d7-654812d6a048 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.768806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3f97081-0001-4e86-95d7-654812d6a048 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.769294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3f97081-0001-4e86-95d7-654812d6a048 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.809232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-b3f97081-0001-4e86-95d7-654812d6a048 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:42.827761 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b3f97081-0001-4e86-95d7-654812d6a048 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-449818182" status: 204 len: 0 microversion: 2.26 time: 0.117758 Jul 14 14:52:42.831682 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2317/4687] 10.222.0.81 () {60 vars in 1360 bytes} [Thu Jul 14 14:52:42 2022] DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-449818182 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:52:42.837294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4190542-d833-4671-abfd-e9f9818dba36 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c4c544c0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:42.846669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4190542-d833-4671-abfd-e9f9818dba36 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.847343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4190542-d833-4671-abfd-e9f9818dba36 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.864827 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d4190542-d833-4671-abfd-e9f9818dba36 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags" status: 200 len: 12 microversion: 2.26 time: 0.031527 Jul 14 14:52:42.866641 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2371/4688] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jul 14 14:52:42 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:42.877290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2029a30f-7029-4932-bb56-d0a8c8b5ad97 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c474d280>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:42.885962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2029a30f-7029-4932-bb56-d0a8c8b5ad97 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.886710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2029a30f-7029-4932-bb56-d0a8c8b5ad97 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.887600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2029a30f-7029-4932-bb56-d0a8c8b5ad97 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:42.894911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2029a30f-7029-4932-bb56-d0a8c8b5ad97 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.895820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2029a30f-7029-4932-bb56-d0a8c8b5ad97 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.896885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2029a30f-7029-4932-bb56-d0a8c8b5ad97 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.898077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2029a30f-7029-4932-bb56-d0a8c8b5ad97 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.927549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2029a30f-7029-4932-bb56-d0a8c8b5ad97 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.928337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2029a30f-7029-4932-bb56-d0a8c8b5ad97 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.949487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-2029a30f-7029-4932-bb56-d0a8c8b5ad97 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:42.966546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-10f4ad03-8921-4ba8-9fd3-6df9facc3e6f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:42.967228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-10f4ad03-8921-4ba8-9fd3-6df9facc3e6f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:42.977110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10f4ad03-8921-4ba8-9fd3-6df9facc3e6f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.977547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10f4ad03-8921-4ba8-9fd3-6df9facc3e6f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.978328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10f4ad03-8921-4ba8-9fd3-6df9facc3e6f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.978776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10f4ad03-8921-4ba8-9fd3-6df9facc3e6f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.986319 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2029a30f-7029-4932-bb56-d0a8c8b5ad97 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags" status: 204 len: 0 microversion: 2.26 time: 0.112945 Jul 14 14:52:42.989004 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2318/4689] 10.222.0.81 () {60 vars in 1294 bytes} [Thu Jul 14 14:52:42 2022] DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 14:52:43.000182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c5999550>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:43.009324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.010042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.010708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:43.017862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.018688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.019674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.019974 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-10f4ad03-8921-4ba8-9fd3-6df9facc3e6f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:52:43.020441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-10f4ad03-8921-4ba8-9fd3-6df9facc3e6f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 HTTP/1.1 Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '465cae4c-e138-4d7f-94a6-4e5ebb016c98'} Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:43.021812 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:43.027495 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:43.027495 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:43.027495 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:43.027495 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:43.027495 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:52:43.027495 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:52:43.027495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-10f4ad03-8921-4ba8-9fd3-6df9facc3e6f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:43.027495 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-10f4ad03-8921-4ba8-9fd3-6df9facc3e6f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 404 len: 111 microversion: 2.1 time: 0.061153 Jul 14 14:52:43.031773 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2372/4690] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:42 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:43.039111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-525b409a-21a6-4f31-93af-b51b5bcf15f4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '.version_select at 0x7fd6c4c405e0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:43.086621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.087237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.101231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.102294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.119085 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-525b409a-21a6-4f31-93af-b51b5bcf15f4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-key-279403775" status: 202 len: 0 microversion: 2.1 time: 0.084930 Jul 14 14:52:43.127067 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2373/4691] 10.222.0.81 () {58 vars in 1205 bytes} [Thu Jul 14 14:52:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-279403775 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:52:43.135267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:43.161553 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c5fbdfab-9e4a-42f0-8344-22915251534f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-1132423880" status: 201 len: 0 microversion: 2.26 time: 0.166901 Jul 14 14:52:43.164153 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2319/4692] 10.222.0.81 () {62 vars in 1379 bytes} [Thu Jul 14 14:52:42 2022] PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-1132423880 => generated 0 bytes in 170 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 14 14:52:43.174906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c4c25a60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:43.193688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.194145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.194635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:43.219515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.222432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.223483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.225417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.268355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-950424df-032e-4452-9b62-b47c9cd4347f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:43.269189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-950424df-032e-4452-9b62-b47c9cd4347f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:43.288427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.290424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-950424df-032e-4452-9b62-b47c9cd4347f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.292976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-950424df-032e-4452-9b62-b47c9cd4347f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.297172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-950424df-032e-4452-9b62-b47c9cd4347f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.298003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-950424df-032e-4452-9b62-b47c9cd4347f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.298313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.317469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.318282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.382590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:43.437445 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-52b07a67-23da-47b8-9f57-b6979417d3e4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-2126775814" status: 201 len: 0 microversion: 2.26 time: 0.268127 Jul 14 14:52:43.444763 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2374/4693] 10.222.0.81 () {62 vars in 1379 bytes} [Thu Jul 14 14:52:43 2022] PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-2126775814 => generated 0 bytes in 276 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 14 14:52:43.455055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-56002128", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "525f1693-8842-4191-b231-7d2db21bdaf8"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:43.567747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] validate_networks() for [('525f1693-8842-4191-b231-7d2db21bdaf8', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:52:43.974472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-950424df-032e-4452-9b62-b47c9cd4347f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:43.999343 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-950424df-032e-4452-9b62-b47c9cd4347f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1323 microversion: 2.1 time: 0.736998 Jul 14 14:52:44.005860 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2320/4694] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:43 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1323 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:52:44.013500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2cca3d0c-e311-4c51-b61b-0e7597cda0c9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6cac2ec10>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:44.045495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cca3d0c-e311-4c51-b61b-0e7597cda0c9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.046402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cca3d0c-e311-4c51-b61b-0e7597cda0c9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.047175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2cca3d0c-e311-4c51-b61b-0e7597cda0c9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:44.065649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cca3d0c-e311-4c51-b61b-0e7597cda0c9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.067145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cca3d0c-e311-4c51-b61b-0e7597cda0c9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.068798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cca3d0c-e311-4c51-b61b-0e7597cda0c9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.072794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cca3d0c-e311-4c51-b61b-0e7597cda0c9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.129240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cca3d0c-e311-4c51-b61b-0e7597cda0c9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.132438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cca3d0c-e311-4c51-b61b-0e7597cda0c9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.158486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-2cca3d0c-e311-4c51-b61b-0e7597cda0c9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:44.189027 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2cca3d0c-e311-4c51-b61b-0e7597cda0c9 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags" status: 204 len: 0 microversion: 2.26 time: 0.179566 Jul 14 14:52:44.194247 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2321/4695] 10.222.0.81 () {60 vars in 1294 bytes} [Thu Jul 14 14:52:44 2022] DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:52:44.204458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4d532179-c93b-4871-bed1-fca2a16a1b8d tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c56ffc10>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:44.221789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d532179-c93b-4871-bed1-fca2a16a1b8d tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.229216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d532179-c93b-4871-bed1-fca2a16a1b8d tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.246805 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4d532179-c93b-4871-bed1-fca2a16a1b8d tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags" status: 200 len: 12 microversion: 2.26 time: 0.047261 Jul 14 14:52:44.248325 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2322/4696] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jul 14 14:52:44 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:44.260526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d7b9e23-d896-45a4-98a6-2019774b6f20 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c4633f70>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:44.269240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d7b9e23-d896-45a4-98a6-2019774b6f20 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.270246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d7b9e23-d896-45a4-98a6-2019774b6f20 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.270246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d7b9e23-d896-45a4-98a6-2019774b6f20 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:44.277497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d7b9e23-d896-45a4-98a6-2019774b6f20 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.290528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d7b9e23-d896-45a4-98a6-2019774b6f20 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.291268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d7b9e23-d896-45a4-98a6-2019774b6f20 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.291724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d7b9e23-d896-45a4-98a6-2019774b6f20 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.336117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d7b9e23-d896-45a4-98a6-2019774b6f20 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.343493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d7b9e23-d896-45a4-98a6-2019774b6f20 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.369128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-7d7b9e23-d896-45a4-98a6-2019774b6f20 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:44.414744 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d7b9e23-d896-45a4-98a6-2019774b6f20 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags" status: 204 len: 0 microversion: 2.26 time: 0.157859 Jul 14 14:52:44.422313 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2323/4697] 10.222.0.81 () {60 vars in 1294 bytes} [Thu Jul 14 14:52:44 2022] DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 14:52:44.433346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c4bf6ca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:44.454355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.455022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.455789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:44.468799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.470885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.472774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.473317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.576858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.577361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.603476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.604202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.613109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:44.681664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:44.725059 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f1c3c41e-ddd0-478b-a3fd-06af44eaac55 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-796497226" status: 201 len: 0 microversion: 2.26 time: 0.300553 Jul 14 14:52:44.726419 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2324/4698] 10.222.0.81 () {62 vars in 1376 bytes} [Thu Jul 14 14:52:44 2022] PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-796497226 => generated 0 bytes in 303 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 14 14:52:44.744064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c5a2a790>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:44.755055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.755814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.757572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:44.811047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.811885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.815311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.816046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.850314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.851098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.880300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.881296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.954209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:44.991549 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-acf7e7c2-a1df-450a-8203-89d3adb3fd05 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-1902744867" status: 201 len: 0 microversion: 2.26 time: 0.257380 Jul 14 14:52:44.994239 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2325/4699] 10.222.0.81 () {62 vars in 1379 bytes} [Thu Jul 14 14:52:44 2022] PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags/tempest-tag-1902744867 => generated 0 bytes in 261 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 14 14:52:45.010309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4965af1a-c4d9-49e1-9645-3a93a93e6a33 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Action: 'update_all', calling method: .version_select at 0x7fd6c56ff310>, body: {"tags": ["tempest-tag-570979503", "tempest-tag-1415138847"]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:45.035588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4965af1a-c4d9-49e1-9645-3a93a93e6a33 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.039245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4965af1a-c4d9-49e1-9645-3a93a93e6a33 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.040042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4965af1a-c4d9-49e1-9645-3a93a93e6a33 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:45.067148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4965af1a-c4d9-49e1-9645-3a93a93e6a33 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.069411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4965af1a-c4d9-49e1-9645-3a93a93e6a33 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.070660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4965af1a-c4d9-49e1-9645-3a93a93e6a33 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.072072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4965af1a-c4d9-49e1-9645-3a93a93e6a33 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.121254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4965af1a-c4d9-49e1-9645-3a93a93e6a33 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.121936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4965af1a-c4d9-49e1-9645-3a93a93e6a33 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.158769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-4965af1a-c4d9-49e1-9645-3a93a93e6a33 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:45.206672 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4965af1a-c4d9-49e1-9645-3a93a93e6a33 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags" status: 200 len: 61 microversion: 2.26 time: 0.208238 Jul 14 14:52:45.211811 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2326/4700] 10.222.0.81 () {62 vars in 1311 bytes} [Thu Jul 14 14:52:44 2022] PUT /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags => generated 61 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:45.213011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-66ce9ce8-28e6-4456-9a3e-e5ae3c3fd19d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:45.213631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-66ce9ce8-28e6-4456-9a3e-e5ae3c3fd19d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:45.228082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66ce9ce8-28e6-4456-9a3e-e5ae3c3fd19d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.228541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66ce9ce8-28e6-4456-9a3e-e5ae3c3fd19d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.229363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66ce9ce8-28e6-4456-9a3e-e5ae3c3fd19d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.229804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-66ce9ce8-28e6-4456-9a3e-e5ae3c3fd19d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.246208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:52:45.246831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:52:45.247270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:52:45.247689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:52:45.248113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:52:45.270414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.280312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.281652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.285717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.342665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:52:45.349215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for user 4e3af45ec76c4a0b8dd03dcff6802f3c and project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:52:45.373853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:52:45.380586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:52:45.449380 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9da21e58-63bf-4966-af88-b4e0dacdf930 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.003285 Jul 14 14:52:45.452243 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2375/4701] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:52:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:52:45.472042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e5e3de51-555b-48ed-a3db-659464b6684f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6c4c25b80>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:45.487847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5e3de51-555b-48ed-a3db-659464b6684f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.488648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5e3de51-555b-48ed-a3db-659464b6684f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.503247 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e5e3de51-555b-48ed-a3db-659464b6684f tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags" status: 200 len: 61 microversion: 2.26 time: 0.046397 Jul 14 14:52:45.513373 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2376/4702] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jul 14 14:52:45 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags => generated 61 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:45.521240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1251841f-295a-43a7-bbe8-add73410e64d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:45.522155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1251841f-295a-43a7-bbe8-add73410e64d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:45.698419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-66ce9ce8-28e6-4456-9a3e-e5ae3c3fd19d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:45.710012 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-66ce9ce8-28e6-4456-9a3e-e5ae3c3fd19d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1518 microversion: 2.1 time: 0.501121 Jul 14 14:52:45.717865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1251841f-295a-43a7-bbe8-add73410e64d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:45.725442 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2327/4703] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:45 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1518 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:45.726502 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1251841f-295a-43a7-bbe8-add73410e64d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1207 microversion: 2.1 time: 0.211454 Jul 14 14:52:45.730261 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2377/4704] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:45 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1207 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:45.754124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-96d2d131-4ade-4f00-9798-3e53f05fc2a4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '.version_select at 0x7fd6cad224c0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:45.759967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:45.787123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96d2d131-4ade-4f00-9798-3e53f05fc2a4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.787123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96d2d131-4ade-4f00-9798-3e53f05fc2a4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.788781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-96d2d131-4ade-4f00-9798-3e53f05fc2a4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:45.809049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96d2d131-4ade-4f00-9798-3e53f05fc2a4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.812021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96d2d131-4ade-4f00-9798-3e53f05fc2a4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.812856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96d2d131-4ade-4f00-9798-3e53f05fc2a4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.813343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96d2d131-4ade-4f00-9798-3e53f05fc2a4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.891486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96d2d131-4ade-4f00-9798-3e53f05fc2a4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.893786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96d2d131-4ade-4f00-9798-3e53f05fc2a4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.945550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-96d2d131-4ade-4f00-9798-3e53f05fc2a4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lazy-loading 'flavor' on Instance uuid 09efbb61-3d16-41bc-ba5f-cdeab10fd88c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:45.987824 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-96d2d131-4ade-4f00-9798-3e53f05fc2a4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags" status: 204 len: 0 microversion: 2.26 time: 0.261143 Jul 14 14:52:45.991089 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2328/4705] 10.222.0.81 () {60 vars in 1294 bytes} [Thu Jul 14 14:52:45 2022] DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c/tags => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:52:45.999676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-436a1db5-348d-4d91-a209-706414d5460b tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:46.000185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-436a1db5-348d-4d91-a209-706414d5460b tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:46.014272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e1bb982-6eff-47c9-9f58-a7876ba35c09 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-478205313", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1632f1e7-373a-48e0-9894-094c34cc4ab6"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:46.017250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:46.039280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-436a1db5-348d-4d91-a209-706414d5460b tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:46.039749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-436a1db5-348d-4d91-a209-706414d5460b tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:46.040556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-436a1db5-348d-4d91-a209-706414d5460b tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:46.041034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-436a1db5-348d-4d91-a209-706414d5460b tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e1bb982-6eff-47c9-9f58-a7876ba35c09 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Request method failure captured: Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 242 Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C2dTMoHMZWZytrfoPsCWMjy0j7VKJGo2hi0-gyyCP6ezAIjjqbUHMvDLUiAyncZz-xnyRYXgLeHPphxPSedmD4OwpGqEEEIuDigGYsKa5AL0T0ePwq3TC_JUJYiHmA-SG8JrwjAKvzaF-jWNLJAXxaQov-jw5PtbgS7k2WtA8o5NNM Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_850ed2d2a9384d7cbe8f1b2e6aea8bc4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}] Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: c4082011ea9b4ce2b591f131e0bc50bb Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-478205313", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1632f1e7-373a-48e0-9894-094c34cc4ab6"}]}} Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-478205313', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '1632f1e7-373a-48e0-9894-094c34cc4ab6'}]}}} Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:52:46.042724 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.049035 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.053586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e1bb982-6eff-47c9-9f58-a7876ba35c09 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:46.054664 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5e1bb982-6eff-47c9-9f58-a7876ba35c09 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.044741 Jul 14 14:52:46.055869 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2329/4706] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:52:46 2022] POST /compute/v2.1/servers => generated 175 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:52:46.071033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b2136a6e-a11a-4f26-9edd-f96ef59ae5e6 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:46.071856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b2136a6e-a11a-4f26-9edd-f96ef59ae5e6 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: af4a59c0-d63f-43a4-b42b-b4a9f36a3885] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:46.082093 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b2136a6e-a11a-4f26-9edd-f96ef59ae5e6 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] HTTP exception thrown: Instance af4a59c0-d63f-43a4-b42b-b4a9f36a3885 could not be found. Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b2136a6e-a11a-4f26-9edd-f96ef59ae5e6 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Request method failure captured: Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/af4a59c0-d63f-43a4-b42b-b4a9f36a3885/metadata HTTP/1.1 Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C2dTMoHMZWZytrfoPsCWMjy0j7VKJGo2hi0-gyyCP6ezAIjjqbUHMvDLUiAyncZz-xnyRYXgLeHPphxPSedmD4OwpGqEEEIuDigGYsKa5AL0T0ePwq3TC_JUJYiHmA-SG8JrwjAKvzaF-jWNLJAXxaQov-jw5PtbgS7k2WtA8o5NNM Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_850ed2d2a9384d7cbe8f1b2e6aea8bc4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}] Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: c4082011ea9b4ce2b591f131e0bc50bb Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance af4a59c0-d63f-43a4-b42b-b4a9f36a3885 could not be found. Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'server_id': 'af4a59c0-d63f-43a4-b42b-b4a9f36a3885'} Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af4a59c0-d63f-43a4-b42b-b4a9f36a3885 could not be found. Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af4a59c0-d63f-43a4-b42b-b4a9f36a3885 could not be found. Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.087835 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.094400 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:46.094400 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:46.094400 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af4a59c0-d63f-43a4-b42b-b4a9f36a3885 could not be found. Jul 14 14:52:46.094400 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.096241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b2136a6e-a11a-4f26-9edd-f96ef59ae5e6 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Returning 404 to user: Instance af4a59c0-d63f-43a4-b42b-b4a9f36a3885 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:46.097721 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b2136a6e-a11a-4f26-9edd-f96ef59ae5e6 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/af4a59c0-d63f-43a4-b42b-b4a9f36a3885/metadata" status: 404 len: 111 microversion: 2.1 time: 0.035346 Jul 14 14:52:46.098841 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2330/4707] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jul 14 14:52:46 2022] GET /compute/v2.1/servers/af4a59c0-d63f-43a4-b42b-b4a9f36a3885/metadata => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:46.192203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fdd4bbd5-8ee0-4794-9094-33a6072fd753 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-333190182", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1632f1e7-373a-48e0-9894-094c34cc4ab6"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fdd4bbd5-8ee0-4794-9094-33a6072fd753 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Request method failure captured: Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 498 Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C2dTMoHMZWZytrfoPsCWMjy0j7VKJGo2hi0-gyyCP6ezAIjjqbUHMvDLUiAyncZz-xnyRYXgLeHPphxPSedmD4OwpGqEEEIuDigGYsKa5AL0T0ePwq3TC_JUJYiHmA-SG8JrwjAKvzaF-jWNLJAXxaQov-jw5PtbgS7k2WtA8o5NNM Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_850ed2d2a9384d7cbe8f1b2e6aea8bc4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}] Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: c4082011ea9b4ce2b591f131e0bc50bb Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-333190182", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1632f1e7-373a-48e0-9894-094c34cc4ab6"}]}} Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-333190182', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1632f1e7-373a-48e0-9894-094c34cc4ab6'}]}}} Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 14:52:46.200512 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.204646 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.220980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fdd4bbd5-8ee0-4794-9094-33a6072fd753 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:46.223306 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fdd4bbd5-8ee0-4794-9094-33a6072fd753 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.037752 Jul 14 14:52:46.233633 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2331/4708] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:52:46 2022] POST /compute/v2.1/servers => generated 687 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:52:46.318122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7de8a8e9-e372-4aeb-895c-97f49636b7a3 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-437750963", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1632f1e7-373a-48e0-9894-094c34cc4ab6"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7de8a8e9-e372-4aeb-895c-97f49636b7a3 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Request method failure captured: Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 499 Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C2dTMoHMZWZytrfoPsCWMjy0j7VKJGo2hi0-gyyCP6ezAIjjqbUHMvDLUiAyncZz-xnyRYXgLeHPphxPSedmD4OwpGqEEEIuDigGYsKa5AL0T0ePwq3TC_JUJYiHmA-SG8JrwjAKvzaF-jWNLJAXxaQov-jw5PtbgS7k2WtA8o5NNM Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_850ed2d2a9384d7cbe8f1b2e6aea8bc4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}] Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: c4082011ea9b4ce2b591f131e0bc50bb Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-437750963", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1632f1e7-373a-48e0-9894-094c34cc4ab6"}]}} Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-437750963', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1632f1e7-373a-48e0-9894-094c34cc4ab6'}]}}} Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 14:52:46.321979 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.326503 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.330770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7de8a8e9-e372-4aeb-895c-97f49636b7a3 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:46.332735 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7de8a8e9-e372-4aeb-895c-97f49636b7a3 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.016793 Jul 14 14:52:46.332735 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2332/4709] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:52:46 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:52:46.424504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-07a4b0f3-dbc3-40c9-92f9-6d1f1531920e tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1944425991", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1632f1e7-373a-48e0-9894-094c34cc4ab6"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-07a4b0f3-dbc3-40c9-92f9-6d1f1531920e tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Request method failure captured: Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 754 Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C2dTMoHMZWZytrfoPsCWMjy0j7VKJGo2hi0-gyyCP6ezAIjjqbUHMvDLUiAyncZz-xnyRYXgLeHPphxPSedmD4OwpGqEEEIuDigGYsKa5AL0T0ePwq3TC_JUJYiHmA-SG8JrwjAKvzaF-jWNLJAXxaQov-jw5PtbgS7k2WtA8o5NNM Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_850ed2d2a9384d7cbe8f1b2e6aea8bc4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}] Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: c4082011ea9b4ce2b591f131e0bc50bb Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1944425991", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1632f1e7-373a-48e0-9894-094c34cc4ab6"}]}} Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1944425991', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1632f1e7-373a-48e0-9894-094c34cc4ab6'}]}}} Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:52:46.427900 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:52:46.431144 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:52:46.434771 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.434771 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.434771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-07a4b0f3-dbc3-40c9-92f9-6d1f1531920e tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:46.436073 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-07a4b0f3-dbc3-40c9-92f9-6d1f1531920e tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.010570 Jul 14 14:52:46.436530 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2333/4710] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:52:46 2022] POST /compute/v2.1/servers => generated 1197 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jul 14 14:52:46.546156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7b2b7edb-377f-4acb-8704-c1c8ed751e94 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2119783408", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1632f1e7-373a-48e0-9894-094c34cc4ab6"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7b2b7edb-377f-4acb-8704-c1c8ed751e94 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Request method failure captured: Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 1266 Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C2dTMoHMZWZytrfoPsCWMjy0j7VKJGo2hi0-gyyCP6ezAIjjqbUHMvDLUiAyncZz-xnyRYXgLeHPphxPSedmD4OwpGqEEEIuDigGYsKa5AL0T0ePwq3TC_JUJYiHmA-SG8JrwjAKvzaF-jWNLJAXxaQov-jw5PtbgS7k2WtA8o5NNM Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_850ed2d2a9384d7cbe8f1b2e6aea8bc4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}] Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: c4082011ea9b4ce2b591f131e0bc50bb Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2119783408", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1632f1e7-373a-48e0-9894-094c34cc4ab6"}]}} Jul 14 14:52:46.551929 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2119783408', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1632f1e7-373a-48e0-9894-094c34cc4ab6'}]}}} Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.554841 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:52:46.556285 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:52:46.564321 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:52:46.564321 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.564321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7b2b7edb-377f-4acb-8704-c1c8ed751e94 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:46.564321 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7b2b7edb-377f-4acb-8704-c1c8ed751e94 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.019744 Jul 14 14:52:46.568737 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2334/4711] 10.222.0.81 () {60 vars in 1147 bytes} [Thu Jul 14 14:52:46 2022] POST /compute/v2.1/servers => generated 2221 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jul 14 14:52:46.590177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed0c2149-da63-4f08-9c5b-b8e8a078f91c tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:46.594358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ed0c2149-da63-4f08-9c5b-b8e8a078f91c tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: f2396059-34d7-41d7-a712-b2962a25f9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:46.632204 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-ed0c2149-da63-4f08-9c5b-b8e8a078f91c tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] HTTP exception thrown: Instance f2396059-34d7-41d7-a712-b2962a25f9b9 could not be found. Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed0c2149-da63-4f08-9c5b-b8e8a078f91c tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Request method failure captured: Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/f2396059-34d7-41d7-a712-b2962a25f9b9/metadata/test2 HTTP/1.1 Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C2dTMoHMZWZytrfoPsCWMjy0j7VKJGo2hi0-gyyCP6ezAIjjqbUHMvDLUiAyncZz-xnyRYXgLeHPphxPSedmD4OwpGqEEEIuDigGYsKa5AL0T0ePwq3TC_JUJYiHmA-SG8JrwjAKvzaF-jWNLJAXxaQov-jw5PtbgS7k2WtA8o5NNM Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_850ed2d2a9384d7cbe8f1b2e6aea8bc4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}] Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: c4082011ea9b4ce2b591f131e0bc50bb Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance f2396059-34d7-41d7-a712-b2962a25f9b9 could not be found. Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'server_id': 'f2396059-34d7-41d7-a712-b2962a25f9b9', 'id': 'test2'} Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2396059-34d7-41d7-a712-b2962a25f9b9 could not be found. Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2396059-34d7-41d7-a712-b2962a25f9b9 could not be found. Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.636909 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.642899 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:46.642899 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:46.642899 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2396059-34d7-41d7-a712-b2962a25f9b9 could not be found. Jul 14 14:52:46.642899 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.644455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed0c2149-da63-4f08-9c5b-b8e8a078f91c tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Returning 404 to user: Instance f2396059-34d7-41d7-a712-b2962a25f9b9 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:46.647417 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed0c2149-da63-4f08-9c5b-b8e8a078f91c tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/f2396059-34d7-41d7-a712-b2962a25f9b9/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.075794 Jul 14 14:52:46.648289 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2335/4712] 10.222.0.81 () {58 vars in 1280 bytes} [Thu Jul 14 14:52:46 2022] GET /compute/v2.1/servers/f2396059-34d7-41d7-a712-b2962a25f9b9/metadata/test2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:46.669716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c66fe229-10f7-479f-a774-8ac963a9634d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:46.676383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c66fe229-10f7-479f-a774-8ac963a9634d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:46.691651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c66fe229-10f7-479f-a774-8ac963a9634d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:46.693627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c66fe229-10f7-479f-a774-8ac963a9634d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:46.694998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c66fe229-10f7-479f-a774-8ac963a9634d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:46.696716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c66fe229-10f7-479f-a774-8ac963a9634d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:46.760401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-436a1db5-348d-4d91-a209-706414d5460b tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:52:46.798161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c66fe229-10f7-479f-a774-8ac963a9634d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:52:46.839468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:47.066645 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c66fe229-10f7-479f-a774-8ac963a9634d tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 204 len: 0 microversion: 2.1 time: 0.407640 Jul 14 14:52:47.067810 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2336/4713] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:52:46 2022] DELETE /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:52:47.071357 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-436a1db5-348d-4d91-a209-706414d5460b tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 204 len: 0 microversion: 2.26 time: 1.074074 Jul 14 14:52:47.074240 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2378/4714] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:52:45 2022] DELETE /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:52:47.076470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2219fe95-b209-4669-80ed-0f271688a8c5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:47.078005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2219fe95-b209-4669-80ed-0f271688a8c5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:47.086736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2219fe95-b209-4669-80ed-0f271688a8c5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:47.087708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2219fe95-b209-4669-80ed-0f271688a8c5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:47.087926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a3890408-5ec2-4764-8c51-03bc78b6d841 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:47.088907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a3890408-5ec2-4764-8c51-03bc78b6d841 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:47.089502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2219fe95-b209-4669-80ed-0f271688a8c5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:47.090491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2219fe95-b209-4669-80ed-0f271688a8c5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:47.100813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3890408-5ec2-4764-8c51-03bc78b6d841 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:47.101620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3890408-5ec2-4764-8c51-03bc78b6d841 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:47.102640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3890408-5ec2-4764-8c51-03bc78b6d841 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:47.103618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3890408-5ec2-4764-8c51-03bc78b6d841 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:47.483247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2219fe95-b209-4669-80ed-0f271688a8c5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:47.501532 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2219fe95-b209-4669-80ed-0f271688a8c5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1259 microversion: 2.1 time: 0.432092 Jul 14 14:52:47.502286 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2337/4715] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:47 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1259 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:47.518156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1450a5f2-e13d-4757-bcd8-25e015f03cc4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:47.519594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1450a5f2-e13d-4757-bcd8-25e015f03cc4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:47.538221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1450a5f2-e13d-4757-bcd8-25e015f03cc4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:47.538795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1450a5f2-e13d-4757-bcd8-25e015f03cc4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:47.539605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1450a5f2-e13d-4757-bcd8-25e015f03cc4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:47.540068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1450a5f2-e13d-4757-bcd8-25e015f03cc4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:48.094126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a3890408-5ec2-4764-8c51-03bc78b6d841 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:48.107803 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a3890408-5ec2-4764-8c51-03bc78b6d841 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1524 microversion: 2.1 time: 1.030465 Jul 14 14:52:48.109997 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2379/4716] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:47 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1524 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:48.179778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1450a5f2-e13d-4757-bcd8-25e015f03cc4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:48.194525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1450a5f2-e13d-4757-bcd8-25e015f03cc4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:48.197758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1450a5f2-e13d-4757-bcd8-25e015f03cc4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:48.201820 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1450a5f2-e13d-4757-bcd8-25e015f03cc4 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1549 microversion: 2.26 time: 0.696537 Jul 14 14:52:48.202717 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2338/4717] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:47 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1549 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:48.519861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8cba706c-05df-40fe-834d-123b284b3bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:48.521506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8cba706c-05df-40fe-834d-123b284b3bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:48.534548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8cba706c-05df-40fe-834d-123b284b3bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:48.538160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8cba706c-05df-40fe-834d-123b284b3bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:48.539063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8cba706c-05df-40fe-834d-123b284b3bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:48.539513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8cba706c-05df-40fe-834d-123b284b3bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:48.674825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8cba706c-05df-40fe-834d-123b284b3bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:48.683309 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8cba706c-05df-40fe-834d-123b284b3bd1 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1265 microversion: 2.1 time: 0.168075 Jul 14 14:52:48.694225 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2380/4718] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:48 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:49.140738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eebb9a4c-f0b3-435b-9aba-b17b11b7c23f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:49.143533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eebb9a4c-f0b3-435b-9aba-b17b11b7c23f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:49.159859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eebb9a4c-f0b3-435b-9aba-b17b11b7c23f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:49.160715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eebb9a4c-f0b3-435b-9aba-b17b11b7c23f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:49.161885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eebb9a4c-f0b3-435b-9aba-b17b11b7c23f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:49.162818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eebb9a4c-f0b3-435b-9aba-b17b11b7c23f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:49.221709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e99728af-c469-4204-98ce-ab92a0138924 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:49.222342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e99728af-c469-4204-98ce-ab92a0138924 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:49.242820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e99728af-c469-4204-98ce-ab92a0138924 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:49.243285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e99728af-c469-4204-98ce-ab92a0138924 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:49.244074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e99728af-c469-4204-98ce-ab92a0138924 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:49.244515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e99728af-c469-4204-98ce-ab92a0138924 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:49.883869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eebb9a4c-f0b3-435b-9aba-b17b11b7c23f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:49.901097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e99728af-c469-4204-98ce-ab92a0138924 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:49.904756 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eebb9a4c-f0b3-435b-9aba-b17b11b7c23f tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1524 microversion: 2.1 time: 0.780226 Jul 14 14:52:49.905734 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2339/4719] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:49 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1524 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:49.910415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-10b58f74-de4e-4da8-a9b4-c5c3a47dbb22 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:49.915835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-10b58f74-de4e-4da8-a9b4-c5c3a47dbb22 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:49.919034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e99728af-c469-4204-98ce-ab92a0138924 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:49.922155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e99728af-c469-4204-98ce-ab92a0138924 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:49.924415 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e99728af-c469-4204-98ce-ab92a0138924 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1549 microversion: 2.26 time: 0.707367 Jul 14 14:52:49.926192 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2381/4720] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:49 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1549 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:52:49.932116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10b58f74-de4e-4da8-a9b4-c5c3a47dbb22 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:49.932823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10b58f74-de4e-4da8-a9b4-c5c3a47dbb22 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:49.934640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10b58f74-de4e-4da8-a9b4-c5c3a47dbb22 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:49.935288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10b58f74-de4e-4da8-a9b4-c5c3a47dbb22 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:50.362108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-10b58f74-de4e-4da8-a9b4-c5c3a47dbb22 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:50.389854 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-10b58f74-de4e-4da8-a9b4-c5c3a47dbb22 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1307 microversion: 2.1 time: 0.482971 Jul 14 14:52:50.401323 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2340/4721] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:49 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1307 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:50.922761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1774c779-c859-4548-8f0e-1ada36788719 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:50.923636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1774c779-c859-4548-8f0e-1ada36788719 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:50.932100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1774c779-c859-4548-8f0e-1ada36788719 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:50.932909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1774c779-c859-4548-8f0e-1ada36788719 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:50.934776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1774c779-c859-4548-8f0e-1ada36788719 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:50.935463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1774c779-c859-4548-8f0e-1ada36788719 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:50.940653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:50.949306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-286d7272-9012-45b0-ae69-e9766a237609 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:50.950012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-286d7272-9012-45b0-ae69-e9766a237609 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:50.972479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-286d7272-9012-45b0-ae69-e9766a237609 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:50.974818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-286d7272-9012-45b0-ae69-e9766a237609 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:50.976159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-286d7272-9012-45b0-ae69-e9766a237609 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:50.977319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-286d7272-9012-45b0-ae69-e9766a237609 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:51.840933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1774c779-c859-4548-8f0e-1ada36788719 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:51.864036 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1774c779-c859-4548-8f0e-1ada36788719 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1524 microversion: 2.1 time: 0.945915 Jul 14 14:52:51.866761 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2382/4722] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:50 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1524 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:51.874103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2dc32e87-3e77-4b2f-bdc8-1cf2025b1b97 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:51.874997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2dc32e87-3e77-4b2f-bdc8-1cf2025b1b97 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:51.884598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dc32e87-3e77-4b2f-bdc8-1cf2025b1b97 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:51.885429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dc32e87-3e77-4b2f-bdc8-1cf2025b1b97 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:51.886793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dc32e87-3e77-4b2f-bdc8-1cf2025b1b97 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:51.888277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dc32e87-3e77-4b2f-bdc8-1cf2025b1b97 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:51.901976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-286d7272-9012-45b0-ae69-e9766a237609 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:51.918113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-286d7272-9012-45b0-ae69-e9766a237609 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:51.918113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-286d7272-9012-45b0-ae69-e9766a237609 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:51.918380 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-286d7272-9012-45b0-ae69-e9766a237609 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1549 microversion: 2.26 time: 0.978428 Jul 14 14:52:51.919324 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2341/4723] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:50 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1549 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:52:52.493860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-80202416-1e9d-4f9e-853d-63b621185d7f req-6bc2f0f4-1098-468c-897b-8d6f08c10bcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2462a80-02b2-406d-9468-28996da82f64", "tag": "33451e7f-bd9d-4dd2-9ccb-27a52ac539ce"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:52.519248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-80202416-1e9d-4f9e-853d-63b621185d7f req-6bc2f0f4-1098-468c-897b-8d6f08c10bcb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:52.521411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-80202416-1e9d-4f9e-853d-63b621185d7f req-6bc2f0f4-1098-468c-897b-8d6f08c10bcb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:52.579073 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-80202416-1e9d-4f9e-853d-63b621185d7f req-6bc2f0f4-1098-468c-897b-8d6f08c10bcb service nova] Creating event network-changed:33451e7f-bd9d-4dd2-9ccb-27a52ac539ce for instance d2462a80-02b2-406d-9468-28996da82f64 on n-h2-767704-28 Jul 14 14:52:52.592392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2dc32e87-3e77-4b2f-bdc8-1cf2025b1b97 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:52.597136 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-80202416-1e9d-4f9e-853d-63b621185d7f req-6bc2f0f4-1098-468c-897b-8d6f08c10bcb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110441 Jul 14 14:52:52.600147 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2342/4724] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:52.607140 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2dc32e87-3e77-4b2f-bdc8-1cf2025b1b97 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1307 microversion: 2.1 time: 0.738612 Jul 14 14:52:52.607645 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2383/4725] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:51 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1307 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:52.885686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c06592dc-3f99-4c49-8aea-fd3acaede41b tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:52.886817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c06592dc-3f99-4c49-8aea-fd3acaede41b tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:52.900272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c06592dc-3f99-4c49-8aea-fd3acaede41b tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:52.901231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c06592dc-3f99-4c49-8aea-fd3acaede41b tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:52.902298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c06592dc-3f99-4c49-8aea-fd3acaede41b tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:52.904403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c06592dc-3f99-4c49-8aea-fd3acaede41b tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:52.921836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:52.938395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b39a6723-7b24-452d-bf0b-4bfc305b19b2 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:52.939021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b39a6723-7b24-452d-bf0b-4bfc305b19b2 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:52.951121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b39a6723-7b24-452d-bf0b-4bfc305b19b2 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:52.951901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b39a6723-7b24-452d-bf0b-4bfc305b19b2 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:52.964604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b39a6723-7b24-452d-bf0b-4bfc305b19b2 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:52.965991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b39a6723-7b24-452d-bf0b-4bfc305b19b2 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:54.047780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c06592dc-3f99-4c49-8aea-fd3acaede41b tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:54.067861 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c06592dc-3f99-4c49-8aea-fd3acaede41b tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1524 microversion: 2.1 time: 1.186791 Jul 14 14:52:54.072691 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2343/4726] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:52 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1524 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:54.096103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b64447be-a048-452a-8429-eafd1d6e86bd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:54.097208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b64447be-a048-452a-8429-eafd1d6e86bd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:54.132692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b64447be-a048-452a-8429-eafd1d6e86bd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:54.140793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b64447be-a048-452a-8429-eafd1d6e86bd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:54.142159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b64447be-a048-452a-8429-eafd1d6e86bd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:54.145465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b64447be-a048-452a-8429-eafd1d6e86bd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:54.596539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b39a6723-7b24-452d-bf0b-4bfc305b19b2 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:54.615792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b39a6723-7b24-452d-bf0b-4bfc305b19b2 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:54.618579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b39a6723-7b24-452d-bf0b-4bfc305b19b2 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21ce7d197ab4e1894b125b230514da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7e71d44e0447b8a810fcd5d935b7c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:54.624673 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b39a6723-7b24-452d-bf0b-4bfc305b19b2 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 200 len: 1549 microversion: 2.26 time: 1.690778 Jul 14 14:52:54.640207 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2384/4727] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:52 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 1549 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:54.805291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-de6a799b-e7e9-4969-89d7-0e9f7677c2b7 req-987b4ca8-53c3-4daf-97df-0feb32241fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09efbb61-3d16-41bc-ba5f-cdeab10fd88c", "name": "network-vif-deleted", "tag": "53d4ce0a-1cd6-4bbd-bd75-05653ff4c2a6"}, {"server_uuid": "c7148982-49b4-4147-b082-63692fd18868", "name": "network-vif-deleted", "tag": "0542a439-f512-4965-ad58-2ad6b62e2471"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:54.820881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-de6a799b-e7e9-4969-89d7-0e9f7677c2b7 req-987b4ca8-53c3-4daf-97df-0feb32241fd4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:54.822643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-de6a799b-e7e9-4969-89d7-0e9f7677c2b7 req-987b4ca8-53c3-4daf-97df-0feb32241fd4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:54.839266 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-de6a799b-e7e9-4969-89d7-0e9f7677c2b7 req-987b4ca8-53c3-4daf-97df-0feb32241fd4 service nova] Creating event network-vif-deleted:53d4ce0a-1cd6-4bbd-bd75-05653ff4c2a6 for instance 09efbb61-3d16-41bc-ba5f-cdeab10fd88c on n-h1-767704-28 Jul 14 14:52:54.841411 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-de6a799b-e7e9-4969-89d7-0e9f7677c2b7 req-987b4ca8-53c3-4daf-97df-0feb32241fd4 service nova] Creating event network-vif-deleted:0542a439-f512-4965-ad58-2ad6b62e2471 for instance c7148982-49b4-4147-b082-63692fd18868 on n-h1-767704-28 Jul 14 14:52:54.851091 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-de6a799b-e7e9-4969-89d7-0e9f7677c2b7 req-987b4ca8-53c3-4daf-97df-0feb32241fd4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053406 Jul 14 14:52:54.852918 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2385/4728] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:54.901515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b64447be-a048-452a-8429-eafd1d6e86bd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:54.933479 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b64447be-a048-452a-8429-eafd1d6e86bd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1307 microversion: 2.1 time: 0.857507 Jul 14 14:52:54.936046 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2344/4729] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:54 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1307 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:55.096611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1629d261-f561-49e4-b98e-d2032549d272 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:55.099531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1629d261-f561-49e4-b98e-d2032549d272 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:55.126748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1629d261-f561-49e4-b98e-d2032549d272 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:55.127184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1629d261-f561-49e4-b98e-d2032549d272 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:55.132998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1629d261-f561-49e4-b98e-d2032549d272 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:55.134562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1629d261-f561-49e4-b98e-d2032549d272 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:55.237535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1629d261-f561-49e4-b98e-d2032549d272 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:55.248519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1629d261-f561-49e4-b98e-d2032549d272 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:55.252857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-1629d261-f561-49e4-b98e-d2032549d272 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lazy-loading 'fault' on Instance uuid c7148982-49b4-4147-b082-63692fd18868 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:55.317091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:55.404005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1629d261-f561-49e4-b98e-d2032549d272 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4082011ea9b4ce2b591f131e0bc50bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ed2d2a9384d7cbe8f1b2e6aea8bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:55.413946 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1629d261-f561-49e4-b98e-d2032549d272 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 200 len: 1313 microversion: 2.1 time: 0.326605 Jul 14 14:52:55.415049 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2386/4730] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:55 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:55.644523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6f980ba-97a7-4574-8ae1-747bad3a9390 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:55.646324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b6f980ba-97a7-4574-8ae1-747bad3a9390 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] [instance: 09efbb61-3d16-41bc-ba5f-cdeab10fd88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:55.656407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6f980ba-97a7-4574-8ae1-747bad3a9390 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:55.659144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6f980ba-97a7-4574-8ae1-747bad3a9390 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:55.661348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6f980ba-97a7-4574-8ae1-747bad3a9390 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:55.663360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6f980ba-97a7-4574-8ae1-747bad3a9390 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:55.701093 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b6f980ba-97a7-4574-8ae1-747bad3a9390 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] HTTP exception thrown: Instance 09efbb61-3d16-41bc-ba5f-cdeab10fd88c could not be found. Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6f980ba-97a7-4574-8ae1-747bad3a9390 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Request method failure captured: Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c HTTP/1.1 Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C2S8JMpZM79wUFxyaI5tGBaHpexxY4qreu2-4WB88rD_3ka8wHE9FfUGtanuciGUf_O84qumZoJm8eQJoyIWS6tqhIzLbTUjkLVCL5KPi1_9bSV2Wxm29O2LskCabTUuiG6EHPp6RfnmoqPrwkixmkwXULGyP9NK9IZPN4P3jBhw6M Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.26 Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1e7e71d44e0447b8a810fcd5d935b7c1 Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerTagsTestJSON-2079544786 Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e7e71d44e0447b8a810fcd5d935b7c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1e7e71d44e0447b8a810fcd5d935b7c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1e7e71d44e0447b8a810fcd5d935b7c1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1e7e71d44e0447b8a810fcd5d935b7c1"}]}] Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerTagsTestJSON-2079544786 Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1e7e71d44e0447b8a810fcd5d935b7c1 Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerTagsTestJSON-2079544786 Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerTagsTestJSON-2079544786-project Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: c21ce7d197ab4e1894b125b230514da1 Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerTagsTestJSON-2079544786-project Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 09efbb61-3d16-41bc-ba5f-cdeab10fd88c could not be found. Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '09efbb61-3d16-41bc-ba5f-cdeab10fd88c'} Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09efbb61-3d16-41bc-ba5f-cdeab10fd88c could not be found. Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09efbb61-3d16-41bc-ba5f-cdeab10fd88c could not be found. Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:55.706990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:55.713851 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:55.713851 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:55.713851 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:55.713851 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:55.713851 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:55.713851 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09efbb61-3d16-41bc-ba5f-cdeab10fd88c could not be found. Jul 14 14:52:55.713851 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:55.716625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6f980ba-97a7-4574-8ae1-747bad3a9390 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] Returning 404 to user: Instance 09efbb61-3d16-41bc-ba5f-cdeab10fd88c could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:55.719835 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b6f980ba-97a7-4574-8ae1-747bad3a9390 tempest-ServerTagsTestJSON-2079544786 tempest-ServerTagsTestJSON-2079544786-project] 10.222.0.81 "GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c" status: 404 len: 111 microversion: 2.26 time: 0.079448 Jul 14 14:52:55.723066 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2345/4731] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:55 2022] GET /compute/v2.1/servers/09efbb61-3d16-41bc-ba5f-cdeab10fd88c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:52:55.958307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-741b583b-a7f8-4c05-b8f9-ddce1e85ce09 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:55.959426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-741b583b-a7f8-4c05-b8f9-ddce1e85ce09 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:55.973207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=12 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:55.978684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-741b583b-a7f8-4c05-b8f9-ddce1e85ce09 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:55.979551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-741b583b-a7f8-4c05-b8f9-ddce1e85ce09 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:55.980359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-741b583b-a7f8-4c05-b8f9-ddce1e85ce09 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:55.980926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-741b583b-a7f8-4c05-b8f9-ddce1e85ce09 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:56.441532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44a1c6b3-7840-4c39-885f-4ae316176ef7 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:56.443283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-44a1c6b3-7840-4c39-885f-4ae316176ef7 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] [instance: c7148982-49b4-4147-b082-63692fd18868] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:56.454327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44a1c6b3-7840-4c39-885f-4ae316176ef7 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:56.456482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44a1c6b3-7840-4c39-885f-4ae316176ef7 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:56.457296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44a1c6b3-7840-4c39-885f-4ae316176ef7 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:56.459099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44a1c6b3-7840-4c39-885f-4ae316176ef7 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:56.499298 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-44a1c6b3-7840-4c39-885f-4ae316176ef7 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] HTTP exception thrown: Instance c7148982-49b4-4147-b082-63692fd18868 could not be found. Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44a1c6b3-7840-4c39-885f-4ae316176ef7 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Request method failure captured: Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 HTTP/1.1 Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C2dTMoHMZWZytrfoPsCWMjy0j7VKJGo2hi0-gyyCP6ezAIjjqbUHMvDLUiAyncZz-xnyRYXgLeHPphxPSedmD4OwpGqEEEIuDigGYsKa5AL0T0ePwq3TC_JUJYiHmA-SG8JrwjAKvzaF-jWNLJAXxaQov-jw5PtbgS7k2WtA8o5NNM Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_850ed2d2a9384d7cbe8f1b2e6aea8bc4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/850ed2d2a9384d7cbe8f1b2e6aea8bc4"}]}] Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 850ed2d2a9384d7cbe8f1b2e6aea8bc4 Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1432251153 Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: c4082011ea9b4ce2b591f131e0bc50bb Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1432251153-project Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance c7148982-49b4-4147-b082-63692fd18868 could not be found. Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'c7148982-49b4-4147-b082-63692fd18868'} Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7148982-49b4-4147-b082-63692fd18868 could not be found. Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7148982-49b4-4147-b082-63692fd18868 could not be found. Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:56.502087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:56.506837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:56.506837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:56.506837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:56.506837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:56.506837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:56.506837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:56.506837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7148982-49b4-4147-b082-63692fd18868 could not be found. Jul 14 14:52:56.506837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:52:56.506837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44a1c6b3-7840-4c39-885f-4ae316176ef7 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] Returning 404 to user: Instance c7148982-49b4-4147-b082-63692fd18868 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:56.506837 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-44a1c6b3-7840-4c39-885f-4ae316176ef7 tempest-ServerMetadataNegativeTestJSON-1432251153 tempest-ServerMetadataNegativeTestJSON-1432251153-project] 10.222.0.81 "GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868" status: 404 len: 111 microversion: 2.1 time: 0.075428 Jul 14 14:52:56.509270 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2346/4732] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:56 2022] GET /compute/v2.1/servers/c7148982-49b4-4147-b082-63692fd18868 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:56.975797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-741b583b-a7f8-4c05-b8f9-ddce1e85ce09 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:56.991700 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-741b583b-a7f8-4c05-b8f9-ddce1e85ce09 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1307 microversion: 2.1 time: 1.043733 Jul 14 14:52:57.010810 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2387/4733] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:55 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1307 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:58.030337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7fb85d66-df15-494b-b77a-034199addeb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:58.030950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7fb85d66-df15-494b-b77a-034199addeb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:58.041754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fb85d66-df15-494b-b77a-034199addeb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:58.047503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fb85d66-df15-494b-b77a-034199addeb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:58.048839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fb85d66-df15-494b-b77a-034199addeb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:58.049502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fb85d66-df15-494b-b77a-034199addeb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:58.645996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7fb85d66-df15-494b-b77a-034199addeb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:58.661651 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7fb85d66-df15-494b-b77a-034199addeb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1307 microversion: 2.1 time: 0.649609 Jul 14 14:52:58.662347 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2347/4734] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:58 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1307 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:59.595191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a6ba0cb9-6a5f-404d-9687-646c14db26d1 req-a3903b61-dd24-4f87-b15a-3e1da5d7e3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2462a80-02b2-406d-9468-28996da82f64", "name": "network-vif-plugged", "status": "completed", "tag": "33451e7f-bd9d-4dd2-9ccb-27a52ac539ce"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:59.625665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a6ba0cb9-6a5f-404d-9687-646c14db26d1 req-a3903b61-dd24-4f87-b15a-3e1da5d7e3a7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:59.628611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a6ba0cb9-6a5f-404d-9687-646c14db26d1 req-a3903b61-dd24-4f87-b15a-3e1da5d7e3a7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:59.668255 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a6ba0cb9-6a5f-404d-9687-646c14db26d1 req-a3903b61-dd24-4f87-b15a-3e1da5d7e3a7 service nova] Creating event network-vif-plugged:33451e7f-bd9d-4dd2-9ccb-27a52ac539ce for instance d2462a80-02b2-406d-9468-28996da82f64 on n-h2-767704-28 Jul 14 14:52:59.679438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b855d48-b93d-4ff4-b0f2-cf6d1022d674 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:59.680725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0b855d48-b93d-4ff4-b0f2-cf6d1022d674 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:59.708813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b855d48-b93d-4ff4-b0f2-cf6d1022d674 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:59.710958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b855d48-b93d-4ff4-b0f2-cf6d1022d674 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:59.711697 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a6ba0cb9-6a5f-404d-9687-646c14db26d1 req-a3903b61-dd24-4f87-b15a-3e1da5d7e3a7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123528 Jul 14 14:52:59.713543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b855d48-b93d-4ff4-b0f2-cf6d1022d674 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:59.717044 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2388/4735] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:52:59.718160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b855d48-b93d-4ff4-b0f2-cf6d1022d674 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:00.671466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0b855d48-b93d-4ff4-b0f2-cf6d1022d674 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:00.680448 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0b855d48-b93d-4ff4-b0f2-cf6d1022d674 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1307 microversion: 2.1 time: 1.005280 Jul 14 14:53:00.689213 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2348/4736] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:59 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1307 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:01.709930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b55c3438-643f-473a-a266-25882c12bba5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:01.721433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b55c3438-643f-473a-a266-25882c12bba5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:01.757337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b55c3438-643f-473a-a266-25882c12bba5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:01.757797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b55c3438-643f-473a-a266-25882c12bba5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:01.758610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b55c3438-643f-473a-a266-25882c12bba5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:01.769329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b55c3438-643f-473a-a266-25882c12bba5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:02.494212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b55c3438-643f-473a-a266-25882c12bba5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:02.513375 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b55c3438-643f-473a-a266-25882c12bba5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1307 microversion: 2.1 time: 0.811406 Jul 14 14:53:02.514712 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2389/4737] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:01 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1307 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:03.537765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e382654b-01a5-446d-afb5-734a5d770058 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:03.539862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e382654b-01a5-446d-afb5-734a5d770058 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:03.554712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e382654b-01a5-446d-afb5-734a5d770058 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:03.559964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e382654b-01a5-446d-afb5-734a5d770058 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:03.562038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e382654b-01a5-446d-afb5-734a5d770058 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:03.563557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e382654b-01a5-446d-afb5-734a5d770058 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:04.626252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e382654b-01a5-446d-afb5-734a5d770058 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:04.634274 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e382654b-01a5-446d-afb5-734a5d770058 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1489 microversion: 2.1 time: 1.107336 Jul 14 14:53:04.639132 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2349/4738] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:03 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1489 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:04.863315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-56002128", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "525f1693-8842-4191-b231-7d2db21bdaf8"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:05.002641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] validate_networks() for [('525f1693-8842-4191-b231-7d2db21bdaf8', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:53:07.181369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:53:07.186127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:53:07.187210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:53:07.188284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:53:07.189137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:53:07.202947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:07.204106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:07.207374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:07.208134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:07.236699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:53:07.243747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for user 4e3af45ec76c4a0b8dd03dcff6802f3c and project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:53:07.265096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:53:07.268111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:53:07.330800 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8d8ebb65-ccc5-47fa-ba6c-0b3d7a9ce741 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.471247 Jul 14 14:53:07.332791 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2390/4739] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:53:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:53:07.344810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-56297028-14c0-4386-80e9-77d593aac30b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:07.346269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-56297028-14c0-4386-80e9-77d593aac30b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:07.458254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-56297028-14c0-4386-80e9-77d593aac30b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:07.471488 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-56297028-14c0-4386-80e9-77d593aac30b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1207 microversion: 2.1 time: 0.132379 Jul 14 14:53:07.473740 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2350/4740] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:07 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1207 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:08.495512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3c0e047b-1be2-4c41-a0ae-049becce2f17 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:08.498017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3c0e047b-1be2-4c41-a0ae-049becce2f17 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:08.528224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c0e047b-1be2-4c41-a0ae-049becce2f17 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:08.529204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c0e047b-1be2-4c41-a0ae-049becce2f17 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:08.530689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c0e047b-1be2-4c41-a0ae-049becce2f17 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:08.531525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c0e047b-1be2-4c41-a0ae-049becce2f17 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:08.693120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3c0e047b-1be2-4c41-a0ae-049becce2f17 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:08.705917 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3c0e047b-1be2-4c41-a0ae-049becce2f17 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1203 microversion: 2.1 time: 0.219607 Jul 14 14:53:08.709079 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2391/4741] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:08 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1203 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:09.725674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0615597c-b1d2-492c-8379-e2d7a0a54f42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:09.726242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0615597c-b1d2-492c-8379-e2d7a0a54f42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:09.736861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0615597c-b1d2-492c-8379-e2d7a0a54f42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:09.741696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0615597c-b1d2-492c-8379-e2d7a0a54f42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:09.742844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0615597c-b1d2-492c-8379-e2d7a0a54f42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:09.743510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0615597c-b1d2-492c-8379-e2d7a0a54f42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:09.909223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0615597c-b1d2-492c-8379-e2d7a0a54f42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:09.920318 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0615597c-b1d2-492c-8379-e2d7a0a54f42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1265 microversion: 2.1 time: 0.198619 Jul 14 14:53:09.923868 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2392/4742] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:09 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:10.234977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-60dbecf1-9775-45fa-bd9f-256f4e28df60 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:10.236181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-60dbecf1-9775-45fa-bd9f-256f4e28df60 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:10.246809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60dbecf1-9775-45fa-bd9f-256f4e28df60 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:10.255660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60dbecf1-9775-45fa-bd9f-256f4e28df60 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:10.256879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60dbecf1-9775-45fa-bd9f-256f4e28df60 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:10.257540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60dbecf1-9775-45fa-bd9f-256f4e28df60 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:10.320309 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-60dbecf1-9775-45fa-bd9f-256f4e28df60 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/ips" status: 200 len: 151 microversion: 2.1 time: 0.644399 Jul 14 14:53:10.320891 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2351/4743] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 14:53:09 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/ips => generated 151 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:10.954174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-81a473c6-10b4-46a8-8b1e-80c17cb77d90 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:10.956321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-81a473c6-10b4-46a8-8b1e-80c17cb77d90 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:10.989931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81a473c6-10b4-46a8-8b1e-80c17cb77d90 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:10.991414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81a473c6-10b4-46a8-8b1e-80c17cb77d90 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:10.994808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81a473c6-10b4-46a8-8b1e-80c17cb77d90 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:10.995320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81a473c6-10b4-46a8-8b1e-80c17cb77d90 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:12.024429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-81a473c6-10b4-46a8-8b1e-80c17cb77d90 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:12.055626 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-81a473c6-10b4-46a8-8b1e-80c17cb77d90 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1307 microversion: 2.1 time: 1.119242 Jul 14 14:53:12.059887 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2393/4744] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:10 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1307 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:12.751779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-7e827eb1-2f5a-46a0-8d16-e8a395972fa8 req-257e5d02-4ba0-44ce-b29e-8a523e45b684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50748a8-6d90-4789-b114-2b6d4d88ce11", "tag": "bf5c9000-9be1-41eb-9bd1-5601d12d7dd3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:12.820499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7e827eb1-2f5a-46a0-8d16-e8a395972fa8 req-257e5d02-4ba0-44ce-b29e-8a523e45b684 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:12.829816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7e827eb1-2f5a-46a0-8d16-e8a395972fa8 req-257e5d02-4ba0-44ce-b29e-8a523e45b684 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:12.893741 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-7e827eb1-2f5a-46a0-8d16-e8a395972fa8 req-257e5d02-4ba0-44ce-b29e-8a523e45b684 service nova] Creating event network-changed:bf5c9000-9be1-41eb-9bd1-5601d12d7dd3 for instance c50748a8-6d90-4789-b114-2b6d4d88ce11 on n-h1-767704-28 Jul 14 14:53:12.925560 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-7e827eb1-2f5a-46a0-8d16-e8a395972fa8 req-257e5d02-4ba0-44ce-b29e-8a523e45b684 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182121 Jul 14 14:53:12.929054 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2352/4745] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:13.083586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8864b2f6-13f6-4ea0-990f-11454708fc82 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:13.084760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8864b2f6-13f6-4ea0-990f-11454708fc82 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:13.125957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8864b2f6-13f6-4ea0-990f-11454708fc82 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:13.127127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8864b2f6-13f6-4ea0-990f-11454708fc82 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:13.132070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8864b2f6-13f6-4ea0-990f-11454708fc82 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:13.132841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8864b2f6-13f6-4ea0-990f-11454708fc82 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:13.298399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-92de1098-2a3e-4792-9f70-ac298a27b0fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31088986-d132-48cd-8e64-2f3f5a1b81c4"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:13.300043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-92de1098-2a3e-4792-9f70-ac298a27b0fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:13.323287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92de1098-2a3e-4792-9f70-ac298a27b0fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:13.327713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92de1098-2a3e-4792-9f70-ac298a27b0fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:13.329664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92de1098-2a3e-4792-9f70-ac298a27b0fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:13.330212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92de1098-2a3e-4792-9f70-ac298a27b0fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:13.827459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8864b2f6-13f6-4ea0-990f-11454708fc82 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:13.835008 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-92de1098-2a3e-4792-9f70-ac298a27b0fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547379 Jul 14 14:53:13.857719 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8864b2f6-13f6-4ea0-990f-11454708fc82 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1307 microversion: 2.1 time: 0.780206 Jul 14 14:53:13.858837 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2353/4746] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:53:13 2022] POST /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments => generated 194 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:13.861706 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2394/4747] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:13 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1307 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:14.667417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c40a56cd-0804-4f0e-b524-60a5225db702 tempest-ComputeTenantNetworksTest-1923140872 tempest-ComputeTenantNetworksTest-1923140872-project] Calling method '.version_select at 0x7fd6cac2eaf0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:14.876465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cf284691-bb08-4454-af4a-2e089c6526a0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:14.877405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cf284691-bb08-4454-af4a-2e089c6526a0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:14.896919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf284691-bb08-4454-af4a-2e089c6526a0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:14.908531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf284691-bb08-4454-af4a-2e089c6526a0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:14.911129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf284691-bb08-4454-af4a-2e089c6526a0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:14.911887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf284691-bb08-4454-af4a-2e089c6526a0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:16.563418 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c40a56cd-0804-4f0e-b524-60a5225db702 tempest-ComputeTenantNetworksTest-1923140872 tempest-ComputeTenantNetworksTest-1923140872-project] 10.222.0.81 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 2.496971 Jul 14 14:53:16.564811 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2354/4748] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 14:53:14 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 2499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:53:16.581722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ada21e23-9724-41c7-b1c9-b19bd9614fe6 tempest-ComputeTenantNetworksTest-1923140872 tempest-ComputeTenantNetworksTest-1923140872-project] Calling method '.version_select at 0x7fd6c5793940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:17.063305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cf284691-bb08-4454-af4a-2e089c6526a0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:17.071245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:17.085148 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cf284691-bb08-4454-af4a-2e089c6526a0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1307 microversion: 2.1 time: 2.212153 Jul 14 14:53:17.087859 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2395/4749] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:14 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1307 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:17.179214 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ada21e23-9724-41c7-b1c9-b19bd9614fe6 tempest-ComputeTenantNetworksTest-1923140872 tempest-ComputeTenantNetworksTest-1923140872-project] 10.222.0.81 "GET /compute/v2.1/os-tenant-networks/508ecc43-f135-4e09-b376-23bacd103652" status: 200 len: 140 microversion: 2.1 time: 0.608260 Jul 14 14:53:17.180417 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2355/4750] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 14:53:16 2022] GET /compute/v2.1/os-tenant-networks/508ecc43-f135-4e09-b376-23bacd103652 => generated 140 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:18.107709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f9a01d5-2220-4d4a-baaf-d7a939857ef8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:18.108527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3f9a01d5-2220-4d4a-baaf-d7a939857ef8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:18.110580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:18.113288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:18.120720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:18.141194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f9a01d5-2220-4d4a-baaf-d7a939857ef8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:18.142925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f9a01d5-2220-4d4a-baaf-d7a939857ef8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:18.145530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f9a01d5-2220-4d4a-baaf-d7a939857ef8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:18.147150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f9a01d5-2220-4d4a-baaf-d7a939857ef8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:18.786295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3f9a01d5-2220-4d4a-baaf-d7a939857ef8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:18.797998 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f9a01d5-2220-4d4a-baaf-d7a939857ef8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1307 microversion: 2.1 time: 0.696596 Jul 14 14:53:18.801674 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2396/4751] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:18 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1307 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:19.819032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:19.825766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:19.826671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:19.863897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:19.872556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:19.875001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:19.875882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:19.876342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:20.280146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:20.305868 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1307 microversion: 2.1 time: 0.477348 Jul 14 14:53:20.306856 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2356/4752] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:19 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1307 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:21.323641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eddf68aa-7c3e-4bf2-90f7-139ca0ce494a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:21.325478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eddf68aa-7c3e-4bf2-90f7-139ca0ce494a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:21.333889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eddf68aa-7c3e-4bf2-90f7-139ca0ce494a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:21.334606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eddf68aa-7c3e-4bf2-90f7-139ca0ce494a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:21.335738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eddf68aa-7c3e-4bf2-90f7-139ca0ce494a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:21.336432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eddf68aa-7c3e-4bf2-90f7-139ca0ce494a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:21.886638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eddf68aa-7c3e-4bf2-90f7-139ca0ce494a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:21.903584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:21.904649 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001426 Jul 14 14:53:21.905755 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2357/4753] 10.222.0.81 () {56 vars in 885 bytes} [Thu Jul 14 14:53:21 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 14 14:53:21.912098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:21.914103 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002420 Jul 14 14:53:21.914767 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2358/4754] 10.222.0.81 () {54 vars in 1034 bytes} [Thu Jul 14 14:53:21 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Jul 14 14:53:21.917622 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eddf68aa-7c3e-4bf2-90f7-139ca0ce494a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1307 microversion: 2.1 time: 0.597695 Jul 14 14:53:21.918679 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2397/4755] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:21 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1307 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:21.921111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:21.922379 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-52066141-5d9d-4ab1-8652-b4cfe1161bfa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001697 Jul 14 14:53:21.923303 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2359/4756] 10.222.0.81 () {54 vars in 1040 bytes} [Thu Jul 14 14:53:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:21.932410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eddf68aa-7c3e-4bf2-90f7-139ca0ce494a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:21.935766 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eddf68aa-7c3e-4bf2-90f7-139ca0ce494a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003541 Jul 14 14:53:21.936614 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2398/4757] 10.222.0.81 () {56 vars in 885 bytes} [Thu Jul 14 14:53:21 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 14 14:53:22.935783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7eff814c-d408-4f16-85b8-8fe466ab8ef4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:22.936538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7eff814c-d408-4f16-85b8-8fe466ab8ef4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:22.942784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-dae8ac93-585f-4ad7-b05b-a13c093c6969 req-97066ff8-19f9-4ca0-ba5e-965ef6b51e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50748a8-6d90-4789-b114-2b6d4d88ce11", "name": "network-vif-plugged", "status": "completed", "tag": "bf5c9000-9be1-41eb-9bd1-5601d12d7dd3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:22.969418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-dae8ac93-585f-4ad7-b05b-a13c093c6969 req-97066ff8-19f9-4ca0-ba5e-965ef6b51e62 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:22.971729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7eff814c-d408-4f16-85b8-8fe466ab8ef4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:22.976419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7eff814c-d408-4f16-85b8-8fe466ab8ef4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:22.982003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-dae8ac93-585f-4ad7-b05b-a13c093c6969 req-97066ff8-19f9-4ca0-ba5e-965ef6b51e62 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:22.983380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7eff814c-d408-4f16-85b8-8fe466ab8ef4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:22.988157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7eff814c-d408-4f16-85b8-8fe466ab8ef4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:23.028699 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-dae8ac93-585f-4ad7-b05b-a13c093c6969 req-97066ff8-19f9-4ca0-ba5e-965ef6b51e62 service nova] Creating event network-vif-plugged:bf5c9000-9be1-41eb-9bd1-5601d12d7dd3 for instance c50748a8-6d90-4789-b114-2b6d4d88ce11 on n-h1-767704-28 Jul 14 14:53:23.047805 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-dae8ac93-585f-4ad7-b05b-a13c093c6969 req-97066ff8-19f9-4ca0-ba5e-965ef6b51e62 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108634 Jul 14 14:53:23.051064 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2399/4758] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:53:23.114410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:24.923857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7eff814c-d408-4f16-85b8-8fe466ab8ef4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:24.937122 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7eff814c-d408-4f16-85b8-8fe466ab8ef4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1307 microversion: 2.1 time: 2.005672 Jul 14 14:53:24.941032 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2360/4759] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:22 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1307 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:25.958781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-38037296-7015-44e9-8dc9-27dd3c8281aa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:25.960536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-38037296-7015-44e9-8dc9-27dd3c8281aa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:25.988801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38037296-7015-44e9-8dc9-27dd3c8281aa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:25.998049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38037296-7015-44e9-8dc9-27dd3c8281aa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:25.999386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38037296-7015-44e9-8dc9-27dd3c8281aa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:26.000130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38037296-7015-44e9-8dc9-27dd3c8281aa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:26.779968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-38037296-7015-44e9-8dc9-27dd3c8281aa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:26.794642 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-38037296-7015-44e9-8dc9-27dd3c8281aa tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1307 microversion: 2.1 time: 0.840806 Jul 14 14:53:26.815487 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2400/4760] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:25 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1307 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:27.821653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-df36b3a2-13d6-4ed1-8013-185117e34c36 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:27.822349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-df36b3a2-13d6-4ed1-8013-185117e34c36 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:27.836822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df36b3a2-13d6-4ed1-8013-185117e34c36 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:27.837372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df36b3a2-13d6-4ed1-8013-185117e34c36 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:27.838179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df36b3a2-13d6-4ed1-8013-185117e34c36 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:27.838580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df36b3a2-13d6-4ed1-8013-185117e34c36 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:28.721365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-df36b3a2-13d6-4ed1-8013-185117e34c36 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:28.739217 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-df36b3a2-13d6-4ed1-8013-185117e34c36 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1488 microversion: 2.1 time: 0.923234 Jul 14 14:53:28.740724 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2361/4761] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:27 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1488 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:28.758652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9aeb9660-83b2-4e9c-bcbe-6cc6e76f19d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:28.759908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9aeb9660-83b2-4e9c-bcbe-6cc6e76f19d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:28.769042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9aeb9660-83b2-4e9c-bcbe-6cc6e76f19d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:28.769811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9aeb9660-83b2-4e9c-bcbe-6cc6e76f19d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:28.770899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9aeb9660-83b2-4e9c-bcbe-6cc6e76f19d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:28.771609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9aeb9660-83b2-4e9c-bcbe-6cc6e76f19d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:29.273308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9aeb9660-83b2-4e9c-bcbe-6cc6e76f19d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:29.287910 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9aeb9660-83b2-4e9c-bcbe-6cc6e76f19d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1489 microversion: 2.1 time: 0.533107 Jul 14 14:53:29.288889 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2401/4762] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:28 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1489 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:29.307446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d44d75f-d869-4d75-86e6-deb6aeffc1a6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:29.310311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8d44d75f-d869-4d75-86e6-deb6aeffc1a6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:29.347036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d44d75f-d869-4d75-86e6-deb6aeffc1a6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:29.350952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d44d75f-d869-4d75-86e6-deb6aeffc1a6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:29.351816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d44d75f-d869-4d75-86e6-deb6aeffc1a6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:29.355723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d44d75f-d869-4d75-86e6-deb6aeffc1a6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:29.802406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1325427791", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:29.889865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] validate_networks() for [('8e3ef6f2-6d20-4870-adea-e8565b643562', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:53:30.114200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8d44d75f-d869-4d75-86e6-deb6aeffc1a6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:30.126935 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8d44d75f-d869-4d75-86e6-deb6aeffc1a6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1488 microversion: 2.1 time: 0.824141 Jul 14 14:53:30.134607 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2362/4763] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:29 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1488 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:30.151274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2eeb1945-08b1-49c2-aa2b-58879b9cc7fe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:30.152096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2eeb1945-08b1-49c2-aa2b-58879b9cc7fe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:30.167179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2eeb1945-08b1-49c2-aa2b-58879b9cc7fe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:30.167614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2eeb1945-08b1-49c2-aa2b-58879b9cc7fe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:30.169506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2eeb1945-08b1-49c2-aa2b-58879b9cc7fe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:30.171141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2eeb1945-08b1-49c2-aa2b-58879b9cc7fe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:30.239835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2eeb1945-08b1-49c2-aa2b-58879b9cc7fe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:53:30.450794 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2eeb1945-08b1-49c2-aa2b-58879b9cc7fe tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 204 len: 0 microversion: 2.1 time: 0.302131 Jul 14 14:53:30.454716 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2363/4764] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:53:30 2022] DELETE /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:53:30.479525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-64137dc4-e3ca-4ff0-937f-a53be2e43525 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:30.489944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-64137dc4-e3ca-4ff0-937f-a53be2e43525 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:30.503267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64137dc4-e3ca-4ff0-937f-a53be2e43525 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:30.505520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64137dc4-e3ca-4ff0-937f-a53be2e43525 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:30.506887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64137dc4-e3ca-4ff0-937f-a53be2e43525 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:30.507748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64137dc4-e3ca-4ff0-937f-a53be2e43525 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:31.534042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-64137dc4-e3ca-4ff0-937f-a53be2e43525 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:31.547646 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-64137dc4-e3ca-4ff0-937f-a53be2e43525 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1494 microversion: 2.1 time: 1.087866 Jul 14 14:53:31.569038 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2364/4765] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:30 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1494 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:32.086566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:53:32.087260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:53:32.087490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:53:32.088177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:53:32.088831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:53:32.112726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:32.114488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:32.115578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:32.116227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:32.176474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Getting quotas for project 889dffd008a54d03845c9de4be5f0e7b. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:53:32.184483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Getting quotas for user 87bf2b5f51d34e8e981e90a05b81f9fa and project 889dffd008a54d03845c9de4be5f0e7b. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:53:32.214659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:53:32.222522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:53:32.290833 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0100a3d0-6609-4794-9e84-edb2cf5e6710 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.784839 Jul 14 14:53:32.291501 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2402/4766] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:53:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:53:32.318011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1e0655d1-9c7e-4a00-b5c2-1d1543f667b9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:32.323033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1e0655d1-9c7e-4a00-b5c2-1d1543f667b9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:32.591216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac596051-5fb7-404b-8237-d7a076421288 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:32.592178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac596051-5fb7-404b-8237-d7a076421288 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:32.618794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac596051-5fb7-404b-8237-d7a076421288 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:32.621084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac596051-5fb7-404b-8237-d7a076421288 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:32.624138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac596051-5fb7-404b-8237-d7a076421288 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:32.626147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac596051-5fb7-404b-8237-d7a076421288 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:32.649386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1e0655d1-9c7e-4a00-b5c2-1d1543f667b9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:32.684365 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1e0655d1-9c7e-4a00-b5c2-1d1543f667b9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1217 microversion: 2.1 time: 0.372187 Jul 14 14:53:32.698539 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2365/4767] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:32 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1217 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:33.336881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5085ab45-ddae-428e-8b71-6a2b6564c11e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31088986-d132-48cd-8e64-2f3f5a1b81c4"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:33.338231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5085ab45-ddae-428e-8b71-6a2b6564c11e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:33.361043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5085ab45-ddae-428e-8b71-6a2b6564c11e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:33.361921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5085ab45-ddae-428e-8b71-6a2b6564c11e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:33.362969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5085ab45-ddae-428e-8b71-6a2b6564c11e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:33.364075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5085ab45-ddae-428e-8b71-6a2b6564c11e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:33.598802 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-5085ab45-ddae-428e-8b71-6a2b6564c11e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Invalid volume: volume 31088986-d132-48cd-8e64-2f3f5a1b81c4 is already attached to instances: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5085ab45-ddae-428e-8b71-6a2b6564c11e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments HTTP/1.1 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 74 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: {"volumeAttachment": {"volumeId": "31088986-d132-48cd-8e64-2f3f5a1b81c4"}} Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid volume: volume 31088986-d132-48cd-8e64-2f3f5a1b81c4 is already attached to instances: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'server_id': 'e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99', 'body': {'volumeAttachment': {'volumeId': '31088986-d132-48cd-8e64-2f3f5a1b81c4'}}} Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 31088986-d132-48cd-8e64-2f3f5a1b81c4 is already attached to instances: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:53:33.600609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 31088986-d132-48cd-8e64-2f3f5a1b81c4 is already attached to instances: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 31088986-d132-48cd-8e64-2f3f5a1b81c4 is already attached to instances: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5085ab45-ddae-428e-8b71-6a2b6564c11e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 400 to user: Invalid volume: volume 31088986-d132-48cd-8e64-2f3f5a1b81c4 is already attached to instances: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5085ab45-ddae-428e-8b71-6a2b6564c11e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.274232 Jul 14 14:53:33.611557 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2366/4768] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:53:33 2022] POST /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments => generated 174 bytes in 279 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:53:33.702915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98a8594a-f671-4b8c-ae97-8b6eb39e3873 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:33.703617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-98a8594a-f671-4b8c-ae97-8b6eb39e3873 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:33.718663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98a8594a-f671-4b8c-ae97-8b6eb39e3873 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:33.719135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98a8594a-f671-4b8c-ae97-8b6eb39e3873 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:33.720041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98a8594a-f671-4b8c-ae97-8b6eb39e3873 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:33.726564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98a8594a-f671-4b8c-ae97-8b6eb39e3873 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:34.346497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-98a8594a-f671-4b8c-ae97-8b6eb39e3873 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:34.367433 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98a8594a-f671-4b8c-ae97-8b6eb39e3873 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1221 microversion: 2.1 time: 0.664162 Jul 14 14:53:34.371065 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2367/4769] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:33 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1221 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:34.385459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f7f46ab5-3e24-41fa-b0f7-0588ad8ade43 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:34.392848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f7f46ab5-3e24-41fa-b0f7-0588ad8ade43 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:34.400919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7f46ab5-3e24-41fa-b0f7-0588ad8ade43 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:34.404974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7f46ab5-3e24-41fa-b0f7-0588ad8ade43 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:34.409987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7f46ab5-3e24-41fa-b0f7-0588ad8ade43 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:34.410913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7f46ab5-3e24-41fa-b0f7-0588ad8ade43 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:34.664166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-f7f46ab5-3e24-41fa-b0f7-0588ad8ade43 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lazy-loading 'services' on Instance uuid e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:53:34.743910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac596051-5fb7-404b-8237-d7a076421288 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:34.767182 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac596051-5fb7-404b-8237-d7a076421288 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1494 microversion: 2.1 time: 2.182347 Jul 14 14:53:34.781503 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2403/4770] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:32 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1494 bytes in 2197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:34.856779 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f7f46ab5-3e24-41fa-b0f7-0588ad8ade43 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments/31088986-d132-48cd-8e64-2f3f5a1b81c4" status: 202 len: 0 microversion: 2.1 time: 0.481003 Jul 14 14:53:34.879424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-371e7e29-18e0-4882-b371-345bbcf1c878 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:34.880933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-371e7e29-18e0-4882-b371-345bbcf1c878 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:34.881874 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2368/4771] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 14:53:34 2022] DELETE /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments/31088986-d132-48cd-8e64-2f3f5a1b81c4 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:53:34.892832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-371e7e29-18e0-4882-b371-345bbcf1c878 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:34.894127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-371e7e29-18e0-4882-b371-345bbcf1c878 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:34.895365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-371e7e29-18e0-4882-b371-345bbcf1c878 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:34.896702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-371e7e29-18e0-4882-b371-345bbcf1c878 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:34.955387 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-371e7e29-18e0-4882-b371-345bbcf1c878 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090759 Jul 14 14:53:34.956770 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2404/4772] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:53:34 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:35.390728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aa6a0966-9ab4-4cd3-87d8-c520a79bf13a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:35.391597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aa6a0966-9ab4-4cd3-87d8-c520a79bf13a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:35.411385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa6a0966-9ab4-4cd3-87d8-c520a79bf13a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:35.412615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa6a0966-9ab4-4cd3-87d8-c520a79bf13a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:35.419136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa6a0966-9ab4-4cd3-87d8-c520a79bf13a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:35.420617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa6a0966-9ab4-4cd3-87d8-c520a79bf13a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:35.787148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d1a4dd9a-6c60-42df-90d6-6f779673b1de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:35.787816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d1a4dd9a-6c60-42df-90d6-6f779673b1de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:35.812477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1a4dd9a-6c60-42df-90d6-6f779673b1de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:35.812980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1a4dd9a-6c60-42df-90d6-6f779673b1de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:35.813779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1a4dd9a-6c60-42df-90d6-6f779673b1de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:35.814228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1a4dd9a-6c60-42df-90d6-6f779673b1de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:35.820355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aa6a0966-9ab4-4cd3-87d8-c520a79bf13a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:35.835637 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aa6a0966-9ab4-4cd3-87d8-c520a79bf13a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1275 microversion: 2.1 time: 0.451361 Jul 14 14:53:35.838401 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2369/4773] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:35 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1275 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:35.969810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a6a24279-f066-4979-b192-bab9b40b9bf3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:35.973152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a6a24279-f066-4979-b192-bab9b40b9bf3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:35.994807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6a24279-f066-4979-b192-bab9b40b9bf3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:35.995767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6a24279-f066-4979-b192-bab9b40b9bf3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:35.997614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6a24279-f066-4979-b192-bab9b40b9bf3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:36.001617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6a24279-f066-4979-b192-bab9b40b9bf3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:36.085044 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a6a24279-f066-4979-b192-bab9b40b9bf3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121173 Jul 14 14:53:36.091016 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2370/4774] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:53:35 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:36.614909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d1a4dd9a-6c60-42df-90d6-6f779673b1de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:36.628457 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d1a4dd9a-6c60-42df-90d6-6f779673b1de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1494 microversion: 2.1 time: 0.847065 Jul 14 14:53:36.633276 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2405/4775] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:35 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1494 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:36.855126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d0b628c2-a42a-4213-b3d2-cbb68512be57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:36.856025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d0b628c2-a42a-4213-b3d2-cbb68512be57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:36.873238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0b628c2-a42a-4213-b3d2-cbb68512be57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:36.874042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0b628c2-a42a-4213-b3d2-cbb68512be57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:36.875896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0b628c2-a42a-4213-b3d2-cbb68512be57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:36.886220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0b628c2-a42a-4213-b3d2-cbb68512be57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:37.044675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d0b628c2-a42a-4213-b3d2-cbb68512be57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:37.107583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-594aff05-c2e0-49af-ab17-5952d5faebd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:37.109589 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d0b628c2-a42a-4213-b3d2-cbb68512be57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1275 microversion: 2.1 time: 0.238055 Jul 14 14:53:37.110910 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2371/4776] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:36 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1275 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:37.112664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-594aff05-c2e0-49af-ab17-5952d5faebd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:37.141137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-594aff05-c2e0-49af-ab17-5952d5faebd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:37.142493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-594aff05-c2e0-49af-ab17-5952d5faebd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:37.144635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-594aff05-c2e0-49af-ab17-5952d5faebd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:37.146323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-594aff05-c2e0-49af-ab17-5952d5faebd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:37.300472 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-594aff05-c2e0-49af-ab17-5952d5faebd5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200689 Jul 14 14:53:37.313298 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2406/4777] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:53:37 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:37.559323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-2fb329b8-a263-4a43-b2d3-0e89d77a961f req-d9a5d763-8ddd-4c40-a94d-bb4635d3a84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50748a8-6d90-4789-b114-2b6d4d88ce11", "name": "network-vif-deleted", "tag": "bf5c9000-9be1-41eb-9bd1-5601d12d7dd3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:37.594006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2fb329b8-a263-4a43-b2d3-0e89d77a961f req-d9a5d763-8ddd-4c40-a94d-bb4635d3a84d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:37.595406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2fb329b8-a263-4a43-b2d3-0e89d77a961f req-d9a5d763-8ddd-4c40-a94d-bb4635d3a84d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:37.623810 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-2fb329b8-a263-4a43-b2d3-0e89d77a961f req-d9a5d763-8ddd-4c40-a94d-bb4635d3a84d service nova] Creating event network-vif-deleted:bf5c9000-9be1-41eb-9bd1-5601d12d7dd3 for instance c50748a8-6d90-4789-b114-2b6d4d88ce11 on n-h1-767704-28 Jul 14 14:53:37.629583 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-2fb329b8-a263-4a43-b2d3-0e89d77a961f req-d9a5d763-8ddd-4c40-a94d-bb4635d3a84d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.391393 Jul 14 14:53:37.631011 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2372/4778] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:53:37.647982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd0023d0-e60b-4a9a-8c01-1c38dd2d5feb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:37.652436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bd0023d0-e60b-4a9a-8c01-1c38dd2d5feb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:37.666914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd0023d0-e60b-4a9a-8c01-1c38dd2d5feb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:37.667819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd0023d0-e60b-4a9a-8c01-1c38dd2d5feb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:37.669290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd0023d0-e60b-4a9a-8c01-1c38dd2d5feb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:37.670005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd0023d0-e60b-4a9a-8c01-1c38dd2d5feb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:37.761367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd0023d0-e60b-4a9a-8c01-1c38dd2d5feb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:37.762646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd0023d0-e60b-4a9a-8c01-1c38dd2d5feb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:37.763243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-bd0023d0-e60b-4a9a-8c01-1c38dd2d5feb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lazy-loading 'fault' on Instance uuid c50748a8-6d90-4789-b114-2b6d4d88ce11 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:53:38.148853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d07b2bcc-6a4f-4d73-a916-789e0bfb7942 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:38.149613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d07b2bcc-6a4f-4d73-a916-789e0bfb7942 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:38.176263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d07b2bcc-6a4f-4d73-a916-789e0bfb7942 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:38.176723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d07b2bcc-6a4f-4d73-a916-789e0bfb7942 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:38.177556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d07b2bcc-6a4f-4d73-a916-789e0bfb7942 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:38.178000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d07b2bcc-6a4f-4d73-a916-789e0bfb7942 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:38.382863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bd0023d0-e60b-4a9a-8c01-1c38dd2d5feb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:38.393885 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bd0023d0-e60b-4a9a-8c01-1c38dd2d5feb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 200 len: 1297 microversion: 2.1 time: 0.749845 Jul 14 14:53:38.396880 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2407/4779] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:37 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 1297 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:38.411552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f4d15bf6-1cb0-4dd8-92a0-2c6b353feb27 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:38.413205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f4d15bf6-1cb0-4dd8-92a0-2c6b353feb27 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:38.433011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4d15bf6-1cb0-4dd8-92a0-2c6b353feb27 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:38.434441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4d15bf6-1cb0-4dd8-92a0-2c6b353feb27 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:38.437162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4d15bf6-1cb0-4dd8-92a0-2c6b353feb27 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:38.440070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4d15bf6-1cb0-4dd8-92a0-2c6b353feb27 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:38.515349 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f4d15bf6-1cb0-4dd8-92a0-2c6b353feb27 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115119 Jul 14 14:53:38.516668 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2408/4780] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:53:38 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:38.863404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d07b2bcc-6a4f-4d73-a916-789e0bfb7942 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:38.880082 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d07b2bcc-6a4f-4d73-a916-789e0bfb7942 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1275 microversion: 2.1 time: 0.742795 Jul 14 14:53:38.892206 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2373/4781] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:38 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1275 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:39.415367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5bbcb8f0-6793-47b2-bc28-73e2f4dedcf5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:39.416444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5bbcb8f0-6793-47b2-bc28-73e2f4dedcf5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:39.429343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5bbcb8f0-6793-47b2-bc28-73e2f4dedcf5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:39.430194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5bbcb8f0-6793-47b2-bc28-73e2f4dedcf5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:39.431277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5bbcb8f0-6793-47b2-bc28-73e2f4dedcf5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:39.433297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5bbcb8f0-6793-47b2-bc28-73e2f4dedcf5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:39.463428 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-5bbcb8f0-6793-47b2-bc28-73e2f4dedcf5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5bbcb8f0-6793-47b2-bc28-73e2f4dedcf5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 HTTP/1.1 Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'c50748a8-6d90-4789-b114-2b6d4d88ce11'} Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:53:39.468028 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:39.476364 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:39.476364 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:39.476364 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:53:39.476364 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:53:39.476364 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:53:39.476364 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:53:39.478724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5bbcb8f0-6793-47b2-bc28-73e2f4dedcf5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:53:39.479848 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5bbcb8f0-6793-47b2-bc28-73e2f4dedcf5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 404 len: 111 microversion: 2.1 time: 0.069809 Jul 14 14:53:39.482091 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2409/4782] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:39 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:53:39.490507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dd5d25c8-3720-4645-aa12-0f11345d8fab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:39.491241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dd5d25c8-3720-4645-aa12-0f11345d8fab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:39.499155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd5d25c8-3720-4645-aa12-0f11345d8fab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:39.499849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd5d25c8-3720-4645-aa12-0f11345d8fab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:39.500884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd5d25c8-3720-4645-aa12-0f11345d8fab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:39.501534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd5d25c8-3720-4645-aa12-0f11345d8fab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:39.529358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7b267700-ac0c-402c-aa2c-57cf28675b67 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:39.530793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7b267700-ac0c-402c-aa2c-57cf28675b67 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:39.536798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dd5d25c8-3720-4645-aa12-0f11345d8fab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:53:39.546563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b267700-ac0c-402c-aa2c-57cf28675b67 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:39.547027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b267700-ac0c-402c-aa2c-57cf28675b67 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:39.548041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b267700-ac0c-402c-aa2c-57cf28675b67 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:39.548496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b267700-ac0c-402c-aa2c-57cf28675b67 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:39.632221 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7b267700-ac0c-402c-aa2c-57cf28675b67 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108737 Jul 14 14:53:39.636721 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2410/4783] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:53:39 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:53:39.638728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:39.699889 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dd5d25c8-3720-4645-aa12-0f11345d8fab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 204 len: 0 microversion: 2.1 time: 0.213102 Jul 14 14:53:39.715345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c3964a64-e931-45ec-8db9-a47a6679fdc3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:39.716208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c3964a64-e931-45ec-8db9-a47a6679fdc3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:39.719861 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2374/4784] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:53:39 2022] DELETE /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:53:39.723937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3964a64-e931-45ec-8db9-a47a6679fdc3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:39.724742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3964a64-e931-45ec-8db9-a47a6679fdc3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:39.725834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3964a64-e931-45ec-8db9-a47a6679fdc3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:39.726574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3964a64-e931-45ec-8db9-a47a6679fdc3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:39.901770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bbf2f81f-187d-4c4d-88bf-06147c6343a1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:39.903988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bbf2f81f-187d-4c4d-88bf-06147c6343a1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:39.922964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bbf2f81f-187d-4c4d-88bf-06147c6343a1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:39.930124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bbf2f81f-187d-4c4d-88bf-06147c6343a1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:39.931013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bbf2f81f-187d-4c4d-88bf-06147c6343a1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:39.931466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bbf2f81f-187d-4c4d-88bf-06147c6343a1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:40.562158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c3964a64-e931-45ec-8db9-a47a6679fdc3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:40.582760 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c3964a64-e931-45ec-8db9-a47a6679fdc3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1495 microversion: 2.1 time: 0.868569 Jul 14 14:53:40.600659 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2411/4785] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:39 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1495 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:40.648353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-84045b45-bcc8-4e56-92a2-736c87afa8dc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:40.650033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-84045b45-bcc8-4e56-92a2-736c87afa8dc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:40.678246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84045b45-bcc8-4e56-92a2-736c87afa8dc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:40.681555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84045b45-bcc8-4e56-92a2-736c87afa8dc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:40.682723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84045b45-bcc8-4e56-92a2-736c87afa8dc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:40.687050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84045b45-bcc8-4e56-92a2-736c87afa8dc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:40.810473 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-84045b45-bcc8-4e56-92a2-736c87afa8dc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166391 Jul 14 14:53:40.825057 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2412/4786] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:53:40 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:40.921986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bbf2f81f-187d-4c4d-88bf-06147c6343a1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:40.936548 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bbf2f81f-187d-4c4d-88bf-06147c6343a1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1317 microversion: 2.1 time: 1.039810 Jul 14 14:53:40.941506 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2375/4787] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:39 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1317 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:41.617836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cb2e0e7a-4abd-4faf-aaa1-79545d804c92 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:41.618770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cb2e0e7a-4abd-4faf-aaa1-79545d804c92 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:41.677805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb2e0e7a-4abd-4faf-aaa1-79545d804c92 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:41.681694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb2e0e7a-4abd-4faf-aaa1-79545d804c92 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:41.686590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb2e0e7a-4abd-4faf-aaa1-79545d804c92 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:41.687259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb2e0e7a-4abd-4faf-aaa1-79545d804c92 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:41.836130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23b90ec3-002f-4a8c-93fd-ea0857d326d5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:41.837783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-23b90ec3-002f-4a8c-93fd-ea0857d326d5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:41.858225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23b90ec3-002f-4a8c-93fd-ea0857d326d5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:41.863242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23b90ec3-002f-4a8c-93fd-ea0857d326d5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:41.868111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23b90ec3-002f-4a8c-93fd-ea0857d326d5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:41.868834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23b90ec3-002f-4a8c-93fd-ea0857d326d5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:42.053139 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-23b90ec3-002f-4a8c-93fd-ea0857d326d5 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.214876 Jul 14 14:53:42.054987 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2376/4788] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:53:41 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:53:42.071071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e4b25426-7a83-4006-8121-c9881122c29b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:42.078290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e4b25426-7a83-4006-8121-c9881122c29b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:42.096021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4b25426-7a83-4006-8121-c9881122c29b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:42.099185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4b25426-7a83-4006-8121-c9881122c29b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:42.104262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4b25426-7a83-4006-8121-c9881122c29b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:42.106987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4b25426-7a83-4006-8121-c9881122c29b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:42.144926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:42.202355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:42.680526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:43.768148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cb2e0e7a-4abd-4faf-aaa1-79545d804c92 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:43.801830 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cb2e0e7a-4abd-4faf-aaa1-79545d804c92 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1495 microversion: 2.1 time: 2.184921 Jul 14 14:53:43.804046 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2413/4789] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:41 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1495 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:43.841149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-04129316-cd56-4911-adf6-6164140e6064 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:43.851564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-04129316-cd56-4911-adf6-6164140e6064 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:43.877568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04129316-cd56-4911-adf6-6164140e6064 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:43.883255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04129316-cd56-4911-adf6-6164140e6064 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:43.889946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04129316-cd56-4911-adf6-6164140e6064 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:43.893495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04129316-cd56-4911-adf6-6164140e6064 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:43.955688 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-04129316-cd56-4911-adf6-6164140e6064 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146960 Jul 14 14:53:43.959514 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2414/4790] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:53:43 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:43.977162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e4b25426-7a83-4006-8121-c9881122c29b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:43.985200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-31836e8a-317a-411a-b6d3-dd4e3dc32745 req-c6518088-0629-43ed-8531-7a646270916a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2462a80-02b2-406d-9468-28996da82f64", "name": "network-vif-unplugged", "status": "completed", "tag": "33451e7f-bd9d-4dd2-9ccb-27a52ac539ce"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:43.992920 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e4b25426-7a83-4006-8121-c9881122c29b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1317 microversion: 2.1 time: 1.936555 Jul 14 14:53:43.997064 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2377/4791] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:42 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1317 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:44.014506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-31836e8a-317a-411a-b6d3-dd4e3dc32745 req-c6518088-0629-43ed-8531-7a646270916a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:44.016262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-31836e8a-317a-411a-b6d3-dd4e3dc32745 req-c6518088-0629-43ed-8531-7a646270916a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:44.044373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:44.052516 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-31836e8a-317a-411a-b6d3-dd4e3dc32745 req-c6518088-0629-43ed-8531-7a646270916a service nova] Creating event network-vif-unplugged:33451e7f-bd9d-4dd2-9ccb-27a52ac539ce for instance d2462a80-02b2-406d-9468-28996da82f64 on n-h2-767704-28 Jul 14 14:53:44.076443 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-31836e8a-317a-411a-b6d3-dd4e3dc32745 req-c6518088-0629-43ed-8531-7a646270916a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115166 Jul 14 14:53:44.077083 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2415/4792] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:44.826933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eec4ef5c-4961-4b98-a6c7-0780d831f4f4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:44.831424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eec4ef5c-4961-4b98-a6c7-0780d831f4f4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:44.846656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ab192c7e-4b25-4067-a535-22c364a1e256 req-d28f81d1-94a7-4851-816b-6e97fba91c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2462a80-02b2-406d-9468-28996da82f64", "name": "network-vif-deleted", "tag": "33451e7f-bd9d-4dd2-9ccb-27a52ac539ce"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:44.859541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eec4ef5c-4961-4b98-a6c7-0780d831f4f4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:44.870217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eec4ef5c-4961-4b98-a6c7-0780d831f4f4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:44.872421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eec4ef5c-4961-4b98-a6c7-0780d831f4f4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:44.884863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eec4ef5c-4961-4b98-a6c7-0780d831f4f4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:44.911317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ab192c7e-4b25-4067-a535-22c364a1e256 req-d28f81d1-94a7-4851-816b-6e97fba91c55 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:44.915130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ab192c7e-4b25-4067-a535-22c364a1e256 req-d28f81d1-94a7-4851-816b-6e97fba91c55 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:44.953314 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ab192c7e-4b25-4067-a535-22c364a1e256 req-d28f81d1-94a7-4851-816b-6e97fba91c55 service nova] Creating event network-vif-deleted:33451e7f-bd9d-4dd2-9ccb-27a52ac539ce for instance d2462a80-02b2-406d-9468-28996da82f64 on n-h2-767704-28 Jul 14 14:53:44.966947 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ab192c7e-4b25-4067-a535-22c364a1e256 req-d28f81d1-94a7-4851-816b-6e97fba91c55 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162578 Jul 14 14:53:44.970892 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2378/4793] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:44.990957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4db9dbb-6f41-44da-adef-d15fd2068c73 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:44.995016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d4db9dbb-6f41-44da-adef-d15fd2068c73 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:45.035751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4db9dbb-6f41-44da-adef-d15fd2068c73 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:45.036621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4db9dbb-6f41-44da-adef-d15fd2068c73 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:45.041172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4db9dbb-6f41-44da-adef-d15fd2068c73 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:45.041860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4db9dbb-6f41-44da-adef-d15fd2068c73 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:45.147227 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d4db9dbb-6f41-44da-adef-d15fd2068c73 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173444 Jul 14 14:53:45.152195 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2379/4794] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:53:44 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:45.177556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf660fcf-6d0e-4f90-99e0-4ecfc56f09a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:45.178563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bf660fcf-6d0e-4f90-99e0-4ecfc56f09a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:45.195891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf660fcf-6d0e-4f90-99e0-4ecfc56f09a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:45.199225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf660fcf-6d0e-4f90-99e0-4ecfc56f09a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:45.201936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf660fcf-6d0e-4f90-99e0-4ecfc56f09a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:45.204345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf660fcf-6d0e-4f90-99e0-4ecfc56f09a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:45.357622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eec4ef5c-4961-4b98-a6c7-0780d831f4f4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:45.379377 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eec4ef5c-4961-4b98-a6c7-0780d831f4f4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 200 len: 1292 microversion: 2.1 time: 0.558838 Jul 14 14:53:45.381599 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2416/4795] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:44 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 1292 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:45.728795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bf660fcf-6d0e-4f90-99e0-4ecfc56f09a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:45.739106 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf660fcf-6d0e-4f90-99e0-4ecfc56f09a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1317 microversion: 2.1 time: 0.578383 Jul 14 14:53:45.743766 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2380/4796] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:45 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:46.170208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a3e8d207-81c1-42ad-9546-0f75a6ecae06 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:46.172577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a3e8d207-81c1-42ad-9546-0f75a6ecae06 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:46.187897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3e8d207-81c1-42ad-9546-0f75a6ecae06 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:46.189062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3e8d207-81c1-42ad-9546-0f75a6ecae06 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:46.190816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3e8d207-81c1-42ad-9546-0f75a6ecae06 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:46.191948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3e8d207-81c1-42ad-9546-0f75a6ecae06 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:46.264703 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a3e8d207-81c1-42ad-9546-0f75a6ecae06 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108367 Jul 14 14:53:46.269864 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2417/4797] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:53:46 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:53:46.360860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a6201e00-47b9-440d-955e-903c9e2ca9f4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:46.361482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a6201e00-47b9-440d-955e-903c9e2ca9f4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:46.369756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6201e00-47b9-440d-955e-903c9e2ca9f4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:46.370201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6201e00-47b9-440d-955e-903c9e2ca9f4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:46.370998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6201e00-47b9-440d-955e-903c9e2ca9f4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:46.371540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6201e00-47b9-440d-955e-903c9e2ca9f4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:46.400107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e17c571f-4856-4b8f-a6fa-a3cd0361a3de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:46.400734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e17c571f-4856-4b8f-a6fa-a3cd0361a3de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:46.410960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e17c571f-4856-4b8f-a6fa-a3cd0361a3de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:46.411476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e17c571f-4856-4b8f-a6fa-a3cd0361a3de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:46.412355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e17c571f-4856-4b8f-a6fa-a3cd0361a3de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:46.413289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e17c571f-4856-4b8f-a6fa-a3cd0361a3de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:46.442910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a6201e00-47b9-440d-955e-903c9e2ca9f4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:53:46.456792 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-e17c571f-4856-4b8f-a6fa-a3cd0361a3de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e17c571f-4856-4b8f-a6fa-a3cd0361a3de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 HTTP/1.1 Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'd2462a80-02b2-406d-9468-28996da82f64'} Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:53:46.458552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:46.464503 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:46.464503 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:46.464503 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:53:46.464503 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:53:46.464503 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:53:46.464503 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:53:46.464503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e17c571f-4856-4b8f-a6fa-a3cd0361a3de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:53:46.464503 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e17c571f-4856-4b8f-a6fa-a3cd0361a3de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 404 len: 111 microversion: 2.1 time: 0.065420 Jul 14 14:53:46.464503 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2418/4798] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:46 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:53:46.593594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1936898134", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "525f1693-8842-4191-b231-7d2db21bdaf8"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:46.597200 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a6201e00-47b9-440d-955e-903c9e2ca9f4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 204 len: 0 microversion: 2.1 time: 0.230551 Jul 14 14:53:46.598130 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2381/4799] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:53:46 2022] DELETE /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:53:46.616470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21b4eb3a-b3a6-495b-8ee2-3fb0140ef452 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:46.619852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-21b4eb3a-b3a6-495b-8ee2-3fb0140ef452 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:46.634030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21b4eb3a-b3a6-495b-8ee2-3fb0140ef452 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:46.634735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21b4eb3a-b3a6-495b-8ee2-3fb0140ef452 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:46.637903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21b4eb3a-b3a6-495b-8ee2-3fb0140ef452 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:46.639482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21b4eb3a-b3a6-495b-8ee2-3fb0140ef452 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:46.662287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] validate_networks() for [('525f1693-8842-4191-b231-7d2db21bdaf8', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:53:47.103441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-21b4eb3a-b3a6-495b-8ee2-3fb0140ef452 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:47.120915 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21b4eb3a-b3a6-495b-8ee2-3fb0140ef452 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1682 microversion: 2.1 time: 0.517912 Jul 14 14:53:47.125154 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2382/4800] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:46 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1682 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:47.134776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bb767f43-26ff-4d79-8f6f-96cf5a97eab3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:47.144130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bb767f43-26ff-4d79-8f6f-96cf5a97eab3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:47.171415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb767f43-26ff-4d79-8f6f-96cf5a97eab3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:47.173977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb767f43-26ff-4d79-8f6f-96cf5a97eab3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:47.180136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb767f43-26ff-4d79-8f6f-96cf5a97eab3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:47.182104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb767f43-26ff-4d79-8f6f-96cf5a97eab3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:47.511583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bb767f43-26ff-4d79-8f6f-96cf5a97eab3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:47.521952 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bb767f43-26ff-4d79-8f6f-96cf5a97eab3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1317 microversion: 2.1 time: 0.393293 Jul 14 14:53:47.525141 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2383/4801] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:47 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:47.538886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-db4c4d84-268b-4f38-87ac-840bf177b6e1 req-fd0dd43d-94fa-4c32-af47-9e63b56bc6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f554d9f-a901-4284-8c0e-d34d0924e67d", "tag": "9af0d9f1-4145-44d0-a287-acb8ff126aa7"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:47.560971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-db4c4d84-268b-4f38-87ac-840bf177b6e1 req-fd0dd43d-94fa-4c32-af47-9e63b56bc6c7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:47.561699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-db4c4d84-268b-4f38-87ac-840bf177b6e1 req-fd0dd43d-94fa-4c32-af47-9e63b56bc6c7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:47.596985 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-db4c4d84-268b-4f38-87ac-840bf177b6e1 req-fd0dd43d-94fa-4c32-af47-9e63b56bc6c7 service nova] Creating event network-changed:9af0d9f1-4145-44d0-a287-acb8ff126aa7 for instance 0f554d9f-a901-4284-8c0e-d34d0924e67d on n-h2-767704-28 Jul 14 14:53:47.607225 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-db4c4d84-268b-4f38-87ac-840bf177b6e1 req-fd0dd43d-94fa-4c32-af47-9e63b56bc6c7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078448 Jul 14 14:53:47.613705 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2384/4802] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:47.651796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:53:47.653876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:53:47.654554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:53:47.655138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:53:47.655974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:53:47.676458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:47.679381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:47.683818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:47.685700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:47.723714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:53:47.730041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for user 4e3af45ec76c4a0b8dd03dcff6802f3c and project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:53:47.746494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:53:47.750277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:53:47.828528 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b3fd89d-7173-448d-a4d6-1a20680f1931 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239571 Jul 14 14:53:47.829885 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2419/4803] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:53:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:53:47.845053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8298141f-9da0-46ee-8c3e-6f0738eee16e tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:47.846806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8298141f-9da0-46ee-8c3e-6f0738eee16e tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:48.024097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8298141f-9da0-46ee-8c3e-6f0738eee16e tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:48.033228 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8298141f-9da0-46ee-8c3e-6f0738eee16e tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1209 microversion: 2.1 time: 0.196925 Jul 14 14:53:48.034106 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2385/4804] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:47 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1209 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:48.143032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a4e9f874-bc0a-44e2-9179-cc9661ab450e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:48.143924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a4e9f874-bc0a-44e2-9179-cc9661ab450e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:48.165966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4e9f874-bc0a-44e2-9179-cc9661ab450e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:48.167715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4e9f874-bc0a-44e2-9179-cc9661ab450e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:48.175512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4e9f874-bc0a-44e2-9179-cc9661ab450e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:48.176101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a4e9f874-bc0a-44e2-9179-cc9661ab450e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:48.724545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-96e1d181-8f8d-4d82-8fae-54e9622d53fc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Action: 'create', calling method: .version_select at 0x7fd6c5b901f0>, body: {"keypair": {"name": "tempest-keypair-634402904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVd/KCWBsMo3ndmPYPmeuvf+M0yoxmyYq4VBA5PlvNWst+SAE8nES9KCfxReXlO1JKCOZue35n6ZIhgIakCaU9wzPJvTmjc2jaEJ58TjPkY+Se2a7//fk8AhYqMZhS07A=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:48.782488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-96e1d181-8f8d-4d82-8fae-54e9622d53fc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Getting quotas for project 696fe3c794f345898ccdfc30555d420d. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:53:48.800710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-96e1d181-8f8d-4d82-8fae-54e9622d53fc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Getting quotas for user b19287c405854751b7ad4846457b5882 and project 696fe3c794f345898ccdfc30555d420d. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:53:48.877654 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-96e1d181-8f8d-4d82-8fae-54e9622d53fc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.514033 Jul 14 14:53:48.881632 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2386/4805] 10.222.0.81 () {62 vars in 1199 bytes} [Thu Jul 14 14:53:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 519 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:53:48.897941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c962ac53-d745-4d07-afc9-2ee017b40cc8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:48.899936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c962ac53-d745-4d07-afc9-2ee017b40cc8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:48.921166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c962ac53-d745-4d07-afc9-2ee017b40cc8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:48.922081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c962ac53-d745-4d07-afc9-2ee017b40cc8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:48.923220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c962ac53-d745-4d07-afc9-2ee017b40cc8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:48.924146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c962ac53-d745-4d07-afc9-2ee017b40cc8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:49.064046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a4e9f874-bc0a-44e2-9179-cc9661ab450e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:49.076633 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a4e9f874-bc0a-44e2-9179-cc9661ab450e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1682 microversion: 2.1 time: 0.938170 Jul 14 14:53:49.094505 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2420/4806] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:48 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1682 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:49.106394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-591409f1-2dab-4909-b897-c9589d872062 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:49.107167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-591409f1-2dab-4909-b897-c9589d872062 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:49.122747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:49.149686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-591409f1-2dab-4909-b897-c9589d872062 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:49.150150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-591409f1-2dab-4909-b897-c9589d872062 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:49.151053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-591409f1-2dab-4909-b897-c9589d872062 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:49.151510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-591409f1-2dab-4909-b897-c9589d872062 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:50.005313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-591409f1-2dab-4909-b897-c9589d872062 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:50.031540 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-591409f1-2dab-4909-b897-c9589d872062 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1205 microversion: 2.1 time: 0.935922 Jul 14 14:53:50.036155 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2421/4807] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:49 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1205 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:50.095523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-91433fb5-9309-4fca-aa6d-358641033d55 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:50.096334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-91433fb5-9309-4fca-aa6d-358641033d55 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:50.118755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91433fb5-9309-4fca-aa6d-358641033d55 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:50.119223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91433fb5-9309-4fca-aa6d-358641033d55 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:50.120470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91433fb5-9309-4fca-aa6d-358641033d55 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:50.122002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-91433fb5-9309-4fca-aa6d-358641033d55 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:50.735008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-91433fb5-9309-4fca-aa6d-358641033d55 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:50.746150 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-91433fb5-9309-4fca-aa6d-358641033d55 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1682 microversion: 2.1 time: 0.655793 Jul 14 14:53:50.751098 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2422/4808] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:50 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1682 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:51.038178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c962ac53-d745-4d07-afc9-2ee017b40cc8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:51.056046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-09cfe446-0415-446a-8940-ce583a423b86 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:51.056680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-09cfe446-0415-446a-8940-ce583a423b86 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:51.062255 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c962ac53-d745-4d07-afc9-2ee017b40cc8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1317 microversion: 2.1 time: 2.179127 Jul 14 14:53:51.062873 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2387/4809] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:48 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1317 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:51.075946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09cfe446-0415-446a-8940-ce583a423b86 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:51.076705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09cfe446-0415-446a-8940-ce583a423b86 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:51.078073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09cfe446-0415-446a-8940-ce583a423b86 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:51.078847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09cfe446-0415-446a-8940-ce583a423b86 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:51.765516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be672682-56d8-4419-a958-8140c45e505b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:51.766493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-be672682-56d8-4419-a958-8140c45e505b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:51.773205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:51.803102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be672682-56d8-4419-a958-8140c45e505b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:51.805384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be672682-56d8-4419-a958-8140c45e505b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:51.808272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be672682-56d8-4419-a958-8140c45e505b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:51.810966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be672682-56d8-4419-a958-8140c45e505b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:51.818543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-09cfe446-0415-446a-8940-ce583a423b86 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:51.843681 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-09cfe446-0415-446a-8940-ce583a423b86 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1267 microversion: 2.1 time: 0.791104 Jul 14 14:53:51.844929 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2423/4810] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:51 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1267 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:52.080147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b77a00a3-d7c0-439e-802d-d9014c0a2f57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:52.081561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b77a00a3-d7c0-439e-802d-d9014c0a2f57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:52.094044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b77a00a3-d7c0-439e-802d-d9014c0a2f57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:52.099503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b77a00a3-d7c0-439e-802d-d9014c0a2f57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:52.100361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b77a00a3-d7c0-439e-802d-d9014c0a2f57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:52.100834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b77a00a3-d7c0-439e-802d-d9014c0a2f57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:52.791995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-be672682-56d8-4419-a958-8140c45e505b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:52.807142 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-be672682-56d8-4419-a958-8140c45e505b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1682 microversion: 2.1 time: 1.047517 Jul 14 14:53:52.821081 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2388/4811] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:51 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1682 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:52.862466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bd0797cf-650c-4c11-adae-e8124da6e13a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:52.863369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bd0797cf-650c-4c11-adae-e8124da6e13a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:52.875915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd0797cf-650c-4c11-adae-e8124da6e13a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:52.876786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd0797cf-650c-4c11-adae-e8124da6e13a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:52.878308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd0797cf-650c-4c11-adae-e8124da6e13a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:52.879149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd0797cf-650c-4c11-adae-e8124da6e13a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:52.976022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b77a00a3-d7c0-439e-802d-d9014c0a2f57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:53.009285 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b77a00a3-d7c0-439e-802d-d9014c0a2f57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1317 microversion: 2.1 time: 0.933194 Jul 14 14:53:53.016196 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2424/4812] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:52 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1317 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:53.071258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bd0797cf-650c-4c11-adae-e8124da6e13a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:53.087749 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bd0797cf-650c-4c11-adae-e8124da6e13a tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1267 microversion: 2.1 time: 0.229638 Jul 14 14:53:53.101800 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2389/4813] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:52 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:53.651974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9a9290a7-a027-4ec7-9996-023cd438d81f req-ab92cdd9-d2ed-437b-8faf-f25f3adbc4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99", "name": "network-vif-deleted", "tag": "ac272c7e-fc83-4f7e-82e5-9206b48aeaeb"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:53.662363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9a9290a7-a027-4ec7-9996-023cd438d81f req-ab92cdd9-d2ed-437b-8faf-f25f3adbc4ba service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:53.677385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9a9290a7-a027-4ec7-9996-023cd438d81f req-ab92cdd9-d2ed-437b-8faf-f25f3adbc4ba service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:53.697757 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9a9290a7-a027-4ec7-9996-023cd438d81f req-ab92cdd9-d2ed-437b-8faf-f25f3adbc4ba service nova] Creating event network-vif-deleted:ac272c7e-fc83-4f7e-82e5-9206b48aeaeb for instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 on n-h1-767704-28 Jul 14 14:53:53.711952 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9a9290a7-a027-4ec7-9996-023cd438d81f req-ab92cdd9-d2ed-437b-8faf-f25f3adbc4ba service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058238 Jul 14 14:53:53.714119 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2425/4814] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:53.829646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a4667c18-51c2-43b5-bad2-5840c87a7c79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:53.830868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a4667c18-51c2-43b5-bad2-5840c87a7c79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:53.845536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4667c18-51c2-43b5-bad2-5840c87a7c79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:53.846031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4667c18-51c2-43b5-bad2-5840c87a7c79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:53.848495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4667c18-51c2-43b5-bad2-5840c87a7c79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:53.849063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4667c18-51c2-43b5-bad2-5840c87a7c79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:53.957462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4667c18-51c2-43b5-bad2-5840c87a7c79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:53.958191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4667c18-51c2-43b5-bad2-5840c87a7c79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:53.966950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-a4667c18-51c2-43b5-bad2-5840c87a7c79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lazy-loading 'fault' on Instance uuid e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:53:54.032981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-12ae031d-c330-491e-81e7-11aefb407569 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:54.033709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-12ae031d-c330-491e-81e7-11aefb407569 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:54.051639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-12ae031d-c330-491e-81e7-11aefb407569 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:54.056805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-12ae031d-c330-491e-81e7-11aefb407569 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:54.057920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-12ae031d-c330-491e-81e7-11aefb407569 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:54.070530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-12ae031d-c330-491e-81e7-11aefb407569 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:54.119311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a4667c18-51c2-43b5-bad2-5840c87a7c79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:54.140713 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a4667c18-51c2-43b5-bad2-5840c87a7c79 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 200 len: 1331 microversion: 2.1 time: 0.314789 Jul 14 14:53:54.142189 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2390/4815] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:53 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 1331 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:54.154651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-860f7f32-eb8d-484b-a964-4db197838bb3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:54.155589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-860f7f32-eb8d-484b-a964-4db197838bb3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:54.168671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-860f7f32-eb8d-484b-a964-4db197838bb3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:54.169538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-860f7f32-eb8d-484b-a964-4db197838bb3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:54.170618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-860f7f32-eb8d-484b-a964-4db197838bb3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:54.171258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-860f7f32-eb8d-484b-a964-4db197838bb3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:54.676818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-860f7f32-eb8d-484b-a964-4db197838bb3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:54.692505 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-860f7f32-eb8d-484b-a964-4db197838bb3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1309 microversion: 2.1 time: 0.548804 Jul 14 14:53:54.693781 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2391/4816] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:54 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1309 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:54.720436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-12ae031d-c330-491e-81e7-11aefb407569 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:54.734456 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-12ae031d-c330-491e-81e7-11aefb407569 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1317 microversion: 2.1 time: 0.706341 Jul 14 14:53:54.735702 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2426/4817] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:54 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:55.158405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0ed1493c-ac45-49e1-b9df-162a4a256e75 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:55.159035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0ed1493c-ac45-49e1-b9df-162a4a256e75 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:55.177963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ed1493c-ac45-49e1-b9df-162a4a256e75 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:55.178872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ed1493c-ac45-49e1-b9df-162a4a256e75 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:55.182250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ed1493c-ac45-49e1-b9df-162a4a256e75 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:55.184980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ed1493c-ac45-49e1-b9df-162a4a256e75 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:55.219151 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-0ed1493c-ac45-49e1-b9df-162a4a256e75 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0ed1493c-ac45-49e1-b9df-162a4a256e75 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 HTTP/1.1 Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99'} Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:55.225877 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:53:55.232467 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:55.232467 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:55.232467 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:55.232467 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:53:55.232467 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:53:55.232467 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:53:55.232467 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:53:55.235886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0ed1493c-ac45-49e1-b9df-162a4a256e75 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 404 to user: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:53:55.238604 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0ed1493c-ac45-49e1-b9df-162a4a256e75 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 404 len: 111 microversion: 2.1 time: 0.084165 Jul 14 14:53:55.239418 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2392/4818] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:55 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:53:55.248644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a763e88-4e4a-411e-a496-abc80a864b0c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '.version_select at 0x7fd6c5a67940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:55.292564 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3a763e88-4e4a-411e-a496-abc80a864b0c tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126205305" status: 202 len: 0 microversion: 2.1 time: 0.048105 Jul 14 14:53:55.294206 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2427/4819] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 14:53:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126205305 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:53:55.721265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-135b90a7-bd67-486d-ae4e-04b05b31cd84 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:55.721903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-135b90a7-bd67-486d-ae4e-04b05b31cd84 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:55.735661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-135b90a7-bd67-486d-ae4e-04b05b31cd84 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:55.736127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-135b90a7-bd67-486d-ae4e-04b05b31cd84 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:55.740468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-135b90a7-bd67-486d-ae4e-04b05b31cd84 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:55.740956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-135b90a7-bd67-486d-ae4e-04b05b31cd84 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:55.753784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-785ce4fd-ad18-4abf-a1a6-0669f822dc9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:55.754407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-785ce4fd-ad18-4abf-a1a6-0669f822dc9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:55.757131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:55.780442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-785ce4fd-ad18-4abf-a1a6-0669f822dc9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:55.780901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-785ce4fd-ad18-4abf-a1a6-0669f822dc9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:55.800468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-785ce4fd-ad18-4abf-a1a6-0669f822dc9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:55.801116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-785ce4fd-ad18-4abf-a1a6-0669f822dc9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:56.377401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-785ce4fd-ad18-4abf-a1a6-0669f822dc9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:56.394443 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-785ce4fd-ad18-4abf-a1a6-0669f822dc9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1317 microversion: 2.1 time: 0.645618 Jul 14 14:53:56.395051 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2428/4820] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:55 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1317 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:56.400043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3d6df282-6dab-4e4f-8d78-29fed1369dd3 req-bf7a8f96-bbbe-4776-aede-894d31296000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f554d9f-a901-4284-8c0e-d34d0924e67d", "name": "network-vif-plugged", "status": "completed", "tag": "9af0d9f1-4145-44d0-a287-acb8ff126aa7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:56.411492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3d6df282-6dab-4e4f-8d78-29fed1369dd3 req-bf7a8f96-bbbe-4776-aede-894d31296000 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:56.412271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3d6df282-6dab-4e4f-8d78-29fed1369dd3 req-bf7a8f96-bbbe-4776-aede-894d31296000 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:56.430164 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3d6df282-6dab-4e4f-8d78-29fed1369dd3 req-bf7a8f96-bbbe-4776-aede-894d31296000 service nova] Creating event network-vif-plugged:9af0d9f1-4145-44d0-a287-acb8ff126aa7 for instance 0f554d9f-a901-4284-8c0e-d34d0924e67d on n-h2-767704-28 Jul 14 14:53:56.439449 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3d6df282-6dab-4e4f-8d78-29fed1369dd3 req-bf7a8f96-bbbe-4776-aede-894d31296000 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042832 Jul 14 14:53:56.441439 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2429/4821] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:56.538144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-135b90a7-bd67-486d-ae4e-04b05b31cd84 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:56.577168 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-135b90a7-bd67-486d-ae4e-04b05b31cd84 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1309 microversion: 2.1 time: 0.863825 Jul 14 14:53:56.587156 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2393/4822] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:55 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1309 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:56.732915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-682807287", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "993a5803-cc68-44ca-9776-148e10fa1f91"}], "security_groups": [{"name": "tempest-securitygroup--1553283444"}], "key_name": "tempest-keypair-634402904", "user_data": "}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:57.351021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] validate_networks() for [('993a5803-cc68-44ca-9776-148e10fa1f91', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:53:57.417439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e8825528-266f-4e4e-a931-8f70af469e86 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:57.418839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e8825528-266f-4e4e-a931-8f70af469e86 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:57.435182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8825528-266f-4e4e-a931-8f70af469e86 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:57.435915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8825528-266f-4e4e-a931-8f70af469e86 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:57.437224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8825528-266f-4e4e-a931-8f70af469e86 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:57.437841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8825528-266f-4e4e-a931-8f70af469e86 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:57.710107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:57.740377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:58.045006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e8825528-266f-4e4e-a931-8f70af469e86 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:58.063495 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e8825528-266f-4e4e-a931-8f70af469e86 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1317 microversion: 2.1 time: 0.655770 Jul 14 14:53:58.064380 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2394/4823] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:57 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:58.081527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d319e3d-379b-476c-aeab-eb74a9e8c276 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: .version_select at 0x7fd6c5e7e790>, body: {"keypair": {"name": "tempest-keypair-652063530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhgzWQwRqOxrktw02Ykxpt7q4POnCtwbTwKw06Tg9ghcytqcbTWbG2K6jB/nFvciW0Nb90rwAfA+A6RwPl/sTLJwkHpRyXESHDcMPquwwTXrif/M9PbIi19QS2xnu0SOQ=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:58.106880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-8d319e3d-379b-476c-aeab-eb74a9e8c276 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:53:58.112853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-8d319e3d-379b-476c-aeab-eb74a9e8c276 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for user 9260cbc32f1e423ab8ea4d06058b4050 and project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:53:58.168137 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8d319e3d-379b-476c-aeab-eb74a9e8c276 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.101959 Jul 14 14:53:58.171958 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2395/4824] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:53:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:58.180056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d954ae8-0643-428f-b9d0-ab6fdee25d28 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:58.181886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d954ae8-0643-428f-b9d0-ab6fdee25d28 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:58.199657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d954ae8-0643-428f-b9d0-ab6fdee25d28 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:58.200631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d954ae8-0643-428f-b9d0-ab6fdee25d28 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:58.201827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d954ae8-0643-428f-b9d0-ab6fdee25d28 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:58.202509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d954ae8-0643-428f-b9d0-ab6fdee25d28 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:58.584735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7d954ae8-0643-428f-b9d0-ab6fdee25d28 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:58.599444 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d954ae8-0643-428f-b9d0-ab6fdee25d28 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1309 microversion: 2.1 time: 0.423879 Jul 14 14:53:58.610494 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2396/4825] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:58 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:58.616876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-34638470-0699-48e2-9c18-e297d68ab768 req-9ede8885-158e-432d-8d59-0966a9dde407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab8280b-6dcc-4928-b155-d85479522d01", "tag": "f9299e46-ac94-4a39-9ba8-99b4a9fd83a4"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:58.627591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-34638470-0699-48e2-9c18-e297d68ab768 req-9ede8885-158e-432d-8d59-0966a9dde407 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:58.628269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-34638470-0699-48e2-9c18-e297d68ab768 req-9ede8885-158e-432d-8d59-0966a9dde407 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:58.642465 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-34638470-0699-48e2-9c18-e297d68ab768 req-9ede8885-158e-432d-8d59-0966a9dde407 service nova] Creating event network-changed:f9299e46-ac94-4a39-9ba8-99b4a9fd83a4 for instance fab8280b-6dcc-4928-b155-d85479522d01 on n-h1-767704-28 Jul 14 14:53:58.648316 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-34638470-0699-48e2-9c18-e297d68ab768 req-9ede8885-158e-432d-8d59-0966a9dde407 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036174 Jul 14 14:53:58.650106 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2397/4826] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:58.893675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cd654f95-a347-49e1-b235-e90a670fb2ca tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Action: 'create', calling method: .version_select at 0x7fd6c5e7e790>, body: {"keypair": {"name": "tempest-TestServerBasicOps-583928654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtOKpD8QaBgBgktDpl4JNo1dggraUG6ptWSdgcwpDgMhiqP908mjiaixPtqEAnwzHn2NFqcqDYEa/32ZC/TFT+4GfzgaNmMPlvsAyF3DtJ2VrBaqem2zDEh89Lgh6fbxQ=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:58.930707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-cd654f95-a347-49e1-b235-e90a670fb2ca tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Getting quotas for project f7cf2566982e41979f539ed762164b41. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:53:58.945931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-cd654f95-a347-49e1-b235-e90a670fb2ca tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Getting quotas for user b09a2b13c80f44e288b7d5d15eb6aa9a and project f7cf2566982e41979f539ed762164b41. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:53:58.999131 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cd654f95-a347-49e1-b235-e90a670fb2ca tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.342979 Jul 14 14:53:59.001815 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2398/4827] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:53:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:59.081550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c2bd9a0d-b5b6-4c2f-b5f7-3d06bd72b572 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:59.082950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c2bd9a0d-b5b6-4c2f-b5f7-3d06bd72b572 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:59.101038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2bd9a0d-b5b6-4c2f-b5f7-3d06bd72b572 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:59.101787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2bd9a0d-b5b6-4c2f-b5f7-3d06bd72b572 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:59.102780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2bd9a0d-b5b6-4c2f-b5f7-3d06bd72b572 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:59.105476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:53:59.106548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:53:59.107115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:53:59.107488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2bd9a0d-b5b6-4c2f-b5f7-3d06bd72b572 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:59.107628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:53:59.108109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:53:59.147766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:59.148646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:59.149591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:59.150343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:59.173813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Getting quotas for project 696fe3c794f345898ccdfc30555d420d. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:53:59.180513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Getting quotas for user b19287c405854751b7ad4846457b5882 and project 696fe3c794f345898ccdfc30555d420d. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:53:59.195417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:53:59.198175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:53:59.295839 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1052da18-d09b-45e0-893a-d4ae72e395bd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.567496 Jul 14 14:53:59.297973 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2430/4828] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:53:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 14 14:53:59.310940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c96059ce-51bc-4f06-af81-f953293349d8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:59.311573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c96059ce-51bc-4f06-af81-f953293349d8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:59.445824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c96059ce-51bc-4f06-af81-f953293349d8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:59.463679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c96059ce-51bc-4f06-af81-f953293349d8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:59.466050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c96059ce-51bc-4f06-af81-f953293349d8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:59.467793 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c96059ce-51bc-4f06-af81-f953293349d8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1280 microversion: 2.20 time: 0.162264 Jul 14 14:53:59.468507 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2431/4829] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:59 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:53:59.483739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c2bd9a0d-b5b6-4c2f-b5f7-3d06bd72b572 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:59.498184 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c2bd9a0d-b5b6-4c2f-b5f7-3d06bd72b572 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.419711 Jul 14 14:53:59.520854 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2399/4830] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:59 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:59.620503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-466af8b7-2845-43fb-bdbc-0f703afa4428 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:59.634463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-466af8b7-2845-43fb-bdbc-0f703afa4428 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:59.672147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-466af8b7-2845-43fb-bdbc-0f703afa4428 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:59.672704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-466af8b7-2845-43fb-bdbc-0f703afa4428 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:59.673716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-466af8b7-2845-43fb-bdbc-0f703afa4428 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:59.674389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-466af8b7-2845-43fb-bdbc-0f703afa4428 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:59.741299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1322689256", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:59.893600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] validate_networks() for [('8e3ef6f2-6d20-4870-adea-e8565b643562', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:54:00.372731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-466af8b7-2845-43fb-bdbc-0f703afa4428 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:00.386681 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-466af8b7-2845-43fb-bdbc-0f703afa4428 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1309 microversion: 2.1 time: 0.771847 Jul 14 14:54:00.388619 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2432/4831] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:59 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1309 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:00.489464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8990885f-0a03-4ce5-b847-c8765d98927e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:00.490098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8990885f-0a03-4ce5-b847-c8765d98927e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:00.499911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8990885f-0a03-4ce5-b847-c8765d98927e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:00.500375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8990885f-0a03-4ce5-b847-c8765d98927e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:00.501207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8990885f-0a03-4ce5-b847-c8765d98927e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:00.501665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8990885f-0a03-4ce5-b847-c8765d98927e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:00.742626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8990885f-0a03-4ce5-b847-c8765d98927e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:00.756326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8990885f-0a03-4ce5-b847-c8765d98927e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:00.757918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8990885f-0a03-4ce5-b847-c8765d98927e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:00.759082 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8990885f-0a03-4ce5-b847-c8765d98927e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1276 microversion: 2.20 time: 0.274933 Jul 14 14:54:00.768215 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2433/4832] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:00 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1276 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:01.406309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-130b20c5-2d23-4670-999b-e9a5414b5bec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:01.407002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-130b20c5-2d23-4670-999b-e9a5414b5bec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:01.425331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-130b20c5-2d23-4670-999b-e9a5414b5bec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:01.425809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-130b20c5-2d23-4670-999b-e9a5414b5bec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:01.426636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-130b20c5-2d23-4670-999b-e9a5414b5bec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:01.427094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-130b20c5-2d23-4670-999b-e9a5414b5bec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:02.687765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-130b20c5-2d23-4670-999b-e9a5414b5bec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:02.703647 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-130b20c5-2d23-4670-999b-e9a5414b5bec tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1309 microversion: 2.1 time: 1.298388 Jul 14 14:54:02.707465 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2434/4833] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:01 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1309 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:02.719008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8b6b4d09-8276-4c73-b7a6-f990aee98f11 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:02.722041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8b6b4d09-8276-4c73-b7a6-f990aee98f11 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:02.738229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8b6b4d09-8276-4c73-b7a6-f990aee98f11 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:02.738993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8b6b4d09-8276-4c73-b7a6-f990aee98f11 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:02.741962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8b6b4d09-8276-4c73-b7a6-f990aee98f11 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:02.744346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8b6b4d09-8276-4c73-b7a6-f990aee98f11 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:02.983311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8b6b4d09-8276-4c73-b7a6-f990aee98f11 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:03.000548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8b6b4d09-8276-4c73-b7a6-f990aee98f11 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:03.005718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8b6b4d09-8276-4c73-b7a6-f990aee98f11 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:03.010099 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8b6b4d09-8276-4c73-b7a6-f990aee98f11 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1338 microversion: 2.20 time: 0.300303 Jul 14 14:54:03.012806 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2435/4834] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:02 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1338 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:03.351572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1616024502", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-583928654", "security_groups": [{"name": "tempest-secgroup-smoke-1555555024"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "73350e7d-28a0-430a-b53f-cc2b2d626271"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:03.547875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:54:03.549609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:54:03.550365 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:54:03.551286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:54:03.551963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:54:03.569576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:03.570358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:03.572301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:03.573151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:03.605707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Getting quotas for project 889dffd008a54d03845c9de4be5f0e7b. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:03.613348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Getting quotas for user 87bf2b5f51d34e8e981e90a05b81f9fa and project 889dffd008a54d03845c9de4be5f0e7b. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:03.631953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:54:03.635022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:54:03.663274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] validate_networks() for [('73350e7d-28a0-430a-b53f-cc2b2d626271', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:54:03.708644 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8c872b45-1e93-47b9-ad52-ee5b49bbf4e3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.985230 Jul 14 14:54:03.709362 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2400/4835] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:54:03.724720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e53f3084-405a-4f98-9b8d-313633bd2386 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:03.725404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e53f3084-405a-4f98-9b8d-313633bd2386 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:03.898855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e53f3084-405a-4f98-9b8d-313633bd2386 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:03.911583 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e53f3084-405a-4f98-9b8d-313633bd2386 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1217 microversion: 2.1 time: 0.196128 Jul 14 14:54:03.912198 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2401/4836] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:03 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:03.916909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7115f299-8d68-424b-8d37-97c10234ead6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:03.929896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7115f299-8d68-424b-8d37-97c10234ead6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:03.947005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7115f299-8d68-424b-8d37-97c10234ead6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:03.947473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7115f299-8d68-424b-8d37-97c10234ead6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:03.948283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7115f299-8d68-424b-8d37-97c10234ead6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:03.948988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7115f299-8d68-424b-8d37-97c10234ead6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:04.626956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7115f299-8d68-424b-8d37-97c10234ead6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:04.636687 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7115f299-8d68-424b-8d37-97c10234ead6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1309 microversion: 2.1 time: 0.723387 Jul 14 14:54:04.643126 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2402/4837] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:03 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1309 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:04.648828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2090649808", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19a7ef92-3b71-4a1b-b101-91e7276e71cb"}], "security_groups": [{"name": "tempest-securitygroup--1358264781"}], "key_name": "tempest-keypair-652063530", "user_data": "}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:04.899565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] validate_networks() for [('19a7ef92-3b71-4a1b-b101-91e7276e71cb', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:54:05.737392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Getting quotas for project f7cf2566982e41979f539ed762164b41. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:05.765346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Getting quotas for user b09a2b13c80f44e288b7d5d15eb6aa9a and project f7cf2566982e41979f539ed762164b41. Resources: dict_keys(['metadata_items']) {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:05.804138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:54:05.805864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:54:05.806509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:54:05.808346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:54:05.810599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:54:05.837760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:05.841032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:05.846691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:05.847173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:05.905781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Getting quotas for project f7cf2566982e41979f539ed762164b41. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:05.920913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Getting quotas for user b09a2b13c80f44e288b7d5d15eb6aa9a and project f7cf2566982e41979f539ed762164b41. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:05.956088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:54:05.958362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:54:06.076315 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ef65a350-c17e-4f19-8012-1d8a2460d62e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.729795 Jul 14 14:54:06.081422 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2436/4838] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 2734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:54:06.097475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d279c4f6-02b5-4aaf-82b2-79e46381a85c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:06.097475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d279c4f6-02b5-4aaf-82b2-79e46381a85c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:06.116893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d279c4f6-02b5-4aaf-82b2-79e46381a85c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:06.120253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d279c4f6-02b5-4aaf-82b2-79e46381a85c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:06.121934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d279c4f6-02b5-4aaf-82b2-79e46381a85c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:06.124217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d279c4f6-02b5-4aaf-82b2-79e46381a85c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:07.481814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d279c4f6-02b5-4aaf-82b2-79e46381a85c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:07.496184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d279c4f6-02b5-4aaf-82b2-79e46381a85c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:07.501522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d279c4f6-02b5-4aaf-82b2-79e46381a85c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:07.508057 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d279c4f6-02b5-4aaf-82b2-79e46381a85c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1406 microversion: 2.20 time: 1.422459 Jul 14 14:54:07.513077 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2437/4839] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:06 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1406 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:07.544519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9b25082c-3038-444c-a27d-7e51d3a67f41 req-4ed3cefa-1120-4c08-8145-b9bcd65562de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab8280b-6dcc-4928-b155-d85479522d01", "name": "network-vif-plugged", "status": "completed", "tag": "f9299e46-ac94-4a39-9ba8-99b4a9fd83a4"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:07.574856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9b25082c-3038-444c-a27d-7e51d3a67f41 req-4ed3cefa-1120-4c08-8145-b9bcd65562de service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.575613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9b25082c-3038-444c-a27d-7e51d3a67f41 req-4ed3cefa-1120-4c08-8145-b9bcd65562de service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:07.598865 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9b25082c-3038-444c-a27d-7e51d3a67f41 req-4ed3cefa-1120-4c08-8145-b9bcd65562de service nova] Creating event network-vif-plugged:f9299e46-ac94-4a39-9ba8-99b4a9fd83a4 for instance fab8280b-6dcc-4928-b155-d85479522d01 on n-h1-767704-28 Jul 14 14:54:07.614104 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9b25082c-3038-444c-a27d-7e51d3a67f41 req-4ed3cefa-1120-4c08-8145-b9bcd65562de service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097303 Jul 14 14:54:07.625209 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2438/4840] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:07.631195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4ba95903-7ec9-4dc1-a40c-461660e3cb9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:07.632194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4ba95903-7ec9-4dc1-a40c-461660e3cb9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:07.641838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ba95903-7ec9-4dc1-a40c-461660e3cb9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.642285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ba95903-7ec9-4dc1-a40c-461660e3cb9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:07.643250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ba95903-7ec9-4dc1-a40c-461660e3cb9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.643687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ba95903-7ec9-4dc1-a40c-461660e3cb9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:07.648677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:07.730848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:54:07.732350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:54:07.733178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:54:07.733598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:54:07.734027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:54:07.760895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.761599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:07.763587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.764244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:07.793479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:07.800133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Getting quotas for user 9260cbc32f1e423ab8ea4d06058b4050 and project 53c2a638aab846d39d0a225ac6cc69d2. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:07.808063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4ba95903-7ec9-4dc1-a40c-461660e3cb9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:07.815076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:54:07.817422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:54:07.825544 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4ba95903-7ec9-4dc1-a40c-461660e3cb9f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1275 microversion: 2.1 time: 0.197518 Jul 14 14:54:07.826343 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2439/4841] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:07 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:07.848049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e1492df1-201a-4f46-8b04-f875433251b5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:07.848861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e1492df1-201a-4f46-8b04-f875433251b5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:07.859829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1492df1-201a-4f46-8b04-f875433251b5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.861680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1492df1-201a-4f46-8b04-f875433251b5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:07.863145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1492df1-201a-4f46-8b04-f875433251b5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.863731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1492df1-201a-4f46-8b04-f875433251b5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:07.892299 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-085accc5-d8f2-46db-bb00-cf07e2ae6347 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.247755 Jul 14 14:54:07.899668 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2403/4842] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 3252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:54:07.907616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af6df9f0-acec-407e-adda-59cb7663d046 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:07.912805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-af6df9f0-acec-407e-adda-59cb7663d046 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:07.933161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af6df9f0-acec-407e-adda-59cb7663d046 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.934479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af6df9f0-acec-407e-adda-59cb7663d046 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:07.935576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af6df9f0-acec-407e-adda-59cb7663d046 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.936163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af6df9f0-acec-407e-adda-59cb7663d046 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:08.179022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-af6df9f0-acec-407e-adda-59cb7663d046 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:08.197260 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-af6df9f0-acec-407e-adda-59cb7663d046 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1354 microversion: 2.1 time: 0.296110 Jul 14 14:54:08.201239 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2404/4843] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:07 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1354 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:08.223892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8da7ffc4-65cf-417f-a215-5b44e2c497d8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:08.226947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8da7ffc4-65cf-417f-a215-5b44e2c497d8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:08.420404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8da7ffc4-65cf-417f-a215-5b44e2c497d8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:08.437474 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8da7ffc4-65cf-417f-a215-5b44e2c497d8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1241 microversion: 2.1 time: 0.234999 Jul 14 14:54:08.438075 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2405/4844] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:08 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1241 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:08.531358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ff5b22c1-a1ac-4ba0-85b0-f99e6f8066a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:08.532225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ff5b22c1-a1ac-4ba0-85b0-f99e6f8066a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:08.544078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff5b22c1-a1ac-4ba0-85b0-f99e6f8066a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:08.547593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff5b22c1-a1ac-4ba0-85b0-f99e6f8066a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:08.548814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff5b22c1-a1ac-4ba0-85b0-f99e6f8066a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:08.549433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff5b22c1-a1ac-4ba0-85b0-f99e6f8066a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:08.756277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e1492df1-201a-4f46-8b04-f875433251b5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:08.770865 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e1492df1-201a-4f46-8b04-f875433251b5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1309 microversion: 2.1 time: 0.941957 Jul 14 14:54:08.771588 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2440/4845] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:07 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1309 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:08.858253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd551e76-e363-40e9-b6df-a2ddcce6a01c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:08.858900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bd551e76-e363-40e9-b6df-a2ddcce6a01c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:08.869093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd551e76-e363-40e9-b6df-a2ddcce6a01c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:08.869561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd551e76-e363-40e9-b6df-a2ddcce6a01c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:08.870378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd551e76-e363-40e9-b6df-a2ddcce6a01c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:08.870847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd551e76-e363-40e9-b6df-a2ddcce6a01c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:09.347679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ff5b22c1-a1ac-4ba0-85b0-f99e6f8066a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:09.357613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ff5b22c1-a1ac-4ba0-85b0-f99e6f8066a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:09.364876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ff5b22c1-a1ac-4ba0-85b0-f99e6f8066a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:09.368626 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ff5b22c1-a1ac-4ba0-85b0-f99e6f8066a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1406 microversion: 2.20 time: 0.842006 Jul 14 14:54:09.393021 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2406/4846] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:08 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1406 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:09.399007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f84c8e10-4cbb-4d48-91df-269ad06e0268 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:09.399961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f84c8e10-4cbb-4d48-91df-269ad06e0268 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:09.409264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f84c8e10-4cbb-4d48-91df-269ad06e0268 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:09.410061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f84c8e10-4cbb-4d48-91df-269ad06e0268 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:09.411190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f84c8e10-4cbb-4d48-91df-269ad06e0268 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:09.411957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f84c8e10-4cbb-4d48-91df-269ad06e0268 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:09.641489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f84c8e10-4cbb-4d48-91df-269ad06e0268 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:09.659632 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f84c8e10-4cbb-4d48-91df-269ad06e0268 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1360 microversion: 2.1 time: 0.265078 Jul 14 14:54:09.660622 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2407/4847] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:09 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1360 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:09.668285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4dd9e94f-1c25-4e20-9866-f8edd5101ccf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:09.669072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4dd9e94f-1c25-4e20-9866-f8edd5101ccf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:09.680407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bd551e76-e363-40e9-b6df-a2ddcce6a01c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:09.684443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4dd9e94f-1c25-4e20-9866-f8edd5101ccf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:09.689471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4dd9e94f-1c25-4e20-9866-f8edd5101ccf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:09.691603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4dd9e94f-1c25-4e20-9866-f8edd5101ccf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:09.693514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4dd9e94f-1c25-4e20-9866-f8edd5101ccf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:09.700380 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bd551e76-e363-40e9-b6df-a2ddcce6a01c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1317 microversion: 2.1 time: 0.849336 Jul 14 14:54:09.703377 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2441/4848] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:08 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:09.719653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-880a6aba-93cc-429b-a584-b63ec30b353e req-62eef5b0-ea8b-40f7-97cf-7fa3d0a63832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5292ea7-49d5-4a1e-8fee-76a77bf64afa", "tag": "93b2a2b3-1bf6-47ff-9851-01934b486943"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:09.740190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-880a6aba-93cc-429b-a584-b63ec30b353e req-62eef5b0-ea8b-40f7-97cf-7fa3d0a63832 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:09.743084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-880a6aba-93cc-429b-a584-b63ec30b353e req-62eef5b0-ea8b-40f7-97cf-7fa3d0a63832 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:09.775428 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-880a6aba-93cc-429b-a584-b63ec30b353e req-62eef5b0-ea8b-40f7-97cf-7fa3d0a63832 service nova] Creating event network-changed:93b2a2b3-1bf6-47ff-9851-01934b486943 for instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa on n-h1-767704-28 Jul 14 14:54:09.788677 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-880a6aba-93cc-429b-a584-b63ec30b353e req-62eef5b0-ea8b-40f7-97cf-7fa3d0a63832 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082729 Jul 14 14:54:09.795846 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2442/4849] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:09.802696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-373e82c2-34aa-4473-844b-e2d2151b14bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:09.803405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-373e82c2-34aa-4473-844b-e2d2151b14bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:09.829599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-373e82c2-34aa-4473-844b-e2d2151b14bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:09.830268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-373e82c2-34aa-4473-844b-e2d2151b14bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:09.833453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-373e82c2-34aa-4473-844b-e2d2151b14bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:09.834798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-373e82c2-34aa-4473-844b-e2d2151b14bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:10.047931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4dd9e94f-1c25-4e20-9866-f8edd5101ccf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:10.064721 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4dd9e94f-1c25-4e20-9866-f8edd5101ccf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1293 microversion: 2.1 time: 0.402378 Jul 14 14:54:10.067577 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2408/4850] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:09 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1293 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:10.399906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-93cb26d3-6e9f-411d-8a47-b71ecc6ee84b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:10.400556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-93cb26d3-6e9f-411d-8a47-b71ecc6ee84b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:10.417517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-93cb26d3-6e9f-411d-8a47-b71ecc6ee84b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:10.418368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-93cb26d3-6e9f-411d-8a47-b71ecc6ee84b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:10.419261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-93cb26d3-6e9f-411d-8a47-b71ecc6ee84b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:10.424177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-93cb26d3-6e9f-411d-8a47-b71ecc6ee84b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:10.572398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-373e82c2-34aa-4473-844b-e2d2151b14bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:10.582310 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-373e82c2-34aa-4473-844b-e2d2151b14bb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1309 microversion: 2.1 time: 0.784934 Jul 14 14:54:10.582913 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2443/4851] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:09 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1309 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:10.679851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-27a4faa1-a08a-4e8c-930e-680ca1a5f779 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:10.680974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-27a4faa1-a08a-4e8c-930e-680ca1a5f779 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:10.690110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-27a4faa1-a08a-4e8c-930e-680ca1a5f779 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:10.690919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-27a4faa1-a08a-4e8c-930e-680ca1a5f779 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:10.691897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-27a4faa1-a08a-4e8c-930e-680ca1a5f779 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:10.692546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-27a4faa1-a08a-4e8c-930e-680ca1a5f779 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:10.836391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-27a4faa1-a08a-4e8c-930e-680ca1a5f779 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:10.849960 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-27a4faa1-a08a-4e8c-930e-680ca1a5f779 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1360 microversion: 2.1 time: 0.175319 Jul 14 14:54:10.864644 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2444/4852] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:10 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1360 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:10.871395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-59ced83f-1208-496d-95f4-3e0506e382c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:10.872240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-59ced83f-1208-496d-95f4-3e0506e382c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:10.878803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59ced83f-1208-496d-95f4-3e0506e382c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:10.879533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59ced83f-1208-496d-95f4-3e0506e382c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:10.881194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59ced83f-1208-496d-95f4-3e0506e382c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:10.882203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59ced83f-1208-496d-95f4-3e0506e382c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:10.909838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-93cb26d3-6e9f-411d-8a47-b71ecc6ee84b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:10.929273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-93cb26d3-6e9f-411d-8a47-b71ecc6ee84b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:10.931280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-93cb26d3-6e9f-411d-8a47-b71ecc6ee84b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:10.935890 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-93cb26d3-6e9f-411d-8a47-b71ecc6ee84b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1406 microversion: 2.20 time: 0.538928 Jul 14 14:54:10.939885 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2409/4853] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:10 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1406 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:11.084781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-53f9979c-9340-4c83-986e-15d70c98d625 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:11.085505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-53f9979c-9340-4c83-986e-15d70c98d625 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:11.087900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:11.110514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53f9979c-9340-4c83-986e-15d70c98d625 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:11.111242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53f9979c-9340-4c83-986e-15d70c98d625 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:11.112071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53f9979c-9340-4c83-986e-15d70c98d625 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:11.112520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-53f9979c-9340-4c83-986e-15d70c98d625 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:11.736572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-53f9979c-9340-4c83-986e-15d70c98d625 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:11.791937 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-53f9979c-9340-4c83-986e-15d70c98d625 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1299 microversion: 2.1 time: 0.709259 Jul 14 14:54:11.796420 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2410/4854] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:11 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1299 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:11.809857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-85dd8763-10fc-4a0a-b7ec-e185ea414067 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:11.810824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-85dd8763-10fc-4a0a-b7ec-e185ea414067 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:11.825107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85dd8763-10fc-4a0a-b7ec-e185ea414067 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:11.826221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85dd8763-10fc-4a0a-b7ec-e185ea414067 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:11.830904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85dd8763-10fc-4a0a-b7ec-e185ea414067 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:11.832010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85dd8763-10fc-4a0a-b7ec-e185ea414067 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:12.321807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-59ced83f-1208-496d-95f4-3e0506e382c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:12.349495 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-59ced83f-1208-496d-95f4-3e0506e382c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1317 microversion: 2.1 time: 1.482987 Jul 14 14:54:12.350767 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2445/4855] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:10 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1317 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:12.363969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e784c052-c9c4-47fb-99d7-6564e1bb947f tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:12.364903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e784c052-c9c4-47fb-99d7-6564e1bb947f tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:12.373396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e784c052-c9c4-47fb-99d7-6564e1bb947f tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:12.374187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e784c052-c9c4-47fb-99d7-6564e1bb947f tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:12.375541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e784c052-c9c4-47fb-99d7-6564e1bb947f tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:12.376170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e784c052-c9c4-47fb-99d7-6564e1bb947f tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:12.454855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-85dd8763-10fc-4a0a-b7ec-e185ea414067 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:12.464464 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-85dd8763-10fc-4a0a-b7ec-e185ea414067 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1490 microversion: 2.1 time: 0.665395 Jul 14 14:54:12.477627 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2411/4856] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:11 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1490 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:12.484474 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ecb729dc-392c-48d5-bd51-7b57ccdd54c0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:12.485767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ecb729dc-392c-48d5-bd51-7b57ccdd54c0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:12.494157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ecb729dc-392c-48d5-bd51-7b57ccdd54c0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:12.494917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ecb729dc-392c-48d5-bd51-7b57ccdd54c0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:12.495930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ecb729dc-392c-48d5-bd51-7b57ccdd54c0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:12.497204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ecb729dc-392c-48d5-bd51-7b57ccdd54c0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:13.071878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e784c052-c9c4-47fb-99d7-6564e1bb947f tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:13.127198 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e784c052-c9c4-47fb-99d7-6564e1bb947f tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1428 microversion: 2.1 time: 0.774318 Jul 14 14:54:13.128972 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2446/4857] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:12 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1428 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:13.140290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a43e90ea-bf43-422d-b948-a5fff4d1e20f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:13.141593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a43e90ea-bf43-422d-b948-a5fff4d1e20f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:13.156049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a43e90ea-bf43-422d-b948-a5fff4d1e20f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:13.156758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a43e90ea-bf43-422d-b948-a5fff4d1e20f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:13.163337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ecb729dc-392c-48d5-bd51-7b57ccdd54c0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:13.172360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a43e90ea-bf43-422d-b948-a5fff4d1e20f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:13.173858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a43e90ea-bf43-422d-b948-a5fff4d1e20f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:13.175255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ecb729dc-392c-48d5-bd51-7b57ccdd54c0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:13.177085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ecb729dc-392c-48d5-bd51-7b57ccdd54c0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:13.178705 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ecb729dc-392c-48d5-bd51-7b57ccdd54c0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1406 microversion: 2.20 time: 0.699440 Jul 14 14:54:13.191999 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2412/4858] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:12 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1406 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:13.198191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-20154c4b-2604-47af-ad9d-688ae51e2534 req-c04ec789-9b48-41a9-8844-df3639b66553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f42c33-3241-4e35-b580-34bff52d73c4", "tag": "80264c6f-69b7-4369-84d7-44b85d806d82"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:13.219580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-20154c4b-2604-47af-ad9d-688ae51e2534 req-c04ec789-9b48-41a9-8844-df3639b66553 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:13.224681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-20154c4b-2604-47af-ad9d-688ae51e2534 req-c04ec789-9b48-41a9-8844-df3639b66553 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:13.253189 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-20154c4b-2604-47af-ad9d-688ae51e2534 req-c04ec789-9b48-41a9-8844-df3639b66553 service nova] Creating event network-changed:80264c6f-69b7-4369-84d7-44b85d806d82 for instance 03f42c33-3241-4e35-b580-34bff52d73c4 on n-h1-767704-28 Jul 14 14:54:13.270158 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-20154c4b-2604-47af-ad9d-688ae51e2534 req-c04ec789-9b48-41a9-8844-df3639b66553 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076673 Jul 14 14:54:13.271156 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2413/4859] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:13.285692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba85a75c-3197-443f-99b2-fd751bed6e2f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:13.286632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ba85a75c-3197-443f-99b2-fd751bed6e2f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:13.309172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba85a75c-3197-443f-99b2-fd751bed6e2f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:13.309981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba85a75c-3197-443f-99b2-fd751bed6e2f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:13.313428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba85a75c-3197-443f-99b2-fd751bed6e2f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:13.314252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba85a75c-3197-443f-99b2-fd751bed6e2f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:13.342900 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a43e90ea-bf43-422d-b948-a5fff4d1e20f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "PUT /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1085 microversion: 2.1 time: 0.212293 Jul 14 14:54:13.345861 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2447/4860] 10.222.0.81 () {60 vars in 1255 bytes} [Thu Jul 14 14:54:13 2022] PUT /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1085 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:13.359397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-573c004c-f4eb-4fd6-9fa4-bbff00161539 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:13.363669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-573c004c-f4eb-4fd6-9fa4-bbff00161539 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:13.379252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-573c004c-f4eb-4fd6-9fa4-bbff00161539 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:13.379955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-573c004c-f4eb-4fd6-9fa4-bbff00161539 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:13.382389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-573c004c-f4eb-4fd6-9fa4-bbff00161539 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:13.383040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-573c004c-f4eb-4fd6-9fa4-bbff00161539 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:13.680391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ba85a75c-3197-443f-99b2-fd751bed6e2f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:13.693627 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ba85a75c-3197-443f-99b2-fd751bed6e2f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1299 microversion: 2.1 time: 0.419511 Jul 14 14:54:13.694859 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2414/4861] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:13 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1299 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:13.711356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f61f5cc-18a3-4e6f-b7fc-82418094921d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:13.712844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1f61f5cc-18a3-4e6f-b7fc-82418094921d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:13.723629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f61f5cc-18a3-4e6f-b7fc-82418094921d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:13.724165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f61f5cc-18a3-4e6f-b7fc-82418094921d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:13.725383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f61f5cc-18a3-4e6f-b7fc-82418094921d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:13.725929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f61f5cc-18a3-4e6f-b7fc-82418094921d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:14.218723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-573c004c-f4eb-4fd6-9fa4-bbff00161539 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:14.239291 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-573c004c-f4eb-4fd6-9fa4-bbff00161539 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1511 microversion: 2.1 time: 0.883342 Jul 14 14:54:14.239946 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2448/4862] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:13 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1511 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:14.254918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0d00d010-ae0e-46f1-832a-613bd8a5c1c2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:14.255560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0d00d010-ae0e-46f1-832a-613bd8a5c1c2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:14.265979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:14.267905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d00d010-ae0e-46f1-832a-613bd8a5c1c2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:14.268826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d00d010-ae0e-46f1-832a-613bd8a5c1c2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:14.269886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d00d010-ae0e-46f1-832a-613bd8a5c1c2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:14.270580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d00d010-ae0e-46f1-832a-613bd8a5c1c2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:14.364268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1f61f5cc-18a3-4e6f-b7fc-82418094921d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:14.387752 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f61f5cc-18a3-4e6f-b7fc-82418094921d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1317 microversion: 2.1 time: 0.674668 Jul 14 14:54:14.398802 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2415/4863] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:13 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1317 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:14.406186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fbb5cf9d-2fbe-47a8-a94b-78e64d015c45 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:14.408676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fbb5cf9d-2fbe-47a8-a94b-78e64d015c45 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:14.427243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbb5cf9d-2fbe-47a8-a94b-78e64d015c45 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:14.428048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbb5cf9d-2fbe-47a8-a94b-78e64d015c45 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:14.429553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbb5cf9d-2fbe-47a8-a94b-78e64d015c45 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:14.430251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbb5cf9d-2fbe-47a8-a94b-78e64d015c45 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:14.476331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:15.301090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d00d010-ae0e-46f1-832a-613bd8a5c1c2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:15.312424 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0d00d010-ae0e-46f1-832a-613bd8a5c1c2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1428 microversion: 2.1 time: 1.071372 Jul 14 14:54:15.324007 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2449/4864] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:14 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1428 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:15.330017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ae29a8a3-5797-42fe-9d11-ae0f5b0723af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:15.330854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ae29a8a3-5797-42fe-9d11-ae0f5b0723af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:15.338366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae29a8a3-5797-42fe-9d11-ae0f5b0723af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:15.339677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae29a8a3-5797-42fe-9d11-ae0f5b0723af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:15.342028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae29a8a3-5797-42fe-9d11-ae0f5b0723af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:15.342636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae29a8a3-5797-42fe-9d11-ae0f5b0723af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:15.448995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fbb5cf9d-2fbe-47a8-a94b-78e64d015c45 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:15.460479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fbb5cf9d-2fbe-47a8-a94b-78e64d015c45 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:15.463137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fbb5cf9d-2fbe-47a8-a94b-78e64d015c45 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:15.466392 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fbb5cf9d-2fbe-47a8-a94b-78e64d015c45 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1406 microversion: 2.20 time: 1.066211 Jul 14 14:54:15.468481 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2416/4865] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:14 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1406 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:15.476470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f1b40ea1-841d-492c-beb4-6b695ad1751e req-57efe7f4-ef27-4863-aeb5-48bca9d9eab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c224c96-7334-4d8a-a27a-8e3aac8c2d20", "tag": "288a2282-68b2-4539-885c-84991c2267b4"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:15.489344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f1b40ea1-841d-492c-beb4-6b695ad1751e req-57efe7f4-ef27-4863-aeb5-48bca9d9eab3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:15.489834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f1b40ea1-841d-492c-beb4-6b695ad1751e req-57efe7f4-ef27-4863-aeb5-48bca9d9eab3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:15.504990 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f1b40ea1-841d-492c-beb4-6b695ad1751e req-57efe7f4-ef27-4863-aeb5-48bca9d9eab3 service nova] Creating event network-changed:288a2282-68b2-4539-885c-84991c2267b4 for instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 on n-h2-767704-28 Jul 14 14:54:15.510616 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f1b40ea1-841d-492c-beb4-6b695ad1751e req-57efe7f4-ef27-4863-aeb5-48bca9d9eab3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039895 Jul 14 14:54:15.512398 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2417/4866] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:15.519508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e7f304f3-5da4-45d6-8f02-3debf591ddc4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:15.520337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e7f304f3-5da4-45d6-8f02-3debf591ddc4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:15.527816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7f304f3-5da4-45d6-8f02-3debf591ddc4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:15.528541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7f304f3-5da4-45d6-8f02-3debf591ddc4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:15.530162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7f304f3-5da4-45d6-8f02-3debf591ddc4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:15.530781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7f304f3-5da4-45d6-8f02-3debf591ddc4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:15.859439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ae29a8a3-5797-42fe-9d11-ae0f5b0723af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:15.874817 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ae29a8a3-5797-42fe-9d11-ae0f5b0723af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1511 microversion: 2.1 time: 0.546850 Jul 14 14:54:15.875628 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2450/4867] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:15 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1511 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:15.899433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-99a7f730-9d2d-43e8-b66c-9b833ddc7032 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:15.900059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-99a7f730-9d2d-43e8-b66c-9b833ddc7032 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:15.906177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:15.908906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99a7f730-9d2d-43e8-b66c-9b833ddc7032 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:15.909770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99a7f730-9d2d-43e8-b66c-9b833ddc7032 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:15.910819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99a7f730-9d2d-43e8-b66c-9b833ddc7032 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:15.911620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-99a7f730-9d2d-43e8-b66c-9b833ddc7032 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:15.946542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=18 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:15.988098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e7f304f3-5da4-45d6-8f02-3debf591ddc4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:16.005797 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e7f304f3-5da4-45d6-8f02-3debf591ddc4 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1367 microversion: 2.1 time: 0.491149 Jul 14 14:54:16.006422 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2418/4868] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:15 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:16.011225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bc9fe93a-1662-4190-8e7f-880e256894b3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:16.015470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bc9fe93a-1662-4190-8e7f-880e256894b3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:16.026949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc9fe93a-1662-4190-8e7f-880e256894b3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:16.027168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc9fe93a-1662-4190-8e7f-880e256894b3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:16.033397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc9fe93a-1662-4190-8e7f-880e256894b3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:16.041984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc9fe93a-1662-4190-8e7f-880e256894b3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:16.097985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bc9fe93a-1662-4190-8e7f-880e256894b3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:54:16.287624 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bc9fe93a-1662-4190-8e7f-880e256894b3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 204 len: 0 microversion: 2.1 time: 0.279888 Jul 14 14:54:16.288240 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2419/4869] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:54:16 2022] DELETE /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:54:16.299296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dddab139-5df0-4cbe-9dc0-1dc971f294dc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:16.300041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dddab139-5df0-4cbe-9dc0-1dc971f294dc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:16.316099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dddab139-5df0-4cbe-9dc0-1dc971f294dc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:16.321174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dddab139-5df0-4cbe-9dc0-1dc971f294dc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:16.322051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dddab139-5df0-4cbe-9dc0-1dc971f294dc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:16.322506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dddab139-5df0-4cbe-9dc0-1dc971f294dc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:16.735014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dddab139-5df0-4cbe-9dc0-1dc971f294dc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:16.751157 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dddab139-5df0-4cbe-9dc0-1dc971f294dc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1517 microversion: 2.1 time: 0.455567 Jul 14 14:54:16.752405 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2420/4870] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:16 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1517 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:16.766638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-71275f76-26a7-447f-867e-2885f53693bc tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:16.768057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-71275f76-26a7-447f-867e-2885f53693bc tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:16.769258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-99a7f730-9d2d-43e8-b66c-9b833ddc7032 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:16.784227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71275f76-26a7-447f-867e-2885f53693bc tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:16.786023 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-99a7f730-9d2d-43e8-b66c-9b833ddc7032 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1317 microversion: 2.1 time: 0.891088 Jul 14 14:54:16.786644 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2451/4871] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:15 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1317 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:16.786861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71275f76-26a7-447f-867e-2885f53693bc tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:16.791810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71275f76-26a7-447f-867e-2885f53693bc tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:16.792534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71275f76-26a7-447f-867e-2885f53693bc tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:16.800562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e74cdff6-3684-4dec-9c49-ad40c712f4d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:16.801222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e74cdff6-3684-4dec-9c49-ad40c712f4d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:16.821347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e74cdff6-3684-4dec-9c49-ad40c712f4d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:16.822652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e74cdff6-3684-4dec-9c49-ad40c712f4d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:16.823543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e74cdff6-3684-4dec-9c49-ad40c712f4d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:16.823993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e74cdff6-3684-4dec-9c49-ad40c712f4d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:17.286072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e74cdff6-3684-4dec-9c49-ad40c712f4d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:17.304667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e74cdff6-3684-4dec-9c49-ad40c712f4d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:17.306912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e74cdff6-3684-4dec-9c49-ad40c712f4d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:17.308105 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e74cdff6-3684-4dec-9c49-ad40c712f4d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1406 microversion: 2.20 time: 0.520476 Jul 14 14:54:17.309142 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2452/4872] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:16 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1406 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:17.318737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b167f6b-8f51-4998-a781-f9cc06849dce tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:17.321098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3b167f6b-8f51-4998-a781-f9cc06849dce tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:17.338617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b167f6b-8f51-4998-a781-f9cc06849dce tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:17.339288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b167f6b-8f51-4998-a781-f9cc06849dce tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:17.340473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b167f6b-8f51-4998-a781-f9cc06849dce tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:17.341296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b167f6b-8f51-4998-a781-f9cc06849dce tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:17.403177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-71275f76-26a7-447f-867e-2885f53693bc tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:17.411416 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-71275f76-26a7-447f-867e-2885f53693bc tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1428 microversion: 2.1 time: 0.657708 Jul 14 14:54:17.417176 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2421/4873] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:16 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1428 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:17.769351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-91565852-c94f-4867-943e-14732b8d7074 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:17.770022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b167f6b-8f51-4998-a781-f9cc06849dce tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:17.771082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-91565852-c94f-4867-943e-14732b8d7074 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:17.779073 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b167f6b-8f51-4998-a781-f9cc06849dce tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1367 microversion: 2.1 time: 0.468508 Jul 14 14:54:17.782060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:17.782211 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2453/4874] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:17 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:17.787384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91565852-c94f-4867-943e-14732b8d7074 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:17.787860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91565852-c94f-4867-943e-14732b8d7074 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:17.788772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91565852-c94f-4867-943e-14732b8d7074 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:17.789242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91565852-c94f-4867-943e-14732b8d7074 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:17.812289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c779958f-84da-4e9a-ae1d-7c0519fcaf17 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:17.813005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c779958f-84da-4e9a-ae1d-7c0519fcaf17 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:17.824747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c779958f-84da-4e9a-ae1d-7c0519fcaf17 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:17.831505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c779958f-84da-4e9a-ae1d-7c0519fcaf17 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:17.834052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c779958f-84da-4e9a-ae1d-7c0519fcaf17 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:17.835105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c779958f-84da-4e9a-ae1d-7c0519fcaf17 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:18.424992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=30 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:18.594704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-91565852-c94f-4867-943e-14732b8d7074 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:18.611532 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-91565852-c94f-4867-943e-14732b8d7074 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1517 microversion: 2.1 time: 0.845299 Jul 14 14:54:18.613308 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2422/4875] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:17 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1517 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:18.624769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-81d7c71c-9155-444a-8075-4e0b48062032 req-588a6926-3fd9-4f94-a8ec-8e1d5d08c5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9e2f71-381c-4989-9db3-ee7cccb35a2a", "tag": "784131ad-46f8-4829-aa2e-78e6294d0f3b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:18.641029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-81d7c71c-9155-444a-8075-4e0b48062032 req-588a6926-3fd9-4f94-a8ec-8e1d5d08c5c9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:18.641611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-81d7c71c-9155-444a-8075-4e0b48062032 req-588a6926-3fd9-4f94-a8ec-8e1d5d08c5c9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:18.658188 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-81d7c71c-9155-444a-8075-4e0b48062032 req-588a6926-3fd9-4f94-a8ec-8e1d5d08c5c9 service nova] Creating event network-changed:784131ad-46f8-4829-aa2e-78e6294d0f3b for instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a on n-h2-767704-28 Jul 14 14:54:18.664072 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-81d7c71c-9155-444a-8075-4e0b48062032 req-588a6926-3fd9-4f94-a8ec-8e1d5d08c5c9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048690 Jul 14 14:54:18.664986 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2423/4876] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:18.672198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d6338754-de97-410a-a185-fb0461019b28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:18.673253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d6338754-de97-410a-a185-fb0461019b28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:18.681400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6338754-de97-410a-a185-fb0461019b28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:18.682101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6338754-de97-410a-a185-fb0461019b28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:18.683101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6338754-de97-410a-a185-fb0461019b28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:18.683763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6338754-de97-410a-a185-fb0461019b28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:19.378936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c779958f-84da-4e9a-ae1d-7c0519fcaf17 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:19.399902 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c779958f-84da-4e9a-ae1d-7c0519fcaf17 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1317 microversion: 2.1 time: 1.583259 Jul 14 14:54:19.401685 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2454/4877] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:17 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1317 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:19.407114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-11adcd2d-3b9f-47ab-8937-8927d48fe49e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:19.408174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-11adcd2d-3b9f-47ab-8937-8927d48fe49e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:19.425214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11adcd2d-3b9f-47ab-8937-8927d48fe49e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:19.425903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11adcd2d-3b9f-47ab-8937-8927d48fe49e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:19.426890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11adcd2d-3b9f-47ab-8937-8927d48fe49e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:19.427540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11adcd2d-3b9f-47ab-8937-8927d48fe49e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:19.998155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d6338754-de97-410a-a185-fb0461019b28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:20.009012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d6338754-de97-410a-a185-fb0461019b28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:20.010977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d6338754-de97-410a-a185-fb0461019b28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:20.012694 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d6338754-de97-410a-a185-fb0461019b28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1406 microversion: 2.20 time: 1.346227 Jul 14 14:54:20.013898 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2424/4878] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:18 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1406 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:20.020099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-54ad99d2-0adf-4bdc-a08c-031e5862cdb2 req-4b9947bb-069b-44e1-9fd6-d948f5fb383f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5292ea7-49d5-4a1e-8fee-76a77bf64afa", "name": "network-vif-plugged", "status": "completed", "tag": "93b2a2b3-1bf6-47ff-9851-01934b486943"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:20.031101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-54ad99d2-0adf-4bdc-a08c-031e5862cdb2 req-4b9947bb-069b-44e1-9fd6-d948f5fb383f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:20.031901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-54ad99d2-0adf-4bdc-a08c-031e5862cdb2 req-4b9947bb-069b-44e1-9fd6-d948f5fb383f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:20.049522 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-54ad99d2-0adf-4bdc-a08c-031e5862cdb2 req-4b9947bb-069b-44e1-9fd6-d948f5fb383f service nova] Creating event network-vif-plugged:93b2a2b3-1bf6-47ff-9851-01934b486943 for instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa on n-h1-767704-28 Jul 14 14:54:20.057351 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-54ad99d2-0adf-4bdc-a08c-031e5862cdb2 req-4b9947bb-069b-44e1-9fd6-d948f5fb383f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041682 Jul 14 14:54:20.058478 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2425/4879] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:20.065441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-358b423a-4458-4d2b-bd67-b9225c6427fd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:20.066445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-358b423a-4458-4d2b-bd67-b9225c6427fd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:20.075562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-358b423a-4458-4d2b-bd67-b9225c6427fd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:20.076128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-358b423a-4458-4d2b-bd67-b9225c6427fd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:20.077705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-358b423a-4458-4d2b-bd67-b9225c6427fd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:20.078406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-358b423a-4458-4d2b-bd67-b9225c6427fd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:20.330698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-11adcd2d-3b9f-47ab-8937-8927d48fe49e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:20.334050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:20.345728 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-11adcd2d-3b9f-47ab-8937-8927d48fe49e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1428 microversion: 2.1 time: 0.942698 Jul 14 14:54:20.355653 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2455/4880] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:19 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1428 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:20.362046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b7312c58-e703-499a-9bdb-bc28760be7eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:20.362701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b7312c58-e703-499a-9bdb-bc28760be7eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:20.369978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7312c58-e703-499a-9bdb-bc28760be7eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:20.370446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7312c58-e703-499a-9bdb-bc28760be7eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:20.371782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7312c58-e703-499a-9bdb-bc28760be7eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:20.372401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7312c58-e703-499a-9bdb-bc28760be7eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:20.417471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7312c58-e703-499a-9bdb-bc28760be7eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:20.418367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7312c58-e703-499a-9bdb-bc28760be7eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:20.419319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-b7312c58-e703-499a-9bdb-bc28760be7eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lazy-loading 'fault' on Instance uuid fab8280b-6dcc-4928-b155-d85479522d01 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:54:20.579895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b7312c58-e703-499a-9bdb-bc28760be7eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:20.593888 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b7312c58-e703-499a-9bdb-bc28760be7eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 200 len: 1320 microversion: 2.1 time: 0.236128 Jul 14 14:54:20.605197 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2456/4881] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:20 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 1320 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:20.605197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-076ce194-a50d-4369-ab89-63063a43d4cd req-5320183b-0d12-45ec-a773-b11e560f5d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab8280b-6dcc-4928-b155-d85479522d01", "name": "network-vif-deleted", "tag": "f9299e46-ac94-4a39-9ba8-99b4a9fd83a4"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:20.615402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-076ce194-a50d-4369-ab89-63063a43d4cd req-5320183b-0d12-45ec-a773-b11e560f5d3c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:20.615968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-076ce194-a50d-4369-ab89-63063a43d4cd req-5320183b-0d12-45ec-a773-b11e560f5d3c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:20.633897 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-076ce194-a50d-4369-ab89-63063a43d4cd req-5320183b-0d12-45ec-a773-b11e560f5d3c service nova] Creating event network-vif-deleted:f9299e46-ac94-4a39-9ba8-99b4a9fd83a4 for instance fab8280b-6dcc-4928-b155-d85479522d01 on n-h1-767704-28 Jul 14 14:54:20.642442 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-076ce194-a50d-4369-ab89-63063a43d4cd req-5320183b-0d12-45ec-a773-b11e560f5d3c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044104 Jul 14 14:54:20.643036 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2457/4882] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:20.651065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1f97dac0-148f-4565-b71a-0bf08cd7faca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:20.651975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f97dac0-148f-4565-b71a-0bf08cd7faca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:20.661728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f97dac0-148f-4565-b71a-0bf08cd7faca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:20.661728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f97dac0-148f-4565-b71a-0bf08cd7faca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:20.662155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f97dac0-148f-4565-b71a-0bf08cd7faca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:20.662537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f97dac0-148f-4565-b71a-0bf08cd7faca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:20.730141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-358b423a-4458-4d2b-bd67-b9225c6427fd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:20.740843 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-358b423a-4458-4d2b-bd67-b9225c6427fd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1367 microversion: 2.1 time: 0.680257 Jul 14 14:54:20.741854 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2426/4883] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:20 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1367 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:21.031567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4731585d-9d1b-4ccf-a3a3-f68a9cd0cbfa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:21.042948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4731585d-9d1b-4ccf-a3a3-f68a9cd0cbfa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:21.050560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4731585d-9d1b-4ccf-a3a3-f68a9cd0cbfa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.051026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4731585d-9d1b-4ccf-a3a3-f68a9cd0cbfa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.051824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4731585d-9d1b-4ccf-a3a3-f68a9cd0cbfa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.052446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4731585d-9d1b-4ccf-a3a3-f68a9cd0cbfa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.143285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f97dac0-148f-4565-b71a-0bf08cd7faca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:21.155556 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1f97dac0-148f-4565-b71a-0bf08cd7faca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1317 microversion: 2.1 time: 0.509867 Jul 14 14:54:21.161404 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2458/4884] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:20 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:21.340418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4731585d-9d1b-4ccf-a3a3-f68a9cd0cbfa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:21.350503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4731585d-9d1b-4ccf-a3a3-f68a9cd0cbfa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:21.352661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4731585d-9d1b-4ccf-a3a3-f68a9cd0cbfa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:21.354114 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4731585d-9d1b-4ccf-a3a3-f68a9cd0cbfa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1406 microversion: 2.20 time: 0.326871 Jul 14 14:54:21.367038 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2427/4885] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:21 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:54:21.367591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-605b63aa-a732-45d1-a369-50451ecf1fc6 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:21.368559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-605b63aa-a732-45d1-a369-50451ecf1fc6 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:21.381645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-605b63aa-a732-45d1-a369-50451ecf1fc6 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.382487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-605b63aa-a732-45d1-a369-50451ecf1fc6 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.384366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-605b63aa-a732-45d1-a369-50451ecf1fc6 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.385259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-605b63aa-a732-45d1-a369-50451ecf1fc6 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.614249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6fcc4b84-ed9e-4f4c-be7a-a934573c1056 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:21.615122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6fcc4b84-ed9e-4f4c-be7a-a934573c1056 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:21.624295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fcc4b84-ed9e-4f4c-be7a-a934573c1056 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.625131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fcc4b84-ed9e-4f4c-be7a-a934573c1056 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.626139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fcc4b84-ed9e-4f4c-be7a-a934573c1056 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.626774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fcc4b84-ed9e-4f4c-be7a-a934573c1056 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.658741 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-6fcc4b84-ed9e-4f4c-be7a-a934573c1056 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6fcc4b84-ed9e-4f4c-be7a-a934573c1056 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 HTTP/1.1 Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'fab8280b-6dcc-4928-b155-d85479522d01'} Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:21.669215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:21.675336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:21.675336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:21.675336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:21.675336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:21.675336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:54:21.675336 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:21.676044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-605b63aa-a732-45d1-a369-50451ecf1fc6 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:21.680278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6fcc4b84-ed9e-4f4c-be7a-a934573c1056 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:21.681759 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-605b63aa-a732-45d1-a369-50451ecf1fc6 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1428 microversion: 2.1 time: 0.320524 Jul 14 14:54:21.684670 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6fcc4b84-ed9e-4f4c-be7a-a934573c1056 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 404 len: 111 microversion: 2.1 time: 0.072730 Jul 14 14:54:21.684854 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2459/4886] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:21 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1428 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:21.687005 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2428/4887] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:21 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:54:21.759563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fe4875c7-86da-496b-98a0-31c1d6299b72 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:21.760207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fe4875c7-86da-496b-98a0-31c1d6299b72 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:21.773976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe4875c7-86da-496b-98a0-31c1d6299b72 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.774438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe4875c7-86da-496b-98a0-31c1d6299b72 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.798504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe4875c7-86da-496b-98a0-31c1d6299b72 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.799557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe4875c7-86da-496b-98a0-31c1d6299b72 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.873531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-434379925", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "525f1693-8842-4191-b231-7d2db21bdaf8"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:21.980059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] validate_networks() for [('525f1693-8842-4191-b231-7d2db21bdaf8', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:54:22.283087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fe4875c7-86da-496b-98a0-31c1d6299b72 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:22.294197 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fe4875c7-86da-496b-98a0-31c1d6299b72 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1367 microversion: 2.1 time: 0.539784 Jul 14 14:54:22.303616 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2460/4888] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:21 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1367 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:22.303616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-38b12f93-e82b-4d9a-9f64-a68b8768f5b4 req-5170eb6d-d39e-447c-8227-d50a69e8253a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f42c33-3241-4e35-b580-34bff52d73c4", "name": "network-vif-plugged", "status": "completed", "tag": "80264c6f-69b7-4369-84d7-44b85d806d82"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:22.313608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-38b12f93-e82b-4d9a-9f64-a68b8768f5b4 req-5170eb6d-d39e-447c-8227-d50a69e8253a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:22.314082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-38b12f93-e82b-4d9a-9f64-a68b8768f5b4 req-5170eb6d-d39e-447c-8227-d50a69e8253a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:22.329835 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-38b12f93-e82b-4d9a-9f64-a68b8768f5b4 req-5170eb6d-d39e-447c-8227-d50a69e8253a service nova] Creating event network-vif-plugged:80264c6f-69b7-4369-84d7-44b85d806d82 for instance 03f42c33-3241-4e35-b580-34bff52d73c4 on n-h1-767704-28 Jul 14 14:54:22.337519 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-38b12f93-e82b-4d9a-9f64-a68b8768f5b4 req-5170eb6d-d39e-447c-8227-d50a69e8253a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040780 Jul 14 14:54:22.338475 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2461/4889] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:22.345279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b043192e-ab26-426d-a38d-ab10ba174941 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:22.346457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b043192e-ab26-426d-a38d-ab10ba174941 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:22.357312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b043192e-ab26-426d-a38d-ab10ba174941 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:22.358359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b043192e-ab26-426d-a38d-ab10ba174941 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:22.360274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b043192e-ab26-426d-a38d-ab10ba174941 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:22.361306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b043192e-ab26-426d-a38d-ab10ba174941 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:23.250083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b043192e-ab26-426d-a38d-ab10ba174941 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:23.259714 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b043192e-ab26-426d-a38d-ab10ba174941 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1317 microversion: 2.1 time: 0.919945 Jul 14 14:54:23.262423 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2462/4890] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:22 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1317 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:23.274322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a3819954-9afc-4e9f-a80f-152f8233786d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:23.280702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a3819954-9afc-4e9f-a80f-152f8233786d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:23.299649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3819954-9afc-4e9f-a80f-152f8233786d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:23.300123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3819954-9afc-4e9f-a80f-152f8233786d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:23.300939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3819954-9afc-4e9f-a80f-152f8233786d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:23.310245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a3819954-9afc-4e9f-a80f-152f8233786d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.025730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:54:24.026189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:54:24.026620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:54:24.027024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:54:24.028457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:54:24.050083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.050971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.052413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.056299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.086559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a3819954-9afc-4e9f-a80f-152f8233786d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:24.103824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a3819954-9afc-4e9f-a80f-152f8233786d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:24.106465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a3819954-9afc-4e9f-a80f-152f8233786d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:24.107891 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a3819954-9afc-4e9f-a80f-152f8233786d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1597 microversion: 2.20 time: 0.837559 Jul 14 14:54:24.108492 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2463/4891] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:23 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1597 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:24.115127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:24.126473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b5f3ab83-b236-44ef-819a-96e1cdd7413a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:24.128793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Getting quotas for user 4e3af45ec76c4a0b8dd03dcff6802f3c and project 315bd34f122d4428a8fede4ef18c0eae. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:24.129622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b5f3ab83-b236-44ef-819a-96e1cdd7413a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:24.157507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5f3ab83-b236-44ef-819a-96e1cdd7413a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.160262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5f3ab83-b236-44ef-819a-96e1cdd7413a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.163030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5f3ab83-b236-44ef-819a-96e1cdd7413a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.166192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5f3ab83-b236-44ef-819a-96e1cdd7413a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.181587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:54:24.190663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:54:24.312037 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e4855af6-a886-4e1b-b457-9ce2b1b5e126 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.440254 Jul 14 14:54:24.320927 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2429/4892] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:54:24.330959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c2e666e1-ae95-4e63-95b8-6fefe1dbd89f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:24.331601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c2e666e1-ae95-4e63-95b8-6fefe1dbd89f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:24.347985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2e666e1-ae95-4e63-95b8-6fefe1dbd89f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.348544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2e666e1-ae95-4e63-95b8-6fefe1dbd89f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.349490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2e666e1-ae95-4e63-95b8-6fefe1dbd89f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.349864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c2e666e1-ae95-4e63-95b8-6fefe1dbd89f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.599737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b5f3ab83-b236-44ef-819a-96e1cdd7413a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:24.625297 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b5f3ab83-b236-44ef-819a-96e1cdd7413a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1428 microversion: 2.1 time: 0.496418 Jul 14 14:54:24.625297 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2464/4893] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:24 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1428 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:24.640048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-58e297a0-ba4a-46c8-82df-571e9f4de4d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:24.640564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-58e297a0-ba4a-46c8-82df-571e9f4de4d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:24.667802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58e297a0-ba4a-46c8-82df-571e9f4de4d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.668991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58e297a0-ba4a-46c8-82df-571e9f4de4d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.669992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58e297a0-ba4a-46c8-82df-571e9f4de4d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.674525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58e297a0-ba4a-46c8-82df-571e9f4de4d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.798390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c2e666e1-ae95-4e63-95b8-6fefe1dbd89f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:24.809560 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c2e666e1-ae95-4e63-95b8-6fefe1dbd89f tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1367 microversion: 2.1 time: 0.492167 Jul 14 14:54:24.810256 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2430/4894] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:24 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:24.829436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-81c3410c-976a-457d-b6a3-49018c036f7c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:24.836670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-81c3410c-976a-457d-b6a3-49018c036f7c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:24.857790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81c3410c-976a-457d-b6a3-49018c036f7c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.858592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81c3410c-976a-457d-b6a3-49018c036f7c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.859701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81c3410c-976a-457d-b6a3-49018c036f7c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.860301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81c3410c-976a-457d-b6a3-49018c036f7c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.932596 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-58e297a0-ba4a-46c8-82df-571e9f4de4d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.313228 Jul 14 14:54:24.940539 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2465/4895] 10.222.0.81 () {60 vars in 1315 bytes} [Thu Jul 14 14:54:24 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-interface => generated 284 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:54:24.975312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3113a6cd-f5ff-45b8-b173-28ecf77cf4b2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:24.986700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3113a6cd-f5ff-45b8-b173-28ecf77cf4b2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:25.412245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3113a6cd-f5ff-45b8-b173-28ecf77cf4b2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:25.422111 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3113a6cd-f5ff-45b8-b173-28ecf77cf4b2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1208 microversion: 2.1 time: 0.480289 Jul 14 14:54:25.426191 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2466/4896] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:24 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1208 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:25.440896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3f7524e4-897d-48e2-a85e-6f7f98e3892f req-734dd6e8-d2d6-4a7d-a72a-c62bf324e397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c224c96-7334-4d8a-a27a-8e3aac8c2d20", "name": "network-vif-plugged", "status": "completed", "tag": "288a2282-68b2-4539-885c-84991c2267b4"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:25.457281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3f7524e4-897d-48e2-a85e-6f7f98e3892f req-734dd6e8-d2d6-4a7d-a72a-c62bf324e397 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:25.467057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3f7524e4-897d-48e2-a85e-6f7f98e3892f req-734dd6e8-d2d6-4a7d-a72a-c62bf324e397 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:25.495827 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3f7524e4-897d-48e2-a85e-6f7f98e3892f req-734dd6e8-d2d6-4a7d-a72a-c62bf324e397 service nova] Creating event network-vif-plugged:288a2282-68b2-4539-885c-84991c2267b4 for instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 on n-h2-767704-28 Jul 14 14:54:25.516107 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3f7524e4-897d-48e2-a85e-6f7f98e3892f req-734dd6e8-d2d6-4a7d-a72a-c62bf324e397 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086809 Jul 14 14:54:25.518557 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2467/4897] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:25.644201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8f636830-9705-41a9-ab4d-c90c1bc09505 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:25.650979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8f636830-9705-41a9-ab4d-c90c1bc09505 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:25.653890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-81c3410c-976a-457d-b6a3-49018c036f7c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:25.671598 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-81c3410c-976a-457d-b6a3-49018c036f7c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1317 microversion: 2.1 time: 0.855726 Jul 14 14:54:25.672305 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2431/4898] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:24 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1317 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:25.681846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f636830-9705-41a9-ab4d-c90c1bc09505 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:25.682697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f636830-9705-41a9-ab4d-c90c1bc09505 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:25.684534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f636830-9705-41a9-ab4d-c90c1bc09505 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:25.692710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f636830-9705-41a9-ab4d-c90c1bc09505 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:25.837389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af319595-60d2-44bf-83d2-95e1e8be1ded tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:25.841530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-af319595-60d2-44bf-83d2-95e1e8be1ded tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:25.853807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af319595-60d2-44bf-83d2-95e1e8be1ded tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:25.857225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af319595-60d2-44bf-83d2-95e1e8be1ded tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:25.860638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af319595-60d2-44bf-83d2-95e1e8be1ded tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:25.861431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af319595-60d2-44bf-83d2-95e1e8be1ded tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:26.412336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8f636830-9705-41a9-ab4d-c90c1bc09505 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:26.432007 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8f636830-9705-41a9-ab4d-c90c1bc09505 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1608 microversion: 2.1 time: 0.792573 Jul 14 14:54:26.434911 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2468/4899] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:25 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1608 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:26.457180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-02a0f5ef-77aa-46f9-bdce-0b52d4a357f0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:26.479805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-02a0f5ef-77aa-46f9-bdce-0b52d4a357f0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:26.491388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-af319595-60d2-44bf-83d2-95e1e8be1ded tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:26.498607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02a0f5ef-77aa-46f9-bdce-0b52d4a357f0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:26.500010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02a0f5ef-77aa-46f9-bdce-0b52d4a357f0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:26.501133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02a0f5ef-77aa-46f9-bdce-0b52d4a357f0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:26.502665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-02a0f5ef-77aa-46f9-bdce-0b52d4a357f0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:26.505544 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-af319595-60d2-44bf-83d2-95e1e8be1ded tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1367 microversion: 2.1 time: 0.673560 Jul 14 14:54:26.507086 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2432/4900] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:25 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1367 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:26.528403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e98f9923-cd07-4a2b-8445-76f82159d42e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:26.533253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e98f9923-cd07-4a2b-8445-76f82159d42e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:26.546101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e98f9923-cd07-4a2b-8445-76f82159d42e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:26.546939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e98f9923-cd07-4a2b-8445-76f82159d42e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:26.548835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e98f9923-cd07-4a2b-8445-76f82159d42e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:26.549405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e98f9923-cd07-4a2b-8445-76f82159d42e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:26.717548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-02a0f5ef-77aa-46f9-bdce-0b52d4a357f0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:26.739669 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-02a0f5ef-77aa-46f9-bdce-0b52d4a357f0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1268 microversion: 2.1 time: 0.291908 Jul 14 14:54:26.755473 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2469/4901] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:26 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1268 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:26.767598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18c05e35-d359-405f-9d14-ed7c9f259bd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:26.768539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-18c05e35-d359-405f-9d14-ed7c9f259bd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:26.782013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18c05e35-d359-405f-9d14-ed7c9f259bd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:26.782578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18c05e35-d359-405f-9d14-ed7c9f259bd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:26.783754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18c05e35-d359-405f-9d14-ed7c9f259bd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:26.789755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18c05e35-d359-405f-9d14-ed7c9f259bd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:27.258060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e98f9923-cd07-4a2b-8445-76f82159d42e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:27.285560 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e98f9923-cd07-4a2b-8445-76f82159d42e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1608 microversion: 2.1 time: 0.777277 Jul 14 14:54:27.294982 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2433/4902] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:26 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1608 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:27.316291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ffb14c0d-de84-40bb-ade0-df824a5bd3a2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:27.317275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ffb14c0d-de84-40bb-ade0-df824a5bd3a2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:27.325403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18c05e35-d359-405f-9d14-ed7c9f259bd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:27.342879 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-18c05e35-d359-405f-9d14-ed7c9f259bd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1317 microversion: 2.1 time: 0.585697 Jul 14 14:54:27.345819 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2470/4903] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:26 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:27.348104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffb14c0d-de84-40bb-ade0-df824a5bd3a2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:27.348562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffb14c0d-de84-40bb-ade0-df824a5bd3a2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:27.349404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffb14c0d-de84-40bb-ade0-df824a5bd3a2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:27.349838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffb14c0d-de84-40bb-ade0-df824a5bd3a2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:27.526434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1d740ede-90f3-4a4f-afa9-39e62a7ab4b9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:27.527434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1d740ede-90f3-4a4f-afa9-39e62a7ab4b9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:27.547251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d740ede-90f3-4a4f-afa9-39e62a7ab4b9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:27.547868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d740ede-90f3-4a4f-afa9-39e62a7ab4b9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:27.549252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d740ede-90f3-4a4f-afa9-39e62a7ab4b9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:27.550018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d740ede-90f3-4a4f-afa9-39e62a7ab4b9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:28.625963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ffb14c0d-de84-40bb-ade0-df824a5bd3a2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:28.628452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:28.635880 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ffb14c0d-de84-40bb-ade0-df824a5bd3a2 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1608 microversion: 2.1 time: 1.331023 Jul 14 14:54:28.646902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1d740ede-90f3-4a4f-afa9-39e62a7ab4b9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:28.649709 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2434/4904] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:27 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1608 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:28.656410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-dd5e8a10-a55c-46cd-9a2f-f40e7e05441c req-426c9682-dff7-4f76-bea5-f399c8d3c4cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9e2f71-381c-4989-9db3-ee7cccb35a2a", "name": "network-vif-plugged", "status": "completed", "tag": "784131ad-46f8-4829-aa2e-78e6294d0f3b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:28.667439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-dd5e8a10-a55c-46cd-9a2f-f40e7e05441c req-426c9682-dff7-4f76-bea5-f399c8d3c4cc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:28.669176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-dd5e8a10-a55c-46cd-9a2f-f40e7e05441c req-426c9682-dff7-4f76-bea5-f399c8d3c4cc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:28.672408 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1d740ede-90f3-4a4f-afa9-39e62a7ab4b9 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1367 microversion: 2.1 time: 1.151539 Jul 14 14:54:28.684857 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2471/4905] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:27 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1367 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:28.687720 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-dd5e8a10-a55c-46cd-9a2f-f40e7e05441c req-426c9682-dff7-4f76-bea5-f399c8d3c4cc service nova] Creating event network-vif-plugged:784131ad-46f8-4829-aa2e-78e6294d0f3b for instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a on n-h2-767704-28 Jul 14 14:54:28.693007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3d3a9069-5a6c-41fe-8721-760a7f978ebd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:28.693644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3d3a9069-5a6c-41fe-8721-760a7f978ebd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:28.695037 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-dd5e8a10-a55c-46cd-9a2f-f40e7e05441c req-426c9682-dff7-4f76-bea5-f399c8d3c4cc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043391 Jul 14 14:54:28.695925 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2435/4906] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:28.708443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d3a9069-5a6c-41fe-8721-760a7f978ebd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:28.709176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d3a9069-5a6c-41fe-8721-760a7f978ebd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:28.710215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d3a9069-5a6c-41fe-8721-760a7f978ebd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:28.710817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d3a9069-5a6c-41fe-8721-760a7f978ebd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:28.715435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-32b7dd87-09b0-47ab-844e-ea0bcd87c2c4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:28.717209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-32b7dd87-09b0-47ab-844e-ea0bcd87c2c4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:28.727864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-32b7dd87-09b0-47ab-844e-ea0bcd87c2c4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:28.728708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-32b7dd87-09b0-47ab-844e-ea0bcd87c2c4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:28.729796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-32b7dd87-09b0-47ab-844e-ea0bcd87c2c4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:28.731307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-32b7dd87-09b0-47ab-844e-ea0bcd87c2c4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:28.925581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3d3a9069-5a6c-41fe-8721-760a7f978ebd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:28.935497 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3d3a9069-5a6c-41fe-8721-760a7f978ebd tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1266 microversion: 2.1 time: 0.249693 Jul 14 14:54:28.936665 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2472/4907] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:28 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:29.393549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-32b7dd87-09b0-47ab-844e-ea0bcd87c2c4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:29.410808 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-32b7dd87-09b0-47ab-844e-ea0bcd87c2c4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1506 microversion: 2.1 time: 0.712950 Jul 14 14:54:29.411832 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2436/4908] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:28 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1506 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:29.430169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-44c2ea62-b730-4e9f-835c-ee3a459bdbb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:29.431253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-44c2ea62-b730-4e9f-835c-ee3a459bdbb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:29.443001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44c2ea62-b730-4e9f-835c-ee3a459bdbb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.446921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44c2ea62-b730-4e9f-835c-ee3a459bdbb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.522480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44c2ea62-b730-4e9f-835c-ee3a459bdbb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.525666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44c2ea62-b730-4e9f-835c-ee3a459bdbb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.075s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.607072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1cb6dd6a-21da-4781-9d32-a2b5d68d3762 req-0a87c02d-eac6-408e-88c5-3596e55550ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5292ea7-49d5-4a1e-8fee-76a77bf64afa", "tag": "93b2a2b3-1bf6-47ff-9851-01934b486943"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:29.619318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-44c2ea62-b730-4e9f-835c-ee3a459bdbb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:54:29.628628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1cb6dd6a-21da-4781-9d32-a2b5d68d3762 req-0a87c02d-eac6-408e-88c5-3596e55550ec service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.630580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1cb6dd6a-21da-4781-9d32-a2b5d68d3762 req-0a87c02d-eac6-408e-88c5-3596e55550ec service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.649428 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1cb6dd6a-21da-4781-9d32-a2b5d68d3762 req-0a87c02d-eac6-408e-88c5-3596e55550ec service nova] Creating event network-changed:93b2a2b3-1bf6-47ff-9851-01934b486943 for instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa on n-h1-767704-28 Jul 14 14:54:29.669799 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1cb6dd6a-21da-4781-9d32-a2b5d68d3762 req-0a87c02d-eac6-408e-88c5-3596e55550ec service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069196 Jul 14 14:54:29.673144 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2437/4909] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:29.696529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-76f13ddf-3a26-4ed9-9ae1-cf2bdb6e07b1 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:29.697422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-76f13ddf-3a26-4ed9-9ae1-cf2bdb6e07b1 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:29.720026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76f13ddf-3a26-4ed9-9ae1-cf2bdb6e07b1 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.721560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76f13ddf-3a26-4ed9-9ae1-cf2bdb6e07b1 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.724995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76f13ddf-3a26-4ed9-9ae1-cf2bdb6e07b1 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.725719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76f13ddf-3a26-4ed9-9ae1-cf2bdb6e07b1 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.811052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:29.881853 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-44c2ea62-b730-4e9f-835c-ee3a459bdbb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 204 len: 0 microversion: 2.1 time: 0.456100 Jul 14 14:54:29.882835 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2473/4910] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:54:29 2022] DELETE /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:54:29.903214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9827283e-5e80-4f60-94db-2be86e545b5f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:29.904676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9827283e-5e80-4f60-94db-2be86e545b5f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:29.922189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9827283e-5e80-4f60-94db-2be86e545b5f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.923146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9827283e-5e80-4f60-94db-2be86e545b5f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.926697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9827283e-5e80-4f60-94db-2be86e545b5f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.927612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9827283e-5e80-4f60-94db-2be86e545b5f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:30.431043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9827283e-5e80-4f60-94db-2be86e545b5f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:30.442807 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9827283e-5e80-4f60-94db-2be86e545b5f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1512 microversion: 2.1 time: 0.554197 Jul 14 14:54:30.444815 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2474/4911] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:29 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1512 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:30.452555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-95b42f59-3172-43c9-bf57-c52ba6a2c0e9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:30.454866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-95b42f59-3172-43c9-bf57-c52ba6a2c0e9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:30.469057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95b42f59-3172-43c9-bf57-c52ba6a2c0e9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:30.470000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95b42f59-3172-43c9-bf57-c52ba6a2c0e9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:30.471656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95b42f59-3172-43c9-bf57-c52ba6a2c0e9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:30.472371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-95b42f59-3172-43c9-bf57-c52ba6a2c0e9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:30.489322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-76f13ddf-3a26-4ed9-9ae1-cf2bdb6e07b1 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:30.506998 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-76f13ddf-3a26-4ed9-9ae1-cf2bdb6e07b1 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1367 microversion: 2.1 time: 0.819670 Jul 14 14:54:30.513358 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2438/4912] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:29 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1367 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:31.166825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-95b42f59-3172-43c9-bf57-c52ba6a2c0e9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:31.182067 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-95b42f59-3172-43c9-bf57-c52ba6a2c0e9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1308 microversion: 2.1 time: 0.733460 Jul 14 14:54:31.183088 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2475/4913] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:30 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1308 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:31.471739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1814514f-f45d-4788-be0c-5b6ef06c1683 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:31.472616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1814514f-f45d-4788-be0c-5b6ef06c1683 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:31.496894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1814514f-f45d-4788-be0c-5b6ef06c1683 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:31.498378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1814514f-f45d-4788-be0c-5b6ef06c1683 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:31.498963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1814514f-f45d-4788-be0c-5b6ef06c1683 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:31.499605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1814514f-f45d-4788-be0c-5b6ef06c1683 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:31.544550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b779be9f-729f-4c6c-8911-9099ee3b4772 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:31.549081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b779be9f-729f-4c6c-8911-9099ee3b4772 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:31.599968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b779be9f-729f-4c6c-8911-9099ee3b4772 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:31.607057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b779be9f-729f-4c6c-8911-9099ee3b4772 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:31.611995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b779be9f-729f-4c6c-8911-9099ee3b4772 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:31.620403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b779be9f-729f-4c6c-8911-9099ee3b4772 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:32.336265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1814514f-f45d-4788-be0c-5b6ef06c1683 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:32.349920 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1814514f-f45d-4788-be0c-5b6ef06c1683 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1512 microversion: 2.1 time: 0.883190 Jul 14 14:54:32.352757 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2439/4914] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:31 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1512 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:32.381635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99b2319b-c7de-4f2f-9cda-4d5f8a2c55c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:32.382574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-99b2319b-c7de-4f2f-9cda-4d5f8a2c55c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:32.393403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99b2319b-c7de-4f2f-9cda-4d5f8a2c55c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:32.393913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99b2319b-c7de-4f2f-9cda-4d5f8a2c55c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:32.394797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99b2319b-c7de-4f2f-9cda-4d5f8a2c55c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:32.395243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99b2319b-c7de-4f2f-9cda-4d5f8a2c55c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:32.542208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b779be9f-729f-4c6c-8911-9099ee3b4772 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:32.567907 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b779be9f-729f-4c6c-8911-9099ee3b4772 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1367 microversion: 2.1 time: 1.031175 Jul 14 14:54:32.577189 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2476/4915] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:31 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1367 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:33.023215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-99b2319b-c7de-4f2f-9cda-4d5f8a2c55c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:33.044422 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99b2319b-c7de-4f2f-9cda-4d5f8a2c55c3 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1308 microversion: 2.1 time: 0.688954 Jul 14 14:54:33.047197 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2440/4916] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:32 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1308 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:33.174447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-88d81aa1-8ab7-44a3-b5c6-9e311c1c3a04 req-b042dfb7-f2fb-4028-91f3-ba95b7da9413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6793ce4-88ac-4900-88a8-05fbf34e971e", "tag": "df06d3aa-4905-48f7-8d1e-7546857779b3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:33.227047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-88d81aa1-8ab7-44a3-b5c6-9e311c1c3a04 req-b042dfb7-f2fb-4028-91f3-ba95b7da9413 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:33.233218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-88d81aa1-8ab7-44a3-b5c6-9e311c1c3a04 req-b042dfb7-f2fb-4028-91f3-ba95b7da9413 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:33.267295 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-88d81aa1-8ab7-44a3-b5c6-9e311c1c3a04 req-b042dfb7-f2fb-4028-91f3-ba95b7da9413 service nova] Creating event network-changed:df06d3aa-4905-48f7-8d1e-7546857779b3 for instance f6793ce4-88ac-4900-88a8-05fbf34e971e on n-h1-767704-28 Jul 14 14:54:33.274771 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-88d81aa1-8ab7-44a3-b5c6-9e311c1c3a04 req-b042dfb7-f2fb-4028-91f3-ba95b7da9413 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115107 Jul 14 14:54:33.281318 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2477/4917] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:33.375285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0ad9aef3-b7fd-42fb-bfdd-cdba67c64491 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:33.376328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0ad9aef3-b7fd-42fb-bfdd-cdba67c64491 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:33.391808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ad9aef3-b7fd-42fb-bfdd-cdba67c64491 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:33.392403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ad9aef3-b7fd-42fb-bfdd-cdba67c64491 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:33.396784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ad9aef3-b7fd-42fb-bfdd-cdba67c64491 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:33.397433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ad9aef3-b7fd-42fb-bfdd-cdba67c64491 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:33.587874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fc4f12ac-669e-470c-9bb1-fc95c5971cd0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:33.588692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fc4f12ac-669e-470c-9bb1-fc95c5971cd0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:33.603665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc4f12ac-669e-470c-9bb1-fc95c5971cd0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:33.604132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc4f12ac-669e-470c-9bb1-fc95c5971cd0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:33.605510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc4f12ac-669e-470c-9bb1-fc95c5971cd0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:33.606364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc4f12ac-669e-470c-9bb1-fc95c5971cd0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:34.078872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:34.168009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:34.223631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0ad9aef3-b7fd-42fb-bfdd-cdba67c64491 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:34.238145 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0ad9aef3-b7fd-42fb-bfdd-cdba67c64491 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 200 len: 1512 microversion: 2.1 time: 0.871650 Jul 14 14:54:34.239253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fc4f12ac-669e-470c-9bb1-fc95c5971cd0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:34.240773 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2441/4918] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:33 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 1512 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:34.255975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-147bced1-e0a0-47fa-baac-6198e634d50d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:34.258348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-147bced1-e0a0-47fa-baac-6198e634d50d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:34.258776 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fc4f12ac-669e-470c-9bb1-fc95c5971cd0 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1557 microversion: 2.1 time: 0.675557 Jul 14 14:54:34.259404 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2478/4919] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:33 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1557 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:34.282548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-147bced1-e0a0-47fa-baac-6198e634d50d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:34.283084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-147bced1-e0a0-47fa-baac-6198e634d50d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:34.283947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-147bced1-e0a0-47fa-baac-6198e634d50d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:34.287966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb004218-2476-4511-9288-d4894957a1cf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:34.288678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-147bced1-e0a0-47fa-baac-6198e634d50d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:34.288882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bb004218-2476-4511-9288-d4894957a1cf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:34.304937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb004218-2476-4511-9288-d4894957a1cf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:34.306144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb004218-2476-4511-9288-d4894957a1cf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:34.306426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb004218-2476-4511-9288-d4894957a1cf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:34.306881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb004218-2476-4511-9288-d4894957a1cf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:34.559581 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bb004218-2476-4511-9288-d4894957a1cf tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283542 Jul 14 14:54:34.560199 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2479/4920] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:54:34 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-interface => generated 284 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:34.859212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-147bced1-e0a0-47fa-baac-6198e634d50d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:34.882344 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-147bced1-e0a0-47fa-baac-6198e634d50d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1308 microversion: 2.1 time: 0.639983 Jul 14 14:54:34.883605 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2442/4921] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:34 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1308 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:35.092294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-d4065965-7ba0-4253-a47a-97e0d6749711 req-be766a11-2e57-49f7-b17a-78c36872a34a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f42c33-3241-4e35-b580-34bff52d73c4", "tag": "80264c6f-69b7-4369-84d7-44b85d806d82"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:35.111639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d4065965-7ba0-4253-a47a-97e0d6749711 req-be766a11-2e57-49f7-b17a-78c36872a34a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.112092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d4065965-7ba0-4253-a47a-97e0d6749711 req-be766a11-2e57-49f7-b17a-78c36872a34a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.126963 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-d4065965-7ba0-4253-a47a-97e0d6749711 req-be766a11-2e57-49f7-b17a-78c36872a34a service nova] Creating event network-changed:80264c6f-69b7-4369-84d7-44b85d806d82 for instance 03f42c33-3241-4e35-b580-34bff52d73c4 on n-h1-767704-28 Jul 14 14:54:35.133178 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-d4065965-7ba0-4253-a47a-97e0d6749711 req-be766a11-2e57-49f7-b17a-78c36872a34a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051414 Jul 14 14:54:35.138094 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2480/4922] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:54:35.260296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f9996b86-8a14-4ced-a02b-03a6d2426e53 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:35.260934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f9996b86-8a14-4ced-a02b-03a6d2426e53 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:35.268628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9996b86-8a14-4ced-a02b-03a6d2426e53 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.270420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9996b86-8a14-4ced-a02b-03a6d2426e53 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.274463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9996b86-8a14-4ced-a02b-03a6d2426e53 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.278038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f9996b86-8a14-4ced-a02b-03a6d2426e53 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.313882 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f9996b86-8a14-4ced-a02b-03a6d2426e53 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f9996b86-8a14-4ced-a02b-03a6d2426e53 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 HTTP/1.1 Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '8c224c96-7334-4d8a-a27a-8e3aac8c2d20'} Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:35.315637 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:35.322763 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:35.322763 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:35.322763 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:35.322763 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:35.322763 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:35.322763 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:54:35.322763 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:35.322763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f9996b86-8a14-4ced-a02b-03a6d2426e53 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:35.322763 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f9996b86-8a14-4ced-a02b-03a6d2426e53 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 404 len: 111 microversion: 2.1 time: 0.064957 Jul 14 14:54:35.322763 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2443/4923] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:35 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:35.330721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-48514273-25d9-4ea4-bceb-977fdb8ac39f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:35.331783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1bbe73ee-e53d-467a-902d-9c2029a9dbe4 req-cecb502b-be71-4842-a10e-cdadc28392ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c224c96-7334-4d8a-a27a-8e3aac8c2d20", "name": "network-vif-deleted", "tag": "288a2282-68b2-4539-885c-84991c2267b4"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:35.332367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-48514273-25d9-4ea4-bceb-977fdb8ac39f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:35.344085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1bbe73ee-e53d-467a-902d-9c2029a9dbe4 req-cecb502b-be71-4842-a10e-cdadc28392ca service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.344567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1bbe73ee-e53d-467a-902d-9c2029a9dbe4 req-cecb502b-be71-4842-a10e-cdadc28392ca service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.356713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48514273-25d9-4ea4-bceb-977fdb8ac39f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.357230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48514273-25d9-4ea4-bceb-977fdb8ac39f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.358308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48514273-25d9-4ea4-bceb-977fdb8ac39f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.358935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48514273-25d9-4ea4-bceb-977fdb8ac39f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.364729 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1bbe73ee-e53d-467a-902d-9c2029a9dbe4 req-cecb502b-be71-4842-a10e-cdadc28392ca service nova] Creating event network-vif-deleted:288a2282-68b2-4539-885c-84991c2267b4 for instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 on n-h2-767704-28 Jul 14 14:54:35.370657 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1bbe73ee-e53d-467a-902d-9c2029a9dbe4 req-cecb502b-be71-4842-a10e-cdadc28392ca service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042452 Jul 14 14:54:35.372027 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2444/4924] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:54:35.420174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:35.844682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-48514273-25d9-4ea4-bceb-977fdb8ac39f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:35.858440 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-48514273-25d9-4ea4-bceb-977fdb8ac39f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.534919 Jul 14 14:54:35.859044 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2481/4925] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:35 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:35.902464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-60adaba2-a479-499d-b126-4bcf12bd2f44 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:35.903546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-60adaba2-a479-499d-b126-4bcf12bd2f44 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:35.919008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60adaba2-a479-499d-b126-4bcf12bd2f44 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.921914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60adaba2-a479-499d-b126-4bcf12bd2f44 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.924577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60adaba2-a479-499d-b126-4bcf12bd2f44 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.926832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60adaba2-a479-499d-b126-4bcf12bd2f44 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:36.053689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3996821a-93b6-434e-8f78-ada638856f35 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3996821a-93b6-434e-8f78-ada638856f35 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 163 Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": 12345, "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'networks': [{'uuid': '8e3ef6f2-6d20-4870-adea-e8565b643562'}]}}} Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 12345 Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:54:36.065916 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:54:36.070891 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:54:36.070891 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 14 14:54:36.070891 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:36.070891 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:36.070891 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:36.070891 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:36.070891 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:36.070891 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:36.070891 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:54:36.070891 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:54:36.070891 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 14 14:54:36.070891 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:36.078377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3996821a-93b6-434e-8f78-ada638856f35 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:36.083457 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3996821a-93b6-434e-8f78-ada638856f35 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.033866 Jul 14 14:54:36.086295 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2482/4926] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:36 2022] POST /compute/v2.1/servers => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:54:36.102982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-029313dd-33fc-4d20-a797-121f74a634db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:36.108523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-029313dd-33fc-4d20-a797-121f74a634db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:36.133289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-029313dd-33fc-4d20-a797-121f74a634db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:36.133818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-029313dd-33fc-4d20-a797-121f74a634db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:36.134944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-029313dd-33fc-4d20-a797-121f74a634db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:36.135617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-029313dd-33fc-4d20-a797-121f74a634db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:36.578950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-60adaba2-a479-499d-b126-4bcf12bd2f44 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:36.590703 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-60adaba2-a479-499d-b126-4bcf12bd2f44 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1308 microversion: 2.1 time: 0.694103 Jul 14 14:54:36.592855 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2445/4927] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:35 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1308 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:36.733104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-029313dd-33fc-4d20-a797-121f74a634db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:36.742433 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-029313dd-33fc-4d20-a797-121f74a634db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.648247 Jul 14 14:54:36.743912 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2483/4928] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:36 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:36.764648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-525fa6b7-e53e-4aad-b9ec-37b2660b6b18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:36.765661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-525fa6b7-e53e-4aad-b9ec-37b2660b6b18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:36.778276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-525fa6b7-e53e-4aad-b9ec-37b2660b6b18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:36.778995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-525fa6b7-e53e-4aad-b9ec-37b2660b6b18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:36.780103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-525fa6b7-e53e-4aad-b9ec-37b2660b6b18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:36.780707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-525fa6b7-e53e-4aad-b9ec-37b2660b6b18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.522820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-525fa6b7-e53e-4aad-b9ec-37b2660b6b18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:37.537399 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-525fa6b7-e53e-4aad-b9ec-37b2660b6b18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.776263 Jul 14 14:54:37.542394 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2446/4929] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:36 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:37.578407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a901f00c-b791-4e09-a846-ca9600ff4dd0 req-f56c7002-ab3b-4b78-aaaa-f4142c277776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9e2f71-381c-4989-9db3-ee7cccb35a2a", "tag": "784131ad-46f8-4829-aa2e-78e6294d0f3b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:37.609168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-949958e6-f873-4842-917e-93601904753b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:37.609981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-949958e6-f873-4842-917e-93601904753b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:37.615685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a901f00c-b791-4e09-a846-ca9600ff4dd0 req-f56c7002-ab3b-4b78-aaaa-f4142c277776 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.616151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a901f00c-b791-4e09-a846-ca9600ff4dd0 req-f56c7002-ab3b-4b78-aaaa-f4142c277776 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.619006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-949958e6-f873-4842-917e-93601904753b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.619469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-949958e6-f873-4842-917e-93601904753b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.620266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-949958e6-f873-4842-917e-93601904753b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.620717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-949958e6-f873-4842-917e-93601904753b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.654079 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a901f00c-b791-4e09-a846-ca9600ff4dd0 req-f56c7002-ab3b-4b78-aaaa-f4142c277776 service nova] Creating event network-changed:784131ad-46f8-4829-aa2e-78e6294d0f3b for instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a on n-h2-767704-28 Jul 14 14:54:37.673641 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a901f00c-b791-4e09-a846-ca9600ff4dd0 req-f56c7002-ab3b-4b78-aaaa-f4142c277776 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100009 Jul 14 14:54:37.674991 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2484/4930] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:54:38.327700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-949958e6-f873-4842-917e-93601904753b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:38.344346 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-949958e6-f873-4842-917e-93601904753b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1308 microversion: 2.1 time: 0.739151 Jul 14 14:54:38.357426 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2447/4931] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:37 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1308 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:39.370476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cb4f0029-f76b-49bd-b90a-163561a6ecb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:39.372645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cb4f0029-f76b-49bd-b90a-163561a6ecb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:39.388812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb4f0029-f76b-49bd-b90a-163561a6ecb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:39.389815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb4f0029-f76b-49bd-b90a-163561a6ecb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:39.391973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb4f0029-f76b-49bd-b90a-163561a6ecb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:39.392730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb4f0029-f76b-49bd-b90a-163561a6ecb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:39.879411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cb4f0029-f76b-49bd-b90a-163561a6ecb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:39.895617 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cb4f0029-f76b-49bd-b90a-163561a6ecb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1308 microversion: 2.1 time: 0.533891 Jul 14 14:54:39.907786 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2485/4932] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:39 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1308 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:40.398290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-7264cfd7-b969-4471-95c2-ea1415a65ef2 req-f14d538b-494a-44c8-a0e6-fa9f9c1b62f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6793ce4-88ac-4900-88a8-05fbf34e971e", "name": "network-vif-plugged", "status": "completed", "tag": "df06d3aa-4905-48f7-8d1e-7546857779b3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:40.434792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7264cfd7-b969-4471-95c2-ea1415a65ef2 req-f14d538b-494a-44c8-a0e6-fa9f9c1b62f0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.439648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7264cfd7-b969-4471-95c2-ea1415a65ef2 req-f14d538b-494a-44c8-a0e6-fa9f9c1b62f0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.481411 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-7264cfd7-b969-4471-95c2-ea1415a65ef2 req-f14d538b-494a-44c8-a0e6-fa9f9c1b62f0 service nova] Creating event network-vif-plugged:df06d3aa-4905-48f7-8d1e-7546857779b3 for instance f6793ce4-88ac-4900-88a8-05fbf34e971e on n-h1-767704-28 Jul 14 14:54:40.499903 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-7264cfd7-b969-4471-95c2-ea1415a65ef2 req-f14d538b-494a-44c8-a0e6-fa9f9c1b62f0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105841 Jul 14 14:54:40.502806 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2448/4933] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:40.710986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-da72308b-12b7-4667-abf7-0712931ae1f8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1912976821", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "76dca811-4ff3-40b5-b216-75cd49006149", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:40.820581 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-da72308b-12b7-4667-abf7-0712931ae1f8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Block Device 76dca811-4ff3-40b5-b216-75cd49006149 is not bootable. Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-da72308b-12b7-4667-abf7-0712931ae1f8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 358 Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1912976821", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "76dca811-4ff3-40b5-b216-75cd49006149", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: exception: Block Device 76dca811-4ff3-40b5-b216-75cd49006149 is not bootable. Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1912976821', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '76dca811-4ff3-40b5-b216-75cd49006149'}], 'networks': [{'uuid': '8e3ef6f2-6d20-4870-adea-e8565b643562'}]}}} Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 76dca811-4ff3-40b5-b216-75cd49006149 is not bootable. Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:40.833908 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 76dca811-4ff3-40b5-b216-75cd49006149 is not bootable. Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 76dca811-4ff3-40b5-b216-75cd49006149 is not bootable. Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-da72308b-12b7-4667-abf7-0712931ae1f8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Block Device 76dca811-4ff3-40b5-b216-75cd49006149 is not bootable. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:40.837932 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-da72308b-12b7-4667-abf7-0712931ae1f8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.129272 Jul 14 14:54:40.841630 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2486/4934] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:40 2022] POST /compute/v2.1/servers => generated 110 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:54:40.860105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-422f59d2-0661-43af-9861-9abbf1ff7b2e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:40.861055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-422f59d2-0661-43af-9861-9abbf1ff7b2e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:40.867844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-422f59d2-0661-43af-9861-9abbf1ff7b2e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.868662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-422f59d2-0661-43af-9861-9abbf1ff7b2e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.869583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-422f59d2-0661-43af-9861-9abbf1ff7b2e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.870095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-422f59d2-0661-43af-9861-9abbf1ff7b2e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.914730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-90afff8e-e78e-48c5-9658-248079ea89b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:40.915355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-90afff8e-e78e-48c5-9658-248079ea89b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:40.922768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90afff8e-e78e-48c5-9658-248079ea89b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.923486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90afff8e-e78e-48c5-9658-248079ea89b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.924465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90afff8e-e78e-48c5-9658-248079ea89b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.925313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90afff8e-e78e-48c5-9658-248079ea89b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.097623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-422f59d2-0661-43af-9861-9abbf1ff7b2e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:41.108863 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-422f59d2-0661-43af-9861-9abbf1ff7b2e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.266092 Jul 14 14:54:41.115026 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2449/4935] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:40 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:41.138139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e353503f-344d-44f5-a540-1e69d35735ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:41.138773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e353503f-344d-44f5-a540-1e69d35735ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:41.149011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-90afff8e-e78e-48c5-9658-248079ea89b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:41.149575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:41.151410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e353503f-344d-44f5-a540-1e69d35735ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.152164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e353503f-344d-44f5-a540-1e69d35735ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.161430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e353503f-344d-44f5-a540-1e69d35735ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.162030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e353503f-344d-44f5-a540-1e69d35735ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.177323 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-90afff8e-e78e-48c5-9658-248079ea89b0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1308 microversion: 2.1 time: 0.266979 Jul 14 14:54:41.178297 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2487/4936] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:40 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:41.381523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e353503f-344d-44f5-a540-1e69d35735ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:41.392684 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e353503f-344d-44f5-a540-1e69d35735ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.258227 Jul 14 14:54:41.394474 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2450/4937] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:41 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:42.194286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e6c7cc4d-be46-4b73-bb49-577e6119e2fc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:42.196776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e6c7cc4d-be46-4b73-bb49-577e6119e2fc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:42.214960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6c7cc4d-be46-4b73-bb49-577e6119e2fc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:42.216262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6c7cc4d-be46-4b73-bb49-577e6119e2fc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:42.219268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6c7cc4d-be46-4b73-bb49-577e6119e2fc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:42.219803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6c7cc4d-be46-4b73-bb49-577e6119e2fc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:42.665095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e6c7cc4d-be46-4b73-bb49-577e6119e2fc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:42.674345 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e6c7cc4d-be46-4b73-bb49-577e6119e2fc tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1308 microversion: 2.1 time: 0.484406 Jul 14 14:54:42.675381 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2488/4938] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:42 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1308 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:43.692051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7346a411-e85a-4294-a8f1-d8c8f94cf5a2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:43.692874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7346a411-e85a-4294-a8f1-d8c8f94cf5a2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:43.701406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7346a411-e85a-4294-a8f1-d8c8f94cf5a2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:43.702154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7346a411-e85a-4294-a8f1-d8c8f94cf5a2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:43.702954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7346a411-e85a-4294-a8f1-d8c8f94cf5a2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:43.703619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7346a411-e85a-4294-a8f1-d8c8f94cf5a2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:43.988314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7346a411-e85a-4294-a8f1-d8c8f94cf5a2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:43.998964 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7346a411-e85a-4294-a8f1-d8c8f94cf5a2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1490 microversion: 2.1 time: 0.310755 Jul 14 14:54:44.000464 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2451/4939] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:43 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1490 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:44.000589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-217a978a-37de-4b40-97d3-9da880ca14ba tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2041123589", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "destination_type": "local"}, {"source_type": "volume", "uuid": "7f0a34e0-c7d0-469f-96b7-b54019ccc27a", "destination_type": "invalid"}], "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-217a978a-37de-4b40-97d3-9da880ca14ba tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 495 Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2041123589", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "destination_type": "local"}, {"source_type": "volume", "uuid": "7f0a34e0-c7d0-469f-96b7-b54019ccc27a", "destination_type": "invalid"}], "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2041123589', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '7f0a34e0-c7d0-469f-96b7-b54019ccc27a', 'destination_type': 'invalid'}], 'networks': [{'uuid': '8e3ef6f2-6d20-4870-adea-e8565b643562'}]}}} Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'invalid' Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:44.003564 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-217a978a-37de-4b40-97d3-9da880ca14ba tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:44.007084 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-217a978a-37de-4b40-97d3-9da880ca14ba tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009379 Jul 14 14:54:44.011011 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2489/4940] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:43 2022] POST /compute/v2.1/servers => generated 155 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:54:44.015733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f0e98130-7db7-41dc-813c-f112750864db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:44.016696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f0e98130-7db7-41dc-813c-f112750864db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:44.020778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-42d0945b-2fb1-4949-9a14-21fd35ea803d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-954340070"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:44.022015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-42d0945b-2fb1-4949-9a14-21fd35ea803d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:44.025322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0e98130-7db7-41dc-813c-f112750864db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.026082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0e98130-7db7-41dc-813c-f112750864db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.027143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0e98130-7db7-41dc-813c-f112750864db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.028362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0e98130-7db7-41dc-813c-f112750864db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.048176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42d0945b-2fb1-4949-9a14-21fd35ea803d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.048641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42d0945b-2fb1-4949-9a14-21fd35ea803d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.049503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42d0945b-2fb1-4949-9a14-21fd35ea803d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.049952 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42d0945b-2fb1-4949-9a14-21fd35ea803d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.166656 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-42d0945b-2fb1-4949-9a14-21fd35ea803d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "PUT /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1075 microversion: 2.1 time: 0.152277 Jul 14 14:54:44.167773 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2490/4941] 10.222.0.81 () {60 vars in 1255 bytes} [Thu Jul 14 14:54:44 2022] PUT /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1075 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:44.189535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ee0ac92b-08db-4cae-8c66-ec1fb93b87ee tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:44.190660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ee0ac92b-08db-4cae-8c66-ec1fb93b87ee tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:44.200590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee0ac92b-08db-4cae-8c66-ec1fb93b87ee tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.201776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee0ac92b-08db-4cae-8c66-ec1fb93b87ee tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.202872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee0ac92b-08db-4cae-8c66-ec1fb93b87ee tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.203469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee0ac92b-08db-4cae-8c66-ec1fb93b87ee tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.250118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f0e98130-7db7-41dc-813c-f112750864db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:44.269942 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f0e98130-7db7-41dc-813c-f112750864db tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.258490 Jul 14 14:54:44.271504 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2452/4942] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:44 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:44.290019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf8aa63c-1b83-440b-a222-16352c3a59f7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:44.290872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bf8aa63c-1b83-440b-a222-16352c3a59f7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:44.301093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf8aa63c-1b83-440b-a222-16352c3a59f7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.301937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf8aa63c-1b83-440b-a222-16352c3a59f7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.302987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf8aa63c-1b83-440b-a222-16352c3a59f7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.303666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf8aa63c-1b83-440b-a222-16352c3a59f7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.517498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ee0ac92b-08db-4cae-8c66-ec1fb93b87ee tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:44.531885 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ee0ac92b-08db-4cae-8c66-ec1fb93b87ee tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1501 microversion: 2.1 time: 0.352176 Jul 14 14:54:44.532789 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2491/4943] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:44 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1501 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:44.549805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1f8267c6-2626-477f-9689-423987bf0f08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:44.560171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f8267c6-2626-477f-9689-423987bf0f08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:44.572603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:44.576377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f8267c6-2626-477f-9689-423987bf0f08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.577333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f8267c6-2626-477f-9689-423987bf0f08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.578311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f8267c6-2626-477f-9689-423987bf0f08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.578921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f8267c6-2626-477f-9689-423987bf0f08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.624148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bf8aa63c-1b83-440b-a222-16352c3a59f7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:44.632481 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf8aa63c-1b83-440b-a222-16352c3a59f7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.346980 Jul 14 14:54:44.645737 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2453/4944] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:44 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:44.712799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cdd6ebed-4ece-4fd3-afbb-8ee66431f799 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1688046851", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cdd6ebed-4ece-4fd3-afbb-8ee66431f799 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 492 Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1688046851", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1688046851', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '8e3ef6f2-6d20-4870-adea-e8565b643562'}]}}} Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 14 14:54:44.717338 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 14 14:54:44.720331 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:44.724141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cdd6ebed-4ece-4fd3-afbb-8ee66431f799 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:44.725046 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cdd6ebed-4ece-4fd3-afbb-8ee66431f799 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.017428 Jul 14 14:54:44.729005 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2454/4945] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:44 2022] POST /compute/v2.1/servers => generated 624 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:54:44.734877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-59613a3d-b3a3-4df1-950e-c4ca656420bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:44.735511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-59613a3d-b3a3-4df1-950e-c4ca656420bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:44.744852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59613a3d-b3a3-4df1-950e-c4ca656420bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.745559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59613a3d-b3a3-4df1-950e-c4ca656420bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.746501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59613a3d-b3a3-4df1-950e-c4ca656420bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.747086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59613a3d-b3a3-4df1-950e-c4ca656420bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.017588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f8267c6-2626-477f-9689-423987bf0f08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:45.027746 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1f8267c6-2626-477f-9689-423987bf0f08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1501 microversion: 2.1 time: 0.481650 Jul 14 14:54:45.028788 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2492/4946] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:44 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1501 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:45.045968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8381b18c-b376-4e24-89c6-07c03ee69d2b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:45.053598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8381b18c-b376-4e24-89c6-07c03ee69d2b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.054163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8381b18c-b376-4e24-89c6-07c03ee69d2b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.100403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8381b18c-b376-4e24-89c6-07c03ee69d2b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Going to try to stop instance {{(pid=119512) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:54:45.103807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-59613a3d-b3a3-4df1-950e-c4ca656420bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:45.108821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:45.133531 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-59613a3d-b3a3-4df1-950e-c4ca656420bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.403166 Jul 14 14:54:45.134156 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2455/4947] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:44 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:45.154476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-777320a7-2dd0-4b95-baf2-ba930965601d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:45.155528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-777320a7-2dd0-4b95-baf2-ba930965601d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:45.169021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-777320a7-2dd0-4b95-baf2-ba930965601d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.170054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-777320a7-2dd0-4b95-baf2-ba930965601d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.171411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-777320a7-2dd0-4b95-baf2-ba930965601d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.172182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-777320a7-2dd0-4b95-baf2-ba930965601d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.211298 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8381b18c-b376-4e24-89c6-07c03ee69d2b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "POST /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e/action" status: 202 len: 0 microversion: 2.1 time: 0.170535 Jul 14 14:54:45.212583 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2493/4948] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:54:45 2022] POST /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:54:45.225544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8eae4119-bf65-4e32-8e9c-e8415c5cda8b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:45.228256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8eae4119-bf65-4e32-8e9c-e8415c5cda8b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:45.245484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8eae4119-bf65-4e32-8e9c-e8415c5cda8b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.246002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8eae4119-bf65-4e32-8e9c-e8415c5cda8b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.247600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8eae4119-bf65-4e32-8e9c-e8415c5cda8b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.248200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8eae4119-bf65-4e32-8e9c-e8415c5cda8b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.254051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:45.676360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8eae4119-bf65-4e32-8e9c-e8415c5cda8b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:45.687849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-777320a7-2dd0-4b95-baf2-ba930965601d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:45.701132 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8eae4119-bf65-4e32-8e9c-e8415c5cda8b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.482342 Jul 14 14:54:45.711056 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2494/4949] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:45 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:45.711272 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-777320a7-2dd0-4b95-baf2-ba930965601d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.556052 Jul 14 14:54:45.711272 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2456/4950] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:45 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:45.797478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-196bfb54-f542-4794-8936-2e201a9603bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-196bfb54-f542-4794-8936-2e201a9603bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 416 Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'networks': [{'uuid': '8e3ef6f2-6d20-4870-adea-e8565b643562'}]}}} Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:45.800202 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-196bfb54-f542-4794-8936-2e201a9603bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-196bfb54-f542-4794-8936-2e201a9603bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009297 Jul 14 14:54:45.815833 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2495/4951] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:45 2022] POST /compute/v2.1/servers => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:54:45.817616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9c4e0732-dbc0-4518-868b-fa5d060c1b09 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:45.817616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9c4e0732-dbc0-4518-868b-fa5d060c1b09 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:45.824696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c4e0732-dbc0-4518-868b-fa5d060c1b09 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.825858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c4e0732-dbc0-4518-868b-fa5d060c1b09 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.826861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c4e0732-dbc0-4518-868b-fa5d060c1b09 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.827317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c4e0732-dbc0-4518-868b-fa5d060c1b09 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.101693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9c4e0732-dbc0-4518-868b-fa5d060c1b09 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:46.113382 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9c4e0732-dbc0-4518-868b-fa5d060c1b09 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.305802 Jul 14 14:54:46.129812 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2457/4952] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:45 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:46.145650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-907727cd-91a6-4c16-adc4-9ebd1fdbb7d6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:46.146300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-907727cd-91a6-4c16-adc4-9ebd1fdbb7d6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:46.156620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-907727cd-91a6-4c16-adc4-9ebd1fdbb7d6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:46.157142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-907727cd-91a6-4c16-adc4-9ebd1fdbb7d6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.157985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-907727cd-91a6-4c16-adc4-9ebd1fdbb7d6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:46.158446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-907727cd-91a6-4c16-adc4-9ebd1fdbb7d6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.411750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-907727cd-91a6-4c16-adc4-9ebd1fdbb7d6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:46.424072 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-907727cd-91a6-4c16-adc4-9ebd1fdbb7d6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.283916 Jul 14 14:54:46.430683 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2496/4953] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:46 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:46.494386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8251162a-ec46-40a1-a7d7-93f23141c11f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1042830453", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": -1, "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:46.505841 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-8251162a-ec46-40a1-a7d7-93f23141c11f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Flavor -1 could not be found. Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8251162a-ec46-40a1-a7d7-93f23141c11f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 206 Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1042830453", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": -1, "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: exception: Flavor -1 could not be found. Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1042830453', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': -1, 'networks': [{'uuid': '8e3ef6f2-6d20-4870-adea-e8565b643562'}]}}} Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 780, in create Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:46.508155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8251162a-ec46-40a1-a7d7-93f23141c11f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:46.512609 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8251162a-ec46-40a1-a7d7-93f23141c11f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.021025 Jul 14 14:54:46.515701 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2458/4954] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:46 2022] POST /compute/v2.1/servers => generated 73 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:54:46.520689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-48190091-9348-416a-911d-5a8515c419e8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:46.521345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-48190091-9348-416a-911d-5a8515c419e8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:46.529415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48190091-9348-416a-911d-5a8515c419e8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:46.529878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48190091-9348-416a-911d-5a8515c419e8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.530723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48190091-9348-416a-911d-5a8515c419e8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:46.531330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48190091-9348-416a-911d-5a8515c419e8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.720296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b7b41671-2918-4d69-a1b4-270eb4453216 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:46.721533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b7b41671-2918-4d69-a1b4-270eb4453216 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:46.731102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7b41671-2918-4d69-a1b4-270eb4453216 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:46.731746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7b41671-2918-4d69-a1b4-270eb4453216 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.732635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7b41671-2918-4d69-a1b4-270eb4453216 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:46.733754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7b41671-2918-4d69-a1b4-270eb4453216 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.770353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-48190091-9348-416a-911d-5a8515c419e8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:46.779988 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-48190091-9348-416a-911d-5a8515c419e8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.263144 Jul 14 14:54:46.780789 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2497/4955] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:46 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:46.799438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e8d2082b-41cb-499a-838e-514801523e06 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:46.800434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e8d2082b-41cb-499a-838e-514801523e06 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:46.811485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8d2082b-41cb-499a-838e-514801523e06 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:46.812173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8d2082b-41cb-499a-838e-514801523e06 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.813233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8d2082b-41cb-499a-838e-514801523e06 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:46.813870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e8d2082b-41cb-499a-838e-514801523e06 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.911714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b7b41671-2918-4d69-a1b4-270eb4453216 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:46.922035 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b7b41671-2918-4d69-a1b4-270eb4453216 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.206918 Jul 14 14:54:46.932436 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2459/4956] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:46 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:47.094555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e8d2082b-41cb-499a-838e-514801523e06 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:47.105163 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e8d2082b-41cb-499a-838e-514801523e06 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.309474 Jul 14 14:54:47.115964 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2498/4957] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:46 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:47.167084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fc2e6761-d61c-4eb5-be21-63cfbf2fddaa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-711771444", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fc2e6761-d61c-4eb5-be21-63cfbf2fddaa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 172 Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-711771444", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-711771444', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '8e3ef6f2-6d20-4870-adea-e8565b643562'}]}}} Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi -1 Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:54:47.171120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fc2e6761-d61c-4eb5-be21-63cfbf2fddaa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fc2e6761-d61c-4eb5-be21-63cfbf2fddaa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.009548 Jul 14 14:54:47.175236 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2460/4958] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:47 2022] POST /compute/v2.1/servers => generated 145 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:54:47.181490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6c9a3e1b-974f-497f-8013-a03c8381fe54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:47.182218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6c9a3e1b-974f-497f-8013-a03c8381fe54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:47.190877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c9a3e1b-974f-497f-8013-a03c8381fe54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.191476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c9a3e1b-974f-497f-8013-a03c8381fe54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.192376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c9a3e1b-974f-497f-8013-a03c8381fe54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.192931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c9a3e1b-974f-497f-8013-a03c8381fe54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.531915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6c9a3e1b-974f-497f-8013-a03c8381fe54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:47.539830 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6c9a3e1b-974f-497f-8013-a03c8381fe54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.362411 Jul 14 14:54:47.540427 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2499/4959] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:47 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:47.558221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cc50a2ef-5561-4197-a679-7a03d2e1b58d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:47.559383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cc50a2ef-5561-4197-a679-7a03d2e1b58d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:47.567073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc50a2ef-5561-4197-a679-7a03d2e1b58d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.567782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc50a2ef-5561-4197-a679-7a03d2e1b58d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.568749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc50a2ef-5561-4197-a679-7a03d2e1b58d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.569204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc50a2ef-5561-4197-a679-7a03d2e1b58d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.853937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cc50a2ef-5561-4197-a679-7a03d2e1b58d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:47.862173 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cc50a2ef-5561-4197-a679-7a03d2e1b58d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.307756 Jul 14 14:54:47.876980 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2461/4960] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:47 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:47.940257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0597da73-7a29-439c-ac77-d51b5a10ad80 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-771729874", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:47.942088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-64d142b6-1b9a-4252-a156-c07b8168fa1d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:47.943311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-64d142b6-1b9a-4252-a156-c07b8168fa1d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:47.946703 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-0597da73-7a29-439c-ac77-d51b5a10ad80 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0597da73-7a29-439c-ac77-d51b5a10ad80 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 215 Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-771729874", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-771729874', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 775, in create Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 549, in _process_networks_for_create Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 449, in _get_requested_networks Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 398, in _validate_network_id Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:47.948552 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.953924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:47.953924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:47.953924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:47.953924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:47.953924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:47.953924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 14 14:54:47.953924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.953924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0597da73-7a29-439c-ac77-d51b5a10ad80 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:47.954966 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0597da73-7a29-439c-ac77-d51b5a10ad80 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.023436 Jul 14 14:54:47.955966 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2500/4961] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:47 2022] POST /compute/v2.1/servers => generated 123 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:54:47.957313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64d142b6-1b9a-4252-a156-c07b8168fa1d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.957947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64d142b6-1b9a-4252-a156-c07b8168fa1d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.958953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64d142b6-1b9a-4252-a156-c07b8168fa1d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.959545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64d142b6-1b9a-4252-a156-c07b8168fa1d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.966281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b86312c-407d-4a3f-b5e4-53eaa4d1d937 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:47.966760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1b86312c-407d-4a3f-b5e4-53eaa4d1d937 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:47.979247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b86312c-407d-4a3f-b5e4-53eaa4d1d937 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.979702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b86312c-407d-4a3f-b5e4-53eaa4d1d937 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.981214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b86312c-407d-4a3f-b5e4-53eaa4d1d937 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.981470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b86312c-407d-4a3f-b5e4-53eaa4d1d937 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:48.285313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-64d142b6-1b9a-4252-a156-c07b8168fa1d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:48.304977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1b86312c-407d-4a3f-b5e4-53eaa4d1d937 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:48.307097 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-64d142b6-1b9a-4252-a156-c07b8168fa1d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.370301 Jul 14 14:54:48.307916 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2462/4962] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:47 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:48.330647 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1b86312c-407d-4a3f-b5e4-53eaa4d1d937 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.368603 Jul 14 14:54:48.331351 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2501/4963] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:47 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:48.349271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9d7366d-5cdf-4b69-8080-dd3686a8be98 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:48.349904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c9d7366d-5cdf-4b69-8080-dd3686a8be98 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:48.358657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9d7366d-5cdf-4b69-8080-dd3686a8be98 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:48.359308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9d7366d-5cdf-4b69-8080-dd3686a8be98 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:48.360139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9d7366d-5cdf-4b69-8080-dd3686a8be98 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:48.360598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9d7366d-5cdf-4b69-8080-dd3686a8be98 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:48.528641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c9d7366d-5cdf-4b69-8080-dd3686a8be98 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:48.539361 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c9d7366d-5cdf-4b69-8080-dd3686a8be98 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.194002 Jul 14 14:54:48.541034 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2463/4964] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:48 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:48.761180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-14f56cf5-8a5c-48a6-937b-997781704848 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1897760364", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "key_name": "tempest-key-1086750678", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:48.845304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-14f56cf5-8a5c-48a6-937b-997781704848 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] validate_networks() for [('8e3ef6f2-6d20-4870-adea-e8565b643562', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:54:49.323759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0235a1d0-ad1d-410b-af9a-556d735f9809 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.326473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0235a1d0-ad1d-410b-af9a-556d735f9809 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:49.335510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0235a1d0-ad1d-410b-af9a-556d735f9809 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.336356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0235a1d0-ad1d-410b-af9a-556d735f9809 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.337495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0235a1d0-ad1d-410b-af9a-556d735f9809 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.338184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0235a1d0-ad1d-410b-af9a-556d735f9809 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.511009 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-14f56cf5-8a5c-48a6-937b-997781704848 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Invalid key_name provided. Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-14f56cf5-8a5c-48a6-937b-997781704848 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 247 Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1897760364", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "key_name": "tempest-key-1086750678", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid key_name provided. Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1897760364', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'key_name': 'tempest-key-1086750678', 'networks': [{'uuid': '8e3ef6f2-6d20-4870-adea-e8565b643562'}]}}} Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1086750678 not found for user 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.514554 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 809, in create Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 14 14:54:49.517921 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.520778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-14f56cf5-8a5c-48a6-937b-997781704848 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Invalid key_name provided. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:49.523514 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-14f56cf5-8a5c-48a6-937b-997781704848 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.766522 Jul 14 14:54:49.526340 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2502/4965] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 770 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:54:49.537984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7758bd2e-66a4-44ac-a3fb-1fa3312bc8cf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.539034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7758bd2e-66a4-44ac-a3fb-1fa3312bc8cf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:49.558296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7758bd2e-66a4-44ac-a3fb-1fa3312bc8cf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.561782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7758bd2e-66a4-44ac-a3fb-1fa3312bc8cf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.562885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7758bd2e-66a4-44ac-a3fb-1fa3312bc8cf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.564363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7758bd2e-66a4-44ac-a3fb-1fa3312bc8cf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.674816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0235a1d0-ad1d-410b-af9a-556d735f9809 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:49.682827 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0235a1d0-ad1d-410b-af9a-556d735f9809 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.362926 Jul 14 14:54:49.686830 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2464/4966] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:49 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:49.839608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7758bd2e-66a4-44ac-a3fb-1fa3312bc8cf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:49.847947 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7758bd2e-66a4-44ac-a3fb-1fa3312bc8cf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.314074 Jul 14 14:54:49.848609 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2503/4967] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:49 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:49.870174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-baa3c57a-d97e-4ed8-8744-a69a2cf0c2df tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.871547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-baa3c57a-d97e-4ed8-8744-a69a2cf0c2df tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:49.878406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baa3c57a-d97e-4ed8-8744-a69a2cf0c2df tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.879101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baa3c57a-d97e-4ed8-8744-a69a2cf0c2df tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.880050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baa3c57a-d97e-4ed8-8744-a69a2cf0c2df tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.880692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baa3c57a-d97e-4ed8-8744-a69a2cf0c2df tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.073851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-baa3c57a-d97e-4ed8-8744-a69a2cf0c2df tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:50.082804 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-baa3c57a-d97e-4ed8-8744-a69a2cf0c2df tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.219413 Jul 14 14:54:50.083934 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2465/4968] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:49 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:50.214437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a0e5744-ce51-490d-9316-c324acf8bf2f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-643838767", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:50.389936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.security_group_api [None req-0a0e5744-ce51-490d-9316-c324acf8bf2f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Neutron security group does_not_exist not found {{(pid=119512) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 14 14:54:50.390992 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-0a0e5744-ce51-490d-9316-c324acf8bf2f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a0e5744-ce51-490d-9316-c324acf8bf2f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 257 Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-643838767", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-643838767', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '8e3ef6f2-6d20-4870-adea-e8565b643562'}]}}} Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 14 14:54:50.403774 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 14 14:54:50.410406 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:50.419850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a0e5744-ce51-490d-9316-c324acf8bf2f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:50.419850 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0a0e5744-ce51-490d-9316-c324acf8bf2f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.205149 Jul 14 14:54:50.419850 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2504/4969] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:54:50.429885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7c1657bb-dc1e-44c7-87ac-61e6578bb6aa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:50.431046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7c1657bb-dc1e-44c7-87ac-61e6578bb6aa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:50.441538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c1657bb-dc1e-44c7-87ac-61e6578bb6aa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:50.442135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c1657bb-dc1e-44c7-87ac-61e6578bb6aa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.443053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c1657bb-dc1e-44c7-87ac-61e6578bb6aa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:50.443747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c1657bb-dc1e-44c7-87ac-61e6578bb6aa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.702927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-70c5b380-2ede-4ec7-9c05-bbb3567b4177 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:50.703554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-70c5b380-2ede-4ec7-9c05-bbb3567b4177 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:50.706569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c1657bb-dc1e-44c7-87ac-61e6578bb6aa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:50.711274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70c5b380-2ede-4ec7-9c05-bbb3567b4177 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:50.711742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70c5b380-2ede-4ec7-9c05-bbb3567b4177 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.712544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70c5b380-2ede-4ec7-9c05-bbb3567b4177 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:50.714468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70c5b380-2ede-4ec7-9c05-bbb3567b4177 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.717999 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7c1657bb-dc1e-44c7-87ac-61e6578bb6aa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.294873 Jul 14 14:54:50.718936 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2466/4970] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:50 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:50.738707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80a9050a-6933-46dd-8117-4649daa64f05 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:50.739483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80a9050a-6933-46dd-8117-4649daa64f05 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:50.750479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a9050a-6933-46dd-8117-4649daa64f05 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:50.750935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a9050a-6933-46dd-8117-4649daa64f05 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.751982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a9050a-6933-46dd-8117-4649daa64f05 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:50.752786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a9050a-6933-46dd-8117-4649daa64f05 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.995784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-70c5b380-2ede-4ec7-9c05-bbb3567b4177 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:50.998770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-80a9050a-6933-46dd-8117-4649daa64f05 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:51.007590 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80a9050a-6933-46dd-8117-4649daa64f05 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.273117 Jul 14 14:54:51.009370 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2467/4971] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:50 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:51.017570 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-70c5b380-2ede-4ec7-9c05-bbb3567b4177 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.310790 Jul 14 14:54:51.026320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7da931dd-c5f8-444d-80f3-391e03e7b091 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:51.026824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7da931dd-c5f8-444d-80f3-391e03e7b091 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: a8766aff-78ff-42c9-b85a-968377db0657] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:51.029601 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2505/4972] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:50 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:51.034036 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-7da931dd-c5f8-444d-80f3-391e03e7b091 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance a8766aff-78ff-42c9-b85a-968377db0657 could not be found. Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7da931dd-c5f8-444d-80f3-391e03e7b091 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/a8766aff-78ff-42c9-b85a-968377db0657 HTTP/1.1 Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance a8766aff-78ff-42c9-b85a-968377db0657 could not be found. Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'a8766aff-78ff-42c9-b85a-968377db0657'} Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8766aff-78ff-42c9-b85a-968377db0657 could not be found. Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8766aff-78ff-42c9-b85a-968377db0657 could not be found. Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:51.035600 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:51.039679 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:51.039679 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:51.039679 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:51.039679 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:51.039679 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:51.039679 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8766aff-78ff-42c9-b85a-968377db0657 could not be found. Jul 14 14:54:51.039679 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:51.040907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7da931dd-c5f8-444d-80f3-391e03e7b091 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance a8766aff-78ff-42c9-b85a-968377db0657 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:51.041979 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7da931dd-c5f8-444d-80f3-391e03e7b091 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a8766aff-78ff-42c9-b85a-968377db0657" status: 404 len: 111 microversion: 2.1 time: 0.019703 Jul 14 14:54:51.043446 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2468/4973] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:54:51 2022] DELETE /compute/v2.1/servers/a8766aff-78ff-42c9-b85a-968377db0657 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:54:51.054964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f1552ad-f2b8-44e7-acba-cbc5f8b8c073 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:51.056272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f1552ad-f2b8-44e7-acba-cbc5f8b8c073 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:51.066586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f1552ad-f2b8-44e7-acba-cbc5f8b8c073 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:51.067431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f1552ad-f2b8-44e7-acba-cbc5f8b8c073 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:51.068472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f1552ad-f2b8-44e7-acba-cbc5f8b8c073 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:51.091719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f1552ad-f2b8-44e7-acba-cbc5f8b8c073 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:51.330656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f1552ad-f2b8-44e7-acba-cbc5f8b8c073 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:51.339044 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f1552ad-f2b8-44e7-acba-cbc5f8b8c073 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.291132 Jul 14 14:54:51.352342 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2506/4974] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:51 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:51.361118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0f87f6a1-96b7-4273-b398-69ed5042a3a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:51.362299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0f87f6a1-96b7-4273-b398-69ed5042a3a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:51.374957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f87f6a1-96b7-4273-b398-69ed5042a3a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:51.375847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f87f6a1-96b7-4273-b398-69ed5042a3a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:51.377227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f87f6a1-96b7-4273-b398-69ed5042a3a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:51.379051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f87f6a1-96b7-4273-b398-69ed5042a3a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:51.600312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0f87f6a1-96b7-4273-b398-69ed5042a3a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:51.610864 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0f87f6a1-96b7-4273-b398-69ed5042a3a8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.255302 Jul 14 14:54:51.615619 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2469/4975] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:51 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:51.638444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aedf8da3-c478-4fc2-a5ef-6217d5e4fc42 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:51.638949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aedf8da3-c478-4fc2-a5ef-6217d5e4fc42 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 14:54:51.639451 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-aedf8da3-c478-4fc2-a5ef-6217d5e4fc42 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aedf8da3-c478-4fc2-a5ef-6217d5e4fc42 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 9223372036854775808 could not be found. Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '9223372036854775808'} Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:51.641477 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:51.644805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:51.644805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:51.644805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:51.644805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 14 14:54:51.644805 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:51.644805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aedf8da3-c478-4fc2-a5ef-6217d5e4fc42 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:51.645196 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aedf8da3-c478-4fc2-a5ef-6217d5e4fc42 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.012883 Jul 14 14:54:51.650254 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2507/4976] 10.222.0.81 () {58 vars in 1187 bytes} [Thu Jul 14 14:54:51 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:54:51.658959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5d895302-47ab-429c-a235-33a9e0fd7564 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:51.659923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5d895302-47ab-429c-a235-33a9e0fd7564 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:51.670478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d895302-47ab-429c-a235-33a9e0fd7564 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:51.671567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d895302-47ab-429c-a235-33a9e0fd7564 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:51.672867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d895302-47ab-429c-a235-33a9e0fd7564 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:51.673566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d895302-47ab-429c-a235-33a9e0fd7564 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:51.895855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5d895302-47ab-429c-a235-33a9e0fd7564 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:51.907609 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5d895302-47ab-429c-a235-33a9e0fd7564 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.253283 Jul 14 14:54:51.920397 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2470/4977] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:51 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:51.930382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb563f8b-f249-45fc-8c06-1d5f19cc3e40 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:51.931540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bb563f8b-f249-45fc-8c06-1d5f19cc3e40 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:51.942050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb563f8b-f249-45fc-8c06-1d5f19cc3e40 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:51.942608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb563f8b-f249-45fc-8c06-1d5f19cc3e40 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:51.943723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb563f8b-f249-45fc-8c06-1d5f19cc3e40 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:51.944466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb563f8b-f249-45fc-8c06-1d5f19cc3e40 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.036780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21b2a737-275a-47cb-840a-47f7495ee1af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:52.045003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-21b2a737-275a-47cb-840a-47f7495ee1af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:52.058981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21b2a737-275a-47cb-840a-47f7495ee1af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.060662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21b2a737-275a-47cb-840a-47f7495ee1af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.062680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21b2a737-275a-47cb-840a-47f7495ee1af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.063926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21b2a737-275a-47cb-840a-47f7495ee1af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.137936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bb563f8b-f249-45fc-8c06-1d5f19cc3e40 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:52.149098 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bb563f8b-f249-45fc-8c06-1d5f19cc3e40 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.222434 Jul 14 14:54:52.150607 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2508/4978] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:51 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:52.166043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac1f27fa-879b-4a44-a878-87c4c83bb795 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:52.166812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac1f27fa-879b-4a44-a878-87c4c83bb795 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Failed to fetch instance by id -1 {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 14:54:52.167488 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-ac1f27fa-879b-4a44-a878-87c4c83bb795 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance -1 could not be found. Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac1f27fa-879b-4a44-a878-87c4c83bb795 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance -1 could not be found. Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '-1'} Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:52.169437 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:52.173416 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:52.173416 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:52.173416 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 14 14:54:52.173416 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:52.173416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac1f27fa-879b-4a44-a878-87c4c83bb795 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:52.173416 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac1f27fa-879b-4a44-a878-87c4c83bb795 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008824 Jul 14 14:54:52.173416 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2509/4979] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:54:52 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:54:52.185212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac9e94e0-52d0-4b65-adfc-fed7e7d89bc9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:52.187037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac9e94e0-52d0-4b65-adfc-fed7e7d89bc9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:52.201910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac9e94e0-52d0-4b65-adfc-fed7e7d89bc9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.203666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac9e94e0-52d0-4b65-adfc-fed7e7d89bc9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.204880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac9e94e0-52d0-4b65-adfc-fed7e7d89bc9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.205724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac9e94e0-52d0-4b65-adfc-fed7e7d89bc9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.267170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-21b2a737-275a-47cb-840a-47f7495ee1af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:52.279463 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21b2a737-275a-47cb-840a-47f7495ee1af tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.246571 Jul 14 14:54:52.282224 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2471/4980] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:52 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:52.401576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac9e94e0-52d0-4b65-adfc-fed7e7d89bc9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:52.411880 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac9e94e0-52d0-4b65-adfc-fed7e7d89bc9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.232870 Jul 14 14:54:52.425022 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2510/4981] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:52 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:52.434838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fa6023c4-3331-495d-a193-6c537eb9be68 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:52.436026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fa6023c4-3331-495d-a193-6c537eb9be68 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:52.446458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa6023c4-3331-495d-a193-6c537eb9be68 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.447671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa6023c4-3331-495d-a193-6c537eb9be68 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.448656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa6023c4-3331-495d-a193-6c537eb9be68 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.449674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa6023c4-3331-495d-a193-6c537eb9be68 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.616450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fa6023c4-3331-495d-a193-6c537eb9be68 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:52.637710 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fa6023c4-3331-495d-a193-6c537eb9be68 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.203905 Jul 14 14:54:52.639930 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2472/4982] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:52 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:52.657783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-adc8a46b-e9c3-4ae3-89fd-99f0acf82336 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:52.658746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-adc8a46b-e9c3-4ae3-89fd-99f0acf82336 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8d54ef9e-ec8c-4401-b2c3-be03cd39a1f7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:52.666607 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-adc8a46b-e9c3-4ae3-89fd-99f0acf82336 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 8d54ef9e-ec8c-4401-b2c3-be03cd39a1f7 could not be found. Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-adc8a46b-e9c3-4ae3-89fd-99f0acf82336 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/8d54ef9e-ec8c-4401-b2c3-be03cd39a1f7/action HTTP/1.1 Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 19 Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: {"forceDelete": {}} Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 8d54ef9e-ec8c-4401-b2c3-be03cd39a1f7 could not be found. Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '8d54ef9e-ec8c-4401-b2c3-be03cd39a1f7', 'body': {'forceDelete': {}}} Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d54ef9e-ec8c-4401-b2c3-be03cd39a1f7 could not be found. Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d54ef9e-ec8c-4401-b2c3-be03cd39a1f7 could not be found. Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:52.672804 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:52.676363 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:52.676363 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:52.676363 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d54ef9e-ec8c-4401-b2c3-be03cd39a1f7 could not be found. Jul 14 14:54:52.676363 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:52.678573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-adc8a46b-e9c3-4ae3-89fd-99f0acf82336 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 8d54ef9e-ec8c-4401-b2c3-be03cd39a1f7 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:52.679869 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-adc8a46b-e9c3-4ae3-89fd-99f0acf82336 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/8d54ef9e-ec8c-4401-b2c3-be03cd39a1f7/action" status: 404 len: 111 microversion: 2.1 time: 0.028558 Jul 14 14:54:52.684969 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2511/4983] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:54:52 2022] POST /compute/v2.1/servers/8d54ef9e-ec8c-4401-b2c3-be03cd39a1f7/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:52.690819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4942d77d-553a-402d-893c-3f815801b47d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:52.691587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4942d77d-553a-402d-893c-3f815801b47d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:52.698294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4942d77d-553a-402d-893c-3f815801b47d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.699889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4942d77d-553a-402d-893c-3f815801b47d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.700972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4942d77d-553a-402d-893c-3f815801b47d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.701647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4942d77d-553a-402d-893c-3f815801b47d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.876088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4942d77d-553a-402d-893c-3f815801b47d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:52.886531 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4942d77d-553a-402d-893c-3f815801b47d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.199149 Jul 14 14:54:52.888106 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2473/4984] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:52 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:52.908556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2adf70da-9279-4812-a91e-5277bb05c8e6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:52.909374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2adf70da-9279-4812-a91e-5277bb05c8e6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:52.917754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2adf70da-9279-4812-a91e-5277bb05c8e6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.918936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2adf70da-9279-4812-a91e-5277bb05c8e6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.919929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2adf70da-9279-4812-a91e-5277bb05c8e6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.920480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2adf70da-9279-4812-a91e-5277bb05c8e6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.094803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2adf70da-9279-4812-a91e-5277bb05c8e6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:53.103178 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2adf70da-9279-4812-a91e-5277bb05c8e6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.198576 Jul 14 14:54:53.106532 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2512/4985] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:52 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:53.126385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0aae34a8-f496-4dba-9447-6b2ad9e16515 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:53.127652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0aae34a8-f496-4dba-9447-6b2ad9e16515 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 5bbfce65-444f-4e4a-8c48-0f9793fc0de8] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:53.134625 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-0aae34a8-f496-4dba-9447-6b2ad9e16515 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 5bbfce65-444f-4e4a-8c48-0f9793fc0de8 could not be found. Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0aae34a8-f496-4dba-9447-6b2ad9e16515 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/5bbfce65-444f-4e4a-8c48-0f9793fc0de8/action HTTP/1.1 Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 39 Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: {"os-getConsoleOutput": {"length": 10}} Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 5bbfce65-444f-4e4a-8c48-0f9793fc0de8 could not be found. Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '5bbfce65-444f-4e4a-8c48-0f9793fc0de8', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bbfce65-444f-4e4a-8c48-0f9793fc0de8 could not be found. Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bbfce65-444f-4e4a-8c48-0f9793fc0de8 could not be found. Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:53.144824 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:53.150044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:53.150044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:53.150044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:53.150044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:53.150044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bbfce65-444f-4e4a-8c48-0f9793fc0de8 could not be found. Jul 14 14:54:53.150044 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:53.150044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0aae34a8-f496-4dba-9447-6b2ad9e16515 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 5bbfce65-444f-4e4a-8c48-0f9793fc0de8 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:53.150044 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0aae34a8-f496-4dba-9447-6b2ad9e16515 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/5bbfce65-444f-4e4a-8c48-0f9793fc0de8/action" status: 404 len: 111 microversion: 2.1 time: 0.024163 Jul 14 14:54:53.150044 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2474/4986] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:54:53 2022] POST /compute/v2.1/servers/5bbfce65-444f-4e4a-8c48-0f9793fc0de8/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:53.153507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c08d317b-a5d4-46b8-842e-81aa1736fb3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:53.154572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c08d317b-a5d4-46b8-842e-81aa1736fb3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:53.161332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c08d317b-a5d4-46b8-842e-81aa1736fb3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.162005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c08d317b-a5d4-46b8-842e-81aa1736fb3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.162983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c08d317b-a5d4-46b8-842e-81aa1736fb3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.163662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c08d317b-a5d4-46b8-842e-81aa1736fb3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.300912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-baa1d86f-f184-428e-be1d-76cbb318da45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:53.307647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-baa1d86f-f184-428e-be1d-76cbb318da45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:53.327043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baa1d86f-f184-428e-be1d-76cbb318da45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.327796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baa1d86f-f184-428e-be1d-76cbb318da45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.330230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baa1d86f-f184-428e-be1d-76cbb318da45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.333125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-baa1d86f-f184-428e-be1d-76cbb318da45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.444915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c08d317b-a5d4-46b8-842e-81aa1736fb3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:53.459388 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c08d317b-a5d4-46b8-842e-81aa1736fb3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.306566 Jul 14 14:54:53.469600 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2513/4987] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:53 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:53.478102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a622edfd-8bbe-495f-8c94-679a84fc8ea9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:53.478888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a622edfd-8bbe-495f-8c94-679a84fc8ea9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:53.498061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a622edfd-8bbe-495f-8c94-679a84fc8ea9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.498830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a622edfd-8bbe-495f-8c94-679a84fc8ea9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.499815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a622edfd-8bbe-495f-8c94-679a84fc8ea9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.500270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a622edfd-8bbe-495f-8c94-679a84fc8ea9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.665343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-baa1d86f-f184-428e-be1d-76cbb318da45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:53.681069 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-baa1d86f-f184-428e-be1d-76cbb318da45 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.384798 Jul 14 14:54:53.691433 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2475/4988] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:53 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:53.752361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a622edfd-8bbe-495f-8c94-679a84fc8ea9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:53.765817 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a622edfd-8bbe-495f-8c94-679a84fc8ea9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.292028 Jul 14 14:54:53.767340 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2514/4989] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:53 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:53.784453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e23f28b-4be5-48f9-9329-86912d2f1a57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:53.785327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5e23f28b-4be5-48f9-9329-86912d2f1a57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: c0e73fbb-e172-43a9-8e6a-ce4c34b8e832] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:53.792250 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-5e23f28b-4be5-48f9-9329-86912d2f1a57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance c0e73fbb-e172-43a9-8e6a-ce4c34b8e832 could not be found. Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e23f28b-4be5-48f9-9329-86912d2f1a57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/c0e73fbb-e172-43a9-8e6a-ce4c34b8e832 HTTP/1.1 Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance c0e73fbb-e172-43a9-8e6a-ce4c34b8e832 could not be found. Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'c0e73fbb-e172-43a9-8e6a-ce4c34b8e832'} Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e73fbb-e172-43a9-8e6a-ce4c34b8e832 could not be found. Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e73fbb-e172-43a9-8e6a-ce4c34b8e832 could not be found. Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:53.794839 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:53.798163 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:53.798163 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:53.798163 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:53.798163 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e73fbb-e172-43a9-8e6a-ce4c34b8e832 could not be found. Jul 14 14:54:53.798163 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:53.800290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e23f28b-4be5-48f9-9329-86912d2f1a57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance c0e73fbb-e172-43a9-8e6a-ce4c34b8e832 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:53.802035 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5e23f28b-4be5-48f9-9329-86912d2f1a57 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/c0e73fbb-e172-43a9-8e6a-ce4c34b8e832" status: 404 len: 111 microversion: 2.1 time: 0.021453 Jul 14 14:54:53.803105 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2476/4990] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:53 2022] GET /compute/v2.1/servers/c0e73fbb-e172-43a9-8e6a-ce4c34b8e832 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:53.812038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc066d96-aa62-4715-b750-41cb270ddffd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:53.812838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc066d96-aa62-4715-b750-41cb270ddffd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:53.822907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc066d96-aa62-4715-b750-41cb270ddffd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.827104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc066d96-aa62-4715-b750-41cb270ddffd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.828371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc066d96-aa62-4715-b750-41cb270ddffd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.828823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc066d96-aa62-4715-b750-41cb270ddffd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.004152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc066d96-aa62-4715-b750-41cb270ddffd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:54.014441 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc066d96-aa62-4715-b750-41cb270ddffd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.206982 Jul 14 14:54:54.015044 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2515/4991] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:53 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:54.034408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5898830-ed33-4401-94ac-a9e330f71eb6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:54.035086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d5898830-ed33-4401-94ac-a9e330f71eb6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:54.044224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5898830-ed33-4401-94ac-a9e330f71eb6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.044706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5898830-ed33-4401-94ac-a9e330f71eb6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.045547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5898830-ed33-4401-94ac-a9e330f71eb6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.045992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5898830-ed33-4401-94ac-a9e330f71eb6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.078285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:54.238197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d5898830-ed33-4401-94ac-a9e330f71eb6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:54.253615 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d5898830-ed33-4401-94ac-a9e330f71eb6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.222535 Jul 14 14:54:54.254759 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2477/4992] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:54 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:54.395448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-104a7faa-0e12-44bb-93e1-b49b377480b4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1593503565", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-104a7faa-0e12-44bb-93e1-b49b377480b4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 238 Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1593503565", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1593503565', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '8e3ef6f2-6d20-4870-adea-e8565b643562'}]}}} Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:54:54.398562 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 14 14:54:54.403596 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:54.405902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-104a7faa-0e12-44bb-93e1-b49b377480b4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:54.406947 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-104a7faa-0e12-44bb-93e1-b49b377480b4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015558 Jul 14 14:54:54.410813 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2516/4993] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:54:54.416476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9cfa88e4-517e-403d-adbe-9077a7cb8437 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:54.417218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9cfa88e4-517e-403d-adbe-9077a7cb8437 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:54.425917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cfa88e4-517e-403d-adbe-9077a7cb8437 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.426364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cfa88e4-517e-403d-adbe-9077a7cb8437 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.427760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cfa88e4-517e-403d-adbe-9077a7cb8437 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.428378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cfa88e4-517e-403d-adbe-9077a7cb8437 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.678255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9cfa88e4-517e-403d-adbe-9077a7cb8437 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:54.688592 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9cfa88e4-517e-403d-adbe-9077a7cb8437 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.276400 Jul 14 14:54:54.696608 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2478/4994] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:54 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:54.704988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fbc75ed4-8717-489a-a83a-5705f0e0deb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:54.705859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fbc75ed4-8717-489a-a83a-5705f0e0deb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:54.715838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-83f1da0a-025b-47a9-a7c4-aea2c0cb22f0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:54.716286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fbc75ed4-8717-489a-a83a-5705f0e0deb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.716478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-83f1da0a-025b-47a9-a7c4-aea2c0cb22f0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:54.716758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fbc75ed4-8717-489a-a83a-5705f0e0deb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.717583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fbc75ed4-8717-489a-a83a-5705f0e0deb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.718195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fbc75ed4-8717-489a-a83a-5705f0e0deb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.729924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83f1da0a-025b-47a9-a7c4-aea2c0cb22f0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.730945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83f1da0a-025b-47a9-a7c4-aea2c0cb22f0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.731756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83f1da0a-025b-47a9-a7c4-aea2c0cb22f0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.732198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83f1da0a-025b-47a9-a7c4-aea2c0cb22f0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:55.033512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fbc75ed4-8717-489a-a83a-5705f0e0deb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:55.054935 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fbc75ed4-8717-489a-a83a-5705f0e0deb8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.357544 Jul 14 14:54:55.056365 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2517/4995] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:54 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:55.069844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-83f1da0a-025b-47a9-a7c4-aea2c0cb22f0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:55.079763 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-83f1da0a-025b-47a9-a7c4-aea2c0cb22f0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.370008 Jul 14 14:54:55.081167 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2479/4996] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:54 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:55.197639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2ce2e6b6-482c-451a-a44d-198abb2fceb4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1481303668", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2ce2e6b6-482c-451a-a44d-198abb2fceb4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 235 Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1481303668", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1481303668', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '8e3ef6f2-6d20-4870-adea-e8565b643562'}]}}} Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:55.213246 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2ce2e6b6-482c-451a-a44d-198abb2fceb4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2ce2e6b6-482c-451a-a44d-198abb2fceb4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.037731 Jul 14 14:54:55.228582 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2518/4997] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:55 2022] POST /compute/v2.1/servers => generated 133 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:54:55.242567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ccb1becb-3fc5-4270-9721-0da1ae697ef0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:55.244217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ccb1becb-3fc5-4270-9721-0da1ae697ef0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:55.257799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ccb1becb-3fc5-4270-9721-0da1ae697ef0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:55.259038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ccb1becb-3fc5-4270-9721-0da1ae697ef0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:55.261406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ccb1becb-3fc5-4270-9721-0da1ae697ef0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:55.263345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ccb1becb-3fc5-4270-9721-0da1ae697ef0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:55.632610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ccb1becb-3fc5-4270-9721-0da1ae697ef0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:55.641606 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ccb1becb-3fc5-4270-9721-0da1ae697ef0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.406147 Jul 14 14:54:55.642110 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2480/4998] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:55 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:55.659438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2e33e886-0001-4f82-bd49-df169758f18d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:55.660046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2e33e886-0001-4f82-bd49-df169758f18d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:55.667660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e33e886-0001-4f82-bd49-df169758f18d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:55.668174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e33e886-0001-4f82-bd49-df169758f18d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:55.668974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e33e886-0001-4f82-bd49-df169758f18d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:55.669628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e33e886-0001-4f82-bd49-df169758f18d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:56.016773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2e33e886-0001-4f82-bd49-df169758f18d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:56.019034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:56.025759 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2e33e886-0001-4f82-bd49-df169758f18d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.370173 Jul 14 14:54:56.026279 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2519/4999] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:55 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:56.042359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0de0b608-4594-4829-b457-85eefcb3595a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:56.043517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0de0b608-4594-4829-b457-85eefcb3595a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 3b822314-c49b-4c94-b011-74b1cfa3d196] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:56.049645 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-0de0b608-4594-4829-b457-85eefcb3595a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 3b822314-c49b-4c94-b011-74b1cfa3d196 could not be found. Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0de0b608-4594-4829-b457-85eefcb3595a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/3b822314-c49b-4c94-b011-74b1cfa3d196/action HTTP/1.1 Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 13 Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: {"pause": {}} Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 3b822314-c49b-4c94-b011-74b1cfa3d196 could not be found. Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '3b822314-c49b-4c94-b011-74b1cfa3d196', 'body': {'pause': {}}} Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b822314-c49b-4c94-b011-74b1cfa3d196 could not be found. Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b822314-c49b-4c94-b011-74b1cfa3d196 could not be found. Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:56.053129 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:56.056741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:56.056741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:56.056741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b822314-c49b-4c94-b011-74b1cfa3d196 could not be found. Jul 14 14:54:56.056741 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:54:56.056741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0de0b608-4594-4829-b457-85eefcb3595a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 3b822314-c49b-4c94-b011-74b1cfa3d196 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:56.056741 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0de0b608-4594-4829-b457-85eefcb3595a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/3b822314-c49b-4c94-b011-74b1cfa3d196/action" status: 404 len: 111 microversion: 2.1 time: 0.016209 Jul 14 14:54:56.056741 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2481/5000] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:54:56 2022] POST /compute/v2.1/servers/3b822314-c49b-4c94-b011-74b1cfa3d196/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:56.063936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1ef9e8af-a2d8-4dab-a0a6-e0ad58c26bda tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:56.064556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1ef9e8af-a2d8-4dab-a0a6-e0ad58c26bda tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:56.074103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c20d5908-f90f-4e8b-aeb5-03316e055570 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:56.074731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c20d5908-f90f-4e8b-aeb5-03316e055570 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:56.082914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ef9e8af-a2d8-4dab-a0a6-e0ad58c26bda tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:56.083295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ef9e8af-a2d8-4dab-a0a6-e0ad58c26bda tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:56.084174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ef9e8af-a2d8-4dab-a0a6-e0ad58c26bda tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:56.084532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1ef9e8af-a2d8-4dab-a0a6-e0ad58c26bda tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:56.091068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c20d5908-f90f-4e8b-aeb5-03316e055570 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:56.091521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c20d5908-f90f-4e8b-aeb5-03316e055570 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:56.092814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c20d5908-f90f-4e8b-aeb5-03316e055570 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:56.093483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c20d5908-f90f-4e8b-aeb5-03316e055570 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:56.511256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c20d5908-f90f-4e8b-aeb5-03316e055570 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:56.526881 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c20d5908-f90f-4e8b-aeb5-03316e055570 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.456596 Jul 14 14:54:56.528199 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2482/5001] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:56 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:56.533130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1ef9e8af-a2d8-4dab-a0a6-e0ad58c26bda tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:56.545192 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1ef9e8af-a2d8-4dab-a0a6-e0ad58c26bda tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.485013 Jul 14 14:54:56.545786 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2520/5002] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:56 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:56.562924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-04a0eb52-3015-41d1-b186-0d41b66b1d85 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:56.563550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-04a0eb52-3015-41d1-b186-0d41b66b1d85 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:56.569936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04a0eb52-3015-41d1-b186-0d41b66b1d85 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:56.570396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04a0eb52-3015-41d1-b186-0d41b66b1d85 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:56.571170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04a0eb52-3015-41d1-b186-0d41b66b1d85 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:56.571642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04a0eb52-3015-41d1-b186-0d41b66b1d85 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:56.782202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-04a0eb52-3015-41d1-b186-0d41b66b1d85 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:56.793435 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-04a0eb52-3015-41d1-b186-0d41b66b1d85 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.234371 Jul 14 14:54:56.794548 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2483/5003] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:56 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:56.811699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-75e02c02-cb2e-4297-b96b-80f49ec80e2a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:56.813797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-75e02c02-cb2e-4297-b96b-80f49ec80e2a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:56.822843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75e02c02-cb2e-4297-b96b-80f49ec80e2a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:56.823311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75e02c02-cb2e-4297-b96b-80f49ec80e2a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:56.824840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75e02c02-cb2e-4297-b96b-80f49ec80e2a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:56.825351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75e02c02-cb2e-4297-b96b-80f49ec80e2a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:56.911728 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-75e02c02-cb2e-4297-b96b-80f49ec80e2a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 202 len: 0 microversion: 2.1 time: 0.104969 Jul 14 14:54:56.912548 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2521/5004] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:54:56 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:54:56.921717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-71d1d915-c851-4ffa-b7a7-ade23dc0441c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:56.922743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-71d1d915-c851-4ffa-b7a7-ade23dc0441c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:56.930237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71d1d915-c851-4ffa-b7a7-ade23dc0441c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:56.931124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71d1d915-c851-4ffa-b7a7-ade23dc0441c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:56.932086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71d1d915-c851-4ffa-b7a7-ade23dc0441c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:56.932755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71d1d915-c851-4ffa-b7a7-ade23dc0441c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:57.271285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-71d1d915-c851-4ffa-b7a7-ade23dc0441c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:57.281619 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-71d1d915-c851-4ffa-b7a7-ade23dc0441c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1512 microversion: 2.1 time: 0.364856 Jul 14 14:54:57.282848 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2484/5005] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:56 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:57.546791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d0564e71-064f-4883-8e4b-0c2d20b774de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:57.548233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d0564e71-064f-4883-8e4b-0c2d20b774de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:57.556548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0564e71-064f-4883-8e4b-0c2d20b774de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:57.557408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0564e71-064f-4883-8e4b-0c2d20b774de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:57.559720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0564e71-064f-4883-8e4b-0c2d20b774de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:57.560123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0564e71-064f-4883-8e4b-0c2d20b774de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:57.734858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d0564e71-064f-4883-8e4b-0c2d20b774de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:57.744254 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d0564e71-064f-4883-8e4b-0c2d20b774de tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.202731 Jul 14 14:54:57.745945 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2522/5006] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:57 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:58.300217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c363481d-2bf7-4c9d-894f-784a0586a2ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:58.300976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c363481d-2bf7-4c9d-894f-784a0586a2ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:58.319841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c363481d-2bf7-4c9d-894f-784a0586a2ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.322065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c363481d-2bf7-4c9d-894f-784a0586a2ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:58.325333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c363481d-2bf7-4c9d-894f-784a0586a2ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.327259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c363481d-2bf7-4c9d-894f-784a0586a2ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:58.510693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c363481d-2bf7-4c9d-894f-784a0586a2ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:58.523371 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c363481d-2bf7-4c9d-894f-784a0586a2ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1492 microversion: 2.1 time: 0.226993 Jul 14 14:54:58.542403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-26e8e245-361a-4cc3-a46b-23552397ffb9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:58.544980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-26e8e245-361a-4cc3-a46b-23552397ffb9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:58.550498 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2485/5007] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:58 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1492 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:58.554215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26e8e245-361a-4cc3-a46b-23552397ffb9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.554866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26e8e245-361a-4cc3-a46b-23552397ffb9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:58.556232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26e8e245-361a-4cc3-a46b-23552397ffb9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.556865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-26e8e245-361a-4cc3-a46b-23552397ffb9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:58.586146 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-26e8e245-361a-4cc3-a46b-23552397ffb9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Cannot 'pause' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state paused Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-26e8e245-361a-4cc3-a46b-23552397ffb9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action HTTP/1.1 Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 13 Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: {"pause": {}} Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: exception: Cannot 'pause' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state paused Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '0f554d9f-a901-4284-8c0e-d34d0924e67d', 'body': {'pause': {}}} Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d in vm_state paused. Cannot pause while the instance is in this state. Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state paused Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:58.588341 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:58.593399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:58.593399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:58.593399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:58.593399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state paused Jul 14 14:54:58.593399 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:54:58.594718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-26e8e245-361a-4cc3-a46b-23552397ffb9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 409 to user: Cannot 'pause' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state paused {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:58.596023 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-26e8e245-361a-4cc3-a46b-23552397ffb9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 409 len: 143 microversion: 2.1 time: 0.058228 Jul 14 14:54:58.601329 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2523/5008] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:54:58 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 143 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:54:58.604991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ade25f74-e88a-4964-923a-c68f8d94c589 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:58.606449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ade25f74-e88a-4964-923a-c68f8d94c589 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:58.612917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ade25f74-e88a-4964-923a-c68f8d94c589 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.613749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ade25f74-e88a-4964-923a-c68f8d94c589 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:58.614707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ade25f74-e88a-4964-923a-c68f8d94c589 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.615150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ade25f74-e88a-4964-923a-c68f8d94c589 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:58.712068 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ade25f74-e88a-4964-923a-c68f8d94c589 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 202 len: 0 microversion: 2.1 time: 0.110806 Jul 14 14:54:58.712987 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2486/5009] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:54:58 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:54:58.722707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-732d7bcd-7a90-4a81-ad9e-2042e0f17fd6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:58.723785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-732d7bcd-7a90-4a81-ad9e-2042e0f17fd6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:58.732265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-732d7bcd-7a90-4a81-ad9e-2042e0f17fd6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.733083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-732d7bcd-7a90-4a81-ad9e-2042e0f17fd6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:58.734247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-732d7bcd-7a90-4a81-ad9e-2042e0f17fd6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.734759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-732d7bcd-7a90-4a81-ad9e-2042e0f17fd6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:58.764710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e8c9d464-0c78-4bf6-ab83-164204785f2d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:58.767243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e8c9d464-0c78-4bf6-ab83-164204785f2d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:58.775924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8c9d464-0c78-4bf6-ab83-164204785f2d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.776741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8c9d464-0c78-4bf6-ab83-164204785f2d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:58.778403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8c9d464-0c78-4bf6-ab83-164204785f2d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.779289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8c9d464-0c78-4bf6-ab83-164204785f2d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:59.363453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-732d7bcd-7a90-4a81-ad9e-2042e0f17fd6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:59.377074 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-732d7bcd-7a90-4a81-ad9e-2042e0f17fd6 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1499 microversion: 2.1 time: 0.658540 Jul 14 14:54:59.379006 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2524/5010] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:58 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1499 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:59.381541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e8c9d464-0c78-4bf6-ab83-164204785f2d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:59.394093 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e8c9d464-0c78-4bf6-ab83-164204785f2d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.634721 Jul 14 14:54:59.395620 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2487/5011] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:58 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:00.395902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6e69f0bf-7836-4c5c-a183-97233b8dda54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:00.397555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6e69f0bf-7836-4c5c-a183-97233b8dda54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:00.406198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e69f0bf-7836-4c5c-a183-97233b8dda54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.408271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e69f0bf-7836-4c5c-a183-97233b8dda54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.409325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e69f0bf-7836-4c5c-a183-97233b8dda54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.409931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e69f0bf-7836-4c5c-a183-97233b8dda54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.412228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eb33d593-454a-46b9-9cd2-140c54b84045 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:00.412857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eb33d593-454a-46b9-9cd2-140c54b84045 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:00.423425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb33d593-454a-46b9-9cd2-140c54b84045 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.423887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb33d593-454a-46b9-9cd2-140c54b84045 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.424689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb33d593-454a-46b9-9cd2-140c54b84045 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.425166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eb33d593-454a-46b9-9cd2-140c54b84045 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.634194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6e69f0bf-7836-4c5c-a183-97233b8dda54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:00.646248 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6e69f0bf-7836-4c5c-a183-97233b8dda54 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.254215 Jul 14 14:55:00.654492 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2525/5012] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:00 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:00.668622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-157723f1-8edf-488b-b95a-962b56092a76 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:00.669288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-157723f1-8edf-488b-b95a-962b56092a76 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:00.674764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eb33d593-454a-46b9-9cd2-140c54b84045 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:00.675798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-157723f1-8edf-488b-b95a-962b56092a76 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.676428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-157723f1-8edf-488b-b95a-962b56092a76 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.677438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-157723f1-8edf-488b-b95a-962b56092a76 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.678113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-157723f1-8edf-488b-b95a-962b56092a76 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.688005 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eb33d593-454a-46b9-9cd2-140c54b84045 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.280024 Jul 14 14:55:00.697702 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2488/5013] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:00 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:00.847221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-157723f1-8edf-488b-b95a-962b56092a76 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:00.858549 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-157723f1-8edf-488b-b95a-962b56092a76 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.193429 Jul 14 14:55:00.858914 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2526/5014] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:00 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:00.875165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c98d78b8-f7f3-4ea1-bea3-66752d4eac73 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:00.876217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c98d78b8-f7f3-4ea1-bea3-66752d4eac73 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:00.885322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c98d78b8-f7f3-4ea1-bea3-66752d4eac73 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.898227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c98d78b8-f7f3-4ea1-bea3-66752d4eac73 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.901160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c98d78b8-f7f3-4ea1-bea3-66752d4eac73 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.901869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c98d78b8-f7f3-4ea1-bea3-66752d4eac73 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.927553 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c98d78b8-f7f3-4ea1-bea3-66752d4eac73 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c98d78b8-f7f3-4ea1-bea3-66752d4eac73 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20/action HTTP/1.1 Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 28 Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: {"reboot": {"type": "SOFT"}} Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '8c224c96-7334-4d8a-a27a-8e3aac8c2d20', 'body': {'reboot': {'type': 'SOFT'}}} Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1033, in _action_reboot Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:00.929479 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:00.934072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:55:00.934072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:00.934072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:00.934072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:00.934072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:00.934072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:00.934072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:00.934072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:00.934072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:00.934072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:55:00.934072 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:00.934072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c98d78b8-f7f3-4ea1-bea3-66752d4eac73 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:00.936194 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c98d78b8-f7f3-4ea1-bea3-66752d4eac73 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20/action" status: 404 len: 111 microversion: 2.1 time: 0.065880 Jul 14 14:55:00.940449 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2489/5015] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:55:00 2022] POST /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:00.945909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-159f129e-4a6a-44a2-a6ed-285d9f7aef48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:00.947203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-159f129e-4a6a-44a2-a6ed-285d9f7aef48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:00.954266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-159f129e-4a6a-44a2-a6ed-285d9f7aef48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.954940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-159f129e-4a6a-44a2-a6ed-285d9f7aef48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.965360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-159f129e-4a6a-44a2-a6ed-285d9f7aef48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.966295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-159f129e-4a6a-44a2-a6ed-285d9f7aef48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:01.304231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-159f129e-4a6a-44a2-a6ed-285d9f7aef48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:01.313640 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-159f129e-4a6a-44a2-a6ed-285d9f7aef48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.371978 Jul 14 14:55:01.325739 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2527/5016] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:00 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:01.350108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fd13fa18-40be-48d0-81ab-eb3e67650067 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:01.351086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fd13fa18-40be-48d0-81ab-eb3e67650067 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:01.360081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd13fa18-40be-48d0-81ab-eb3e67650067 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:01.360536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd13fa18-40be-48d0-81ab-eb3e67650067 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:01.361776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd13fa18-40be-48d0-81ab-eb3e67650067 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:01.362223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd13fa18-40be-48d0-81ab-eb3e67650067 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:01.607857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fd13fa18-40be-48d0-81ab-eb3e67650067 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:01.618605 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fd13fa18-40be-48d0-81ab-eb3e67650067 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.273660 Jul 14 14:55:01.620834 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2490/5017] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:01 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:01.636436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9d363b5-4bca-4019-9655-0abb3baea2ff tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:01.638731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b9d363b5-4bca-4019-9655-0abb3baea2ff tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 2e5f47f4-42c2-4255-b85a-e4fa3ba024d8] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:01.645408 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-b9d363b5-4bca-4019-9655-0abb3baea2ff tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 2e5f47f4-42c2-4255-b85a-e4fa3ba024d8 could not be found. Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9d363b5-4bca-4019-9655-0abb3baea2ff tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/2e5f47f4-42c2-4255-b85a-e4fa3ba024d8/action HTTP/1.1 Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 28 Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: {"reboot": {"type": "SOFT"}} Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 2e5f47f4-42c2-4255-b85a-e4fa3ba024d8 could not be found. Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '2e5f47f4-42c2-4255-b85a-e4fa3ba024d8', 'body': {'reboot': {'type': 'SOFT'}}} Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5f47f4-42c2-4255-b85a-e4fa3ba024d8 could not be found. Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1033, in _action_reboot Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5f47f4-42c2-4255-b85a-e4fa3ba024d8 could not be found. Jul 14 14:55:01.647209 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:01.651357 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:01.651357 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:01.651357 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:01.651357 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:01.651357 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:01.651357 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:01.651357 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:01.651357 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5f47f4-42c2-4255-b85a-e4fa3ba024d8 could not be found. Jul 14 14:55:01.651357 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:01.653744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9d363b5-4bca-4019-9655-0abb3baea2ff tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 2e5f47f4-42c2-4255-b85a-e4fa3ba024d8 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:01.654768 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b9d363b5-4bca-4019-9655-0abb3baea2ff tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/2e5f47f4-42c2-4255-b85a-e4fa3ba024d8/action" status: 404 len: 111 microversion: 2.1 time: 0.022490 Jul 14 14:55:01.658718 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2528/5018] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:55:01 2022] POST /compute/v2.1/servers/2e5f47f4-42c2-4255-b85a-e4fa3ba024d8/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:01.665493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b525d9c-8d11-4469-b39a-74ab3245e021 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:01.666505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0b525d9c-8d11-4469-b39a-74ab3245e021 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:01.673793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b525d9c-8d11-4469-b39a-74ab3245e021 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:01.674447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b525d9c-8d11-4469-b39a-74ab3245e021 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:01.675738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b525d9c-8d11-4469-b39a-74ab3245e021 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:01.676517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b525d9c-8d11-4469-b39a-74ab3245e021 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:01.707747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b3b13f36-cea7-4db0-9449-053ad7c610d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:01.708362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b3b13f36-cea7-4db0-9449-053ad7c610d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:01.731296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3b13f36-cea7-4db0-9449-053ad7c610d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:01.732250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3b13f36-cea7-4db0-9449-053ad7c610d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:01.733440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3b13f36-cea7-4db0-9449-053ad7c610d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:01.734050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3b13f36-cea7-4db0-9449-053ad7c610d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:01.915132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b3b13f36-cea7-4db0-9449-053ad7c610d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:01.923886 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b3b13f36-cea7-4db0-9449-053ad7c610d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.220044 Jul 14 14:55:01.926277 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2529/5019] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:01 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:01.998925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0b525d9c-8d11-4469-b39a-74ab3245e021 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:02.009684 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0b525d9c-8d11-4469-b39a-74ab3245e021 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.349859 Jul 14 14:55:02.021585 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2491/5020] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:01 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:02.038228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-289b9607-d1f0-47b4-8c68-7f17e6c8d6ac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:02.039103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-289b9607-d1f0-47b4-8c68-7f17e6c8d6ac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:02.053870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-289b9607-d1f0-47b4-8c68-7f17e6c8d6ac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.054567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-289b9607-d1f0-47b4-8c68-7f17e6c8d6ac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.055524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-289b9607-d1f0-47b4-8c68-7f17e6c8d6ac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.056114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-289b9607-d1f0-47b4-8c68-7f17e6c8d6ac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.336167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-289b9607-d1f0-47b4-8c68-7f17e6c8d6ac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:02.359065 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-289b9607-d1f0-47b4-8c68-7f17e6c8d6ac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.333899 Jul 14 14:55:02.369934 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2530/5021] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:02 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:02.384647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-08a4fcd1-27cd-4386-a06f-c7da220e825e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:02.388044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-08a4fcd1-27cd-4386-a06f-c7da220e825e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:02.401532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08a4fcd1-27cd-4386-a06f-c7da220e825e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.408256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08a4fcd1-27cd-4386-a06f-c7da220e825e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.409422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08a4fcd1-27cd-4386-a06f-c7da220e825e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.410294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08a4fcd1-27cd-4386-a06f-c7da220e825e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.438386 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-08a4fcd1-27cd-4386-a06f-c7da220e825e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-08a4fcd1-27cd-4386-a06f-c7da220e825e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20/action HTTP/1.1 Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 65 Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '8c224c96-7334-4d8a-a27a-8e3aac8c2d20', 'body': {'rebuild': {'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7'}}} Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 14 14:55:02.441949 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1162, in _action_rebuild Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:55:02.446436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:02.451413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-08a4fcd1-27cd-4386-a06f-c7da220e825e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:02.452454 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-08a4fcd1-27cd-4386-a06f-c7da220e825e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20/action" status: 404 len: 111 microversion: 2.1 time: 0.071821 Jul 14 14:55:02.454081 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2492/5022] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:55:02 2022] POST /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:02.462500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8ae3da4a-448d-4876-bf93-794ae1ed14f4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:02.463124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8ae3da4a-448d-4876-bf93-794ae1ed14f4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:02.474738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ae3da4a-448d-4876-bf93-794ae1ed14f4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.475206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ae3da4a-448d-4876-bf93-794ae1ed14f4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.475999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ae3da4a-448d-4876-bf93-794ae1ed14f4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.481584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ae3da4a-448d-4876-bf93-794ae1ed14f4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.634934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8ae3da4a-448d-4876-bf93-794ae1ed14f4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:02.645956 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8ae3da4a-448d-4876-bf93-794ae1ed14f4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.187616 Jul 14 14:55:02.655854 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2531/5023] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:02 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:02.666481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a9eb5b6f-33ed-4caf-b0dc-db4caefdf3cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:02.667900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a9eb5b6f-33ed-4caf-b0dc-db4caefdf3cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:02.676429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9eb5b6f-33ed-4caf-b0dc-db4caefdf3cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.677300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9eb5b6f-33ed-4caf-b0dc-db4caefdf3cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.678375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9eb5b6f-33ed-4caf-b0dc-db4caefdf3cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.679201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9eb5b6f-33ed-4caf-b0dc-db4caefdf3cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.924331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a9eb5b6f-33ed-4caf-b0dc-db4caefdf3cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:02.935327 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a9eb5b6f-33ed-4caf-b0dc-db4caefdf3cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.272619 Jul 14 14:55:02.937709 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2493/5024] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:02 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:02.943290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8d142b2-c34c-4f06-8453-d86a312cabf6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:02.943928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8d142b2-c34c-4f06-8453-d86a312cabf6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:02.952046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8d142b2-c34c-4f06-8453-d86a312cabf6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.952547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8d142b2-c34c-4f06-8453-d86a312cabf6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.953383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8d142b2-c34c-4f06-8453-d86a312cabf6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.953838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8d142b2-c34c-4f06-8453-d86a312cabf6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.962274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c94e007a-d915-4548-a3c0-3891d5429ef5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:02.967081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c94e007a-d915-4548-a3c0-3891d5429ef5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: ba8dfec1-7a59-43ff-8f0e-a8af01a47baf] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:02.974619 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c94e007a-d915-4548-a3c0-3891d5429ef5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance ba8dfec1-7a59-43ff-8f0e-a8af01a47baf could not be found. Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c94e007a-d915-4548-a3c0-3891d5429ef5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/ba8dfec1-7a59-43ff-8f0e-a8af01a47baf/action HTTP/1.1 Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 65 Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance ba8dfec1-7a59-43ff-8f0e-a8af01a47baf could not be found. Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'ba8dfec1-7a59-43ff-8f0e-a8af01a47baf', 'body': {'rebuild': {'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7'}}} Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba8dfec1-7a59-43ff-8f0e-a8af01a47baf could not be found. Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1162, in _action_rebuild Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 14:55:02.976620 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba8dfec1-7a59-43ff-8f0e-a8af01a47baf could not be found. Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba8dfec1-7a59-43ff-8f0e-a8af01a47baf could not be found. Jul 14 14:55:02.981019 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:02.986142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c94e007a-d915-4548-a3c0-3891d5429ef5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance ba8dfec1-7a59-43ff-8f0e-a8af01a47baf could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:02.988094 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c94e007a-d915-4548-a3c0-3891d5429ef5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/ba8dfec1-7a59-43ff-8f0e-a8af01a47baf/action" status: 404 len: 111 microversion: 2.1 time: 0.036522 Jul 14 14:55:02.989390 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2494/5025] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:55:02 2022] POST /compute/v2.1/servers/ba8dfec1-7a59-43ff-8f0e-a8af01a47baf/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:55:02.999772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80a5b41d-7657-4c74-8b8e-428335b7807c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:03.000408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80a5b41d-7657-4c74-8b8e-428335b7807c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:03.008013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a5b41d-7657-4c74-8b8e-428335b7807c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:03.008477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a5b41d-7657-4c74-8b8e-428335b7807c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:03.009287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a5b41d-7657-4c74-8b8e-428335b7807c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:03.009735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a5b41d-7657-4c74-8b8e-428335b7807c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:03.321792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f8d142b2-c34c-4f06-8453-d86a312cabf6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:03.331153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-80a5b41d-7657-4c74-8b8e-428335b7807c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:03.334099 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8d142b2-c34c-4f06-8453-d86a312cabf6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.394794 Jul 14 14:55:03.346626 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2532/5026] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:02 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:03.357041 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80a5b41d-7657-4c74-8b8e-428335b7807c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.362029 Jul 14 14:55:03.357799 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2495/5027] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:02 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:03.376994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e9cbad0f-4386-49de-aa3e-fb832a8cdfcf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:03.377553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e9cbad0f-4386-49de-aa3e-fb832a8cdfcf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:03.384769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9cbad0f-4386-49de-aa3e-fb832a8cdfcf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:03.385322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9cbad0f-4386-49de-aa3e-fb832a8cdfcf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:03.386204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9cbad0f-4386-49de-aa3e-fb832a8cdfcf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:03.387353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e9cbad0f-4386-49de-aa3e-fb832a8cdfcf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:03.623859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e9cbad0f-4386-49de-aa3e-fb832a8cdfcf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:03.635294 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e9cbad0f-4386-49de-aa3e-fb832a8cdfcf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.262275 Jul 14 14:55:03.637995 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2533/5028] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:03 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:03.656116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-25077b24-330e-403a-8495-bd70a97f9108 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:03.657935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-25077b24-330e-403a-8495-bd70a97f9108 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 14197367-1f7d-4887-8219-89da3d7d08d1] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:03.669694 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-25077b24-330e-403a-8495-bd70a97f9108 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 14197367-1f7d-4887-8219-89da3d7d08d1 could not be found. Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-25077b24-330e-403a-8495-bd70a97f9108 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/14197367-1f7d-4887-8219-89da3d7d08d1/action HTTP/1.1 Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 15 Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: {"restore": {}} Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 14197367-1f7d-4887-8219-89da3d7d08d1 could not be found. Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '14197367-1f7d-4887-8219-89da3d7d08d1', 'body': {'restore': {}}} Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14197367-1f7d-4887-8219-89da3d7d08d1 could not be found. Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14197367-1f7d-4887-8219-89da3d7d08d1 could not be found. Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:03.676596 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:03.681652 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:03.681652 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:03.681652 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14197367-1f7d-4887-8219-89da3d7d08d1 could not be found. Jul 14 14:55:03.681652 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:03.687503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-25077b24-330e-403a-8495-bd70a97f9108 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 14197367-1f7d-4887-8219-89da3d7d08d1 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:03.688793 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-25077b24-330e-403a-8495-bd70a97f9108 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/14197367-1f7d-4887-8219-89da3d7d08d1/action" status: 404 len: 111 microversion: 2.1 time: 0.040073 Jul 14 14:55:03.690026 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2496/5029] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:55:03 2022] POST /compute/v2.1/servers/14197367-1f7d-4887-8219-89da3d7d08d1/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:03.698026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ec2377c-bd02-40e3-8212-785da68543ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:03.699796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6ec2377c-bd02-40e3-8212-785da68543ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:03.706356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ec2377c-bd02-40e3-8212-785da68543ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:03.707089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ec2377c-bd02-40e3-8212-785da68543ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:03.708086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ec2377c-bd02-40e3-8212-785da68543ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:03.708714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ec2377c-bd02-40e3-8212-785da68543ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:04.096906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6ec2377c-bd02-40e3-8212-785da68543ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:04.109191 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6ec2377c-bd02-40e3-8212-785da68543ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.414669 Jul 14 14:55:04.110442 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2534/5030] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:03 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:04.129277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0586375e-7a52-4d9c-8413-546a5b9ece49 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:04.129912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0586375e-7a52-4d9c-8413-546a5b9ece49 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:04.140470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0586375e-7a52-4d9c-8413-546a5b9ece49 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:04.141215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0586375e-7a52-4d9c-8413-546a5b9ece49 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:04.142179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0586375e-7a52-4d9c-8413-546a5b9ece49 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:04.142627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0586375e-7a52-4d9c-8413-546a5b9ece49 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:04.166126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:04.354921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-673eb345-77e3-4ba6-b596-f1ddc04899d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:04.356592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-673eb345-77e3-4ba6-b596-f1ddc04899d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:04.368332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-673eb345-77e3-4ba6-b596-f1ddc04899d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:04.369704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-673eb345-77e3-4ba6-b596-f1ddc04899d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:04.372293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-673eb345-77e3-4ba6-b596-f1ddc04899d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:04.373334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-673eb345-77e3-4ba6-b596-f1ddc04899d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:04.482783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0586375e-7a52-4d9c-8413-546a5b9ece49 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:04.499800 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0586375e-7a52-4d9c-8413-546a5b9ece49 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.374305 Jul 14 14:55:04.500416 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2497/5031] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:04 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:04.516680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f35621a-f885-4de2-aaf1-2674dc255495 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:04.517436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9f35621a-f885-4de2-aaf1-2674dc255495 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:04.525463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f35621a-f885-4de2-aaf1-2674dc255495 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:04.526215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f35621a-f885-4de2-aaf1-2674dc255495 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:04.527313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f35621a-f885-4de2-aaf1-2674dc255495 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:04.528340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f35621a-f885-4de2-aaf1-2674dc255495 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:04.561192 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-9f35621a-f885-4de2-aaf1-2674dc255495 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Cannot 'restore' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f35621a-f885-4de2-aaf1-2674dc255495 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action HTTP/1.1 Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 15 Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: {"restore": {}} Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: exception: Cannot 'restore' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0f554d9f-a901-4284-8c0e-d34d0924e67d', 'body': {'restore': {}}} Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d in vm_state active. Cannot restore while the instance is in this state. Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:04.563745 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:04.567703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:04.567703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:04.567703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:04.567703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:55:04.567703 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:04.572566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f35621a-f885-4de2-aaf1-2674dc255495 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 409 to user: Cannot 'restore' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:04.573493 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9f35621a-f885-4de2-aaf1-2674dc255495 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 409 len: 145 microversion: 2.1 time: 0.061133 Jul 14 14:55:04.577803 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2498/5032] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:55:04 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 145 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:55:04.582966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6f59b831-87e1-490f-97cf-abb96d46f002 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:04.583583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6f59b831-87e1-490f-97cf-abb96d46f002 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:04.592582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f59b831-87e1-490f-97cf-abb96d46f002 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:04.593630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f59b831-87e1-490f-97cf-abb96d46f002 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:04.594759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f59b831-87e1-490f-97cf-abb96d46f002 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:04.595607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f59b831-87e1-490f-97cf-abb96d46f002 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:04.818910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-673eb345-77e3-4ba6-b596-f1ddc04899d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:04.835789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-673eb345-77e3-4ba6-b596-f1ddc04899d0 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.486606 Jul 14 14:55:04.837698 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2535/5033] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:04 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:05.020002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6f59b831-87e1-490f-97cf-abb96d46f002 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:05.030647 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6f59b831-87e1-490f-97cf-abb96d46f002 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.451592 Jul 14 14:55:05.032126 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2499/5034] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:04 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:05.054593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-391d2872-1cb8-4e9d-be63-fb33c7275e36 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:05.059957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-391d2872-1cb8-4e9d-be63-fb33c7275e36 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:05.072722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-391d2872-1cb8-4e9d-be63-fb33c7275e36 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:05.073486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-391d2872-1cb8-4e9d-be63-fb33c7275e36 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:05.074566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-391d2872-1cb8-4e9d-be63-fb33c7275e36 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:05.075490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-391d2872-1cb8-4e9d-be63-fb33c7275e36 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:05.348929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-391d2872-1cb8-4e9d-be63-fb33c7275e36 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:05.356639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:05.363179 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-391d2872-1cb8-4e9d-be63-fb33c7275e36 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.313582 Jul 14 14:55:05.364348 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2536/5035] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:05 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:05.382209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2166307a-4a6e-4649-ac04-83b413c67fc2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:05.383210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2166307a-4a6e-4649-ac04-83b413c67fc2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 144dd8ff-43fd-47de-9d86-11ab30a26548] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:05.393681 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-2166307a-4a6e-4649-ac04-83b413c67fc2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 144dd8ff-43fd-47de-9d86-11ab30a26548 could not be found. Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2166307a-4a6e-4649-ac04-83b413c67fc2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/144dd8ff-43fd-47de-9d86-11ab30a26548/action HTTP/1.1 Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 14 Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: {"resume": {}} Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 144dd8ff-43fd-47de-9d86-11ab30a26548 could not be found. Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '144dd8ff-43fd-47de-9d86-11ab30a26548', 'body': {'resume': {}}} Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 144dd8ff-43fd-47de-9d86-11ab30a26548 could not be found. Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 144dd8ff-43fd-47de-9d86-11ab30a26548 could not be found. Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:05.402307 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:05.406422 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:05.406422 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:05.406422 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 144dd8ff-43fd-47de-9d86-11ab30a26548 could not be found. Jul 14 14:55:05.406422 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:05.408707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2166307a-4a6e-4649-ac04-83b413c67fc2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 144dd8ff-43fd-47de-9d86-11ab30a26548 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:05.410091 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2166307a-4a6e-4649-ac04-83b413c67fc2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/144dd8ff-43fd-47de-9d86-11ab30a26548/action" status: 404 len: 111 microversion: 2.1 time: 0.032184 Jul 14 14:55:05.410744 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2500/5036] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:55:05 2022] POST /compute/v2.1/servers/144dd8ff-43fd-47de-9d86-11ab30a26548/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:05.419739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1f73b0c2-be14-485f-9169-9ca605c4a533 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:05.420610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f73b0c2-be14-485f-9169-9ca605c4a533 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:05.437299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f73b0c2-be14-485f-9169-9ca605c4a533 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:05.438127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f73b0c2-be14-485f-9169-9ca605c4a533 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:05.440772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f73b0c2-be14-485f-9169-9ca605c4a533 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:05.441582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f73b0c2-be14-485f-9169-9ca605c4a533 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:05.704155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f73b0c2-be14-485f-9169-9ca605c4a533 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:05.717216 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1f73b0c2-be14-485f-9169-9ca605c4a533 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.301670 Jul 14 14:55:05.719742 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2537/5037] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:05 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:05.738286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e020f9eb-ac23-4877-93c6-e6bebdee9412 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:05.738911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e020f9eb-ac23-4877-93c6-e6bebdee9412 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:05.759645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e020f9eb-ac23-4877-93c6-e6bebdee9412 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:05.760112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e020f9eb-ac23-4877-93c6-e6bebdee9412 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:05.762649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e020f9eb-ac23-4877-93c6-e6bebdee9412 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:05.763104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e020f9eb-ac23-4877-93c6-e6bebdee9412 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:05.854262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1f31dd0f-5a68-472a-b8d8-67a996719b25 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:05.854871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f31dd0f-5a68-472a-b8d8-67a996719b25 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:05.863138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f31dd0f-5a68-472a-b8d8-67a996719b25 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:05.863698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f31dd0f-5a68-472a-b8d8-67a996719b25 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:05.864556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f31dd0f-5a68-472a-b8d8-67a996719b25 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:05.871123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f31dd0f-5a68-472a-b8d8-67a996719b25 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:06.275017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e020f9eb-ac23-4877-93c6-e6bebdee9412 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:06.285005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f31dd0f-5a68-472a-b8d8-67a996719b25 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:06.302524 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e020f9eb-ac23-4877-93c6-e6bebdee9412 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.568031 Jul 14 14:55:06.303357 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2501/5038] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:05 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:06.303960 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1f31dd0f-5a68-472a-b8d8-67a996719b25 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.453433 Jul 14 14:55:06.313387 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2538/5039] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:05 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:06.323396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9fa56b17-2d13-4dd1-9ad6-23f4cc32445a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:06.324266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9fa56b17-2d13-4dd1-9ad6-23f4cc32445a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:06.330014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:06.331960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9fa56b17-2d13-4dd1-9ad6-23f4cc32445a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:06.332679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9fa56b17-2d13-4dd1-9ad6-23f4cc32445a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:06.333664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9fa56b17-2d13-4dd1-9ad6-23f4cc32445a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:06.334267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9fa56b17-2d13-4dd1-9ad6-23f4cc32445a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:06.363956 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-9fa56b17-2d13-4dd1-9ad6-23f4cc32445a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Cannot 'resume' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9fa56b17-2d13-4dd1-9ad6-23f4cc32445a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action HTTP/1.1 Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 14 Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: {"resume": {}} Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: exception: Cannot 'resume' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0f554d9f-a901-4284-8c0e-d34d0924e67d', 'body': {'resume': {}}} Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d in vm_state active. Cannot resume while the instance is in this state. Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:06.365574 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:06.369902 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:06.369902 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:06.369902 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:06.369902 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:55:06.369902 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:06.369902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9fa56b17-2d13-4dd1-9ad6-23f4cc32445a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 409 to user: Cannot 'resume' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:06.369902 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9fa56b17-2d13-4dd1-9ad6-23f4cc32445a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 409 len: 144 microversion: 2.1 time: 0.047854 Jul 14 14:55:06.369902 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2502/5040] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:55:06 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 144 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:55:06.376760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f41f44e-460b-4eab-bd3c-45c62aad039f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:06.377794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3f41f44e-460b-4eab-bd3c-45c62aad039f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:06.384424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f41f44e-460b-4eab-bd3c-45c62aad039f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:06.385244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f41f44e-460b-4eab-bd3c-45c62aad039f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:06.386164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f41f44e-460b-4eab-bd3c-45c62aad039f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:06.386792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f41f44e-460b-4eab-bd3c-45c62aad039f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:06.655780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3f41f44e-460b-4eab-bd3c-45c62aad039f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:06.681244 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f41f44e-460b-4eab-bd3c-45c62aad039f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.300984 Jul 14 14:55:06.682186 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2539/5041] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:06 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:06.702729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-14c39423-5dcd-4d3a-88cc-d73e2e277f3f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:06.703722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-14c39423-5dcd-4d3a-88cc-d73e2e277f3f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:06.723358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14c39423-5dcd-4d3a-88cc-d73e2e277f3f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:06.724203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14c39423-5dcd-4d3a-88cc-d73e2e277f3f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:06.725258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14c39423-5dcd-4d3a-88cc-d73e2e277f3f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:06.725919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14c39423-5dcd-4d3a-88cc-d73e2e277f3f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:07.017724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-14c39423-5dcd-4d3a-88cc-d73e2e277f3f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:07.025570 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-14c39423-5dcd-4d3a-88cc-d73e2e277f3f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.327267 Jul 14 14:55:07.028750 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2503/5042] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:06 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:07.191865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f80becfe-f140-49a2-8bd0-79552835871f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f80becfe-f140-49a2-8bd0-79552835871f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 160 Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "8e3ef6f2-6d20-4870-adea-e8565b643562"}]}} Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'server': {'name': '', 'imageRef': '4f5e5af0-d72c-4006-a62b-d41e489facb7', 'flavorRef': '452', 'networks': [{'uuid': '8e3ef6f2-6d20-4870-adea-e8565b643562'}]}}} Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi '' Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:55:07.194737 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f80becfe-f140-49a2-8bd0-79552835871f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f80becfe-f140-49a2-8bd0-79552835871f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.010501 Jul 14 14:55:07.198924 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2540/5043] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:55:07 2022] POST /compute/v2.1/servers => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:55:07.215205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bb0fdeb0-9343-41da-b2b7-d14f1c22eeca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:07.216109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bb0fdeb0-9343-41da-b2b7-d14f1c22eeca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:07.226421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb0fdeb0-9343-41da-b2b7-d14f1c22eeca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:07.227006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb0fdeb0-9343-41da-b2b7-d14f1c22eeca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:07.227946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb0fdeb0-9343-41da-b2b7-d14f1c22eeca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:07.228780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb0fdeb0-9343-41da-b2b7-d14f1c22eeca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:07.320966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-371f434f-e610-4c5d-96c8-4727095b7af5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:07.321606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-371f434f-e610-4c5d-96c8-4727095b7af5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:07.330499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-371f434f-e610-4c5d-96c8-4727095b7af5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:07.330959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-371f434f-e610-4c5d-96c8-4727095b7af5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:07.331750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-371f434f-e610-4c5d-96c8-4727095b7af5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:07.332195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-371f434f-e610-4c5d-96c8-4727095b7af5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:07.506922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bb0fdeb0-9343-41da-b2b7-d14f1c22eeca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:07.530328 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bb0fdeb0-9343-41da-b2b7-d14f1c22eeca tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.322513 Jul 14 14:55:07.531520 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2504/5044] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:07 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:07.556783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d0057c2f-20f9-496b-991b-2e1ddf164df0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:07.559026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d0057c2f-20f9-496b-991b-2e1ddf164df0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:07.582001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0057c2f-20f9-496b-991b-2e1ddf164df0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:07.582907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0057c2f-20f9-496b-991b-2e1ddf164df0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:07.587068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0057c2f-20f9-496b-991b-2e1ddf164df0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:07.589260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0057c2f-20f9-496b-991b-2e1ddf164df0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:07.730280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-371f434f-e610-4c5d-96c8-4727095b7af5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:07.743909 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-371f434f-e610-4c5d-96c8-4727095b7af5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.426675 Jul 14 14:55:07.745582 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2541/5045] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:07 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:07.870097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d0057c2f-20f9-496b-991b-2e1ddf164df0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:07.890666 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d0057c2f-20f9-496b-991b-2e1ddf164df0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.341727 Jul 14 14:55:07.902306 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2505/5046] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:07 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:07.909978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d27a1bcd-f8d2-41cf-b263-3a84df34218a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:07.910771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d27a1bcd-f8d2-41cf-b263-3a84df34218a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: b2a0bbbf-78bb-41c5-b168-b241e1e44e9c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:07.923314 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-d27a1bcd-f8d2-41cf-b263-3a84df34218a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance b2a0bbbf-78bb-41c5-b168-b241e1e44e9c could not be found. Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d27a1bcd-f8d2-41cf-b263-3a84df34218a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/b2a0bbbf-78bb-41c5-b168-b241e1e44e9c/action HTTP/1.1 Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 14 Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: {"shelve": {}} Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance b2a0bbbf-78bb-41c5-b168-b241e1e44e9c could not be found. Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'b2a0bbbf-78bb-41c5-b168-b241e1e44e9c', 'body': {'shelve': {}}} Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a0bbbf-78bb-41c5-b168-b241e1e44e9c could not be found. Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a0bbbf-78bb-41c5-b168-b241e1e44e9c could not be found. Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:07.929953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:07.934208 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:07.934208 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:07.934208 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a0bbbf-78bb-41c5-b168-b241e1e44e9c could not be found. Jul 14 14:55:07.934208 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:07.936800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d27a1bcd-f8d2-41cf-b263-3a84df34218a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance b2a0bbbf-78bb-41c5-b168-b241e1e44e9c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:07.938100 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d27a1bcd-f8d2-41cf-b263-3a84df34218a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/b2a0bbbf-78bb-41c5-b168-b241e1e44e9c/action" status: 404 len: 111 microversion: 2.1 time: 0.032271 Jul 14 14:55:07.938893 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2542/5047] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:55:07 2022] POST /compute/v2.1/servers/b2a0bbbf-78bb-41c5-b168-b241e1e44e9c/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:07.948393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7a8f48bb-f265-4ebd-ab1f-c9f6813aac6e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:07.950056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7a8f48bb-f265-4ebd-ab1f-c9f6813aac6e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:07.961517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a8f48bb-f265-4ebd-ab1f-c9f6813aac6e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:07.963195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a8f48bb-f265-4ebd-ab1f-c9f6813aac6e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:07.969166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a8f48bb-f265-4ebd-ab1f-c9f6813aac6e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:07.969729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a8f48bb-f265-4ebd-ab1f-c9f6813aac6e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:08.249046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7a8f48bb-f265-4ebd-ab1f-c9f6813aac6e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:08.258017 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7a8f48bb-f265-4ebd-ab1f-c9f6813aac6e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.314626 Jul 14 14:55:08.259120 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2506/5048] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:07 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:08.282443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eed0d742-c5d8-467b-af9d-bbb7615a7aa8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:08.283614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eed0d742-c5d8-467b-af9d-bbb7615a7aa8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:08.295403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eed0d742-c5d8-467b-af9d-bbb7615a7aa8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:08.296321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eed0d742-c5d8-467b-af9d-bbb7615a7aa8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:08.297338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eed0d742-c5d8-467b-af9d-bbb7615a7aa8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:08.299348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eed0d742-c5d8-467b-af9d-bbb7615a7aa8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:08.530695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eed0d742-c5d8-467b-af9d-bbb7615a7aa8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:08.550409 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eed0d742-c5d8-467b-af9d-bbb7615a7aa8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.275164 Jul 14 14:55:08.565585 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2543/5049] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:08 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:08.569421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-529ec3c0-fd44-4510-8e85-e0b1b8436e84 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:08.569989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-529ec3c0-fd44-4510-8e85-e0b1b8436e84 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:08.586921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-529ec3c0-fd44-4510-8e85-e0b1b8436e84 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:08.587373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-529ec3c0-fd44-4510-8e85-e0b1b8436e84 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:08.588400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-529ec3c0-fd44-4510-8e85-e0b1b8436e84 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:08.588862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-529ec3c0-fd44-4510-8e85-e0b1b8436e84 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:08.615834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-529ec3c0-fd44-4510-8e85-e0b1b8436e84 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lazy-loading 'flavor' on Instance uuid 0f554d9f-a901-4284-8c0e-d34d0924e67d {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:55:08.764837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f0a34a1-7141-4281-a506-3ad7e1704901 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:08.765590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f0a34a1-7141-4281-a506-3ad7e1704901 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:08.781967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f0a34a1-7141-4281-a506-3ad7e1704901 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:08.782186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f0a34a1-7141-4281-a506-3ad7e1704901 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:08.782987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f0a34a1-7141-4281-a506-3ad7e1704901 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:08.783445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f0a34a1-7141-4281-a506-3ad7e1704901 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:09.023461 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-529ec3c0-fd44-4510-8e85-e0b1b8436e84 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 202 len: 0 microversion: 2.1 time: 0.457615 Jul 14 14:55:09.030272 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2507/5050] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:55:08 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:55:09.038265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bee62bf1-27b7-4538-b10d-e5779c593ef2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:09.040695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bee62bf1-27b7-4538-b10d-e5779c593ef2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:09.057509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bee62bf1-27b7-4538-b10d-e5779c593ef2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:09.058109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bee62bf1-27b7-4538-b10d-e5779c593ef2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:09.059340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bee62bf1-27b7-4538-b10d-e5779c593ef2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:09.059793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bee62bf1-27b7-4538-b10d-e5779c593ef2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:09.347047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f0a34a1-7141-4281-a506-3ad7e1704901 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:09.358364 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f0a34a1-7141-4281-a506-3ad7e1704901 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.599188 Jul 14 14:55:09.361413 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2544/5051] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:08 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:09.367449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bee62bf1-27b7-4538-b10d-e5779c593ef2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:09.378954 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bee62bf1-27b7-4538-b10d-e5779c593ef2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.346908 Jul 14 14:55:09.391853 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2508/5052] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:09 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:10.376668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8bf85504-dd74-4420-93c9-398e2ae92c4e tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:10.377327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8bf85504-dd74-4420-93c9-398e2ae92c4e tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:10.386165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bf85504-dd74-4420-93c9-398e2ae92c4e tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:10.386947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bf85504-dd74-4420-93c9-398e2ae92c4e tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:10.387967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bf85504-dd74-4420-93c9-398e2ae92c4e tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:10.388577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bf85504-dd74-4420-93c9-398e2ae92c4e tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:10.397577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-802ac52e-1960-470a-83fe-dbb5f7f4bda7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:10.398884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-802ac52e-1960-470a-83fe-dbb5f7f4bda7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:10.430776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-802ac52e-1960-470a-83fe-dbb5f7f4bda7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:10.431257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-802ac52e-1960-470a-83fe-dbb5f7f4bda7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:10.432373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-802ac52e-1960-470a-83fe-dbb5f7f4bda7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:10.435076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-802ac52e-1960-470a-83fe-dbb5f7f4bda7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:10.703480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8bf85504-dd74-4420-93c9-398e2ae92c4e tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:10.715130 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8bf85504-dd74-4420-93c9-398e2ae92c4e tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.341271 Jul 14 14:55:10.726261 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2545/5053] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:10 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:10.740763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-802ac52e-1960-470a-83fe-dbb5f7f4bda7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:10.758807 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-802ac52e-1960-470a-83fe-dbb5f7f4bda7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.366461 Jul 14 14:55:10.759863 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2509/5054] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:10 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:11.292522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fcac8743-db35-4850-9057-9cfb00b15c13 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:11.293156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fcac8743-db35-4850-9057-9cfb00b15c13 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:11.300085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fcac8743-db35-4850-9057-9cfb00b15c13 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:11.300813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fcac8743-db35-4850-9057-9cfb00b15c13 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:11.301794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fcac8743-db35-4850-9057-9cfb00b15c13 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:11.302401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fcac8743-db35-4850-9057-9cfb00b15c13 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:11.330114 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fcac8743-db35-4850-9057-9cfb00b15c13 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/ips" status: 200 len: 150 microversion: 2.1 time: 0.041699 Jul 14 14:55:11.333783 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2546/5055] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 14:55:11 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:11.736352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5eed16f1-287d-4bb7-9b4b-96b6542e3e87 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:11.736915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5eed16f1-287d-4bb7-9b4b-96b6542e3e87 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:11.746673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5eed16f1-287d-4bb7-9b4b-96b6542e3e87 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:11.747132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5eed16f1-287d-4bb7-9b4b-96b6542e3e87 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:11.748264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5eed16f1-287d-4bb7-9b4b-96b6542e3e87 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:11.748706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5eed16f1-287d-4bb7-9b4b-96b6542e3e87 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:11.776064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7f85fdbe-a2ef-4cf1-b48f-8b8c8329f087 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:11.776770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7f85fdbe-a2ef-4cf1-b48f-8b8c8329f087 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:11.791695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f85fdbe-a2ef-4cf1-b48f-8b8c8329f087 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:11.792168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f85fdbe-a2ef-4cf1-b48f-8b8c8329f087 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:11.793603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f85fdbe-a2ef-4cf1-b48f-8b8c8329f087 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:11.794516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f85fdbe-a2ef-4cf1-b48f-8b8c8329f087 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:12.062420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5eed16f1-287d-4bb7-9b4b-96b6542e3e87 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:12.078626 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5eed16f1-287d-4bb7-9b4b-96b6542e3e87 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.347472 Jul 14 14:55:12.079247 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2510/5056] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:11 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:12.112600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7f85fdbe-a2ef-4cf1-b48f-8b8c8329f087 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:12.127163 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7f85fdbe-a2ef-4cf1-b48f-8b8c8329f087 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.354911 Jul 14 14:55:12.128764 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2547/5057] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:11 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:12.729624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f5a635c4-a82b-4cf8-8e59-ea597f094a54 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "123eec53-7289-4612-9ad6-31051cb50a63"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:12.731796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f5a635c4-a82b-4cf8-8e59-ea597f094a54 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:12.738965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5a635c4-a82b-4cf8-8e59-ea597f094a54 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:12.739606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6a9697f2-d167-4b5c-8ba8-f6dbf1559901 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:12.740041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6a9697f2-d167-4b5c-8ba8-f6dbf1559901 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:12.741302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5a635c4-a82b-4cf8-8e59-ea597f094a54 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:12.742043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:12.742941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5a635c4-a82b-4cf8-8e59-ea597f094a54 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:12.743716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5a635c4-a82b-4cf8-8e59-ea597f094a54 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:12.752697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a9697f2-d167-4b5c-8ba8-f6dbf1559901 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:12.757244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a9697f2-d167-4b5c-8ba8-f6dbf1559901 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:12.759003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a9697f2-d167-4b5c-8ba8-f6dbf1559901 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:12.759459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a9697f2-d167-4b5c-8ba8-f6dbf1559901 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:12.792586 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6a9697f2-d167-4b5c-8ba8-f6dbf1559901 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/ips" status: 200 len: 151 microversion: 2.20 time: 0.058566 Jul 14 14:55:12.794936 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2548/5058] 10.222.0.81 () {60 vars in 1288 bytes} [Thu Jul 14 14:55:12 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/ips => generated 151 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:55:13.103943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d01a9e41-8f61-40d6-b7be-04e0733b2174 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:13.104788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d01a9e41-8f61-40d6-b7be-04e0733b2174 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:13.116911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d01a9e41-8f61-40d6-b7be-04e0733b2174 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:13.122896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d01a9e41-8f61-40d6-b7be-04e0733b2174 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:13.125522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d01a9e41-8f61-40d6-b7be-04e0733b2174 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:13.131873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d01a9e41-8f61-40d6-b7be-04e0733b2174 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:13.193316 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f5a635c4-a82b-4cf8-8e59-ea597f094a54 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "POST /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467591 Jul 14 14:55:13.216179 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2511/5059] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:55:12 2022] POST /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:13.222417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d2495de-3780-4963-915c-93a4e8428969 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:13.234565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d2495de-3780-4963-915c-93a4e8428969 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:13.248397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d2495de-3780-4963-915c-93a4e8428969 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:13.248862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d2495de-3780-4963-915c-93a4e8428969 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:13.252676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d2495de-3780-4963-915c-93a4e8428969 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:13.253236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d2495de-3780-4963-915c-93a4e8428969 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:13.285295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:13.572735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d01a9e41-8f61-40d6-b7be-04e0733b2174 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:13.604425 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d01a9e41-8f61-40d6-b7be-04e0733b2174 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.508705 Jul 14 14:55:13.607343 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2549/5060] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:13 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:13.618488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e2c53d13-fdb1-43fa-aab9-4e9d6c1b781e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:13.618998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e2c53d13-fdb1-43fa-aab9-4e9d6c1b781e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:13.637460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e2c53d13-fdb1-43fa-aab9-4e9d6c1b781e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:13.638103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e2c53d13-fdb1-43fa-aab9-4e9d6c1b781e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:13.638826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e2c53d13-fdb1-43fa-aab9-4e9d6c1b781e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:13.644316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e2c53d13-fdb1-43fa-aab9-4e9d6c1b781e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:13.713679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e2c53d13-fdb1-43fa-aab9-4e9d6c1b781e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.104967 Jul 14 14:55:13.714311 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2550/5061] 10.222.0.81 () {58 vars in 1292 bytes} [Thu Jul 14 14:55:13 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4/os-server-password => generated 116 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:13.766237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7d2495de-3780-4963-915c-93a4e8428969 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:13.776685 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d2495de-3780-4963-915c-93a4e8428969 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.558792 Jul 14 14:55:13.778699 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2512/5062] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:13 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:14.623745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ba839e56-8793-48df-8ec1-e55962cd91e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:14.624380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ba839e56-8793-48df-8ec1-e55962cd91e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:14.642039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba839e56-8793-48df-8ec1-e55962cd91e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:14.642757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba839e56-8793-48df-8ec1-e55962cd91e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:14.643802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba839e56-8793-48df-8ec1-e55962cd91e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:14.644422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba839e56-8793-48df-8ec1-e55962cd91e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:14.794478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5f4e70ca-ae0a-43cb-90e3-1df0b7783fb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:14.795102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5f4e70ca-ae0a-43cb-90e3-1df0b7783fb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:14.806787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f4e70ca-ae0a-43cb-90e3-1df0b7783fb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:14.808169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f4e70ca-ae0a-43cb-90e3-1df0b7783fb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:14.810950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f4e70ca-ae0a-43cb-90e3-1df0b7783fb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:14.811696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f4e70ca-ae0a-43cb-90e3-1df0b7783fb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:14.812519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba839e56-8793-48df-8ec1-e55962cd91e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:14.822644 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ba839e56-8793-48df-8ec1-e55962cd91e8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 0.203568 Jul 14 14:55:14.833434 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2551/5063] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:14 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:15.086004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5f4e70ca-ae0a-43cb-90e3-1df0b7783fb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:15.102187 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5f4e70ca-ae0a-43cb-90e3-1df0b7783fb2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.312097 Jul 14 14:55:15.103081 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2513/5064] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:14 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:15.841518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8798faaa-8c77-410f-ab75-75f93baae3d4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:15.842740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8798faaa-8c77-410f-ab75-75f93baae3d4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:15.859817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8798faaa-8c77-410f-ab75-75f93baae3d4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:15.866978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8798faaa-8c77-410f-ab75-75f93baae3d4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:15.868114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8798faaa-8c77-410f-ab75-75f93baae3d4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:15.868770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8798faaa-8c77-410f-ab75-75f93baae3d4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:16.109042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-90ea83bc-081d-4a72-b086-934d0985c6d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:16.109651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-90ea83bc-081d-4a72-b086-934d0985c6d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:16.125324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90ea83bc-081d-4a72-b086-934d0985c6d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:16.125788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90ea83bc-081d-4a72-b086-934d0985c6d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:16.126576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90ea83bc-081d-4a72-b086-934d0985c6d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:16.127187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90ea83bc-081d-4a72-b086-934d0985c6d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:16.169583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-90ea83bc-081d-4a72-b086-934d0985c6d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lazy-loading 'flavor' on Instance uuid e5292ea7-49d5-4a1e-8fee-76a77bf64afa {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:55:16.566335 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-90ea83bc-081d-4a72-b086-934d0985c6d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "POST /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/action" status: 202 len: 0 microversion: 2.20 time: 0.441311 Jul 14 14:55:16.568425 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2514/5065] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 14:55:16 2022] POST /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:55:16.588258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a5c8e0ab-62cb-4ab9-a845-a2c238a44e5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:16.589005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a5c8e0ab-62cb-4ab9-a845-a2c238a44e5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:16.602859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5c8e0ab-62cb-4ab9-a845-a2c238a44e5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:16.603416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5c8e0ab-62cb-4ab9-a845-a2c238a44e5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:16.604425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5c8e0ab-62cb-4ab9-a845-a2c238a44e5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:16.605566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a5c8e0ab-62cb-4ab9-a845-a2c238a44e5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:17.302249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a5c8e0ab-62cb-4ab9-a845-a2c238a44e5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:17.313335 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a5c8e0ab-62cb-4ab9-a845-a2c238a44e5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.733991 Jul 14 14:55:17.322026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8798faaa-8c77-410f-ab75-75f93baae3d4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:17.326676 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2515/5066] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:16 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:17.335928 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8798faaa-8c77-410f-ab75-75f93baae3d4 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1511 microversion: 2.1 time: 1.499562 Jul 14 14:55:17.336705 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2552/5067] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:15 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1511 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:17.351244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-daa07bb0-f6ec-4920-ac9d-2304861e6268 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:17.352016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-daa07bb0-f6ec-4920-ac9d-2304861e6268 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:17.360505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daa07bb0-f6ec-4920-ac9d-2304861e6268 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:17.361057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daa07bb0-f6ec-4920-ac9d-2304861e6268 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:17.361819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daa07bb0-f6ec-4920-ac9d-2304861e6268 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:17.362601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daa07bb0-f6ec-4920-ac9d-2304861e6268 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:17.870744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-daa07bb0-f6ec-4920-ac9d-2304861e6268 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:17.881214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-daa07bb0-f6ec-4920-ac9d-2304861e6268 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:17.883631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-daa07bb0-f6ec-4920-ac9d-2304861e6268 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:17.885157 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-daa07bb0-f6ec-4920-ac9d-2304861e6268 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.555126 Jul 14 14:55:17.899985 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2516/5068] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:17 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:18.343728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b31a60bc-48be-48de-b038-70963686fd6b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:18.345132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b31a60bc-48be-48de-b038-70963686fd6b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:18.353904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fb05b754-7dcd-466f-92e3-81034f7b8bf2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:18.355334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fb05b754-7dcd-466f-92e3-81034f7b8bf2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:18.364733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb05b754-7dcd-466f-92e3-81034f7b8bf2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.367397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b31a60bc-48be-48de-b038-70963686fd6b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.368142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb05b754-7dcd-466f-92e3-81034f7b8bf2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:18.369196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb05b754-7dcd-466f-92e3-81034f7b8bf2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.370137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b31a60bc-48be-48de-b038-70963686fd6b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:18.371922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b31a60bc-48be-48de-b038-70963686fd6b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.372708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb05b754-7dcd-466f-92e3-81034f7b8bf2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:18.376044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b31a60bc-48be-48de-b038-70963686fd6b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:18.775768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fb05b754-7dcd-466f-92e3-81034f7b8bf2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:18.794958 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fb05b754-7dcd-466f-92e3-81034f7b8bf2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1488 microversion: 2.1 time: 0.443852 Jul 14 14:55:18.795831 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2517/5069] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:18 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1488 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:18.812404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f5934ee-1736-41a7-b79c-84ae73108f31 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1323770077"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:18.813721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8f5934ee-1736-41a7-b79c-84ae73108f31 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:18.822657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f5934ee-1736-41a7-b79c-84ae73108f31 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.823117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f5934ee-1736-41a7-b79c-84ae73108f31 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:18.823919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f5934ee-1736-41a7-b79c-84ae73108f31 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.824669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f5934ee-1736-41a7-b79c-84ae73108f31 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:18.866947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b31a60bc-48be-48de-b038-70963686fd6b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:18.882227 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b31a60bc-48be-48de-b038-70963686fd6b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.542690 Jul 14 14:55:18.883436 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2553/5070] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:18 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:18.911466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-49b4bbdf-7553-456a-b59a-74f01a4a7412 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:18.912391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-49b4bbdf-7553-456a-b59a-74f01a4a7412 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:18.934823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49b4bbdf-7553-456a-b59a-74f01a4a7412 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.935385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49b4bbdf-7553-456a-b59a-74f01a4a7412 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:18.936270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49b4bbdf-7553-456a-b59a-74f01a4a7412 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.937217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49b4bbdf-7553-456a-b59a-74f01a4a7412 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:18.948526 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8f5934ee-1736-41a7-b79c-84ae73108f31 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "PUT /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1062 microversion: 2.1 time: 0.141144 Jul 14 14:55:18.950714 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2518/5071] 10.222.0.81 () {60 vars in 1255 bytes} [Thu Jul 14 14:55:18 2022] PUT /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1062 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:18.966173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9e6007f1-e616-4244-82d2-62f7c37cf4e5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:18.967050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9e6007f1-e616-4244-82d2-62f7c37cf4e5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:18.976104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e6007f1-e616-4244-82d2-62f7c37cf4e5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.976759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e6007f1-e616-4244-82d2-62f7c37cf4e5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:18.978113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e6007f1-e616-4244-82d2-62f7c37cf4e5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.978849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e6007f1-e616-4244-82d2-62f7c37cf4e5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:19.332036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-49b4bbdf-7553-456a-b59a-74f01a4a7412 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:19.345108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-49b4bbdf-7553-456a-b59a-74f01a4a7412 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:19.347724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-49b4bbdf-7553-456a-b59a-74f01a4a7412 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:19.349333 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-49b4bbdf-7553-456a-b59a-74f01a4a7412 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.443404 Jul 14 14:55:19.350463 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2554/5072] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:18 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:55:19.385040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e6007f1-e616-4244-82d2-62f7c37cf4e5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:19.394850 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9e6007f1-e616-4244-82d2-62f7c37cf4e5 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1489 microversion: 2.1 time: 0.433897 Jul 14 14:55:19.396591 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2519/5073] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:18 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1489 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:19.414774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-50b99618-4aa3-42b8-b8aa-2b5230f48510 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:19.415570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-50b99618-4aa3-42b8-b8aa-2b5230f48510 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:19.431349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50b99618-4aa3-42b8-b8aa-2b5230f48510 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:19.431885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50b99618-4aa3-42b8-b8aa-2b5230f48510 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:19.432735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50b99618-4aa3-42b8-b8aa-2b5230f48510 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:19.433525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50b99618-4aa3-42b8-b8aa-2b5230f48510 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:19.704344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-50b99618-4aa3-42b8-b8aa-2b5230f48510 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:19.717288 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-50b99618-4aa3-42b8-b8aa-2b5230f48510 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1489 microversion: 2.1 time: 0.305876 Jul 14 14:55:19.719235 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2555/5074] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:19 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1489 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:19.743406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ff08bbc9-8aee-4e5d-ac47-76d83914f5c6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:19.744567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ff08bbc9-8aee-4e5d-ac47-76d83914f5c6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:19.756112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff08bbc9-8aee-4e5d-ac47-76d83914f5c6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:19.756817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff08bbc9-8aee-4e5d-ac47-76d83914f5c6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:19.770778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff08bbc9-8aee-4e5d-ac47-76d83914f5c6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:19.772411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff08bbc9-8aee-4e5d-ac47-76d83914f5c6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:19.825535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ff08bbc9-8aee-4e5d-ac47-76d83914f5c6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:55:19.914229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b425493-84c2-428c-929b-78b719f1cac5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:19.914864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0b425493-84c2-428c-929b-78b719f1cac5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:19.927041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b425493-84c2-428c-929b-78b719f1cac5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:19.927516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b425493-84c2-428c-929b-78b719f1cac5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:19.931704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b425493-84c2-428c-929b-78b719f1cac5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:19.932160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b425493-84c2-428c-929b-78b719f1cac5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:19.975207 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ff08bbc9-8aee-4e5d-ac47-76d83914f5c6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 204 len: 0 microversion: 2.1 time: 0.244197 Jul 14 14:55:19.976763 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2520/5075] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:19 2022] DELETE /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:55:19.986540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:19.988117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-78af611f-43b9-4b08-a19b-4a3276c66a5c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:19.988986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-78af611f-43b9-4b08-a19b-4a3276c66a5c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:20.000774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78af611f-43b9-4b08-a19b-4a3276c66a5c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:20.001771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78af611f-43b9-4b08-a19b-4a3276c66a5c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:20.002877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78af611f-43b9-4b08-a19b-4a3276c66a5c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:20.003556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78af611f-43b9-4b08-a19b-4a3276c66a5c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:20.334382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0b425493-84c2-428c-929b-78b719f1cac5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:20.346985 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0b425493-84c2-428c-929b-78b719f1cac5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.449728 Jul 14 14:55:20.353442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-78af611f-43b9-4b08-a19b-4a3276c66a5c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:20.357610 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2556/5076] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:19 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:20.373151 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-78af611f-43b9-4b08-a19b-4a3276c66a5c tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1495 microversion: 2.1 time: 0.385154 Jul 14 14:55:20.374376 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2521/5077] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:19 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1495 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:20.375531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-007bc9de-9f55-494d-9a65-87a1134c9658 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:20.376385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-007bc9de-9f55-494d-9a65-87a1134c9658 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:20.390277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-007bc9de-9f55-494d-9a65-87a1134c9658 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:20.390894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-007bc9de-9f55-494d-9a65-87a1134c9658 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:20.391834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-007bc9de-9f55-494d-9a65-87a1134c9658 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:20.392410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-007bc9de-9f55-494d-9a65-87a1134c9658 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:20.621476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-007bc9de-9f55-494d-9a65-87a1134c9658 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:20.632019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-007bc9de-9f55-494d-9a65-87a1134c9658 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:20.633888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-007bc9de-9f55-494d-9a65-87a1134c9658 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:20.635123 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-007bc9de-9f55-494d-9a65-87a1134c9658 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.266441 Jul 14 14:55:20.635704 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2557/5078] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:20 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:21.363743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-08ca6c3d-2d2a-415c-b039-7f57aed74e18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:21.364470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-08ca6c3d-2d2a-415c-b039-7f57aed74e18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:21.372446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08ca6c3d-2d2a-415c-b039-7f57aed74e18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:21.372899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08ca6c3d-2d2a-415c-b039-7f57aed74e18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:21.373722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08ca6c3d-2d2a-415c-b039-7f57aed74e18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:21.374162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08ca6c3d-2d2a-415c-b039-7f57aed74e18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:21.391254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ccd68802-251e-4c4b-8217-0a24fcc60666 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:21.392715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ccd68802-251e-4c4b-8217-0a24fcc60666 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:21.399671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ccd68802-251e-4c4b-8217-0a24fcc60666 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:21.400449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ccd68802-251e-4c4b-8217-0a24fcc60666 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:21.401500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ccd68802-251e-4c4b-8217-0a24fcc60666 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:21.402760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ccd68802-251e-4c4b-8217-0a24fcc60666 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:22.179476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ccd68802-251e-4c4b-8217-0a24fcc60666 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:22.190671 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ccd68802-251e-4c4b-8217-0a24fcc60666 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1495 microversion: 2.1 time: 0.803062 Jul 14 14:55:22.204680 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2558/5079] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:21 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1495 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:22.211917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e326dacf-4775-44a2-aa71-d369ad496690 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:22.213591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e326dacf-4775-44a2-aa71-d369ad496690 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:22.218490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-08ca6c3d-2d2a-415c-b039-7f57aed74e18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:22.224806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e326dacf-4775-44a2-aa71-d369ad496690 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:22.225528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e326dacf-4775-44a2-aa71-d369ad496690 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:22.227752 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-08ca6c3d-2d2a-415c-b039-7f57aed74e18 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.867877 Jul 14 14:55:22.228615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e326dacf-4775-44a2-aa71-d369ad496690 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:22.229935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e326dacf-4775-44a2-aa71-d369ad496690 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:22.241319 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2522/5080] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:21 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:22.483595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e326dacf-4775-44a2-aa71-d369ad496690 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:22.492745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e326dacf-4775-44a2-aa71-d369ad496690 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:22.494896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e326dacf-4775-44a2-aa71-d369ad496690 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:22.496578 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e326dacf-4775-44a2-aa71-d369ad496690 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.289593 Jul 14 14:55:22.497432 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2559/5081] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:22 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:22.706690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3d40f722-810a-483c-ae80-828d2247cd53 req-4f355467-5d16-4996-be0b-ccbeac858be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6793ce4-88ac-4900-88a8-05fbf34e971e", "name": "network-vif-deleted", "tag": "df06d3aa-4905-48f7-8d1e-7546857779b3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:22.719869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3d40f722-810a-483c-ae80-828d2247cd53 req-4f355467-5d16-4996-be0b-ccbeac858be9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:22.720613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3d40f722-810a-483c-ae80-828d2247cd53 req-4f355467-5d16-4996-be0b-ccbeac858be9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:22.738318 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3d40f722-810a-483c-ae80-828d2247cd53 req-4f355467-5d16-4996-be0b-ccbeac858be9 service nova] Creating event network-vif-deleted:df06d3aa-4905-48f7-8d1e-7546857779b3 for instance f6793ce4-88ac-4900-88a8-05fbf34e971e on n-h1-767704-28 Jul 14 14:55:22.745191 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3d40f722-810a-483c-ae80-828d2247cd53 req-4f355467-5d16-4996-be0b-ccbeac858be9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041265 Jul 14 14:55:22.746535 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2523/5082] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:23.213972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0fb41f05-fb54-4539-83c3-4e8087f649f9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:23.215694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0fb41f05-fb54-4539-83c3-4e8087f649f9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:23.227943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0fb41f05-fb54-4539-83c3-4e8087f649f9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:23.229162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0fb41f05-fb54-4539-83c3-4e8087f649f9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:23.231995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0fb41f05-fb54-4539-83c3-4e8087f649f9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:23.233768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0fb41f05-fb54-4539-83c3-4e8087f649f9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:23.249768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-875ad6f4-fa6f-4c4a-9497-8efff1799143 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:23.250972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-875ad6f4-fa6f-4c4a-9497-8efff1799143 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:23.267274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-875ad6f4-fa6f-4c4a-9497-8efff1799143 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:23.280858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-875ad6f4-fa6f-4c4a-9497-8efff1799143 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:23.282332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-875ad6f4-fa6f-4c4a-9497-8efff1799143 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:23.283656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-875ad6f4-fa6f-4c4a-9497-8efff1799143 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:23.297590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0fb41f05-fb54-4539-83c3-4e8087f649f9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:23.298054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0fb41f05-fb54-4539-83c3-4e8087f649f9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:23.298517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-0fb41f05-fb54-4539-83c3-4e8087f649f9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lazy-loading 'fault' on Instance uuid f6793ce4-88ac-4900-88a8-05fbf34e971e {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:55:23.399633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0fb41f05-fb54-4539-83c3-4e8087f649f9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:23.412706 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0fb41f05-fb54-4539-83c3-4e8087f649f9 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 200 len: 1310 microversion: 2.1 time: 0.204718 Jul 14 14:55:23.414177 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2560/5083] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:23 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 1310 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:23.519487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-360ce639-6061-439f-b687-396dfe4fe9e0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:23.520231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-360ce639-6061-439f-b687-396dfe4fe9e0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:23.532998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-360ce639-6061-439f-b687-396dfe4fe9e0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:23.532998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-360ce639-6061-439f-b687-396dfe4fe9e0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:23.532998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-360ce639-6061-439f-b687-396dfe4fe9e0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:23.532998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-360ce639-6061-439f-b687-396dfe4fe9e0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:23.616847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-875ad6f4-fa6f-4c4a-9497-8efff1799143 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:23.625756 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-875ad6f4-fa6f-4c4a-9497-8efff1799143 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.383443 Jul 14 14:55:23.626719 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2524/5084] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:23 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:23.770502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-360ce639-6061-439f-b687-396dfe4fe9e0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:23.787726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-360ce639-6061-439f-b687-396dfe4fe9e0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:23.789374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-360ce639-6061-439f-b687-396dfe4fe9e0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:23.790734 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-360ce639-6061-439f-b687-396dfe4fe9e0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.278914 Jul 14 14:55:23.791171 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2561/5085] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:23 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:24.431273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-85f5ccf1-2430-46dc-bf45-5e44df3dba0d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.432510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-85f5ccf1-2430-46dc-bf45-5e44df3dba0d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.442250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85f5ccf1-2430-46dc-bf45-5e44df3dba0d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.442699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85f5ccf1-2430-46dc-bf45-5e44df3dba0d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.443505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85f5ccf1-2430-46dc-bf45-5e44df3dba0d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.443904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85f5ccf1-2430-46dc-bf45-5e44df3dba0d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.463505 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-85f5ccf1-2430-46dc-bf45-5e44df3dba0d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-85f5ccf1-2430-46dc-bf45-5e44df3dba0d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e HTTP/1.1 Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'f6793ce4-88ac-4900-88a8-05fbf34e971e'} Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.466120 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.470477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.470477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.470477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:24.470477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:24.470477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.470477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.470477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-85f5ccf1-2430-46dc-bf45-5e44df3dba0d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:24.470477 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-85f5ccf1-2430-46dc-bf45-5e44df3dba0d tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 404 len: 111 microversion: 2.1 time: 0.040890 Jul 14 14:55:24.470477 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2525/5086] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:24.490453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-09b9ad41-768a-4305-b6de-7104d28bb682 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.491029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-09b9ad41-768a-4305-b6de-7104d28bb682 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.498879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09b9ad41-768a-4305-b6de-7104d28bb682 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.499361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09b9ad41-768a-4305-b6de-7104d28bb682 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.500175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09b9ad41-768a-4305-b6de-7104d28bb682 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.500976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09b9ad41-768a-4305-b6de-7104d28bb682 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.537777 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-09b9ad41-768a-4305-b6de-7104d28bb682 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-09b9ad41-768a-4305-b6de-7104d28bb682 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e HTTP/1.1 Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'f6793ce4-88ac-4900-88a8-05fbf34e971e'} Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:24.539370 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.543956 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.543956 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.543956 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.543956 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.543956 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.543956 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.543956 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:24.543956 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:24.543956 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.543956 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.543956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-09b9ad41-768a-4305-b6de-7104d28bb682 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:24.543956 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-09b9ad41-768a-4305-b6de-7104d28bb682 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 404 len: 111 microversion: 2.1 time: 0.055828 Jul 14 14:55:24.554874 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2562/5087] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:24 2022] DELETE /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:24.563898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24c76c10-db7c-4ce3-9b5f-45db9c5f8a19 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.564546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-24c76c10-db7c-4ce3-9b5f-45db9c5f8a19 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: f6793ce4-88ac-4900-88a8-05fbf34e971e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.571523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24c76c10-db7c-4ce3-9b5f-45db9c5f8a19 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.572151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24c76c10-db7c-4ce3-9b5f-45db9c5f8a19 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.573129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24c76c10-db7c-4ce3-9b5f-45db9c5f8a19 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.573732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24c76c10-db7c-4ce3-9b5f-45db9c5f8a19 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.584374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:24.594976 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-24c76c10-db7c-4ce3-9b5f-45db9c5f8a19 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24c76c10-db7c-4ce3-9b5f-45db9c5f8a19 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e HTTP/1.1 Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'f6793ce4-88ac-4900-88a8-05fbf34e971e'} Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.596765 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.601155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.601155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.601155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:24.601155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:24.601155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. Jul 14 14:55:24.601155 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.601155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24c76c10-db7c-4ce3-9b5f-45db9c5f8a19 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance f6793ce4-88ac-4900-88a8-05fbf34e971e could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:24.601155 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-24c76c10-db7c-4ce3-9b5f-45db9c5f8a19 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e" status: 404 len: 111 microversion: 2.1 time: 0.038695 Jul 14 14:55:24.601155 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2526/5088] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/servers/f6793ce4-88ac-4900-88a8-05fbf34e971e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:24.608335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24696ba3-f2f0-42b8-a7ba-f5b93c13ac08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.608920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-24696ba3-f2f0-42b8-a7ba-f5b93c13ac08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.615789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24696ba3-f2f0-42b8-a7ba-f5b93c13ac08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.616559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24696ba3-f2f0-42b8-a7ba-f5b93c13ac08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.617491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24696ba3-f2f0-42b8-a7ba-f5b93c13ac08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.618043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24696ba3-f2f0-42b8-a7ba-f5b93c13ac08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.635457 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-24696ba3-f2f0-42b8-a7ba-f5b93c13ac08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24696ba3-f2f0-42b8-a7ba-f5b93c13ac08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 HTTP/1.1 Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'fab8280b-6dcc-4928-b155-d85479522d01'} Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:24.637927 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:55:24.642995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.642995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.642995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.642995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.642995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.642995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.642995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:24.642995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:24.642995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:55:24.642995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.642995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24696ba3-f2f0-42b8-a7ba-f5b93c13ac08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:24.643826 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-24696ba3-f2f0-42b8-a7ba-f5b93c13ac08 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 404 len: 111 microversion: 2.1 time: 0.038815 Jul 14 14:55:24.644686 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2563/5089] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:24 2022] DELETE /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:24.653987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d347bba4-5cbf-4f63-b92b-edd526917ce7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.654163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f8861be1-da96-4faf-8fd7-50a39edee51f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.655187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d347bba4-5cbf-4f63-b92b-edd526917ce7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: fab8280b-6dcc-4928-b155-d85479522d01] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.655795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f8861be1-da96-4faf-8fd7-50a39edee51f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.663662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d347bba4-5cbf-4f63-b92b-edd526917ce7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.664573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d347bba4-5cbf-4f63-b92b-edd526917ce7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.665647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d347bba4-5cbf-4f63-b92b-edd526917ce7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.666318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d347bba4-5cbf-4f63-b92b-edd526917ce7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.666973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8861be1-da96-4faf-8fd7-50a39edee51f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.667445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8861be1-da96-4faf-8fd7-50a39edee51f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.668271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8861be1-da96-4faf-8fd7-50a39edee51f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.669422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8861be1-da96-4faf-8fd7-50a39edee51f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.683902 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-d347bba4-5cbf-4f63-b92b-edd526917ce7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d347bba4-5cbf-4f63-b92b-edd526917ce7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 HTTP/1.1 Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'fab8280b-6dcc-4928-b155-d85479522d01'} Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.685903 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.690000 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.690000 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.690000 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:24.690000 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:24.690000 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. Jul 14 14:55:24.690000 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.690000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d347bba4-5cbf-4f63-b92b-edd526917ce7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance fab8280b-6dcc-4928-b155-d85479522d01 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:24.690000 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d347bba4-5cbf-4f63-b92b-edd526917ce7 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01" status: 404 len: 111 microversion: 2.1 time: 0.038910 Jul 14 14:55:24.690000 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2564/5090] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/servers/fab8280b-6dcc-4928-b155-d85479522d01 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:55:24.696565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7779b6f0-a6c7-4ceb-ab25-d2669a14ddb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.697080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7779b6f0-a6c7-4ceb-ab25-d2669a14ddb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.704128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7779b6f0-a6c7-4ceb-ab25-d2669a14ddb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.704580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7779b6f0-a6c7-4ceb-ab25-d2669a14ddb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.709839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7779b6f0-a6c7-4ceb-ab25-d2669a14ddb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.713728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7779b6f0-a6c7-4ceb-ab25-d2669a14ddb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.735514 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-7779b6f0-a6c7-4ceb-ab25-d2669a14ddb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7779b6f0-a6c7-4ceb-ab25-d2669a14ddb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 HTTP/1.1 Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'c50748a8-6d90-4789-b114-2b6d4d88ce11'} Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:24.737306 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:55:24.741468 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.741468 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.741468 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.741468 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.741468 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.741468 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.741468 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:24.741468 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:24.741468 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:55:24.741468 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.741468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7779b6f0-a6c7-4ceb-ab25-d2669a14ddb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:24.741468 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7779b6f0-a6c7-4ceb-ab25-d2669a14ddb6 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 404 len: 111 microversion: 2.1 time: 0.046177 Jul 14 14:55:24.743698 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2565/5091] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:24 2022] DELETE /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:55:24.752205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-437e90a2-09b0-4ae5-ac71-c6f87a9aaf75 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.753307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-437e90a2-09b0-4ae5-ac71-c6f87a9aaf75 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: c50748a8-6d90-4789-b114-2b6d4d88ce11] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.765994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-437e90a2-09b0-4ae5-ac71-c6f87a9aaf75 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.767497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-437e90a2-09b0-4ae5-ac71-c6f87a9aaf75 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.768479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-437e90a2-09b0-4ae5-ac71-c6f87a9aaf75 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.769133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-437e90a2-09b0-4ae5-ac71-c6f87a9aaf75 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.785192 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-437e90a2-09b0-4ae5-ac71-c6f87a9aaf75 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-437e90a2-09b0-4ae5-ac71-c6f87a9aaf75 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 HTTP/1.1 Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'c50748a8-6d90-4789-b114-2b6d4d88ce11'} Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.786770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.791493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.791493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.791493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:24.791493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:24.791493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. Jul 14 14:55:24.791493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.791493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-437e90a2-09b0-4ae5-ac71-c6f87a9aaf75 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance c50748a8-6d90-4789-b114-2b6d4d88ce11 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:24.791493 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-437e90a2-09b0-4ae5-ac71-c6f87a9aaf75 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11" status: 404 len: 111 microversion: 2.1 time: 0.043025 Jul 14 14:55:24.791493 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2566/5092] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/servers/c50748a8-6d90-4789-b114-2b6d4d88ce11 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:24.798571 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-012b1821-29f3-4166-9ca8-d95b36ca1c7f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.799159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-012b1821-29f3-4166-9ca8-d95b36ca1c7f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.807362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-012b1821-29f3-4166-9ca8-d95b36ca1c7f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.809671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-012b1821-29f3-4166-9ca8-d95b36ca1c7f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.810801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-012b1821-29f3-4166-9ca8-d95b36ca1c7f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.811730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-012b1821-29f3-4166-9ca8-d95b36ca1c7f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.831920 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-012b1821-29f3-4166-9ca8-d95b36ca1c7f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-012b1821-29f3-4166-9ca8-d95b36ca1c7f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 HTTP/1.1 Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'd2462a80-02b2-406d-9468-28996da82f64'} Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:24.833840 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-012b1821-29f3-4166-9ca8-d95b36ca1c7f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-012b1821-29f3-4166-9ca8-d95b36ca1c7f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 404 len: 111 microversion: 2.1 time: 0.041389 Jul 14 14:55:24.840424 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2567/5093] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:24 2022] DELETE /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:55:24.845502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a782f06-05da-4faf-8d53-6495080afba5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.846317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0a782f06-05da-4faf-8d53-6495080afba5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.851271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f8861be1-da96-4faf-8fd7-50a39edee51f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:24.857660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a782f06-05da-4faf-8d53-6495080afba5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.858124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a782f06-05da-4faf-8d53-6495080afba5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.859247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a782f06-05da-4faf-8d53-6495080afba5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.859712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a782f06-05da-4faf-8d53-6495080afba5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.862099 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f8861be1-da96-4faf-8fd7-50a39edee51f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.214737 Jul 14 14:55:24.873104 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2527/5094] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:24.886315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cb22dbe7-b8c3-4a07-b914-860fad2df537 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.888384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cb22dbe7-b8c3-4a07-b914-860fad2df537 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: d2462a80-02b2-406d-9468-28996da82f64] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.896497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb22dbe7-b8c3-4a07-b914-860fad2df537 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.897309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb22dbe7-b8c3-4a07-b914-860fad2df537 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.898267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb22dbe7-b8c3-4a07-b914-860fad2df537 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.898873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb22dbe7-b8c3-4a07-b914-860fad2df537 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.928108 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-cb22dbe7-b8c3-4a07-b914-860fad2df537 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cb22dbe7-b8c3-4a07-b914-860fad2df537 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 HTTP/1.1 Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'd2462a80-02b2-406d-9468-28996da82f64'} Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.929853 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.934079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.934079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.934079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:24.934079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:24.934079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. Jul 14 14:55:24.934079 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.934079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cb22dbe7-b8c3-4a07-b914-860fad2df537 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance d2462a80-02b2-406d-9468-28996da82f64 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:24.934079 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cb22dbe7-b8c3-4a07-b914-860fad2df537 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64" status: 404 len: 111 microversion: 2.1 time: 0.058574 Jul 14 14:55:24.934079 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2528/5095] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/servers/d2462a80-02b2-406d-9468-28996da82f64 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:24.942358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-93d94450-3a36-487a-9e7d-e500d38930ae tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.943169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-93d94450-3a36-487a-9e7d-e500d38930ae tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.951896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-93d94450-3a36-487a-9e7d-e500d38930ae tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.952449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-93d94450-3a36-487a-9e7d-e500d38930ae tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.953426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-93d94450-3a36-487a-9e7d-e500d38930ae tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.954005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-93d94450-3a36-487a-9e7d-e500d38930ae tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.972475 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-93d94450-3a36-487a-9e7d-e500d38930ae tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-93d94450-3a36-487a-9e7d-e500d38930ae tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 HTTP/1.1 Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '465cae4c-e138-4d7f-94a6-4e5ebb016c98'} Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:24.974232 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:55:24.978732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.978732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.978732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.978732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.978732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.978732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.978732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:24.978732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:24.978732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:55:24.978732 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.978732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-93d94450-3a36-487a-9e7d-e500d38930ae tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:24.981414 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-93d94450-3a36-487a-9e7d-e500d38930ae tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 404 len: 111 microversion: 2.1 time: 0.042027 Jul 14 14:55:24.984817 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2529/5096] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:24 2022] DELETE /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:24.990251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f6b4bbfe-b5c8-4e30-9266-9fee9bbfaaab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.991864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f6b4bbfe-b5c8-4e30-9266-9fee9bbfaaab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 465cae4c-e138-4d7f-94a6-4e5ebb016c98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:25.002866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6b4bbfe-b5c8-4e30-9266-9fee9bbfaaab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.003344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6b4bbfe-b5c8-4e30-9266-9fee9bbfaaab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.004921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6b4bbfe-b5c8-4e30-9266-9fee9bbfaaab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.009191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6b4bbfe-b5c8-4e30-9266-9fee9bbfaaab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.033286 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f6b4bbfe-b5c8-4e30-9266-9fee9bbfaaab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f6b4bbfe-b5c8-4e30-9266-9fee9bbfaaab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 HTTP/1.1 Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '465cae4c-e138-4d7f-94a6-4e5ebb016c98'} Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.035087 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.039454 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:25.039454 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:25.039454 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:25.039454 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:25.039454 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. Jul 14 14:55:25.039454 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.040079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f6b4bbfe-b5c8-4e30-9266-9fee9bbfaaab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance 465cae4c-e138-4d7f-94a6-4e5ebb016c98 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:25.041478 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f6b4bbfe-b5c8-4e30-9266-9fee9bbfaaab tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98" status: 404 len: 111 microversion: 2.1 time: 0.054867 Jul 14 14:55:25.041914 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2530/5097] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/servers/465cae4c-e138-4d7f-94a6-4e5ebb016c98 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:25.050537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-05c4050c-c6de-4915-b1fa-f95e3754ddbb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:25.051038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-05c4050c-c6de-4915-b1fa-f95e3754ddbb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:25.057422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05c4050c-c6de-4915-b1fa-f95e3754ddbb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.057875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05c4050c-c6de-4915-b1fa-f95e3754ddbb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.059369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05c4050c-c6de-4915-b1fa-f95e3754ddbb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.059812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05c4050c-c6de-4915-b1fa-f95e3754ddbb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.068732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0a782f06-05da-4faf-8d53-6495080afba5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:25.075709 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-05c4050c-c6de-4915-b1fa-f95e3754ddbb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-05c4050c-c6de-4915-b1fa-f95e3754ddbb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba HTTP/1.1 Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '9f7ce841-cb1a-4bb8-8b71-b869986dedba'} Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:25.077538 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:55:25.082392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.082392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:25.082392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.082392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.082392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:25.082392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:25.082392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:25.082392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:25.082392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:55:25.082392 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.083064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0a782f06-05da-4faf-8d53-6495080afba5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:25.083064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0a782f06-05da-4faf-8d53-6495080afba5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:25.083064 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0a782f06-05da-4faf-8d53-6495080afba5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.240856 Jul 14 14:55:25.085364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-05c4050c-c6de-4915-b1fa-f95e3754ddbb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:25.086235 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-05c4050c-c6de-4915-b1fa-f95e3754ddbb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 404 len: 111 microversion: 2.1 time: 0.039952 Jul 14 14:55:25.086804 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2531/5098] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:25 2022] DELETE /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:55:25.089979 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2568/5099] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:25.095543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f4fbae5-4eaf-41a0-bc12-026674485e42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:25.096422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3f4fbae5-4eaf-41a0-bc12-026674485e42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 9f7ce841-cb1a-4bb8-8b71-b869986dedba] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:25.103109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f4fbae5-4eaf-41a0-bc12-026674485e42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.103573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f4fbae5-4eaf-41a0-bc12-026674485e42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.104618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f4fbae5-4eaf-41a0-bc12-026674485e42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.105088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f4fbae5-4eaf-41a0-bc12-026674485e42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.120103 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-3f4fbae5-4eaf-41a0-bc12-026674485e42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f4fbae5-4eaf-41a0-bc12-026674485e42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba HTTP/1.1 Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '9f7ce841-cb1a-4bb8-8b71-b869986dedba'} Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.122525 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.126529 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:25.126529 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:25.126529 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:25.126529 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:25.126529 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. Jul 14 14:55:25.126529 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.126529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f4fbae5-4eaf-41a0-bc12-026674485e42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance 9f7ce841-cb1a-4bb8-8b71-b869986dedba could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:25.126955 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3f4fbae5-4eaf-41a0-bc12-026674485e42 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba" status: 404 len: 111 microversion: 2.1 time: 0.035444 Jul 14 14:55:25.131180 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2532/5100] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:25 2022] GET /compute/v2.1/servers/9f7ce841-cb1a-4bb8-8b71-b869986dedba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:25.135964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4806ccd6-e7c6-4053-8e25-dc8794fa347f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:25.136506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4806ccd6-e7c6-4053-8e25-dc8794fa347f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 0678eeec-7eca-4d88-900e-7eeac0ef7303] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:25.143764 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-4806ccd6-e7c6-4053-8e25-dc8794fa347f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4806ccd6-e7c6-4053-8e25-dc8794fa347f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/0678eeec-7eca-4d88-900e-7eeac0ef7303 HTTP/1.1 Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '0678eeec-7eca-4d88-900e-7eeac0ef7303'} Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:25.145372 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.149411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.149411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:25.149411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:25.149411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:25.149411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:25.149411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:55:25.149411 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.153545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4806ccd6-e7c6-4053-8e25-dc8794fa347f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:25.153545 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4806ccd6-e7c6-4053-8e25-dc8794fa347f tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0678eeec-7eca-4d88-900e-7eeac0ef7303" status: 404 len: 111 microversion: 2.1 time: 0.020183 Jul 14 14:55:25.153545 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2569/5101] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:25 2022] DELETE /compute/v2.1/servers/0678eeec-7eca-4d88-900e-7eeac0ef7303 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:25.161318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2e8fe2bd-7d0c-41bb-8dd4-f1f42a6edb41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:25.161942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2e8fe2bd-7d0c-41bb-8dd4-f1f42a6edb41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: 0678eeec-7eca-4d88-900e-7eeac0ef7303] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:25.172328 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-2e8fe2bd-7d0c-41bb-8dd4-f1f42a6edb41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2e8fe2bd-7d0c-41bb-8dd4-f1f42a6edb41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/0678eeec-7eca-4d88-900e-7eeac0ef7303 HTTP/1.1 Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0678eeec-7eca-4d88-900e-7eeac0ef7303'} Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:25.173862 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:25.177669 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:25.177669 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:25.177669 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. Jul 14 14:55:25.177669 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:25.177669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2e8fe2bd-7d0c-41bb-8dd4-f1f42a6edb41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance 0678eeec-7eca-4d88-900e-7eeac0ef7303 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:25.177669 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2e8fe2bd-7d0c-41bb-8dd4-f1f42a6edb41 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/0678eeec-7eca-4d88-900e-7eeac0ef7303" status: 404 len: 111 microversion: 2.1 time: 0.019055 Jul 14 14:55:25.177669 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2533/5102] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:25 2022] GET /compute/v2.1/servers/0678eeec-7eca-4d88-900e-7eeac0ef7303 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:25.185691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-34ecc498-7ac0-491c-b974-95679099c3f8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:25.186354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-34ecc498-7ac0-491c-b974-95679099c3f8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:25.193426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34ecc498-7ac0-491c-b974-95679099c3f8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.193949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34ecc498-7ac0-491c-b974-95679099c3f8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.194727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34ecc498-7ac0-491c-b974-95679099c3f8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.195167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-34ecc498-7ac0-491c-b974-95679099c3f8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.222614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-34ecc498-7ac0-491c-b974-95679099c3f8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:55:25.313846 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-34ecc498-7ac0-491c-b974-95679099c3f8 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "DELETE /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 204 len: 0 microversion: 2.1 time: 0.132758 Jul 14 14:55:25.317037 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2570/5103] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:25 2022] DELETE /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:55:25.335316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23a0a267-a607-4e83-93ef-f628a864369b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:25.335977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-23a0a267-a607-4e83-93ef-f628a864369b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:25.351955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23a0a267-a607-4e83-93ef-f628a864369b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.352636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23a0a267-a607-4e83-93ef-f628a864369b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.353465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23a0a267-a607-4e83-93ef-f628a864369b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.353916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23a0a267-a607-4e83-93ef-f628a864369b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.640975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-23a0a267-a607-4e83-93ef-f628a864369b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:25.649657 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-23a0a267-a607-4e83-93ef-f628a864369b tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 200 len: 1479 microversion: 2.1 time: 0.330692 Jul 14 14:55:25.650540 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2534/5104] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:25 2022] GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 1479 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:25.881512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4907aee8-81d3-4eda-9292-0d51d58389e1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:25.882903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4907aee8-81d3-4eda-9292-0d51d58389e1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:25.890407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4907aee8-81d3-4eda-9292-0d51d58389e1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.890870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4907aee8-81d3-4eda-9292-0d51d58389e1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.892608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4907aee8-81d3-4eda-9292-0d51d58389e1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.893134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4907aee8-81d3-4eda-9292-0d51d58389e1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.065519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4907aee8-81d3-4eda-9292-0d51d58389e1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:26.075450 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4907aee8-81d3-4eda-9292-0d51d58389e1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.198757 Jul 14 14:55:26.084815 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2571/5105] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:25 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:26.106501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6273e173-7f78-4371-9fcb-24a2407c707a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:26.107579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6273e173-7f78-4371-9fcb-24a2407c707a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:26.114376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6273e173-7f78-4371-9fcb-24a2407c707a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.115132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6273e173-7f78-4371-9fcb-24a2407c707a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.116118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6273e173-7f78-4371-9fcb-24a2407c707a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.116744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6273e173-7f78-4371-9fcb-24a2407c707a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.375263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6273e173-7f78-4371-9fcb-24a2407c707a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:26.385777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6273e173-7f78-4371-9fcb-24a2407c707a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:26.388821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6273e173-7f78-4371-9fcb-24a2407c707a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:26.390188 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6273e173-7f78-4371-9fcb-24a2407c707a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.293318 Jul 14 14:55:26.391101 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2535/5106] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:26 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:26.668622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-73a3b7dc-bca4-4d53-92d5-0d706b5307eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:26.669358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-73a3b7dc-bca4-4d53-92d5-0d706b5307eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:26.675864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73a3b7dc-bca4-4d53-92d5-0d706b5307eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.676323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73a3b7dc-bca4-4d53-92d5-0d706b5307eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.677164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73a3b7dc-bca4-4d53-92d5-0d706b5307eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.677603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73a3b7dc-bca4-4d53-92d5-0d706b5307eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.845848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-73a3b7dc-bca4-4d53-92d5-0d706b5307eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:26.853836 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-73a3b7dc-bca4-4d53-92d5-0d706b5307eb tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 200 len: 1479 microversion: 2.1 time: 0.190175 Jul 14 14:55:26.863358 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2572/5107] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:26 2022] GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 1479 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:27.093834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c58ff128-1300-4e10-88d2-e1dd66fc0ff7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:27.094461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c58ff128-1300-4e10-88d2-e1dd66fc0ff7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:27.102687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c58ff128-1300-4e10-88d2-e1dd66fc0ff7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:27.103134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c58ff128-1300-4e10-88d2-e1dd66fc0ff7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.103931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c58ff128-1300-4e10-88d2-e1dd66fc0ff7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:27.104350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c58ff128-1300-4e10-88d2-e1dd66fc0ff7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.416202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-232ffff5-5682-4b10-a6b0-77898d50f527 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:27.416727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-232ffff5-5682-4b10-a6b0-77898d50f527 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:27.430594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-232ffff5-5682-4b10-a6b0-77898d50f527 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:27.431059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-232ffff5-5682-4b10-a6b0-77898d50f527 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.432140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-232ffff5-5682-4b10-a6b0-77898d50f527 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:27.432308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-232ffff5-5682-4b10-a6b0-77898d50f527 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.677469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c58ff128-1300-4e10-88d2-e1dd66fc0ff7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:27.689972 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c58ff128-1300-4e10-88d2-e1dd66fc0ff7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.601512 Jul 14 14:55:27.690571 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2536/5108] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:27 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:27.757046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-232ffff5-5682-4b10-a6b0-77898d50f527 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:27.770077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-232ffff5-5682-4b10-a6b0-77898d50f527 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:27.772177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-232ffff5-5682-4b10-a6b0-77898d50f527 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:27.779270 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-232ffff5-5682-4b10-a6b0-77898d50f527 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.371774 Jul 14 14:55:27.780649 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2573/5109] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:27 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:55:27.845992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-426445f7-6fd2-4a28-b248-e24260df9264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:27.846652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-426445f7-6fd2-4a28-b248-e24260df9264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:27.853861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-426445f7-6fd2-4a28-b248-e24260df9264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:27.854549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-426445f7-6fd2-4a28-b248-e24260df9264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.856125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-426445f7-6fd2-4a28-b248-e24260df9264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:27.856729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-426445f7-6fd2-4a28-b248-e24260df9264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.875777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-709d355a-43bd-4d04-8da3-a7e2e29be4e2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:27.876490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-709d355a-43bd-4d04-8da3-a7e2e29be4e2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:27.883137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-709d355a-43bd-4d04-8da3-a7e2e29be4e2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:27.888369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-709d355a-43bd-4d04-8da3-a7e2e29be4e2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.891501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-709d355a-43bd-4d04-8da3-a7e2e29be4e2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:27.892271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-709d355a-43bd-4d04-8da3-a7e2e29be4e2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.983246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-426445f7-6fd2-4a28-b248-e24260df9264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lazy-loading 'services' on Instance uuid 6b9e2f71-381c-4989-9db3-ee7cccb35a2a {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:55:28.156238 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-426445f7-6fd2-4a28-b248-e24260df9264 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments/123eec53-7289-4612-9ad6-31051cb50a63" status: 202 len: 0 microversion: 2.1 time: 0.314898 Jul 14 14:55:28.161175 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2537/5110] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 14:55:27 2022] DELETE /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments/123eec53-7289-4612-9ad6-31051cb50a63 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:55:28.167594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-40523f17-f2d0-4f9e-8407-52728eed6f56 req-587a530f-e527-40bd-a8b9-339d3d9a3067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc099f7a-cc72-418f-a1ab-34040ebb0275", "name": "network-vif-deleted", "tag": "7cf26e3d-566a-483e-9cdb-ae816129726c"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:28.179750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-40523f17-f2d0-4f9e-8407-52728eed6f56 req-587a530f-e527-40bd-a8b9-339d3d9a3067 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:28.180611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-40523f17-f2d0-4f9e-8407-52728eed6f56 req-587a530f-e527-40bd-a8b9-339d3d9a3067 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:28.198368 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-40523f17-f2d0-4f9e-8407-52728eed6f56 req-587a530f-e527-40bd-a8b9-339d3d9a3067 service nova] Creating event network-vif-deleted:7cf26e3d-566a-483e-9cdb-ae816129726c for instance bc099f7a-cc72-418f-a1ab-34040ebb0275 on n-h2-767704-28 Jul 14 14:55:28.206872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-709d355a-43bd-4d04-8da3-a7e2e29be4e2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3af45ec76c4a0b8dd03dcff6802f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315bd34f122d4428a8fede4ef18c0eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:28.223877 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-40523f17-f2d0-4f9e-8407-52728eed6f56 req-587a530f-e527-40bd-a8b9-339d3d9a3067 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056441 Jul 14 14:55:28.226379 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2538/5111] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:28.227139 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-709d355a-43bd-4d04-8da3-a7e2e29be4e2 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 200 len: 1479 microversion: 2.1 time: 0.352593 Jul 14 14:55:28.228613 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2574/5112] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:27 2022] GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 1479 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:28.246864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f1f503ae-1840-4cfe-aa0f-44a86ef44e32 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:28.248215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f1f503ae-1840-4cfe-aa0f-44a86ef44e32 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:28.267224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1f503ae-1840-4cfe-aa0f-44a86ef44e32 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:28.268233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1f503ae-1840-4cfe-aa0f-44a86ef44e32 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:28.269764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1f503ae-1840-4cfe-aa0f-44a86ef44e32 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:28.271550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f1f503ae-1840-4cfe-aa0f-44a86ef44e32 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:28.330261 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f1f503ae-1840-4cfe-aa0f-44a86ef44e32 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100725 Jul 14 14:55:28.331135 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2539/5113] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:55:28 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:28.716730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f2ca1a5d-1195-4494-9dc3-5175310d04cc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:28.717540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f2ca1a5d-1195-4494-9dc3-5175310d04cc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:28.725085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f2ca1a5d-1195-4494-9dc3-5175310d04cc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:28.725805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f2ca1a5d-1195-4494-9dc3-5175310d04cc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:28.727160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f2ca1a5d-1195-4494-9dc3-5175310d04cc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:28.727795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f2ca1a5d-1195-4494-9dc3-5175310d04cc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:28.802334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-29c4d06f-ea5e-421b-ba40-032f51ede801 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:28.803160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-29c4d06f-ea5e-421b-ba40-032f51ede801 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:28.810458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29c4d06f-ea5e-421b-ba40-032f51ede801 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:28.811447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29c4d06f-ea5e-421b-ba40-032f51ede801 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:28.812673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29c4d06f-ea5e-421b-ba40-032f51ede801 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:28.813410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-29c4d06f-ea5e-421b-ba40-032f51ede801 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:28.951393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f2ca1a5d-1195-4494-9dc3-5175310d04cc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:28.976288 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f2ca1a5d-1195-4494-9dc3-5175310d04cc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.263348 Jul 14 14:55:28.977342 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2575/5114] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:28 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:29.069413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-29c4d06f-ea5e-421b-ba40-032f51ede801 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:29.079915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-29c4d06f-ea5e-421b-ba40-032f51ede801 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:29.081710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-29c4d06f-ea5e-421b-ba40-032f51ede801 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:29.082935 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-29c4d06f-ea5e-421b-ba40-032f51ede801 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.286274 Jul 14 14:55:29.095077 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2540/5115] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:28 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:29.245556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e267fd78-0d7a-4a6d-9fd9-dea999ad0921 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:29.247905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e267fd78-0d7a-4a6d-9fd9-dea999ad0921 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] [instance: bc099f7a-cc72-418f-a1ab-34040ebb0275] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:29.256091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e267fd78-0d7a-4a6d-9fd9-dea999ad0921 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:29.256975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e267fd78-0d7a-4a6d-9fd9-dea999ad0921 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:29.258157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e267fd78-0d7a-4a6d-9fd9-dea999ad0921 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:29.259084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e267fd78-0d7a-4a6d-9fd9-dea999ad0921 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:29.264860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:29.295645 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-e267fd78-0d7a-4a6d-9fd9-dea999ad0921 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] HTTP exception thrown: Instance bc099f7a-cc72-418f-a1ab-34040ebb0275 could not be found. Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e267fd78-0d7a-4a6d-9fd9-dea999ad0921 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Request method failure captured: Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 HTTP/1.1 Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C1NLXNvFwWSPMGmEzpvCuYSfdks_nREpZP3cNawYTAN60fGu9UAQmu0kTjrBXCTIKzrGT-BqYcko9tyehqddpfHiW5g-AMQh66HtMf07J-9QfNwatkv3rM_LSBaY3Dt9_XgB43KXJptWJPzTv0rFHREKnCTyLQwsjRY117uTCG9ECA Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/315bd34f122d4428a8fede4ef18c0eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_315bd34f122d4428a8fede4ef18c0eae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/315bd34f122d4428a8fede4ef18c0eae"}]}] Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersTestJSON-1476538492 Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 315bd34f122d4428a8fede4ef18c0eae Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersTestJSON-1476538492 Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 4e3af45ec76c4a0b8dd03dcff6802f3c Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersTestJSON-1476538492-project Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance bc099f7a-cc72-418f-a1ab-34040ebb0275 could not be found. Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'bc099f7a-cc72-418f-a1ab-34040ebb0275'} Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc099f7a-cc72-418f-a1ab-34040ebb0275 could not be found. Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc099f7a-cc72-418f-a1ab-34040ebb0275 could not be found. Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:29.298071 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:29.301673 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:29.301673 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:29.301673 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:29.301673 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:29.301673 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc099f7a-cc72-418f-a1ab-34040ebb0275 could not be found. Jul 14 14:55:29.301673 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:55:29.303937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e267fd78-0d7a-4a6d-9fd9-dea999ad0921 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] Returning 404 to user: Instance bc099f7a-cc72-418f-a1ab-34040ebb0275 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:29.305243 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e267fd78-0d7a-4a6d-9fd9-dea999ad0921 tempest-ServersTestJSON-1476538492 tempest-ServersTestJSON-1476538492-project] 10.222.0.81 "GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275" status: 404 len: 111 microversion: 2.1 time: 0.064111 Jul 14 14:55:29.310750 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2576/5116] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:29 2022] GET /compute/v2.1/servers/bc099f7a-cc72-418f-a1ab-34040ebb0275 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:29.343891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-419b2316-98ff-478f-a12a-54e9d23ebac3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:29.345499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-419b2316-98ff-478f-a12a-54e9d23ebac3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:29.352912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-419b2316-98ff-478f-a12a-54e9d23ebac3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:29.353768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-419b2316-98ff-478f-a12a-54e9d23ebac3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:29.354874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-419b2316-98ff-478f-a12a-54e9d23ebac3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:29.355918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-419b2316-98ff-478f-a12a-54e9d23ebac3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:29.397414 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-419b2316-98ff-478f-a12a-54e9d23ebac3 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058516 Jul 14 14:55:29.403100 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2541/5117] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:55:29 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:55:29.997210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ec8d047-c662-4b23-9c9d-7e8e860c7395 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:29.998292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ec8d047-c662-4b23-9c9d-7e8e860c7395 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:30.019843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ec8d047-c662-4b23-9c9d-7e8e860c7395 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:30.020513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ec8d047-c662-4b23-9c9d-7e8e860c7395 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:30.021824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ec8d047-c662-4b23-9c9d-7e8e860c7395 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:30.022409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ec8d047-c662-4b23-9c9d-7e8e860c7395 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:30.102480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0a3a2139-bbb8-4826-9898-a01ebd9c3edb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:30.103558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0a3a2139-bbb8-4826-9898-a01ebd9c3edb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:30.119072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a3a2139-bbb8-4826-9898-a01ebd9c3edb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:30.119250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a3a2139-bbb8-4826-9898-a01ebd9c3edb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:30.121777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a3a2139-bbb8-4826-9898-a01ebd9c3edb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:30.122333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a3a2139-bbb8-4826-9898-a01ebd9c3edb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:30.371690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ec8d047-c662-4b23-9c9d-7e8e860c7395 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:30.412388 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ec8d047-c662-4b23-9c9d-7e8e860c7395 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.420796 Jul 14 14:55:30.413769 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2577/5118] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:29 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:30.421910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5f93db8c-17f9-41f3-8265-ab6ae9545980 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:30.424727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5f93db8c-17f9-41f3-8265-ab6ae9545980 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:30.436991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f93db8c-17f9-41f3-8265-ab6ae9545980 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:30.439166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f93db8c-17f9-41f3-8265-ab6ae9545980 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:30.445107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f93db8c-17f9-41f3-8265-ab6ae9545980 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:30.446398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f93db8c-17f9-41f3-8265-ab6ae9545980 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:30.500802 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5f93db8c-17f9-41f3-8265-ab6ae9545980 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084644 Jul 14 14:55:30.502837 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2578/5119] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:55:30 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:30.581600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0a3a2139-bbb8-4826-9898-a01ebd9c3edb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:30.593519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0a3a2139-bbb8-4826-9898-a01ebd9c3edb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:30.595773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0a3a2139-bbb8-4826-9898-a01ebd9c3edb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:30.597787 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0a3a2139-bbb8-4826-9898-a01ebd9c3edb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.499281 Jul 14 14:55:30.600386 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2542/5120] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:30 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:31.436276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-671efa85-6a83-4f8a-90bf-a5e3684de181 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:31.437051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-671efa85-6a83-4f8a-90bf-a5e3684de181 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:31.446982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-671efa85-6a83-4f8a-90bf-a5e3684de181 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:31.448242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-671efa85-6a83-4f8a-90bf-a5e3684de181 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:31.451133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-671efa85-6a83-4f8a-90bf-a5e3684de181 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:31.451867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-671efa85-6a83-4f8a-90bf-a5e3684de181 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:31.520495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8dee9637-4e51-4ea5-a4eb-c22029bdf6fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:31.525306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8dee9637-4e51-4ea5-a4eb-c22029bdf6fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:31.555333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dee9637-4e51-4ea5-a4eb-c22029bdf6fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:31.556529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dee9637-4e51-4ea5-a4eb-c22029bdf6fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:31.564354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dee9637-4e51-4ea5-a4eb-c22029bdf6fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:31.565190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dee9637-4e51-4ea5-a4eb-c22029bdf6fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:31.642488 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8dee9637-4e51-4ea5-a4eb-c22029bdf6fc tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132876 Jul 14 14:55:31.645864 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2543/5121] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:55:31 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:31.654705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a714ff70-1584-4866-aebc-fff81c4a4d28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:31.656331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a714ff70-1584-4866-aebc-fff81c4a4d28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:31.667525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a714ff70-1584-4866-aebc-fff81c4a4d28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:31.668737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a714ff70-1584-4866-aebc-fff81c4a4d28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:31.670783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a714ff70-1584-4866-aebc-fff81c4a4d28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:31.672459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a714ff70-1584-4866-aebc-fff81c4a4d28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:32.486426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-671efa85-6a83-4f8a-90bf-a5e3684de181 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:32.501482 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-671efa85-6a83-4f8a-90bf-a5e3684de181 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 1.071856 Jul 14 14:55:32.502122 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2579/5122] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:31 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:32.512575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a714ff70-1584-4866-aebc-fff81c4a4d28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:32.529468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a714ff70-1584-4866-aebc-fff81c4a4d28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:32.532171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a714ff70-1584-4866-aebc-fff81c4a4d28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:32.533428 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a714ff70-1584-4866-aebc-fff81c4a4d28 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.886027 Jul 14 14:55:32.534002 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2544/5123] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:31 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:32.659208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d1eb0d92-e193-4b4e-b679-d788fb43d3bd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:32.660889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d1eb0d92-e193-4b4e-b679-d788fb43d3bd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:32.674234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1eb0d92-e193-4b4e-b679-d788fb43d3bd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:32.677927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1eb0d92-e193-4b4e-b679-d788fb43d3bd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:32.679717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1eb0d92-e193-4b4e-b679-d788fb43d3bd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:32.682388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1eb0d92-e193-4b4e-b679-d788fb43d3bd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:32.743080 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d1eb0d92-e193-4b4e-b679-d788fb43d3bd tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091177 Jul 14 14:55:32.743784 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2580/5124] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:55:32 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:33.521811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-952ddad9-fc3d-42d9-981a-e25ba70767fe tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:33.522606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-952ddad9-fc3d-42d9-981a-e25ba70767fe tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:33.542744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-952ddad9-fc3d-42d9-981a-e25ba70767fe tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:33.543613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-952ddad9-fc3d-42d9-981a-e25ba70767fe tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:33.544188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-952ddad9-fc3d-42d9-981a-e25ba70767fe tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:33.558910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b6022e6-cc6f-4c16-ae09-0b0447a33d73 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:33.562007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1b6022e6-cc6f-4c16-ae09-0b0447a33d73 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:33.571900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-952ddad9-fc3d-42d9-981a-e25ba70767fe tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:33.589796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b6022e6-cc6f-4c16-ae09-0b0447a33d73 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:33.590263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b6022e6-cc6f-4c16-ae09-0b0447a33d73 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:33.591581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b6022e6-cc6f-4c16-ae09-0b0447a33d73 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:33.602392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b6022e6-cc6f-4c16-ae09-0b0447a33d73 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:34.027230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1b6022e6-cc6f-4c16-ae09-0b0447a33d73 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:34.036784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1b6022e6-cc6f-4c16-ae09-0b0447a33d73 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:34.038565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1b6022e6-cc6f-4c16-ae09-0b0447a33d73 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:34.040092 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1b6022e6-cc6f-4c16-ae09-0b0447a33d73 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1743 microversion: 2.20 time: 0.491573 Jul 14 14:55:34.041188 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2581/5125] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:33 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1743 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:34.046635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bf660a5e-8459-4dbb-8806-e5e7f07f0e21 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:34.047811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bf660a5e-8459-4dbb-8806-e5e7f07f0e21 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:34.065205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf660a5e-8459-4dbb-8806-e5e7f07f0e21 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:34.065780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf660a5e-8459-4dbb-8806-e5e7f07f0e21 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:34.067457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf660a5e-8459-4dbb-8806-e5e7f07f0e21 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:34.068072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf660a5e-8459-4dbb-8806-e5e7f07f0e21 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:34.105632 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bf660a5e-8459-4dbb-8806-e5e7f07f0e21 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062811 Jul 14 14:55:34.110327 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2582/5126] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:55:34 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:34.126767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-952ddad9-fc3d-42d9-981a-e25ba70767fe tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:34.136552 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-952ddad9-fc3d-42d9-981a-e25ba70767fe tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.620455 Jul 14 14:55:34.138913 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2545/5127] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:33 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:35.064604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-23e40904-e621-4b50-ac02-e32e28b3ffb2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:35.069260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-23e40904-e621-4b50-ac02-e32e28b3ffb2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:35.087516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23e40904-e621-4b50-ac02-e32e28b3ffb2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:35.088204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23e40904-e621-4b50-ac02-e32e28b3ffb2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:35.089276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23e40904-e621-4b50-ac02-e32e28b3ffb2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:35.090118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23e40904-e621-4b50-ac02-e32e28b3ffb2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:35.117834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c18214db-f30b-4ad7-a803-5bbe5cf607da tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:35.118780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c18214db-f30b-4ad7-a803-5bbe5cf607da tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:35.134994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c18214db-f30b-4ad7-a803-5bbe5cf607da tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:35.135635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c18214db-f30b-4ad7-a803-5bbe5cf607da tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:35.138527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c18214db-f30b-4ad7-a803-5bbe5cf607da tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:35.139421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c18214db-f30b-4ad7-a803-5bbe5cf607da tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:35.220296 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c18214db-f30b-4ad7-a803-5bbe5cf607da tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104846 Jul 14 14:55:35.223266 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2546/5128] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:55:35 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:35.248777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-757db6f5-1233-48ce-b3bc-6dbf2a2cbf61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:35.252414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-757db6f5-1233-48ce-b3bc-6dbf2a2cbf61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:35.285192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-757db6f5-1233-48ce-b3bc-6dbf2a2cbf61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:35.305140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-757db6f5-1233-48ce-b3bc-6dbf2a2cbf61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:35.308130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-757db6f5-1233-48ce-b3bc-6dbf2a2cbf61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:35.314123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-757db6f5-1233-48ce-b3bc-6dbf2a2cbf61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:35.460021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-23e40904-e621-4b50-ac02-e32e28b3ffb2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:35.475546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-23e40904-e621-4b50-ac02-e32e28b3ffb2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:35.482216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-23e40904-e621-4b50-ac02-e32e28b3ffb2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:35.486522 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-23e40904-e621-4b50-ac02-e32e28b3ffb2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.428747 Jul 14 14:55:35.499741 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2583/5129] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:35 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:35.681888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-757db6f5-1233-48ce-b3bc-6dbf2a2cbf61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:35.686586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:35.705242 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-757db6f5-1233-48ce-b3bc-6dbf2a2cbf61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1534 microversion: 2.1 time: 0.479878 Jul 14 14:55:35.709164 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2547/5130] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:35 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1534 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:36.233215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6643efe5-f666-48aa-9764-be7b3f3beb9b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:36.234164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6643efe5-f666-48aa-9764-be7b3f3beb9b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:36.260419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6643efe5-f666-48aa-9764-be7b3f3beb9b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:36.264294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6643efe5-f666-48aa-9764-be7b3f3beb9b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:36.266640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6643efe5-f666-48aa-9764-be7b3f3beb9b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:36.267396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6643efe5-f666-48aa-9764-be7b3f3beb9b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:36.308767 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6643efe5-f666-48aa-9764-be7b3f3beb9b tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080381 Jul 14 14:55:36.314777 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2584/5131] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 14:55:36 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:55:36.407695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e68f9670-6bb5-4fc2-9d9f-777477958e33 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:36.408303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e68f9670-6bb5-4fc2-9d9f-777477958e33 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:36.412784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:36.419905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e68f9670-6bb5-4fc2-9d9f-777477958e33 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:36.430972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e68f9670-6bb5-4fc2-9d9f-777477958e33 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:36.432398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e68f9670-6bb5-4fc2-9d9f-777477958e33 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:36.432398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e68f9670-6bb5-4fc2-9d9f-777477958e33 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:36.482649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e68f9670-6bb5-4fc2-9d9f-777477958e33 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:55:36.509577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3ecdf519-fb0d-4452-adad-3da2d564641b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:36.510543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3ecdf519-fb0d-4452-adad-3da2d564641b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:36.523756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ecdf519-fb0d-4452-adad-3da2d564641b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:36.524548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ecdf519-fb0d-4452-adad-3da2d564641b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:36.526363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ecdf519-fb0d-4452-adad-3da2d564641b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:36.528503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ecdf519-fb0d-4452-adad-3da2d564641b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:36.698203 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e68f9670-6bb5-4fc2-9d9f-777477958e33 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 204 len: 0 microversion: 2.1 time: 0.296812 Jul 14 14:55:36.701686 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2548/5132] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:36 2022] DELETE /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:55:36.714118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ff2b9879-729d-448d-8991-53c471c7e1c6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:36.715627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ff2b9879-729d-448d-8991-53c471c7e1c6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:36.726418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff2b9879-729d-448d-8991-53c471c7e1c6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:36.727108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff2b9879-729d-448d-8991-53c471c7e1c6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:36.728940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff2b9879-729d-448d-8991-53c471c7e1c6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:36.731901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff2b9879-729d-448d-8991-53c471c7e1c6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:37.116132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3ecdf519-fb0d-4452-adad-3da2d564641b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:37.127426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3ecdf519-fb0d-4452-adad-3da2d564641b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:37.133114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3ecdf519-fb0d-4452-adad-3da2d564641b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:37.139084 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3ecdf519-fb0d-4452-adad-3da2d564641b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.633393 Jul 14 14:55:37.140665 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2585/5133] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:36 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:55:37.153000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3e93a67e-5d76-417d-a61b-367152cf0b63 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:37.153808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3e93a67e-5d76-417d-a61b-367152cf0b63 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:37.169141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e93a67e-5d76-417d-a61b-367152cf0b63 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:37.169604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e93a67e-5d76-417d-a61b-367152cf0b63 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:37.170416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e93a67e-5d76-417d-a61b-367152cf0b63 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:37.170853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e93a67e-5d76-417d-a61b-367152cf0b63 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:37.210819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ff2b9879-729d-448d-8991-53c471c7e1c6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:37.222067 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ff2b9879-729d-448d-8991-53c471c7e1c6 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1682 microversion: 2.1 time: 0.515316 Jul 14 14:55:37.225692 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2549/5134] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:36 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1682 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:37.239003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f705f4d4-a87f-4792-8fc4-e190d644b26d req-92027efc-20bf-438d-b2bb-ea2ed01af785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5292ea7-49d5-4a1e-8fee-76a77bf64afa", "name": "network-vif-plugged", "status": "completed", "tag": "93b2a2b3-1bf6-47ff-9851-01934b486943"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:37.264123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f705f4d4-a87f-4792-8fc4-e190d644b26d req-92027efc-20bf-438d-b2bb-ea2ed01af785 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:37.270929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f705f4d4-a87f-4792-8fc4-e190d644b26d req-92027efc-20bf-438d-b2bb-ea2ed01af785 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:37.285064 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f705f4d4-a87f-4792-8fc4-e190d644b26d req-92027efc-20bf-438d-b2bb-ea2ed01af785 service nova] Creating event network-vif-plugged:93b2a2b3-1bf6-47ff-9851-01934b486943 for instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa on n-h1-767704-28 Jul 14 14:55:37.290385 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f705f4d4-a87f-4792-8fc4-e190d644b26d req-92027efc-20bf-438d-b2bb-ea2ed01af785 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062856 Jul 14 14:55:37.291355 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2550/5135] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:37.547330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3e93a67e-5d76-417d-a61b-367152cf0b63 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:37.569379 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3e93a67e-5d76-417d-a61b-367152cf0b63 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1534 microversion: 2.1 time: 0.427235 Jul 14 14:55:37.577595 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2586/5136] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:37 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1534 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:38.164261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4cf6f04b-8757-4cee-9dc7-94774a3d8aa5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:38.165914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4cf6f04b-8757-4cee-9dc7-94774a3d8aa5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:38.179334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4cf6f04b-8757-4cee-9dc7-94774a3d8aa5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:38.179996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4cf6f04b-8757-4cee-9dc7-94774a3d8aa5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:38.181089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4cf6f04b-8757-4cee-9dc7-94774a3d8aa5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:38.181681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4cf6f04b-8757-4cee-9dc7-94774a3d8aa5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:38.245257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8d3f0b21-93bf-4b6e-a1a9-7328cfff2896 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:38.247681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8d3f0b21-93bf-4b6e-a1a9-7328cfff2896 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:38.269781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d3f0b21-93bf-4b6e-a1a9-7328cfff2896 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:38.273655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d3f0b21-93bf-4b6e-a1a9-7328cfff2896 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:38.275493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d3f0b21-93bf-4b6e-a1a9-7328cfff2896 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:38.277452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d3f0b21-93bf-4b6e-a1a9-7328cfff2896 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:38.536720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4cf6f04b-8757-4cee-9dc7-94774a3d8aa5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:38.554809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4cf6f04b-8757-4cee-9dc7-94774a3d8aa5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:38.564213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4cf6f04b-8757-4cee-9dc7-94774a3d8aa5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:38.566153 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4cf6f04b-8757-4cee-9dc7-94774a3d8aa5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.410295 Jul 14 14:55:38.580639 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2551/5137] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:38 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:38.601738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0e44b83f-e32f-4873-a802-c209ec3e758b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:38.602745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0e44b83f-e32f-4873-a802-c209ec3e758b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:38.623913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e44b83f-e32f-4873-a802-c209ec3e758b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:38.624715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e44b83f-e32f-4873-a802-c209ec3e758b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:38.625810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e44b83f-e32f-4873-a802-c209ec3e758b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:38.626411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e44b83f-e32f-4873-a802-c209ec3e758b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:38.768031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8d3f0b21-93bf-4b6e-a1a9-7328cfff2896 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:38.780828 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8d3f0b21-93bf-4b6e-a1a9-7328cfff2896 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1682 microversion: 2.1 time: 0.541742 Jul 14 14:55:38.782872 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2587/5138] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:38 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1682 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:39.010644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0e44b83f-e32f-4873-a802-c209ec3e758b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:39.028122 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0e44b83f-e32f-4873-a802-c209ec3e758b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.436888 Jul 14 14:55:39.038730 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2552/5139] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:38 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:39.588356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7072ebda-1b20-44fd-b76e-7456f806ffd4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:39.590643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7072ebda-1b20-44fd-b76e-7456f806ffd4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:39.605459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7072ebda-1b20-44fd-b76e-7456f806ffd4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:39.606350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7072ebda-1b20-44fd-b76e-7456f806ffd4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:39.608599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7072ebda-1b20-44fd-b76e-7456f806ffd4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:39.610522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7072ebda-1b20-44fd-b76e-7456f806ffd4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:39.807023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ab9c2e8f-41a2-49f3-a2ae-4768d021167e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:39.808972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ab9c2e8f-41a2-49f3-a2ae-4768d021167e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:39.828233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab9c2e8f-41a2-49f3-a2ae-4768d021167e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:39.830178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab9c2e8f-41a2-49f3-a2ae-4768d021167e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:39.832640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab9c2e8f-41a2-49f3-a2ae-4768d021167e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:39.835341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab9c2e8f-41a2-49f3-a2ae-4768d021167e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:40.100332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ab9c2e8f-41a2-49f3-a2ae-4768d021167e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:40.122180 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ab9c2e8f-41a2-49f3-a2ae-4768d021167e tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1614 microversion: 2.1 time: 0.322891 Jul 14 14:55:40.134193 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2553/5140] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:39 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1614 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:40.150134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-721c6252-0992-47bd-becf-a2b2e7c6fa7f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:40.150782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-721c6252-0992-47bd-becf-a2b2e7c6fa7f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:40.179988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-721c6252-0992-47bd-becf-a2b2e7c6fa7f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:40.180455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-721c6252-0992-47bd-becf-a2b2e7c6fa7f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:40.186713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-721c6252-0992-47bd-becf-a2b2e7c6fa7f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:40.187190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-721c6252-0992-47bd-becf-a2b2e7c6fa7f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:40.237930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7072ebda-1b20-44fd-b76e-7456f806ffd4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:40.254803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7072ebda-1b20-44fd-b76e-7456f806ffd4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:40.269395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7072ebda-1b20-44fd-b76e-7456f806ffd4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:40.273086 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7072ebda-1b20-44fd-b76e-7456f806ffd4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.690566 Jul 14 14:55:40.275499 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2588/5141] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:39 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:40.291635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4e76af31-d173-4f39-9078-8145c617a6ce req-db372b3b-bae5-47ce-9883-4bf673ca25d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f554d9f-a901-4284-8c0e-d34d0924e67d", "name": "network-vif-plugged", "status": "completed", "tag": "9af0d9f1-4145-44d0-a287-acb8ff126aa7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:40.315665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4e76af31-d173-4f39-9078-8145c617a6ce req-db372b3b-bae5-47ce-9883-4bf673ca25d8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:40.316159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4e76af31-d173-4f39-9078-8145c617a6ce req-db372b3b-bae5-47ce-9883-4bf673ca25d8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:40.351472 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4e76af31-d173-4f39-9078-8145c617a6ce req-db372b3b-bae5-47ce-9883-4bf673ca25d8 service nova] Creating event network-vif-plugged:9af0d9f1-4145-44d0-a287-acb8ff126aa7 for instance 0f554d9f-a901-4284-8c0e-d34d0924e67d on n-h2-767704-28 Jul 14 14:55:40.363440 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4e76af31-d173-4f39-9078-8145c617a6ce req-db372b3b-bae5-47ce-9883-4bf673ca25d8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083858 Jul 14 14:55:40.375523 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2589/5142] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:40.698514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-721c6252-0992-47bd-becf-a2b2e7c6fa7f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:40.712196 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-721c6252-0992-47bd-becf-a2b2e7c6fa7f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.575765 Jul 14 14:55:40.717965 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2554/5143] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:40 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:40.919062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1774517930", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": "none"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:41.141858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-820b8eac-458d-4eb5-9cf1-f16a6c189d4a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:41.142636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-820b8eac-458d-4eb5-9cf1-f16a6c189d4a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:41.157363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-820b8eac-458d-4eb5-9cf1-f16a6c189d4a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:41.163074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-820b8eac-458d-4eb5-9cf1-f16a6c189d4a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:41.168143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-820b8eac-458d-4eb5-9cf1-f16a6c189d4a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:41.170296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-820b8eac-458d-4eb5-9cf1-f16a6c189d4a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:41.413558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-820b8eac-458d-4eb5-9cf1-f16a6c189d4a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9260cbc32f1e423ab8ea4d06058b4050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c2a638aab846d39d0a225ac6cc69d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:41.423746 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-820b8eac-458d-4eb5-9cf1-f16a6c189d4a tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 200 len: 1614 microversion: 2.1 time: 0.286135 Jul 14 14:55:41.426505 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2555/5144] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:41 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 1614 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:41.432602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-89568282-dbea-4da9-a5fe-a9adf3f3ab6d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:41.437845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-89568282-dbea-4da9-a5fe-a9adf3f3ab6d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:41.456224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89568282-dbea-4da9-a5fe-a9adf3f3ab6d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:41.456932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89568282-dbea-4da9-a5fe-a9adf3f3ab6d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:41.457946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89568282-dbea-4da9-a5fe-a9adf3f3ab6d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:41.458555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89568282-dbea-4da9-a5fe-a9adf3f3ab6d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:41.689880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-89568282-dbea-4da9-a5fe-a9adf3f3ab6d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:41.711235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-89568282-dbea-4da9-a5fe-a9adf3f3ab6d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:41.713415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-89568282-dbea-4da9-a5fe-a9adf3f3ab6d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:41.715437 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-89568282-dbea-4da9-a5fe-a9adf3f3ab6d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.287098 Jul 14 14:55:41.728393 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2556/5145] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:41 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:41.734635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e967d78b-3936-413d-973b-445ee4ba278c req-af49bd90-660d-41e0-8dbc-b87557a24641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9e2f71-381c-4989-9db3-ee7cccb35a2a", "name": "network-vif-deleted", "tag": "784131ad-46f8-4829-aa2e-78e6294d0f3b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:41.744139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e967d78b-3936-413d-973b-445ee4ba278c req-af49bd90-660d-41e0-8dbc-b87557a24641 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:41.744876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e967d78b-3936-413d-973b-445ee4ba278c req-af49bd90-660d-41e0-8dbc-b87557a24641 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:41.758556 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e967d78b-3936-413d-973b-445ee4ba278c req-af49bd90-660d-41e0-8dbc-b87557a24641 service nova] Creating event network-vif-deleted:784131ad-46f8-4829-aa2e-78e6294d0f3b for instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a on n-h2-767704-28 Jul 14 14:55:41.801259 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e967d78b-3936-413d-973b-445ee4ba278c req-af49bd90-660d-41e0-8dbc-b87557a24641 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070831 Jul 14 14:55:41.802599 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2557/5146] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:41.812762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8a5574fd-b59b-4f7e-a374-4926d0a143da tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:41.815149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8a5574fd-b59b-4f7e-a374-4926d0a143da tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:41.830353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a5574fd-b59b-4f7e-a374-4926d0a143da tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:41.832568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a5574fd-b59b-4f7e-a374-4926d0a143da tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:41.835460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a5574fd-b59b-4f7e-a374-4926d0a143da tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:41.836036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a5574fd-b59b-4f7e-a374-4926d0a143da tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:42.313715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8a5574fd-b59b-4f7e-a374-4926d0a143da tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:42.329105 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8a5574fd-b59b-4f7e-a374-4926d0a143da tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.522263 Jul 14 14:55:42.334610 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2558/5147] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:41 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:42.444446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f0acf9b8-7304-4c9d-b725-d23576734ea2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:42.445132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f0acf9b8-7304-4c9d-b725-d23576734ea2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:42.467323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0acf9b8-7304-4c9d-b725-d23576734ea2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:42.469988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0acf9b8-7304-4c9d-b725-d23576734ea2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:42.471009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0acf9b8-7304-4c9d-b725-d23576734ea2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:42.472640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0acf9b8-7304-4c9d-b725-d23576734ea2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:42.517444 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f0acf9b8-7304-4c9d-b725-d23576734ea2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f0acf9b8-7304-4c9d-b725-d23576734ea2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a HTTP/1.1 Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6b9e2f71-381c-4989-9db3-ee7cccb35a2a'} Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:42.533870 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:42.538648 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:42.538648 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:42.538648 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:42.538648 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:42.538648 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:42.538648 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:42.538648 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:42.542625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f0acf9b8-7304-4c9d-b725-d23576734ea2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 404 to user: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:42.544092 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f0acf9b8-7304-4c9d-b725-d23576734ea2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 404 len: 111 microversion: 2.1 time: 0.103485 Jul 14 14:55:42.545210 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2559/5148] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:42 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:42.564682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8cbb54a3-a240-4008-ac69-d4f268002b42 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '.version_select at 0x7fd6c459bee0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:42.614899 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8cbb54a3-a240-4008-ac69-d4f268002b42 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-652063530" status: 202 len: 0 microversion: 2.1 time: 0.062910 Jul 14 14:55:42.616188 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2560/5149] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jul 14 14:55:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-652063530 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:55:42.734800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c638d32-ff69-4e2d-ae5f-672c66a09b0b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:42.735690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3c638d32-ff69-4e2d-ae5f-672c66a09b0b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:42.780002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c638d32-ff69-4e2d-ae5f-672c66a09b0b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:42.781719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c638d32-ff69-4e2d-ae5f-672c66a09b0b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:42.793729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c638d32-ff69-4e2d-ae5f-672c66a09b0b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:42.802200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c638d32-ff69-4e2d-ae5f-672c66a09b0b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:43.377737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3c638d32-ff69-4e2d-ae5f-672c66a09b0b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:43.399589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3c638d32-ff69-4e2d-ae5f-672c66a09b0b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:43.413289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3c638d32-ff69-4e2d-ae5f-672c66a09b0b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:43.415562 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3c638d32-ff69-4e2d-ae5f-672c66a09b0b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.685219 Jul 14 14:55:43.416410 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2561/5150] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:42 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:43.442871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-464492f7-1ce1-4a7f-97b1-7cf25144db59 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:43.444684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-464492f7-1ce1-4a7f-97b1-7cf25144db59 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:43.467842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-464492f7-1ce1-4a7f-97b1-7cf25144db59 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:43.473242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-464492f7-1ce1-4a7f-97b1-7cf25144db59 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:43.482770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-464492f7-1ce1-4a7f-97b1-7cf25144db59 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:43.483508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-464492f7-1ce1-4a7f-97b1-7cf25144db59 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:44.796845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-464492f7-1ce1-4a7f-97b1-7cf25144db59 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:44.811341 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-464492f7-1ce1-4a7f-97b1-7cf25144db59 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 1.389482 Jul 14 14:55:44.843173 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2562/5151] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:43 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:44.872501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-904b9db3-47b6-485c-ba2e-8b81cbd4dfc2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:44.877502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-904b9db3-47b6-485c-ba2e-8b81cbd4dfc2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:44.911374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-904b9db3-47b6-485c-ba2e-8b81cbd4dfc2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:44.912183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-904b9db3-47b6-485c-ba2e-8b81cbd4dfc2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:44.915083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-904b9db3-47b6-485c-ba2e-8b81cbd4dfc2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:44.915796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-904b9db3-47b6-485c-ba2e-8b81cbd4dfc2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:45.477502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-904b9db3-47b6-485c-ba2e-8b81cbd4dfc2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:45.490116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-904b9db3-47b6-485c-ba2e-8b81cbd4dfc2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:45.492127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-904b9db3-47b6-485c-ba2e-8b81cbd4dfc2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:45.493746 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-904b9db3-47b6-485c-ba2e-8b81cbd4dfc2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.649244 Jul 14 14:55:45.499666 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2563/5152] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:44 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:45.836127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d9768b53-2a3f-476c-8968-35f042f53054 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:45.836781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d9768b53-2a3f-476c-8968-35f042f53054 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:45.849982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9768b53-2a3f-476c-8968-35f042f53054 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:45.859864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9768b53-2a3f-476c-8968-35f042f53054 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:45.860781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9768b53-2a3f-476c-8968-35f042f53054 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:45.861275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9768b53-2a3f-476c-8968-35f042f53054 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:46.392853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d9768b53-2a3f-476c-8968-35f042f53054 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:46.409027 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d9768b53-2a3f-476c-8968-35f042f53054 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.575909 Jul 14 14:55:46.410172 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2564/5153] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:45 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:46.518457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-173a0caf-c762-4078-89f8-c14a29320d02 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:46.519269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-173a0caf-c762-4078-89f8-c14a29320d02 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:46.534137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-173a0caf-c762-4078-89f8-c14a29320d02 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:46.538756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-173a0caf-c762-4078-89f8-c14a29320d02 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:46.540048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-173a0caf-c762-4078-89f8-c14a29320d02 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:46.540756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-173a0caf-c762-4078-89f8-c14a29320d02 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:47.998379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-173a0caf-c762-4078-89f8-c14a29320d02 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:48.002411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:48.030046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-173a0caf-c762-4078-89f8-c14a29320d02 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:48.032930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-173a0caf-c762-4078-89f8-c14a29320d02 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:48.034401 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-173a0caf-c762-4078-89f8-c14a29320d02 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 1.520905 Jul 14 14:55:48.040579 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2565/5154] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:46 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:48.054479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-10665e56-f4d7-4ac1-9488-7f8530328471 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:48.069929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-10665e56-f4d7-4ac1-9488-7f8530328471 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:48.089181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10665e56-f4d7-4ac1-9488-7f8530328471 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:48.090182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10665e56-f4d7-4ac1-9488-7f8530328471 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:48.116479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10665e56-f4d7-4ac1-9488-7f8530328471 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:48.117378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-10665e56-f4d7-4ac1-9488-7f8530328471 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:48.539000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-10665e56-f4d7-4ac1-9488-7f8530328471 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:48.550716 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-10665e56-f4d7-4ac1-9488-7f8530328471 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.508106 Jul 14 14:55:48.554098 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2566/5155] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:48 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:49.060533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-91343553-4ee4-44c1-a9c2-df762691fdaf tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:49.061262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-91343553-4ee4-44c1-a9c2-df762691fdaf tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:49.079121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91343553-4ee4-44c1-a9c2-df762691fdaf tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:49.079535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91343553-4ee4-44c1-a9c2-df762691fdaf tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:49.104462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91343553-4ee4-44c1-a9c2-df762691fdaf tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:49.105299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91343553-4ee4-44c1-a9c2-df762691fdaf tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:49.618286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-91343553-4ee4-44c1-a9c2-df762691fdaf tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:49.636073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-91343553-4ee4-44c1-a9c2-df762691fdaf tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:49.644280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-91343553-4ee4-44c1-a9c2-df762691fdaf tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:49.648242 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-91343553-4ee4-44c1-a9c2-df762691fdaf tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.592587 Jul 14 14:55:49.655672 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2567/5156] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:49 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:55:49.680321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aa4c2788-b9c4-4f69-86ff-3ef5e6662e48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:49.685380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aa4c2788-b9c4-4f69-86ff-3ef5e6662e48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:49.719018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa4c2788-b9c4-4f69-86ff-3ef5e6662e48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:49.721545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa4c2788-b9c4-4f69-86ff-3ef5e6662e48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:49.726497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa4c2788-b9c4-4f69-86ff-3ef5e6662e48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:49.727190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aa4c2788-b9c4-4f69-86ff-3ef5e6662e48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:50.097661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aa4c2788-b9c4-4f69-86ff-3ef5e6662e48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:50.115921 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aa4c2788-b9c4-4f69-86ff-3ef5e6662e48 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.458902 Jul 14 14:55:50.123353 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2568/5157] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:49 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:50.329761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=75 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:50.671907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-84b1b8cf-6753-4554-bb32-1273bd48f3fb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:50.672522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-84b1b8cf-6753-4554-bb32-1273bd48f3fb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:50.701245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84b1b8cf-6753-4554-bb32-1273bd48f3fb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:50.709637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84b1b8cf-6753-4554-bb32-1273bd48f3fb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:50.713275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84b1b8cf-6753-4554-bb32-1273bd48f3fb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:50.713966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84b1b8cf-6753-4554-bb32-1273bd48f3fb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:50.942725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:51.142862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-84b1b8cf-6753-4554-bb32-1273bd48f3fb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:51.151572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-84b1b8cf-6753-4554-bb32-1273bd48f3fb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:51.185983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-84b1b8cf-6753-4554-bb32-1273bd48f3fb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:51.187465 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-84b1b8cf-6753-4554-bb32-1273bd48f3fb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.520992 Jul 14 14:55:51.188385 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2569/5158] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:50 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:51.193214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ee21ba49-98c5-4420-b3f8-29d57942f5a7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:51.205937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ee21ba49-98c5-4420-b3f8-29d57942f5a7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:51.228501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee21ba49-98c5-4420-b3f8-29d57942f5a7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:51.228985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee21ba49-98c5-4420-b3f8-29d57942f5a7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:51.229853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee21ba49-98c5-4420-b3f8-29d57942f5a7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:51.230915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee21ba49-98c5-4420-b3f8-29d57942f5a7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:51.699605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ee21ba49-98c5-4420-b3f8-29d57942f5a7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:51.717818 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ee21ba49-98c5-4420-b3f8-29d57942f5a7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.528109 Jul 14 14:55:51.718430 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2570/5159] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:51 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:52.208739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5c60b00d-180f-46ac-90a5-b034d061ca23 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:52.210087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5c60b00d-180f-46ac-90a5-b034d061ca23 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:52.221326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c60b00d-180f-46ac-90a5-b034d061ca23 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:52.231210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c60b00d-180f-46ac-90a5-b034d061ca23 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:52.234315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c60b00d-180f-46ac-90a5-b034d061ca23 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:52.235744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c60b00d-180f-46ac-90a5-b034d061ca23 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:52.628859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5c60b00d-180f-46ac-90a5-b034d061ca23 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:52.639580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5c60b00d-180f-46ac-90a5-b034d061ca23 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:52.643740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5c60b00d-180f-46ac-90a5-b034d061ca23 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:52.645053 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5c60b00d-180f-46ac-90a5-b034d061ca23 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.442535 Jul 14 14:55:52.661422 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2571/5160] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:52 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:55:52.736427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3b6d5980-fdb1-41f4-a0af-edd478be6000 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:52.737165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3b6d5980-fdb1-41f4-a0af-edd478be6000 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:52.754918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b6d5980-fdb1-41f4-a0af-edd478be6000 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:52.757598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b6d5980-fdb1-41f4-a0af-edd478be6000 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:52.759537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b6d5980-fdb1-41f4-a0af-edd478be6000 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:52.760103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b6d5980-fdb1-41f4-a0af-edd478be6000 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:53.183965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3b6d5980-fdb1-41f4-a0af-edd478be6000 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:53.200167 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3b6d5980-fdb1-41f4-a0af-edd478be6000 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.467905 Jul 14 14:55:53.215381 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2572/5161] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:52 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:53.665339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ee49a315-1129-4d74-97f0-99ba0801ca68 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:53.666272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ee49a315-1129-4d74-97f0-99ba0801ca68 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:53.683077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee49a315-1129-4d74-97f0-99ba0801ca68 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:53.683834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee49a315-1129-4d74-97f0-99ba0801ca68 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:53.693098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee49a315-1129-4d74-97f0-99ba0801ca68 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:53.698045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee49a315-1129-4d74-97f0-99ba0801ca68 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:53.987718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ee49a315-1129-4d74-97f0-99ba0801ca68 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:53.998668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ee49a315-1129-4d74-97f0-99ba0801ca68 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:54.022112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ee49a315-1129-4d74-97f0-99ba0801ca68 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:54.023851 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ee49a315-1129-4d74-97f0-99ba0801ca68 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.364172 Jul 14 14:55:54.026874 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2573/5162] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:53 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:55:54.051156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b71d940-67b2-4888-a5a8-3fe622670bc8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:54.052063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8b71d940-67b2-4888-a5a8-3fe622670bc8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:54.077926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b71d940-67b2-4888-a5a8-3fe622670bc8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:54.087091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b71d940-67b2-4888-a5a8-3fe622670bc8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:54.088096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b71d940-67b2-4888-a5a8-3fe622670bc8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:54.088557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b71d940-67b2-4888-a5a8-3fe622670bc8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:54.147338 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-8b71d940-67b2-4888-a5a8-3fe622670bc8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b71d940-67b2-4888-a5a8-3fe622670bc8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a HTTP/1.1 Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6b9e2f71-381c-4989-9db3-ee7cccb35a2a'} Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:54.150068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b71d940-67b2-4888-a5a8-3fe622670bc8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 404 to user: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8b71d940-67b2-4888-a5a8-3fe622670bc8 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 404 len: 111 microversion: 2.1 time: 0.117644 Jul 14 14:55:54.153659 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2574/5163] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:54 2022] DELETE /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:54.168169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a2540c0a-7c08-4499-9466-0e0240e4ac56 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:54.168825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a2540c0a-7c08-4499-9466-0e0240e4ac56 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b9e2f71-381c-4989-9db3-ee7cccb35a2a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:54.175359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2540c0a-7c08-4499-9466-0e0240e4ac56 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:54.175819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2540c0a-7c08-4499-9466-0e0240e4ac56 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:54.176674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2540c0a-7c08-4499-9466-0e0240e4ac56 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:54.177307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2540c0a-7c08-4499-9466-0e0240e4ac56 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:54.194438 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-a2540c0a-7c08-4499-9466-0e0240e4ac56 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a2540c0a-7c08-4499-9466-0e0240e4ac56 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a HTTP/1.1 Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6b9e2f71-381c-4989-9db3-ee7cccb35a2a'} Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:54.206965 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:54.210616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:54.210616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:54.210616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:54.210616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:54.210616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:54.210616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. Jul 14 14:55:54.210616 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:55:54.210616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a2540c0a-7c08-4499-9466-0e0240e4ac56 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 404 to user: Instance 6b9e2f71-381c-4989-9db3-ee7cccb35a2a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:54.217223 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a2540c0a-7c08-4499-9466-0e0240e4ac56 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a" status: 404 len: 111 microversion: 2.1 time: 0.050359 Jul 14 14:55:54.218219 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2575/5164] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:54 2022] GET /compute/v2.1/servers/6b9e2f71-381c-4989-9db3-ee7cccb35a2a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:54.223070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-504e4c52-e3f3-42d2-b3df-40f1106bd55b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:54.223701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-504e4c52-e3f3-42d2-b3df-40f1106bd55b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:54.242228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-504e4c52-e3f3-42d2-b3df-40f1106bd55b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:54.242690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-504e4c52-e3f3-42d2-b3df-40f1106bd55b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:54.243559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-504e4c52-e3f3-42d2-b3df-40f1106bd55b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:54.244012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-504e4c52-e3f3-42d2-b3df-40f1106bd55b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:54.672602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-504e4c52-e3f3-42d2-b3df-40f1106bd55b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:54.686049 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-504e4c52-e3f3-42d2-b3df-40f1106bd55b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.465802 Jul 14 14:55:54.686846 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2576/5165] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:54 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:55.045951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-00c78c0b-6ead-4a0f-b5b7-73a23b3e37d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:55.046580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-00c78c0b-6ead-4a0f-b5b7-73a23b3e37d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:55.060737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00c78c0b-6ead-4a0f-b5b7-73a23b3e37d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:55.070466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00c78c0b-6ead-4a0f-b5b7-73a23b3e37d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:55.071343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00c78c0b-6ead-4a0f-b5b7-73a23b3e37d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:55.071800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00c78c0b-6ead-4a0f-b5b7-73a23b3e37d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:55.431564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-00c78c0b-6ead-4a0f-b5b7-73a23b3e37d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:55.444529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-00c78c0b-6ead-4a0f-b5b7-73a23b3e37d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:55.447122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-00c78c0b-6ead-4a0f-b5b7-73a23b3e37d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:55.465628 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-00c78c0b-6ead-4a0f-b5b7-73a23b3e37d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.424880 Jul 14 14:55:55.485153 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2577/5166] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:55 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:55:55.705201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a361cac5-13c3-4b6b-80ae-d74eb204e5f3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:55.706067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a361cac5-13c3-4b6b-80ae-d74eb204e5f3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:55.716919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a361cac5-13c3-4b6b-80ae-d74eb204e5f3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:55.719431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a361cac5-13c3-4b6b-80ae-d74eb204e5f3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:55.723992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a361cac5-13c3-4b6b-80ae-d74eb204e5f3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:55.724532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a361cac5-13c3-4b6b-80ae-d74eb204e5f3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:56.051530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a361cac5-13c3-4b6b-80ae-d74eb204e5f3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:56.065372 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a361cac5-13c3-4b6b-80ae-d74eb204e5f3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.362565 Jul 14 14:55:56.081967 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2578/5167] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:55 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:56.492056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-85727616-a432-4a51-8221-c1739947fb0f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:56.494923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-85727616-a432-4a51-8221-c1739947fb0f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:56.506599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85727616-a432-4a51-8221-c1739947fb0f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:56.507726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85727616-a432-4a51-8221-c1739947fb0f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:56.509585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85727616-a432-4a51-8221-c1739947fb0f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:56.510209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85727616-a432-4a51-8221-c1739947fb0f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:56.911482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-85727616-a432-4a51-8221-c1739947fb0f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:56.924079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-85727616-a432-4a51-8221-c1739947fb0f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:56.927067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-85727616-a432-4a51-8221-c1739947fb0f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:56.928779 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-85727616-a432-4a51-8221-c1739947fb0f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1738 microversion: 2.20 time: 0.440823 Jul 14 14:55:56.930073 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2579/5168] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:56 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1738 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:55:57.007640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:55:57.008136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:55:57.008538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:55:57.008988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:55:57.009398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:55:57.036877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:57.041771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:57.043913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:57.044709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:57.083331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-009443bc-67ea-4eee-8c02-dd7f2bb84257 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:57.084284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-009443bc-67ea-4eee-8c02-dd7f2bb84257 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:57.101375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Getting quotas for project a54fec9f71f842c988f58ac67af674ed. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:55:57.101773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-009443bc-67ea-4eee-8c02-dd7f2bb84257 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:57.103856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-009443bc-67ea-4eee-8c02-dd7f2bb84257 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:57.106863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-009443bc-67ea-4eee-8c02-dd7f2bb84257 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:57.107252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-009443bc-67ea-4eee-8c02-dd7f2bb84257 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:57.122734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Getting quotas for user a9259b10b0ae4959aa7b603d6167af17 and project a54fec9f71f842c988f58ac67af674ed. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:55:57.179298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:55:57.188386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:55:57.360865 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9847b67e-441a-4996-96f1-a9826abd82fa tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 16.840602 Jul 14 14:55:57.361504 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2590/5169] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:55:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 16843 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:55:57.378464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e57d48de-2355-4d49-879e-8c6011a57965 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:57.379306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e57d48de-2355-4d49-879e-8c6011a57965 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:57.525035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-009443bc-67ea-4eee-8c02-dd7f2bb84257 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:57.525555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e57d48de-2355-4d49-879e-8c6011a57965 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:57.534361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e57d48de-2355-4d49-879e-8c6011a57965 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:57.536693 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-009443bc-67ea-4eee-8c02-dd7f2bb84257 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.457242 Jul 14 14:55:57.536861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e57d48de-2355-4d49-879e-8c6011a57965 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:57.548284 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2580/5170] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:57 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:57.551598 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e57d48de-2355-4d49-879e-8c6011a57965 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1278 microversion: 2.57 time: 0.183481 Jul 14 14:55:57.552599 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2591/5171] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:57 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:57.951194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-de7d6a5d-0021-4ec0-a4dc-700e2c7b376f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:57.952076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-de7d6a5d-0021-4ec0-a4dc-700e2c7b376f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:57.967793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de7d6a5d-0021-4ec0-a4dc-700e2c7b376f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:57.968271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de7d6a5d-0021-4ec0-a4dc-700e2c7b376f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:57.974397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de7d6a5d-0021-4ec0-a4dc-700e2c7b376f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:57.974722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de7d6a5d-0021-4ec0-a4dc-700e2c7b376f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:58.477528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-de7d6a5d-0021-4ec0-a4dc-700e2c7b376f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:58.499990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-de7d6a5d-0021-4ec0-a4dc-700e2c7b376f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:58.503508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-de7d6a5d-0021-4ec0-a4dc-700e2c7b376f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:58.506434 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-de7d6a5d-0021-4ec0-a4dc-700e2c7b376f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1720 microversion: 2.20 time: 0.558136 Jul 14 14:55:58.512567 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2581/5172] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:57 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1720 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:58.561186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ba7204cf-dec6-45bc-9ce9-fffe202c1a8e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:58.567576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ba7204cf-dec6-45bc-9ce9-fffe202c1a8e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:58.573428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80f58190-3b3b-4d42-9efc-992dc7979b8e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:58.573428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80f58190-3b3b-4d42-9efc-992dc7979b8e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:58.581099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba7204cf-dec6-45bc-9ce9-fffe202c1a8e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:58.582095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba7204cf-dec6-45bc-9ce9-fffe202c1a8e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:58.584322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba7204cf-dec6-45bc-9ce9-fffe202c1a8e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:58.585446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba7204cf-dec6-45bc-9ce9-fffe202c1a8e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:58.606596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80f58190-3b3b-4d42-9efc-992dc7979b8e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:58.609143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80f58190-3b3b-4d42-9efc-992dc7979b8e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:58.612270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80f58190-3b3b-4d42-9efc-992dc7979b8e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:58.617364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80f58190-3b3b-4d42-9efc-992dc7979b8e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:58.831313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-80f58190-3b3b-4d42-9efc-992dc7979b8e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:58.846585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-80f58190-3b3b-4d42-9efc-992dc7979b8e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:58.867256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-80f58190-3b3b-4d42-9efc-992dc7979b8e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:58.877644 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80f58190-3b3b-4d42-9efc-992dc7979b8e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1282 microversion: 2.57 time: 0.309374 Jul 14 14:55:58.882265 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2582/5173] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:58 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1282 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:55:59.146948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba7204cf-dec6-45bc-9ce9-fffe202c1a8e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:59.160211 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ba7204cf-dec6-45bc-9ce9-fffe202c1a8e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.609014 Jul 14 14:55:59.160783 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2592/5174] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:58 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:59.532914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a32cb372-ebc0-45a8-90d2-1b2f4690a5e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:59.533605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a32cb372-ebc0-45a8-90d2-1b2f4690a5e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:59.565142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a32cb372-ebc0-45a8-90d2-1b2f4690a5e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:59.567865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a32cb372-ebc0-45a8-90d2-1b2f4690a5e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:59.568709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a32cb372-ebc0-45a8-90d2-1b2f4690a5e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:59.574920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a32cb372-ebc0-45a8-90d2-1b2f4690a5e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:59.921170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18acbb91-254d-47a1-94e5-89828dc2f862 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:59.925942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-18acbb91-254d-47a1-94e5-89828dc2f862 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:59.942418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18acbb91-254d-47a1-94e5-89828dc2f862 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:59.945327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18acbb91-254d-47a1-94e5-89828dc2f862 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:59.946773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18acbb91-254d-47a1-94e5-89828dc2f862 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:59.947373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18acbb91-254d-47a1-94e5-89828dc2f862 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:59.947622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a32cb372-ebc0-45a8-90d2-1b2f4690a5e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:59.950935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:59.971273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a32cb372-ebc0-45a8-90d2-1b2f4690a5e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:59.992822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a32cb372-ebc0-45a8-90d2-1b2f4690a5e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:59.998653 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a32cb372-ebc0-45a8-90d2-1b2f4690a5e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1720 microversion: 2.20 time: 0.467154 Jul 14 14:56:00.000251 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2583/5175] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:59 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1720 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:00.054348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18acbb91-254d-47a1-94e5-89828dc2f862 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:00.075597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18acbb91-254d-47a1-94e5-89828dc2f862 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:00.077953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18acbb91-254d-47a1-94e5-89828dc2f862 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:00.082819 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-18acbb91-254d-47a1-94e5-89828dc2f862 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1336 microversion: 2.57 time: 0.186008 Jul 14 14:56:00.084396 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2593/5176] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:59 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1336 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:00.178681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ad11f768-e5f3-4c62-bf52-73e90a0b389d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:00.179575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ad11f768-e5f3-4c62-bf52-73e90a0b389d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:00.189747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad11f768-e5f3-4c62-bf52-73e90a0b389d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:00.192085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad11f768-e5f3-4c62-bf52-73e90a0b389d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:00.195438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad11f768-e5f3-4c62-bf52-73e90a0b389d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:00.198708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad11f768-e5f3-4c62-bf52-73e90a0b389d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:00.474387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ad11f768-e5f3-4c62-bf52-73e90a0b389d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:00.511830 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ad11f768-e5f3-4c62-bf52-73e90a0b389d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.334354 Jul 14 14:56:00.514590 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2584/5177] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:00 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:00.713608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c9a85f94-058c-40c7-a683-58d282470d03 req-a408b4ff-a25e-4f03-a652-1002814ebb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5292ea7-49d5-4a1e-8fee-76a77bf64afa", "name": "network-vif-unplugged", "status": "completed", "tag": "93b2a2b3-1bf6-47ff-9851-01934b486943"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:00.734579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c9a85f94-058c-40c7-a683-58d282470d03 req-a408b4ff-a25e-4f03-a652-1002814ebb7d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:00.740459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c9a85f94-058c-40c7-a683-58d282470d03 req-a408b4ff-a25e-4f03-a652-1002814ebb7d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:00.799708 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c9a85f94-058c-40c7-a683-58d282470d03 req-a408b4ff-a25e-4f03-a652-1002814ebb7d service nova] Creating event network-vif-unplugged:93b2a2b3-1bf6-47ff-9851-01934b486943 for instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa on n-h1-767704-28 Jul 14 14:56:00.816913 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c9a85f94-058c-40c7-a683-58d282470d03 req-a408b4ff-a25e-4f03-a652-1002814ebb7d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107047 Jul 14 14:56:00.822106 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2594/5178] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:01.019546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4b46eec7-d0e4-4122-bfc6-bbe73585887c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:01.021004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4b46eec7-d0e4-4122-bfc6-bbe73585887c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:01.036596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b46eec7-d0e4-4122-bfc6-bbe73585887c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.037345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b46eec7-d0e4-4122-bfc6-bbe73585887c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.045766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b46eec7-d0e4-4122-bfc6-bbe73585887c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.046563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4b46eec7-d0e4-4122-bfc6-bbe73585887c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.105259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ddfece3a-eccf-4bdc-9b73-55fab2febaae tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:01.106881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ddfece3a-eccf-4bdc-9b73-55fab2febaae tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:01.131929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddfece3a-eccf-4bdc-9b73-55fab2febaae tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.132353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddfece3a-eccf-4bdc-9b73-55fab2febaae tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.135578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddfece3a-eccf-4bdc-9b73-55fab2febaae tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.136484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddfece3a-eccf-4bdc-9b73-55fab2febaae tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.319803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ddfece3a-eccf-4bdc-9b73-55fab2febaae tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:01.330335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ddfece3a-eccf-4bdc-9b73-55fab2febaae tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:01.343042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ddfece3a-eccf-4bdc-9b73-55fab2febaae tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:01.345065 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ddfece3a-eccf-4bdc-9b73-55fab2febaae tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1336 microversion: 2.57 time: 0.244741 Jul 14 14:56:01.358212 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2595/5179] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:01 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1336 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:01.371359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b455ed7-a3ae-4a42-a950-7648c2408118 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:01.372146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0b455ed7-a3ae-4a42-a950-7648c2408118 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:01.381884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b455ed7-a3ae-4a42-a950-7648c2408118 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.389389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b455ed7-a3ae-4a42-a950-7648c2408118 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.390497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b455ed7-a3ae-4a42-a950-7648c2408118 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.391128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0b455ed7-a3ae-4a42-a950-7648c2408118 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.417186 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-0b455ed7-a3ae-4a42-a950-7648c2408118 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b455ed7-a3ae-4a42-a950-7648c2408118 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 HTTP/1.1 Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99'} Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:01.420038 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:01.423770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:56:01.423770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.423770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:01.423770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.423770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:01.423770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:01.423770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:01.423770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:01.423770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:01.423770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:56:01.423770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.426051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0b455ed7-a3ae-4a42-a950-7648c2408118 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 404 to user: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:01.427252 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0b455ed7-a3ae-4a42-a950-7648c2408118 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 404 len: 111 microversion: 2.1 time: 0.067714 Jul 14 14:56:01.428436 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2596/5180] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:56:01 2022] DELETE /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:01.448067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c1d6a3f2-1a59-4db2-b09b-49797d3e4083 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:01.457815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c1d6a3f2-1a59-4db2-b09b-49797d3e4083 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:01.475492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c1d6a3f2-1a59-4db2-b09b-49797d3e4083 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.477850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c1d6a3f2-1a59-4db2-b09b-49797d3e4083 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.479491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c1d6a3f2-1a59-4db2-b09b-49797d3e4083 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.479952 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c1d6a3f2-1a59-4db2-b09b-49797d3e4083 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.503419 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-c1d6a3f2-1a59-4db2-b09b-49797d3e4083 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c1d6a3f2-1a59-4db2-b09b-49797d3e4083 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 HTTP/1.1 Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99'} Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:01.505212 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.508857 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:01.508857 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:01.508857 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:01.508857 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:01.508857 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:01.508857 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. Jul 14 14:56:01.508857 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.508857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c1d6a3f2-1a59-4db2-b09b-49797d3e4083 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 404 to user: Instance e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:01.508857 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c1d6a3f2-1a59-4db2-b09b-49797d3e4083 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99" status: 404 len: 111 microversion: 2.1 time: 0.074275 Jul 14 14:56:01.510588 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2597/5181] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:01 2022] GET /compute/v2.1/servers/e5ebae48-d9ca-4bd7-a38e-4c26a46b6a99 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:01.547392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a90696fe-9773-44c5-b7c0-5dc1bed26a8d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:01.548242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a90696fe-9773-44c5-b7c0-5dc1bed26a8d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:01.587169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a90696fe-9773-44c5-b7c0-5dc1bed26a8d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.588041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a90696fe-9773-44c5-b7c0-5dc1bed26a8d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.592767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a90696fe-9773-44c5-b7c0-5dc1bed26a8d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.593705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a90696fe-9773-44c5-b7c0-5dc1bed26a8d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.595053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4b46eec7-d0e4-4122-bfc6-bbe73585887c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:01.609747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4b46eec7-d0e4-4122-bfc6-bbe73585887c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:01.611543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4b46eec7-d0e4-4122-bfc6-bbe73585887c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:01.620367 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4b46eec7-d0e4-4122-bfc6-bbe73585887c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1720 microversion: 2.20 time: 0.604676 Jul 14 14:56:01.625283 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2585/5182] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:01 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1720 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:01.635752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-641ad099-cb24-4ff2-bbc6-ec229e5fa8bd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:01.639592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-641ad099-cb24-4ff2-bbc6-ec229e5fa8bd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:01.663395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-641ad099-cb24-4ff2-bbc6-ec229e5fa8bd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.663880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-641ad099-cb24-4ff2-bbc6-ec229e5fa8bd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.664697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-641ad099-cb24-4ff2-bbc6-ec229e5fa8bd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.665179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-641ad099-cb24-4ff2-bbc6-ec229e5fa8bd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.669475 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-a90696fe-9773-44c5-b7c0-5dc1bed26a8d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a90696fe-9773-44c5-b7c0-5dc1bed26a8d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 HTTP/1.1 Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6b770b7b-68e4-45a2-b7c0-8a6361470c46'} Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:01.673953 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:01.678290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:56:01.678290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.678290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:01.678290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.678290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:01.678290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:01.678290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:01.678290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:01.678290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:01.678290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:56:01.678290 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.680487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a90696fe-9773-44c5-b7c0-5dc1bed26a8d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 404 to user: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:01.682737 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a90696fe-9773-44c5-b7c0-5dc1bed26a8d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 404 len: 111 microversion: 2.1 time: 0.171043 Jul 14 14:56:01.684570 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2598/5183] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:56:01 2022] DELETE /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:01.703622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b8a7988-390e-4c36-bf3e-e6479d35e1f2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:01.706946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b8a7988-390e-4c36-bf3e-e6479d35e1f2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: 6b770b7b-68e4-45a2-b7c0-8a6361470c46] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:01.723481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b8a7988-390e-4c36-bf3e-e6479d35e1f2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.725574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b8a7988-390e-4c36-bf3e-e6479d35e1f2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.727875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b8a7988-390e-4c36-bf3e-e6479d35e1f2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.728530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b8a7988-390e-4c36-bf3e-e6479d35e1f2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.781646 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-9b8a7988-390e-4c36-bf3e-e6479d35e1f2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b8a7988-390e-4c36-bf3e-e6479d35e1f2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 HTTP/1.1 Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6b770b7b-68e4-45a2-b7c0-8a6361470c46'} Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:01.786285 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.790684 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:01.790684 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:01.790684 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:01.790684 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:01.790684 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:01.790684 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. Jul 14 14:56:01.790684 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:01.795317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b8a7988-390e-4c36-bf3e-e6479d35e1f2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 404 to user: Instance 6b770b7b-68e4-45a2-b7c0-8a6361470c46 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:01.799463 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9b8a7988-390e-4c36-bf3e-e6479d35e1f2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46" status: 404 len: 111 microversion: 2.1 time: 0.108248 Jul 14 14:56:01.803830 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2599/5184] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:01 2022] GET /compute/v2.1/servers/6b770b7b-68e4-45a2-b7c0-8a6361470c46 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:02.235441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-641ad099-cb24-4ff2-bbc6-ec229e5fa8bd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:02.247061 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-641ad099-cb24-4ff2-bbc6-ec229e5fa8bd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.620234 Jul 14 14:56:02.248175 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2586/5185] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:01 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:02.364589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-29e7ed04-e9ce-4ea1-b376-3069c67b37b8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:02.365316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-29e7ed04-e9ce-4ea1-b376-3069c67b37b8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:02.401761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-29e7ed04-e9ce-4ea1-b376-3069c67b37b8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:02.409248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-29e7ed04-e9ce-4ea1-b376-3069c67b37b8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:02.410139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-29e7ed04-e9ce-4ea1-b376-3069c67b37b8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:02.410599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-29e7ed04-e9ce-4ea1-b376-3069c67b37b8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:02.584332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-29e7ed04-e9ce-4ea1-b376-3069c67b37b8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:02.597450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-29e7ed04-e9ce-4ea1-b376-3069c67b37b8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:02.599221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-29e7ed04-e9ce-4ea1-b376-3069c67b37b8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:02.602318 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-29e7ed04-e9ce-4ea1-b376-3069c67b37b8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1357 microversion: 2.57 time: 0.242342 Jul 14 14:56:02.605875 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2600/5186] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:02 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:02.633123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:02.634794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:02.642470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e6f5b55f-361e-44a4-b94f-1ec1bd0e530e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:02.643453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e6f5b55f-361e-44a4-b94f-1ec1bd0e530e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:02.654991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6f5b55f-361e-44a4-b94f-1ec1bd0e530e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:02.656273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:02.656825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:02.657564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6f5b55f-361e-44a4-b94f-1ec1bd0e530e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:02.657839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:02.658545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:02.659625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6f5b55f-361e-44a4-b94f-1ec1bd0e530e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:02.662452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6f5b55f-361e-44a4-b94f-1ec1bd0e530e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:02.885759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:56:02.886201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:56:02.891793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:56:02.892233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:56:02.892668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:56:02.987916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e6f5b55f-361e-44a4-b94f-1ec1bd0e530e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:02.999068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e6f5b55f-361e-44a4-b94f-1ec1bd0e530e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:03.010955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e6f5b55f-361e-44a4-b94f-1ec1bd0e530e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:03.013098 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e6f5b55f-361e-44a4-b94f-1ec1bd0e530e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1663 microversion: 2.20 time: 0.374378 Jul 14 14:56:03.014528 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2601/5187] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:02 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1663 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:03.038912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a6568ccf-9aa8-4093-a428-46261094f217 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8ee0d53-ba45-4c47-9ea3-05a2f23621e4"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:03.040383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a6568ccf-9aa8-4093-a428-46261094f217 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:03.054788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6568ccf-9aa8-4093-a428-46261094f217 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:03.055624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6568ccf-9aa8-4093-a428-46261094f217 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:03.056676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6568ccf-9aa8-4093-a428-46261094f217 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:03.059738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6568ccf-9aa8-4093-a428-46261094f217 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:03.081751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:03.133353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:03.152397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:03.162699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:03.166819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:03.346246 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bd7a6c80-2bb3-432e-8494-6bf3a40d631e tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "POST /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0/action" status: 202 len: 1138 microversion: 2.57 time: 0.723105 Jul 14 14:56:03.362210 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2587/5188] 10.222.0.81 () {62 vars in 1319 bytes} [Thu Jul 14 14:56:02 2022] POST /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0/action => generated 1138 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 14 14:56:03.383414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c4e26b3c-f7b2-4204-b031-aa59ae711407 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:03.385587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c4e26b3c-f7b2-4204-b031-aa59ae711407 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:03.394369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4e26b3c-f7b2-4204-b031-aa59ae711407 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:03.395350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4e26b3c-f7b2-4204-b031-aa59ae711407 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:03.396434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4e26b3c-f7b2-4204-b031-aa59ae711407 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:03.399002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4e26b3c-f7b2-4204-b031-aa59ae711407 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:03.890022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c4e26b3c-f7b2-4204-b031-aa59ae711407 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:03.918835 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c4e26b3c-f7b2-4204-b031-aa59ae711407 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.553928 Jul 14 14:56:03.934788 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2588/5189] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:03 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:03.940190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-83d0fc0f-3d2b-4019-8d00-e9dcdba04d3c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:03.944287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-83d0fc0f-3d2b-4019-8d00-e9dcdba04d3c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:03.955733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83d0fc0f-3d2b-4019-8d00-e9dcdba04d3c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:03.956603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83d0fc0f-3d2b-4019-8d00-e9dcdba04d3c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:03.974934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83d0fc0f-3d2b-4019-8d00-e9dcdba04d3c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:03.975872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83d0fc0f-3d2b-4019-8d00-e9dcdba04d3c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:04.132064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-83d0fc0f-3d2b-4019-8d00-e9dcdba04d3c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:04.146671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-83d0fc0f-3d2b-4019-8d00-e9dcdba04d3c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:04.151823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-83d0fc0f-3d2b-4019-8d00-e9dcdba04d3c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:04.155036 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-83d0fc0f-3d2b-4019-8d00-e9dcdba04d3c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.218767 Jul 14 14:56:04.164312 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2589/5190] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:03 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:04.312310 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a6568ccf-9aa8-4093-a428-46261094f217 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "POST /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.276459 Jul 14 14:56:04.313185 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2602/5191] 10.222.0.81 () {62 vars in 1363 bytes} [Thu Jul 14 14:56:03 2022] POST /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments => generated 188 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:56:04.645882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4f6a4484-780a-47e3-abd3-6190503d43ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:04.646698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4f6a4484-780a-47e3-abd3-6190503d43ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:04.656797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f6a4484-780a-47e3-abd3-6190503d43ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:04.657354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f6a4484-780a-47e3-abd3-6190503d43ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:04.658256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f6a4484-780a-47e3-abd3-6190503d43ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:04.658712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f6a4484-780a-47e3-abd3-6190503d43ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:04.871561 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4f6a4484-780a-47e3-abd3-6190503d43ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "POST /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/action" status: 202 len: 0 microversion: 2.20 time: 0.229884 Jul 14 14:56:04.875276 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2590/5192] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 14:56:04 2022] POST /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:56:04.881042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9353f80-307e-4ede-9b85-119d28260b2b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:04.881883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b9353f80-307e-4ede-9b85-119d28260b2b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:04.906672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9353f80-307e-4ede-9b85-119d28260b2b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:04.908122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9353f80-307e-4ede-9b85-119d28260b2b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:04.909311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9353f80-307e-4ede-9b85-119d28260b2b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:04.910152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9353f80-307e-4ede-9b85-119d28260b2b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:04.941962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-59590621-e77c-4bc0-82b9-ff0678cffca7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:04.942996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-59590621-e77c-4bc0-82b9-ff0678cffca7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:04.951612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:04.954496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59590621-e77c-4bc0-82b9-ff0678cffca7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:04.956979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59590621-e77c-4bc0-82b9-ff0678cffca7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:04.972457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59590621-e77c-4bc0-82b9-ff0678cffca7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:04.973329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59590621-e77c-4bc0-82b9-ff0678cffca7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:05.488604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b9353f80-307e-4ede-9b85-119d28260b2b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:05.499371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b9353f80-307e-4ede-9b85-119d28260b2b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:05.522919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b9353f80-307e-4ede-9b85-119d28260b2b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:05.524291 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b9353f80-307e-4ede-9b85-119d28260b2b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1749 microversion: 2.20 time: 0.647777 Jul 14 14:56:05.525223 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2603/5193] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:04 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1749 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:05.531502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-537a4f9b-59c7-47c2-93c4-09c1c5c41ae3 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:05.538237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-537a4f9b-59c7-47c2-93c4-09c1c5c41ae3 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:05.550563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-537a4f9b-59c7-47c2-93c4-09c1c5c41ae3 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:05.551251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-537a4f9b-59c7-47c2-93c4-09c1c5c41ae3 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:05.552274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-537a4f9b-59c7-47c2-93c4-09c1c5c41ae3 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:05.552638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-537a4f9b-59c7-47c2-93c4-09c1c5c41ae3 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:05.630970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-59590621-e77c-4bc0-82b9-ff0678cffca7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:05.643036 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-59590621-e77c-4bc0-82b9-ff0678cffca7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1529 microversion: 2.1 time: 0.704851 Jul 14 14:56:05.653234 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2591/5194] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:04 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1529 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:05.688528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-537a4f9b-59c7-47c2-93c4-09c1c5c41ae3 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:05.697466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-537a4f9b-59c7-47c2-93c4-09c1c5c41ae3 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:05.704632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-537a4f9b-59c7-47c2-93c4-09c1c5c41ae3 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:05.709719 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-537a4f9b-59c7-47c2-93c4-09c1c5c41ae3 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.183283 Jul 14 14:56:05.710568 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2604/5195] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:05 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:06.546873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9e4b5791-07a9-4f02-8d90-5014f3db4d34 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:06.547493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9e4b5791-07a9-4f02-8d90-5014f3db4d34 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:06.563446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e4b5791-07a9-4f02-8d90-5014f3db4d34 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:06.565931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e4b5791-07a9-4f02-8d90-5014f3db4d34 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:06.567009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e4b5791-07a9-4f02-8d90-5014f3db4d34 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:06.576095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9e4b5791-07a9-4f02-8d90-5014f3db4d34 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:06.660631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5c159e93-1c8d-4144-8250-eb357917da12 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:06.661356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5c159e93-1c8d-4144-8250-eb357917da12 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:06.677226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c159e93-1c8d-4144-8250-eb357917da12 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:06.677697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c159e93-1c8d-4144-8250-eb357917da12 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:06.678518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c159e93-1c8d-4144-8250-eb357917da12 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:06.681802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c159e93-1c8d-4144-8250-eb357917da12 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:07.052714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5c159e93-1c8d-4144-8250-eb357917da12 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:07.069553 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5c159e93-1c8d-4144-8250-eb357917da12 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1511 microversion: 2.1 time: 0.413429 Jul 14 14:56:07.071312 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2605/5196] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:06 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1511 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:07.077060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cf968390-0bbc-4f18-8513-c67a64e4c7e9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:07.077917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cf968390-0bbc-4f18-8513-c67a64e4c7e9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:07.081073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:07.093316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf968390-0bbc-4f18-8513-c67a64e4c7e9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:07.099088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf968390-0bbc-4f18-8513-c67a64e4c7e9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:07.101283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf968390-0bbc-4f18-8513-c67a64e4c7e9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:07.102564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf968390-0bbc-4f18-8513-c67a64e4c7e9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:07.214086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e4b5791-07a9-4f02-8d90-5014f3db4d34 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:07.267041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e4b5791-07a9-4f02-8d90-5014f3db4d34 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:07.269210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9e4b5791-07a9-4f02-8d90-5014f3db4d34 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:07.271803 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9e4b5791-07a9-4f02-8d90-5014f3db4d34 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1749 microversion: 2.20 time: 0.731921 Jul 14 14:56:07.278829 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2592/5197] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:06 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1749 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:07.316831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cf968390-0bbc-4f18-8513-c67a64e4c7e9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:07.327680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cf968390-0bbc-4f18-8513-c67a64e4c7e9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:07.330504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cf968390-0bbc-4f18-8513-c67a64e4c7e9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:07.332274 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cf968390-0bbc-4f18-8513-c67a64e4c7e9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.259713 Jul 14 14:56:07.333544 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2606/5198] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:07 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:07.832205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1d5c4c6b-d142-4fe1-ba2a-7f50f4c1f67d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:07.833045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1d5c4c6b-d142-4fe1-ba2a-7f50f4c1f67d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:07.848561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d5c4c6b-d142-4fe1-ba2a-7f50f4c1f67d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:07.859659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d5c4c6b-d142-4fe1-ba2a-7f50f4c1f67d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:07.861960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d5c4c6b-d142-4fe1-ba2a-7f50f4c1f67d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:07.862643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d5c4c6b-d142-4fe1-ba2a-7f50f4c1f67d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:07.900471 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-1d5c4c6b-d142-4fe1-ba2a-7f50f4c1f67d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1d5c4c6b-d142-4fe1-ba2a-7f50f4c1f67d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 HTTP/1.1 Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'fba14e7e-dbff-47d0-9515-3acd4c797b52'} Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:07.906221 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:07.909754 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:56:07.909754 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.909754 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:07.909754 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.909754 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:07.909754 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:07.909754 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:07.909754 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:07.909754 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:07.909754 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:56:07.909754 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.912599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1d5c4c6b-d142-4fe1-ba2a-7f50f4c1f67d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 404 to user: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:07.916538 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1d5c4c6b-d142-4fe1-ba2a-7f50f4c1f67d tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 404 len: 111 microversion: 2.1 time: 0.091140 Jul 14 14:56:07.917492 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2593/5199] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:56:07 2022] DELETE /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:07.924006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:07.932904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4994c6b5-1bb8-453e-9688-6c488738d9d2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:07.933743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4994c6b5-1bb8-453e-9688-6c488738d9d2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] [instance: fba14e7e-dbff-47d0-9515-3acd4c797b52] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:07.954176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4994c6b5-1bb8-453e-9688-6c488738d9d2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:07.954806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4994c6b5-1bb8-453e-9688-6c488738d9d2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:07.955712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4994c6b5-1bb8-453e-9688-6c488738d9d2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:07.956254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4994c6b5-1bb8-453e-9688-6c488738d9d2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:07.987726 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-4994c6b5-1bb8-453e-9688-6c488738d9d2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] HTTP exception thrown: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4994c6b5-1bb8-453e-9688-6c488738d9d2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Request method failure captured: Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 HTTP/1.1 Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0CycqH54UymsoNy0286zxQShTyW-rlqBJYyfuyvpEksrYNLrgCqyR1zopBTDPJQ2wgaB6dyWxcOgC1AsQ59cTet7kK44aN_7osMkMhf0gntt6oR8-NGvdr5WRhw-kl30jHjr-DSDnDsuFgH67raCuFgxrpVbOOBm8ad78_CWP0XTsVA Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/53c2a638aab846d39d0a225ac6cc69d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_53c2a638aab846d39d0a225ac6cc69d2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/53c2a638aab846d39d0a225ac6cc69d2"}]}] Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 53c2a638aab846d39d0a225ac6cc69d2 Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1694004081 Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9260cbc32f1e423ab8ea4d06058b4050 Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachVolumeNegativeTest-1694004081-project Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'fba14e7e-dbff-47d0-9515-3acd4c797b52'} Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:07.991974 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.996062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:07.996062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:07.996062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:07.996062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:07.996062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:07.996062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. Jul 14 14:56:07.996062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.996062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4994c6b5-1bb8-453e-9688-6c488738d9d2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] Returning 404 to user: Instance fba14e7e-dbff-47d0-9515-3acd4c797b52 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:07.998056 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4994c6b5-1bb8-453e-9688-6c488738d9d2 tempest-AttachVolumeNegativeTest-1694004081 tempest-AttachVolumeNegativeTest-1694004081-project] 10.222.0.81 "GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52" status: 404 len: 111 microversion: 2.1 time: 0.074749 Jul 14 14:56:07.998662 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2607/5200] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:07 2022] GET /compute/v2.1/servers/fba14e7e-dbff-47d0-9515-3acd4c797b52 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:08.090607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4e35705-c06c-46c8-b1dd-9da7a78a9ca1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:08.093382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b4e35705-c06c-46c8-b1dd-9da7a78a9ca1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:08.117987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4e35705-c06c-46c8-b1dd-9da7a78a9ca1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:08.120286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4e35705-c06c-46c8-b1dd-9da7a78a9ca1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:08.123557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4e35705-c06c-46c8-b1dd-9da7a78a9ca1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:08.125843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4e35705-c06c-46c8-b1dd-9da7a78a9ca1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:08.299051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e33492a4-c829-4d10-80f1-9e734828d0ba tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:08.300090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e33492a4-c829-4d10-80f1-9e734828d0ba tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:08.322183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e33492a4-c829-4d10-80f1-9e734828d0ba tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:08.322643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e33492a4-c829-4d10-80f1-9e734828d0ba tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:08.323432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e33492a4-c829-4d10-80f1-9e734828d0ba tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:08.324878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e33492a4-c829-4d10-80f1-9e734828d0ba tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:08.756938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b4e35705-c06c-46c8-b1dd-9da7a78a9ca1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:08.778160 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b4e35705-c06c-46c8-b1dd-9da7a78a9ca1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1511 microversion: 2.1 time: 0.683487 Jul 14 14:56:08.781096 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2594/5201] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:08 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1511 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:08.786546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-56147643-ef9f-4bad-bd84-49d4ddb8fdf4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:08.792012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-56147643-ef9f-4bad-bd84-49d4ddb8fdf4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:08.813405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56147643-ef9f-4bad-bd84-49d4ddb8fdf4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:08.814237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56147643-ef9f-4bad-bd84-49d4ddb8fdf4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:08.815140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56147643-ef9f-4bad-bd84-49d4ddb8fdf4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:08.818338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56147643-ef9f-4bad-bd84-49d4ddb8fdf4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:09.528278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e33492a4-c829-4d10-80f1-9e734828d0ba tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:09.554941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e33492a4-c829-4d10-80f1-9e734828d0ba tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:09.562266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e33492a4-c829-4d10-80f1-9e734828d0ba tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:09.567424 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e33492a4-c829-4d10-80f1-9e734828d0ba tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1751 microversion: 2.20 time: 1.276727 Jul 14 14:56:09.585537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-56147643-ef9f-4bad-bd84-49d4ddb8fdf4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:09.594941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-56147643-ef9f-4bad-bd84-49d4ddb8fdf4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:09.596468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-56147643-ef9f-4bad-bd84-49d4ddb8fdf4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:09.602998 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2608/5202] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:08 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1751 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:09.610815 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-56147643-ef9f-4bad-bd84-49d4ddb8fdf4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.828177 Jul 14 14:56:09.622845 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2595/5203] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:08 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:09.801092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-adb80d69-14d2-4a01-8763-ee66b6a8f06b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:09.801092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-adb80d69-14d2-4a01-8763-ee66b6a8f06b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:09.813534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-adb80d69-14d2-4a01-8763-ee66b6a8f06b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:09.814117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-adb80d69-14d2-4a01-8763-ee66b6a8f06b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:09.815113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-adb80d69-14d2-4a01-8763-ee66b6a8f06b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:09.815665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-adb80d69-14d2-4a01-8763-ee66b6a8f06b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:09.867803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:10.208174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a2266a3b-bab6-4abb-a13d-2bf3047c2090 req-28bbdb12-1d59-4a8f-aa35-1188af275039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f554d9f-a901-4284-8c0e-d34d0924e67d", "name": "network-vif-unplugged", "status": "completed", "tag": "9af0d9f1-4145-44d0-a287-acb8ff126aa7"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:10.220463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a2266a3b-bab6-4abb-a13d-2bf3047c2090 req-28bbdb12-1d59-4a8f-aa35-1188af275039 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:10.221217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a2266a3b-bab6-4abb-a13d-2bf3047c2090 req-28bbdb12-1d59-4a8f-aa35-1188af275039 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:10.222721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-adb80d69-14d2-4a01-8763-ee66b6a8f06b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:10.237700 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-adb80d69-14d2-4a01-8763-ee66b6a8f06b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1514 microversion: 2.1 time: 0.442416 Jul 14 14:56:10.243171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.compute.server_external_events [req-a2266a3b-bab6-4abb-a13d-2bf3047c2090 req-28bbdb12-1d59-4a8f-aa35-1188af275039 service nova] Unable to find a host for instance 0f554d9f-a901-4284-8c0e-d34d0924e67d. Dropping event network-vif-unplugged {{(pid=119511) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 14:56:10.246726 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2609/5204] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:09 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1514 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:10.248029 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a2266a3b-bab6-4abb-a13d-2bf3047c2090 req-28bbdb12-1d59-4a8f-aa35-1188af275039 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053758 Jul 14 14:56:10.249451 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2596/5205] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 14 14:56:10.274120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a5c3c0e-0b3e-4fd7-99c4-9f9d62e0cbfa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:10.276242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3a5c3c0e-0b3e-4fd7-99c4-9f9d62e0cbfa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:10.290142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a5c3c0e-0b3e-4fd7-99c4-9f9d62e0cbfa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:10.292977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a5c3c0e-0b3e-4fd7-99c4-9f9d62e0cbfa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:10.293852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a5c3c0e-0b3e-4fd7-99c4-9f9d62e0cbfa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:10.294770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a5c3c0e-0b3e-4fd7-99c4-9f9d62e0cbfa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:10.583979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3a5c3c0e-0b3e-4fd7-99c4-9f9d62e0cbfa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:10.590584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-91dc69d5-7516-4bce-8fad-8443258049d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:10.594428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-91dc69d5-7516-4bce-8fad-8443258049d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:10.601410 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3a5c3c0e-0b3e-4fd7-99c4-9f9d62e0cbfa tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1454 microversion: 2.1 time: 0.332289 Jul 14 14:56:10.608304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91dc69d5-7516-4bce-8fad-8443258049d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:10.610471 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2610/5206] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:10 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1454 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:10.611251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91dc69d5-7516-4bce-8fad-8443258049d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:10.612457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91dc69d5-7516-4bce-8fad-8443258049d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:10.613827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91dc69d5-7516-4bce-8fad-8443258049d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:10.637557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-83416fea-718d-4c5c-9da2-fe11bac0c316 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:10.638177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-83416fea-718d-4c5c-9da2-fe11bac0c316 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:10.665906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83416fea-718d-4c5c-9da2-fe11bac0c316 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:10.666371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83416fea-718d-4c5c-9da2-fe11bac0c316 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:10.667225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83416fea-718d-4c5c-9da2-fe11bac0c316 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:10.667708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83416fea-718d-4c5c-9da2-fe11bac0c316 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:10.877381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-83416fea-718d-4c5c-9da2-fe11bac0c316 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:10.896398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-83416fea-718d-4c5c-9da2-fe11bac0c316 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:10.905717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-83416fea-718d-4c5c-9da2-fe11bac0c316 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:10.906970 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-83416fea-718d-4c5c-9da2-fe11bac0c316 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.280022 Jul 14 14:56:10.907547 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2611/5207] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:10 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:10.912628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-27825bbf-1879-4358-911d-3aa8be4805f1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:10.924006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-27825bbf-1879-4358-911d-3aa8be4805f1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:10.951067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-27825bbf-1879-4358-911d-3aa8be4805f1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:10.956510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-27825bbf-1879-4358-911d-3aa8be4805f1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:10.970546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-27825bbf-1879-4358-911d-3aa8be4805f1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:10.971396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-27825bbf-1879-4358-911d-3aa8be4805f1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:11.007343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-91dc69d5-7516-4bce-8fad-8443258049d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:11.020614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-91dc69d5-7516-4bce-8fad-8443258049d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:11.027886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-91dc69d5-7516-4bce-8fad-8443258049d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:11.029615 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-91dc69d5-7516-4bce-8fad-8443258049d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1751 microversion: 2.20 time: 0.443515 Jul 14 14:56:11.030405 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2597/5208] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:10 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1751 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:11.041288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-27825bbf-1879-4358-911d-3aa8be4805f1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lazy-loading 'flavor' on Instance uuid 0f554d9f-a901-4284-8c0e-d34d0924e67d {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:56:11.056997 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-27825bbf-1879-4358-911d-3aa8be4805f1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Cannot 'shelve' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state shelved_offloaded Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-27825bbf-1879-4358-911d-3aa8be4805f1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action HTTP/1.1 Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 14 Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: {"shelve": {}} Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: exception: Cannot 'shelve' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state shelved_offloaded Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '0f554d9f-a901-4284-8c0e-d34d0924e67d', 'body': {'shelve': {}}} Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 14 14:56:11.061060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state shelved_offloaded Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state shelved_offloaded Jul 14 14:56:11.066067 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:11.067315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-27825bbf-1879-4358-911d-3aa8be4805f1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 409 to user: Cannot 'shelve' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state shelved_offloaded {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:11.069272 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-27825bbf-1879-4358-911d-3aa8be4805f1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 409 len: 155 microversion: 2.1 time: 0.160605 Jul 14 14:56:11.069885 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2612/5209] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:56:10 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 155 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:56:11.083157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d6f59fc7-812b-4500-8748-95842173b694 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:11.083836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d6f59fc7-812b-4500-8748-95842173b694 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:11.091435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6f59fc7-812b-4500-8748-95842173b694 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:11.092003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6f59fc7-812b-4500-8748-95842173b694 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:11.092975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6f59fc7-812b-4500-8748-95842173b694 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:11.093494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d6f59fc7-812b-4500-8748-95842173b694 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:11.167970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:11.219804 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d6f59fc7-812b-4500-8748-95842173b694 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 202 len: 0 microversion: 2.1 time: 0.141415 Jul 14 14:56:11.221883 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2598/5210] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:56:11 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:56:11.229622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d0a00840-db77-450a-a517-00de122a7f3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:11.231694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d0a00840-db77-450a-a517-00de122a7f3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:11.245330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0a00840-db77-450a-a517-00de122a7f3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:11.249740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0a00840-db77-450a-a517-00de122a7f3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:11.250876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0a00840-db77-450a-a517-00de122a7f3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:11.252405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0a00840-db77-450a-a517-00de122a7f3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:11.447436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d0a00840-db77-450a-a517-00de122a7f3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:11.459588 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d0a00840-db77-450a-a517-00de122a7f3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1462 microversion: 2.1 time: 0.233955 Jul 14 14:56:11.460744 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2613/5211] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:11 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1462 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:11.928335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9c0e77ec-ae09-4777-9a6a-6be029e43790 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:11.929552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9c0e77ec-ae09-4777-9a6a-6be029e43790 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:11.951083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c0e77ec-ae09-4777-9a6a-6be029e43790 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:11.951914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c0e77ec-ae09-4777-9a6a-6be029e43790 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:11.953379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c0e77ec-ae09-4777-9a6a-6be029e43790 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:11.956664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c0e77ec-ae09-4777-9a6a-6be029e43790 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:12.050246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3cc62591-9d87-464d-a2e5-56d46709e90d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:12.051159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3cc62591-9d87-464d-a2e5-56d46709e90d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:12.060685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cc62591-9d87-464d-a2e5-56d46709e90d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:12.061434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cc62591-9d87-464d-a2e5-56d46709e90d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:12.062456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cc62591-9d87-464d-a2e5-56d46709e90d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:12.063096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cc62591-9d87-464d-a2e5-56d46709e90d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:12.144687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9c0e77ec-ae09-4777-9a6a-6be029e43790 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:12.159777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9c0e77ec-ae09-4777-9a6a-6be029e43790 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:12.166378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9c0e77ec-ae09-4777-9a6a-6be029e43790 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:12.170261 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9c0e77ec-ae09-4777-9a6a-6be029e43790 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.246370 Jul 14 14:56:12.171807 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2599/5212] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:11 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:12.451525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3cc62591-9d87-464d-a2e5-56d46709e90d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:12.470226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3cc62591-9d87-464d-a2e5-56d46709e90d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:12.479202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3cc62591-9d87-464d-a2e5-56d46709e90d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:12.479727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5faf6afc-3155-4a05-acb7-97603227f11b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:12.481647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5faf6afc-3155-4a05-acb7-97603227f11b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:12.482496 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3cc62591-9d87-464d-a2e5-56d46709e90d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1751 microversion: 2.20 time: 0.436869 Jul 14 14:56:12.484014 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2614/5213] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:12 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1751 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:12.495217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5faf6afc-3155-4a05-acb7-97603227f11b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:12.496281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5faf6afc-3155-4a05-acb7-97603227f11b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:12.498654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5faf6afc-3155-4a05-acb7-97603227f11b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:12.501566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5faf6afc-3155-4a05-acb7-97603227f11b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:12.852889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5faf6afc-3155-4a05-acb7-97603227f11b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:12.869853 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5faf6afc-3155-4a05-acb7-97603227f11b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1462 microversion: 2.1 time: 0.395867 Jul 14 14:56:12.870457 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2600/5214] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:12 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1462 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:13.191662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a46e3df1-7ef7-4f5d-a536-b17ecb728559 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:13.192187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a46e3df1-7ef7-4f5d-a536-b17ecb728559 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:13.231982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a46e3df1-7ef7-4f5d-a536-b17ecb728559 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:13.241611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a46e3df1-7ef7-4f5d-a536-b17ecb728559 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:13.242898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a46e3df1-7ef7-4f5d-a536-b17ecb728559 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:13.244154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a46e3df1-7ef7-4f5d-a536-b17ecb728559 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:13.346394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a46e3df1-7ef7-4f5d-a536-b17ecb728559 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:13.368351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a46e3df1-7ef7-4f5d-a536-b17ecb728559 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:13.370285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a46e3df1-7ef7-4f5d-a536-b17ecb728559 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:13.373057 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a46e3df1-7ef7-4f5d-a536-b17ecb728559 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.187064 Jul 14 14:56:13.373901 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2615/5215] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:13 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:13.504595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0761f861-a07a-48be-a776-6ede4bb12b6c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:13.505241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0761f861-a07a-48be-a776-6ede4bb12b6c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:13.520979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0761f861-a07a-48be-a776-6ede4bb12b6c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:13.540547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0761f861-a07a-48be-a776-6ede4bb12b6c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:13.541418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0761f861-a07a-48be-a776-6ede4bb12b6c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:13.541887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0761f861-a07a-48be-a776-6ede4bb12b6c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:13.862792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0761f861-a07a-48be-a776-6ede4bb12b6c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:13.888831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-63bd8970-7d72-4182-967b-8991c9d7f89c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:13.889501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-63bd8970-7d72-4182-967b-8991c9d7f89c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:13.895670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0761f861-a07a-48be-a776-6ede4bb12b6c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:13.897232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0761f861-a07a-48be-a776-6ede4bb12b6c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:13.904522 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0761f861-a07a-48be-a776-6ede4bb12b6c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1751 microversion: 2.20 time: 0.404436 Jul 14 14:56:13.908638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63bd8970-7d72-4182-967b-8991c9d7f89c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:13.909383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63bd8970-7d72-4182-967b-8991c9d7f89c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:13.910368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63bd8970-7d72-4182-967b-8991c9d7f89c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:13.910992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63bd8970-7d72-4182-967b-8991c9d7f89c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:13.923481 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2601/5216] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:13 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1751 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:14.230503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-63bd8970-7d72-4182-967b-8991c9d7f89c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:14.250511 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-63bd8970-7d72-4182-967b-8991c9d7f89c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1462 microversion: 2.1 time: 0.358057 Jul 14 14:56:14.251371 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2616/5217] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:13 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1462 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:14.398349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-03a60fd5-cfec-4d7a-8878-8b2a1f352949 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:14.399513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-03a60fd5-cfec-4d7a-8878-8b2a1f352949 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:14.414873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03a60fd5-cfec-4d7a-8878-8b2a1f352949 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:14.426963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03a60fd5-cfec-4d7a-8878-8b2a1f352949 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:14.430200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03a60fd5-cfec-4d7a-8878-8b2a1f352949 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:14.431006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-03a60fd5-cfec-4d7a-8878-8b2a1f352949 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:14.623004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-03a60fd5-cfec-4d7a-8878-8b2a1f352949 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:14.647616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-03a60fd5-cfec-4d7a-8878-8b2a1f352949 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:14.654833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-03a60fd5-cfec-4d7a-8878-8b2a1f352949 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:14.659985 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-03a60fd5-cfec-4d7a-8878-8b2a1f352949 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.267490 Jul 14 14:56:14.663229 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2602/5218] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:14 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:14.930870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-39fc7600-bdec-4005-bc54-3ed5cb389b98 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:14.931941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-39fc7600-bdec-4005-bc54-3ed5cb389b98 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:14.947227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39fc7600-bdec-4005-bc54-3ed5cb389b98 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:14.947893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39fc7600-bdec-4005-bc54-3ed5cb389b98 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:14.949511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39fc7600-bdec-4005-bc54-3ed5cb389b98 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:14.950184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39fc7600-bdec-4005-bc54-3ed5cb389b98 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:15.269655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0a2f5ceb-b771-4901-a931-61a7a0a22307 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:15.270782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0a2f5ceb-b771-4901-a931-61a7a0a22307 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:15.285157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a2f5ceb-b771-4901-a931-61a7a0a22307 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:15.285999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a2f5ceb-b771-4901-a931-61a7a0a22307 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:15.286998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a2f5ceb-b771-4901-a931-61a7a0a22307 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:15.291329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a2f5ceb-b771-4901-a931-61a7a0a22307 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:15.552097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-39fc7600-bdec-4005-bc54-3ed5cb389b98 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:15.599459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-39fc7600-bdec-4005-bc54-3ed5cb389b98 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:15.605539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-39fc7600-bdec-4005-bc54-3ed5cb389b98 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:15.611312 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-39fc7600-bdec-4005-bc54-3ed5cb389b98 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1751 microversion: 2.20 time: 0.684015 Jul 14 14:56:15.612030 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2617/5219] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:14 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1751 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:15.681273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-41d9a50d-5218-4c2b-aa8f-bf8f295923d7 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:15.682234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-41d9a50d-5218-4c2b-aa8f-bf8f295923d7 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:15.688897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41d9a50d-5218-4c2b-aa8f-bf8f295923d7 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:15.689670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41d9a50d-5218-4c2b-aa8f-bf8f295923d7 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:15.690707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41d9a50d-5218-4c2b-aa8f-bf8f295923d7 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:15.691557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41d9a50d-5218-4c2b-aa8f-bf8f295923d7 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:15.908337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-41d9a50d-5218-4c2b-aa8f-bf8f295923d7 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:15.921488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-41d9a50d-5218-4c2b-aa8f-bf8f295923d7 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:15.923049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-41d9a50d-5218-4c2b-aa8f-bf8f295923d7 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:15.924466 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-41d9a50d-5218-4c2b-aa8f-bf8f295923d7 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.247232 Jul 14 14:56:15.938113 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2618/5220] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:15 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:15.970705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0a2f5ceb-b771-4901-a931-61a7a0a22307 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:15.983326 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0a2f5ceb-b771-4901-a931-61a7a0a22307 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.718310 Jul 14 14:56:15.984192 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2603/5221] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:15 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:16.631461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f80d0fc-c52a-43e3-8d7e-1dc3f1be4bf1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:16.632088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f80d0fc-c52a-43e3-8d7e-1dc3f1be4bf1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:16.648809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f80d0fc-c52a-43e3-8d7e-1dc3f1be4bf1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:16.649595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f80d0fc-c52a-43e3-8d7e-1dc3f1be4bf1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:16.650416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f80d0fc-c52a-43e3-8d7e-1dc3f1be4bf1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:16.650849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f80d0fc-c52a-43e3-8d7e-1dc3f1be4bf1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:16.925628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a83f8340-2f0f-44ca-9dd8-52b97cc5ac6b req-5fda3c3a-01b2-41ba-88af-dfbfbf759d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f554d9f-a901-4284-8c0e-d34d0924e67d", "tag": "9af0d9f1-4145-44d0-a287-acb8ff126aa7"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:16.948103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a83f8340-2f0f-44ca-9dd8-52b97cc5ac6b req-5fda3c3a-01b2-41ba-88af-dfbfbf759d82 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:16.948558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a83f8340-2f0f-44ca-9dd8-52b97cc5ac6b req-5fda3c3a-01b2-41ba-88af-dfbfbf759d82 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:17.038038 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a83f8340-2f0f-44ca-9dd8-52b97cc5ac6b req-5fda3c3a-01b2-41ba-88af-dfbfbf759d82 service nova] Creating event network-changed:9af0d9f1-4145-44d0-a287-acb8ff126aa7 for instance 0f554d9f-a901-4284-8c0e-d34d0924e67d on n-h1-767704-28 Jul 14 14:56:17.066784 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a83f8340-2f0f-44ca-9dd8-52b97cc5ac6b req-5fda3c3a-01b2-41ba-88af-dfbfbf759d82 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144804 Jul 14 14:56:17.076289 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2604/5222] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:56:17.097292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-42725664-af07-46c5-930e-b13f168f69c5 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:17.100545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-42725664-af07-46c5-930e-b13f168f69c5 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:17.110985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f80d0fc-c52a-43e3-8d7e-1dc3f1be4bf1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:17.127327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f80d0fc-c52a-43e3-8d7e-1dc3f1be4bf1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:17.129293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f80d0fc-c52a-43e3-8d7e-1dc3f1be4bf1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:17.129651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42725664-af07-46c5-930e-b13f168f69c5 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:17.131522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42725664-af07-46c5-930e-b13f168f69c5 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:17.133649 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f80d0fc-c52a-43e3-8d7e-1dc3f1be4bf1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1751 microversion: 2.20 time: 0.505391 Jul 14 14:56:17.135000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42725664-af07-46c5-930e-b13f168f69c5 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:17.136778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42725664-af07-46c5-930e-b13f168f69c5 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:17.157410 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2619/5223] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:16 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1751 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:17.162407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dd724c29-e846-4acb-8499-14e7602f0e3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:17.163276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dd724c29-e846-4acb-8499-14e7602f0e3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:17.179641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd724c29-e846-4acb-8499-14e7602f0e3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:17.180298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd724c29-e846-4acb-8499-14e7602f0e3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:17.181303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd724c29-e846-4acb-8499-14e7602f0e3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:17.181914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd724c29-e846-4acb-8499-14e7602f0e3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:17.580483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-42725664-af07-46c5-930e-b13f168f69c5 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:17.593214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-42725664-af07-46c5-930e-b13f168f69c5 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:17.594761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-42725664-af07-46c5-930e-b13f168f69c5 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:17.595966 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-42725664-af07-46c5-930e-b13f168f69c5 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.517240 Jul 14 14:56:17.612393 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2605/5224] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:17 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:17.784647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dd724c29-e846-4acb-8499-14e7602f0e3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:17.805933 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dd724c29-e846-4acb-8499-14e7602f0e3b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.647158 Jul 14 14:56:17.809381 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2620/5225] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:17 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:18.155822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a7e88169-d242-4442-8199-e8629c6dad72 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:18.157012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a7e88169-d242-4442-8199-e8629c6dad72 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:18.165632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7e88169-d242-4442-8199-e8629c6dad72 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:18.166361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7e88169-d242-4442-8199-e8629c6dad72 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:18.167319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7e88169-d242-4442-8199-e8629c6dad72 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:18.168602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7e88169-d242-4442-8199-e8629c6dad72 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:18.504360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a7e88169-d242-4442-8199-e8629c6dad72 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:18.519042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a7e88169-d242-4442-8199-e8629c6dad72 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:18.520721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a7e88169-d242-4442-8199-e8629c6dad72 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:18.522772 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a7e88169-d242-4442-8199-e8629c6dad72 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.372358 Jul 14 14:56:18.525870 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2606/5226] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:18 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:18.621915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c46d5bb3-f5ce-48b1-a3f9-95a1b3bf18f8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:18.623039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c46d5bb3-f5ce-48b1-a3f9-95a1b3bf18f8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:18.632916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c46d5bb3-f5ce-48b1-a3f9-95a1b3bf18f8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:18.634160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c46d5bb3-f5ce-48b1-a3f9-95a1b3bf18f8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:18.635769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c46d5bb3-f5ce-48b1-a3f9-95a1b3bf18f8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:18.637198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c46d5bb3-f5ce-48b1-a3f9-95a1b3bf18f8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:18.826793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5b2609e0-957d-43d7-b374-84975a8780bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:18.827466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5b2609e0-957d-43d7-b374-84975a8780bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:18.844456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b2609e0-957d-43d7-b374-84975a8780bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:18.845228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b2609e0-957d-43d7-b374-84975a8780bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:18.849475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b2609e0-957d-43d7-b374-84975a8780bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:18.851185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b2609e0-957d-43d7-b374-84975a8780bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:18.852180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c46d5bb3-f5ce-48b1-a3f9-95a1b3bf18f8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:18.861604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c46d5bb3-f5ce-48b1-a3f9-95a1b3bf18f8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:18.868291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c46d5bb3-f5ce-48b1-a3f9-95a1b3bf18f8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:18.872918 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c46d5bb3-f5ce-48b1-a3f9-95a1b3bf18f8 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.256960 Jul 14 14:56:18.875554 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2621/5227] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:18 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:19.196248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5b2609e0-957d-43d7-b374-84975a8780bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:19.211910 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5b2609e0-957d-43d7-b374-84975a8780bc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.391266 Jul 14 14:56:19.223481 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2607/5228] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:18 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:19.545380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b22d523-448d-46fb-af8a-f8cd7da11cec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:19.546096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b22d523-448d-46fb-af8a-f8cd7da11cec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:19.556310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b22d523-448d-46fb-af8a-f8cd7da11cec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:19.557400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b22d523-448d-46fb-af8a-f8cd7da11cec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:19.561490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b22d523-448d-46fb-af8a-f8cd7da11cec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:19.564407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b22d523-448d-46fb-af8a-f8cd7da11cec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:19.896276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9b22d523-448d-46fb-af8a-f8cd7da11cec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:19.905724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0e063ac6-45e9-4611-a45d-fdfe476d6b5b tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:19.906347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0e063ac6-45e9-4611-a45d-fdfe476d6b5b tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:19.930101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9b22d523-448d-46fb-af8a-f8cd7da11cec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:19.932570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e063ac6-45e9-4611-a45d-fdfe476d6b5b tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:19.935090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e063ac6-45e9-4611-a45d-fdfe476d6b5b tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:19.948367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9b22d523-448d-46fb-af8a-f8cd7da11cec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:19.950060 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9b22d523-448d-46fb-af8a-f8cd7da11cec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.410292 Jul 14 14:56:19.957000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e063ac6-45e9-4611-a45d-fdfe476d6b5b tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:19.959456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0e063ac6-45e9-4611-a45d-fdfe476d6b5b tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:19.960535 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2622/5229] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:19 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:20.105757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0e063ac6-45e9-4611-a45d-fdfe476d6b5b tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:20.115421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0e063ac6-45e9-4611-a45d-fdfe476d6b5b tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:20.117686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0e063ac6-45e9-4611-a45d-fdfe476d6b5b tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:20.119319 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0e063ac6-45e9-4611-a45d-fdfe476d6b5b tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.225833 Jul 14 14:56:20.132113 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2608/5230] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:19 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:20.229920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bf715c25-928f-40ef-8ea8-8cd76af000c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:20.231417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bf715c25-928f-40ef-8ea8-8cd76af000c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:20.246925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf715c25-928f-40ef-8ea8-8cd76af000c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:20.247400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf715c25-928f-40ef-8ea8-8cd76af000c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:20.248188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf715c25-928f-40ef-8ea8-8cd76af000c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:20.248827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf715c25-928f-40ef-8ea8-8cd76af000c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:20.629861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bf715c25-928f-40ef-8ea8-8cd76af000c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:20.642163 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bf715c25-928f-40ef-8ea8-8cd76af000c8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.416712 Jul 14 14:56:20.646788 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2623/5231] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:20 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:20.985275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-299b844a-7444-4f97-87bf-5d4113e82288 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:20.985275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-299b844a-7444-4f97-87bf-5d4113e82288 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:20.993663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-299b844a-7444-4f97-87bf-5d4113e82288 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:20.994263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-299b844a-7444-4f97-87bf-5d4113e82288 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:20.995270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-299b844a-7444-4f97-87bf-5d4113e82288 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:20.999174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-299b844a-7444-4f97-87bf-5d4113e82288 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:21.142749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-35e610e8-e389-4b84-a297-1bf71b6717f2 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:21.143760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-35e610e8-e389-4b84-a297-1bf71b6717f2 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:21.165576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:21.179702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-35e610e8-e389-4b84-a297-1bf71b6717f2 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:21.181358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-35e610e8-e389-4b84-a297-1bf71b6717f2 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:21.184112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-35e610e8-e389-4b84-a297-1bf71b6717f2 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:21.188308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-35e610e8-e389-4b84-a297-1bf71b6717f2 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:21.403300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-35e610e8-e389-4b84-a297-1bf71b6717f2 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:21.416520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-35e610e8-e389-4b84-a297-1bf71b6717f2 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:21.419976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-35e610e8-e389-4b84-a297-1bf71b6717f2 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:21.427887 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-35e610e8-e389-4b84-a297-1bf71b6717f2 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.287986 Jul 14 14:56:21.430625 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2624/5232] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:21 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:21.468007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-299b844a-7444-4f97-87bf-5d4113e82288 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:21.492228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-299b844a-7444-4f97-87bf-5d4113e82288 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:21.499221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-299b844a-7444-4f97-87bf-5d4113e82288 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:21.502138 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-299b844a-7444-4f97-87bf-5d4113e82288 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.525976 Jul 14 14:56:21.502744 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2609/5233] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:20 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:21.663128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f51d20e7-229a-4a2a-ad7f-c1216068bc44 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:21.663764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f51d20e7-229a-4a2a-ad7f-c1216068bc44 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:21.678207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f51d20e7-229a-4a2a-ad7f-c1216068bc44 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:21.678720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f51d20e7-229a-4a2a-ad7f-c1216068bc44 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:21.679534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f51d20e7-229a-4a2a-ad7f-c1216068bc44 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:21.679984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f51d20e7-229a-4a2a-ad7f-c1216068bc44 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:22.006623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f51d20e7-229a-4a2a-ad7f-c1216068bc44 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:22.017649 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f51d20e7-229a-4a2a-ad7f-c1216068bc44 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.358101 Jul 14 14:56:22.028361 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2625/5234] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:21 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:22.457488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-312b62f8-b25c-4ee6-a88a-cebba693fbdf tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:22.459501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-312b62f8-b25c-4ee6-a88a-cebba693fbdf tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:22.469936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-312b62f8-b25c-4ee6-a88a-cebba693fbdf tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:22.471427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-312b62f8-b25c-4ee6-a88a-cebba693fbdf tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:22.472478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-312b62f8-b25c-4ee6-a88a-cebba693fbdf tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:22.473314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-312b62f8-b25c-4ee6-a88a-cebba693fbdf tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:22.527980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e1861bbe-9f3d-4697-a513-3d28806bbf5f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:22.529592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e1861bbe-9f3d-4697-a513-3d28806bbf5f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:22.543681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1861bbe-9f3d-4697-a513-3d28806bbf5f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:22.546875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1861bbe-9f3d-4697-a513-3d28806bbf5f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:22.548350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1861bbe-9f3d-4697-a513-3d28806bbf5f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:22.549844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1861bbe-9f3d-4697-a513-3d28806bbf5f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:22.583091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:22.697453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-312b62f8-b25c-4ee6-a88a-cebba693fbdf tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:22.730891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-312b62f8-b25c-4ee6-a88a-cebba693fbdf tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:22.732922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-312b62f8-b25c-4ee6-a88a-cebba693fbdf tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:22.734567 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-312b62f8-b25c-4ee6-a88a-cebba693fbdf tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.285672 Jul 14 14:56:22.735710 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2610/5235] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:22 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:23.036571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-91b79682-8d5f-4582-86d4-36e724dfeee0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:23.038523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-91b79682-8d5f-4582-86d4-36e724dfeee0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:23.048449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91b79682-8d5f-4582-86d4-36e724dfeee0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:23.049394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91b79682-8d5f-4582-86d4-36e724dfeee0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:23.050490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91b79682-8d5f-4582-86d4-36e724dfeee0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:23.051167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91b79682-8d5f-4582-86d4-36e724dfeee0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:23.477358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e1861bbe-9f3d-4697-a513-3d28806bbf5f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:23.513540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e1861bbe-9f3d-4697-a513-3d28806bbf5f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:23.520432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e1861bbe-9f3d-4697-a513-3d28806bbf5f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:23.523862 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e1861bbe-9f3d-4697-a513-3d28806bbf5f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 1.005873 Jul 14 14:56:23.529084 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2626/5236] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:22 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:23.534106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-91b79682-8d5f-4582-86d4-36e724dfeee0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:23.545638 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-91b79682-8d5f-4582-86d4-36e724dfeee0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.514344 Jul 14 14:56:23.556402 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2611/5237] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:23 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:23.755044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-973cc20c-c141-4342-b0ce-25310bf89616 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:23.755671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-973cc20c-c141-4342-b0ce-25310bf89616 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:23.768661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-973cc20c-c141-4342-b0ce-25310bf89616 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:23.771211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-973cc20c-c141-4342-b0ce-25310bf89616 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:23.773602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-973cc20c-c141-4342-b0ce-25310bf89616 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:23.774447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-973cc20c-c141-4342-b0ce-25310bf89616 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:23.962418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-973cc20c-c141-4342-b0ce-25310bf89616 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:23.986796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-973cc20c-c141-4342-b0ce-25310bf89616 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:23.988333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-973cc20c-c141-4342-b0ce-25310bf89616 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:23.989643 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-973cc20c-c141-4342-b0ce-25310bf89616 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.239027 Jul 14 14:56:24.002475 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2627/5238] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:23 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:24.557270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e9989680-cc7c-4e5c-8182-07cca894ddeb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:24.558017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e9989680-cc7c-4e5c-8182-07cca894ddeb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:24.567027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e8c5771-6d3c-4466-88d1-78d613a8f8b2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:24.568491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0e8c5771-6d3c-4466-88d1-78d613a8f8b2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:24.578550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e8c5771-6d3c-4466-88d1-78d613a8f8b2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:24.580241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e8c5771-6d3c-4466-88d1-78d613a8f8b2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:24.581457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e9989680-cc7c-4e5c-8182-07cca894ddeb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:24.581768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e8c5771-6d3c-4466-88d1-78d613a8f8b2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:24.582164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e9989680-cc7c-4e5c-8182-07cca894ddeb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:24.582813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e8c5771-6d3c-4466-88d1-78d613a8f8b2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:24.593455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e9989680-cc7c-4e5c-8182-07cca894ddeb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:24.594692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e9989680-cc7c-4e5c-8182-07cca894ddeb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:25.018424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0e8c5771-6d3c-4466-88d1-78d613a8f8b2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:25.028608 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0e8c5771-6d3c-4466-88d1-78d613a8f8b2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.466694 Jul 14 14:56:25.045814 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2628/5239] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:24 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:25.055917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3d1a85b9-a860-4017-b404-8e3487199d01 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:25.056789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3d1a85b9-a860-4017-b404-8e3487199d01 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:25.058647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e9989680-cc7c-4e5c-8182-07cca894ddeb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:25.065858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d1a85b9-a860-4017-b404-8e3487199d01 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:25.066393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d1a85b9-a860-4017-b404-8e3487199d01 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:25.067294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d1a85b9-a860-4017-b404-8e3487199d01 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:25.067753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d1a85b9-a860-4017-b404-8e3487199d01 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:25.072671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e9989680-cc7c-4e5c-8182-07cca894ddeb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:25.079895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e9989680-cc7c-4e5c-8182-07cca894ddeb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:25.082067 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e9989680-cc7c-4e5c-8182-07cca894ddeb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.538096 Jul 14 14:56:25.097945 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2612/5240] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:24 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:25.180823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3d1a85b9-a860-4017-b404-8e3487199d01 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:25.207292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3d1a85b9-a860-4017-b404-8e3487199d01 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:25.209026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3d1a85b9-a860-4017-b404-8e3487199d01 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:25.210263 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3d1a85b9-a860-4017-b404-8e3487199d01 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.163085 Jul 14 14:56:25.211313 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2629/5241] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:25 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:26.055466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45868949-9324-434d-b946-89a65761a760 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:26.057812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-45868949-9324-434d-b946-89a65761a760 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:26.076864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45868949-9324-434d-b946-89a65761a760 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:26.078056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45868949-9324-434d-b946-89a65761a760 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:26.080645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45868949-9324-434d-b946-89a65761a760 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:26.083518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45868949-9324-434d-b946-89a65761a760 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:26.108910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-394548b4-62d1-4134-b867-fed90fb940c9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:26.109980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-394548b4-62d1-4134-b867-fed90fb940c9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:26.138633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-394548b4-62d1-4134-b867-fed90fb940c9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:26.138986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-394548b4-62d1-4134-b867-fed90fb940c9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:26.139800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-394548b4-62d1-4134-b867-fed90fb940c9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:26.140217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-394548b4-62d1-4134-b867-fed90fb940c9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:26.642906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-45868949-9324-434d-b946-89a65761a760 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:26.651025 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-45868949-9324-434d-b946-89a65761a760 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.605191 Jul 14 14:56:26.656538 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2613/5242] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:26 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:26.666047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f702897c-066c-45b9-b0f3-582a99055c10 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:26.666940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f702897c-066c-45b9-b0f3-582a99055c10 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:26.697227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f702897c-066c-45b9-b0f3-582a99055c10 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:26.699808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f702897c-066c-45b9-b0f3-582a99055c10 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:26.702113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f702897c-066c-45b9-b0f3-582a99055c10 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:26.703356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f702897c-066c-45b9-b0f3-582a99055c10 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:26.852732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f702897c-066c-45b9-b0f3-582a99055c10 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:26.870712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f702897c-066c-45b9-b0f3-582a99055c10 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:26.879146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-394548b4-62d1-4134-b867-fed90fb940c9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:26.889627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f702897c-066c-45b9-b0f3-582a99055c10 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:26.892601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-394548b4-62d1-4134-b867-fed90fb940c9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:26.892812 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f702897c-066c-45b9-b0f3-582a99055c10 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.234329 Jul 14 14:56:26.893923 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2614/5243] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:26 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:26.909493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-394548b4-62d1-4134-b867-fed90fb940c9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:26.911369 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-394548b4-62d1-4134-b867-fed90fb940c9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.807885 Jul 14 14:56:26.917449 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2630/5244] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:26 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:27.669337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f5d9a3bb-f0fc-4a0e-85bd-286d0d9f9278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:27.669964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f5d9a3bb-f0fc-4a0e-85bd-286d0d9f9278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:27.684272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5d9a3bb-f0fc-4a0e-85bd-286d0d9f9278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:27.689094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5d9a3bb-f0fc-4a0e-85bd-286d0d9f9278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:27.691754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5d9a3bb-f0fc-4a0e-85bd-286d0d9f9278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:27.693693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5d9a3bb-f0fc-4a0e-85bd-286d0d9f9278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:27.771224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:27.914601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-88230c9a-8241-4dda-9b73-8903922bf4f4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:27.915523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-88230c9a-8241-4dda-9b73-8903922bf4f4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:27.954884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88230c9a-8241-4dda-9b73-8903922bf4f4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:27.954884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88230c9a-8241-4dda-9b73-8903922bf4f4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:27.954884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88230c9a-8241-4dda-9b73-8903922bf4f4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:27.954884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88230c9a-8241-4dda-9b73-8903922bf4f4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.152738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-88230c9a-8241-4dda-9b73-8903922bf4f4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:28.172057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-88230c9a-8241-4dda-9b73-8903922bf4f4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:28.185262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-88230c9a-8241-4dda-9b73-8903922bf4f4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:28.187103 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-88230c9a-8241-4dda-9b73-8903922bf4f4 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.277924 Jul 14 14:56:28.190792 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2631/5245] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:27 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:28.194503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f5d9a3bb-f0fc-4a0e-85bd-286d0d9f9278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:28.205553 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f5d9a3bb-f0fc-4a0e-85bd-286d0d9f9278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.540133 Jul 14 14:56:28.206456 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2615/5246] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:27 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:28.211315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0cb95779-57c4-4365-bb92-c7893805237f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:28.213957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0cb95779-57c4-4365-bb92-c7893805237f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:28.239549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0cb95779-57c4-4365-bb92-c7893805237f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:28.248918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0cb95779-57c4-4365-bb92-c7893805237f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.250310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0cb95779-57c4-4365-bb92-c7893805237f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:28.254950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0cb95779-57c4-4365-bb92-c7893805237f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.583658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0cb95779-57c4-4365-bb92-c7893805237f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:28.595176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0cb95779-57c4-4365-bb92-c7893805237f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:28.597321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0cb95779-57c4-4365-bb92-c7893805237f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:28.598773 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0cb95779-57c4-4365-bb92-c7893805237f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.395417 Jul 14 14:56:28.599870 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2632/5247] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:28 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:29.212285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-573cbd29-bb81-4f08-b0ba-424d7d640ff9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:29.213696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-573cbd29-bb81-4f08-b0ba-424d7d640ff9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:29.223810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc556c8f-a061-4f0c-ad84-3911d7c8d8fd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:29.225128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc556c8f-a061-4f0c-ad84-3911d7c8d8fd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:29.233183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-573cbd29-bb81-4f08-b0ba-424d7d640ff9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:29.233712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-573cbd29-bb81-4f08-b0ba-424d7d640ff9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:29.234549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-573cbd29-bb81-4f08-b0ba-424d7d640ff9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:29.235028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-573cbd29-bb81-4f08-b0ba-424d7d640ff9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:29.237071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc556c8f-a061-4f0c-ad84-3911d7c8d8fd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:29.237900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc556c8f-a061-4f0c-ad84-3911d7c8d8fd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:29.240019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc556c8f-a061-4f0c-ad84-3911d7c8d8fd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:29.241471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc556c8f-a061-4f0c-ad84-3911d7c8d8fd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:29.464993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-573cbd29-bb81-4f08-b0ba-424d7d640ff9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:29.501410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-573cbd29-bb81-4f08-b0ba-424d7d640ff9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:29.509977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-573cbd29-bb81-4f08-b0ba-424d7d640ff9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:29.517334 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-573cbd29-bb81-4f08-b0ba-424d7d640ff9 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.307150 Jul 14 14:56:29.521421 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2616/5248] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:29 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:29.594833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc556c8f-a061-4f0c-ad84-3911d7c8d8fd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:29.607130 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc556c8f-a061-4f0c-ad84-3911d7c8d8fd tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.387358 Jul 14 14:56:29.616412 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2633/5249] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:29 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:29.625780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-754c35dc-5bc8-4e68-bd2c-e8cd574e77d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:29.627043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-754c35dc-5bc8-4e68-bd2c-e8cd574e77d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:29.646875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-754c35dc-5bc8-4e68-bd2c-e8cd574e77d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:29.649817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-754c35dc-5bc8-4e68-bd2c-e8cd574e77d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:29.653555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-754c35dc-5bc8-4e68-bd2c-e8cd574e77d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:29.655343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-754c35dc-5bc8-4e68-bd2c-e8cd574e77d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:29.876792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-754c35dc-5bc8-4e68-bd2c-e8cd574e77d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:29.896330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-754c35dc-5bc8-4e68-bd2c-e8cd574e77d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:29.910682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-754c35dc-5bc8-4e68-bd2c-e8cd574e77d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:29.912428 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-754c35dc-5bc8-4e68-bd2c-e8cd574e77d9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.297301 Jul 14 14:56:29.914492 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2617/5250] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:29 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:30.542214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-538038d0-5b34-4548-abf9-6e0e7e7a9550 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:30.543242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-538038d0-5b34-4548-abf9-6e0e7e7a9550 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:30.555430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-538038d0-5b34-4548-abf9-6e0e7e7a9550 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:30.555756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-538038d0-5b34-4548-abf9-6e0e7e7a9550 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:30.556539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-538038d0-5b34-4548-abf9-6e0e7e7a9550 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:30.556992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-538038d0-5b34-4548-abf9-6e0e7e7a9550 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:30.628779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d9b84efd-63a5-4bee-8aa5-5b4b56e740b1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:30.644117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d9b84efd-63a5-4bee-8aa5-5b4b56e740b1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:30.670182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-538038d0-5b34-4548-abf9-6e0e7e7a9550 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:30.688030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-538038d0-5b34-4548-abf9-6e0e7e7a9550 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:30.696972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-538038d0-5b34-4548-abf9-6e0e7e7a9550 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:30.698040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9b84efd-63a5-4bee-8aa5-5b4b56e740b1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:30.698225 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-538038d0-5b34-4548-abf9-6e0e7e7a9550 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.166525 Jul 14 14:56:30.700987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9b84efd-63a5-4bee-8aa5-5b4b56e740b1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:30.702704 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2634/5251] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:30 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:30.704810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9b84efd-63a5-4bee-8aa5-5b4b56e740b1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:30.706340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d9b84efd-63a5-4bee-8aa5-5b4b56e740b1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:30.934438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b6813b01-cb23-4ab7-8bba-5d7410c85433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:30.935337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b6813b01-cb23-4ab7-8bba-5d7410c85433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:30.946016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6813b01-cb23-4ab7-8bba-5d7410c85433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:30.950601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6813b01-cb23-4ab7-8bba-5d7410c85433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:30.956701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6813b01-cb23-4ab7-8bba-5d7410c85433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:30.957471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6813b01-cb23-4ab7-8bba-5d7410c85433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:31.017580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d9b84efd-63a5-4bee-8aa5-5b4b56e740b1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:31.030193 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d9b84efd-63a5-4bee-8aa5-5b4b56e740b1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.409876 Jul 14 14:56:31.031102 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2618/5252] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:30 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:31.475904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b6813b01-cb23-4ab7-8bba-5d7410c85433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:31.486226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b6813b01-cb23-4ab7-8bba-5d7410c85433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:31.494460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b6813b01-cb23-4ab7-8bba-5d7410c85433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:31.499243 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b6813b01-cb23-4ab7-8bba-5d7410c85433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.566365 Jul 14 14:56:31.512799 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2635/5253] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:30 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:31.719762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1b1f0dce-024e-4c93-aef5-ce1f9c23a5ba tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:31.721154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1b1f0dce-024e-4c93-aef5-ce1f9c23a5ba tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:31.729224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b1f0dce-024e-4c93-aef5-ce1f9c23a5ba tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:31.732261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b1f0dce-024e-4c93-aef5-ce1f9c23a5ba tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:31.733565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b1f0dce-024e-4c93-aef5-ce1f9c23a5ba tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:31.734786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b1f0dce-024e-4c93-aef5-ce1f9c23a5ba tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:31.851255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1b1f0dce-024e-4c93-aef5-ce1f9c23a5ba tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:31.868249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1b1f0dce-024e-4c93-aef5-ce1f9c23a5ba tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:31.872714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1b1f0dce-024e-4c93-aef5-ce1f9c23a5ba tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:31.875409 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1b1f0dce-024e-4c93-aef5-ce1f9c23a5ba tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.160995 Jul 14 14:56:31.878414 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2619/5254] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:31 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:32.048335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f8f519b-8464-4f2c-b765-d372e65e5cbf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:32.049171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f8f519b-8464-4f2c-b765-d372e65e5cbf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:32.071366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f8f519b-8464-4f2c-b765-d372e65e5cbf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:32.072199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f8f519b-8464-4f2c-b765-d372e65e5cbf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:32.073223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f8f519b-8464-4f2c-b765-d372e65e5cbf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:32.075051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f8f519b-8464-4f2c-b765-d372e65e5cbf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:32.343092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f8f519b-8464-4f2c-b765-d372e65e5cbf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:32.356973 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f8f519b-8464-4f2c-b765-d372e65e5cbf tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.311850 Jul 14 14:56:32.358245 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2636/5255] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:32 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:32.518422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae185172-a712-4c5c-b1f2-aa2c0ac25e4e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:32.519052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae185172-a712-4c5c-b1f2-aa2c0ac25e4e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:32.538577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae185172-a712-4c5c-b1f2-aa2c0ac25e4e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:32.546453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae185172-a712-4c5c-b1f2-aa2c0ac25e4e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:32.547780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae185172-a712-4c5c-b1f2-aa2c0ac25e4e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:32.548818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae185172-a712-4c5c-b1f2-aa2c0ac25e4e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:32.860667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ae185172-a712-4c5c-b1f2-aa2c0ac25e4e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:32.881963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ae185172-a712-4c5c-b1f2-aa2c0ac25e4e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:32.897725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b42fc357-d7f3-4f57-8325-260f801ca91f tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:32.898395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b42fc357-d7f3-4f57-8325-260f801ca91f tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:32.904203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ae185172-a712-4c5c-b1f2-aa2c0ac25e4e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:32.905966 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ae185172-a712-4c5c-b1f2-aa2c0ac25e4e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.391367 Jul 14 14:56:32.928506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b42fc357-d7f3-4f57-8325-260f801ca91f tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:32.929531 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2620/5256] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:32 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:32.931987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b42fc357-d7f3-4f57-8325-260f801ca91f tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:32.932847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b42fc357-d7f3-4f57-8325-260f801ca91f tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:32.933442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b42fc357-d7f3-4f57-8325-260f801ca91f tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:33.098042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b42fc357-d7f3-4f57-8325-260f801ca91f tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:33.109493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b42fc357-d7f3-4f57-8325-260f801ca91f tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:33.111394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b42fc357-d7f3-4f57-8325-260f801ca91f tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:33.113752 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b42fc357-d7f3-4f57-8325-260f801ca91f tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.221185 Jul 14 14:56:33.125817 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2637/5257] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:32 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:33.382114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1deafbff-cc9b-4055-a690-c5a12124a246 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:33.382751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1deafbff-cc9b-4055-a690-c5a12124a246 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:33.406706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1deafbff-cc9b-4055-a690-c5a12124a246 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:33.407272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1deafbff-cc9b-4055-a690-c5a12124a246 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:33.410581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1deafbff-cc9b-4055-a690-c5a12124a246 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:33.412798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1deafbff-cc9b-4055-a690-c5a12124a246 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:33.739864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1deafbff-cc9b-4055-a690-c5a12124a246 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:33.756831 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1deafbff-cc9b-4055-a690-c5a12124a246 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.384324 Jul 14 14:56:33.759253 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2621/5258] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:33 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:33.948046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd01d664-32ff-4129-acb7-5392910bbc91 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:33.951503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cd01d664-32ff-4129-acb7-5392910bbc91 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:33.977806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd01d664-32ff-4129-acb7-5392910bbc91 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:33.981125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd01d664-32ff-4129-acb7-5392910bbc91 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:33.982055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd01d664-32ff-4129-acb7-5392910bbc91 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:33.982520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd01d664-32ff-4129-acb7-5392910bbc91 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:34.134592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dc97563c-dbbf-4067-af0a-959b95897024 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:34.135212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dc97563c-dbbf-4067-af0a-959b95897024 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:34.154153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc97563c-dbbf-4067-af0a-959b95897024 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:34.156114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc97563c-dbbf-4067-af0a-959b95897024 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:34.156986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc97563c-dbbf-4067-af0a-959b95897024 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:34.157444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc97563c-dbbf-4067-af0a-959b95897024 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:34.271451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cd01d664-32ff-4129-acb7-5392910bbc91 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:34.288662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cd01d664-32ff-4129-acb7-5392910bbc91 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:34.290704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cd01d664-32ff-4129-acb7-5392910bbc91 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:34.292358 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cd01d664-32ff-4129-acb7-5392910bbc91 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.357397 Jul 14 14:56:34.294536 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2638/5259] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:33 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:34.366148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dc97563c-dbbf-4067-af0a-959b95897024 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:34.395876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dc97563c-dbbf-4067-af0a-959b95897024 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:34.398348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dc97563c-dbbf-4067-af0a-959b95897024 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:34.400664 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dc97563c-dbbf-4067-af0a-959b95897024 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.271498 Jul 14 14:56:34.401300 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2622/5260] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:34 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:34.778068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a74a592-27c0-46ed-85f5-fcfa81731cfb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:34.778726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0a74a592-27c0-46ed-85f5-fcfa81731cfb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:34.795421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a74a592-27c0-46ed-85f5-fcfa81731cfb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:34.795890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a74a592-27c0-46ed-85f5-fcfa81731cfb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:34.796702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a74a592-27c0-46ed-85f5-fcfa81731cfb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:34.797207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a74a592-27c0-46ed-85f5-fcfa81731cfb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:35.138321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0a74a592-27c0-46ed-85f5-fcfa81731cfb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:35.147533 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0a74a592-27c0-46ed-85f5-fcfa81731cfb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.374118 Jul 14 14:56:35.152315 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2639/5261] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:34 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:35.312020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9495fbfc-f774-43e5-8917-abfb16d1a0b5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:35.313302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9495fbfc-f774-43e5-8917-abfb16d1a0b5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:35.319158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=66 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:35.360411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9495fbfc-f774-43e5-8917-abfb16d1a0b5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:35.360904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9495fbfc-f774-43e5-8917-abfb16d1a0b5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:35.361901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9495fbfc-f774-43e5-8917-abfb16d1a0b5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:35.362341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9495fbfc-f774-43e5-8917-abfb16d1a0b5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:35.426550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d248d3bc-aab7-4c5c-8c40-c84689b6c629 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:35.427176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d248d3bc-aab7-4c5c-8c40-c84689b6c629 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:35.441093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d248d3bc-aab7-4c5c-8c40-c84689b6c629 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:35.459356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d248d3bc-aab7-4c5c-8c40-c84689b6c629 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:35.465710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d248d3bc-aab7-4c5c-8c40-c84689b6c629 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:35.467874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d248d3bc-aab7-4c5c-8c40-c84689b6c629 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:35.682031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d248d3bc-aab7-4c5c-8c40-c84689b6c629 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:35.705054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d248d3bc-aab7-4c5c-8c40-c84689b6c629 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:35.712469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d248d3bc-aab7-4c5c-8c40-c84689b6c629 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:35.718587 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d248d3bc-aab7-4c5c-8c40-c84689b6c629 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1366 microversion: 2.57 time: 0.293702 Jul 14 14:56:35.721288 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2640/5262] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:35 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:35.829129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9495fbfc-f774-43e5-8917-abfb16d1a0b5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:35.848617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9495fbfc-f774-43e5-8917-abfb16d1a0b5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:35.850493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9495fbfc-f774-43e5-8917-abfb16d1a0b5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:35.851709 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9495fbfc-f774-43e5-8917-abfb16d1a0b5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.544029 Jul 14 14:56:35.852286 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2623/5263] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:35 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:36.168463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77af7eab-3b58-4f57-be87-177881bd5524 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:36.169467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-77af7eab-3b58-4f57-be87-177881bd5524 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:36.209895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77af7eab-3b58-4f57-be87-177881bd5524 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:36.212797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77af7eab-3b58-4f57-be87-177881bd5524 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:36.213824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77af7eab-3b58-4f57-be87-177881bd5524 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:36.216581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77af7eab-3b58-4f57-be87-177881bd5524 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:36.475773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-77af7eab-3b58-4f57-be87-177881bd5524 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:36.486660 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-77af7eab-3b58-4f57-be87-177881bd5524 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.322666 Jul 14 14:56:36.493078 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2641/5264] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:36 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:36.738933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6385fff3-ad7b-426b-9b98-bc17ed3ab8b1 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:36.739718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6385fff3-ad7b-426b-9b98-bc17ed3ab8b1 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:36.765237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6385fff3-ad7b-426b-9b98-bc17ed3ab8b1 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:36.766073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6385fff3-ad7b-426b-9b98-bc17ed3ab8b1 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:36.767131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6385fff3-ad7b-426b-9b98-bc17ed3ab8b1 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:36.769238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6385fff3-ad7b-426b-9b98-bc17ed3ab8b1 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:36.874906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ddb9f0f-e512-4bd8-a807-d080c5d836e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:36.875684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ddb9f0f-e512-4bd8-a807-d080c5d836e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:36.893104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ddb9f0f-e512-4bd8-a807-d080c5d836e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:36.896661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ddb9f0f-e512-4bd8-a807-d080c5d836e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:36.903398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ddb9f0f-e512-4bd8-a807-d080c5d836e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:36.907880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ddb9f0f-e512-4bd8-a807-d080c5d836e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:36.943562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6385fff3-ad7b-426b-9b98-bc17ed3ab8b1 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:36.963884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6385fff3-ad7b-426b-9b98-bc17ed3ab8b1 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:36.990432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6385fff3-ad7b-426b-9b98-bc17ed3ab8b1 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:36.992775 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6385fff3-ad7b-426b-9b98-bc17ed3ab8b1 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1372 microversion: 2.57 time: 0.258087 Jul 14 14:56:36.998176 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2624/5265] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:36 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1372 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:37.308704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ddb9f0f-e512-4bd8-a807-d080c5d836e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:37.313860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:37.334225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ddb9f0f-e512-4bd8-a807-d080c5d836e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:37.336164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ddb9f0f-e512-4bd8-a807-d080c5d836e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:37.337608 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ddb9f0f-e512-4bd8-a807-d080c5d836e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.467614 Jul 14 14:56:37.338665 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2642/5266] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:36 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:37.504569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6a07796f-4b8d-4c25-a250-406de6ec06b4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:37.505451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6a07796f-4b8d-4c25-a250-406de6ec06b4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:37.513753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a07796f-4b8d-4c25-a250-406de6ec06b4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:37.515081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a07796f-4b8d-4c25-a250-406de6ec06b4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:37.516142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a07796f-4b8d-4c25-a250-406de6ec06b4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:37.516852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a07796f-4b8d-4c25-a250-406de6ec06b4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:38.015230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eadeb6ea-392b-47b4-9a41-3aebc559be54 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:38.016638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eadeb6ea-392b-47b4-9a41-3aebc559be54 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:38.053729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eadeb6ea-392b-47b4-9a41-3aebc559be54 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:38.054217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eadeb6ea-392b-47b4-9a41-3aebc559be54 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:38.055050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eadeb6ea-392b-47b4-9a41-3aebc559be54 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:38.055494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eadeb6ea-392b-47b4-9a41-3aebc559be54 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:38.085066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6a07796f-4b8d-4c25-a250-406de6ec06b4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:38.093991 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6a07796f-4b8d-4c25-a250-406de6ec06b4 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.593194 Jul 14 14:56:38.094591 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2625/5267] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:37 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:38.226502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eadeb6ea-392b-47b4-9a41-3aebc559be54 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:38.242076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eadeb6ea-392b-47b4-9a41-3aebc559be54 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:38.249821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eadeb6ea-392b-47b4-9a41-3aebc559be54 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:38.251591 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eadeb6ea-392b-47b4-9a41-3aebc559be54 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1372 microversion: 2.57 time: 0.241911 Jul 14 14:56:38.253647 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2643/5268] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:38 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1372 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:38.358781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8945405f-718c-4f80-8d85-fa2c563aa5a5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:38.359403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8945405f-718c-4f80-8d85-fa2c563aa5a5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:38.369987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8945405f-718c-4f80-8d85-fa2c563aa5a5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:38.370453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8945405f-718c-4f80-8d85-fa2c563aa5a5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:38.377460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8945405f-718c-4f80-8d85-fa2c563aa5a5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:38.378427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8945405f-718c-4f80-8d85-fa2c563aa5a5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:38.734475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8945405f-718c-4f80-8d85-fa2c563aa5a5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:38.745965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8945405f-718c-4f80-8d85-fa2c563aa5a5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:38.748897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8945405f-718c-4f80-8d85-fa2c563aa5a5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:38.750662 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8945405f-718c-4f80-8d85-fa2c563aa5a5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.396308 Jul 14 14:56:38.763850 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2626/5269] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:38 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:39.111486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-86f4e19f-ab8f-49a7-92fd-f7d1f9eae5ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:39.112128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-86f4e19f-ab8f-49a7-92fd-f7d1f9eae5ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:39.123998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86f4e19f-ab8f-49a7-92fd-f7d1f9eae5ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:39.127560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86f4e19f-ab8f-49a7-92fd-f7d1f9eae5ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:39.130068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86f4e19f-ab8f-49a7-92fd-f7d1f9eae5ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:39.130749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86f4e19f-ab8f-49a7-92fd-f7d1f9eae5ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:39.287652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d1e1ea17-4918-48c0-8c83-014f53df2020 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:39.292609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d1e1ea17-4918-48c0-8c83-014f53df2020 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:39.316906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1e1ea17-4918-48c0-8c83-014f53df2020 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:39.321201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1e1ea17-4918-48c0-8c83-014f53df2020 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:39.328448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1e1ea17-4918-48c0-8c83-014f53df2020 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:39.329169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d1e1ea17-4918-48c0-8c83-014f53df2020 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:39.541941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d1e1ea17-4918-48c0-8c83-014f53df2020 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:39.556932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-86f4e19f-ab8f-49a7-92fd-f7d1f9eae5ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:39.568857 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-86f4e19f-ab8f-49a7-92fd-f7d1f9eae5ef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.461328 Jul 14 14:56:39.569540 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2644/5270] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:39 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:39.571053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d1e1ea17-4918-48c0-8c83-014f53df2020 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:39.574469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d1e1ea17-4918-48c0-8c83-014f53df2020 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:39.576172 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d1e1ea17-4918-48c0-8c83-014f53df2020 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1357 microversion: 2.57 time: 0.296576 Jul 14 14:56:39.588767 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2627/5271] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:39 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1357 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:39.606065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f9dda18e-bb71-48df-a98f-b94191aa2b6c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:39.606913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f9dda18e-bb71-48df-a98f-b94191aa2b6c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:39.614471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f9dda18e-bb71-48df-a98f-b94191aa2b6c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:39.615190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f9dda18e-bb71-48df-a98f-b94191aa2b6c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:39.616140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f9dda18e-bb71-48df-a98f-b94191aa2b6c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:39.616930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f9dda18e-bb71-48df-a98f-b94191aa2b6c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:39.649319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f9dda18e-bb71-48df-a98f-b94191aa2b6c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:56:39.774155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2471bcb3-2889-47e0-be9f-8fecfb00e2fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:39.775511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2471bcb3-2889-47e0-be9f-8fecfb00e2fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:39.786594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2471bcb3-2889-47e0-be9f-8fecfb00e2fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:39.787588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2471bcb3-2889-47e0-be9f-8fecfb00e2fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:39.789125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2471bcb3-2889-47e0-be9f-8fecfb00e2fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:39.790218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2471bcb3-2889-47e0-be9f-8fecfb00e2fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:39.820100 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f9dda18e-bb71-48df-a98f-b94191aa2b6c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 204 len: 0 microversion: 2.57 time: 0.225843 Jul 14 14:56:39.826128 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2645/5272] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:56:39 2022] DELETE /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:56:39.832065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-40b1c038-40ab-4d48-8344-a1acbf81bcb6 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:39.838017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-40b1c038-40ab-4d48-8344-a1acbf81bcb6 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:39.854645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40b1c038-40ab-4d48-8344-a1acbf81bcb6 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:39.855691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40b1c038-40ab-4d48-8344-a1acbf81bcb6 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:39.856755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40b1c038-40ab-4d48-8344-a1acbf81bcb6 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:39.858553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40b1c038-40ab-4d48-8344-a1acbf81bcb6 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:40.199477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-40b1c038-40ab-4d48-8344-a1acbf81bcb6 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:40.215299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-40b1c038-40ab-4d48-8344-a1acbf81bcb6 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:40.221050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-40b1c038-40ab-4d48-8344-a1acbf81bcb6 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:40.224162 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-40b1c038-40ab-4d48-8344-a1acbf81bcb6 tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1363 microversion: 2.57 time: 0.396383 Jul 14 14:56:40.249997 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2646/5273] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:39 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:40.538012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2471bcb3-2889-47e0-be9f-8fecfb00e2fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:40.550968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2471bcb3-2889-47e0-be9f-8fecfb00e2fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:40.560240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2471bcb3-2889-47e0-be9f-8fecfb00e2fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:40.569442 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2471bcb3-2889-47e0-be9f-8fecfb00e2fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.801851 Jul 14 14:56:40.570716 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2628/5274] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:39 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:40.587929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1dc24533-3ec2-4fb1-9c7e-072343a23c2c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:40.590362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1dc24533-3ec2-4fb1-9c7e-072343a23c2c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:40.600397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1dc24533-3ec2-4fb1-9c7e-072343a23c2c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:40.607017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1dc24533-3ec2-4fb1-9c7e-072343a23c2c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:40.608186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1dc24533-3ec2-4fb1-9c7e-072343a23c2c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:40.609075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1dc24533-3ec2-4fb1-9c7e-072343a23c2c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:40.829660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1dc24533-3ec2-4fb1-9c7e-072343a23c2c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:40.846670 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1dc24533-3ec2-4fb1-9c7e-072343a23c2c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.263344 Jul 14 14:56:40.858242 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2647/5275] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:40 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:41.267993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f3391c89-9465-4855-a21a-2b8c1415fbdb tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:41.276226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f3391c89-9465-4855-a21a-2b8c1415fbdb tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:41.288454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3391c89-9465-4855-a21a-2b8c1415fbdb tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:41.296496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3391c89-9465-4855-a21a-2b8c1415fbdb tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:41.297447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3391c89-9465-4855-a21a-2b8c1415fbdb tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:41.299356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3391c89-9465-4855-a21a-2b8c1415fbdb tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:41.416773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f3391c89-9465-4855-a21a-2b8c1415fbdb tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:41.430227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f3391c89-9465-4855-a21a-2b8c1415fbdb tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:41.431779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f3391c89-9465-4855-a21a-2b8c1415fbdb tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:41.433556 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f3391c89-9465-4855-a21a-2b8c1415fbdb tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1363 microversion: 2.57 time: 0.173117 Jul 14 14:56:41.442355 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2629/5276] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:41 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:41.592787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18f3ea2f-3c25-4d0a-87d0-058e8e42cca5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:41.593742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-18f3ea2f-3c25-4d0a-87d0-058e8e42cca5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:41.615016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18f3ea2f-3c25-4d0a-87d0-058e8e42cca5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:41.616190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18f3ea2f-3c25-4d0a-87d0-058e8e42cca5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:41.617944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18f3ea2f-3c25-4d0a-87d0-058e8e42cca5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:41.618240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18f3ea2f-3c25-4d0a-87d0-058e8e42cca5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:41.865102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-33359b0f-12cf-4398-824f-390e2ab88c81 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:41.865777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-33359b0f-12cf-4398-824f-390e2ab88c81 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:41.875516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33359b0f-12cf-4398-824f-390e2ab88c81 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:41.876486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33359b0f-12cf-4398-824f-390e2ab88c81 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:41.876766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33359b0f-12cf-4398-824f-390e2ab88c81 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:41.877235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33359b0f-12cf-4398-824f-390e2ab88c81 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:41.922944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18f3ea2f-3c25-4d0a-87d0-058e8e42cca5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:41.934675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18f3ea2f-3c25-4d0a-87d0-058e8e42cca5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:41.936477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18f3ea2f-3c25-4d0a-87d0-058e8e42cca5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:41.940054 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-18f3ea2f-3c25-4d0a-87d0-058e8e42cca5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.354947 Jul 14 14:56:41.942153 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2648/5277] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:41 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:42.294092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-33359b0f-12cf-4398-824f-390e2ab88c81 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:42.302244 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-33359b0f-12cf-4398-824f-390e2ab88c81 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.441238 Jul 14 14:56:42.302851 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2630/5278] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:41 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:42.455945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:42.459485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:42.484186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:42.484641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:42.485774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:42.485883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:42.532796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:42.534319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:42.534771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lazy-loading 'fault' on Instance uuid 6a87e663-5f01-4218-8a43-e44c00dc59c0 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:56:42.627953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:42.646441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:42.648538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9259b10b0ae4959aa7b603d6167af17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54fec9f71f842c988f58ac67af674ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:42.650615 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dece7a1e-ecab-41f7-a63c-cd54b39c140a tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 200 len: 1368 microversion: 2.57 time: 0.199875 Jul 14 14:56:42.651635 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2649/5279] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:42 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:42.968881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c025afa8-0acd-4b41-8769-814fd523644b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:42.969585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c025afa8-0acd-4b41-8769-814fd523644b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:42.976731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c025afa8-0acd-4b41-8769-814fd523644b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:42.977266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c025afa8-0acd-4b41-8769-814fd523644b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:42.978100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c025afa8-0acd-4b41-8769-814fd523644b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:42.978550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c025afa8-0acd-4b41-8769-814fd523644b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:43.154954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c025afa8-0acd-4b41-8769-814fd523644b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:43.161316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:43.170878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c025afa8-0acd-4b41-8769-814fd523644b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:43.172391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c025afa8-0acd-4b41-8769-814fd523644b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:43.173795 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c025afa8-0acd-4b41-8769-814fd523644b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.219205 Jul 14 14:56:43.186361 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2631/5280] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:42 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:43.326879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b1cd50c-dd12-4cfe-bd9f-b39c4a13734a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:43.327983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3b1cd50c-dd12-4cfe-bd9f-b39c4a13734a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:43.344037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b1cd50c-dd12-4cfe-bd9f-b39c4a13734a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:43.344991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b1cd50c-dd12-4cfe-bd9f-b39c4a13734a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:43.347387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b1cd50c-dd12-4cfe-bd9f-b39c4a13734a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:43.348277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b1cd50c-dd12-4cfe-bd9f-b39c4a13734a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:43.534122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b1cd50c-dd12-4cfe-bd9f-b39c4a13734a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:43.546631 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b1cd50c-dd12-4cfe-bd9f-b39c4a13734a tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.230592 Jul 14 14:56:43.559936 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2650/5281] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:43 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:43.674285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4005dd71-becb-4e48-ba9f-b845488a465c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:43.676346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4005dd71-becb-4e48-ba9f-b845488a465c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] [instance: 6a87e663-5f01-4218-8a43-e44c00dc59c0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:43.694382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4005dd71-becb-4e48-ba9f-b845488a465c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:43.694988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4005dd71-becb-4e48-ba9f-b845488a465c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:43.697458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4005dd71-becb-4e48-ba9f-b845488a465c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:43.697458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4005dd71-becb-4e48-ba9f-b845488a465c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:43.711832 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-4005dd71-becb-4e48-ba9f-b845488a465c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] HTTP exception thrown: Instance 6a87e663-5f01-4218-8a43-e44c00dc59c0 could not be found. Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4005dd71-becb-4e48-ba9f-b845488a465c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Request method failure captured: Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 HTTP/1.1 Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C5r1xgB-wJ5SQ8Gy0Vi87ylK7eNuJp68oKV8uP91A1F28R-kIbJIbe2OGYy450bsMwCVipEp0KL3uJVm-bXopmWf74cVA9je1hlGS5nr_r-9u048vhpkV9Ta5JUueaJsZbMQhifAUUC73dbry-yrIPn0BV8sex6JwzNRO6dReUoNbw Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.57 Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a54fec9f71f842c988f58ac67af674ed Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerShowV257Test-545778594 Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a54fec9f71f842c988f58ac67af674ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a54fec9f71f842c988f58ac67af674ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a54fec9f71f842c988f58ac67af674ed", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a54fec9f71f842c988f58ac67af674ed"}]}] Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerShowV257Test-545778594 Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a54fec9f71f842c988f58ac67af674ed Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerShowV257Test-545778594 Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerShowV257Test-545778594-project Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: a9259b10b0ae4959aa7b603d6167af17 Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerShowV257Test-545778594-project Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6a87e663-5f01-4218-8a43-e44c00dc59c0 could not be found. Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6a87e663-5f01-4218-8a43-e44c00dc59c0'} Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a87e663-5f01-4218-8a43-e44c00dc59c0 could not be found. Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a87e663-5f01-4218-8a43-e44c00dc59c0 could not be found. Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:43.713775 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:43.719757 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:43.719757 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:43.719757 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:43.719757 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:43.719757 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:43.719757 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a87e663-5f01-4218-8a43-e44c00dc59c0 could not be found. Jul 14 14:56:43.719757 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:43.720931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4005dd71-becb-4e48-ba9f-b845488a465c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] Returning 404 to user: Instance 6a87e663-5f01-4218-8a43-e44c00dc59c0 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:43.722218 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4005dd71-becb-4e48-ba9f-b845488a465c tempest-ServerShowV257Test-545778594 tempest-ServerShowV257Test-545778594-project] 10.222.0.81 "GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0" status: 404 len: 111 microversion: 2.57 time: 0.054521 Jul 14 14:56:43.725865 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2632/5282] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:43 2022] GET /compute/v2.1/servers/6a87e663-5f01-4218-8a43-e44c00dc59c0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:56:44.193883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36372eae-0315-462c-942d-5ae08d45b55c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:44.195327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-36372eae-0315-462c-942d-5ae08d45b55c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:44.208597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36372eae-0315-462c-942d-5ae08d45b55c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:44.209253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36372eae-0315-462c-942d-5ae08d45b55c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:44.210548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36372eae-0315-462c-942d-5ae08d45b55c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:44.213177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36372eae-0315-462c-942d-5ae08d45b55c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:44.566666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-597667af-fb32-48bb-b739-4eb6cde12860 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:44.568103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-597667af-fb32-48bb-b739-4eb6cde12860 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:44.589212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-597667af-fb32-48bb-b739-4eb6cde12860 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:44.590436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-597667af-fb32-48bb-b739-4eb6cde12860 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:44.591241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-597667af-fb32-48bb-b739-4eb6cde12860 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:44.593262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-597667af-fb32-48bb-b739-4eb6cde12860 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:44.605786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-36372eae-0315-462c-942d-5ae08d45b55c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:44.619442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-36372eae-0315-462c-942d-5ae08d45b55c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:44.623741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-36372eae-0315-462c-942d-5ae08d45b55c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:44.630267 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-36372eae-0315-462c-942d-5ae08d45b55c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.440510 Jul 14 14:56:44.645854 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2651/5283] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:44 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:44.897448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-597667af-fb32-48bb-b739-4eb6cde12860 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:44.916655 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-597667af-fb32-48bb-b739-4eb6cde12860 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.353722 Jul 14 14:56:44.919534 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2633/5284] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:44 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:45.652980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-687671b4-56f4-4f60-83df-22baa7d461d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:45.654158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-687671b4-56f4-4f60-83df-22baa7d461d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:45.664029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-687671b4-56f4-4f60-83df-22baa7d461d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:45.664767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-687671b4-56f4-4f60-83df-22baa7d461d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:45.665736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-687671b4-56f4-4f60-83df-22baa7d461d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:45.666319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-687671b4-56f4-4f60-83df-22baa7d461d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:45.939916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-76b017a9-a7b1-4ef3-8e50-3a3ba1a20800 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:45.940477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-76b017a9-a7b1-4ef3-8e50-3a3ba1a20800 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:45.955301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76b017a9-a7b1-4ef3-8e50-3a3ba1a20800 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:45.964868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76b017a9-a7b1-4ef3-8e50-3a3ba1a20800 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:45.974055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76b017a9-a7b1-4ef3-8e50-3a3ba1a20800 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:45.974965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76b017a9-a7b1-4ef3-8e50-3a3ba1a20800 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:45.980048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-687671b4-56f4-4f60-83df-22baa7d461d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:45.993533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-687671b4-56f4-4f60-83df-22baa7d461d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:45.998208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-687671b4-56f4-4f60-83df-22baa7d461d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:45.999749 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-687671b4-56f4-4f60-83df-22baa7d461d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.353181 Jul 14 14:56:46.004633 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2652/5285] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:45 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:46.174556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-76b017a9-a7b1-4ef3-8e50-3a3ba1a20800 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:46.185218 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-76b017a9-a7b1-4ef3-8e50-3a3ba1a20800 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.251112 Jul 14 14:56:46.186786 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2634/5286] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:45 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:46.693279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-687671b4-56f4-4f60-83df-22baa7d461d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:46.695547 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-687671b4-56f4-4f60-83df-22baa7d461d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005095 Jul 14 14:56:46.702728 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2653/5287] 10.222.0.81 () {56 vars in 885 bytes} [Thu Jul 14 14:56:46 2022] GET /compute/ => generated 377 bytes in 17 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 14 14:56:47.028074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac0447bf-b7ca-45af-9ada-0b1a4a6cd4e1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:47.029341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ac0447bf-b7ca-45af-9ada-0b1a4a6cd4e1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:47.040784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac0447bf-b7ca-45af-9ada-0b1a4a6cd4e1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:47.041533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac0447bf-b7ca-45af-9ada-0b1a4a6cd4e1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:47.044560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac0447bf-b7ca-45af-9ada-0b1a4a6cd4e1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:47.046638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac0447bf-b7ca-45af-9ada-0b1a4a6cd4e1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:47.216009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab37cccc-f165-4634-bd70-08a9bb36196b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:47.218439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ab37cccc-f165-4634-bd70-08a9bb36196b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:47.248684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab37cccc-f165-4634-bd70-08a9bb36196b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:47.250499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab37cccc-f165-4634-bd70-08a9bb36196b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:47.252412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab37cccc-f165-4634-bd70-08a9bb36196b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:47.253926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab37cccc-f165-4634-bd70-08a9bb36196b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:47.437593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ac0447bf-b7ca-45af-9ada-0b1a4a6cd4e1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:47.460501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ac0447bf-b7ca-45af-9ada-0b1a4a6cd4e1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:47.462380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ac0447bf-b7ca-45af-9ada-0b1a4a6cd4e1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:47.463595 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ac0447bf-b7ca-45af-9ada-0b1a4a6cd4e1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.440308 Jul 14 14:56:47.464175 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2635/5288] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:47 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:47.580894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab37cccc-f165-4634-bd70-08a9bb36196b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:47.595732 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ab37cccc-f165-4634-bd70-08a9bb36196b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.395171 Jul 14 14:56:47.596537 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2654/5289] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:47 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:48.499216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-118c9b3d-6100-43c5-9040-87c32f4f2491 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:48.500546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-118c9b3d-6100-43c5-9040-87c32f4f2491 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:48.508426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-118c9b3d-6100-43c5-9040-87c32f4f2491 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:48.509228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-118c9b3d-6100-43c5-9040-87c32f4f2491 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:48.510215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-118c9b3d-6100-43c5-9040-87c32f4f2491 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:48.510861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-118c9b3d-6100-43c5-9040-87c32f4f2491 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:48.617752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-09475d75-252c-4a51-a0dc-210a3f79d01b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:48.621700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-09475d75-252c-4a51-a0dc-210a3f79d01b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:48.634371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09475d75-252c-4a51-a0dc-210a3f79d01b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:48.635090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09475d75-252c-4a51-a0dc-210a3f79d01b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:48.636059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09475d75-252c-4a51-a0dc-210a3f79d01b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:48.636720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09475d75-252c-4a51-a0dc-210a3f79d01b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:48.797251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-118c9b3d-6100-43c5-9040-87c32f4f2491 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:48.814721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-118c9b3d-6100-43c5-9040-87c32f4f2491 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:48.822319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-118c9b3d-6100-43c5-9040-87c32f4f2491 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:48.827268 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-118c9b3d-6100-43c5-9040-87c32f4f2491 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.331638 Jul 14 14:56:48.828220 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2636/5290] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:48 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:48.868455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-09475d75-252c-4a51-a0dc-210a3f79d01b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:48.879660 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:56:48.879839 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 14:56:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d (ip 10.222.0.81) !!! Jul 14 14:56:48.924638 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-09475d75-252c-4a51-a0dc-210a3f79d01b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.312741 Jul 14 14:56:48.938069 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2655/5291] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:48 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:49.342264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c341371b-9c3f-4dff-981c-92a161ad9d32 req-651b894b-99ce-43e0-a276-071ac151e047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f554d9f-a901-4284-8c0e-d34d0924e67d", "name": "network-vif-plugged", "status": "completed", "tag": "9af0d9f1-4145-44d0-a287-acb8ff126aa7"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:49.360974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c341371b-9c3f-4dff-981c-92a161ad9d32 req-651b894b-99ce-43e0-a276-071ac151e047 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:49.362892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c341371b-9c3f-4dff-981c-92a161ad9d32 req-651b894b-99ce-43e0-a276-071ac151e047 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:49.378490 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c341371b-9c3f-4dff-981c-92a161ad9d32 req-651b894b-99ce-43e0-a276-071ac151e047 service nova] Creating event network-vif-plugged:9af0d9f1-4145-44d0-a287-acb8ff126aa7 for instance 0f554d9f-a901-4284-8c0e-d34d0924e67d on n-h1-767704-28 Jul 14 14:56:49.385170 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c341371b-9c3f-4dff-981c-92a161ad9d32 req-651b894b-99ce-43e0-a276-071ac151e047 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.360129 Jul 14 14:56:49.387685 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2637/5292] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:49.848395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fd408148-2e0a-430a-8bd6-6ff2090776f3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:49.849149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fd408148-2e0a-430a-8bd6-6ff2090776f3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:49.863840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd408148-2e0a-430a-8bd6-6ff2090776f3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:49.865236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd408148-2e0a-430a-8bd6-6ff2090776f3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:49.866139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd408148-2e0a-430a-8bd6-6ff2090776f3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:49.866587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd408148-2e0a-430a-8bd6-6ff2090776f3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:49.973327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-39a28507-95eb-43aa-9634-3dd530d7b30f tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Action: 'create', calling method: .version_select at 0x7fd6c5c641f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-256356024", "metadata": {"Type": "work"}}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-39a28507-95eb-43aa-9634-3dd530d7b30f tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Request method failure captured: Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 121 Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C6xr192edSMOHBiLDNyKSwLdJYTVKKm8l8J3J0OZxgHiMTPx2OgVoYtlppIlqeg9ITs0LR6U9SsT6u-pxas7PvekQmjJ9RtHbrGwe9CJtEW1HU8DA-iELIdKMhrP7FcJay-n0s6z3--IC8teJkSTshi_Jck4JRoNzPn-YYlyl4Wb4Y Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 653206fdecb74872bf51df5221192e92 Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/653206fdecb74872bf51df5221192e92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/653206fdecb74872bf51df5221192e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_653206fdecb74872bf51df5221192e92", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/653206fdecb74872bf51df5221192e92"}]}] Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 653206fdecb74872bf51df5221192e92 Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-VolumesNegativeTest-1524963192-project Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 3408421aa29c42da8f2f6b155ea0304a Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-VolumesNegativeTest-1524963192-project Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-256356024", "metadata": {"Type": "work"}}} Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-256356024', 'metadata': {'Type': 'work'}}}} Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:56:49.976493 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-39a28507-95eb-43aa-9634-3dd530d7b30f tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-39a28507-95eb-43aa-9634-3dd530d7b30f tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.259057 Jul 14 14:56:49.982200 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2656/5293] 10.222.0.81 () {60 vars in 1155 bytes} [Thu Jul 14 14:56:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 261 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:56:49.986551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c3fa0b36-fe8e-4de2-9b4e-a71053c446cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:49.987120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c3fa0b36-fe8e-4de2-9b4e-a71053c446cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:49.994774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3fa0b36-fe8e-4de2-9b4e-a71053c446cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:49.995230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3fa0b36-fe8e-4de2-9b4e-a71053c446cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:49.996596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3fa0b36-fe8e-4de2-9b4e-a71053c446cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:49.997385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3fa0b36-fe8e-4de2-9b4e-a71053c446cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:50.191962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fd408148-2e0a-430a-8bd6-6ff2090776f3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:50.208723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fd408148-2e0a-430a-8bd6-6ff2090776f3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:50.213938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fd408148-2e0a-430a-8bd6-6ff2090776f3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:50.218801 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fd408148-2e0a-430a-8bd6-6ff2090776f3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.375642 Jul 14 14:56:50.221686 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2638/5294] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:49 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:50.231231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f644461f-6ddb-40a1-8003-a9698100ccd8 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Action: 'create', calling method: .version_select at 0x7fd6c43664c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-35392719", "metadata": {"Type": "work"}}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:50.237758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c3fa0b36-fe8e-4de2-9b4e-a71053c446cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f644461f-6ddb-40a1-8003-a9698100ccd8 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Request method failure captured: Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 118 Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C6xr192edSMOHBiLDNyKSwLdJYTVKKm8l8J3J0OZxgHiMTPx2OgVoYtlppIlqeg9ITs0LR6U9SsT6u-pxas7PvekQmjJ9RtHbrGwe9CJtEW1HU8DA-iELIdKMhrP7FcJay-n0s6z3--IC8teJkSTshi_Jck4JRoNzPn-YYlyl4Wb4Y Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 653206fdecb74872bf51df5221192e92 Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/653206fdecb74872bf51df5221192e92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/653206fdecb74872bf51df5221192e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_653206fdecb74872bf51df5221192e92", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/653206fdecb74872bf51df5221192e92"}]}] Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 653206fdecb74872bf51df5221192e92 Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesNegativeTest-1524963192-project Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 3408421aa29c42da8f2f6b155ea0304a Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesNegativeTest-1524963192-project Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-35392719", "metadata": {"Type": "work"}}} Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-35392719', 'metadata': {'Type': 'work'}}}} Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi '0' Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:56:50.237911 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:56:50.243257 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 14:56:50.243257 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.243257 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.243257 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.243257 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.243257 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:50.243257 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:50.243257 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:56:50.243257 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:56:50.243257 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 14:56:50.243257 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.243257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f644461f-6ddb-40a1-8003-a9698100ccd8 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:50.246142 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f644461f-6ddb-40a1-8003-a9698100ccd8 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020686 Jul 14 14:56:50.247478 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2639/5295] 10.222.0.81 () {60 vars in 1155 bytes} [Thu Jul 14 14:56:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:56:50.256181 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c3fa0b36-fe8e-4de2-9b4e-a71053c446cb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.275860 Jul 14 14:56:50.258189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d95f0e28-380f-405d-8a32-0f383e21e665 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Action: 'create', calling method: .version_select at 0x7fd6c5363a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1517018246", "metadata": {"Type": "work"}}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d95f0e28-380f-405d-8a32-0f383e21e665 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Request method failure captured: Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 119 Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C6xr192edSMOHBiLDNyKSwLdJYTVKKm8l8J3J0OZxgHiMTPx2OgVoYtlppIlqeg9ITs0LR6U9SsT6u-pxas7PvekQmjJ9RtHbrGwe9CJtEW1HU8DA-iELIdKMhrP7FcJay-n0s6z3--IC8teJkSTshi_Jck4JRoNzPn-YYlyl4Wb4Y Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 653206fdecb74872bf51df5221192e92 Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/653206fdecb74872bf51df5221192e92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/653206fdecb74872bf51df5221192e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_653206fdecb74872bf51df5221192e92", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/653206fdecb74872bf51df5221192e92"}]}] Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 653206fdecb74872bf51df5221192e92 Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesNegativeTest-1524963192-project Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 3408421aa29c42da8f2f6b155ea0304a Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesNegativeTest-1524963192-project Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1517018246", "metadata": {"Type": "work"}}} Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1517018246', 'metadata': {'Type': 'work'}}}} Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi '' Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:56:50.261995 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:56:50.266395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 14:56:50.266395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.266395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.266395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.266395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.266395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:50.266395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:50.266395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:56:50.266395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:56:50.266395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 14:56:50.266395 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.268020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d95f0e28-380f-405d-8a32-0f383e21e665 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:50.268465 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2657/5296] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:49 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:50.269529 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d95f0e28-380f-405d-8a32-0f383e21e665 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016608 Jul 14 14:56:50.271215 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2640/5297] 10.222.0.81 () {60 vars in 1155 bytes} [Thu Jul 14 14:56:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:56:50.281421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-435b1f3b-2e4d-4aae-976c-3288d6eeb1d8 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Calling method '.version_select at 0x7fd6c4e67b80>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:50.314909 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-435b1f3b-2e4d-4aae-976c-3288d6eeb1d8 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] HTTP exception thrown: Volume tempest-invalid-21855777 could not be found. Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-435b1f3b-2e4d-4aae-976c-3288d6eeb1d8 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Request method failure captured: Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-21855777 HTTP/1.1 Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C6xr192edSMOHBiLDNyKSwLdJYTVKKm8l8J3J0OZxgHiMTPx2OgVoYtlppIlqeg9ITs0LR6U9SsT6u-pxas7PvekQmjJ9RtHbrGwe9CJtEW1HU8DA-iELIdKMhrP7FcJay-n0s6z3--IC8teJkSTshi_Jck4JRoNzPn-YYlyl4Wb4Y Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 653206fdecb74872bf51df5221192e92 Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/653206fdecb74872bf51df5221192e92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/653206fdecb74872bf51df5221192e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_653206fdecb74872bf51df5221192e92", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/653206fdecb74872bf51df5221192e92"}]}] Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 653206fdecb74872bf51df5221192e92 Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-VolumesNegativeTest-1524963192-project Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 3408421aa29c42da8f2f6b155ea0304a Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-VolumesNegativeTest-1524963192-project Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: exception: Volume tempest-invalid-21855777 could not be found. Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'tempest-invalid-21855777'} Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-21855777 could not be found. (HTTP 404) (Request-ID: req-22db40a1-225e-4439-a79d-a7ba737d303a) Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:56:50.339289 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-21855777 could not be found. Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-21855777 could not be found. Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-21855777 could not be found. Jul 14 14:56:50.344033 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.348910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-435b1f3b-2e4d-4aae-976c-3288d6eeb1d8 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Returning 404 to user: Volume tempest-invalid-21855777 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:50.350254 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-435b1f3b-2e4d-4aae-976c-3288d6eeb1d8 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/tempest-invalid-21855777" status: 404 len: 97 microversion: 2.1 time: 0.074142 Jul 14 14:56:50.351087 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2658/5298] 10.222.0.81 () {58 vars in 1211 bytes} [Thu Jul 14 14:56:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-21855777 => generated 97 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:56:50.364211 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-76c676f7-3a14-4e57-8975-aa51d620140e tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006318 Jul 14 14:56:50.365151 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2641/5299] 10.222.0.81 () {58 vars in 1139 bytes} [Thu Jul 14 14:56:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 14:56:50.376933 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-57a7e46e-9447-4044-8b7d-0b34b45fc0fd tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006577 Jul 14 14:56:50.380682 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2659/5300] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jul 14 14:56:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 14:56:50.391049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d4d7c5e-85c4-40db-814d-cf4bdfc48ed0 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Calling method '.version_select at 0x7fd6c5363280>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:50.427630 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-8d4d7c5e-85c4-40db-814d-cf4bdfc48ed0 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] HTTP exception thrown: Volume 2adf4ca0-76a4-4a0c-8000-1a860c453d07 could not be found. Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d4d7c5e-85c4-40db-814d-cf4bdfc48ed0 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Request method failure captured: Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/os-volumes/2adf4ca0-76a4-4a0c-8000-1a860c453d07 HTTP/1.1 Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C6xr192edSMOHBiLDNyKSwLdJYTVKKm8l8J3J0OZxgHiMTPx2OgVoYtlppIlqeg9ITs0LR6U9SsT6u-pxas7PvekQmjJ9RtHbrGwe9CJtEW1HU8DA-iELIdKMhrP7FcJay-n0s6z3--IC8teJkSTshi_Jck4JRoNzPn-YYlyl4Wb4Y Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 653206fdecb74872bf51df5221192e92 Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/653206fdecb74872bf51df5221192e92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/653206fdecb74872bf51df5221192e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_653206fdecb74872bf51df5221192e92", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/653206fdecb74872bf51df5221192e92"}]}] Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 653206fdecb74872bf51df5221192e92 Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesNegativeTest-1524963192-project Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 3408421aa29c42da8f2f6b155ea0304a Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesNegativeTest-1524963192-project Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: exception: Volume 2adf4ca0-76a4-4a0c-8000-1a860c453d07 could not be found. Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '2adf4ca0-76a4-4a0c-8000-1a860c453d07'} Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2adf4ca0-76a4-4a0c-8000-1a860c453d07 could not be found. (HTTP 404) (Request-ID: req-0cb1be06-a8dd-444a-b9e3-71804754cc4b) Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:56:50.429658 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2adf4ca0-76a4-4a0c-8000-1a860c453d07 could not be found. Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2adf4ca0-76a4-4a0c-8000-1a860c453d07 could not be found. Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2adf4ca0-76a4-4a0c-8000-1a860c453d07 could not be found. Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d4d7c5e-85c4-40db-814d-cf4bdfc48ed0 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Returning 404 to user: Volume 2adf4ca0-76a4-4a0c-8000-1a860c453d07 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8d4d7c5e-85c4-40db-814d-cf4bdfc48ed0 tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/2adf4ca0-76a4-4a0c-8000-1a860c453d07" status: 404 len: 109 microversion: 2.1 time: 0.045382 Jul 14 14:56:50.439089 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2642/5301] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 14:56:50 2022] DELETE /compute/v2.1/os-volumes/2adf4ca0-76a4-4a0c-8000-1a860c453d07 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:50.446767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-99c3d495-80a6-4a45-bafc-949426edc40f tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Calling method '.version_select at 0x7fd6c4f14670>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:50.506818 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-99c3d495-80a6-4a45-bafc-949426edc40f tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] HTTP exception thrown: Volume a3f4849f-92a4-44b5-b752-813ba12724fe could not be found. Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-99c3d495-80a6-4a45-bafc-949426edc40f tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Request method failure captured: Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-volumes/a3f4849f-92a4-44b5-b752-813ba12724fe HTTP/1.1 Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C6xr192edSMOHBiLDNyKSwLdJYTVKKm8l8J3J0OZxgHiMTPx2OgVoYtlppIlqeg9ITs0LR6U9SsT6u-pxas7PvekQmjJ9RtHbrGwe9CJtEW1HU8DA-iELIdKMhrP7FcJay-n0s6z3--IC8teJkSTshi_Jck4JRoNzPn-YYlyl4Wb4Y Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 653206fdecb74872bf51df5221192e92 Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/653206fdecb74872bf51df5221192e92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/653206fdecb74872bf51df5221192e92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_653206fdecb74872bf51df5221192e92", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/653206fdecb74872bf51df5221192e92"}]}] Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 653206fdecb74872bf51df5221192e92 Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-VolumesNegativeTest-1524963192 Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-VolumesNegativeTest-1524963192-project Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 3408421aa29c42da8f2f6b155ea0304a Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-VolumesNegativeTest-1524963192-project Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: exception: Volume a3f4849f-92a4-44b5-b752-813ba12724fe could not be found. Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'a3f4849f-92a4-44b5-b752-813ba12724fe'} Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a3f4849f-92a4-44b5-b752-813ba12724fe could not be found. (HTTP 404) (Request-ID: req-800d8681-9357-402a-bf7b-ff53da9fd1a3) Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:56:50.509559 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a3f4849f-92a4-44b5-b752-813ba12724fe could not be found. Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a3f4849f-92a4-44b5-b752-813ba12724fe could not be found. Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a3f4849f-92a4-44b5-b752-813ba12724fe could not be found. Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-99c3d495-80a6-4a45-bafc-949426edc40f tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] Returning 404 to user: Volume a3f4849f-92a4-44b5-b752-813ba12724fe could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-99c3d495-80a6-4a45-bafc-949426edc40f tempest-VolumesNegativeTest-1524963192 tempest-VolumesNegativeTest-1524963192-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/a3f4849f-92a4-44b5-b752-813ba12724fe" status: 404 len: 109 microversion: 2.1 time: 0.072120 Jul 14 14:56:50.515651 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2660/5302] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 14:56:50 2022] GET /compute/v2.1/os-volumes/a3f4849f-92a4-44b5-b752-813ba12724fe => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:51.241471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-18bab1d8-13c7-4290-9cce-d86c4f743c2d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:51.242683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-18bab1d8-13c7-4290-9cce-d86c4f743c2d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:51.253577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18bab1d8-13c7-4290-9cce-d86c4f743c2d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:51.254812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18bab1d8-13c7-4290-9cce-d86c4f743c2d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:51.256784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18bab1d8-13c7-4290-9cce-d86c4f743c2d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:51.257857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18bab1d8-13c7-4290-9cce-d86c4f743c2d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:51.275795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a0568bc-6849-4acb-b9f1-3f1786b8b698 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:51.276609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0a0568bc-6849-4acb-b9f1-3f1786b8b698 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:51.289694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a0568bc-6849-4acb-b9f1-3f1786b8b698 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:51.290420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a0568bc-6849-4acb-b9f1-3f1786b8b698 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:51.292577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a0568bc-6849-4acb-b9f1-3f1786b8b698 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:51.293706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a0568bc-6849-4acb-b9f1-3f1786b8b698 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:51.642277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-18bab1d8-13c7-4290-9cce-d86c4f743c2d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:51.653463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-18bab1d8-13c7-4290-9cce-d86c4f743c2d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:51.662130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-18bab1d8-13c7-4290-9cce-d86c4f743c2d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:51.663680 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-18bab1d8-13c7-4290-9cce-d86c4f743c2d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.427742 Jul 14 14:56:51.666290 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2643/5303] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:51 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:51.704033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0a0568bc-6849-4acb-b9f1-3f1786b8b698 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:51.755890 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0a0568bc-6849-4acb-b9f1-3f1786b8b698 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.485715 Jul 14 14:56:51.762336 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2661/5304] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:51 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:52.685875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2e547c11-3a1d-44dc-bcd3-225e4f2fc0f1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:52.687123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2e547c11-3a1d-44dc-bcd3-225e4f2fc0f1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:52.703781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e547c11-3a1d-44dc-bcd3-225e4f2fc0f1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:52.704239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e547c11-3a1d-44dc-bcd3-225e4f2fc0f1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:52.705052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e547c11-3a1d-44dc-bcd3-225e4f2fc0f1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:52.705485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e547c11-3a1d-44dc-bcd3-225e4f2fc0f1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:52.779840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3fb0057f-66a4-40d7-b68f-6e19a8094381 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:52.780813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3fb0057f-66a4-40d7-b68f-6e19a8094381 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:52.793385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:52.799513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3fb0057f-66a4-40d7-b68f-6e19a8094381 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:52.800146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3fb0057f-66a4-40d7-b68f-6e19a8094381 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:52.802124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3fb0057f-66a4-40d7-b68f-6e19a8094381 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:52.804046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3fb0057f-66a4-40d7-b68f-6e19a8094381 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:52.879767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:53.251813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2e547c11-3a1d-44dc-bcd3-225e4f2fc0f1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:53.265219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2e547c11-3a1d-44dc-bcd3-225e4f2fc0f1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:53.270772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2e547c11-3a1d-44dc-bcd3-225e4f2fc0f1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:53.275465 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2e547c11-3a1d-44dc-bcd3-225e4f2fc0f1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.594327 Jul 14 14:56:53.289323 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2644/5305] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:52 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:53.368773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3fb0057f-66a4-40d7-b68f-6e19a8094381 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:53.391097 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3fb0057f-66a4-40d7-b68f-6e19a8094381 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1520 microversion: 2.1 time: 0.616080 Jul 14 14:56:53.391705 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2662/5306] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:52 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1520 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:54.308775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-20773475-7fd4-4c95-b8ff-7b59586a6d58 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:54.311014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-20773475-7fd4-4c95-b8ff-7b59586a6d58 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:54.322263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20773475-7fd4-4c95-b8ff-7b59586a6d58 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:54.323086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20773475-7fd4-4c95-b8ff-7b59586a6d58 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:54.325152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20773475-7fd4-4c95-b8ff-7b59586a6d58 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:54.327237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20773475-7fd4-4c95-b8ff-7b59586a6d58 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:54.408342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f42d5c15-14d4-4a05-b743-1e40911b0fec tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:54.408990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f42d5c15-14d4-4a05-b743-1e40911b0fec tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:54.416271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f42d5c15-14d4-4a05-b743-1e40911b0fec tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:54.422272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f42d5c15-14d4-4a05-b743-1e40911b0fec tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:54.423406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f42d5c15-14d4-4a05-b743-1e40911b0fec tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:54.426289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f42d5c15-14d4-4a05-b743-1e40911b0fec tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:54.702303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-20773475-7fd4-4c95-b8ff-7b59586a6d58 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:54.719795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-20773475-7fd4-4c95-b8ff-7b59586a6d58 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:54.721659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-20773475-7fd4-4c95-b8ff-7b59586a6d58 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:54.723048 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-20773475-7fd4-4c95-b8ff-7b59586a6d58 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.427702 Jul 14 14:56:54.725141 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2645/5307] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:54 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:54.786092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f42d5c15-14d4-4a05-b743-1e40911b0fec tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:54.822291 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f42d5c15-14d4-4a05-b743-1e40911b0fec tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.417751 Jul 14 14:56:54.824172 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2663/5308] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:54 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:54.842974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-02b5c367-4c9b-40c4-a85a-5af9418a859c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:54.843616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-02b5c367-4c9b-40c4-a85a-5af9418a859c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:54.864906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02b5c367-4c9b-40c4-a85a-5af9418a859c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:54.867646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02b5c367-4c9b-40c4-a85a-5af9418a859c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:54.870305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02b5c367-4c9b-40c4-a85a-5af9418a859c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:54.872411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02b5c367-4c9b-40c4-a85a-5af9418a859c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:55.039930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-c6e1e569-6ab7-40b6-928e-d1ae271397e1 req-affb72af-7cba-45bb-a53a-cdf34f7c01af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5292ea7-49d5-4a1e-8fee-76a77bf64afa", "name": "network-vif-plugged", "status": "completed", "tag": "93b2a2b3-1bf6-47ff-9851-01934b486943"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:55.053212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c6e1e569-6ab7-40b6-928e-d1ae271397e1 req-affb72af-7cba-45bb-a53a-cdf34f7c01af service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:55.057696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-c6e1e569-6ab7-40b6-928e-d1ae271397e1 req-affb72af-7cba-45bb-a53a-cdf34f7c01af service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:55.081443 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-c6e1e569-6ab7-40b6-928e-d1ae271397e1 req-affb72af-7cba-45bb-a53a-cdf34f7c01af service nova] Creating event network-vif-plugged:93b2a2b3-1bf6-47ff-9851-01934b486943 for instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa on n-h1-767704-28 Jul 14 14:56:55.094426 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-c6e1e569-6ab7-40b6-928e-d1ae271397e1 req-affb72af-7cba-45bb-a53a-cdf34f7c01af service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058919 Jul 14 14:56:55.095040 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2664/5309] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:55.153811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-02b5c367-4c9b-40c4-a85a-5af9418a859c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:55.185093 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-02b5c367-4c9b-40c4-a85a-5af9418a859c tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.345182 Jul 14 14:56:55.209383 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2646/5310] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:54 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:55.216383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6d720978-926a-4d55-9e2b-c35e9dd817d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:55.217713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6d720978-926a-4d55-9e2b-c35e9dd817d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:55.232939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d720978-926a-4d55-9e2b-c35e9dd817d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:55.233434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d720978-926a-4d55-9e2b-c35e9dd817d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:55.236403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d720978-926a-4d55-9e2b-c35e9dd817d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:55.236863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d720978-926a-4d55-9e2b-c35e9dd817d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:55.506750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6d720978-926a-4d55-9e2b-c35e9dd817d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:55.529776 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6d720978-926a-4d55-9e2b-c35e9dd817d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.315455 Jul 14 14:56:55.530428 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2665/5311] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:55 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:55.547893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-54930d6d-1fe5-4cb3-b5c4-1579ca5d92b0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:55.562653 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-54930d6d-1fe5-4cb3-b5c4-1579ca5d92b0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 7c65fa74-72fa-43f9-b4d5-e96bc1db2bdd has no mapping to a cell. Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-54930d6d-1fe5-4cb3-b5c4-1579ca5d92b0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/7c65fa74-72fa-43f9-b4d5-e96bc1db2bdd/action HTTP/1.1 Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 15 Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: {"os-stop": {}} Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 7c65fa74-72fa-43f9-b4d5-e96bc1db2bdd has no mapping to a cell. Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '7c65fa74-72fa-43f9-b4d5-e96bc1db2bdd', 'body': {'os-stop': {}}} Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1410, in _get_instance Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 7c65fa74-72fa-43f9-b4d5-e96bc1db2bdd has no mapping to a cell. Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1443, in _stop_server Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1417, in _get_instance Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:55.575323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c65fa74-72fa-43f9-b4d5-e96bc1db2bdd has no mapping to a cell. Jul 14 14:56:55.580020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:55.580020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:55.580020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:55.580020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:55.580020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:55.580020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:55.580020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:55.580020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:55.580020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c65fa74-72fa-43f9-b4d5-e96bc1db2bdd has no mapping to a cell. Jul 14 14:56:55.580020 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:55.583778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-54930d6d-1fe5-4cb3-b5c4-1579ca5d92b0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 7c65fa74-72fa-43f9-b4d5-e96bc1db2bdd has no mapping to a cell. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:55.585499 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-54930d6d-1fe5-4cb3-b5c4-1579ca5d92b0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/7c65fa74-72fa-43f9-b4d5-e96bc1db2bdd/action" status: 404 len: 117 microversion: 2.1 time: 0.042177 Jul 14 14:56:55.591361 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2647/5312] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:56:55 2022] POST /compute/v2.1/servers/7c65fa74-72fa-43f9-b4d5-e96bc1db2bdd/action => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:55.596367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1eefe62-0ffc-455e-ba1e-70644355bcef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:55.597097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f1eefe62-0ffc-455e-ba1e-70644355bcef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:55.612330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1eefe62-0ffc-455e-ba1e-70644355bcef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:55.612865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1eefe62-0ffc-455e-ba1e-70644355bcef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:55.615648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1eefe62-0ffc-455e-ba1e-70644355bcef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:55.622420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1eefe62-0ffc-455e-ba1e-70644355bcef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:55.743012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f53d8400-5c95-4ba7-8a72-15b16d9b8c6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:55.743592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f53d8400-5c95-4ba7-8a72-15b16d9b8c6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:55.759348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f53d8400-5c95-4ba7-8a72-15b16d9b8c6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:55.762783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f53d8400-5c95-4ba7-8a72-15b16d9b8c6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:55.766162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f53d8400-5c95-4ba7-8a72-15b16d9b8c6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:55.766980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f53d8400-5c95-4ba7-8a72-15b16d9b8c6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:56.120285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f1eefe62-0ffc-455e-ba1e-70644355bcef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:56.136836 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f1eefe62-0ffc-455e-ba1e-70644355bcef tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.542954 Jul 14 14:56:56.149040 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2666/5313] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:55 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:56.161385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6e98a455-fc83-4781-975d-fe7faf020083 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:56.162540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6e98a455-fc83-4781-975d-fe7faf020083 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:56.171297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e98a455-fc83-4781-975d-fe7faf020083 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:56.172131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e98a455-fc83-4781-975d-fe7faf020083 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:56.173130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e98a455-fc83-4781-975d-fe7faf020083 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:56.173730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e98a455-fc83-4781-975d-fe7faf020083 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:56.189796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f53d8400-5c95-4ba7-8a72-15b16d9b8c6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:56.200806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f53d8400-5c95-4ba7-8a72-15b16d9b8c6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:56.206362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f53d8400-5c95-4ba7-8a72-15b16d9b8c6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:56.207867 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f53d8400-5c95-4ba7-8a72-15b16d9b8c6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.469275 Jul 14 14:56:56.220167 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2648/5314] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:55 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:56.358755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6e98a455-fc83-4781-975d-fe7faf020083 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:56.370355 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6e98a455-fc83-4781-975d-fe7faf020083 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.215079 Jul 14 14:56:56.383954 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2667/5315] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:56 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:56.390087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e6331e2-60f5-4ae7-bc84-8e0d5b7a9d4f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:56.390707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4e6331e2-60f5-4ae7-bc84-8e0d5b7a9d4f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: afae31b5-7f32-4f0d-add9-b9fe51eabb3e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:56.402909 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-4e6331e2-60f5-4ae7-bc84-8e0d5b7a9d4f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance afae31b5-7f32-4f0d-add9-b9fe51eabb3e could not be found. Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e6331e2-60f5-4ae7-bc84-8e0d5b7a9d4f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/afae31b5-7f32-4f0d-add9-b9fe51eabb3e/action HTTP/1.1 Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 15 Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: {"suspend": {}} Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance afae31b5-7f32-4f0d-add9-b9fe51eabb3e could not be found. Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'afae31b5-7f32-4f0d-add9-b9fe51eabb3e', 'body': {'suspend': {}}} Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afae31b5-7f32-4f0d-add9-b9fe51eabb3e could not be found. Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afae31b5-7f32-4f0d-add9-b9fe51eabb3e could not be found. Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:56.407341 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:56.412379 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:56.412379 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:56.412379 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afae31b5-7f32-4f0d-add9-b9fe51eabb3e could not be found. Jul 14 14:56:56.412379 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:56:56.416071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e6331e2-60f5-4ae7-bc84-8e0d5b7a9d4f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance afae31b5-7f32-4f0d-add9-b9fe51eabb3e could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:56.418491 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e6331e2-60f5-4ae7-bc84-8e0d5b7a9d4f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/afae31b5-7f32-4f0d-add9-b9fe51eabb3e/action" status: 404 len: 111 microversion: 2.1 time: 0.033697 Jul 14 14:56:56.422546 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2649/5316] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:56:56 2022] POST /compute/v2.1/servers/afae31b5-7f32-4f0d-add9-b9fe51eabb3e/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:56.430317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4aa8214c-e113-44e8-9ae9-d2f2f7f7a06e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:56.431118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4aa8214c-e113-44e8-9ae9-d2f2f7f7a06e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:56.459642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aa8214c-e113-44e8-9ae9-d2f2f7f7a06e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:56.463811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aa8214c-e113-44e8-9ae9-d2f2f7f7a06e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:56.468478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aa8214c-e113-44e8-9ae9-d2f2f7f7a06e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:56.472442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aa8214c-e113-44e8-9ae9-d2f2f7f7a06e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:56.778363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4aa8214c-e113-44e8-9ae9-d2f2f7f7a06e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:56.799207 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4aa8214c-e113-44e8-9ae9-d2f2f7f7a06e tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.370931 Jul 14 14:56:56.809328 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2668/5317] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:56 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:56.816932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f4fd0e81-767c-4073-a8a4-7eba8f1ddcac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:56.818188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f4fd0e81-767c-4073-a8a4-7eba8f1ddcac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:56.840055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4fd0e81-767c-4073-a8a4-7eba8f1ddcac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:56.842594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4fd0e81-767c-4073-a8a4-7eba8f1ddcac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:56.843647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4fd0e81-767c-4073-a8a4-7eba8f1ddcac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:56.844494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4fd0e81-767c-4073-a8a4-7eba8f1ddcac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:57.228909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eaa4f80d-65e4-4fcd-9f95-4d604cddd8c4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:57.229766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eaa4f80d-65e4-4fcd-9f95-4d604cddd8c4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:57.243079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eaa4f80d-65e4-4fcd-9f95-4d604cddd8c4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:57.246689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eaa4f80d-65e4-4fcd-9f95-4d604cddd8c4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:57.251764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eaa4f80d-65e4-4fcd-9f95-4d604cddd8c4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:57.253620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eaa4f80d-65e4-4fcd-9f95-4d604cddd8c4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:57.298024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f4fd0e81-767c-4073-a8a4-7eba8f1ddcac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:57.310250 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f4fd0e81-767c-4073-a8a4-7eba8f1ddcac tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.496900 Jul 14 14:56:57.311262 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2650/5318] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:56 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:57.333096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3e52c3ec-222e-4d68-bd83-da1807279540 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:57.341201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3e52c3ec-222e-4d68-bd83-da1807279540 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:57.360633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3e52c3ec-222e-4d68-bd83-da1807279540 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:57.373143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3e52c3ec-222e-4d68-bd83-da1807279540 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:57.375741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3e52c3ec-222e-4d68-bd83-da1807279540 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:57.377419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3e52c3ec-222e-4d68-bd83-da1807279540 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:57.447239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-3e52c3ec-222e-4d68-bd83-da1807279540 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lazy-loading 'flavor' on Instance uuid 0f554d9f-a901-4284-8c0e-d34d0924e67d {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:56:57.563838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eaa4f80d-65e4-4fcd-9f95-4d604cddd8c4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:57.584063 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3e52c3ec-222e-4d68-bd83-da1807279540 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 202 len: 0 microversion: 2.1 time: 0.241057 Jul 14 14:56:57.585493 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2651/5319] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:56:57 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:56:57.598922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8914b4d8-e17a-4528-90f4-485bf1f93809 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:57.600144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8914b4d8-e17a-4528-90f4-485bf1f93809 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:57.600777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eaa4f80d-65e4-4fcd-9f95-4d604cddd8c4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:57.617800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eaa4f80d-65e4-4fcd-9f95-4d604cddd8c4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:57.623433 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eaa4f80d-65e4-4fcd-9f95-4d604cddd8c4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.397427 Jul 14 14:56:57.625449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8914b4d8-e17a-4528-90f4-485bf1f93809 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:57.626157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8914b4d8-e17a-4528-90f4-485bf1f93809 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:57.626942 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2669/5320] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:57 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:57.627597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8914b4d8-e17a-4528-90f4-485bf1f93809 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:57.628640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8914b4d8-e17a-4528-90f4-485bf1f93809 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:57.865210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8914b4d8-e17a-4528-90f4-485bf1f93809 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:57.877960 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8914b4d8-e17a-4528-90f4-485bf1f93809 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1515 microversion: 2.1 time: 0.286845 Jul 14 14:56:57.879117 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2652/5321] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:57 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1515 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:58.646705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ba04d285-603f-4fd0-90d4-a1d9ba5d238b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:58.647305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ba04d285-603f-4fd0-90d4-a1d9ba5d238b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:58.669179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba04d285-603f-4fd0-90d4-a1d9ba5d238b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:58.673558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba04d285-603f-4fd0-90d4-a1d9ba5d238b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:58.674924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba04d285-603f-4fd0-90d4-a1d9ba5d238b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:58.675752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba04d285-603f-4fd0-90d4-a1d9ba5d238b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:58.895750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9d53afba-3a26-49c9-80a0-b390e09720bb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:58.896531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9d53afba-3a26-49c9-80a0-b390e09720bb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:58.911774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d53afba-3a26-49c9-80a0-b390e09720bb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:58.913776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d53afba-3a26-49c9-80a0-b390e09720bb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:58.914758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d53afba-3a26-49c9-80a0-b390e09720bb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:58.915206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d53afba-3a26-49c9-80a0-b390e09720bb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:59.048177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba04d285-603f-4fd0-90d4-a1d9ba5d238b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:59.072155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba04d285-603f-4fd0-90d4-a1d9ba5d238b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:59.077165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ba04d285-603f-4fd0-90d4-a1d9ba5d238b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:59.079673 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ba04d285-603f-4fd0-90d4-a1d9ba5d238b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1807 microversion: 2.20 time: 0.439781 Jul 14 14:56:59.095060 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2670/5322] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:58 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1807 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:59.272192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9d53afba-3a26-49c9-80a0-b390e09720bb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:59.282518 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9d53afba-3a26-49c9-80a0-b390e09720bb tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1498 microversion: 2.1 time: 0.390431 Jul 14 14:56:59.283645 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2653/5323] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:58 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1498 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:59.301311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d1c66346-46a3-4c9f-9fda-a7f5c8a38c72 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:59.302019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d1c66346-46a3-4c9f-9fda-a7f5c8a38c72 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:59.312790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1c66346-46a3-4c9f-9fda-a7f5c8a38c72 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:59.314195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1c66346-46a3-4c9f-9fda-a7f5c8a38c72 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:59.315021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1c66346-46a3-4c9f-9fda-a7f5c8a38c72 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:59.315464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d1c66346-46a3-4c9f-9fda-a7f5c8a38c72 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:59.354237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-d1c66346-46a3-4c9f-9fda-a7f5c8a38c72 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lazy-loading 'flavor' on Instance uuid 0f554d9f-a901-4284-8c0e-d34d0924e67d {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:56:59.388480 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-d1c66346-46a3-4c9f-9fda-a7f5c8a38c72 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Cannot 'suspend' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state suspended Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d1c66346-46a3-4c9f-9fda-a7f5c8a38c72 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action HTTP/1.1 Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 15 Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: {"suspend": {}} Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: exception: Cannot 'suspend' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state suspended Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '0f554d9f-a901-4284-8c0e-d34d0924e67d', 'body': {'suspend': {}}} Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d in vm_state suspended. Cannot suspend while the instance is in this state. Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 14 14:56:59.391183 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state suspended Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state suspended Jul 14 14:56:59.396093 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:56:59.399401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d1c66346-46a3-4c9f-9fda-a7f5c8a38c72 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 409 to user: Cannot 'suspend' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state suspended {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:59.400515 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d1c66346-46a3-4c9f-9fda-a7f5c8a38c72 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 409 len: 148 microversion: 2.1 time: 0.103730 Jul 14 14:56:59.401365 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2671/5324] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:56:59 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 148 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:56:59.410453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-65a2b4d4-8e0d-4e47-9f60-fd676b8739a2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:59.411187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-65a2b4d4-8e0d-4e47-9f60-fd676b8739a2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:59.421843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-65a2b4d4-8e0d-4e47-9f60-fd676b8739a2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:59.422234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-65a2b4d4-8e0d-4e47-9f60-fd676b8739a2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:59.425902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-65a2b4d4-8e0d-4e47-9f60-fd676b8739a2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:59.426414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-65a2b4d4-8e0d-4e47-9f60-fd676b8739a2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:59.432523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:59.532803 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-65a2b4d4-8e0d-4e47-9f60-fd676b8739a2 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 202 len: 0 microversion: 2.1 time: 0.123289 Jul 14 14:56:59.534992 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2654/5325] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:56:59 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:56:59.547469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-775ca8f3-6599-4823-8847-9b46dd154570 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:59.548268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-775ca8f3-6599-4823-8847-9b46dd154570 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:59.591394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-775ca8f3-6599-4823-8847-9b46dd154570 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:59.594351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-775ca8f3-6599-4823-8847-9b46dd154570 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:59.595747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-775ca8f3-6599-4823-8847-9b46dd154570 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:59.598499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-775ca8f3-6599-4823-8847-9b46dd154570 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:59.845386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-775ca8f3-6599-4823-8847-9b46dd154570 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:59.855335 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-775ca8f3-6599-4823-8847-9b46dd154570 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1504 microversion: 2.1 time: 0.316491 Jul 14 14:56:59.857614 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2672/5326] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:59 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:00.102681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-13e8fe50-c6e5-4218-9321-640e2f9a0a3f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:00.103378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-13e8fe50-c6e5-4218-9321-640e2f9a0a3f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:00.142067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13e8fe50-c6e5-4218-9321-640e2f9a0a3f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:00.142782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13e8fe50-c6e5-4218-9321-640e2f9a0a3f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:00.143756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13e8fe50-c6e5-4218-9321-640e2f9a0a3f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:00.146591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13e8fe50-c6e5-4218-9321-640e2f9a0a3f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:00.365149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-13e8fe50-c6e5-4218-9321-640e2f9a0a3f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:00.375180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-13e8fe50-c6e5-4218-9321-640e2f9a0a3f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:00.377242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-13e8fe50-c6e5-4218-9321-640e2f9a0a3f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:00.378942 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-13e8fe50-c6e5-4218-9321-640e2f9a0a3f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1794 microversion: 2.20 time: 0.282330 Jul 14 14:57:00.380005 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2655/5327] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:00 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1794 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:00.874970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-68561ced-a8a7-4474-bf8c-56a15e3fb646 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:00.876179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-68561ced-a8a7-4474-bf8c-56a15e3fb646 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:00.893665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68561ced-a8a7-4474-bf8c-56a15e3fb646 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:00.894126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68561ced-a8a7-4474-bf8c-56a15e3fb646 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:00.895653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68561ced-a8a7-4474-bf8c-56a15e3fb646 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:00.896126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68561ced-a8a7-4474-bf8c-56a15e3fb646 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:01.189932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-68561ced-a8a7-4474-bf8c-56a15e3fb646 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:01.212688 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-68561ced-a8a7-4474-bf8c-56a15e3fb646 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1504 microversion: 2.1 time: 0.341058 Jul 14 14:57:01.226216 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2673/5328] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:00 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:02.238974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a8b0ddff-f8a0-4f24-90aa-78faf02a4c7b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:02.239657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a8b0ddff-f8a0-4f24-90aa-78faf02a4c7b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:02.266988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8b0ddff-f8a0-4f24-90aa-78faf02a4c7b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:02.267669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8b0ddff-f8a0-4f24-90aa-78faf02a4c7b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:02.270344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8b0ddff-f8a0-4f24-90aa-78faf02a4c7b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:02.270962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8b0ddff-f8a0-4f24-90aa-78faf02a4c7b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:02.587838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a8b0ddff-f8a0-4f24-90aa-78faf02a4c7b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:02.596234 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a8b0ddff-f8a0-4f24-90aa-78faf02a4c7b tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.366755 Jul 14 14:57:02.596833 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2656/5329] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:02 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:02.616355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a279113d-cfe6-4dcc-9063-5c91984b2278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:02.617702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a279113d-cfe6-4dcc-9063-5c91984b2278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:02.627988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a279113d-cfe6-4dcc-9063-5c91984b2278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:02.628500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a279113d-cfe6-4dcc-9063-5c91984b2278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:02.629394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a279113d-cfe6-4dcc-9063-5c91984b2278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:02.630838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a279113d-cfe6-4dcc-9063-5c91984b2278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:02.870373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a279113d-cfe6-4dcc-9063-5c91984b2278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:02.881528 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a279113d-cfe6-4dcc-9063-5c91984b2278 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.269094 Jul 14 14:57:02.882416 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2674/5330] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:02 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:02.909032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2f691474-f1de-4575-82ac-293f041b9cbc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:02.909780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2f691474-f1de-4575-82ac-293f041b9cbc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 608e5121-c634-402e-b1b5-e1aaa4c927b4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:02.920000 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-2f691474-f1de-4575-82ac-293f041b9cbc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 608e5121-c634-402e-b1b5-e1aaa4c927b4 could not be found. Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2f691474-f1de-4575-82ac-293f041b9cbc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/608e5121-c634-402e-b1b5-e1aaa4c927b4/action HTTP/1.1 Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 15 Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: {"unpause": {}} Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 608e5121-c634-402e-b1b5-e1aaa4c927b4 could not be found. Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '608e5121-c634-402e-b1b5-e1aaa4c927b4', 'body': {'unpause': {}}} Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608e5121-c634-402e-b1b5-e1aaa4c927b4 could not be found. Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608e5121-c634-402e-b1b5-e1aaa4c927b4 could not be found. Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:02.922484 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:02.927837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:57:02.927837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:57:02.927837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608e5121-c634-402e-b1b5-e1aaa4c927b4 could not be found. Jul 14 14:57:02.927837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:02.927837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2f691474-f1de-4575-82ac-293f041b9cbc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 608e5121-c634-402e-b1b5-e1aaa4c927b4 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:57:02.927837 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2f691474-f1de-4575-82ac-293f041b9cbc tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/608e5121-c634-402e-b1b5-e1aaa4c927b4/action" status: 404 len: 111 microversion: 2.1 time: 0.028904 Jul 14 14:57:02.927837 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2657/5331] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:57:02 2022] POST /compute/v2.1/servers/608e5121-c634-402e-b1b5-e1aaa4c927b4/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:57:02.936103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8d891ec-82bb-432a-b976-e350d656bea7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:02.936995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8d891ec-82bb-432a-b976-e350d656bea7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:02.945043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8d891ec-82bb-432a-b976-e350d656bea7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:02.945618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8d891ec-82bb-432a-b976-e350d656bea7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:02.946618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8d891ec-82bb-432a-b976-e350d656bea7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:02.947307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8d891ec-82bb-432a-b976-e350d656bea7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:03.132703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d8d891ec-82bb-432a-b976-e350d656bea7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:03.140477 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8d891ec-82bb-432a-b976-e350d656bea7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.209471 Jul 14 14:57:03.141314 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2675/5332] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:02 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:03.158607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5000fe8b-3f90-4145-9139-c949e83a48d5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:03.159448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5000fe8b-3f90-4145-9139-c949e83a48d5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:03.167272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5000fe8b-3f90-4145-9139-c949e83a48d5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:03.168732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5000fe8b-3f90-4145-9139-c949e83a48d5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:03.169944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5000fe8b-3f90-4145-9139-c949e83a48d5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:03.170845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5000fe8b-3f90-4145-9139-c949e83a48d5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:03.341775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5000fe8b-3f90-4145-9139-c949e83a48d5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:03.354580 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5000fe8b-3f90-4145-9139-c949e83a48d5 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.199154 Jul 14 14:57:03.356152 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2658/5333] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:03 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:03.380350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-939ce82e-73b1-4fce-b5a6-6578f62e5f75 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:03.383267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-939ce82e-73b1-4fce-b5a6-6578f62e5f75 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:03.392098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-939ce82e-73b1-4fce-b5a6-6578f62e5f75 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:03.392968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-939ce82e-73b1-4fce-b5a6-6578f62e5f75 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:03.394093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-939ce82e-73b1-4fce-b5a6-6578f62e5f75 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:03.395001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-939ce82e-73b1-4fce-b5a6-6578f62e5f75 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:03.452302 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-939ce82e-73b1-4fce-b5a6-6578f62e5f75 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Cannot 'unpause' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-939ce82e-73b1-4fce-b5a6-6578f62e5f75 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action HTTP/1.1 Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 15 Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: {"unpause": {}} Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: exception: Cannot 'unpause' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '0f554d9f-a901-4284-8c0e-d34d0924e67d', 'body': {'unpause': {}}} Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d in vm_state active. Cannot unpause while the instance is in this state. Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:03.456090 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:03.460190 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:03.460190 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:57:03.460190 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:57:03.460190 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:57:03.460190 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:03.474254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-939ce82e-73b1-4fce-b5a6-6578f62e5f75 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 409 to user: Cannot 'unpause' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:57:03.477723 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-939ce82e-73b1-4fce-b5a6-6578f62e5f75 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 409 len: 145 microversion: 2.1 time: 0.104950 Jul 14 14:57:03.479062 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2676/5334] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:57:03 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 145 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:57:03.499173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-06124187-7519-4b3d-91e5-1c350c9541d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:03.500154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-06124187-7519-4b3d-91e5-1c350c9541d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:03.517645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06124187-7519-4b3d-91e5-1c350c9541d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:03.518507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06124187-7519-4b3d-91e5-1c350c9541d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:03.520462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06124187-7519-4b3d-91e5-1c350c9541d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:03.521453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06124187-7519-4b3d-91e5-1c350c9541d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:03.771838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-06124187-7519-4b3d-91e5-1c350c9541d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:03.788768 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-06124187-7519-4b3d-91e5-1c350c9541d3 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.303137 Jul 14 14:57:03.791726 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2659/5335] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:03 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:03.812551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-653df03a-e11a-42c1-9b8c-fcb3d3ae4cd0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:03.815811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-653df03a-e11a-42c1-9b8c-fcb3d3ae4cd0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:03.836277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-653df03a-e11a-42c1-9b8c-fcb3d3ae4cd0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:03.837063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-653df03a-e11a-42c1-9b8c-fcb3d3ae4cd0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:03.838761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-653df03a-e11a-42c1-9b8c-fcb3d3ae4cd0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:03.840922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-653df03a-e11a-42c1-9b8c-fcb3d3ae4cd0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:04.094753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-653df03a-e11a-42c1-9b8c-fcb3d3ae4cd0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:04.106133 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-653df03a-e11a-42c1-9b8c-fcb3d3ae4cd0 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.299906 Jul 14 14:57:04.106779 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2677/5336] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:03 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:04.123988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5ec0a3e0-221f-4ecc-bff1-4e4d381ed73f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:04.124568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5ec0a3e0-221f-4ecc-bff1-4e4d381ed73f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 7de714b7-50cd-4505-b25f-bdc1104719b1] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:04.133734 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-5ec0a3e0-221f-4ecc-bff1-4e4d381ed73f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 7de714b7-50cd-4505-b25f-bdc1104719b1 could not be found. Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5ec0a3e0-221f-4ecc-bff1-4e4d381ed73f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/7de714b7-50cd-4505-b25f-bdc1104719b1/action HTTP/1.1 Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 18 Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: {"unshelve": null} Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 7de714b7-50cd-4505-b25f-bdc1104719b1 could not be found. Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '7de714b7-50cd-4505-b25f-bdc1104719b1', 'body': {'unshelve': None}} Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de714b7-50cd-4505-b25f-bdc1104719b1 could not be found. Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de714b7-50cd-4505-b25f-bdc1104719b1 could not be found. Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:04.139996 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:04.144720 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:04.144720 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:57:04.144720 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:57:04.144720 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de714b7-50cd-4505-b25f-bdc1104719b1 could not be found. Jul 14 14:57:04.144720 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:04.147554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5ec0a3e0-221f-4ecc-bff1-4e4d381ed73f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 7de714b7-50cd-4505-b25f-bdc1104719b1 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:57:04.148625 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5ec0a3e0-221f-4ecc-bff1-4e4d381ed73f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/7de714b7-50cd-4505-b25f-bdc1104719b1/action" status: 404 len: 111 microversion: 2.1 time: 0.029678 Jul 14 14:57:04.149980 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2660/5337] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:57:04 2022] POST /compute/v2.1/servers/7de714b7-50cd-4505-b25f-bdc1104719b1/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:57:04.162116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-de239911-94e3-452e-b9f5-c30000e84655 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:04.163306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-de239911-94e3-452e-b9f5-c30000e84655 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:04.173022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de239911-94e3-452e-b9f5-c30000e84655 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:04.173607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de239911-94e3-452e-b9f5-c30000e84655 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:04.174821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de239911-94e3-452e-b9f5-c30000e84655 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:04.179941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de239911-94e3-452e-b9f5-c30000e84655 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:04.479370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-de239911-94e3-452e-b9f5-c30000e84655 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:04.490730 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-de239911-94e3-452e-b9f5-c30000e84655 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.333295 Jul 14 14:57:04.499960 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2678/5338] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:04 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:04.509235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4695435f-c23f-43fa-b85d-23036a40be30 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:04.510143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4695435f-c23f-43fa-b85d-23036a40be30 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:04.519881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4695435f-c23f-43fa-b85d-23036a40be30 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:04.520599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4695435f-c23f-43fa-b85d-23036a40be30 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:04.522199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4695435f-c23f-43fa-b85d-23036a40be30 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:04.523337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4695435f-c23f-43fa-b85d-23036a40be30 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:04.734847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4695435f-c23f-43fa-b85d-23036a40be30 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:04.753411 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4695435f-c23f-43fa-b85d-23036a40be30 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.247791 Jul 14 14:57:04.766311 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2661/5339] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:04 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:04.771304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d80bccfd-4940-442e-b9c3-8d80aa60a8d8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:04.772115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d80bccfd-4940-442e-b9c3-8d80aa60a8d8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:04.781037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d80bccfd-4940-442e-b9c3-8d80aa60a8d8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:04.784128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d80bccfd-4940-442e-b9c3-8d80aa60a8d8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:04.789547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d80bccfd-4940-442e-b9c3-8d80aa60a8d8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:04.790330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d80bccfd-4940-442e-b9c3-8d80aa60a8d8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:04.867038 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-d80bccfd-4940-442e-b9c3-8d80aa60a8d8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Cannot 'unshelve' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d80bccfd-4940-442e-b9c3-8d80aa60a8d8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action HTTP/1.1 Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 18 Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: {"unshelve": null} Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: exception: Cannot 'unshelve' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '0f554d9f-a901-4284-8c0e-d34d0924e67d', 'body': {'unshelve': None}} Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d in vm_state active. Cannot unshelve while the instance is in this state. Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:57:04.870031 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:04.878757 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:04.878757 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:04.878757 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:04.878757 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:04.878757 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:04.878757 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:57:04.878757 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:57:04.878757 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active Jul 14 14:57:04.878757 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:04.878757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d80bccfd-4940-442e-b9c3-8d80aa60a8d8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 409 to user: Cannot 'unshelve' instance 0f554d9f-a901-4284-8c0e-d34d0924e67d while it is in vm_state active {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:57:04.878757 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d80bccfd-4940-442e-b9c3-8d80aa60a8d8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action" status: 409 len: 146 microversion: 2.1 time: 0.106321 Jul 14 14:57:04.878757 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2679/5340] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:57:04 2022] POST /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d/action => generated 146 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:57:04.888663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-28483fda-3a4f-4232-8489-342332cd2602 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:04.892595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-28483fda-3a4f-4232-8489-342332cd2602 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:04.899354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28483fda-3a4f-4232-8489-342332cd2602 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:04.899949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28483fda-3a4f-4232-8489-342332cd2602 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:04.900816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28483fda-3a4f-4232-8489-342332cd2602 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:04.901389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28483fda-3a4f-4232-8489-342332cd2602 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:05.092562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-28483fda-3a4f-4232-8489-342332cd2602 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:05.101128 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-28483fda-3a4f-4232-8489-342332cd2602 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.220541 Jul 14 14:57:05.102171 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2662/5341] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:04 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:05.120569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e3fd2f39-99a0-4a2b-8cda-aacccc0c7ab1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:05.122244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e3fd2f39-99a0-4a2b-8cda-aacccc0c7ab1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:05.130498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3fd2f39-99a0-4a2b-8cda-aacccc0c7ab1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:05.131489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3fd2f39-99a0-4a2b-8cda-aacccc0c7ab1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:05.132603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3fd2f39-99a0-4a2b-8cda-aacccc0c7ab1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:05.133385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3fd2f39-99a0-4a2b-8cda-aacccc0c7ab1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:05.158255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:05.316259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e3fd2f39-99a0-4a2b-8cda-aacccc0c7ab1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:05.326543 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e3fd2f39-99a0-4a2b-8cda-aacccc0c7ab1 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.210718 Jul 14 14:57:05.328989 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2680/5342] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:05 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:05.343715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-37397199-4ce4-44ec-9114-0d91b0e7ddd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-773185286_updated"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:05.344987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-37397199-4ce4-44ec-9114-0d91b0e7ddd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 28182b9c-e8e3-4c97-a233-e84bb83936a7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:05.351701 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-37397199-4ce4-44ec-9114-0d91b0e7ddd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 28182b9c-e8e3-4c97-a233-e84bb83936a7 could not be found. Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-37397199-4ce4-44ec-9114-0d91b0e7ddd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: request: PUT /compute/v2.1/servers/28182b9c-e8e3-4c97-a233-e84bb83936a7 HTTP/1.1 Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 80 Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-773185286_updated"}} Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 28182b9c-e8e3-4c97-a233-e84bb83936a7 could not be found. Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '28182b9c-e8e3-4c97-a233-e84bb83936a7', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-773185286_updated'}}} Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28182b9c-e8e3-4c97-a233-e84bb83936a7 could not be found. Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 917, in update Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 14 14:57:05.354537 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28182b9c-e8e3-4c97-a233-e84bb83936a7 could not be found. Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28182b9c-e8e3-4c97-a233-e84bb83936a7 could not be found. Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-37397199-4ce4-44ec-9114-0d91b0e7ddd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 28182b9c-e8e3-4c97-a233-e84bb83936a7 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-37397199-4ce4-44ec-9114-0d91b0e7ddd8 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "PUT /compute/v2.1/servers/28182b9c-e8e3-4c97-a233-e84bb83936a7" status: 404 len: 111 microversion: 2.1 time: 0.016766 Jul 14 14:57:05.363631 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2663/5343] 10.222.0.81 () {60 vars in 1255 bytes} [Thu Jul 14 14:57:05 2022] PUT /compute/v2.1/servers/28182b9c-e8e3-4c97-a233-e84bb83936a7 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:57:05.367651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c5164a8e-67ae-4660-a72d-fcb7f065c16f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:05.368336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c5164a8e-67ae-4660-a72d-fcb7f065c16f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:05.375777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5164a8e-67ae-4660-a72d-fcb7f065c16f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:05.376227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5164a8e-67ae-4660-a72d-fcb7f065c16f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:05.377027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5164a8e-67ae-4660-a72d-fcb7f065c16f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:05.377639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5164a8e-67ae-4660-a72d-fcb7f065c16f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:05.580780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c5164a8e-67ae-4660-a72d-fcb7f065c16f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:05.589208 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c5164a8e-67ae-4660-a72d-fcb7f065c16f tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.227208 Jul 14 14:57:05.606407 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2681/5344] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:05 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:05.609613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-36584165-4fb9-4913-87e1-7fe39efbf248 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:05.610234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-36584165-4fb9-4913-87e1-7fe39efbf248 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:05.614595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=74 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:05.623803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36584165-4fb9-4913-87e1-7fe39efbf248 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:05.624248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36584165-4fb9-4913-87e1-7fe39efbf248 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:05.625130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36584165-4fb9-4913-87e1-7fe39efbf248 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:05.625589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36584165-4fb9-4913-87e1-7fe39efbf248 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:06.335031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-36584165-4fb9-4913-87e1-7fe39efbf248 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:06.343282 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-36584165-4fb9-4913-87e1-7fe39efbf248 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.738320 Jul 14 14:57:06.343861 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2664/5345] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:05 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:06.360857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-814b2d0c-d9fa-4ec7-9253-d452107ed141 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-814b2d0c-d9fa-4ec7-9253-d452107ed141 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: request: PUT /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d HTTP/1.1 Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 280 Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '0f554d9f-a901-4284-8c0e-d34d0924e67d', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.363275 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-814b2d0c-d9fa-4ec7-9253-d452107ed141 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-814b2d0c-d9fa-4ec7-9253-d452107ed141 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "PUT /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 400 len: 619 microversion: 2.1 time: 0.008117 Jul 14 14:57:06.367256 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2682/5346] 10.222.0.81 () {60 vars in 1256 bytes} [Thu Jul 14 14:57:06 2022] PUT /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:57:06.375345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6f6da063-c88f-4f4c-9180-54dc15180767 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:06.375549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6f6da063-c88f-4f4c-9180-54dc15180767 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:06.381568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f6da063-c88f-4f4c-9180-54dc15180767 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:06.382021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f6da063-c88f-4f4c-9180-54dc15180767 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:06.382790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f6da063-c88f-4f4c-9180-54dc15180767 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:06.383411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f6da063-c88f-4f4c-9180-54dc15180767 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:06.539078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6f6da063-c88f-4f4c-9180-54dc15180767 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:06.545356 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6f6da063-c88f-4f4c-9180-54dc15180767 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.175744 Jul 14 14:57:06.546014 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2665/5347] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:06 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:06.564811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a858ca9-2a9d-4af4-b6c8-18c279fed0e7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:06.565594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0a858ca9-2a9d-4af4-b6c8-18c279fed0e7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:06.574492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a858ca9-2a9d-4af4-b6c8-18c279fed0e7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:06.574955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a858ca9-2a9d-4af4-b6c8-18c279fed0e7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:06.575739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a858ca9-2a9d-4af4-b6c8-18c279fed0e7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:06.576296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a858ca9-2a9d-4af4-b6c8-18c279fed0e7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:06.776168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0a858ca9-2a9d-4af4-b6c8-18c279fed0e7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:06.788646 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0a858ca9-2a9d-4af4-b6c8-18c279fed0e7 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.229806 Jul 14 14:57:06.801296 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2683/5348] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:06 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:06.818182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f1db61a9-dc5c-4d31-9f59-8c3ffac8c89d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f1db61a9-dc5c-4d31-9f59-8c3ffac8c89d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: request: PUT /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d HTTP/1.1 Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 24 Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: {"server": {"name": ""}} Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0f554d9f-a901-4284-8c0e-d34d0924e67d', 'body': {'server': {'name': ''}}} Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi '' Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:57:06.821488 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:57:06.826919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.826919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:06.826919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.826919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:06.826919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:06.826919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:06.826919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:57:06.826919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:57:06.826919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:57:06.826919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:06.828763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f1db61a9-dc5c-4d31-9f59-8c3ffac8c89d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:57:06.829997 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f1db61a9-dc5c-4d31-9f59-8c3ffac8c89d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "PUT /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 400 len: 108 microversion: 2.1 time: 0.016135 Jul 14 14:57:06.838452 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2666/5349] 10.222.0.81 () {60 vars in 1255 bytes} [Thu Jul 14 14:57:06 2022] PUT /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:57:06.842217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9eb36abd-3abb-462f-b173-d11c3903d2f9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:06.842843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9eb36abd-3abb-462f-b173-d11c3903d2f9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:06.850263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9eb36abd-3abb-462f-b173-d11c3903d2f9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:06.850718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9eb36abd-3abb-462f-b173-d11c3903d2f9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:06.852193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9eb36abd-3abb-462f-b173-d11c3903d2f9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:06.852804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9eb36abd-3abb-462f-b173-d11c3903d2f9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:07.031237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9eb36abd-3abb-462f-b173-d11c3903d2f9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:07.040281 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9eb36abd-3abb-462f-b173-d11c3903d2f9 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1507 microversion: 2.1 time: 0.204125 Jul 14 14:57:07.054085 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2684/5350] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:06 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:13.918112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9099368-80cc-439a-982e-49bbe81984ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:13.920017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c9099368-80cc-439a-982e-49bbe81984ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:13.936219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9099368-80cc-439a-982e-49bbe81984ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:13.946737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9099368-80cc-439a-982e-49bbe81984ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:13.947874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9099368-80cc-439a-982e-49bbe81984ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:13.948847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9099368-80cc-439a-982e-49bbe81984ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:13.974837 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c9099368-80cc-439a-982e-49bbe81984ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9099368-80cc-439a-982e-49bbe81984ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 HTTP/1.1 Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '8c224c96-7334-4d8a-a27a-8e3aac8c2d20'} Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:57:13.976811 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:57:13.983333 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:57:13.983333 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:13.983333 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:13.983333 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:13.983333 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:13.983333 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:13.983333 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:13.983333 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:57:13.983333 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:57:13.983333 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:57:13.983333 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:13.985534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9099368-80cc-439a-982e-49bbe81984ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:57:13.986915 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c9099368-80cc-439a-982e-49bbe81984ab tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 404 len: 111 microversion: 2.1 time: 0.074963 Jul 14 14:57:13.993027 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2667/5351] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:57:13 2022] DELETE /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:57:14.002086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-39b92def-a90c-42f9-a7c6-c04b5a10ef6d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:14.003436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-39b92def-a90c-42f9-a7c6-c04b5a10ef6d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 8c224c96-7334-4d8a-a27a-8e3aac8c2d20] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:14.017844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39b92def-a90c-42f9-a7c6-c04b5a10ef6d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:14.018624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39b92def-a90c-42f9-a7c6-c04b5a10ef6d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:14.019654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39b92def-a90c-42f9-a7c6-c04b5a10ef6d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:14.024669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-39b92def-a90c-42f9-a7c6-c04b5a10ef6d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:14.064166 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-39b92def-a90c-42f9-a7c6-c04b5a10ef6d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-39b92def-a90c-42f9-a7c6-c04b5a10ef6d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 HTTP/1.1 Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '8c224c96-7334-4d8a-a27a-8e3aac8c2d20'} Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:14.070155 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:14.075828 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:14.075828 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:14.075828 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:14.075828 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:57:14.075828 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:57:14.075828 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. Jul 14 14:57:14.075828 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:57:14.075828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-39b92def-a90c-42f9-a7c6-c04b5a10ef6d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 8c224c96-7334-4d8a-a27a-8e3aac8c2d20 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:57:14.078344 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-39b92def-a90c-42f9-a7c6-c04b5a10ef6d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20" status: 404 len: 111 microversion: 2.1 time: 0.080403 Jul 14 14:57:14.079447 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2685/5352] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:13 2022] GET /compute/v2.1/servers/8c224c96-7334-4d8a-a27a-8e3aac8c2d20 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:57:14.088281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b5b467a0-d1c5-45e7-876e-226951ac5c5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:14.088791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5b467a0-d1c5-45e7-876e-226951ac5c5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:14.106853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5b467a0-d1c5-45e7-876e-226951ac5c5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:14.107340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5b467a0-d1c5-45e7-876e-226951ac5c5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:14.108138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5b467a0-d1c5-45e7-876e-226951ac5c5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:14.108588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5b467a0-d1c5-45e7-876e-226951ac5c5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:14.202280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5b467a0-d1c5-45e7-876e-226951ac5c5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:57:14.374567 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b5b467a0-d1c5-45e7-876e-226951ac5c5d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 204 len: 0 microversion: 2.1 time: 0.290028 Jul 14 14:57:14.375483 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2668/5353] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:57:14 2022] DELETE /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:57:14.383984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f6925b14-cd01-4d05-81d5-58bd527e1485 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:14.384607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f6925b14-cd01-4d05-81d5-58bd527e1485 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:14.403350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6925b14-cd01-4d05-81d5-58bd527e1485 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:14.403820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6925b14-cd01-4d05-81d5-58bd527e1485 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:14.404646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6925b14-cd01-4d05-81d5-58bd527e1485 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:14.405132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6925b14-cd01-4d05-81d5-58bd527e1485 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:14.698190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6925b14-cd01-4d05-81d5-58bd527e1485 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:14.716439 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f6925b14-cd01-4d05-81d5-58bd527e1485 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.334175 Jul 14 14:57:14.718239 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2686/5354] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:14 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:15.736991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e8176a97-d110-44ce-b251-920c17ee3a61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:15.741300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e8176a97-d110-44ce-b251-920c17ee3a61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:15.758252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8176a97-d110-44ce-b251-920c17ee3a61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:15.760335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8176a97-d110-44ce-b251-920c17ee3a61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:15.763023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8176a97-d110-44ce-b251-920c17ee3a61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:15.764989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8176a97-d110-44ce-b251-920c17ee3a61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:16.091315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e8176a97-d110-44ce-b251-920c17ee3a61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:16.100757 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e8176a97-d110-44ce-b251-920c17ee3a61 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.368995 Jul 14 14:57:16.101906 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2669/5355] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:15 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:17.119313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a2479e5b-299f-440c-9182-cb5554dd5003 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:17.120064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a2479e5b-299f-440c-9182-cb5554dd5003 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:17.137252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2479e5b-299f-440c-9182-cb5554dd5003 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:17.140221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2479e5b-299f-440c-9182-cb5554dd5003 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:17.143363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2479e5b-299f-440c-9182-cb5554dd5003 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:17.144564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2479e5b-299f-440c-9182-cb5554dd5003 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:17.500367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a2479e5b-299f-440c-9182-cb5554dd5003 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:17.512913 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a2479e5b-299f-440c-9182-cb5554dd5003 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1513 microversion: 2.1 time: 0.397401 Jul 14 14:57:17.524060 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2687/5356] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:17 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1513 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:18.531016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-82f0bb9c-d91f-4caf-902b-835c3c9e8d41 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:18.532627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-82f0bb9c-d91f-4caf-902b-835c3c9e8d41 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:18.545495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82f0bb9c-d91f-4caf-902b-835c3c9e8d41 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:18.545955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82f0bb9c-d91f-4caf-902b-835c3c9e8d41 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:18.546746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82f0bb9c-d91f-4caf-902b-835c3c9e8d41 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:18.547183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82f0bb9c-d91f-4caf-902b-835c3c9e8d41 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:18.584044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3bfd1d22-3b16-4578-b730-b34da7343fbe req-eefd2a5d-2ab9-403b-9f61-f243d2ef6cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f554d9f-a901-4284-8c0e-d34d0924e67d", "name": "network-vif-deleted", "tag": "9af0d9f1-4145-44d0-a287-acb8ff126aa7"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:18.607890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3bfd1d22-3b16-4578-b730-b34da7343fbe req-eefd2a5d-2ab9-403b-9f61-f243d2ef6cb1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:18.608733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3bfd1d22-3b16-4578-b730-b34da7343fbe req-eefd2a5d-2ab9-403b-9f61-f243d2ef6cb1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:18.610176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82f0bb9c-d91f-4caf-902b-835c3c9e8d41 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:18.611608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82f0bb9c-d91f-4caf-902b-835c3c9e8d41 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:18.612259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-82f0bb9c-d91f-4caf-902b-835c3c9e8d41 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lazy-loading 'fault' on Instance uuid 0f554d9f-a901-4284-8c0e-d34d0924e67d {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:57:18.632166 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3bfd1d22-3b16-4578-b730-b34da7343fbe req-eefd2a5d-2ab9-403b-9f61-f243d2ef6cb1 service nova] Creating event network-vif-deleted:9af0d9f1-4145-44d0-a287-acb8ff126aa7 for instance 0f554d9f-a901-4284-8c0e-d34d0924e67d on n-h1-767704-28 Jul 14 14:57:18.640202 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3bfd1d22-3b16-4578-b730-b34da7343fbe req-eefd2a5d-2ab9-403b-9f61-f243d2ef6cb1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.439616 Jul 14 14:57:18.652874 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2670/5357] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:57:18.716992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-82f0bb9c-d91f-4caf-902b-835c3c9e8d41 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bf2b5f51d34e8e981e90a05b81f9fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889dffd008a54d03845c9de4be5f0e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:18.728409 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-82f0bb9c-d91f-4caf-902b-835c3c9e8d41 tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 200 len: 1307 microversion: 2.1 time: 0.202111 Jul 14 14:57:18.731388 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2688/5358] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:18 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:19.749533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d60cac7-e890-4191-b459-109eae1e0e7d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:19.750333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6d60cac7-e890-4191-b459-109eae1e0e7d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] [instance: 0f554d9f-a901-4284-8c0e-d34d0924e67d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:19.769104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d60cac7-e890-4191-b459-109eae1e0e7d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:19.773158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d60cac7-e890-4191-b459-109eae1e0e7d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:19.774107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d60cac7-e890-4191-b459-109eae1e0e7d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:19.774555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d60cac7-e890-4191-b459-109eae1e0e7d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:19.801307 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-6d60cac7-e890-4191-b459-109eae1e0e7d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] HTTP exception thrown: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d could not be found. Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d60cac7-e890-4191-b459-109eae1e0e7d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Request method failure captured: Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d HTTP/1.1 Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3pkdgfN_grMuf-jP4BerpZiYrUjnVebhVOlyI9dH9ENBnt8Mfh58F5BPL9fxgRrqXfz92uJGBemkQgOGJI_w_ioCzVECMh_o1FfM8-jRPWZoR6J-k7PPMXaS4GRIRY2pCTK5PxiWLtkyns1p7krnAHvMjey7PuAF9LCkpStCWsvJ4 Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/889dffd008a54d03845c9de4be5f0e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_889dffd008a54d03845c9de4be5f0e7b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/889dffd008a54d03845c9de4be5f0e7b"}]}] Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 889dffd008a54d03845c9de4be5f0e7b Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-706909977 Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 87bf2b5f51d34e8e981e90a05b81f9fa Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-706909977-project Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d could not be found. Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0f554d9f-a901-4284-8c0e-d34d0924e67d'} Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d could not be found. Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d could not be found. Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:57:19.806564 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:19.812673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:57:19.812673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:57:19.812673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:57:19.812673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:57:19.812673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:57:19.812673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d could not be found. Jul 14 14:57:19.812673 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:57:19.814679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d60cac7-e890-4191-b459-109eae1e0e7d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] Returning 404 to user: Instance 0f554d9f-a901-4284-8c0e-d34d0924e67d could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:57:19.815799 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6d60cac7-e890-4191-b459-109eae1e0e7d tempest-ServersNegativeTestJSON-706909977 tempest-ServersNegativeTestJSON-706909977-project] 10.222.0.81 "GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d" status: 404 len: 111 microversion: 2.1 time: 0.072545 Jul 14 14:57:19.816585 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2671/5359] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:19 2022] GET /compute/v2.1/servers/0f554d9f-a901-4284-8c0e-d34d0924e67d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:57:42.421100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d729a05c-de62-472f-a7d9-c4bc17ba87e7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:42.422257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d729a05c-de62-472f-a7d9-c4bc17ba87e7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:42.438281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=53 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:42.440395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=42 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:42.448637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d729a05c-de62-472f-a7d9-c4bc17ba87e7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:42.468770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d729a05c-de62-472f-a7d9-c4bc17ba87e7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:42.479339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d729a05c-de62-472f-a7d9-c4bc17ba87e7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:42.483138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d729a05c-de62-472f-a7d9-c4bc17ba87e7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:42.676922 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d729a05c-de62-472f-a7d9-c4bc17ba87e7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments/f8ee0d53-ba45-4c47-9ea3-05a2f23621e4" status: 200 len: 194 microversion: 2.20 time: 0.260640 Jul 14 14:57:42.681382 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2689/5360] 10.222.0.81 () {60 vars in 1453 bytes} [Thu Jul 14 14:57:42 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments/f8ee0d53-ba45-4c47-9ea3-05a2f23621e4 => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:57:42.801195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a8e1c04d-671f-4b57-ace1-3e96fd362cf3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:42.802386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a8e1c04d-671f-4b57-ace1-3e96fd362cf3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:42.814950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:42.818173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:42.825319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8e1c04d-671f-4b57-ace1-3e96fd362cf3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:42.825801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8e1c04d-671f-4b57-ace1-3e96fd362cf3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:42.832879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8e1c04d-671f-4b57-ace1-3e96fd362cf3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:42.834418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8e1c04d-671f-4b57-ace1-3e96fd362cf3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:43.143923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-a8e1c04d-671f-4b57-ace1-3e96fd362cf3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lazy-loading 'services' on Instance uuid e5292ea7-49d5-4a1e-8fee-76a77bf64afa {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:57:43.321455 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a8e1c04d-671f-4b57-ace1-3e96fd362cf3 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments/f8ee0d53-ba45-4c47-9ea3-05a2f23621e4" status: 202 len: 0 microversion: 2.20 time: 0.525257 Jul 14 14:57:43.322660 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2672/5361] 10.222.0.81 () {60 vars in 1456 bytes} [Thu Jul 14 14:57:42 2022] DELETE /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments/f8ee0d53-ba45-4c47-9ea3-05a2f23621e4 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:57:43.332220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4a19aebb-f7e9-4c37-8152-5e2892a1ef78 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:43.333811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4a19aebb-f7e9-4c37-8152-5e2892a1ef78 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:43.345696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a19aebb-f7e9-4c37-8152-5e2892a1ef78 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:43.346912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a19aebb-f7e9-4c37-8152-5e2892a1ef78 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:43.348517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a19aebb-f7e9-4c37-8152-5e2892a1ef78 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:43.349440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a19aebb-f7e9-4c37-8152-5e2892a1ef78 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:43.540783 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4a19aebb-f7e9-4c37-8152-5e2892a1ef78 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.207427 Jul 14 14:57:43.545694 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2690/5362] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:57:43 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:57:44.561094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c47375d9-5933-44aa-b44a-0e87d1013c3d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:44.561786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c47375d9-5933-44aa-b44a-0e87d1013c3d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:44.604046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c47375d9-5933-44aa-b44a-0e87d1013c3d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:44.604848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c47375d9-5933-44aa-b44a-0e87d1013c3d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:44.605983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c47375d9-5933-44aa-b44a-0e87d1013c3d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:44.606433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c47375d9-5933-44aa-b44a-0e87d1013c3d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:44.744092 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c47375d9-5933-44aa-b44a-0e87d1013c3d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.190193 Jul 14 14:57:44.750768 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2691/5363] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:57:44 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:57:45.207267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-17266771-e4fd-4e83-b848-d39ca53e2e00 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Action: 'create', calling method: .version_select at 0x7fd6c45414c0>, body: {"keypair": {"name": "tempest-keypair-43326953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+PuBt8JxmgJw0x/Xmu4WXxPcNgtRQaom5CIT/ZOyx00fTYH+oF9t3zqsbbxuv2/xsTK8ZvOL8OgYZMonUdFcMvUh7/TpHcATaTN6cWVWSr38cx50OscgiY1xzkRzaFDQ=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:45.272631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-17266771-e4fd-4e83-b848-d39ca53e2e00 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Getting quotas for project d2da89f72ce5460ca5c6b01801c6a887. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:57:45.281166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-17266771-e4fd-4e83-b848-d39ca53e2e00 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Getting quotas for user 8e61e6e12c0a4cdda2008953a997411f and project d2da89f72ce5460ca5c6b01801c6a887. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:57:45.379270 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-17266771-e4fd-4e83-b848-d39ca53e2e00 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.019458 Jul 14 14:57:45.379895 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2673/5364] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 14:57:44 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:57:45.760566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b27dfb70-b199-42c4-afd1-d27f963c2b47 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:45.764121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b27dfb70-b199-42c4-afd1-d27f963c2b47 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:45.785661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b27dfb70-b199-42c4-afd1-d27f963c2b47 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:45.786576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b27dfb70-b199-42c4-afd1-d27f963c2b47 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:45.787759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b27dfb70-b199-42c4-afd1-d27f963c2b47 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:45.788481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b27dfb70-b199-42c4-afd1-d27f963c2b47 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:45.880317 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b27dfb70-b199-42c4-afd1-d27f963c2b47 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122575 Jul 14 14:57:45.893761 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2692/5365] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:57:45 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:57:46.914445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-025811df-ff90-4312-9501-515511cb12ec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:46.919055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-025811df-ff90-4312-9501-515511cb12ec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:46.938649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-025811df-ff90-4312-9501-515511cb12ec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:46.939114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-025811df-ff90-4312-9501-515511cb12ec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:46.939907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-025811df-ff90-4312-9501-515511cb12ec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:46.940352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-025811df-ff90-4312-9501-515511cb12ec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:47.164448 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-025811df-ff90-4312-9501-515511cb12ec tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.260882 Jul 14 14:57:47.166878 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2674/5366] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:57:46 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments => generated 197 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:57:48.179352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-41f5d427-8175-4ef3-9cdc-aa81bf74f964 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:48.180293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-41f5d427-8175-4ef3-9cdc-aa81bf74f964 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:48.198823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41f5d427-8175-4ef3-9cdc-aa81bf74f964 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:48.199474 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41f5d427-8175-4ef3-9cdc-aa81bf74f964 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:48.201110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41f5d427-8175-4ef3-9cdc-aa81bf74f964 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:48.201841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41f5d427-8175-4ef3-9cdc-aa81bf74f964 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:48.289604 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-41f5d427-8175-4ef3-9cdc-aa81bf74f964 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115273 Jul 14 14:57:48.291503 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2693/5367] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:57:48 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:57:49.304207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39e15438-5b64-4bbf-b8da-40a5f64ffd54 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:49.305712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-39e15438-5b64-4bbf-b8da-40a5f64ffd54 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:49.340611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39e15438-5b64-4bbf-b8da-40a5f64ffd54 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:49.343171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39e15438-5b64-4bbf-b8da-40a5f64ffd54 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:49.349002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39e15438-5b64-4bbf-b8da-40a5f64ffd54 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:49.351488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39e15438-5b64-4bbf-b8da-40a5f64ffd54 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:49.504521 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-39e15438-5b64-4bbf-b8da-40a5f64ffd54 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.205315 Jul 14 14:57:49.506798 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2675/5368] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:57:49 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:57:50.163475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1347724150", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4a30086-913a-4f83-95a8-00718bd2af52"}], "security_groups": [{"name": "tempest-securitygroup--1771895745"}], "key_name": "tempest-keypair-43326953", "user_data": "}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:50.502087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] validate_networks() for [('d4a30086-913a-4f83-95a8-00718bd2af52', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:57:50.518546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-76aa8d0a-49ca-43bd-9cd4-eadac4f4e433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:50.519502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-76aa8d0a-49ca-43bd-9cd4-eadac4f4e433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:50.539082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76aa8d0a-49ca-43bd-9cd4-eadac4f4e433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:50.539559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76aa8d0a-49ca-43bd-9cd4-eadac4f4e433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:50.540355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76aa8d0a-49ca-43bd-9cd4-eadac4f4e433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:50.544206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-76aa8d0a-49ca-43bd-9cd4-eadac4f4e433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:50.630193 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-76aa8d0a-49ca-43bd-9cd4-eadac4f4e433 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116054 Jul 14 14:57:50.631882 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2676/5369] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:57:50 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:57:51.644403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-666419bb-95bd-499e-9588-d1b3e459429d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:51.645871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-666419bb-95bd-499e-9588-d1b3e459429d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:51.658542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-666419bb-95bd-499e-9588-d1b3e459429d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:51.660373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-666419bb-95bd-499e-9588-d1b3e459429d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:51.662977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-666419bb-95bd-499e-9588-d1b3e459429d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:51.663640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-666419bb-95bd-499e-9588-d1b3e459429d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:51.772867 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-666419bb-95bd-499e-9588-d1b3e459429d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.132911 Jul 14 14:57:51.774212 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2677/5370] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:57:51 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:57:52.237626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:57:52.238435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:57:52.238801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:57:52.239244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:57:52.239723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:57:52.273573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:52.274061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:52.274944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:52.275400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:52.319733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Getting quotas for project d2da89f72ce5460ca5c6b01801c6a887. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:57:52.326925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Getting quotas for user 8e61e6e12c0a4cdda2008953a997411f and project d2da89f72ce5460ca5c6b01801c6a887. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:57:52.380566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:57:52.389356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:57:52.509829 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-369a7760-83ff-4665-91d5-16e8ac1c0c42 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.349643 Jul 14 14:57:52.510906 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2694/5371] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:57:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:57:52.522366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e4c9192d-66a8-4329-9c18-94147d527cfe tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:52.523232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e4c9192d-66a8-4329-9c18-94147d527cfe tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:52.785183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-59611129-7ec4-48e5-b620-1162b1f59fc8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:52.786587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-59611129-7ec4-48e5-b620-1162b1f59fc8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:52.803295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59611129-7ec4-48e5-b620-1162b1f59fc8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:52.806708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59611129-7ec4-48e5-b620-1162b1f59fc8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:52.810636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59611129-7ec4-48e5-b620-1162b1f59fc8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:52.811368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59611129-7ec4-48e5-b620-1162b1f59fc8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:52.828767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e4c9192d-66a8-4329-9c18-94147d527cfe tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:52.844781 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e4c9192d-66a8-4329-9c18-94147d527cfe tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1236 microversion: 2.1 time: 0.318126 Jul 14 14:57:52.845777 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2678/5372] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:52 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1236 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:52.925783 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-59611129-7ec4-48e5-b620-1162b1f59fc8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.144678 Jul 14 14:57:52.927004 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2695/5373] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:57:52 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:57:53.862885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-85d3e460-85a4-403e-bbf9-66a602300703 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:53.864541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-85d3e460-85a4-403e-bbf9-66a602300703 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:53.890172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85d3e460-85a4-403e-bbf9-66a602300703 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:53.890745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85d3e460-85a4-403e-bbf9-66a602300703 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:53.891686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85d3e460-85a4-403e-bbf9-66a602300703 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:53.892269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85d3e460-85a4-403e-bbf9-66a602300703 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:53.938691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e18b009b-3a6b-4303-b465-144287970b27 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:53.939681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e18b009b-3a6b-4303-b465-144287970b27 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:53.962793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e18b009b-3a6b-4303-b465-144287970b27 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:53.963550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e18b009b-3a6b-4303-b465-144287970b27 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:53.968609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e18b009b-3a6b-4303-b465-144287970b27 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:53.969445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e18b009b-3a6b-4303-b465-144287970b27 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:54.093680 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e18b009b-3a6b-4303-b465-144287970b27 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.160401 Jul 14 14:57:54.116484 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2696/5374] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:57:53 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:57:54.144684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-85d3e460-85a4-403e-bbf9-66a602300703 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:54.153634 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-85d3e460-85a4-403e-bbf9-66a602300703 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1240 microversion: 2.1 time: 0.294843 Jul 14 14:57:54.168374 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2679/5375] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:53 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1240 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:55.126807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-68c69004-802d-4be9-a150-8561fc06a262 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:55.127761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-68c69004-802d-4be9-a150-8561fc06a262 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:55.153912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68c69004-802d-4be9-a150-8561fc06a262 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.154362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68c69004-802d-4be9-a150-8561fc06a262 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.155145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68c69004-802d-4be9-a150-8561fc06a262 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.155584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68c69004-802d-4be9-a150-8561fc06a262 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.180871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-95325339-2989-43b8-be4d-6abb616ecf49 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:55.181564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-95325339-2989-43b8-be4d-6abb616ecf49 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:55.210642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95325339-2989-43b8-be4d-6abb616ecf49 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.211168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95325339-2989-43b8-be4d-6abb616ecf49 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.211871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95325339-2989-43b8-be4d-6abb616ecf49 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.212312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-95325339-2989-43b8-be4d-6abb616ecf49 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.272351 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-68c69004-802d-4be9-a150-8561fc06a262 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.147660 Jul 14 14:57:55.281145 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2697/5376] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 14:57:55 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:55.342517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4bc93b7-1e1f-4fff-877d-5e4ea4fd0557 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:55.343494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d4bc93b7-1e1f-4fff-877d-5e4ea4fd0557 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:55.358138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4bc93b7-1e1f-4fff-877d-5e4ea4fd0557 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.361522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4bc93b7-1e1f-4fff-877d-5e4ea4fd0557 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.362840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4bc93b7-1e1f-4fff-877d-5e4ea4fd0557 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.363502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4bc93b7-1e1f-4fff-877d-5e4ea4fd0557 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.401136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-95325339-2989-43b8-be4d-6abb616ecf49 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:55.419539 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-95325339-2989-43b8-be4d-6abb616ecf49 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1294 microversion: 2.1 time: 0.242840 Jul 14 14:57:55.425946 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2680/5377] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:55 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1294 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:55.432545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d4bc93b7-1e1f-4fff-877d-5e4ea4fd0557 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:57:55.598138 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d4bc93b7-1e1f-4fff-877d-5e4ea4fd0557 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 204 len: 0 microversion: 2.20 time: 0.259573 Jul 14 14:57:55.599972 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2698/5378] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 14:57:55 2022] DELETE /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 14:57:55.612787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ce051e7-f30c-4b27-89a4-b2bac07eb742 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:55.613927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ce051e7-f30c-4b27-89a4-b2bac07eb742 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:55.637605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ce051e7-f30c-4b27-89a4-b2bac07eb742 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.637605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ce051e7-f30c-4b27-89a4-b2bac07eb742 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.643384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ce051e7-f30c-4b27-89a4-b2bac07eb742 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.646604 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ce051e7-f30c-4b27-89a4-b2bac07eb742 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.995768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ce051e7-f30c-4b27-89a4-b2bac07eb742 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:56.009280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ce051e7-f30c-4b27-89a4-b2bac07eb742 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:56.011866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ce051e7-f30c-4b27-89a4-b2bac07eb742 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:56.015045 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ce051e7-f30c-4b27-89a4-b2bac07eb742 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.410470 Jul 14 14:57:56.020388 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2681/5379] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:55 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:56.451035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6caa08a8-5d5f-4065-90e8-6b7f367e19b1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:56.454126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6caa08a8-5d5f-4065-90e8-6b7f367e19b1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:56.468497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6caa08a8-5d5f-4065-90e8-6b7f367e19b1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:56.469291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6caa08a8-5d5f-4065-90e8-6b7f367e19b1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:56.470264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6caa08a8-5d5f-4065-90e8-6b7f367e19b1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:56.472245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6caa08a8-5d5f-4065-90e8-6b7f367e19b1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:56.602380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-193360918", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "7f940052-ebb9-4860-a6c6-432d170fab66"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:56.788691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] validate_networks() for [('7f940052-ebb9-4860-a6c6-432d170fab66', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:57:56.922732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6caa08a8-5d5f-4065-90e8-6b7f367e19b1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:56.936013 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6caa08a8-5d5f-4065-90e8-6b7f367e19b1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1362 microversion: 2.1 time: 0.496280 Jul 14 14:57:56.947084 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2699/5380] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:56 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1362 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:57.046296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37e631b5-ab5d-4916-8abb-a350c3efd7cd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:57.047638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-37e631b5-ab5d-4916-8abb-a350c3efd7cd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:57.069658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37e631b5-ab5d-4916-8abb-a350c3efd7cd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:57.070419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37e631b5-ab5d-4916-8abb-a350c3efd7cd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:57.071893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37e631b5-ab5d-4916-8abb-a350c3efd7cd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:57.073230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37e631b5-ab5d-4916-8abb-a350c3efd7cd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:57.669695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-37e631b5-ab5d-4916-8abb-a350c3efd7cd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:57.685672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-37e631b5-ab5d-4916-8abb-a350c3efd7cd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:57.687932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-37e631b5-ab5d-4916-8abb-a350c3efd7cd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:57.689529 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-37e631b5-ab5d-4916-8abb-a350c3efd7cd tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.650929 Jul 14 14:57:57.694809 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2700/5381] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:57 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:57.965394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9d133934-20e5-45d9-bcc2-6a39bbb53522 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:57.967404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9d133934-20e5-45d9-bcc2-6a39bbb53522 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:57.975685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d133934-20e5-45d9-bcc2-6a39bbb53522 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:57.976559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d133934-20e5-45d9-bcc2-6a39bbb53522 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:57.977673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d133934-20e5-45d9-bcc2-6a39bbb53522 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:57.978380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d133934-20e5-45d9-bcc2-6a39bbb53522 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:58.477724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9d133934-20e5-45d9-bcc2-6a39bbb53522 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:58.484145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:57:58.486041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:57:58.487522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:57:58.488309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:57:58.489626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:57:58.496480 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9d133934-20e5-45d9-bcc2-6a39bbb53522 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1362 microversion: 2.1 time: 0.534323 Jul 14 14:57:58.498024 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2701/5382] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:57 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:58.507823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:58.507823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:58.507823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:58.508465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:58.535607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Getting quotas for project 1420a918066140fe8fd6877cd8a2b514. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:57:58.545975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Getting quotas for user 862f63b48b954c1491b06a51565167ac and project 1420a918066140fe8fd6877cd8a2b514. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:57:58.576696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:57:58.581449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:57:58.651387 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d32ca29c-3b88-4f58-9a0a-c2ad45afbc5b tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.059324 Jul 14 14:57:58.653202 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2682/5383] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:57:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:57:58.663497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a1e550eb-546d-4af2-847c-ffdae29daeda tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:58.664752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a1e550eb-546d-4af2-847c-ffdae29daeda tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:58.724443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ad059ee9-99a2-4255-a51e-d0b3d3d19238 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:58.725032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ad059ee9-99a2-4255-a51e-d0b3d3d19238 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:58.737993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad059ee9-99a2-4255-a51e-d0b3d3d19238 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:58.738439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad059ee9-99a2-4255-a51e-d0b3d3d19238 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:58.742273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad059ee9-99a2-4255-a51e-d0b3d3d19238 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:58.743114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad059ee9-99a2-4255-a51e-d0b3d3d19238 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:58.772626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a1e550eb-546d-4af2-847c-ffdae29daeda tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:58.779726 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a1e550eb-546d-4af2-847c-ffdae29daeda tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1213 microversion: 2.1 time: 0.120253 Jul 14 14:57:58.782784 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2702/5384] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:58 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:59.067358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ad059ee9-99a2-4255-a51e-d0b3d3d19238 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:59.076348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ad059ee9-99a2-4255-a51e-d0b3d3d19238 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:59.077901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ad059ee9-99a2-4255-a51e-d0b3d3d19238 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:59.085295 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ad059ee9-99a2-4255-a51e-d0b3d3d19238 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1722 microversion: 2.20 time: 0.365320 Jul 14 14:57:59.086245 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2683/5385] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:58 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:57:59.106322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ef540992-ad51-4cca-90b6-342d98d20cb6 req-81770ebd-9897-4dda-aea8-2519a0a83fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accee1e3-de25-42fe-b062-e6c330d4e88c", "tag": "70641ce3-b2fb-4c43-9416-6a623723ac81"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:59.176270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ef540992-ad51-4cca-90b6-342d98d20cb6 req-81770ebd-9897-4dda-aea8-2519a0a83fe8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:59.177362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ef540992-ad51-4cca-90b6-342d98d20cb6 req-81770ebd-9897-4dda-aea8-2519a0a83fe8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:59.203483 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ef540992-ad51-4cca-90b6-342d98d20cb6 req-81770ebd-9897-4dda-aea8-2519a0a83fe8 service nova] Creating event network-changed:70641ce3-b2fb-4c43-9416-6a623723ac81 for instance accee1e3-de25-42fe-b062-e6c330d4e88c on n-h2-767704-28 Jul 14 14:57:59.210736 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ef540992-ad51-4cca-90b6-342d98d20cb6 req-81770ebd-9897-4dda-aea8-2519a0a83fe8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112500 Jul 14 14:57:59.212125 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2703/5386] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:57:59.515362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-07a83835-e118-4efe-82de-42d072fd5b94 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:59.515987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-07a83835-e118-4efe-82de-42d072fd5b94 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:59.522655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-07a83835-e118-4efe-82de-42d072fd5b94 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:59.523452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-07a83835-e118-4efe-82de-42d072fd5b94 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:59.525149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-07a83835-e118-4efe-82de-42d072fd5b94 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:59.525805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-07a83835-e118-4efe-82de-42d072fd5b94 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:59.787184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-07a83835-e118-4efe-82de-42d072fd5b94 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:59.799156 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-07a83835-e118-4efe-82de-42d072fd5b94 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1362 microversion: 2.1 time: 0.287184 Jul 14 14:57:59.799888 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2684/5387] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:59 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:59.801099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-74c1e969-472b-4659-97f5-292288af444f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:59.802321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-74c1e969-472b-4659-97f5-292288af444f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:59.810260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74c1e969-472b-4659-97f5-292288af444f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:59.810715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74c1e969-472b-4659-97f5-292288af444f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:59.811530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74c1e969-472b-4659-97f5-292288af444f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:59.811970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74c1e969-472b-4659-97f5-292288af444f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:59.915475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-74c1e969-472b-4659-97f5-292288af444f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:59.924843 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-74c1e969-472b-4659-97f5-292288af444f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1209 microversion: 2.1 time: 0.129036 Jul 14 14:57:59.925461 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2704/5388] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:59 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1209 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:00.110618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dbf42931-a07d-4638-87cb-001c6a5fcf60 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:00.112148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dbf42931-a07d-4638-87cb-001c6a5fcf60 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:00.124448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dbf42931-a07d-4638-87cb-001c6a5fcf60 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:00.125627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dbf42931-a07d-4638-87cb-001c6a5fcf60 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:00.127735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dbf42931-a07d-4638-87cb-001c6a5fcf60 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:00.129256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dbf42931-a07d-4638-87cb-001c6a5fcf60 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:00.225319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dbf42931-a07d-4638-87cb-001c6a5fcf60 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:00.235172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dbf42931-a07d-4638-87cb-001c6a5fcf60 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:00.237199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dbf42931-a07d-4638-87cb-001c6a5fcf60 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:00.238916 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dbf42931-a07d-4638-87cb-001c6a5fcf60 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1654 microversion: 2.20 time: 0.137655 Jul 14 14:58:00.239639 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2685/5389] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:00 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1654 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:00.580760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4aa1d081-7ecd-4553-8199-38f360833216 req-816ea607-b09b-4fd2-8bd0-4e91eddc770a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5292ea7-49d5-4a1e-8fee-76a77bf64afa", "name": "network-vif-deleted", "tag": "93b2a2b3-1bf6-47ff-9851-01934b486943"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:00.601751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4aa1d081-7ecd-4553-8199-38f360833216 req-816ea607-b09b-4fd2-8bd0-4e91eddc770a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:00.603154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4aa1d081-7ecd-4553-8199-38f360833216 req-816ea607-b09b-4fd2-8bd0-4e91eddc770a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:00.645074 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4aa1d081-7ecd-4553-8199-38f360833216 req-816ea607-b09b-4fd2-8bd0-4e91eddc770a service nova] Creating event network-vif-deleted:93b2a2b3-1bf6-47ff-9851-01934b486943 for instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa on n-h1-767704-28 Jul 14 14:58:00.671545 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4aa1d081-7ecd-4553-8199-38f360833216 req-816ea607-b09b-4fd2-8bd0-4e91eddc770a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092369 Jul 14 14:58:00.672882 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2705/5390] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:00.820812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9da32743-551a-4174-8384-189a79f704e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:00.823338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9da32743-551a-4174-8384-189a79f704e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:00.841929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9da32743-551a-4174-8384-189a79f704e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:00.876463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9da32743-551a-4174-8384-189a79f704e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:00.878291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9da32743-551a-4174-8384-189a79f704e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:00.883214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9da32743-551a-4174-8384-189a79f704e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:00.947466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e3d50925-42a6-48da-8163-25ba75f1dd67 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:00.949946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e3d50925-42a6-48da-8163-25ba75f1dd67 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:00.992449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3d50925-42a6-48da-8163-25ba75f1dd67 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:00.999368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3d50925-42a6-48da-8163-25ba75f1dd67 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:01.000222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3d50925-42a6-48da-8163-25ba75f1dd67 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:01.000666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3d50925-42a6-48da-8163-25ba75f1dd67 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:01.316204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e3d50925-42a6-48da-8163-25ba75f1dd67 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:01.320245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:01.341162 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e3d50925-42a6-48da-8163-25ba75f1dd67 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1271 microversion: 2.1 time: 0.401752 Jul 14 14:58:01.346743 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2706/5391] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:00 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1271 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:01.358510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:01.368606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:01.387769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:01.388276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:01.393121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:01.393712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:01.514959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:01.515740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:01.516513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lazy-loading 'fault' on Instance uuid e5292ea7-49d5-4a1e-8fee-76a77bf64afa {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:01.612776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9da32743-551a-4174-8384-189a79f704e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:01.630784 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9da32743-551a-4174-8384-189a79f704e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1362 microversion: 2.1 time: 0.816757 Jul 14 14:58:01.632302 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2686/5392] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:00 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1362 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:01.739310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:01.748925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:01.758015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:01.759530 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c3141f5f-deeb-4ae9-aa89-38b95ba04d2e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 200 len: 1370 microversion: 2.20 time: 0.411521 Jul 14 14:58:01.773459 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2707/5393] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:01 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 1370 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:02.360975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c67ab012-7454-4e2a-903f-d36186e49185 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:02.362224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c67ab012-7454-4e2a-903f-d36186e49185 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:02.373877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c67ab012-7454-4e2a-903f-d36186e49185 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:02.383408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c67ab012-7454-4e2a-903f-d36186e49185 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:02.384385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c67ab012-7454-4e2a-903f-d36186e49185 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:02.384846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c67ab012-7454-4e2a-903f-d36186e49185 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:02.648825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-df95afc7-3447-41e3-aa4b-cade0daf5be4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:02.649624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-df95afc7-3447-41e3-aa4b-cade0daf5be4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:02.668888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:02.674762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df95afc7-3447-41e3-aa4b-cade0daf5be4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:02.676290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df95afc7-3447-41e3-aa4b-cade0daf5be4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:02.680117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df95afc7-3447-41e3-aa4b-cade0daf5be4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:02.681518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df95afc7-3447-41e3-aa4b-cade0daf5be4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:02.922247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c67ab012-7454-4e2a-903f-d36186e49185 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:02.938444 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c67ab012-7454-4e2a-903f-d36186e49185 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1313 microversion: 2.1 time: 0.580835 Jul 14 14:58:02.939236 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2687/5394] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:02 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:02.954668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf6cb5cb-ca5b-41df-ab8d-e0f38fcb541d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:02.955305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bf6cb5cb-ca5b-41df-ab8d-e0f38fcb541d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:02.969843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf6cb5cb-ca5b-41df-ab8d-e0f38fcb541d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:02.976627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf6cb5cb-ca5b-41df-ab8d-e0f38fcb541d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:02.977703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf6cb5cb-ca5b-41df-ab8d-e0f38fcb541d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:02.978166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf6cb5cb-ca5b-41df-ab8d-e0f38fcb541d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:03.019832 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-bf6cb5cb-ca5b-41df-ab8d-e0f38fcb541d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] HTTP exception thrown: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 14:58:03.024383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-df95afc7-3447-41e3-aa4b-cade0daf5be4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf6cb5cb-ca5b-41df-ab8d-e0f38fcb541d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Request method failure captured: Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa HTTP/1.1 Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C38MeByVKiVMOKtC1kTurWRhHcyxi-0AmvGy4XdQHsXDCN3Ic4YUg5WccbTqc_s0z_-6insPcg5rV7EvJiPcfDl9lYs49sbFZCfB2_PGxb5rzlpWwbxE5SLzzW5-fl6tG0Vwo64dau0r4yPcjJGa7WLmipShtzifhH5p6QYSXPJYfM Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 696fe3c794f345898ccdfc30555d420d Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/696fe3c794f345898ccdfc30555d420d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/696fe3c794f345898ccdfc30555d420d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_696fe3c794f345898ccdfc30555d420d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/696fe3c794f345898ccdfc30555d420d"}]}] Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 696fe3c794f345898ccdfc30555d420d Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeShelveTestJSON-136825956-project Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: b19287c405854751b7ad4846457b5882 Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeShelveTestJSON-136825956-project Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'e5292ea7-49d5-4a1e-8fee-76a77bf64afa'} Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:03.027982 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:58:03.034028 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:03.034028 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:03.034028 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:58:03.034028 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:58:03.034028 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:58:03.034028 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:58:03.034028 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 14:58:03.034028 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:03.034028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf6cb5cb-ca5b-41df-ab8d-e0f38fcb541d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Returning 404 to user: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:58:03.034028 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf6cb5cb-ca5b-41df-ab8d-e0f38fcb541d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 404 len: 111 microversion: 2.20 time: 0.090128 Jul 14 14:58:03.034028 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2688/5395] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:02 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:58:03.039602 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-df95afc7-3447-41e3-aa4b-cade0daf5be4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1362 microversion: 2.1 time: 0.395421 Jul 14 14:58:03.040423 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2708/5396] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:02 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1362 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:03.063914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6c49f4d-d23b-4681-be74-ab9a7c58b729 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '.version_select at 0x7fd6c45414c0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:03.097111 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b6c49f4d-d23b-4681-be74-ab9a7c58b729 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-634402904" status: 204 len: 0 microversion: 2.20 time: 0.058400 Jul 14 14:58:03.101667 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2689/5397] 10.222.0.81 () {60 vars in 1258 bytes} [Thu Jul 14 14:58:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-634402904 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:58:03.965691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-72970346-2490-4348-affa-cf9dd90f5e79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:03.967080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-72970346-2490-4348-affa-cf9dd90f5e79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:03.987512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72970346-2490-4348-affa-cf9dd90f5e79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:03.988082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72970346-2490-4348-affa-cf9dd90f5e79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:03.989008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72970346-2490-4348-affa-cf9dd90f5e79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:03.989560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-72970346-2490-4348-affa-cf9dd90f5e79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:04.061950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3707de22-fea0-46fd-a184-d5dd99ea2281 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:04.103220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3707de22-fea0-46fd-a184-d5dd99ea2281 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:04.115613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3707de22-fea0-46fd-a184-d5dd99ea2281 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:04.116203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3707de22-fea0-46fd-a184-d5dd99ea2281 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:04.117215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3707de22-fea0-46fd-a184-d5dd99ea2281 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:04.117830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3707de22-fea0-46fd-a184-d5dd99ea2281 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:04.337314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-72970346-2490-4348-affa-cf9dd90f5e79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:04.348434 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-72970346-2490-4348-affa-cf9dd90f5e79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1313 microversion: 2.1 time: 0.396247 Jul 14 14:58:04.366136 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2709/5398] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:03 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:04.375700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-08f44883-f794-47ac-a1c2-db427b70621e req-951f4fa4-7af1-4743-ab3a-a4bdac326502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab0d0856-8fcc-48fe-b93e-3f7259653765", "tag": "429e5b15-1cef-48fe-999a-d15cf524c9d2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:04.387140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-08f44883-f794-47ac-a1c2-db427b70621e req-951f4fa4-7af1-4743-ab3a-a4bdac326502 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:04.387899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-08f44883-f794-47ac-a1c2-db427b70621e req-951f4fa4-7af1-4743-ab3a-a4bdac326502 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:04.412114 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-08f44883-f794-47ac-a1c2-db427b70621e req-951f4fa4-7af1-4743-ab3a-a4bdac326502 service nova] Creating event network-changed:429e5b15-1cef-48fe-999a-d15cf524c9d2 for instance ab0d0856-8fcc-48fe-b93e-3f7259653765 on n-h1-767704-28 Jul 14 14:58:04.421339 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-08f44883-f794-47ac-a1c2-db427b70621e req-951f4fa4-7af1-4743-ab3a-a4bdac326502 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052401 Jul 14 14:58:04.423173 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2710/5399] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:04.447390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3707de22-fea0-46fd-a184-d5dd99ea2281 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:04.456739 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3707de22-fea0-46fd-a184-d5dd99ea2281 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1362 microversion: 2.1 time: 0.401279 Jul 14 14:58:04.457688 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2690/5400] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:04 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:04.715208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2754fc86-d94f-4aa7-9400-a00ae9587297 req-fa4bc671-01e9-4924-acfb-250c9adc6320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accee1e3-de25-42fe-b062-e6c330d4e88c", "name": "network-vif-plugged", "status": "completed", "tag": "70641ce3-b2fb-4c43-9416-6a623723ac81"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:04.748154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2754fc86-d94f-4aa7-9400-a00ae9587297 req-fa4bc671-01e9-4924-acfb-250c9adc6320 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:04.755146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2754fc86-d94f-4aa7-9400-a00ae9587297 req-fa4bc671-01e9-4924-acfb-250c9adc6320 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:04.796125 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2754fc86-d94f-4aa7-9400-a00ae9587297 req-fa4bc671-01e9-4924-acfb-250c9adc6320 service nova] Creating event network-vif-plugged:70641ce3-b2fb-4c43-9416-6a623723ac81 for instance accee1e3-de25-42fe-b062-e6c330d4e88c on n-h2-767704-28 Jul 14 14:58:04.806492 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2754fc86-d94f-4aa7-9400-a00ae9587297 req-fa4bc671-01e9-4924-acfb-250c9adc6320 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103029 Jul 14 14:58:04.820788 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2711/5401] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:05.366324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2048c5d9-bb0a-41bf-8635-d6be79975e1e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:05.368326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2048c5d9-bb0a-41bf-8635-d6be79975e1e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:05.382412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2048c5d9-bb0a-41bf-8635-d6be79975e1e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:05.383699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2048c5d9-bb0a-41bf-8635-d6be79975e1e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:05.385205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2048c5d9-bb0a-41bf-8635-d6be79975e1e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:05.387884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2048c5d9-bb0a-41bf-8635-d6be79975e1e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:05.438637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0dfb2e09-b83e-4f54-b80c-a538eddac163 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Action: 'create', calling method: .version_select at 0x7fd6c5712700>, body: {"keypair": {"name": "tempest-keypair-1207859285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgd7qojZdA37pr64FTrXsr5RO/FSmEAQmS0mwq4Jnx9vFCLvZAC8mimmAtgbBk0hT0Ap7pYikWWWJiScKMZ1g4dIS9MMLtD13u6S3WGHjJDBBqiL5NkL+8RI30rmO1Amg=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:05.455466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-0dfb2e09-b83e-4f54-b80c-a538eddac163 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Getting quotas for project 696fe3c794f345898ccdfc30555d420d. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:58:05.461049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-0dfb2e09-b83e-4f54-b80c-a538eddac163 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Getting quotas for user b19287c405854751b7ad4846457b5882 and project 696fe3c794f345898ccdfc30555d420d. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:58:05.499539 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0dfb2e09-b83e-4f54-b80c-a538eddac163 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.065672 Jul 14 14:58:05.500619 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2712/5402] 10.222.0.81 () {62 vars in 1199 bytes} [Thu Jul 14 14:58:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 14 14:58:05.505691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b7ba309c-94d5-4c49-b03a-b1a48add1413 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:05.506782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b7ba309c-94d5-4c49-b03a-b1a48add1413 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:05.515963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7ba309c-94d5-4c49-b03a-b1a48add1413 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:05.517063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7ba309c-94d5-4c49-b03a-b1a48add1413 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:05.518400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7ba309c-94d5-4c49-b03a-b1a48add1413 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:05.519284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7ba309c-94d5-4c49-b03a-b1a48add1413 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:05.750089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2048c5d9-bb0a-41bf-8635-d6be79975e1e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:05.758800 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2048c5d9-bb0a-41bf-8635-d6be79975e1e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1313 microversion: 2.1 time: 0.396808 Jul 14 14:58:05.760364 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2691/5403] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:05 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:06.278264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b7ba309c-94d5-4c49-b03a-b1a48add1413 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:06.286910 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b7ba309c-94d5-4c49-b03a-b1a48add1413 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1362 microversion: 2.1 time: 0.784909 Jul 14 14:58:06.293809 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2713/5404] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:05 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1362 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:06.779093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f9deb12-8a73-4318-a618-0ffde0293066 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:06.780493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1f9deb12-8a73-4318-a618-0ffde0293066 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:06.791413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f9deb12-8a73-4318-a618-0ffde0293066 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:06.794223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f9deb12-8a73-4318-a618-0ffde0293066 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:06.795418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f9deb12-8a73-4318-a618-0ffde0293066 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:06.796075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f9deb12-8a73-4318-a618-0ffde0293066 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:06.806951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:07.193664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1f9deb12-8a73-4318-a618-0ffde0293066 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:07.203453 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f9deb12-8a73-4318-a618-0ffde0293066 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1313 microversion: 2.1 time: 0.430846 Jul 14 14:58:07.204358 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2692/5405] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:06 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:07.310843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b7049076-3902-44dc-92bc-c32abe089fc2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:07.311844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b7049076-3902-44dc-92bc-c32abe089fc2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:07.330682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7049076-3902-44dc-92bc-c32abe089fc2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:07.331159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7049076-3902-44dc-92bc-c32abe089fc2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:07.332028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7049076-3902-44dc-92bc-c32abe089fc2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:07.333271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7049076-3902-44dc-92bc-c32abe089fc2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:07.608080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b7049076-3902-44dc-92bc-c32abe089fc2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:07.636793 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b7049076-3902-44dc-92bc-c32abe089fc2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1547 microversion: 2.1 time: 0.329376 Jul 14 14:58:07.642584 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2714/5406] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:07 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1547 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:07.659058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-25f1f132-f7db-4ed5-8ad8-8dbc143cd27a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:07.659574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-25f1f132-f7db-4ed5-8ad8-8dbc143cd27a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:07.666262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25f1f132-f7db-4ed5-8ad8-8dbc143cd27a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:07.667024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25f1f132-f7db-4ed5-8ad8-8dbc143cd27a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:07.668608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25f1f132-f7db-4ed5-8ad8-8dbc143cd27a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:07.669710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25f1f132-f7db-4ed5-8ad8-8dbc143cd27a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:07.783071 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-25f1f132-f7db-4ed5-8ad8-8dbc143cd27a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128065 Jul 14 14:58:07.783683 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2693/5407] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 14:58:07 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:08.221567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a6dc4bf2-4fe5-4892-b8a6-9d3f0fed7154 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:08.222657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a6dc4bf2-4fe5-4892-b8a6-9d3f0fed7154 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:08.234149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6dc4bf2-4fe5-4892-b8a6-9d3f0fed7154 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:08.234628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6dc4bf2-4fe5-4892-b8a6-9d3f0fed7154 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:08.235409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6dc4bf2-4fe5-4892-b8a6-9d3f0fed7154 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:08.235861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6dc4bf2-4fe5-4892-b8a6-9d3f0fed7154 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:08.360675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1787367529", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "993a5803-cc68-44ca-9776-148e10fa1f91"}], "security_groups": [{"name": "tempest-securitygroup--1946146047"}], "key_name": "tempest-keypair-1207859285", "user_data": "}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:08.482134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a6dc4bf2-4fe5-4892-b8a6-9d3f0fed7154 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:08.498431 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a6dc4bf2-4fe5-4892-b8a6-9d3f0fed7154 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1313 microversion: 2.1 time: 0.278338 Jul 14 14:58:08.499068 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2715/5408] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:08 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:08.521708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:08.562856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:08.639893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] validate_networks() for [('993a5803-cc68-44ca-9776-148e10fa1f91', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:58:09.361641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a0310b82-c379-48ff-9f67-1cd7f51a06ba req-2f1d7636-a85d-440e-832b-20af803eca29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accee1e3-de25-42fe-b062-e6c330d4e88c", "tag": "70641ce3-b2fb-4c43-9416-6a623723ac81"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:09.375663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a0310b82-c379-48ff-9f67-1cd7f51a06ba req-2f1d7636-a85d-440e-832b-20af803eca29 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:09.380454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a0310b82-c379-48ff-9f67-1cd7f51a06ba req-2f1d7636-a85d-440e-832b-20af803eca29 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:09.408604 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a0310b82-c379-48ff-9f67-1cd7f51a06ba req-2f1d7636-a85d-440e-832b-20af803eca29 service nova] Creating event network-changed:70641ce3-b2fb-4c43-9416-6a623723ac81 for instance accee1e3-de25-42fe-b062-e6c330d4e88c on n-h2-767704-28 Jul 14 14:58:09.423233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:58:09.423945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:58:09.424544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:58:09.425233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:58:09.425768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:58:09.426777 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a0310b82-c379-48ff-9f67-1cd7f51a06ba req-2f1d7636-a85d-440e-832b-20af803eca29 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068654 Jul 14 14:58:09.429646 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2716/5409] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:09.466423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:09.468138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:09.471507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:09.471986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:09.514024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Getting quotas for project 696fe3c794f345898ccdfc30555d420d. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:58:09.518214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a7d34f1b-d85b-4901-867f-8c76cd33a240 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:09.519151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a7d34f1b-d85b-4901-867f-8c76cd33a240 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:09.521286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Getting quotas for user b19287c405854751b7ad4846457b5882 and project 696fe3c794f345898ccdfc30555d420d. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:58:09.537729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7d34f1b-d85b-4901-867f-8c76cd33a240 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:09.538283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7d34f1b-d85b-4901-867f-8c76cd33a240 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:09.539167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7d34f1b-d85b-4901-867f-8c76cd33a240 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:09.539837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a7d34f1b-d85b-4901-867f-8c76cd33a240 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:09.541669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:58:09.545537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:58:09.642362 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-17d123ea-4a14-4f06-ad13-f8bd5b5b8282 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.288095 Jul 14 14:58:09.645089 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2694/5410] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jul 14 14:58:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:58:09.657672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e4b3ba91-3132-4dcb-a286-98f77ee84ba1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:09.660273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e4b3ba91-3132-4dcb-a286-98f77ee84ba1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:09.866223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e4b3ba91-3132-4dcb-a286-98f77ee84ba1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:09.878453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e4b3ba91-3132-4dcb-a286-98f77ee84ba1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:09.880017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e4b3ba91-3132-4dcb-a286-98f77ee84ba1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:09.885383 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e4b3ba91-3132-4dcb-a286-98f77ee84ba1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1282 microversion: 2.20 time: 0.230363 Jul 14 14:58:09.898863 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2695/5411] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:09 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1282 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:09.898863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-336d9010-7464-47ca-bca4-a9394f7f54a2 req-70475ac6-2494-4c4f-abe6-ccf9fd7c2fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0d0856-8fcc-48fe-b93e-3f7259653765", "name": "network-vif-plugged", "status": "completed", "tag": "429e5b15-1cef-48fe-999a-d15cf524c9d2"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:09.918175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-336d9010-7464-47ca-bca4-a9394f7f54a2 req-70475ac6-2494-4c4f-abe6-ccf9fd7c2fe4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:09.921414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-336d9010-7464-47ca-bca4-a9394f7f54a2 req-70475ac6-2494-4c4f-abe6-ccf9fd7c2fe4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:09.944226 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-336d9010-7464-47ca-bca4-a9394f7f54a2 req-70475ac6-2494-4c4f-abe6-ccf9fd7c2fe4 service nova] Creating event network-vif-plugged:429e5b15-1cef-48fe-999a-d15cf524c9d2 for instance ab0d0856-8fcc-48fe-b93e-3f7259653765 on n-h1-767704-28 Jul 14 14:58:09.962375 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-336d9010-7464-47ca-bca4-a9394f7f54a2 req-70475ac6-2494-4c4f-abe6-ccf9fd7c2fe4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071158 Jul 14 14:58:09.965146 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2696/5412] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:10.034584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a7d34f1b-d85b-4901-867f-8c76cd33a240 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:10.048337 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a7d34f1b-d85b-4901-867f-8c76cd33a240 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1313 microversion: 2.1 time: 0.534667 Jul 14 14:58:10.051379 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2717/5413] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:09 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:10.909555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c65a0646-3d72-426e-9bb9-d771e1ca138e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:10.910329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c65a0646-3d72-426e-9bb9-d771e1ca138e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:10.917158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c65a0646-3d72-426e-9bb9-d771e1ca138e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.918110 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c65a0646-3d72-426e-9bb9-d771e1ca138e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.918920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c65a0646-3d72-426e-9bb9-d771e1ca138e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.919377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c65a0646-3d72-426e-9bb9-d771e1ca138e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:11.068783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fc70b4e8-bd4d-42ca-8ca0-cf0e4ef64f79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:11.070958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fc70b4e8-bd4d-42ca-8ca0-cf0e4ef64f79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:11.082053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc70b4e8-bd4d-42ca-8ca0-cf0e4ef64f79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:11.083291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc70b4e8-bd4d-42ca-8ca0-cf0e4ef64f79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:11.085070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc70b4e8-bd4d-42ca-8ca0-cf0e4ef64f79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:11.085760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc70b4e8-bd4d-42ca-8ca0-cf0e4ef64f79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:11.086219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c65a0646-3d72-426e-9bb9-d771e1ca138e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:11.116656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c65a0646-3d72-426e-9bb9-d771e1ca138e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:11.122558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c65a0646-3d72-426e-9bb9-d771e1ca138e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:11.124194 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c65a0646-3d72-426e-9bb9-d771e1ca138e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1334 microversion: 2.20 time: 0.220695 Jul 14 14:58:11.131276 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2697/5414] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:10 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1334 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:11.478472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fc70b4e8-bd4d-42ca-8ca0-cf0e4ef64f79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:11.492692 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fc70b4e8-bd4d-42ca-8ca0-cf0e4ef64f79 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1313 microversion: 2.1 time: 0.428544 Jul 14 14:58:11.493684 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2718/5415] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:11 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:12.152097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4299d1d9-7376-4904-9c6e-c5912d0c9bc0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:12.153477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4299d1d9-7376-4904-9c6e-c5912d0c9bc0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:12.156757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:12.162221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4299d1d9-7376-4904-9c6e-c5912d0c9bc0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:12.162791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4299d1d9-7376-4904-9c6e-c5912d0c9bc0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:12.163670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4299d1d9-7376-4904-9c6e-c5912d0c9bc0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:12.164181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4299d1d9-7376-4904-9c6e-c5912d0c9bc0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:12.346705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4299d1d9-7376-4904-9c6e-c5912d0c9bc0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:12.357992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4299d1d9-7376-4904-9c6e-c5912d0c9bc0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:12.360500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4299d1d9-7376-4904-9c6e-c5912d0c9bc0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:12.362044 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4299d1d9-7376-4904-9c6e-c5912d0c9bc0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1340 microversion: 2.20 time: 0.215537 Jul 14 14:58:12.362738 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2698/5416] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:12 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1340 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:12.511924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-63b89f91-d682-41bc-a10c-459d24db7663 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:12.516873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-63b89f91-d682-41bc-a10c-459d24db7663 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:12.521405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:12.526413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63b89f91-d682-41bc-a10c-459d24db7663 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:12.527786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63b89f91-d682-41bc-a10c-459d24db7663 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:12.529208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63b89f91-d682-41bc-a10c-459d24db7663 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:12.529826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63b89f91-d682-41bc-a10c-459d24db7663 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:12.893078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-63b89f91-d682-41bc-a10c-459d24db7663 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:12.921267 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-63b89f91-d682-41bc-a10c-459d24db7663 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1497 microversion: 2.1 time: 0.413562 Jul 14 14:58:12.934657 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2719/5417] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:12 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1497 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:13.385268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d734871f-90c9-4b3b-9cdc-f0ebf412afcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:13.388087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d734871f-90c9-4b3b-9cdc-f0ebf412afcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:13.421867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d734871f-90c9-4b3b-9cdc-f0ebf412afcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.422691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d734871f-90c9-4b3b-9cdc-f0ebf412afcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.423719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d734871f-90c9-4b3b-9cdc-f0ebf412afcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.424672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d734871f-90c9-4b3b-9cdc-f0ebf412afcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.608239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5aeefef1-4c36-4426-9c96-20adca0c0a5c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:13.609704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5aeefef1-4c36-4426-9c96-20adca0c0a5c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:13.619663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5aeefef1-4c36-4426-9c96-20adca0c0a5c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.621064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5aeefef1-4c36-4426-9c96-20adca0c0a5c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.622262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5aeefef1-4c36-4426-9c96-20adca0c0a5c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.623089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5aeefef1-4c36-4426-9c96-20adca0c0a5c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.671508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5aeefef1-4c36-4426-9c96-20adca0c0a5c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:58:13.804683 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5aeefef1-4c36-4426-9c96-20adca0c0a5c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 204 len: 0 microversion: 2.1 time: 0.199995 Jul 14 14:58:13.805945 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2720/5418] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:58:13 2022] DELETE /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:58:13.814210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d734871f-90c9-4b3b-9cdc-f0ebf412afcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:13.821141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bff05739-106c-4c49-ab12-8bb6dc399454 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:13.821863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bff05739-106c-4c49-ab12-8bb6dc399454 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:13.830391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d734871f-90c9-4b3b-9cdc-f0ebf412afcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:13.832269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bff05739-106c-4c49-ab12-8bb6dc399454 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.832494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d734871f-90c9-4b3b-9cdc-f0ebf412afcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:13.832755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bff05739-106c-4c49-ab12-8bb6dc399454 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.833684 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d734871f-90c9-4b3b-9cdc-f0ebf412afcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1408 microversion: 2.20 time: 0.454289 Jul 14 14:58:13.833823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bff05739-106c-4c49-ab12-8bb6dc399454 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.834189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bff05739-106c-4c49-ab12-8bb6dc399454 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.834327 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2699/5419] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:13 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1408 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:14.241833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bff05739-106c-4c49-ab12-8bb6dc399454 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:14.251402 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bff05739-106c-4c49-ab12-8bb6dc399454 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1503 microversion: 2.1 time: 0.438411 Jul 14 14:58:14.252452 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2721/5420] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:13 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1503 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:14.852077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ea88d56-5f21-4c7a-aba7-6f066645c5d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:14.852695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8ea88d56-5f21-4c7a-aba7-6f066645c5d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:14.881961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ea88d56-5f21-4c7a-aba7-6f066645c5d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:14.882768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ea88d56-5f21-4c7a-aba7-6f066645c5d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:14.883830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ea88d56-5f21-4c7a-aba7-6f066645c5d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:14.884651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ea88d56-5f21-4c7a-aba7-6f066645c5d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.251524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8ea88d56-5f21-4c7a-aba7-6f066645c5d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:15.263089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8ea88d56-5f21-4c7a-aba7-6f066645c5d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:15.265797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8ea88d56-5f21-4c7a-aba7-6f066645c5d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:15.267562 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8ea88d56-5f21-4c7a-aba7-6f066645c5d5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1408 microversion: 2.20 time: 0.419436 Jul 14 14:58:15.268681 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2700/5421] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:14 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1408 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:15.281691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cc7b0966-d034-402b-b822-1032ed94d247 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:15.283124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cc7b0966-d034-402b-b822-1032ed94d247 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:15.301237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc7b0966-d034-402b-b822-1032ed94d247 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.301700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc7b0966-d034-402b-b822-1032ed94d247 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.303845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc7b0966-d034-402b-b822-1032ed94d247 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.307071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cc7b0966-d034-402b-b822-1032ed94d247 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.470947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=12 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:15.535420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0aadf42f-09ab-4b25-a6c1-549784402166 req-be31f8af-a604-4c51-8b4e-ea6e3dc5779c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9928624-d55d-4cef-b484-6c377f54271e", "tag": "2c2be47c-cc25-46c1-a7aa-1dde1fe54b61"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:15.547329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0aadf42f-09ab-4b25-a6c1-549784402166 req-be31f8af-a604-4c51-8b4e-ea6e3dc5779c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.548466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0aadf42f-09ab-4b25-a6c1-549784402166 req-be31f8af-a604-4c51-8b4e-ea6e3dc5779c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.570990 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0aadf42f-09ab-4b25-a6c1-549784402166 req-be31f8af-a604-4c51-8b4e-ea6e3dc5779c service nova] Creating event network-changed:2c2be47c-cc25-46c1-a7aa-1dde1fe54b61 for instance e9928624-d55d-4cef-b484-6c377f54271e on n-h2-767704-28 Jul 14 14:58:15.585270 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0aadf42f-09ab-4b25-a6c1-549784402166 req-be31f8af-a604-4c51-8b4e-ea6e3dc5779c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063957 Jul 14 14:58:15.586491 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2701/5422] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:15.885575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cc7b0966-d034-402b-b822-1032ed94d247 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:15.894850 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cc7b0966-d034-402b-b822-1032ed94d247 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1503 microversion: 2.1 time: 0.628577 Jul 14 14:58:15.895935 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2722/5423] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:15 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1503 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:16.289768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-605bb589-e95f-4fe6-b07c-c6dc0988acc4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:16.291377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-605bb589-e95f-4fe6-b07c-c6dc0988acc4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:16.307219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-605bb589-e95f-4fe6-b07c-c6dc0988acc4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:16.309207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-605bb589-e95f-4fe6-b07c-c6dc0988acc4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:16.310433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-605bb589-e95f-4fe6-b07c-c6dc0988acc4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:16.311103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-605bb589-e95f-4fe6-b07c-c6dc0988acc4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:16.681957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-605bb589-e95f-4fe6-b07c-c6dc0988acc4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:16.691244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-605bb589-e95f-4fe6-b07c-c6dc0988acc4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:16.692869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-605bb589-e95f-4fe6-b07c-c6dc0988acc4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:16.694400 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-605bb589-e95f-4fe6-b07c-c6dc0988acc4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1408 microversion: 2.20 time: 0.411086 Jul 14 14:58:16.695479 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2702/5424] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:16 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1408 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:16.914074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-40ee6b3e-7dd1-46cc-b616-30705f3189e9 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:16.914688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-40ee6b3e-7dd1-46cc-b616-30705f3189e9 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:16.927857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40ee6b3e-7dd1-46cc-b616-30705f3189e9 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:16.928386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40ee6b3e-7dd1-46cc-b616-30705f3189e9 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:16.929323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40ee6b3e-7dd1-46cc-b616-30705f3189e9 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:16.930007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40ee6b3e-7dd1-46cc-b616-30705f3189e9 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:16.983742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40ee6b3e-7dd1-46cc-b616-30705f3189e9 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:16.985121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40ee6b3e-7dd1-46cc-b616-30705f3189e9 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:16.986039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-40ee6b3e-7dd1-46cc-b616-30705f3189e9 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lazy-loading 'fault' on Instance uuid ab0d0856-8fcc-48fe-b93e-3f7259653765 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:17.056256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-40ee6b3e-7dd1-46cc-b616-30705f3189e9 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:17.064923 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-40ee6b3e-7dd1-46cc-b616-30705f3189e9 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 200 len: 1303 microversion: 2.1 time: 0.154676 Jul 14 14:58:17.065850 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2723/5425] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:16 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:17.684369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-4a28e840-4140-4644-9046-bf2209c95da1 req-f6a42c46-4d82-418e-a7a3-55284cbcdd51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0d0856-8fcc-48fe-b93e-3f7259653765", "name": "network-vif-deleted", "tag": "429e5b15-1cef-48fe-999a-d15cf524c9d2"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:17.708298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4a28e840-4140-4644-9046-bf2209c95da1 req-f6a42c46-4d82-418e-a7a3-55284cbcdd51 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.709277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4a28e840-4140-4644-9046-bf2209c95da1 req-f6a42c46-4d82-418e-a7a3-55284cbcdd51 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.714526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6338c730-2c3f-4de5-915a-7a86cd66b312 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:17.715195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6338c730-2c3f-4de5-915a-7a86cd66b312 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:17.722205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6338c730-2c3f-4de5-915a-7a86cd66b312 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.723286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6338c730-2c3f-4de5-915a-7a86cd66b312 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.724389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6338c730-2c3f-4de5-915a-7a86cd66b312 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.725163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6338c730-2c3f-4de5-915a-7a86cd66b312 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.734450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:17.748427 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-4a28e840-4140-4644-9046-bf2209c95da1 req-f6a42c46-4d82-418e-a7a3-55284cbcdd51 service nova] Creating event network-vif-deleted:429e5b15-1cef-48fe-999a-d15cf524c9d2 for instance ab0d0856-8fcc-48fe-b93e-3f7259653765 on n-h1-767704-28 Jul 14 14:58:17.758752 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-4a28e840-4140-4644-9046-bf2209c95da1 req-f6a42c46-4d82-418e-a7a3-55284cbcdd51 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078037 Jul 14 14:58:17.760049 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2703/5426] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:18.086969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4bda5a6-e3e3-4024-8d4f-eb2a6e172874 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:18.087915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b4bda5a6-e3e3-4024-8d4f-eb2a6e172874 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: ab0d0856-8fcc-48fe-b93e-3f7259653765] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:18.095185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4bda5a6-e3e3-4024-8d4f-eb2a6e172874 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.095915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4bda5a6-e3e3-4024-8d4f-eb2a6e172874 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.096851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4bda5a6-e3e3-4024-8d4f-eb2a6e172874 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.097471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4bda5a6-e3e3-4024-8d4f-eb2a6e172874 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.114641 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b4bda5a6-e3e3-4024-8d4f-eb2a6e172874 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] HTTP exception thrown: Instance ab0d0856-8fcc-48fe-b93e-3f7259653765 could not be found. Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4bda5a6-e3e3-4024-8d4f-eb2a6e172874 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Request method failure captured: Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 HTTP/1.1 Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C7wdL67iRJFVWy6a6i0OtmaaMtb6b6Gqm2QdvuZ6Jn6oAjtwsX_tIrLurSoVz0loOm9TJ5q7lJPURFAZGZicPXfGZdjGSnHI57RJLGs9pJCvMlPwbYwekmlUws3D3r4qlBeXN7hdte98GveDhkf350wn_0qugSzhGwFFogMzO9SmSg Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1420a918066140fe8fd6877cd8a2b514 Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesActionsTest-1027602570 Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1420a918066140fe8fd6877cd8a2b514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1420a918066140fe8fd6877cd8a2b514"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1420a918066140fe8fd6877cd8a2b514", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1420a918066140fe8fd6877cd8a2b514"}]}] Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesActionsTest-1027602570 Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1420a918066140fe8fd6877cd8a2b514 Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesActionsTest-1027602570 Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesActionsTest-1027602570-project Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 862f63b48b954c1491b06a51565167ac Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesActionsTest-1027602570-project Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance ab0d0856-8fcc-48fe-b93e-3f7259653765 could not be found. Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'ab0d0856-8fcc-48fe-b93e-3f7259653765'} Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab0d0856-8fcc-48fe-b93e-3f7259653765 could not be found. Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab0d0856-8fcc-48fe-b93e-3f7259653765 could not be found. Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:58:18.117052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:18.123771 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:18.123771 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:58:18.123771 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:58:18.123771 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:58:18.123771 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:58:18.123771 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab0d0856-8fcc-48fe-b93e-3f7259653765 could not be found. Jul 14 14:58:18.123771 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:18.126240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4bda5a6-e3e3-4024-8d4f-eb2a6e172874 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Returning 404 to user: Instance ab0d0856-8fcc-48fe-b93e-3f7259653765 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:58:18.127386 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b4bda5a6-e3e3-4024-8d4f-eb2a6e172874 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765" status: 404 len: 111 microversion: 2.1 time: 0.044792 Jul 14 14:58:18.128204 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2704/5427] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:18 2022] GET /compute/v2.1/servers/ab0d0856-8fcc-48fe-b93e-3f7259653765 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:58:18.142875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6338c730-2c3f-4de5-915a-7a86cd66b312 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:18.166443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6338c730-2c3f-4de5-915a-7a86cd66b312 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:18.171575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6338c730-2c3f-4de5-915a-7a86cd66b312 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:18.176023 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6338c730-2c3f-4de5-915a-7a86cd66b312 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1408 microversion: 2.20 time: 0.463851 Jul 14 14:58:18.176656 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2724/5428] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:17 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:18.243262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1203840619", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "7f940052-ebb9-4860-a6c6-432d170fab66"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:18.346073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] validate_networks() for [('7f940052-ebb9-4860-a6c6-432d170fab66', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:58:19.200450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31fdcf0a-8663-4d73-b113-1fb2668087f8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:19.205275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-31fdcf0a-8663-4d73-b113-1fb2668087f8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:19.239787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31fdcf0a-8663-4d73-b113-1fb2668087f8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:19.240824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31fdcf0a-8663-4d73-b113-1fb2668087f8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:19.244662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31fdcf0a-8663-4d73-b113-1fb2668087f8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:19.252191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31fdcf0a-8663-4d73-b113-1fb2668087f8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:19.490505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:19.871569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:20.134282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-31fdcf0a-8663-4d73-b113-1fb2668087f8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:20.149548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-31fdcf0a-8663-4d73-b113-1fb2668087f8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:20.153268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-31fdcf0a-8663-4d73-b113-1fb2668087f8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:20.154948 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-31fdcf0a-8663-4d73-b113-1fb2668087f8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1408 microversion: 2.20 time: 0.963825 Jul 14 14:58:20.155895 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2725/5429] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:19 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1408 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:58:20.252661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:58:20.253133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:58:20.253706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:58:20.254137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:58:20.254755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:58:20.275373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.275909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.278959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.279804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.302966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Getting quotas for project 1420a918066140fe8fd6877cd8a2b514. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:58:20.311767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Getting quotas for user 862f63b48b954c1491b06a51565167ac and project 1420a918066140fe8fd6877cd8a2b514. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:58:20.329854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:58:20.332189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:58:20.388247 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1bc38f77-4fe1-47ed-a906-8501d1464811 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.148770 Jul 14 14:58:20.389301 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2705/5430] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:58:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:58:20.399565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ee678e1-5913-49f7-a6ed-ab2bff00f113 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:20.399990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ee678e1-5913-49f7-a6ed-ab2bff00f113 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:20.587204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ee678e1-5913-49f7-a6ed-ab2bff00f113 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:20.602909 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ee678e1-5913-49f7-a6ed-ab2bff00f113 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1214 microversion: 2.1 time: 0.206984 Jul 14 14:58:20.616757 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2726/5431] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:20 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:20.986673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-5194253d-a12e-4637-b562-a9fd87e320b5 req-137c38a7-7d34-410a-be30-8757091c1e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9928624-d55d-4cef-b484-6c377f54271e", "name": "network-vif-plugged", "status": "completed", "tag": "2c2be47c-cc25-46c1-a7aa-1dde1fe54b61"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:21.003704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5194253d-a12e-4637-b562-a9fd87e320b5 req-137c38a7-7d34-410a-be30-8757091c1e98 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.004450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5194253d-a12e-4637-b562-a9fd87e320b5 req-137c38a7-7d34-410a-be30-8757091c1e98 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.022084 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-5194253d-a12e-4637-b562-a9fd87e320b5 req-137c38a7-7d34-410a-be30-8757091c1e98 service nova] Creating event network-vif-plugged:2c2be47c-cc25-46c1-a7aa-1dde1fe54b61 for instance e9928624-d55d-4cef-b484-6c377f54271e on n-h2-767704-28 Jul 14 14:58:21.040771 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-5194253d-a12e-4637-b562-a9fd87e320b5 req-137c38a7-7d34-410a-be30-8757091c1e98 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058495 Jul 14 14:58:21.045841 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2706/5432] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:21.178779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2cd08b39-d534-41e7-95fd-f2ba8ac73fc7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:21.179559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2cd08b39-d534-41e7-95fd-f2ba8ac73fc7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:21.205028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2cd08b39-d534-41e7-95fd-f2ba8ac73fc7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.206741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2cd08b39-d534-41e7-95fd-f2ba8ac73fc7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.208217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2cd08b39-d534-41e7-95fd-f2ba8ac73fc7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.210637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2cd08b39-d534-41e7-95fd-f2ba8ac73fc7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.625184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5145f68-e96e-4336-aa51-60634db4623f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:21.626328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d5145f68-e96e-4336-aa51-60634db4623f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:21.646236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5145f68-e96e-4336-aa51-60634db4623f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.647147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5145f68-e96e-4336-aa51-60634db4623f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.648116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5145f68-e96e-4336-aa51-60634db4623f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.648722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5145f68-e96e-4336-aa51-60634db4623f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.780654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d5145f68-e96e-4336-aa51-60634db4623f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:21.811407 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d5145f68-e96e-4336-aa51-60634db4623f tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1266 microversion: 2.1 time: 0.191807 Jul 14 14:58:21.813245 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2707/5433] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:21 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:21.822379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2cd08b39-d534-41e7-95fd-f2ba8ac73fc7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:21.838155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2cd08b39-d534-41e7-95fd-f2ba8ac73fc7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:21.842287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2cd08b39-d534-41e7-95fd-f2ba8ac73fc7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:21.843555 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2cd08b39-d534-41e7-95fd-f2ba8ac73fc7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1408 microversion: 2.20 time: 0.673321 Jul 14 14:58:21.846028 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2727/5434] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:21 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1408 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:22.831234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7c1644eb-c6ff-41b6-8709-386fcce105d3 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:22.833834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7c1644eb-c6ff-41b6-8709-386fcce105d3 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:22.842507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c1644eb-c6ff-41b6-8709-386fcce105d3 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:22.843876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c1644eb-c6ff-41b6-8709-386fcce105d3 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:22.845020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c1644eb-c6ff-41b6-8709-386fcce105d3 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:22.845694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c1644eb-c6ff-41b6-8709-386fcce105d3 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:22.862991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b8e93d32-5d11-4c2f-846b-fb0aa3560c96 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:22.864771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b8e93d32-5d11-4c2f-846b-fb0aa3560c96 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:22.908349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8e93d32-5d11-4c2f-846b-fb0aa3560c96 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:22.909152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8e93d32-5d11-4c2f-846b-fb0aa3560c96 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:22.910780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8e93d32-5d11-4c2f-846b-fb0aa3560c96 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:22.912681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8e93d32-5d11-4c2f-846b-fb0aa3560c96 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:23.302582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7c1644eb-c6ff-41b6-8709-386fcce105d3 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:23.321784 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7c1644eb-c6ff-41b6-8709-386fcce105d3 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1272 microversion: 2.1 time: 0.493736 Jul 14 14:58:23.325163 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2708/5435] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:22 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1272 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:23.476234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b8e93d32-5d11-4c2f-846b-fb0aa3560c96 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:23.489508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b8e93d32-5d11-4c2f-846b-fb0aa3560c96 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:23.497688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b8e93d32-5d11-4c2f-846b-fb0aa3560c96 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:23.503771 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b8e93d32-5d11-4c2f-846b-fb0aa3560c96 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1408 microversion: 2.20 time: 0.642101 Jul 14 14:58:23.505084 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2728/5436] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:22 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1408 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:58:24.344211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-822201cf-53d6-4723-8eaa-7520d3e92de6 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:24.345503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-822201cf-53d6-4723-8eaa-7520d3e92de6 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:24.362927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-822201cf-53d6-4723-8eaa-7520d3e92de6 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:24.363548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-822201cf-53d6-4723-8eaa-7520d3e92de6 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:24.365250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-822201cf-53d6-4723-8eaa-7520d3e92de6 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:24.366173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-822201cf-53d6-4723-8eaa-7520d3e92de6 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:24.527684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c0fa2f2f-c432-4999-ad67-3bfe0d0270a4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:24.529076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c0fa2f2f-c432-4999-ad67-3bfe0d0270a4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:24.544060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0fa2f2f-c432-4999-ad67-3bfe0d0270a4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:24.544810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0fa2f2f-c432-4999-ad67-3bfe0d0270a4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:24.545790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0fa2f2f-c432-4999-ad67-3bfe0d0270a4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:24.546500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0fa2f2f-c432-4999-ad67-3bfe0d0270a4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:24.883900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-822201cf-53d6-4723-8eaa-7520d3e92de6 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:24.895602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c0fa2f2f-c432-4999-ad67-3bfe0d0270a4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:24.904226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c0fa2f2f-c432-4999-ad67-3bfe0d0270a4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:24.906266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c0fa2f2f-c432-4999-ad67-3bfe0d0270a4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:24.913401 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c0fa2f2f-c432-4999-ad67-3bfe0d0270a4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1599 microversion: 2.20 time: 0.394226 Jul 14 14:58:24.914278 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2729/5437] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:24 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1599 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:58:24.916145 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-822201cf-53d6-4723-8eaa-7520d3e92de6 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1314 microversion: 2.1 time: 0.576195 Jul 14 14:58:24.917996 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2709/5438] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:24 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:24.939928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ce025a9-d976-423c-ae01-a41f196522d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:24.940588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ce025a9-d976-423c-ae01-a41f196522d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:24.954501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ce025a9-d976-423c-ae01-a41f196522d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:24.955024 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ce025a9-d976-423c-ae01-a41f196522d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:24.955823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ce025a9-d976-423c-ae01-a41f196522d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:24.956263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ce025a9-d976-423c-ae01-a41f196522d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:25.203615 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ce025a9-d976-423c-ae01-a41f196522d2 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.273620 Jul 14 14:58:25.204209 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2730/5439] 10.222.0.81 () {60 vars in 1315 bytes} [Thu Jul 14 14:58:24 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/os-interface => generated 284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:58:25.936886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-345433c8-5f17-448a-8291-b1a6bc8c9650 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:25.937978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-345433c8-5f17-448a-8291-b1a6bc8c9650 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:25.955066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-345433c8-5f17-448a-8291-b1a6bc8c9650 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:25.955539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-345433c8-5f17-448a-8291-b1a6bc8c9650 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:25.962070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-345433c8-5f17-448a-8291-b1a6bc8c9650 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:25.962628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-345433c8-5f17-448a-8291-b1a6bc8c9650 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:26.274225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-345433c8-5f17-448a-8291-b1a6bc8c9650 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:26.284772 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-345433c8-5f17-448a-8291-b1a6bc8c9650 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1314 microversion: 2.1 time: 0.352930 Jul 14 14:58:26.302703 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2710/5440] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:25 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:26.438269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0b41dd38-4376-4fd5-92d9-b6f1da8a1b53 req-7913f5f1-b82f-492d-88c0-eff4ebde20be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf8e2bb-e164-40b2-8003-cb368df6da19", "tag": "e291159d-d987-43f0-bdcd-c162302803ed"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:26.452395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0b41dd38-4376-4fd5-92d9-b6f1da8a1b53 req-7913f5f1-b82f-492d-88c0-eff4ebde20be service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:26.453174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0b41dd38-4376-4fd5-92d9-b6f1da8a1b53 req-7913f5f1-b82f-492d-88c0-eff4ebde20be service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:26.486731 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0b41dd38-4376-4fd5-92d9-b6f1da8a1b53 req-7913f5f1-b82f-492d-88c0-eff4ebde20be service nova] Creating event network-changed:e291159d-d987-43f0-bdcd-c162302803ed for instance 0cf8e2bb-e164-40b2-8003-cb368df6da19 on n-h1-767704-28 Jul 14 14:58:26.492138 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0b41dd38-4376-4fd5-92d9-b6f1da8a1b53 req-7913f5f1-b82f-492d-88c0-eff4ebde20be service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063602 Jul 14 14:58:26.493585 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2731/5441] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:27.311190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-12a486a9-d276-4cc7-b9e5-0605f7473c01 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:27.312145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-12a486a9-d276-4cc7-b9e5-0605f7473c01 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:27.320209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-12a486a9-d276-4cc7-b9e5-0605f7473c01 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:27.320767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-12a486a9-d276-4cc7-b9e5-0605f7473c01 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:27.321683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-12a486a9-d276-4cc7-b9e5-0605f7473c01 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:27.322240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-12a486a9-d276-4cc7-b9e5-0605f7473c01 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:27.655055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-12a486a9-d276-4cc7-b9e5-0605f7473c01 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:27.669052 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-12a486a9-d276-4cc7-b9e5-0605f7473c01 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1314 microversion: 2.1 time: 0.362458 Jul 14 14:58:27.673268 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2711/5442] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:27 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:27.875605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-99c4fd11-367a-4348-acc5-0c8f21a1edf5 req-f84d0e94-51b8-4bc0-a074-fa782063a121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9928624-d55d-4cef-b484-6c377f54271e", "tag": "2c2be47c-cc25-46c1-a7aa-1dde1fe54b61"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:27.896982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-99c4fd11-367a-4348-acc5-0c8f21a1edf5 req-f84d0e94-51b8-4bc0-a074-fa782063a121 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:27.896982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-99c4fd11-367a-4348-acc5-0c8f21a1edf5 req-f84d0e94-51b8-4bc0-a074-fa782063a121 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:27.903322 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-99c4fd11-367a-4348-acc5-0c8f21a1edf5 req-f84d0e94-51b8-4bc0-a074-fa782063a121 service nova] Creating event network-changed:2c2be47c-cc25-46c1-a7aa-1dde1fe54b61 for instance e9928624-d55d-4cef-b484-6c377f54271e on n-h2-767704-28 Jul 14 14:58:27.910273 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-99c4fd11-367a-4348-acc5-0c8f21a1edf5 req-f84d0e94-51b8-4bc0-a074-fa782063a121 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040437 Jul 14 14:58:27.911916 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2732/5443] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:28.689360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e8f81275-ed70-4ede-bf54-363b4c977088 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:28.690024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e8f81275-ed70-4ede-bf54-363b4c977088 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:28.702436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8f81275-ed70-4ede-bf54-363b4c977088 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.704334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8f81275-ed70-4ede-bf54-363b4c977088 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.705429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8f81275-ed70-4ede-bf54-363b4c977088 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.706599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8f81275-ed70-4ede-bf54-363b4c977088 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.984546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e8f81275-ed70-4ede-bf54-363b4c977088 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:28.993838 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e8f81275-ed70-4ede-bf54-363b4c977088 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1314 microversion: 2.1 time: 0.308315 Jul 14 14:58:28.994768 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2712/5444] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:28 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:30.014023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2940c289-c91f-4e60-88b3-a83d201ee33e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:30.014805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2940c289-c91f-4e60-88b3-a83d201ee33e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:30.043509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2940c289-c91f-4e60-88b3-a83d201ee33e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:30.044561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2940c289-c91f-4e60-88b3-a83d201ee33e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:30.045402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2940c289-c91f-4e60-88b3-a83d201ee33e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:30.045842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2940c289-c91f-4e60-88b3-a83d201ee33e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:30.322724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2940c289-c91f-4e60-88b3-a83d201ee33e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:30.332749 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2940c289-c91f-4e60-88b3-a83d201ee33e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1314 microversion: 2.1 time: 0.323983 Jul 14 14:58:30.333916 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2733/5445] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:30 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:31.354448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d73e031d-45f8-4413-8034-c948e31d7d95 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:31.357700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d73e031d-45f8-4413-8034-c948e31d7d95 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:31.364770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:31.367324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:31.377089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d73e031d-45f8-4413-8034-c948e31d7d95 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:31.379055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d73e031d-45f8-4413-8034-c948e31d7d95 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:31.380275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d73e031d-45f8-4413-8034-c948e31d7d95 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:31.381792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d73e031d-45f8-4413-8034-c948e31d7d95 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:31.725378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d73e031d-45f8-4413-8034-c948e31d7d95 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:31.736939 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d73e031d-45f8-4413-8034-c948e31d7d95 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1314 microversion: 2.1 time: 0.389484 Jul 14 14:58:31.738200 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2713/5446] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:31 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:32.755679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d9977c38-3814-47ef-b674-574d0d65b98e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:32.756511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d9977c38-3814-47ef-b674-574d0d65b98e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:32.766135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:32.771677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9977c38-3814-47ef-b674-574d0d65b98e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:32.772287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9977c38-3814-47ef-b674-574d0d65b98e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:32.773257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9977c38-3814-47ef-b674-574d0d65b98e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:32.773996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9977c38-3814-47ef-b674-574d0d65b98e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:33.026118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d9977c38-3814-47ef-b674-574d0d65b98e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:33.040784 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d9977c38-3814-47ef-b674-574d0d65b98e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1314 microversion: 2.1 time: 0.288923 Jul 14 14:58:33.050919 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2734/5447] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:32 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:34.066033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99852493-ef99-48d3-af0c-f8285e8f4bff tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:34.070568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-99852493-ef99-48d3-af0c-f8285e8f4bff tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:34.092373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99852493-ef99-48d3-af0c-f8285e8f4bff tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:34.100256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99852493-ef99-48d3-af0c-f8285e8f4bff tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:34.102328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99852493-ef99-48d3-af0c-f8285e8f4bff tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:34.103698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99852493-ef99-48d3-af0c-f8285e8f4bff tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:34.759427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5aafafbb-4309-4952-a892-5bedbce8ba58 req-c28588a4-c678-40f7-9901-ceec2153e51c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf8e2bb-e164-40b2-8003-cb368df6da19", "name": "network-vif-plugged", "status": "completed", "tag": "e291159d-d987-43f0-bdcd-c162302803ed"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:34.799326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5aafafbb-4309-4952-a892-5bedbce8ba58 req-c28588a4-c678-40f7-9901-ceec2153e51c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:34.800207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5aafafbb-4309-4952-a892-5bedbce8ba58 req-c28588a4-c678-40f7-9901-ceec2153e51c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:34.832789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5aafafbb-4309-4952-a892-5bedbce8ba58 req-c28588a4-c678-40f7-9901-ceec2153e51c service nova] Creating event network-vif-plugged:e291159d-d987-43f0-bdcd-c162302803ed for instance 0cf8e2bb-e164-40b2-8003-cb368df6da19 on n-h1-767704-28 Jul 14 14:58:34.840926 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5aafafbb-4309-4952-a892-5bedbce8ba58 req-c28588a4-c678-40f7-9901-ceec2153e51c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086955 Jul 14 14:58:34.842019 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2735/5448] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:35.225314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-99852493-ef99-48d3-af0c-f8285e8f4bff tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:35.234391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=100 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:35.243855 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99852493-ef99-48d3-af0c-f8285e8f4bff tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1314 microversion: 2.1 time: 1.188808 Jul 14 14:58:35.247668 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2714/5449] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:34 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1314 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:36.277717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-30a3b918-1e99-4a4e-82b1-de610c58c3cc tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:36.279086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-30a3b918-1e99-4a4e-82b1-de610c58c3cc tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:36.301602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30a3b918-1e99-4a4e-82b1-de610c58c3cc tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:36.304049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30a3b918-1e99-4a4e-82b1-de610c58c3cc tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:36.308691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30a3b918-1e99-4a4e-82b1-de610c58c3cc tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:36.310072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30a3b918-1e99-4a4e-82b1-de610c58c3cc tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:36.883986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-30a3b918-1e99-4a4e-82b1-de610c58c3cc tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:36.895613 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-30a3b918-1e99-4a4e-82b1-de610c58c3cc tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1314 microversion: 2.1 time: 0.635395 Jul 14 14:58:36.905594 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2736/5450] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:36 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:37.924985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c903bcd2-e0dd-4cb0-b564-11bf838fc6b5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:37.926258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c903bcd2-e0dd-4cb0-b564-11bf838fc6b5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:37.934782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c903bcd2-e0dd-4cb0-b564-11bf838fc6b5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:37.935617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c903bcd2-e0dd-4cb0-b564-11bf838fc6b5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:37.937196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c903bcd2-e0dd-4cb0-b564-11bf838fc6b5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:37.939480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c903bcd2-e0dd-4cb0-b564-11bf838fc6b5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:38.188486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c903bcd2-e0dd-4cb0-b564-11bf838fc6b5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:38.198088 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c903bcd2-e0dd-4cb0-b564-11bf838fc6b5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1498 microversion: 2.1 time: 0.278177 Jul 14 14:58:38.201980 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2715/5451] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:37 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1498 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:39.119451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-446314f2-5f0a-46da-93b9-4229feb3890a tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:39.121162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-446314f2-5f0a-46da-93b9-4229feb3890a tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:39.176813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-446314f2-5f0a-46da-93b9-4229feb3890a tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:39.177483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-446314f2-5f0a-46da-93b9-4229feb3890a tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:39.178344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-446314f2-5f0a-46da-93b9-4229feb3890a tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:39.178795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-446314f2-5f0a-46da-93b9-4229feb3890a tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:39.300987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-446314f2-5f0a-46da-93b9-4229feb3890a tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:58:39.521143 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-446314f2-5f0a-46da-93b9-4229feb3890a tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 204 len: 0 microversion: 2.1 time: 0.405935 Jul 14 14:58:39.521978 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2737/5452] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:58:39 2022] DELETE /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:58:39.531269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1c5c4ce4-4a31-4aa6-9492-1ba286f0f19c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:39.531968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1c5c4ce4-4a31-4aa6-9492-1ba286f0f19c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:39.557128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c5c4ce4-4a31-4aa6-9492-1ba286f0f19c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:39.560853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c5c4ce4-4a31-4aa6-9492-1ba286f0f19c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:39.563131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c5c4ce4-4a31-4aa6-9492-1ba286f0f19c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:39.563970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c5c4ce4-4a31-4aa6-9492-1ba286f0f19c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:39.878185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1c5c4ce4-4a31-4aa6-9492-1ba286f0f19c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:39.897749 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1c5c4ce4-4a31-4aa6-9492-1ba286f0f19c tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1504 microversion: 2.1 time: 0.371367 Jul 14 14:58:39.898889 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2716/5453] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:39 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:40.917756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-543c24a6-9cfa-4a31-889e-ffba8b5731a5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:40.919985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-543c24a6-9cfa-4a31-889e-ffba8b5731a5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:40.928005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-543c24a6-9cfa-4a31-889e-ffba8b5731a5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:40.928387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-543c24a6-9cfa-4a31-889e-ffba8b5731a5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:40.929243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-543c24a6-9cfa-4a31-889e-ffba8b5731a5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:40.929693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-543c24a6-9cfa-4a31-889e-ffba8b5731a5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:41.091427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-543c24a6-9cfa-4a31-889e-ffba8b5731a5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:41.099670 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-543c24a6-9cfa-4a31-889e-ffba8b5731a5 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1504 microversion: 2.1 time: 0.187609 Jul 14 14:58:41.109830 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2738/5454] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:40 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:42.118593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b8914c37-64fd-4485-b435-85c7bc41295e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:42.119248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b8914c37-64fd-4485-b435-85c7bc41295e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:42.137743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8914c37-64fd-4485-b435-85c7bc41295e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:42.138094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8914c37-64fd-4485-b435-85c7bc41295e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:42.140163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8914c37-64fd-4485-b435-85c7bc41295e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:42.140815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8914c37-64fd-4485-b435-85c7bc41295e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:42.195701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8914c37-64fd-4485-b435-85c7bc41295e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:42.196389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8914c37-64fd-4485-b435-85c7bc41295e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:42.197041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-b8914c37-64fd-4485-b435-85c7bc41295e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lazy-loading 'fault' on Instance uuid 0cf8e2bb-e164-40b2-8003-cb368df6da19 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:42.227906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c15b8a8d-49e5-41bd-8181-eb360526899c req-1c0e463d-5f04-4da4-a6fe-0df22f653908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf8e2bb-e164-40b2-8003-cb368df6da19", "name": "network-vif-deleted", "tag": "e291159d-d987-43f0-bdcd-c162302803ed"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:42.235981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:42.248858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c15b8a8d-49e5-41bd-8181-eb360526899c req-1c0e463d-5f04-4da4-a6fe-0df22f653908 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:42.249372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c15b8a8d-49e5-41bd-8181-eb360526899c req-1c0e463d-5f04-4da4-a6fe-0df22f653908 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:42.281918 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c15b8a8d-49e5-41bd-8181-eb360526899c req-1c0e463d-5f04-4da4-a6fe-0df22f653908 service nova] Creating event network-vif-deleted:e291159d-d987-43f0-bdcd-c162302803ed for instance 0cf8e2bb-e164-40b2-8003-cb368df6da19 on n-h1-767704-28 Jul 14 14:58:42.287730 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c15b8a8d-49e5-41bd-8181-eb360526899c req-1c0e463d-5f04-4da4-a6fe-0df22f653908 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.313082 Jul 14 14:58:42.288936 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2717/5455] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:42.353151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b8914c37-64fd-4485-b435-85c7bc41295e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862f63b48b954c1491b06a51565167ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1420a918066140fe8fd6877cd8a2b514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:42.363605 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b8914c37-64fd-4485-b435-85c7bc41295e tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 200 len: 1304 microversion: 2.1 time: 0.250417 Jul 14 14:58:42.364588 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2739/5456] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:42 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 1304 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:43.387727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fd2cde1a-471a-4f46-a59f-c638cc871002 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:43.390427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fd2cde1a-471a-4f46-a59f-c638cc871002 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] [instance: 0cf8e2bb-e164-40b2-8003-cb368df6da19] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:43.411757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd2cde1a-471a-4f46-a59f-c638cc871002 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:43.413063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd2cde1a-471a-4f46-a59f-c638cc871002 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:43.415041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd2cde1a-471a-4f46-a59f-c638cc871002 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:43.415667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd2cde1a-471a-4f46-a59f-c638cc871002 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:43.455253 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-fd2cde1a-471a-4f46-a59f-c638cc871002 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] HTTP exception thrown: Instance 0cf8e2bb-e164-40b2-8003-cb368df6da19 could not be found. Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fd2cde1a-471a-4f46-a59f-c638cc871002 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Request method failure captured: Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 HTTP/1.1 Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C7wdL67iRJFVWy6a6i0OtmaaMtb6b6Gqm2QdvuZ6Jn6oAjtwsX_tIrLurSoVz0loOm9TJ5q7lJPURFAZGZicPXfGZdjGSnHI57RJLGs9pJCvMlPwbYwekmlUws3D3r4qlBeXN7hdte98GveDhkf350wn_0qugSzhGwFFogMzO9SmSg Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 1420a918066140fe8fd6877cd8a2b514 Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesActionsTest-1027602570 Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1420a918066140fe8fd6877cd8a2b514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1420a918066140fe8fd6877cd8a2b514"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1420a918066140fe8fd6877cd8a2b514", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1420a918066140fe8fd6877cd8a2b514"}]}] Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesActionsTest-1027602570 Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 1420a918066140fe8fd6877cd8a2b514 Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesActionsTest-1027602570 Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesActionsTest-1027602570-project Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 862f63b48b954c1491b06a51565167ac Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesActionsTest-1027602570-project Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 0cf8e2bb-e164-40b2-8003-cb368df6da19 could not be found. Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0cf8e2bb-e164-40b2-8003-cb368df6da19'} Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf8e2bb-e164-40b2-8003-cb368df6da19 could not be found. Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf8e2bb-e164-40b2-8003-cb368df6da19 could not be found. Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:58:43.457805 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:43.462196 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:43.462196 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:58:43.462196 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:58:43.462196 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:58:43.462196 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:58:43.462196 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf8e2bb-e164-40b2-8003-cb368df6da19 could not be found. Jul 14 14:58:43.462196 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:58:43.466989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fd2cde1a-471a-4f46-a59f-c638cc871002 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] Returning 404 to user: Instance 0cf8e2bb-e164-40b2-8003-cb368df6da19 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:58:43.468153 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fd2cde1a-471a-4f46-a59f-c638cc871002 tempest-VolumesActionsTest-1027602570 tempest-VolumesActionsTest-1027602570-project] 10.222.0.81 "GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19" status: 404 len: 111 microversion: 2.1 time: 0.090222 Jul 14 14:58:43.472419 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2718/5457] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:43 2022] GET /compute/v2.1/servers/0cf8e2bb-e164-40b2-8003-cb368df6da19 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:58:44.895694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-92b158ea-d33a-4a2f-a60d-91b8ed6c8191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:44.896280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-92b158ea-d33a-4a2f-a60d-91b8ed6c8191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:44.909478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:44.928808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92b158ea-d33a-4a2f-a60d-91b8ed6c8191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:44.929350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92b158ea-d33a-4a2f-a60d-91b8ed6c8191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:44.930219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92b158ea-d33a-4a2f-a60d-91b8ed6c8191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:44.930678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92b158ea-d33a-4a2f-a60d-91b8ed6c8191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:45.026537 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-92b158ea-d33a-4a2f-a60d-91b8ed6c8191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/ips" status: 200 len: 144 microversion: 2.1 time: 0.134736 Jul 14 14:58:45.029725 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2740/5458] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 14:58:44 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/ips => generated 144 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:49.265542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d08ec57-fc72-40a1-8d71-323d33773a69 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8378f0a-ce7a-45bf-9058-1c24376de3b1"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:49.267854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6d08ec57-fc72-40a1-8d71-323d33773a69 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:49.291455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d08ec57-fc72-40a1-8d71-323d33773a69 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:49.299496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d08ec57-fc72-40a1-8d71-323d33773a69 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:49.300496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d08ec57-fc72-40a1-8d71-323d33773a69 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:49.300978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d08ec57-fc72-40a1-8d71-323d33773a69 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:49.921069 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6d08ec57-fc72-40a1-8d71-323d33773a69 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "POST /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.658651 Jul 14 14:58:49.923928 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2719/5459] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:58:49 2022] POST /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:59:06.003103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:06.005917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:06.715439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3bdfb5be-5762-48b3-98b6-ef58eb8247a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:06.715974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3bdfb5be-5762-48b3-98b6-ef58eb8247a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:06.742554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3bdfb5be-5762-48b3-98b6-ef58eb8247a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:06.743387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3bdfb5be-5762-48b3-98b6-ef58eb8247a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:06.748470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3bdfb5be-5762-48b3-98b6-ef58eb8247a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:06.751170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3bdfb5be-5762-48b3-98b6-ef58eb8247a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:06.807558 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3bdfb5be-5762-48b3-98b6-ef58eb8247a1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/ips" status: 200 len: 150 microversion: 2.20 time: 0.812384 Jul 14 14:59:06.815875 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2741/5460] 10.222.0.81 () {60 vars in 1288 bytes} [Thu Jul 14 14:59:05 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/ips => generated 150 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:59:07.266861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d858673b-94a8-43a8-8af4-2ab79a0d97af tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:07.287347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=5 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:07.297553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:07.329190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d858673b-94a8-43a8-8af4-2ab79a0d97af tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:07.331724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d858673b-94a8-43a8-8af4-2ab79a0d97af tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:07.416659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d858673b-94a8-43a8-8af4-2ab79a0d97af tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Going to try to stop instance {{(pid=119511) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:59:07.539412 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d858673b-94a8-43a8-8af4-2ab79a0d97af tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "POST /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/action" status: 202 len: 0 microversion: 2.1 time: 0.277222 Jul 14 14:59:07.549937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6db5063e-a7ac-4c78-be39-4c4f2c0e7376 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:07.551434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6db5063e-a7ac-4c78-be39-4c4f2c0e7376 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:07.559006 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2720/5461] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:59:07 2022] POST /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:59:07.570112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6db5063e-a7ac-4c78-be39-4c4f2c0e7376 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:07.571607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6db5063e-a7ac-4c78-be39-4c4f2c0e7376 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:07.572849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6db5063e-a7ac-4c78-be39-4c4f2c0e7376 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:07.577334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6db5063e-a7ac-4c78-be39-4c4f2c0e7376 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:07.873971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6db5063e-a7ac-4c78-be39-4c4f2c0e7376 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:07.888218 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6db5063e-a7ac-4c78-be39-4c4f2c0e7376 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.343440 Jul 14 14:59:07.889508 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2742/5462] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:07 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:08.910914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a760df86-c974-48f7-8c4d-f0993b4c6cd0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:08.912981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a760df86-c974-48f7-8c4d-f0993b4c6cd0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:08.937628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a760df86-c974-48f7-8c4d-f0993b4c6cd0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:08.938920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a760df86-c974-48f7-8c4d-f0993b4c6cd0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:08.939983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a760df86-c974-48f7-8c4d-f0993b4c6cd0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:08.940717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a760df86-c974-48f7-8c4d-f0993b4c6cd0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:09.529566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a760df86-c974-48f7-8c4d-f0993b4c6cd0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:09.546413 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a760df86-c974-48f7-8c4d-f0993b4c6cd0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.642781 Jul 14 14:59:09.547526 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2721/5463] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:08 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:10.249919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bf556cda-e0e7-48e7-9c77-ecceaadd158c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:10.251705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bf556cda-e0e7-48e7-9c77-ecceaadd158c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:10.267729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf556cda-e0e7-48e7-9c77-ecceaadd158c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:10.270228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf556cda-e0e7-48e7-9c77-ecceaadd158c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:10.272754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf556cda-e0e7-48e7-9c77-ecceaadd158c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:10.274648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bf556cda-e0e7-48e7-9c77-ecceaadd158c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:10.391688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-bf556cda-e0e7-48e7-9c77-ecceaadd158c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lazy-loading 'flavor' on Instance uuid e9928624-d55d-4cef-b484-6c377f54271e {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:59:10.564426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-64b3fa3e-ded3-4e77-8256-a7c8682b51bc tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:10.565475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-64b3fa3e-ded3-4e77-8256-a7c8682b51bc tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:10.575915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64b3fa3e-ded3-4e77-8256-a7c8682b51bc tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:10.582749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64b3fa3e-ded3-4e77-8256-a7c8682b51bc tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:10.592544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64b3fa3e-ded3-4e77-8256-a7c8682b51bc tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:10.592544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64b3fa3e-ded3-4e77-8256-a7c8682b51bc tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:10.983734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-64b3fa3e-ded3-4e77-8256-a7c8682b51bc tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:10.994604 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-64b3fa3e-ded3-4e77-8256-a7c8682b51bc tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.433993 Jul 14 14:59:10.996634 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2722/5464] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:10 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:12.014315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae51ae16-f7d5-4c7c-bfc3-55c73fa1b4c1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:12.015869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae51ae16-f7d5-4c7c-bfc3-55c73fa1b4c1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:12.028924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae51ae16-f7d5-4c7c-bfc3-55c73fa1b4c1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:12.029346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae51ae16-f7d5-4c7c-bfc3-55c73fa1b4c1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:12.030145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae51ae16-f7d5-4c7c-bfc3-55c73fa1b4c1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:12.030585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae51ae16-f7d5-4c7c-bfc3-55c73fa1b4c1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:12.349173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ae51ae16-f7d5-4c7c-bfc3-55c73fa1b4c1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:12.367851 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ae51ae16-f7d5-4c7c-bfc3-55c73fa1b4c1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.357128 Jul 14 14:59:12.368916 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2723/5465] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:12 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:13.386672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d7cef89b-9984-477b-b443-980d5ecac191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:13.387387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d7cef89b-9984-477b-b443-980d5ecac191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:13.403367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7cef89b-9984-477b-b443-980d5ecac191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:13.409236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7cef89b-9984-477b-b443-980d5ecac191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:13.410988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7cef89b-9984-477b-b443-980d5ecac191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:13.414366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7cef89b-9984-477b-b443-980d5ecac191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:13.677528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d7cef89b-9984-477b-b443-980d5ecac191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:13.719023 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d7cef89b-9984-477b-b443-980d5ecac191 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.336324 Jul 14 14:59:13.722319 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2724/5466] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:13 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:13.871589 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bf556cda-e0e7-48e7-9c77-ecceaadd158c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "POST /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/action" status: 202 len: 0 microversion: 2.20 time: 3.626551 Jul 14 14:59:13.872410 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2743/5467] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 14:59:10 2022] POST /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/action => generated 0 bytes in 3629 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:59:13.888582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-211a7aeb-1697-483f-8fc6-0d9ffd3965e5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:13.892131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-211a7aeb-1697-483f-8fc6-0d9ffd3965e5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:13.915959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-211a7aeb-1697-483f-8fc6-0d9ffd3965e5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:13.919877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-211a7aeb-1697-483f-8fc6-0d9ffd3965e5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:13.922164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-211a7aeb-1697-483f-8fc6-0d9ffd3965e5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:13.925502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-211a7aeb-1697-483f-8fc6-0d9ffd3965e5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:14.491679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-211a7aeb-1697-483f-8fc6-0d9ffd3965e5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:14.511213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-211a7aeb-1697-483f-8fc6-0d9ffd3965e5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:14.514378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-211a7aeb-1697-483f-8fc6-0d9ffd3965e5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:14.516298 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-211a7aeb-1697-483f-8fc6-0d9ffd3965e5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1723 microversion: 2.20 time: 0.639401 Jul 14 14:59:14.518430 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2725/5468] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:13 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1723 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:14.741031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eda8b187-c417-4890-9f1f-10605d20885a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:14.742382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eda8b187-c417-4890-9f1f-10605d20885a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:14.755465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eda8b187-c417-4890-9f1f-10605d20885a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:14.756293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eda8b187-c417-4890-9f1f-10605d20885a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:14.757390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eda8b187-c417-4890-9f1f-10605d20885a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:14.758513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eda8b187-c417-4890-9f1f-10605d20885a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:15.374716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eda8b187-c417-4890-9f1f-10605d20885a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:15.393036 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eda8b187-c417-4890-9f1f-10605d20885a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.658288 Jul 14 14:59:15.413610 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2744/5469] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:14 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:15.546092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24769e9a-49af-4781-8392-ff939a38db16 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:15.548430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-24769e9a-49af-4781-8392-ff939a38db16 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:15.564797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24769e9a-49af-4781-8392-ff939a38db16 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:15.565284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24769e9a-49af-4781-8392-ff939a38db16 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:15.572643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24769e9a-49af-4781-8392-ff939a38db16 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:15.574061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24769e9a-49af-4781-8392-ff939a38db16 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:15.932345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-24769e9a-49af-4781-8392-ff939a38db16 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:15.951396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-24769e9a-49af-4781-8392-ff939a38db16 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:15.953334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-24769e9a-49af-4781-8392-ff939a38db16 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:15.955414 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-24769e9a-49af-4781-8392-ff939a38db16 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1723 microversion: 2.20 time: 0.421338 Jul 14 14:59:15.956530 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2726/5470] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:15 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:16.412577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb04b7ec-ecbb-492f-8745-46607033a71a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:16.414255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bb04b7ec-ecbb-492f-8745-46607033a71a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:16.427510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb04b7ec-ecbb-492f-8745-46607033a71a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:16.430770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb04b7ec-ecbb-492f-8745-46607033a71a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:16.431817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb04b7ec-ecbb-492f-8745-46607033a71a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:16.432471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb04b7ec-ecbb-492f-8745-46607033a71a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:16.785694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bb04b7ec-ecbb-492f-8745-46607033a71a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:16.799425 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bb04b7ec-ecbb-492f-8745-46607033a71a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.391007 Jul 14 14:59:16.803513 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2745/5471] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:16 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:16.974764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-744943c9-1ab5-4c12-b903-d31b23133ebc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:16.975655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-744943c9-1ab5-4c12-b903-d31b23133ebc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:16.998539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-744943c9-1ab5-4c12-b903-d31b23133ebc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:16.999011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-744943c9-1ab5-4c12-b903-d31b23133ebc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:16.999821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-744943c9-1ab5-4c12-b903-d31b23133ebc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:17.000312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-744943c9-1ab5-4c12-b903-d31b23133ebc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:17.334873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-744943c9-1ab5-4c12-b903-d31b23133ebc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:17.346682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-744943c9-1ab5-4c12-b903-d31b23133ebc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:17.348847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-744943c9-1ab5-4c12-b903-d31b23133ebc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:17.350485 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-744943c9-1ab5-4c12-b903-d31b23133ebc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1723 microversion: 2.20 time: 0.380265 Jul 14 14:59:17.351261 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2727/5472] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:16 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1723 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:17.820298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-56340f85-5088-4a39-80fd-b97ea30e77df tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:17.821096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-56340f85-5088-4a39-80fd-b97ea30e77df tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:17.844864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56340f85-5088-4a39-80fd-b97ea30e77df tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:17.844864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56340f85-5088-4a39-80fd-b97ea30e77df tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:17.845232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56340f85-5088-4a39-80fd-b97ea30e77df tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:17.847408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56340f85-5088-4a39-80fd-b97ea30e77df tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:18.180089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-56340f85-5088-4a39-80fd-b97ea30e77df tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:18.199323 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-56340f85-5088-4a39-80fd-b97ea30e77df tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.382670 Jul 14 14:59:18.204402 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2746/5473] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:17 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:18.373672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b9bcf367-e906-44cc-98cc-e033e680c01e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:18.374989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b9bcf367-e906-44cc-98cc-e033e680c01e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:18.390733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9bcf367-e906-44cc-98cc-e033e680c01e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:18.391494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9bcf367-e906-44cc-98cc-e033e680c01e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:18.393993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9bcf367-e906-44cc-98cc-e033e680c01e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:18.394621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b9bcf367-e906-44cc-98cc-e033e680c01e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:18.770626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1d84a848-4e70-4b70-8ef4-cca5896fdc69 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:18.771881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1d84a848-4e70-4b70-8ef4-cca5896fdc69 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:18.785645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d84a848-4e70-4b70-8ef4-cca5896fdc69 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:18.787790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d84a848-4e70-4b70-8ef4-cca5896fdc69 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:18.790492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d84a848-4e70-4b70-8ef4-cca5896fdc69 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:18.791454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d84a848-4e70-4b70-8ef4-cca5896fdc69 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:18.804630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b9bcf367-e906-44cc-98cc-e033e680c01e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:18.814788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b9bcf367-e906-44cc-98cc-e033e680c01e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:18.816322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b9bcf367-e906-44cc-98cc-e033e680c01e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:18.822288 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b9bcf367-e906-44cc-98cc-e033e680c01e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1723 microversion: 2.20 time: 0.454423 Jul 14 14:59:18.827756 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2747/5474] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:18 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1723 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:59:18.863359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1d84a848-4e70-4b70-8ef4-cca5896fdc69 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:59:19.118641 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1d84a848-4e70-4b70-8ef4-cca5896fdc69 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "DELETE /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 204 len: 0 microversion: 2.1 time: 0.931944 Jul 14 14:59:19.134525 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2728/5475] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:59:18 2022] DELETE /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 0 bytes in 948 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:59:19.150055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-62d9abad-d303-48e8-ad06-6c347339fd1e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:19.151428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-62d9abad-d303-48e8-ad06-6c347339fd1e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:19.169961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62d9abad-d303-48e8-ad06-6c347339fd1e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:19.176208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62d9abad-d303-48e8-ad06-6c347339fd1e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:19.177714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62d9abad-d303-48e8-ad06-6c347339fd1e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:19.181610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62d9abad-d303-48e8-ad06-6c347339fd1e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:19.222177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-588e9aa2-cff4-41c8-8ed7-06edfdd3b4cb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:19.223169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-588e9aa2-cff4-41c8-8ed7-06edfdd3b4cb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:19.230783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-588e9aa2-cff4-41c8-8ed7-06edfdd3b4cb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:19.231499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-588e9aa2-cff4-41c8-8ed7-06edfdd3b4cb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:19.235577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-588e9aa2-cff4-41c8-8ed7-06edfdd3b4cb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:19.236226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-588e9aa2-cff4-41c8-8ed7-06edfdd3b4cb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:20.547985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-62d9abad-d303-48e8-ad06-6c347339fd1e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:20.573957 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-62d9abad-d303-48e8-ad06-6c347339fd1e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1732 microversion: 2.1 time: 1.430818 Jul 14 14:59:20.579150 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2748/5476] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:19 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1732 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:20.590953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-883cc52c-4f7e-4bc9-946b-84981a0c417a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:20.597366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-883cc52c-4f7e-4bc9-946b-84981a0c417a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:20.622098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-883cc52c-4f7e-4bc9-946b-84981a0c417a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:20.622098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-883cc52c-4f7e-4bc9-946b-84981a0c417a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:20.622626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-883cc52c-4f7e-4bc9-946b-84981a0c417a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:20.630379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-883cc52c-4f7e-4bc9-946b-84981a0c417a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:20.909431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-588e9aa2-cff4-41c8-8ed7-06edfdd3b4cb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:20.925179 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-588e9aa2-cff4-41c8-8ed7-06edfdd3b4cb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 1.707130 Jul 14 14:59:20.925787 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2729/5477] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:19 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:20.937371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-563638957", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:21.061893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:59:21.279546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-883cc52c-4f7e-4bc9-946b-84981a0c417a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:21.300321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-883cc52c-4f7e-4bc9-946b-84981a0c417a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:21.310586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-883cc52c-4f7e-4bc9-946b-84981a0c417a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:21.320675 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-883cc52c-4f7e-4bc9-946b-84981a0c417a tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1723 microversion: 2.20 time: 0.739937 Jul 14 14:59:21.323500 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2749/5478] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:20 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1723 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:21.596622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5356a10f-b418-4323-bfa4-c32841af7d24 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:21.598877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5356a10f-b418-4323-bfa4-c32841af7d24 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:21.606438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5356a10f-b418-4323-bfa4-c32841af7d24 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:21.607293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5356a10f-b418-4323-bfa4-c32841af7d24 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:21.608299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5356a10f-b418-4323-bfa4-c32841af7d24 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:21.609047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5356a10f-b418-4323-bfa4-c32841af7d24 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:21.988220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:59:21.990135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:59:21.991565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:59:21.992231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:59:21.993285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:59:22.035491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5356a10f-b418-4323-bfa4-c32841af7d24 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:22.041134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:22.045257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:22.046987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:22.047140 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5356a10f-b418-4323-bfa4-c32841af7d24 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1732 microversion: 2.1 time: 0.455345 Jul 14 14:59:22.047815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:22.054273 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2750/5479] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:21 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1732 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:22.071191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-86b86310-c21a-4a71-8a22-0bc8b1c4a30b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:22.071834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-86b86310-c21a-4a71-8a22-0bc8b1c4a30b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:22.102648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Getting quotas for project d7375ce093114f54a26704134418070e. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:59:22.105305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86b86310-c21a-4a71-8a22-0bc8b1c4a30b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:22.110886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86b86310-c21a-4a71-8a22-0bc8b1c4a30b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:22.114382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86b86310-c21a-4a71-8a22-0bc8b1c4a30b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:22.114878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86b86310-c21a-4a71-8a22-0bc8b1c4a30b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:22.115824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Getting quotas for user 5be790767b664b22a71802928190af4b and project d7375ce093114f54a26704134418070e. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:59:22.149578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:59:22.153056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:59:22.288377 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cb421861-b9e1-4bd0-a7d6-a4507f8702b6 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.361264 Jul 14 14:59:22.307014 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2730/5480] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 14:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:59:22.318947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4c12dad6-00cb-4db6-86e5-fe2058fcd7c8 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:22.328661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4c12dad6-00cb-4db6-86e5-fe2058fcd7c8 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:22.632276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4c12dad6-00cb-4db6-86e5-fe2058fcd7c8 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:22.649482 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4c12dad6-00cb-4db6-86e5-fe2058fcd7c8 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1213 microversion: 2.1 time: 0.334722 Jul 14 14:59:22.650786 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2731/5481] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:22 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1213 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:22.657943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4e38ea2-5393-48f7-a804-5ebc60def729 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:22.658593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d4e38ea2-5393-48f7-a804-5ebc60def729 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:22.678373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4e38ea2-5393-48f7-a804-5ebc60def729 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:22.678909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4e38ea2-5393-48f7-a804-5ebc60def729 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:22.679753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4e38ea2-5393-48f7-a804-5ebc60def729 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:22.680198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4e38ea2-5393-48f7-a804-5ebc60def729 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:23.133277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-86b86310-c21a-4a71-8a22-0bc8b1c4a30b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:23.165250 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-86b86310-c21a-4a71-8a22-0bc8b1c4a30b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 1.107606 Jul 14 14:59:23.171819 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2751/5482] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:22 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:23.208128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-de848457-be10-4f11-aac5-15da847c602e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:23.211552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-de848457-be10-4f11-aac5-15da847c602e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:23.224557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de848457-be10-4f11-aac5-15da847c602e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:23.231830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de848457-be10-4f11-aac5-15da847c602e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:23.233151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de848457-be10-4f11-aac5-15da847c602e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:23.236034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de848457-be10-4f11-aac5-15da847c602e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:23.512329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-de848457-be10-4f11-aac5-15da847c602e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:23.520716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d4e38ea2-5393-48f7-a804-5ebc60def729 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:23.531846 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-de848457-be10-4f11-aac5-15da847c602e tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1664 microversion: 2.1 time: 0.358395 Jul 14 14:59:23.539348 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2752/5483] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:23 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1664 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:23.546741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d4e38ea2-5393-48f7-a804-5ebc60def729 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:23.567583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d4e38ea2-5393-48f7-a804-5ebc60def729 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:23.569036 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d4e38ea2-5393-48f7-a804-5ebc60def729 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1723 microversion: 2.20 time: 0.917189 Jul 14 14:59:23.581350 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2732/5484] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:22 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1723 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:23.668873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a27dca4d-a782-4f77-992d-b88f86325f04 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:23.669866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a27dca4d-a782-4f77-992d-b88f86325f04 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:23.721595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a27dca4d-a782-4f77-992d-b88f86325f04 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:23.723749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a27dca4d-a782-4f77-992d-b88f86325f04 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:23.742176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a27dca4d-a782-4f77-992d-b88f86325f04 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:23.756594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a27dca4d-a782-4f77-992d-b88f86325f04 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:24.188079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d2cd34de-5994-4d39-8c11-0c58218c94a8 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:24.189030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d2cd34de-5994-4d39-8c11-0c58218c94a8 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:24.208838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2cd34de-5994-4d39-8c11-0c58218c94a8 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:24.210514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2cd34de-5994-4d39-8c11-0c58218c94a8 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:24.216485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2cd34de-5994-4d39-8c11-0c58218c94a8 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:24.217314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2cd34de-5994-4d39-8c11-0c58218c94a8 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:24.288321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a27dca4d-a782-4f77-992d-b88f86325f04 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:24.331065 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a27dca4d-a782-4f77-992d-b88f86325f04 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1217 microversion: 2.1 time: 0.644546 Jul 14 14:59:24.344397 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2753/5485] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:23 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1217 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:24.359870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e81ed3f0-54fd-43f1-b8de-fd272fc72d11 req-d1798ca7-294a-4572-96a0-6fa3ab72745a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f42c33-3241-4e35-b580-34bff52d73c4", "name": "network-vif-deleted", "tag": "80264c6f-69b7-4369-84d7-44b85d806d82"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:24.418330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e81ed3f0-54fd-43f1-b8de-fd272fc72d11 req-d1798ca7-294a-4572-96a0-6fa3ab72745a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:24.433663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e81ed3f0-54fd-43f1-b8de-fd272fc72d11 req-d1798ca7-294a-4572-96a0-6fa3ab72745a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:24.512509 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e81ed3f0-54fd-43f1-b8de-fd272fc72d11 req-d1798ca7-294a-4572-96a0-6fa3ab72745a service nova] Creating event network-vif-deleted:80264c6f-69b7-4369-84d7-44b85d806d82 for instance 03f42c33-3241-4e35-b580-34bff52d73c4 on n-h1-767704-28 Jul 14 14:59:24.550086 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e81ed3f0-54fd-43f1-b8de-fd272fc72d11 req-d1798ca7-294a-4572-96a0-6fa3ab72745a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200993 Jul 14 14:59:24.561923 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2754/5486] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:24.578216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d2cd34de-5994-4d39-8c11-0c58218c94a8 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:24.596809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0eb5e7ab-b2bc-42c9-9d7e-6aa488767e2c tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:24.604692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0eb5e7ab-b2bc-42c9-9d7e-6aa488767e2c tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:24.619496 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d2cd34de-5994-4d39-8c11-0c58218c94a8 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.435452 Jul 14 14:59:24.631252 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2733/5487] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:24 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:24.647521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-731ac708-0f3f-4978-abb2-4cb318758e9b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:24.648146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-731ac708-0f3f-4978-abb2-4cb318758e9b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:24.652707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eb5e7ab-b2bc-42c9-9d7e-6aa488767e2c tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:24.653807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eb5e7ab-b2bc-42c9-9d7e-6aa488767e2c tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:24.654947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eb5e7ab-b2bc-42c9-9d7e-6aa488767e2c tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:24.661243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eb5e7ab-b2bc-42c9-9d7e-6aa488767e2c tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:24.669367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-731ac708-0f3f-4978-abb2-4cb318758e9b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:24.669845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-731ac708-0f3f-4978-abb2-4cb318758e9b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:24.673364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-731ac708-0f3f-4978-abb2-4cb318758e9b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:24.674033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-731ac708-0f3f-4978-abb2-4cb318758e9b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:24.852206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eb5e7ab-b2bc-42c9-9d7e-6aa488767e2c tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:24.861250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0eb5e7ab-b2bc-42c9-9d7e-6aa488767e2c tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:24.865089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-0eb5e7ab-b2bc-42c9-9d7e-6aa488767e2c tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lazy-loading 'fault' on Instance uuid 03f42c33-3241-4e35-b580-34bff52d73c4 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:59:25.069806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0eb5e7ab-b2bc-42c9-9d7e-6aa488767e2c tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:25.079032 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0eb5e7ab-b2bc-42c9-9d7e-6aa488767e2c tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1388 microversion: 2.1 time: 0.511329 Jul 14 14:59:25.081765 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2755/5488] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:24 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1388 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:25.226745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-731ac708-0f3f-4978-abb2-4cb318758e9b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:25.250447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-731ac708-0f3f-4978-abb2-4cb318758e9b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:25.254817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-731ac708-0f3f-4978-abb2-4cb318758e9b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:25.267421 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-731ac708-0f3f-4978-abb2-4cb318758e9b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1744 microversion: 2.20 time: 0.637052 Jul 14 14:59:25.273173 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2734/5489] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:24 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1744 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:25.361212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3d90bb86-8e38-4f2e-8c78-0152c2f58289 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:25.362184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3d90bb86-8e38-4f2e-8c78-0152c2f58289 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:25.384129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d90bb86-8e38-4f2e-8c78-0152c2f58289 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:25.385127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d90bb86-8e38-4f2e-8c78-0152c2f58289 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:25.388503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d90bb86-8e38-4f2e-8c78-0152c2f58289 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:25.389675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3d90bb86-8e38-4f2e-8c78-0152c2f58289 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:25.407939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:25.639755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3ab13b49-6e27-4d03-9072-324422e30d48 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:25.641158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3ab13b49-6e27-4d03-9072-324422e30d48 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:25.661984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ab13b49-6e27-4d03-9072-324422e30d48 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:25.662961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ab13b49-6e27-4d03-9072-324422e30d48 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:25.664160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ab13b49-6e27-4d03-9072-324422e30d48 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:25.664780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ab13b49-6e27-4d03-9072-324422e30d48 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:25.716599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:25.772497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3d90bb86-8e38-4f2e-8c78-0152c2f58289 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:25.785749 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3d90bb86-8e38-4f2e-8c78-0152c2f58289 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1265 microversion: 2.1 time: 0.428501 Jul 14 14:59:25.795897 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2756/5490] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:25 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1265 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:26.100101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cf65ef33-8321-4c3d-8416-cc7a8234eb49 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:26.101096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cf65ef33-8321-4c3d-8416-cc7a8234eb49 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:26.110682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf65ef33-8321-4c3d-8416-cc7a8234eb49 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.113531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf65ef33-8321-4c3d-8416-cc7a8234eb49 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:26.118174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf65ef33-8321-4c3d-8416-cc7a8234eb49 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.119778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf65ef33-8321-4c3d-8416-cc7a8234eb49 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:26.223288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf65ef33-8321-4c3d-8416-cc7a8234eb49 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.225701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf65ef33-8321-4c3d-8416-cc7a8234eb49 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:26.226449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-cf65ef33-8321-4c3d-8416-cc7a8234eb49 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lazy-loading 'fault' on Instance uuid 03f42c33-3241-4e35-b580-34bff52d73c4 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:59:26.363712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cf65ef33-8321-4c3d-8416-cc7a8234eb49 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09a2b13c80f44e288b7d5d15eb6aa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cf2566982e41979f539ed762164b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:26.367368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3ab13b49-6e27-4d03-9072-324422e30d48 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:26.383911 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cf65ef33-8321-4c3d-8416-cc7a8234eb49 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 200 len: 1388 microversion: 2.1 time: 0.287258 Jul 14 14:59:26.385872 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3ab13b49-6e27-4d03-9072-324422e30d48 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.749152 Jul 14 14:59:26.387551 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2735/5491] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:25 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:26.389301 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2757/5492] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:26 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 1388 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:26.404505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5363d0d9-9032-4562-8fc9-ff428dc781b8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:26.407244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5363d0d9-9032-4562-8fc9-ff428dc781b8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:26.423133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5363d0d9-9032-4562-8fc9-ff428dc781b8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.428897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5363d0d9-9032-4562-8fc9-ff428dc781b8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:26.430373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5363d0d9-9032-4562-8fc9-ff428dc781b8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.431021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5363d0d9-9032-4562-8fc9-ff428dc781b8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:26.804745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e74c91fb-b448-45ef-ae5b-ce2f8394b45d tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:26.806330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e74c91fb-b448-45ef-ae5b-ce2f8394b45d tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:26.821953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e74c91fb-b448-45ef-ae5b-ce2f8394b45d tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.824023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e74c91fb-b448-45ef-ae5b-ce2f8394b45d tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:26.826032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e74c91fb-b448-45ef-ae5b-ce2f8394b45d tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.826829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e74c91fb-b448-45ef-ae5b-ce2f8394b45d tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:27.106161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5363d0d9-9032-4562-8fc9-ff428dc781b8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:27.121254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e74c91fb-b448-45ef-ae5b-ce2f8394b45d tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:27.127982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5363d0d9-9032-4562-8fc9-ff428dc781b8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:27.129851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5363d0d9-9032-4562-8fc9-ff428dc781b8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:27.133351 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5363d0d9-9032-4562-8fc9-ff428dc781b8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1744 microversion: 2.20 time: 0.741042 Jul 14 14:59:27.138709 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2736/5493] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:26 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1744 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:27.139430 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e74c91fb-b448-45ef-ae5b-ce2f8394b45d tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1271 microversion: 2.1 time: 0.340719 Jul 14 14:59:27.143293 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2758/5494] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:26 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1271 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:27.404456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f8723667-db65-45fc-9102-2d7371a43ba9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:27.405112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f8723667-db65-45fc-9102-2d7371a43ba9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:27.413933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3753e7a8-dce0-47be-855d-f6a14b12085a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:27.414558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3753e7a8-dce0-47be-855d-f6a14b12085a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:27.435720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8723667-db65-45fc-9102-2d7371a43ba9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:27.436602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8723667-db65-45fc-9102-2d7371a43ba9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:27.437743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3753e7a8-dce0-47be-855d-f6a14b12085a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:27.442363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8723667-db65-45fc-9102-2d7371a43ba9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:27.443419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8723667-db65-45fc-9102-2d7371a43ba9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:27.445463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3753e7a8-dce0-47be-855d-f6a14b12085a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:27.452803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3753e7a8-dce0-47be-855d-f6a14b12085a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:27.454336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3753e7a8-dce0-47be-855d-f6a14b12085a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:27.503768 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3753e7a8-dce0-47be-855d-f6a14b12085a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] HTTP exception thrown: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3753e7a8-dce0-47be-855d-f6a14b12085a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Request method failure captured: Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 HTTP/1.1 Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C3yun08iQplYhVa4cX0JljQOMy6Tggfe5QPpydeCyCmzg1pCWtGbLjaoYDb20XIxeKTG8ix72ig2OY7AFquQSOWus18gR5AOt98T2_Y-0xAwxwvjBcApPOHqQa7c1Cv2AQ7su3UjMgwtPe2iVuNfF2uaKuqn7AGKNgQQEI4R0_SJcs Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: f7cf2566982e41979f539ed762164b41 Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestServerBasicOps-419149443 Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f7cf2566982e41979f539ed762164b41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f7cf2566982e41979f539ed762164b41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f7cf2566982e41979f539ed762164b41", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f7cf2566982e41979f539ed762164b41"}]}] Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestServerBasicOps-419149443 Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: f7cf2566982e41979f539ed762164b41 Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestServerBasicOps-419149443 Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestServerBasicOps-419149443-project Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: b09a2b13c80f44e288b7d5d15eb6aa9a Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestServerBasicOps-419149443-project Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '03f42c33-3241-4e35-b580-34bff52d73c4'} Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:27.515621 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.521416 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:27.521416 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:27.521416 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:27.521416 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:27.521416 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:27.521416 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:27.521416 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.528299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3753e7a8-dce0-47be-855d-f6a14b12085a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Returning 404 to user: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:27.530042 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3753e7a8-dce0-47be-855d-f6a14b12085a tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 404 len: 111 microversion: 2.1 time: 0.120216 Jul 14 14:59:27.536176 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2759/5495] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:27 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:59:28.157426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-04ab9e66-6687-4921-8e17-9b7d60be29ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:28.158224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-04ab9e66-6687-4921-8e17-9b7d60be29ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:28.170997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04ab9e66-6687-4921-8e17-9b7d60be29ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:28.171625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04ab9e66-6687-4921-8e17-9b7d60be29ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:28.172688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04ab9e66-6687-4921-8e17-9b7d60be29ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:28.177973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04ab9e66-6687-4921-8e17-9b7d60be29ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:28.290237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f8723667-db65-45fc-9102-2d7371a43ba9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:28.307801 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f8723667-db65-45fc-9102-2d7371a43ba9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.905375 Jul 14 14:59:28.313790 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2737/5496] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:27 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:28.326459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3028be34-b210-4071-a301-fe82c92659e9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:28.327308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3028be34-b210-4071-a301-fe82c92659e9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:28.335469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3028be34-b210-4071-a301-fe82c92659e9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:28.336278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3028be34-b210-4071-a301-fe82c92659e9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:28.337398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3028be34-b210-4071-a301-fe82c92659e9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:28.338018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3028be34-b210-4071-a301-fe82c92659e9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:28.561246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3028be34-b210-4071-a301-fe82c92659e9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:28.580710 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3028be34-b210-4071-a301-fe82c92659e9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1271 microversion: 2.1 time: 0.257947 Jul 14 14:59:28.581707 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2738/5497] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:28 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:28.587054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e340a422-3472-4e3c-a4c2-44dc1231e8e4 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:28.587772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e340a422-3472-4e3c-a4c2-44dc1231e8e4 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:28.604705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e340a422-3472-4e3c-a4c2-44dc1231e8e4 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:28.605864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e340a422-3472-4e3c-a4c2-44dc1231e8e4 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:28.606683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e340a422-3472-4e3c-a4c2-44dc1231e8e4 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:28.610963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e340a422-3472-4e3c-a4c2-44dc1231e8e4 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:28.664183 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-e340a422-3472-4e3c-a4c2-44dc1231e8e4 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] HTTP exception thrown: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e340a422-3472-4e3c-a4c2-44dc1231e8e4 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Request method failure captured: Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 HTTP/1.1 Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3yun08iQplYhVa4cX0JljQOMy6Tggfe5QPpydeCyCmzg1pCWtGbLjaoYDb20XIxeKTG8ix72ig2OY7AFquQSOWus18gR5AOt98T2_Y-0xAwxwvjBcApPOHqQa7c1Cv2AQ7su3UjMgwtPe2iVuNfF2uaKuqn7AGKNgQQEI4R0_SJcs Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: f7cf2566982e41979f539ed762164b41 Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestServerBasicOps-419149443 Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f7cf2566982e41979f539ed762164b41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f7cf2566982e41979f539ed762164b41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f7cf2566982e41979f539ed762164b41", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f7cf2566982e41979f539ed762164b41"}]}] Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestServerBasicOps-419149443 Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: f7cf2566982e41979f539ed762164b41 Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestServerBasicOps-419149443 Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestServerBasicOps-419149443-project Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: b09a2b13c80f44e288b7d5d15eb6aa9a Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestServerBasicOps-419149443-project Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '03f42c33-3241-4e35-b580-34bff52d73c4'} Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:28.670068 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:28.675225 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:59:28.675225 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:28.675225 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:59:28.675225 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:28.675225 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:28.675225 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:28.675225 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:28.675225 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:28.675225 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:28.675225 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:59:28.676804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e340a422-3472-4e3c-a4c2-44dc1231e8e4 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Returning 404 to user: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:28.681034 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e340a422-3472-4e3c-a4c2-44dc1231e8e4 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "DELETE /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 404 len: 111 microversion: 2.1 time: 0.097746 Jul 14 14:59:28.681752 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2739/5498] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 14:59:28 2022] DELETE /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:59:28.704338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c13272e7-b956-4240-b767-e7d6fa78459b tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:28.706232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c13272e7-b956-4240-b767-e7d6fa78459b tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] [instance: 03f42c33-3241-4e35-b580-34bff52d73c4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:28.728491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c13272e7-b956-4240-b767-e7d6fa78459b tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:28.728905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c13272e7-b956-4240-b767-e7d6fa78459b tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:28.730564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c13272e7-b956-4240-b767-e7d6fa78459b tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:28.731135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c13272e7-b956-4240-b767-e7d6fa78459b tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:28.788508 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c13272e7-b956-4240-b767-e7d6fa78459b tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] HTTP exception thrown: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c13272e7-b956-4240-b767-e7d6fa78459b tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Request method failure captured: Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 HTTP/1.1 Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C3yun08iQplYhVa4cX0JljQOMy6Tggfe5QPpydeCyCmzg1pCWtGbLjaoYDb20XIxeKTG8ix72ig2OY7AFquQSOWus18gR5AOt98T2_Y-0xAwxwvjBcApPOHqQa7c1Cv2AQ7su3UjMgwtPe2iVuNfF2uaKuqn7AGKNgQQEI4R0_SJcs Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: f7cf2566982e41979f539ed762164b41 Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestServerBasicOps-419149443 Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f7cf2566982e41979f539ed762164b41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f7cf2566982e41979f539ed762164b41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f7cf2566982e41979f539ed762164b41", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f7cf2566982e41979f539ed762164b41"}]}] Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestServerBasicOps-419149443 Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: f7cf2566982e41979f539ed762164b41 Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestServerBasicOps-419149443 Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestServerBasicOps-419149443-project Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: b09a2b13c80f44e288b7d5d15eb6aa9a Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestServerBasicOps-419149443-project Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '03f42c33-3241-4e35-b580-34bff52d73c4'} Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:28.790139 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:59:28.794629 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:28.794629 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:28.794629 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:28.794629 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:28.794629 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:28.794629 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. Jul 14 14:59:28.794629 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 14:59:28.802591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c13272e7-b956-4240-b767-e7d6fa78459b tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Returning 404 to user: Instance 03f42c33-3241-4e35-b580-34bff52d73c4 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:28.806235 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c13272e7-b956-4240-b767-e7d6fa78459b tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4" status: 404 len: 111 microversion: 2.1 time: 0.115908 Jul 14 14:59:28.820384 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2740/5499] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:28 2022] GET /compute/v2.1/servers/03f42c33-3241-4e35-b580-34bff52d73c4 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:59:29.284079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7f78572c-6203-4897-acaf-10b70eaa77e3 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] Calling method '.version_select at 0x7fd6c4409670>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:29.351876 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7f78572c-6203-4897-acaf-10b70eaa77e3 tempest-TestServerBasicOps-419149443 tempest-TestServerBasicOps-419149443-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-583928654" status: 202 len: 0 microversion: 2.1 time: 0.072233 Jul 14 14:59:29.361493 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2741/5500] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 14:59:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-583928654 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:59:29.412546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ca78502a-a019-4073-820a-7a9c846184f5 req-fe705163-9f50-4913-93f5-617902c9ec8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9928624-d55d-4cef-b484-6c377f54271e", "name": "network-vif-plugged", "status": "completed", "tag": "2c2be47c-cc25-46c1-a7aa-1dde1fe54b61"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:29.441618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04ab9e66-6687-4921-8e17-9b7d60be29ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:29.455961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04ab9e66-6687-4921-8e17-9b7d60be29ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:29.473320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ca78502a-a019-4073-820a-7a9c846184f5 req-fe705163-9f50-4913-93f5-617902c9ec8e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:29.475696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04ab9e66-6687-4921-8e17-9b7d60be29ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:29.491524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ca78502a-a019-4073-820a-7a9c846184f5 req-fe705163-9f50-4913-93f5-617902c9ec8e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:29.491950 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-04ab9e66-6687-4921-8e17-9b7d60be29ee tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 1.323661 Jul 14 14:59:29.497040 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2760/5501] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:28 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:29.514690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e7a0e1f7-5286-4828-a06b-ce2bb5153611 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:29.515322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e7a0e1f7-5286-4828-a06b-ce2bb5153611 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:29.548531 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ca78502a-a019-4073-820a-7a9c846184f5 req-fe705163-9f50-4913-93f5-617902c9ec8e service nova] Creating event network-vif-plugged:2c2be47c-cc25-46c1-a7aa-1dde1fe54b61 for instance e9928624-d55d-4cef-b484-6c377f54271e on n-h2-767704-28 Jul 14 14:59:29.560719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7a0e1f7-5286-4828-a06b-ce2bb5153611 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:29.569423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7a0e1f7-5286-4828-a06b-ce2bb5153611 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:29.570394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7a0e1f7-5286-4828-a06b-ce2bb5153611 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:29.570852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7a0e1f7-5286-4828-a06b-ce2bb5153611 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:29.577639 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ca78502a-a019-4073-820a-7a9c846184f5 req-fe705163-9f50-4913-93f5-617902c9ec8e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209059 Jul 14 14:59:29.578819 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2742/5502] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:29.606362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6321820e-8ec2-4c8f-84ac-5b5d3eb6450e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:29.607730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6321820e-8ec2-4c8f-84ac-5b5d3eb6450e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:29.625619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6321820e-8ec2-4c8f-84ac-5b5d3eb6450e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:29.626145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6321820e-8ec2-4c8f-84ac-5b5d3eb6450e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:29.627244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6321820e-8ec2-4c8f-84ac-5b5d3eb6450e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:29.637766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6321820e-8ec2-4c8f-84ac-5b5d3eb6450e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:30.111803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6321820e-8ec2-4c8f-84ac-5b5d3eb6450e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:30.126358 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6321820e-8ec2-4c8f-84ac-5b5d3eb6450e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1313 microversion: 2.1 time: 0.528086 Jul 14 14:59:30.128018 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2743/5503] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:29 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:30.143222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e7a0e1f7-5286-4828-a06b-ce2bb5153611 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:30.160720 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e7a0e1f7-5286-4828-a06b-ce2bb5153611 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.662532 Jul 14 14:59:30.161553 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2761/5504] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:29 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:30.513103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ecf58309-a008-45a2-b56f-a8572f7655b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:30.513739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ecf58309-a008-45a2-b56f-a8572f7655b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:30.539341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ecf58309-a008-45a2-b56f-a8572f7655b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:30.541328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ecf58309-a008-45a2-b56f-a8572f7655b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:30.542401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ecf58309-a008-45a2-b56f-a8572f7655b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:30.545548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ecf58309-a008-45a2-b56f-a8572f7655b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:31.143800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ecf58309-a008-45a2-b56f-a8572f7655b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:31.152841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7813e499-7779-48c4-8962-03421ab959a8 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:31.157276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7813e499-7779-48c4-8962-03421ab959a8 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:31.164316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ecf58309-a008-45a2-b56f-a8572f7655b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:31.171431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7813e499-7779-48c4-8962-03421ab959a8 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:31.172904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7813e499-7779-48c4-8962-03421ab959a8 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:31.174363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ecf58309-a008-45a2-b56f-a8572f7655b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:31.177837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7813e499-7779-48c4-8962-03421ab959a8 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:31.179095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7813e499-7779-48c4-8962-03421ab959a8 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:31.179628 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ecf58309-a008-45a2-b56f-a8572f7655b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 0.671443 Jul 14 14:59:31.180223 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2744/5505] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:30 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:31.186963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5f9e6fff-b6a9-4260-92f8-910cad9bbb26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:31.199018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5f9e6fff-b6a9-4260-92f8-910cad9bbb26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:31.222457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f9e6fff-b6a9-4260-92f8-910cad9bbb26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:31.226706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f9e6fff-b6a9-4260-92f8-910cad9bbb26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:31.231302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f9e6fff-b6a9-4260-92f8-910cad9bbb26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:31.232113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f9e6fff-b6a9-4260-92f8-910cad9bbb26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:31.772291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7813e499-7779-48c4-8962-03421ab959a8 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:31.792000 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7813e499-7779-48c4-8962-03421ab959a8 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1313 microversion: 2.1 time: 0.645069 Jul 14 14:59:31.794985 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2762/5506] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:31 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:32.039799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5f9e6fff-b6a9-4260-92f8-910cad9bbb26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:32.075087 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5f9e6fff-b6a9-4260-92f8-910cad9bbb26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1721 microversion: 2.1 time: 0.893538 Jul 14 14:59:32.085815 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2745/5507] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:31 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1721 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:32.199825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d50c33f8-3641-4b73-9a86-d8805bbfdc3c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:32.200744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d50c33f8-3641-4b73-9a86-d8805bbfdc3c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:32.208907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d50c33f8-3641-4b73-9a86-d8805bbfdc3c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:32.222526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d50c33f8-3641-4b73-9a86-d8805bbfdc3c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:32.223415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d50c33f8-3641-4b73-9a86-d8805bbfdc3c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:32.234870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d50c33f8-3641-4b73-9a86-d8805bbfdc3c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:32.309958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-24da8fef-bde9-437a-9130-7bdd13dc24e2 req-bdc85c69-0dff-4960-98e7-0e8f3bcef5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cff31d9-6ffc-4c36-a0fa-2b1fd850c507", "tag": "070bf628-cece-415a-9a43-1a008501dbd0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:32.373660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:32.382903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-24da8fef-bde9-437a-9130-7bdd13dc24e2 req-bdc85c69-0dff-4960-98e7-0e8f3bcef5c3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:32.384587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-24da8fef-bde9-437a-9130-7bdd13dc24e2 req-bdc85c69-0dff-4960-98e7-0e8f3bcef5c3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:32.427815 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-24da8fef-bde9-437a-9130-7bdd13dc24e2 req-bdc85c69-0dff-4960-98e7-0e8f3bcef5c3 service nova] Creating event network-changed:070bf628-cece-415a-9a43-1a008501dbd0 for instance 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 on n-h1-767704-28 Jul 14 14:59:32.454497 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-24da8fef-bde9-437a-9130-7bdd13dc24e2 req-bdc85c69-0dff-4960-98e7-0e8f3bcef5c3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164317 Jul 14 14:59:32.455875 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2746/5508] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:59:32.812552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3579acc1-161b-410d-adec-e5734a386ed9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:32.813566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3579acc1-161b-410d-adec-e5734a386ed9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:32.831382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:32.838897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3579acc1-161b-410d-adec-e5734a386ed9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:32.839854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3579acc1-161b-410d-adec-e5734a386ed9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:32.843762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3579acc1-161b-410d-adec-e5734a386ed9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:32.845760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3579acc1-161b-410d-adec-e5734a386ed9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:33.354890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d50c33f8-3641-4b73-9a86-d8805bbfdc3c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:33.367799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d50c33f8-3641-4b73-9a86-d8805bbfdc3c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:33.382885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d50c33f8-3641-4b73-9a86-d8805bbfdc3c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:33.384362 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d50c33f8-3641-4b73-9a86-d8805bbfdc3c tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 1.188636 Jul 14 14:59:33.394846 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2763/5509] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:32 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:33.420761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c65083f2-c195-44b3-9b12-b08b1b0c2e26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:33.424879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c65083f2-c195-44b3-9b12-b08b1b0c2e26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:33.444521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c65083f2-c195-44b3-9b12-b08b1b0c2e26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:33.447830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c65083f2-c195-44b3-9b12-b08b1b0c2e26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:33.449700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c65083f2-c195-44b3-9b12-b08b1b0c2e26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:33.451060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c65083f2-c195-44b3-9b12-b08b1b0c2e26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:33.809223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3579acc1-161b-410d-adec-e5734a386ed9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:33.833111 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3579acc1-161b-410d-adec-e5734a386ed9 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1313 microversion: 2.1 time: 1.027436 Jul 14 14:59:33.834503 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2747/5510] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:32 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1313 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:33.996399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c65083f2-c195-44b3-9b12-b08b1b0c2e26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:34.008246 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c65083f2-c195-44b3-9b12-b08b1b0c2e26 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1698 microversion: 2.1 time: 0.608250 Jul 14 14:59:34.038320 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2764/5511] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:33 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1698 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:34.042964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a90ba155-f1d6-488a-9c1f-3a4f447d3eac tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:34.060376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a90ba155-f1d6-488a-9c1f-3a4f447d3eac tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:34.061415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a90ba155-f1d6-488a-9c1f-3a4f447d3eac tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:34.141316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a90ba155-f1d6-488a-9c1f-3a4f447d3eac tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Going to try to start instance {{(pid=119511) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 14:59:34.247200 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a90ba155-f1d6-488a-9c1f-3a4f447d3eac tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "POST /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/action" status: 202 len: 0 microversion: 2.1 time: 0.211573 Jul 14 14:59:34.248560 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2748/5512] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 14:59:34 2022] POST /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:59:34.260403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-788e38a7-1d15-4941-9c6d-10e12bb195e1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:34.261752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-788e38a7-1d15-4941-9c6d-10e12bb195e1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:34.278191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-788e38a7-1d15-4941-9c6d-10e12bb195e1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:34.278662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-788e38a7-1d15-4941-9c6d-10e12bb195e1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:34.279739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-788e38a7-1d15-4941-9c6d-10e12bb195e1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:34.280143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-788e38a7-1d15-4941-9c6d-10e12bb195e1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:34.407158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cccd039a-cc77-4b80-bad0-e061f4b2826f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:34.408986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cccd039a-cc77-4b80-bad0-e061f4b2826f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:34.431214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cccd039a-cc77-4b80-bad0-e061f4b2826f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:34.438283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cccd039a-cc77-4b80-bad0-e061f4b2826f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:34.445888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cccd039a-cc77-4b80-bad0-e061f4b2826f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:34.447409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cccd039a-cc77-4b80-bad0-e061f4b2826f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:35.168406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cccd039a-cc77-4b80-bad0-e061f4b2826f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:35.203552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cccd039a-cc77-4b80-bad0-e061f4b2826f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:35.215057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cccd039a-cc77-4b80-bad0-e061f4b2826f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:35.216318 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cccd039a-cc77-4b80-bad0-e061f4b2826f tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 0.816224 Jul 14 14:59:35.227840 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2749/5513] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:34 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:35.245294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-78482e7d-e53b-4aaf-a520-042778e5b668 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:35.255229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-78482e7d-e53b-4aaf-a520-042778e5b668 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:35.272682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78482e7d-e53b-4aaf-a520-042778e5b668 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:35.273466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-788e38a7-1d15-4941-9c6d-10e12bb195e1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:35.275527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78482e7d-e53b-4aaf-a520-042778e5b668 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:35.276478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78482e7d-e53b-4aaf-a520-042778e5b668 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:35.276938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78482e7d-e53b-4aaf-a520-042778e5b668 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:35.289556 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-788e38a7-1d15-4941-9c6d-10e12bb195e1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1707 microversion: 2.1 time: 1.033678 Jul 14 14:59:35.306080 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2765/5514] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:34 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1707 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:36.248749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-119e02d2-499a-4f40-9a75-607232f539b6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:36.249513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-119e02d2-499a-4f40-9a75-607232f539b6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:36.276361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=55 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:36.278640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-119e02d2-499a-4f40-9a75-607232f539b6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:36.286321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-119e02d2-499a-4f40-9a75-607232f539b6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:36.287408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-119e02d2-499a-4f40-9a75-607232f539b6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:36.291876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-119e02d2-499a-4f40-9a75-607232f539b6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:36.297173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-78482e7d-e53b-4aaf-a520-042778e5b668 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:36.312190 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-78482e7d-e53b-4aaf-a520-042778e5b668 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1313 microversion: 2.1 time: 1.088591 Jul 14 14:59:36.328032 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2750/5515] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:35 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1313 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:36.337682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0de32900-886b-4a49-85f0-0bad49e2344d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:36.341757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0de32900-886b-4a49-85f0-0bad49e2344d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:36.356262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0de32900-886b-4a49-85f0-0bad49e2344d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:36.370444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0de32900-886b-4a49-85f0-0bad49e2344d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:36.372057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0de32900-886b-4a49-85f0-0bad49e2344d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:36.378942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0de32900-886b-4a49-85f0-0bad49e2344d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:37.200147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0de32900-886b-4a49-85f0-0bad49e2344d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:37.215042 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0de32900-886b-4a49-85f0-0bad49e2344d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1707 microversion: 2.1 time: 0.885574 Jul 14 14:59:37.224986 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2751/5516] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:36 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1707 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:37.332940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-119e02d2-499a-4f40-9a75-607232f539b6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:37.345283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f3bcc81b-c62f-4075-989f-651fc97c6175 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:37.346501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f3bcc81b-c62f-4075-989f-651fc97c6175 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:37.350258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-119e02d2-499a-4f40-9a75-607232f539b6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:37.353033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:37.355155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3bcc81b-c62f-4075-989f-651fc97c6175 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:37.355907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3bcc81b-c62f-4075-989f-651fc97c6175 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:37.356908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3bcc81b-c62f-4075-989f-651fc97c6175 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:37.357558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3bcc81b-c62f-4075-989f-651fc97c6175 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:37.363494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-119e02d2-499a-4f40-9a75-607232f539b6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:37.371675 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-119e02d2-499a-4f40-9a75-607232f539b6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 1.138376 Jul 14 14:59:37.372331 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2766/5517] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:36 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:38.235374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b16d62f-6287-48b1-b063-ecd469662653 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:38.236292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b16d62f-6287-48b1-b063-ecd469662653 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:38.246543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b16d62f-6287-48b1-b063-ecd469662653 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:38.249565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b16d62f-6287-48b1-b063-ecd469662653 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:38.252262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b16d62f-6287-48b1-b063-ecd469662653 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:38.252932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b16d62f-6287-48b1-b063-ecd469662653 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:38.441982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f3bcc81b-c62f-4075-989f-651fc97c6175 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:38.459963 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f3bcc81b-c62f-4075-989f-651fc97c6175 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1313 microversion: 2.1 time: 1.119206 Jul 14 14:59:38.471499 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2752/5518] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:37 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1313 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:38.483559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6e956794-c700-476a-b9f0-65885d8bc255 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:38.484191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6e956794-c700-476a-b9f0-65885d8bc255 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:38.507305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e956794-c700-476a-b9f0-65885d8bc255 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:38.507762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e956794-c700-476a-b9f0-65885d8bc255 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:38.508575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e956794-c700-476a-b9f0-65885d8bc255 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:38.509050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e956794-c700-476a-b9f0-65885d8bc255 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:39.785163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9b16d62f-6287-48b1-b063-ecd469662653 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:39.800058 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9b16d62f-6287-48b1-b063-ecd469662653 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1707 microversion: 2.1 time: 1.568525 Jul 14 14:59:39.800669 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2767/5519] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:38 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1707 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:39.823255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-00891055-75cb-4acc-9a9e-04275d961404 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:39.828344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-00891055-75cb-4acc-9a9e-04275d961404 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:39.834425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6e956794-c700-476a-b9f0-65885d8bc255 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:39.843722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6e956794-c700-476a-b9f0-65885d8bc255 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:39.858404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6e956794-c700-476a-b9f0-65885d8bc255 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:39.860468 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6e956794-c700-476a-b9f0-65885d8bc255 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 1.387902 Jul 14 14:59:39.864679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00891055-75cb-4acc-9a9e-04275d961404 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:39.865218 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2753/5520] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:38 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:39.866154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00891055-75cb-4acc-9a9e-04275d961404 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:39.867343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00891055-75cb-4acc-9a9e-04275d961404 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:39.867978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00891055-75cb-4acc-9a9e-04275d961404 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:40.304004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-00891055-75cb-4acc-9a9e-04275d961404 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:40.343725 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-00891055-75cb-4acc-9a9e-04275d961404 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1313 microversion: 2.1 time: 0.521052 Jul 14 14:59:40.344491 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2768/5521] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:39 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:40.835409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1d9cf23f-6347-4727-b10e-fa8e2f028231 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:40.836037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1d9cf23f-6347-4727-b10e-fa8e2f028231 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:40.861432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d9cf23f-6347-4727-b10e-fa8e2f028231 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:40.864404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d9cf23f-6347-4727-b10e-fa8e2f028231 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:40.875112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d9cf23f-6347-4727-b10e-fa8e2f028231 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:40.879134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d9cf23f-6347-4727-b10e-fa8e2f028231 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:40.889762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-04489620-f5c2-469a-a058-149301941fe4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:40.889762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-04489620-f5c2-469a-a058-149301941fe4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:40.910648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04489620-f5c2-469a-a058-149301941fe4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:40.911454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04489620-f5c2-469a-a058-149301941fe4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:40.912331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04489620-f5c2-469a-a058-149301941fe4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:40.912778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04489620-f5c2-469a-a058-149301941fe4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:41.605533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04489620-f5c2-469a-a058-149301941fe4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:41.625431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04489620-f5c2-469a-a058-149301941fe4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:41.629418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04489620-f5c2-469a-a058-149301941fe4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:41.634554 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-04489620-f5c2-469a-a058-149301941fe4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 0.754590 Jul 14 14:59:41.647880 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2769/5522] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:40 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:41.659389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b112f21b-aa50-4fd5-a804-dc150c75d17f tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:41.660033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b112f21b-aa50-4fd5-a804-dc150c75d17f tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:41.676997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b112f21b-aa50-4fd5-a804-dc150c75d17f tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:41.677476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b112f21b-aa50-4fd5-a804-dc150c75d17f tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:41.678633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b112f21b-aa50-4fd5-a804-dc150c75d17f tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:41.679096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b112f21b-aa50-4fd5-a804-dc150c75d17f tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:41.956360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b112f21b-aa50-4fd5-a804-dc150c75d17f tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:41.972472 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b112f21b-aa50-4fd5-a804-dc150c75d17f tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1313 microversion: 2.1 time: 0.323223 Jul 14 14:59:41.973334 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2770/5523] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:41 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:42.115703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1d9cf23f-6347-4727-b10e-fa8e2f028231 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:42.138762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:42.144850 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1d9cf23f-6347-4727-b10e-fa8e2f028231 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1711 microversion: 2.1 time: 1.322962 Jul 14 14:59:42.157131 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2754/5524] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:40 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1711 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:42.514459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5956f7c3-b3dc-4849-a002-391905a85221 req-e70d7ac2-518f-4092-9e30-90b6d22f4437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cff31d9-6ffc-4c36-a0fa-2b1fd850c507", "name": "network-vif-plugged", "status": "completed", "tag": "070bf628-cece-415a-9a43-1a008501dbd0"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:42.538562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5956f7c3-b3dc-4849-a002-391905a85221 req-e70d7ac2-518f-4092-9e30-90b6d22f4437 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:42.565307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5956f7c3-b3dc-4849-a002-391905a85221 req-e70d7ac2-518f-4092-9e30-90b6d22f4437 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:42.616759 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5956f7c3-b3dc-4849-a002-391905a85221 req-e70d7ac2-518f-4092-9e30-90b6d22f4437 service nova] Creating event network-vif-plugged:070bf628-cece-415a-9a43-1a008501dbd0 for instance 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 on n-h1-767704-28 Jul 14 14:59:42.637419 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5956f7c3-b3dc-4849-a002-391905a85221 req-e70d7ac2-518f-4092-9e30-90b6d22f4437 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125674 Jul 14 14:59:42.639411 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2771/5525] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:42.655290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-021bba4b-3ccc-48cc-84cf-4bca7f0c43a9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:42.655923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-021bba4b-3ccc-48cc-84cf-4bca7f0c43a9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:42.670270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021bba4b-3ccc-48cc-84cf-4bca7f0c43a9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:42.670779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021bba4b-3ccc-48cc-84cf-4bca7f0c43a9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:42.671612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021bba4b-3ccc-48cc-84cf-4bca7f0c43a9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:42.672063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021bba4b-3ccc-48cc-84cf-4bca7f0c43a9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:42.996766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b64e8f73-595d-49eb-bef4-629af75ac974 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:42.997708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b64e8f73-595d-49eb-bef4-629af75ac974 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:43.023029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b64e8f73-595d-49eb-bef4-629af75ac974 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:43.024043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b64e8f73-595d-49eb-bef4-629af75ac974 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:43.025984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b64e8f73-595d-49eb-bef4-629af75ac974 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:43.031728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b64e8f73-595d-49eb-bef4-629af75ac974 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:43.123452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-021bba4b-3ccc-48cc-84cf-4bca7f0c43a9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:43.146790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-021bba4b-3ccc-48cc-84cf-4bca7f0c43a9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:43.158746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-021bba4b-3ccc-48cc-84cf-4bca7f0c43a9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:43.166127 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-021bba4b-3ccc-48cc-84cf-4bca7f0c43a9 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 0.515382 Jul 14 14:59:43.171972 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2755/5526] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:42 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:43.525975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b64e8f73-595d-49eb-bef4-629af75ac974 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:43.542813 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b64e8f73-595d-49eb-bef4-629af75ac974 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1313 microversion: 2.1 time: 0.553553 Jul 14 14:59:43.555454 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2772/5527] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:42 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:44.189934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-00ce10a1-2ba0-47b3-8008-7108fecb1794 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:44.190566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-00ce10a1-2ba0-47b3-8008-7108fecb1794 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:44.204906 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00ce10a1-2ba0-47b3-8008-7108fecb1794 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:44.205399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00ce10a1-2ba0-47b3-8008-7108fecb1794 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:44.206209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00ce10a1-2ba0-47b3-8008-7108fecb1794 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:44.206658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-00ce10a1-2ba0-47b3-8008-7108fecb1794 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:44.562199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8d8ec319-6c46-4580-8d4d-7b75db89df60 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:44.563108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8d8ec319-6c46-4580-8d4d-7b75db89df60 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:44.581671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d8ec319-6c46-4580-8d4d-7b75db89df60 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:44.583095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d8ec319-6c46-4580-8d4d-7b75db89df60 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:44.584888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d8ec319-6c46-4580-8d4d-7b75db89df60 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:44.586386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d8ec319-6c46-4580-8d4d-7b75db89df60 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:44.689071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-00ce10a1-2ba0-47b3-8008-7108fecb1794 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:44.708645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-00ce10a1-2ba0-47b3-8008-7108fecb1794 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:44.713239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-00ce10a1-2ba0-47b3-8008-7108fecb1794 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:44.717908 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-00ce10a1-2ba0-47b3-8008-7108fecb1794 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 0.531821 Jul 14 14:59:44.721859 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2756/5528] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:44 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:45.111859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8d8ec319-6c46-4580-8d4d-7b75db89df60 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:45.118828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:45.136259 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8d8ec319-6c46-4580-8d4d-7b75db89df60 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1313 microversion: 2.1 time: 0.574673 Jul 14 14:59:45.137237 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2773/5529] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:44 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:45.739641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-412122e6-05ca-4b04-8ba7-a0d395c29858 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:45.740491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-412122e6-05ca-4b04-8ba7-a0d395c29858 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:45.765903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-412122e6-05ca-4b04-8ba7-a0d395c29858 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:45.771836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-412122e6-05ca-4b04-8ba7-a0d395c29858 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:45.773003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-412122e6-05ca-4b04-8ba7-a0d395c29858 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:45.776849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-412122e6-05ca-4b04-8ba7-a0d395c29858 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:46.154862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9365f8cf-e3f8-4554-9aec-915fc783ffa1 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:46.156231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9365f8cf-e3f8-4554-9aec-915fc783ffa1 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:46.170982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9365f8cf-e3f8-4554-9aec-915fc783ffa1 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:46.171728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9365f8cf-e3f8-4554-9aec-915fc783ffa1 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:46.173492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9365f8cf-e3f8-4554-9aec-915fc783ffa1 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:46.175580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9365f8cf-e3f8-4554-9aec-915fc783ffa1 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:46.777125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9365f8cf-e3f8-4554-9aec-915fc783ffa1 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:46.793697 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9365f8cf-e3f8-4554-9aec-915fc783ffa1 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1463 microversion: 2.1 time: 0.639117 Jul 14 14:59:46.795608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-412122e6-05ca-4b04-8ba7-a0d395c29858 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:46.800239 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2774/5530] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:46 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1463 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:46.813334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77940130-20a0-48b8-9321-5a021b2a2c89 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "119241ce-fd7d-4dcb-9ea9-9894ba6f0be9", "device": "/dev/sdb"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:46.814620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-77940130-20a0-48b8-9321-5a021b2a2c89 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:46.822875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-412122e6-05ca-4b04-8ba7-a0d395c29858 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:46.826155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-412122e6-05ca-4b04-8ba7-a0d395c29858 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:46.828471 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-412122e6-05ca-4b04-8ba7-a0d395c29858 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 1.095660 Jul 14 14:59:46.830906 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2757/5531] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:45 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:46.834731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77940130-20a0-48b8-9321-5a021b2a2c89 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:46.836128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77940130-20a0-48b8-9321-5a021b2a2c89 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:46.837216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77940130-20a0-48b8-9321-5a021b2a2c89 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:46.837871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77940130-20a0-48b8-9321-5a021b2a2c89 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:47.414164 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-77940130-20a0-48b8-9321-5a021b2a2c89 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "POST /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.604481 Jul 14 14:59:47.414806 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2775/5532] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 14:59:46 2022] POST /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507/os-volume_attachments => generated 194 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:59:47.852525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d6a6b62-c739-41e7-8aec-a972adf8b393 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:47.854913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d6a6b62-c739-41e7-8aec-a972adf8b393 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:47.875822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d6a6b62-c739-41e7-8aec-a972adf8b393 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:47.882034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d6a6b62-c739-41e7-8aec-a972adf8b393 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:47.887406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d6a6b62-c739-41e7-8aec-a972adf8b393 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:47.893736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d6a6b62-c739-41e7-8aec-a972adf8b393 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:48.172548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7d6a6b62-c739-41e7-8aec-a972adf8b393 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:48.195982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7d6a6b62-c739-41e7-8aec-a972adf8b393 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:48.198087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7d6a6b62-c739-41e7-8aec-a972adf8b393 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:48.203030 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d6a6b62-c739-41e7-8aec-a972adf8b393 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 0.357724 Jul 14 14:59:48.205131 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2758/5533] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:47 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:49.224721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b4f4582-74d6-4c63-a74b-498d3c6eab6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:49.233752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3b4f4582-74d6-4c63-a74b-498d3c6eab6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:49.258783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b4f4582-74d6-4c63-a74b-498d3c6eab6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:49.262524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b4f4582-74d6-4c63-a74b-498d3c6eab6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:49.263853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b4f4582-74d6-4c63-a74b-498d3c6eab6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:49.264709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b4f4582-74d6-4c63-a74b-498d3c6eab6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:49.668432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b4f4582-74d6-4c63-a74b-498d3c6eab6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:49.683958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b4f4582-74d6-4c63-a74b-498d3c6eab6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:49.691533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b4f4582-74d6-4c63-a74b-498d3c6eab6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:49.693162 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b4f4582-74d6-4c63-a74b-498d3c6eab6e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 0.474822 Jul 14 14:59:49.695782 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2776/5534] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:49 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:50.722850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f4e551c3-895f-4b5b-afaf-43f7d2a52ee4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:50.723414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f4e551c3-895f-4b5b-afaf-43f7d2a52ee4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:50.747477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4e551c3-895f-4b5b-afaf-43f7d2a52ee4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:50.747847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4e551c3-895f-4b5b-afaf-43f7d2a52ee4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:50.757153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4e551c3-895f-4b5b-afaf-43f7d2a52ee4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:50.764220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4e551c3-895f-4b5b-afaf-43f7d2a52ee4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:51.155695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f4e551c3-895f-4b5b-afaf-43f7d2a52ee4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:51.169783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f4e551c3-895f-4b5b-afaf-43f7d2a52ee4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:51.177250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f4e551c3-895f-4b5b-afaf-43f7d2a52ee4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:51.181386 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f4e551c3-895f-4b5b-afaf-43f7d2a52ee4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 0.470843 Jul 14 14:59:51.184454 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2759/5535] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:50 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:52.202429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c474cdff-a509-42a9-8968-894534a0f961 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:52.203676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c474cdff-a509-42a9-8968-894534a0f961 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:52.218788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c474cdff-a509-42a9-8968-894534a0f961 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:52.219526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c474cdff-a509-42a9-8968-894534a0f961 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:52.220509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c474cdff-a509-42a9-8968-894534a0f961 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:52.221144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c474cdff-a509-42a9-8968-894534a0f961 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:52.975121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c474cdff-a509-42a9-8968-894534a0f961 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:53.003459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c474cdff-a509-42a9-8968-894534a0f961 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:53.005705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c474cdff-a509-42a9-8968-894534a0f961 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:53.007220 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c474cdff-a509-42a9-8968-894534a0f961 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 0.809215 Jul 14 14:59:53.008293 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2777/5536] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:52 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:54.029358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-08d4c42e-00e9-43f1-9b08-2dd487bc49e6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:54.029985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-08d4c42e-00e9-43f1-9b08-2dd487bc49e6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:54.069871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08d4c42e-00e9-43f1-9b08-2dd487bc49e6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:54.075306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08d4c42e-00e9-43f1-9b08-2dd487bc49e6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:54.080336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08d4c42e-00e9-43f1-9b08-2dd487bc49e6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:54.084226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-08d4c42e-00e9-43f1-9b08-2dd487bc49e6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:54.627045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-08d4c42e-00e9-43f1-9b08-2dd487bc49e6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:54.637338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-08d4c42e-00e9-43f1-9b08-2dd487bc49e6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:54.645877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-08d4c42e-00e9-43f1-9b08-2dd487bc49e6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:54.648689 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-08d4c42e-00e9-43f1-9b08-2dd487bc49e6 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 0.625707 Jul 14 14:59:54.652993 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2760/5537] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:54 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:55.672484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f60cf6d-bd1e-4753-9f0f-739c0daa2798 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:55.673946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f60cf6d-bd1e-4753-9f0f-739c0daa2798 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:55.688673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f60cf6d-bd1e-4753-9f0f-739c0daa2798 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:55.690866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f60cf6d-bd1e-4753-9f0f-739c0daa2798 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:55.693303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f60cf6d-bd1e-4753-9f0f-739c0daa2798 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:55.694692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f60cf6d-bd1e-4753-9f0f-739c0daa2798 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:55.959886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f60cf6d-bd1e-4753-9f0f-739c0daa2798 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:55.973452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f60cf6d-bd1e-4753-9f0f-739c0daa2798 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:55.975781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f60cf6d-bd1e-4753-9f0f-739c0daa2798 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:55.977346 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f60cf6d-bd1e-4753-9f0f-739c0daa2798 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1739 microversion: 2.20 time: 0.310516 Jul 14 14:59:55.978659 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2778/5538] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:55 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:56.999878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e8345ee-8786-4012-9521-ca375c1214ef tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:57.000659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5e8345ee-8786-4012-9521-ca375c1214ef tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:57.014509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e8345ee-8786-4012-9521-ca375c1214ef tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:57.028623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e8345ee-8786-4012-9521-ca375c1214ef tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:57.039896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e8345ee-8786-4012-9521-ca375c1214ef tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:57.041203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e8345ee-8786-4012-9521-ca375c1214ef tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:57.744194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5e8345ee-8786-4012-9521-ca375c1214ef tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:57.759361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5e8345ee-8786-4012-9521-ca375c1214ef tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:57.762519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5e8345ee-8786-4012-9521-ca375c1214ef tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:57.767504 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5e8345ee-8786-4012-9521-ca375c1214ef tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1721 microversion: 2.20 time: 0.772801 Jul 14 14:59:57.768654 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2761/5539] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:56 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1721 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:58.787491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8297ac4c-718d-4a3e-906b-776102343678 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:58.788106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8297ac4c-718d-4a3e-906b-776102343678 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:58.810810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8297ac4c-718d-4a3e-906b-776102343678 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:58.811502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8297ac4c-718d-4a3e-906b-776102343678 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:58.812480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8297ac4c-718d-4a3e-906b-776102343678 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:58.813159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8297ac4c-718d-4a3e-906b-776102343678 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:59.206107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8297ac4c-718d-4a3e-906b-776102343678 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:59.218732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8297ac4c-718d-4a3e-906b-776102343678 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:59.220741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8297ac4c-718d-4a3e-906b-776102343678 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:59.222648 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8297ac4c-718d-4a3e-906b-776102343678 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1721 microversion: 2.20 time: 0.439795 Jul 14 14:59:59.223743 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2779/5540] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:58 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1721 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:59.675908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-215db2bb-1050-4844-b970-ea7dbf4bbb34 req-af23db50-1eae-445a-aa06-9877e61f9d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9928624-d55d-4cef-b484-6c377f54271e", "name": "network-vif-unplugged", "status": "completed", "tag": "2c2be47c-cc25-46c1-a7aa-1dde1fe54b61"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:59.704165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-215db2bb-1050-4844-b970-ea7dbf4bbb34 req-af23db50-1eae-445a-aa06-9877e61f9d06 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:59.704816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-215db2bb-1050-4844-b970-ea7dbf4bbb34 req-af23db50-1eae-445a-aa06-9877e61f9d06 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:59.745114 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-215db2bb-1050-4844-b970-ea7dbf4bbb34 req-af23db50-1eae-445a-aa06-9877e61f9d06 service nova] Creating event network-vif-unplugged:2c2be47c-cc25-46c1-a7aa-1dde1fe54b61 for instance e9928624-d55d-4cef-b484-6c377f54271e on n-h2-767704-28 Jul 14 14:59:59.772980 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-215db2bb-1050-4844-b970-ea7dbf4bbb34 req-af23db50-1eae-445a-aa06-9877e61f9d06 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103318 Jul 14 14:59:59.777863 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2762/5541] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:00.249362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-90a310ff-2846-41be-b810-526b79bbdb17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:00.250181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-90a310ff-2846-41be-b810-526b79bbdb17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:00.293504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90a310ff-2846-41be-b810-526b79bbdb17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:00.293978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90a310ff-2846-41be-b810-526b79bbdb17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:00.295142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90a310ff-2846-41be-b810-526b79bbdb17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:00.295586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90a310ff-2846-41be-b810-526b79bbdb17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:00.650547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-90a310ff-2846-41be-b810-526b79bbdb17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:00.663132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-90a310ff-2846-41be-b810-526b79bbdb17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:00.666177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-90a310ff-2846-41be-b810-526b79bbdb17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:00.669951 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-90a310ff-2846-41be-b810-526b79bbdb17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1664 microversion: 2.20 time: 0.427811 Jul 14 15:00:00.675980 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2780/5542] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:00 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1664 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:00.696245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7eec6992-d6a7-4c03-9e38-131220a22f17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15ae49f7-840b-4fce-8a9c-b4795cc7ecd8"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:00.697592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7eec6992-d6a7-4c03-9e38-131220a22f17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:00.751261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7eec6992-d6a7-4c03-9e38-131220a22f17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:00.758467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7eec6992-d6a7-4c03-9e38-131220a22f17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:00.760354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7eec6992-d6a7-4c03-9e38-131220a22f17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:00.763836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7eec6992-d6a7-4c03-9e38-131220a22f17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:01.412565 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7eec6992-d6a7-4c03-9e38-131220a22f17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "POST /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.721015 Jul 14 15:00:01.419802 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2763/5543] 10.222.0.81 () {62 vars in 1363 bytes} [Thu Jul 14 15:00:00 2022] POST /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/os-volume_attachments => generated 188 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:00:01.855921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5cf9c87b-5973-411b-bcf3-2adf51b8014b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:01.857440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5cf9c87b-5973-411b-bcf3-2adf51b8014b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:01.883462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5cf9c87b-5973-411b-bcf3-2adf51b8014b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:01.885246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5cf9c87b-5973-411b-bcf3-2adf51b8014b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:01.889865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5cf9c87b-5973-411b-bcf3-2adf51b8014b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:01.890580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5cf9c87b-5973-411b-bcf3-2adf51b8014b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:02.927750 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5cf9c87b-5973-411b-bcf3-2adf51b8014b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/os-volume_attachments/15ae49f7-840b-4fce-8a9c-b4795cc7ecd8" status: 202 len: 0 microversion: 2.20 time: 1.077567 Jul 14 15:00:02.935566 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2781/5544] 10.222.0.81 () {60 vars in 1456 bytes} [Thu Jul 14 15:00:01 2022] DELETE /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/os-volume_attachments/15ae49f7-840b-4fce-8a9c-b4795cc7ecd8 => generated 0 bytes in 1085 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:00:03.280525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8a6bab10-8989-48a1-9c22-e6ca9c57e9be tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:03.281083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8a6bab10-8989-48a1-9c22-e6ca9c57e9be tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:03.305343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a6bab10-8989-48a1-9c22-e6ca9c57e9be tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:03.306323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a6bab10-8989-48a1-9c22-e6ca9c57e9be tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:03.308152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a6bab10-8989-48a1-9c22-e6ca9c57e9be tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:03.309715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a6bab10-8989-48a1-9c22-e6ca9c57e9be tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:03.604078 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8a6bab10-8989-48a1-9c22-e6ca9c57e9be tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "POST /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/action" status: 202 len: 0 microversion: 2.20 time: 0.342053 Jul 14 15:00:03.632834 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2764/5545] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jul 14 15:00:03 2022] POST /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:00:03.633075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6743c18b-fc9f-42a3-8d81-238e381a65d7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:03.633657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6743c18b-fc9f-42a3-8d81-238e381a65d7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:03.651005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6743c18b-fc9f-42a3-8d81-238e381a65d7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:03.652092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6743c18b-fc9f-42a3-8d81-238e381a65d7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:03.658709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6743c18b-fc9f-42a3-8d81-238e381a65d7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:03.663104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6743c18b-fc9f-42a3-8d81-238e381a65d7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:05.054374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6743c18b-fc9f-42a3-8d81-238e381a65d7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:05.073967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6743c18b-fc9f-42a3-8d81-238e381a65d7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:05.078119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6743c18b-fc9f-42a3-8d81-238e381a65d7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:05.080309 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6743c18b-fc9f-42a3-8d81-238e381a65d7 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1672 microversion: 2.20 time: 1.451552 Jul 14 15:00:05.087594 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2782/5546] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:03 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1672 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:00:06.131766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ecce9073-32e2-4e67-b360-186def1638fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:06.136651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ecce9073-32e2-4e67-b360-186def1638fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:06.188489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ecce9073-32e2-4e67-b360-186def1638fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:06.188972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ecce9073-32e2-4e67-b360-186def1638fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:06.199426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ecce9073-32e2-4e67-b360-186def1638fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:06.209132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ecce9073-32e2-4e67-b360-186def1638fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:07.091172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ecce9073-32e2-4e67-b360-186def1638fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:07.099914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ecce9073-32e2-4e67-b360-186def1638fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:07.101369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ecce9073-32e2-4e67-b360-186def1638fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:07.112151 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ecce9073-32e2-4e67-b360-186def1638fa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.997767 Jul 14 15:00:07.126890 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2765/5547] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:06 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:08.145520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4635c748-306d-432b-a7b4-6162ada0bbac tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:08.147316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4635c748-306d-432b-a7b4-6162ada0bbac tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:08.159348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=34 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:08.165845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4635c748-306d-432b-a7b4-6162ada0bbac tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:08.167570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4635c748-306d-432b-a7b4-6162ada0bbac tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:08.174300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4635c748-306d-432b-a7b4-6162ada0bbac tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:08.175091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4635c748-306d-432b-a7b4-6162ada0bbac tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:08.675533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4635c748-306d-432b-a7b4-6162ada0bbac tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:08.696000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4635c748-306d-432b-a7b4-6162ada0bbac tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:08.705087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4635c748-306d-432b-a7b4-6162ada0bbac tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:08.710143 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4635c748-306d-432b-a7b4-6162ada0bbac tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.568590 Jul 14 15:00:08.713444 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2783/5548] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:08 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:08.927749 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:00:08.928034 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:00:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:00:09.731967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea36b8fe-1b4c-47af-9037-44e3ffc148cc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:09.734064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ea36b8fe-1b4c-47af-9037-44e3ffc148cc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:09.750110 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=30 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:09.754924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea36b8fe-1b4c-47af-9037-44e3ffc148cc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:09.756659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea36b8fe-1b4c-47af-9037-44e3ffc148cc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:09.762642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea36b8fe-1b4c-47af-9037-44e3ffc148cc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:09.763524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea36b8fe-1b4c-47af-9037-44e3ffc148cc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:10.102746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ea36b8fe-1b4c-47af-9037-44e3ffc148cc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:10.115374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ea36b8fe-1b4c-47af-9037-44e3ffc148cc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:10.121924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ea36b8fe-1b4c-47af-9037-44e3ffc148cc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:10.126242 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ea36b8fe-1b4c-47af-9037-44e3ffc148cc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.398834 Jul 14 15:00:10.131731 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2766/5549] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:09 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:11.153143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fd1d60e2-70c1-4c68-b1a1-995aea00e489 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:11.153968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fd1d60e2-70c1-4c68-b1a1-995aea00e489 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:11.228186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fd1d60e2-70c1-4c68-b1a1-995aea00e489 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:11.228536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fd1d60e2-70c1-4c68-b1a1-995aea00e489 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:11.235487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fd1d60e2-70c1-4c68-b1a1-995aea00e489 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:11.238537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fd1d60e2-70c1-4c68-b1a1-995aea00e489 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:11.969294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fd1d60e2-70c1-4c68-b1a1-995aea00e489 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:11.985276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fd1d60e2-70c1-4c68-b1a1-995aea00e489 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:11.991235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fd1d60e2-70c1-4c68-b1a1-995aea00e489 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:11.992811 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fd1d60e2-70c1-4c68-b1a1-995aea00e489 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.846681 Jul 14 15:00:12.011985 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2784/5550] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:11 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:13.022838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-283f9e1c-6b33-460f-876d-d9a7862601c5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:13.024409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-283f9e1c-6b33-460f-876d-d9a7862601c5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:13.064433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-283f9e1c-6b33-460f-876d-d9a7862601c5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:13.068240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-283f9e1c-6b33-460f-876d-d9a7862601c5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:13.086218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-283f9e1c-6b33-460f-876d-d9a7862601c5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:13.089993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-283f9e1c-6b33-460f-876d-d9a7862601c5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:13.255800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:13.570503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-283f9e1c-6b33-460f-876d-d9a7862601c5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:13.587108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-283f9e1c-6b33-460f-876d-d9a7862601c5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:13.594639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-283f9e1c-6b33-460f-876d-d9a7862601c5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:13.604213 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-283f9e1c-6b33-460f-876d-d9a7862601c5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.587172 Jul 14 15:00:13.615873 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2767/5551] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:13 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:14.628972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9388d9f3-0383-41ba-b064-29436147b925 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:14.630364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9388d9f3-0383-41ba-b064-29436147b925 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:14.644008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9388d9f3-0383-41ba-b064-29436147b925 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:14.645047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9388d9f3-0383-41ba-b064-29436147b925 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:14.646168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9388d9f3-0383-41ba-b064-29436147b925 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:14.647140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9388d9f3-0383-41ba-b064-29436147b925 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:15.040528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9388d9f3-0383-41ba-b064-29436147b925 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:15.057313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9388d9f3-0383-41ba-b064-29436147b925 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:15.063307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9388d9f3-0383-41ba-b064-29436147b925 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:15.069783 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9388d9f3-0383-41ba-b064-29436147b925 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.445599 Jul 14 15:00:15.070543 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2785/5552] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:14 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:15.563934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ca13ea8e-f791-4731-ba19-f83e7591b6ad tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:15.564990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ca13ea8e-f791-4731-ba19-f83e7591b6ad tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:15.590216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca13ea8e-f791-4731-ba19-f83e7591b6ad tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:15.594467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca13ea8e-f791-4731-ba19-f83e7591b6ad tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:15.598495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca13ea8e-f791-4731-ba19-f83e7591b6ad tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:15.601223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca13ea8e-f791-4731-ba19-f83e7591b6ad tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:15.897006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-ca13ea8e-f791-4731-ba19-f83e7591b6ad tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lazy-loading 'services' on Instance uuid accee1e3-de25-42fe-b062-e6c330d4e88c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:00:16.090235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5897879e-e580-4d04-b908-5b668dc10de5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:16.094764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5897879e-e580-4d04-b908-5b668dc10de5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:16.127166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5897879e-e580-4d04-b908-5b668dc10de5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:16.127627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5897879e-e580-4d04-b908-5b668dc10de5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:16.128716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5897879e-e580-4d04-b908-5b668dc10de5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:16.129228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5897879e-e580-4d04-b908-5b668dc10de5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:16.174775 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ca13ea8e-f791-4731-ba19-f83e7591b6ad tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "DELETE /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/os-volume_attachments/a8378f0a-ce7a-45bf-9058-1c24376de3b1" status: 202 len: 0 microversion: 2.1 time: 0.617257 Jul 14 15:00:16.190494 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2768/5553] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:00:15 2022] DELETE /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/os-volume_attachments/a8378f0a-ce7a-45bf-9058-1c24376de3b1 => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:00:16.247686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:17.747916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5897879e-e580-4d04-b908-5b668dc10de5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:17.759152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5897879e-e580-4d04-b908-5b668dc10de5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:17.773308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5897879e-e580-4d04-b908-5b668dc10de5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:17.781342 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5897879e-e580-4d04-b908-5b668dc10de5 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 1.691459 Jul 14 15:00:17.783194 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2786/5554] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:16 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:00:18.803963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-69737901-5d2c-4137-8cc8-04f20aa4503b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:18.805565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-69737901-5d2c-4137-8cc8-04f20aa4503b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:18.824127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69737901-5d2c-4137-8cc8-04f20aa4503b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:18.825083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69737901-5d2c-4137-8cc8-04f20aa4503b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:18.826116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69737901-5d2c-4137-8cc8-04f20aa4503b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:18.826774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69737901-5d2c-4137-8cc8-04f20aa4503b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:19.393619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-69737901-5d2c-4137-8cc8-04f20aa4503b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:19.419830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-69737901-5d2c-4137-8cc8-04f20aa4503b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:19.446167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-69737901-5d2c-4137-8cc8-04f20aa4503b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:19.451960 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-69737901-5d2c-4137-8cc8-04f20aa4503b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.653158 Jul 14 15:00:19.453157 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2769/5555] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:18 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:20.497986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2ba2e134-ef8f-423a-95e2-439e980d5283 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:20.502103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2ba2e134-ef8f-423a-95e2-439e980d5283 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:20.585828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ba2e134-ef8f-423a-95e2-439e980d5283 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:20.586778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ba2e134-ef8f-423a-95e2-439e980d5283 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:20.590493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ba2e134-ef8f-423a-95e2-439e980d5283 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:20.595046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ba2e134-ef8f-423a-95e2-439e980d5283 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:21.854242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2ba2e134-ef8f-423a-95e2-439e980d5283 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:21.863105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2ba2e134-ef8f-423a-95e2-439e980d5283 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:21.868754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2ba2e134-ef8f-423a-95e2-439e980d5283 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:21.872624 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2ba2e134-ef8f-423a-95e2-439e980d5283 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 1.405102 Jul 14 15:00:21.886481 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2787/5556] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:20 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:22.906465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-088dd56a-864d-44f3-b749-f4093b588ccb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:22.907075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-088dd56a-864d-44f3-b749-f4093b588ccb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:22.934853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-088dd56a-864d-44f3-b749-f4093b588ccb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:22.945304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-088dd56a-864d-44f3-b749-f4093b588ccb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:22.969054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-088dd56a-864d-44f3-b749-f4093b588ccb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:22.970314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-088dd56a-864d-44f3-b749-f4093b588ccb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:23.771597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-088dd56a-864d-44f3-b749-f4093b588ccb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:23.787122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-088dd56a-864d-44f3-b749-f4093b588ccb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:23.795073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-088dd56a-864d-44f3-b749-f4093b588ccb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:23.796757 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-088dd56a-864d-44f3-b749-f4093b588ccb tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.894790 Jul 14 15:00:23.797670 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2770/5557] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:22 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:24.821346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-986f8230-fd0c-4f14-8c5c-0c4d59ebfc50 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:24.822104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-986f8230-fd0c-4f14-8c5c-0c4d59ebfc50 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:24.862767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-986f8230-fd0c-4f14-8c5c-0c4d59ebfc50 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:24.863226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-986f8230-fd0c-4f14-8c5c-0c4d59ebfc50 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:24.864031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-986f8230-fd0c-4f14-8c5c-0c4d59ebfc50 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:24.864534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-986f8230-fd0c-4f14-8c5c-0c4d59ebfc50 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:25.251802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-986f8230-fd0c-4f14-8c5c-0c4d59ebfc50 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:25.266821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-986f8230-fd0c-4f14-8c5c-0c4d59ebfc50 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:25.281443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-986f8230-fd0c-4f14-8c5c-0c4d59ebfc50 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:25.283265 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-986f8230-fd0c-4f14-8c5c-0c4d59ebfc50 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.467495 Jul 14 15:00:25.284488 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2788/5558] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:24 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:26.306168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-185b60b8-4a1d-4ce0-a1de-a05851426e36 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:26.306902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-185b60b8-4a1d-4ce0-a1de-a05851426e36 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:26.333449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-185b60b8-4a1d-4ce0-a1de-a05851426e36 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:26.333916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-185b60b8-4a1d-4ce0-a1de-a05851426e36 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:26.334725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-185b60b8-4a1d-4ce0-a1de-a05851426e36 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:26.335179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-185b60b8-4a1d-4ce0-a1de-a05851426e36 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:27.982068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-185b60b8-4a1d-4ce0-a1de-a05851426e36 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:27.996848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-185b60b8-4a1d-4ce0-a1de-a05851426e36 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:28.005065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-185b60b8-4a1d-4ce0-a1de-a05851426e36 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:28.010256 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-185b60b8-4a1d-4ce0-a1de-a05851426e36 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 1.709174 Jul 14 15:00:28.014906 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2771/5559] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:26 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:29.035641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c6c47a4b-eabf-4673-94bf-08c4fc2e79e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:29.037864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c6c47a4b-eabf-4673-94bf-08c4fc2e79e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:29.079463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c47a4b-eabf-4673-94bf-08c4fc2e79e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:29.085482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c47a4b-eabf-4673-94bf-08c4fc2e79e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:29.086545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c47a4b-eabf-4673-94bf-08c4fc2e79e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:29.087015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c47a4b-eabf-4673-94bf-08c4fc2e79e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:29.790319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c6c47a4b-eabf-4673-94bf-08c4fc2e79e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:29.801871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c6c47a4b-eabf-4673-94bf-08c4fc2e79e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:29.806824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c6c47a4b-eabf-4673-94bf-08c4fc2e79e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:29.816009 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c6c47a4b-eabf-4673-94bf-08c4fc2e79e4 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.785342 Jul 14 15:00:29.828401 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2789/5560] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:29 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:30.840068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-806731a4-9048-461a-ab60-1834551214c8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:30.841168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-806731a4-9048-461a-ab60-1834551214c8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:30.883317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-806731a4-9048-461a-ab60-1834551214c8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:30.883788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-806731a4-9048-461a-ab60-1834551214c8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:30.884591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-806731a4-9048-461a-ab60-1834551214c8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:30.885690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-806731a4-9048-461a-ab60-1834551214c8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:31.340753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-806731a4-9048-461a-ab60-1834551214c8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:31.353736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-806731a4-9048-461a-ab60-1834551214c8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:31.356127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-806731a4-9048-461a-ab60-1834551214c8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:31.357614 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-806731a4-9048-461a-ab60-1834551214c8 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.522338 Jul 14 15:00:31.359418 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2772/5561] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:30 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:32.377943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1f9fe59f-0718-4a62-b2aa-d243b9565d17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:32.379000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f9fe59f-0718-4a62-b2aa-d243b9565d17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:32.401010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f9fe59f-0718-4a62-b2aa-d243b9565d17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:32.410597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f9fe59f-0718-4a62-b2aa-d243b9565d17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:32.415107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f9fe59f-0718-4a62-b2aa-d243b9565d17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:32.416350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f9fe59f-0718-4a62-b2aa-d243b9565d17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:33.186579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2112721880", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3d98a607-f77c-4d0d-bd4e-795f29f9cd89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bce1cdb9-0501-4062-a135-972a001804ef"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:33.347924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] validate_networks() for [('bce1cdb9-0501-4062-a135-972a001804ef', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:00:33.707331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f9fe59f-0718-4a62-b2aa-d243b9565d17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:33.733183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f9fe59f-0718-4a62-b2aa-d243b9565d17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:33.739528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1f9fe59f-0718-4a62-b2aa-d243b9565d17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:33.747077 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1f9fe59f-0718-4a62-b2aa-d243b9565d17 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 1.373093 Jul 14 15:00:33.748466 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2790/5562] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:32 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:34.383504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:00:34.384062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:00:34.384427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:00:34.384839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:00:34.385295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:00:34.400187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.404543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:34.405746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.406283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:34.461441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:00:34.480364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for user e77523cc1cca458eb2a1b553aff072be and project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:00:34.736985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:00:34.739647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d98a607-f77c-4d0d-bd4e-795f29f9cd89',volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:00:34.784213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c35eecb6-c302-4f3b-b234-dcc016c5c57d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:34.784845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c35eecb6-c302-4f3b-b234-dcc016c5c57d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:34.793545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c35eecb6-c302-4f3b-b234-dcc016c5c57d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.808678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c35eecb6-c302-4f3b-b234-dcc016c5c57d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:34.820656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c35eecb6-c302-4f3b-b234-dcc016c5c57d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.829373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c35eecb6-c302-4f3b-b234-dcc016c5c57d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:35.143195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c35eecb6-c302-4f3b-b234-dcc016c5c57d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:35.166534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c35eecb6-c302-4f3b-b234-dcc016c5c57d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:35.168573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c35eecb6-c302-4f3b-b234-dcc016c5c57d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:35.170519 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c35eecb6-c302-4f3b-b234-dcc016c5c57d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.396092 Jul 14 15:00:35.171607 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2791/5563] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:34 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:00:35.216099 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-94774efe-be17-4888-9b6e-9caafa40a1d8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.034015 Jul 14 15:00:35.217602 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2773/5564] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:00:35.228242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8b832804-264d-4433-b387-feb317f9056b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:35.228880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8b832804-264d-4433-b387-feb317f9056b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:35.339878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8b832804-264d-4433-b387-feb317f9056b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:35.348510 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8b832804-264d-4433-b387-feb317f9056b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1057 microversion: 2.1 time: 0.124760 Jul 14 15:00:35.358261 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2792/5565] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:35 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1057 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:36.189997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d3015ce-93aa-4e5f-bd02-133dcd6142b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:36.190628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0d3015ce-93aa-4e5f-bd02-133dcd6142b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:36.203269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d3015ce-93aa-4e5f-bd02-133dcd6142b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:36.205923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d3015ce-93aa-4e5f-bd02-133dcd6142b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:36.212378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d3015ce-93aa-4e5f-bd02-133dcd6142b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:36.214530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d3015ce-93aa-4e5f-bd02-133dcd6142b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:36.366477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eb7052b7-95c9-46f0-9371-14c718f01122 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:36.367269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eb7052b7-95c9-46f0-9371-14c718f01122 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:36.392858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb7052b7-95c9-46f0-9371-14c718f01122 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:36.393351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb7052b7-95c9-46f0-9371-14c718f01122 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:36.394173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb7052b7-95c9-46f0-9371-14c718f01122 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:36.394621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb7052b7-95c9-46f0-9371-14c718f01122 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:36.603469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eb7052b7-95c9-46f0-9371-14c718f01122 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:36.621568 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eb7052b7-95c9-46f0-9371-14c718f01122 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1099 microversion: 2.1 time: 0.258433 Jul 14 15:00:36.627825 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2793/5566] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:36 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1099 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:36.634090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7766293f-08f9-4548-b5da-36458e17b764 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:36.683668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0d3015ce-93aa-4e5f-bd02-133dcd6142b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:36.684792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7766293f-08f9-4548-b5da-36458e17b764 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:36.686375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7766293f-08f9-4548-b5da-36458e17b764 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:36.698750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0d3015ce-93aa-4e5f-bd02-133dcd6142b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:36.702154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0d3015ce-93aa-4e5f-bd02-133dcd6142b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:36.704058 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0d3015ce-93aa-4e5f-bd02-133dcd6142b0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.518229 Jul 14 15:00:36.704662 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2774/5567] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:36 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:36.719664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7766293f-08f9-4548-b5da-36458e17b764 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Going to try to stop instance {{(pid=119512) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 15:00:36.827338 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7766293f-08f9-4548-b5da-36458e17b764 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "POST /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/action" status: 202 len: 0 microversion: 2.1 time: 0.196074 Jul 14 15:00:36.828448 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2794/5568] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:36 2022] POST /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:00:36.847456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-540a88fa-1a39-4aef-8844-1956aef1131d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:36.850749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-540a88fa-1a39-4aef-8844-1956aef1131d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:36.877390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-540a88fa-1a39-4aef-8844-1956aef1131d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:36.878027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-540a88fa-1a39-4aef-8844-1956aef1131d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:36.883675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-540a88fa-1a39-4aef-8844-1956aef1131d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:36.885334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-540a88fa-1a39-4aef-8844-1956aef1131d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.270462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-540a88fa-1a39-4aef-8844-1956aef1131d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:37.293281 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-540a88fa-1a39-4aef-8844-1956aef1131d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1675 microversion: 2.1 time: 0.455300 Jul 14 15:00:37.293958 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2775/5569] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:36 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1675 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:37.612398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e33dd7e1-5741-4280-9c66-e49c50d46dcb req-7b62a81f-c25d-41a4-9dab-ed7511f4ffc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9928624-d55d-4cef-b484-6c377f54271e", "name": "network-vif-plugged", "status": "completed", "tag": "2c2be47c-cc25-46c1-a7aa-1dde1fe54b61"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:37.641658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e33dd7e1-5741-4280-9c66-e49c50d46dcb req-7b62a81f-c25d-41a4-9dab-ed7511f4ffc6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.644594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e33dd7e1-5741-4280-9c66-e49c50d46dcb req-7b62a81f-c25d-41a4-9dab-ed7511f4ffc6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.653041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7709c3ab-5062-440d-8abb-b33833cf2ebc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:37.660632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7709c3ab-5062-440d-8abb-b33833cf2ebc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:37.676069 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e33dd7e1-5741-4280-9c66-e49c50d46dcb req-7b62a81f-c25d-41a4-9dab-ed7511f4ffc6 service nova] Creating event network-vif-plugged:2c2be47c-cc25-46c1-a7aa-1dde1fe54b61 for instance e9928624-d55d-4cef-b484-6c377f54271e on n-h2-767704-28 Jul 14 15:00:37.690219 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e33dd7e1-5741-4280-9c66-e49c50d46dcb req-7b62a81f-c25d-41a4-9dab-ed7511f4ffc6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084037 Jul 14 15:00:37.693276 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2795/5570] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:37.694570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7709c3ab-5062-440d-8abb-b33833cf2ebc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.695215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7709c3ab-5062-440d-8abb-b33833cf2ebc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.701431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7709c3ab-5062-440d-8abb-b33833cf2ebc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.702262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7709c3ab-5062-440d-8abb-b33833cf2ebc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.726518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-157724d7-1900-43a1-b83f-3f5d5223b65e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:37.727246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-157724d7-1900-43a1-b83f-3f5d5223b65e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:37.754020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-157724d7-1900-43a1-b83f-3f5d5223b65e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.754491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-157724d7-1900-43a1-b83f-3f5d5223b65e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.755322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-157724d7-1900-43a1-b83f-3f5d5223b65e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.767127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-157724d7-1900-43a1-b83f-3f5d5223b65e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.883643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7709c3ab-5062-440d-8abb-b33833cf2ebc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:37.900189 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7709c3ab-5062-440d-8abb-b33833cf2ebc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1173 microversion: 2.1 time: 0.258204 Jul 14 15:00:37.902130 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2776/5571] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:37 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1173 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:38.312893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-de712536-0819-4cb0-8b89-111f8ca83058 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:38.314310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-de712536-0819-4cb0-8b89-111f8ca83058 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:38.340325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de712536-0819-4cb0-8b89-111f8ca83058 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:38.341111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de712536-0819-4cb0-8b89-111f8ca83058 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:38.342251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de712536-0819-4cb0-8b89-111f8ca83058 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:38.343541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de712536-0819-4cb0-8b89-111f8ca83058 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:38.571827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-157724d7-1900-43a1-b83f-3f5d5223b65e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:38.587766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-157724d7-1900-43a1-b83f-3f5d5223b65e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:38.590054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-157724d7-1900-43a1-b83f-3f5d5223b65e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:38.591296 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-157724d7-1900-43a1-b83f-3f5d5223b65e tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.872351 Jul 14 15:00:38.591878 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2796/5572] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:37 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:00:38.921073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8489cb1d-c610-40b1-926c-255ff8ed6767 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:38.922231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8489cb1d-c610-40b1-926c-255ff8ed6767 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:38.934745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=30 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:38.942270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8489cb1d-c610-40b1-926c-255ff8ed6767 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:38.942809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-de712536-0819-4cb0-8b89-111f8ca83058 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:38.943248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8489cb1d-c610-40b1-926c-255ff8ed6767 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:38.944249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8489cb1d-c610-40b1-926c-255ff8ed6767 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:38.944897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8489cb1d-c610-40b1-926c-255ff8ed6767 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:38.951760 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-de712536-0819-4cb0-8b89-111f8ca83058 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1675 microversion: 2.1 time: 0.644669 Jul 14 15:00:38.952360 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2777/5573] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:38 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1675 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:39.393838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8489cb1d-c610-40b1-926c-255ff8ed6767 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:39.406392 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8489cb1d-c610-40b1-926c-255ff8ed6767 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1215 microversion: 2.1 time: 0.490641 Jul 14 15:00:39.407930 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2797/5574] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:38 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1215 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:39.614872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3901d213-af0f-4a51-889d-1c0d8184d428 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:39.616092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3901d213-af0f-4a51-889d-1c0d8184d428 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:39.639582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3901d213-af0f-4a51-889d-1c0d8184d428 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:39.640797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3901d213-af0f-4a51-889d-1c0d8184d428 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:39.641933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3901d213-af0f-4a51-889d-1c0d8184d428 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:39.643039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3901d213-af0f-4a51-889d-1c0d8184d428 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:39.976063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6a5fb116-f750-4a45-950a-9b1adba8038f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:39.976700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6a5fb116-f750-4a45-950a-9b1adba8038f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:39.987804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a5fb116-f750-4a45-950a-9b1adba8038f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:39.989624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a5fb116-f750-4a45-950a-9b1adba8038f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:39.989624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a5fb116-f750-4a45-950a-9b1adba8038f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:39.989624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a5fb116-f750-4a45-950a-9b1adba8038f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:40.259337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3901d213-af0f-4a51-889d-1c0d8184d428 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:40.272784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3901d213-af0f-4a51-889d-1c0d8184d428 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:40.282952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3901d213-af0f-4a51-889d-1c0d8184d428 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:40.284632 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3901d213-af0f-4a51-889d-1c0d8184d428 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.677837 Jul 14 15:00:40.288031 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2778/5575] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:39 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:40.426839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8411ba4a-b833-4ba5-9278-bf44727657ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:40.428425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8411ba4a-b833-4ba5-9278-bf44727657ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:40.431137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:40.446171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8411ba4a-b833-4ba5-9278-bf44727657ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:40.447039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8411ba4a-b833-4ba5-9278-bf44727657ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:40.448252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8411ba4a-b833-4ba5-9278-bf44727657ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:40.452298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8411ba4a-b833-4ba5-9278-bf44727657ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:40.467400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6a5fb116-f750-4a45-950a-9b1adba8038f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:40.476755 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6a5fb116-f750-4a45-950a-9b1adba8038f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1675 microversion: 2.1 time: 0.508603 Jul 14 15:00:40.477603 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2798/5576] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:39 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1675 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:41.080066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8411ba4a-b833-4ba5-9278-bf44727657ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:41.098019 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8411ba4a-b833-4ba5-9278-bf44727657ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1215 microversion: 2.1 time: 0.674254 Jul 14 15:00:41.109348 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2779/5577] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:40 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1215 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:41.310957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-985016dc-a836-4c3f-99e8-a917eb3489b1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:41.315508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-985016dc-a836-4c3f-99e8-a917eb3489b1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:41.333315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-985016dc-a836-4c3f-99e8-a917eb3489b1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:41.340597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-985016dc-a836-4c3f-99e8-a917eb3489b1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:41.341716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-985016dc-a836-4c3f-99e8-a917eb3489b1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:41.345341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-985016dc-a836-4c3f-99e8-a917eb3489b1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:41.497045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dfe7eee0-9baf-4c05-acac-0af0cb7f2cc3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:41.497694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dfe7eee0-9baf-4c05-acac-0af0cb7f2cc3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:41.515428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dfe7eee0-9baf-4c05-acac-0af0cb7f2cc3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:41.515899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dfe7eee0-9baf-4c05-acac-0af0cb7f2cc3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:41.516720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dfe7eee0-9baf-4c05-acac-0af0cb7f2cc3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:41.525138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dfe7eee0-9baf-4c05-acac-0af0cb7f2cc3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:42.187662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-985016dc-a836-4c3f-99e8-a917eb3489b1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:42.247999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-985016dc-a836-4c3f-99e8-a917eb3489b1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:42.250125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-985016dc-a836-4c3f-99e8-a917eb3489b1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:42.254106 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-985016dc-a836-4c3f-99e8-a917eb3489b1 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1730 microversion: 2.20 time: 0.947796 Jul 14 15:00:42.254861 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2799/5578] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:41 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1730 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:42.261585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-322c1c7b-0f50-498f-bc27-6f7aee0440fc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:42.262629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-322c1c7b-0f50-498f-bc27-6f7aee0440fc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:42.272300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-322c1c7b-0f50-498f-bc27-6f7aee0440fc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:42.273189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-322c1c7b-0f50-498f-bc27-6f7aee0440fc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:42.274194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-322c1c7b-0f50-498f-bc27-6f7aee0440fc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:42.274654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-322c1c7b-0f50-498f-bc27-6f7aee0440fc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:42.552018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dfe7eee0-9baf-4c05-acac-0af0cb7f2cc3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:42.570244 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dfe7eee0-9baf-4c05-acac-0af0cb7f2cc3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1675 microversion: 2.1 time: 1.079341 Jul 14 15:00:42.571088 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2780/5579] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:41 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1675 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:42.650600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-322c1c7b-0f50-498f-bc27-6f7aee0440fc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:42.680805 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-322c1c7b-0f50-498f-bc27-6f7aee0440fc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1215 microversion: 2.1 time: 0.423828 Jul 14 15:00:42.681832 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2800/5580] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:42 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1215 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:42.756711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-8ba34eb3-74b8-4096-aba8-d05f4f1b92ed req-ef118d62-71e0-4194-8501-b0550717c01e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2", "tag": "1c510783-0a10-4fcc-96f9-dae1701c7e30"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:42.790458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8ba34eb3-74b8-4096-aba8-d05f4f1b92ed req-ef118d62-71e0-4194-8501-b0550717c01e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:42.791064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8ba34eb3-74b8-4096-aba8-d05f4f1b92ed req-ef118d62-71e0-4194-8501-b0550717c01e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:42.853975 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8ba34eb3-74b8-4096-aba8-d05f4f1b92ed req-ef118d62-71e0-4194-8501-b0550717c01e service nova] Creating event network-changed:1c510783-0a10-4fcc-96f9-dae1701c7e30 for instance 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 on n-h2-767704-28 Jul 14 15:00:42.883508 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-8ba34eb3-74b8-4096-aba8-d05f4f1b92ed req-ef118d62-71e0-4194-8501-b0550717c01e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133111 Jul 14 15:00:42.885032 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2781/5581] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:43.286138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3650b027-cca9-46e2-9983-d1acd43a5875 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:43.291412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3650b027-cca9-46e2-9983-d1acd43a5875 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:43.327324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3650b027-cca9-46e2-9983-d1acd43a5875 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:43.331814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3650b027-cca9-46e2-9983-d1acd43a5875 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:43.336857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3650b027-cca9-46e2-9983-d1acd43a5875 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:43.337901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3650b027-cca9-46e2-9983-d1acd43a5875 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:43.591361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c5fc2b16-f4f8-41cc-b3a3-2fc7c8957fa6 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:43.594863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c5fc2b16-f4f8-41cc-b3a3-2fc7c8957fa6 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:43.607490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fc2b16-f4f8-41cc-b3a3-2fc7c8957fa6 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:43.608457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fc2b16-f4f8-41cc-b3a3-2fc7c8957fa6 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:43.609679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fc2b16-f4f8-41cc-b3a3-2fc7c8957fa6 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:43.610787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5fc2b16-f4f8-41cc-b3a3-2fc7c8957fa6 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:43.618702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:43.760162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3650b027-cca9-46e2-9983-d1acd43a5875 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:43.779917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3650b027-cca9-46e2-9983-d1acd43a5875 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:43.790195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3650b027-cca9-46e2-9983-d1acd43a5875 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:43.791640 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3650b027-cca9-46e2-9983-d1acd43a5875 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1717 microversion: 2.20 time: 0.515710 Jul 14 15:00:43.801039 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2801/5582] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:00:43 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1717 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:00:43.806108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fdc4c5ed-d221-454b-875b-a95537e9b261 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:43.806738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fdc4c5ed-d221-454b-875b-a95537e9b261 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:43.820077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdc4c5ed-d221-454b-875b-a95537e9b261 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:43.820542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdc4c5ed-d221-454b-875b-a95537e9b261 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:43.832997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdc4c5ed-d221-454b-875b-a95537e9b261 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:43.833482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fdc4c5ed-d221-454b-875b-a95537e9b261 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:44.427903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:44.503641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:44.784544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c5fc2b16-f4f8-41cc-b3a3-2fc7c8957fa6 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:44.813918 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c5fc2b16-f4f8-41cc-b3a3-2fc7c8957fa6 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1675 microversion: 2.1 time: 1.218723 Jul 14 15:00:44.813918 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2782/5583] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:43 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1675 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:44.988698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fdc4c5ed-d221-454b-875b-a95537e9b261 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:45.005960 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fdc4c5ed-d221-454b-875b-a95537e9b261 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1215 microversion: 2.1 time: 1.203653 Jul 14 15:00:45.006570 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2802/5584] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:43 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1215 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:45.833418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-969be338-c822-40e1-a1d0-227f2c73e57d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:45.837088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-969be338-c822-40e1-a1d0-227f2c73e57d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:45.857403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-969be338-c822-40e1-a1d0-227f2c73e57d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:45.860324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-969be338-c822-40e1-a1d0-227f2c73e57d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:45.862435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-969be338-c822-40e1-a1d0-227f2c73e57d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:45.863984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-969be338-c822-40e1-a1d0-227f2c73e57d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:46.035980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a81e7f7b-ebe9-4026-8791-acc49fcc31a8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:46.037583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a81e7f7b-ebe9-4026-8791-acc49fcc31a8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:46.060979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:46.076276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a81e7f7b-ebe9-4026-8791-acc49fcc31a8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:46.079260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a81e7f7b-ebe9-4026-8791-acc49fcc31a8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:46.081968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a81e7f7b-ebe9-4026-8791-acc49fcc31a8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:46.083176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a81e7f7b-ebe9-4026-8791-acc49fcc31a8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:46.171615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:46.511484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-969be338-c822-40e1-a1d0-227f2c73e57d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:46.514533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a81e7f7b-ebe9-4026-8791-acc49fcc31a8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:46.522835 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a81e7f7b-ebe9-4026-8791-acc49fcc31a8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1215 microversion: 2.1 time: 0.493522 Jul 14 15:00:46.527036 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-969be338-c822-40e1-a1d0-227f2c73e57d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1675 microversion: 2.1 time: 0.709540 Jul 14 15:00:46.528348 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2783/5585] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:45 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1675 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:46.533597 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2803/5586] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:46 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1215 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:47.543746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e3d12a48-7631-4d0d-8198-a8b9183c5f38 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:47.545050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e3d12a48-7631-4d0d-8198-a8b9183c5f38 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:47.548825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b69db57-600a-478f-8717-3dbfcb25e273 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:47.549634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b69db57-600a-478f-8717-3dbfcb25e273 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:47.556492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3d12a48-7631-4d0d-8198-a8b9183c5f38 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:47.561690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3d12a48-7631-4d0d-8198-a8b9183c5f38 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:47.563012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3d12a48-7631-4d0d-8198-a8b9183c5f38 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:47.566795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b69db57-600a-478f-8717-3dbfcb25e273 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:47.567956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b69db57-600a-478f-8717-3dbfcb25e273 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:47.569228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b69db57-600a-478f-8717-3dbfcb25e273 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:47.569981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b69db57-600a-478f-8717-3dbfcb25e273 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:47.572349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3d12a48-7631-4d0d-8198-a8b9183c5f38 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:48.001094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e3d12a48-7631-4d0d-8198-a8b9183c5f38 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:48.039492 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e3d12a48-7631-4d0d-8198-a8b9183c5f38 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1215 microversion: 2.1 time: 0.486554 Jul 14 15:00:48.040680 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2784/5587] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:47 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1215 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:48.158458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2b69db57-600a-478f-8717-3dbfcb25e273 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:48.174585 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b69db57-600a-478f-8717-3dbfcb25e273 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1652 microversion: 2.1 time: 0.630356 Jul 14 15:00:48.175587 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2804/5588] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:47 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1652 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:48.206002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e009adf8-e5c2-4a14-b711-d24cab77a5ac tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:48.217939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e009adf8-e5c2-4a14-b711-d24cab77a5ac tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:48.219005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e009adf8-e5c2-4a14-b711-d24cab77a5ac tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:48.354757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e009adf8-e5c2-4a14-b711-d24cab77a5ac tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Going to try to start instance {{(pid=119511) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 15:00:48.486025 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e009adf8-e5c2-4a14-b711-d24cab77a5ac tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "POST /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/action" status: 202 len: 0 microversion: 2.1 time: 0.282070 Jul 14 15:00:48.490284 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2785/5589] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:48 2022] POST /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:00:48.500638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7d7fc2f1-5c53-4f9d-bca3-4602cd0e1762 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:48.507301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7d7fc2f1-5c53-4f9d-bca3-4602cd0e1762 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:48.536209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d7fc2f1-5c53-4f9d-bca3-4602cd0e1762 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:48.554410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d7fc2f1-5c53-4f9d-bca3-4602cd0e1762 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:48.563191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d7fc2f1-5c53-4f9d-bca3-4602cd0e1762 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:48.565584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d7fc2f1-5c53-4f9d-bca3-4602cd0e1762 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:49.055393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7d7fc2f1-5c53-4f9d-bca3-4602cd0e1762 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:49.071999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-69c3bffa-b933-425f-8639-076291af24cb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:49.077814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-69c3bffa-b933-425f-8639-076291af24cb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:49.091014 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7d7fc2f1-5c53-4f9d-bca3-4602cd0e1762 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1661 microversion: 2.1 time: 0.598603 Jul 14 15:00:49.098655 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2805/5590] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:48 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1661 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:49.132736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69c3bffa-b933-425f-8639-076291af24cb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:49.143578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69c3bffa-b933-425f-8639-076291af24cb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:49.145537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69c3bffa-b933-425f-8639-076291af24cb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:49.146508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69c3bffa-b933-425f-8639-076291af24cb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:49.586905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-69c3bffa-b933-425f-8639-076291af24cb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:49.597277 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-69c3bffa-b933-425f-8639-076291af24cb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1215 microversion: 2.1 time: 0.529490 Jul 14 15:00:49.609387 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2786/5591] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:49 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1215 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:50.128611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3c7ca791-8c94-4c4d-9a69-067df239ce5d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:50.130866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3c7ca791-8c94-4c4d-9a69-067df239ce5d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:50.155567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c7ca791-8c94-4c4d-9a69-067df239ce5d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:50.156054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c7ca791-8c94-4c4d-9a69-067df239ce5d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:50.156890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c7ca791-8c94-4c4d-9a69-067df239ce5d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:50.157379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c7ca791-8c94-4c4d-9a69-067df239ce5d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:50.580359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3c7ca791-8c94-4c4d-9a69-067df239ce5d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:50.603013 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3c7ca791-8c94-4c4d-9a69-067df239ce5d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1661 microversion: 2.1 time: 0.483903 Jul 14 15:00:50.616534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cfbe1cea-1755-4449-aa99-92ba7e0a3f40 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:50.617867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cfbe1cea-1755-4449-aa99-92ba7e0a3f40 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:50.636643 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2806/5592] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:50 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1661 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:50.645354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cfbe1cea-1755-4449-aa99-92ba7e0a3f40 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:50.645837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cfbe1cea-1755-4449-aa99-92ba7e0a3f40 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:50.657505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cfbe1cea-1755-4449-aa99-92ba7e0a3f40 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:50.657976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cfbe1cea-1755-4449-aa99-92ba7e0a3f40 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:50.987520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cfbe1cea-1755-4449-aa99-92ba7e0a3f40 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:51.003301 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cfbe1cea-1755-4449-aa99-92ba7e0a3f40 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1215 microversion: 2.1 time: 0.390986 Jul 14 15:00:51.025950 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2787/5593] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:50 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1215 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:51.659052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-81061fec-5fbf-4d0f-a401-10e975ae8f67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:51.660196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-81061fec-5fbf-4d0f-a401-10e975ae8f67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:51.674708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81061fec-5fbf-4d0f-a401-10e975ae8f67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:51.675519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81061fec-5fbf-4d0f-a401-10e975ae8f67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:51.676879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81061fec-5fbf-4d0f-a401-10e975ae8f67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:51.680530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81061fec-5fbf-4d0f-a401-10e975ae8f67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:52.036887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-43ca04fc-1163-4ed4-8e72-2355a82596f5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:52.037806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-43ca04fc-1163-4ed4-8e72-2355a82596f5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:52.055762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43ca04fc-1163-4ed4-8e72-2355a82596f5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:52.092915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43ca04fc-1163-4ed4-8e72-2355a82596f5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:52.099402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43ca04fc-1163-4ed4-8e72-2355a82596f5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:52.104178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43ca04fc-1163-4ed4-8e72-2355a82596f5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:52.116892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-81061fec-5fbf-4d0f-a401-10e975ae8f67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:52.151362 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-81061fec-5fbf-4d0f-a401-10e975ae8f67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1665 microversion: 2.1 time: 0.488618 Jul 14 15:00:52.152463 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2807/5594] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:51 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1665 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:52.456781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-43ca04fc-1163-4ed4-8e72-2355a82596f5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:52.467863 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-43ca04fc-1163-4ed4-8e72-2355a82596f5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1215 microversion: 2.1 time: 0.441888 Jul 14 15:00:52.469688 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2788/5595] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:52 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1215 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:53.486950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b7c429fe-43a8-4cdf-be86-a911f0ed8376 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:53.494614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b7c429fe-43a8-4cdf-be86-a911f0ed8376 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:53.519836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7c429fe-43a8-4cdf-be86-a911f0ed8376 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:53.521061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7c429fe-43a8-4cdf-be86-a911f0ed8376 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:53.522462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7c429fe-43a8-4cdf-be86-a911f0ed8376 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:53.524707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7c429fe-43a8-4cdf-be86-a911f0ed8376 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:53.780796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b7c429fe-43a8-4cdf-be86-a911f0ed8376 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:53.790933 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b7c429fe-43a8-4cdf-be86-a911f0ed8376 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1215 microversion: 2.1 time: 0.307723 Jul 14 15:00:53.804747 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2808/5596] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:53 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1215 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:54.808517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-150a840b-5029-4fc3-8a84-1e17bb5b8a5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:54.809903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-150a840b-5029-4fc3-8a84-1e17bb5b8a5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:54.824085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-150a840b-5029-4fc3-8a84-1e17bb5b8a5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:54.824757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-150a840b-5029-4fc3-8a84-1e17bb5b8a5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:54.828049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-150a840b-5029-4fc3-8a84-1e17bb5b8a5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:54.828702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-150a840b-5029-4fc3-8a84-1e17bb5b8a5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:55.114713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-150a840b-5029-4fc3-8a84-1e17bb5b8a5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:55.128923 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-150a840b-5029-4fc3-8a84-1e17bb5b8a5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1215 microversion: 2.1 time: 0.325008 Jul 14 15:00:55.141741 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2789/5597] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:54 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1215 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:56.152597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-70588e67-e0a6-4a78-9ed6-b2feaa1c18df tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:56.153310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-70588e67-e0a6-4a78-9ed6-b2feaa1c18df tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:56.173479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70588e67-e0a6-4a78-9ed6-b2feaa1c18df tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:56.174045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70588e67-e0a6-4a78-9ed6-b2feaa1c18df tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:56.174810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70588e67-e0a6-4a78-9ed6-b2feaa1c18df tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:56.175263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70588e67-e0a6-4a78-9ed6-b2feaa1c18df tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:56.427359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-70588e67-e0a6-4a78-9ed6-b2feaa1c18df tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:56.457369 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-70588e67-e0a6-4a78-9ed6-b2feaa1c18df tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1203 microversion: 2.1 time: 0.311845 Jul 14 15:00:56.458892 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2809/5598] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:56 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1203 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:57.475713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-79f39051-0322-4fb8-9228-4f0360a3012b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:57.476346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-79f39051-0322-4fb8-9228-4f0360a3012b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:57.497289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79f39051-0322-4fb8-9228-4f0360a3012b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:57.498073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79f39051-0322-4fb8-9228-4f0360a3012b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:57.499195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79f39051-0322-4fb8-9228-4f0360a3012b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:57.499905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79f39051-0322-4fb8-9228-4f0360a3012b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:57.729007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-79f39051-0322-4fb8-9228-4f0360a3012b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:57.758131 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-79f39051-0322-4fb8-9228-4f0360a3012b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1203 microversion: 2.1 time: 0.285651 Jul 14 15:00:57.773197 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2790/5599] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:57 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1203 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:58.066285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-215602736", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "253b4f9a-c723-4c52-a793-3f5fa1cd0f9c"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:58.137727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] validate_networks() for [('253b4f9a-c723-4c52-a793-3f5fa1cd0f9c', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:00:58.683642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:00:58.684334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:00:58.684824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:00:58.685280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:00:58.685705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:00:58.695696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:58.696164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:58.697081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:58.697537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:58.716675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Getting quotas for project 00bc6392fb6e490e92d52c8bee17646c. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:00:58.722535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Getting quotas for user 1771187ed40e40bf9076f2265ce13c3e and project 00bc6392fb6e490e92d52c8bee17646c. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:00:58.736534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:00:58.738914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:00:58.782911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4272bc3-733d-4fa3-8c4a-31c7d4bfa81b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:58.783514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d4272bc3-733d-4fa3-8c4a-31c7d4bfa81b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:58.795679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e5020450-d707-4a6e-9abf-841e485dd994 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897460 Jul 14 15:00:58.796598 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2810/5600] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:00:58.802796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4272bc3-733d-4fa3-8c4a-31c7d4bfa81b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:58.803263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4272bc3-733d-4fa3-8c4a-31c7d4bfa81b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:58.804066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4272bc3-733d-4fa3-8c4a-31c7d4bfa81b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:58.804513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4272bc3-733d-4fa3-8c4a-31c7d4bfa81b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:58.807287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a32098bd-d3c1-49ab-a50b-1034dca0ee28 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:58.808763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a32098bd-d3c1-49ab-a50b-1034dca0ee28 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:58.980872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a32098bd-d3c1-49ab-a50b-1034dca0ee28 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:58.994808 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a32098bd-d3c1-49ab-a50b-1034dca0ee28 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1213 microversion: 2.1 time: 0.191691 Jul 14 15:00:59.006706 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2811/5601] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:58 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1213 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:59.107096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d4272bc3-733d-4fa3-8c4a-31c7d4bfa81b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:59.135622 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d4272bc3-733d-4fa3-8c4a-31c7d4bfa81b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1203 microversion: 2.1 time: 0.342076 Jul 14 15:00:59.138456 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2791/5602] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:58 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1203 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:00.014505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e606a0a6-3ce2-44cf-8c11-f0af136d60cb tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:00.015803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e606a0a6-3ce2-44cf-8c11-f0af136d60cb tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:00.023776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e606a0a6-3ce2-44cf-8c11-f0af136d60cb tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:00.024544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e606a0a6-3ce2-44cf-8c11-f0af136d60cb tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:00.025374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e606a0a6-3ce2-44cf-8c11-f0af136d60cb tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:00.025817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e606a0a6-3ce2-44cf-8c11-f0af136d60cb tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:00.108325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e606a0a6-3ce2-44cf-8c11-f0af136d60cb tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:00.117147 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e606a0a6-3ce2-44cf-8c11-f0af136d60cb tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1265 microversion: 2.1 time: 0.106976 Jul 14 15:01:00.118440 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2812/5603] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:00 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:00.161500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d0996931-81a0-4913-bba7-976fac7841e5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:00.162076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d0996931-81a0-4913-bba7-976fac7841e5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:00.171198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0996931-81a0-4913-bba7-976fac7841e5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:00.171659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0996931-81a0-4913-bba7-976fac7841e5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:00.172652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0996931-81a0-4913-bba7-976fac7841e5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:00.173324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d0996931-81a0-4913-bba7-976fac7841e5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:00.590843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d0996931-81a0-4913-bba7-976fac7841e5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:00.599966 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d0996931-81a0-4913-bba7-976fac7841e5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1203 microversion: 2.1 time: 0.442354 Jul 14 15:01:00.607443 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2792/5604] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:00 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1203 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:01.136322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31d25720-0762-4276-a271-ac1ef8cd9b0e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:01.137627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-31d25720-0762-4276-a271-ac1ef8cd9b0e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:01.149465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31d25720-0762-4276-a271-ac1ef8cd9b0e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:01.154893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31d25720-0762-4276-a271-ac1ef8cd9b0e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:01.156483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31d25720-0762-4276-a271-ac1ef8cd9b0e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:01.157206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31d25720-0762-4276-a271-ac1ef8cd9b0e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:01.366363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-31d25720-0762-4276-a271-ac1ef8cd9b0e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:01.394842 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-31d25720-0762-4276-a271-ac1ef8cd9b0e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1271 microversion: 2.1 time: 0.263023 Jul 14 15:01:01.396246 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2813/5605] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:01 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:01.624545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-beff4ebe-7d06-4ac0-850c-c2beed34736a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:01.625395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-beff4ebe-7d06-4ac0-850c-c2beed34736a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:01.639185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-beff4ebe-7d06-4ac0-850c-c2beed34736a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:01.639668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-beff4ebe-7d06-4ac0-850c-c2beed34736a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:01.640501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-beff4ebe-7d06-4ac0-850c-c2beed34736a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:01.650467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-beff4ebe-7d06-4ac0-850c-c2beed34736a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:02.420588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5f821717-f07b-4c40-9eaa-fe96f986ef1e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:02.422505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-beff4ebe-7d06-4ac0-850c-c2beed34736a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:02.424360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5f821717-f07b-4c40-9eaa-fe96f986ef1e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:02.438462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f821717-f07b-4c40-9eaa-fe96f986ef1e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:02.439196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f821717-f07b-4c40-9eaa-fe96f986ef1e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:02.440496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f821717-f07b-4c40-9eaa-fe96f986ef1e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:02.441154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f821717-f07b-4c40-9eaa-fe96f986ef1e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:02.446186 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-beff4ebe-7d06-4ac0-850c-c2beed34736a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1203 microversion: 2.1 time: 0.826263 Jul 14 15:01:02.447862 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2793/5606] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:01 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1203 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:03.111654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5f821717-f07b-4c40-9eaa-fe96f986ef1e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:03.124160 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5f821717-f07b-4c40-9eaa-fe96f986ef1e tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1313 microversion: 2.1 time: 0.714034 Jul 14 15:01:03.135646 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2814/5607] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:02 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1313 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:03.468152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0db88c01-5c22-4b5a-a492-29844a9eb9ca tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:03.468794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0db88c01-5c22-4b5a-a492-29844a9eb9ca tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:03.491861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0db88c01-5c22-4b5a-a492-29844a9eb9ca tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:03.493538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0db88c01-5c22-4b5a-a492-29844a9eb9ca tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:03.498504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0db88c01-5c22-4b5a-a492-29844a9eb9ca tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:03.499078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0db88c01-5c22-4b5a-a492-29844a9eb9ca tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:03.975877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0db88c01-5c22-4b5a-a492-29844a9eb9ca tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:03.987021 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0db88c01-5c22-4b5a-a492-29844a9eb9ca tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1203 microversion: 2.1 time: 0.526650 Jul 14 15:01:04.005002 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2794/5608] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:03 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1203 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:04.071560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ff093e98-a258-4f2e-b4b6-cd746b7fe623 req-d510135a-032d-4cc2-9073-ffd04ec8f212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319cd5a4-c70e-4263-aaeb-0ab2170380b6", "tag": "9d770835-d2fd-43b5-a160-a60673aef238"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:04.101090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ff093e98-a258-4f2e-b4b6-cd746b7fe623 req-d510135a-032d-4cc2-9073-ffd04ec8f212 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:04.105682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ff093e98-a258-4f2e-b4b6-cd746b7fe623 req-d510135a-032d-4cc2-9073-ffd04ec8f212 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:04.126816 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ff093e98-a258-4f2e-b4b6-cd746b7fe623 req-d510135a-032d-4cc2-9073-ffd04ec8f212 service nova] Creating event network-changed:9d770835-d2fd-43b5-a160-a60673aef238 for instance 319cd5a4-c70e-4263-aaeb-0ab2170380b6 on n-h1-767704-28 Jul 14 15:01:04.139984 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ff093e98-a258-4f2e-b4b6-cd746b7fe623 req-d510135a-032d-4cc2-9073-ffd04ec8f212 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066707 Jul 14 15:01:04.142276 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2815/5609] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:04.143237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a95b2700-5b99-4580-8796-8d62627937de tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:04.143852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a95b2700-5b99-4580-8796-8d62627937de tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:04.151073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a95b2700-5b99-4580-8796-8d62627937de tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:04.151649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a95b2700-5b99-4580-8796-8d62627937de tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:04.152772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a95b2700-5b99-4580-8796-8d62627937de tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:04.165759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a95b2700-5b99-4580-8796-8d62627937de tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:04.649366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a95b2700-5b99-4580-8796-8d62627937de tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:04.660852 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a95b2700-5b99-4580-8796-8d62627937de tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1313 microversion: 2.1 time: 0.521913 Jul 14 15:01:04.661766 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2795/5610] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:04 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1313 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:05.005895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2fc0fe8d-2189-4b63-a3de-251e5cf5c2ff tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:05.006610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2fc0fe8d-2189-4b63-a3de-251e5cf5c2ff tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:05.028468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fc0fe8d-2189-4b63-a3de-251e5cf5c2ff tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:05.029600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fc0fe8d-2189-4b63-a3de-251e5cf5c2ff tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:05.030595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fc0fe8d-2189-4b63-a3de-251e5cf5c2ff tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:05.031203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fc0fe8d-2189-4b63-a3de-251e5cf5c2ff tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:05.233442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2fc0fe8d-2189-4b63-a3de-251e5cf5c2ff tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:05.247992 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2fc0fe8d-2189-4b63-a3de-251e5cf5c2ff tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1203 microversion: 2.1 time: 0.246431 Jul 14 15:01:05.248802 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2816/5611] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:05 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1203 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:05.645234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-dcc3f827-3275-4a64-852b-352780f8c169 req-893b17ff-d597-49f1-ba87-bdb5691bfa07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2", "name": "network-vif-plugged", "status": "completed", "tag": "1c510783-0a10-4fcc-96f9-dae1701c7e30"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:05.666155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-dcc3f827-3275-4a64-852b-352780f8c169 req-893b17ff-d597-49f1-ba87-bdb5691bfa07 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:05.666854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-dcc3f827-3275-4a64-852b-352780f8c169 req-893b17ff-d597-49f1-ba87-bdb5691bfa07 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:05.678287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a5bb9011-9b94-4699-8e1d-4939d7b44324 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:05.679049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a5bb9011-9b94-4699-8e1d-4939d7b44324 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:05.687967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5bb9011-9b94-4699-8e1d-4939d7b44324 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:05.688703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5bb9011-9b94-4699-8e1d-4939d7b44324 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:05.691287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5bb9011-9b94-4699-8e1d-4939d7b44324 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:05.692440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a5bb9011-9b94-4699-8e1d-4939d7b44324 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:05.692575 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-dcc3f827-3275-4a64-852b-352780f8c169 req-893b17ff-d597-49f1-ba87-bdb5691bfa07 service nova] Creating event network-vif-plugged:1c510783-0a10-4fcc-96f9-dae1701c7e30 for instance 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 on n-h2-767704-28 Jul 14 15:01:05.707363 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-dcc3f827-3275-4a64-852b-352780f8c169 req-893b17ff-d597-49f1-ba87-bdb5691bfa07 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065721 Jul 14 15:01:05.708050 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2796/5612] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:05.995651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a5bb9011-9b94-4699-8e1d-4939d7b44324 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:06.006863 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a5bb9011-9b94-4699-8e1d-4939d7b44324 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1313 microversion: 2.1 time: 0.330839 Jul 14 15:01:06.008448 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2817/5613] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:05 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:06.267644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f150161-7ac4-472c-8c4a-52c19c358b7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:06.268609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9f150161-7ac4-472c-8c4a-52c19c358b7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:06.290637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f150161-7ac4-472c-8c4a-52c19c358b7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:06.291119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f150161-7ac4-472c-8c4a-52c19c358b7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:06.297603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f150161-7ac4-472c-8c4a-52c19c358b7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:06.298351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f150161-7ac4-472c-8c4a-52c19c358b7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:06.899472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9f150161-7ac4-472c-8c4a-52c19c358b7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:06.919904 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9f150161-7ac4-472c-8c4a-52c19c358b7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1203 microversion: 2.1 time: 0.651553 Jul 14 15:01:06.923841 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2797/5614] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:06 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1203 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:07.026189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-24d2ea1b-9439-455c-a298-a3718fbd6797 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:07.026924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-24d2ea1b-9439-455c-a298-a3718fbd6797 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:07.059085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24d2ea1b-9439-455c-a298-a3718fbd6797 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:07.060790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24d2ea1b-9439-455c-a298-a3718fbd6797 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:07.062309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24d2ea1b-9439-455c-a298-a3718fbd6797 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:07.067974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-24d2ea1b-9439-455c-a298-a3718fbd6797 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:07.590964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-24d2ea1b-9439-455c-a298-a3718fbd6797 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:07.601840 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-24d2ea1b-9439-455c-a298-a3718fbd6797 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1313 microversion: 2.1 time: 0.580270 Jul 14 15:01:07.606573 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2818/5615] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:07 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:07.942298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77e2e299-2fa7-42b1-af60-be049bfd0fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:07.942916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-77e2e299-2fa7-42b1-af60-be049bfd0fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:07.952579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77e2e299-2fa7-42b1-af60-be049bfd0fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:07.953080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77e2e299-2fa7-42b1-af60-be049bfd0fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:07.954056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77e2e299-2fa7-42b1-af60-be049bfd0fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:07.956922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77e2e299-2fa7-42b1-af60-be049bfd0fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:07.983741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:08.167438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-77e2e299-2fa7-42b1-af60-be049bfd0fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:08.177809 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-77e2e299-2fa7-42b1-af60-be049bfd0fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1203 microversion: 2.1 time: 0.239336 Jul 14 15:01:08.188843 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2798/5616] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:07 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1203 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:08.446116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-92d42c20-97d5-49f7-a558-0f9409939fda req-a56d6dcd-1e54-41c3-bbcf-31c6d3075497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319cd5a4-c70e-4263-aaeb-0ab2170380b6", "name": "network-vif-plugged", "status": "completed", "tag": "9d770835-d2fd-43b5-a160-a60673aef238"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:08.465196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-92d42c20-97d5-49f7-a558-0f9409939fda req-a56d6dcd-1e54-41c3-bbcf-31c6d3075497 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:08.469179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-92d42c20-97d5-49f7-a558-0f9409939fda req-a56d6dcd-1e54-41c3-bbcf-31c6d3075497 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:08.487629 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-92d42c20-97d5-49f7-a558-0f9409939fda req-a56d6dcd-1e54-41c3-bbcf-31c6d3075497 service nova] Creating event network-vif-plugged:9d770835-d2fd-43b5-a160-a60673aef238 for instance 319cd5a4-c70e-4263-aaeb-0ab2170380b6 on n-h1-767704-28 Jul 14 15:01:08.493449 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-92d42c20-97d5-49f7-a558-0f9409939fda req-a56d6dcd-1e54-41c3-bbcf-31c6d3075497 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051397 Jul 14 15:01:08.498451 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2819/5617] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:08.623380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d554a72a-f921-4150-ac99-a5d962e7e9b9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:08.624013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d554a72a-f921-4150-ac99-a5d962e7e9b9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:08.641189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d554a72a-f921-4150-ac99-a5d962e7e9b9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:08.641642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d554a72a-f921-4150-ac99-a5d962e7e9b9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:08.642526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d554a72a-f921-4150-ac99-a5d962e7e9b9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:08.642978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d554a72a-f921-4150-ac99-a5d962e7e9b9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:08.890233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d554a72a-f921-4150-ac99-a5d962e7e9b9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:08.921852 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d554a72a-f921-4150-ac99-a5d962e7e9b9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1313 microversion: 2.1 time: 0.302620 Jul 14 15:01:08.922484 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2799/5618] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:08 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:09.196938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f310e3f1-8ba3-4f3e-971a-5d344f64c775 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:09.199307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f310e3f1-8ba3-4f3e-971a-5d344f64c775 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:09.206510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:09.208346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:09.209943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:09.212477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f310e3f1-8ba3-4f3e-971a-5d344f64c775 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.213256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f310e3f1-8ba3-4f3e-971a-5d344f64c775 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.215155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f310e3f1-8ba3-4f3e-971a-5d344f64c775 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.215827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f310e3f1-8ba3-4f3e-971a-5d344f64c775 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.429395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f310e3f1-8ba3-4f3e-971a-5d344f64c775 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:09.438828 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f310e3f1-8ba3-4f3e-971a-5d344f64c775 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1390 microversion: 2.1 time: 0.247014 Jul 14 15:01:09.439438 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2820/5619] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:09 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1390 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:09.456212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3b5f4658-ed92-4521-b628-8f45afee4fd5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:09.456838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3b5f4658-ed92-4521-b628-8f45afee4fd5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:09.477958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b5f4658-ed92-4521-b628-8f45afee4fd5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.481160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b5f4658-ed92-4521-b628-8f45afee4fd5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.483201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b5f4658-ed92-4521-b628-8f45afee4fd5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.484544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b5f4658-ed92-4521-b628-8f45afee4fd5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.678490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3b5f4658-ed92-4521-b628-8f45afee4fd5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:09.694978 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3b5f4658-ed92-4521-b628-8f45afee4fd5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1390 microversion: 2.1 time: 0.242678 Jul 14 15:01:09.712001 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2800/5620] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:09 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1390 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:09.715641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-47ce27b9-a460-4d2d-9e1b-f5628eb03d4e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:09.716590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-47ce27b9-a460-4d2d-9e1b-f5628eb03d4e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:09.726032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47ce27b9-a460-4d2d-9e1b-f5628eb03d4e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.726964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47ce27b9-a460-4d2d-9e1b-f5628eb03d4e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.727961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47ce27b9-a460-4d2d-9e1b-f5628eb03d4e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.728631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47ce27b9-a460-4d2d-9e1b-f5628eb03d4e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.893923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-47ce27b9-a460-4d2d-9e1b-f5628eb03d4e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:09.902957 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-47ce27b9-a460-4d2d-9e1b-f5628eb03d4e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1390 microversion: 2.1 time: 0.191852 Jul 14 15:01:09.904442 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2821/5621] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:09 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1390 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:09.919972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-05a5c825-7c29-49f7-901c-6b2d59a6cbe5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:09.920482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-05a5c825-7c29-49f7-901c-6b2d59a6cbe5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:09.928600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05a5c825-7c29-49f7-901c-6b2d59a6cbe5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.929102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05a5c825-7c29-49f7-901c-6b2d59a6cbe5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.929899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05a5c825-7c29-49f7-901c-6b2d59a6cbe5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.930358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-05a5c825-7c29-49f7-901c-6b2d59a6cbe5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.938857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4ac04bb4-aa3c-4e3f-ae07-179aa7cfbc28 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:09.939485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4ac04bb4-aa3c-4e3f-ae07-179aa7cfbc28 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:09.951656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ac04bb4-aa3c-4e3f-ae07-179aa7cfbc28 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.952121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ac04bb4-aa3c-4e3f-ae07-179aa7cfbc28 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.952921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ac04bb4-aa3c-4e3f-ae07-179aa7cfbc28 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.953395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4ac04bb4-aa3c-4e3f-ae07-179aa7cfbc28 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.973883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-05a5c825-7c29-49f7-901c-6b2d59a6cbe5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:01:10.188744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4ac04bb4-aa3c-4e3f-ae07-179aa7cfbc28 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:10.194168 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-05a5c825-7c29-49f7-901c-6b2d59a6cbe5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 204 len: 0 microversion: 2.1 time: 0.278447 Jul 14 15:01:10.195636 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2801/5622] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:01:09 2022] DELETE /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:01:10.201582 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4ac04bb4-aa3c-4e3f-ae07-179aa7cfbc28 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1313 microversion: 2.1 time: 0.266863 Jul 14 15:01:10.203153 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2822/5623] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:09 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:10.210728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a3e0aa46-41c2-449f-ada8-3ebdf7ef7d6c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:10.211701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a3e0aa46-41c2-449f-ada8-3ebdf7ef7d6c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:10.219274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3e0aa46-41c2-449f-ada8-3ebdf7ef7d6c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:10.220711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3e0aa46-41c2-449f-ada8-3ebdf7ef7d6c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:10.221783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3e0aa46-41c2-449f-ada8-3ebdf7ef7d6c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:10.222446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3e0aa46-41c2-449f-ada8-3ebdf7ef7d6c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:10.433778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a3e0aa46-41c2-449f-ada8-3ebdf7ef7d6c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:10.449058 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a3e0aa46-41c2-449f-ada8-3ebdf7ef7d6c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1396 microversion: 2.1 time: 0.247117 Jul 14 15:01:10.450599 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2802/5624] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:10 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1396 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:11.219567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a77be189-5b39-4ed8-a898-d9d646afba79 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:11.220196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a77be189-5b39-4ed8-a898-d9d646afba79 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:11.227880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a77be189-5b39-4ed8-a898-d9d646afba79 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:11.228596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a77be189-5b39-4ed8-a898-d9d646afba79 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:11.230622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a77be189-5b39-4ed8-a898-d9d646afba79 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:11.231329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a77be189-5b39-4ed8-a898-d9d646afba79 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:11.234619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:11.393889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a77be189-5b39-4ed8-a898-d9d646afba79 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:11.408328 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a77be189-5b39-4ed8-a898-d9d646afba79 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1497 microversion: 2.1 time: 0.191810 Jul 14 15:01:11.410621 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2823/5625] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:11 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:11.469440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fd3039eb-984f-4efb-abce-281d42e304db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:11.474629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fd3039eb-984f-4efb-abce-281d42e304db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:11.474629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:11.478886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd3039eb-984f-4efb-abce-281d42e304db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:11.480228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd3039eb-984f-4efb-abce-281d42e304db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:11.481083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd3039eb-984f-4efb-abce-281d42e304db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:11.481767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd3039eb-984f-4efb-abce-281d42e304db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:11.764566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fd3039eb-984f-4efb-abce-281d42e304db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:11.773686 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fd3039eb-984f-4efb-abce-281d42e304db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1396 microversion: 2.1 time: 0.308307 Jul 14 15:01:11.774500 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2803/5626] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:11 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1396 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:12.794680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-995db436-1a0c-489f-b030-627ddb279f6b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:12.796596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-995db436-1a0c-489f-b030-627ddb279f6b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:12.805652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b7815d81-8d32-444a-967d-28c911713f5f req-a8365be4-6c97-4754-b95a-051983039436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2", "name": "network-vif-deleted", "tag": "1c510783-0a10-4fcc-96f9-dae1701c7e30"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:12.811946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-995db436-1a0c-489f-b030-627ddb279f6b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:12.813222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-995db436-1a0c-489f-b030-627ddb279f6b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:12.817187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-995db436-1a0c-489f-b030-627ddb279f6b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:12.820330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-995db436-1a0c-489f-b030-627ddb279f6b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:12.851136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b7815d81-8d32-444a-967d-28c911713f5f req-a8365be4-6c97-4754-b95a-051983039436 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:12.851905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b7815d81-8d32-444a-967d-28c911713f5f req-a8365be4-6c97-4754-b95a-051983039436 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:12.899402 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b7815d81-8d32-444a-967d-28c911713f5f req-a8365be4-6c97-4754-b95a-051983039436 service nova] Creating event network-vif-deleted:1c510783-0a10-4fcc-96f9-dae1701c7e30 for instance 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 on n-h2-767704-28 Jul 14 15:01:12.936332 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b7815d81-8d32-444a-967d-28c911713f5f req-a8365be4-6c97-4754-b95a-051983039436 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159486 Jul 14 15:01:12.958137 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2824/5627] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:13.042934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-995db436-1a0c-489f-b030-627ddb279f6b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:13.057288 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-995db436-1a0c-489f-b030-627ddb279f6b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1354 microversion: 2.1 time: 0.269423 Jul 14 15:01:13.059076 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2804/5628] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:12 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1354 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:14.078499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-94f1b4d3-8b75-45cb-9d49-5595e9d71a37 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:14.079205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-94f1b4d3-8b75-45cb-9d49-5595e9d71a37 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:14.088607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94f1b4d3-8b75-45cb-9d49-5595e9d71a37 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:14.089481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94f1b4d3-8b75-45cb-9d49-5595e9d71a37 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:14.090554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94f1b4d3-8b75-45cb-9d49-5595e9d71a37 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:14.091208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94f1b4d3-8b75-45cb-9d49-5595e9d71a37 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:14.219179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-94f1b4d3-8b75-45cb-9d49-5595e9d71a37 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:14.238771 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-94f1b4d3-8b75-45cb-9d49-5595e9d71a37 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1188 microversion: 2.1 time: 0.167039 Jul 14 15:01:14.240217 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2825/5629] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:14 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1188 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:15.258864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8496a15b-fb33-45d4-845e-36e2a5a6fcb0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:15.261534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8496a15b-fb33-45d4-845e-36e2a5a6fcb0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:15.271312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8496a15b-fb33-45d4-845e-36e2a5a6fcb0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:15.272132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8496a15b-fb33-45d4-845e-36e2a5a6fcb0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:15.273345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8496a15b-fb33-45d4-845e-36e2a5a6fcb0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:15.274077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8496a15b-fb33-45d4-845e-36e2a5a6fcb0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:15.377831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8496a15b-fb33-45d4-845e-36e2a5a6fcb0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:15.391689 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8496a15b-fb33-45d4-845e-36e2a5a6fcb0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1188 microversion: 2.1 time: 0.137195 Jul 14 15:01:15.393156 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2805/5630] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:15 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1188 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:15.846335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0bf79d76-a10c-4fbd-9a51-c97f1f3dd5e1 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:15.847645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0bf79d76-a10c-4fbd-9a51-c97f1f3dd5e1 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:15.857673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bf79d76-a10c-4fbd-9a51-c97f1f3dd5e1 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:15.858485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bf79d76-a10c-4fbd-9a51-c97f1f3dd5e1 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:15.859507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bf79d76-a10c-4fbd-9a51-c97f1f3dd5e1 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:15.860557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bf79d76-a10c-4fbd-9a51-c97f1f3dd5e1 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:15.908558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0bf79d76-a10c-4fbd-9a51-c97f1f3dd5e1 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:01:16.071201 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0bf79d76-a10c-4fbd-9a51-c97f1f3dd5e1 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "DELETE /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 204 len: 0 microversion: 2.1 time: 0.228913 Jul 14 15:01:16.074267 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2826/5631] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:01:15 2022] DELETE /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:01:16.082726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f9f0085-4ff1-4041-92a3-4bbc9acd4b77 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:16.083466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9f9f0085-4ff1-4041-92a3-4bbc9acd4b77 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:16.097180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f9f0085-4ff1-4041-92a3-4bbc9acd4b77 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:16.097654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f9f0085-4ff1-4041-92a3-4bbc9acd4b77 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:16.099844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f9f0085-4ff1-4041-92a3-4bbc9acd4b77 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:16.100292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f9f0085-4ff1-4041-92a3-4bbc9acd4b77 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:16.289668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9f9f0085-4ff1-4041-92a3-4bbc9acd4b77 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:16.299851 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9f9f0085-4ff1-4041-92a3-4bbc9acd4b77 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1503 microversion: 2.1 time: 0.220675 Jul 14 15:01:16.301321 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2806/5632] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:16 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:16.409244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6f7cac02-8072-481b-b16d-b2a2165676c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:16.410537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6f7cac02-8072-481b-b16d-b2a2165676c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:16.430470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f7cac02-8072-481b-b16d-b2a2165676c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:16.431606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f7cac02-8072-481b-b16d-b2a2165676c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:16.434312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f7cac02-8072-481b-b16d-b2a2165676c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:16.434777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6f7cac02-8072-481b-b16d-b2a2165676c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:16.548286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6f7cac02-8072-481b-b16d-b2a2165676c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:16.565169 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6f7cac02-8072-481b-b16d-b2a2165676c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1188 microversion: 2.1 time: 0.160267 Jul 14 15:01:16.566553 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2827/5633] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:16 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1188 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:16.872578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d899ca3-85bb-445f-bb55-92f4a96d8e5d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:16.874061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d899ca3-85bb-445f-bb55-92f4a96d8e5d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:16.883089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d899ca3-85bb-445f-bb55-92f4a96d8e5d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:16.883991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d899ca3-85bb-445f-bb55-92f4a96d8e5d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:16.884983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d899ca3-85bb-445f-bb55-92f4a96d8e5d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:16.886213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d899ca3-85bb-445f-bb55-92f4a96d8e5d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:16.967675 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d899ca3-85bb-445f-bb55-92f4a96d8e5d tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.100670 Jul 14 15:01:16.975834 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2807/5634] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jul 14 15:01:16 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:17.047314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-06a0a746-a17a-47e9-bb79-bfcb6467a7aa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:17.047894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-06a0a746-a17a-47e9-bb79-bfcb6467a7aa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:17.063283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06a0a746-a17a-47e9-bb79-bfcb6467a7aa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:17.068095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06a0a746-a17a-47e9-bb79-bfcb6467a7aa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:17.068899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06a0a746-a17a-47e9-bb79-bfcb6467a7aa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:17.069397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06a0a746-a17a-47e9-bb79-bfcb6467a7aa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:17.109347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-06a0a746-a17a-47e9-bb79-bfcb6467a7aa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:01:17.216192 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-06a0a746-a17a-47e9-bb79-bfcb6467a7aa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 204 len: 0 microversion: 2.20 time: 0.172328 Jul 14 15:01:17.217155 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2828/5635] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 15:01:17 2022] DELETE /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 15:01:17.225869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bce271ef-f39f-4ad5-99e9-d47ba97ebdca tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:17.226763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bce271ef-f39f-4ad5-99e9-d47ba97ebdca tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:17.235196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bce271ef-f39f-4ad5-99e9-d47ba97ebdca tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:17.235894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bce271ef-f39f-4ad5-99e9-d47ba97ebdca tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:17.236579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bce271ef-f39f-4ad5-99e9-d47ba97ebdca tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:17.237108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bce271ef-f39f-4ad5-99e9-d47ba97ebdca tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:17.323431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-63ff1580-ba13-481c-bcc6-dc61af896bc9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:17.329208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-63ff1580-ba13-481c-bcc6-dc61af896bc9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:17.353543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63ff1580-ba13-481c-bcc6-dc61af896bc9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:17.356082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63ff1580-ba13-481c-bcc6-dc61af896bc9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:17.357123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63ff1580-ba13-481c-bcc6-dc61af896bc9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:17.357728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63ff1580-ba13-481c-bcc6-dc61af896bc9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:17.587455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bce271ef-f39f-4ad5-99e9-d47ba97ebdca tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:17.610268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bce271ef-f39f-4ad5-99e9-d47ba97ebdca tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:17.611808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bce271ef-f39f-4ad5-99e9-d47ba97ebdca tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:17.623157 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bce271ef-f39f-4ad5-99e9-d47ba97ebdca tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1723 microversion: 2.20 time: 0.394902 Jul 14 15:01:17.623830 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2808/5636] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:01:17 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1723 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:01:17.634056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-72b5434c-4355-409f-b38b-d2d57a6cf123 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:17.639034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-72b5434c-4355-409f-b38b-d2d57a6cf123 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:17.653248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72b5434c-4355-409f-b38b-d2d57a6cf123 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:17.653732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72b5434c-4355-409f-b38b-d2d57a6cf123 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:17.654566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72b5434c-4355-409f-b38b-d2d57a6cf123 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:17.655024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72b5434c-4355-409f-b38b-d2d57a6cf123 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:17.667963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-63ff1580-ba13-481c-bcc6-dc61af896bc9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:17.681018 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-63ff1580-ba13-481c-bcc6-dc61af896bc9 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1503 microversion: 2.1 time: 0.365443 Jul 14 15:01:17.682899 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2829/5637] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:17 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1503 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:17.763562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-72b5434c-4355-409f-b38b-d2d57a6cf123 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:17.779450 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-72b5434c-4355-409f-b38b-d2d57a6cf123 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1188 microversion: 2.1 time: 0.154521 Jul 14 15:01:17.780500 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2809/5638] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:17 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1188 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:18.618005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-44022f2c-44dd-441f-857e-b21e1f2ac129 req-b04d83c5-4edd-4bef-a743-7ad99539bf8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319cd5a4-c70e-4263-aaeb-0ab2170380b6", "name": "network-vif-deleted", "tag": "9d770835-d2fd-43b5-a160-a60673aef238"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:18.639020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-44022f2c-44dd-441f-857e-b21e1f2ac129 req-b04d83c5-4edd-4bef-a743-7ad99539bf8e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:18.639822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-44022f2c-44dd-441f-857e-b21e1f2ac129 req-b04d83c5-4edd-4bef-a743-7ad99539bf8e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:18.644492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4fa2c4bd-23c0-48d3-ac19-f5e63aebd128 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:18.645392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4fa2c4bd-23c0-48d3-ac19-f5e63aebd128 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:18.655204 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-44022f2c-44dd-441f-857e-b21e1f2ac129 req-b04d83c5-4edd-4bef-a743-7ad99539bf8e service nova] Creating event network-vif-deleted:9d770835-d2fd-43b5-a160-a60673aef238 for instance 319cd5a4-c70e-4263-aaeb-0ab2170380b6 on n-h1-767704-28 Jul 14 15:01:18.664912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fa2c4bd-23c0-48d3-ac19-f5e63aebd128 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:18.667674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fa2c4bd-23c0-48d3-ac19-f5e63aebd128 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:18.671078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fa2c4bd-23c0-48d3-ac19-f5e63aebd128 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:18.671961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fa2c4bd-23c0-48d3-ac19-f5e63aebd128 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:18.682912 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-44022f2c-44dd-441f-857e-b21e1f2ac129 req-b04d83c5-4edd-4bef-a743-7ad99539bf8e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071445 Jul 14 15:01:18.686906 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2830/5639] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:18.705488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ecd9ed80-b44a-4736-bf97-649a9808ffe4 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:18.718516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ecd9ed80-b44a-4736-bf97-649a9808ffe4 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:18.738139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ecd9ed80-b44a-4736-bf97-649a9808ffe4 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:18.739087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ecd9ed80-b44a-4736-bf97-649a9808ffe4 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:18.743042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ecd9ed80-b44a-4736-bf97-649a9808ffe4 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:18.744846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ecd9ed80-b44a-4736-bf97-649a9808ffe4 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:18.823194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ecd9ed80-b44a-4736-bf97-649a9808ffe4 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:18.823577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ecd9ed80-b44a-4736-bf97-649a9808ffe4 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:18.824143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-ecd9ed80-b44a-4736-bf97-649a9808ffe4 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lazy-loading 'fault' on Instance uuid 319cd5a4-c70e-4263-aaeb-0ab2170380b6 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:01:19.018700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ecd9ed80-b44a-4736-bf97-649a9808ffe4 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1771187ed40e40bf9076f2265ce13c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bc6392fb6e490e92d52c8bee17646c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:19.079493 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ecd9ed80-b44a-4736-bf97-649a9808ffe4 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 200 len: 1303 microversion: 2.1 time: 0.384157 Jul 14 15:01:19.090647 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2831/5640] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:18 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 1303 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:19.102438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b64bbd3d-f88f-489b-afc7-7f3a39c811f6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:19.105414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b64bbd3d-f88f-489b-afc7-7f3a39c811f6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:19.120444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b64bbd3d-f88f-489b-afc7-7f3a39c811f6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:19.126773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b64bbd3d-f88f-489b-afc7-7f3a39c811f6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:19.127828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b64bbd3d-f88f-489b-afc7-7f3a39c811f6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:19.128384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b64bbd3d-f88f-489b-afc7-7f3a39c811f6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:19.301404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b64bbd3d-f88f-489b-afc7-7f3a39c811f6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:19.318334 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b64bbd3d-f88f-489b-afc7-7f3a39c811f6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 200 len: 1188 microversion: 2.1 time: 0.222213 Jul 14 15:01:19.319424 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2832/5641] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:19 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 1188 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:19.346954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4fa2c4bd-23c0-48d3-ac19-f5e63aebd128 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:19.377450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4fa2c4bd-23c0-48d3-ac19-f5e63aebd128 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:19.380607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4fa2c4bd-23c0-48d3-ac19-f5e63aebd128 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:19.382265 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4fa2c4bd-23c0-48d3-ac19-f5e63aebd128 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1723 microversion: 2.20 time: 0.743172 Jul 14 15:01:19.383426 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2810/5642] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:01:18 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1723 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:01:20.112753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ae75ea7c-7930-4494-b57a-f439599d8545 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:20.113661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ae75ea7c-7930-4494-b57a-f439599d8545 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] [instance: 319cd5a4-c70e-4263-aaeb-0ab2170380b6] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:20.123086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae75ea7c-7930-4494-b57a-f439599d8545 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:20.123877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae75ea7c-7930-4494-b57a-f439599d8545 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:20.124831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae75ea7c-7930-4494-b57a-f439599d8545 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:20.125872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae75ea7c-7930-4494-b57a-f439599d8545 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:20.143855 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-ae75ea7c-7930-4494-b57a-f439599d8545 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] HTTP exception thrown: Instance 319cd5a4-c70e-4263-aaeb-0ab2170380b6 could not be found. Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ae75ea7c-7930-4494-b57a-f439599d8545 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Request method failure captured: Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 HTTP/1.1 Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C-nadXfFCq6-b4jThKhv7Yvf-ZPdOtAKtQnVbwlKp_UBhrko6vzOtmYeOMyCtkpKT586Cf6Caw8tdHI5XeSZFf6vv19sowI-mTQ1zP2h0DRiyTUBsnOOkmIGWqE4F6wB3hQh9Jc0tAZvMpUjVLJfVzv7o8Aeu14ZFJdVt3hq9NfHQg Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 00bc6392fb6e490e92d52c8bee17646c Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-VolumesActionsTest-1513098449 Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/00bc6392fb6e490e92d52c8bee17646c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/00bc6392fb6e490e92d52c8bee17646c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_00bc6392fb6e490e92d52c8bee17646c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/00bc6392fb6e490e92d52c8bee17646c"}]}] Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-VolumesActionsTest-1513098449 Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 00bc6392fb6e490e92d52c8bee17646c Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-VolumesActionsTest-1513098449 Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-VolumesActionsTest-1513098449-project Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1771187ed40e40bf9076f2265ce13c3e Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-VolumesActionsTest-1513098449-project Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 319cd5a4-c70e-4263-aaeb-0ab2170380b6 could not be found. Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '319cd5a4-c70e-4263-aaeb-0ab2170380b6'} Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319cd5a4-c70e-4263-aaeb-0ab2170380b6 could not be found. Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319cd5a4-c70e-4263-aaeb-0ab2170380b6 could not be found. Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:20.149917 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:20.155615 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:20.155615 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:20.155615 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:20.155615 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:20.155615 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:20.155615 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319cd5a4-c70e-4263-aaeb-0ab2170380b6 could not be found. Jul 14 15:01:20.155615 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:20.157570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ae75ea7c-7930-4494-b57a-f439599d8545 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] Returning 404 to user: Instance 319cd5a4-c70e-4263-aaeb-0ab2170380b6 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:20.165845 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ae75ea7c-7930-4494-b57a-f439599d8545 tempest-VolumesActionsTest-1513098449 tempest-VolumesActionsTest-1513098449-project] 10.222.0.81 "GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6" status: 404 len: 111 microversion: 2.1 time: 0.050533 Jul 14 15:01:20.167690 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2833/5643] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:20 2022] GET /compute/v2.1/servers/319cd5a4-c70e-4263-aaeb-0ab2170380b6 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:20.336876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c6c18e32-02e8-4712-85ff-11d83f55b0b0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:20.339536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c6c18e32-02e8-4712-85ff-11d83f55b0b0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:20.352729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6c18e32-02e8-4712-85ff-11d83f55b0b0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:20.353778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6c18e32-02e8-4712-85ff-11d83f55b0b0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:20.356197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6c18e32-02e8-4712-85ff-11d83f55b0b0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:20.357260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6c18e32-02e8-4712-85ff-11d83f55b0b0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:20.377295 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c6c18e32-02e8-4712-85ff-11d83f55b0b0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 could not be found. Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c6c18e32-02e8-4712-85ff-11d83f55b0b0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 HTTP/1.1 Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 could not be found. Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2'} Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 could not be found. Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 could not be found. Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:20.380300 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:20.386200 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:20.386200 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:20.386200 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:20.386200 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:20.386200 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:20.386200 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 could not be found. Jul 14 15:01:20.386200 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:20.388653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c6c18e32-02e8-4712-85ff-11d83f55b0b0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance 4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:20.390147 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c6c18e32-02e8-4712-85ff-11d83f55b0b0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2" status: 404 len: 111 microversion: 2.1 time: 0.057209 Jul 14 15:01:20.391038 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2811/5644] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:20 2022] GET /compute/v2.1/servers/4ed0a62b-9f72-4cd1-a935-8eb52ff4bcd2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:20.405499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ba7bedb-ab25-4616-b9fd-73bbdbce2cda tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:20.406384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6ba7bedb-ab25-4616-b9fd-73bbdbce2cda tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:20.423874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ba7bedb-ab25-4616-b9fd-73bbdbce2cda tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:20.424323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ba7bedb-ab25-4616-b9fd-73bbdbce2cda tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:20.426211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ba7bedb-ab25-4616-b9fd-73bbdbce2cda tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:20.427066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ba7bedb-ab25-4616-b9fd-73bbdbce2cda tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:20.597672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6ba7bedb-ab25-4616-b9fd-73bbdbce2cda tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:20.614019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6ba7bedb-ab25-4616-b9fd-73bbdbce2cda tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:20.615725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6ba7bedb-ab25-4616-b9fd-73bbdbce2cda tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:20.616927 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6ba7bedb-ab25-4616-b9fd-73bbdbce2cda tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1655 microversion: 2.20 time: 0.218590 Jul 14 15:01:20.619797 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2834/5645] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:01:20 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1655 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:01:21.521003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-2bad9801-2e04-491f-8ab9-a7afbf9b986c req-233db896-6b7a-4549-8ae4-db3122c936f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9928624-d55d-4cef-b484-6c377f54271e", "name": "network-vif-deleted", "tag": "2c2be47c-cc25-46c1-a7aa-1dde1fe54b61"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:21.558896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2bad9801-2e04-491f-8ab9-a7afbf9b986c req-233db896-6b7a-4549-8ae4-db3122c936f1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:21.559349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2bad9801-2e04-491f-8ab9-a7afbf9b986c req-233db896-6b7a-4549-8ae4-db3122c936f1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:21.604310 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-2bad9801-2e04-491f-8ab9-a7afbf9b986c req-233db896-6b7a-4549-8ae4-db3122c936f1 service nova] Creating event network-vif-deleted:2c2be47c-cc25-46c1-a7aa-1dde1fe54b61 for instance e9928624-d55d-4cef-b484-6c377f54271e on n-h2-767704-28 Jul 14 15:01:21.640477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:21.643049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:21.666799 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-2bad9801-2e04-491f-8ab9-a7afbf9b986c req-233db896-6b7a-4549-8ae4-db3122c936f1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150324 Jul 14 15:01:21.668827 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2812/5646] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:21.676414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:21.681780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:21.683322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:21.683608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:21.832386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:21.832846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:21.833369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lazy-loading 'fault' on Instance uuid e9928624-d55d-4cef-b484-6c377f54271e {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:01:21.965840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:21.984511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:21.986278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b19287c405854751b7ad4846457b5882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fe3c794f345898ccdfc30555d420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:21.987505 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f17c331-58a6-4742-b4ae-21a2bb7e4dcc tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 200 len: 1372 microversion: 2.20 time: 0.352651 Jul 14 15:01:21.997471 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2835/5647] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:01:21 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 1372 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:01:23.017512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c652d020-1b39-4e80-b749-bbcf73065063 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:23.019234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c652d020-1b39-4e80-b749-bbcf73065063 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:23.044924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c652d020-1b39-4e80-b749-bbcf73065063 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:23.045668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c652d020-1b39-4e80-b749-bbcf73065063 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:23.046915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c652d020-1b39-4e80-b749-bbcf73065063 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:23.047957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c652d020-1b39-4e80-b749-bbcf73065063 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:23.073470 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c652d020-1b39-4e80-b749-bbcf73065063 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] HTTP exception thrown: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c652d020-1b39-4e80-b749-bbcf73065063 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Request method failure captured: Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e HTTP/1.1 Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C38MeByVKiVMOKtC1kTurWRhHcyxi-0AmvGy4XdQHsXDCN3Ic4YUg5WccbTqc_s0z_-6insPcg5rV7EvJiPcfDl9lYs49sbFZCfB2_PGxb5rzlpWwbxE5SLzzW5-fl6tG0Vwo64dau0r4yPcjJGa7WLmipShtzifhH5p6QYSXPJYfM Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 696fe3c794f345898ccdfc30555d420d Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/696fe3c794f345898ccdfc30555d420d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/696fe3c794f345898ccdfc30555d420d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_696fe3c794f345898ccdfc30555d420d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/696fe3c794f345898ccdfc30555d420d"}]}] Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 696fe3c794f345898ccdfc30555d420d Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeShelveTestJSON-136825956-project Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: b19287c405854751b7ad4846457b5882 Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeShelveTestJSON-136825956-project Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'e9928624-d55d-4cef-b484-6c377f54271e'} Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:23.079179 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:23.089377 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:23.089377 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:23.089377 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:23.089377 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:23.089377 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:23.089377 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:23.089377 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:23.089377 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:23.089377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c652d020-1b39-4e80-b749-bbcf73065063 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Returning 404 to user: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:23.089377 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c652d020-1b39-4e80-b749-bbcf73065063 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 404 len: 111 microversion: 2.20 time: 0.069888 Jul 14 15:01:23.089377 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2813/5648] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:01:23 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:01:23.093012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff62de2f-de48-4b72-b7d2-030287df933b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '.version_select at 0x7fd6c4b8a940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:23.128549 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ff62de2f-de48-4b72-b7d2-030287df933b tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207859285" status: 204 len: 0 microversion: 2.20 time: 0.039937 Jul 14 15:01:23.129682 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2836/5649] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jul 14 15:01:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207859285 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 15:01:29.220390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4daecb7c-f90a-43df-a966-febcfbff0af0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:29.221058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4daecb7c-f90a-43df-a966-febcfbff0af0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:29.236087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4daecb7c-f90a-43df-a966-febcfbff0af0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:29.237390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4daecb7c-f90a-43df-a966-febcfbff0af0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:29.238829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4daecb7c-f90a-43df-a966-febcfbff0af0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:29.240688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4daecb7c-f90a-43df-a966-febcfbff0af0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:29.271671 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-4daecb7c-f90a-43df-a966-febcfbff0af0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] HTTP exception thrown: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4daecb7c-f90a-43df-a966-febcfbff0af0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Request method failure captured: Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e HTTP/1.1 Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C38MeByVKiVMOKtC1kTurWRhHcyxi-0AmvGy4XdQHsXDCN3Ic4YUg5WccbTqc_s0z_-6insPcg5rV7EvJiPcfDl9lYs49sbFZCfB2_PGxb5rzlpWwbxE5SLzzW5-fl6tG0Vwo64dau0r4yPcjJGa7WLmipShtzifhH5p6QYSXPJYfM Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 696fe3c794f345898ccdfc30555d420d Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/696fe3c794f345898ccdfc30555d420d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/696fe3c794f345898ccdfc30555d420d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_696fe3c794f345898ccdfc30555d420d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/696fe3c794f345898ccdfc30555d420d"}]}] Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 696fe3c794f345898ccdfc30555d420d Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeShelveTestJSON-136825956-project Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: b19287c405854751b7ad4846457b5882 Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeShelveTestJSON-136825956-project Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'e9928624-d55d-4cef-b484-6c377f54271e'} Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:29.273436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:29.278713 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:29.278713 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:29.278713 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:29.278713 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:29.278713 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:29.278713 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:29.278713 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:29.278713 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:29.278713 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:29.278713 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:29.278713 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:29.278713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4daecb7c-f90a-43df-a966-febcfbff0af0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Returning 404 to user: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:29.281795 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4daecb7c-f90a-43df-a966-febcfbff0af0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 404 len: 111 microversion: 2.20 time: 0.068478 Jul 14 15:01:29.283788 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2814/5650] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 15:01:29 2022] DELETE /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:01:29.290402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ba9c9a3d-f16a-45ab-8322-4b34bc4bb1d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:29.291202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ba9c9a3d-f16a-45ab-8322-4b34bc4bb1d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e9928624-d55d-4cef-b484-6c377f54271e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:29.308655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba9c9a3d-f16a-45ab-8322-4b34bc4bb1d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:29.312714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba9c9a3d-f16a-45ab-8322-4b34bc4bb1d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:29.314212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba9c9a3d-f16a-45ab-8322-4b34bc4bb1d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:29.314737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ba9c9a3d-f16a-45ab-8322-4b34bc4bb1d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:29.346739 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-ba9c9a3d-f16a-45ab-8322-4b34bc4bb1d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] HTTP exception thrown: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ba9c9a3d-f16a-45ab-8322-4b34bc4bb1d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Request method failure captured: Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e HTTP/1.1 Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C38MeByVKiVMOKtC1kTurWRhHcyxi-0AmvGy4XdQHsXDCN3Ic4YUg5WccbTqc_s0z_-6insPcg5rV7EvJiPcfDl9lYs49sbFZCfB2_PGxb5rzlpWwbxE5SLzzW5-fl6tG0Vwo64dau0r4yPcjJGa7WLmipShtzifhH5p6QYSXPJYfM Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 696fe3c794f345898ccdfc30555d420d Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/696fe3c794f345898ccdfc30555d420d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/696fe3c794f345898ccdfc30555d420d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_696fe3c794f345898ccdfc30555d420d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/696fe3c794f345898ccdfc30555d420d"}]}] Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 696fe3c794f345898ccdfc30555d420d Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachVolumeShelveTestJSON-136825956-project Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: b19287c405854751b7ad4846457b5882 Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachVolumeShelveTestJSON-136825956-project Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'e9928624-d55d-4cef-b484-6c377f54271e'} Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:29.377874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:29.383222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:29.383222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:29.383222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:29.383222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:29.383222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:29.383222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:29.383222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. Jul 14 15:01:29.383222 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:29.413578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ba9c9a3d-f16a-45ab-8322-4b34bc4bb1d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Returning 404 to user: Instance e9928624-d55d-4cef-b484-6c377f54271e could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:29.423278 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ba9c9a3d-f16a-45ab-8322-4b34bc4bb1d0 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e" status: 404 len: 111 microversion: 2.20 time: 0.136586 Jul 14 15:01:29.424110 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2837/5651] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:01:29 2022] GET /compute/v2.1/servers/e9928624-d55d-4cef-b484-6c377f54271e => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:01:30.554857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6223c1a7-4d23-45e6-9491-b8b976f476e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:30.556568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6223c1a7-4d23-45e6-9491-b8b976f476e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:30.571303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6223c1a7-4d23-45e6-9491-b8b976f476e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:30.572603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6223c1a7-4d23-45e6-9491-b8b976f476e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:30.577450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6223c1a7-4d23-45e6-9491-b8b976f476e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:30.579281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6223c1a7-4d23-45e6-9491-b8b976f476e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:30.699968 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6223c1a7-4d23-45e6-9491-b8b976f476e3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135028 Jul 14 15:01:30.706137 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2815/5652] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:01:30 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:01:30.780144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f0f8c5c2-f011-45f5-80f9-208b9c412f2a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:30.784274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f0f8c5c2-f011-45f5-80f9-208b9c412f2a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:30.800247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f0f8c5c2-f011-45f5-80f9-208b9c412f2a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:30.801071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f0f8c5c2-f011-45f5-80f9-208b9c412f2a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:30.802368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f0f8c5c2-f011-45f5-80f9-208b9c412f2a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:30.803224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f0f8c5c2-f011-45f5-80f9-208b9c412f2a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:30.841308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f0f8c5c2-f011-45f5-80f9-208b9c412f2a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:01:30.882785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:31.030333 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f0f8c5c2-f011-45f5-80f9-208b9c412f2a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "DELETE /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 204 len: 0 microversion: 2.1 time: 0.257809 Jul 14 15:01:31.031045 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2838/5653] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:01:30 2022] DELETE /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:01:31.043355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-30ef9159-3968-40c8-b49d-2a643361c2c5 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:31.044045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-30ef9159-3968-40c8-b49d-2a643361c2c5 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:31.055283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30ef9159-3968-40c8-b49d-2a643361c2c5 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:31.056730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30ef9159-3968-40c8-b49d-2a643361c2c5 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:31.059929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30ef9159-3968-40c8-b49d-2a643361c2c5 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:31.075556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30ef9159-3968-40c8-b49d-2a643361c2c5 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:31.090631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:31.384082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-30ef9159-3968-40c8-b49d-2a643361c2c5 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:31.396274 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-30ef9159-3968-40c8-b49d-2a643361c2c5 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1671 microversion: 2.1 time: 0.360216 Jul 14 15:01:31.398259 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2816/5654] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:31 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1671 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:32.417664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0989c853-143b-41df-ad32-009513709bbf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:32.418381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0989c853-143b-41df-ad32-009513709bbf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:32.427632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0989c853-143b-41df-ad32-009513709bbf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:32.428095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0989c853-143b-41df-ad32-009513709bbf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:32.428892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0989c853-143b-41df-ad32-009513709bbf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:32.437580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0989c853-143b-41df-ad32-009513709bbf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:32.824719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0989c853-143b-41df-ad32-009513709bbf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:32.839940 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0989c853-143b-41df-ad32-009513709bbf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1671 microversion: 2.1 time: 0.427071 Jul 14 15:01:32.841177 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2839/5655] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:32 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1671 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:33.859198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d99301b6-2103-4729-8c97-821ca08865a0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:33.861931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d99301b6-2103-4729-8c97-821ca08865a0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:33.871967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d99301b6-2103-4729-8c97-821ca08865a0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:33.872765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d99301b6-2103-4729-8c97-821ca08865a0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:33.875131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d99301b6-2103-4729-8c97-821ca08865a0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:33.875818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d99301b6-2103-4729-8c97-821ca08865a0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:34.701698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d99301b6-2103-4729-8c97-821ca08865a0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:34.716654 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d99301b6-2103-4729-8c97-821ca08865a0 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1671 microversion: 2.1 time: 0.863098 Jul 14 15:01:34.718288 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2817/5656] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:33 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1671 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:35.739698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f29bb761-2ac8-4798-86d4-8e919826b90f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:35.741247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f29bb761-2ac8-4798-86d4-8e919826b90f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:35.753331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f29bb761-2ac8-4798-86d4-8e919826b90f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:35.754074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f29bb761-2ac8-4798-86d4-8e919826b90f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:35.755102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f29bb761-2ac8-4798-86d4-8e919826b90f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:35.756255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f29bb761-2ac8-4798-86d4-8e919826b90f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:35.914358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f29bb761-2ac8-4798-86d4-8e919826b90f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:35.930345 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f29bb761-2ac8-4798-86d4-8e919826b90f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1603 microversion: 2.1 time: 0.194024 Jul 14 15:01:35.935347 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2840/5657] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:35 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1603 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:36.420072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ff709261-9f0e-4312-9c8e-fc78eaca8093 req-ca73575a-5c50-40d8-a9ad-fe6b3c8d8e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accee1e3-de25-42fe-b062-e6c330d4e88c", "name": "network-vif-deleted", "tag": "70641ce3-b2fb-4c43-9416-6a623723ac81"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:36.463235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ff709261-9f0e-4312-9c8e-fc78eaca8093 req-ca73575a-5c50-40d8-a9ad-fe6b3c8d8e84 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:36.464725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ff709261-9f0e-4312-9c8e-fc78eaca8093 req-ca73575a-5c50-40d8-a9ad-fe6b3c8d8e84 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:36.512787 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ff709261-9f0e-4312-9c8e-fc78eaca8093 req-ca73575a-5c50-40d8-a9ad-fe6b3c8d8e84 service nova] Creating event network-vif-deleted:70641ce3-b2fb-4c43-9416-6a623723ac81 for instance accee1e3-de25-42fe-b062-e6c330d4e88c on n-h2-767704-28 Jul 14 15:01:36.525216 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ff709261-9f0e-4312-9c8e-fc78eaca8093 req-ca73575a-5c50-40d8-a9ad-fe6b3c8d8e84 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109396 Jul 14 15:01:36.527084 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2818/5658] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:36.563895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5fd10158-6224-4378-8835-0a44a6f59caa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:36.564406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5fd10158-6224-4378-8835-0a44a6f59caa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:36.584583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fd10158-6224-4378-8835-0a44a6f59caa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:36.590070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fd10158-6224-4378-8835-0a44a6f59caa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:36.591129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fd10158-6224-4378-8835-0a44a6f59caa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:36.591598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fd10158-6224-4378-8835-0a44a6f59caa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:36.669633 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-5fd10158-6224-4378-8835-0a44a6f59caa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] HTTP exception thrown: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5fd10158-6224-4378-8835-0a44a6f59caa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Request method failure captured: Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa HTTP/1.1 Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C38MeByVKiVMOKtC1kTurWRhHcyxi-0AmvGy4XdQHsXDCN3Ic4YUg5WccbTqc_s0z_-6insPcg5rV7EvJiPcfDl9lYs49sbFZCfB2_PGxb5rzlpWwbxE5SLzzW5-fl6tG0Vwo64dau0r4yPcjJGa7WLmipShtzifhH5p6QYSXPJYfM Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 696fe3c794f345898ccdfc30555d420d Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/696fe3c794f345898ccdfc30555d420d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/696fe3c794f345898ccdfc30555d420d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_696fe3c794f345898ccdfc30555d420d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/696fe3c794f345898ccdfc30555d420d"}]}] Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 696fe3c794f345898ccdfc30555d420d Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachVolumeShelveTestJSON-136825956-project Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: b19287c405854751b7ad4846457b5882 Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachVolumeShelveTestJSON-136825956-project Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'e5292ea7-49d5-4a1e-8fee-76a77bf64afa'} Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:36.702957 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5fd10158-6224-4378-8835-0a44a6f59caa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Returning 404 to user: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:36.708660 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5fd10158-6224-4378-8835-0a44a6f59caa tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 404 len: 111 microversion: 2.20 time: 0.144834 Jul 14 15:01:36.716394 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2841/5659] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jul 14 15:01:36 2022] DELETE /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:01:36.726380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4898ec61-f499-4606-b786-5519246f0b53 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:36.727102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4898ec61-f499-4606-b786-5519246f0b53 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] [instance: e5292ea7-49d5-4a1e-8fee-76a77bf64afa] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:36.743341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4898ec61-f499-4606-b786-5519246f0b53 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:36.743807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4898ec61-f499-4606-b786-5519246f0b53 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:36.744616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4898ec61-f499-4606-b786-5519246f0b53 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:36.746909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4898ec61-f499-4606-b786-5519246f0b53 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:36.804658 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-4898ec61-f499-4606-b786-5519246f0b53 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] HTTP exception thrown: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4898ec61-f499-4606-b786-5519246f0b53 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Request method failure captured: Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa HTTP/1.1 Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C38MeByVKiVMOKtC1kTurWRhHcyxi-0AmvGy4XdQHsXDCN3Ic4YUg5WccbTqc_s0z_-6insPcg5rV7EvJiPcfDl9lYs49sbFZCfB2_PGxb5rzlpWwbxE5SLzzW5-fl6tG0Vwo64dau0r4yPcjJGa7WLmipShtzifhH5p6QYSXPJYfM Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 696fe3c794f345898ccdfc30555d420d Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/696fe3c794f345898ccdfc30555d420d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/696fe3c794f345898ccdfc30555d420d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_696fe3c794f345898ccdfc30555d420d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/696fe3c794f345898ccdfc30555d420d"}]}] Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 696fe3c794f345898ccdfc30555d420d Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-136825956 Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeShelveTestJSON-136825956-project Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: b19287c405854751b7ad4846457b5882 Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeShelveTestJSON-136825956-project Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'e5292ea7-49d5-4a1e-8fee-76a77bf64afa'} Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:36.814021 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:36.819464 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:36.819464 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:36.819464 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:36.819464 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:36.819464 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:36.819464 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:36.819464 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. Jul 14 15:01:36.819464 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:36.819464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4898ec61-f499-4606-b786-5519246f0b53 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] Returning 404 to user: Instance e5292ea7-49d5-4a1e-8fee-76a77bf64afa could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:36.819464 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4898ec61-f499-4606-b786-5519246f0b53 tempest-AttachVolumeShelveTestJSON-136825956 tempest-AttachVolumeShelveTestJSON-136825956-project] 10.222.0.81 "GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa" status: 404 len: 111 microversion: 2.20 time: 0.095079 Jul 14 15:01:36.819464 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2819/5660] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jul 14 15:01:36 2022] GET /compute/v2.1/servers/e5292ea7-49d5-4a1e-8fee-76a77bf64afa => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:01:36.957290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-75428e1d-48ab-4015-a533-d1bf64224562 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:36.958532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-75428e1d-48ab-4015-a533-d1bf64224562 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:36.977276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75428e1d-48ab-4015-a533-d1bf64224562 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:36.983756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75428e1d-48ab-4015-a533-d1bf64224562 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:36.992919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75428e1d-48ab-4015-a533-d1bf64224562 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:36.993959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75428e1d-48ab-4015-a533-d1bf64224562 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:37.104145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75428e1d-48ab-4015-a533-d1bf64224562 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:37.104823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75428e1d-48ab-4015-a533-d1bf64224562 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:37.109109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-75428e1d-48ab-4015-a533-d1bf64224562 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lazy-loading 'fault' on Instance uuid accee1e3-de25-42fe-b062-e6c330d4e88c {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:01:37.268517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-75428e1d-48ab-4015-a533-d1bf64224562 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:37.278613 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-75428e1d-48ab-4015-a533-d1bf64224562 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 200 len: 1326 microversion: 2.1 time: 0.330797 Jul 14 15:01:37.297533 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2842/5661] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:36 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 1326 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:38.298186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-800458ee-05cc-436f-973f-b9e92720663a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:38.298866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-800458ee-05cc-436f-973f-b9e92720663a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:38.326114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-800458ee-05cc-436f-973f-b9e92720663a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:38.328448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-800458ee-05cc-436f-973f-b9e92720663a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:38.330109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-800458ee-05cc-436f-973f-b9e92720663a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:38.332735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-800458ee-05cc-436f-973f-b9e92720663a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:38.412755 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-800458ee-05cc-436f-973f-b9e92720663a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] HTTP exception thrown: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-800458ee-05cc-436f-973f-b9e92720663a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Request method failure captured: Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c HTTP/1.1 Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C7opZHjCssO2SzWb1KVTPSGElrFY6ZP12dF9DA5dfNlTS5BI5fTos38FvfX62W00Z-HI1F40nQHSlax05qqMnR66WzpohbQg_pdoSMTOfK4IVZdzGYQm_jfiT8Tt4lJM74Py1tGsnTPqx_GuXX2uyYdJip80dVbJ_02BubbQN-JNMg Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d2da89f72ce5460ca5c6b01801c6a887 Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d2da89f72ce5460ca5c6b01801c6a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d2da89f72ce5460ca5c6b01801c6a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d2da89f72ce5460ca5c6b01801c6a887", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d2da89f72ce5460ca5c6b01801c6a887"}]}] Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d2da89f72ce5460ca5c6b01801c6a887 Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeTestJSON-512659841-project Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 8e61e6e12c0a4cdda2008953a997411f Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeTestJSON-512659841-project Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'accee1e3-de25-42fe-b062-e6c330d4e88c'} Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:38.415145 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:38.420725 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:38.420725 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:38.420725 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:38.420725 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:38.420725 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:38.420725 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:01:38.420725 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:01:38.423216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-800458ee-05cc-436f-973f-b9e92720663a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Returning 404 to user: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:38.424305 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-800458ee-05cc-436f-973f-b9e92720663a tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 404 len: 111 microversion: 2.1 time: 0.131306 Jul 14 15:01:38.438292 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2820/5662] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:38 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:01:38.446772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-749372a9-3f90-4e93-b06d-da0eed889c3c tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '.version_select at 0x7fd6c4e040d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:38.503577 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-749372a9-3f90-4e93-b06d-da0eed889c3c tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43326953" status: 202 len: 0 microversion: 2.1 time: 0.060716 Jul 14 15:01:38.504533 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2843/5663] 10.222.0.81 () {58 vars in 1214 bytes} [Thu Jul 14 15:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43326953 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:01:40.936191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f485b1a-a484-4644-83d7-964c6da71a0d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Action: 'create', calling method: .version_select at 0x7fd6c459b040>, body: {"keypair": {"name": "tempest-keypair-1950178346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERBpOw2b9vxNt9HZ3IfJHIDSakapGl6Z/Nk7tsJ+AIugsxpwqY0FZ4+MAfgPOMbe2ffeaE8sedyZvxv/wJX5hA+7w2c7rFz+muZMK3r0HtHFGUG4l+bVm4ZD4SvnpriLQ=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:40.989965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-8f485b1a-a484-4644-83d7-964c6da71a0d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Getting quotas for project d2da89f72ce5460ca5c6b01801c6a887. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:01:41.002697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-8f485b1a-a484-4644-83d7-964c6da71a0d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Getting quotas for user 8e61e6e12c0a4cdda2008953a997411f and project d2da89f72ce5460ca5c6b01801c6a887. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:01:41.062689 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8f485b1a-a484-4644-83d7-964c6da71a0d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131752 Jul 14 15:01:41.064283 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2821/5664] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:01:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:45.846276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1942082416", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4a30086-913a-4f83-95a8-00718bd2af52"}], "security_groups": [{"name": "tempest-securitygroup--750061044"}], "key_name": "tempest-keypair-1950178346", "user_data": "}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:45.894968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:46.308643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] validate_networks() for [('d4a30086-913a-4f83-95a8-00718bd2af52', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:01:47.274458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:47.299259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:01:47.300002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:01:47.300715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:01:47.301403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:01:47.303471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:01:47.341268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:47.341902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:47.343417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:47.345807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:47.400528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Getting quotas for project d2da89f72ce5460ca5c6b01801c6a887. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:01:47.427665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Getting quotas for user 8e61e6e12c0a4cdda2008953a997411f and project d2da89f72ce5460ca5c6b01801c6a887. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:01:47.467054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:01:47.478261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:01:47.696526 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-404ac169-4a79-431c-b20c-4a935207c71d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.843647 Jul 14 15:01:47.698972 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2844/5665] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:01:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:01:47.709661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d161954-03b6-4bf1-9138-d6878e29a168 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:47.710294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0d161954-03b6-4bf1-9138-d6878e29a168 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:47.727287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:47.891457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0d161954-03b6-4bf1-9138-d6878e29a168 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:47.902540 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0d161954-03b6-4bf1-9138-d6878e29a168 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1238 microversion: 2.1 time: 0.197901 Jul 14 15:01:47.908210 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2822/5666] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:47 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1238 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:48.936594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-862a6655-52bd-4857-a8dd-6afbdc09b10b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:48.937309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-862a6655-52bd-4857-a8dd-6afbdc09b10b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:49.160360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-862a6655-52bd-4857-a8dd-6afbdc09b10b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:49.170024 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-862a6655-52bd-4857-a8dd-6afbdc09b10b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1238 microversion: 2.1 time: 0.249868 Jul 14 15:01:49.179084 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2845/5667] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:48 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1238 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:50.194534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-476605fb-f9fe-4991-9849-325ddb830637 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:50.196232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-476605fb-f9fe-4991-9849-325ddb830637 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:50.246950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=17 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:50.261537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-476605fb-f9fe-4991-9849-325ddb830637 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:50.262437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-476605fb-f9fe-4991-9849-325ddb830637 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:50.263503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-476605fb-f9fe-4991-9849-325ddb830637 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:50.264583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-476605fb-f9fe-4991-9849-325ddb830637 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:50.393750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-368451191", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "883673a0-fc70-4f48-bbc5-d60e7ad09085"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:50.544766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] validate_networks() for [('883673a0-fc70-4f48-bbc5-d60e7ad09085', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:01:50.593288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-476605fb-f9fe-4991-9849-325ddb830637 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:50.608979 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-476605fb-f9fe-4991-9849-325ddb830637 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1308 microversion: 2.1 time: 0.412479 Jul 14 15:01:50.612119 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2823/5668] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:50 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:51.345303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3bd8e520-ea23-4cbf-b0e0-8bb8989c6b77 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Action: 'create', calling method: .version_select at 0x7fd6c42a7a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1409411900"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:51.543408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:01:51.544467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:01:51.545416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:01:51.546027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:01:51.546621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:01:51.571881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:51.574197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:51.578392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:51.579266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:51.614001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Getting quotas for project e0af80f1f8024f1d8d1e70b3ecf03a8a. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:01:51.620469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Getting quotas for user a30beff508f44228a98377afc6c6dbc4 and project e0af80f1f8024f1d8d1e70b3ecf03a8a. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:01:51.642423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:01:51.645635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:01:51.740861 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4cf72639-891d-46c4-a0aa-95ee6133b3aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.356300 Jul 14 15:01:51.741926 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2846/5669] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:01:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:01:51.749148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-baef4fd0-180d-4d26-8242-cd489b8e7bb2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:51.750189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-baef4fd0-180d-4d26-8242-cd489b8e7bb2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:51.759506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-baef4fd0-180d-4d26-8242-cd489b8e7bb2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:51.760250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-baef4fd0-180d-4d26-8242-cd489b8e7bb2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:51.763326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-baef4fd0-180d-4d26-8242-cd489b8e7bb2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:51.764383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-baef4fd0-180d-4d26-8242-cd489b8e7bb2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:51.975401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-baef4fd0-180d-4d26-8242-cd489b8e7bb2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:52.017425 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-baef4fd0-180d-4d26-8242-cd489b8e7bb2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1296 microversion: 2.1 time: 0.265806 Jul 14 15:01:52.019142 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2847/5670] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:51 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1296 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:52.024907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d72f25b6-bb7d-456a-bfdc-8f2f6601ff63 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:52.041161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d72f25b6-bb7d-456a-bfdc-8f2f6601ff63 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:52.124556 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3bd8e520-ea23-4cbf-b0e0-8bb8989c6b77 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.981292 Jul 14 15:01:52.125966 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2824/5671] 10.222.0.81 () {60 vars in 1154 bytes} [Thu Jul 14 15:01:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 983 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 15:01:52.146114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-43da19e5-67d4-4f8c-b4a8-f870aa753317 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c5363670>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:52.247130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d72f25b6-bb7d-456a-bfdc-8f2f6601ff63 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:52.261961 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d72f25b6-bb7d-456a-bfdc-8f2f6601ff63 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1218 microversion: 2.1 time: 0.238254 Jul 14 15:01:52.264930 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2848/5672] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:52 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1218 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:52.352028 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-43da19e5-67d4-4f8c-b4a8-f870aa753317 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8" status: 200 len: 345 microversion: 2.1 time: 0.219219 Jul 14 15:01:52.352621 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2825/5673] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:01:52 2022] GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 => generated 345 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:01:53.042898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-215bcedb-12dd-497e-a114-130aad969f0f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:53.043567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-215bcedb-12dd-497e-a114-130aad969f0f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:53.063178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-215bcedb-12dd-497e-a114-130aad969f0f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:53.073652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-215bcedb-12dd-497e-a114-130aad969f0f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:53.074820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-215bcedb-12dd-497e-a114-130aad969f0f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:53.075443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-215bcedb-12dd-497e-a114-130aad969f0f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:53.291426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-34202061-ad1e-4101-9fc4-5791c0e85d09 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:53.292645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-34202061-ad1e-4101-9fc4-5791c0e85d09 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:53.305786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-34202061-ad1e-4101-9fc4-5791c0e85d09 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:53.309476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-34202061-ad1e-4101-9fc4-5791c0e85d09 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:53.312289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-34202061-ad1e-4101-9fc4-5791c0e85d09 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:53.313120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-34202061-ad1e-4101-9fc4-5791c0e85d09 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:53.502517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-215bcedb-12dd-497e-a114-130aad969f0f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:53.529337 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-215bcedb-12dd-497e-a114-130aad969f0f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1363 microversion: 2.1 time: 0.490910 Jul 14 15:01:53.538128 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2849/5674] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:53 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1363 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:53.548936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff7cd4ad-db70-46b8-9b7a-e12f41519ff2 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c4f14160>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:53.662305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-34202061-ad1e-4101-9fc4-5791c0e85d09 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:53.683209 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-34202061-ad1e-4101-9fc4-5791c0e85d09 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1270 microversion: 2.1 time: 0.396856 Jul 14 15:01:53.697191 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2826/5675] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:53 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1270 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:53.776920 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ff7cd4ad-db70-46b8-9b7a-e12f41519ff2 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8" status: 200 len: 345 microversion: 2.1 time: 0.234852 Jul 14 15:01:53.780002 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2850/5676] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:01:53 2022] GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 => generated 345 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:54.555349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6dded0d3-cf48-4680-9053-b36cc3d3c9bb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:54.556044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6dded0d3-cf48-4680-9053-b36cc3d3c9bb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:54.569086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6dded0d3-cf48-4680-9053-b36cc3d3c9bb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:54.570487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6dded0d3-cf48-4680-9053-b36cc3d3c9bb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:54.570487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6dded0d3-cf48-4680-9053-b36cc3d3c9bb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:54.570763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6dded0d3-cf48-4680-9053-b36cc3d3c9bb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:54.707794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2fbb2c32-0ae8-4624-834c-a2f06b3e5b6a tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:54.708628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2fbb2c32-0ae8-4624-834c-a2f06b3e5b6a tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:54.725133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fbb2c32-0ae8-4624-834c-a2f06b3e5b6a tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:54.726081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fbb2c32-0ae8-4624-834c-a2f06b3e5b6a tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:54.727640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fbb2c32-0ae8-4624-834c-a2f06b3e5b6a tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:54.728580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fbb2c32-0ae8-4624-834c-a2f06b3e5b6a tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:55.010885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2fbb2c32-0ae8-4624-834c-a2f06b3e5b6a tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:55.025793 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2fbb2c32-0ae8-4624-834c-a2f06b3e5b6a tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1276 microversion: 2.1 time: 0.327372 Jul 14 15:01:55.026994 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2851/5677] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:54 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1276 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:55.038774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8a8b51e2-1bec-4010-a9d0-3129843533ae tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c5e60d30>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:55.194345 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8a8b51e2-1bec-4010-a9d0-3129843533ae tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8" status: 200 len: 346 microversion: 2.1 time: 0.166296 Jul 14 15:01:55.194928 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2852/5678] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:01:55 2022] GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 => generated 346 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:55.200213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-519fdbb5-551e-419e-b369-0d8ccee8f755 req-94bce058-a282-454c-bcae-2b6095e21e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0", "tag": "a9ccdd67-cc86-4995-8fb7-8795d8d6ad7f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:55.235471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-519fdbb5-551e-419e-b369-0d8ccee8f755 req-94bce058-a282-454c-bcae-2b6095e21e68 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:55.235917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-519fdbb5-551e-419e-b369-0d8ccee8f755 req-94bce058-a282-454c-bcae-2b6095e21e68 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:55.281265 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-519fdbb5-551e-419e-b369-0d8ccee8f755 req-94bce058-a282-454c-bcae-2b6095e21e68 service nova] Creating event network-changed:a9ccdd67-cc86-4995-8fb7-8795d8d6ad7f for instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 on n-h2-767704-28 Jul 14 15:01:55.294948 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-519fdbb5-551e-419e-b369-0d8ccee8f755 req-94bce058-a282-454c-bcae-2b6095e21e68 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098687 Jul 14 15:01:55.295488 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2853/5679] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:55.311352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8c020fd5-8ae5-447a-b631-0793e17ff510 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Action: 'create', calling method: .version_select at 0x7fd6c4b408b0>, body: {"snapshot": {"volume_id": "f6a278e3-06ca-48ed-80c2-3a9c58f941d8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1956573453"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:55.321831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6dded0d3-cf48-4680-9053-b36cc3d3c9bb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:55.340308 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6dded0d3-cf48-4680-9053-b36cc3d3c9bb tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1363 microversion: 2.1 time: 0.789277 Jul 14 15:01:55.341470 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2827/5680] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:54 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1363 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:55.742519 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8c020fd5-8ae5-447a-b631-0793e17ff510 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.435813 Jul 14 15:01:55.743200 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2854/5681] 10.222.0.81 () {60 vars in 1161 bytes} [Thu Jul 14 15:01:55 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:55.754236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-76326052-7d8d-4821-86db-f65b583ff1f8 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c4652280>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:55.826300 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-76326052-7d8d-4821-86db-f65b583ff1f8 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078" status: 200 len: 287 microversion: 2.1 time: 0.075870 Jul 14 15:01:55.827008 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2828/5682] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 15:01:55 2022] GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:55.837397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1869be44-2f7a-4d0a-9d78-f12cbb39e06f tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c4b25b80>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:55.903620 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1869be44-2f7a-4d0a-9d78-f12cbb39e06f tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.070441 Jul 14 15:01:55.904503 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2855/5683] 10.222.0.81 () {58 vars in 1139 bytes} [Thu Jul 14 15:01:55 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:55.915985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-01933cf3-5e43-4edb-8a07-c18eb8e9070f tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c45499d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:55.964456 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-01933cf3-5e43-4edb-8a07-c18eb8e9070f tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078" status: 200 len: 287 microversion: 2.1 time: 0.051863 Jul 14 15:01:55.965733 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2829/5684] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 15:01:55 2022] GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:56.045433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-83f8fd91-56d5-4e55-90d7-3d1ad242e974 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:56.046191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-83f8fd91-56d5-4e55-90d7-3d1ad242e974 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:56.061484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83f8fd91-56d5-4e55-90d7-3d1ad242e974 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:56.061959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83f8fd91-56d5-4e55-90d7-3d1ad242e974 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:56.062770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83f8fd91-56d5-4e55-90d7-3d1ad242e974 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:56.063222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-83f8fd91-56d5-4e55-90d7-3d1ad242e974 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:56.289411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-83f8fd91-56d5-4e55-90d7-3d1ad242e974 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:56.302631 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-83f8fd91-56d5-4e55-90d7-3d1ad242e974 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1276 microversion: 2.1 time: 0.262284 Jul 14 15:01:56.315866 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2856/5685] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:56 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:56.361953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1f9565ef-5ac4-4a0f-966c-b0e426a2c18b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:56.363204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1f9565ef-5ac4-4a0f-966c-b0e426a2c18b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:56.377202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f9565ef-5ac4-4a0f-966c-b0e426a2c18b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:56.377985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f9565ef-5ac4-4a0f-966c-b0e426a2c18b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:56.378974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f9565ef-5ac4-4a0f-966c-b0e426a2c18b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:56.379642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1f9565ef-5ac4-4a0f-966c-b0e426a2c18b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:56.977664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1469892a-5bf1-4d9c-b123-121c47a2f0fe tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c4b40820>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:57.023925 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1469892a-5bf1-4d9c-b123-121c47a2f0fe tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078" status: 200 len: 287 microversion: 2.1 time: 0.050543 Jul 14 15:01:57.024778 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2857/5686] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 15:01:56 2022] GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:57.035788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1f9565ef-5ac4-4a0f-966c-b0e426a2c18b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:57.052030 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1f9565ef-5ac4-4a0f-966c-b0e426a2c18b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1363 microversion: 2.1 time: 0.697717 Jul 14 15:01:57.052902 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2830/5687] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:56 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1363 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:57.320830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-14c040cc-3049-4f5e-a082-b2a5abca11d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:57.321836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-14c040cc-3049-4f5e-a082-b2a5abca11d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:57.355719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14c040cc-3049-4f5e-a082-b2a5abca11d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:57.356535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14c040cc-3049-4f5e-a082-b2a5abca11d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:57.358638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14c040cc-3049-4f5e-a082-b2a5abca11d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:57.360361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14c040cc-3049-4f5e-a082-b2a5abca11d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:58.037032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6efc38b7-1920-4688-97da-6469861c3610 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c4409a60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:58.048844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:58.145884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-14c040cc-3049-4f5e-a082-b2a5abca11d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:58.167016 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-14c040cc-3049-4f5e-a082-b2a5abca11d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1318 microversion: 2.1 time: 0.848852 Jul 14 15:01:58.169564 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2858/5688] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:57 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1318 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:58.188689 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6efc38b7-1920-4688-97da-6469861c3610 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078" status: 200 len: 287 microversion: 2.1 time: 0.156623 Jul 14 15:01:58.189710 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2831/5689] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 15:01:58 2022] GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078 => generated 287 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:58.197427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0371cbbb-0238-4466-939f-159d611fdb4b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:58.200052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0371cbbb-0238-4466-939f-159d611fdb4b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:58.228552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0371cbbb-0238-4466-939f-159d611fdb4b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:58.228918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0371cbbb-0238-4466-939f-159d611fdb4b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:58.245656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0371cbbb-0238-4466-939f-159d611fdb4b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:58.246139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0371cbbb-0238-4466-939f-159d611fdb4b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:58.853956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0371cbbb-0238-4466-939f-159d611fdb4b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:58.864401 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0371cbbb-0238-4466-939f-159d611fdb4b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1363 microversion: 2.1 time: 0.691905 Jul 14 15:01:58.865024 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2859/5690] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:58 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1363 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:59.212774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aa4cbdb2-442e-40ea-aad7-bd9917cfc2a2 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c4b8e790>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:59.220625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9588f2d8-a9d2-426d-80d4-d8f744a0e335 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:59.223446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9588f2d8-a9d2-426d-80d4-d8f744a0e335 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:59.271163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9588f2d8-a9d2-426d-80d4-d8f744a0e335 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:59.272048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9588f2d8-a9d2-426d-80d4-d8f744a0e335 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:59.274575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9588f2d8-a9d2-426d-80d4-d8f744a0e335 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:59.275505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9588f2d8-a9d2-426d-80d4-d8f744a0e335 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:59.332993 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aa4cbdb2-442e-40ea-aad7-bd9917cfc2a2 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078" status: 200 len: 288 microversion: 2.1 time: 0.136880 Jul 14 15:01:59.334200 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2860/5691] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 15:01:59 2022] GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078 => generated 288 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:59.347096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-09efb16e-40f7-43d5-aa00-046c766cf7d0 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c4b401f0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:59.538924 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-09efb16e-40f7-43d5-aa00-046c766cf7d0 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "DELETE /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078" status: 202 len: 0 microversion: 2.1 time: 0.196895 Jul 14 15:01:59.543514 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2861/5692] 10.222.0.81 () {58 vars in 1253 bytes} [Thu Jul 14 15:01:59 2022] DELETE /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:01:59.552536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b2a83323-f6f4-4a19-a4a8-7f43cb43ff54 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c4b8a550>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:59.691424 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b2a83323-f6f4-4a19-a4a8-7f43cb43ff54 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078" status: 200 len: 287 microversion: 2.1 time: 0.144314 Jul 14 15:01:59.692906 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2862/5693] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 15:01:59 2022] GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078 => generated 287 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:59.882036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6a26f517-43a7-43ab-b6af-d16bbd09a752 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:59.886530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6a26f517-43a7-43ab-b6af-d16bbd09a752 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:59.941006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a26f517-43a7-43ab-b6af-d16bbd09a752 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:59.946176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a26f517-43a7-43ab-b6af-d16bbd09a752 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:59.947084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a26f517-43a7-43ab-b6af-d16bbd09a752 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:59.947555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a26f517-43a7-43ab-b6af-d16bbd09a752 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:59.977662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9588f2d8-a9d2-426d-80d4-d8f744a0e335 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:00.001853 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9588f2d8-a9d2-426d-80d4-d8f744a0e335 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1318 microversion: 2.1 time: 0.817641 Jul 14 15:02:00.002490 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2832/5694] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:59 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1318 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:00.704587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-04fa69b6-5ffa-4e22-ad78-724e208ac3f0 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c5e248b0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:00.779717 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-04fa69b6-5ffa-4e22-ad78-724e208ac3f0 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078" status: 200 len: 287 microversion: 2.1 time: 0.079290 Jul 14 15:02:00.780304 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2833/5695] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 15:02:00 2022] GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:02:00.974026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6a26f517-43a7-43ab-b6af-d16bbd09a752 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:00.986826 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6a26f517-43a7-43ab-b6af-d16bbd09a752 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1363 microversion: 2.1 time: 1.109122 Jul 14 15:02:00.991423 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2863/5696] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:59 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1363 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:01.028015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b7589911-be08-4865-aa04-f4392afa88aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:01.028901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b7589911-be08-4865-aa04-f4392afa88aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:01.075009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7589911-be08-4865-aa04-f4392afa88aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:01.075476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7589911-be08-4865-aa04-f4392afa88aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:01.076283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7589911-be08-4865-aa04-f4392afa88aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:01.076723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7589911-be08-4865-aa04-f4392afa88aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:01.792578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-506176f9-f45a-454e-abb8-1c41f561de72 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c4b644c0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:01.835606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:01.864379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b7589911-be08-4865-aa04-f4392afa88aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:01.888117 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b7589911-be08-4865-aa04-f4392afa88aa tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1318 microversion: 2.1 time: 0.864866 Jul 14 15:02:01.919044 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2834/5697] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:01 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1318 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:02.008515 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-506176f9-f45a-454e-abb8-1c41f561de72 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078" status: 200 len: 287 microversion: 2.1 time: 0.220493 Jul 14 15:02:02.009233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-55f5854c-5db4-4065-addb-966b8b70a459 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:02.009874 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2864/5698] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 15:02:01 2022] GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078 => generated 287 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:02.010089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-55f5854c-5db4-4065-addb-966b8b70a459 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:02.032753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-55f5854c-5db4-4065-addb-966b8b70a459 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:02.039706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-55f5854c-5db4-4065-addb-966b8b70a459 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:02.040736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-55f5854c-5db4-4065-addb-966b8b70a459 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:02.043782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-55f5854c-5db4-4065-addb-966b8b70a459 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:02.486874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=16 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:02.492836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-35d3b64e-ef95-473c-a8ed-593952d380e2 req-2ff10e0d-f367-40cc-8673-c339eabba9bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d42b7f9-83a8-4390-afe2-a596731808ad", "tag": "61da9320-48c7-4ae6-81ff-325af1e07c83"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:02.547774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-35d3b64e-ef95-473c-a8ed-593952d380e2 req-2ff10e0d-f367-40cc-8673-c339eabba9bd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:02.548340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-35d3b64e-ef95-473c-a8ed-593952d380e2 req-2ff10e0d-f367-40cc-8673-c339eabba9bd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:02.641383 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-35d3b64e-ef95-473c-a8ed-593952d380e2 req-2ff10e0d-f367-40cc-8673-c339eabba9bd service nova] Creating event network-changed:61da9320-48c7-4ae6-81ff-325af1e07c83 for instance 8d42b7f9-83a8-4390-afe2-a596731808ad on n-h1-767704-28 Jul 14 15:02:02.662914 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-35d3b64e-ef95-473c-a8ed-593952d380e2 req-2ff10e0d-f367-40cc-8673-c339eabba9bd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170078 Jul 14 15:02:02.663608 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2865/5699] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:02:02.989175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-95a35a75-c93b-4a14-a6f0-4084fbac914b req-829a0e65-0a4f-4bc0-b5d3-042739ee0d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0", "name": "network-vif-plugged", "status": "completed", "tag": "a9ccdd67-cc86-4995-8fb7-8795d8d6ad7f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:03.010982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-95a35a75-c93b-4a14-a6f0-4084fbac914b req-829a0e65-0a4f-4bc0-b5d3-042739ee0d03 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:03.011555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-95a35a75-c93b-4a14-a6f0-4084fbac914b req-829a0e65-0a4f-4bc0-b5d3-042739ee0d03 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:03.101324 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-95a35a75-c93b-4a14-a6f0-4084fbac914b req-829a0e65-0a4f-4bc0-b5d3-042739ee0d03 service nova] Creating event network-vif-plugged:a9ccdd67-cc86-4995-8fb7-8795d8d6ad7f for instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 on n-h2-767704-28 Jul 14 15:02:03.132854 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-95a35a75-c93b-4a14-a6f0-4084fbac914b req-829a0e65-0a4f-4bc0-b5d3-042739ee0d03 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.455317 Jul 14 15:02:03.138327 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2866/5700] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:03.147977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-df1914c5-c32a-4a9b-9c0d-c0b0cef40da0 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:03.148603 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-df1914c5-c32a-4a9b-9c0d-c0b0cef40da0 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:03.164484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-55f5854c-5db4-4065-addb-966b8b70a459 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:03.177457 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-55f5854c-5db4-4065-addb-966b8b70a459 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1363 microversion: 2.1 time: 1.173384 Jul 14 15:02:03.186557 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2835/5701] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:02 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1363 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:03.194649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df1914c5-c32a-4a9b-9c0d-c0b0cef40da0 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:03.197468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df1914c5-c32a-4a9b-9c0d-c0b0cef40da0 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:03.198975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df1914c5-c32a-4a9b-9c0d-c0b0cef40da0 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:03.204074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-df1914c5-c32a-4a9b-9c0d-c0b0cef40da0 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:03.209179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e159283-3b29-4423-9b2f-9ca49f077780 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c45405e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:03.305194 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e159283-3b29-4423-9b2f-9ca49f077780 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078" status: 200 len: 287 microversion: 2.1 time: 0.117403 Jul 14 15:02:03.306057 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2836/5702] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 15:02:03 2022] GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078 => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:04.205769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6495ac65-7a2b-40c5-8efc-777c98aacbaf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:04.206490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6495ac65-7a2b-40c5-8efc-777c98aacbaf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:04.225325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6495ac65-7a2b-40c5-8efc-777c98aacbaf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:04.227597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6495ac65-7a2b-40c5-8efc-777c98aacbaf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:04.228554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6495ac65-7a2b-40c5-8efc-777c98aacbaf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:04.229036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6495ac65-7a2b-40c5-8efc-777c98aacbaf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:04.521877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-df1914c5-c32a-4a9b-9c0d-c0b0cef40da0 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:04.534009 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-df1914c5-c32a-4a9b-9c0d-c0b0cef40da0 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1318 microversion: 2.1 time: 1.393957 Jul 14 15:02:04.535417 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2867/5703] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:03 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1318 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:04.540394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-249bcd14-daf5-46e8-b02b-2ed7c3a93dc0 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:04.541072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-249bcd14-daf5-46e8-b02b-2ed7c3a93dc0 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:04.559214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-249bcd14-daf5-46e8-b02b-2ed7c3a93dc0 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:04.559825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-249bcd14-daf5-46e8-b02b-2ed7c3a93dc0 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:04.560662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-249bcd14-daf5-46e8-b02b-2ed7c3a93dc0 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:04.561150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-249bcd14-daf5-46e8-b02b-2ed7c3a93dc0 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:04.652216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6495ac65-7a2b-40c5-8efc-777c98aacbaf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:04.674490 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6495ac65-7a2b-40c5-8efc-777c98aacbaf tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1363 microversion: 2.1 time: 0.474522 Jul 14 15:02:04.676972 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2837/5704] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:04 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1363 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:04.688441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-51649fc1-4f79-43e1-9b96-8188062205ad tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c63cde50>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:04.725003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-249bcd14-daf5-46e8-b02b-2ed7c3a93dc0 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lazy-loading 'services' on Instance uuid 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:02:04.750879 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-51649fc1-4f79-43e1-9b96-8188062205ad tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] HTTP exception thrown: Snapshot 17d6006f-9554-4dfa-a4a5-afe4ead1e078 could not be found. Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-51649fc1-4f79-43e1-9b96-8188062205ad tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Request method failure captured: Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078 HTTP/1.1 Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C_fyOmkVNlreSbEcVmXz_IG_hd8hLfZr8VHwkYnvCUa-vqyWu_LMiMKVWyCZCRRIlFQH28h5VQUifkm791Z4rYPqFqKDJTL2_jBv3J2-IcP_kncboN7v4z5--htOPL-C7qKFDqRSipi-cCphESeTVYIvvE8T87-YY_Wrl3uvKRxBFc Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: ee040adb7be14c4c984b853d77abea11 Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-83549404 Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee040adb7be14c4c984b853d77abea11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ee040adb7be14c4c984b853d77abea11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ee040adb7be14c4c984b853d77abea11", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee040adb7be14c4c984b853d77abea11"}]}] Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesSnapshotsTestJSON-83549404 Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: ee040adb7be14c4c984b853d77abea11 Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-83549404 Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesSnapshotsTestJSON-83549404-project Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 603d04ca14474daf8f6641783c64a233 Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesSnapshotsTestJSON-83549404-project Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: exception: Snapshot 17d6006f-9554-4dfa-a4a5-afe4ead1e078 could not be found. Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '17d6006f-9554-4dfa-a4a5-afe4ead1e078'} Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 17d6006f-9554-4dfa-a4a5-afe4ead1e078 could not be found. (HTTP 404) (Request-ID: req-bfcaf703-705f-4ed8-bacf-459ef039e1cf) Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:02:04.765161 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 17d6006f-9554-4dfa-a4a5-afe4ead1e078 could not be found. Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 17d6006f-9554-4dfa-a4a5-afe4ead1e078 could not be found. Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 17d6006f-9554-4dfa-a4a5-afe4ead1e078 could not be found. Jul 14 15:02:04.770920 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:04.777123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-51649fc1-4f79-43e1-9b96-8188062205ad tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Returning 404 to user: Snapshot 17d6006f-9554-4dfa-a4a5-afe4ead1e078 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:02:04.777358 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-51649fc1-4f79-43e1-9b96-8188062205ad tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078" status: 404 len: 111 microversion: 2.1 time: 0.098907 Jul 14 15:02:04.778097 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2838/5705] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 15:02:04 2022] GET /compute/v2.1/os-snapshots/17d6006f-9554-4dfa-a4a5-afe4ead1e078 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:04.786983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7eebbe1d-7c3d-4197-98cd-f7020950900a tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c5b79c10>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:04.843662 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-249bcd14-daf5-46e8-b02b-2ed7c3a93dc0 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507/os-volume_attachments/119241ce-fd7d-4dcb-9ea9-9894ba6f0be9" status: 202 len: 0 microversion: 2.1 time: 0.306880 Jul 14 15:02:04.844751 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2868/5706] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:02:04 2022] DELETE /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507/os-volume_attachments/119241ce-fd7d-4dcb-9ea9-9894ba6f0be9 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:02:04.904376 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7eebbe1d-7c3d-4197-98cd-f7020950900a tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8" status: 202 len: 0 microversion: 2.1 time: 0.118688 Jul 14 15:02:04.906477 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2839/5707] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 15:02:04 2022] DELETE /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:02:04.927214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ea5e75c8-35a7-4905-895c-5e2e6b49defc tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c4b8a9d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:05.035863 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ea5e75c8-35a7-4905-895c-5e2e6b49defc tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8" status: 200 len: 345 microversion: 2.1 time: 0.125607 Jul 14 15:02:05.036725 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2869/5708] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:02:04 2022] GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:05.555402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fa23dd99-4f0a-4948-9f41-e17502b975d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:05.556041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fa23dd99-4f0a-4948-9f41-e17502b975d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:05.564028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa23dd99-4f0a-4948-9f41-e17502b975d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:05.564762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa23dd99-4f0a-4948-9f41-e17502b975d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:05.566531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa23dd99-4f0a-4948-9f41-e17502b975d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:05.567173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fa23dd99-4f0a-4948-9f41-e17502b975d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:05.692363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-500d055f-b324-4086-89ec-9934dbba151d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:05.693230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-500d055f-b324-4086-89ec-9934dbba151d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:05.712468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-500d055f-b324-4086-89ec-9934dbba151d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:05.712930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-500d055f-b324-4086-89ec-9934dbba151d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:05.714673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-500d055f-b324-4086-89ec-9934dbba151d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:05.715193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-500d055f-b324-4086-89ec-9934dbba151d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:06.174833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-500d055f-b324-4086-89ec-9934dbba151d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:06.181733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fa23dd99-4f0a-4948-9f41-e17502b975d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:06.189530 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-500d055f-b324-4086-89ec-9934dbba151d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1549 microversion: 2.1 time: 0.501509 Jul 14 15:02:06.190713 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2870/5709] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:05 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1549 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:06.195571 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9d170047-5b9c-4d53-a76d-78400e0adfd1 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c4ce2940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:06.219832 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fa23dd99-4f0a-4948-9f41-e17502b975d3 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1318 microversion: 2.1 time: 0.670726 Jul 14 15:02:06.220434 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2840/5710] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:05 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1318 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:06.237097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5d652329-64a1-4e5b-a821-299219ea2c12 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:06.237600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5d652329-64a1-4e5b-a821-299219ea2c12 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:06.244513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d652329-64a1-4e5b-a821-299219ea2c12 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:06.245436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d652329-64a1-4e5b-a821-299219ea2c12 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:06.246313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d652329-64a1-4e5b-a821-299219ea2c12 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:06.246770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d652329-64a1-4e5b-a821-299219ea2c12 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:06.354237 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9d170047-5b9c-4d53-a76d-78400e0adfd1 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8" status: 200 len: 345 microversion: 2.1 time: 0.162214 Jul 14 15:02:06.361378 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2871/5711] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:02:06 2022] GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:06.739758 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5d652329-64a1-4e5b-a821-299219ea2c12 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.517949 Jul 14 15:02:06.740867 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2841/5712] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 15:02:06 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-interface => generated 285 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:07.242820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1fdc77e0-4db7-4207-b26d-f81d72d1b50b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:07.245893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1fdc77e0-4db7-4207-b26d-f81d72d1b50b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:07.283796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1fdc77e0-4db7-4207-b26d-f81d72d1b50b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:07.284280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1fdc77e0-4db7-4207-b26d-f81d72d1b50b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:07.287445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1fdc77e0-4db7-4207-b26d-f81d72d1b50b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:07.293005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1fdc77e0-4db7-4207-b26d-f81d72d1b50b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:07.371861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-13667c32-548b-4981-8050-0f92921dad74 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c5363940>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:07.499777 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-13667c32-548b-4981-8050-0f92921dad74 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8" status: 200 len: 345 microversion: 2.1 time: 0.131968 Jul 14 15:02:07.504775 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2842/5713] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:02:07 2022] GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:02:07.695629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1fdc77e0-4db7-4207-b26d-f81d72d1b50b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:07.709818 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1fdc77e0-4db7-4207-b26d-f81d72d1b50b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1318 microversion: 2.1 time: 0.474253 Jul 14 15:02:07.712738 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2872/5714] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:07 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:08.513823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7669a939-6380-4583-bc2e-130d914c1098 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c6143d30>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:08.638424 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7669a939-6380-4583-bc2e-130d914c1098 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8" status: 200 len: 345 microversion: 2.1 time: 0.129331 Jul 14 15:02:08.650511 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2843/5715] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:02:08 2022] GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:08.731289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e8e33f5-95cf-4b6a-b49f-cf76a0abdbe5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:08.732629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0e8e33f5-95cf-4b6a-b49f-cf76a0abdbe5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:08.748989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e8e33f5-95cf-4b6a-b49f-cf76a0abdbe5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:08.751701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e8e33f5-95cf-4b6a-b49f-cf76a0abdbe5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:08.754099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e8e33f5-95cf-4b6a-b49f-cf76a0abdbe5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:08.755057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e8e33f5-95cf-4b6a-b49f-cf76a0abdbe5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:08.982490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-04d7e1ac-5a26-4976-a2ec-b595d44ea672 req-bb77a4ec-c449-4ec5-84cf-bece17d5c57a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d42b7f9-83a8-4390-afe2-a596731808ad", "name": "network-vif-plugged", "status": "completed", "tag": "61da9320-48c7-4ae6-81ff-325af1e07c83"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:09.008426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-04d7e1ac-5a26-4976-a2ec-b595d44ea672 req-bb77a4ec-c449-4ec5-84cf-bece17d5c57a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:09.009111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-04d7e1ac-5a26-4976-a2ec-b595d44ea672 req-bb77a4ec-c449-4ec5-84cf-bece17d5c57a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:09.030938 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-04d7e1ac-5a26-4976-a2ec-b595d44ea672 req-bb77a4ec-c449-4ec5-84cf-bece17d5c57a service nova] Creating event network-vif-plugged:61da9320-48c7-4ae6-81ff-325af1e07c83 for instance 8d42b7f9-83a8-4390-afe2-a596731808ad on n-h1-767704-28 Jul 14 15:02:09.062746 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-04d7e1ac-5a26-4976-a2ec-b595d44ea672 req-bb77a4ec-c449-4ec5-84cf-bece17d5c57a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085411 Jul 14 15:02:09.071801 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2844/5716] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:02:09.241918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0e8e33f5-95cf-4b6a-b49f-cf76a0abdbe5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:09.259322 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0e8e33f5-95cf-4b6a-b49f-cf76a0abdbe5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1318 microversion: 2.1 time: 0.530564 Jul 14 15:02:09.260213 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2873/5717] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:08 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:09.658487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24794cd4-8c83-4e88-9692-e6e640b6587d tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c5f2ad30>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:09.729466 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-24794cd4-8c83-4e88-9692-e6e640b6587d tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] HTTP exception thrown: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24794cd4-8c83-4e88-9692-e6e640b6587d tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Request method failure captured: Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 HTTP/1.1 Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C_fyOmkVNlreSbEcVmXz_IG_hd8hLfZr8VHwkYnvCUa-vqyWu_LMiMKVWyCZCRRIlFQH28h5VQUifkm791Z4rYPqFqKDJTL2_jBv3J2-IcP_kncboN7v4z5--htOPL-C7qKFDqRSipi-cCphESeTVYIvvE8T87-YY_Wrl3uvKRxBFc Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: ee040adb7be14c4c984b853d77abea11 Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-83549404 Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee040adb7be14c4c984b853d77abea11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ee040adb7be14c4c984b853d77abea11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ee040adb7be14c4c984b853d77abea11", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee040adb7be14c4c984b853d77abea11"}]}] Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesSnapshotsTestJSON-83549404 Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: ee040adb7be14c4c984b853d77abea11 Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-83549404 Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesSnapshotsTestJSON-83549404-project Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 603d04ca14474daf8f6641783c64a233 Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesSnapshotsTestJSON-83549404-project Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: exception: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'f6a278e3-06ca-48ed-80c2-3a9c58f941d8'} Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. (HTTP 404) (Request-ID: req-014397ba-3acb-4846-9ed9-20c846e77e68) Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:02:09.732003 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:09.738226 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.745252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24794cd4-8c83-4e88-9692-e6e640b6587d tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Returning 404 to user: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:02:09.747725 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-24794cd4-8c83-4e88-9692-e6e640b6587d tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8" status: 404 len: 109 microversion: 2.1 time: 0.093447 Jul 14 15:02:09.748530 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2845/5718] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:02:09 2022] GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:09.758116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-692825f1-1d21-4472-9f5d-74778f02ca04 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c4b8e040>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:09.820485 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-692825f1-1d21-4472-9f5d-74778f02ca04 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] HTTP exception thrown: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-692825f1-1d21-4472-9f5d-74778f02ca04 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Request method failure captured: Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 HTTP/1.1 Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C_fyOmkVNlreSbEcVmXz_IG_hd8hLfZr8VHwkYnvCUa-vqyWu_LMiMKVWyCZCRRIlFQH28h5VQUifkm791Z4rYPqFqKDJTL2_jBv3J2-IcP_kncboN7v4z5--htOPL-C7qKFDqRSipi-cCphESeTVYIvvE8T87-YY_Wrl3uvKRxBFc Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ee040adb7be14c4c984b853d77abea11 Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-83549404 Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee040adb7be14c4c984b853d77abea11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ee040adb7be14c4c984b853d77abea11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ee040adb7be14c4c984b853d77abea11", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee040adb7be14c4c984b853d77abea11"}]}] Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-VolumesSnapshotsTestJSON-83549404 Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ee040adb7be14c4c984b853d77abea11 Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-83549404 Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-VolumesSnapshotsTestJSON-83549404-project Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 603d04ca14474daf8f6641783c64a233 Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-VolumesSnapshotsTestJSON-83549404-project Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: exception: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'f6a278e3-06ca-48ed-80c2-3a9c58f941d8'} Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. (HTTP 404) (Request-ID: req-f3cf6237-3e15-4849-be76-afd807f23f90) Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:02:09.822843 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:09.827939 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:02:09.835152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-692825f1-1d21-4472-9f5d-74778f02ca04 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Returning 404 to user: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:02:09.835152 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-692825f1-1d21-4472-9f5d-74778f02ca04 tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8" status: 404 len: 109 microversion: 2.1 time: 0.080578 Jul 14 15:02:09.835152 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2874/5719] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 15:02:09 2022] DELETE /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:09.848841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8bb84353-1e7c-4ea7-aef5-cc21e220734b tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Calling method '.version_select at 0x7fd6c5f2aaf0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:09.981392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-17f47431-b4dd-4c67-9351-e18493e514d9 req-51630d5a-fb4b-4329-bc71-93358116a861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0", "tag": "a9ccdd67-cc86-4995-8fb7-8795d8d6ad7f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:10.010396 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-8bb84353-1e7c-4ea7-aef5-cc21e220734b tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] HTTP exception thrown: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8bb84353-1e7c-4ea7-aef5-cc21e220734b tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Request method failure captured: Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 HTTP/1.1 Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C_fyOmkVNlreSbEcVmXz_IG_hd8hLfZr8VHwkYnvCUa-vqyWu_LMiMKVWyCZCRRIlFQH28h5VQUifkm791Z4rYPqFqKDJTL2_jBv3J2-IcP_kncboN7v4z5--htOPL-C7qKFDqRSipi-cCphESeTVYIvvE8T87-YY_Wrl3uvKRxBFc Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: ee040adb7be14c4c984b853d77abea11 Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-83549404 Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee040adb7be14c4c984b853d77abea11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ee040adb7be14c4c984b853d77abea11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ee040adb7be14c4c984b853d77abea11", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee040adb7be14c4c984b853d77abea11"}]}] Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesSnapshotsTestJSON-83549404 Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: ee040adb7be14c4c984b853d77abea11 Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-83549404 Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesSnapshotsTestJSON-83549404-project Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 603d04ca14474daf8f6641783c64a233 Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesSnapshotsTestJSON-83549404-project Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: method: Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: exception: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'f6a278e3-06ca-48ed-80c2-3a9c58f941d8'} Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. (HTTP 404) (Request-ID: req-278948a7-9808-49db-8c46-abd25cfa9b86) Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:02:10.013361 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. Jul 14 15:02:10.018936 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:10.023927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-17f47431-b4dd-4c67-9351-e18493e514d9 req-51630d5a-fb4b-4329-bc71-93358116a861 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:10.023927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-17f47431-b4dd-4c67-9351-e18493e514d9 req-51630d5a-fb4b-4329-bc71-93358116a861 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:10.025182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8bb84353-1e7c-4ea7-aef5-cc21e220734b tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] Returning 404 to user: Volume f6a278e3-06ca-48ed-80c2-3a9c58f941d8 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:02:10.027694 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8bb84353-1e7c-4ea7-aef5-cc21e220734b tempest-VolumesSnapshotsTestJSON-83549404 tempest-VolumesSnapshotsTestJSON-83549404-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8" status: 404 len: 109 microversion: 2.1 time: 0.186286 Jul 14 15:02:10.028850 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2846/5720] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:02:09 2022] GET /compute/v2.1/os-volumes/f6a278e3-06ca-48ed-80c2-3a9c58f941d8 => generated 109 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:10.062410 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-17f47431-b4dd-4c67-9351-e18493e514d9 req-51630d5a-fb4b-4329-bc71-93358116a861 service nova] Creating event network-changed:a9ccdd67-cc86-4995-8fb7-8795d8d6ad7f for instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 on n-h2-767704-28 Jul 14 15:02:10.083137 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-17f47431-b4dd-4c67-9351-e18493e514d9 req-51630d5a-fb4b-4329-bc71-93358116a861 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109584 Jul 14 15:02:10.102263 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2875/5721] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:02:10.279873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5c527b9-8f41-437e-85e7-aaf412bf0c88 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:10.280408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e5c527b9-8f41-437e-85e7-aaf412bf0c88 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:10.297603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5c527b9-8f41-437e-85e7-aaf412bf0c88 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:10.298077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5c527b9-8f41-437e-85e7-aaf412bf0c88 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:10.310003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5c527b9-8f41-437e-85e7-aaf412bf0c88 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:10.310704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5c527b9-8f41-437e-85e7-aaf412bf0c88 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:10.792347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e5c527b9-8f41-437e-85e7-aaf412bf0c88 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:10.801278 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e5c527b9-8f41-437e-85e7-aaf412bf0c88 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1318 microversion: 2.1 time: 0.527368 Jul 14 15:02:10.804488 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2847/5722] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:10 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:11.820650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fc3f81eb-ba2a-4ae0-b09c-f4a2708365ff tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:11.822294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fc3f81eb-ba2a-4ae0-b09c-f4a2708365ff tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:11.845397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc3f81eb-ba2a-4ae0-b09c-f4a2708365ff tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:11.847448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc3f81eb-ba2a-4ae0-b09c-f4a2708365ff tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:11.856757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc3f81eb-ba2a-4ae0-b09c-f4a2708365ff tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:11.876212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fc3f81eb-ba2a-4ae0-b09c-f4a2708365ff tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:12.814276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fc3f81eb-ba2a-4ae0-b09c-f4a2708365ff tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:12.845253 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fc3f81eb-ba2a-4ae0-b09c-f4a2708365ff tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1507 microversion: 2.1 time: 1.029179 Jul 14 15:02:12.846375 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2876/5723] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:11 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1507 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:15.272461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1716200546", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:15.393565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:02:15.682190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:02:15.683144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:02:15.684316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:02:15.684986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:02:15.685633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:02:15.698499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:15.700239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:15.702301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:15.702951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:15.738326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Getting quotas for project 976feab134504549bc7b2661deff019d. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:02:15.746864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Getting quotas for user c4cb9ff00b5e4225b102f5ed7d1f2ea3 and project 976feab134504549bc7b2661deff019d. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:02:15.768021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:02:15.772171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:02:15.846920 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8b2fd942-01bd-4269-a60c-be1176fe9ed3 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574787 Jul 14 15:02:15.847977 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2848/5724] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:02:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:02:15.858282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8d2bdd58-527f-442d-8f2c-b72bd29b86c2 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:15.858912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8d2bdd58-527f-442d-8f2c-b72bd29b86c2 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:16.051955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8d2bdd58-527f-442d-8f2c-b72bd29b86c2 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:16.065660 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8d2bdd58-527f-442d-8f2c-b72bd29b86c2 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1215 microversion: 2.1 time: 0.211806 Jul 14 15:02:16.076603 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2877/5725] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:15 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:16.110757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-06393016-df45-4a20-9dc5-8c8980188894 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:16.111290 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-06393016-df45-4a20-9dc5-8c8980188894 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:16.120744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06393016-df45-4a20-9dc5-8c8980188894 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:16.127167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06393016-df45-4a20-9dc5-8c8980188894 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:16.128294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06393016-df45-4a20-9dc5-8c8980188894 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:16.128767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06393016-df45-4a20-9dc5-8c8980188894 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:16.176530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-06393016-df45-4a20-9dc5-8c8980188894 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:02:16.341864 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-06393016-df45-4a20-9dc5-8c8980188894 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 204 len: 0 microversion: 2.1 time: 0.233946 Jul 14 15:02:16.345667 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2849/5726] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:02:16 2022] DELETE /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:02:16.356004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-55379262-0b40-4704-8a91-0fa6de4d77fa tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:16.356843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-55379262-0b40-4704-8a91-0fa6de4d77fa tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:16.363964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:16.366133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55379262-0b40-4704-8a91-0fa6de4d77fa tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:16.367014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55379262-0b40-4704-8a91-0fa6de4d77fa tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:16.368414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55379262-0b40-4704-8a91-0fa6de4d77fa tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:16.369074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-55379262-0b40-4704-8a91-0fa6de4d77fa tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:16.780327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-55379262-0b40-4704-8a91-0fa6de4d77fa tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:16.786890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:16.789194 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-55379262-0b40-4704-8a91-0fa6de4d77fa tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1469 microversion: 2.1 time: 0.438627 Jul 14 15:02:16.804059 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2878/5727] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:16 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1469 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:16.806501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-64a47b14-a7d5-4a70-9b20-40bde48c537f tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] Calling method '.version_select at 0x7fd6c5da64c0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:16.891641 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-64a47b14-a7d5-4a70-9b20-40bde48c537f tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/a9f94c18-9f29-4401-b61d-79d4c8c6f569" status: 200 len: 351 microversion: 2.1 time: 0.090582 Jul 14 15:02:16.892489 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2850/5728] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:02:16 2022] GET /compute/v2.1/os-volumes/a9f94c18-9f29-4401-b61d-79d4c8c6f569 => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:17.084386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-871dae69-b8f9-46b0-a968-18b1ac2024c2 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:17.085035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-871dae69-b8f9-46b0-a968-18b1ac2024c2 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:17.100057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-871dae69-b8f9-46b0-a968-18b1ac2024c2 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:17.100525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-871dae69-b8f9-46b0-a968-18b1ac2024c2 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:17.101360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-871dae69-b8f9-46b0-a968-18b1ac2024c2 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:17.102029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-871dae69-b8f9-46b0-a968-18b1ac2024c2 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:17.233297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-871dae69-b8f9-46b0-a968-18b1ac2024c2 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:17.242194 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-871dae69-b8f9-46b0-a968-18b1ac2024c2 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1267 microversion: 2.1 time: 0.162095 Jul 14 15:02:17.242882 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2879/5729] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:17 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:17.818355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-13f73939-1077-40f1-9b9b-342a493eac23 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:17.819173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-13f73939-1077-40f1-9b9b-342a493eac23 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:17.831101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:17.851352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13f73939-1077-40f1-9b9b-342a493eac23 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:17.854724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13f73939-1077-40f1-9b9b-342a493eac23 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:17.856456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13f73939-1077-40f1-9b9b-342a493eac23 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:17.857311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13f73939-1077-40f1-9b9b-342a493eac23 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:18.259907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5374daa9-aad2-47b4-836d-897f4eff5ad9 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:18.261306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5374daa9-aad2-47b4-836d-897f4eff5ad9 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:18.282332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5374daa9-aad2-47b4-836d-897f4eff5ad9 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:18.283129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5374daa9-aad2-47b4-836d-897f4eff5ad9 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:18.283981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5374daa9-aad2-47b4-836d-897f4eff5ad9 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:18.284437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5374daa9-aad2-47b4-836d-897f4eff5ad9 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:18.462185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-13f73939-1077-40f1-9b9b-342a493eac23 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:18.479039 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-13f73939-1077-40f1-9b9b-342a493eac23 tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1469 microversion: 2.1 time: 0.666387 Jul 14 15:02:18.480581 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2851/5730] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:17 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1469 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:18.524291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5374daa9-aad2-47b4-836d-897f4eff5ad9 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:18.536796 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5374daa9-aad2-47b4-836d-897f4eff5ad9 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1273 microversion: 2.1 time: 0.279601 Jul 14 15:02:18.539399 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2880/5731] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:18 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1273 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:18.853891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1632955773", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "85a9665b-87cc-4b5a-a439-b3407daab9dd", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "bce1cdb9-0501-4062-a135-972a001804ef"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:18.999060 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] validate_networks() for [('bce1cdb9-0501-4062-a135-972a001804ef', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:02:19.501069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-93a4072e-f56f-463d-92fe-65a7ccc87dca tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:19.502371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-93a4072e-f56f-463d-92fe-65a7ccc87dca tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:19.541235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93a4072e-f56f-463d-92fe-65a7ccc87dca tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:19.542561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93a4072e-f56f-463d-92fe-65a7ccc87dca tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:19.543573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93a4072e-f56f-463d-92fe-65a7ccc87dca tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:19.544029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-93a4072e-f56f-463d-92fe-65a7ccc87dca tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:20.110547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-93a4072e-f56f-463d-92fe-65a7ccc87dca tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be790767b664b22a71802928190af4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7375ce093114f54a26704134418070e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:20.120150 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-93a4072e-f56f-463d-92fe-65a7ccc87dca tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 200 len: 1469 microversion: 2.1 time: 0.625410 Jul 14 15:02:20.120150 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2881/5732] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:19 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 1469 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:20.125389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc7e1b35-2c25-4eb4-bb58-04548b08010c tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:20.126133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc7e1b35-2c25-4eb4-bb58-04548b08010c tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:20.133439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc7e1b35-2c25-4eb4-bb58-04548b08010c tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:20.134023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc7e1b35-2c25-4eb4-bb58-04548b08010c tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:20.135060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc7e1b35-2c25-4eb4-bb58-04548b08010c tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:20.136586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc7e1b35-2c25-4eb4-bb58-04548b08010c tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:20.174571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:02:20.175801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:02:20.176575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:02:20.177029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:02:20.177451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:02:20.188084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:20.189392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:20.190226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:20.191656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:20.226751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:02:20.243811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for user e77523cc1cca458eb2a1b553aff072be and project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:02:20.280321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:02:20.282813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='85a9665b-87cc-4b5a-a439-b3407daab9dd',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:02:20.394481 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c6075f61-bf7b-4633-bc1b-c87a3d06ea02 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.546434 Jul 14 15:02:20.395875 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2852/5733] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:02:20.405759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bd394100-9211-4530-9ff4-da215464e037 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] Calling method '.version_select at 0x7fd6c4350550>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:20.497429 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bd394100-9211-4530-9ff4-da215464e037 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/9524908e-819a-4d4b-ac54-437dca802040" status: 200 len: 351 microversion: 2.1 time: 0.100157 Jul 14 15:02:20.498053 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2853/5734] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:02:20 2022] GET /compute/v2.1/os-volumes/9524908e-819a-4d4b-ac54-437dca802040 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:20.502811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d0092fa0-8090-4981-a2d4-60d857927924 req-5be9dcfe-fecc-412a-97ab-66d483ec8eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cff31d9-6ffc-4c36-a0fa-2b1fd850c507", "name": "network-vif-deleted", "tag": "070bf628-cece-415a-9a43-1a008501dbd0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:20.524202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d0092fa0-8090-4981-a2d4-60d857927924 req-5be9dcfe-fecc-412a-97ab-66d483ec8eff service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:20.524669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d0092fa0-8090-4981-a2d4-60d857927924 req-5be9dcfe-fecc-412a-97ab-66d483ec8eff service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:20.545173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc7e1b35-2c25-4eb4-bb58-04548b08010c tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:20.549546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:20.554889 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d0092fa0-8090-4981-a2d4-60d857927924 req-5be9dcfe-fecc-412a-97ab-66d483ec8eff service nova] Creating event network-vif-deleted:070bf628-cece-415a-9a43-1a008501dbd0 for instance 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 on n-h1-767704-28 Jul 14 15:02:20.556488 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc7e1b35-2c25-4eb4-bb58-04548b08010c tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1315 microversion: 2.1 time: 0.434999 Jul 14 15:02:20.561531 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2882/5735] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:20 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:20.576000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aa7cc6b6-482d-46d7-9e21-50d6218b1e2c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:20.576635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aa7cc6b6-482d-46d7-9e21-50d6218b1e2c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:20.579413 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d0092fa0-8090-4981-a2d4-60d857927924 req-5be9dcfe-fecc-412a-97ab-66d483ec8eff service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079893 Jul 14 15:02:20.580461 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2854/5736] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:20.739836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-aa7cc6b6-482d-46d7-9e21-50d6218b1e2c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:20.753637 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aa7cc6b6-482d-46d7-9e21-50d6218b1e2c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1057 microversion: 2.1 time: 0.189081 Jul 14 15:02:20.754250 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2883/5737] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:20 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1057 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:21.138859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f7f10307-76e3-4033-a97d-187d2cefe57e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:21.140081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f7f10307-76e3-4033-a97d-187d2cefe57e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] [instance: 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:21.163865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7f10307-76e3-4033-a97d-187d2cefe57e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:21.170585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7f10307-76e3-4033-a97d-187d2cefe57e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:21.171713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7f10307-76e3-4033-a97d-187d2cefe57e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:21.183197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f7f10307-76e3-4033-a97d-187d2cefe57e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:21.227508 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f7f10307-76e3-4033-a97d-187d2cefe57e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] HTTP exception thrown: Instance 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 could not be found. Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f7f10307-76e3-4033-a97d-187d2cefe57e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Request method failure captured: Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 HTTP/1.1 Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C9E8pXaMfmDn5MLwYX2S3uSsVzZqTVu8AWL0CnXAU61Cq8vQJMXsxS41QJsgvH76IBt7mZDGOpSq2GOT_cQiY7MstENqaobWnSNjUyaxK7SkQaAH2rFVxNdY4B5f5mIC0fDug4TlTu22gF5zBJxETzkw9tnPReesichPmu6p9NiUiQ Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d7375ce093114f54a26704134418070e Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesBackupsTest-2123309626 Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7375ce093114f54a26704134418070e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d7375ce093114f54a26704134418070e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d7375ce093114f54a26704134418070e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d7375ce093114f54a26704134418070e"}]}] Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesBackupsTest-2123309626 Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d7375ce093114f54a26704134418070e Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesBackupsTest-2123309626 Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesBackupsTest-2123309626-project Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 5be790767b664b22a71802928190af4b Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesBackupsTest-2123309626-project Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 could not be found. Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '9cff31d9-6ffc-4c36-a0fa-2b1fd850c507'} Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 could not be found. Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 could not be found. Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:21.236038 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:21.242321 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:21.242321 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:21.242321 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:21.242321 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:02:21.242321 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:02:21.242321 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 could not be found. Jul 14 15:02:21.242321 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:02:21.242321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f7f10307-76e3-4033-a97d-187d2cefe57e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] Returning 404 to user: Instance 9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:02:21.247980 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f7f10307-76e3-4033-a97d-187d2cefe57e tempest-VolumesBackupsTest-2123309626 tempest-VolumesBackupsTest-2123309626-project] 10.222.0.81 "GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507" status: 404 len: 111 microversion: 2.1 time: 0.109488 Jul 14 15:02:21.248694 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2855/5738] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:21 2022] GET /compute/v2.1/servers/9cff31d9-6ffc-4c36-a0fa-2b1fd850c507 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:21.576545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9ea6c44f-0038-4108-b955-ef6bbf330d31 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:21.577509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9ea6c44f-0038-4108-b955-ef6bbf330d31 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:21.778165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bfd99887-4500-4507-9136-817379b6aac9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:21.778976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bfd99887-4500-4507-9136-817379b6aac9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:21.791525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfd99887-4500-4507-9136-817379b6aac9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:21.801840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfd99887-4500-4507-9136-817379b6aac9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:21.804885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfd99887-4500-4507-9136-817379b6aac9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:21.808565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfd99887-4500-4507-9136-817379b6aac9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.025861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bfd99887-4500-4507-9136-817379b6aac9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:22.045833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ea6c44f-0038-4108-b955-ef6bbf330d31 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:22.046380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ea6c44f-0038-4108-b955-ef6bbf330d31 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.047226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ea6c44f-0038-4108-b955-ef6bbf330d31 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:22.047689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ea6c44f-0038-4108-b955-ef6bbf330d31 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.049691 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bfd99887-4500-4507-9136-817379b6aac9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1109 microversion: 2.1 time: 0.274989 Jul 14 15:02:22.052037 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2856/5739] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:21 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1109 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:22.521215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9ea6c44f-0038-4108-b955-ef6bbf330d31 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:22.554541 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9ea6c44f-0038-4108-b955-ef6bbf330d31 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1315 microversion: 2.1 time: 0.982661 Jul 14 15:02:22.569549 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2884/5740] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:21 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1315 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:22.613203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-41c7c4e1-9d65-4ec7-99df-b04661996e55 req-48df401e-3420-4203-b75d-ec595f1cf2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "464ff84b-b7bd-42ff-9d33-f638f8f54d35", "tag": "417c7b8d-0f3f-4c03-92cd-478f490184fd"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:22.633132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-41c7c4e1-9d65-4ec7-99df-b04661996e55 req-48df401e-3420-4203-b75d-ec595f1cf2aa service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:22.633591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-41c7c4e1-9d65-4ec7-99df-b04661996e55 req-48df401e-3420-4203-b75d-ec595f1cf2aa service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.664583 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-41c7c4e1-9d65-4ec7-99df-b04661996e55 req-48df401e-3420-4203-b75d-ec595f1cf2aa service nova] Creating event network-changed:417c7b8d-0f3f-4c03-92cd-478f490184fd for instance 464ff84b-b7bd-42ff-9d33-f638f8f54d35 on n-h2-767704-28 Jul 14 15:02:22.678291 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-41c7c4e1-9d65-4ec7-99df-b04661996e55 req-48df401e-3420-4203-b75d-ec595f1cf2aa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069299 Jul 14 15:02:22.679305 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2857/5741] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:23.073345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c9a0b20-06c1-49dc-8ed3-c60e9b8df5c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:23.074611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1c9a0b20-06c1-49dc-8ed3-c60e9b8df5c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:23.098381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c9a0b20-06c1-49dc-8ed3-c60e9b8df5c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:23.099121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c9a0b20-06c1-49dc-8ed3-c60e9b8df5c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:23.100139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c9a0b20-06c1-49dc-8ed3-c60e9b8df5c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:23.104681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c9a0b20-06c1-49dc-8ed3-c60e9b8df5c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:23.262903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1c9a0b20-06c1-49dc-8ed3-c60e9b8df5c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:23.274236 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1c9a0b20-06c1-49dc-8ed3-c60e9b8df5c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1127 microversion: 2.1 time: 0.208521 Jul 14 15:02:23.284164 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2885/5742] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:23 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1127 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:23.374022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f432a8ec-cd08-4f3f-9389-2a43487f0599 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] Calling method '.version_select at 0x7fd6c4688f70>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:23.427179 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f432a8ec-cd08-4f3f-9389-2a43487f0599 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/1c484bf8-0e6d-4843-b466-bdcf5d48a68a" status: 200 len: 351 microversion: 2.1 time: 0.058267 Jul 14 15:02:23.427755 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2858/5743] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:02:23 2022] GET /compute/v2.1/os-volumes/1c484bf8-0e6d-4843-b466-bdcf5d48a68a => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:23.453208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f3e528e6-a47f-43ae-b7c6-a700811195e1 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] Calling method '.version_select at 0x7fd6c4ba33a0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:23.583928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-722d6376-85ba-481e-b0e0-4e4b3a231f5e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:23.584789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-722d6376-85ba-481e-b0e0-4e4b3a231f5e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:23.617567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-722d6376-85ba-481e-b0e0-4e4b3a231f5e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:23.618267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-722d6376-85ba-481e-b0e0-4e4b3a231f5e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:23.618918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-722d6376-85ba-481e-b0e0-4e4b3a231f5e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:23.619376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-722d6376-85ba-481e-b0e0-4e4b3a231f5e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:23.638110 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f3e528e6-a47f-43ae-b7c6-a700811195e1 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.202465 Jul 14 15:02:23.638692 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2886/5744] 10.222.0.81 () {58 vars in 1133 bytes} [Thu Jul 14 15:02:23 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:23.650771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a50711a-bcff-47e2-89b7-7e8a7f9fd725 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] Calling method '.version_select at 0x7fd6c4b8a3a0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:23.916493 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a50711a-bcff-47e2-89b7-7e8a7f9fd725 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.269493 Jul 14 15:02:23.918438 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2887/5745] 10.222.0.81 () {58 vars in 1148 bytes} [Thu Jul 14 15:02:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:23.930709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-780a5559-1ddd-4fd6-8009-1c4e63388eb7 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] Calling method '.version_select at 0x7fd6c4be28b0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:24.090445 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-780a5559-1ddd-4fd6-8009-1c4e63388eb7 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.164164 Jul 14 15:02:24.091135 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2888/5746] 10.222.0.81 () {58 vars in 1133 bytes} [Thu Jul 14 15:02:23 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:24.102814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-20f97fce-9553-4082-b965-482dffebe61b tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] Calling method '.version_select at 0x7fd6c4b8a310>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:24.156794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-722d6376-85ba-481e-b0e0-4e4b3a231f5e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:24.176783 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-722d6376-85ba-481e-b0e0-4e4b3a231f5e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1315 microversion: 2.1 time: 0.596249 Jul 14 15:02:24.178473 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2859/5747] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:23 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:24.292425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b7daa0ae-9f2c-4605-8264-b36a701a11b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:24.293732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b7daa0ae-9f2c-4605-8264-b36a701a11b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:24.306472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7daa0ae-9f2c-4605-8264-b36a701a11b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:24.309646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7daa0ae-9f2c-4605-8264-b36a701a11b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:24.311434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7daa0ae-9f2c-4605-8264-b36a701a11b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:24.315332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7daa0ae-9f2c-4605-8264-b36a701a11b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:24.325101 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-20f97fce-9553-4082-b965-482dffebe61b tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.226068 Jul 14 15:02:24.325691 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2889/5748] 10.222.0.81 () {58 vars in 1166 bytes} [Thu Jul 14 15:02:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:02:24.341488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eba34167-d703-492c-aced-a5a0fc135009 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] Calling method '.version_select at 0x7fd6c4ba3310>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:24.557400 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eba34167-d703-492c-aced-a5a0fc135009 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.222329 Jul 14 15:02:24.559449 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2890/5749] 10.222.0.81 () {58 vars in 1169 bytes} [Thu Jul 14 15:02:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:02:24.571756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-de0cc375-43a1-470d-8706-5aa2c261e20e tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] Calling method '.version_select at 0x7fd6c4b8eca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:24.709667 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-de0cc375-43a1-470d-8706-5aa2c261e20e tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.140260 Jul 14 15:02:24.710440 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2891/5750] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 15:02:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:24.723962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b368b28f-8c9c-40cf-a83d-c099b72132cc tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] Calling method '.version_select at 0x7fd6c4ba3c10>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:24.829493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b7daa0ae-9f2c-4605-8264-b36a701a11b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:24.843633 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b7daa0ae-9f2c-4605-8264-b36a701a11b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.556294 Jul 14 15:02:24.854946 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2860/5751] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:24 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:24.950218 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b368b28f-8c9c-40cf-a83d-c099b72132cc tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.231970 Jul 14 15:02:24.951604 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2892/5752] 10.222.0.81 () {58 vars in 1187 bytes} [Thu Jul 14 15:02:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:24.964393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cdfaef19-c68d-4405-ae89-5a3cf32bff89 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] Calling method '.version_select at 0x7fd6c6143790>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:25.116881 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cdfaef19-c68d-4405-ae89-5a3cf32bff89 tempest-VolumesTestJSON-1564115378 tempest-VolumesTestJSON-1564115378-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.157448 Jul 14 15:02:25.117760 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2861/5753] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jul 14 15:02:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:25.196609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7d4ad97d-7fc3-4253-a84b-62f36c9d169f tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:25.199824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7d4ad97d-7fc3-4253-a84b-62f36c9d169f tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:25.210046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d4ad97d-7fc3-4253-a84b-62f36c9d169f tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:25.218071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d4ad97d-7fc3-4253-a84b-62f36c9d169f tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:25.219639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d4ad97d-7fc3-4253-a84b-62f36c9d169f tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:25.220263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d4ad97d-7fc3-4253-a84b-62f36c9d169f tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:25.556922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7d4ad97d-7fc3-4253-a84b-62f36c9d169f tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:25.581092 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7d4ad97d-7fc3-4253-a84b-62f36c9d169f tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1315 microversion: 2.1 time: 0.378525 Jul 14 15:02:25.582040 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2893/5754] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:25 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:25.861927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d7a1c7ed-07de-47dd-9d41-470486063646 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:25.862946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d7a1c7ed-07de-47dd-9d41-470486063646 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:25.887313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7a1c7ed-07de-47dd-9d41-470486063646 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:25.911492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7a1c7ed-07de-47dd-9d41-470486063646 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:25.919677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7a1c7ed-07de-47dd-9d41-470486063646 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:25.920501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7a1c7ed-07de-47dd-9d41-470486063646 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:26.154974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-bd426ad6-15e9-4e5c-a1e6-352b6e9cdf02 req-e879ba01-715c-45be-a9e3-70701022eff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cb1cdb-5789-4e4e-a1f8-34716de096a4", "tag": "3b232abe-a54f-441e-a1a6-2e06d2bbdcb6"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:26.194874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bd426ad6-15e9-4e5c-a1e6-352b6e9cdf02 req-e879ba01-715c-45be-a9e3-70701022eff8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:26.198810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bd426ad6-15e9-4e5c-a1e6-352b6e9cdf02 req-e879ba01-715c-45be-a9e3-70701022eff8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:26.233595 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-bd426ad6-15e9-4e5c-a1e6-352b6e9cdf02 req-e879ba01-715c-45be-a9e3-70701022eff8 service nova] Creating event network-changed:3b232abe-a54f-441e-a1a6-2e06d2bbdcb6 for instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 on n-h1-767704-28 Jul 14 15:02:26.249512 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-bd426ad6-15e9-4e5c-a1e6-352b6e9cdf02 req-e879ba01-715c-45be-a9e3-70701022eff8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100109 Jul 14 15:02:26.256107 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2894/5755] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:26.431286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d7a1c7ed-07de-47dd-9d41-470486063646 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:26.441202 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d7a1c7ed-07de-47dd-9d41-470486063646 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.584000 Jul 14 15:02:26.453867 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2862/5756] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:25 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:26.601580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-67304cff-04b7-4eaf-9a0b-1ec172c56c44 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:26.602823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-67304cff-04b7-4eaf-9a0b-1ec172c56c44 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:26.618086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67304cff-04b7-4eaf-9a0b-1ec172c56c44 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:26.620833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67304cff-04b7-4eaf-9a0b-1ec172c56c44 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:26.623638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67304cff-04b7-4eaf-9a0b-1ec172c56c44 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:26.625764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67304cff-04b7-4eaf-9a0b-1ec172c56c44 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:27.012766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-67304cff-04b7-4eaf-9a0b-1ec172c56c44 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:27.036756 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-67304cff-04b7-4eaf-9a0b-1ec172c56c44 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1315 microversion: 2.1 time: 0.441222 Jul 14 15:02:27.049465 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2895/5757] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:26 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:27.466047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-017d2bee-8bb0-4648-8cbb-b333cdcf6031 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:27.468236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-017d2bee-8bb0-4648-8cbb-b333cdcf6031 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:27.502589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-017d2bee-8bb0-4648-8cbb-b333cdcf6031 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:27.503353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-017d2bee-8bb0-4648-8cbb-b333cdcf6031 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:27.504334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-017d2bee-8bb0-4648-8cbb-b333cdcf6031 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:27.508253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-017d2bee-8bb0-4648-8cbb-b333cdcf6031 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:27.795160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-017d2bee-8bb0-4648-8cbb-b333cdcf6031 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:27.807044 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-017d2bee-8bb0-4648-8cbb-b333cdcf6031 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.350384 Jul 14 15:02:27.811879 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2863/5758] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:27 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:28.055905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-03b4390a-d484-43a4-a168-d50cfd570c4e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:28.056674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-03b4390a-d484-43a4-a168-d50cfd570c4e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:28.077317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03b4390a-d484-43a4-a168-d50cfd570c4e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:28.077932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03b4390a-d484-43a4-a168-d50cfd570c4e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:28.078821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03b4390a-d484-43a4-a168-d50cfd570c4e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:28.079385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03b4390a-d484-43a4-a168-d50cfd570c4e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:28.098623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f7ee3d4e-c506-4177-bde5-3111448183b9 req-84c06b2d-038f-4233-b445-bc59dfb1b36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464ff84b-b7bd-42ff-9d33-f638f8f54d35", "name": "network-vif-plugged", "status": "completed", "tag": "417c7b8d-0f3f-4c03-92cd-478f490184fd"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:28.115747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f7ee3d4e-c506-4177-bde5-3111448183b9 req-84c06b2d-038f-4233-b445-bc59dfb1b36e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:28.116461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f7ee3d4e-c506-4177-bde5-3111448183b9 req-84c06b2d-038f-4233-b445-bc59dfb1b36e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:28.145524 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f7ee3d4e-c506-4177-bde5-3111448183b9 req-84c06b2d-038f-4233-b445-bc59dfb1b36e service nova] Creating event network-vif-plugged:417c7b8d-0f3f-4c03-92cd-478f490184fd for instance 464ff84b-b7bd-42ff-9d33-f638f8f54d35 on n-h2-767704-28 Jul 14 15:02:28.162142 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f7ee3d4e-c506-4177-bde5-3111448183b9 req-84c06b2d-038f-4233-b445-bc59dfb1b36e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064429 Jul 14 15:02:28.163818 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2864/5759] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:02:28.714595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-03b4390a-d484-43a4-a168-d50cfd570c4e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:28.728183 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-03b4390a-d484-43a4-a168-d50cfd570c4e tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1315 microversion: 2.1 time: 0.676117 Jul 14 15:02:28.739970 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2896/5760] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:28 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:28.829695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3490b7d2-1ea3-4e75-bcf3-eae6f8114855 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:28.830666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3490b7d2-1ea3-4e75-bcf3-eae6f8114855 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:28.846715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3490b7d2-1ea3-4e75-bcf3-eae6f8114855 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:28.847624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3490b7d2-1ea3-4e75-bcf3-eae6f8114855 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:28.848910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3490b7d2-1ea3-4e75-bcf3-eae6f8114855 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:28.852686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3490b7d2-1ea3-4e75-bcf3-eae6f8114855 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:29.138456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3490b7d2-1ea3-4e75-bcf3-eae6f8114855 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:29.172048 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3490b7d2-1ea3-4e75-bcf3-eae6f8114855 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.347512 Jul 14 15:02:29.172794 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2865/5761] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:28 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:29.762637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1928f083-67dc-4762-ba1f-bbce1a5ea7c8 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:29.765265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1928f083-67dc-4762-ba1f-bbce1a5ea7c8 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:29.777022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1928f083-67dc-4762-ba1f-bbce1a5ea7c8 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:29.778536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1928f083-67dc-4762-ba1f-bbce1a5ea7c8 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:29.780085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1928f083-67dc-4762-ba1f-bbce1a5ea7c8 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:29.780721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1928f083-67dc-4762-ba1f-bbce1a5ea7c8 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:30.192680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1928f083-67dc-4762-ba1f-bbce1a5ea7c8 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:30.196540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a657ce35-3bb5-423c-b5fd-3d171a689c54 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:30.198427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a657ce35-3bb5-423c-b5fd-3d171a689c54 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:30.214468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a657ce35-3bb5-423c-b5fd-3d171a689c54 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:30.216490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a657ce35-3bb5-423c-b5fd-3d171a689c54 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:30.217795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a657ce35-3bb5-423c-b5fd-3d171a689c54 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:30.221655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a657ce35-3bb5-423c-b5fd-3d171a689c54 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:30.223419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:30.234418 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1928f083-67dc-4762-ba1f-bbce1a5ea7c8 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1315 microversion: 2.1 time: 0.472647 Jul 14 15:02:30.244817 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2897/5762] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:29 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:30.285659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:30.661067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a657ce35-3bb5-423c-b5fd-3d171a689c54 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:30.715446 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a657ce35-3bb5-423c-b5fd-3d171a689c54 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.526915 Jul 14 15:02:30.741312 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2866/5763] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:30 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:31.257870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-58936db4-572e-4bf0-872e-26df20b5bd45 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:31.259451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-58936db4-572e-4bf0-872e-26df20b5bd45 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:31.266750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:31.272625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58936db4-572e-4bf0-872e-26df20b5bd45 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:31.275620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58936db4-572e-4bf0-872e-26df20b5bd45 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:31.277494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58936db4-572e-4bf0-872e-26df20b5bd45 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:31.278580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58936db4-572e-4bf0-872e-26df20b5bd45 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:31.456637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-58936db4-572e-4bf0-872e-26df20b5bd45 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:31.472759 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-58936db4-572e-4bf0-872e-26df20b5bd45 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1464 microversion: 2.1 time: 0.219363 Jul 14 15:02:31.488641 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2898/5764] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:31 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1464 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:31.550289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c0529c9d-5565-4588-aef4-303d6b3605fc tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:31.550289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c0529c9d-5565-4588-aef4-303d6b3605fc tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:31.558569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0529c9d-5565-4588-aef4-303d6b3605fc tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:31.559471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0529c9d-5565-4588-aef4-303d6b3605fc tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:31.560752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0529c9d-5565-4588-aef4-303d6b3605fc tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:31.561310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0529c9d-5565-4588-aef4-303d6b3605fc tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:31.593254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c0529c9d-5565-4588-aef4-303d6b3605fc tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:02:31.748566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-756ceb0f-c633-4c25-9c23-5283f3b241c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:31.749161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-756ceb0f-c633-4c25-9c23-5283f3b241c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:31.773906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-756ceb0f-c633-4c25-9c23-5283f3b241c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:31.773906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-756ceb0f-c633-4c25-9c23-5283f3b241c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:31.777792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-756ceb0f-c633-4c25-9c23-5283f3b241c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:31.781149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-756ceb0f-c633-4c25-9c23-5283f3b241c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:31.813242 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c0529c9d-5565-4588-aef4-303d6b3605fc tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "DELETE /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 204 len: 0 microversion: 2.1 time: 0.265226 Jul 14 15:02:31.813983 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2867/5765] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:02:31 2022] DELETE /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:02:31.824189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-71f2c475-a9f2-43cd-b1b1-cf4f2273a436 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:31.826901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-71f2c475-a9f2-43cd-b1b1-cf4f2273a436 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:31.832464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71f2c475-a9f2-43cd-b1b1-cf4f2273a436 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:31.833105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71f2c475-a9f2-43cd-b1b1-cf4f2273a436 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:31.834135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71f2c475-a9f2-43cd-b1b1-cf4f2273a436 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:31.834695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71f2c475-a9f2-43cd-b1b1-cf4f2273a436 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:32.097061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-756ceb0f-c633-4c25-9c23-5283f3b241c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:32.124789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-756ceb0f-c633-4c25-9c23-5283f3b241c8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.382781 Jul 14 15:02:32.135239 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2899/5766] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:31 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:32.182924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-71f2c475-a9f2-43cd-b1b1-cf4f2273a436 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:32.208067 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-71f2c475-a9f2-43cd-b1b1-cf4f2273a436 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1470 microversion: 2.1 time: 0.388861 Jul 14 15:02:32.214256 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2868/5767] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:31 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:33.145167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-db9f3642-488b-466f-b02e-7debd0bbd781 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:33.146277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-db9f3642-488b-466f-b02e-7debd0bbd781 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:33.161962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db9f3642-488b-466f-b02e-7debd0bbd781 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:33.162728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db9f3642-488b-466f-b02e-7debd0bbd781 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:33.165853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db9f3642-488b-466f-b02e-7debd0bbd781 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:33.169483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db9f3642-488b-466f-b02e-7debd0bbd781 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:33.240012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-219b0c07-9fa9-4e2a-b8df-d9559113bc7a tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:33.241303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-219b0c07-9fa9-4e2a-b8df-d9559113bc7a tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:33.255721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-219b0c07-9fa9-4e2a-b8df-d9559113bc7a tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:33.257426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-219b0c07-9fa9-4e2a-b8df-d9559113bc7a tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:33.262037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-219b0c07-9fa9-4e2a-b8df-d9559113bc7a tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:33.262917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-219b0c07-9fa9-4e2a-b8df-d9559113bc7a tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:33.799226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-db9f3642-488b-466f-b02e-7debd0bbd781 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:33.824486 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-db9f3642-488b-466f-b02e-7debd0bbd781 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.671422 Jul 14 15:02:33.825581 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2900/5768] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:33 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:34.010756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-219b0c07-9fa9-4e2a-b8df-d9559113bc7a tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:34.024131 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-219b0c07-9fa9-4e2a-b8df-d9559113bc7a tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1470 microversion: 2.1 time: 0.788276 Jul 14 15:02:34.025360 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2869/5769] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:33 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1470 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:34.846423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5e2317fa-9b94-443c-8762-adf53f9b8a6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:34.851826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5e2317fa-9b94-443c-8762-adf53f9b8a6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:34.867579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e2317fa-9b94-443c-8762-adf53f9b8a6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:34.868653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e2317fa-9b94-443c-8762-adf53f9b8a6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:34.870282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e2317fa-9b94-443c-8762-adf53f9b8a6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:34.871866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e2317fa-9b94-443c-8762-adf53f9b8a6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:35.046947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98182346-d12e-454a-9c52-b1fec3a34173 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:35.048533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-98182346-d12e-454a-9c52-b1fec3a34173 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:35.065561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98182346-d12e-454a-9c52-b1fec3a34173 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:35.066015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98182346-d12e-454a-9c52-b1fec3a34173 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:35.071971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98182346-d12e-454a-9c52-b1fec3a34173 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:35.074356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98182346-d12e-454a-9c52-b1fec3a34173 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:35.337832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-98182346-d12e-454a-9c52-b1fec3a34173 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4cb9ff00b5e4225b102f5ed7d1f2ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976feab134504549bc7b2661deff019d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:35.358883 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98182346-d12e-454a-9c52-b1fec3a34173 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 200 len: 1428 microversion: 2.1 time: 0.317100 Jul 14 15:02:35.371642 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2870/5770] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:35 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 1428 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:35.635171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e87335c9-8998-4ce1-a05a-f804cf8b7f78 req-28aec081-a9b6-4ea6-b9ef-9d3e186c49ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464ff84b-b7bd-42ff-9d33-f638f8f54d35", "name": "network-vif-deleted", "tag": "417c7b8d-0f3f-4c03-92cd-478f490184fd"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:35.677487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e87335c9-8998-4ce1-a05a-f804cf8b7f78 req-28aec081-a9b6-4ea6-b9ef-9d3e186c49ba service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:35.680351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5e2317fa-9b94-443c-8762-adf53f9b8a6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:35.682144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e87335c9-8998-4ce1-a05a-f804cf8b7f78 req-28aec081-a9b6-4ea6-b9ef-9d3e186c49ba service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:35.692575 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5e2317fa-9b94-443c-8762-adf53f9b8a6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.849941 Jul 14 15:02:35.706695 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2901/5771] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:34 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:35.745287 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e87335c9-8998-4ce1-a05a-f804cf8b7f78 req-28aec081-a9b6-4ea6-b9ef-9d3e186c49ba service nova] Creating event network-vif-deleted:417c7b8d-0f3f-4c03-92cd-478f490184fd for instance 464ff84b-b7bd-42ff-9d33-f638f8f54d35 on n-h2-767704-28 Jul 14 15:02:35.754568 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e87335c9-8998-4ce1-a05a-f804cf8b7f78 req-28aec081-a9b6-4ea6-b9ef-9d3e186c49ba service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125868 Jul 14 15:02:35.758841 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2871/5772] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:02:36.385632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1f9aeb0-31db-443a-82b4-3378d3f4cea1 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:36.397664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f1f9aeb0-31db-443a-82b4-3378d3f4cea1 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] [instance: 464ff84b-b7bd-42ff-9d33-f638f8f54d35] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:36.413792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1f9aeb0-31db-443a-82b4-3378d3f4cea1 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:36.415932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1f9aeb0-31db-443a-82b4-3378d3f4cea1 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:36.417962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1f9aeb0-31db-443a-82b4-3378d3f4cea1 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:36.418809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1f9aeb0-31db-443a-82b4-3378d3f4cea1 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:36.443974 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-f1f9aeb0-31db-443a-82b4-3378d3f4cea1 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] HTTP exception thrown: Instance 464ff84b-b7bd-42ff-9d33-f638f8f54d35 could not be found. Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1f9aeb0-31db-443a-82b4-3378d3f4cea1 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Request method failure captured: Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 HTTP/1.1 Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C_yAsnhIAjsHa_bJr7kfbmV4GC9odeix_t0tXJ8FgbonzVvq3eiZZmapbT3hWijNHz8Hgq9VAP8nSRJQCC_l3MT0C1C5tC4xvX-pQpNMn0mxNmZ5WqA2V8URFcLnCan1Jp_gMfOkdu_J04ecISg6CVu5KNp6U6V67uw3WlK4kwAXpY Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 976feab134504549bc7b2661deff019d Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-VolumesNegativeTest-1303293870 Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/976feab134504549bc7b2661deff019d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/976feab134504549bc7b2661deff019d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_976feab134504549bc7b2661deff019d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/976feab134504549bc7b2661deff019d"}]}] Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-VolumesNegativeTest-1303293870 Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 976feab134504549bc7b2661deff019d Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-VolumesNegativeTest-1303293870 Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-VolumesNegativeTest-1303293870-project Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: c4cb9ff00b5e4225b102f5ed7d1f2ea3 Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-VolumesNegativeTest-1303293870-project Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 464ff84b-b7bd-42ff-9d33-f638f8f54d35 could not be found. Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '464ff84b-b7bd-42ff-9d33-f638f8f54d35'} Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 464ff84b-b7bd-42ff-9d33-f638f8f54d35 could not be found. Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 464ff84b-b7bd-42ff-9d33-f638f8f54d35 could not be found. Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:36.445623 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:02:36.451528 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:36.451528 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:36.451528 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:36.451528 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:02:36.451528 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:02:36.451528 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 464ff84b-b7bd-42ff-9d33-f638f8f54d35 could not be found. Jul 14 15:02:36.451528 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:02:36.451528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1f9aeb0-31db-443a-82b4-3378d3f4cea1 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] Returning 404 to user: Instance 464ff84b-b7bd-42ff-9d33-f638f8f54d35 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:02:36.451528 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f1f9aeb0-31db-443a-82b4-3378d3f4cea1 tempest-VolumesNegativeTest-1303293870 tempest-VolumesNegativeTest-1303293870-project] 10.222.0.81 "GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35" status: 404 len: 111 microversion: 2.1 time: 0.073285 Jul 14 15:02:36.451528 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2902/5773] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:36 2022] GET /compute/v2.1/servers/464ff84b-b7bd-42ff-9d33-f638f8f54d35 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:36.724268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-281bae22-ef78-4625-840e-b3600ba09cb3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:36.725156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-281bae22-ef78-4625-840e-b3600ba09cb3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:36.733459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-281bae22-ef78-4625-840e-b3600ba09cb3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:36.734476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-281bae22-ef78-4625-840e-b3600ba09cb3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:36.735960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-281bae22-ef78-4625-840e-b3600ba09cb3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:36.736625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-281bae22-ef78-4625-840e-b3600ba09cb3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:36.975230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-281bae22-ef78-4625-840e-b3600ba09cb3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:36.991952 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-281bae22-ef78-4625-840e-b3600ba09cb3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.273422 Jul 14 15:02:36.993701 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2872/5774] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:36 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:38.010432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-315d8d4a-088a-4a8d-8e85-5fd17681e97f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:38.011032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-315d8d4a-088a-4a8d-8e85-5fd17681e97f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:38.020417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-315d8d4a-088a-4a8d-8e85-5fd17681e97f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:38.021304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-315d8d4a-088a-4a8d-8e85-5fd17681e97f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:38.022595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-315d8d4a-088a-4a8d-8e85-5fd17681e97f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:38.023269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-315d8d4a-088a-4a8d-8e85-5fd17681e97f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:38.193772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-315d8d4a-088a-4a8d-8e85-5fd17681e97f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:38.206719 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-315d8d4a-088a-4a8d-8e85-5fd17681e97f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.200141 Jul 14 15:02:38.219384 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2903/5775] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:38 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:39.227231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4d1573c3-f1db-469d-9bf6-7ec806eb74db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:39.230628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4d1573c3-f1db-469d-9bf6-7ec806eb74db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:39.238582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d1573c3-f1db-469d-9bf6-7ec806eb74db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:39.239316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d1573c3-f1db-469d-9bf6-7ec806eb74db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:39.242232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d1573c3-f1db-469d-9bf6-7ec806eb74db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:39.245624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d1573c3-f1db-469d-9bf6-7ec806eb74db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:39.471746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4d1573c3-f1db-469d-9bf6-7ec806eb74db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:39.487358 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4d1573c3-f1db-469d-9bf6-7ec806eb74db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.265270 Jul 14 15:02:39.488600 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2873/5776] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:39 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:40.504317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-45a97bbb-692a-46a7-8720-b8aab14132cc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:40.505377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-45a97bbb-692a-46a7-8720-b8aab14132cc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:40.519241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-45a97bbb-692a-46a7-8720-b8aab14132cc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:40.519374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-45a97bbb-692a-46a7-8720-b8aab14132cc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:40.520083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-45a97bbb-692a-46a7-8720-b8aab14132cc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:40.520559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-45a97bbb-692a-46a7-8720-b8aab14132cc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:40.727935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-45a97bbb-692a-46a7-8720-b8aab14132cc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:40.732467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:40.740172 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-45a97bbb-692a-46a7-8720-b8aab14132cc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.239665 Jul 14 15:02:40.740974 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2904/5777] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:40 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:41.863327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8a818868-1893-4707-9937-cb924a3876e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:41.864261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8a818868-1893-4707-9937-cb924a3876e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:41.874047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a818868-1893-4707-9937-cb924a3876e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:41.874755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a818868-1893-4707-9937-cb924a3876e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:41.875970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a818868-1893-4707-9937-cb924a3876e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:41.877212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a818868-1893-4707-9937-cb924a3876e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:41.900352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:42.101380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8a818868-1893-4707-9937-cb924a3876e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:42.111028 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8a818868-1893-4707-9937-cb924a3876e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.255271 Jul 14 15:02:42.122160 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2874/5778] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:41 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:43.130487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-278ab9b4-a76d-45c4-a004-04335a68d063 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:43.131767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-278ab9b4-a76d-45c4-a004-04335a68d063 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:43.148515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-278ab9b4-a76d-45c4-a004-04335a68d063 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:43.148801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-278ab9b4-a76d-45c4-a004-04335a68d063 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:43.150365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-278ab9b4-a76d-45c4-a004-04335a68d063 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:43.150721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-278ab9b4-a76d-45c4-a004-04335a68d063 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:43.442685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-278ab9b4-a76d-45c4-a004-04335a68d063 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:43.454239 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-278ab9b4-a76d-45c4-a004-04335a68d063 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.329333 Jul 14 15:02:43.455674 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2905/5779] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:43 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:44.476363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d37821e5-da60-4e3f-976e-13aaf2743a27 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:44.478967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d37821e5-da60-4e3f-976e-13aaf2743a27 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:44.489370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d37821e5-da60-4e3f-976e-13aaf2743a27 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:44.490328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d37821e5-da60-4e3f-976e-13aaf2743a27 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:44.491530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d37821e5-da60-4e3f-976e-13aaf2743a27 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:44.492247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d37821e5-da60-4e3f-976e-13aaf2743a27 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:44.495725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aa85528d-b0c7-4a25-9a57-2682f65d555d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:44.496999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aa85528d-b0c7-4a25-9a57-2682f65d555d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:44.511047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa85528d-b0c7-4a25-9a57-2682f65d555d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:44.511809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa85528d-b0c7-4a25-9a57-2682f65d555d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:44.513446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa85528d-b0c7-4a25-9a57-2682f65d555d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:44.514021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa85528d-b0c7-4a25-9a57-2682f65d555d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:44.546725 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aa85528d-b0c7-4a25-9a57-2682f65d555d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/ips" status: 200 len: 146 microversion: 2.1 time: 0.056002 Jul 14 15:02:44.548566 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2906/5780] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 15:02:44 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/ips => generated 146 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:02:44.841560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d37821e5-da60-4e3f-976e-13aaf2743a27 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:44.855093 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d37821e5-da60-4e3f-976e-13aaf2743a27 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1169 microversion: 2.1 time: 0.385069 Jul 14 15:02:44.871379 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2875/5781] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:44 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1169 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:45.874246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4db119a6-d5c3-439f-8fef-4c12f5008ae9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:45.875148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4db119a6-d5c3-439f-8fef-4c12f5008ae9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:45.883512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4db119a6-d5c3-439f-8fef-4c12f5008ae9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:45.883983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4db119a6-d5c3-439f-8fef-4c12f5008ae9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:45.884972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4db119a6-d5c3-439f-8fef-4c12f5008ae9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:45.886882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4db119a6-d5c3-439f-8fef-4c12f5008ae9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:46.125129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4db119a6-d5c3-439f-8fef-4c12f5008ae9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:46.134953 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4db119a6-d5c3-439f-8fef-4c12f5008ae9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1215 microversion: 2.1 time: 0.265558 Jul 14 15:02:46.135844 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2907/5782] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:45 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:46.618738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a6397bdf-30fb-49d2-8590-1e214e3ea2d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59b7e01c-5483-4135-853a-d13045b1ce15"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:46.621259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a6397bdf-30fb-49d2-8590-1e214e3ea2d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:46.630767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6397bdf-30fb-49d2-8590-1e214e3ea2d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:46.631650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6397bdf-30fb-49d2-8590-1e214e3ea2d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:46.632768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6397bdf-30fb-49d2-8590-1e214e3ea2d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:46.633299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6397bdf-30fb-49d2-8590-1e214e3ea2d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:46.975452 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a6397bdf-30fb-49d2-8590-1e214e3ea2d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "POST /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360911 Jul 14 15:02:46.976021 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2876/5783] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 15:02:46 2022] POST /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:47.155661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c88991eb-6327-4d35-b430-6e61c3242198 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:47.156566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c88991eb-6327-4d35-b430-6e61c3242198 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:47.162401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=48 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:47.178960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c88991eb-6327-4d35-b430-6e61c3242198 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:47.179758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c88991eb-6327-4d35-b430-6e61c3242198 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:47.181090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c88991eb-6327-4d35-b430-6e61c3242198 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:47.181854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c88991eb-6327-4d35-b430-6e61c3242198 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:47.403461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c88991eb-6327-4d35-b430-6e61c3242198 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:47.413765 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c88991eb-6327-4d35-b430-6e61c3242198 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1203 microversion: 2.1 time: 0.265067 Jul 14 15:02:47.424837 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2908/5784] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:47 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1203 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:48.438301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cc3d7419-06df-4067-b3ac-21a2dd95846b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:48.440390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cc3d7419-06df-4067-b3ac-21a2dd95846b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:48.460673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:48.470223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc3d7419-06df-4067-b3ac-21a2dd95846b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:48.474465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc3d7419-06df-4067-b3ac-21a2dd95846b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:48.476133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc3d7419-06df-4067-b3ac-21a2dd95846b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:48.477186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc3d7419-06df-4067-b3ac-21a2dd95846b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:48.712673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cc3d7419-06df-4067-b3ac-21a2dd95846b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:48.725198 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cc3d7419-06df-4067-b3ac-21a2dd95846b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1203 microversion: 2.1 time: 0.295238 Jul 14 15:02:48.725790 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2877/5785] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:48 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1203 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:49.742359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-657100cf-b3a1-4f70-b660-1c2fc7a34a3c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:49.743677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-657100cf-b3a1-4f70-b660-1c2fc7a34a3c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:49.769380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-657100cf-b3a1-4f70-b660-1c2fc7a34a3c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:49.770595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-657100cf-b3a1-4f70-b660-1c2fc7a34a3c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:49.780598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-657100cf-b3a1-4f70-b660-1c2fc7a34a3c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:49.781652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-657100cf-b3a1-4f70-b660-1c2fc7a34a3c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:50.064932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-657100cf-b3a1-4f70-b660-1c2fc7a34a3c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:50.087639 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-657100cf-b3a1-4f70-b660-1c2fc7a34a3c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1203 microversion: 2.1 time: 0.348235 Jul 14 15:02:50.098226 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2909/5786] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:49 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1203 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:51.106754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1231958e-6ff0-4f53-8b50-8f46764cc01d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:51.108435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1231958e-6ff0-4f53-8b50-8f46764cc01d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:51.142781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1231958e-6ff0-4f53-8b50-8f46764cc01d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:51.145185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1231958e-6ff0-4f53-8b50-8f46764cc01d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:51.148314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1231958e-6ff0-4f53-8b50-8f46764cc01d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:51.149679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1231958e-6ff0-4f53-8b50-8f46764cc01d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:51.462658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1231958e-6ff0-4f53-8b50-8f46764cc01d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:51.488451 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1231958e-6ff0-4f53-8b50-8f46764cc01d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1203 microversion: 2.1 time: 0.386043 Jul 14 15:02:51.489676 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2878/5787] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:51 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1203 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:52.506438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-59c56731-e155-4678-ad1b-80bf49c0ef6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:52.507864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-59c56731-e155-4678-ad1b-80bf49c0ef6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:52.520176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59c56731-e155-4678-ad1b-80bf49c0ef6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:52.522855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59c56731-e155-4678-ad1b-80bf49c0ef6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:52.525217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59c56731-e155-4678-ad1b-80bf49c0ef6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:52.525870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59c56731-e155-4678-ad1b-80bf49c0ef6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:52.824267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-59c56731-e155-4678-ad1b-80bf49c0ef6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:52.843699 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-59c56731-e155-4678-ad1b-80bf49c0ef6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1203 microversion: 2.1 time: 0.341605 Jul 14 15:02:52.844770 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2910/5788] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:52 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1203 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:53.866214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e92fdb42-314f-405e-896a-b0b1a3fd2b28 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:53.867797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e92fdb42-314f-405e-896a-b0b1a3fd2b28 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:53.888405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e92fdb42-314f-405e-896a-b0b1a3fd2b28 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:53.891647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e92fdb42-314f-405e-896a-b0b1a3fd2b28 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:53.892813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e92fdb42-314f-405e-896a-b0b1a3fd2b28 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:53.893757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e92fdb42-314f-405e-896a-b0b1a3fd2b28 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:54.318761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e92fdb42-314f-405e-896a-b0b1a3fd2b28 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:54.329647 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e92fdb42-314f-405e-896a-b0b1a3fd2b28 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1203 microversion: 2.1 time: 0.469901 Jul 14 15:02:54.330238 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2879/5789] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:53 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1203 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:55.069471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-64490105-d775-4f1c-996e-0e58a24b4528 req-ea22d0e8-13c8-4dba-b735-fef6f8c1cbad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cb1cdb-5789-4e4e-a1f8-34716de096a4", "name": "network-vif-plugged", "status": "completed", "tag": "3b232abe-a54f-441e-a1a6-2e06d2bbdcb6"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:55.116339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-64490105-d775-4f1c-996e-0e58a24b4528 req-ea22d0e8-13c8-4dba-b735-fef6f8c1cbad service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:55.121429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-64490105-d775-4f1c-996e-0e58a24b4528 req-ea22d0e8-13c8-4dba-b735-fef6f8c1cbad service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:55.174295 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-64490105-d775-4f1c-996e-0e58a24b4528 req-ea22d0e8-13c8-4dba-b735-fef6f8c1cbad service nova] Creating event network-vif-plugged:3b232abe-a54f-441e-a1a6-2e06d2bbdcb6 for instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 on n-h1-767704-28 Jul 14 15:02:55.209656 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-64490105-d775-4f1c-996e-0e58a24b4528 req-ea22d0e8-13c8-4dba-b735-fef6f8c1cbad service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144318 Jul 14 15:02:55.211593 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2911/5790] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:55.351510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-166d151c-15cb-4c45-a06f-eb884508983a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:55.361258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-166d151c-15cb-4c45-a06f-eb884508983a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:55.404812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-166d151c-15cb-4c45-a06f-eb884508983a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:55.406885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-166d151c-15cb-4c45-a06f-eb884508983a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:55.407566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-166d151c-15cb-4c45-a06f-eb884508983a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:55.410314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-166d151c-15cb-4c45-a06f-eb884508983a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:55.700700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-166d151c-15cb-4c45-a06f-eb884508983a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:55.711872 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-166d151c-15cb-4c45-a06f-eb884508983a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1203 microversion: 2.1 time: 0.368082 Jul 14 15:02:55.717034 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2880/5791] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:55 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1203 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:55.952985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d9222fc6-fd6a-4cf1-ab03-8473bc3e6af5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e61a5bf1-22ec-4613-856c-203d2c28a051", "device": "/dev/sdb"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:55.957405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d9222fc6-fd6a-4cf1-ab03-8473bc3e6af5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:55.968017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9222fc6-fd6a-4cf1-ab03-8473bc3e6af5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:55.968634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9222fc6-fd6a-4cf1-ab03-8473bc3e6af5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:55.972003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9222fc6-fd6a-4cf1-ab03-8473bc3e6af5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:55.972833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9222fc6-fd6a-4cf1-ab03-8473bc3e6af5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:56.718726 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d9222fc6-fd6a-4cf1-ab03-8473bc3e6af5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "POST /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.774568 Jul 14 15:02:56.722591 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2912/5792] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 15:02:55 2022] POST /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:56.732713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-452bdc6b-74d0-4ceb-9bd2-d4b14071ad55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:56.733984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-452bdc6b-74d0-4ceb-9bd2-d4b14071ad55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:56.749232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-452bdc6b-74d0-4ceb-9bd2-d4b14071ad55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:56.749773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-452bdc6b-74d0-4ceb-9bd2-d4b14071ad55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:56.750632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-452bdc6b-74d0-4ceb-9bd2-d4b14071ad55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:56.751969 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-452bdc6b-74d0-4ceb-9bd2-d4b14071ad55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:57.083780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-452bdc6b-74d0-4ceb-9bd2-d4b14071ad55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:57.098557 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-452bdc6b-74d0-4ceb-9bd2-d4b14071ad55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1203 microversion: 2.1 time: 0.370164 Jul 14 15:02:57.108523 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2881/5793] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:56 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1203 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:58.122262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-56053d5e-5ede-4835-8faa-b8c8bc728a0c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:58.128700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-56053d5e-5ede-4835-8faa-b8c8bc728a0c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:58.163884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56053d5e-5ede-4835-8faa-b8c8bc728a0c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:58.165742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56053d5e-5ede-4835-8faa-b8c8bc728a0c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:58.167847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56053d5e-5ede-4835-8faa-b8c8bc728a0c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:58.173411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56053d5e-5ede-4835-8faa-b8c8bc728a0c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:58.593492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-56053d5e-5ede-4835-8faa-b8c8bc728a0c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:58.607556 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-56053d5e-5ede-4835-8faa-b8c8bc728a0c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1389 microversion: 2.1 time: 0.495006 Jul 14 15:02:58.608251 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2913/5794] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:58 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1389 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:58.626991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6c09523d-e29e-40e8-a541-4e6d20eb1e55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:58.628873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6c09523d-e29e-40e8-a541-4e6d20eb1e55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:58.669155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6c09523d-e29e-40e8-a541-4e6d20eb1e55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:58.669787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6c09523d-e29e-40e8-a541-4e6d20eb1e55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:58.671350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6c09523d-e29e-40e8-a541-4e6d20eb1e55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:58.671983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6c09523d-e29e-40e8-a541-4e6d20eb1e55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:58.990171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6c09523d-e29e-40e8-a541-4e6d20eb1e55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:58.999994 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6c09523d-e29e-40e8-a541-4e6d20eb1e55 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1389 microversion: 2.1 time: 0.379841 Jul 14 15:02:59.000593 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2882/5795] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:58 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1389 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:59.016682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8c1139bc-c23f-48f0-89ac-ddd2b5cf31c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:59.017343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8c1139bc-c23f-48f0-89ac-ddd2b5cf31c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:59.027666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c1139bc-c23f-48f0-89ac-ddd2b5cf31c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:59.033844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c1139bc-c23f-48f0-89ac-ddd2b5cf31c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:59.037894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c1139bc-c23f-48f0-89ac-ddd2b5cf31c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:59.038618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c1139bc-c23f-48f0-89ac-ddd2b5cf31c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:59.396408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8c1139bc-c23f-48f0-89ac-ddd2b5cf31c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:59.407444 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8c1139bc-c23f-48f0-89ac-ddd2b5cf31c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1389 microversion: 2.1 time: 0.395074 Jul 14 15:02:59.417628 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2914/5796] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:59 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1389 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:59.617730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-264af6f9-2481-4c9f-8732-2c41d8d24e18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:59.618596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-264af6f9-2481-4c9f-8732-2c41d8d24e18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:59.631374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-264af6f9-2481-4c9f-8732-2c41d8d24e18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:59.633381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-264af6f9-2481-4c9f-8732-2c41d8d24e18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:59.637432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-264af6f9-2481-4c9f-8732-2c41d8d24e18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:59.638204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-264af6f9-2481-4c9f-8732-2c41d8d24e18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:59.711082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-264af6f9-2481-4c9f-8732-2c41d8d24e18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:02:59.890971 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-264af6f9-2481-4c9f-8732-2c41d8d24e18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 204 len: 0 microversion: 2.1 time: 0.277784 Jul 14 15:02:59.892274 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2883/5797] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:02:59 2022] DELETE /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:02:59.901992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c0781fa8-ef7f-41b5-85bc-3f3e03e95dbe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:59.903277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c0781fa8-ef7f-41b5-85bc-3f3e03e95dbe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:59.921177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0781fa8-ef7f-41b5-85bc-3f3e03e95dbe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:59.924276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0781fa8-ef7f-41b5-85bc-3f3e03e95dbe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:59.926602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0781fa8-ef7f-41b5-85bc-3f3e03e95dbe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:59.928007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0781fa8-ef7f-41b5-85bc-3f3e03e95dbe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:00.151696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c0781fa8-ef7f-41b5-85bc-3f3e03e95dbe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:00.161906 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c0781fa8-ef7f-41b5-85bc-3f3e03e95dbe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1395 microversion: 2.1 time: 0.264566 Jul 14 15:03:00.162549 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2915/5798] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:59 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1395 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:01.181557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-acb8c19b-5ceb-47d9-bcdb-e58ba1ae6c92 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:01.184082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-acb8c19b-5ceb-47d9-bcdb-e58ba1ae6c92 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:01.197646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acb8c19b-5ceb-47d9-bcdb-e58ba1ae6c92 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:01.207281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acb8c19b-5ceb-47d9-bcdb-e58ba1ae6c92 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:01.208787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acb8c19b-5ceb-47d9-bcdb-e58ba1ae6c92 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:01.211881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-acb8c19b-5ceb-47d9-bcdb-e58ba1ae6c92 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:01.622615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-acb8c19b-5ceb-47d9-bcdb-e58ba1ae6c92 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:01.641360 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-acb8c19b-5ceb-47d9-bcdb-e58ba1ae6c92 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1395 microversion: 2.1 time: 0.464926 Jul 14 15:03:01.642554 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2884/5799] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:01 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1395 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:02.179051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-362e658d-8734-43af-b1ed-fad679419974 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:02.180875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-362e658d-8734-43af-b1ed-fad679419974 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:02.200212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-362e658d-8734-43af-b1ed-fad679419974 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:02.207107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-362e658d-8734-43af-b1ed-fad679419974 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:02.208063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-362e658d-8734-43af-b1ed-fad679419974 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:02.209655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-362e658d-8734-43af-b1ed-fad679419974 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:02.287025 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-362e658d-8734-43af-b1ed-fad679419974 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120221 Jul 14 15:03:02.287025 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2916/5800] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:03:02 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:02.297598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b92398ae-1ed0-4649-ba50-df02683a1654 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:02.298140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b92398ae-1ed0-4649-ba50-df02683a1654 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:02.310669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b92398ae-1ed0-4649-ba50-df02683a1654 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:02.311378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b92398ae-1ed0-4649-ba50-df02683a1654 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:02.312360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b92398ae-1ed0-4649-ba50-df02683a1654 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:02.315862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b92398ae-1ed0-4649-ba50-df02683a1654 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:02.438833 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b92398ae-1ed0-4649-ba50-df02683a1654 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments/59b7e01c-5483-4135-853a-d13045b1ce15" status: 200 len: 194 microversion: 2.1 time: 0.145138 Jul 14 15:03:02.439480 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2885/5801] 10.222.0.81 () {58 vars in 1412 bytes} [Thu Jul 14 15:03:02 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments/59b7e01c-5483-4135-853a-d13045b1ce15 => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:02.674986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-75de1570-6b9d-4ddf-98d4-4089bfa2e661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:02.675723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-75de1570-6b9d-4ddf-98d4-4089bfa2e661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:02.696387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75de1570-6b9d-4ddf-98d4-4089bfa2e661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:02.697508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75de1570-6b9d-4ddf-98d4-4089bfa2e661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:02.704496 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75de1570-6b9d-4ddf-98d4-4089bfa2e661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:02.705214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75de1570-6b9d-4ddf-98d4-4089bfa2e661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:03.292136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-75de1570-6b9d-4ddf-98d4-4089bfa2e661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:03.302581 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-75de1570-6b9d-4ddf-98d4-4089bfa2e661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1395 microversion: 2.1 time: 0.631402 Jul 14 15:03:03.303980 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2917/5802] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:02 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1395 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:03.749195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-795200fa-4d7c-42a9-84b5-375b1a1377a1 req-15106332-3e86-40e9-afca-697554ed004a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cb1cdb-5789-4e4e-a1f8-34716de096a4", "name": "network-vif-deleted", "tag": "3b232abe-a54f-441e-a1a6-2e06d2bbdcb6"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:03.772141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-795200fa-4d7c-42a9-84b5-375b1a1377a1 req-15106332-3e86-40e9-afca-697554ed004a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:03.772482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-795200fa-4d7c-42a9-84b5-375b1a1377a1 req-15106332-3e86-40e9-afca-697554ed004a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:03.812276 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-795200fa-4d7c-42a9-84b5-375b1a1377a1 req-15106332-3e86-40e9-afca-697554ed004a service nova] Creating event network-vif-deleted:3b232abe-a54f-441e-a1a6-2e06d2bbdcb6 for instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 on n-h1-767704-28 Jul 14 15:03:03.837434 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-795200fa-4d7c-42a9-84b5-375b1a1377a1 req-15106332-3e86-40e9-afca-697554ed004a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093055 Jul 14 15:03:03.849704 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2886/5803] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:04.325414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-30e67104-f6e9-4719-a00d-6c7b807123d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:04.326467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-30e67104-f6e9-4719-a00d-6c7b807123d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:04.356077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30e67104-f6e9-4719-a00d-6c7b807123d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:04.365885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30e67104-f6e9-4719-a00d-6c7b807123d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:04.367157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30e67104-f6e9-4719-a00d-6c7b807123d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:04.369226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30e67104-f6e9-4719-a00d-6c7b807123d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:04.577427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-30e67104-f6e9-4719-a00d-6c7b807123d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:04.590920 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-30e67104-f6e9-4719-a00d-6c7b807123d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1188 microversion: 2.1 time: 0.273792 Jul 14 15:03:04.602115 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2918/5804] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:04 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:05.610091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-213c3df2-b31e-4e21-a0f8-19b5ee209e75 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:05.612351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-213c3df2-b31e-4e21-a0f8-19b5ee209e75 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:05.639578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-213c3df2-b31e-4e21-a0f8-19b5ee209e75 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:05.640589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-213c3df2-b31e-4e21-a0f8-19b5ee209e75 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:05.643643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-213c3df2-b31e-4e21-a0f8-19b5ee209e75 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:05.644400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-213c3df2-b31e-4e21-a0f8-19b5ee209e75 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:05.798595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-213c3df2-b31e-4e21-a0f8-19b5ee209e75 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:05.806698 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-213c3df2-b31e-4e21-a0f8-19b5ee209e75 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1188 microversion: 2.1 time: 0.202023 Jul 14 15:03:05.816786 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2887/5805] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:05 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1188 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:06.773752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3aa6552c-947d-4897-b47f-985c1df7c206 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb4643cd-29a2-48df-80b2-dbc6a6ba0a0b"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:06.778989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3aa6552c-947d-4897-b47f-985c1df7c206 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:06.806022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3aa6552c-947d-4897-b47f-985c1df7c206 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:06.809910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3aa6552c-947d-4897-b47f-985c1df7c206 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:06.811337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3aa6552c-947d-4897-b47f-985c1df7c206 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:06.813719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3aa6552c-947d-4897-b47f-985c1df7c206 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:06.824495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-434aa0e7-e9d0-4e53-abe5-a64288d5b88e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:06.825825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-434aa0e7-e9d0-4e53-abe5-a64288d5b88e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:06.839615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-434aa0e7-e9d0-4e53-abe5-a64288d5b88e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:06.840368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-434aa0e7-e9d0-4e53-abe5-a64288d5b88e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:06.841378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-434aa0e7-e9d0-4e53-abe5-a64288d5b88e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:06.841990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-434aa0e7-e9d0-4e53-abe5-a64288d5b88e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:06.992901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-434aa0e7-e9d0-4e53-abe5-a64288d5b88e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:07.000441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:07.004100 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-434aa0e7-e9d0-4e53-abe5-a64288d5b88e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1188 microversion: 2.1 time: 0.184383 Jul 14 15:03:07.015372 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2888/5806] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:06 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1188 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:03:07.413084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:07.455946 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3aa6552c-947d-4897-b47f-985c1df7c206 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "POST /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684307 Jul 14 15:03:07.458052 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2919/5807] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 15:03:06 2022] POST /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:08.022556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4fa8b2b7-0f07-4f8d-9c93-b6ea914108c6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:08.023341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4fa8b2b7-0f07-4f8d-9c93-b6ea914108c6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:08.049203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fa8b2b7-0f07-4f8d-9c93-b6ea914108c6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:08.052334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fa8b2b7-0f07-4f8d-9c93-b6ea914108c6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:08.053681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fa8b2b7-0f07-4f8d-9c93-b6ea914108c6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:08.054243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fa8b2b7-0f07-4f8d-9c93-b6ea914108c6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:08.267141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4fa8b2b7-0f07-4f8d-9c93-b6ea914108c6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:08.279038 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4fa8b2b7-0f07-4f8d-9c93-b6ea914108c6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1188 microversion: 2.1 time: 0.260350 Jul 14 15:03:08.281890 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2889/5808] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:08 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1188 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:09.300650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-856a1e84-c4a5-4e44-a73e-b7318f50ba61 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:09.301412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-856a1e84-c4a5-4e44-a73e-b7318f50ba61 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:09.323834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-856a1e84-c4a5-4e44-a73e-b7318f50ba61 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:09.324307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-856a1e84-c4a5-4e44-a73e-b7318f50ba61 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:09.325145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-856a1e84-c4a5-4e44-a73e-b7318f50ba61 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:09.325600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-856a1e84-c4a5-4e44-a73e-b7318f50ba61 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:09.478522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-856a1e84-c4a5-4e44-a73e-b7318f50ba61 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:09.493567 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-856a1e84-c4a5-4e44-a73e-b7318f50ba61 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1188 microversion: 2.1 time: 0.198655 Jul 14 15:03:09.494164 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2920/5809] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:09 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1188 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:10.512304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ddc1f308-5df4-4b2a-b13c-4b3a819c0705 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:10.513059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ddc1f308-5df4-4b2a-b13c-4b3a819c0705 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:10.531847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddc1f308-5df4-4b2a-b13c-4b3a819c0705 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:10.532306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddc1f308-5df4-4b2a-b13c-4b3a819c0705 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:10.533124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddc1f308-5df4-4b2a-b13c-4b3a819c0705 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:10.539079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddc1f308-5df4-4b2a-b13c-4b3a819c0705 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:10.762243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ddc1f308-5df4-4b2a-b13c-4b3a819c0705 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:10.788225 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ddc1f308-5df4-4b2a-b13c-4b3a819c0705 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1188 microversion: 2.1 time: 0.280560 Jul 14 15:03:10.805315 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2890/5810] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:10 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:11.810654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-82ac59de-d492-454b-8093-471eb805d522 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:11.811271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-82ac59de-d492-454b-8093-471eb805d522 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:11.821656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82ac59de-d492-454b-8093-471eb805d522 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:11.826109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82ac59de-d492-454b-8093-471eb805d522 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:11.827140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82ac59de-d492-454b-8093-471eb805d522 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:11.831029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82ac59de-d492-454b-8093-471eb805d522 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:11.972280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-82ac59de-d492-454b-8093-471eb805d522 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:11.988572 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-82ac59de-d492-454b-8093-471eb805d522 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1188 microversion: 2.1 time: 0.176921 Jul 14 15:03:12.001080 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2921/5811] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:11 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1188 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:13.006012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a27bada3-307a-4ba6-b4c1-fd311fb4613d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:13.006645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a27bada3-307a-4ba6-b4c1-fd311fb4613d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:13.024142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a27bada3-307a-4ba6-b4c1-fd311fb4613d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:13.024612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a27bada3-307a-4ba6-b4c1-fd311fb4613d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:13.025453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a27bada3-307a-4ba6-b4c1-fd311fb4613d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:13.025927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a27bada3-307a-4ba6-b4c1-fd311fb4613d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:13.125748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a27bada3-307a-4ba6-b4c1-fd311fb4613d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:13.135164 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a27bada3-307a-4ba6-b4c1-fd311fb4613d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1188 microversion: 2.1 time: 0.133267 Jul 14 15:03:13.136551 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2891/5812] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:13 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1188 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:14.154741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-69533ece-3128-4ff1-a094-9430f3129c1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:14.155504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-69533ece-3128-4ff1-a094-9430f3129c1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:14.171063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69533ece-3128-4ff1-a094-9430f3129c1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:14.172460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69533ece-3128-4ff1-a094-9430f3129c1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:14.175366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69533ece-3128-4ff1-a094-9430f3129c1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:14.177906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69533ece-3128-4ff1-a094-9430f3129c1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:14.328638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-69533ece-3128-4ff1-a094-9430f3129c1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:14.341731 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-69533ece-3128-4ff1-a094-9430f3129c1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1188 microversion: 2.1 time: 0.193427 Jul 14 15:03:14.350204 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2922/5813] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:14 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1188 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:14.921460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4fa6509-79bb-4f25-bfbf-6b1142e8df89 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Action: 'create', calling method: .version_select at 0x7fd6c4549940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-827606132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPudnCsdghcu07JHyK2E7n3qZw/DqIM2tUXgp/AXX9vUnS/s6gGAdRd/VSqUiamWP/MVc7K5KQH7KLtU+3aMg1JpReHpHy5570Uwe86Exfq6qAAD7OZmTbdErSKVkZT+0Q=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:14.955500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b4fa6509-79bb-4f25-bfbf-6b1142e8df89 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Getting quotas for project c5b1a0afc1a942f7b4ce2d0b20739da1. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:03:14.985689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b4fa6509-79bb-4f25-bfbf-6b1142e8df89 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Getting quotas for user 663974b480e3425a9a31d4eee8c946b5 and project c5b1a0afc1a942f7b4ce2d0b20739da1. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:03:15.035851 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b4fa6509-79bb-4f25-bfbf-6b1142e8df89 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.122067 Jul 14 15:03:15.036498 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2892/5814] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:03:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:15.360325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5fcf7e72-0021-4655-9f2e-94f78b28ad73 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:15.361289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5fcf7e72-0021-4655-9f2e-94f78b28ad73 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:15.376452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fcf7e72-0021-4655-9f2e-94f78b28ad73 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:15.377141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fcf7e72-0021-4655-9f2e-94f78b28ad73 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:15.378439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fcf7e72-0021-4655-9f2e-94f78b28ad73 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:15.384726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fcf7e72-0021-4655-9f2e-94f78b28ad73 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:15.616254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5fcf7e72-0021-4655-9f2e-94f78b28ad73 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:15.630084 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5fcf7e72-0021-4655-9f2e-94f78b28ad73 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1188 microversion: 2.1 time: 0.271605 Jul 14 15:03:15.634101 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2923/5815] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:15 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1188 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:16.650613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-721f4ba4-20e9-4ff2-97b6-c0cd4c7ffe83 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:16.651279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-721f4ba4-20e9-4ff2-97b6-c0cd4c7ffe83 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:16.667273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-721f4ba4-20e9-4ff2-97b6-c0cd4c7ffe83 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:16.668035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-721f4ba4-20e9-4ff2-97b6-c0cd4c7ffe83 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:16.668920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-721f4ba4-20e9-4ff2-97b6-c0cd4c7ffe83 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:16.671312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-721f4ba4-20e9-4ff2-97b6-c0cd4c7ffe83 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:16.799902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-721f4ba4-20e9-4ff2-97b6-c0cd4c7ffe83 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:16.812555 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-721f4ba4-20e9-4ff2-97b6-c0cd4c7ffe83 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1188 microversion: 2.1 time: 0.166632 Jul 14 15:03:16.813866 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2893/5816] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:16 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1188 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:17.832844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e3e505de-31f9-4689-9885-8ae22bef8d4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:17.833578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e3e505de-31f9-4689-9885-8ae22bef8d4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:17.857784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=32 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:17.859545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3e505de-31f9-4689-9885-8ae22bef8d4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:17.865725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3e505de-31f9-4689-9885-8ae22bef8d4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:17.866598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3e505de-31f9-4689-9885-8ae22bef8d4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:17.867052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3e505de-31f9-4689-9885-8ae22bef8d4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:18.029634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3e505de-31f9-4689-9885-8ae22bef8d4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:18.030047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3e505de-31f9-4689-9885-8ae22bef8d4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:18.030524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-e3e505de-31f9-4689-9885-8ae22bef8d4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lazy-loading 'fault' on Instance uuid b1cb1cdb-5789-4e4e-a1f8-34716de096a4 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:03:18.137333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e3e505de-31f9-4689-9885-8ae22bef8d4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:18.146536 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e3e505de-31f9-4689-9885-8ae22bef8d4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 200 len: 1147 microversion: 2.1 time: 0.319683 Jul 14 15:03:18.157583 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2924/5817] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:17 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 1147 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:18.238211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-404097701", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "ea4e1df2-6f50-44dc-ba56-ee12a8cb4113"}], "key_name": "tempest-TestNetworkBasicOps-827606132", "security_groups": [{"name": "tempest-secgroup-smoke-1387475394"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:18.472862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] validate_networks() for [('ea4e1df2-6f50-44dc-ba56-ee12a8cb4113', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:03:18.960446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:19.168172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c06f604b-60a5-49b4-8eb5-6fea7584bde6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:19.169118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c06f604b-60a5-49b4-8eb5-6fea7584bde6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:19.194100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c06f604b-60a5-49b4-8eb5-6fea7584bde6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:19.194568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c06f604b-60a5-49b4-8eb5-6fea7584bde6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:19.195389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c06f604b-60a5-49b4-8eb5-6fea7584bde6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:19.195842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c06f604b-60a5-49b4-8eb5-6fea7584bde6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:19.227257 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-c06f604b-60a5-49b4-8eb5-6fea7584bde6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c06f604b-60a5-49b4-8eb5-6fea7584bde6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 HTTP/1.1 Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'b1cb1cdb-5789-4e4e-a1f8-34716de096a4'} Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:19.234996 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:19.240136 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:19.240136 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:19.240136 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:19.240136 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:03:19.240136 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:03:19.240136 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:19.240136 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:19.242601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c06f604b-60a5-49b4-8eb5-6fea7584bde6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:03:19.243694 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c06f604b-60a5-49b4-8eb5-6fea7584bde6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 404 len: 111 microversion: 2.1 time: 0.081478 Jul 14 15:03:19.248763 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2925/5818] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:19 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:03:19.559566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:03:19.560098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:03:19.560472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:03:19.560893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:03:19.563266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:03:19.579679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:19.580139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:19.580970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:19.581416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:19.639831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Getting quotas for project c5b1a0afc1a942f7b4ce2d0b20739da1. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:03:19.646399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Getting quotas for user 663974b480e3425a9a31d4eee8c946b5 and project c5b1a0afc1a942f7b4ce2d0b20739da1. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:03:19.693598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:03:19.696860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:03:19.815790 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d73d9556-bd4a-4760-8b37-45c6221cbdfc tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.583951 Jul 14 15:03:19.816374 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2894/5819] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:03:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:03:19.832289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4f731454-4692-491f-893e-91fa2687d810 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:19.832939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4f731454-4692-491f-893e-91fa2687d810 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:19.970129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4f731454-4692-491f-893e-91fa2687d810 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:19.982139 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4f731454-4692-491f-893e-91fa2687d810 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1247 microversion: 2.1 time: 0.159009 Jul 14 15:03:19.982741 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2926/5820] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:19 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1247 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:20.999987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-30cfa6a3-9775-42da-bf83-d1ad3431f659 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:21.000662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-30cfa6a3-9775-42da-bf83-d1ad3431f659 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:21.211700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-30cfa6a3-9775-42da-bf83-d1ad3431f659 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:21.219949 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-30cfa6a3-9775-42da-bf83-d1ad3431f659 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1247 microversion: 2.1 time: 0.223921 Jul 14 15:03:21.221317 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2895/5821] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:20 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1247 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:22.246816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2436607b-9183-4fec-8079-770ec79e6cdb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:22.248148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2436607b-9183-4fec-8079-770ec79e6cdb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:22.267523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2436607b-9183-4fec-8079-770ec79e6cdb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:22.267993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2436607b-9183-4fec-8079-770ec79e6cdb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:22.268817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2436607b-9183-4fec-8079-770ec79e6cdb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:22.269305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2436607b-9183-4fec-8079-770ec79e6cdb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:22.555614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2436607b-9183-4fec-8079-770ec79e6cdb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:22.573732 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2436607b-9183-4fec-8079-770ec79e6cdb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1307 microversion: 2.1 time: 0.329849 Jul 14 15:03:22.574754 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2927/5822] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:22 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1307 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:23.591162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5f9365a1-2461-4e68-ba02-97c9caa77fda tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:23.592747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5f9365a1-2461-4e68-ba02-97c9caa77fda tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:23.614334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f9365a1-2461-4e68-ba02-97c9caa77fda tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:23.615228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f9365a1-2461-4e68-ba02-97c9caa77fda tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:23.616322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f9365a1-2461-4e68-ba02-97c9caa77fda tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:23.617057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5f9365a1-2461-4e68-ba02-97c9caa77fda tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:23.841476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5f9365a1-2461-4e68-ba02-97c9caa77fda tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:23.859384 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5f9365a1-2461-4e68-ba02-97c9caa77fda tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1305 microversion: 2.1 time: 0.272542 Jul 14 15:03:23.861879 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2896/5823] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:23 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1305 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:03:24.879491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-441c5ab7-5ad1-4661-a020-436683715b58 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:24.880299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-441c5ab7-5ad1-4661-a020-436683715b58 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:24.903828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-441c5ab7-5ad1-4661-a020-436683715b58 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:24.908389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-441c5ab7-5ad1-4661-a020-436683715b58 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:24.909462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-441c5ab7-5ad1-4661-a020-436683715b58 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:24.910128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-441c5ab7-5ad1-4661-a020-436683715b58 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:25.566785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-441c5ab7-5ad1-4661-a020-436683715b58 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:25.586804 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-441c5ab7-5ad1-4661-a020-436683715b58 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1373 microversion: 2.1 time: 0.711416 Jul 14 15:03:25.607524 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2928/5824] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:24 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1373 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:26.611687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f80f8193-0437-4e90-8fb0-5e33bc86a5d5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:26.612386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f80f8193-0437-4e90-8fb0-5e33bc86a5d5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:26.628740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f80f8193-0437-4e90-8fb0-5e33bc86a5d5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:26.629308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f80f8193-0437-4e90-8fb0-5e33bc86a5d5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:26.630187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f80f8193-0437-4e90-8fb0-5e33bc86a5d5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:26.630733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f80f8193-0437-4e90-8fb0-5e33bc86a5d5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:26.972309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f80f8193-0437-4e90-8fb0-5e33bc86a5d5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:26.985597 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f80f8193-0437-4e90-8fb0-5e33bc86a5d5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1373 microversion: 2.1 time: 0.377934 Jul 14 15:03:26.989916 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2897/5825] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:26 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1373 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:27.280754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e56ef769-67e3-4daf-88c0-632f6ef06ba2 req-4d1a03bd-fb80-4daa-88ea-fde8180873fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a729e84-2942-45d8-a50b-c731bf30cb21", "tag": "f3241ea7-9d3f-43e9-bcc6-45b4d0e4dcd7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:27.307304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e56ef769-67e3-4daf-88c0-632f6ef06ba2 req-4d1a03bd-fb80-4daa-88ea-fde8180873fe service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:27.308011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e56ef769-67e3-4daf-88c0-632f6ef06ba2 req-4d1a03bd-fb80-4daa-88ea-fde8180873fe service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:27.362487 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e56ef769-67e3-4daf-88c0-632f6ef06ba2 req-4d1a03bd-fb80-4daa-88ea-fde8180873fe service nova] Creating event network-changed:f3241ea7-9d3f-43e9-bcc6-45b4d0e4dcd7 for instance 0a729e84-2942-45d8-a50b-c731bf30cb21 on n-h1-767704-28 Jul 14 15:03:27.379890 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e56ef769-67e3-4daf-88c0-632f6ef06ba2 req-4d1a03bd-fb80-4daa-88ea-fde8180873fe service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101837 Jul 14 15:03:27.380560 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2929/5826] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:28.004584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99dc6bc2-16bc-412f-aefd-ab57cc15fd6b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:28.006103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-99dc6bc2-16bc-412f-aefd-ab57cc15fd6b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:28.019822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99dc6bc2-16bc-412f-aefd-ab57cc15fd6b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:28.020294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99dc6bc2-16bc-412f-aefd-ab57cc15fd6b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:28.037205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd2e8628-c6aa-4feb-8fc3-a31ff36bc669 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:28.037820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bd2e8628-c6aa-4feb-8fc3-a31ff36bc669 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:28.038748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99dc6bc2-16bc-412f-aefd-ab57cc15fd6b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:28.040851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99dc6bc2-16bc-412f-aefd-ab57cc15fd6b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:28.055140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd2e8628-c6aa-4feb-8fc3-a31ff36bc669 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:28.055555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd2e8628-c6aa-4feb-8fc3-a31ff36bc669 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:28.056364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd2e8628-c6aa-4feb-8fc3-a31ff36bc669 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:28.056822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bd2e8628-c6aa-4feb-8fc3-a31ff36bc669 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:28.095721 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-bd2e8628-c6aa-4feb-8fc3-a31ff36bc669 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd2e8628-c6aa-4feb-8fc3-a31ff36bc669 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 HTTP/1.1 Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'b1cb1cdb-5789-4e4e-a1f8-34716de096a4'} Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:03:28.097481 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:03:28.102085 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:28.102085 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:28.102085 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:28.102085 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:28.102085 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:28.102085 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:28.102085 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:28.102085 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:03:28.102085 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:03:28.102085 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:28.102085 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:28.102085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bd2e8628-c6aa-4feb-8fc3-a31ff36bc669 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:03:28.109199 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bd2e8628-c6aa-4feb-8fc3-a31ff36bc669 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 404 len: 111 microversion: 2.1 time: 0.066227 Jul 14 15:03:28.112888 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2930/5827] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:03:28 2022] DELETE /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:03:28.118047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e56dc498-1580-4a6a-a90f-a354d11846ac tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:28.118942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e56dc498-1580-4a6a-a90f-a354d11846ac tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: b1cb1cdb-5789-4e4e-a1f8-34716de096a4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:28.135519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e56dc498-1580-4a6a-a90f-a354d11846ac tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:28.136849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e56dc498-1580-4a6a-a90f-a354d11846ac tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:28.137910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e56dc498-1580-4a6a-a90f-a354d11846ac tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:28.140743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e56dc498-1580-4a6a-a90f-a354d11846ac tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:28.170057 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-e56dc498-1580-4a6a-a90f-a354d11846ac tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e56dc498-1580-4a6a-a90f-a354d11846ac tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 HTTP/1.1 Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'b1cb1cdb-5789-4e4e-a1f8-34716de096a4'} Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:28.172242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:28.177686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:28.177686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:28.177686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:28.177686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:03:28.177686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:03:28.177686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. Jul 14 15:03:28.177686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:03:28.179385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e56dc498-1580-4a6a-a90f-a354d11846ac tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance b1cb1cdb-5789-4e4e-a1f8-34716de096a4 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:03:28.194334 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e56dc498-1580-4a6a-a90f-a354d11846ac tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4" status: 404 len: 111 microversion: 2.1 time: 0.079943 Jul 14 15:03:28.195589 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2931/5828] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:28 2022] GET /compute/v2.1/servers/b1cb1cdb-5789-4e4e-a1f8-34716de096a4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:03:28.473897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-99dc6bc2-16bc-412f-aefd-ab57cc15fd6b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:28.483864 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99dc6bc2-16bc-412f-aefd-ab57cc15fd6b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1373 microversion: 2.1 time: 0.483011 Jul 14 15:03:28.496984 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2898/5829] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:27 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1373 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:29.502128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d2c870f2-b1d3-4538-973c-ae4dc33f7202 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:29.503641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d2c870f2-b1d3-4538-973c-ae4dc33f7202 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:29.534625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d2c870f2-b1d3-4538-973c-ae4dc33f7202 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:29.538985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d2c870f2-b1d3-4538-973c-ae4dc33f7202 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:29.545125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d2c870f2-b1d3-4538-973c-ae4dc33f7202 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:29.547107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d2c870f2-b1d3-4538-973c-ae4dc33f7202 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:29.975304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:30.298335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d2c870f2-b1d3-4538-973c-ae4dc33f7202 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:30.326136 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d2c870f2-b1d3-4538-973c-ae4dc33f7202 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1373 microversion: 2.1 time: 0.829136 Jul 14 15:03:30.342659 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2932/5830] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:29 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1373 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:31.344776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9902224a-d737-408f-87ce-b9c6aa978196 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:31.345443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9902224a-d737-408f-87ce-b9c6aa978196 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:31.355614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:31.356226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:31.357830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9902224a-d737-408f-87ce-b9c6aa978196 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:31.358287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9902224a-d737-408f-87ce-b9c6aa978196 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:31.359083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9902224a-d737-408f-87ce-b9c6aa978196 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:31.366557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9902224a-d737-408f-87ce-b9c6aa978196 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:31.670177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9902224a-d737-408f-87ce-b9c6aa978196 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:31.694191 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9902224a-d737-408f-87ce-b9c6aa978196 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1373 microversion: 2.1 time: 0.353300 Jul 14 15:03:31.694762 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2899/5831] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:31 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1373 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:32.480903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-848e030c-493b-4e05-9431-f79ec78bd2a9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:32.482543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-848e030c-493b-4e05-9431-f79ec78bd2a9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:32.489829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-848e030c-493b-4e05-9431-f79ec78bd2a9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:32.490579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-848e030c-493b-4e05-9431-f79ec78bd2a9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:32.491723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-848e030c-493b-4e05-9431-f79ec78bd2a9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:32.492370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-848e030c-493b-4e05-9431-f79ec78bd2a9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:32.529751 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-848e030c-493b-4e05-9431-f79ec78bd2a9 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053733 Jul 14 15:03:32.530610 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2933/5832] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:03:32 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:32.690887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-465f91ec-e035-4122-b1c5-63ce8c0338a2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:32.692054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-465f91ec-e035-4122-b1c5-63ce8c0338a2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:32.702378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-465f91ec-e035-4122-b1c5-63ce8c0338a2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:32.703081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-465f91ec-e035-4122-b1c5-63ce8c0338a2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:32.704134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-465f91ec-e035-4122-b1c5-63ce8c0338a2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:32.704811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-465f91ec-e035-4122-b1c5-63ce8c0338a2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:32.712563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0c3be4ce-0bec-4853-b27e-413768f2f44f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:32.713219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0c3be4ce-0bec-4853-b27e-413768f2f44f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:32.744143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0c3be4ce-0bec-4853-b27e-413768f2f44f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:32.744584 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-465f91ec-e035-4122-b1c5-63ce8c0338a2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments/59b7e01c-5483-4135-853a-d13045b1ce15" status: 200 len: 194 microversion: 2.1 time: 0.057734 Jul 14 15:03:32.746895 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2900/5833] 10.222.0.81 () {58 vars in 1412 bytes} [Thu Jul 14 15:03:32 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments/59b7e01c-5483-4135-853a-d13045b1ce15 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:32.748666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0c3be4ce-0bec-4853-b27e-413768f2f44f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:32.750545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0c3be4ce-0bec-4853-b27e-413768f2f44f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:32.752134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0c3be4ce-0bec-4853-b27e-413768f2f44f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:32.757857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7c4fa0ef-3bd9-4518-99d8-cd5e0519c4f1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:32.759540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7c4fa0ef-3bd9-4518-99d8-cd5e0519c4f1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:32.779810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c4fa0ef-3bd9-4518-99d8-cd5e0519c4f1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:32.781582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c4fa0ef-3bd9-4518-99d8-cd5e0519c4f1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:32.786211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c4fa0ef-3bd9-4518-99d8-cd5e0519c4f1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:32.787050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c4fa0ef-3bd9-4518-99d8-cd5e0519c4f1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:32.959949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-7c4fa0ef-3bd9-4518-99d8-cd5e0519c4f1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lazy-loading 'services' on Instance uuid d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:03:33.122106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0c3be4ce-0bec-4853-b27e-413768f2f44f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:33.139210 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0c3be4ce-0bec-4853-b27e-413768f2f44f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1373 microversion: 2.1 time: 0.431183 Jul 14 15:03:33.142532 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2934/5834] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:32 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1373 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:33.151729 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7c4fa0ef-3bd9-4518-99d8-cd5e0519c4f1 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments/59b7e01c-5483-4135-853a-d13045b1ce15" status: 202 len: 0 microversion: 2.1 time: 0.386373 Jul 14 15:03:33.153081 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2901/5835] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:03:32 2022] DELETE /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments/59b7e01c-5483-4135-853a-d13045b1ce15 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:03:34.156802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-296e5aed-55b3-4006-abf5-99a4a6f76b50 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:34.158065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-296e5aed-55b3-4006-abf5-99a4a6f76b50 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:34.168870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-296e5aed-55b3-4006-abf5-99a4a6f76b50 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:34.175035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-296e5aed-55b3-4006-abf5-99a4a6f76b50 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:34.176877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-296e5aed-55b3-4006-abf5-99a4a6f76b50 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:34.178238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-296e5aed-55b3-4006-abf5-99a4a6f76b50 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:34.545478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-296e5aed-55b3-4006-abf5-99a4a6f76b50 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:34.561314 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-296e5aed-55b3-4006-abf5-99a4a6f76b50 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1373 microversion: 2.1 time: 0.408596 Jul 14 15:03:34.564637 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2935/5836] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:34 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1373 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:35.478020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-839e5d69-e227-49f6-8340-968ba2ca782d req-3d336a85-7b18-4797-8a03-402e6339c858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a729e84-2942-45d8-a50b-c731bf30cb21", "name": "network-vif-plugged", "status": "completed", "tag": "f3241ea7-9d3f-43e9-bcc6-45b4d0e4dcd7"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:35.519663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-839e5d69-e227-49f6-8340-968ba2ca782d req-3d336a85-7b18-4797-8a03-402e6339c858 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:35.520671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-839e5d69-e227-49f6-8340-968ba2ca782d req-3d336a85-7b18-4797-8a03-402e6339c858 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:35.572492 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-839e5d69-e227-49f6-8340-968ba2ca782d req-3d336a85-7b18-4797-8a03-402e6339c858 service nova] Creating event network-vif-plugged:f3241ea7-9d3f-43e9-bcc6-45b4d0e4dcd7 for instance 0a729e84-2942-45d8-a50b-c731bf30cb21 on n-h1-767704-28 Jul 14 15:03:35.584906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-85da8ea6-27f1-4b4b-a7bf-e55a92442654 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:35.585730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-85da8ea6-27f1-4b4b-a7bf-e55a92442654 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:35.604937 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-839e5d69-e227-49f6-8340-968ba2ca782d req-3d336a85-7b18-4797-8a03-402e6339c858 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123445 Jul 14 15:03:35.606808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-85da8ea6-27f1-4b4b-a7bf-e55a92442654 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:35.609604 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2902/5837] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:35.615158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-85da8ea6-27f1-4b4b-a7bf-e55a92442654 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:35.616385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-85da8ea6-27f1-4b4b-a7bf-e55a92442654 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:35.618294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-85da8ea6-27f1-4b4b-a7bf-e55a92442654 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:35.990540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-85da8ea6-27f1-4b4b-a7bf-e55a92442654 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:36.000009 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-85da8ea6-27f1-4b4b-a7bf-e55a92442654 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1373 microversion: 2.1 time: 0.419113 Jul 14 15:03:36.009813 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2936/5838] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:35 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1373 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:37.029600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8e756c78-e047-4bb6-aa4e-2d711f9c9e7e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:37.030389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8e756c78-e047-4bb6-aa4e-2d711f9c9e7e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:37.049757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e756c78-e047-4bb6-aa4e-2d711f9c9e7e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:37.061699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e756c78-e047-4bb6-aa4e-2d711f9c9e7e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:37.063501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e756c78-e047-4bb6-aa4e-2d711f9c9e7e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:37.064180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e756c78-e047-4bb6-aa4e-2d711f9c9e7e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:38.250537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8e756c78-e047-4bb6-aa4e-2d711f9c9e7e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:38.257892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:38.281354 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8e756c78-e047-4bb6-aa4e-2d711f9c9e7e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1373 microversion: 2.1 time: 1.261604 Jul 14 15:03:38.282239 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2903/5839] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:37 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1373 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:39.304254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18637749-c48a-44d9-8039-b9880447b8ef tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:39.305542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-18637749-c48a-44d9-8039-b9880447b8ef tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:39.314873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18637749-c48a-44d9-8039-b9880447b8ef tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:39.323625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18637749-c48a-44d9-8039-b9880447b8ef tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:39.324980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18637749-c48a-44d9-8039-b9880447b8ef tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:39.329510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18637749-c48a-44d9-8039-b9880447b8ef tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:39.395128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=83 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:39.649651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18637749-c48a-44d9-8039-b9880447b8ef tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:39.662090 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-18637749-c48a-44d9-8039-b9880447b8ef tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1545 microversion: 2.1 time: 0.367031 Jul 14 15:03:39.689367 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2937/5840] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:39 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1545 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:39.717195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c5a86d99-79fd-4b65-9d76-dde6b42ac906 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:39.718497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c5a86d99-79fd-4b65-9d76-dde6b42ac906 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:39.749462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5a86d99-79fd-4b65-9d76-dde6b42ac906 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:39.759648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5a86d99-79fd-4b65-9d76-dde6b42ac906 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:39.763341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5a86d99-79fd-4b65-9d76-dde6b42ac906 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:39.764038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5a86d99-79fd-4b65-9d76-dde6b42ac906 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:39.978936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c5a86d99-79fd-4b65-9d76-dde6b42ac906 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:39.995266 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c5a86d99-79fd-4b65-9d76-dde6b42ac906 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1545 microversion: 2.1 time: 0.297329 Jul 14 15:03:39.997314 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2904/5841] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:39 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1545 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:45.464816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-96cb8924-07cf-42fe-8ba8-c9c3524a52db tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:45.466087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-96cb8924-07cf-42fe-8ba8-c9c3524a52db tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:45.476897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96cb8924-07cf-42fe-8ba8-c9c3524a52db tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:45.480303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96cb8924-07cf-42fe-8ba8-c9c3524a52db tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:45.482298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96cb8924-07cf-42fe-8ba8-c9c3524a52db tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:45.483721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-96cb8924-07cf-42fe-8ba8-c9c3524a52db tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:45.602320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-51693ee6-4571-438f-b142-d48518187f98 req-78f9f550-104e-44ef-a597-f2e4115ffe3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a729e84-2942-45d8-a50b-c731bf30cb21", "tag": "f3241ea7-9d3f-43e9-bcc6-45b4d0e4dcd7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:45.624463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-51693ee6-4571-438f-b142-d48518187f98 req-78f9f550-104e-44ef-a597-f2e4115ffe3e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:45.625016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-51693ee6-4571-438f-b142-d48518187f98 req-78f9f550-104e-44ef-a597-f2e4115ffe3e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:45.654376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-96cb8924-07cf-42fe-8ba8-c9c3524a52db tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lazy-loading 'services' on Instance uuid 8d42b7f9-83a8-4390-afe2-a596731808ad {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:03:45.660802 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-51693ee6-4571-438f-b142-d48518187f98 req-78f9f550-104e-44ef-a597-f2e4115ffe3e service nova] Creating event network-changed:f3241ea7-9d3f-43e9-bcc6-45b4d0e4dcd7 for instance 0a729e84-2942-45d8-a50b-c731bf30cb21 on n-h1-767704-28 Jul 14 15:03:45.667949 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-51693ee6-4571-438f-b142-d48518187f98 req-78f9f550-104e-44ef-a597-f2e4115ffe3e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.713765 Jul 14 15:03:45.669348 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2938/5842] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:03:45.858599 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-96cb8924-07cf-42fe-8ba8-c9c3524a52db tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad/os-volume_attachments/e61a5bf1-22ec-4613-856c-203d2c28a051" status: 202 len: 0 microversion: 2.1 time: 0.397076 Jul 14 15:03:45.860743 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2905/5843] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:03:45 2022] DELETE /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad/os-volume_attachments/e61a5bf1-22ec-4613-856c-203d2c28a051 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:03:46.345790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1f338290-6551-4847-914c-fc504dfd7d67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:46.346823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1f338290-6551-4847-914c-fc504dfd7d67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:46.365937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f338290-6551-4847-914c-fc504dfd7d67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:46.366690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f338290-6551-4847-914c-fc504dfd7d67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:46.375398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f338290-6551-4847-914c-fc504dfd7d67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:46.376165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1f338290-6551-4847-914c-fc504dfd7d67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:46.487411 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1f338290-6551-4847-914c-fc504dfd7d67 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments/cb4643cd-29a2-48df-80b2-dbc6a6ba0a0b" status: 200 len: 194 microversion: 2.1 time: 0.147267 Jul 14 15:03:46.504932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-214c0de3-803d-46da-88d9-f590585ea203 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:46.506603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-214c0de3-803d-46da-88d9-f590585ea203 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:46.507208 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2939/5844] 10.222.0.81 () {58 vars in 1412 bytes} [Thu Jul 14 15:03:46 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments/cb4643cd-29a2-48df-80b2-dbc6a6ba0a0b => generated 194 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:46.540913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-214c0de3-803d-46da-88d9-f590585ea203 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:46.545153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-214c0de3-803d-46da-88d9-f590585ea203 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:46.546409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-214c0de3-803d-46da-88d9-f590585ea203 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:46.547319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-214c0de3-803d-46da-88d9-f590585ea203 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:46.827676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-214c0de3-803d-46da-88d9-f590585ea203 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lazy-loading 'services' on Instance uuid d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:03:47.065374 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-214c0de3-803d-46da-88d9-f590585ea203 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments/cb4643cd-29a2-48df-80b2-dbc6a6ba0a0b" status: 202 len: 0 microversion: 2.1 time: 0.565053 Jul 14 15:03:47.070396 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2906/5845] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:03:46 2022] DELETE /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments/cb4643cd-29a2-48df-80b2-dbc6a6ba0a0b => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:03:55.030422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-73bc0497-90d3-4725-b1ac-42d4c1ff57d8 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:55.034546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-73bc0497-90d3-4725-b1ac-42d4c1ff57d8 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:55.085354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=36 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:55.095660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73bc0497-90d3-4725-b1ac-42d4c1ff57d8 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:55.102582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73bc0497-90d3-4725-b1ac-42d4c1ff57d8 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:55.104549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73bc0497-90d3-4725-b1ac-42d4c1ff57d8 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:55.105375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73bc0497-90d3-4725-b1ac-42d4c1ff57d8 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:55.265185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-73bc0497-90d3-4725-b1ac-42d4c1ff57d8 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:03:55.475138 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-73bc0497-90d3-4725-b1ac-42d4c1ff57d8 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 204 len: 0 microversion: 2.1 time: 0.453033 Jul 14 15:03:55.481035 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2940/5846] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:03:55 2022] DELETE /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:03:55.501249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-db4706f3-97bb-4f71-883d-31ca68f64374 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:55.503916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-db4706f3-97bb-4f71-883d-31ca68f64374 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:55.514990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:55.519679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db4706f3-97bb-4f71-883d-31ca68f64374 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:55.520899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db4706f3-97bb-4f71-883d-31ca68f64374 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:55.523406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db4706f3-97bb-4f71-883d-31ca68f64374 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:55.524528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db4706f3-97bb-4f71-883d-31ca68f64374 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:55.875154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-db4706f3-97bb-4f71-883d-31ca68f64374 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:55.920150 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-db4706f3-97bb-4f71-883d-31ca68f64374 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1513 microversion: 2.1 time: 0.429971 Jul 14 15:03:55.925175 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2907/5847] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:55 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1513 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:56.942313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-64ef9c9b-3a0f-4939-948d-750616b18e18 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:56.943193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-64ef9c9b-3a0f-4939-948d-750616b18e18 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:56.954893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-64ef9c9b-3a0f-4939-948d-750616b18e18 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:56.955377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-64ef9c9b-3a0f-4939-948d-750616b18e18 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:56.957850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-64ef9c9b-3a0f-4939-948d-750616b18e18 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:56.958545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-64ef9c9b-3a0f-4939-948d-750616b18e18 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:57.331422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-64ef9c9b-3a0f-4939-948d-750616b18e18 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:57.342858 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-64ef9c9b-3a0f-4939-948d-750616b18e18 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1513 microversion: 2.1 time: 0.404549 Jul 14 15:03:57.343709 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2941/5848] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:56 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1513 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:58.361371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b83721d2-14ab-46be-82ff-2d954b325a39 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:58.362018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b83721d2-14ab-46be-82ff-2d954b325a39 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:58.395132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b83721d2-14ab-46be-82ff-2d954b325a39 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:58.418274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b83721d2-14ab-46be-82ff-2d954b325a39 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:58.427930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b83721d2-14ab-46be-82ff-2d954b325a39 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:58.428919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b83721d2-14ab-46be-82ff-2d954b325a39 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:58.656158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b83721d2-14ab-46be-82ff-2d954b325a39 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:58.671418 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b83721d2-14ab-46be-82ff-2d954b325a39 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 200 len: 1471 microversion: 2.1 time: 0.313364 Jul 14 15:03:58.672910 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2908/5849] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:58 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:58.953358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-02c69f93-35c0-4dcc-862d-451ded6941a9 req-d9bad2d0-49a6-4785-95df-cc77646da902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d42b7f9-83a8-4390-afe2-a596731808ad", "name": "network-vif-deleted", "tag": "61da9320-48c7-4ae6-81ff-325af1e07c83"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:58.964168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-02c69f93-35c0-4dcc-862d-451ded6941a9 req-d9bad2d0-49a6-4785-95df-cc77646da902 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:58.965201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-02c69f93-35c0-4dcc-862d-451ded6941a9 req-d9bad2d0-49a6-4785-95df-cc77646da902 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:59.023059 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-02c69f93-35c0-4dcc-862d-451ded6941a9 req-d9bad2d0-49a6-4785-95df-cc77646da902 service nova] Creating event network-vif-deleted:61da9320-48c7-4ae6-81ff-325af1e07c83 for instance 8d42b7f9-83a8-4390-afe2-a596731808ad on n-h1-767704-28 Jul 14 15:03:59.030481 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-02c69f93-35c0-4dcc-862d-451ded6941a9 req-d9bad2d0-49a6-4785-95df-cc77646da902 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.448446 Jul 14 15:03:59.035992 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2942/5850] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:59.691642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f4ef14a1-8e9e-4d0d-b322-1cfd983dc6e7 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:59.692483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f4ef14a1-8e9e-4d0d-b322-1cfd983dc6e7 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: 8d42b7f9-83a8-4390-afe2-a596731808ad] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:59.705467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4ef14a1-8e9e-4d0d-b322-1cfd983dc6e7 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:59.705926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4ef14a1-8e9e-4d0d-b322-1cfd983dc6e7 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:59.706716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4ef14a1-8e9e-4d0d-b322-1cfd983dc6e7 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:59.707160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4ef14a1-8e9e-4d0d-b322-1cfd983dc6e7 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:59.760017 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-f4ef14a1-8e9e-4d0d-b322-1cfd983dc6e7 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] HTTP exception thrown: Instance 8d42b7f9-83a8-4390-afe2-a596731808ad could not be found. Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f4ef14a1-8e9e-4d0d-b322-1cfd983dc6e7 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Request method failure captured: Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad HTTP/1.1 Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C9hAgZfh2tEZJ8VXQTQnNuL8aYF21Q5KUYzqeKzzPBZT0IJHknYCFuH4DvRm9Sr3oKrVLN0DOYF0__PJb_4QQtZdJBUm6YRaIzeJdiKjNimC9mumj3hB0AP8Dr0iCCxGIPmaiYFYcGIdcdE3raNjt9Dd1X3OurE2kJS6lhhLqdYXrw Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: e0af80f1f8024f1d8d1e70b3ecf03a8a Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1797295386 Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e0af80f1f8024f1d8d1e70b3ecf03a8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e0af80f1f8024f1d8d1e70b3ecf03a8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e0af80f1f8024f1d8d1e70b3ecf03a8a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e0af80f1f8024f1d8d1e70b3ecf03a8a"}]}] Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesSnapshotTestJSON-1797295386 Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: e0af80f1f8024f1d8d1e70b3ecf03a8a Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1797295386 Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesSnapshotTestJSON-1797295386-project Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: a30beff508f44228a98377afc6c6dbc4 Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesSnapshotTestJSON-1797295386-project Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 8d42b7f9-83a8-4390-afe2-a596731808ad could not be found. Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '8d42b7f9-83a8-4390-afe2-a596731808ad'} Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d42b7f9-83a8-4390-afe2-a596731808ad could not be found. Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d42b7f9-83a8-4390-afe2-a596731808ad could not be found. Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:59.762097 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:03:59.770795 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:59.770795 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:59.770795 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:59.770795 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:03:59.770795 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:03:59.770795 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d42b7f9-83a8-4390-afe2-a596731808ad could not be found. Jul 14 15:03:59.770795 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:03:59.770795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f4ef14a1-8e9e-4d0d-b322-1cfd983dc6e7 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Returning 404 to user: Instance 8d42b7f9-83a8-4390-afe2-a596731808ad could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:03:59.770795 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f4ef14a1-8e9e-4d0d-b322-1cfd983dc6e7 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad" status: 404 len: 111 microversion: 2.1 time: 0.077816 Jul 14 15:03:59.790319 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2909/5851] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:59 2022] GET /compute/v2.1/servers/8d42b7f9-83a8-4390-afe2-a596731808ad => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:03.248710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-970ece82-fb90-4470-820b-e3c0c8c500d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:03.249811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-970ece82-fb90-4470-820b-e3c0c8c500d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:03.260861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-970ece82-fb90-4470-820b-e3c0c8c500d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:03.262081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-970ece82-fb90-4470-820b-e3c0c8c500d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:03.264828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-970ece82-fb90-4470-820b-e3c0c8c500d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:03.266045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-970ece82-fb90-4470-820b-e3c0c8c500d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:03.344586 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-970ece82-fb90-4470-820b-e3c0c8c500d2 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102339 Jul 14 15:04:03.345525 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2943/5852] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:04:03 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:04:03.542732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4ee26fd3-bfb5-4e33-8e33-13b4db2fd7d4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:03.545725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4ee26fd3-bfb5-4e33-8e33-13b4db2fd7d4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:03.557499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ee26fd3-bfb5-4e33-8e33-13b4db2fd7d4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:03.558517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ee26fd3-bfb5-4e33-8e33-13b4db2fd7d4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:03.559822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ee26fd3-bfb5-4e33-8e33-13b4db2fd7d4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:03.560470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ee26fd3-bfb5-4e33-8e33-13b4db2fd7d4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:03.630242 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4ee26fd3-bfb5-4e33-8e33-13b4db2fd7d4 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093737 Jul 14 15:04:03.631036 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2910/5853] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:04:03 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:04:03.717431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f7e58bce-acb7-42b0-a0dd-6c3a1292aace tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:03.718010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f7e58bce-acb7-42b0-a0dd-6c3a1292aace tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:03.751922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7e58bce-acb7-42b0-a0dd-6c3a1292aace tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:03.758265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7e58bce-acb7-42b0-a0dd-6c3a1292aace tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:03.764710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7e58bce-acb7-42b0-a0dd-6c3a1292aace tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:03.766823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f7e58bce-acb7-42b0-a0dd-6c3a1292aace tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:03.847308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f7e58bce-acb7-42b0-a0dd-6c3a1292aace tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:04:04.080088 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f7e58bce-acb7-42b0-a0dd-6c3a1292aace tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 204 len: 0 microversion: 2.1 time: 0.370907 Jul 14 15:04:04.083223 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2944/5854] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:03 2022] DELETE /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:04:04.094433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4857547e-6c6d-47a5-9c97-b30ac227cc41 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:04.095117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4857547e-6c6d-47a5-9c97-b30ac227cc41 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:04.114592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4857547e-6c6d-47a5-9c97-b30ac227cc41 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:04.115708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4857547e-6c6d-47a5-9c97-b30ac227cc41 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:04.117433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4857547e-6c6d-47a5-9c97-b30ac227cc41 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:04.126503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4857547e-6c6d-47a5-9c97-b30ac227cc41 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:04.426422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4857547e-6c6d-47a5-9c97-b30ac227cc41 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:04.441872 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4857547e-6c6d-47a5-9c97-b30ac227cc41 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1674 microversion: 2.1 time: 0.352510 Jul 14 15:04:04.442662 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2911/5855] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:04 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1674 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:05.460781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4627b127-9566-4c63-be4c-bdf3df2f24be tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:05.462432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4627b127-9566-4c63-be4c-bdf3df2f24be tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:05.480539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4627b127-9566-4c63-be4c-bdf3df2f24be tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:05.493779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4627b127-9566-4c63-be4c-bdf3df2f24be tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:05.495814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4627b127-9566-4c63-be4c-bdf3df2f24be tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:05.496526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4627b127-9566-4c63-be4c-bdf3df2f24be tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:05.816374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4627b127-9566-4c63-be4c-bdf3df2f24be tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:05.832579 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4627b127-9566-4c63-be4c-bdf3df2f24be tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1674 microversion: 2.1 time: 0.375879 Jul 14 15:04:05.833710 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2945/5856] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:05 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1674 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:06.851061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-edf824b3-8305-4b60-8909-38dbc0861fa3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:06.852359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-edf824b3-8305-4b60-8909-38dbc0861fa3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:06.870553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-edf824b3-8305-4b60-8909-38dbc0861fa3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:06.871016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-edf824b3-8305-4b60-8909-38dbc0861fa3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:06.871814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-edf824b3-8305-4b60-8909-38dbc0861fa3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:06.872313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-edf824b3-8305-4b60-8909-38dbc0861fa3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:07.081336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-edf824b3-8305-4b60-8909-38dbc0861fa3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:07.097814 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-edf824b3-8305-4b60-8909-38dbc0861fa3 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1674 microversion: 2.1 time: 0.250515 Jul 14 15:04:07.098701 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2912/5857] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:06 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1674 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:07.137447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-878105f0-ac7f-41f8-b6b6-a9321da5af10 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:07.139137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-878105f0-ac7f-41f8-b6b6-a9321da5af10 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:07.159596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-878105f0-ac7f-41f8-b6b6-a9321da5af10 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:07.160058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-878105f0-ac7f-41f8-b6b6-a9321da5af10 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:07.160860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-878105f0-ac7f-41f8-b6b6-a9321da5af10 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:07.161602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-878105f0-ac7f-41f8-b6b6-a9321da5af10 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:07.251919 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-878105f0-ac7f-41f8-b6b6-a9321da5af10 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "POST /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21/action" status: 200 len: 24559 microversion: 2.1 time: 0.120289 Jul 14 15:04:07.253540 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2946/5858] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:07 2022] POST /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21/action => generated 24559 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:04:07.921069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e10eba8a-d98c-4f33-8b43-f5ab6ab453e9 req-decbc685-f963-4322-b9fc-ee47b846beb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0", "name": "network-vif-deleted", "tag": "a9ccdd67-cc86-4995-8fb7-8795d8d6ad7f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:07.947492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e10eba8a-d98c-4f33-8b43-f5ab6ab453e9 req-decbc685-f963-4322-b9fc-ee47b846beb0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:07.948623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e10eba8a-d98c-4f33-8b43-f5ab6ab453e9 req-decbc685-f963-4322-b9fc-ee47b846beb0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:07.967791 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e10eba8a-d98c-4f33-8b43-f5ab6ab453e9 req-decbc685-f963-4322-b9fc-ee47b846beb0 service nova] Creating event network-vif-deleted:a9ccdd67-cc86-4995-8fb7-8795d8d6ad7f for instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 on n-h2-767704-28 Jul 14 15:04:07.982988 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e10eba8a-d98c-4f33-8b43-f5ab6ab453e9 req-decbc685-f963-4322-b9fc-ee47b846beb0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066321 Jul 14 15:04:07.984005 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2913/5859] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:08.124549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-70e3a463-d570-4bf8-800c-50ae2134633b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:08.125260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-70e3a463-d570-4bf8-800c-50ae2134633b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:08.140483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70e3a463-d570-4bf8-800c-50ae2134633b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:08.141164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70e3a463-d570-4bf8-800c-50ae2134633b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:08.141736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70e3a463-d570-4bf8-800c-50ae2134633b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:08.152755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70e3a463-d570-4bf8-800c-50ae2134633b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:08.239304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70e3a463-d570-4bf8-800c-50ae2134633b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:08.239784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70e3a463-d570-4bf8-800c-50ae2134633b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:08.240364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-70e3a463-d570-4bf8-800c-50ae2134633b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lazy-loading 'fault' on Instance uuid d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:04:08.353152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-70e3a463-d570-4bf8-800c-50ae2134633b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e61e6e12c0a4cdda2008953a997411f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2da89f72ce5460ca5c6b01801c6a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:08.366224 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-70e3a463-d570-4bf8-800c-50ae2134633b tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 200 len: 1328 microversion: 2.1 time: 0.246484 Jul 14 15:04:08.366518 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2947/5860] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:08 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 1328 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:09.388147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae6b15ea-0a0f-44c8-aad5-0de32a63839d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:09.389363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae6b15ea-0a0f-44c8-aad5-0de32a63839d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:09.410147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae6b15ea-0a0f-44c8-aad5-0de32a63839d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:09.412858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae6b15ea-0a0f-44c8-aad5-0de32a63839d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:09.414783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae6b15ea-0a0f-44c8-aad5-0de32a63839d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:09.416494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae6b15ea-0a0f-44c8-aad5-0de32a63839d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:09.485363 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-ae6b15ea-0a0f-44c8-aad5-0de32a63839d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] HTTP exception thrown: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae6b15ea-0a0f-44c8-aad5-0de32a63839d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Request method failure captured: Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 HTTP/1.1 Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C7opZHjCssO2SzWb1KVTPSGElrFY6ZP12dF9DA5dfNlTS5BI5fTos38FvfX62W00Z-HI1F40nQHSlax05qqMnR66WzpohbQg_pdoSMTOfK4IVZdzGYQm_jfiT8Tt4lJM74Py1tGsnTPqx_GuXX2uyYdJip80dVbJ_02BubbQN-JNMg Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d2da89f72ce5460ca5c6b01801c6a887 Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d2da89f72ce5460ca5c6b01801c6a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d2da89f72ce5460ca5c6b01801c6a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d2da89f72ce5460ca5c6b01801c6a887", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d2da89f72ce5460ca5c6b01801c6a887"}]}] Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d2da89f72ce5460ca5c6b01801c6a887 Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeTestJSON-512659841-project Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 8e61e6e12c0a4cdda2008953a997411f Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeTestJSON-512659841-project Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'd63d0a8c-d82a-4c0e-84fe-b1f95ed101a0'} Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:09.494536 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:04:09.501435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:09.501435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:09.501435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:09.501435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:09.501435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:09.501435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:09.501435 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:04:09.507493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae6b15ea-0a0f-44c8-aad5-0de32a63839d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Returning 404 to user: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:09.514054 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ae6b15ea-0a0f-44c8-aad5-0de32a63839d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 404 len: 111 microversion: 2.1 time: 0.133726 Jul 14 15:04:09.524209 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2914/5861] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:09 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:09.529875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-971dde9d-1942-481c-a5d2-0cdb8b955f0d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '.version_select at 0x7fd6c4c541f0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:09.596869 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-971dde9d-1942-481c-a5d2-0cdb8b955f0d tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950178346" status: 202 len: 0 microversion: 2.1 time: 0.071798 Jul 14 15:04:09.599906 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2948/5862] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 15:04:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950178346 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:04:11.235798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1156723286", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "883673a0-fc70-4f48-bbc5-d60e7ad09085"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:11.376679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] validate_networks() for [('883673a0-fc70-4f48-bbc5-d60e7ad09085', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:04:12.331386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:04:12.331963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:04:12.332377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:04:12.333123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:04:12.333547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:04:12.349941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:12.350769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:12.353020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:12.353778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:12.367988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:12.384643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Getting quotas for project e0af80f1f8024f1d8d1e70b3ecf03a8a. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:04:12.392285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Getting quotas for user a30beff508f44228a98377afc6c6dbc4 and project e0af80f1f8024f1d8d1e70b3ecf03a8a. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:04:12.409855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:04:12.413510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:04:12.476785 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a55927ce-a6ce-40ab-8721-f19925658e16 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.244914 Jul 14 15:04:12.478361 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2915/5863] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:04:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:04:12.492505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6bb25910-418e-4979-9961-7eac16eb9fe5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:12.494483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6bb25910-418e-4979-9961-7eac16eb9fe5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:12.641330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6bb25910-418e-4979-9961-7eac16eb9fe5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:12.653089 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6bb25910-418e-4979-9961-7eac16eb9fe5 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1219 microversion: 2.1 time: 0.164440 Jul 14 15:04:12.674555 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2949/5864] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:12 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:12.798570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-326390107", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ce470289-c6bd-444a-adef-b1279e186e3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "bce1cdb9-0501-4062-a135-972a001804ef"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:12.909770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] validate_networks() for [('bce1cdb9-0501-4062-a135-972a001804ef', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:04:13.671404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ed0509a9-4a82-4c3e-9663-7ece7fe1fe48 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:13.672031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ed0509a9-4a82-4c3e-9663-7ece7fe1fe48 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:13.685545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed0509a9-4a82-4c3e-9663-7ece7fe1fe48 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:13.686022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed0509a9-4a82-4c3e-9663-7ece7fe1fe48 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:13.686825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed0509a9-4a82-4c3e-9663-7ece7fe1fe48 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:13.687272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed0509a9-4a82-4c3e-9663-7ece7fe1fe48 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:13.700328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:13.732343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:04:13.732923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:04:13.733502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:04:13.734152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:04:13.734744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:04:13.751918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:13.752547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:13.753556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:13.755189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:13.829011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:04:13.842118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for user e77523cc1cca458eb2a1b553aff072be and project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:04:13.844534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ed0509a9-4a82-4c3e-9663-7ece7fe1fe48 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:13.855089 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ed0509a9-4a82-4c3e-9663-7ece7fe1fe48 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1271 microversion: 2.1 time: 0.188337 Jul 14 15:04:13.859171 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2950/5865] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:13 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:13.966013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:04:13.968269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce470289-c6bd-444a-adef-b1279e186e3a',volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:04:14.230354 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b57b722a-f60a-4afe-97d1-1cc28e231783 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.433767 Jul 14 15:04:14.246589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cf095398-4dee-45fa-a5f8-83db50cdaf53 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:14.247240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cf095398-4dee-45fa-a5f8-83db50cdaf53 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:14.251095 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2916/5866] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:04:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:04:14.403200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cf095398-4dee-45fa-a5f8-83db50cdaf53 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:14.415065 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cf095398-4dee-45fa-a5f8-83db50cdaf53 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1070 microversion: 2.1 time: 0.174218 Jul 14 15:04:14.418247 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2951/5867] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:14 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1070 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:14.875871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6303154c-c265-42d1-80b6-af94fb5b5194 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:14.877647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6303154c-c265-42d1-80b6-af94fb5b5194 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:14.893613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6303154c-c265-42d1-80b6-af94fb5b5194 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:14.894983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6303154c-c265-42d1-80b6-af94fb5b5194 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:14.896520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6303154c-c265-42d1-80b6-af94fb5b5194 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:14.910500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6303154c-c265-42d1-80b6-af94fb5b5194 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:15.251914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6303154c-c265-42d1-80b6-af94fb5b5194 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:15.265410 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6303154c-c265-42d1-80b6-af94fb5b5194 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1319 microversion: 2.1 time: 0.396628 Jul 14 15:04:15.277381 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2917/5868] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:14 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:15.435958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f12b4cc0-7cac-4e42-a1d8-c098ecacec2c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:15.437317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f12b4cc0-7cac-4e42-a1d8-c098ecacec2c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:15.456864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f12b4cc0-7cac-4e42-a1d8-c098ecacec2c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:15.457779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f12b4cc0-7cac-4e42-a1d8-c098ecacec2c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:15.460103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f12b4cc0-7cac-4e42-a1d8-c098ecacec2c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:15.461044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f12b4cc0-7cac-4e42-a1d8-c098ecacec2c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:15.711549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f12b4cc0-7cac-4e42-a1d8-c098ecacec2c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:15.725757 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f12b4cc0-7cac-4e42-a1d8-c098ecacec2c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1168 microversion: 2.1 time: 0.294297 Jul 14 15:04:15.738332 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2952/5869] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:15 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1168 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:16.285789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ebaebf6d-0374-4496-a67b-86014cff20bf tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:16.286568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ebaebf6d-0374-4496-a67b-86014cff20bf tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:16.307732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ebaebf6d-0374-4496-a67b-86014cff20bf tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:16.308625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ebaebf6d-0374-4496-a67b-86014cff20bf tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:16.309234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ebaebf6d-0374-4496-a67b-86014cff20bf tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:16.309754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ebaebf6d-0374-4496-a67b-86014cff20bf tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:16.747089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4404d74f-9600-4240-9216-8d227807b9a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:16.748479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4404d74f-9600-4240-9216-8d227807b9a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:16.759932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4404d74f-9600-4240-9216-8d227807b9a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:16.760697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4404d74f-9600-4240-9216-8d227807b9a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:16.761540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4404d74f-9600-4240-9216-8d227807b9a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:16.761994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4404d74f-9600-4240-9216-8d227807b9a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:16.890118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ebaebf6d-0374-4496-a67b-86014cff20bf tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:16.908852 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ebaebf6d-0374-4496-a67b-86014cff20bf tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1319 microversion: 2.1 time: 0.627510 Jul 14 15:04:16.919305 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2918/5870] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:16 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1319 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:17.038901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4404d74f-9600-4240-9216-8d227807b9a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:17.054876 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4404d74f-9600-4240-9216-8d227807b9a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1186 microversion: 2.1 time: 0.312900 Jul 14 15:04:17.068889 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2953/5871] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:16 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1186 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:17.801941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1fbdff4f-b913-4418-9635-69676c0a9499 req-c1854483-3458-4d26-a7b6-af43bcd22be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec58b382-5a25-45f2-9c1b-8aa257382782", "tag": "6e5c47b9-f797-40e5-bbe0-874a8e13ff73"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:17.825068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1fbdff4f-b913-4418-9635-69676c0a9499 req-c1854483-3458-4d26-a7b6-af43bcd22be8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:17.825701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1fbdff4f-b913-4418-9635-69676c0a9499 req-c1854483-3458-4d26-a7b6-af43bcd22be8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:17.856559 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1fbdff4f-b913-4418-9635-69676c0a9499 req-c1854483-3458-4d26-a7b6-af43bcd22be8 service nova] Creating event network-changed:6e5c47b9-f797-40e5-bbe0-874a8e13ff73 for instance ec58b382-5a25-45f2-9c1b-8aa257382782 on n-h2-767704-28 Jul 14 15:04:17.868377 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1fbdff4f-b913-4418-9635-69676c0a9499 req-c1854483-3458-4d26-a7b6-af43bcd22be8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073406 Jul 14 15:04:17.869031 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2919/5872] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:17.930115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2d091c0b-1e59-4f74-b108-a39859d4528b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:17.930940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2d091c0b-1e59-4f74-b108-a39859d4528b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:17.969556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d091c0b-1e59-4f74-b108-a39859d4528b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:17.970327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d091c0b-1e59-4f74-b108-a39859d4528b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:17.974307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d091c0b-1e59-4f74-b108-a39859d4528b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:17.977768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d091c0b-1e59-4f74-b108-a39859d4528b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:18.084157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-968c7e4e-4bc6-4fc8-9429-a83680533194 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:18.087323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-968c7e4e-4bc6-4fc8-9429-a83680533194 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:18.113246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-968c7e4e-4bc6-4fc8-9429-a83680533194 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:18.114673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-968c7e4e-4bc6-4fc8-9429-a83680533194 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:18.119479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-968c7e4e-4bc6-4fc8-9429-a83680533194 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:18.123793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-968c7e4e-4bc6-4fc8-9429-a83680533194 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:19.035686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2d091c0b-1e59-4f74-b108-a39859d4528b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:19.051884 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2d091c0b-1e59-4f74-b108-a39859d4528b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1319 microversion: 2.1 time: 1.125830 Jul 14 15:04:19.055162 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2954/5873] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:17 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1319 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:19.092640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-968c7e4e-4bc6-4fc8-9429-a83680533194 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:19.101595 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-968c7e4e-4bc6-4fc8-9429-a83680533194 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1228 microversion: 2.1 time: 1.030269 Jul 14 15:04:19.106082 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2920/5874] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:18 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1228 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:20.082420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-791189c5-d2a3-4a53-b730-9a8a3e7d7591 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:20.083213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-791189c5-d2a3-4a53-b730-9a8a3e7d7591 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:20.099872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-791189c5-d2a3-4a53-b730-9a8a3e7d7591 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:20.111039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-791189c5-d2a3-4a53-b730-9a8a3e7d7591 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:20.112374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-791189c5-d2a3-4a53-b730-9a8a3e7d7591 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:20.112970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-791189c5-d2a3-4a53-b730-9a8a3e7d7591 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:20.124307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-64f6a530-76ff-43bb-9115-6f00a6c7eb6f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:20.126659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-64f6a530-76ff-43bb-9115-6f00a6c7eb6f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:20.142222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64f6a530-76ff-43bb-9115-6f00a6c7eb6f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:20.144544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64f6a530-76ff-43bb-9115-6f00a6c7eb6f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:20.146783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64f6a530-76ff-43bb-9115-6f00a6c7eb6f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:20.147498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-64f6a530-76ff-43bb-9115-6f00a6c7eb6f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:21.229737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-791189c5-d2a3-4a53-b730-9a8a3e7d7591 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:21.251003 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-791189c5-d2a3-4a53-b730-9a8a3e7d7591 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1319 microversion: 2.1 time: 1.173105 Jul 14 15:04:21.262152 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2955/5875] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:20 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1319 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:21.270370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3166edfa-a26f-4798-818c-d87aa3ef8b39 req-e6f7a60c-4121-4d60-b338-1b672bf81495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be69051-1f14-4d37-810d-d29624714f45", "tag": "6ae42087-6009-4b04-8bb7-574891960f82"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:21.288783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3166edfa-a26f-4798-818c-d87aa3ef8b39 req-e6f7a60c-4121-4d60-b338-1b672bf81495 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:21.289272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3166edfa-a26f-4798-818c-d87aa3ef8b39 req-e6f7a60c-4121-4d60-b338-1b672bf81495 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:21.319737 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3166edfa-a26f-4798-818c-d87aa3ef8b39 req-e6f7a60c-4121-4d60-b338-1b672bf81495 service nova] Creating event network-changed:6ae42087-6009-4b04-8bb7-574891960f82 for instance 6be69051-1f14-4d37-810d-d29624714f45 on n-h1-767704-28 Jul 14 15:04:21.335051 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3166edfa-a26f-4798-818c-d87aa3ef8b39 req-e6f7a60c-4121-4d60-b338-1b672bf81495 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071439 Jul 14 15:04:21.335679 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2956/5876] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:21.336792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-64f6a530-76ff-43bb-9115-6f00a6c7eb6f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:21.387461 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-64f6a530-76ff-43bb-9115-6f00a6c7eb6f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1228 microversion: 2.1 time: 1.268890 Jul 14 15:04:21.408403 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2921/5877] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:20 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1228 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:22.127414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aa1425ad-52ae-4e31-a7fb-f7098c101d76 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:22.128595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aa1425ad-52ae-4e31-a7fb-f7098c101d76 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:22.144118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa1425ad-52ae-4e31-a7fb-f7098c101d76 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:22.145046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa1425ad-52ae-4e31-a7fb-f7098c101d76 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:22.150737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa1425ad-52ae-4e31-a7fb-f7098c101d76 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:22.153003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aa1425ad-52ae-4e31-a7fb-f7098c101d76 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:22.194953 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-aa1425ad-52ae-4e31-a7fb-f7098c101d76 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] HTTP exception thrown: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aa1425ad-52ae-4e31-a7fb-f7098c101d76 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Request method failure captured: Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 HTTP/1.1 Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C7opZHjCssO2SzWb1KVTPSGElrFY6ZP12dF9DA5dfNlTS5BI5fTos38FvfX62W00Z-HI1F40nQHSlax05qqMnR66WzpohbQg_pdoSMTOfK4IVZdzGYQm_jfiT8Tt4lJM74Py1tGsnTPqx_GuXX2uyYdJip80dVbJ_02BubbQN-JNMg Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d2da89f72ce5460ca5c6b01801c6a887 Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d2da89f72ce5460ca5c6b01801c6a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d2da89f72ce5460ca5c6b01801c6a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d2da89f72ce5460ca5c6b01801c6a887", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d2da89f72ce5460ca5c6b01801c6a887"}]}] Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d2da89f72ce5460ca5c6b01801c6a887 Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachVolumeTestJSON-512659841-project Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 8e61e6e12c0a4cdda2008953a997411f Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachVolumeTestJSON-512659841-project Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'd63d0a8c-d82a-4c0e-84fe-b1f95ed101a0'} Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:22.200622 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:22.207311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:22.207311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:22.207311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:22.207311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:22.207311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:22.207311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:22.207311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:22.207311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:22.207311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:22.207311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:22.207311 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:22.210078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aa1425ad-52ae-4e31-a7fb-f7098c101d76 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Returning 404 to user: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:22.211810 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aa1425ad-52ae-4e31-a7fb-f7098c101d76 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 404 len: 111 microversion: 2.1 time: 0.089080 Jul 14 15:04:22.218109 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2957/5878] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:22 2022] DELETE /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:22.230569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ab462f59-685e-4e22-8076-36485f0d6b5f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:22.231202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ab462f59-685e-4e22-8076-36485f0d6b5f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:22.249649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab462f59-685e-4e22-8076-36485f0d6b5f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:22.250318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab462f59-685e-4e22-8076-36485f0d6b5f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:22.251237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab462f59-685e-4e22-8076-36485f0d6b5f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:22.251687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab462f59-685e-4e22-8076-36485f0d6b5f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:22.268125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f332bb7f-701f-4670-a6a5-4c168d836605 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:22.269364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f332bb7f-701f-4670-a6a5-4c168d836605 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:22.281621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f332bb7f-701f-4670-a6a5-4c168d836605 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:22.282302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f332bb7f-701f-4670-a6a5-4c168d836605 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:22.283260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f332bb7f-701f-4670-a6a5-4c168d836605 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:22.283870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f332bb7f-701f-4670-a6a5-4c168d836605 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:22.288742 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-ab462f59-685e-4e22-8076-36485f0d6b5f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] HTTP exception thrown: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ab462f59-685e-4e22-8076-36485f0d6b5f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Request method failure captured: Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 HTTP/1.1 Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C7opZHjCssO2SzWb1KVTPSGElrFY6ZP12dF9DA5dfNlTS5BI5fTos38FvfX62W00Z-HI1F40nQHSlax05qqMnR66WzpohbQg_pdoSMTOfK4IVZdzGYQm_jfiT8Tt4lJM74Py1tGsnTPqx_GuXX2uyYdJip80dVbJ_02BubbQN-JNMg Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: d2da89f72ce5460ca5c6b01801c6a887 Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d2da89f72ce5460ca5c6b01801c6a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d2da89f72ce5460ca5c6b01801c6a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d2da89f72ce5460ca5c6b01801c6a887", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d2da89f72ce5460ca5c6b01801c6a887"}]}] Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: d2da89f72ce5460ca5c6b01801c6a887 Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-AttachVolumeTestJSON-512659841-project Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 8e61e6e12c0a4cdda2008953a997411f Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-AttachVolumeTestJSON-512659841-project Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'd63d0a8c-d82a-4c0e-84fe-b1f95ed101a0'} Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:22.290692 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:04:22.297778 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:22.297778 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:22.297778 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:22.297778 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:22.297778 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:22.297778 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. Jul 14 15:04:22.297778 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:04:22.301607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ab462f59-685e-4e22-8076-36485f0d6b5f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Returning 404 to user: Instance d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:22.302837 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ab462f59-685e-4e22-8076-36485f0d6b5f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0" status: 404 len: 111 microversion: 2.1 time: 0.076852 Jul 14 15:04:22.305859 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2922/5879] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:22 2022] GET /compute/v2.1/servers/d63d0a8c-d82a-4c0e-84fe-b1f95ed101a0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:22.426833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d163170d-79ad-45fa-b476-e772a9fdb13a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:22.428471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d163170d-79ad-45fa-b476-e772a9fdb13a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:22.439763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d163170d-79ad-45fa-b476-e772a9fdb13a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:22.440294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d163170d-79ad-45fa-b476-e772a9fdb13a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:22.441197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d163170d-79ad-45fa-b476-e772a9fdb13a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:22.441728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d163170d-79ad-45fa-b476-e772a9fdb13a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:22.979988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f332bb7f-701f-4670-a6a5-4c168d836605 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:22.999016 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f332bb7f-701f-4670-a6a5-4c168d836605 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1319 microversion: 2.1 time: 0.734542 Jul 14 15:04:23.000103 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2958/5880] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:22 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1319 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:23.040973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d163170d-79ad-45fa-b476-e772a9fdb13a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:23.059092 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d163170d-79ad-45fa-b476-e772a9fdb13a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1228 microversion: 2.1 time: 0.636993 Jul 14 15:04:23.084609 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2923/5881] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:22 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1228 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:24.016758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0ef53ed9-7bc1-4c5e-a343-2d1ec7118a3d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:24.017401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0ef53ed9-7bc1-4c5e-a343-2d1ec7118a3d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:24.024497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ef53ed9-7bc1-4c5e-a343-2d1ec7118a3d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.024994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ef53ed9-7bc1-4c5e-a343-2d1ec7118a3d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.025826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ef53ed9-7bc1-4c5e-a343-2d1ec7118a3d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.026274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ef53ed9-7bc1-4c5e-a343-2d1ec7118a3d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.101356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7312a18f-08a7-46e1-9df2-af5786191ca6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:24.102578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7312a18f-08a7-46e1-9df2-af5786191ca6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:24.116820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:24.117595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:24.119292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7312a18f-08a7-46e1-9df2-af5786191ca6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.120474 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7312a18f-08a7-46e1-9df2-af5786191ca6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.121355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7312a18f-08a7-46e1-9df2-af5786191ca6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.125093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7312a18f-08a7-46e1-9df2-af5786191ca6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.410214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:24.534026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7312a18f-08a7-46e1-9df2-af5786191ca6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:24.543123 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7312a18f-08a7-46e1-9df2-af5786191ca6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1228 microversion: 2.1 time: 0.445411 Jul 14 15:04:24.543730 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2924/5882] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:24 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1228 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:24.547665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0ef53ed9-7bc1-4c5e-a343-2d1ec7118a3d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:24.558309 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0ef53ed9-7bc1-4c5e-a343-2d1ec7118a3d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1319 microversion: 2.1 time: 0.545288 Jul 14 15:04:24.560118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d169985a-98b3-4218-9c9e-6007da7b38ee req-d0c72fbd-b4f8-4fa0-82e1-ee923d5a6c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec58b382-5a25-45f2-9c1b-8aa257382782", "name": "network-vif-plugged", "status": "completed", "tag": "6e5c47b9-f797-40e5-bbe0-874a8e13ff73"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:24.573710 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2959/5883] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:24 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1319 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:24.582575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d169985a-98b3-4218-9c9e-6007da7b38ee req-d0c72fbd-b4f8-4fa0-82e1-ee923d5a6c8b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.587778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d169985a-98b3-4218-9c9e-6007da7b38ee req-d0c72fbd-b4f8-4fa0-82e1-ee923d5a6c8b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.605423 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d169985a-98b3-4218-9c9e-6007da7b38ee req-d0c72fbd-b4f8-4fa0-82e1-ee923d5a6c8b service nova] Creating event network-vif-plugged:6e5c47b9-f797-40e5-bbe0-874a8e13ff73 for instance ec58b382-5a25-45f2-9c1b-8aa257382782 on n-h2-767704-28 Jul 14 15:04:24.612705 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d169985a-98b3-4218-9c9e-6007da7b38ee req-d0c72fbd-b4f8-4fa0-82e1-ee923d5a6c8b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067639 Jul 14 15:04:24.613411 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2925/5884] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:25.041303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f1604d1-d19e-4ab0-9d31-883cbb4691a0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Action: 'create', calling method: .version_select at 0x7fd6c4b8e1f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2109286522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+K760l9n/CZv0Snb0T95h+ShZQiG2ectdplzzGNGj2tHqpY8gkLJrmlbeSj7JbgmxbUEWXjjwqrQse0RHNO72srQz1N7m5MYqWAc/vAqhEVLTG1srIS4rUNW31v4CG2w=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:25.087417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-3f1604d1-d19e-4ab0-9d31-883cbb4691a0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Getting quotas for project c5b1a0afc1a942f7b4ce2d0b20739da1. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:04:25.108710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-3f1604d1-d19e-4ab0-9d31-883cbb4691a0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Getting quotas for user 663974b480e3425a9a31d4eee8c946b5 and project c5b1a0afc1a942f7b4ce2d0b20739da1. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:04:25.177302 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f1604d1-d19e-4ab0-9d31-883cbb4691a0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.139843 Jul 14 15:04:25.177950 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2960/5885] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:04:25 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:25.561474 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d662d465-05b4-4440-938a-0b29ebfd0590 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:25.562194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d662d465-05b4-4440-938a-0b29ebfd0590 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:25.576440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ed82ae99-8c34-4ed1-b994-93737ea01c1e tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:25.577167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ed82ae99-8c34-4ed1-b994-93737ea01c1e tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:25.586960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:25.587705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:25.594973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed82ae99-8c34-4ed1-b994-93737ea01c1e tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:25.596602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d662d465-05b4-4440-938a-0b29ebfd0590 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:25.597076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d662d465-05b4-4440-938a-0b29ebfd0590 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:25.597569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed82ae99-8c34-4ed1-b994-93737ea01c1e tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:25.599196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed82ae99-8c34-4ed1-b994-93737ea01c1e tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:25.628845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed82ae99-8c34-4ed1-b994-93737ea01c1e tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:25.629621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d662d465-05b4-4440-938a-0b29ebfd0590 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:25.630530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d662d465-05b4-4440-938a-0b29ebfd0590 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:26.200761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d662d465-05b4-4440-938a-0b29ebfd0590 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:26.213953 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d662d465-05b4-4440-938a-0b29ebfd0590 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1228 microversion: 2.1 time: 0.657647 Jul 14 15:04:26.223282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ed82ae99-8c34-4ed1-b994-93737ea01c1e tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:26.223890 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2926/5886] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:25 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1228 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:26.233824 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ed82ae99-8c34-4ed1-b994-93737ea01c1e tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1319 microversion: 2.1 time: 0.662207 Jul 14 15:04:26.237251 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2961/5887] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:25 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1319 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:27.233079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-67812c41-12af-4f2d-8f1e-b7b42187b655 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:27.234972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-67812c41-12af-4f2d-8f1e-b7b42187b655 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:27.251350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-67812c41-12af-4f2d-8f1e-b7b42187b655 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:27.252228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-67812c41-12af-4f2d-8f1e-b7b42187b655 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:27.252979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7589092a-7863-491c-ae59-38f9f60c307b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:27.253604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7589092a-7863-491c-ae59-38f9f60c307b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:27.254155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-67812c41-12af-4f2d-8f1e-b7b42187b655 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:27.254832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-67812c41-12af-4f2d-8f1e-b7b42187b655 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:27.272955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7589092a-7863-491c-ae59-38f9f60c307b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:27.273445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7589092a-7863-491c-ae59-38f9f60c307b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:27.274261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7589092a-7863-491c-ae59-38f9f60c307b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:27.274717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7589092a-7863-491c-ae59-38f9f60c307b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:28.117324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7589092a-7863-491c-ae59-38f9f60c307b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:28.126425 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7589092a-7863-491c-ae59-38f9f60c307b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1509 microversion: 2.1 time: 0.877448 Jul 14 15:04:28.129099 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2962/5888] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:27 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1509 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:28.150074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-74eae3b1-c2c8-4c2f-8763-418754eb64f2 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37074aa3-96f5-42a2-98f7-f8b1a66a18e8", "device": "/dev/sdb"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:28.200222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-74eae3b1-c2c8-4c2f-8763-418754eb64f2 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:28.200222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74eae3b1-c2c8-4c2f-8763-418754eb64f2 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:28.200222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74eae3b1-c2c8-4c2f-8763-418754eb64f2 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:28.200222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74eae3b1-c2c8-4c2f-8763-418754eb64f2 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:28.200222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74eae3b1-c2c8-4c2f-8763-418754eb64f2 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:28.200517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-67812c41-12af-4f2d-8f1e-b7b42187b655 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:28.200517 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-67812c41-12af-4f2d-8f1e-b7b42187b655 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1228 microversion: 2.1 time: 0.962453 Jul 14 15:04:28.200517 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2927/5889] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:27 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1228 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:28.471531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-51601974", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "e1dc08d8-d685-4bd5-aaac-b942b675194a"}], "key_name": "tempest-TestNetworkBasicOps-2109286522", "security_groups": [{"name": "tempest-secgroup-smoke-500707401"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:28.684209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] validate_networks() for [('e1dc08d8-d685-4bd5-aaac-b942b675194a', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:04:28.740100 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-74eae3b1-c2c8-4c2f-8763-418754eb64f2 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "POST /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.593967 Jul 14 15:04:28.741307 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2963/5890] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 15:04:28 2022] POST /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782/os-volume_attachments => generated 194 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:29.184223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-69dc4992-44b7-48c9-8fa9-dca04027078f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:29.189404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-69dc4992-44b7-48c9-8fa9-dca04027078f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:29.215553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69dc4992-44b7-48c9-8fa9-dca04027078f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:29.218634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69dc4992-44b7-48c9-8fa9-dca04027078f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:29.219883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69dc4992-44b7-48c9-8fa9-dca04027078f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:29.222451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-69dc4992-44b7-48c9-8fa9-dca04027078f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:29.268358 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-69dc4992-44b7-48c9-8fa9-dca04027078f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] HTTP exception thrown: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-69dc4992-44b7-48c9-8fa9-dca04027078f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Request method failure captured: Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c HTTP/1.1 Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C7opZHjCssO2SzWb1KVTPSGElrFY6ZP12dF9DA5dfNlTS5BI5fTos38FvfX62W00Z-HI1F40nQHSlax05qqMnR66WzpohbQg_pdoSMTOfK4IVZdzGYQm_jfiT8Tt4lJM74Py1tGsnTPqx_GuXX2uyYdJip80dVbJ_02BubbQN-JNMg Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d2da89f72ce5460ca5c6b01801c6a887 Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d2da89f72ce5460ca5c6b01801c6a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d2da89f72ce5460ca5c6b01801c6a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d2da89f72ce5460ca5c6b01801c6a887", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d2da89f72ce5460ca5c6b01801c6a887"}]}] Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d2da89f72ce5460ca5c6b01801c6a887 Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachVolumeTestJSON-512659841-project Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 8e61e6e12c0a4cdda2008953a997411f Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachVolumeTestJSON-512659841-project Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'accee1e3-de25-42fe-b062-e6c330d4e88c'} Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:29.283021 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:29.285923 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:04:29.285923 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:29.285923 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:29.285923 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:29.285923 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:29.285923 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:29.285923 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:29.285923 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:29.285923 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:29.285923 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:04:29.285923 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:29.290171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-69dc4992-44b7-48c9-8fa9-dca04027078f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Returning 404 to user: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:29.291287 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-69dc4992-44b7-48c9-8fa9-dca04027078f tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "DELETE /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 404 len: 111 microversion: 2.1 time: 0.113080 Jul 14 15:04:29.293849 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2964/5891] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:29 2022] DELETE /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:04:29.299576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e12a7bbd-7903-4b2a-93f1-6c121d574de0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:29.304599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e12a7bbd-7903-4b2a-93f1-6c121d574de0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:29.313366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e12a7bbd-7903-4b2a-93f1-6c121d574de0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:29.319766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e12a7bbd-7903-4b2a-93f1-6c121d574de0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:29.321594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e12a7bbd-7903-4b2a-93f1-6c121d574de0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:29.322293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e12a7bbd-7903-4b2a-93f1-6c121d574de0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:29.893998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:04:29.894932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e12a7bbd-7903-4b2a-93f1-6c121d574de0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:29.895372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:04:29.896822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:04:29.897418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:04:29.898012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:04:29.915601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:29.922279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:29.923415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:29.924016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:29.928539 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e12a7bbd-7903-4b2a-93f1-6c121d574de0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1216 microversion: 2.1 time: 0.633250 Jul 14 15:04:29.931150 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2965/5892] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:29 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1216 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:29.941484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e4185e2-f14e-4606-b5da-d80f2b99a519 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:29.949524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0e4185e2-f14e-4606-b5da-d80f2b99a519 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] [instance: accee1e3-de25-42fe-b062-e6c330d4e88c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:29.974796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e4185e2-f14e-4606-b5da-d80f2b99a519 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:29.979548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Getting quotas for project c5b1a0afc1a942f7b4ce2d0b20739da1. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:04:29.980697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e4185e2-f14e-4606-b5da-d80f2b99a519 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:29.981836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e4185e2-f14e-4606-b5da-d80f2b99a519 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:29.988659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e4185e2-f14e-4606-b5da-d80f2b99a519 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:30.002580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Getting quotas for user 663974b480e3425a9a31d4eee8c946b5 and project c5b1a0afc1a942f7b4ce2d0b20739da1. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:04:30.045150 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-0e4185e2-f14e-4606-b5da-d80f2b99a519 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] HTTP exception thrown: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:04:30.045353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e4185e2-f14e-4606-b5da-d80f2b99a519 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Request method failure captured: Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c HTTP/1.1 Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C7opZHjCssO2SzWb1KVTPSGElrFY6ZP12dF9DA5dfNlTS5BI5fTos38FvfX62W00Z-HI1F40nQHSlax05qqMnR66WzpohbQg_pdoSMTOfK4IVZdzGYQm_jfiT8Tt4lJM74Py1tGsnTPqx_GuXX2uyYdJip80dVbJ_02BubbQN-JNMg Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: d2da89f72ce5460ca5c6b01801c6a887 Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d2da89f72ce5460ca5c6b01801c6a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d2da89f72ce5460ca5c6b01801c6a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d2da89f72ce5460ca5c6b01801c6a887", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d2da89f72ce5460ca5c6b01801c6a887"}]}] Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: d2da89f72ce5460ca5c6b01801c6a887 Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-512659841 Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-AttachVolumeTestJSON-512659841-project Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 8e61e6e12c0a4cdda2008953a997411f Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-AttachVolumeTestJSON-512659841-project Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'accee1e3-de25-42fe-b062-e6c330d4e88c'} Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:30.048062 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:30.051328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:30.051328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:30.051328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:30.051328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:30.051328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:30.051328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. Jul 14 15:04:30.051328 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:30.053253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:04:30.054121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e4185e2-f14e-4606-b5da-d80f2b99a519 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] Returning 404 to user: Instance accee1e3-de25-42fe-b062-e6c330d4e88c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:30.056502 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0e4185e2-f14e-4606-b5da-d80f2b99a519 tempest-AttachVolumeTestJSON-512659841 tempest-AttachVolumeTestJSON-512659841-project] 10.222.0.81 "GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c" status: 404 len: 111 microversion: 2.1 time: 0.124039 Jul 14 15:04:30.057807 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2966/5893] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:29 2022] GET /compute/v2.1/servers/accee1e3-de25-42fe-b062-e6c330d4e88c => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:30.189885 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-535a89c3-ee6f-45e6-a1db-ba52105a8dee tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.722239 Jul 14 15:04:30.191125 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2928/5894] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:04:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:04:30.201437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7fcd6fca-fbd4-4884-b5e3-f0ea09195be7 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:30.202181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7fcd6fca-fbd4-4884-b5e3-f0ea09195be7 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:30.947598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a51f346b-fa36-43a8-a8e6-02747a602e4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:30.949767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a51f346b-fa36-43a8-a8e6-02747a602e4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:30.978940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a51f346b-fa36-43a8-a8e6-02747a602e4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:30.985493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a51f346b-fa36-43a8-a8e6-02747a602e4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:30.991232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a51f346b-fa36-43a8-a8e6-02747a602e4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:30.991850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a51f346b-fa36-43a8-a8e6-02747a602e4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:31.295032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7fcd6fca-fbd4-4884-b5e3-f0ea09195be7 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:31.316777 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7fcd6fca-fbd4-4884-b5e3-f0ea09195be7 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1247 microversion: 2.1 time: 1.119619 Jul 14 15:04:31.318030 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2967/5895] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:30 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1247 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:32.054928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a51f346b-fa36-43a8-a8e6-02747a602e4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:32.092116 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a51f346b-fa36-43a8-a8e6-02747a602e4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1216 microversion: 2.1 time: 1.149369 Jul 14 15:04:32.092908 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2929/5896] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:30 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1216 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:32.344963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d07ce2f6-d886-4c8e-ba4b-3c28cf177f98 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:32.346191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d07ce2f6-d886-4c8e-ba4b-3c28cf177f98 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:32.393408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d07ce2f6-d886-4c8e-ba4b-3c28cf177f98 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:32.394754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d07ce2f6-d886-4c8e-ba4b-3c28cf177f98 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:32.398922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d07ce2f6-d886-4c8e-ba4b-3c28cf177f98 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:32.399510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d07ce2f6-d886-4c8e-ba4b-3c28cf177f98 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:32.637383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d07ce2f6-d886-4c8e-ba4b-3c28cf177f98 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:32.654852 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d07ce2f6-d886-4c8e-ba4b-3c28cf177f98 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1317 microversion: 2.1 time: 0.317409 Jul 14 15:04:32.656147 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2968/5897] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:32 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:33.110654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6b05e4e3-6008-4f75-8959-badb5feca6ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:33.112121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6b05e4e3-6008-4f75-8959-badb5feca6ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:33.130114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b05e4e3-6008-4f75-8959-badb5feca6ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:33.131421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b05e4e3-6008-4f75-8959-badb5feca6ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:33.134010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b05e4e3-6008-4f75-8959-badb5feca6ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:33.137885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b05e4e3-6008-4f75-8959-badb5feca6ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:33.679879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-924d7741-fc62-4ff2-b671-5dcfa5d43292 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:33.680813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-924d7741-fc62-4ff2-b671-5dcfa5d43292 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:33.700196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-924d7741-fc62-4ff2-b671-5dcfa5d43292 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:33.704877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-924d7741-fc62-4ff2-b671-5dcfa5d43292 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:33.707735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-924d7741-fc62-4ff2-b671-5dcfa5d43292 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:33.715416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-924d7741-fc62-4ff2-b671-5dcfa5d43292 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:33.918436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-924d7741-fc62-4ff2-b671-5dcfa5d43292 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:33.933879 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-924d7741-fc62-4ff2-b671-5dcfa5d43292 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1305 microversion: 2.1 time: 0.264021 Jul 14 15:04:33.935787 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2969/5898] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:33 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1305 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:33.944409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6b05e4e3-6008-4f75-8959-badb5feca6ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:33.961180 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6b05e4e3-6008-4f75-8959-badb5feca6ae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1216 microversion: 2.1 time: 0.851874 Jul 14 15:04:33.963155 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2930/5899] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:33 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1216 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:34.953619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b8ce8e12-ab86-4075-9a56-09664cdb9490 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:34.954242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b8ce8e12-ab86-4075-9a56-09664cdb9490 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:34.967291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8ce8e12-ab86-4075-9a56-09664cdb9490 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:34.967974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8ce8e12-ab86-4075-9a56-09664cdb9490 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:34.977792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8ce8e12-ab86-4075-9a56-09664cdb9490 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:34.978491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b8ce8e12-ab86-4075-9a56-09664cdb9490 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:34.983961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be0d05de-22ad-4066-9662-290b6a1837b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:34.985309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-be0d05de-22ad-4066-9662-290b6a1837b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:35.006315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be0d05de-22ad-4066-9662-290b6a1837b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:35.007548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be0d05de-22ad-4066-9662-290b6a1837b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:35.009674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be0d05de-22ad-4066-9662-290b6a1837b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:35.010568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be0d05de-22ad-4066-9662-290b6a1837b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:35.119321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b8ce8e12-ab86-4075-9a56-09664cdb9490 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:35.128018 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b8ce8e12-ab86-4075-9a56-09664cdb9490 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1305 microversion: 2.1 time: 0.178398 Jul 14 15:04:35.128612 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2970/5900] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:34 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:35.830036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-be0d05de-22ad-4066-9662-290b6a1837b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:35.839740 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-be0d05de-22ad-4066-9662-290b6a1837b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1216 microversion: 2.1 time: 0.860629 Jul 14 15:04:35.846122 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2931/5901] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:34 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1216 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:36.146008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-376c9475-785d-42b6-b597-243dfeae2a86 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:36.147171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-376c9475-785d-42b6-b597-243dfeae2a86 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:36.159472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-376c9475-785d-42b6-b597-243dfeae2a86 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:36.160256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-376c9475-785d-42b6-b597-243dfeae2a86 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:36.161879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-376c9475-785d-42b6-b597-243dfeae2a86 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:36.170810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-376c9475-785d-42b6-b597-243dfeae2a86 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:36.220355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:36.737692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-376c9475-785d-42b6-b597-243dfeae2a86 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:36.746253 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-376c9475-785d-42b6-b597-243dfeae2a86 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1372 microversion: 2.1 time: 0.604068 Jul 14 15:04:36.753317 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2971/5902] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:36 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1372 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:36.864639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5a6ddf3d-fdd3-4056-843f-fd0d5e2e619a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:36.865269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5a6ddf3d-fdd3-4056-843f-fd0d5e2e619a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:36.886509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a6ddf3d-fdd3-4056-843f-fd0d5e2e619a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:36.887134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a6ddf3d-fdd3-4056-843f-fd0d5e2e619a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:36.888087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a6ddf3d-fdd3-4056-843f-fd0d5e2e619a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:36.888545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5a6ddf3d-fdd3-4056-843f-fd0d5e2e619a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:37.778874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b2a88fb2-659b-4577-968c-687b0976e7d6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:37.779512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b2a88fb2-659b-4577-968c-687b0976e7d6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:37.787737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2a88fb2-659b-4577-968c-687b0976e7d6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:37.788200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2a88fb2-659b-4577-968c-687b0976e7d6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:37.797118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2a88fb2-659b-4577-968c-687b0976e7d6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:37.797884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2a88fb2-659b-4577-968c-687b0976e7d6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:38.291430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5a6ddf3d-fdd3-4056-843f-fd0d5e2e619a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:38.306503 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5a6ddf3d-fdd3-4056-843f-fd0d5e2e619a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1216 microversion: 2.1 time: 1.447791 Jul 14 15:04:38.307659 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2932/5903] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:36 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1216 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:38.488023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b2a88fb2-659b-4577-968c-687b0976e7d6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:38.501928 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b2a88fb2-659b-4577-968c-687b0976e7d6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1372 microversion: 2.1 time: 0.727131 Jul 14 15:04:38.503781 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2972/5904] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:37 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1372 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:38.995293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0ee57953-3ee4-4473-9cb6-2a0aa1a9ea23 req-d805f620-fe67-4b1c-aaa1-a1b277702d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e97ace-c3e2-41c2-a5a8-bf83730f4b98", "tag": "fbb41389-e752-45c6-be7f-c06d76fb88ff"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:39.023210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0ee57953-3ee4-4473-9cb6-2a0aa1a9ea23 req-d805f620-fe67-4b1c-aaa1-a1b277702d9d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:39.026807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0ee57953-3ee4-4473-9cb6-2a0aa1a9ea23 req-d805f620-fe67-4b1c-aaa1-a1b277702d9d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:39.060932 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0ee57953-3ee4-4473-9cb6-2a0aa1a9ea23 req-d805f620-fe67-4b1c-aaa1-a1b277702d9d service nova] Creating event network-changed:fbb41389-e752-45c6-be7f-c06d76fb88ff for instance 76e97ace-c3e2-41c2-a5a8-bf83730f4b98 on n-h2-767704-28 Jul 14 15:04:39.074231 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0ee57953-3ee4-4473-9cb6-2a0aa1a9ea23 req-d805f620-fe67-4b1c-aaa1-a1b277702d9d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085022 Jul 14 15:04:39.076628 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2933/5905] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:39.328567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-54badaab-3af1-4a44-a331-b12e557a408a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:39.331612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-54badaab-3af1-4a44-a331-b12e557a408a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:39.352753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54badaab-3af1-4a44-a331-b12e557a408a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:39.355624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54badaab-3af1-4a44-a331-b12e557a408a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:39.357721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54badaab-3af1-4a44-a331-b12e557a408a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:39.359876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54badaab-3af1-4a44-a331-b12e557a408a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:39.521725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-054b877a-0c06-4a58-8f6b-f0a1b45e67e5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:39.523087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-054b877a-0c06-4a58-8f6b-f0a1b45e67e5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:39.536062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-054b877a-0c06-4a58-8f6b-f0a1b45e67e5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:39.536527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-054b877a-0c06-4a58-8f6b-f0a1b45e67e5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:39.543528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-054b877a-0c06-4a58-8f6b-f0a1b45e67e5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:39.543999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-054b877a-0c06-4a58-8f6b-f0a1b45e67e5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:39.949948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:40.029835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:40.345756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-54badaab-3af1-4a44-a331-b12e557a408a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:40.360914 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-54badaab-3af1-4a44-a331-b12e557a408a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1216 microversion: 2.1 time: 1.039697 Jul 14 15:04:40.363997 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2973/5906] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:39 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1216 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:40.457851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-054b877a-0c06-4a58-8f6b-f0a1b45e67e5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:40.473128 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-054b877a-0c06-4a58-8f6b-f0a1b45e67e5 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1372 microversion: 2.1 time: 0.955892 Jul 14 15:04:40.474127 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2934/5907] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:39 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1372 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:41.381107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c5627fe1-2720-4b42-993d-018b192c4b19 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:41.381737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c5627fe1-2720-4b42-993d-018b192c4b19 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:41.383642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:41.401582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5627fe1-2720-4b42-993d-018b192c4b19 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:41.402302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5627fe1-2720-4b42-993d-018b192c4b19 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:41.403614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5627fe1-2720-4b42-993d-018b192c4b19 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:41.404289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5627fe1-2720-4b42-993d-018b192c4b19 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:41.490881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8664740b-d0d7-404d-91d4-af888e0c963a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:41.491857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8664740b-d0d7-404d-91d4-af888e0c963a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:41.516715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8664740b-d0d7-404d-91d4-af888e0c963a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:41.518921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8664740b-d0d7-404d-91d4-af888e0c963a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:41.521401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8664740b-d0d7-404d-91d4-af888e0c963a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:41.526415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8664740b-d0d7-404d-91d4-af888e0c963a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:41.984925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c5627fe1-2720-4b42-993d-018b192c4b19 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:42.005555 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c5627fe1-2720-4b42-993d-018b192c4b19 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1216 microversion: 2.1 time: 0.627392 Jul 14 15:04:42.008234 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2974/5908] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:41 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1216 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:42.014988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e089e984-26ea-445e-85e5-52f026ecf2d2 req-a28ffea2-769d-42b7-92b1-4c8e4350dca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be69051-1f14-4d37-810d-d29624714f45", "name": "network-vif-plugged", "status": "completed", "tag": "6ae42087-6009-4b04-8bb7-574891960f82"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:42.027880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e089e984-26ea-445e-85e5-52f026ecf2d2 req-a28ffea2-769d-42b7-92b1-4c8e4350dca2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:42.029772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e089e984-26ea-445e-85e5-52f026ecf2d2 req-a28ffea2-769d-42b7-92b1-4c8e4350dca2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:42.052022 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e089e984-26ea-445e-85e5-52f026ecf2d2 req-a28ffea2-769d-42b7-92b1-4c8e4350dca2 service nova] Creating event network-vif-plugged:6ae42087-6009-4b04-8bb7-574891960f82 for instance 6be69051-1f14-4d37-810d-d29624714f45 on n-h1-767704-28 Jul 14 15:04:42.059144 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e089e984-26ea-445e-85e5-52f026ecf2d2 req-a28ffea2-769d-42b7-92b1-4c8e4350dca2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049391 Jul 14 15:04:42.060935 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2975/5909] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:42.187421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8664740b-d0d7-404d-91d4-af888e0c963a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:42.232455 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8664740b-d0d7-404d-91d4-af888e0c963a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1372 microversion: 2.1 time: 0.739406 Jul 14 15:04:42.233164 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2935/5910] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:41 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1372 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:43.027069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-59a79aa2-922b-47d6-9301-16546ad9c156 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:43.028885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-59a79aa2-922b-47d6-9301-16546ad9c156 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:43.038309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59a79aa2-922b-47d6-9301-16546ad9c156 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:43.039096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59a79aa2-922b-47d6-9301-16546ad9c156 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.040126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59a79aa2-922b-47d6-9301-16546ad9c156 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:43.040779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59a79aa2-922b-47d6-9301-16546ad9c156 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.255940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6f4f5eff-f4dc-417b-8456-b0c6154684d9 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:43.257253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6f4f5eff-f4dc-417b-8456-b0c6154684d9 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:43.271997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f4f5eff-f4dc-417b-8456-b0c6154684d9 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:43.274704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f4f5eff-f4dc-417b-8456-b0c6154684d9 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.276928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f4f5eff-f4dc-417b-8456-b0c6154684d9 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:43.284760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6f4f5eff-f4dc-417b-8456-b0c6154684d9 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.335755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:43.367432 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-59a79aa2-922b-47d6-9301-16546ad9c156 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:43.388489 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-59a79aa2-922b-47d6-9301-16546ad9c156 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1216 microversion: 2.1 time: 0.359120 Jul 14 15:04:43.391503 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2976/5911] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:43 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1216 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:43.656008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6f4f5eff-f4dc-417b-8456-b0c6154684d9 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:43.668694 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6f4f5eff-f4dc-417b-8456-b0c6154684d9 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1372 microversion: 2.1 time: 0.422152 Jul 14 15:04:43.670213 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2936/5912] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:43 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1372 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:44.415786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-448871ec-bf8c-4680-9239-6fd9eacefa3a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:44.417831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-448871ec-bf8c-4680-9239-6fd9eacefa3a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:44.438229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-448871ec-bf8c-4680-9239-6fd9eacefa3a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:44.442178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-448871ec-bf8c-4680-9239-6fd9eacefa3a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:44.444736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-448871ec-bf8c-4680-9239-6fd9eacefa3a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:44.445524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-448871ec-bf8c-4680-9239-6fd9eacefa3a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:44.570405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-741a36fe-8b94-4d4d-b014-ee655ec96842 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Action: 'create', calling method: .version_select at 0x7fd6c4e55160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1610006260", "metadata": {"Type": "work"}}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:44.777772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-448871ec-bf8c-4680-9239-6fd9eacefa3a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:44.810188 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-448871ec-bf8c-4680-9239-6fd9eacefa3a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1402 microversion: 2.1 time: 0.399218 Jul 14 15:04:44.811439 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2937/5913] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:44 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1402 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:44.822109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ab93d55a-b535-4f33-b073-a4213281c2b0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:44.825357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ab93d55a-b535-4f33-b073-a4213281c2b0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:44.844576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab93d55a-b535-4f33-b073-a4213281c2b0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:44.845296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab93d55a-b535-4f33-b073-a4213281c2b0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:44.846269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab93d55a-b535-4f33-b073-a4213281c2b0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:44.846870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab93d55a-b535-4f33-b073-a4213281c2b0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:45.176489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ab93d55a-b535-4f33-b073-a4213281c2b0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:45.192606 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ab93d55a-b535-4f33-b073-a4213281c2b0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1372 microversion: 2.1 time: 0.379801 Jul 14 15:04:45.194528 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2938/5914] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:44 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1372 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:45.203843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4f650ecc-7af1-4f4e-965c-d49aeb6abd8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:45.204923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4f650ecc-7af1-4f4e-965c-d49aeb6abd8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:45.217480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f650ecc-7af1-4f4e-965c-d49aeb6abd8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:45.218163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f650ecc-7af1-4f4e-965c-d49aeb6abd8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:45.219191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f650ecc-7af1-4f4e-965c-d49aeb6abd8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:45.219842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f650ecc-7af1-4f4e-965c-d49aeb6abd8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:45.335462 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-741a36fe-8b94-4d4d-b014-ee655ec96842 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.047895 Jul 14 15:04:45.336108 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2977/5915] 10.222.0.81 () {60 vars in 1155 bytes} [Thu Jul 14 15:04:44 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1049 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 15:04:45.348839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fcd04c53-ee7e-4523-b40a-0b9e1b4f4599 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Calling method '.version_select at 0x7fd6c4e8c160>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:45.438039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4f650ecc-7af1-4f4e-965c-d49aeb6abd8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:45.447105 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fcd04c53-ee7e-4523-b40a-0b9e1b4f4599 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6" status: 200 len: 353 microversion: 2.1 time: 0.102353 Jul 14 15:04:45.452555 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2978/5916] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:04:45 2022] GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:45.455558 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4f650ecc-7af1-4f4e-965c-d49aeb6abd8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1402 microversion: 2.1 time: 0.258348 Jul 14 15:04:45.456408 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2939/5917] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:45 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1402 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:45.474201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-abd2e2d9-af46-42db-802b-46793873fe59 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-934832128"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:45.475657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-abd2e2d9-af46-42db-802b-46793873fe59 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:45.507914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abd2e2d9-af46-42db-802b-46793873fe59 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:45.509138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abd2e2d9-af46-42db-802b-46793873fe59 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:45.514986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abd2e2d9-af46-42db-802b-46793873fe59 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:45.515687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abd2e2d9-af46-42db-802b-46793873fe59 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:45.719765 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.compute.api [None req-abd2e2d9-af46-42db-802b-46793873fe59 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Attempting to quiesce instance before volume snapshot. Jul 14 15:04:45.789092 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.compute.api [None req-abd2e2d9-af46-42db-802b-46793873fe59 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 14 15:04:45.928346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-abd2e2d9-af46-42db-802b-46793873fe59 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Creating snapshot from volume ce470289-c6bd-444a-adef-b1279e186e3a. {{(pid=119512) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 14 15:04:46.216858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ca138cda-0ae1-4cee-ba15-c01c8ed59ff1 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:46.220764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ca138cda-0ae1-4cee-ba15-c01c8ed59ff1 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:46.241873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca138cda-0ae1-4cee-ba15-c01c8ed59ff1 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:46.242606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca138cda-0ae1-4cee-ba15-c01c8ed59ff1 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:46.243746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca138cda-0ae1-4cee-ba15-c01c8ed59ff1 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:46.245349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ca138cda-0ae1-4cee-ba15-c01c8ed59ff1 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:46.829274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ca138cda-0ae1-4cee-ba15-c01c8ed59ff1 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:46.837959 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ca138cda-0ae1-4cee-ba15-c01c8ed59ff1 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1372 microversion: 2.1 time: 0.628886 Jul 14 15:04:46.840165 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2940/5918] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:46 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1372 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:46.848827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af387482-dcc8-4eda-8227-e26db2624315 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Calling method '.version_select at 0x7fd6c63ba5e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:47.004822 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-af387482-dcc8-4eda-8227-e26db2624315 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6" status: 200 len: 353 microversion: 2.1 time: 0.163036 Jul 14 15:04:47.005789 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2941/5919] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:04:46 2022] GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6 => generated 353 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:47.630681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1d8fff12-33e5-462e-b603-641005d117fb req-abd3fa35-5c21-46b8-b36c-05e6a6e59322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e97ace-c3e2-41c2-a5a8-bf83730f4b98", "name": "network-vif-plugged", "status": "completed", "tag": "fbb41389-e752-45c6-be7f-c06d76fb88ff"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:47.655283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1d8fff12-33e5-462e-b603-641005d117fb req-abd3fa35-5c21-46b8-b36c-05e6a6e59322 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:47.657098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1d8fff12-33e5-462e-b603-641005d117fb req-abd3fa35-5c21-46b8-b36c-05e6a6e59322 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:47.684827 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1d8fff12-33e5-462e-b603-641005d117fb req-abd3fa35-5c21-46b8-b36c-05e6a6e59322 service nova] Creating event network-vif-plugged:fbb41389-e752-45c6-be7f-c06d76fb88ff for instance 76e97ace-c3e2-41c2-a5a8-bf83730f4b98 on n-h2-767704-28 Jul 14 15:04:47.696385 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1d8fff12-33e5-462e-b603-641005d117fb req-abd3fa35-5c21-46b8-b36c-05e6a6e59322 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067891 Jul 14 15:04:47.697856 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2942/5920] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:04:47.863161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-717dc93e-93a7-45fa-98c9-b81d6d8bb54d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:47.863927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-717dc93e-93a7-45fa-98c9-b81d6d8bb54d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:47.883701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-717dc93e-93a7-45fa-98c9-b81d6d8bb54d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:47.884221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-717dc93e-93a7-45fa-98c9-b81d6d8bb54d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:47.888669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-717dc93e-93a7-45fa-98c9-b81d6d8bb54d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:47.889354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-717dc93e-93a7-45fa-98c9-b81d6d8bb54d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:48.171777 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-abd2e2d9-af46-42db-802b-46793873fe59 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "POST /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45/action" status: 202 len: 0 microversion: 2.1 time: 2.696285 Jul 14 15:04:48.185148 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2979/5921] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:45 2022] POST /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45/action => generated 0 bytes in 2717 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 15:04:48.206597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c5ecad24-d73b-468d-a9bb-d5ef9f0ad533 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Calling method '.version_select at 0x7fd6c4b8e3a0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:48.390231 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c5ecad24-d73b-468d-a9bb-d5ef9f0ad533 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6" status: 200 len: 354 microversion: 2.1 time: 0.203444 Jul 14 15:04:48.392935 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2980/5922] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:04:48 2022] GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6 => generated 354 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:48.412362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d7efd599-2168-4447-befd-438de316b6c7 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Calling method '.version_select at 0x7fd6c4b8e700>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:48.494299 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d7efd599-2168-4447-befd-438de316b6c7 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6" status: 200 len: 354 microversion: 2.1 time: 0.093223 Jul 14 15:04:48.496922 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2981/5923] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:04:48 2022] GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:48.525639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b06842f1-8c8c-4667-b851-1048e088890d tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Calling method '.version_select at 0x7fd6c5af60d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:48.528559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-717dc93e-93a7-45fa-98c9-b81d6d8bb54d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:48.550799 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-717dc93e-93a7-45fa-98c9-b81d6d8bb54d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1372 microversion: 2.1 time: 0.686886 Jul 14 15:04:48.551523 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2943/5924] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:47 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1372 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:48.706003 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b06842f1-8c8c-4667-b851-1048e088890d tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6" status: 202 len: 0 microversion: 2.1 time: 0.199794 Jul 14 15:04:48.706973 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2982/5925] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jul 14 15:04:48 2022] DELETE /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:04:48.719031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ccc79166-06ba-494d-92a3-93ff4f8b433a tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Calling method '.version_select at 0x7fd6c5793820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:48.819005 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ccc79166-06ba-494d-92a3-93ff4f8b433a tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6" status: 200 len: 353 microversion: 2.1 time: 0.107994 Jul 14 15:04:48.821699 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2944/5926] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:04:48 2022] GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:49.570590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eff6d02c-9b9f-42d2-93eb-3f7c0ac86a7b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:49.571959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eff6d02c-9b9f-42d2-93eb-3f7c0ac86a7b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:49.605908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eff6d02c-9b9f-42d2-93eb-3f7c0ac86a7b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:49.606721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eff6d02c-9b9f-42d2-93eb-3f7c0ac86a7b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:49.607737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eff6d02c-9b9f-42d2-93eb-3f7c0ac86a7b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:49.608401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eff6d02c-9b9f-42d2-93eb-3f7c0ac86a7b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:49.832852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9045683d-f67b-423d-908e-63ee8612905b tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Calling method '.version_select at 0x7fd6c45405e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:49.870852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eff6d02c-9b9f-42d2-93eb-3f7c0ac86a7b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:49.881738 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eff6d02c-9b9f-42d2-93eb-3f7c0ac86a7b tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1372 microversion: 2.1 time: 0.315846 Jul 14 15:04:49.885829 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2983/5927] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:49 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1372 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:49.948343 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9045683d-f67b-423d-908e-63ee8612905b tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6" status: 200 len: 353 microversion: 2.1 time: 0.119574 Jul 14 15:04:49.950285 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2945/5928] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:04:49 2022] GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:50.818670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1828046612", "imageRef": "2e209451-66aa-4758-b8c0-43cdd2079e31", "flavorRef": "452", "networks": [{"uuid": "bce1cdb9-0501-4062-a135-972a001804ef"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:50.892323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] validate_networks() for [('bce1cdb9-0501-4062-a135-972a001804ef', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:04:50.934603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-417c4b00-2ae8-4364-9ee6-605bce80beaa tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:50.935713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-417c4b00-2ae8-4364-9ee6-605bce80beaa tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:50.959350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-417c4b00-2ae8-4364-9ee6-605bce80beaa tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:50.965452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-417c4b00-2ae8-4364-9ee6-605bce80beaa tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:50.968389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-417c4b00-2ae8-4364-9ee6-605bce80beaa tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:50.975598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-417c4b00-2ae8-4364-9ee6-605bce80beaa tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:51.466008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-417c4b00-2ae8-4364-9ee6-605bce80beaa tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:51.475364 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-417c4b00-2ae8-4364-9ee6-605bce80beaa tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1544 microversion: 2.1 time: 0.567873 Jul 14 15:04:51.486160 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2946/5929] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:50 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1544 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:51.493428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af250ed8-6ac1-44fb-b3b8-d0e652169420 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Calling method '.version_select at 0x7fd6c4540790>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:51.602859 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-af250ed8-6ac1-44fb-b3b8-d0e652169420 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6" status: 200 len: 353 microversion: 2.1 time: 0.113696 Jul 14 15:04:51.603731 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2947/5930] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:04:51 2022] GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:51.610878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3acd95fd-ff0b-4532-995d-12ffe6779726 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:51.611922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3acd95fd-ff0b-4532-995d-12ffe6779726 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:51.630331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3acd95fd-ff0b-4532-995d-12ffe6779726 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:51.631031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3acd95fd-ff0b-4532-995d-12ffe6779726 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:51.631989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3acd95fd-ff0b-4532-995d-12ffe6779726 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:51.632573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3acd95fd-ff0b-4532-995d-12ffe6779726 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:51.863188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:04:51.864376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:04:51.865237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:04:51.865864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:04:51.866462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:04:51.880312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:51.880789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:51.883663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:51.886715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:51.931951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:04:51.945289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for user e77523cc1cca458eb2a1b553aff072be and project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:04:51.962676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:04:51.966655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8c2496a8-f8b3-4155-a7cb-35e95b3c8554',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:04:52.004160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3acd95fd-ff0b-4532-995d-12ffe6779726 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:52.047719 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3acd95fd-ff0b-4532-995d-12ffe6779726 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1544 microversion: 2.1 time: 0.441853 Jul 14 15:04:52.075028 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2948/5931] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:51 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1544 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:52.276436 n-d-767704-28 devstack@n-api.service[119512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [d4998366-8610-4443-9347-e496645857e2] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:04:52.616447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b3776f17-4217-4890-8fa0-99e401d34643 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Calling method '.version_select at 0x7fd6c533b550>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:52.697662 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b3776f17-4217-4890-8fa0-99e401d34643 tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6" status: 200 len: 353 microversion: 2.1 time: 0.074988 Jul 14 15:04:52.701391 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2949/5932] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:04:52 2022] GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:04:53.294600 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [d4998366-8610-4443-9347-e496645857e2] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 39532. Jul 14 15:04:53.300759 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c857f8ed-378f-49a3-8423-4601d8a25772 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.485828 Jul 14 15:04:53.302026 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2984/5933] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:04:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:04:53.313460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-112e49d0-3f5d-4d8e-aaf7-bcf221b3de60 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:53.314537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-112e49d0-3f5d-4d8e-aaf7-bcf221b3de60 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:53.732232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-15259e15-2692-43ec-9c80-7ebd2d9d148e tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Calling method '.version_select at 0x7fd6c4cf5f70>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:53.813761 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-15259e15-2692-43ec-9c80-7ebd2d9d148e tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] HTTP exception thrown: Volume 198aecff-1f28-4d7a-9af1-67b5e89916a6 could not be found. Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-15259e15-2692-43ec-9c80-7ebd2d9d148e tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Request method failure captured: Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6 HTTP/1.1 Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DCMj4apDxirL2dgJtCa7KBAGMJcl5Hud2cf_q_uQbnMNI-gjligpAszzS7RMWLXmtFhB4cX7oS3YDbQpbjG2fHn5kbE00NEGSftW-3zewaV86FVrNO7yXDb4xZN9cBv-4VT6p_j-wg0nSLX30ZbnwcieH1aD_TAYN004CJRO5Ycuh0 Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: cc0cfb4656064c66a56de0d6385dcb58 Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-VolumesGetTestJSON-476169669 Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cc0cfb4656064c66a56de0d6385dcb58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cc0cfb4656064c66a56de0d6385dcb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cc0cfb4656064c66a56de0d6385dcb58", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cc0cfb4656064c66a56de0d6385dcb58"}]}] Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-VolumesGetTestJSON-476169669 Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: cc0cfb4656064c66a56de0d6385dcb58 Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-VolumesGetTestJSON-476169669 Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-VolumesGetTestJSON-476169669-project Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 5d0ed19a7ed2476aa8cb9d3ddd98d65c Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-VolumesGetTestJSON-476169669-project Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: method: Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: exception: Volume 198aecff-1f28-4d7a-9af1-67b5e89916a6 could not be found. Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '198aecff-1f28-4d7a-9af1-67b5e89916a6'} Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 198aecff-1f28-4d7a-9af1-67b5e89916a6 could not be found. (HTTP 404) (Request-ID: req-794469f7-96f1-49a6-880e-6966c88aab25) Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:04:53.816598 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 198aecff-1f28-4d7a-9af1-67b5e89916a6 could not be found. Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 198aecff-1f28-4d7a-9af1-67b5e89916a6 could not be found. Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 198aecff-1f28-4d7a-9af1-67b5e89916a6 could not be found. Jul 14 15:04:53.822369 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.829215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-15259e15-2692-43ec-9c80-7ebd2d9d148e tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] Returning 404 to user: Volume 198aecff-1f28-4d7a-9af1-67b5e89916a6 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:53.830470 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-15259e15-2692-43ec-9c80-7ebd2d9d148e tempest-VolumesGetTestJSON-476169669 tempest-VolumesGetTestJSON-476169669-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6" status: 404 len: 109 microversion: 2.1 time: 0.109081 Jul 14 15:04:53.831673 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2985/5934] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jul 14 15:04:53 2022] GET /compute/v2.1/os-volumes/198aecff-1f28-4d7a-9af1-67b5e89916a6 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:53.932673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-112e49d0-3f5d-4d8e-aaf7-bcf221b3de60 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:53.941763 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-112e49d0-3f5d-4d8e-aaf7-bcf221b3de60 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1230 microversion: 2.1 time: 0.633763 Jul 14 15:04:53.955476 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2950/5935] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:53 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1230 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:54.965357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c339d956-0021-46e3-8ac3-4f40d96187d5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:54.973661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c339d956-0021-46e3-8ac3-4f40d96187d5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:55.038689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c339d956-0021-46e3-8ac3-4f40d96187d5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:55.039169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c339d956-0021-46e3-8ac3-4f40d96187d5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:55.043824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c339d956-0021-46e3-8ac3-4f40d96187d5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:55.044416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c339d956-0021-46e3-8ac3-4f40d96187d5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:55.288409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c339d956-0021-46e3-8ac3-4f40d96187d5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:55.299615 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c339d956-0021-46e3-8ac3-4f40d96187d5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1282 microversion: 2.1 time: 0.340776 Jul 14 15:04:55.301152 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2986/5936] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:54 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1282 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:56.331871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2a4ccae2-221a-4fa2-ace4-2ef6f950fb6a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:56.333605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2a4ccae2-221a-4fa2-ace4-2ef6f950fb6a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:56.365533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:56.378640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a4ccae2-221a-4fa2-ace4-2ef6f950fb6a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:56.384601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a4ccae2-221a-4fa2-ace4-2ef6f950fb6a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:56.389671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a4ccae2-221a-4fa2-ace4-2ef6f950fb6a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:56.393054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a4ccae2-221a-4fa2-ace4-2ef6f950fb6a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:56.579366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2a4ccae2-221a-4fa2-ace4-2ef6f950fb6a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:56.626042 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2a4ccae2-221a-4fa2-ace4-2ef6f950fb6a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1300 microversion: 2.1 time: 0.302740 Jul 14 15:04:56.643612 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2951/5937] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:56 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1300 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:57.655013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4aec3ed-d0d9-40b5-8c06-e2dc82126cf3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:57.656443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d4aec3ed-d0d9-40b5-8c06-e2dc82126cf3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:57.694576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:57.696628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4aec3ed-d0d9-40b5-8c06-e2dc82126cf3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:57.697291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4aec3ed-d0d9-40b5-8c06-e2dc82126cf3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:57.698589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4aec3ed-d0d9-40b5-8c06-e2dc82126cf3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:57.699165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4aec3ed-d0d9-40b5-8c06-e2dc82126cf3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:58.547382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d4aec3ed-d0d9-40b5-8c06-e2dc82126cf3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:58.556221 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d4aec3ed-d0d9-40b5-8c06-e2dc82126cf3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.910907 Jul 14 15:04:58.560571 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2987/5938] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:57 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:59.575679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b98c4cb2-664b-4220-8ba9-07bb44d05082 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:59.577077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b98c4cb2-664b-4220-8ba9-07bb44d05082 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:59.597175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b98c4cb2-664b-4220-8ba9-07bb44d05082 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:59.597885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b98c4cb2-664b-4220-8ba9-07bb44d05082 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:59.598858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b98c4cb2-664b-4220-8ba9-07bb44d05082 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:59.599462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b98c4cb2-664b-4220-8ba9-07bb44d05082 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:59.659567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a567a6ce-cbcd-4a91-90ae-61de91f99ffa req-d6648360-cae4-4d1a-b14b-172d523e1ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e7ee779-1625-419f-a417-b349d98c61e9", "tag": "532717ab-5e56-4e9b-ac54-0122f4332be3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:59.671231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a567a6ce-cbcd-4a91-90ae-61de91f99ffa req-d6648360-cae4-4d1a-b14b-172d523e1ee3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:59.671771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a567a6ce-cbcd-4a91-90ae-61de91f99ffa req-d6648360-cae4-4d1a-b14b-172d523e1ee3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:59.742343 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a567a6ce-cbcd-4a91-90ae-61de91f99ffa req-d6648360-cae4-4d1a-b14b-172d523e1ee3 service nova] Creating event network-changed:532717ab-5e56-4e9b-ac54-0122f4332be3 for instance 9e7ee779-1625-419f-a417-b349d98c61e9 on n-h1-767704-28 Jul 14 15:04:59.751759 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a567a6ce-cbcd-4a91-90ae-61de91f99ffa req-d6648360-cae4-4d1a-b14b-172d523e1ee3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114020 Jul 14 15:04:59.757434 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2988/5939] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 14 15:05:00.203112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b98c4cb2-664b-4220-8ba9-07bb44d05082 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:00.213920 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b98c4cb2-664b-4220-8ba9-07bb44d05082 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.641817 Jul 14 15:05:00.216426 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2952/5940] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:59 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:01.233529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f572dbfa-3971-4053-b295-2b0b6e4d96bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:01.234333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f572dbfa-3971-4053-b295-2b0b6e4d96bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:01.265322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f572dbfa-3971-4053-b295-2b0b6e4d96bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:01.265799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f572dbfa-3971-4053-b295-2b0b6e4d96bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:01.272186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f572dbfa-3971-4053-b295-2b0b6e4d96bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:01.280081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f572dbfa-3971-4053-b295-2b0b6e4d96bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:01.921300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:01.956534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:02.478273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f572dbfa-3971-4053-b295-2b0b6e4d96bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:02.487092 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f572dbfa-3971-4053-b295-2b0b6e4d96bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 1.259437 Jul 14 15:05:02.496974 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2989/5941] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:01 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:03.513927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9a45e372-6933-4b14-9499-5624e3f08955 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:03.515478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9a45e372-6933-4b14-9499-5624e3f08955 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:03.542993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a45e372-6933-4b14-9499-5624e3f08955 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:03.552848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a45e372-6933-4b14-9499-5624e3f08955 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:03.556599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a45e372-6933-4b14-9499-5624e3f08955 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:03.558059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a45e372-6933-4b14-9499-5624e3f08955 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:03.906554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9a45e372-6933-4b14-9499-5624e3f08955 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:03.924529 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9a45e372-6933-4b14-9499-5624e3f08955 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.414760 Jul 14 15:05:03.928355 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2953/5942] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:03 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:04.975995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-98f154cc-5c00-446d-af8f-f51d0a23742e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:04.978116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-98f154cc-5c00-446d-af8f-f51d0a23742e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:04.986703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-98f154cc-5c00-446d-af8f-f51d0a23742e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:04.988641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-98f154cc-5c00-446d-af8f-f51d0a23742e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:04.992520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-98f154cc-5c00-446d-af8f-f51d0a23742e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:04.993201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-98f154cc-5c00-446d-af8f-f51d0a23742e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:05.388509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-98f154cc-5c00-446d-af8f-f51d0a23742e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:05.399488 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-98f154cc-5c00-446d-af8f-f51d0a23742e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.430392 Jul 14 15:05:05.406734 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2990/5943] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:04 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:06.435404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac3c5f8e-bcdc-4a89-b1aa-8b14805f051b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:06.437412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ac3c5f8e-bcdc-4a89-b1aa-8b14805f051b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:06.449052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:06.459783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac3c5f8e-bcdc-4a89-b1aa-8b14805f051b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:06.460793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac3c5f8e-bcdc-4a89-b1aa-8b14805f051b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:06.461854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac3c5f8e-bcdc-4a89-b1aa-8b14805f051b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:06.462511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac3c5f8e-bcdc-4a89-b1aa-8b14805f051b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:06.702529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ac3c5f8e-bcdc-4a89-b1aa-8b14805f051b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:06.720771 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ac3c5f8e-bcdc-4a89-b1aa-8b14805f051b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.300080 Jul 14 15:05:06.721878 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2954/5944] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:06 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:06.873340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7a3f72e6-722f-4a9c-b621-c761c7173a92 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:06.874469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7a3f72e6-722f-4a9c-b621-c761c7173a92 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:06.883203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a3f72e6-722f-4a9c-b621-c761c7173a92 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:06.883878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a3f72e6-722f-4a9c-b621-c761c7173a92 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:06.892467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a3f72e6-722f-4a9c-b621-c761c7173a92 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:06.893304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a3f72e6-722f-4a9c-b621-c761c7173a92 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:06.898105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:07.020516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-7a3f72e6-722f-4a9c-b621-c761c7173a92 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lazy-loading 'services' on Instance uuid ec58b382-5a25-45f2-9c1b-8aa257382782 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:05:07.146626 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7a3f72e6-722f-4a9c-b621-c761c7173a92 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782/os-volume_attachments/37074aa3-96f5-42a2-98f7-f8b1a66a18e8" status: 202 len: 0 microversion: 2.1 time: 0.277507 Jul 14 15:05:07.150484 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2991/5945] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:05:06 2022] DELETE /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782/os-volume_attachments/37074aa3-96f5-42a2-98f7-f8b1a66a18e8 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:05:07.740192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c980d6e2-68c5-4dcd-8174-7aa4d1e7c200 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:07.741806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c980d6e2-68c5-4dcd-8174-7aa4d1e7c200 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:07.771393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c980d6e2-68c5-4dcd-8174-7aa4d1e7c200 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:07.774645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c980d6e2-68c5-4dcd-8174-7aa4d1e7c200 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:07.778935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c980d6e2-68c5-4dcd-8174-7aa4d1e7c200 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:07.781342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c980d6e2-68c5-4dcd-8174-7aa4d1e7c200 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:08.652176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c980d6e2-68c5-4dcd-8174-7aa4d1e7c200 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:08.673279 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c980d6e2-68c5-4dcd-8174-7aa4d1e7c200 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.936891 Jul 14 15:05:08.687627 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2955/5946] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:07 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:09.709163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f835f4dc-bd0b-4cdc-bd14-372347a6ec7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:09.711413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f835f4dc-bd0b-4cdc-bd14-372347a6ec7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:09.746168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f835f4dc-bd0b-4cdc-bd14-372347a6ec7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:09.746611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f835f4dc-bd0b-4cdc-bd14-372347a6ec7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:09.753836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f835f4dc-bd0b-4cdc-bd14-372347a6ec7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:09.754705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f835f4dc-bd0b-4cdc-bd14-372347a6ec7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:10.011396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f835f4dc-bd0b-4cdc-bd14-372347a6ec7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:10.019791 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f835f4dc-bd0b-4cdc-bd14-372347a6ec7e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.323286 Jul 14 15:05:10.035595 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2992/5947] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:09 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:11.044790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23e7253f-ceac-47af-ab80-94e411bdf02c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:11.046415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-23e7253f-ceac-47af-ab80-94e411bdf02c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:11.073199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23e7253f-ceac-47af-ab80-94e411bdf02c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:11.073800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23e7253f-ceac-47af-ab80-94e411bdf02c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:11.074636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23e7253f-ceac-47af-ab80-94e411bdf02c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:11.075232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23e7253f-ceac-47af-ab80-94e411bdf02c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:11.550677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-23e7253f-ceac-47af-ab80-94e411bdf02c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:11.559975 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-23e7253f-ceac-47af-ab80-94e411bdf02c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.522222 Jul 14 15:05:11.576306 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2956/5948] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:11 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:12.579893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36659390-ba1d-4124-9c32-9181d1b58ede tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:12.580691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-36659390-ba1d-4124-9c32-9181d1b58ede tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:12.617804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36659390-ba1d-4124-9c32-9181d1b58ede tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:12.621847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36659390-ba1d-4124-9c32-9181d1b58ede tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:12.625212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36659390-ba1d-4124-9c32-9181d1b58ede tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:12.629941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36659390-ba1d-4124-9c32-9181d1b58ede tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:13.555865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-36659390-ba1d-4124-9c32-9181d1b58ede tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:13.572586 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-36659390-ba1d-4124-9c32-9181d1b58ede tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.999011 Jul 14 15:05:13.583768 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2993/5949] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:12 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:14.594460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-281c82b7-c08b-4ebd-b6cc-ba93ec8090a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:14.595948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-281c82b7-c08b-4ebd-b6cc-ba93ec8090a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:14.623382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-281c82b7-c08b-4ebd-b6cc-ba93ec8090a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:14.626399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-281c82b7-c08b-4ebd-b6cc-ba93ec8090a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:14.627444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-281c82b7-c08b-4ebd-b6cc-ba93ec8090a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:14.630168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-281c82b7-c08b-4ebd-b6cc-ba93ec8090a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:14.702070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=86 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:14.915936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-281c82b7-c08b-4ebd-b6cc-ba93ec8090a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:14.926166 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-281c82b7-c08b-4ebd-b6cc-ba93ec8090a1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.338951 Jul 14 15:05:14.954955 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2957/5950] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:14 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:15.944791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f6610f26-2ac0-41da-bc1b-678382e7d100 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:15.946778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f6610f26-2ac0-41da-bc1b-678382e7d100 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:15.981665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6610f26-2ac0-41da-bc1b-678382e7d100 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:15.982547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6610f26-2ac0-41da-bc1b-678382e7d100 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:15.983298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6610f26-2ac0-41da-bc1b-678382e7d100 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:15.983756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6610f26-2ac0-41da-bc1b-678382e7d100 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:16.377707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6610f26-2ac0-41da-bc1b-678382e7d100 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:16.390489 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f6610f26-2ac0-41da-bc1b-678382e7d100 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.449546 Jul 14 15:05:16.392302 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2994/5951] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:15 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:16.969784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d5e53e35-f8f5-4ebc-b55b-d93e9046495d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:16.970491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d5e53e35-f8f5-4ebc-b55b-d93e9046495d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:16.998281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5e53e35-f8f5-4ebc-b55b-d93e9046495d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:16.998751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5e53e35-f8f5-4ebc-b55b-d93e9046495d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:16.999653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5e53e35-f8f5-4ebc-b55b-d93e9046495d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:16.999998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d5e53e35-f8f5-4ebc-b55b-d93e9046495d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:17.050696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d5e53e35-f8f5-4ebc-b55b-d93e9046495d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:05:17.195227 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d5e53e35-f8f5-4ebc-b55b-d93e9046495d tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 204 len: 0 microversion: 2.1 time: 0.231416 Jul 14 15:05:17.202238 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2958/5952] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:05:16 2022] DELETE /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:05:17.207147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7aba50b4-2db6-48e1-a446-8f1dfaabe25c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:17.207802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7aba50b4-2db6-48e1-a446-8f1dfaabe25c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:17.230297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7aba50b4-2db6-48e1-a446-8f1dfaabe25c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:17.230826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7aba50b4-2db6-48e1-a446-8f1dfaabe25c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:17.231803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7aba50b4-2db6-48e1-a446-8f1dfaabe25c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:17.232974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7aba50b4-2db6-48e1-a446-8f1dfaabe25c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:17.414239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45e43715-b0e5-4b4d-ae58-0dd0add574b2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:17.414977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-45e43715-b0e5-4b4d-ae58-0dd0add574b2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:17.439343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45e43715-b0e5-4b4d-ae58-0dd0add574b2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:17.443029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45e43715-b0e5-4b4d-ae58-0dd0add574b2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:17.450332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45e43715-b0e5-4b4d-ae58-0dd0add574b2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:17.452252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45e43715-b0e5-4b4d-ae58-0dd0add574b2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:17.714645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-45e43715-b0e5-4b4d-ae58-0dd0add574b2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:17.725410 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-45e43715-b0e5-4b4d-ae58-0dd0add574b2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.317279 Jul 14 15:05:17.726712 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2959/5953] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:17 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:05:17.933198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7aba50b4-2db6-48e1-a446-8f1dfaabe25c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:17.943090 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7aba50b4-2db6-48e1-a446-8f1dfaabe25c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1515 microversion: 2.1 time: 0.741378 Jul 14 15:05:17.944230 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2995/5954] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:17 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1515 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:05:18.752173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c20d48a-1d13-44b9-b7bf-0b9c9d61af52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:18.752714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3c20d48a-1d13-44b9-b7bf-0b9c9d61af52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:18.766934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c20d48a-1d13-44b9-b7bf-0b9c9d61af52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:18.768866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c20d48a-1d13-44b9-b7bf-0b9c9d61af52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:18.770116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c20d48a-1d13-44b9-b7bf-0b9c9d61af52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:18.771113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c20d48a-1d13-44b9-b7bf-0b9c9d61af52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:18.961556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7a118e5e-7b40-4c29-8173-8ab63616b7b6 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:18.962864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7a118e5e-7b40-4c29-8173-8ab63616b7b6 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:18.988273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a118e5e-7b40-4c29-8173-8ab63616b7b6 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:18.988752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a118e5e-7b40-4c29-8173-8ab63616b7b6 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:18.989875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a118e5e-7b40-4c29-8173-8ab63616b7b6 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:18.990404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a118e5e-7b40-4c29-8173-8ab63616b7b6 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:19.287329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3c20d48a-1d13-44b9-b7bf-0b9c9d61af52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:19.304641 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3c20d48a-1d13-44b9-b7bf-0b9c9d61af52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.564979 Jul 14 15:05:19.306702 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2960/5955] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:18 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:19.575033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7a118e5e-7b40-4c29-8173-8ab63616b7b6 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:19.592249 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7a118e5e-7b40-4c29-8173-8ab63616b7b6 tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1515 microversion: 2.1 time: 0.633637 Jul 14 15:05:19.605969 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2996/5956] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:18 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1515 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:05:19.996225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-51e2b422-edf8-4c38-b2d0-d06efdfadbf4 req-871f2a91-07e0-44a5-8a61-93430a3a7fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec58b382-5a25-45f2-9c1b-8aa257382782", "name": "network-vif-deleted", "tag": "6e5c47b9-f797-40e5-bbe0-874a8e13ff73"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:05:20.017798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-51e2b422-edf8-4c38-b2d0-d06efdfadbf4 req-871f2a91-07e0-44a5-8a61-93430a3a7fce service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:20.018732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-51e2b422-edf8-4c38-b2d0-d06efdfadbf4 req-871f2a91-07e0-44a5-8a61-93430a3a7fce service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:20.066239 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-51e2b422-edf8-4c38-b2d0-d06efdfadbf4 req-871f2a91-07e0-44a5-8a61-93430a3a7fce service nova] Creating event network-vif-deleted:6e5c47b9-f797-40e5-bbe0-874a8e13ff73 for instance ec58b382-5a25-45f2-9c1b-8aa257382782 on n-h2-767704-28 Jul 14 15:05:20.092775 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-51e2b422-edf8-4c38-b2d0-d06efdfadbf4 req-871f2a91-07e0-44a5-8a61-93430a3a7fce service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102857 Jul 14 15:05:20.097855 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2961/5957] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:05:20.326126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f437fec-f8db-4a74-acab-bf1f17f5f170 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:20.327207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f437fec-f8db-4a74-acab-bf1f17f5f170 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:20.346403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f437fec-f8db-4a74-acab-bf1f17f5f170 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:20.347397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f437fec-f8db-4a74-acab-bf1f17f5f170 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:20.348428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f437fec-f8db-4a74-acab-bf1f17f5f170 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:20.349380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f437fec-f8db-4a74-acab-bf1f17f5f170 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:20.621328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c196ab5e-b8de-49a1-9c01-6a53884cad8c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:20.622711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c196ab5e-b8de-49a1-9c01-6a53884cad8c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:20.634783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c196ab5e-b8de-49a1-9c01-6a53884cad8c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:20.636657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c196ab5e-b8de-49a1-9c01-6a53884cad8c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:20.638496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c196ab5e-b8de-49a1-9c01-6a53884cad8c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:20.639530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c196ab5e-b8de-49a1-9c01-6a53884cad8c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:20.647103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f437fec-f8db-4a74-acab-bf1f17f5f170 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:20.664805 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f437fec-f8db-4a74-acab-bf1f17f5f170 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.342745 Jul 14 15:05:20.670727 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2997/5958] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:20 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:20.715218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c196ab5e-b8de-49a1-9c01-6a53884cad8c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:20.716134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c196ab5e-b8de-49a1-9c01-6a53884cad8c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:20.716873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-c196ab5e-b8de-49a1-9c01-6a53884cad8c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lazy-loading 'fault' on Instance uuid ec58b382-5a25-45f2-9c1b-8aa257382782 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:05:20.810525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c196ab5e-b8de-49a1-9c01-6a53884cad8c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30beff508f44228a98377afc6c6dbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0af80f1f8024f1d8d1e70b3ecf03a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:20.839572 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c196ab5e-b8de-49a1-9c01-6a53884cad8c tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 200 len: 1309 microversion: 2.1 time: 0.227843 Jul 14 15:05:20.853149 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2962/5959] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:20 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 1309 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:21.690747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6a5eff64-b064-4686-9074-565fcacf89d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:21.691566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6a5eff64-b064-4686-9074-565fcacf89d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:21.734460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a5eff64-b064-4686-9074-565fcacf89d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:21.736181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a5eff64-b064-4686-9074-565fcacf89d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:21.739581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a5eff64-b064-4686-9074-565fcacf89d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:21.740306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6a5eff64-b064-4686-9074-565fcacf89d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:21.860080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6423427f-2317-4b37-8298-88a814b81a2b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:21.861835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6423427f-2317-4b37-8298-88a814b81a2b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] [instance: ec58b382-5a25-45f2-9c1b-8aa257382782] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:21.877638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6423427f-2317-4b37-8298-88a814b81a2b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:21.880034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6423427f-2317-4b37-8298-88a814b81a2b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:21.882746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6423427f-2317-4b37-8298-88a814b81a2b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:21.883405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6423427f-2317-4b37-8298-88a814b81a2b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:21.935728 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-6423427f-2317-4b37-8298-88a814b81a2b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] HTTP exception thrown: Instance ec58b382-5a25-45f2-9c1b-8aa257382782 could not be found. Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6423427f-2317-4b37-8298-88a814b81a2b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Request method failure captured: Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 HTTP/1.1 Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C9hAgZfh2tEZJ8VXQTQnNuL8aYF21Q5KUYzqeKzzPBZT0IJHknYCFuH4DvRm9Sr3oKrVLN0DOYF0__PJb_4QQtZdJBUm6YRaIzeJdiKjNimC9mumj3hB0AP8Dr0iCCxGIPmaiYFYcGIdcdE3raNjt9Dd1X3OurE2kJS6lhhLqdYXrw Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: e0af80f1f8024f1d8d1e70b3ecf03a8a Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1797295386 Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e0af80f1f8024f1d8d1e70b3ecf03a8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e0af80f1f8024f1d8d1e70b3ecf03a8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e0af80f1f8024f1d8d1e70b3ecf03a8a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e0af80f1f8024f1d8d1e70b3ecf03a8a"}]}] Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-VolumesSnapshotTestJSON-1797295386 Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: e0af80f1f8024f1d8d1e70b3ecf03a8a Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1797295386 Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-VolumesSnapshotTestJSON-1797295386-project Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: a30beff508f44228a98377afc6c6dbc4 Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-VolumesSnapshotTestJSON-1797295386-project Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance ec58b382-5a25-45f2-9c1b-8aa257382782 could not be found. Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'ec58b382-5a25-45f2-9c1b-8aa257382782'} Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec58b382-5a25-45f2-9c1b-8aa257382782 could not be found. Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec58b382-5a25-45f2-9c1b-8aa257382782 could not be found. Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:05:21.943471 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:05:21.948845 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:05:21.948845 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:05:21.948845 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:05:21.948845 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:05:21.948845 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:05:21.948845 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec58b382-5a25-45f2-9c1b-8aa257382782 could not be found. Jul 14 15:05:21.948845 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:05:21.951738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6423427f-2317-4b37-8298-88a814b81a2b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] Returning 404 to user: Instance ec58b382-5a25-45f2-9c1b-8aa257382782 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:05:21.953917 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6423427f-2317-4b37-8298-88a814b81a2b tempest-VolumesSnapshotTestJSON-1797295386 tempest-VolumesSnapshotTestJSON-1797295386-project] 10.222.0.81 "GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782" status: 404 len: 111 microversion: 2.1 time: 0.098120 Jul 14 15:05:21.969994 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2963/5960] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:21 2022] GET /compute/v2.1/servers/ec58b382-5a25-45f2-9c1b-8aa257382782 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:05:22.303232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6a5eff64-b064-4686-9074-565fcacf89d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:22.321544 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6a5eff64-b064-4686-9074-565fcacf89d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.631366 Jul 14 15:05:22.322874 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2998/5961] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:21 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:23.340525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-557c89a0-1ac8-4eae-b212-b291cd1aa919 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:23.341452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-557c89a0-1ac8-4eae-b212-b291cd1aa919 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:23.362039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-557c89a0-1ac8-4eae-b212-b291cd1aa919 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:23.365837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-557c89a0-1ac8-4eae-b212-b291cd1aa919 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:23.367330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-557c89a0-1ac8-4eae-b212-b291cd1aa919 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:23.368600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-557c89a0-1ac8-4eae-b212-b291cd1aa919 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:23.418023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-730a816d-788b-4e85-bca4-d58ab9ff80f0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:23.419688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-730a816d-788b-4e85-bca4-d58ab9ff80f0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:23.436637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-730a816d-788b-4e85-bca4-d58ab9ff80f0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:23.437422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-730a816d-788b-4e85-bca4-d58ab9ff80f0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:23.438411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-730a816d-788b-4e85-bca4-d58ab9ff80f0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:23.441395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-730a816d-788b-4e85-bca4-d58ab9ff80f0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:23.503744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-730a816d-788b-4e85-bca4-d58ab9ff80f0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:05:23.686559 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-730a816d-788b-4e85-bca4-d58ab9ff80f0 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "DELETE /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 204 len: 0 microversion: 2.1 time: 0.273272 Jul 14 15:05:23.687708 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 2999/5962] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:05:23 2022] DELETE /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:05:23.697399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6c6b1516-a775-42a6-a506-1a049e5acfb6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:23.699193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6c6b1516-a775-42a6-a506-1a049e5acfb6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:23.706775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c6b1516-a775-42a6-a506-1a049e5acfb6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:23.710287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c6b1516-a775-42a6-a506-1a049e5acfb6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:23.711154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c6b1516-a775-42a6-a506-1a049e5acfb6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:23.711620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6c6b1516-a775-42a6-a506-1a049e5acfb6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:23.998335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-557c89a0-1ac8-4eae-b212-b291cd1aa919 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:24.012781 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-557c89a0-1ac8-4eae-b212-b291cd1aa919 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 0.677569 Jul 14 15:05:24.025459 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2964/5963] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:23 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:24.454914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6c6b1516-a775-42a6-a506-1a049e5acfb6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:24.475515 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6c6b1516-a775-42a6-a506-1a049e5acfb6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1550 microversion: 2.1 time: 0.783403 Jul 14 15:05:24.477621 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3000/5964] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:23 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1550 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:05:25.034659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-89ae006b-61ad-4140-b6c4-74dfd6dec59e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:25.035630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-89ae006b-61ad-4140-b6c4-74dfd6dec59e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:25.074760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89ae006b-61ad-4140-b6c4-74dfd6dec59e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:25.075232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89ae006b-61ad-4140-b6c4-74dfd6dec59e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:25.076058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89ae006b-61ad-4140-b6c4-74dfd6dec59e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:25.076511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89ae006b-61ad-4140-b6c4-74dfd6dec59e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:25.508012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f804609-7d12-4950-b5ad-4a266c52f2d8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:25.508810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f804609-7d12-4950-b5ad-4a266c52f2d8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:25.521514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f804609-7d12-4950-b5ad-4a266c52f2d8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:25.523192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f804609-7d12-4950-b5ad-4a266c52f2d8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:25.526735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f804609-7d12-4950-b5ad-4a266c52f2d8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:25.527344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f804609-7d12-4950-b5ad-4a266c52f2d8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:26.060818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-89ae006b-61ad-4140-b6c4-74dfd6dec59e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:26.076267 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-89ae006b-61ad-4140-b6c4-74dfd6dec59e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 1.042863 Jul 14 15:05:26.077546 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2965/5965] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:25 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:26.273901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f804609-7d12-4950-b5ad-4a266c52f2d8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:26.304910 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f804609-7d12-4950-b5ad-4a266c52f2d8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1550 microversion: 2.1 time: 0.799101 Jul 14 15:05:26.308519 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3001/5966] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:25 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1550 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:27.097094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eaffd06f-8742-476a-9e6d-63b1e555a98a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:27.098394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eaffd06f-8742-476a-9e6d-63b1e555a98a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:27.106856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:27.108883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eaffd06f-8742-476a-9e6d-63b1e555a98a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:27.109832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eaffd06f-8742-476a-9e6d-63b1e555a98a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:27.111158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eaffd06f-8742-476a-9e6d-63b1e555a98a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:27.111862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eaffd06f-8742-476a-9e6d-63b1e555a98a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:27.333117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b54b788-1767-4b56-9f34-d937ef4493ba tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:27.333764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b54b788-1767-4b56-9f34-d937ef4493ba tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:27.361832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b54b788-1767-4b56-9f34-d937ef4493ba tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:27.363083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b54b788-1767-4b56-9f34-d937ef4493ba tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:27.368124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b54b788-1767-4b56-9f34-d937ef4493ba tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:27.374217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b54b788-1767-4b56-9f34-d937ef4493ba tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:27.743326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2b54b788-1767-4b56-9f34-d937ef4493ba tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:27.775491 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b54b788-1767-4b56-9f34-d937ef4493ba tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 200 len: 1483 microversion: 2.1 time: 0.444748 Jul 14 15:05:27.779523 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3002/5967] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:27 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 1483 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:27.820307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-d67613f3-d37c-4987-808c-b89b28fd6917 req-65b5bd65-e47f-4195-beb0-1358af2801ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e97ace-c3e2-41c2-a5a8-bf83730f4b98", "name": "network-vif-deleted", "tag": "fbb41389-e752-45c6-be7f-c06d76fb88ff"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:05:27.856581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:27.869004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d67613f3-d37c-4987-808c-b89b28fd6917 req-65b5bd65-e47f-4195-beb0-1358af2801ef service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:27.869678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d67613f3-d37c-4987-808c-b89b28fd6917 req-65b5bd65-e47f-4195-beb0-1358af2801ef service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:27.929294 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-d67613f3-d37c-4987-808c-b89b28fd6917 req-65b5bd65-e47f-4195-beb0-1358af2801ef service nova] Creating event network-vif-deleted:fbb41389-e752-45c6-be7f-c06d76fb88ff for instance 76e97ace-c3e2-41c2-a5a8-bf83730f4b98 on n-h2-767704-28 Jul 14 15:05:27.960547 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-d67613f3-d37c-4987-808c-b89b28fd6917 req-65b5bd65-e47f-4195-beb0-1358af2801ef service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174437 Jul 14 15:05:27.965197 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3003/5968] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:05:28.147202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eaffd06f-8742-476a-9e6d-63b1e555a98a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:28.185133 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eaffd06f-8742-476a-9e6d-63b1e555a98a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1342 microversion: 2.1 time: 1.092374 Jul 14 15:05:28.193149 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2966/5969] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:27 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1342 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:28.797436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-674a191a-4719-4c12-a6f9-cb939a8d8020 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:28.798987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-674a191a-4719-4c12-a6f9-cb939a8d8020 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 76e97ace-c3e2-41c2-a5a8-bf83730f4b98] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:28.809003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-674a191a-4719-4c12-a6f9-cb939a8d8020 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:28.810187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-674a191a-4719-4c12-a6f9-cb939a8d8020 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:28.811437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-674a191a-4719-4c12-a6f9-cb939a8d8020 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:28.812641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-674a191a-4719-4c12-a6f9-cb939a8d8020 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:28.852174 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-674a191a-4719-4c12-a6f9-cb939a8d8020 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] HTTP exception thrown: Instance 76e97ace-c3e2-41c2-a5a8-bf83730f4b98 could not be found. Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-674a191a-4719-4c12-a6f9-cb939a8d8020 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Request method failure captured: Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 HTTP/1.1 Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DAkBH-ClvX7f6k1DJIyrf_u7w0WlZpM6IUOZ-9m2g6oOMAUHsPE3ZT8sQmtBqmuviYLBaNIuEwl3Tar3lti_IxUa2rgsc_KA9LDh2niiiMbjE-jbpCtvtvIqsn_hD2QuHoDpKS_PW5krAVGT9BQ0Ese-YyrkA3TgQji6PbrqRkbgvE Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: c5b1a0afc1a942f7b4ce2d0b20739da1 Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestNetworkBasicOps-1166988558 Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c5b1a0afc1a942f7b4ce2d0b20739da1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c5b1a0afc1a942f7b4ce2d0b20739da1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c5b1a0afc1a942f7b4ce2d0b20739da1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c5b1a0afc1a942f7b4ce2d0b20739da1"}]}] Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestNetworkBasicOps-1166988558 Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: c5b1a0afc1a942f7b4ce2d0b20739da1 Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestNetworkBasicOps-1166988558 Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestNetworkBasicOps-1166988558-project Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 663974b480e3425a9a31d4eee8c946b5 Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestNetworkBasicOps-1166988558-project Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 76e97ace-c3e2-41c2-a5a8-bf83730f4b98 could not be found. Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '76e97ace-c3e2-41c2-a5a8-bf83730f4b98'} Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76e97ace-c3e2-41c2-a5a8-bf83730f4b98 could not be found. Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76e97ace-c3e2-41c2-a5a8-bf83730f4b98 could not be found. Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:05:28.856173 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:05:28.861405 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:05:28.861405 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:05:28.861405 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:05:28.861405 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:05:28.861405 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:05:28.861405 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76e97ace-c3e2-41c2-a5a8-bf83730f4b98 could not be found. Jul 14 15:05:28.861405 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:05:28.861405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-674a191a-4719-4c12-a6f9-cb939a8d8020 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Returning 404 to user: Instance 76e97ace-c3e2-41c2-a5a8-bf83730f4b98 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:05:28.861405 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-674a191a-4719-4c12-a6f9-cb939a8d8020 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98" status: 404 len: 111 microversion: 2.1 time: 0.067060 Jul 14 15:05:28.861405 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3004/5970] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:28 2022] GET /compute/v2.1/servers/76e97ace-c3e2-41c2-a5a8-bf83730f4b98 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:05:29.285458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c4173e4a-c828-42ae-be0e-ddcebb181d87 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '.version_select at 0x7fd6c4e558b0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:29.344070 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c4173e4a-c828-42ae-be0e-ddcebb181d87 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2109286522" status: 202 len: 0 microversion: 2.1 time: 0.062930 Jul 14 15:05:29.345011 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3005/5971] 10.222.0.81 () {58 vars in 1256 bytes} [Thu Jul 14 15:05:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2109286522 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:05:29.815069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-28b09e92-2784-4044-9322-d2bb8b899450 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:29.816359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-28b09e92-2784-4044-9322-d2bb8b899450 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:29.831865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28b09e92-2784-4044-9322-d2bb8b899450 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:29.836107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28b09e92-2784-4044-9322-d2bb8b899450 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:29.837552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28b09e92-2784-4044-9322-d2bb8b899450 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:29.838303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28b09e92-2784-4044-9322-d2bb8b899450 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:30.344972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-28b09e92-2784-4044-9322-d2bb8b899450 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:30.372873 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-28b09e92-2784-4044-9322-d2bb8b899450 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1376 microversion: 2.1 time: 1.161390 Jul 14 15:05:30.378667 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2967/5972] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:29 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1376 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:31.390738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7726176e-1e41-4291-9749-b2a1016ed11c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:31.391367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7726176e-1e41-4291-9749-b2a1016ed11c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:31.404875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7726176e-1e41-4291-9749-b2a1016ed11c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:31.411548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7726176e-1e41-4291-9749-b2a1016ed11c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:31.415206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7726176e-1e41-4291-9749-b2a1016ed11c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:31.415991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7726176e-1e41-4291-9749-b2a1016ed11c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:32.004689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7726176e-1e41-4291-9749-b2a1016ed11c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:32.020118 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7726176e-1e41-4291-9749-b2a1016ed11c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1376 microversion: 2.1 time: 0.633467 Jul 14 15:05:32.024028 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3006/5973] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:31 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1376 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:33.041051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-32887c8b-29bb-4500-a977-6d18d88911b8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:33.043781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-32887c8b-29bb-4500-a977-6d18d88911b8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:33.056331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-32887c8b-29bb-4500-a977-6d18d88911b8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:33.056801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-32887c8b-29bb-4500-a977-6d18d88911b8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:33.058179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-32887c8b-29bb-4500-a977-6d18d88911b8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:33.058633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-32887c8b-29bb-4500-a977-6d18d88911b8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:33.501122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-32887c8b-29bb-4500-a977-6d18d88911b8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:33.514813 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-32887c8b-29bb-4500-a977-6d18d88911b8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1376 microversion: 2.1 time: 0.477768 Jul 14 15:05:33.524149 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2968/5974] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:33 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1376 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:33.712862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0697f3c1-df61-4b9c-a222-ba461c2f3bc8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:33.714310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0697f3c1-df61-4b9c-a222-ba461c2f3bc8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:33.734925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6342d02c-59f9-4292-8c26-80409da90704 req-5a7882e2-250f-400f-87cc-d51fe8395d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a729e84-2942-45d8-a50b-c731bf30cb21", "tag": "f3241ea7-9d3f-43e9-bcc6-45b4d0e4dcd7"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:05:33.745343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0697f3c1-df61-4b9c-a222-ba461c2f3bc8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:33.747237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0697f3c1-df61-4b9c-a222-ba461c2f3bc8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:33.756257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0697f3c1-df61-4b9c-a222-ba461c2f3bc8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:33.757119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0697f3c1-df61-4b9c-a222-ba461c2f3bc8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:33.765029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6342d02c-59f9-4292-8c26-80409da90704 req-5a7882e2-250f-400f-87cc-d51fe8395d91 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:33.766337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6342d02c-59f9-4292-8c26-80409da90704 req-5a7882e2-250f-400f-87cc-d51fe8395d91 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:33.805142 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6342d02c-59f9-4292-8c26-80409da90704 req-5a7882e2-250f-400f-87cc-d51fe8395d91 service nova] Creating event network-changed:f3241ea7-9d3f-43e9-bcc6-45b4d0e4dcd7 for instance 0a729e84-2942-45d8-a50b-c731bf30cb21 on n-h1-767704-28 Jul 14 15:05:33.825923 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6342d02c-59f9-4292-8c26-80409da90704 req-5a7882e2-250f-400f-87cc-d51fe8395d91 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095386 Jul 14 15:05:33.831449 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2969/5975] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:05:33.840400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0697f3c1-df61-4b9c-a222-ba461c2f3bc8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:05:33.849942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:34.050459 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0697f3c1-df61-4b9c-a222-ba461c2f3bc8 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 204 len: 0 microversion: 2.1 time: 0.339469 Jul 14 15:05:34.057882 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3007/5976] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:05:33 2022] DELETE /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:05:34.064518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ea0cfed4-399d-4f64-960c-6163e6122958 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:34.064909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ea0cfed4-399d-4f64-960c-6163e6122958 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:34.074602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea0cfed4-399d-4f64-960c-6163e6122958 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:34.075067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea0cfed4-399d-4f64-960c-6163e6122958 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:34.075881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea0cfed4-399d-4f64-960c-6163e6122958 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:34.076562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ea0cfed4-399d-4f64-960c-6163e6122958 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:34.394953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ea0cfed4-399d-4f64-960c-6163e6122958 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:34.407208 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ea0cfed4-399d-4f64-960c-6163e6122958 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1670 microversion: 2.1 time: 0.349545 Jul 14 15:05:34.408658 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2970/5977] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:34 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1670 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:34.533685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c060a1b3-a199-4771-a943-5363de120897 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:34.534437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c060a1b3-a199-4771-a943-5363de120897 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:34.546188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c060a1b3-a199-4771-a943-5363de120897 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:34.546813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c060a1b3-a199-4771-a943-5363de120897 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:34.547646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c060a1b3-a199-4771-a943-5363de120897 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:34.548249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c060a1b3-a199-4771-a943-5363de120897 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:35.158457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c060a1b3-a199-4771-a943-5363de120897 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:35.169107 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c060a1b3-a199-4771-a943-5363de120897 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1376 microversion: 2.1 time: 0.640177 Jul 14 15:05:35.172088 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3008/5978] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:34 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1376 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:35.426996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-69468ba9-ba6d-4d27-88e3-cb6d35a4916a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:35.427633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-69468ba9-ba6d-4d27-88e3-cb6d35a4916a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:35.442779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69468ba9-ba6d-4d27-88e3-cb6d35a4916a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:35.443745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69468ba9-ba6d-4d27-88e3-cb6d35a4916a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:35.444662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69468ba9-ba6d-4d27-88e3-cb6d35a4916a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:35.445990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69468ba9-ba6d-4d27-88e3-cb6d35a4916a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:35.734731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-69468ba9-ba6d-4d27-88e3-cb6d35a4916a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:35.752116 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-69468ba9-ba6d-4d27-88e3-cb6d35a4916a tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1670 microversion: 2.1 time: 0.329914 Jul 14 15:05:35.763882 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2971/5979] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:35 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1670 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:36.198975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-764f1d46-9653-4b0a-a226-dc8fd0b46812 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:36.200391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-764f1d46-9653-4b0a-a226-dc8fd0b46812 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:36.241241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-764f1d46-9653-4b0a-a226-dc8fd0b46812 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:36.242543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-764f1d46-9653-4b0a-a226-dc8fd0b46812 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:36.250403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-764f1d46-9653-4b0a-a226-dc8fd0b46812 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:36.253301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-764f1d46-9653-4b0a-a226-dc8fd0b46812 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:36.757396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-764f1d46-9653-4b0a-a226-dc8fd0b46812 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:36.782933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aac296d0-1d41-46a6-bad2-aeab89a6fc5e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:36.794565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aac296d0-1d41-46a6-bad2-aeab89a6fc5e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:36.845561 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-764f1d46-9653-4b0a-a226-dc8fd0b46812 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1376 microversion: 2.1 time: 0.657369 Jul 14 15:05:36.849417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aac296d0-1d41-46a6-bad2-aeab89a6fc5e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:36.853775 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3009/5980] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:36 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1376 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:36.862029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aac296d0-1d41-46a6-bad2-aeab89a6fc5e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:36.865545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aac296d0-1d41-46a6-bad2-aeab89a6fc5e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:36.866157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aac296d0-1d41-46a6-bad2-aeab89a6fc5e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:37.546307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aac296d0-1d41-46a6-bad2-aeab89a6fc5e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:37.572125 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aac296d0-1d41-46a6-bad2-aeab89a6fc5e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1670 microversion: 2.1 time: 0.804048 Jul 14 15:05:37.581317 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2972/5981] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:36 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1670 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:05:37.874049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-404f48df-0efa-467f-a770-6071c53caff0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:37.874780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-404f48df-0efa-467f-a770-6071c53caff0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:37.927766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-404f48df-0efa-467f-a770-6071c53caff0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:37.929363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-404f48df-0efa-467f-a770-6071c53caff0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:37.930544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-404f48df-0efa-467f-a770-6071c53caff0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:37.935851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-404f48df-0efa-467f-a770-6071c53caff0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:38.095808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3e807a3f-7b70-45bc-b669-7e2535fb8e46 req-3271f0ab-718c-4c14-a1c5-dac1e03f2d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a729e84-2942-45d8-a50b-c731bf30cb21", "name": "network-vif-deleted", "tag": "f3241ea7-9d3f-43e9-bcc6-45b4d0e4dcd7"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:05:38.116928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3e807a3f-7b70-45bc-b669-7e2535fb8e46 req-3271f0ab-718c-4c14-a1c5-dac1e03f2d8b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:38.120385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3e807a3f-7b70-45bc-b669-7e2535fb8e46 req-3271f0ab-718c-4c14-a1c5-dac1e03f2d8b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:38.153512 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3e807a3f-7b70-45bc-b669-7e2535fb8e46 req-3271f0ab-718c-4c14-a1c5-dac1e03f2d8b service nova] Creating event network-vif-deleted:f3241ea7-9d3f-43e9-bcc6-45b4d0e4dcd7 for instance 0a729e84-2942-45d8-a50b-c731bf30cb21 on n-h1-767704-28 Jul 14 15:05:38.164324 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3e807a3f-7b70-45bc-b669-7e2535fb8e46 req-3271f0ab-718c-4c14-a1c5-dac1e03f2d8b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069175 Jul 14 15:05:38.169947 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2973/5982] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 14 15:05:38.609494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-533e828b-e9d6-4fd0-a4ae-e33c4278c050 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:38.610651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-533e828b-e9d6-4fd0-a4ae-e33c4278c050 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:38.656738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-533e828b-e9d6-4fd0-a4ae-e33c4278c050 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:38.658247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-533e828b-e9d6-4fd0-a4ae-e33c4278c050 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:38.661644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-533e828b-e9d6-4fd0-a4ae-e33c4278c050 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:38.662547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-533e828b-e9d6-4fd0-a4ae-e33c4278c050 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:38.707693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:38.746399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-533e828b-e9d6-4fd0-a4ae-e33c4278c050 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:38.747240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-533e828b-e9d6-4fd0-a4ae-e33c4278c050 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:38.747996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-533e828b-e9d6-4fd0-a4ae-e33c4278c050 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lazy-loading 'fault' on Instance uuid 0a729e84-2942-45d8-a50b-c731bf30cb21 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:05:40.089751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-533e828b-e9d6-4fd0-a4ae-e33c4278c050 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:40.159141 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-533e828b-e9d6-4fd0-a4ae-e33c4278c050 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 200 len: 1337 microversion: 2.1 time: 1.546183 Jul 14 15:05:40.163577 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2974/5983] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:38 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 1337 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:41.022331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-404f48df-0efa-467f-a770-6071c53caff0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:41.046489 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-404f48df-0efa-467f-a770-6071c53caff0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1376 microversion: 2.1 time: 3.179447 Jul 14 15:05:41.048916 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3010/5984] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:37 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1376 bytes in 3183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:41.206391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39710f73-0b70-41c3-b196-b59622e6dc62 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:41.216364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-39710f73-0b70-41c3-b196-b59622e6dc62 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: 0a729e84-2942-45d8-a50b-c731bf30cb21] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:41.279640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39710f73-0b70-41c3-b196-b59622e6dc62 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:41.281610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39710f73-0b70-41c3-b196-b59622e6dc62 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:41.284249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39710f73-0b70-41c3-b196-b59622e6dc62 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:41.286603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39710f73-0b70-41c3-b196-b59622e6dc62 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:41.347110 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-39710f73-0b70-41c3-b196-b59622e6dc62 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] HTTP exception thrown: Instance 0a729e84-2942-45d8-a50b-c731bf30cb21 could not be found. Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39710f73-0b70-41c3-b196-b59622e6dc62 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Request method failure captured: Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 HTTP/1.1 Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DAkBH-ClvX7f6k1DJIyrf_u7w0WlZpM6IUOZ-9m2g6oOMAUHsPE3ZT8sQmtBqmuviYLBaNIuEwl3Tar3lti_IxUa2rgsc_KA9LDh2niiiMbjE-jbpCtvtvIqsn_hD2QuHoDpKS_PW5krAVGT9BQ0Ese-YyrkA3TgQji6PbrqRkbgvE Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: c5b1a0afc1a942f7b4ce2d0b20739da1 Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestNetworkBasicOps-1166988558 Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c5b1a0afc1a942f7b4ce2d0b20739da1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c5b1a0afc1a942f7b4ce2d0b20739da1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c5b1a0afc1a942f7b4ce2d0b20739da1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c5b1a0afc1a942f7b4ce2d0b20739da1"}]}] Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestNetworkBasicOps-1166988558 Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: c5b1a0afc1a942f7b4ce2d0b20739da1 Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestNetworkBasicOps-1166988558 Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestNetworkBasicOps-1166988558-project Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 663974b480e3425a9a31d4eee8c946b5 Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestNetworkBasicOps-1166988558-project Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 0a729e84-2942-45d8-a50b-c731bf30cb21 could not be found. Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '0a729e84-2942-45d8-a50b-c731bf30cb21'} Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a729e84-2942-45d8-a50b-c731bf30cb21 could not be found. Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a729e84-2942-45d8-a50b-c731bf30cb21 could not be found. Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:05:41.348818 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:05:41.355182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:05:41.355182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:05:41.355182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:05:41.355182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:05:41.355182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:05:41.355182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a729e84-2942-45d8-a50b-c731bf30cb21 could not be found. Jul 14 15:05:41.355182 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:05:41.362141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39710f73-0b70-41c3-b196-b59622e6dc62 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Returning 404 to user: Instance 0a729e84-2942-45d8-a50b-c731bf30cb21 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:05:41.365538 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-39710f73-0b70-41c3-b196-b59622e6dc62 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21" status: 404 len: 111 microversion: 2.1 time: 0.166545 Jul 14 15:05:41.366769 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2975/5985] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:41 2022] GET /compute/v2.1/servers/0a729e84-2942-45d8-a50b-c731bf30cb21 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:05:42.079138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4773a914-3dd1-48df-b407-40e90666b4bf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:42.086405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4773a914-3dd1-48df-b407-40e90666b4bf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:42.127231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4773a914-3dd1-48df-b407-40e90666b4bf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:42.129955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4773a914-3dd1-48df-b407-40e90666b4bf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:42.137047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4773a914-3dd1-48df-b407-40e90666b4bf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:42.140014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4773a914-3dd1-48df-b407-40e90666b4bf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:42.249579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5ac2c855-9ba2-4e0a-859b-0554400b48ac tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '.version_select at 0x7fd6c5793280>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:42.316224 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5ac2c855-9ba2-4e0a-859b-0554400b48ac tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-827606132" status: 202 len: 0 microversion: 2.1 time: 0.072271 Jul 14 15:05:42.318271 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2976/5986] 10.222.0.81 () {58 vars in 1253 bytes} [Thu Jul 14 15:05:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-827606132 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:05:42.807909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4773a914-3dd1-48df-b407-40e90666b4bf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:42.820601 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4773a914-3dd1-48df-b407-40e90666b4bf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1376 microversion: 2.1 time: 0.757421 Jul 14 15:05:42.825779 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3011/5987] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:42 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1376 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:43.392493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e5cce825-9e4d-41bf-878b-75d336dd008e req-83bf9f80-8551-4f03-8b2e-8ddf376fe2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7ee779-1625-419f-a417-b349d98c61e9", "name": "network-vif-plugged", "status": "completed", "tag": "532717ab-5e56-4e9b-ac54-0122f4332be3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:05:43.422143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e5cce825-9e4d-41bf-878b-75d336dd008e req-83bf9f80-8551-4f03-8b2e-8ddf376fe2fe service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:43.424682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e5cce825-9e4d-41bf-878b-75d336dd008e req-83bf9f80-8551-4f03-8b2e-8ddf376fe2fe service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:43.451772 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e5cce825-9e4d-41bf-878b-75d336dd008e req-83bf9f80-8551-4f03-8b2e-8ddf376fe2fe service nova] Creating event network-vif-plugged:532717ab-5e56-4e9b-ac54-0122f4332be3 for instance 9e7ee779-1625-419f-a417-b349d98c61e9 on n-h1-767704-28 Jul 14 15:05:43.457682 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e5cce825-9e4d-41bf-878b-75d336dd008e req-83bf9f80-8551-4f03-8b2e-8ddf376fe2fe service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077253 Jul 14 15:05:43.458931 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2977/5988] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:05:43.888873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9d5df72d-bf47-437f-afb2-ef2466af2554 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:43.893192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9d5df72d-bf47-437f-afb2-ef2466af2554 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:43.935285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d5df72d-bf47-437f-afb2-ef2466af2554 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:43.935833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d5df72d-bf47-437f-afb2-ef2466af2554 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:43.937323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d5df72d-bf47-437f-afb2-ef2466af2554 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:43.938729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d5df72d-bf47-437f-afb2-ef2466af2554 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:44.374149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9d5df72d-bf47-437f-afb2-ef2466af2554 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:44.398825 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9d5df72d-bf47-437f-afb2-ef2466af2554 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1376 microversion: 2.1 time: 0.558445 Jul 14 15:05:44.405255 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3012/5989] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:43 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1376 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:45.423869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d7f4c113-529c-4f65-bcd1-81a0bc94b064 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:45.424574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d7f4c113-529c-4f65-bcd1-81a0bc94b064 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:45.448769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7f4c113-529c-4f65-bcd1-81a0bc94b064 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:45.460818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7f4c113-529c-4f65-bcd1-81a0bc94b064 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:45.462059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7f4c113-529c-4f65-bcd1-81a0bc94b064 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:45.466665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7f4c113-529c-4f65-bcd1-81a0bc94b064 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:46.272543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d7f4c113-529c-4f65-bcd1-81a0bc94b064 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:46.303120 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d7f4c113-529c-4f65-bcd1-81a0bc94b064 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1376 microversion: 2.1 time: 0.884985 Jul 14 15:05:46.303949 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2978/5990] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:45 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1376 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:05:47.334050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-360ab130-ff6b-4fd8-92b7-52579cb26c33 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:47.335239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-360ab130-ff6b-4fd8-92b7-52579cb26c33 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:47.363798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-360ab130-ff6b-4fd8-92b7-52579cb26c33 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:47.369078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-360ab130-ff6b-4fd8-92b7-52579cb26c33 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:47.370805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-360ab130-ff6b-4fd8-92b7-52579cb26c33 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:47.387239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-360ab130-ff6b-4fd8-92b7-52579cb26c33 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:48.505216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-360ab130-ff6b-4fd8-92b7-52579cb26c33 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:48.522676 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-360ab130-ff6b-4fd8-92b7-52579cb26c33 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1563 microversion: 2.1 time: 1.193823 Jul 14 15:05:48.524929 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3013/5991] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:47 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1563 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:05:48.560050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8bdd4dd8-c50f-4405-b1ed-5b859ccd1a08 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:48.562031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8bdd4dd8-c50f-4405-b1ed-5b859ccd1a08 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:48.581367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bdd4dd8-c50f-4405-b1ed-5b859ccd1a08 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:48.585217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bdd4dd8-c50f-4405-b1ed-5b859ccd1a08 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:48.586384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bdd4dd8-c50f-4405-b1ed-5b859ccd1a08 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:48.592805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bdd4dd8-c50f-4405-b1ed-5b859ccd1a08 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:49.403716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8bdd4dd8-c50f-4405-b1ed-5b859ccd1a08 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:49.425448 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8bdd4dd8-c50f-4405-b1ed-5b859ccd1a08 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1563 microversion: 2.1 time: 0.870590 Jul 14 15:05:49.426652 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2979/5992] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:48 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1563 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:49.568676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65c064f2-d6c8-4a7c-b4b9-15ca4c13f9b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:49.575123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-65c064f2-d6c8-4a7c-b4b9-15ca4c13f9b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:49.597424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65c064f2-d6c8-4a7c-b4b9-15ca4c13f9b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:49.598055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65c064f2-d6c8-4a7c-b4b9-15ca4c13f9b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:49.599239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65c064f2-d6c8-4a7c-b4b9-15ca4c13f9b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:49.599722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65c064f2-d6c8-4a7c-b4b9-15ca4c13f9b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:49.642102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-65c064f2-d6c8-4a7c-b4b9-15ca4c13f9b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:05:49.781563 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65c064f2-d6c8-4a7c-b4b9-15ca4c13f9b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 204 len: 0 microversion: 2.1 time: 0.216598 Jul 14 15:05:49.782538 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3014/5993] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:05:49 2022] DELETE /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:05:49.796384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d727b69f-0db3-4a83-aa6f-14636c0ef14c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:49.800738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d727b69f-0db3-4a83-aa6f-14636c0ef14c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:49.832227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d727b69f-0db3-4a83-aa6f-14636c0ef14c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:49.843557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d727b69f-0db3-4a83-aa6f-14636c0ef14c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:49.846092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d727b69f-0db3-4a83-aa6f-14636c0ef14c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:49.846908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d727b69f-0db3-4a83-aa6f-14636c0ef14c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:50.526691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d727b69f-0db3-4a83-aa6f-14636c0ef14c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:50.526691 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d727b69f-0db3-4a83-aa6f-14636c0ef14c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1569 microversion: 2.1 time: 0.731474 Jul 14 15:05:50.526691 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2980/5994] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:49 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1569 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:51.544694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-642fb475-5777-4834-ad24-5ceed30f3f86 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:51.545668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-642fb475-5777-4834-ad24-5ceed30f3f86 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:51.559751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-642fb475-5777-4834-ad24-5ceed30f3f86 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:51.560243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-642fb475-5777-4834-ad24-5ceed30f3f86 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:51.561480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-642fb475-5777-4834-ad24-5ceed30f3f86 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:51.562215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-642fb475-5777-4834-ad24-5ceed30f3f86 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:52.785137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-642fb475-5777-4834-ad24-5ceed30f3f86 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:52.797052 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-642fb475-5777-4834-ad24-5ceed30f3f86 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1569 microversion: 2.1 time: 1.258476 Jul 14 15:05:52.802547 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3015/5995] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:51 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1569 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:53.827317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-22bd3b8e-34f5-4e75-a1c7-0858c7798885 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:53.827952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-22bd3b8e-34f5-4e75-a1c7-0858c7798885 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:53.841492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-22bd3b8e-34f5-4e75-a1c7-0858c7798885 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:53.849761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-22bd3b8e-34f5-4e75-a1c7-0858c7798885 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:53.855966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-22bd3b8e-34f5-4e75-a1c7-0858c7798885 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:53.863814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-22bd3b8e-34f5-4e75-a1c7-0858c7798885 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:54.179818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b23f06c8-d0b5-4bbd-a66b-6d2771261554 req-26b8769f-b999-4a5c-b8e8-581556717eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7ee779-1625-419f-a417-b349d98c61e9", "name": "network-vif-unplugged", "status": "completed", "tag": "532717ab-5e56-4e9b-ac54-0122f4332be3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:05:54.220256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b23f06c8-d0b5-4bbd-a66b-6d2771261554 req-26b8769f-b999-4a5c-b8e8-581556717eb1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:54.225755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b23f06c8-d0b5-4bbd-a66b-6d2771261554 req-26b8769f-b999-4a5c-b8e8-581556717eb1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:54.265424 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b23f06c8-d0b5-4bbd-a66b-6d2771261554 req-26b8769f-b999-4a5c-b8e8-581556717eb1 service nova] Creating event network-vif-unplugged:532717ab-5e56-4e9b-ac54-0122f4332be3 for instance 9e7ee779-1625-419f-a417-b349d98c61e9 on n-h1-767704-28 Jul 14 15:05:54.274734 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b23f06c8-d0b5-4bbd-a66b-6d2771261554 req-26b8769f-b999-4a5c-b8e8-581556717eb1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105095 Jul 14 15:05:54.279181 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3016/5996] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:05:54.881212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-22bd3b8e-34f5-4e75-a1c7-0858c7798885 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:54.894825 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-22bd3b8e-34f5-4e75-a1c7-0858c7798885 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1569 microversion: 2.1 time: 1.074544 Jul 14 15:05:54.900585 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2981/5997] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:53 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1569 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:55.367472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-aa15eac4-2f5f-4472-a26c-9ac398925166 req-e641053c-450b-4885-a166-0cfad462b24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7ee779-1625-419f-a417-b349d98c61e9", "name": "network-vif-deleted", "tag": "532717ab-5e56-4e9b-ac54-0122f4332be3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:05:55.382739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-aa15eac4-2f5f-4472-a26c-9ac398925166 req-e641053c-450b-4885-a166-0cfad462b24e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:55.383540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-aa15eac4-2f5f-4472-a26c-9ac398925166 req-e641053c-450b-4885-a166-0cfad462b24e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:55.428911 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-aa15eac4-2f5f-4472-a26c-9ac398925166 req-e641053c-450b-4885-a166-0cfad462b24e service nova] Creating event network-vif-deleted:532717ab-5e56-4e9b-ac54-0122f4332be3 for instance 9e7ee779-1625-419f-a417-b349d98c61e9 on n-h1-767704-28 Jul 14 15:05:55.471787 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-aa15eac4-2f5f-4472-a26c-9ac398925166 req-e641053c-450b-4885-a166-0cfad462b24e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094838 Jul 14 15:05:55.475344 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3017/5998] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:05:55.919065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6fc8a704-9229-4a6e-a043-f71481174abd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:55.919661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6fc8a704-9229-4a6e-a043-f71481174abd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:55.948865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fc8a704-9229-4a6e-a043-f71481174abd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:55.962930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fc8a704-9229-4a6e-a043-f71481174abd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:55.964521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fc8a704-9229-4a6e-a043-f71481174abd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:55.975568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fc8a704-9229-4a6e-a043-f71481174abd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:56.242873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6fc8a704-9229-4a6e-a043-f71481174abd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:56.269718 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6fc8a704-9229-4a6e-a043-f71481174abd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1361 microversion: 2.1 time: 0.355421 Jul 14 15:05:56.270335 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2982/5999] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:55 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1361 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:57.290419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c100222-eec1-47e3-aa7a-d15161b96bf4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:57.291929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1c100222-eec1-47e3-aa7a-d15161b96bf4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:57.303128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c100222-eec1-47e3-aa7a-d15161b96bf4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:57.305006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c100222-eec1-47e3-aa7a-d15161b96bf4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:57.306107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c100222-eec1-47e3-aa7a-d15161b96bf4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:57.306758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c100222-eec1-47e3-aa7a-d15161b96bf4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:57.457218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1c100222-eec1-47e3-aa7a-d15161b96bf4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:57.491700 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1c100222-eec1-47e3-aa7a-d15161b96bf4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1361 microversion: 2.1 time: 0.203399 Jul 14 15:05:57.493006 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3018/6000] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:57 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:58.515040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9727a2c5-4131-4120-8926-4da3aca41c85 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:58.515665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9727a2c5-4131-4120-8926-4da3aca41c85 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:58.524819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:58.527055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9727a2c5-4131-4120-8926-4da3aca41c85 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:58.527696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9727a2c5-4131-4120-8926-4da3aca41c85 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:58.535375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9727a2c5-4131-4120-8926-4da3aca41c85 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:58.535950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9727a2c5-4131-4120-8926-4da3aca41c85 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:58.889153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9727a2c5-4131-4120-8926-4da3aca41c85 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:58.905854 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9727a2c5-4131-4120-8926-4da3aca41c85 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1361 microversion: 2.1 time: 0.396397 Jul 14 15:05:58.909405 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2983/6001] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:58 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1361 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:59.926310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0bca921d-3d5d-4f05-bbc2-9734a951a7a7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:59.926939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0bca921d-3d5d-4f05-bbc2-9734a951a7a7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:59.938855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:59.949635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bca921d-3d5d-4f05-bbc2-9734a951a7a7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:59.950102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bca921d-3d5d-4f05-bbc2-9734a951a7a7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:59.951303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bca921d-3d5d-4f05-bbc2-9734a951a7a7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:59.951983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bca921d-3d5d-4f05-bbc2-9734a951a7a7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:00.154778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0bca921d-3d5d-4f05-bbc2-9734a951a7a7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:00.164141 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0bca921d-3d5d-4f05-bbc2-9734a951a7a7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1361 microversion: 2.1 time: 0.241668 Jul 14 15:06:00.173953 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3019/6002] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:59 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:01.183194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6fbc2241-49c9-4607-8884-e784afc17e8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:01.184283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6fbc2241-49c9-4607-8884-e784afc17e8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:01.203410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fbc2241-49c9-4607-8884-e784afc17e8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:01.205566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fbc2241-49c9-4607-8884-e784afc17e8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:01.218599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fbc2241-49c9-4607-8884-e784afc17e8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:01.223849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fbc2241-49c9-4607-8884-e784afc17e8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:01.529055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6fbc2241-49c9-4607-8884-e784afc17e8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:01.560482 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6fbc2241-49c9-4607-8884-e784afc17e8d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1361 microversion: 2.1 time: 0.379666 Jul 14 15:06:01.561643 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2984/6003] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:01 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1361 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:02.583453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a329663e-74dd-48e2-9c9d-92ca2b112661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:02.584901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a329663e-74dd-48e2-9c9d-92ca2b112661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:02.609175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a329663e-74dd-48e2-9c9d-92ca2b112661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:02.609661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a329663e-74dd-48e2-9c9d-92ca2b112661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:02.613325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a329663e-74dd-48e2-9c9d-92ca2b112661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:02.613802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a329663e-74dd-48e2-9c9d-92ca2b112661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:03.473561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a329663e-74dd-48e2-9c9d-92ca2b112661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:03.496188 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a329663e-74dd-48e2-9c9d-92ca2b112661 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1361 microversion: 2.1 time: 0.917128 Jul 14 15:06:03.501916 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3020/6004] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:02 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1361 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:04.307929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-83571709-e6ec-4651-ac91-7ba2866a0e7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826-project-admin] Calling method '.version_select at 0x7fd6cab9a820>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:04.315087 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:06:04.315087 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 15:06:04.317482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83571709-e6ec-4651-ac91-7ba2866a0e7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:04.326358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83571709-e6ec-4651-ac91-7ba2866a0e7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:04.445165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83571709-e6ec-4651-ac91-7ba2866a0e7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:04.446619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83571709-e6ec-4651-ac91-7ba2866a0e7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:04.492824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83571709-e6ec-4651-ac91-7ba2866a0e7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:04.499114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83571709-e6ec-4651-ac91-7ba2866a0e7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:04.534303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1295eaa7-8a47-4e30-9f0d-15a0c535bfc1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:04.545439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1295eaa7-8a47-4e30-9f0d-15a0c535bfc1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:04.559484 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-83571709-e6ec-4651-ac91-7ba2866a0e7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1632341826-project-admin] 10.222.0.81 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.597127 Jul 14 15:06:04.566635 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2985/6005] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 15:06:03 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:04.581001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1295eaa7-8a47-4e30-9f0d-15a0c535bfc1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:04.586759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1295eaa7-8a47-4e30-9f0d-15a0c535bfc1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:04.587901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1295eaa7-8a47-4e30-9f0d-15a0c535bfc1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:04.590042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1295eaa7-8a47-4e30-9f0d-15a0c535bfc1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:04.600973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:04.833282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1295eaa7-8a47-4e30-9f0d-15a0c535bfc1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:04.848018 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1295eaa7-8a47-4e30-9f0d-15a0c535bfc1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1361 microversion: 2.1 time: 0.333373 Jul 14 15:06:04.849455 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3021/6006] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:04 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1361 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:05.877779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fdbadaab-c497-49e7-8c51-ff8f25e369b1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:05.888273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fdbadaab-c497-49e7-8c51-ff8f25e369b1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:05.924866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdbadaab-c497-49e7-8c51-ff8f25e369b1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:05.925743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdbadaab-c497-49e7-8c51-ff8f25e369b1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:05.926777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdbadaab-c497-49e7-8c51-ff8f25e369b1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:05.927441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdbadaab-c497-49e7-8c51-ff8f25e369b1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:06.032066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdbadaab-c497-49e7-8c51-ff8f25e369b1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:06.032908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdbadaab-c497-49e7-8c51-ff8f25e369b1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:06.033662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-fdbadaab-c497-49e7-8c51-ff8f25e369b1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lazy-loading 'fault' on Instance uuid 9e7ee779-1625-419f-a417-b349d98c61e9 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:06:06.333325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fdbadaab-c497-49e7-8c51-ff8f25e369b1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:06.353352 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fdbadaab-c497-49e7-8c51-ff8f25e369b1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 200 len: 1366 microversion: 2.1 time: 0.488589 Jul 14 15:06:06.389714 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2986/6007] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:05 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:07.410297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-751dc9f0-0dd7-4e46-a14b-e6de9389b892 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:07.411430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-751dc9f0-0dd7-4e46-a14b-e6de9389b892 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:07.443836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-751dc9f0-0dd7-4e46-a14b-e6de9389b892 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:07.444737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-751dc9f0-0dd7-4e46-a14b-e6de9389b892 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:07.447722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-751dc9f0-0dd7-4e46-a14b-e6de9389b892 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:07.450023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-751dc9f0-0dd7-4e46-a14b-e6de9389b892 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:07.488077 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-751dc9f0-0dd7-4e46-a14b-e6de9389b892 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-751dc9f0-0dd7-4e46-a14b-e6de9389b892 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 HTTP/1.1 Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '9e7ee779-1625-419f-a417-b349d98c61e9'} Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:07.493317 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:07.497995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:07.497995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:07.497995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:07.497995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:06:07.497995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:06:07.497995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:07.497995 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:07.501543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-751dc9f0-0dd7-4e46-a14b-e6de9389b892 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:06:07.504388 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-751dc9f0-0dd7-4e46-a14b-e6de9389b892 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 404 len: 111 microversion: 2.1 time: 0.101037 Jul 14 15:06:07.506920 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3022/6008] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:07 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:06:08.590139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e1874b28-995c-4fe4-943e-3577ba9776d2 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Action: 'create', calling method: .version_select at 0x7fd6c56e2820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-763647266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtUwkFL7qRosefa5SaJWIXVflZa4YCvdv/lxBUSs1coUIZzQna4hRjaUxa0Ereipmprr6O5v/6vPF1OCT+SI65evJwCcY6Ak7gV+RzR55noyUwT6JwnmqF0U6iqCvjoQA=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:08.614619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e1874b28-995c-4fe4-943e-3577ba9776d2 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Getting quotas for project c5b1a0afc1a942f7b4ce2d0b20739da1. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:06:08.667642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e1874b28-995c-4fe4-943e-3577ba9776d2 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Getting quotas for user 663974b480e3425a9a31d4eee8c946b5 and project c5b1a0afc1a942f7b4ce2d0b20739da1. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:06:08.733414 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e1874b28-995c-4fe4-943e-3577ba9776d2 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.150153 Jul 14 15:06:08.739845 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2987/6009] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:06:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:06:15.299118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-807975736", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "bd9cac24-638c-4163-b450-83802774d7b0"}], "key_name": "tempest-TestNetworkBasicOps-763647266", "security_groups": [{"name": "tempest-secgroup-smoke-1043046182"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:16.321826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] validate_networks() for [('bd9cac24-638c-4163-b450-83802774d7b0', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:06:17.487402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=7 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:18.692735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:06:18.696247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:06:18.696620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:06:18.698427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:06:18.698427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:06:18.709480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:18.709955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:18.710785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:18.711247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:18.741196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Getting quotas for project c5b1a0afc1a942f7b4ce2d0b20739da1. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:06:18.754794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Getting quotas for user 663974b480e3425a9a31d4eee8c946b5 and project c5b1a0afc1a942f7b4ce2d0b20739da1. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:06:18.782159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:06:18.787493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:06:18.875990 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-05c31a18-67f5-4a24-a7af-1ebb673add17 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.608747 Jul 14 15:06:18.894348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0ef32257-a69b-4ae4-95d0-1d96555398c1 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:18.894348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0ef32257-a69b-4ae4-95d0-1d96555398c1 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:18.905748 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3023/6010] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:06:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 3637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:06:18.905986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=65 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:18.905986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:18.905986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:19.016373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0ef32257-a69b-4ae4-95d0-1d96555398c1 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:19.032116 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0ef32257-a69b-4ae4-95d0-1d96555398c1 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1247 microversion: 2.1 time: 0.144092 Jul 14 15:06:19.044984 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2988/6011] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:18 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1247 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:19.285962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b483fa6-e1e7-4ec7-bba1-a78b9715c066 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:19.286380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b483fa6-e1e7-4ec7-bba1-a78b9715c066 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:19.294683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b483fa6-e1e7-4ec7-bba1-a78b9715c066 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:19.295444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b483fa6-e1e7-4ec7-bba1-a78b9715c066 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:19.296273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b483fa6-e1e7-4ec7-bba1-a78b9715c066 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:19.296728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b483fa6-e1e7-4ec7-bba1-a78b9715c066 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:19.341944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b483fa6-e1e7-4ec7-bba1-a78b9715c066 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:06:19.502596 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9b483fa6-e1e7-4ec7-bba1-a78b9715c066 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 204 len: 0 microversion: 2.1 time: 0.218992 Jul 14 15:06:19.503643 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3024/6012] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:06:19 2022] DELETE /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:06:19.516148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8693c51b-30fd-4acb-81bb-5fa2a94616f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:19.517635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8693c51b-30fd-4acb-81bb-5fa2a94616f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:19.574946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8693c51b-30fd-4acb-81bb-5fa2a94616f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:19.578536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8693c51b-30fd-4acb-81bb-5fa2a94616f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:19.596738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8693c51b-30fd-4acb-81bb-5fa2a94616f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:19.598083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8693c51b-30fd-4acb-81bb-5fa2a94616f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:20.059806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d21c2666-9d9a-4d0b-b727-42e5552d1444 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:20.060545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d21c2666-9d9a-4d0b-b727-42e5552d1444 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:20.074762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d21c2666-9d9a-4d0b-b727-42e5552d1444 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:20.075244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d21c2666-9d9a-4d0b-b727-42e5552d1444 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:20.076069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d21c2666-9d9a-4d0b-b727-42e5552d1444 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:20.084900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d21c2666-9d9a-4d0b-b727-42e5552d1444 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:20.269018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8693c51b-30fd-4acb-81bb-5fa2a94616f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:20.284461 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8693c51b-30fd-4acb-81bb-5fa2a94616f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1408 microversion: 2.1 time: 0.774102 Jul 14 15:06:20.285782 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2989/6013] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:19 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1408 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:20.331444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d21c2666-9d9a-4d0b-b727-42e5552d1444 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:20.346628 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d21c2666-9d9a-4d0b-b727-42e5552d1444 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1299 microversion: 2.1 time: 0.292330 Jul 14 15:06:20.347245 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3025/6014] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:20 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1299 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:21.307090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2b35509c-50be-4495-b137-7368b68ae654 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:21.308776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2b35509c-50be-4495-b137-7368b68ae654 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:21.320084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b35509c-50be-4495-b137-7368b68ae654 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:21.320858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b35509c-50be-4495-b137-7368b68ae654 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:21.321933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b35509c-50be-4495-b137-7368b68ae654 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:21.323307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b35509c-50be-4495-b137-7368b68ae654 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:21.364457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c36dfb33-3607-45a1-8339-f0c91cf55d83 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:21.365264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c36dfb33-3607-45a1-8339-f0c91cf55d83 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:21.376861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36dfb33-3607-45a1-8339-f0c91cf55d83 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:21.377543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36dfb33-3607-45a1-8339-f0c91cf55d83 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:21.378569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36dfb33-3607-45a1-8339-f0c91cf55d83 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:21.379196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36dfb33-3607-45a1-8339-f0c91cf55d83 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:21.607070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c36dfb33-3607-45a1-8339-f0c91cf55d83 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:21.616339 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c36dfb33-3607-45a1-8339-f0c91cf55d83 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1305 microversion: 2.1 time: 0.256423 Jul 14 15:06:21.616981 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3026/6015] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:21 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1305 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:21.890020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2b35509c-50be-4495-b137-7368b68ae654 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:21.905651 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2b35509c-50be-4495-b137-7368b68ae654 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1408 microversion: 2.1 time: 0.606744 Jul 14 15:06:21.907768 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2990/6016] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:21 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1408 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:22.635119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c6c773a5-05fc-4d78-aae2-064a92cf4409 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:22.635897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c6c773a5-05fc-4d78-aae2-064a92cf4409 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:22.653464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c773a5-05fc-4d78-aae2-064a92cf4409 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:22.653946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c773a5-05fc-4d78-aae2-064a92cf4409 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:22.654765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c773a5-05fc-4d78-aae2-064a92cf4409 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:22.655232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c773a5-05fc-4d78-aae2-064a92cf4409 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:22.924967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fbb75893-cf77-4273-8972-4c2105cd2e1d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:22.926272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fbb75893-cf77-4273-8972-4c2105cd2e1d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:22.935413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbb75893-cf77-4273-8972-4c2105cd2e1d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:22.941404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbb75893-cf77-4273-8972-4c2105cd2e1d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:22.942691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbb75893-cf77-4273-8972-4c2105cd2e1d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:22.944042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbb75893-cf77-4273-8972-4c2105cd2e1d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:23.611287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c6c773a5-05fc-4d78-aae2-064a92cf4409 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:23.620493 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c6c773a5-05fc-4d78-aae2-064a92cf4409 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1373 microversion: 2.1 time: 0.989777 Jul 14 15:06:23.621111 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3027/6017] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:22 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1373 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:23.689567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fbb75893-cf77-4273-8972-4c2105cd2e1d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:23.702653 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fbb75893-cf77-4273-8972-4c2105cd2e1d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1408 microversion: 2.1 time: 0.781546 Jul 14 15:06:23.709648 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2991/6018] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:22 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1408 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:24.165269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9c151141-42a5-49dd-8dcb-d77ca8561176 req-2ea55539-ab79-4cbb-9f62-bf80b3551e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be69051-1f14-4d37-810d-d29624714f45", "name": "network-vif-deleted", "tag": "6ae42087-6009-4b04-8bb7-574891960f82"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:24.191479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9c151141-42a5-49dd-8dcb-d77ca8561176 req-2ea55539-ab79-4cbb-9f62-bf80b3551e80 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:24.191961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9c151141-42a5-49dd-8dcb-d77ca8561176 req-2ea55539-ab79-4cbb-9f62-bf80b3551e80 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:24.247442 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9c151141-42a5-49dd-8dcb-d77ca8561176 req-2ea55539-ab79-4cbb-9f62-bf80b3551e80 service nova] Creating event network-vif-deleted:6ae42087-6009-4b04-8bb7-574891960f82 for instance 6be69051-1f14-4d37-810d-d29624714f45 on n-h1-767704-28 Jul 14 15:06:24.271093 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9c151141-42a5-49dd-8dcb-d77ca8561176 req-2ea55539-ab79-4cbb-9f62-bf80b3551e80 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109639 Jul 14 15:06:24.271756 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3028/6019] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:24.640774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d018ce38-a951-43a9-82c4-9f1242c22df3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:24.642213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d018ce38-a951-43a9-82c4-9f1242c22df3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:24.656566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d018ce38-a951-43a9-82c4-9f1242c22df3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:24.658339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d018ce38-a951-43a9-82c4-9f1242c22df3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:24.662225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d018ce38-a951-43a9-82c4-9f1242c22df3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:24.663341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d018ce38-a951-43a9-82c4-9f1242c22df3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:24.729038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-170e1d2d-5c2b-4489-abde-d9e2a0ea88dc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:24.729864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-170e1d2d-5c2b-4489-abde-d9e2a0ea88dc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:24.740477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-170e1d2d-5c2b-4489-abde-d9e2a0ea88dc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:24.740973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-170e1d2d-5c2b-4489-abde-d9e2a0ea88dc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:24.745061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-170e1d2d-5c2b-4489-abde-d9e2a0ea88dc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:24.747722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-170e1d2d-5c2b-4489-abde-d9e2a0ea88dc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:24.949132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-170e1d2d-5c2b-4489-abde-d9e2a0ea88dc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:24.976287 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-170e1d2d-5c2b-4489-abde-d9e2a0ea88dc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1201 microversion: 2.1 time: 0.252893 Jul 14 15:06:24.977193 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3029/6020] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:24 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1201 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:25.266768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d018ce38-a951-43a9-82c4-9f1242c22df3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:25.279056 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d018ce38-a951-43a9-82c4-9f1242c22df3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1373 microversion: 2.1 time: 0.645427 Jul 14 15:06:25.281714 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2992/6021] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:24 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1373 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:25.995455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8dff4681-a999-43b7-9298-a5af09594afc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:25.996093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8dff4681-a999-43b7-9298-a5af09594afc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:26.020112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8dff4681-a999-43b7-9298-a5af09594afc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:26.024668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8dff4681-a999-43b7-9298-a5af09594afc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:26.025818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8dff4681-a999-43b7-9298-a5af09594afc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:26.027829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8dff4681-a999-43b7-9298-a5af09594afc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:26.208759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8dff4681-a999-43b7-9298-a5af09594afc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:26.228318 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8dff4681-a999-43b7-9298-a5af09594afc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1201 microversion: 2.1 time: 0.236318 Jul 14 15:06:26.245550 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3030/6022] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:25 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1201 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:26.303101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ad1a6e31-4a12-4786-af68-3604131ab93d req-884809cf-a75d-425a-a3e5-38dd616bd442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef7be5f1-1d82-407b-a9cd-89b652953a1f", "tag": "20dfa921-09b9-4aa4-9675-7a2c8dd78e5d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:26.305108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e0593eda-3cc0-4266-af25-95be360c0a3d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:26.305707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e0593eda-3cc0-4266-af25-95be360c0a3d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:26.325972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ad1a6e31-4a12-4786-af68-3604131ab93d req-884809cf-a75d-425a-a3e5-38dd616bd442 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:26.326436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ad1a6e31-4a12-4786-af68-3604131ab93d req-884809cf-a75d-425a-a3e5-38dd616bd442 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:26.328957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e0593eda-3cc0-4266-af25-95be360c0a3d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:26.329422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e0593eda-3cc0-4266-af25-95be360c0a3d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:26.330214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e0593eda-3cc0-4266-af25-95be360c0a3d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:26.338149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e0593eda-3cc0-4266-af25-95be360c0a3d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:26.409568 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ad1a6e31-4a12-4786-af68-3604131ab93d req-884809cf-a75d-425a-a3e5-38dd616bd442 service nova] Creating event network-changed:20dfa921-09b9-4aa4-9675-7a2c8dd78e5d for instance ef7be5f1-1d82-407b-a9cd-89b652953a1f on n-h2-767704-28 Jul 14 15:06:26.429411 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ad1a6e31-4a12-4786-af68-3604131ab93d req-884809cf-a75d-425a-a3e5-38dd616bd442 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125694 Jul 14 15:06:26.431937 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3031/6023] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:27.251940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6dfe03ee-e652-46b6-8d4b-0522dbf6fc8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:27.252903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6dfe03ee-e652-46b6-8d4b-0522dbf6fc8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:27.261343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6dfe03ee-e652-46b6-8d4b-0522dbf6fc8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:27.262056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6dfe03ee-e652-46b6-8d4b-0522dbf6fc8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:27.263466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6dfe03ee-e652-46b6-8d4b-0522dbf6fc8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:27.264089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6dfe03ee-e652-46b6-8d4b-0522dbf6fc8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:27.567386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e0593eda-3cc0-4266-af25-95be360c0a3d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:27.576971 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e0593eda-3cc0-4266-af25-95be360c0a3d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1373 microversion: 2.1 time: 1.282559 Jul 14 15:06:27.593212 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2993/6024] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:26 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1373 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:27.628391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6dfe03ee-e652-46b6-8d4b-0522dbf6fc8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:27.639919 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6dfe03ee-e652-46b6-8d4b-0522dbf6fc8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1201 microversion: 2.1 time: 0.393372 Jul 14 15:06:27.646878 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3032/6025] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:27 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1201 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:28.597896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5d3b887-58a5-40ad-ab32-b88720ee218e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:28.598593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e5d3b887-58a5-40ad-ab32-b88720ee218e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:28.617162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5d3b887-58a5-40ad-ab32-b88720ee218e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:28.617631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5d3b887-58a5-40ad-ab32-b88720ee218e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:28.619049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5d3b887-58a5-40ad-ab32-b88720ee218e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:28.619799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e5d3b887-58a5-40ad-ab32-b88720ee218e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:28.664250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-db0f1258-9ed5-4caa-aa6b-48fc61e710a4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:28.666198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-db0f1258-9ed5-4caa-aa6b-48fc61e710a4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:28.685873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db0f1258-9ed5-4caa-aa6b-48fc61e710a4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:28.686357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db0f1258-9ed5-4caa-aa6b-48fc61e710a4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:28.691468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db0f1258-9ed5-4caa-aa6b-48fc61e710a4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:28.696069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db0f1258-9ed5-4caa-aa6b-48fc61e710a4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:28.754560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:28.762908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:29.030974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:29.093388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-db0f1258-9ed5-4caa-aa6b-48fc61e710a4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:29.107936 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-db0f1258-9ed5-4caa-aa6b-48fc61e710a4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1201 microversion: 2.1 time: 0.447563 Jul 14 15:06:29.110383 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3033/6026] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:28 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1201 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:29.375685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e5d3b887-58a5-40ad-ab32-b88720ee218e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:29.384817 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e5d3b887-58a5-40ad-ab32-b88720ee218e tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1373 microversion: 2.1 time: 0.790506 Jul 14 15:06:29.405202 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2994/6027] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:28 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1373 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:30.128238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c0432e2f-82d3-4846-a889-d2115d0c739a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:30.139388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c0432e2f-82d3-4846-a889-d2115d0c739a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:30.159990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:30.166094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0432e2f-82d3-4846-a889-d2115d0c739a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:30.166559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0432e2f-82d3-4846-a889-d2115d0c739a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:30.167397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0432e2f-82d3-4846-a889-d2115d0c739a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:30.174251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0432e2f-82d3-4846-a889-d2115d0c739a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:30.407497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a1c6e5e3-5b86-4dc1-9d2a-883e515473c4 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:30.408125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a1c6e5e3-5b86-4dc1-9d2a-883e515473c4 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:30.420088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1c6e5e3-5b86-4dc1-9d2a-883e515473c4 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:30.441701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1c6e5e3-5b86-4dc1-9d2a-883e515473c4 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:30.443295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1c6e5e3-5b86-4dc1-9d2a-883e515473c4 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:30.443907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1c6e5e3-5b86-4dc1-9d2a-883e515473c4 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:30.673337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c0432e2f-82d3-4846-a889-d2115d0c739a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:30.693761 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c0432e2f-82d3-4846-a889-d2115d0c739a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1201 microversion: 2.1 time: 0.569394 Jul 14 15:06:30.705241 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3034/6028] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:30 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1201 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:31.029331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a1c6e5e3-5b86-4dc1-9d2a-883e515473c4 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:31.045527 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a1c6e5e3-5b86-4dc1-9d2a-883e515473c4 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1373 microversion: 2.1 time: 0.642142 Jul 14 15:06:31.046339 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2995/6029] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:30 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1373 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:31.712320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-48861d98-6697-4414-9da3-822583cc3b34 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:31.713111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-48861d98-6697-4414-9da3-822583cc3b34 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:31.730769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48861d98-6697-4414-9da3-822583cc3b34 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:31.731250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48861d98-6697-4414-9da3-822583cc3b34 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:31.735982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48861d98-6697-4414-9da3-822583cc3b34 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:31.736546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48861d98-6697-4414-9da3-822583cc3b34 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:32.044345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-48861d98-6697-4414-9da3-822583cc3b34 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:32.063354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c7e80300-f814-40f8-bbfb-f1a3ae2794bb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:32.063976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c7e80300-f814-40f8-bbfb-f1a3ae2794bb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:32.065158 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-48861d98-6697-4414-9da3-822583cc3b34 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1201 microversion: 2.1 time: 0.357057 Jul 14 15:06:32.065902 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3035/6030] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:31 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1201 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:32.087330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7e80300-f814-40f8-bbfb-f1a3ae2794bb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:32.089637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7e80300-f814-40f8-bbfb-f1a3ae2794bb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:32.090647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7e80300-f814-40f8-bbfb-f1a3ae2794bb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:32.093521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7e80300-f814-40f8-bbfb-f1a3ae2794bb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:32.565685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c7e80300-f814-40f8-bbfb-f1a3ae2794bb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:32.574709 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c7e80300-f814-40f8-bbfb-f1a3ae2794bb tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1373 microversion: 2.1 time: 0.515567 Jul 14 15:06:32.580203 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2996/6031] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:32 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1373 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:33.087381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e80fa66e-bf5a-4c1d-9a38-dffe62feb403 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:33.092599 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e80fa66e-bf5a-4c1d-9a38-dffe62feb403 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:33.127449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e80fa66e-bf5a-4c1d-9a38-dffe62feb403 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:33.139923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e80fa66e-bf5a-4c1d-9a38-dffe62feb403 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:33.144041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e80fa66e-bf5a-4c1d-9a38-dffe62feb403 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:33.151895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e80fa66e-bf5a-4c1d-9a38-dffe62feb403 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:33.316732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e80fa66e-bf5a-4c1d-9a38-dffe62feb403 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:33.328504 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e80fa66e-bf5a-4c1d-9a38-dffe62feb403 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1201 microversion: 2.1 time: 0.247169 Jul 14 15:06:33.329553 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3036/6032] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:33 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1201 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:33.596492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1ee15f9b-0876-4c6a-b325-64beed0148da tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:33.597689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1ee15f9b-0876-4c6a-b325-64beed0148da tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:33.613751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1ee15f9b-0876-4c6a-b325-64beed0148da tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:33.619645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1ee15f9b-0876-4c6a-b325-64beed0148da tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:33.624404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1ee15f9b-0876-4c6a-b325-64beed0148da tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:33.626993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1ee15f9b-0876-4c6a-b325-64beed0148da tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:33.864009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1ee15f9b-0876-4c6a-b325-64beed0148da tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:33.872719 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1ee15f9b-0876-4c6a-b325-64beed0148da tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1373 microversion: 2.1 time: 0.280101 Jul 14 15:06:33.882860 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2997/6033] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:33 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1373 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:34.039616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-bb33df4e-0f6c-44ca-b5ef-39559d3048c5 req-6eaad10b-9549-49db-b104-cc91a00909cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7be5f1-1d82-407b-a9cd-89b652953a1f", "name": "network-vif-plugged", "status": "completed", "tag": "20dfa921-09b9-4aa4-9675-7a2c8dd78e5d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:34.056095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bb33df4e-0f6c-44ca-b5ef-39559d3048c5 req-6eaad10b-9549-49db-b104-cc91a00909cc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:34.059269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bb33df4e-0f6c-44ca-b5ef-39559d3048c5 req-6eaad10b-9549-49db-b104-cc91a00909cc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:34.088646 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-bb33df4e-0f6c-44ca-b5ef-39559d3048c5 req-6eaad10b-9549-49db-b104-cc91a00909cc service nova] Creating event network-vif-plugged:20dfa921-09b9-4aa4-9675-7a2c8dd78e5d for instance ef7be5f1-1d82-407b-a9cd-89b652953a1f on n-h2-767704-28 Jul 14 15:06:34.103524 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-bb33df4e-0f6c-44ca-b5ef-39559d3048c5 req-6eaad10b-9549-49db-b104-cc91a00909cc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066801 Jul 14 15:06:34.104495 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3037/6034] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:34.350930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4362c1d3-4f1b-4331-b372-3257efe11f60 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:34.351597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4362c1d3-4f1b-4331-b372-3257efe11f60 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:34.362736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4362c1d3-4f1b-4331-b372-3257efe11f60 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:34.368576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4362c1d3-4f1b-4331-b372-3257efe11f60 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:34.369835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4362c1d3-4f1b-4331-b372-3257efe11f60 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:34.370527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4362c1d3-4f1b-4331-b372-3257efe11f60 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:34.521299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4362c1d3-4f1b-4331-b372-3257efe11f60 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:34.542135 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4362c1d3-4f1b-4331-b372-3257efe11f60 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 200 len: 1201 microversion: 2.1 time: 0.199524 Jul 14 15:06:34.552191 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2998/6035] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:34 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 1201 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:34.906085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2c007198-3748-4e15-9f52-1499caa18794 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:34.907374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2c007198-3748-4e15-9f52-1499caa18794 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:34.924666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c007198-3748-4e15-9f52-1499caa18794 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:34.926401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c007198-3748-4e15-9f52-1499caa18794 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:34.929485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c007198-3748-4e15-9f52-1499caa18794 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:34.933389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c007198-3748-4e15-9f52-1499caa18794 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:35.561276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b3110a8e-a38e-42f1-8db5-9c14d2838efc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:35.561276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b3110a8e-a38e-42f1-8db5-9c14d2838efc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:35.574996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3110a8e-a38e-42f1-8db5-9c14d2838efc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:35.575828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3110a8e-a38e-42f1-8db5-9c14d2838efc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:35.577327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3110a8e-a38e-42f1-8db5-9c14d2838efc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:35.578150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3110a8e-a38e-42f1-8db5-9c14d2838efc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:35.646889 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b3110a8e-a38e-42f1-8db5-9c14d2838efc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b3110a8e-a38e-42f1-8db5-9c14d2838efc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 HTTP/1.1 Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6be69051-1f14-4d37-810d-d29624714f45'} Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:35.649506 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:35.656685 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:35.656685 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:35.656685 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:35.656685 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:06:35.656685 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:06:35.656685 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:35.656685 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:35.656685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b3110a8e-a38e-42f1-8db5-9c14d2838efc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:06:35.656685 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b3110a8e-a38e-42f1-8db5-9c14d2838efc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 404 len: 111 microversion: 2.1 time: 0.095691 Jul 14 15:06:35.656685 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 2999/6036] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:35 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:06:35.866185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2c007198-3748-4e15-9f52-1499caa18794 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:35.892356 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2c007198-3748-4e15-9f52-1499caa18794 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1373 microversion: 2.1 time: 0.994752 Jul 14 15:06:35.893175 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3038/6037] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:34 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1373 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:36.911330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b60f5b2d-1eb0-4053-83f2-86f609073534 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:36.911979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b60f5b2d-1eb0-4053-83f2-86f609073534 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:36.935431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b60f5b2d-1eb0-4053-83f2-86f609073534 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:36.935914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b60f5b2d-1eb0-4053-83f2-86f609073534 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:36.936743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b60f5b2d-1eb0-4053-83f2-86f609073534 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:36.941492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b60f5b2d-1eb0-4053-83f2-86f609073534 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:37.515866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b60f5b2d-1eb0-4053-83f2-86f609073534 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:37.530292 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b60f5b2d-1eb0-4053-83f2-86f609073534 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1545 microversion: 2.1 time: 0.623593 Jul 14 15:06:37.541465 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3000/6038] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:36 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1545 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:37.551327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-52c877c3-9c1b-48ae-bcf6-5e8bb5ba703d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:37.552537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-52c877c3-9c1b-48ae-bcf6-5e8bb5ba703d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:37.567697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52c877c3-9c1b-48ae-bcf6-5e8bb5ba703d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:37.568430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52c877c3-9c1b-48ae-bcf6-5e8bb5ba703d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:37.569448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52c877c3-9c1b-48ae-bcf6-5e8bb5ba703d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:37.573749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-52c877c3-9c1b-48ae-bcf6-5e8bb5ba703d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:38.062463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-52c877c3-9c1b-48ae-bcf6-5e8bb5ba703d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:38.071962 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-52c877c3-9c1b-48ae-bcf6-5e8bb5ba703d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1545 microversion: 2.1 time: 0.524505 Jul 14 15:06:38.078620 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3039/6039] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:37 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1545 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:42.749040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2cb2d89d-3061-44dd-a61d-685ae64ce35e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:42.750922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2cb2d89d-3061-44dd-a61d-685ae64ce35e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:42.775403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cb2d89d-3061-44dd-a61d-685ae64ce35e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.775751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cb2d89d-3061-44dd-a61d-685ae64ce35e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.776620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cb2d89d-3061-44dd-a61d-685ae64ce35e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.777038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cb2d89d-3061-44dd-a61d-685ae64ce35e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.825770 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-2cb2d89d-3061-44dd-a61d-685ae64ce35e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2cb2d89d-3061-44dd-a61d-685ae64ce35e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 HTTP/1.1 Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '9e7ee779-1625-419f-a417-b349d98c61e9'} Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:06:42.831643 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:06:42.835671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:42.835671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:42.835671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:42.835671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:42.835671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:42.835671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:42.835671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:42.835671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:06:42.835671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:06:42.835671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:42.835671 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:42.842039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2cb2d89d-3061-44dd-a61d-685ae64ce35e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:06:42.844093 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2cb2d89d-3061-44dd-a61d-685ae64ce35e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 404 len: 111 microversion: 2.1 time: 0.101928 Jul 14 15:06:42.845480 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3001/6040] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:06:42 2022] DELETE /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:06:42.858111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-389288d7-0325-4282-ab22-cdeb0df7177b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:42.859457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-389288d7-0325-4282-ab22-cdeb0df7177b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 9e7ee779-1625-419f-a417-b349d98c61e9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:42.909731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-389288d7-0325-4282-ab22-cdeb0df7177b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.910484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-389288d7-0325-4282-ab22-cdeb0df7177b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.912398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-389288d7-0325-4282-ab22-cdeb0df7177b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.915477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-389288d7-0325-4282-ab22-cdeb0df7177b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:43.005390 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-389288d7-0325-4282-ab22-cdeb0df7177b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-389288d7-0325-4282-ab22-cdeb0df7177b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 HTTP/1.1 Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '9e7ee779-1625-419f-a417-b349d98c61e9'} Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:43.007766 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:43.014487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:43.014487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:43.014487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:43.014487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:06:43.014487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:06:43.014487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. Jul 14 15:06:43.014487 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:43.015602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-389288d7-0325-4282-ab22-cdeb0df7177b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance 9e7ee779-1625-419f-a417-b349d98c61e9 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:06:43.018036 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-389288d7-0325-4282-ab22-cdeb0df7177b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9" status: 404 len: 111 microversion: 2.1 time: 0.167401 Jul 14 15:06:43.021782 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3040/6041] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:42 2022] GET /compute/v2.1/servers/9e7ee779-1625-419f-a417-b349d98c61e9 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:06:44.834996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-49e692c4-f751-41ca-b856-29262279b6d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:44.835581 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-49e692c4-f751-41ca-b856-29262279b6d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:44.855407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49e692c4-f751-41ca-b856-29262279b6d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:44.855943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49e692c4-f751-41ca-b856-29262279b6d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:44.856791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49e692c4-f751-41ca-b856-29262279b6d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:44.857269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49e692c4-f751-41ca-b856-29262279b6d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:44.913170 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-49e692c4-f751-41ca-b856-29262279b6d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-49e692c4-f751-41ca-b856-29262279b6d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 HTTP/1.1 Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6be69051-1f14-4d37-810d-d29624714f45'} Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:06:44.915657 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:06:44.920166 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:44.920166 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:44.920166 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:44.920166 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:44.920166 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:44.920166 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:44.920166 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:44.920166 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:06:44.920166 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:06:44.920166 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:44.920166 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:06:44.920166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-49e692c4-f751-41ca-b856-29262279b6d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:06:44.930438 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-49e692c4-f751-41ca-b856-29262279b6d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 404 len: 111 microversion: 2.1 time: 0.100938 Jul 14 15:06:44.931079 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3002/6042] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:06:44 2022] DELETE /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:06:44.940274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77ed6963-208d-48cb-8ff9-4bc22c846a18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:44.941061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-77ed6963-208d-48cb-8ff9-4bc22c846a18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 6be69051-1f14-4d37-810d-d29624714f45] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:44.955344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77ed6963-208d-48cb-8ff9-4bc22c846a18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:44.955822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77ed6963-208d-48cb-8ff9-4bc22c846a18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:44.956667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77ed6963-208d-48cb-8ff9-4bc22c846a18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:44.971304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77ed6963-208d-48cb-8ff9-4bc22c846a18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:44.986312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:45.013843 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-77ed6963-208d-48cb-8ff9-4bc22c846a18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77ed6963-208d-48cb-8ff9-4bc22c846a18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 HTTP/1.1 Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6be69051-1f14-4d37-810d-d29624714f45'} Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:45.022281 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:45.027706 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:45.027706 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:45.027706 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:45.027706 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:06:45.027706 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:06:45.027706 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. Jul 14 15:06:45.027706 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:06:45.027706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77ed6963-208d-48cb-8ff9-4bc22c846a18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance 6be69051-1f14-4d37-810d-d29624714f45 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:06:45.027706 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-77ed6963-208d-48cb-8ff9-4bc22c846a18 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45" status: 404 len: 111 microversion: 2.1 time: 0.088749 Jul 14 15:06:45.041585 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3041/6043] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:44 2022] GET /compute/v2.1/servers/6be69051-1f14-4d37-810d-d29624714f45 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:06:45.143791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aaa87dea-9c5c-4b4e-ac05-0a9abc89825a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Action: 'create', calling method: .version_select at 0x7fd6c533b1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-296175840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa221ZyOx2obnFJPI5dV5tD+meBQTdZWdKHn/KNKQ+/XII6Guq4mA5GWmumFohAoE+3oUaTWDFH8iL3J54tDxd/MUVclZn/0XFC1Ifr1wt+WLZr85KdWIJ4zt88xkzlUw=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:45.238509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-aaa87dea-9c5c-4b4e-ac05-0a9abc89825a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for project a357b38aa86347a68c4135066aef2786. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:06:45.259090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-aaa87dea-9c5c-4b4e-ac05-0a9abc89825a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for user e77523cc1cca458eb2a1b553aff072be and project a357b38aa86347a68c4135066aef2786. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:06:45.422563 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aaa87dea-9c5c-4b4e-ac05-0a9abc89825a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.292736 Jul 14 15:06:45.425129 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3003/6044] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:06:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:45.623612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-d1a3550a-8dec-4188-b9b3-b627d1e9deef req-197a46d3-3ca1-43d9-8bba-d35bd97f3b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef7be5f1-1d82-407b-a9cd-89b652953a1f", "tag": "20dfa921-09b9-4aa4-9675-7a2c8dd78e5d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:45.655216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d1a3550a-8dec-4188-b9b3-b627d1e9deef req-197a46d3-3ca1-43d9-8bba-d35bd97f3b1d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:45.656504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d1a3550a-8dec-4188-b9b3-b627d1e9deef req-197a46d3-3ca1-43d9-8bba-d35bd97f3b1d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:45.691798 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-d1a3550a-8dec-4188-b9b3-b627d1e9deef req-197a46d3-3ca1-43d9-8bba-d35bd97f3b1d service nova] Creating event network-changed:20dfa921-09b9-4aa4-9675-7a2c8dd78e5d for instance ef7be5f1-1d82-407b-a9cd-89b652953a1f on n-h2-767704-28 Jul 14 15:06:45.703726 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-d1a3550a-8dec-4188-b9b3-b627d1e9deef req-197a46d3-3ca1-43d9-8bba-d35bd97f3b1d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084571 Jul 14 15:06:45.704514 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3042/6045] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:04.942903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=72 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:04.944550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:04.945448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:04.954022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba04bb0f-6eee-4643-b34a-e1f94fc04ad3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:04.956230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ba04bb0f-6eee-4643-b34a-e1f94fc04ad3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:04.992702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba04bb0f-6eee-4643-b34a-e1f94fc04ad3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:04.996939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba04bb0f-6eee-4643-b34a-e1f94fc04ad3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:04.997974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba04bb0f-6eee-4643-b34a-e1f94fc04ad3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:05.000192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba04bb0f-6eee-4643-b34a-e1f94fc04ad3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:05.107919 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ba04bb0f-6eee-4643-b34a-e1f94fc04ad3 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "POST /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f/action" status: 200 len: 24572 microversion: 2.1 time: 0.166206 Jul 14 15:07:05.110151 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3004/6046] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:07:04 2022] POST /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f/action => generated 24572 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:07:16.218248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=17 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:16.220796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:16.238396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a896c1ee-95b0-48c4-b7ab-77e87d51329d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:16.240354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a896c1ee-95b0-48c4-b7ab-77e87d51329d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:16.263774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a896c1ee-95b0-48c4-b7ab-77e87d51329d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:16.267084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a896c1ee-95b0-48c4-b7ab-77e87d51329d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:16.268150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a896c1ee-95b0-48c4-b7ab-77e87d51329d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:16.273992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a896c1ee-95b0-48c4-b7ab-77e87d51329d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:16.368318 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a896c1ee-95b0-48c4-b7ab-77e87d51329d tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "POST /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f/action" status: 200 len: 32648 microversion: 2.1 time: 0.151928 Jul 14 15:07:16.369905 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3043/6047] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:07:16 2022] POST /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f/action => generated 32648 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:07:19.336399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b2c19ca6-c2a9-4d76-a0e4-ed0bf68f7418 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:19.337618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b2c19ca6-c2a9-4d76-a0e4-ed0bf68f7418 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:19.342561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:19.345588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:19.357313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2c19ca6-c2a9-4d76-a0e4-ed0bf68f7418 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:19.358036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-759429e6-20df-42c5-a55c-e167a6865a25 req-88b34dd9-2b41-4773-8d19-749d84703959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef7be5f1-1d82-407b-a9cd-89b652953a1f", "tag": "20dfa921-09b9-4aa4-9675-7a2c8dd78e5d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:19.358640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2c19ca6-c2a9-4d76-a0e4-ed0bf68f7418 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:19.359603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2c19ca6-c2a9-4d76-a0e4-ed0bf68f7418 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:19.360195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2c19ca6-c2a9-4d76-a0e4-ed0bf68f7418 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:19.391315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-759429e6-20df-42c5-a55c-e167a6865a25 req-88b34dd9-2b41-4773-8d19-749d84703959 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:19.391778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-759429e6-20df-42c5-a55c-e167a6865a25 req-88b34dd9-2b41-4773-8d19-749d84703959 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:19.400789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b2c19ca6-c2a9-4d76-a0e4-ed0bf68f7418 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:07:19.437220 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-759429e6-20df-42c5-a55c-e167a6865a25 req-88b34dd9-2b41-4773-8d19-749d84703959 service nova] Creating event network-changed:20dfa921-09b9-4aa4-9675-7a2c8dd78e5d for instance ef7be5f1-1d82-407b-a9cd-89b652953a1f on n-h2-767704-28 Jul 14 15:07:19.463543 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-759429e6-20df-42c5-a55c-e167a6865a25 req-88b34dd9-2b41-4773-8d19-749d84703959 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107092 Jul 14 15:07:19.464199 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3044/6048] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:07:19.592856 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b2c19ca6-c2a9-4d76-a0e4-ed0bf68f7418 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 204 len: 0 microversion: 2.1 time: 0.261279 Jul 14 15:07:19.593514 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3005/6049] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:07:19 2022] DELETE /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:07:19.605246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e6844675-1ff2-484f-8bad-c018085b4837 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:19.607773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e6844675-1ff2-484f-8bad-c018085b4837 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:19.628039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6844675-1ff2-484f-8bad-c018085b4837 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:19.631114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6844675-1ff2-484f-8bad-c018085b4837 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:19.632988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6844675-1ff2-484f-8bad-c018085b4837 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:19.636486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6844675-1ff2-484f-8bad-c018085b4837 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:20.024005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e6844675-1ff2-484f-8bad-c018085b4837 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:20.033072 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e6844675-1ff2-484f-8bad-c018085b4837 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1670 microversion: 2.1 time: 0.433207 Jul 14 15:07:20.034239 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3045/6050] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:19 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1670 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:20.852508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e3b2abc9-a830-4888-8592-05e0df316ac0 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Action: 'create', calling method: .version_select at 0x7fd6c8311af0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2003099985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuqIT+/uGP3WD3FFmyVNhxB5TyX28D29nwSEfviL0xfaKQFUhEbqeCQwm9k+Ou0dgRhKhtOZk5UvmGAlLtIh4pdJllHdSE0rdj+jl6+yS5voidrCnHT6vDCND9zEiIjdg=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:20.873772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e3b2abc9-a830-4888-8592-05e0df316ac0 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Getting quotas for project 0b666acd76f14e11ac2b557a619318a0. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:07:20.880437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e3b2abc9-a830-4888-8592-05e0df316ac0 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Getting quotas for user 675a975fdfd24463b16d546abdb0218b and project 0b666acd76f14e11ac2b557a619318a0. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:07:20.925928 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e3b2abc9-a830-4888-8592-05e0df316ac0 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.476808 Jul 14 15:07:20.929265 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3006/6051] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:07:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:21.054917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-958d58fe-ccb4-4174-9669-25e6b53b3b88 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:21.055587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-958d58fe-ccb4-4174-9669-25e6b53b3b88 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:21.068871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-958d58fe-ccb4-4174-9669-25e6b53b3b88 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:21.069390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-958d58fe-ccb4-4174-9669-25e6b53b3b88 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:21.070143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-958d58fe-ccb4-4174-9669-25e6b53b3b88 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:21.070592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-958d58fe-ccb4-4174-9669-25e6b53b3b88 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:21.621555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-958d58fe-ccb4-4174-9669-25e6b53b3b88 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:21.637983 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-958d58fe-ccb4-4174-9669-25e6b53b3b88 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1670 microversion: 2.1 time: 0.587698 Jul 14 15:07:21.638945 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3046/6052] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:21 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1670 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:22.658289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a8961abd-5748-48ca-9363-1141e9b8c748 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:22.665424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a8961abd-5748-48ca-9363-1141e9b8c748 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:22.704824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8961abd-5748-48ca-9363-1141e9b8c748 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:22.705461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8961abd-5748-48ca-9363-1141e9b8c748 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:22.711759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8961abd-5748-48ca-9363-1141e9b8c748 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:22.712301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8961abd-5748-48ca-9363-1141e9b8c748 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:23.199099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-106045361", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-296175840", "security_groups": [{"name": "tempest-secgroup-smoke-943015086"}], "block_device_mapping_v2": [{"uuid": "f8077642-1af9-438a-9599-68c6a10ca1d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bce1cdb9-0501-4062-a135-972a001804ef"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:23.556752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a8961abd-5748-48ca-9363-1141e9b8c748 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:23.568826 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a8961abd-5748-48ca-9363-1141e9b8c748 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1670 microversion: 2.1 time: 0.914123 Jul 14 15:07:23.568826 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3007/6053] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:22 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1670 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:23.591986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] validate_networks() for [('bce1cdb9-0501-4062-a135-972a001804ef', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:07:24.101971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-bdc9616d-8315-4da3-8e77-a646faa3ab67 req-1d6b6ffe-a9c2-4113-8dd3-b13635322940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7be5f1-1d82-407b-a9cd-89b652953a1f", "name": "network-vif-deleted", "tag": "20dfa921-09b9-4aa4-9675-7a2c8dd78e5d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:24.121022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-bdc9616d-8315-4da3-8e77-a646faa3ab67 req-1d6b6ffe-a9c2-4113-8dd3-b13635322940 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:24.121924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-bdc9616d-8315-4da3-8e77-a646faa3ab67 req-1d6b6ffe-a9c2-4113-8dd3-b13635322940 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:24.142958 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-bdc9616d-8315-4da3-8e77-a646faa3ab67 req-1d6b6ffe-a9c2-4113-8dd3-b13635322940 service nova] Creating event network-vif-deleted:20dfa921-09b9-4aa4-9675-7a2c8dd78e5d for instance ef7be5f1-1d82-407b-a9cd-89b652953a1f on n-h2-767704-28 Jul 14 15:07:24.158208 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-bdc9616d-8315-4da3-8e77-a646faa3ab67 req-1d6b6ffe-a9c2-4113-8dd3-b13635322940 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061044 Jul 14 15:07:24.159246 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3008/6054] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:07:24.586802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-548797ec-6081-40f6-afa9-e11dd760690f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:24.587936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-548797ec-6081-40f6-afa9-e11dd760690f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:24.595358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-548797ec-6081-40f6-afa9-e11dd760690f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:24.595941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-548797ec-6081-40f6-afa9-e11dd760690f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:24.596830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-548797ec-6081-40f6-afa9-e11dd760690f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:24.597403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-548797ec-6081-40f6-afa9-e11dd760690f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:24.639105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-548797ec-6081-40f6-afa9-e11dd760690f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:24.639825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-548797ec-6081-40f6-afa9-e11dd760690f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:24.640571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-548797ec-6081-40f6-afa9-e11dd760690f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lazy-loading 'fault' on Instance uuid ef7be5f1-1d82-407b-a9cd-89b652953a1f {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:07:24.797458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-548797ec-6081-40f6-afa9-e11dd760690f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663974b480e3425a9a31d4eee8c946b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b1a0afc1a942f7b4ce2d0b20739da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:24.810748 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-548797ec-6081-40f6-afa9-e11dd760690f tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 200 len: 1337 microversion: 2.1 time: 0.230281 Jul 14 15:07:24.811355 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3009/6055] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:24 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 1337 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:07:25.586094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:07:25.587407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:07:25.588225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:07:25.588857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:07:25.589635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:07:25.611792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:25.612197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:25.614273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:25.615621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:25.647488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:07:25.655156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for user e77523cc1cca458eb2a1b553aff072be and project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:07:25.758501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:07:25.761009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8077642-1af9-438a-9599-68c6a10ca1d0',volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:07:25.844926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-565d068c-7571-4cca-a2c5-4d7b28429285 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:25.845755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-565d068c-7571-4cca-a2c5-4d7b28429285 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] [instance: ef7be5f1-1d82-407b-a9cd-89b652953a1f] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:25.856630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-565d068c-7571-4cca-a2c5-4d7b28429285 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:25.857263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-565d068c-7571-4cca-a2c5-4d7b28429285 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:25.858163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-565d068c-7571-4cca-a2c5-4d7b28429285 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:25.861373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-565d068c-7571-4cca-a2c5-4d7b28429285 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:25.892601 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-565d068c-7571-4cca-a2c5-4d7b28429285 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] HTTP exception thrown: Instance ef7be5f1-1d82-407b-a9cd-89b652953a1f could not be found. Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-565d068c-7571-4cca-a2c5-4d7b28429285 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Request method failure captured: Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f HTTP/1.1 Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DAkBH-ClvX7f6k1DJIyrf_u7w0WlZpM6IUOZ-9m2g6oOMAUHsPE3ZT8sQmtBqmuviYLBaNIuEwl3Tar3lti_IxUa2rgsc_KA9LDh2niiiMbjE-jbpCtvtvIqsn_hD2QuHoDpKS_PW5krAVGT9BQ0Ese-YyrkA3TgQji6PbrqRkbgvE Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: c5b1a0afc1a942f7b4ce2d0b20739da1 Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestNetworkBasicOps-1166988558 Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c5b1a0afc1a942f7b4ce2d0b20739da1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c5b1a0afc1a942f7b4ce2d0b20739da1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c5b1a0afc1a942f7b4ce2d0b20739da1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c5b1a0afc1a942f7b4ce2d0b20739da1"}]}] Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestNetworkBasicOps-1166988558 Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: c5b1a0afc1a942f7b4ce2d0b20739da1 Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestNetworkBasicOps-1166988558 Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestNetworkBasicOps-1166988558-project Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 663974b480e3425a9a31d4eee8c946b5 Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestNetworkBasicOps-1166988558-project Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance ef7be5f1-1d82-407b-a9cd-89b652953a1f could not be found. Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'ef7be5f1-1d82-407b-a9cd-89b652953a1f'} Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7be5f1-1d82-407b-a9cd-89b652953a1f could not be found. Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7be5f1-1d82-407b-a9cd-89b652953a1f could not be found. Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:25.907147 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:07:25.911219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:25.911219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:25.911219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:25.911219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:07:25.911219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:07:25.911219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7be5f1-1d82-407b-a9cd-89b652953a1f could not be found. Jul 14 15:07:25.911219 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:07:25.913070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-565d068c-7571-4cca-a2c5-4d7b28429285 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Returning 404 to user: Instance ef7be5f1-1d82-407b-a9cd-89b652953a1f could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:07:25.914264 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-565d068c-7571-4cca-a2c5-4d7b28429285 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f" status: 404 len: 111 microversion: 2.1 time: 0.088299 Jul 14 15:07:25.929378 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3010/6056] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:25 2022] GET /compute/v2.1/servers/ef7be5f1-1d82-407b-a9cd-89b652953a1f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:07:25.953439 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4e07f4d1-a934-441b-bdf0-adc97ac61581 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.757814 Jul 14 15:07:25.954728 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3047/6057] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:07:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 2760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:07:25.974915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-73ffc7bd-0bec-4b01-92c2-6a3be65f83b9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:25.975830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-73ffc7bd-0bec-4b01-92c2-6a3be65f83b9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:26.105175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-73ffc7bd-0bec-4b01-92c2-6a3be65f83b9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:26.131319 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-73ffc7bd-0bec-4b01-92c2-6a3be65f83b9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1093 microversion: 2.1 time: 0.163913 Jul 14 15:07:26.134259 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3011/6058] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:25 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1093 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:26.198978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-06f3c30c-e59e-4b7d-b083-2cf63bb664d6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] Calling method '.version_select at 0x7fd6c5a64430>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:26.249388 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-06f3c30c-e59e-4b7d-b083-2cf63bb664d6 tempest-TestNetworkBasicOps-1166988558 tempest-TestNetworkBasicOps-1166988558-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-763647266" status: 202 len: 0 microversion: 2.1 time: 0.054920 Jul 14 15:07:26.250975 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3048/6059] 10.222.0.81 () {58 vars in 1253 bytes} [Thu Jul 14 15:07:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-763647266 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:07:27.150994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e699581-b8ea-4901-b12b-35e0cd1bcea4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:27.151571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4e699581-b8ea-4901-b12b-35e0cd1bcea4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:27.185652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e699581-b8ea-4901-b12b-35e0cd1bcea4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:27.186535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e699581-b8ea-4901-b12b-35e0cd1bcea4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:27.187588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e699581-b8ea-4901-b12b-35e0cd1bcea4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:27.188212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e699581-b8ea-4901-b12b-35e0cd1bcea4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:27.355881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4e699581-b8ea-4901-b12b-35e0cd1bcea4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:27.376357 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e699581-b8ea-4901-b12b-35e0cd1bcea4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1191 microversion: 2.1 time: 0.229252 Jul 14 15:07:27.377573 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3012/6060] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:27 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1191 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:28.395917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2d7a8107-a09b-4747-a63a-8a1fb21b65d4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:28.397164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2d7a8107-a09b-4747-a63a-8a1fb21b65d4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:28.425436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d7a8107-a09b-4747-a63a-8a1fb21b65d4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:28.430618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d7a8107-a09b-4747-a63a-8a1fb21b65d4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:28.432049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d7a8107-a09b-4747-a63a-8a1fb21b65d4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:28.433256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d7a8107-a09b-4747-a63a-8a1fb21b65d4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:28.824680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2d7a8107-a09b-4747-a63a-8a1fb21b65d4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:28.854819 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2d7a8107-a09b-4747-a63a-8a1fb21b65d4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1209 microversion: 2.1 time: 0.461957 Jul 14 15:07:28.870772 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3049/6061] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:28 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1209 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:29.871329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f0820b6-08ae-40a1-a5ce-69be9430d487 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:29.889246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3f0820b6-08ae-40a1-a5ce-69be9430d487 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:29.920029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f0820b6-08ae-40a1-a5ce-69be9430d487 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:29.921370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f0820b6-08ae-40a1-a5ce-69be9430d487 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:29.923619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f0820b6-08ae-40a1-a5ce-69be9430d487 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:29.924380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f0820b6-08ae-40a1-a5ce-69be9430d487 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:30.339358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3f0820b6-08ae-40a1-a5ce-69be9430d487 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:30.352613 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3f0820b6-08ae-40a1-a5ce-69be9430d487 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1209 microversion: 2.1 time: 0.484318 Jul 14 15:07:30.354249 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3013/6062] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:29 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1209 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:31.371794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b7a075a4-33dd-4dce-8aa3-592b7a154fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:31.372591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b7a075a4-33dd-4dce-8aa3-592b7a154fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:31.392538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7a075a4-33dd-4dce-8aa3-592b7a154fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:31.393401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7a075a4-33dd-4dce-8aa3-592b7a154fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:31.396129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7a075a4-33dd-4dce-8aa3-592b7a154fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:31.397320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b7a075a4-33dd-4dce-8aa3-592b7a154fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:32.758545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b7a075a4-33dd-4dce-8aa3-592b7a154fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:32.778868 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b7a075a4-33dd-4dce-8aa3-592b7a154fbf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1276 microversion: 2.1 time: 1.409732 Jul 14 15:07:32.794564 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3050/6063] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:31 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1276 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:33.800185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cf520cf1-e143-4b77-b655-e8f805b2c09c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:33.801058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cf520cf1-e143-4b77-b655-e8f805b2c09c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:33.819642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf520cf1-e143-4b77-b655-e8f805b2c09c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:33.820133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf520cf1-e143-4b77-b655-e8f805b2c09c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:33.820993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf520cf1-e143-4b77-b655-e8f805b2c09c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:33.821441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf520cf1-e143-4b77-b655-e8f805b2c09c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:34.668842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cf520cf1-e143-4b77-b655-e8f805b2c09c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:34.677983 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cf520cf1-e143-4b77-b655-e8f805b2c09c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1276 microversion: 2.1 time: 0.881727 Jul 14 15:07:34.682879 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3014/6064] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:33 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1276 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:35.696516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-23975981-9a9f-477e-8d3c-1faac529ebb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:35.702911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-23975981-9a9f-477e-8d3c-1faac529ebb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:35.706323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:35.710034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:35.730771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23975981-9a9f-477e-8d3c-1faac529ebb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:35.731620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23975981-9a9f-477e-8d3c-1faac529ebb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:35.732703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23975981-9a9f-477e-8d3c-1faac529ebb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:35.733426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-23975981-9a9f-477e-8d3c-1faac529ebb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:37.333806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-23975981-9a9f-477e-8d3c-1faac529ebb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:37.370222 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-23975981-9a9f-477e-8d3c-1faac529ebb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1276 microversion: 2.1 time: 1.677660 Jul 14 15:07:37.383445 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3051/6065] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:35 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1276 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:38.046220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d6b82696-c8f5-45b3-9d1b-bc7b4cf79f48 req-1423dee1-3dec-4a0b-bcfc-2e53f2346648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31932a71-c4d3-4b24-9574-859abc712fd4", "tag": "2aec7664-4fd7-4679-bfda-d5ca2809bd81"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:38.068590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:38.079686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d6b82696-c8f5-45b3-9d1b-bc7b4cf79f48 req-1423dee1-3dec-4a0b-bcfc-2e53f2346648 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:38.080330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d6b82696-c8f5-45b3-9d1b-bc7b4cf79f48 req-1423dee1-3dec-4a0b-bcfc-2e53f2346648 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:38.114075 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d6b82696-c8f5-45b3-9d1b-bc7b4cf79f48 req-1423dee1-3dec-4a0b-bcfc-2e53f2346648 service nova] Creating event network-changed:2aec7664-4fd7-4679-bfda-d5ca2809bd81 for instance 31932a71-c4d3-4b24-9574-859abc712fd4 on n-h1-767704-28 Jul 14 15:07:38.132807 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d6b82696-c8f5-45b3-9d1b-bc7b4cf79f48 req-1423dee1-3dec-4a0b-bcfc-2e53f2346648 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091005 Jul 14 15:07:38.136555 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3015/6066] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:38.387031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8273256a-fb1c-4630-82f7-b926a3ef43bb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:38.387752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8273256a-fb1c-4630-82f7-b926a3ef43bb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:38.415027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8273256a-fb1c-4630-82f7-b926a3ef43bb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:38.416701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8273256a-fb1c-4630-82f7-b926a3ef43bb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:38.430149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8273256a-fb1c-4630-82f7-b926a3ef43bb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:38.430149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8273256a-fb1c-4630-82f7-b926a3ef43bb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:39.313281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8273256a-fb1c-4630-82f7-b926a3ef43bb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:39.328100 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8273256a-fb1c-4630-82f7-b926a3ef43bb tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1276 microversion: 2.1 time: 0.945143 Jul 14 15:07:39.374193 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3052/6067] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:38 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1276 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:40.385216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cf0fd7fe-aeb4-4de5-be26-1d746449cebe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:40.387820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cf0fd7fe-aeb4-4de5-be26-1d746449cebe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:40.413514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf0fd7fe-aeb4-4de5-be26-1d746449cebe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:40.416073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf0fd7fe-aeb4-4de5-be26-1d746449cebe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:40.417066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf0fd7fe-aeb4-4de5-be26-1d746449cebe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:40.419695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf0fd7fe-aeb4-4de5-be26-1d746449cebe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:41.355755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cf0fd7fe-aeb4-4de5-be26-1d746449cebe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:41.411928 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cf0fd7fe-aeb4-4de5-be26-1d746449cebe tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1264 microversion: 2.1 time: 1.030655 Jul 14 15:07:41.427614 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3016/6068] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:40 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1264 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:42.449051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f0811388-0a9d-47b5-9f69-a6e8d3b70295 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:42.450649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f0811388-0a9d-47b5-9f69-a6e8d3b70295 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:42.481534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f0811388-0a9d-47b5-9f69-a6e8d3b70295 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:42.482307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f0811388-0a9d-47b5-9f69-a6e8d3b70295 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:42.483355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f0811388-0a9d-47b5-9f69-a6e8d3b70295 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:42.490994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f0811388-0a9d-47b5-9f69-a6e8d3b70295 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:43.198601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f0811388-0a9d-47b5-9f69-a6e8d3b70295 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:43.210810 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f0811388-0a9d-47b5-9f69-a6e8d3b70295 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1264 microversion: 2.1 time: 0.769025 Jul 14 15:07:43.223628 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3053/6069] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:42 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1264 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:44.233501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-81ef99ae-cff1-4fc3-872d-e8326188ba52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:44.234148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-81ef99ae-cff1-4fc3-872d-e8326188ba52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:44.273624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81ef99ae-cff1-4fc3-872d-e8326188ba52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:44.274283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81ef99ae-cff1-4fc3-872d-e8326188ba52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:44.275148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81ef99ae-cff1-4fc3-872d-e8326188ba52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:44.275618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81ef99ae-cff1-4fc3-872d-e8326188ba52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:44.442172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-654465753-access_point-821154999", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "0eb92f3d-3511-4bb6-8b97-b3cb72c19d0e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2003099985", "security_groups": [{"name": "tempest-secgroup_access--1743209941"}, {"name": "tempest-secgroup_general--862219197"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:44.770843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-81ef99ae-cff1-4fc3-872d-e8326188ba52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:44.785202 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-81ef99ae-cff1-4fc3-872d-e8326188ba52 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1264 microversion: 2.1 time: 0.556797 Jul 14 15:07:44.786624 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3017/6070] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:44 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1264 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:45.015375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] validate_networks() for [('0eb92f3d-3511-4bb6-8b97-b3cb72c19d0e', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:07:45.806169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2d01c732-a96d-4848-b792-6fd6b26b9f20 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:45.807951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2d01c732-a96d-4848-b792-6fd6b26b9f20 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:45.825465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d01c732-a96d-4848-b792-6fd6b26b9f20 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:45.826461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d01c732-a96d-4848-b792-6fd6b26b9f20 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:45.829362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d01c732-a96d-4848-b792-6fd6b26b9f20 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:45.831535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2d01c732-a96d-4848-b792-6fd6b26b9f20 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:46.676416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2d01c732-a96d-4848-b792-6fd6b26b9f20 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:46.704130 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2d01c732-a96d-4848-b792-6fd6b26b9f20 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1264 microversion: 2.1 time: 0.904746 Jul 14 15:07:46.705703 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3018/6071] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:45 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1264 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:47.197442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:07:47.197983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:07:47.198383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:07:47.199461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:07:47.199914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:07:47.207665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:47.215975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:47.216441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:47.217286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:47.218614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:47.237711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=51 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:47.256044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Getting quotas for project 0b666acd76f14e11ac2b557a619318a0. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:07:47.271319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Getting quotas for user 675a975fdfd24463b16d546abdb0218b and project 0b666acd76f14e11ac2b557a619318a0. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:07:47.293145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:07:47.295261 n-d-767704-28 devstack@n-api.service[119512]: WARNING nova.utils [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-654465753-access_point-821154999 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-654465753-acc Jul 14 15:07:47.295933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:07:47.371227 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2ca99489-5788-4df4-b47f-d3181138cfe6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.937190 Jul 14 15:07:47.382371 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3054/6072] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:07:44 2022] POST /compute/v2.1/servers => generated 457 bytes in 2949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:07:47.387891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e0a7f44d-8c07-4e65-b6ba-7ee7f26c62b0 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:47.389837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e0a7f44d-8c07-4e65-b6ba-7ee7f26c62b0 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:47.662417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e0a7f44d-8c07-4e65-b6ba-7ee7f26c62b0 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:47.681433 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e0a7f44d-8c07-4e65-b6ba-7ee7f26c62b0 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1293 microversion: 2.1 time: 0.297885 Jul 14 15:07:47.683313 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3019/6073] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:47 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1293 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:47.722489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c36516d3-b22b-4388-b587-8a9d08173e4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:47.724319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c36516d3-b22b-4388-b587-8a9d08173e4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:47.738671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36516d3-b22b-4388-b587-8a9d08173e4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:47.740150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36516d3-b22b-4388-b587-8a9d08173e4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:47.742755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36516d3-b22b-4388-b587-8a9d08173e4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:47.743931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c36516d3-b22b-4388-b587-8a9d08173e4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:48.154668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c36516d3-b22b-4388-b587-8a9d08173e4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:48.167629 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c36516d3-b22b-4388-b587-8a9d08173e4a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1264 microversion: 2.1 time: 0.449892 Jul 14 15:07:48.168886 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3055/6074] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:47 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1264 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:48.708360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e3feb5ea-8def-4704-aa57-ed14f9b43b1c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:48.709560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e3feb5ea-8def-4704-aa57-ed14f9b43b1c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:48.726649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3feb5ea-8def-4704-aa57-ed14f9b43b1c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:48.727111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3feb5ea-8def-4704-aa57-ed14f9b43b1c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:48.728035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3feb5ea-8def-4704-aa57-ed14f9b43b1c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:48.728477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3feb5ea-8def-4704-aa57-ed14f9b43b1c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:48.929385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e3feb5ea-8def-4704-aa57-ed14f9b43b1c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:48.941869 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e3feb5ea-8def-4704-aa57-ed14f9b43b1c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1345 microversion: 2.1 time: 0.240293 Jul 14 15:07:48.952724 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3020/6075] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:48 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1345 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:49.186485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2760e711-94c1-4ac0-9d20-20f6632a1b7f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:49.187656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2760e711-94c1-4ac0-9d20-20f6632a1b7f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:49.223587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2760e711-94c1-4ac0-9d20-20f6632a1b7f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:49.224574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2760e711-94c1-4ac0-9d20-20f6632a1b7f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:49.226852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2760e711-94c1-4ac0-9d20-20f6632a1b7f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:49.228123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2760e711-94c1-4ac0-9d20-20f6632a1b7f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:49.961322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae0f30a2-770e-473d-9716-d18cc988562a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:49.963533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae0f30a2-770e-473d-9716-d18cc988562a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:49.975300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:49.977604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2760e711-94c1-4ac0-9d20-20f6632a1b7f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:49.979061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae0f30a2-770e-473d-9716-d18cc988562a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:49.980833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae0f30a2-770e-473d-9716-d18cc988562a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:49.981989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae0f30a2-770e-473d-9716-d18cc988562a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:49.983300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae0f30a2-770e-473d-9716-d18cc988562a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:49.986268 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2760e711-94c1-4ac0-9d20-20f6632a1b7f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1264 microversion: 2.1 time: 0.804452 Jul 14 15:07:49.996439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:49.996857 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3056/6076] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:49 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1264 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:50.183626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ae0f30a2-770e-473d-9716-d18cc988562a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:50.196087 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ae0f30a2-770e-473d-9716-d18cc988562a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1351 microversion: 2.1 time: 0.238624 Jul 14 15:07:50.199266 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3021/6077] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:49 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1351 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:51.015811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8473edac-c5f6-46dc-a767-f7a5481bd3a2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:51.017143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8473edac-c5f6-46dc-a767-f7a5481bd3a2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:51.037120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8473edac-c5f6-46dc-a767-f7a5481bd3a2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:51.037852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8473edac-c5f6-46dc-a767-f7a5481bd3a2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:51.041084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8473edac-c5f6-46dc-a767-f7a5481bd3a2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:51.043420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8473edac-c5f6-46dc-a767-f7a5481bd3a2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:51.215436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-75674e53-28c2-4846-bbbd-1cd17c8a4b3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:51.216996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-75674e53-28c2-4846-bbbd-1cd17c8a4b3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:51.233094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75674e53-28c2-4846-bbbd-1cd17c8a4b3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:51.236962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75674e53-28c2-4846-bbbd-1cd17c8a4b3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:51.239013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75674e53-28c2-4846-bbbd-1cd17c8a4b3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:51.243312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75674e53-28c2-4846-bbbd-1cd17c8a4b3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:51.766401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-75674e53-28c2-4846-bbbd-1cd17c8a4b3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:51.778096 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-75674e53-28c2-4846-bbbd-1cd17c8a4b3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1351 microversion: 2.1 time: 0.567346 Jul 14 15:07:51.786610 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3022/6078] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:51 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1351 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:07:52.022372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8473edac-c5f6-46dc-a767-f7a5481bd3a2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:52.038700 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8473edac-c5f6-46dc-a767-f7a5481bd3a2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1264 microversion: 2.1 time: 1.027624 Jul 14 15:07:52.046116 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3057/6079] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:51 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1264 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:52.800973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f82da179-3e3d-4d37-bb89-f854ead872a1 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:52.801428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f82da179-3e3d-4d37-bb89-f854ead872a1 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:52.819898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f82da179-3e3d-4d37-bb89-f854ead872a1 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:52.823587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f82da179-3e3d-4d37-bb89-f854ead872a1 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:52.832049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f82da179-3e3d-4d37-bb89-f854ead872a1 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:52.833748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f82da179-3e3d-4d37-bb89-f854ead872a1 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:53.056617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ddb956e6-fb24-4116-815f-f79a8ab66c81 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:53.057318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ddb956e6-fb24-4116-815f-f79a8ab66c81 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:53.069459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddb956e6-fb24-4116-815f-f79a8ab66c81 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:53.070000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddb956e6-fb24-4116-815f-f79a8ab66c81 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:53.108472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddb956e6-fb24-4116-815f-f79a8ab66c81 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:53.109132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddb956e6-fb24-4116-815f-f79a8ab66c81 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:53.656097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ddb956e6-fb24-4116-815f-f79a8ab66c81 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:53.668812 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ddb956e6-fb24-4116-815f-f79a8ab66c81 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1264 microversion: 2.1 time: 0.616197 Jul 14 15:07:53.669463 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3058/6080] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:53 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1264 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:53.966805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-885ec359-350a-4fce-b03e-d6c51e6eeb65 req-3823bbf8-05b7-4eac-9ccc-c48563f510db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31932a71-c4d3-4b24-9574-859abc712fd4", "name": "network-vif-plugged", "status": "completed", "tag": "2aec7664-4fd7-4679-bfda-d5ca2809bd81"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:53.990194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-885ec359-350a-4fce-b03e-d6c51e6eeb65 req-3823bbf8-05b7-4eac-9ccc-c48563f510db service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:53.995183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-885ec359-350a-4fce-b03e-d6c51e6eeb65 req-3823bbf8-05b7-4eac-9ccc-c48563f510db service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:54.051254 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-885ec359-350a-4fce-b03e-d6c51e6eeb65 req-3823bbf8-05b7-4eac-9ccc-c48563f510db service nova] Creating event network-vif-plugged:2aec7664-4fd7-4679-bfda-d5ca2809bd81 for instance 31932a71-c4d3-4b24-9574-859abc712fd4 on n-h1-767704-28 Jul 14 15:07:54.074429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-885ec359-350a-4fce-b03e-d6c51e6eeb65 req-3823bbf8-05b7-4eac-9ccc-c48563f510db service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401592 Jul 14 15:07:54.076138 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3059/6081] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:54.086457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f82da179-3e3d-4d37-bb89-f854ead872a1 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:54.099182 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f82da179-3e3d-4d37-bb89-f854ead872a1 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1470 microversion: 2.1 time: 1.302017 Jul 14 15:07:54.101891 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3023/6082] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:52 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1470 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:54.686736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-43996caf-b8f6-47d1-a86f-57d291859aed tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:54.687471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-43996caf-b8f6-47d1-a86f-57d291859aed tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:54.701837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43996caf-b8f6-47d1-a86f-57d291859aed tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:54.702582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43996caf-b8f6-47d1-a86f-57d291859aed tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:54.705718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43996caf-b8f6-47d1-a86f-57d291859aed tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:54.705718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-43996caf-b8f6-47d1-a86f-57d291859aed tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:55.121430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-17413ddd-8d36-4f9a-87ee-47f019e79a45 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:55.123420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-17413ddd-8d36-4f9a-87ee-47f019e79a45 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:55.138531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17413ddd-8d36-4f9a-87ee-47f019e79a45 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:55.139977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17413ddd-8d36-4f9a-87ee-47f019e79a45 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:55.141303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17413ddd-8d36-4f9a-87ee-47f019e79a45 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:55.143046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17413ddd-8d36-4f9a-87ee-47f019e79a45 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:55.490038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-43996caf-b8f6-47d1-a86f-57d291859aed tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:55.500210 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-43996caf-b8f6-47d1-a86f-57d291859aed tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1264 microversion: 2.1 time: 0.817791 Jul 14 15:07:55.514277 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3060/6083] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:54 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1264 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:55.718704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-17413ddd-8d36-4f9a-87ee-47f019e79a45 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:55.747110 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-17413ddd-8d36-4f9a-87ee-47f019e79a45 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1470 microversion: 2.1 time: 0.623636 Jul 14 15:07:55.749037 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3024/6084] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:55 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1470 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:56.520835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-991136d5-cd0b-4b85-9e17-cdb13143798c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:56.521518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-991136d5-cd0b-4b85-9e17-cdb13143798c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:56.548271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-991136d5-cd0b-4b85-9e17-cdb13143798c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:56.548826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-991136d5-cd0b-4b85-9e17-cdb13143798c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:56.550507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-991136d5-cd0b-4b85-9e17-cdb13143798c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:56.550979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-991136d5-cd0b-4b85-9e17-cdb13143798c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:56.767313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-81ca4e8b-d4f2-4837-b3c8-a3b359124484 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:56.768082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-81ca4e8b-d4f2-4837-b3c8-a3b359124484 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:56.787589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81ca4e8b-d4f2-4837-b3c8-a3b359124484 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:56.790724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81ca4e8b-d4f2-4837-b3c8-a3b359124484 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:56.797552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81ca4e8b-d4f2-4837-b3c8-a3b359124484 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:56.809393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-81ca4e8b-d4f2-4837-b3c8-a3b359124484 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:57.238551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:57.287199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:57.667580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:58.272414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-991136d5-cd0b-4b85-9e17-cdb13143798c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:58.283130 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-991136d5-cd0b-4b85-9e17-cdb13143798c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1450 microversion: 2.1 time: 1.769242 Jul 14 15:07:58.300382 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3061/6085] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:56 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1450 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:58.308688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6fe857dc-b1c1-48f6-bd56-b37519c34824 req-2175fbbf-117c-4077-8d8b-8bc528ff7294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4de0cd-0830-4cb4-81bf-7fb423fd8069", "tag": "1eb32241-217f-4e99-8b99-35e2e0f7d87e"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:58.323624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6fe857dc-b1c1-48f6-bd56-b37519c34824 req-2175fbbf-117c-4077-8d8b-8bc528ff7294 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:58.324494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6fe857dc-b1c1-48f6-bd56-b37519c34824 req-2175fbbf-117c-4077-8d8b-8bc528ff7294 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:58.346632 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6fe857dc-b1c1-48f6-bd56-b37519c34824 req-2175fbbf-117c-4077-8d8b-8bc528ff7294 service nova] Creating event network-changed:1eb32241-217f-4e99-8b99-35e2e0f7d87e for instance bb4de0cd-0830-4cb4-81bf-7fb423fd8069 on n-h2-767704-28 Jul 14 15:07:58.353131 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6fe857dc-b1c1-48f6-bd56-b37519c34824 req-2175fbbf-117c-4077-8d8b-8bc528ff7294 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050854 Jul 14 15:07:58.354141 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3062/6086] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:58.366923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8917681a-59dd-4580-b3f7-aec834c293e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:58.368610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8917681a-59dd-4580-b3f7-aec834c293e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:58.381698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8917681a-59dd-4580-b3f7-aec834c293e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:58.383126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8917681a-59dd-4580-b3f7-aec834c293e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:58.385094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8917681a-59dd-4580-b3f7-aec834c293e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:58.386031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8917681a-59dd-4580-b3f7-aec834c293e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:58.575030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-81ca4e8b-d4f2-4837-b3c8-a3b359124484 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:58.585607 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-81ca4e8b-d4f2-4837-b3c8-a3b359124484 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1470 microversion: 2.1 time: 1.820388 Jul 14 15:07:58.588716 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3025/6087] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:56 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1470 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:07:59.365596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8917681a-59dd-4580-b3f7-aec834c293e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:59.374500 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8917681a-59dd-4580-b3f7-aec834c293e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1450 microversion: 2.1 time: 1.016571 Jul 14 15:07:59.375338 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3063/6088] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:58 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1450 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:59.604600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b5fba9bd-e06d-4cb0-a117-fb4db302d621 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:59.605250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5fba9bd-e06d-4cb0-a117-fb4db302d621 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:59.620576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5fba9bd-e06d-4cb0-a117-fb4db302d621 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:59.621069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5fba9bd-e06d-4cb0-a117-fb4db302d621 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:59.625314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5fba9bd-e06d-4cb0-a117-fb4db302d621 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:59.625849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5fba9bd-e06d-4cb0-a117-fb4db302d621 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:00.160350 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b5fba9bd-e06d-4cb0-a117-fb4db302d621 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:00.172684 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b5fba9bd-e06d-4cb0-a117-fb4db302d621 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1470 microversion: 2.1 time: 0.574959 Jul 14 15:08:00.182417 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3026/6089] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:59 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1470 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:01.194905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-181e4653-1cc3-4627-8f85-b67ca32f2317 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:01.195925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-181e4653-1cc3-4627-8f85-b67ca32f2317 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:01.213979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-181e4653-1cc3-4627-8f85-b67ca32f2317 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:01.214477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-181e4653-1cc3-4627-8f85-b67ca32f2317 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:01.219714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-181e4653-1cc3-4627-8f85-b67ca32f2317 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:01.222271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-181e4653-1cc3-4627-8f85-b67ca32f2317 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:02.036401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-181e4653-1cc3-4627-8f85-b67ca32f2317 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:02.046745 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-181e4653-1cc3-4627-8f85-b67ca32f2317 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1470 microversion: 2.1 time: 0.856011 Jul 14 15:08:02.058002 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3064/6090] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:01 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1470 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:03.077861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a43a6214-0afe-4162-9ade-177edbee04d8 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:03.079386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a43a6214-0afe-4162-9ade-177edbee04d8 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:03.102776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a43a6214-0afe-4162-9ade-177edbee04d8 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:03.103435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a43a6214-0afe-4162-9ade-177edbee04d8 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:03.104292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a43a6214-0afe-4162-9ade-177edbee04d8 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:03.109145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a43a6214-0afe-4162-9ade-177edbee04d8 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:03.773947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a43a6214-0afe-4162-9ade-177edbee04d8 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:03.837044 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a43a6214-0afe-4162-9ade-177edbee04d8 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1470 microversion: 2.1 time: 0.755502 Jul 14 15:08:03.839406 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3027/6091] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:03 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1470 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:04.859155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36dc00b5-f3dd-46ac-b6f9-29f316c7cbe2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:04.862645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-36dc00b5-f3dd-46ac-b6f9-29f316c7cbe2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:04.880979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36dc00b5-f3dd-46ac-b6f9-29f316c7cbe2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:04.885379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36dc00b5-f3dd-46ac-b6f9-29f316c7cbe2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:04.893028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36dc00b5-f3dd-46ac-b6f9-29f316c7cbe2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:04.895039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36dc00b5-f3dd-46ac-b6f9-29f316c7cbe2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:05.583549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-36dc00b5-f3dd-46ac-b6f9-29f316c7cbe2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:05.597647 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-36dc00b5-f3dd-46ac-b6f9-29f316c7cbe2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1470 microversion: 2.1 time: 0.745120 Jul 14 15:08:05.610058 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3065/6092] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:04 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1470 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:06.618698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-102ea13e-251f-4420-85c0-2973941ea4e6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:06.619323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-102ea13e-251f-4420-85c0-2973941ea4e6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:06.636689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-102ea13e-251f-4420-85c0-2973941ea4e6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:06.637740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-102ea13e-251f-4420-85c0-2973941ea4e6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:06.639369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-102ea13e-251f-4420-85c0-2973941ea4e6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:06.641272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-102ea13e-251f-4420-85c0-2973941ea4e6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:07.255834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-102ea13e-251f-4420-85c0-2973941ea4e6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:07.284296 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-102ea13e-251f-4420-85c0-2973941ea4e6 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1470 microversion: 2.1 time: 0.666208 Jul 14 15:08:07.285414 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3028/6093] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:06 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1470 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:07.625619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-55360028-db2e-4ba0-ba31-d126acbec99c req-c986392e-d47b-4cd6-8dee-0fbc86962767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31932a71-c4d3-4b24-9574-859abc712fd4", "tag": "2aec7664-4fd7-4679-bfda-d5ca2809bd81"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:07.651604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-55360028-db2e-4ba0-ba31-d126acbec99c req-c986392e-d47b-4cd6-8dee-0fbc86962767 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:07.653852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-55360028-db2e-4ba0-ba31-d126acbec99c req-c986392e-d47b-4cd6-8dee-0fbc86962767 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:07.684988 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-55360028-db2e-4ba0-ba31-d126acbec99c req-c986392e-d47b-4cd6-8dee-0fbc86962767 service nova] Creating event network-changed:2aec7664-4fd7-4679-bfda-d5ca2809bd81 for instance 31932a71-c4d3-4b24-9574-859abc712fd4 on n-h1-767704-28 Jul 14 15:08:07.694273 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-55360028-db2e-4ba0-ba31-d126acbec99c req-c986392e-d47b-4cd6-8dee-0fbc86962767 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077333 Jul 14 15:08:07.695989 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3066/6094] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:08.302714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-250e35e4-34d6-4bde-9aaa-ee7644f9a3cf tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:08.303958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-250e35e4-34d6-4bde-9aaa-ee7644f9a3cf tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:08.317870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-250e35e4-34d6-4bde-9aaa-ee7644f9a3cf tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:08.324497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-250e35e4-34d6-4bde-9aaa-ee7644f9a3cf tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:08.325553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-250e35e4-34d6-4bde-9aaa-ee7644f9a3cf tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:08.326185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-250e35e4-34d6-4bde-9aaa-ee7644f9a3cf tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:09.578744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-250e35e4-34d6-4bde-9aaa-ee7644f9a3cf tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:09.599060 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-250e35e4-34d6-4bde-9aaa-ee7644f9a3cf tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1470 microversion: 2.1 time: 1.294661 Jul 14 15:08:09.612742 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3029/6095] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:08 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1470 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:10.621185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cac3e955-28dd-48e6-9870-c7612a908589 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:10.621919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cac3e955-28dd-48e6-9870-c7612a908589 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:10.656627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cac3e955-28dd-48e6-9870-c7612a908589 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:10.657156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cac3e955-28dd-48e6-9870-c7612a908589 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:10.660983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cac3e955-28dd-48e6-9870-c7612a908589 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:10.661378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cac3e955-28dd-48e6-9870-c7612a908589 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:10.955107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-8521ab8f-d107-469a-8fbd-435cd3feb1a8 req-e7a4f016-f738-4789-9ac2-f8eb53fc1097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4de0cd-0830-4cb4-81bf-7fb423fd8069", "name": "network-vif-plugged", "status": "completed", "tag": "1eb32241-217f-4e99-8b99-35e2e0f7d87e"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:10.990663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8521ab8f-d107-469a-8fbd-435cd3feb1a8 req-e7a4f016-f738-4789-9ac2-f8eb53fc1097 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:10.994287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8521ab8f-d107-469a-8fbd-435cd3feb1a8 req-e7a4f016-f738-4789-9ac2-f8eb53fc1097 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:11.020909 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8521ab8f-d107-469a-8fbd-435cd3feb1a8 req-e7a4f016-f738-4789-9ac2-f8eb53fc1097 service nova] Creating event network-vif-plugged:1eb32241-217f-4e99-8b99-35e2e0f7d87e for instance bb4de0cd-0830-4cb4-81bf-7fb423fd8069 on n-h2-767704-28 Jul 14 15:08:11.029958 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-8521ab8f-d107-469a-8fbd-435cd3feb1a8 req-e7a4f016-f738-4789-9ac2-f8eb53fc1097 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078696 Jul 14 15:08:11.032065 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3030/6096] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:08:11.262283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cac3e955-28dd-48e6-9870-c7612a908589 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:11.275153 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cac3e955-28dd-48e6-9870-c7612a908589 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1470 microversion: 2.1 time: 0.658719 Jul 14 15:08:11.276692 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3067/6097] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:10 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1470 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:12.295270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9b208f06-f6bf-4a75-a213-f6734cfd0a3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:12.295987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9b208f06-f6bf-4a75-a213-f6734cfd0a3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:12.331101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b208f06-f6bf-4a75-a213-f6734cfd0a3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:12.332715 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b208f06-f6bf-4a75-a213-f6734cfd0a3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:12.333833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b208f06-f6bf-4a75-a213-f6734cfd0a3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:12.334281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9b208f06-f6bf-4a75-a213-f6734cfd0a3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:12.773857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9b208f06-f6bf-4a75-a213-f6734cfd0a3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:12.803883 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9b208f06-f6bf-4a75-a213-f6734cfd0a3b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1470 microversion: 2.1 time: 0.512922 Jul 14 15:08:12.804801 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3031/6098] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:12 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1470 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:13.822862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b0b13d50-dd94-4008-b700-38829c28a883 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:13.824170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b0b13d50-dd94-4008-b700-38829c28a883 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:13.838159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0b13d50-dd94-4008-b700-38829c28a883 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:13.838666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0b13d50-dd94-4008-b700-38829c28a883 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:13.839951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0b13d50-dd94-4008-b700-38829c28a883 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:13.842653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0b13d50-dd94-4008-b700-38829c28a883 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:14.196443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b0b13d50-dd94-4008-b700-38829c28a883 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:14.207333 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b0b13d50-dd94-4008-b700-38829c28a883 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1642 microversion: 2.1 time: 0.388842 Jul 14 15:08:14.226641 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3068/6099] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:13 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1642 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:14.235987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e82aba13-d917-49bf-93f8-9f9567ed3089 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:14.236857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e82aba13-d917-49bf-93f8-9f9567ed3089 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:14.244592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e82aba13-d917-49bf-93f8-9f9567ed3089 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:14.244788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e82aba13-d917-49bf-93f8-9f9567ed3089 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:14.245655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e82aba13-d917-49bf-93f8-9f9567ed3089 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:14.246094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e82aba13-d917-49bf-93f8-9f9567ed3089 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:14.671806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e82aba13-d917-49bf-93f8-9f9567ed3089 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:14.691851 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e82aba13-d917-49bf-93f8-9f9567ed3089 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1642 microversion: 2.1 time: 0.465842 Jul 14 15:08:14.692745 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3032/6100] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:14 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1642 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:14.722389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1be80f49-09c4-4c36-b145-a9e04d2a230e tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:14.725622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1be80f49-09c4-4c36-b145-a9e04d2a230e tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:14.749145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1be80f49-09c4-4c36-b145-a9e04d2a230e tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:14.753166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1be80f49-09c4-4c36-b145-a9e04d2a230e tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:14.754142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1be80f49-09c4-4c36-b145-a9e04d2a230e tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:14.754581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1be80f49-09c4-4c36-b145-a9e04d2a230e tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:15.297881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6747a33e-e4b5-4f3f-94d7-f02e3b5b1c41 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:15.301119 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:08:15.301119 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 15:08:15.303017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6747a33e-e4b5-4f3f-94d7-f02e3b5b1c41 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:15.304263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6747a33e-e4b5-4f3f-94d7-f02e3b5b1c41 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:15.305585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6747a33e-e4b5-4f3f-94d7-f02e3b5b1c41 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:15.306208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6747a33e-e4b5-4f3f-94d7-f02e3b5b1c41 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:15.341414 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6747a33e-e4b5-4f3f-94d7-f02e3b5b1c41 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.426928 Jul 14 15:08:15.363779 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3033/6101] 10.222.0.81 () {58 vars in 1184 bytes} [Thu Jul 14 15:08:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:08:15.535728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2135961096", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "availability_zone": "nova:n-h2-767704-28", "networks": [{"uuid": "d5bfa889-7c02-4bb0-ba9d-4538d67fa0a3"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:15.677199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] validate_networks() for [('d5bfa889-7c02-4bb0-ba9d-4538d67fa0a3', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:08:15.728674 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1be80f49-09c4-4c36-b145-a9e04d2a230e tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1795 microversion: 2.1 time: 1.022983 Jul 14 15:08:15.733697 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3069/6102] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:14 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1795 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:17.397260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:08:17.400202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:08:17.400771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:08:17.402230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:08:17.402654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:08:17.423121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:17.423995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:17.426204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:17.426940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:17.469088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Getting quotas for project 2f368bf7a0444fe9b306cf0e859660f9. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:08:17.482092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Getting quotas for user 99314f0a8a214263b938c5e89847f98d and project 2f368bf7a0444fe9b306cf0e859660f9. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:08:17.517318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:08:17.524594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:08:17.648103 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-844932b0-7d12-4fc3-a0de-7fdfa5cb0c27 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.122096 Jul 14 15:08:17.649813 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3034/6103] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:08:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:08:17.664399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d3a0a82c-a86c-4ed8-908c-2afb06fac9fc tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:17.666306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d3a0a82c-a86c-4ed8-908c-2afb06fac9fc tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:17.685889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:17.821809 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d3a0a82c-a86c-4ed8-908c-2afb06fac9fc tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1329 microversion: 2.1 time: 0.165807 Jul 14 15:08:17.825087 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3070/6104] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:17 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1329 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:18.853133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9203fb6c-7c0c-41d9-b416-3e9573509b13 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:18.853769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9203fb6c-7c0c-41d9-b416-3e9573509b13 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:18.904403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9203fb6c-7c0c-41d9-b416-3e9573509b13 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:18.904877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9203fb6c-7c0c-41d9-b416-3e9573509b13 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:18.922358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9203fb6c-7c0c-41d9-b416-3e9573509b13 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:18.933498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9203fb6c-7c0c-41d9-b416-3e9573509b13 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:19.368603 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9203fb6c-7c0c-41d9-b416-3e9573509b13 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1346 microversion: 2.1 time: 0.522606 Jul 14 15:08:19.389850 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3035/6105] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:18 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1346 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:20.389371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c9d3074c-db39-4551-8121-e0776b4f4ebb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:20.390025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c9d3074c-db39-4551-8121-e0776b4f4ebb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:20.403227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9d3074c-db39-4551-8121-e0776b4f4ebb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:20.403896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9d3074c-db39-4551-8121-e0776b4f4ebb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:20.404524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9d3074c-db39-4551-8121-e0776b4f4ebb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:20.405012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9d3074c-db39-4551-8121-e0776b4f4ebb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:20.437416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=80 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:20.840173 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c9d3074c-db39-4551-8121-e0776b4f4ebb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1424 microversion: 2.1 time: 0.454692 Jul 14 15:08:20.858005 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3071/6106] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:20 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1424 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:21.877209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d8609c3-04cd-42b6-98c5-d440c4c455ac tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:21.889767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6d8609c3-04cd-42b6-98c5-d440c4c455ac tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:21.909135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:21.911910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d8609c3-04cd-42b6-98c5-d440c4c455ac tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:21.912369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d8609c3-04cd-42b6-98c5-d440c4c455ac tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:21.918871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d8609c3-04cd-42b6-98c5-d440c4c455ac tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:21.919345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d8609c3-04cd-42b6-98c5-d440c4c455ac tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:21.938012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=78 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:22.302562 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6d8609c3-04cd-42b6-98c5-d440c4c455ac tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1424 microversion: 2.1 time: 0.429286 Jul 14 15:08:22.303227 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3036/6107] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:21 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1424 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:23.321205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-88f3791b-bf30-416f-bfdd-f9a907cb569c tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:23.322016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-88f3791b-bf30-416f-bfdd-f9a907cb569c tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:23.341484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88f3791b-bf30-416f-bfdd-f9a907cb569c tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:23.343217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88f3791b-bf30-416f-bfdd-f9a907cb569c tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:23.348779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88f3791b-bf30-416f-bfdd-f9a907cb569c tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:23.351064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88f3791b-bf30-416f-bfdd-f9a907cb569c tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:24.644196 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-88f3791b-bf30-416f-bfdd-f9a907cb569c tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1466 microversion: 2.1 time: 1.327563 Jul 14 15:08:24.647038 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3072/6108] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:23 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1466 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:25.112606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c6df297a-0354-4691-b65a-1b8fe0eb3cf5 req-38346b92-d958-4465-8d32-e41e68d6ea49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4de0cd-0830-4cb4-81bf-7fb423fd8069", "tag": "1eb32241-217f-4e99-8b99-35e2e0f7d87e"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:25.134351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c6df297a-0354-4691-b65a-1b8fe0eb3cf5 req-38346b92-d958-4465-8d32-e41e68d6ea49 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:25.134809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c6df297a-0354-4691-b65a-1b8fe0eb3cf5 req-38346b92-d958-4465-8d32-e41e68d6ea49 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:25.153490 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c6df297a-0354-4691-b65a-1b8fe0eb3cf5 req-38346b92-d958-4465-8d32-e41e68d6ea49 service nova] Creating event network-changed:1eb32241-217f-4e99-8b99-35e2e0f7d87e for instance bb4de0cd-0830-4cb4-81bf-7fb423fd8069 on n-h2-767704-28 Jul 14 15:08:25.180070 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c6df297a-0354-4691-b65a-1b8fe0eb3cf5 req-38346b92-d958-4465-8d32-e41e68d6ea49 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071822 Jul 14 15:08:25.182152 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3037/6109] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:25.664833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2dc2a83e-218d-4ab8-b84f-ff3101098b1a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:25.665514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2dc2a83e-218d-4ab8-b84f-ff3101098b1a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:25.682624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dc2a83e-218d-4ab8-b84f-ff3101098b1a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:25.683389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dc2a83e-218d-4ab8-b84f-ff3101098b1a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:25.684195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dc2a83e-218d-4ab8-b84f-ff3101098b1a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:25.684653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2dc2a83e-218d-4ab8-b84f-ff3101098b1a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:27.317134 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2dc2a83e-218d-4ab8-b84f-ff3101098b1a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1466 microversion: 2.1 time: 1.657289 Jul 14 15:08:27.325823 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3073/6110] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:25 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1466 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:28.353957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5228e130-0db7-40de-9126-714e1165cf06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:28.354733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5228e130-0db7-40de-9126-714e1165cf06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:28.362851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:28.366980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:28.385279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5228e130-0db7-40de-9126-714e1165cf06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:28.385755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5228e130-0db7-40de-9126-714e1165cf06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:28.386517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5228e130-0db7-40de-9126-714e1165cf06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:28.386977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5228e130-0db7-40de-9126-714e1165cf06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:28.885145 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5228e130-0db7-40de-9126-714e1165cf06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1466 microversion: 2.1 time: 0.538970 Jul 14 15:08:28.887659 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3038/6111] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:28 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1466 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:29.904394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-58f8da09-9b0c-4c54-a144-4754fb59e5eb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:29.905151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-58f8da09-9b0c-4c54-a144-4754fb59e5eb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:29.920900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:29.927316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58f8da09-9b0c-4c54-a144-4754fb59e5eb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:29.942123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58f8da09-9b0c-4c54-a144-4754fb59e5eb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:29.943320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58f8da09-9b0c-4c54-a144-4754fb59e5eb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:29.943978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-58f8da09-9b0c-4c54-a144-4754fb59e5eb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:30.597246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-cddeda68-ebef-4cda-ab6b-0289cdec4238 req-7032b6f6-adbb-4fd1-822e-7cab005ff421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6a76df-19dc-42a3-b368-36c544b9e75a", "tag": "6bc6d187-3801-4217-9e4c-46a84f5d483f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:30.625352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cddeda68-ebef-4cda-ab6b-0289cdec4238 req-7032b6f6-adbb-4fd1-822e-7cab005ff421 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:30.627679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cddeda68-ebef-4cda-ab6b-0289cdec4238 req-7032b6f6-adbb-4fd1-822e-7cab005ff421 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:30.659971 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-cddeda68-ebef-4cda-ab6b-0289cdec4238 req-7032b6f6-adbb-4fd1-822e-7cab005ff421 service nova] Creating event network-changed:6bc6d187-3801-4217-9e4c-46a84f5d483f for instance 4a6a76df-19dc-42a3-b368-36c544b9e75a on n-h2-767704-28 Jul 14 15:08:30.699932 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-cddeda68-ebef-4cda-ab6b-0289cdec4238 req-7032b6f6-adbb-4fd1-822e-7cab005ff421 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107318 Jul 14 15:08:30.710199 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3039/6112] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:08:31.027075 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-58f8da09-9b0c-4c54-a144-4754fb59e5eb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1466 microversion: 2.1 time: 1.126842 Jul 14 15:08:31.038410 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3074/6113] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:29 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1466 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:32.048056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-820bc04a-2a28-4db0-8961-2bc0c4fdbea6 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:32.049625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-820bc04a-2a28-4db0-8961-2bc0c4fdbea6 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:32.067112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-820bc04a-2a28-4db0-8961-2bc0c4fdbea6 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:32.067819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-820bc04a-2a28-4db0-8961-2bc0c4fdbea6 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:32.068772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-820bc04a-2a28-4db0-8961-2bc0c4fdbea6 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:32.069629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-820bc04a-2a28-4db0-8961-2bc0c4fdbea6 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:32.388716 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-820bc04a-2a28-4db0-8961-2bc0c4fdbea6 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1466 microversion: 2.1 time: 0.341770 Jul 14 15:08:32.389666 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3040/6114] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:32 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1466 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:33.408833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2ea1af8e-dbc5-47b7-9caa-2d57a511108b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:33.409650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2ea1af8e-dbc5-47b7-9caa-2d57a511108b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:33.418660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ea1af8e-dbc5-47b7-9caa-2d57a511108b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:33.419668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ea1af8e-dbc5-47b7-9caa-2d57a511108b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:33.420622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ea1af8e-dbc5-47b7-9caa-2d57a511108b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:33.421285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ea1af8e-dbc5-47b7-9caa-2d57a511108b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:33.819199 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2ea1af8e-dbc5-47b7-9caa-2d57a511108b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1466 microversion: 2.1 time: 0.415234 Jul 14 15:08:33.819995 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3075/6115] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:33 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1466 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:34.841685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2e55a466-1611-48f3-b6ce-11a13e10a72a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:34.843638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2e55a466-1611-48f3-b6ce-11a13e10a72a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:34.862757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e55a466-1611-48f3-b6ce-11a13e10a72a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:34.863697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e55a466-1611-48f3-b6ce-11a13e10a72a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:34.865415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e55a466-1611-48f3-b6ce-11a13e10a72a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:34.869551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e55a466-1611-48f3-b6ce-11a13e10a72a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:35.111635 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2e55a466-1611-48f3-b6ce-11a13e10a72a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1466 microversion: 2.1 time: 0.278344 Jul 14 15:08:35.115779 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3041/6116] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:34 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1466 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:36.143904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-552c827d-e529-4950-b019-3200fdaeadd9 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:36.145977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-552c827d-e529-4950-b019-3200fdaeadd9 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:36.159205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-552c827d-e529-4950-b019-3200fdaeadd9 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:36.159703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-552c827d-e529-4950-b019-3200fdaeadd9 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:36.160534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-552c827d-e529-4950-b019-3200fdaeadd9 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:36.167074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-552c827d-e529-4950-b019-3200fdaeadd9 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:36.443448 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-552c827d-e529-4950-b019-3200fdaeadd9 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1466 microversion: 2.1 time: 0.314121 Jul 14 15:08:36.445113 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3076/6117] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:36 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1466 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:36.887402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-471196e9-2508-49e0-bcda-92d9534a2f20 req-b6ef843e-dc18-4a9f-aefc-fb48f0166479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6a76df-19dc-42a3-b368-36c544b9e75a", "name": "network-vif-plugged", "status": "completed", "tag": "6bc6d187-3801-4217-9e4c-46a84f5d483f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:36.916428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-471196e9-2508-49e0-bcda-92d9534a2f20 req-b6ef843e-dc18-4a9f-aefc-fb48f0166479 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:36.916916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-471196e9-2508-49e0-bcda-92d9534a2f20 req-b6ef843e-dc18-4a9f-aefc-fb48f0166479 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:36.949289 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-471196e9-2508-49e0-bcda-92d9534a2f20 req-b6ef843e-dc18-4a9f-aefc-fb48f0166479 service nova] Creating event network-vif-plugged:6bc6d187-3801-4217-9e4c-46a84f5d483f for instance 4a6a76df-19dc-42a3-b368-36c544b9e75a on n-h2-767704-28 Jul 14 15:08:36.959171 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-471196e9-2508-49e0-bcda-92d9534a2f20 req-b6ef843e-dc18-4a9f-aefc-fb48f0166479 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076654 Jul 14 15:08:36.960408 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3042/6118] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:37.464120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d0264ab0-afdf-4175-b801-fa7c36efa52b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:37.464848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d0264ab0-afdf-4175-b801-fa7c36efa52b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:37.502003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0264ab0-afdf-4175-b801-fa7c36efa52b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:37.503122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0264ab0-afdf-4175-b801-fa7c36efa52b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:37.505853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0264ab0-afdf-4175-b801-fa7c36efa52b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:37.509576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0264ab0-afdf-4175-b801-fa7c36efa52b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:38.003491 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d0264ab0-afdf-4175-b801-fa7c36efa52b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1466 microversion: 2.1 time: 0.544522 Jul 14 15:08:38.007723 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3077/6119] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:37 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1466 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:39.031618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7e14b1ec-3187-4e3b-b987-c473205e7138 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:39.032337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7e14b1ec-3187-4e3b-b987-c473205e7138 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:39.049480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e14b1ec-3187-4e3b-b987-c473205e7138 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:39.050192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e14b1ec-3187-4e3b-b987-c473205e7138 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:39.051310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e14b1ec-3187-4e3b-b987-c473205e7138 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:39.051915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e14b1ec-3187-4e3b-b987-c473205e7138 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:39.365284 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7e14b1ec-3187-4e3b-b987-c473205e7138 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1651 microversion: 2.1 time: 0.339266 Jul 14 15:08:39.385405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc8f9fc1-c3f8-4633-b24f-1aa8b9173652 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:39.386742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc8f9fc1-c3f8-4633-b24f-1aa8b9173652 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:39.393007 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3043/6120] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:39 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1651 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:39.398088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc8f9fc1-c3f8-4633-b24f-1aa8b9173652 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:39.400141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc8f9fc1-c3f8-4633-b24f-1aa8b9173652 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:39.402860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc8f9fc1-c3f8-4633-b24f-1aa8b9173652 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:39.403796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc8f9fc1-c3f8-4633-b24f-1aa8b9173652 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:40.345576 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc8f9fc1-c3f8-4633-b24f-1aa8b9173652 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1651 microversion: 2.1 time: 0.965274 Jul 14 15:08:40.346873 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3078/6121] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:39 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1651 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:40.362245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-56bd7965-8e59-4560-8990-f07aa1ec5260 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:40.362862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-56bd7965-8e59-4560-8990-f07aa1ec5260 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:40.379001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56bd7965-8e59-4560-8990-f07aa1ec5260 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:40.379451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56bd7965-8e59-4560-8990-f07aa1ec5260 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:40.380251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56bd7965-8e59-4560-8990-f07aa1ec5260 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:40.380694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56bd7965-8e59-4560-8990-f07aa1ec5260 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:40.639158 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-56bd7965-8e59-4560-8990-f07aa1ec5260 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1651 microversion: 2.1 time: 0.280959 Jul 14 15:08:40.643111 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3044/6122] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:40 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1651 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:40.724054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1972657526", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "availability_zone": "nova:n-h1-767704-28", "networks": [{"uuid": "d5bfa889-7c02-4bb0-ba9d-4538d67fa0a3"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:40.887685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] validate_networks() for [('d5bfa889-7c02-4bb0-ba9d-4538d67fa0a3', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:08:41.817558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:08:41.818935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:08:41.819590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:08:41.820173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:08:41.820759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:08:41.846101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:41.851676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:41.852635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:41.853137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:41.913491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Getting quotas for project 2f368bf7a0444fe9b306cf0e859660f9. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:08:41.925187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Getting quotas for user 99314f0a8a214263b938c5e89847f98d and project 2f368bf7a0444fe9b306cf0e859660f9. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:08:41.959957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:08:41.962927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:08:42.044195 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b84cfb30-cc3e-4cae-8091-fc93374b3ae1 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.321924 Jul 14 15:08:42.049895 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3079/6123] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:08:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:08:42.061138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b216909b-511f-4048-92f3-5c987a436aff tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:42.063133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b216909b-511f-4048-92f3-5c987a436aff tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:42.140648 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b216909b-511f-4048-92f3-5c987a436aff tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1329 microversion: 2.1 time: 0.083717 Jul 14 15:08:42.151713 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3045/6124] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:42 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1329 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:43.160747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e7c99d66-fc2b-4efc-9be3-11bbdc604556 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:43.162151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e7c99d66-fc2b-4efc-9be3-11bbdc604556 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:43.198101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7c99d66-fc2b-4efc-9be3-11bbdc604556 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:43.198609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7c99d66-fc2b-4efc-9be3-11bbdc604556 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:43.199519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7c99d66-fc2b-4efc-9be3-11bbdc604556 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:43.199983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e7c99d66-fc2b-4efc-9be3-11bbdc604556 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:43.338943 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e7c99d66-fc2b-4efc-9be3-11bbdc604556 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1346 microversion: 2.1 time: 0.183823 Jul 14 15:08:43.351200 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3080/6125] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:43 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1346 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:44.357674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0f567743-adf3-4c70-9183-30f365c98ede tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:44.361035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0f567743-adf3-4c70-9183-30f365c98ede tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:44.381049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f567743-adf3-4c70-9183-30f365c98ede tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:44.381825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f567743-adf3-4c70-9183-30f365c98ede tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:44.383326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f567743-adf3-4c70-9183-30f365c98ede tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:44.388891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f567743-adf3-4c70-9183-30f365c98ede tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:44.573755 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0f567743-adf3-4c70-9183-30f365c98ede tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1424 microversion: 2.1 time: 0.212946 Jul 14 15:08:44.576451 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3046/6126] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:44 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1424 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:45.597535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7badc04e-b9c0-45e0-905a-e2d94fd6653a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:45.598187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7badc04e-b9c0-45e0-905a-e2d94fd6653a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:45.612210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7badc04e-b9c0-45e0-905a-e2d94fd6653a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:45.614113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7badc04e-b9c0-45e0-905a-e2d94fd6653a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:45.618866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7badc04e-b9c0-45e0-905a-e2d94fd6653a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:45.619703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7badc04e-b9c0-45e0-905a-e2d94fd6653a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:45.970708 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7badc04e-b9c0-45e0-905a-e2d94fd6653a tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1466 microversion: 2.1 time: 0.375127 Jul 14 15:08:45.988539 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3081/6127] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:45 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1466 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:47.000105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0c09afe6-7112-4f50-bbaa-ad9d6ae4b939 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:47.002261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0c09afe6-7112-4f50-bbaa-ad9d6ae4b939 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:47.024610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c09afe6-7112-4f50-bbaa-ad9d6ae4b939 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:47.026043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c09afe6-7112-4f50-bbaa-ad9d6ae4b939 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:47.027542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c09afe6-7112-4f50-bbaa-ad9d6ae4b939 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:47.028174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c09afe6-7112-4f50-bbaa-ad9d6ae4b939 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:47.398754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-42960e01-e46e-4155-beb4-9a0b2de33b90 req-72dd916a-05f8-424e-b0fe-fe63351a36ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6558bc5e-2720-48c1-a8da-a93354406a1a", "tag": "7f519518-3a5b-4567-83e4-dc96f5f7dc65"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:47.426280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-42960e01-e46e-4155-beb4-9a0b2de33b90 req-72dd916a-05f8-424e-b0fe-fe63351a36ef service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:47.429912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-42960e01-e46e-4155-beb4-9a0b2de33b90 req-72dd916a-05f8-424e-b0fe-fe63351a36ef service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:47.484020 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0c09afe6-7112-4f50-bbaa-ad9d6ae4b939 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1466 microversion: 2.1 time: 0.496592 Jul 14 15:08:47.497430 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3047/6128] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:46 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1466 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:47.502338 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-42960e01-e46e-4155-beb4-9a0b2de33b90 req-72dd916a-05f8-424e-b0fe-fe63351a36ef service nova] Creating event network-changed:7f519518-3a5b-4567-83e4-dc96f5f7dc65 for instance 6558bc5e-2720-48c1-a8da-a93354406a1a on n-h1-767704-28 Jul 14 15:08:47.516410 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-42960e01-e46e-4155-beb4-9a0b2de33b90 req-72dd916a-05f8-424e-b0fe-fe63351a36ef service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122430 Jul 14 15:08:47.517061 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3082/6129] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:08:48.503751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9ef9bfde-2c4b-405b-9c2e-98f6fad733cb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:48.505339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9ef9bfde-2c4b-405b-9c2e-98f6fad733cb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:48.515233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ef9bfde-2c4b-405b-9c2e-98f6fad733cb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:48.516050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ef9bfde-2c4b-405b-9c2e-98f6fad733cb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:48.517437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ef9bfde-2c4b-405b-9c2e-98f6fad733cb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:48.518111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9ef9bfde-2c4b-405b-9c2e-98f6fad733cb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:48.792224 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9ef9bfde-2c4b-405b-9c2e-98f6fad733cb tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1466 microversion: 2.1 time: 0.294394 Jul 14 15:08:48.798868 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3048/6130] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:48 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1466 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:49.831718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b34c1de-7dc7-47b7-afc6-b705d688cfff tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:49.833927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b34c1de-7dc7-47b7-afc6-b705d688cfff tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:49.843905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:49.864625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b34c1de-7dc7-47b7-afc6-b705d688cfff tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:49.865552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b34c1de-7dc7-47b7-afc6-b705d688cfff tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:49.866587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b34c1de-7dc7-47b7-afc6-b705d688cfff tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:49.869469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b34c1de-7dc7-47b7-afc6-b705d688cfff tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:50.735967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=68 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:50.754068 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b34c1de-7dc7-47b7-afc6-b705d688cfff tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1466 microversion: 2.1 time: 0.940599 Jul 14 15:08:50.766705 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3083/6131] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:49 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1466 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:51.776676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b7eaf1bb-0267-491e-9391-e0e2bda92157 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:51.777336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b7eaf1bb-0267-491e-9391-e0e2bda92157 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:51.800545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7eaf1bb-0267-491e-9391-e0e2bda92157 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:51.801515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7eaf1bb-0267-491e-9391-e0e2bda92157 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:51.805884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7eaf1bb-0267-491e-9391-e0e2bda92157 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:51.817592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7eaf1bb-0267-491e-9391-e0e2bda92157 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:52.140248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:52.165964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=64 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:52.170025 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b7eaf1bb-0267-491e-9391-e0e2bda92157 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1466 microversion: 2.1 time: 0.397130 Jul 14 15:08:52.173371 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3049/6132] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:51 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1466 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:53.190434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-32fa82ec-788f-4c68-8dce-bf1d161d0a5f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:53.191412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-32fa82ec-788f-4c68-8dce-bf1d161d0a5f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:53.204706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:53.208114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:53.214560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32fa82ec-788f-4c68-8dce-bf1d161d0a5f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:53.215614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32fa82ec-788f-4c68-8dce-bf1d161d0a5f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:53.216901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32fa82ec-788f-4c68-8dce-bf1d161d0a5f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:53.217521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32fa82ec-788f-4c68-8dce-bf1d161d0a5f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:53.520429 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-32fa82ec-788f-4c68-8dce-bf1d161d0a5f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1466 microversion: 2.1 time: 0.335574 Jul 14 15:08:53.523106 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3084/6133] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:53 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1466 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:54.543665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c5d95ab6-fce1-4a33-b964-503ce3e53033 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:54.545017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c5d95ab6-fce1-4a33-b964-503ce3e53033 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:54.570671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=30 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:54.582131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5d95ab6-fce1-4a33-b964-503ce3e53033 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:54.583121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5d95ab6-fce1-4a33-b964-503ce3e53033 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:54.584559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5d95ab6-fce1-4a33-b964-503ce3e53033 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:54.587716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c5d95ab6-fce1-4a33-b964-503ce3e53033 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:54.961834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-fc374e1e-11b9-4b9c-82ab-9a55b6675141 req-4ed79666-85b3-48e3-befe-44e7490457e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6558bc5e-2720-48c1-a8da-a93354406a1a", "name": "network-vif-plugged", "status": "completed", "tag": "7f519518-3a5b-4567-83e4-dc96f5f7dc65"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:54.986269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-fc374e1e-11b9-4b9c-82ab-9a55b6675141 req-4ed79666-85b3-48e3-befe-44e7490457e9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:54.988380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-fc374e1e-11b9-4b9c-82ab-9a55b6675141 req-4ed79666-85b3-48e3-befe-44e7490457e9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:55.046392 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-fc374e1e-11b9-4b9c-82ab-9a55b6675141 req-4ed79666-85b3-48e3-befe-44e7490457e9 service nova] Creating event network-vif-plugged:7f519518-3a5b-4567-83e4-dc96f5f7dc65 for instance 6558bc5e-2720-48c1-a8da-a93354406a1a on n-h1-767704-28 Jul 14 15:08:55.064040 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-fc374e1e-11b9-4b9c-82ab-9a55b6675141 req-4ed79666-85b3-48e3-befe-44e7490457e9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107099 Jul 14 15:08:55.068306 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3085/6134] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:08:55.075759 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c5d95ab6-fce1-4a33-b964-503ce3e53033 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1466 microversion: 2.1 time: 0.539148 Jul 14 15:08:55.082241 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3050/6135] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:54 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1466 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:56.100306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c827e5c9-c08a-4150-b227-875dc3d45d06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:56.101122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c827e5c9-c08a-4150-b227-875dc3d45d06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:56.109849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c827e5c9-c08a-4150-b227-875dc3d45d06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:56.111047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c827e5c9-c08a-4150-b227-875dc3d45d06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:56.111969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c827e5c9-c08a-4150-b227-875dc3d45d06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:56.112489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c827e5c9-c08a-4150-b227-875dc3d45d06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:56.457381 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c827e5c9-c08a-4150-b227-875dc3d45d06 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1466 microversion: 2.1 time: 0.361248 Jul 14 15:08:56.459171 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3086/6136] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:56 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1466 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:57.487463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e508fbac-dcd1-4ee2-bddf-1bff0391e3ed tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:57.490010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e508fbac-dcd1-4ee2-bddf-1bff0391e3ed tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:57.520563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e508fbac-dcd1-4ee2-bddf-1bff0391e3ed tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:57.524911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e508fbac-dcd1-4ee2-bddf-1bff0391e3ed tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:57.526353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e508fbac-dcd1-4ee2-bddf-1bff0391e3ed tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:57.527154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e508fbac-dcd1-4ee2-bddf-1bff0391e3ed tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:58.150863 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e508fbac-dcd1-4ee2-bddf-1bff0391e3ed tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1650 microversion: 2.1 time: 0.670240 Jul 14 15:08:58.171647 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3051/6137] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:57 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1650 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:58.183447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-49be7568-96e3-4278-bbd7-2067ac5ccb5b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:58.184910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-49be7568-96e3-4278-bbd7-2067ac5ccb5b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:58.196635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49be7568-96e3-4278-bbd7-2067ac5ccb5b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:58.197519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49be7568-96e3-4278-bbd7-2067ac5ccb5b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:58.198615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49be7568-96e3-4278-bbd7-2067ac5ccb5b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:58.199457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49be7568-96e3-4278-bbd7-2067ac5ccb5b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:58.745756 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-49be7568-96e3-4278-bbd7-2067ac5ccb5b tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1650 microversion: 2.1 time: 0.564971 Jul 14 15:08:58.749562 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3087/6138] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:58 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1650 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:58.766890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a3f8bc87-1a45-4dc2-a5bf-504ffcb9ae00 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:58.768299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a3f8bc87-1a45-4dc2-a5bf-504ffcb9ae00 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:58.778007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3f8bc87-1a45-4dc2-a5bf-504ffcb9ae00 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:58.781186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3f8bc87-1a45-4dc2-a5bf-504ffcb9ae00 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:58.782898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3f8bc87-1a45-4dc2-a5bf-504ffcb9ae00 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:58.783728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a3f8bc87-1a45-4dc2-a5bf-504ffcb9ae00 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:59.239867 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a3f8bc87-1a45-4dc2-a5bf-504ffcb9ae00 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1650 microversion: 2.1 time: 0.478354 Jul 14 15:08:59.253665 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3052/6139] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:58 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1650 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:59.266044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a58562c1-15e7-4af8-898a-528b6c69017f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:59.269133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a58562c1-15e7-4af8-898a-528b6c69017f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:59.303719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a58562c1-15e7-4af8-898a-528b6c69017f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:59.306096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a58562c1-15e7-4af8-898a-528b6c69017f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:59.310269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a58562c1-15e7-4af8-898a-528b6c69017f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:59.311686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a58562c1-15e7-4af8-898a-528b6c69017f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:59.350243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a58562c1-15e7-4af8-898a-528b6c69017f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:08:59.541410 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a58562c1-15e7-4af8-898a-528b6c69017f tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "DELETE /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 204 len: 0 microversion: 2.1 time: 0.280530 Jul 14 15:08:59.542168 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3088/6140] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:08:59 2022] DELETE /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:08:59.555105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-445fe618-98ec-4c17-b30f-b59ef6f086f8 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:59.556444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-445fe618-98ec-4c17-b30f-b59ef6f086f8 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:59.605701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-445fe618-98ec-4c17-b30f-b59ef6f086f8 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:59.607796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-445fe618-98ec-4c17-b30f-b59ef6f086f8 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:59.611076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-445fe618-98ec-4c17-b30f-b59ef6f086f8 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:59.612358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-445fe618-98ec-4c17-b30f-b59ef6f086f8 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:59.918499 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-445fe618-98ec-4c17-b30f-b59ef6f086f8 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1656 microversion: 2.1 time: 0.348957 Jul 14 15:08:59.920919 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3053/6141] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:59 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1656 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:00.945449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ded9e6f6-e967-40e9-80ce-702021dc0087 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:00.946405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ded9e6f6-e967-40e9-80ce-702021dc0087 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:00.960500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ded9e6f6-e967-40e9-80ce-702021dc0087 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:00.963343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ded9e6f6-e967-40e9-80ce-702021dc0087 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:00.964473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ded9e6f6-e967-40e9-80ce-702021dc0087 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:00.966018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ded9e6f6-e967-40e9-80ce-702021dc0087 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:02.903464 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ded9e6f6-e967-40e9-80ce-702021dc0087 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1656 microversion: 2.1 time: 1.959243 Jul 14 15:09:02.907431 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3089/6142] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:00 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1656 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:03.932171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bc962bd4-acd0-4b86-ac37-ac85c6285de5 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:03.934326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bc962bd4-acd0-4b86-ac37-ac85c6285de5 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:03.945131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc962bd4-acd0-4b86-ac37-ac85c6285de5 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:03.948933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc962bd4-acd0-4b86-ac37-ac85c6285de5 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:03.950096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc962bd4-acd0-4b86-ac37-ac85c6285de5 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:03.955960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc962bd4-acd0-4b86-ac37-ac85c6285de5 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:04.231338 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bc962bd4-acd0-4b86-ac37-ac85c6285de5 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 200 len: 1614 microversion: 2.1 time: 0.302876 Jul 14 15:09:04.242816 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3054/6143] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:03 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 1614 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:04.610637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-18ba8721-3c90-425f-bd47-c9b58399a3bc req-d3ea3ec1-adfb-4f90-8a14-baefaac9e7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6558bc5e-2720-48c1-a8da-a93354406a1a", "name": "network-vif-deleted", "tag": "7f519518-3a5b-4567-83e4-dc96f5f7dc65"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:04.631025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-18ba8721-3c90-425f-bd47-c9b58399a3bc req-d3ea3ec1-adfb-4f90-8a14-baefaac9e7cb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:04.631810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-18ba8721-3c90-425f-bd47-c9b58399a3bc req-d3ea3ec1-adfb-4f90-8a14-baefaac9e7cb service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:04.655621 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-18ba8721-3c90-425f-bd47-c9b58399a3bc req-d3ea3ec1-adfb-4f90-8a14-baefaac9e7cb service nova] Creating event network-vif-deleted:7f519518-3a5b-4567-83e4-dc96f5f7dc65 for instance 6558bc5e-2720-48c1-a8da-a93354406a1a on n-h1-767704-28 Jul 14 15:09:04.663171 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-18ba8721-3c90-425f-bd47-c9b58399a3bc req-d3ea3ec1-adfb-4f90-8a14-baefaac9e7cb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.410736 Jul 14 15:09:04.669856 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3090/6144] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:05.251302 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a8dc1001-ecf7-4905-a818-0f5a99e52812 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:05.252522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a8dc1001-ecf7-4905-a818-0f5a99e52812 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 6558bc5e-2720-48c1-a8da-a93354406a1a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:05.288583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8dc1001-ecf7-4905-a818-0f5a99e52812 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:05.289775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8dc1001-ecf7-4905-a818-0f5a99e52812 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:05.290626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8dc1001-ecf7-4905-a818-0f5a99e52812 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:05.291077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8dc1001-ecf7-4905-a818-0f5a99e52812 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:05.337261 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-a8dc1001-ecf7-4905-a818-0f5a99e52812 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] HTTP exception thrown: Instance 6558bc5e-2720-48c1-a8da-a93354406a1a could not be found. Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a8dc1001-ecf7-4905-a818-0f5a99e52812 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Request method failure captured: Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a HTTP/1.1 Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DFedSG_utK82kvW4NEnoXSYcmjUXZSnqQ7udbLuLiDUmMKpC2DLP3RxShqvy24USvHT7L91rJ2W-rsHTghrusWbTptKn9Pcc3P7gnovT2CVLtwNC3iMcHbORwnkzYAOzXxM_3OOnHr9BENpy5fqNMh-85-OhI-uGQANID7XCnjUL10 Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 2f368bf7a0444fe9b306cf0e859660f9 Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestServerMultinode-2012305320 Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2f368bf7a0444fe9b306cf0e859660f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2f368bf7a0444fe9b306cf0e859660f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2f368bf7a0444fe9b306cf0e859660f9", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2f368bf7a0444fe9b306cf0e859660f9"}]}] Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestServerMultinode-2012305320 Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 2f368bf7a0444fe9b306cf0e859660f9 Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestServerMultinode-2012305320 Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestServerMultinode-2012305320-project-admin Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 99314f0a8a214263b938c5e89847f98d Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestServerMultinode-2012305320-project-admin Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6558bc5e-2720-48c1-a8da-a93354406a1a could not be found. Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6558bc5e-2720-48c1-a8da-a93354406a1a'} Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6558bc5e-2720-48c1-a8da-a93354406a1a could not be found. Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6558bc5e-2720-48c1-a8da-a93354406a1a could not be found. Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:05.339414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:05.345615 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:05.345615 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:05.345615 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:05.345615 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:09:05.345615 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:09:05.345615 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6558bc5e-2720-48c1-a8da-a93354406a1a could not be found. Jul 14 15:09:05.345615 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:05.351050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a8dc1001-ecf7-4905-a818-0f5a99e52812 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Returning 404 to user: Instance 6558bc5e-2720-48c1-a8da-a93354406a1a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:09:05.352228 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a8dc1001-ecf7-4905-a818-0f5a99e52812 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a" status: 404 len: 111 microversion: 2.1 time: 0.105413 Jul 14 15:09:05.354909 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3055/6145] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:05 2022] GET /compute/v2.1/servers/6558bc5e-2720-48c1-a8da-a93354406a1a => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:09:05.365722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4f1a307d-c740-451a-9938-eaa1bfdf3b2e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:05.366327 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4f1a307d-c740-451a-9938-eaa1bfdf3b2e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:05.375037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f1a307d-c740-451a-9938-eaa1bfdf3b2e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:05.375746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f1a307d-c740-451a-9938-eaa1bfdf3b2e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:05.377109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f1a307d-c740-451a-9938-eaa1bfdf3b2e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:05.378078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f1a307d-c740-451a-9938-eaa1bfdf3b2e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:05.439044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4f1a307d-c740-451a-9938-eaa1bfdf3b2e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:09:05.619539 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4f1a307d-c740-451a-9938-eaa1bfdf3b2e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "DELETE /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 204 len: 0 microversion: 2.1 time: 0.253051 Jul 14 15:09:05.620231 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3091/6146] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:09:05 2022] DELETE /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:09:05.632178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ce18bc15-36af-4f39-8d4d-a9a41b0c1849 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:05.632702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ce18bc15-36af-4f39-8d4d-a9a41b0c1849 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:05.660484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce18bc15-36af-4f39-8d4d-a9a41b0c1849 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:05.663620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce18bc15-36af-4f39-8d4d-a9a41b0c1849 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:05.668428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce18bc15-36af-4f39-8d4d-a9a41b0c1849 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:05.669861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce18bc15-36af-4f39-8d4d-a9a41b0c1849 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:06.030228 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ce18bc15-36af-4f39-8d4d-a9a41b0c1849 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1657 microversion: 2.1 time: 0.404842 Jul 14 15:09:06.031968 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3056/6147] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:05 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1657 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:07.053016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-09f0a029-08c5-4450-90b1-7d8a8929f246 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:07.053776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-09f0a029-08c5-4450-90b1-7d8a8929f246 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:07.077001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09f0a029-08c5-4450-90b1-7d8a8929f246 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:07.077466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09f0a029-08c5-4450-90b1-7d8a8929f246 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:07.078532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09f0a029-08c5-4450-90b1-7d8a8929f246 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:07.082267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09f0a029-08c5-4450-90b1-7d8a8929f246 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:07.416815 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-09f0a029-08c5-4450-90b1-7d8a8929f246 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1657 microversion: 2.1 time: 0.372774 Jul 14 15:09:07.423876 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3092/6148] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:07 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1657 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:08.443484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-efda7182-6856-430b-a01c-7619d0274430 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:08.444249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-efda7182-6856-430b-a01c-7619d0274430 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:08.454451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efda7182-6856-430b-a01c-7619d0274430 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:08.456209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efda7182-6856-430b-a01c-7619d0274430 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:08.459235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efda7182-6856-430b-a01c-7619d0274430 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:08.468872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efda7182-6856-430b-a01c-7619d0274430 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:08.519383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1741406402", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "e633c5d7-79bf-4039-81dd-7361954fe94f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2003099985", "security_groups": []}, "os:scheduler_hints": {"different_host": ["bb4de0cd-0830-4cb4-81bf-7fb423fd8069"]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:08.633860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] validate_networks() for [('e633c5d7-79bf-4039-81dd-7361954fe94f', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:09:08.710947 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-efda7182-6856-430b-a01c-7619d0274430 tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 200 len: 1615 microversion: 2.1 time: 0.275016 Jul 14 15:09:08.725180 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3057/6149] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:08 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 1615 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:08.735253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-41e8d11c-b1fb-40a3-bb6c-744857f856ca req-75ca064f-3090-4ae3-8249-80c2fdf040af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6a76df-19dc-42a3-b368-36c544b9e75a", "name": "network-vif-deleted", "tag": "6bc6d187-3801-4217-9e4c-46a84f5d483f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:08.777898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-41e8d11c-b1fb-40a3-bb6c-744857f856ca req-75ca064f-3090-4ae3-8249-80c2fdf040af service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:08.778532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-41e8d11c-b1fb-40a3-bb6c-744857f856ca req-75ca064f-3090-4ae3-8249-80c2fdf040af service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:08.813843 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-41e8d11c-b1fb-40a3-bb6c-744857f856ca req-75ca064f-3090-4ae3-8249-80c2fdf040af service nova] Creating event network-vif-deleted:6bc6d187-3801-4217-9e4c-46a84f5d483f for instance 4a6a76df-19dc-42a3-b368-36c544b9e75a on n-h2-767704-28 Jul 14 15:09:08.838809 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-41e8d11c-b1fb-40a3-bb6c-744857f856ca req-75ca064f-3090-4ae3-8249-80c2fdf040af service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117736 Jul 14 15:09:08.840208 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3058/6150] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:09.735455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b37b09af-b8dd-4b03-aa7e-6b2f88d2980e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:09.736187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b37b09af-b8dd-4b03-aa7e-6b2f88d2980e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] [instance: 4a6a76df-19dc-42a3-b368-36c544b9e75a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:09.752887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b37b09af-b8dd-4b03-aa7e-6b2f88d2980e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:09.753480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b37b09af-b8dd-4b03-aa7e-6b2f88d2980e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:09.757407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b37b09af-b8dd-4b03-aa7e-6b2f88d2980e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:09.758332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b37b09af-b8dd-4b03-aa7e-6b2f88d2980e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:09.763092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:09:09.763781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:09:09.764202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:09:09.764657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:09:09.765777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:09:09.797837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:09.798380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:09.804065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:09.806898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:09.838479 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-b37b09af-b8dd-4b03-aa7e-6b2f88d2980e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] HTTP exception thrown: Instance 4a6a76df-19dc-42a3-b368-36c544b9e75a could not be found. Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b37b09af-b8dd-4b03-aa7e-6b2f88d2980e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Request method failure captured: Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a HTTP/1.1 Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DFedSG_utK82kvW4NEnoXSYcmjUXZSnqQ7udbLuLiDUmMKpC2DLP3RxShqvy24USvHT7L91rJ2W-rsHTghrusWbTptKn9Pcc3P7gnovT2CVLtwNC3iMcHbORwnkzYAOzXxM_3OOnHr9BENpy5fqNMh-85-OhI-uGQANID7XCnjUL10 Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 2f368bf7a0444fe9b306cf0e859660f9 Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestServerMultinode-2012305320 Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2f368bf7a0444fe9b306cf0e859660f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2f368bf7a0444fe9b306cf0e859660f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2f368bf7a0444fe9b306cf0e859660f9", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2f368bf7a0444fe9b306cf0e859660f9"}]}] Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestServerMultinode-2012305320 Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 2f368bf7a0444fe9b306cf0e859660f9 Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestServerMultinode-2012305320 Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestServerMultinode-2012305320-project-admin Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 99314f0a8a214263b938c5e89847f98d Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestServerMultinode-2012305320-project-admin Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 4a6a76df-19dc-42a3-b368-36c544b9e75a could not be found. Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '4a6a76df-19dc-42a3-b368-36c544b9e75a'} Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6a76df-19dc-42a3-b368-36c544b9e75a could not be found. Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6a76df-19dc-42a3-b368-36c544b9e75a could not be found. Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:09.846837 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:09.851626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:09.851626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:09.851626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:09.851626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:09:09.851626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:09:09.851626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6a76df-19dc-42a3-b368-36c544b9e75a could not be found. Jul 14 15:09:09.851626 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:09.851626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b37b09af-b8dd-4b03-aa7e-6b2f88d2980e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] Returning 404 to user: Instance 4a6a76df-19dc-42a3-b368-36c544b9e75a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:09:09.857617 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b37b09af-b8dd-4b03-aa7e-6b2f88d2980e tempest-TestServerMultinode-2012305320 tempest-TestServerMultinode-2012305320-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a" status: 404 len: 111 microversion: 2.1 time: 0.127913 Jul 14 15:09:09.869373 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3059/6151] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:09 2022] GET /compute/v2.1/servers/4a6a76df-19dc-42a3-b368-36c544b9e75a => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:09:09.895551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Getting quotas for project 0b666acd76f14e11ac2b557a619318a0. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:09:09.913395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Getting quotas for user 675a975fdfd24463b16d546abdb0218b and project 0b666acd76f14e11ac2b557a619318a0. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:09:09.943090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:09:09.945728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:09:10.021538 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e81f981b-f3d6-4036-ba4e-bf077205dc3a tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.505995 Jul 14 15:09:10.022547 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3093/6152] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:09:08 2022] POST /compute/v2.1/servers => generated 361 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:09:10.035882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9aee1705-fc2c-4d69-8746-daf7b7e3b142 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:10.036623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9aee1705-fc2c-4d69-8746-daf7b7e3b142 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:10.200169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9aee1705-fc2c-4d69-8746-daf7b7e3b142 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:10.208795 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9aee1705-fc2c-4d69-8746-daf7b7e3b142 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1242 microversion: 2.1 time: 0.180101 Jul 14 15:09:10.210066 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3060/6153] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:10 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1242 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:11.240123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5a4eb880-bd9f-45ea-b717-67ce0e285a00 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:11.243292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5a4eb880-bd9f-45ea-b717-67ce0e285a00 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:11.283357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a4eb880-bd9f-45ea-b717-67ce0e285a00 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:11.284177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a4eb880-bd9f-45ea-b717-67ce0e285a00 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:11.297166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a4eb880-bd9f-45ea-b717-67ce0e285a00 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:11.298882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a4eb880-bd9f-45ea-b717-67ce0e285a00 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:11.858957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5a4eb880-bd9f-45ea-b717-67ce0e285a00 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:11.869348 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5a4eb880-bd9f-45ea-b717-67ce0e285a00 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1294 microversion: 2.1 time: 0.645473 Jul 14 15:09:11.870537 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3094/6154] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:11 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1294 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:12.896075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-584c071e-9acb-4d95-9fe2-8007ffd1a4d3 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:12.901136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-584c071e-9acb-4d95-9fe2-8007ffd1a4d3 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:12.961095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-584c071e-9acb-4d95-9fe2-8007ffd1a4d3 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:12.971460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-584c071e-9acb-4d95-9fe2-8007ffd1a4d3 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:12.976355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-584c071e-9acb-4d95-9fe2-8007ffd1a4d3 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:12.978766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-584c071e-9acb-4d95-9fe2-8007ffd1a4d3 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:13.320183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-584c071e-9acb-4d95-9fe2-8007ffd1a4d3 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:13.332975 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-584c071e-9acb-4d95-9fe2-8007ffd1a4d3 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1300 microversion: 2.1 time: 0.448105 Jul 14 15:09:13.339508 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3061/6155] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:12 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1300 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:14.353158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8be29606-a1de-4633-9e6a-9e6483510194 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:14.354621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8be29606-a1de-4633-9e6a-9e6483510194 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:14.365114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8be29606-a1de-4633-9e6a-9e6483510194 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:14.365868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8be29606-a1de-4633-9e6a-9e6483510194 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:14.367268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8be29606-a1de-4633-9e6a-9e6483510194 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:14.367969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8be29606-a1de-4633-9e6a-9e6483510194 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:14.620252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8be29606-a1de-4633-9e6a-9e6483510194 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:14.642148 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8be29606-a1de-4633-9e6a-9e6483510194 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1300 microversion: 2.1 time: 0.293719 Jul 14 15:09:14.643400 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3095/6156] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:14 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1300 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:15.670638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-02e4866e-545c-4c88-afb1-c139dfa8b2b9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:15.671275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-02e4866e-545c-4c88-afb1-c139dfa8b2b9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:15.680268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02e4866e-545c-4c88-afb1-c139dfa8b2b9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:15.681985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02e4866e-545c-4c88-afb1-c139dfa8b2b9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:15.697155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02e4866e-545c-4c88-afb1-c139dfa8b2b9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:15.713077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-99fbe3c3-12b1-459b-bead-71d0e1337da0 req-cdbb68bb-1546-421a-97bd-47bb0567002b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18610f97-4978-4d38-844f-eed06a3b494a", "tag": "471da86b-5200-44af-a76a-1ad6ddfdfec1"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:15.724188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02e4866e-545c-4c88-afb1-c139dfa8b2b9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:15.748407 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-99fbe3c3-12b1-459b-bead-71d0e1337da0 req-cdbb68bb-1546-421a-97bd-47bb0567002b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:15.749032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-99fbe3c3-12b1-459b-bead-71d0e1337da0 req-cdbb68bb-1546-421a-97bd-47bb0567002b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:15.780613 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-99fbe3c3-12b1-459b-bead-71d0e1337da0 req-cdbb68bb-1546-421a-97bd-47bb0567002b service nova] Creating event network-changed:471da86b-5200-44af-a76a-1ad6ddfdfec1 for instance 18610f97-4978-4d38-844f-eed06a3b494a on n-h1-767704-28 Jul 14 15:09:15.792712 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-99fbe3c3-12b1-459b-bead-71d0e1337da0 req-cdbb68bb-1546-421a-97bd-47bb0567002b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084862 Jul 14 15:09:15.794595 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3096/6157] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:15.898351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-02e4866e-545c-4c88-afb1-c139dfa8b2b9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:15.909429 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-02e4866e-545c-4c88-afb1-c139dfa8b2b9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1300 microversion: 2.1 time: 0.244362 Jul 14 15:09:15.911907 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3062/6158] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:15 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1300 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:09:16.948429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-771d2e69-c103-4017-ab97-fb42963ab1be tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:16.948429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-771d2e69-c103-4017-ab97-fb42963ab1be tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:16.985806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-771d2e69-c103-4017-ab97-fb42963ab1be tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:16.986351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-771d2e69-c103-4017-ab97-fb42963ab1be tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:16.987218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-771d2e69-c103-4017-ab97-fb42963ab1be tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:16.987695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-771d2e69-c103-4017-ab97-fb42963ab1be tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:17.195616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-771d2e69-c103-4017-ab97-fb42963ab1be tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:17.213740 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-771d2e69-c103-4017-ab97-fb42963ab1be tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1300 microversion: 2.1 time: 0.284902 Jul 14 15:09:17.214418 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3097/6159] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:16 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1300 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:18.236332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-57f315eb-1fc4-4891-bc42-89d863148d57 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:18.236975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-57f315eb-1fc4-4891-bc42-89d863148d57 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:18.257674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57f315eb-1fc4-4891-bc42-89d863148d57 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:18.258700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57f315eb-1fc4-4891-bc42-89d863148d57 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:18.275564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57f315eb-1fc4-4891-bc42-89d863148d57 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:18.277657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57f315eb-1fc4-4891-bc42-89d863148d57 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:18.456253 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-57f315eb-1fc4-4891-bc42-89d863148d57 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:18.464576 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-57f315eb-1fc4-4891-bc42-89d863148d57 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1300 microversion: 2.1 time: 0.232357 Jul 14 15:09:18.465400 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3063/6160] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:18 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1300 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:19.487218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-129086bf-654d-4fd6-947b-5835805431ca tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:19.489358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-129086bf-654d-4fd6-947b-5835805431ca tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:19.505344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-129086bf-654d-4fd6-947b-5835805431ca tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:19.506695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-129086bf-654d-4fd6-947b-5835805431ca tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:19.508299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-129086bf-654d-4fd6-947b-5835805431ca tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:19.509130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-129086bf-654d-4fd6-947b-5835805431ca tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:19.737159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-129086bf-654d-4fd6-947b-5835805431ca tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:19.748556 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-129086bf-654d-4fd6-947b-5835805431ca tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1300 microversion: 2.1 time: 0.269704 Jul 14 15:09:19.749750 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3098/6161] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:19 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1300 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:20.785756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-90c7c30d-ee93-4954-95a3-de0899cd04b2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:20.786555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-90c7c30d-ee93-4954-95a3-de0899cd04b2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:20.790816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:20.804743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90c7c30d-ee93-4954-95a3-de0899cd04b2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:20.805655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90c7c30d-ee93-4954-95a3-de0899cd04b2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:20.807792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90c7c30d-ee93-4954-95a3-de0899cd04b2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:20.808559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-90c7c30d-ee93-4954-95a3-de0899cd04b2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:20.979705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-90c7c30d-ee93-4954-95a3-de0899cd04b2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:20.989670 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-90c7c30d-ee93-4954-95a3-de0899cd04b2 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1300 microversion: 2.1 time: 0.213644 Jul 14 15:09:20.990907 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3064/6162] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:20 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1300 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:21.057416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-be1649a8-f9fd-4f37-ade1-a5ecd96d0267 req-6c711133-97a4-4340-8cb7-9caf088622d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18610f97-4978-4d38-844f-eed06a3b494a", "name": "network-vif-plugged", "status": "completed", "tag": "471da86b-5200-44af-a76a-1ad6ddfdfec1"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:21.070058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:21.071162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:21.076559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:21.080138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-be1649a8-f9fd-4f37-ade1-a5ecd96d0267 req-6c711133-97a4-4340-8cb7-9caf088622d2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:21.081037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-be1649a8-f9fd-4f37-ade1-a5ecd96d0267 req-6c711133-97a4-4340-8cb7-9caf088622d2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:21.103942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:21.120818 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-be1649a8-f9fd-4f37-ade1-a5ecd96d0267 req-6c711133-97a4-4340-8cb7-9caf088622d2 service nova] Creating event network-vif-plugged:471da86b-5200-44af-a76a-1ad6ddfdfec1 for instance 18610f97-4978-4d38-844f-eed06a3b494a on n-h1-767704-28 Jul 14 15:09:21.130595 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-be1649a8-f9fd-4f37-ade1-a5ecd96d0267 req-6c711133-97a4-4340-8cb7-9caf088622d2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079466 Jul 14 15:09:21.132300 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3099/6163] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:22.008394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-abdb5255-1962-4cad-8c28-f673f60e9a43 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:22.009963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-abdb5255-1962-4cad-8c28-f673f60e9a43 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:22.018652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abdb5255-1962-4cad-8c28-f673f60e9a43 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:22.019887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abdb5255-1962-4cad-8c28-f673f60e9a43 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:22.021052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abdb5255-1962-4cad-8c28-f673f60e9a43 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:22.021792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-abdb5255-1962-4cad-8c28-f673f60e9a43 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:22.202082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-abdb5255-1962-4cad-8c28-f673f60e9a43 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:22.215972 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-abdb5255-1962-4cad-8c28-f673f60e9a43 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1300 microversion: 2.1 time: 0.212700 Jul 14 15:09:22.225699 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3065/6164] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:22 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1300 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:23.246128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8a348f7-d6e9-4d93-8f35-db90a2ebe139 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:23.247412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8a348f7-d6e9-4d93-8f35-db90a2ebe139 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:23.257717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8a348f7-d6e9-4d93-8f35-db90a2ebe139 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:23.261555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8a348f7-d6e9-4d93-8f35-db90a2ebe139 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:23.262416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8a348f7-d6e9-4d93-8f35-db90a2ebe139 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:23.262961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8a348f7-d6e9-4d93-8f35-db90a2ebe139 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:23.418807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d8a348f7-d6e9-4d93-8f35-db90a2ebe139 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:23.430435 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8a348f7-d6e9-4d93-8f35-db90a2ebe139 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1473 microversion: 2.1 time: 0.190274 Jul 14 15:09:23.431635 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3100/6165] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:23 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1473 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:23.451494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8e761a95-270b-4bc2-8835-db5629dbad5c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:23.452205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8e761a95-270b-4bc2-8835-db5629dbad5c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:23.460122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e761a95-270b-4bc2-8835-db5629dbad5c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:23.460578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e761a95-270b-4bc2-8835-db5629dbad5c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:23.461567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e761a95-270b-4bc2-8835-db5629dbad5c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:23.462629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e761a95-270b-4bc2-8835-db5629dbad5c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:23.569105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8e761a95-270b-4bc2-8835-db5629dbad5c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:23.578633 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8e761a95-270b-4bc2-8835-db5629dbad5c tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1473 microversion: 2.1 time: 0.132331 Jul 14 15:09:23.579755 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3066/6166] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:23 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1473 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:23.597383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6e66c601-fd5f-42e4-9135-44b256ca9e18 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:23.598079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6e66c601-fd5f-42e4-9135-44b256ca9e18 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:23.605761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e66c601-fd5f-42e4-9135-44b256ca9e18 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:23.606674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e66c601-fd5f-42e4-9135-44b256ca9e18 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:23.607652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e66c601-fd5f-42e4-9135-44b256ca9e18 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:23.608973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e66c601-fd5f-42e4-9135-44b256ca9e18 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:23.735164 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6e66c601-fd5f-42e4-9135-44b256ca9e18 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1626 microversion: 2.1 time: 0.142318 Jul 14 15:09:23.735763 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3101/6167] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:23 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1626 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:23.751399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99cf2a8d-aa35-4727-b23d-d581067b0758 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:23.752121 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-99cf2a8d-aa35-4727-b23d-d581067b0758 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:23.764292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99cf2a8d-aa35-4727-b23d-d581067b0758 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:23.764762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99cf2a8d-aa35-4727-b23d-d581067b0758 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:23.765592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99cf2a8d-aa35-4727-b23d-d581067b0758 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:23.766043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99cf2a8d-aa35-4727-b23d-d581067b0758 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:23.930461 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99cf2a8d-aa35-4727-b23d-d581067b0758 tempest-TestSecurityGroupsBasicOps-49485503 tempest-TestSecurityGroupsBasicOps-49485503-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1914 microversion: 2.1 time: 0.182747 Jul 14 15:09:23.931310 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3067/6168] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:23 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1914 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:24.009976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d895200c-b2f0-475e-8e74-a8fbd18df5a4 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:24.010808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d895200c-b2f0-475e-8e74-a8fbd18df5a4 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:24.019882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d895200c-b2f0-475e-8e74-a8fbd18df5a4 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:24.020685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d895200c-b2f0-475e-8e74-a8fbd18df5a4 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:24.022001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d895200c-b2f0-475e-8e74-a8fbd18df5a4 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:24.023084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d895200c-b2f0-475e-8e74-a8fbd18df5a4 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:24.063928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d895200c-b2f0-475e-8e74-a8fbd18df5a4 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:09:24.173766 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d895200c-b2f0-475e-8e74-a8fbd18df5a4 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "DELETE /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 204 len: 0 microversion: 2.1 time: 0.167490 Jul 14 15:09:24.178137 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3102/6169] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:09:24 2022] DELETE /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:09:24.184263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-09af58e5-f010-4caf-93a2-5b47ac5203fc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:24.184974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-09af58e5-f010-4caf-93a2-5b47ac5203fc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:24.193325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09af58e5-f010-4caf-93a2-5b47ac5203fc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:24.193801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09af58e5-f010-4caf-93a2-5b47ac5203fc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:24.194601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09af58e5-f010-4caf-93a2-5b47ac5203fc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:24.195056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09af58e5-f010-4caf-93a2-5b47ac5203fc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:24.314107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-09af58e5-f010-4caf-93a2-5b47ac5203fc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:24.329251 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-09af58e5-f010-4caf-93a2-5b47ac5203fc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1479 microversion: 2.1 time: 0.149302 Jul 14 15:09:24.338899 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3068/6170] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:24 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1479 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:25.347080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65ddc417-a1c8-4454-a909-f5ca227acb50 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:25.348079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-65ddc417-a1c8-4454-a909-f5ca227acb50 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:25.355156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65ddc417-a1c8-4454-a909-f5ca227acb50 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:25.356382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65ddc417-a1c8-4454-a909-f5ca227acb50 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:25.357231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65ddc417-a1c8-4454-a909-f5ca227acb50 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:25.357921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65ddc417-a1c8-4454-a909-f5ca227acb50 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:25.463105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-65ddc417-a1c8-4454-a909-f5ca227acb50 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:25.474083 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65ddc417-a1c8-4454-a909-f5ca227acb50 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1479 microversion: 2.1 time: 0.131201 Jul 14 15:09:25.474676 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3103/6171] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:25 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1479 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:26.393678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0e4918fe-fac6-4d00-85e3-8467922058d1 req-e5b0d619-68db-439c-a78d-ac5da9fa90e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18610f97-4978-4d38-844f-eed06a3b494a", "name": "network-vif-deleted", "tag": "471da86b-5200-44af-a76a-1ad6ddfdfec1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:26.415261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=40 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:26.418231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0e4918fe-fac6-4d00-85e3-8467922058d1 req-e5b0d619-68db-439c-a78d-ac5da9fa90e7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:26.419186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0e4918fe-fac6-4d00-85e3-8467922058d1 req-e5b0d619-68db-439c-a78d-ac5da9fa90e7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:26.424886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:26.469649 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0e4918fe-fac6-4d00-85e3-8467922058d1 req-e5b0d619-68db-439c-a78d-ac5da9fa90e7 service nova] Creating event network-vif-deleted:471da86b-5200-44af-a76a-1ad6ddfdfec1 for instance 18610f97-4978-4d38-844f-eed06a3b494a on n-h1-767704-28 Jul 14 15:09:26.481620 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0e4918fe-fac6-4d00-85e3-8467922058d1 req-e5b0d619-68db-439c-a78d-ac5da9fa90e7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091263 Jul 14 15:09:26.482943 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3069/6172] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:26.494744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-57b47418-d2b1-4aef-9472-8f626098c06b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:26.498039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-57b47418-d2b1-4aef-9472-8f626098c06b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:26.529218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57b47418-d2b1-4aef-9472-8f626098c06b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:26.532423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57b47418-d2b1-4aef-9472-8f626098c06b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:26.533566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57b47418-d2b1-4aef-9472-8f626098c06b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:26.534258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57b47418-d2b1-4aef-9472-8f626098c06b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:26.588569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57b47418-d2b1-4aef-9472-8f626098c06b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:26.590043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-57b47418-d2b1-4aef-9472-8f626098c06b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:26.590976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-57b47418-d2b1-4aef-9472-8f626098c06b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lazy-loading 'fault' on Instance uuid 18610f97-4978-4d38-844f-eed06a3b494a {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:09:26.664467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-57b47418-d2b1-4aef-9472-8f626098c06b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:26.674465 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-57b47418-d2b1-4aef-9472-8f626098c06b tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 200 len: 1332 microversion: 2.1 time: 0.184962 Jul 14 15:09:26.675688 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3104/6173] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:26 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 1332 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:09:27.693458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1c09aef2-568e-4cbd-9b12-d9585ca5eb05 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:27.695746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1c09aef2-568e-4cbd-9b12-d9585ca5eb05 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: 18610f97-4978-4d38-844f-eed06a3b494a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:27.704738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c09aef2-568e-4cbd-9b12-d9585ca5eb05 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:27.705299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c09aef2-568e-4cbd-9b12-d9585ca5eb05 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:27.706131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c09aef2-568e-4cbd-9b12-d9585ca5eb05 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:27.706914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c09aef2-568e-4cbd-9b12-d9585ca5eb05 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:27.723873 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-1c09aef2-568e-4cbd-9b12-d9585ca5eb05 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] HTTP exception thrown: Instance 18610f97-4978-4d38-844f-eed06a3b494a could not be found. Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1c09aef2-568e-4cbd-9b12-d9585ca5eb05 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Request method failure captured: Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a HTTP/1.1 Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DEm3riAfn_nLm8C1U7IZorcPx4FXr0bXlrle8OEI79P_aeGiIfZNjMFoqqnsJZTu0G0xchFrqrffHIQz0VJzDXr31KPTh1ThsiEggvozOEj1CpkeQVL-W4Wme_d1wrZYe0XZKRi4iDozebmzq0pR18bksFTaiX15rXbocDVubOfZQ4 Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 0b666acd76f14e11ac2b557a619318a0 Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-654465753 Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b666acd76f14e11ac2b557a619318a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0b666acd76f14e11ac2b557a619318a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0b666acd76f14e11ac2b557a619318a0", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b666acd76f14e11ac2b557a619318a0"}]}] Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestSecurityGroupsBasicOps-654465753 Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 0b666acd76f14e11ac2b557a619318a0 Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-654465753 Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestSecurityGroupsBasicOps-654465753-project Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 675a975fdfd24463b16d546abdb0218b Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestSecurityGroupsBasicOps-654465753-project Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 18610f97-4978-4d38-844f-eed06a3b494a could not be found. Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '18610f97-4978-4d38-844f-eed06a3b494a'} Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18610f97-4978-4d38-844f-eed06a3b494a could not be found. Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18610f97-4978-4d38-844f-eed06a3b494a could not be found. Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:27.726363 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:27.739297 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:27.739297 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:27.739297 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:27.739297 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:09:27.739297 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:09:27.739297 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18610f97-4978-4d38-844f-eed06a3b494a could not be found. Jul 14 15:09:27.739297 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:09:27.739297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1c09aef2-568e-4cbd-9b12-d9585ca5eb05 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Returning 404 to user: Instance 18610f97-4978-4d38-844f-eed06a3b494a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:09:27.739297 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1c09aef2-568e-4cbd-9b12-d9585ca5eb05 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a" status: 404 len: 111 microversion: 2.1 time: 0.038884 Jul 14 15:09:27.739297 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3070/6174] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:27 2022] GET /compute/v2.1/servers/18610f97-4978-4d38-844f-eed06a3b494a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:09:36.299214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-86ffd2bd-b926-46d5-9596-8d047b9eb0a9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:36.299987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-86ffd2bd-b926-46d5-9596-8d047b9eb0a9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:36.315815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86ffd2bd-b926-46d5-9596-8d047b9eb0a9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:36.316364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86ffd2bd-b926-46d5-9596-8d047b9eb0a9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:36.320333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86ffd2bd-b926-46d5-9596-8d047b9eb0a9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:36.321152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86ffd2bd-b926-46d5-9596-8d047b9eb0a9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:36.377763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-86ffd2bd-b926-46d5-9596-8d047b9eb0a9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:09:36.520265 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-86ffd2bd-b926-46d5-9596-8d047b9eb0a9 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "DELETE /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 204 len: 0 microversion: 2.1 time: 0.226416 Jul 14 15:09:36.521634 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3105/6175] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:09:36 2022] DELETE /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:09:36.533700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4334a35f-3f97-494f-a321-a49e3bd47332 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:36.534794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4334a35f-3f97-494f-a321-a49e3bd47332 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:36.547508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4334a35f-3f97-494f-a321-a49e3bd47332 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:36.548395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4334a35f-3f97-494f-a321-a49e3bd47332 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:36.549717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4334a35f-3f97-494f-a321-a49e3bd47332 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:36.551272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4334a35f-3f97-494f-a321-a49e3bd47332 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:36.812806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4334a35f-3f97-494f-a321-a49e3bd47332 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:36.822618 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4334a35f-3f97-494f-a321-a49e3bd47332 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1767 microversion: 2.1 time: 0.295791 Jul 14 15:09:36.824247 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3106/6176] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:36 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1767 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:36.873101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-638d9c8b-3e10-4a13-a340-718ee7ce4c7d req-6d4f8e57-4b4e-4c33-b3a8-c886cfbaedee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4de0cd-0830-4cb4-81bf-7fb423fd8069", "tag": "1eb32241-217f-4e99-8b99-35e2e0f7d87e"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:36.894353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-638d9c8b-3e10-4a13-a340-718ee7ce4c7d req-6d4f8e57-4b4e-4c33-b3a8-c886cfbaedee service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:36.897640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-638d9c8b-3e10-4a13-a340-718ee7ce4c7d req-6d4f8e57-4b4e-4c33-b3a8-c886cfbaedee service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:36.934648 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-638d9c8b-3e10-4a13-a340-718ee7ce4c7d req-6d4f8e57-4b4e-4c33-b3a8-c886cfbaedee service nova] Creating event network-changed:1eb32241-217f-4e99-8b99-35e2e0f7d87e for instance bb4de0cd-0830-4cb4-81bf-7fb423fd8069 on n-h2-767704-28 Jul 14 15:09:36.943053 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-638d9c8b-3e10-4a13-a340-718ee7ce4c7d req-6d4f8e57-4b4e-4c33-b3a8-c886cfbaedee service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.640624 Jul 14 15:09:36.944283 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3071/6177] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:09:37.841794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b3460a9f-9b3e-4817-8070-2923d667a226 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:37.843129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b3460a9f-9b3e-4817-8070-2923d667a226 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:37.861547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3460a9f-9b3e-4817-8070-2923d667a226 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:37.863049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3460a9f-9b3e-4817-8070-2923d667a226 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:37.885051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3460a9f-9b3e-4817-8070-2923d667a226 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:37.895224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b3460a9f-9b3e-4817-8070-2923d667a226 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:38.587569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b3460a9f-9b3e-4817-8070-2923d667a226 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:38.595732 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b3460a9f-9b3e-4817-8070-2923d667a226 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1767 microversion: 2.1 time: 0.759364 Jul 14 15:09:38.596335 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3107/6178] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:37 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1767 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:39.613668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d8f3e7e0-69d9-4bcd-a106-d0bbb9fcedfc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:39.614964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d8f3e7e0-69d9-4bcd-a106-d0bbb9fcedfc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:39.633218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8f3e7e0-69d9-4bcd-a106-d0bbb9fcedfc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:39.640535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8f3e7e0-69d9-4bcd-a106-d0bbb9fcedfc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:39.642627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8f3e7e0-69d9-4bcd-a106-d0bbb9fcedfc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:39.653531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8f3e7e0-69d9-4bcd-a106-d0bbb9fcedfc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:40.293952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d8f3e7e0-69d9-4bcd-a106-d0bbb9fcedfc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:40.309852 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d8f3e7e0-69d9-4bcd-a106-d0bbb9fcedfc tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1767 microversion: 2.1 time: 0.700413 Jul 14 15:09:40.310757 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3072/6179] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:39 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1767 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:40.737566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5773b0a9-c72e-4d62-a678-2829d80a1baf req-c439a361-3171-429b-8873-d8a78ae0ce14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4de0cd-0830-4cb4-81bf-7fb423fd8069", "name": "network-vif-deleted", "tag": "1eb32241-217f-4e99-8b99-35e2e0f7d87e"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:40.757171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5773b0a9-c72e-4d62-a678-2829d80a1baf req-c439a361-3171-429b-8873-d8a78ae0ce14 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:40.757649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5773b0a9-c72e-4d62-a678-2829d80a1baf req-c439a361-3171-429b-8873-d8a78ae0ce14 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:40.788917 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5773b0a9-c72e-4d62-a678-2829d80a1baf req-c439a361-3171-429b-8873-d8a78ae0ce14 service nova] Creating event network-vif-deleted:1eb32241-217f-4e99-8b99-35e2e0f7d87e for instance bb4de0cd-0830-4cb4-81bf-7fb423fd8069 on n-h2-767704-28 Jul 14 15:09:40.797221 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5773b0a9-c72e-4d62-a678-2829d80a1baf req-c439a361-3171-429b-8873-d8a78ae0ce14 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064973 Jul 14 15:09:40.798470 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3108/6180] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:41.331396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45986a86-62d8-48fc-ac40-3a0a0f28cb18 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:41.332085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-45986a86-62d8-48fc-ac40-3a0a0f28cb18 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:41.342936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45986a86-62d8-48fc-ac40-3a0a0f28cb18 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:41.351547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45986a86-62d8-48fc-ac40-3a0a0f28cb18 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:41.352520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45986a86-62d8-48fc-ac40-3a0a0f28cb18 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:41.353062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45986a86-62d8-48fc-ac40-3a0a0f28cb18 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:41.464603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45986a86-62d8-48fc-ac40-3a0a0f28cb18 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:41.465504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45986a86-62d8-48fc-ac40-3a0a0f28cb18 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:41.465993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-45986a86-62d8-48fc-ac40-3a0a0f28cb18 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lazy-loading 'fault' on Instance uuid bb4de0cd-0830-4cb4-81bf-7fb423fd8069 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:09:41.530322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-45986a86-62d8-48fc-ac40-3a0a0f28cb18 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a975fdfd24463b16d546abdb0218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b666acd76f14e11ac2b557a619318a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:41.540605 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-45986a86-62d8-48fc-ac40-3a0a0f28cb18 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 200 len: 1383 microversion: 2.1 time: 0.213627 Jul 14 15:09:41.551477 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3073/6181] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:41 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 1383 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:42.561134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dae00edd-6610-4ef6-8203-2e3c1f9a0ce7 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:42.562472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dae00edd-6610-4ef6-8203-2e3c1f9a0ce7 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [instance: bb4de0cd-0830-4cb4-81bf-7fb423fd8069] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:42.571552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dae00edd-6610-4ef6-8203-2e3c1f9a0ce7 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:42.572412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dae00edd-6610-4ef6-8203-2e3c1f9a0ce7 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:42.574441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dae00edd-6610-4ef6-8203-2e3c1f9a0ce7 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:42.575067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dae00edd-6610-4ef6-8203-2e3c1f9a0ce7 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:42.595354 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-dae00edd-6610-4ef6-8203-2e3c1f9a0ce7 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] HTTP exception thrown: Instance bb4de0cd-0830-4cb4-81bf-7fb423fd8069 could not be found. Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dae00edd-6610-4ef6-8203-2e3c1f9a0ce7 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Request method failure captured: Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 HTTP/1.1 Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DEm3riAfn_nLm8C1U7IZorcPx4FXr0bXlrle8OEI79P_aeGiIfZNjMFoqqnsJZTu0G0xchFrqrffHIQz0VJzDXr31KPTh1ThsiEggvozOEj1CpkeQVL-W4Wme_d1wrZYe0XZKRi4iDozebmzq0pR18bksFTaiX15rXbocDVubOfZQ4 Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 0b666acd76f14e11ac2b557a619318a0 Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-654465753 Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b666acd76f14e11ac2b557a619318a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0b666acd76f14e11ac2b557a619318a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0b666acd76f14e11ac2b557a619318a0", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b666acd76f14e11ac2b557a619318a0"}]}] Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestSecurityGroupsBasicOps-654465753 Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 0b666acd76f14e11ac2b557a619318a0 Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-654465753 Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestSecurityGroupsBasicOps-654465753-project Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 675a975fdfd24463b16d546abdb0218b Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestSecurityGroupsBasicOps-654465753-project Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance bb4de0cd-0830-4cb4-81bf-7fb423fd8069 could not be found. Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'bb4de0cd-0830-4cb4-81bf-7fb423fd8069'} Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4de0cd-0830-4cb4-81bf-7fb423fd8069 could not be found. Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4de0cd-0830-4cb4-81bf-7fb423fd8069 could not be found. Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:42.598139 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:09:42.605785 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:42.605785 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:42.605785 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:42.605785 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:09:42.605785 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:09:42.605785 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4de0cd-0830-4cb4-81bf-7fb423fd8069 could not be found. Jul 14 15:09:42.605785 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:09:42.605785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dae00edd-6610-4ef6-8203-2e3c1f9a0ce7 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Returning 404 to user: Instance bb4de0cd-0830-4cb4-81bf-7fb423fd8069 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:09:42.605785 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dae00edd-6610-4ef6-8203-2e3c1f9a0ce7 tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069" status: 404 len: 111 microversion: 2.1 time: 0.044581 Jul 14 15:09:42.605785 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3109/6182] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:42 2022] GET /compute/v2.1/servers/bb4de0cd-0830-4cb4-81bf-7fb423fd8069 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:09:47.868349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fe0fdfc1-7ddd-4ffb-86c1-e955b779c1fa tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] Calling method '.version_select at 0x7fd6c52e5ee0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:47.874111 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe0fdfc1-7ddd-4ffb-86c1-e955b779c1fa tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [dc42b563-e4b2-4de7-822e-cf9b03c28017] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:09:48.888894 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe0fdfc1-7ddd-4ffb-86c1-e955b779c1fa tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] [dc42b563-e4b2-4de7-822e-cf9b03c28017] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 46294. Jul 14 15:09:48.913191 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fe0fdfc1-7ddd-4ffb-86c1-e955b779c1fa tempest-TestSecurityGroupsBasicOps-654465753 tempest-TestSecurityGroupsBasicOps-654465753-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2003099985" status: 202 len: 0 microversion: 2.1 time: 1.051311 Jul 14 15:09:48.914195 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3074/6183] 10.222.0.81 () {58 vars in 1277 bytes} [Thu Jul 14 15:09:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2003099985 => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:09:58.372853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:58.374479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:58.622729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e5e27ec1-b887-4b42-ae52-1766e38e8ff2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'create', calling method: .version_select at 0x7fd6c58b34c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2138864020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL5UPw+kNX60O8NX5nBFqAL+S79mYiOFx5SC8i1HT/zB33wB2fQkY+izynsIaZOhAw37+Ng+0rL26+N4QofNwTNS6ADAhgSILkLWiU51crNKLKvQmLzFxrH+9eC0j3BEQ=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:58.638140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e5e27ec1-b887-4b42-ae52-1766e38e8ff2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for project 24625820309f4411bb0b517b6ebb6583. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:09:58.644651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e5e27ec1-b887-4b42-ae52-1766e38e8ff2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for user 2c0f965a2f344bd69b0fc157fe02ffda and project 24625820309f4411bb0b517b6ebb6583. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:09:58.659467 n-d-767704-28 devstack@n-api.service[119512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5e27ec1-b887-4b42-ae52-1766e38e8ff2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [f429ae4b-6107-4dd5-a3e1-bb32c73ed5eb] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:09:59.667852 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5e27ec1-b887-4b42-ae52-1766e38e8ff2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [f429ae4b-6107-4dd5-a3e1-bb32c73ed5eb] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 46708. Jul 14 15:09:59.688491 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e5e27ec1-b887-4b42-ae52-1766e38e8ff2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.322550 Jul 14 15:09:59.694805 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3110/6184] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:09:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:02.891903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=19 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:02.892725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:02.898034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae8b384b-afc1-468c-8601-b5b0c4f94ba3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:02.898548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae8b384b-afc1-468c-8601-b5b0c4f94ba3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:02.906495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae8b384b-afc1-468c-8601-b5b0c4f94ba3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:02.907022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae8b384b-afc1-468c-8601-b5b0c4f94ba3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:02.907980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae8b384b-afc1-468c-8601-b5b0c4f94ba3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:02.908533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae8b384b-afc1-468c-8601-b5b0c4f94ba3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:02.941169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae8b384b-afc1-468c-8601-b5b0c4f94ba3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:10:03.057348 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ae8b384b-afc1-468c-8601-b5b0c4f94ba3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "DELETE /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 204 len: 0 microversion: 2.1 time: 0.167558 Jul 14 15:10:03.058531 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3075/6185] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:10:02 2022] DELETE /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:10:03.068684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-90d66770-470e-4c92-b0e0-b021fd6b9728 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:03.069347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-90d66770-470e-4c92-b0e0-b021fd6b9728 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:03.077830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90d66770-470e-4c92-b0e0-b021fd6b9728 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:03.078598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90d66770-470e-4c92-b0e0-b021fd6b9728 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:03.079452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90d66770-470e-4c92-b0e0-b021fd6b9728 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:03.079910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90d66770-470e-4c92-b0e0-b021fd6b9728 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:03.271562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-90d66770-470e-4c92-b0e0-b021fd6b9728 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:03.284208 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-90d66770-470e-4c92-b0e0-b021fd6b9728 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1575 microversion: 2.1 time: 0.220439 Jul 14 15:10:03.285501 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3111/6186] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:03 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:04.306863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c6b6402a-6da7-4004-9036-f39504bd68e7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:04.308303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c6b6402a-6da7-4004-9036-f39504bd68e7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:04.315905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6b6402a-6da7-4004-9036-f39504bd68e7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:04.316882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6b6402a-6da7-4004-9036-f39504bd68e7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:04.317952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6b6402a-6da7-4004-9036-f39504bd68e7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:04.318631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c6b6402a-6da7-4004-9036-f39504bd68e7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:04.504170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c6b6402a-6da7-4004-9036-f39504bd68e7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:04.516273 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c6b6402a-6da7-4004-9036-f39504bd68e7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1575 microversion: 2.1 time: 0.214534 Jul 14 15:10:04.528164 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3076/6187] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:04 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:05.542607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36cad8c3-157f-4765-a039-2d2c2018de84 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:05.543964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-36cad8c3-157f-4765-a039-2d2c2018de84 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:05.561973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36cad8c3-157f-4765-a039-2d2c2018de84 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:05.568426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36cad8c3-157f-4765-a039-2d2c2018de84 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:05.570239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36cad8c3-157f-4765-a039-2d2c2018de84 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:05.570702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36cad8c3-157f-4765-a039-2d2c2018de84 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:06.071378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-36cad8c3-157f-4765-a039-2d2c2018de84 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:06.087737 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-36cad8c3-157f-4765-a039-2d2c2018de84 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1575 microversion: 2.1 time: 0.554208 Jul 14 15:10:06.093157 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3112/6188] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:05 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1575 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:06.742716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-40e2c1e7-eef3-421a-8108-5ecc105a078c req-662dcdbb-19b5-41ec-93f8-271d24ed3b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31932a71-c4d3-4b24-9574-859abc712fd4", "name": "network-vif-deleted", "tag": "2aec7664-4fd7-4679-bfda-d5ca2809bd81"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:06.763655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-40e2c1e7-eef3-421a-8108-5ecc105a078c req-662dcdbb-19b5-41ec-93f8-271d24ed3b68 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:06.764669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-40e2c1e7-eef3-421a-8108-5ecc105a078c req-662dcdbb-19b5-41ec-93f8-271d24ed3b68 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:06.805409 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-40e2c1e7-eef3-421a-8108-5ecc105a078c req-662dcdbb-19b5-41ec-93f8-271d24ed3b68 service nova] Creating event network-vif-deleted:2aec7664-4fd7-4679-bfda-d5ca2809bd81 for instance 31932a71-c4d3-4b24-9574-859abc712fd4 on n-h1-767704-28 Jul 14 15:10:06.831003 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-40e2c1e7-eef3-421a-8108-5ecc105a078c req-662dcdbb-19b5-41ec-93f8-271d24ed3b68 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092520 Jul 14 15:10:06.833681 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3077/6189] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:07.110127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9da8b329-cda6-4d11-ad34-907b40933b3f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:07.110797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9da8b329-cda6-4d11-ad34-907b40933b3f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:07.128737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9da8b329-cda6-4d11-ad34-907b40933b3f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:07.135755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9da8b329-cda6-4d11-ad34-907b40933b3f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:07.136929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9da8b329-cda6-4d11-ad34-907b40933b3f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:07.137590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9da8b329-cda6-4d11-ad34-907b40933b3f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:07.309480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9da8b329-cda6-4d11-ad34-907b40933b3f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:07.327640 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9da8b329-cda6-4d11-ad34-907b40933b3f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1224 microversion: 2.1 time: 0.221500 Jul 14 15:10:07.328765 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3113/6190] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:07 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1224 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:07.448699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-52751777", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "c23617f9-4440-4f82-9fcf-9b19ec6c2696"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2138864020", "security_groups": [{"name": "tempest-secgroup-smoke-1854282390"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:07.758698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] validate_networks() for [('c23617f9-4440-4f82-9fcf-9b19ec6c2696', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:10:08.345048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5ed43e98-6cd5-4084-8337-402f8244370d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:08.346414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5ed43e98-6cd5-4084-8337-402f8244370d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:08.366596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ed43e98-6cd5-4084-8337-402f8244370d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:08.371112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ed43e98-6cd5-4084-8337-402f8244370d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:08.372229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ed43e98-6cd5-4084-8337-402f8244370d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:08.372860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ed43e98-6cd5-4084-8337-402f8244370d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:08.498482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5ed43e98-6cd5-4084-8337-402f8244370d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:08.518197 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5ed43e98-6cd5-4084-8337-402f8244370d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1224 microversion: 2.1 time: 0.176970 Jul 14 15:10:08.519589 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3114/6191] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:08 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1224 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:08.675864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:10:08.676404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:10:08.677014 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:10:08.677679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:10:08.678325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:10:08.698930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:08.703880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:08.705398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:08.706124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:08.739935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for project 24625820309f4411bb0b517b6ebb6583. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:10:08.748644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for user 2c0f965a2f344bd69b0fc157fe02ffda and project 24625820309f4411bb0b517b6ebb6583. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:10:08.778062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:10:08.781646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:10:08.854628 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f61155e3-c9e1-4f13-84ec-2f1fa621d33c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.411062 Jul 14 15:10:08.855964 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3078/6192] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:10:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:10:08.866005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e194054e-7d71-44a6-9cd3-f2eeb1eb0e56 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:08.866644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e194054e-7d71-44a6-9cd3-f2eeb1eb0e56 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:08.872809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:09.020442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e194054e-7d71-44a6-9cd3-f2eeb1eb0e56 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:09.030233 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e194054e-7d71-44a6-9cd3-f2eeb1eb0e56 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1265 microversion: 2.1 time: 0.167311 Jul 14 15:10:09.041553 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3115/6193] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:08 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:09.552427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-adaf561a-ab02-4601-98f8-fff3a3284a50 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:09.553113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-adaf561a-ab02-4601-98f8-fff3a3284a50 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:09.582711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adaf561a-ab02-4601-98f8-fff3a3284a50 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:09.583294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adaf561a-ab02-4601-98f8-fff3a3284a50 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:09.584139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adaf561a-ab02-4601-98f8-fff3a3284a50 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:09.590633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-adaf561a-ab02-4601-98f8-fff3a3284a50 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:09.724122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-adaf561a-ab02-4601-98f8-fff3a3284a50 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:09.735777 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-adaf561a-ab02-4601-98f8-fff3a3284a50 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1224 microversion: 2.1 time: 0.193236 Jul 14 15:10:09.746765 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3079/6194] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:09 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1224 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:10.048902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3a7f52a2-c452-4e8c-8f68-0426c63ec18e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:10.049585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3a7f52a2-c452-4e8c-8f68-0426c63ec18e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:10.063408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a7f52a2-c452-4e8c-8f68-0426c63ec18e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:10.063890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a7f52a2-c452-4e8c-8f68-0426c63ec18e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:10.064720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a7f52a2-c452-4e8c-8f68-0426c63ec18e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:10.065215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3a7f52a2-c452-4e8c-8f68-0426c63ec18e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:10.147513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3a7f52a2-c452-4e8c-8f68-0426c63ec18e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:10.158769 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3a7f52a2-c452-4e8c-8f68-0426c63ec18e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1317 microversion: 2.1 time: 0.113907 Jul 14 15:10:10.170811 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3116/6195] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:10 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1317 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:10.753295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d032b24-6978-4a29-a255-e33410db9398 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:10.753925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8d032b24-6978-4a29-a255-e33410db9398 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:10.768289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d032b24-6978-4a29-a255-e33410db9398 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:10.769228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d032b24-6978-4a29-a255-e33410db9398 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:10.770320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d032b24-6978-4a29-a255-e33410db9398 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:10.770935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d032b24-6978-4a29-a255-e33410db9398 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:10.925504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8d032b24-6978-4a29-a255-e33410db9398 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:10.948626 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8d032b24-6978-4a29-a255-e33410db9398 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1224 microversion: 2.1 time: 0.193663 Jul 14 15:10:10.950127 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3080/6196] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:10 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1224 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:11.178151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c7505617-0010-48c8-8658-6fa182429550 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:11.179408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c7505617-0010-48c8-8658-6fa182429550 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:11.189045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7505617-0010-48c8-8658-6fa182429550 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:11.189777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7505617-0010-48c8-8658-6fa182429550 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:11.190750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7505617-0010-48c8-8658-6fa182429550 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:11.191427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c7505617-0010-48c8-8658-6fa182429550 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:11.335079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c7505617-0010-48c8-8658-6fa182429550 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:11.351614 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c7505617-0010-48c8-8658-6fa182429550 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1323 microversion: 2.1 time: 0.178061 Jul 14 15:10:11.361593 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3117/6197] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:11 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:11.967645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-257c4508-2321-4d70-84ab-72214ed30754 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:11.968439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-257c4508-2321-4d70-84ab-72214ed30754 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:11.982422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-257c4508-2321-4d70-84ab-72214ed30754 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:11.983050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-257c4508-2321-4d70-84ab-72214ed30754 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:11.984036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-257c4508-2321-4d70-84ab-72214ed30754 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:11.989598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-257c4508-2321-4d70-84ab-72214ed30754 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:12.369729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a0aed2c-6096-444e-aa96-d9ef469d0ba7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:12.370997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2a0aed2c-6096-444e-aa96-d9ef469d0ba7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:12.390482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a0aed2c-6096-444e-aa96-d9ef469d0ba7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:12.390961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a0aed2c-6096-444e-aa96-d9ef469d0ba7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:12.391801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a0aed2c-6096-444e-aa96-d9ef469d0ba7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:12.392458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a0aed2c-6096-444e-aa96-d9ef469d0ba7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:12.681702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-257c4508-2321-4d70-84ab-72214ed30754 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:12.690118 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-257c4508-2321-4d70-84ab-72214ed30754 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1224 microversion: 2.1 time: 0.726802 Jul 14 15:10:12.699853 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3081/6198] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:11 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1224 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:12.888906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2a0aed2c-6096-444e-aa96-d9ef469d0ba7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:12.907160 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a0aed2c-6096-444e-aa96-d9ef469d0ba7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1391 microversion: 2.1 time: 0.541647 Jul 14 15:10:12.918158 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3118/6199] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:12 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1391 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:13.244018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-63085be5-1c68-4048-a387-7ec85f050411 req-17929212-6516-4ef8-be71-c6d56ccc5264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac", "tag": "4876d271-04d5-44b9-8fbc-4dd20e8a48d3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:13.265557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-63085be5-1c68-4048-a387-7ec85f050411 req-17929212-6516-4ef8-be71-c6d56ccc5264 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:13.266763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-63085be5-1c68-4048-a387-7ec85f050411 req-17929212-6516-4ef8-be71-c6d56ccc5264 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:13.282588 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-63085be5-1c68-4048-a387-7ec85f050411 req-17929212-6516-4ef8-be71-c6d56ccc5264 service nova] Creating event network-changed:4876d271-04d5-44b9-8fbc-4dd20e8a48d3 for instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac on n-h2-767704-28 Jul 14 15:10:13.293247 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-63085be5-1c68-4048-a387-7ec85f050411 req-17929212-6516-4ef8-be71-c6d56ccc5264 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057184 Jul 14 15:10:13.300920 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3082/6200] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:13.709242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8915efc-e5b2-4e67-a475-236309a595de tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:13.709866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8915efc-e5b2-4e67-a475-236309a595de tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:13.717877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8915efc-e5b2-4e67-a475-236309a595de tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:13.718347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8915efc-e5b2-4e67-a475-236309a595de tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:13.719221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8915efc-e5b2-4e67-a475-236309a595de tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:13.719874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8915efc-e5b2-4e67-a475-236309a595de tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:13.756822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8915efc-e5b2-4e67-a475-236309a595de tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:13.757334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8915efc-e5b2-4e67-a475-236309a595de tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:13.757797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-f8915efc-e5b2-4e67-a475-236309a595de tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lazy-loading 'fault' on Instance uuid 31932a71-c4d3-4b24-9574-859abc712fd4 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:10:13.809622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f8915efc-e5b2-4e67-a475-236309a595de tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:13.817613 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8915efc-e5b2-4e67-a475-236309a595de tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 200 len: 1229 microversion: 2.1 time: 0.112192 Jul 14 15:10:13.818199 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3119/6201] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:13 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 1229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:13.935510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1224b105-8ad4-4657-ad2e-db5e218950f2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:13.936169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1224b105-8ad4-4657-ad2e-db5e218950f2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:13.942974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1224b105-8ad4-4657-ad2e-db5e218950f2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:13.943441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1224b105-8ad4-4657-ad2e-db5e218950f2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:13.944223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1224b105-8ad4-4657-ad2e-db5e218950f2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:13.944664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1224b105-8ad4-4657-ad2e-db5e218950f2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:14.111888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1224b105-8ad4-4657-ad2e-db5e218950f2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:14.122851 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1224b105-8ad4-4657-ad2e-db5e218950f2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1391 microversion: 2.1 time: 0.191730 Jul 14 15:10:14.123453 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3083/6202] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:13 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:14.838103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4fd7359-24dd-4d04-a9c9-7a67d046d60d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:14.838875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d4fd7359-24dd-4d04-a9c9-7a67d046d60d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:14.846440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4fd7359-24dd-4d04-a9c9-7a67d046d60d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:14.847238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4fd7359-24dd-4d04-a9c9-7a67d046d60d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:14.848140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4fd7359-24dd-4d04-a9c9-7a67d046d60d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:14.848699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4fd7359-24dd-4d04-a9c9-7a67d046d60d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:14.883027 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-d4fd7359-24dd-4d04-a9c9-7a67d046d60d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4fd7359-24dd-4d04-a9c9-7a67d046d60d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 HTTP/1.1 Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '31932a71-c4d3-4b24-9574-859abc712fd4'} Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:10:14.886387 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:10:14.891735 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:10:14.891735 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:10:14.891735 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:10:14.891735 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:10:14.891735 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:10:14.891735 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:10:14.891735 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:10:14.894169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4fd7359-24dd-4d04-a9c9-7a67d046d60d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:10:14.896267 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d4fd7359-24dd-4d04-a9c9-7a67d046d60d tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 404 len: 111 microversion: 2.1 time: 0.064335 Jul 14 15:10:14.899837 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3120/6203] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:14 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:10:15.098904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1264052181", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-296175840", "security_groups": [{"name": "tempest-secgroup-smoke-943015086"}], "block_device_mapping_v2": [{"uuid": "f8077642-1af9-438a-9599-68c6a10ca1d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bce1cdb9-0501-4062-a135-972a001804ef"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:15.141461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-abbe6d20-b0c0-4108-8787-0844fdcd8750 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:15.142487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-abbe6d20-b0c0-4108-8787-0844fdcd8750 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:15.148825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abbe6d20-b0c0-4108-8787-0844fdcd8750 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:15.149916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abbe6d20-b0c0-4108-8787-0844fdcd8750 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:15.151156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abbe6d20-b0c0-4108-8787-0844fdcd8750 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:15.151777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abbe6d20-b0c0-4108-8787-0844fdcd8750 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:15.379275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] validate_networks() for [('bce1cdb9-0501-4062-a135-972a001804ef', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:10:15.526916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-abbe6d20-b0c0-4108-8787-0844fdcd8750 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:15.534849 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-abbe6d20-b0c0-4108-8787-0844fdcd8750 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1391 microversion: 2.1 time: 0.397471 Jul 14 15:10:15.535358 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3121/6204] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:15 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1391 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:16.052829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:10:16.053390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:10:16.053880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:10:16.054295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:10:16.054708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:10:16.065445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:16.066004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:16.066830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:16.067641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:16.085018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:10:16.091400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for user e77523cc1cca458eb2a1b553aff072be and project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:10:16.154192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:10:16.156349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8077642-1af9-438a-9599-68c6a10ca1d0',volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:10:16.303080 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-91ef7465-a024-4d69-a6a1-fd9bf0a726c2 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.208153 Jul 14 15:10:16.303825 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3084/6205] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:10:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:10:16.316921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-64a61fd1-00ee-49f3-be26-b255c61da8bf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:16.318402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-64a61fd1-00ee-49f3-be26-b255c61da8bf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:16.384974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-64a61fd1-00ee-49f3-be26-b255c61da8bf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:16.395069 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-64a61fd1-00ee-49f3-be26-b255c61da8bf tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1094 microversion: 2.1 time: 0.083278 Jul 14 15:10:16.396490 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3122/6206] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:16 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:16.555148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3329ccae-48d6-4e6d-b14d-e84087afef52 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:16.557257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3329ccae-48d6-4e6d-b14d-e84087afef52 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:16.564198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3329ccae-48d6-4e6d-b14d-e84087afef52 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:16.564873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3329ccae-48d6-4e6d-b14d-e84087afef52 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:16.565698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3329ccae-48d6-4e6d-b14d-e84087afef52 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:16.566150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3329ccae-48d6-4e6d-b14d-e84087afef52 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:16.730652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3329ccae-48d6-4e6d-b14d-e84087afef52 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:16.739746 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3329ccae-48d6-4e6d-b14d-e84087afef52 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1391 microversion: 2.1 time: 0.191998 Jul 14 15:10:16.751100 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3085/6207] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:16 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1391 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:17.419010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eb28082f-4dd7-4ea0-9915-a8f3b6da3f04 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:17.420416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eb28082f-4dd7-4ea0-9915-a8f3b6da3f04 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:17.429505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb28082f-4dd7-4ea0-9915-a8f3b6da3f04 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:17.430485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb28082f-4dd7-4ea0-9915-a8f3b6da3f04 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:17.431643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb28082f-4dd7-4ea0-9915-a8f3b6da3f04 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:17.432393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eb28082f-4dd7-4ea0-9915-a8f3b6da3f04 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:17.511681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eb28082f-4dd7-4ea0-9915-a8f3b6da3f04 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:17.519733 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eb28082f-4dd7-4ea0-9915-a8f3b6da3f04 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1192 microversion: 2.1 time: 0.105990 Jul 14 15:10:17.520352 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3123/6208] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:17 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:17.758583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d65b59a-61d7-4e9c-8d7c-0519ef9ad0c2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:17.759988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6d65b59a-61d7-4e9c-8d7c-0519ef9ad0c2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:17.768735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d65b59a-61d7-4e9c-8d7c-0519ef9ad0c2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:17.769416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d65b59a-61d7-4e9c-8d7c-0519ef9ad0c2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:17.770248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d65b59a-61d7-4e9c-8d7c-0519ef9ad0c2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:17.770685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d65b59a-61d7-4e9c-8d7c-0519ef9ad0c2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:18.045815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6d65b59a-61d7-4e9c-8d7c-0519ef9ad0c2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:18.064344 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6d65b59a-61d7-4e9c-8d7c-0519ef9ad0c2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1391 microversion: 2.1 time: 0.310753 Jul 14 15:10:18.066026 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3086/6209] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:17 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1391 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:18.538550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e3edd7f7-9589-4b7f-98c9-52b78fefab5e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:18.540431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e3edd7f7-9589-4b7f-98c9-52b78fefab5e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:18.554420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3edd7f7-9589-4b7f-98c9-52b78fefab5e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:18.555149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3edd7f7-9589-4b7f-98c9-52b78fefab5e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:18.557445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3edd7f7-9589-4b7f-98c9-52b78fefab5e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:18.561258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e3edd7f7-9589-4b7f-98c9-52b78fefab5e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:19.083071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-069e6e70-b2f6-4c12-9d8b-1773e590f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:19.083704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-069e6e70-b2f6-4c12-9d8b-1773e590f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:19.097203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-069e6e70-b2f6-4c12-9d8b-1773e590f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:19.101966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-069e6e70-b2f6-4c12-9d8b-1773e590f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:19.103697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-069e6e70-b2f6-4c12-9d8b-1773e590f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:19.104168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-069e6e70-b2f6-4c12-9d8b-1773e590f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:19.207747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e3edd7f7-9589-4b7f-98c9-52b78fefab5e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:19.219973 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e3edd7f7-9589-4b7f-98c9-52b78fefab5e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1277 microversion: 2.1 time: 0.685421 Jul 14 15:10:19.230520 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3124/6210] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:18 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1277 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:19.237100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e7fec7a6-4142-4ab9-884c-7059b2699376 req-8818073b-82e2-4614-aa0b-33c8a0fecc0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac", "name": "network-vif-plugged", "status": "completed", "tag": "4876d271-04d5-44b9-8fbc-4dd20e8a48d3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:19.249492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e7fec7a6-4142-4ab9-884c-7059b2699376 req-8818073b-82e2-4614-aa0b-33c8a0fecc0c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:19.250161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e7fec7a6-4142-4ab9-884c-7059b2699376 req-8818073b-82e2-4614-aa0b-33c8a0fecc0c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:19.263347 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e7fec7a6-4142-4ab9-884c-7059b2699376 req-8818073b-82e2-4614-aa0b-33c8a0fecc0c service nova] Creating event network-vif-plugged:4876d271-04d5-44b9-8fbc-4dd20e8a48d3 for instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac on n-h2-767704-28 Jul 14 15:10:19.269897 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e7fec7a6-4142-4ab9-884c-7059b2699376 req-8818073b-82e2-4614-aa0b-33c8a0fecc0c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037959 Jul 14 15:10:19.272522 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3125/6211] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:19.575650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-069e6e70-b2f6-4c12-9d8b-1773e590f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:19.586512 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-069e6e70-b2f6-4c12-9d8b-1773e590f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1391 microversion: 2.1 time: 0.507410 Jul 14 15:10:19.587357 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3087/6212] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:19 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1391 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:19.773981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-14bda15e-5970-4d21-8003-94d0430a58bb req-ba0867bc-b153-497b-8224-2977ed7b636a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab371da2-5cbd-4ec5-b5e1-c016e221738b", "tag": "27c9fe9c-e43f-4879-92c1-03edd95a45e5"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:19.792995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-14bda15e-5970-4d21-8003-94d0430a58bb req-ba0867bc-b153-497b-8224-2977ed7b636a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:19.793845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-14bda15e-5970-4d21-8003-94d0430a58bb req-ba0867bc-b153-497b-8224-2977ed7b636a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:19.810835 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-14bda15e-5970-4d21-8003-94d0430a58bb req-ba0867bc-b153-497b-8224-2977ed7b636a service nova] Creating event network-changed:27c9fe9c-e43f-4879-92c1-03edd95a45e5 for instance ab371da2-5cbd-4ec5-b5e1-c016e221738b on n-h1-767704-28 Jul 14 15:10:19.818213 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-14bda15e-5970-4d21-8003-94d0430a58bb req-ba0867bc-b153-497b-8224-2977ed7b636a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055102 Jul 14 15:10:19.819587 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3126/6213] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:20.239194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-448c7b22-55a7-4213-9ae6-ba9160aced49 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:20.239775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-448c7b22-55a7-4213-9ae6-ba9160aced49 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:20.247220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-448c7b22-55a7-4213-9ae6-ba9160aced49 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:20.247685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-448c7b22-55a7-4213-9ae6-ba9160aced49 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:20.248472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-448c7b22-55a7-4213-9ae6-ba9160aced49 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:20.248917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-448c7b22-55a7-4213-9ae6-ba9160aced49 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:20.413627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-448c7b22-55a7-4213-9ae6-ba9160aced49 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:20.422760 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-448c7b22-55a7-4213-9ae6-ba9160aced49 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1277 microversion: 2.1 time: 0.187987 Jul 14 15:10:20.423352 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3088/6214] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:20 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:20.604817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-75e11753-df13-4b5c-b6f8-9fe083dbd418 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:20.605969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-75e11753-df13-4b5c-b6f8-9fe083dbd418 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:20.612850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75e11753-df13-4b5c-b6f8-9fe083dbd418 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:20.613486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75e11753-df13-4b5c-b6f8-9fe083dbd418 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:20.614618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75e11753-df13-4b5c-b6f8-9fe083dbd418 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:20.615086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-75e11753-df13-4b5c-b6f8-9fe083dbd418 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:20.822370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-75e11753-df13-4b5c-b6f8-9fe083dbd418 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:20.831532 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-75e11753-df13-4b5c-b6f8-9fe083dbd418 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1391 microversion: 2.1 time: 0.231351 Jul 14 15:10:20.832251 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3127/6215] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:20 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1391 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:21.439887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-495c41fa-86a5-4893-b7e2-7fd94a04f39c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:21.440507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-495c41fa-86a5-4893-b7e2-7fd94a04f39c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:21.449351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-495c41fa-86a5-4893-b7e2-7fd94a04f39c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:21.450051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-495c41fa-86a5-4893-b7e2-7fd94a04f39c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:21.450869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-495c41fa-86a5-4893-b7e2-7fd94a04f39c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:21.451825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-495c41fa-86a5-4893-b7e2-7fd94a04f39c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:21.620050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-495c41fa-86a5-4893-b7e2-7fd94a04f39c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:21.628114 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-495c41fa-86a5-4893-b7e2-7fd94a04f39c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1277 microversion: 2.1 time: 0.192340 Jul 14 15:10:21.630447 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3089/6216] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:21 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:21.849736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9bcd150e-275a-4c87-aee4-b846bdecef58 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:21.851182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9bcd150e-275a-4c87-aee4-b846bdecef58 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:21.859243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9bcd150e-275a-4c87-aee4-b846bdecef58 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:21.859825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9bcd150e-275a-4c87-aee4-b846bdecef58 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:21.860861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9bcd150e-275a-4c87-aee4-b846bdecef58 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:21.861550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9bcd150e-275a-4c87-aee4-b846bdecef58 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:22.013096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9bcd150e-275a-4c87-aee4-b846bdecef58 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:22.021406 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9bcd150e-275a-4c87-aee4-b846bdecef58 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1563 microversion: 2.1 time: 0.175483 Jul 14 15:10:22.033297 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3128/6217] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:21 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:22.041019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a6eaf383-2001-4f42-8781-00fe7c5f8311 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:22.041714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a6eaf383-2001-4f42-8781-00fe7c5f8311 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:22.052445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6eaf383-2001-4f42-8781-00fe7c5f8311 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:22.053381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6eaf383-2001-4f42-8781-00fe7c5f8311 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:22.054605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6eaf383-2001-4f42-8781-00fe7c5f8311 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:22.056336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6eaf383-2001-4f42-8781-00fe7c5f8311 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:22.221654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a6eaf383-2001-4f42-8781-00fe7c5f8311 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:22.231891 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a6eaf383-2001-4f42-8781-00fe7c5f8311 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1563 microversion: 2.1 time: 0.195329 Jul 14 15:10:22.232845 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3090/6218] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:22 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1563 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:22.646838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6598639a-eb8f-4cb8-979e-1320295ec439 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:22.647910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6598639a-eb8f-4cb8-979e-1320295ec439 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:22.655594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6598639a-eb8f-4cb8-979e-1320295ec439 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:22.656440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6598639a-eb8f-4cb8-979e-1320295ec439 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:22.657495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6598639a-eb8f-4cb8-979e-1320295ec439 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:22.658170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6598639a-eb8f-4cb8-979e-1320295ec439 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:22.990822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6598639a-eb8f-4cb8-979e-1320295ec439 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:23.001076 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6598639a-eb8f-4cb8-979e-1320295ec439 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1277 microversion: 2.1 time: 0.357985 Jul 14 15:10:23.001675 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3129/6219] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:22 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1277 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:24.021709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b77dde58-0939-4ceb-8cc3-aecb50394256 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:24.023128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b77dde58-0939-4ceb-8cc3-aecb50394256 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:24.032189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b77dde58-0939-4ceb-8cc3-aecb50394256 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:24.033236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b77dde58-0939-4ceb-8cc3-aecb50394256 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:24.034574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b77dde58-0939-4ceb-8cc3-aecb50394256 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:24.035427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b77dde58-0939-4ceb-8cc3-aecb50394256 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:24.330570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b77dde58-0939-4ceb-8cc3-aecb50394256 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:24.341086 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b77dde58-0939-4ceb-8cc3-aecb50394256 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1265 microversion: 2.1 time: 0.324478 Jul 14 15:10:24.342834 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3091/6220] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:24 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:24.572545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0838b0a0-e619-4430-a984-fabfaea7b45b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:24.573239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0838b0a0-e619-4430-a984-fabfaea7b45b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:24.578833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-cf96c9a3-ffb8-40f1-985b-a11ebb6472dd req-1aceb466-2e60-494d-828b-f407565542d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac", "tag": "4876d271-04d5-44b9-8fbc-4dd20e8a48d3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:24.581130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0838b0a0-e619-4430-a984-fabfaea7b45b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:24.581610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0838b0a0-e619-4430-a984-fabfaea7b45b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:24.582421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0838b0a0-e619-4430-a984-fabfaea7b45b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:24.582885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0838b0a0-e619-4430-a984-fabfaea7b45b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:24.596652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cf96c9a3-ffb8-40f1-985b-a11ebb6472dd req-1aceb466-2e60-494d-828b-f407565542d3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:24.597248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cf96c9a3-ffb8-40f1-985b-a11ebb6472dd req-1aceb466-2e60-494d-828b-f407565542d3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:24.630042 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-cf96c9a3-ffb8-40f1-985b-a11ebb6472dd req-1aceb466-2e60-494d-828b-f407565542d3 service nova] Creating event network-changed:4876d271-04d5-44b9-8fbc-4dd20e8a48d3 for instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac on n-h2-767704-28 Jul 14 15:10:24.638050 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-cf96c9a3-ffb8-40f1-985b-a11ebb6472dd req-1aceb466-2e60-494d-828b-f407565542d3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062692 Jul 14 15:10:24.639000 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3092/6221] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:24.890297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0838b0a0-e619-4430-a984-fabfaea7b45b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:24.913523 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0838b0a0-e619-4430-a984-fabfaea7b45b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1563 microversion: 2.1 time: 0.346153 Jul 14 15:10:24.926447 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3130/6222] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:24 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1563 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:25.359897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-decc28d7-d24a-41bf-a43a-dba5054e0a4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:25.361574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-decc28d7-d24a-41bf-a43a-dba5054e0a4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:25.378468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-decc28d7-d24a-41bf-a43a-dba5054e0a4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:25.378942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-decc28d7-d24a-41bf-a43a-dba5054e0a4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:25.380037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-decc28d7-d24a-41bf-a43a-dba5054e0a4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:25.380493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-decc28d7-d24a-41bf-a43a-dba5054e0a4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:25.470248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:25.663364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-decc28d7-d24a-41bf-a43a-dba5054e0a4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:25.671871 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-decc28d7-d24a-41bf-a43a-dba5054e0a4c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1265 microversion: 2.1 time: 0.317047 Jul 14 15:10:25.672486 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3093/6223] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:25 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1265 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:26.689578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c68c0d48-de5c-49a5-ac45-9290f90f49c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:26.690348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c68c0d48-de5c-49a5-ac45-9290f90f49c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:26.694044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:26.699140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c68c0d48-de5c-49a5-ac45-9290f90f49c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:26.699620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c68c0d48-de5c-49a5-ac45-9290f90f49c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:26.700490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c68c0d48-de5c-49a5-ac45-9290f90f49c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:26.700985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c68c0d48-de5c-49a5-ac45-9290f90f49c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:26.705433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=100 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:26.845082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c68c0d48-de5c-49a5-ac45-9290f90f49c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:26.856199 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c68c0d48-de5c-49a5-ac45-9290f90f49c1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1265 microversion: 2.1 time: 0.170345 Jul 14 15:10:26.856802 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3131/6224] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:26 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:27.875945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-88d7d9ff-cbef-46cd-947d-19c38d7fad90 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:27.876568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-88d7d9ff-cbef-46cd-947d-19c38d7fad90 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:27.878649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:27.879755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:27.888465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88d7d9ff-cbef-46cd-947d-19c38d7fad90 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:27.888919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88d7d9ff-cbef-46cd-947d-19c38d7fad90 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:27.889722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88d7d9ff-cbef-46cd-947d-19c38d7fad90 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:27.890162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-88d7d9ff-cbef-46cd-947d-19c38d7fad90 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:28.222933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-88d7d9ff-cbef-46cd-947d-19c38d7fad90 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:28.231814 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-88d7d9ff-cbef-46cd-947d-19c38d7fad90 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1265 microversion: 2.1 time: 0.359782 Jul 14 15:10:28.232547 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3094/6225] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:27 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1265 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:29.248630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61a3555a-7f81-4edd-9312-efb3227c2b1c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:29.249336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-61a3555a-7f81-4edd-9312-efb3227c2b1c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:29.252140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:29.258745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61a3555a-7f81-4edd-9312-efb3227c2b1c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:29.259241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61a3555a-7f81-4edd-9312-efb3227c2b1c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:29.260029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61a3555a-7f81-4edd-9312-efb3227c2b1c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:29.260486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61a3555a-7f81-4edd-9312-efb3227c2b1c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:29.409426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-61a3555a-7f81-4edd-9312-efb3227c2b1c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:29.417915 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-61a3555a-7f81-4edd-9312-efb3227c2b1c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1265 microversion: 2.1 time: 0.173127 Jul 14 15:10:29.418509 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3132/6226] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:29 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:30.553133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8a9c57ee-d21c-4992-a178-c2ecbd44af6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:30.553775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8a9c57ee-d21c-4992-a178-c2ecbd44af6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:30.561052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a9c57ee-d21c-4992-a178-c2ecbd44af6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:30.561522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a9c57ee-d21c-4992-a178-c2ecbd44af6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:30.562311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a9c57ee-d21c-4992-a178-c2ecbd44af6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:30.562760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a9c57ee-d21c-4992-a178-c2ecbd44af6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:30.709037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8a9c57ee-d21c-4992-a178-c2ecbd44af6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:30.717971 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8a9c57ee-d21c-4992-a178-c2ecbd44af6e tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1265 microversion: 2.1 time: 0.287471 Jul 14 15:10:30.718345 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3095/6227] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:30 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:31.737967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c9ac6d8e-71af-4f60-baf6-fbabe58dceab tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:31.740268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c9ac6d8e-71af-4f60-baf6-fbabe58dceab tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:31.756235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9ac6d8e-71af-4f60-baf6-fbabe58dceab tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:31.757050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9ac6d8e-71af-4f60-baf6-fbabe58dceab tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:31.758640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9ac6d8e-71af-4f60-baf6-fbabe58dceab tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:31.759453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c9ac6d8e-71af-4f60-baf6-fbabe58dceab tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:31.927375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c9ac6d8e-71af-4f60-baf6-fbabe58dceab tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:31.936395 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c9ac6d8e-71af-4f60-baf6-fbabe58dceab tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1265 microversion: 2.1 time: 0.205177 Jul 14 15:10:31.937009 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3133/6228] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:31 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:32.954445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5c56cb7a-db2b-47ae-aa33-95353faaae9f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:32.955627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5c56cb7a-db2b-47ae-aa33-95353faaae9f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:32.969737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:32.973271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c56cb7a-db2b-47ae-aa33-95353faaae9f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:32.976268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c56cb7a-db2b-47ae-aa33-95353faaae9f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:32.978844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c56cb7a-db2b-47ae-aa33-95353faaae9f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:32.980161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c56cb7a-db2b-47ae-aa33-95353faaae9f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:33.145066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-7c02d82b-d370-4883-8dec-e726ebae36a9 req-47e8e2f8-3005-42d7-b401-0180d2d0268f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab371da2-5cbd-4ec5-b5e1-c016e221738b", "name": "network-vif-plugged", "status": "completed", "tag": "27c9fe9c-e43f-4879-92c1-03edd95a45e5"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:33.151850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5c56cb7a-db2b-47ae-aa33-95353faaae9f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:33.167097 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5c56cb7a-db2b-47ae-aa33-95353faaae9f tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1265 microversion: 2.1 time: 0.217542 Jul 14 15:10:33.167807 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3096/6229] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:32 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:33.181369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7c02d82b-d370-4883-8dec-e726ebae36a9 req-47e8e2f8-3005-42d7-b401-0180d2d0268f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:33.181835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7c02d82b-d370-4883-8dec-e726ebae36a9 req-47e8e2f8-3005-42d7-b401-0180d2d0268f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:33.197098 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-7c02d82b-d370-4883-8dec-e726ebae36a9 req-47e8e2f8-3005-42d7-b401-0180d2d0268f service nova] Creating event network-vif-plugged:27c9fe9c-e43f-4879-92c1-03edd95a45e5 for instance ab371da2-5cbd-4ec5-b5e1-c016e221738b on n-h1-767704-28 Jul 14 15:10:33.202318 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-7c02d82b-d370-4883-8dec-e726ebae36a9 req-47e8e2f8-3005-42d7-b401-0180d2d0268f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063281 Jul 14 15:10:33.203220 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3134/6230] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:10:34.184706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4e18e911-a60e-4a61-9069-b1389bfc200b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:34.185367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4e18e911-a60e-4a61-9069-b1389bfc200b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:34.194093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e18e911-a60e-4a61-9069-b1389bfc200b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:34.194569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e18e911-a60e-4a61-9069-b1389bfc200b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:34.195665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e18e911-a60e-4a61-9069-b1389bfc200b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:34.196295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4e18e911-a60e-4a61-9069-b1389bfc200b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:34.337634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4e18e911-a60e-4a61-9069-b1389bfc200b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:34.345204 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4e18e911-a60e-4a61-9069-b1389bfc200b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1265 microversion: 2.1 time: 0.164598 Jul 14 15:10:34.345780 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3097/6231] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:34 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:35.377654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c651bef9-4406-4daf-819a-08bed965a4b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:35.379164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c651bef9-4406-4daf-819a-08bed965a4b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:35.387195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c651bef9-4406-4daf-819a-08bed965a4b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:35.387669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c651bef9-4406-4daf-819a-08bed965a4b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:35.388472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c651bef9-4406-4daf-819a-08bed965a4b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:35.389345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c651bef9-4406-4daf-819a-08bed965a4b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:35.548753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c651bef9-4406-4daf-819a-08bed965a4b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:35.559468 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c651bef9-4406-4daf-819a-08bed965a4b6 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1451 microversion: 2.1 time: 0.196748 Jul 14 15:10:35.560211 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3135/6232] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:35 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1451 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:35.581642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1529cb8e-08c9-41cd-8212-58b8e06e6ab4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:35.582493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1529cb8e-08c9-41cd-8212-58b8e06e6ab4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:35.590169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1529cb8e-08c9-41cd-8212-58b8e06e6ab4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:35.591268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1529cb8e-08c9-41cd-8212-58b8e06e6ab4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:35.591420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1529cb8e-08c9-41cd-8212-58b8e06e6ab4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:35.591958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1529cb8e-08c9-41cd-8212-58b8e06e6ab4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:35.743706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1529cb8e-08c9-41cd-8212-58b8e06e6ab4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:35.751357 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1529cb8e-08c9-41cd-8212-58b8e06e6ab4 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1451 microversion: 2.1 time: 0.174406 Jul 14 15:10:35.751959 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3098/6233] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:35 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:38.002921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-cbaea5cd-cefa-4406-aecc-f3de7d50b642 req-ed0aca6b-5130-4396-8477-7a9c7c084f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab371da2-5cbd-4ec5-b5e1-c016e221738b", "tag": "27c9fe9c-e43f-4879-92c1-03edd95a45e5"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:38.014349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-cbaea5cd-cefa-4406-aecc-f3de7d50b642 req-ed0aca6b-5130-4396-8477-7a9c7c084f52 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:38.014810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-cbaea5cd-cefa-4406-aecc-f3de7d50b642 req-ed0aca6b-5130-4396-8477-7a9c7c084f52 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:38.029271 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-cbaea5cd-cefa-4406-aecc-f3de7d50b642 req-ed0aca6b-5130-4396-8477-7a9c7c084f52 service nova] Creating event network-changed:27c9fe9c-e43f-4879-92c1-03edd95a45e5 for instance ab371da2-5cbd-4ec5-b5e1-c016e221738b on n-h1-767704-28 Jul 14 15:10:38.037328 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-cbaea5cd-cefa-4406-aecc-f3de7d50b642 req-ed0aca6b-5130-4396-8477-7a9c7c084f52 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037987 Jul 14 15:10:38.037965 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3136/6234] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:52.210471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2a95080a-aca5-405a-b1b4-28a26dc4c67d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:52.211540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2a95080a-aca5-405a-b1b4-28a26dc4c67d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:52.214102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=5 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:52.214978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=34 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:52.221123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a95080a-aca5-405a-b1b4-28a26dc4c67d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:52.221582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a95080a-aca5-405a-b1b4-28a26dc4c67d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:52.222371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a95080a-aca5-405a-b1b4-28a26dc4c67d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:52.222815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a95080a-aca5-405a-b1b4-28a26dc4c67d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:52.294017 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2a95080a-aca5-405a-b1b4-28a26dc4c67d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac/action" status: 200 len: 24493 microversion: 2.1 time: 0.088213 Jul 14 15:10:52.295697 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3099/6235] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:10:52 2022] POST /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac/action => generated 24493 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:11:03.511038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=9 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:03.512451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=26 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:03.517944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d390a3a7-da9f-43aa-ab2c-98751d8bfa47 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:03.518660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d390a3a7-da9f-43aa-ab2c-98751d8bfa47 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:03.526362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d390a3a7-da9f-43aa-ab2c-98751d8bfa47 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:03.526753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d390a3a7-da9f-43aa-ab2c-98751d8bfa47 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:03.527539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d390a3a7-da9f-43aa-ab2c-98751d8bfa47 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:03.527989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d390a3a7-da9f-43aa-ab2c-98751d8bfa47 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:03.778073 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d390a3a7-da9f-43aa-ab2c-98751d8bfa47 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1835 microversion: 2.1 time: 0.268927 Jul 14 15:11:03.778811 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3137/6236] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:03 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1835 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:11:03.798627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cd44a421-8dc4-4916-a821-af0d24b5d9fd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:03.799467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cd44a421-8dc4-4916-a821-af0d24b5d9fd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:03.803991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:03.804726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:03.811315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd44a421-8dc4-4916-a821-af0d24b5d9fd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:03.811788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd44a421-8dc4-4916-a821-af0d24b5d9fd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:03.812594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd44a421-8dc4-4916-a821-af0d24b5d9fd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:03.813074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd44a421-8dc4-4916-a821-af0d24b5d9fd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:03.963521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cd44a421-8dc4-4916-a821-af0d24b5d9fd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:03.971438 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cd44a421-8dc4-4916-a821-af0d24b5d9fd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1682 microversion: 2.1 time: 0.177778 Jul 14 15:11:03.972258 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3100/6237] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:03 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:11:04.067147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a92c04a2-29b1-4d69-966a-a304e51e1d80 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:04.068324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a92c04a2-29b1-4d69-966a-a304e51e1d80 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:04.075240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a92c04a2-29b1-4d69-966a-a304e51e1d80 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:04.075711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a92c04a2-29b1-4d69-966a-a304e51e1d80 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:04.076523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a92c04a2-29b1-4d69-966a-a304e51e1d80 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:04.077055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a92c04a2-29b1-4d69-966a-a304e51e1d80 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:04.132446 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a92c04a2-29b1-4d69-966a-a304e51e1d80 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac/action" status: 200 len: 32566 microversion: 2.1 time: 0.069397 Jul 14 15:11:04.133264 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3138/6238] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:11:04 2022] POST /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac/action => generated 32566 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:11:04.406054 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-017a0c36-edb1-4276-9486-269ba493def8 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:04.406525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-017a0c36-edb1-4276-9486-269ba493def8 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:04.414151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-017a0c36-edb1-4276-9486-269ba493def8 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:04.414600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-017a0c36-edb1-4276-9486-269ba493def8 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:04.415399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-017a0c36-edb1-4276-9486-269ba493def8 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:04.415835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-017a0c36-edb1-4276-9486-269ba493def8 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:04.459020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-017a0c36-edb1-4276-9486-269ba493def8 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4019e5ce460b4080bd8af36619f0a81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb002ba76849e5a6f070b2e307e3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:04.460157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-017a0c36-edb1-4276-9486-269ba493def8 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] flavor_id is None. Assuming migration. {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 14 15:11:04.460611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-017a0c36-edb1-4276-9486-269ba493def8 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:11:04.730398 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-017a0c36-edb1-4276-9486-269ba493def8 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.328166 Jul 14 15:11:04.731495 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3101/6239] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:11:04 2022] POST /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:11:04.740130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b792ee77-645e-4e0a-b08f-22140a3ec722 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:04.741761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b792ee77-645e-4e0a-b08f-22140a3ec722 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:04.753004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b792ee77-645e-4e0a-b08f-22140a3ec722 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:04.753004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b792ee77-645e-4e0a-b08f-22140a3ec722 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:04.753004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b792ee77-645e-4e0a-b08f-22140a3ec722 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:04.753730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b792ee77-645e-4e0a-b08f-22140a3ec722 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:04.950497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b792ee77-645e-4e0a-b08f-22140a3ec722 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:04.965430 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b792ee77-645e-4e0a-b08f-22140a3ec722 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1691 microversion: 2.1 time: 0.229016 Jul 14 15:11:04.966637 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3139/6240] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:04 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1691 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:05.987182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a6bf2887-780b-4f51-ab75-74d1369afab5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:05.987972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a6bf2887-780b-4f51-ab75-74d1369afab5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:05.996357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6bf2887-780b-4f51-ab75-74d1369afab5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:05.996811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6bf2887-780b-4f51-ab75-74d1369afab5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:05.997798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6bf2887-780b-4f51-ab75-74d1369afab5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:05.998240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6bf2887-780b-4f51-ab75-74d1369afab5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:06.138058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a6bf2887-780b-4f51-ab75-74d1369afab5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:06.145847 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a6bf2887-780b-4f51-ab75-74d1369afab5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1691 microversion: 2.1 time: 0.164788 Jul 14 15:11:06.146432 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3102/6241] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:05 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:07.164123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-33908652-31b4-4360-b1c6-13d858a06dd0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:07.164749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-33908652-31b4-4360-b1c6-13d858a06dd0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:07.173026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33908652-31b4-4360-b1c6-13d858a06dd0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:07.173493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33908652-31b4-4360-b1c6-13d858a06dd0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:07.174284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33908652-31b4-4360-b1c6-13d858a06dd0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:07.174733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33908652-31b4-4360-b1c6-13d858a06dd0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:07.330096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-33908652-31b4-4360-b1c6-13d858a06dd0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:07.341278 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-33908652-31b4-4360-b1c6-13d858a06dd0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1691 microversion: 2.1 time: 0.181829 Jul 14 15:11:07.341879 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3140/6242] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:07 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:11:08.359852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b18f20e3-3bde-449f-b74e-576a7b822e18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:08.360972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b18f20e3-3bde-449f-b74e-576a7b822e18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:08.368496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b18f20e3-3bde-449f-b74e-576a7b822e18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:08.368975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b18f20e3-3bde-449f-b74e-576a7b822e18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:08.369767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b18f20e3-3bde-449f-b74e-576a7b822e18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:08.370208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b18f20e3-3bde-449f-b74e-576a7b822e18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:08.505356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b18f20e3-3bde-449f-b74e-576a7b822e18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:08.514495 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b18f20e3-3bde-449f-b74e-576a7b822e18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.158555 Jul 14 15:11:08.515081 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3103/6243] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:08 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:09.531752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac028ad1-df95-4bfc-bf88-aeaec2a959d1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:09.532398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac028ad1-df95-4bfc-bf88-aeaec2a959d1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:09.539808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac028ad1-df95-4bfc-bf88-aeaec2a959d1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:09.540276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac028ad1-df95-4bfc-bf88-aeaec2a959d1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:09.541107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac028ad1-df95-4bfc-bf88-aeaec2a959d1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:09.541564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac028ad1-df95-4bfc-bf88-aeaec2a959d1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:09.684677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac028ad1-df95-4bfc-bf88-aeaec2a959d1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:09.692513 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac028ad1-df95-4bfc-bf88-aeaec2a959d1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.164631 Jul 14 15:11:09.693144 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3141/6244] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:09 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:10.711996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b139c021-dc3b-4fc0-bcc8-1fd32cef5978 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:10.712811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b139c021-dc3b-4fc0-bcc8-1fd32cef5978 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:10.721298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b139c021-dc3b-4fc0-bcc8-1fd32cef5978 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:10.721765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b139c021-dc3b-4fc0-bcc8-1fd32cef5978 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:10.722565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b139c021-dc3b-4fc0-bcc8-1fd32cef5978 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:10.723009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b139c021-dc3b-4fc0-bcc8-1fd32cef5978 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:10.868563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b139c021-dc3b-4fc0-bcc8-1fd32cef5978 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:10.876214 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b139c021-dc3b-4fc0-bcc8-1fd32cef5978 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.168955 Jul 14 15:11:10.876793 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3104/6245] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:10 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:11.895842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0d7e2b48-f025-40d4-962f-c5b851ad2b7a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:11.897220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0d7e2b48-f025-40d4-962f-c5b851ad2b7a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:11.904727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d7e2b48-f025-40d4-962f-c5b851ad2b7a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:11.905220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d7e2b48-f025-40d4-962f-c5b851ad2b7a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:11.906066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d7e2b48-f025-40d4-962f-c5b851ad2b7a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:11.906902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d7e2b48-f025-40d4-962f-c5b851ad2b7a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:12.053556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d7e2b48-f025-40d4-962f-c5b851ad2b7a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:12.061256 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0d7e2b48-f025-40d4-962f-c5b851ad2b7a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.169947 Jul 14 15:11:12.061842 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3142/6246] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:11 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:13.080852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2828f98f-f3b1-49fb-9139-98f899f6b670 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:13.081567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2828f98f-f3b1-49fb-9139-98f899f6b670 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:13.088819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2828f98f-f3b1-49fb-9139-98f899f6b670 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:13.089320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2828f98f-f3b1-49fb-9139-98f899f6b670 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:13.090099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2828f98f-f3b1-49fb-9139-98f899f6b670 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:13.090538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2828f98f-f3b1-49fb-9139-98f899f6b670 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:13.236687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2828f98f-f3b1-49fb-9139-98f899f6b670 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:13.246331 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2828f98f-f3b1-49fb-9139-98f899f6b670 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.169513 Jul 14 15:11:13.246996 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3105/6247] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:13 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:14.264872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4d53d786-abe6-448b-a722-cb8a1de36388 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:14.265790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4d53d786-abe6-448b-a722-cb8a1de36388 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:14.274159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d53d786-abe6-448b-a722-cb8a1de36388 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:14.274670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d53d786-abe6-448b-a722-cb8a1de36388 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:14.275499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d53d786-abe6-448b-a722-cb8a1de36388 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:14.276034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d53d786-abe6-448b-a722-cb8a1de36388 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:14.437865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4d53d786-abe6-448b-a722-cb8a1de36388 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:14.448000 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4d53d786-abe6-448b-a722-cb8a1de36388 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.187298 Jul 14 15:11:14.448589 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3143/6248] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:14 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:15.465642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6a0532ff-b55f-41ac-99fc-cbf0e1693f86 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:15.466360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6a0532ff-b55f-41ac-99fc-cbf0e1693f86 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:15.474120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a0532ff-b55f-41ac-99fc-cbf0e1693f86 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:15.474580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a0532ff-b55f-41ac-99fc-cbf0e1693f86 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:15.475872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a0532ff-b55f-41ac-99fc-cbf0e1693f86 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:15.476351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a0532ff-b55f-41ac-99fc-cbf0e1693f86 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:15.639111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6a0532ff-b55f-41ac-99fc-cbf0e1693f86 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:15.654927 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6a0532ff-b55f-41ac-99fc-cbf0e1693f86 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.192757 Jul 14 15:11:15.656032 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3106/6249] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:15 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:16.673204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b42ece2f-b607-4bb7-8edb-4320596a5cb4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:16.673852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b42ece2f-b607-4bb7-8edb-4320596a5cb4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:16.681779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b42ece2f-b607-4bb7-8edb-4320596a5cb4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:16.682404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b42ece2f-b607-4bb7-8edb-4320596a5cb4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:16.683450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b42ece2f-b607-4bb7-8edb-4320596a5cb4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:16.684168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b42ece2f-b607-4bb7-8edb-4320596a5cb4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:16.848480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b42ece2f-b607-4bb7-8edb-4320596a5cb4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:16.857129 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b42ece2f-b607-4bb7-8edb-4320596a5cb4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.187916 Jul 14 15:11:16.857798 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3144/6250] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:16 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:17.877503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c39a3fd4-ff29-47f1-bb23-ffadc05e6800 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:17.878414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c39a3fd4-ff29-47f1-bb23-ffadc05e6800 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:17.886561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c39a3fd4-ff29-47f1-bb23-ffadc05e6800 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:17.887025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c39a3fd4-ff29-47f1-bb23-ffadc05e6800 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:17.887809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c39a3fd4-ff29-47f1-bb23-ffadc05e6800 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:17.888267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c39a3fd4-ff29-47f1-bb23-ffadc05e6800 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:18.056743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c39a3fd4-ff29-47f1-bb23-ffadc05e6800 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:18.064576 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c39a3fd4-ff29-47f1-bb23-ffadc05e6800 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.190963 Jul 14 15:11:18.065207 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3107/6251] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:17 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:19.082807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd620db1-80e9-4939-a0fa-5d4c74057d05 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:19.083477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cd620db1-80e9-4939-a0fa-5d4c74057d05 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:19.091589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd620db1-80e9-4939-a0fa-5d4c74057d05 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:19.092102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd620db1-80e9-4939-a0fa-5d4c74057d05 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:19.092924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd620db1-80e9-4939-a0fa-5d4c74057d05 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:19.093413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd620db1-80e9-4939-a0fa-5d4c74057d05 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:19.355789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cd620db1-80e9-4939-a0fa-5d4c74057d05 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:19.355789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cd620db1-80e9-4939-a0fa-5d4c74057d05 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.202698 Jul 14 15:11:19.355789 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3145/6252] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:19 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:20.307312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-001833b2-476f-47f8-b041-f19aa12bd9ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:20.307965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-001833b2-476f-47f8-b041-f19aa12bd9ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:20.315477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-001833b2-476f-47f8-b041-f19aa12bd9ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:20.315939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-001833b2-476f-47f8-b041-f19aa12bd9ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:20.316726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-001833b2-476f-47f8-b041-f19aa12bd9ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:20.317201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-001833b2-476f-47f8-b041-f19aa12bd9ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:20.478820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-001833b2-476f-47f8-b041-f19aa12bd9ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:20.488099 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-001833b2-476f-47f8-b041-f19aa12bd9ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.185298 Jul 14 15:11:20.488713 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3108/6253] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:20 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:11:21.508688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b578308f-e81f-42a4-8e80-4d22f9c51f69 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:21.509483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b578308f-e81f-42a4-8e80-4d22f9c51f69 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:21.517961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b578308f-e81f-42a4-8e80-4d22f9c51f69 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:21.518210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b578308f-e81f-42a4-8e80-4d22f9c51f69 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:21.519417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b578308f-e81f-42a4-8e80-4d22f9c51f69 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:21.520107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b578308f-e81f-42a4-8e80-4d22f9c51f69 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:21.701680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b578308f-e81f-42a4-8e80-4d22f9c51f69 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:21.720408 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b578308f-e81f-42a4-8e80-4d22f9c51f69 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.217208 Jul 14 15:11:21.723522 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3146/6254] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:21 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:22.741087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fb7be046-c755-40fa-83fe-d992af9aaf26 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:22.742558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fb7be046-c755-40fa-83fe-d992af9aaf26 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:22.752684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb7be046-c755-40fa-83fe-d992af9aaf26 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:22.753820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb7be046-c755-40fa-83fe-d992af9aaf26 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:22.754859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb7be046-c755-40fa-83fe-d992af9aaf26 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:22.755584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb7be046-c755-40fa-83fe-d992af9aaf26 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:22.985370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fb7be046-c755-40fa-83fe-d992af9aaf26 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:22.994865 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fb7be046-c755-40fa-83fe-d992af9aaf26 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.259985 Jul 14 15:11:22.995474 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3109/6255] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:22 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:11:24.017036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-94760084-b89d-4607-83b0-39a8e8d3a86f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:24.018249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-94760084-b89d-4607-83b0-39a8e8d3a86f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:24.026992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94760084-b89d-4607-83b0-39a8e8d3a86f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:24.027469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94760084-b89d-4607-83b0-39a8e8d3a86f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:24.028480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94760084-b89d-4607-83b0-39a8e8d3a86f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:24.028983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94760084-b89d-4607-83b0-39a8e8d3a86f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:24.201542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-94760084-b89d-4607-83b0-39a8e8d3a86f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:24.210823 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-94760084-b89d-4607-83b0-39a8e8d3a86f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1696 microversion: 2.1 time: 0.199051 Jul 14 15:11:24.216222 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3147/6256] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:24 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1696 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:25.235864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ad88f5c6-1104-4db1-87f9-fff58f8ef3ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:25.236435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ad88f5c6-1104-4db1-87f9-fff58f8ef3ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:25.243914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad88f5c6-1104-4db1-87f9-fff58f8ef3ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:25.244692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad88f5c6-1104-4db1-87f9-fff58f8ef3ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:25.245606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad88f5c6-1104-4db1-87f9-fff58f8ef3ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:25.245992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad88f5c6-1104-4db1-87f9-fff58f8ef3ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:25.499281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ad88f5c6-1104-4db1-87f9-fff58f8ef3ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:25.512429 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ad88f5c6-1104-4db1-87f9-fff58f8ef3ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1695 microversion: 2.1 time: 0.280796 Jul 14 15:11:25.525773 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3110/6257] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:25 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1695 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:25.628215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0f65ea50-914f-43a3-bd0d-f139d1c0ceee req-b0cdaa69-577b-49e2-940d-30ba182b3aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac", "name": "network-vif-unplugged", "status": "completed", "tag": "4876d271-04d5-44b9-8fbc-4dd20e8a48d3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:25.640078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0f65ea50-914f-43a3-bd0d-f139d1c0ceee req-b0cdaa69-577b-49e2-940d-30ba182b3aad service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:25.640555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0f65ea50-914f-43a3-bd0d-f139d1c0ceee req-b0cdaa69-577b-49e2-940d-30ba182b3aad service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:25.676934 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0f65ea50-914f-43a3-bd0d-f139d1c0ceee req-b0cdaa69-577b-49e2-940d-30ba182b3aad service nova] Creating event network-vif-unplugged:4876d271-04d5-44b9-8fbc-4dd20e8a48d3 for instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac on n-h1-767704-28 Jul 14 15:11:25.685762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-0f65ea50-914f-43a3-bd0d-f139d1c0ceee req-b0cdaa69-577b-49e2-940d-30ba182b3aad service nova] Instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:11:25.710987 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0f65ea50-914f-43a3-bd0d-f139d1c0ceee req-b0cdaa69-577b-49e2-940d-30ba182b3aad service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086603 Jul 14 15:11:25.712006 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3148/6258] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:26.535092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-196aa0f2-37d2-47de-8791-28c97170a135 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:26.535750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-196aa0f2-37d2-47de-8791-28c97170a135 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:26.544678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-196aa0f2-37d2-47de-8791-28c97170a135 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:26.545211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-196aa0f2-37d2-47de-8791-28c97170a135 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:26.546095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-196aa0f2-37d2-47de-8791-28c97170a135 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:26.546406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-196aa0f2-37d2-47de-8791-28c97170a135 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:26.806335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-196aa0f2-37d2-47de-8791-28c97170a135 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:26.816721 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-196aa0f2-37d2-47de-8791-28c97170a135 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1695 microversion: 2.1 time: 0.285972 Jul 14 15:11:26.817375 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3111/6259] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:26 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1695 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:27.753032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b6766897-87ca-46a1-bdee-3af65cf95e5c req-a29a375a-4bcb-4277-8bd5-99a22b593812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac", "tag": "4876d271-04d5-44b9-8fbc-4dd20e8a48d3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:27.762910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b6766897-87ca-46a1-bdee-3af65cf95e5c req-a29a375a-4bcb-4277-8bd5-99a22b593812 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:27.763455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b6766897-87ca-46a1-bdee-3af65cf95e5c req-a29a375a-4bcb-4277-8bd5-99a22b593812 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:27.777634 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b6766897-87ca-46a1-bdee-3af65cf95e5c req-a29a375a-4bcb-4277-8bd5-99a22b593812 service nova] Creating event network-changed:4876d271-04d5-44b9-8fbc-4dd20e8a48d3 for instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac on n-h1-767704-28 Jul 14 15:11:27.783783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-b6766897-87ca-46a1-bdee-3af65cf95e5c req-a29a375a-4bcb-4277-8bd5-99a22b593812 service nova] Instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:11:27.797238 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b6766897-87ca-46a1-bdee-3af65cf95e5c req-a29a375a-4bcb-4277-8bd5-99a22b593812 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050558 Jul 14 15:11:27.797868 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3149/6260] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:27.835902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-11cb6115-154e-4879-96dd-a1ec7d6c0c98 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:27.836782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-11cb6115-154e-4879-96dd-a1ec7d6c0c98 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:27.844157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11cb6115-154e-4879-96dd-a1ec7d6c0c98 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:27.845165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11cb6115-154e-4879-96dd-a1ec7d6c0c98 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:27.846223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11cb6115-154e-4879-96dd-a1ec7d6c0c98 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:27.846783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11cb6115-154e-4879-96dd-a1ec7d6c0c98 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:28.415505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-11cb6115-154e-4879-96dd-a1ec7d6c0c98 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:28.424054 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-11cb6115-154e-4879-96dd-a1ec7d6c0c98 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1693 microversion: 2.1 time: 0.592809 Jul 14 15:11:28.425192 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3112/6261] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:27 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1693 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:29.443669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d54670c4-fc0a-494a-a3c5-2428761e22d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:29.444514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d54670c4-fc0a-494a-a3c5-2428761e22d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:29.455269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d54670c4-fc0a-494a-a3c5-2428761e22d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:29.455993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d54670c4-fc0a-494a-a3c5-2428761e22d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:29.457280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d54670c4-fc0a-494a-a3c5-2428761e22d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:29.458014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d54670c4-fc0a-494a-a3c5-2428761e22d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:29.728698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d54670c4-fc0a-494a-a3c5-2428761e22d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:29.737376 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d54670c4-fc0a-494a-a3c5-2428761e22d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1690 microversion: 2.1 time: 0.297979 Jul 14 15:11:29.738009 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3150/6262] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:29 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1690 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:29.757270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aed11af6-9f67-4a21-9f2b-09ebd9eaa202 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:29.757879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aed11af6-9f67-4a21-9f2b-09ebd9eaa202 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:29.765421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aed11af6-9f67-4a21-9f2b-09ebd9eaa202 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:29.765881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aed11af6-9f67-4a21-9f2b-09ebd9eaa202 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:29.766673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aed11af6-9f67-4a21-9f2b-09ebd9eaa202 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:29.767119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aed11af6-9f67-4a21-9f2b-09ebd9eaa202 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:29.829241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:29.843932 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aed11af6-9f67-4a21-9f2b-09ebd9eaa202 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac/action" status: 204 len: 0 microversion: 2.1 time: 0.092054 Jul 14 15:11:29.844834 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3113/6263] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:11:29 2022] POST /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac/action => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:11:29.855942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-92159ada-3201-432c-beef-4a3a775d2c74 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:29.857526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-92159ada-3201-432c-beef-4a3a775d2c74 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:29.868611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92159ada-3201-432c-beef-4a3a775d2c74 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:29.869622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92159ada-3201-432c-beef-4a3a775d2c74 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:29.870538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92159ada-3201-432c-beef-4a3a775d2c74 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:29.871011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92159ada-3201-432c-beef-4a3a775d2c74 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:30.136457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-92159ada-3201-432c-beef-4a3a775d2c74 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:30.148421 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-92159ada-3201-432c-beef-4a3a775d2c74 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1690 microversion: 2.1 time: 0.298605 Jul 14 15:11:30.160616 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3151/6264] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:29 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1690 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:31.174345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3e6ec88a-0ac7-4ad6-9114-a660cf9efe54 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:31.183196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3e6ec88a-0ac7-4ad6-9114-a660cf9efe54 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:31.195849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3e6ec88a-0ac7-4ad6-9114-a660cf9efe54 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:31.196966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3e6ec88a-0ac7-4ad6-9114-a660cf9efe54 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:31.198049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3e6ec88a-0ac7-4ad6-9114-a660cf9efe54 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:31.198676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3e6ec88a-0ac7-4ad6-9114-a660cf9efe54 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:31.370837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e475de49-73d0-4fb1-a0b3-1e0c08011780 req-c1adebd1-2731-46d8-a822-68b347594626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac", "name": "network-vif-plugged", "status": "completed", "tag": "4876d271-04d5-44b9-8fbc-4dd20e8a48d3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:31.394427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e475de49-73d0-4fb1-a0b3-1e0c08011780 req-c1adebd1-2731-46d8-a822-68b347594626 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:31.394913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e475de49-73d0-4fb1-a0b3-1e0c08011780 req-c1adebd1-2731-46d8-a822-68b347594626 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:31.416020 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e475de49-73d0-4fb1-a0b3-1e0c08011780 req-c1adebd1-2731-46d8-a822-68b347594626 service nova] Creating event network-vif-plugged:4876d271-04d5-44b9-8fbc-4dd20e8a48d3 for instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac on n-h1-767704-28 Jul 14 15:11:31.427752 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e475de49-73d0-4fb1-a0b3-1e0c08011780 req-c1adebd1-2731-46d8-a822-68b347594626 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064307 Jul 14 15:11:31.429135 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3152/6265] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:31.439132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3e6ec88a-0ac7-4ad6-9114-a660cf9efe54 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:31.453634 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3e6ec88a-0ac7-4ad6-9114-a660cf9efe54 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1690 microversion: 2.1 time: 0.288867 Jul 14 15:11:31.454330 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3114/6266] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:31 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1690 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:32.473383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-546a9513-9d10-42c3-94e4-d9493f4016da tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:32.474649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-546a9513-9d10-42c3-94e4-d9493f4016da tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:32.482523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-546a9513-9d10-42c3-94e4-d9493f4016da tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:32.483001 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-546a9513-9d10-42c3-94e4-d9493f4016da tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:32.483811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-546a9513-9d10-42c3-94e4-d9493f4016da tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:32.484281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-546a9513-9d10-42c3-94e4-d9493f4016da tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:32.641219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-546a9513-9d10-42c3-94e4-d9493f4016da tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:32.650089 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-546a9513-9d10-42c3-94e4-d9493f4016da tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1682 microversion: 2.1 time: 0.182074 Jul 14 15:11:32.650719 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3153/6267] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:32 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:56.881392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2f684a2a-5d31-4236-88ac-73a9552ad6aa tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:56.882411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2f684a2a-5d31-4236-88ac-73a9552ad6aa tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:56.884676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=32 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:56.885438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:56.892079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f684a2a-5d31-4236-88ac-73a9552ad6aa tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:56.892542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f684a2a-5d31-4236-88ac-73a9552ad6aa tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:56.893353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f684a2a-5d31-4236-88ac-73a9552ad6aa tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:56.893793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f684a2a-5d31-4236-88ac-73a9552ad6aa tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:56.968267 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2f684a2a-5d31-4236-88ac-73a9552ad6aa tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac/action" status: 200 len: 24563 microversion: 2.1 time: 0.091486 Jul 14 15:11:56.968938 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3115/6268] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:11:56 2022] POST /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac/action => generated 24563 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:12:03.355754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f65932a1-efae-409d-9813-a0d5b07dbf8a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:03.356404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f65932a1-efae-409d-9813-a0d5b07dbf8a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:03.358849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=34 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:03.359519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=92 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:03.365636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f65932a1-efae-409d-9813-a0d5b07dbf8a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:03.366106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f65932a1-efae-409d-9813-a0d5b07dbf8a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:03.366891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f65932a1-efae-409d-9813-a0d5b07dbf8a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:03.367345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f65932a1-efae-409d-9813-a0d5b07dbf8a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:03.526483 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f65932a1-efae-409d-9813-a0d5b07dbf8a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1835 microversion: 2.1 time: 0.174553 Jul 14 15:12:03.527375 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3154/6269] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:03 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1835 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:04.466027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2617b7d0-46bc-4703-8892-9162863f8334 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:04.467248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2617b7d0-46bc-4703-8892-9162863f8334 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:04.476119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2617b7d0-46bc-4703-8892-9162863f8334 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:04.476788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2617b7d0-46bc-4703-8892-9162863f8334 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:04.477802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2617b7d0-46bc-4703-8892-9162863f8334 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:04.478251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2617b7d0-46bc-4703-8892-9162863f8334 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:04.482109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-8de06457-d206-4f25-ad0e-d98f916a23b8 req-03e96eb4-226b-48f6-815e-ab4f944f038b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac", "tag": "4876d271-04d5-44b9-8fbc-4dd20e8a48d3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:04.503077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8de06457-d206-4f25-ad0e-d98f916a23b8 req-03e96eb4-226b-48f6-815e-ab4f944f038b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:04.503657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8de06457-d206-4f25-ad0e-d98f916a23b8 req-03e96eb4-226b-48f6-815e-ab4f944f038b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:04.510513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2617b7d0-46bc-4703-8892-9162863f8334 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:12:04.522548 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-8de06457-d206-4f25-ad0e-d98f916a23b8 req-03e96eb4-226b-48f6-815e-ab4f944f038b service nova] Creating event network-changed:4876d271-04d5-44b9-8fbc-4dd20e8a48d3 for instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac on n-h1-767704-28 Jul 14 15:12:04.531780 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-8de06457-d206-4f25-ad0e-d98f916a23b8 req-03e96eb4-226b-48f6-815e-ab4f944f038b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053607 Jul 14 15:12:04.537548 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3155/6270] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:04.610311 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2617b7d0-46bc-4703-8892-9162863f8334 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 204 len: 0 microversion: 2.1 time: 0.148300 Jul 14 15:12:04.611666 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3116/6271] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:12:04 2022] DELETE /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:12:04.622180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0270ecc3-d384-4722-a79b-11c44d6660ae tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:04.623372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0270ecc3-d384-4722-a79b-11c44d6660ae tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:04.633706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0270ecc3-d384-4722-a79b-11c44d6660ae tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:04.634461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0270ecc3-d384-4722-a79b-11c44d6660ae tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:04.635827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0270ecc3-d384-4722-a79b-11c44d6660ae tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:04.636577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0270ecc3-d384-4722-a79b-11c44d6660ae tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:04.796793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0270ecc3-d384-4722-a79b-11c44d6660ae tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:04.807100 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0270ecc3-d384-4722-a79b-11c44d6660ae tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1688 microversion: 2.1 time: 0.190322 Jul 14 15:12:04.807997 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3156/6272] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:04 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:05.825837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af75d43a-73f1-4655-9c21-1e4d47d8897f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:05.826493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-af75d43a-73f1-4655-9c21-1e4d47d8897f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:05.833931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af75d43a-73f1-4655-9c21-1e4d47d8897f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:05.834399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af75d43a-73f1-4655-9c21-1e4d47d8897f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:05.835221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af75d43a-73f1-4655-9c21-1e4d47d8897f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:05.835671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af75d43a-73f1-4655-9c21-1e4d47d8897f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:06.064764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-af75d43a-73f1-4655-9c21-1e4d47d8897f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:06.072768 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-af75d43a-73f1-4655-9c21-1e4d47d8897f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1688 microversion: 2.1 time: 0.251299 Jul 14 15:12:06.073398 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3117/6273] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:05 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1688 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:07.017211 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f9e81ee0-e7ea-453a-b752-0de4d5889ec6 req-240832df-c43b-4353-8b2d-36a0ce0be19a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac", "name": "network-vif-deleted", "tag": "4876d271-04d5-44b9-8fbc-4dd20e8a48d3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:07.030311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f9e81ee0-e7ea-453a-b752-0de4d5889ec6 req-240832df-c43b-4353-8b2d-36a0ce0be19a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:07.030816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f9e81ee0-e7ea-453a-b752-0de4d5889ec6 req-240832df-c43b-4353-8b2d-36a0ce0be19a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:07.047511 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f9e81ee0-e7ea-453a-b752-0de4d5889ec6 req-240832df-c43b-4353-8b2d-36a0ce0be19a service nova] Creating event network-vif-deleted:4876d271-04d5-44b9-8fbc-4dd20e8a48d3 for instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac on n-h1-767704-28 Jul 14 15:12:07.053645 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f9e81ee0-e7ea-453a-b752-0de4d5889ec6 req-240832df-c43b-4353-8b2d-36a0ce0be19a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040424 Jul 14 15:12:07.054403 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3157/6274] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:07.091749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f12fabcf-eefa-4825-8fd0-69c0527de54e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:07.093201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f12fabcf-eefa-4825-8fd0-69c0527de54e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:07.109690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f12fabcf-eefa-4825-8fd0-69c0527de54e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:07.112383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f12fabcf-eefa-4825-8fd0-69c0527de54e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:07.114326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f12fabcf-eefa-4825-8fd0-69c0527de54e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:07.115128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f12fabcf-eefa-4825-8fd0-69c0527de54e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:07.191100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f12fabcf-eefa-4825-8fd0-69c0527de54e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:07.201128 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f12fabcf-eefa-4825-8fd0-69c0527de54e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 200 len: 1350 microversion: 2.1 time: 0.113763 Jul 14 15:12:07.202105 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3118/6275] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:07 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 1350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:08.220796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-63b991ad-c8a3-45f5-878e-3cff4504bad5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:08.221548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-63b991ad-c8a3-45f5-878e-3cff4504bad5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:08.230517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63b991ad-c8a3-45f5-878e-3cff4504bad5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:08.230993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63b991ad-c8a3-45f5-878e-3cff4504bad5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:08.231800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63b991ad-c8a3-45f5-878e-3cff4504bad5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:08.232261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63b991ad-c8a3-45f5-878e-3cff4504bad5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:08.246804 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-63b991ad-c8a3-45f5-878e-3cff4504bad5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] HTTP exception thrown: Instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac could not be found. Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-63b991ad-c8a3-45f5-878e-3cff4504bad5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Request method failure captured: Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac HTTP/1.1 Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DHFbUVubDuVF53yv_hAYoRSg03MNLuaI6bcv8WHLK023TaoiaaNU4yFpijpq2LrcAAQelnsE31SulB5eXwDSO_UCvUxMum-xZRFYpLdlCTFeCSgR_tLStNg3XZcIgUo7xuqh7ojaAOn_gWBQ2r_asoQUBer3Pl4ERYsBV9nV3cW5m0 Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 24625820309f4411bb0b517b6ebb6583 Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-752443759 Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24625820309f4411bb0b517b6ebb6583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24625820309f4411bb0b517b6ebb6583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24625820309f4411bb0b517b6ebb6583", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24625820309f4411bb0b517b6ebb6583"}]}] Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestNetworkAdvancedServerOps-752443759 Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 24625820309f4411bb0b517b6ebb6583 Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-752443759 Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestNetworkAdvancedServerOps-752443759-project Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 2c0f965a2f344bd69b0fc157fe02ffda Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestNetworkAdvancedServerOps-752443759-project Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac could not be found. Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac'} Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac could not be found. Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac could not be found. Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:12:08.248527 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:12:08.254112 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:08.254112 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:12:08.254112 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:12:08.254112 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:12:08.254112 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:12:08.254112 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac could not be found. Jul 14 15:12:08.254112 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:12:08.254112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-63b991ad-c8a3-45f5-878e-3cff4504bad5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Returning 404 to user: Instance 8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:12:08.254112 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-63b991ad-c8a3-45f5-878e-3cff4504bad5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac" status: 404 len: 111 microversion: 2.1 time: 0.033854 Jul 14 15:12:08.254112 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3158/6276] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:08 2022] GET /compute/v2.1/servers/8a5917ce-9a34-438f-a8bd-b1ad9ca6e4ac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:12:11.909206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cb3cbc30-b0b6-470c-8315-c7ccdb21f63f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '.version_select at 0x7fd6c57831f0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:11.932288 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cb3cbc30-b0b6-470c-8315-c7ccdb21f63f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2138864020" status: 202 len: 0 microversion: 2.1 time: 0.035618 Jul 14 15:12:11.933532 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3119/6277] 10.222.0.81 () {58 vars in 1283 bytes} [Thu Jul 14 15:12:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2138864020 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:12:11.967105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-326877e7-072a-476c-b1ff-083e7f7d2cd6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'create', calling method: .version_select at 0x7fd6c5aa89d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-826565196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU/cfHDOBcZRiLYyUVduzqmqsx0yZs8mhs5QspE2BTvRJbP3yunpMKh87Hq5O8NlCUJx5J7dS/2zv2yQhoHXCnQiCCduwFnb1RJsZl/wETbZOxI+4REru/klCodFledBA=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:11.988982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-326877e7-072a-476c-b1ff-083e7f7d2cd6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for project 24625820309f4411bb0b517b6ebb6583. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:12:11.996390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-326877e7-072a-476c-b1ff-083e7f7d2cd6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for user 2c0f965a2f344bd69b0fc157fe02ffda and project 24625820309f4411bb0b517b6ebb6583. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:12:12.028159 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-326877e7-072a-476c-b1ff-083e7f7d2cd6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.065375 Jul 14 15:12:12.028878 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3159/6278] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:12:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:19.009530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1388245478", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "c7dcff04-3058-4eb0-91e1-0017adbcf498"}], "key_name": "tempest-TestNetworkAdvancedServerOps-826565196", "security_groups": [{"name": "tempest-secgroup-smoke-331938832"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:19.031884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:19.175837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] validate_networks() for [('c7dcff04-3058-4eb0-91e1-0017adbcf498', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:12:19.913903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:12:19.914342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:12:19.914824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:12:19.915240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:12:19.915713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:12:19.927074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:19.927814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:19.928854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:19.929496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:19.978518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for project 24625820309f4411bb0b517b6ebb6583. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:12:19.985639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for user 2c0f965a2f344bd69b0fc157fe02ffda and project 24625820309f4411bb0b517b6ebb6583. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:12:20.004829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:12:20.007692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:12:20.077209 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-203f0b51-16b8-4cca-8b7d-8c1a0768b4ce tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.075079 Jul 14 15:12:20.083157 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3120/6279] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:12:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:12:20.087869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=18 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:20.092436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-38f62f35-d0bd-4751-8418-99847f474480 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:20.093173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-38f62f35-d0bd-4751-8418-99847f474480 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:20.174376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-38f62f35-d0bd-4751-8418-99847f474480 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:20.185122 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-38f62f35-d0bd-4751-8418-99847f474480 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1266 microversion: 2.1 time: 0.098508 Jul 14 15:12:20.186431 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3160/6280] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:20 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:21.206248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ea30957-0f29-47b9-8744-99c2aa2b90c6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:21.207730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ea30957-0f29-47b9-8744-99c2aa2b90c6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:21.217850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ea30957-0f29-47b9-8744-99c2aa2b90c6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:21.218309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ea30957-0f29-47b9-8744-99c2aa2b90c6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:21.219105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ea30957-0f29-47b9-8744-99c2aa2b90c6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:21.219547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ea30957-0f29-47b9-8744-99c2aa2b90c6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:21.393904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ea30957-0f29-47b9-8744-99c2aa2b90c6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:21.405463 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ea30957-0f29-47b9-8744-99c2aa2b90c6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1318 microversion: 2.1 time: 0.204224 Jul 14 15:12:21.410724 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3121/6281] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:21 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:22.428086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c47e8f31-100e-49f8-b73c-642f3e325387 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:22.428777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c47e8f31-100e-49f8-b73c-642f3e325387 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:22.444724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c47e8f31-100e-49f8-b73c-642f3e325387 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:22.445431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c47e8f31-100e-49f8-b73c-642f3e325387 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:22.446355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c47e8f31-100e-49f8-b73c-642f3e325387 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:22.446920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c47e8f31-100e-49f8-b73c-642f3e325387 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:22.585165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c47e8f31-100e-49f8-b73c-642f3e325387 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:22.598332 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c47e8f31-100e-49f8-b73c-642f3e325387 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1324 microversion: 2.1 time: 0.174335 Jul 14 15:12:22.599423 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3161/6282] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:22 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1324 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:23.624453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-338c9f64-c709-4f22-837d-97dea551e020 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:23.625436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-338c9f64-c709-4f22-837d-97dea551e020 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:23.667461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-338c9f64-c709-4f22-837d-97dea551e020 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:23.668500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-338c9f64-c709-4f22-837d-97dea551e020 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:23.672185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-338c9f64-c709-4f22-837d-97dea551e020 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:23.673019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-338c9f64-c709-4f22-837d-97dea551e020 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:24.008753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-338c9f64-c709-4f22-837d-97dea551e020 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:24.023068 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-338c9f64-c709-4f22-837d-97dea551e020 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1391 microversion: 2.1 time: 0.407834 Jul 14 15:12:24.036172 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3122/6283] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:23 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1391 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:24.332300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-bc97fe7d-3d7f-4775-927a-b2b42d88f990 req-2795a4e0-c180-43fd-88fe-3577392a9f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e8e1f8-a400-4d55-afd6-32d97f8e10de", "tag": "b1f2ab2e-6755-4360-a82b-094874ac71c4"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:24.367602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bc97fe7d-3d7f-4775-927a-b2b42d88f990 req-2795a4e0-c180-43fd-88fe-3577392a9f90 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:24.367984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bc97fe7d-3d7f-4775-927a-b2b42d88f990 req-2795a4e0-c180-43fd-88fe-3577392a9f90 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:24.385285 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-bc97fe7d-3d7f-4775-927a-b2b42d88f990 req-2795a4e0-c180-43fd-88fe-3577392a9f90 service nova] Creating event network-changed:b1f2ab2e-6755-4360-a82b-094874ac71c4 for instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de on n-h2-767704-28 Jul 14 15:12:24.392248 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-bc97fe7d-3d7f-4775-927a-b2b42d88f990 req-2795a4e0-c180-43fd-88fe-3577392a9f90 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067240 Jul 14 15:12:24.393481 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3162/6284] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:25.043357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-238c20db-53dd-429e-a4bb-d50f3913b89a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:25.044839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-238c20db-53dd-429e-a4bb-d50f3913b89a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:25.053905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-238c20db-53dd-429e-a4bb-d50f3913b89a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:25.054699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-238c20db-53dd-429e-a4bb-d50f3913b89a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:25.055895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-238c20db-53dd-429e-a4bb-d50f3913b89a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:25.056703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-238c20db-53dd-429e-a4bb-d50f3913b89a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:25.215368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-238c20db-53dd-429e-a4bb-d50f3913b89a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:25.223755 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-238c20db-53dd-429e-a4bb-d50f3913b89a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1391 microversion: 2.1 time: 0.185274 Jul 14 15:12:25.224351 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3123/6285] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:25 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:26.244374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5135bbf4-af35-467e-a7f2-d8de00bc27c4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:26.245213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5135bbf4-af35-467e-a7f2-d8de00bc27c4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:26.254611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5135bbf4-af35-467e-a7f2-d8de00bc27c4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:26.255093 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5135bbf4-af35-467e-a7f2-d8de00bc27c4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:26.255917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5135bbf4-af35-467e-a7f2-d8de00bc27c4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:26.256458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5135bbf4-af35-467e-a7f2-d8de00bc27c4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:26.507043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5135bbf4-af35-467e-a7f2-d8de00bc27c4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:26.516301 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5135bbf4-af35-467e-a7f2-d8de00bc27c4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1391 microversion: 2.1 time: 0.278489 Jul 14 15:12:26.516994 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3163/6286] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:26 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1391 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:27.538331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-959dedc9-e60c-4525-8b0e-2d47a1f8b53a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:27.539039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-959dedc9-e60c-4525-8b0e-2d47a1f8b53a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:27.545159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:27.548627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-959dedc9-e60c-4525-8b0e-2d47a1f8b53a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:27.549386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-959dedc9-e60c-4525-8b0e-2d47a1f8b53a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:27.551380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-959dedc9-e60c-4525-8b0e-2d47a1f8b53a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:27.551965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-959dedc9-e60c-4525-8b0e-2d47a1f8b53a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:27.749749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-959dedc9-e60c-4525-8b0e-2d47a1f8b53a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:27.761665 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-959dedc9-e60c-4525-8b0e-2d47a1f8b53a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1391 microversion: 2.1 time: 0.227571 Jul 14 15:12:27.772095 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3124/6287] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:27 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:28.780698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ef236f6-4830-4d5e-b428-c0ce322fd2ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:28.786348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ef236f6-4830-4d5e-b428-c0ce322fd2ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:28.797441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ef236f6-4830-4d5e-b428-c0ce322fd2ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:28.797912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ef236f6-4830-4d5e-b428-c0ce322fd2ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:28.798715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ef236f6-4830-4d5e-b428-c0ce322fd2ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:28.799279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ef236f6-4830-4d5e-b428-c0ce322fd2ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:28.985935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ef236f6-4830-4d5e-b428-c0ce322fd2ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:28.997385 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ef236f6-4830-4d5e-b428-c0ce322fd2ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1391 microversion: 2.1 time: 0.221777 Jul 14 15:12:29.008885 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3164/6288] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:28 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1391 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:29.703458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-558c543b-bf36-402e-bc43-4af5856c1b42 req-04ba0959-ee39-4dd0-98aa-991f8bfe7587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e8e1f8-a400-4d55-afd6-32d97f8e10de", "name": "network-vif-plugged", "status": "completed", "tag": "b1f2ab2e-6755-4360-a82b-094874ac71c4"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:29.714743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-558c543b-bf36-402e-bc43-4af5856c1b42 req-04ba0959-ee39-4dd0-98aa-991f8bfe7587 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:29.715671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-558c543b-bf36-402e-bc43-4af5856c1b42 req-04ba0959-ee39-4dd0-98aa-991f8bfe7587 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:29.733192 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-558c543b-bf36-402e-bc43-4af5856c1b42 req-04ba0959-ee39-4dd0-98aa-991f8bfe7587 service nova] Creating event network-vif-plugged:b1f2ab2e-6755-4360-a82b-094874ac71c4 for instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de on n-h2-767704-28 Jul 14 15:12:29.739249 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-558c543b-bf36-402e-bc43-4af5856c1b42 req-04ba0959-ee39-4dd0-98aa-991f8bfe7587 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040164 Jul 14 15:12:29.740151 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3125/6289] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:30.016333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2fdfd159-ed2d-4f8b-838b-dcadd2807e4d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:30.017074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2fdfd159-ed2d-4f8b-838b-dcadd2807e4d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:30.027243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fdfd159-ed2d-4f8b-838b-dcadd2807e4d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:30.027243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fdfd159-ed2d-4f8b-838b-dcadd2807e4d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:30.027243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fdfd159-ed2d-4f8b-838b-dcadd2807e4d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:30.030050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fdfd159-ed2d-4f8b-838b-dcadd2807e4d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:30.181826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:30.221025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2fdfd159-ed2d-4f8b-838b-dcadd2807e4d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:30.234278 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2fdfd159-ed2d-4f8b-838b-dcadd2807e4d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1391 microversion: 2.1 time: 0.222102 Jul 14 15:12:30.239222 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3165/6290] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:30 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:31.256386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae8c99b1-ec64-4c4c-a515-46566ade93ba tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:31.257704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae8c99b1-ec64-4c4c-a515-46566ade93ba tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:31.259919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:31.260987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:31.270362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae8c99b1-ec64-4c4c-a515-46566ade93ba tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:31.270837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae8c99b1-ec64-4c4c-a515-46566ade93ba tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:31.271649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae8c99b1-ec64-4c4c-a515-46566ade93ba tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:31.272213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae8c99b1-ec64-4c4c-a515-46566ade93ba tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:31.480722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ae8c99b1-ec64-4c4c-a515-46566ade93ba tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:31.489085 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ae8c99b1-ec64-4c4c-a515-46566ade93ba tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1391 microversion: 2.1 time: 0.237890 Jul 14 15:12:31.489698 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3126/6291] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:31 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:32.388934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-374439317", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-296175840", "security_groups": [{"name": "tempest-secgroup-smoke-943015086"}], "block_device_mapping_v2": [{"uuid": "56650f55-096f-4259-8d1e-04b596d16579", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bce1cdb9-0501-4062-a135-972a001804ef"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:32.509337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-62f433f5-7276-4102-83df-3812d62ea7a4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:32.509911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] validate_networks() for [('bce1cdb9-0501-4062-a135-972a001804ef', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:12:32.510910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-62f433f5-7276-4102-83df-3812d62ea7a4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:32.520840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62f433f5-7276-4102-83df-3812d62ea7a4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:32.521402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62f433f5-7276-4102-83df-3812d62ea7a4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:32.522267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62f433f5-7276-4102-83df-3812d62ea7a4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:32.522843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62f433f5-7276-4102-83df-3812d62ea7a4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:32.757883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-62f433f5-7276-4102-83df-3812d62ea7a4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:32.766185 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-62f433f5-7276-4102-83df-3812d62ea7a4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1562 microversion: 2.1 time: 0.262972 Jul 14 15:12:32.766814 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3127/6292] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:32 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1562 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:32.784155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-783c5e75-ba1f-4bc0-8856-213673992a2d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:32.786022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-783c5e75-ba1f-4bc0-8856-213673992a2d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:32.792705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-783c5e75-ba1f-4bc0-8856-213673992a2d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:32.793202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-783c5e75-ba1f-4bc0-8856-213673992a2d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:32.794007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-783c5e75-ba1f-4bc0-8856-213673992a2d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:32.794453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-783c5e75-ba1f-4bc0-8856-213673992a2d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:33.020871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-783c5e75-ba1f-4bc0-8856-213673992a2d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:33.029073 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-783c5e75-ba1f-4bc0-8856-213673992a2d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1562 microversion: 2.1 time: 0.248983 Jul 14 15:12:33.034392 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3128/6293] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:32 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1562 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:33.131293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:12:33.131811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:12:33.132397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:12:33.132896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:12:33.133448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:12:33.144472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:33.145344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:33.146714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:33.147428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:33.169869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:12:33.177034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Getting quotas for user e77523cc1cca458eb2a1b553aff072be and project a357b38aa86347a68c4135066aef2786. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:12:33.254519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:12:33.257218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56650f55-096f-4259-8d1e-04b596d16579',volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:12:33.384936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:33.430680 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-947f2503-cf3f-491c-9ae3-87d27b897a00 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.045611 Jul 14 15:12:33.432422 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3166/6294] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:12:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:12:33.445660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e6d0d32a-486a-4d5e-b7fa-bd70f5408d3a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:33.447877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e6d0d32a-486a-4d5e-b7fa-bd70f5408d3a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:33.552574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e6d0d32a-486a-4d5e-b7fa-bd70f5408d3a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:33.561728 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e6d0d32a-486a-4d5e-b7fa-bd70f5408d3a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1093 microversion: 2.1 time: 0.122543 Jul 14 15:12:33.563556 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3129/6295] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:33 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1093 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:34.584014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-11699d3d-1f44-4209-a7f6-504c8f2b4c4b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:34.585674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-11699d3d-1f44-4209-a7f6-504c8f2b4c4b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:34.598543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11699d3d-1f44-4209-a7f6-504c8f2b4c4b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:34.599123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11699d3d-1f44-4209-a7f6-504c8f2b4c4b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:34.600097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11699d3d-1f44-4209-a7f6-504c8f2b4c4b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:34.600684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11699d3d-1f44-4209-a7f6-504c8f2b4c4b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:34.715205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-11699d3d-1f44-4209-a7f6-504c8f2b4c4b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:34.731956 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-11699d3d-1f44-4209-a7f6-504c8f2b4c4b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1191 microversion: 2.1 time: 0.153747 Jul 14 15:12:34.734042 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3167/6296] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:34 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1191 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:35.288163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d81e0d24-7c59-48ae-bdb7-5bb79d21858f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:35.288785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d81e0d24-7c59-48ae-bdb7-5bb79d21858f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:35.290957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-fbf83e2b-2c45-47a8-ae32-7ee044b1f832 req-431d65f0-ba34-4c34-9c9d-9918e5b1f4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e8e1f8-a400-4d55-afd6-32d97f8e10de", "tag": "b1f2ab2e-6755-4360-a82b-094874ac71c4"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:35.301582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d81e0d24-7c59-48ae-bdb7-5bb79d21858f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:35.302528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d81e0d24-7c59-48ae-bdb7-5bb79d21858f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:35.305760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d81e0d24-7c59-48ae-bdb7-5bb79d21858f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:35.306495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d81e0d24-7c59-48ae-bdb7-5bb79d21858f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:35.307301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-fbf83e2b-2c45-47a8-ae32-7ee044b1f832 req-431d65f0-ba34-4c34-9c9d-9918e5b1f4e5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:35.307778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-fbf83e2b-2c45-47a8-ae32-7ee044b1f832 req-431d65f0-ba34-4c34-9c9d-9918e5b1f4e5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:35.351836 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-fbf83e2b-2c45-47a8-ae32-7ee044b1f832 req-431d65f0-ba34-4c34-9c9d-9918e5b1f4e5 service nova] Creating event network-changed:b1f2ab2e-6755-4360-a82b-094874ac71c4 for instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de on n-h2-767704-28 Jul 14 15:12:35.369799 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-fbf83e2b-2c45-47a8-ae32-7ee044b1f832 req-431d65f0-ba34-4c34-9c9d-9918e5b1f4e5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088848 Jul 14 15:12:35.370920 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3168/6297] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:35.628902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d81e0d24-7c59-48ae-bdb7-5bb79d21858f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:35.637783 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d81e0d24-7c59-48ae-bdb7-5bb79d21858f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1562 microversion: 2.1 time: 0.359070 Jul 14 15:12:35.652248 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3130/6298] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:35 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1562 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:35.753839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cdeea2d2-e193-4ae1-bbca-2f233f5e1b7b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:35.755387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cdeea2d2-e193-4ae1-bbca-2f233f5e1b7b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:35.772705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdeea2d2-e193-4ae1-bbca-2f233f5e1b7b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:35.774034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdeea2d2-e193-4ae1-bbca-2f233f5e1b7b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:35.775032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdeea2d2-e193-4ae1-bbca-2f233f5e1b7b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:35.777116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdeea2d2-e193-4ae1-bbca-2f233f5e1b7b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:36.060141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cdeea2d2-e193-4ae1-bbca-2f233f5e1b7b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:36.088110 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cdeea2d2-e193-4ae1-bbca-2f233f5e1b7b tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1209 microversion: 2.1 time: 0.337882 Jul 14 15:12:36.091712 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3169/6299] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:35 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1209 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:37.110777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39d7d91d-f7f8-4096-9657-0c98cdda6c99 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:37.111855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-39d7d91d-f7f8-4096-9657-0c98cdda6c99 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:37.151963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39d7d91d-f7f8-4096-9657-0c98cdda6c99 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:37.153351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39d7d91d-f7f8-4096-9657-0c98cdda6c99 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:37.155088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39d7d91d-f7f8-4096-9657-0c98cdda6c99 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:37.155757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39d7d91d-f7f8-4096-9657-0c98cdda6c99 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:37.453124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-39d7d91d-f7f8-4096-9657-0c98cdda6c99 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:37.464350 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-39d7d91d-f7f8-4096-9657-0c98cdda6c99 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1276 microversion: 2.1 time: 0.358466 Jul 14 15:12:37.476315 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3131/6300] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:37 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1276 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:38.264614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e219754c-1398-4d80-b181-1658f88dea42 req-a8c4f3e3-4df7-449c-acdc-39c979609cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e99786-d56c-4847-90e0-948ef26fe51c", "tag": "62956400-473b-4bdf-89e0-cfc7c625af30"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:38.292334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e219754c-1398-4d80-b181-1658f88dea42 req-a8c4f3e3-4df7-449c-acdc-39c979609cf5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:38.293703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e219754c-1398-4d80-b181-1658f88dea42 req-a8c4f3e3-4df7-449c-acdc-39c979609cf5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:38.329196 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e219754c-1398-4d80-b181-1658f88dea42 req-a8c4f3e3-4df7-449c-acdc-39c979609cf5 service nova] Creating event network-changed:62956400-473b-4bdf-89e0-cfc7c625af30 for instance c9e99786-d56c-4847-90e0-948ef26fe51c on n-h1-767704-28 Jul 14 15:12:38.336698 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e219754c-1398-4d80-b181-1658f88dea42 req-a8c4f3e3-4df7-449c-acdc-39c979609cf5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075631 Jul 14 15:12:38.337910 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3170/6301] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:38.482864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-886b050a-5ed9-4048-92ad-2d5d9cb0e79a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:38.483644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-886b050a-5ed9-4048-92ad-2d5d9cb0e79a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:38.505058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-886b050a-5ed9-4048-92ad-2d5d9cb0e79a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:38.505952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-886b050a-5ed9-4048-92ad-2d5d9cb0e79a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:38.506987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-886b050a-5ed9-4048-92ad-2d5d9cb0e79a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:38.507614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-886b050a-5ed9-4048-92ad-2d5d9cb0e79a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:38.778142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-886b050a-5ed9-4048-92ad-2d5d9cb0e79a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:38.793851 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-886b050a-5ed9-4048-92ad-2d5d9cb0e79a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1276 microversion: 2.1 time: 0.314031 Jul 14 15:12:38.796419 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3132/6302] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:38 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1276 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:39.818992 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ec5996ec-1e8e-4da7-8e4d-21b4e7616b29 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:39.820355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ec5996ec-1e8e-4da7-8e4d-21b4e7616b29 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:39.830158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec5996ec-1e8e-4da7-8e4d-21b4e7616b29 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:39.830935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec5996ec-1e8e-4da7-8e4d-21b4e7616b29 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:39.831909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec5996ec-1e8e-4da7-8e4d-21b4e7616b29 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:39.832682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec5996ec-1e8e-4da7-8e4d-21b4e7616b29 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:40.011276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ec5996ec-1e8e-4da7-8e4d-21b4e7616b29 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:40.019319 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ec5996ec-1e8e-4da7-8e4d-21b4e7616b29 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1276 microversion: 2.1 time: 0.208560 Jul 14 15:12:40.020534 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3171/6303] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:39 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:41.037353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-824998db-1f2f-4d31-aae9-b96e788b86b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:41.038593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-824998db-1f2f-4d31-aae9-b96e788b86b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:41.045246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-824998db-1f2f-4d31-aae9-b96e788b86b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:41.045905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-824998db-1f2f-4d31-aae9-b96e788b86b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:41.046981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-824998db-1f2f-4d31-aae9-b96e788b86b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:41.048461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-824998db-1f2f-4d31-aae9-b96e788b86b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:41.669793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-824998db-1f2f-4d31-aae9-b96e788b86b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:41.679471 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-824998db-1f2f-4d31-aae9-b96e788b86b3 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1276 microversion: 2.1 time: 0.647119 Jul 14 15:12:41.689510 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3133/6304] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:41 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1276 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:42.697226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-be8fec00-4906-4978-91ea-33b14b775c31 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:42.697858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-be8fec00-4906-4978-91ea-33b14b775c31 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:42.705530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-be8fec00-4906-4978-91ea-33b14b775c31 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:42.706004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-be8fec00-4906-4978-91ea-33b14b775c31 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:42.706791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-be8fec00-4906-4978-91ea-33b14b775c31 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:42.707239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-be8fec00-4906-4978-91ea-33b14b775c31 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:42.861281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-be8fec00-4906-4978-91ea-33b14b775c31 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:42.870158 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-be8fec00-4906-4978-91ea-33b14b775c31 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1264 microversion: 2.1 time: 0.176204 Jul 14 15:12:42.870777 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3172/6305] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:42 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:43.887781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7eeaa73d-9b26-4d8c-bd6c-81e2cf8c7e8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:43.888403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7eeaa73d-9b26-4d8c-bd6c-81e2cf8c7e8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:43.895148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:43.897844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7eeaa73d-9b26-4d8c-bd6c-81e2cf8c7e8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:43.898319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7eeaa73d-9b26-4d8c-bd6c-81e2cf8c7e8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:43.899107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7eeaa73d-9b26-4d8c-bd6c-81e2cf8c7e8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:43.899552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7eeaa73d-9b26-4d8c-bd6c-81e2cf8c7e8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:44.042244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7eeaa73d-9b26-4d8c-bd6c-81e2cf8c7e8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:44.050751 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7eeaa73d-9b26-4d8c-bd6c-81e2cf8c7e8a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1264 microversion: 2.1 time: 0.166837 Jul 14 15:12:44.051336 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3134/6306] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:43 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:45.067666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-eaaf3c6b-e9e2-416f-ac12-148b03d3b929 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:45.068295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-eaaf3c6b-e9e2-416f-ac12-148b03d3b929 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:45.070350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:45.071217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:45.077815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eaaf3c6b-e9e2-416f-ac12-148b03d3b929 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:45.078247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eaaf3c6b-e9e2-416f-ac12-148b03d3b929 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:45.079030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eaaf3c6b-e9e2-416f-ac12-148b03d3b929 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:45.079484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-eaaf3c6b-e9e2-416f-ac12-148b03d3b929 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:45.234429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-eaaf3c6b-e9e2-416f-ac12-148b03d3b929 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:45.243432 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-eaaf3c6b-e9e2-416f-ac12-148b03d3b929 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1264 microversion: 2.1 time: 0.179543 Jul 14 15:12:45.244023 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3173/6307] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:45 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:12:46.264736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-547710be-4d9d-498d-ab25-f5d297acb2c0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:46.265463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-547710be-4d9d-498d-ab25-f5d297acb2c0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:46.273182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-547710be-4d9d-498d-ab25-f5d297acb2c0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:46.274037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-547710be-4d9d-498d-ab25-f5d297acb2c0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:46.275035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-547710be-4d9d-498d-ab25-f5d297acb2c0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:46.275654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-547710be-4d9d-498d-ab25-f5d297acb2c0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:46.423938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-547710be-4d9d-498d-ab25-f5d297acb2c0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:46.432188 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-547710be-4d9d-498d-ab25-f5d297acb2c0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1264 microversion: 2.1 time: 0.173672 Jul 14 15:12:46.432820 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3135/6308] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:46 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:47.449622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b184cc9e-100e-4dde-92d7-abcb84c9fc09 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:47.450246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b184cc9e-100e-4dde-92d7-abcb84c9fc09 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:47.457403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b184cc9e-100e-4dde-92d7-abcb84c9fc09 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:47.457899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b184cc9e-100e-4dde-92d7-abcb84c9fc09 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:47.458700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b184cc9e-100e-4dde-92d7-abcb84c9fc09 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:47.459161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b184cc9e-100e-4dde-92d7-abcb84c9fc09 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:47.604746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b184cc9e-100e-4dde-92d7-abcb84c9fc09 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:47.613379 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b184cc9e-100e-4dde-92d7-abcb84c9fc09 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1264 microversion: 2.1 time: 0.167610 Jul 14 15:12:47.614186 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3174/6309] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:47 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:48.631209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8e59e507-a9b8-4f7c-846a-bfd1a37df1e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:48.631929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8e59e507-a9b8-4f7c-846a-bfd1a37df1e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:48.639606 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e59e507-a9b8-4f7c-846a-bfd1a37df1e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:48.640133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e59e507-a9b8-4f7c-846a-bfd1a37df1e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:48.641008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e59e507-a9b8-4f7c-846a-bfd1a37df1e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:48.641519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8e59e507-a9b8-4f7c-846a-bfd1a37df1e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:48.805648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8e59e507-a9b8-4f7c-846a-bfd1a37df1e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:48.815318 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8e59e507-a9b8-4f7c-846a-bfd1a37df1e0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1264 microversion: 2.1 time: 0.187331 Jul 14 15:12:48.816999 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3136/6310] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:48 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:49.833847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d51e361a-9f1a-41bd-969f-069593dea0e1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:49.834723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d51e361a-9f1a-41bd-969f-069593dea0e1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:49.842041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d51e361a-9f1a-41bd-969f-069593dea0e1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:49.842519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d51e361a-9f1a-41bd-969f-069593dea0e1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:49.843311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d51e361a-9f1a-41bd-969f-069593dea0e1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:49.843803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d51e361a-9f1a-41bd-969f-069593dea0e1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:49.980411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d51e361a-9f1a-41bd-969f-069593dea0e1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:49.988584 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d51e361a-9f1a-41bd-969f-069593dea0e1 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1264 microversion: 2.1 time: 0.158959 Jul 14 15:12:49.990049 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3175/6311] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:49 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:51.006582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98ef9105-c499-468d-8646-c097f1c2bda0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:51.007208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-98ef9105-c499-468d-8646-c097f1c2bda0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:51.014229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98ef9105-c499-468d-8646-c097f1c2bda0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:51.014691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98ef9105-c499-468d-8646-c097f1c2bda0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:51.015474 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98ef9105-c499-468d-8646-c097f1c2bda0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:51.015923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98ef9105-c499-468d-8646-c097f1c2bda0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:51.020741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=89 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:51.152391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-98ef9105-c499-468d-8646-c097f1c2bda0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:51.160318 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98ef9105-c499-468d-8646-c097f1c2bda0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1264 microversion: 2.1 time: 0.158209 Jul 14 15:12:51.160845 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3137/6312] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:51 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:51.706168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f90ac11f-331a-4aa7-89aa-ce7b382caef4 req-2b953be4-443a-419e-9d1e-1f994dabf458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e99786-d56c-4847-90e0-948ef26fe51c", "name": "network-vif-plugged", "status": "completed", "tag": "62956400-473b-4bdf-89e0-cfc7c625af30"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:51.716130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f90ac11f-331a-4aa7-89aa-ce7b382caef4 req-2b953be4-443a-419e-9d1e-1f994dabf458 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:51.716632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f90ac11f-331a-4aa7-89aa-ce7b382caef4 req-2b953be4-443a-419e-9d1e-1f994dabf458 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:51.722274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=75 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:51.731130 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f90ac11f-331a-4aa7-89aa-ce7b382caef4 req-2b953be4-443a-419e-9d1e-1f994dabf458 service nova] Creating event network-vif-plugged:62956400-473b-4bdf-89e0-cfc7c625af30 for instance c9e99786-d56c-4847-90e0-948ef26fe51c on n-h1-767704-28 Jul 14 15:12:51.737203 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f90ac11f-331a-4aa7-89aa-ce7b382caef4 req-2b953be4-443a-419e-9d1e-1f994dabf458 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034786 Jul 14 15:12:51.738194 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3176/6313] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:52.178229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e7759e36-cd77-44e4-bfac-b586197e1f5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:52.178850 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e7759e36-cd77-44e4-bfac-b586197e1f5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:52.186438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7759e36-cd77-44e4-bfac-b586197e1f5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:52.186904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7759e36-cd77-44e4-bfac-b586197e1f5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:52.187686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7759e36-cd77-44e4-bfac-b586197e1f5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:52.188127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7759e36-cd77-44e4-bfac-b586197e1f5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:52.329994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e7759e36-cd77-44e4-bfac-b586197e1f5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:52.337845 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e7759e36-cd77-44e4-bfac-b586197e1f5a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1264 microversion: 2.1 time: 0.164060 Jul 14 15:12:52.338440 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3138/6314] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:52 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:53.362291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc500c97-dc57-42ca-81eb-190606b8eeb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:53.363824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dc500c97-dc57-42ca-81eb-190606b8eeb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:53.372748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc500c97-dc57-42ca-81eb-190606b8eeb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:53.373394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc500c97-dc57-42ca-81eb-190606b8eeb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:53.374106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc500c97-dc57-42ca-81eb-190606b8eeb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:53.374564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc500c97-dc57-42ca-81eb-190606b8eeb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:53.526775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dc500c97-dc57-42ca-81eb-190606b8eeb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:53.536229 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dc500c97-dc57-42ca-81eb-190606b8eeb9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1450 microversion: 2.1 time: 0.184536 Jul 14 15:12:53.537477 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3177/6315] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:53 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1450 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:53.553217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-74b4bc0c-755c-489f-85de-4ee48306a30c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:53.553842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-74b4bc0c-755c-489f-85de-4ee48306a30c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:53.561450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74b4bc0c-755c-489f-85de-4ee48306a30c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:53.562171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74b4bc0c-755c-489f-85de-4ee48306a30c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:53.563231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74b4bc0c-755c-489f-85de-4ee48306a30c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:53.563903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-74b4bc0c-755c-489f-85de-4ee48306a30c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:53.749192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-74b4bc0c-755c-489f-85de-4ee48306a30c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:53.758956 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-74b4bc0c-755c-489f-85de-4ee48306a30c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1450 microversion: 2.1 time: 0.209885 Jul 14 15:12:53.759486 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3139/6316] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:53 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1450 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:55.672244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-34e7c927-ecbd-4013-b3d4-629f2af74511 req-fb71a5d2-4e75-448d-87d5-86071a135b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e99786-d56c-4847-90e0-948ef26fe51c", "tag": "62956400-473b-4bdf-89e0-cfc7c625af30"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:55.681675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-34e7c927-ecbd-4013-b3d4-629f2af74511 req-fb71a5d2-4e75-448d-87d5-86071a135b68 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:55.682141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-34e7c927-ecbd-4013-b3d4-629f2af74511 req-fb71a5d2-4e75-448d-87d5-86071a135b68 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:55.694209 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-34e7c927-ecbd-4013-b3d4-629f2af74511 req-fb71a5d2-4e75-448d-87d5-86071a135b68 service nova] Creating event network-changed:62956400-473b-4bdf-89e0-cfc7c625af30 for instance c9e99786-d56c-4847-90e0-948ef26fe51c on n-h1-767704-28 Jul 14 15:12:55.699547 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-34e7c927-ecbd-4013-b3d4-629f2af74511 req-fb71a5d2-4e75-448d-87d5-86071a135b68 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030900 Jul 14 15:12:55.700265 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3178/6317] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:00.213598 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-296b8038-e09c-43e3-a236-da65a863f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:00.214448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-296b8038-e09c-43e3-a236-da65a863f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:00.218241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=34 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:00.222873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-296b8038-e09c-43e3-a236-da65a863f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:00.223328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-296b8038-e09c-43e3-a236-da65a863f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:00.224099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-296b8038-e09c-43e3-a236-da65a863f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:00.224538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-296b8038-e09c-43e3-a236-da65a863f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:00.290597 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-296b8038-e09c-43e3-a236-da65a863f33d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de/action" status: 200 len: 24575 microversion: 2.1 time: 0.080832 Jul 14 15:13:00.291471 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3140/6318] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:13:00 2022] POST /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de/action => generated 24575 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:13:11.357329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=24 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:11.358443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=9 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:11.364067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c6c704fa-d920-4a5f-9f29-68502afaa271 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:11.364787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c6c704fa-d920-4a5f-9f29-68502afaa271 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:11.372220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c704fa-d920-4a5f-9f29-68502afaa271 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:11.372689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c704fa-d920-4a5f-9f29-68502afaa271 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:11.373504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c704fa-d920-4a5f-9f29-68502afaa271 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:11.373960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6c704fa-d920-4a5f-9f29-68502afaa271 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:11.511070 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c6c704fa-d920-4a5f-9f29-68502afaa271 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1834 microversion: 2.1 time: 0.156326 Jul 14 15:13:11.511682 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3179/6319] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:11 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1834 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:11.528853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c681f409-0524-426c-a3ba-e3ac7a6f9559 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:11.529668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c681f409-0524-426c-a3ba-e3ac7a6f9559 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:11.532877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:11.533619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=21 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:11.539525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c681f409-0524-426c-a3ba-e3ac7a6f9559 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:11.539985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c681f409-0524-426c-a3ba-e3ac7a6f9559 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:11.540763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c681f409-0524-426c-a3ba-e3ac7a6f9559 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:11.541234 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c681f409-0524-426c-a3ba-e3ac7a6f9559 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:11.684757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c681f409-0524-426c-a3ba-e3ac7a6f9559 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:11.692986 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c681f409-0524-426c-a3ba-e3ac7a6f9559 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1681 microversion: 2.1 time: 0.168291 Jul 14 15:13:11.693607 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3141/6320] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:11 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:11.781591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6e3f474b-7c9f-451f-85de-fc46e82f8f93 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:11.782627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6e3f474b-7c9f-451f-85de-fc46e82f8f93 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:11.789263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e3f474b-7c9f-451f-85de-fc46e82f8f93 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:11.789732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e3f474b-7c9f-451f-85de-fc46e82f8f93 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:11.790514 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e3f474b-7c9f-451f-85de-fc46e82f8f93 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:11.790969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e3f474b-7c9f-451f-85de-fc46e82f8f93 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:11.851956 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6e3f474b-7c9f-451f-85de-fc46e82f8f93 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de/action" status: 200 len: 32640 microversion: 2.1 time: 0.074511 Jul 14 15:13:11.852635 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3180/6321] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:13:11 2022] POST /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de/action => generated 32640 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:13:12.070489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cd91e11e-1474-44fd-8b87-f38bcbb6a846 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:12.071091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cd91e11e-1474-44fd-8b87-f38bcbb6a846 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:12.077682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd91e11e-1474-44fd-8b87-f38bcbb6a846 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:12.078144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd91e11e-1474-44fd-8b87-f38bcbb6a846 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:12.078922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd91e11e-1474-44fd-8b87-f38bcbb6a846 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:12.079917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cd91e11e-1474-44fd-8b87-f38bcbb6a846 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:12.111325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cd91e11e-1474-44fd-8b87-f38bcbb6a846 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4019e5ce460b4080bd8af36619f0a81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb002ba76849e5a6f070b2e307e3e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:12.111919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cd91e11e-1474-44fd-8b87-f38bcbb6a846 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] flavor_id is None. Assuming migration. {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 14 15:13:12.112369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cd91e11e-1474-44fd-8b87-f38bcbb6a846 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:13:12.228656 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cd91e11e-1474-44fd-8b87-f38bcbb6a846 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de/action" status: 202 len: 0 microversion: 2.1 time: 0.161966 Jul 14 15:13:12.229678 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3142/6322] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:13:12 2022] POST /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:13:12.239024 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-533dc85c-957c-4dd4-a320-a442d852c36f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:12.239853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-533dc85c-957c-4dd4-a320-a442d852c36f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:12.247489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-533dc85c-957c-4dd4-a320-a442d852c36f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:12.247927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-533dc85c-957c-4dd4-a320-a442d852c36f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:12.248739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-533dc85c-957c-4dd4-a320-a442d852c36f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:12.249247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-533dc85c-957c-4dd4-a320-a442d852c36f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:12.434464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-533dc85c-957c-4dd4-a320-a442d852c36f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:12.448627 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-533dc85c-957c-4dd4-a320-a442d852c36f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1690 microversion: 2.1 time: 0.213557 Jul 14 15:13:12.462799 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3181/6323] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:12 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1690 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:13.471651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-89203918-12e9-45bf-a697-971ae7ebcfe3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:13.472268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-89203918-12e9-45bf-a697-971ae7ebcfe3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:13.478492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89203918-12e9-45bf-a697-971ae7ebcfe3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:13.478956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89203918-12e9-45bf-a697-971ae7ebcfe3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:13.479704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89203918-12e9-45bf-a697-971ae7ebcfe3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:13.480146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89203918-12e9-45bf-a697-971ae7ebcfe3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:13.629953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-89203918-12e9-45bf-a697-971ae7ebcfe3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:13.639037 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-89203918-12e9-45bf-a697-971ae7ebcfe3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1690 microversion: 2.1 time: 0.172662 Jul 14 15:13:13.640525 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3143/6324] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:13 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:14.659526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-875ef250-79d0-4f1a-b66e-3654e1efbc50 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:14.660195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-875ef250-79d0-4f1a-b66e-3654e1efbc50 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:14.668506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-875ef250-79d0-4f1a-b66e-3654e1efbc50 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:14.668916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-875ef250-79d0-4f1a-b66e-3654e1efbc50 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:14.669766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-875ef250-79d0-4f1a-b66e-3654e1efbc50 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:14.670237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-875ef250-79d0-4f1a-b66e-3654e1efbc50 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:14.815431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-875ef250-79d0-4f1a-b66e-3654e1efbc50 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:14.823666 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-875ef250-79d0-4f1a-b66e-3654e1efbc50 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1690 microversion: 2.1 time: 0.168918 Jul 14 15:13:14.824246 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3182/6325] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:14 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:15.841523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ab95479d-3a27-404a-aadf-f0629b99c140 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:15.842208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ab95479d-3a27-404a-aadf-f0629b99c140 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:15.851608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab95479d-3a27-404a-aadf-f0629b99c140 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:15.851608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab95479d-3a27-404a-aadf-f0629b99c140 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:15.851608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab95479d-3a27-404a-aadf-f0629b99c140 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:15.852035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ab95479d-3a27-404a-aadf-f0629b99c140 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:16.001665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ab95479d-3a27-404a-aadf-f0629b99c140 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:16.009669 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ab95479d-3a27-404a-aadf-f0629b99c140 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1695 microversion: 2.1 time: 0.172289 Jul 14 15:13:16.010282 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3144/6326] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:15 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:17.028245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-63d2e7e4-2db1-4039-b4ad-48a9a7f29ca5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:17.028806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-63d2e7e4-2db1-4039-b4ad-48a9a7f29ca5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:17.036374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63d2e7e4-2db1-4039-b4ad-48a9a7f29ca5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:17.036575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63d2e7e4-2db1-4039-b4ad-48a9a7f29ca5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:17.037372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63d2e7e4-2db1-4039-b4ad-48a9a7f29ca5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:17.037836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-63d2e7e4-2db1-4039-b4ad-48a9a7f29ca5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:17.186428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-63d2e7e4-2db1-4039-b4ad-48a9a7f29ca5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:17.195475 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-63d2e7e4-2db1-4039-b4ad-48a9a7f29ca5 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1695 microversion: 2.1 time: 0.171187 Jul 14 15:13:17.196146 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3183/6327] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:17 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:18.213259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2088442d-bf75-4886-ab52-01af9d3caa45 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:18.213910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2088442d-bf75-4886-ab52-01af9d3caa45 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:18.221235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2088442d-bf75-4886-ab52-01af9d3caa45 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:18.221691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2088442d-bf75-4886-ab52-01af9d3caa45 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:18.222553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2088442d-bf75-4886-ab52-01af9d3caa45 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:18.222915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2088442d-bf75-4886-ab52-01af9d3caa45 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:18.368004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2088442d-bf75-4886-ab52-01af9d3caa45 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:18.375752 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2088442d-bf75-4886-ab52-01af9d3caa45 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1695 microversion: 2.1 time: 0.166628 Jul 14 15:13:18.376673 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3145/6328] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:18 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:19.395341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-565f6421-e3b4-4584-b17e-9a633bd4fbb2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:19.395967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-565f6421-e3b4-4584-b17e-9a633bd4fbb2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:19.402953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-565f6421-e3b4-4584-b17e-9a633bd4fbb2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:19.403421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-565f6421-e3b4-4584-b17e-9a633bd4fbb2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:19.404202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-565f6421-e3b4-4584-b17e-9a633bd4fbb2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:19.404649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-565f6421-e3b4-4584-b17e-9a633bd4fbb2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:19.538174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-565f6421-e3b4-4584-b17e-9a633bd4fbb2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:19.546134 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-565f6421-e3b4-4584-b17e-9a633bd4fbb2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1695 microversion: 2.1 time: 0.154716 Jul 14 15:13:19.546860 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3184/6329] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:19 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:20.565451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24b49b87-9c98-443b-abe4-1691da92a3fe tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:20.566072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-24b49b87-9c98-443b-abe4-1691da92a3fe tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:20.576985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24b49b87-9c98-443b-abe4-1691da92a3fe tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:20.577519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24b49b87-9c98-443b-abe4-1691da92a3fe tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:20.578389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24b49b87-9c98-443b-abe4-1691da92a3fe tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:20.578948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24b49b87-9c98-443b-abe4-1691da92a3fe tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:20.728838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-24b49b87-9c98-443b-abe4-1691da92a3fe tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:20.736598 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-24b49b87-9c98-443b-abe4-1691da92a3fe tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1695 microversion: 2.1 time: 0.176673 Jul 14 15:13:20.737207 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3146/6330] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:20 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:21.756677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8f72f324-02ea-4e89-81df-5d14a8b30386 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:21.756677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8f72f324-02ea-4e89-81df-5d14a8b30386 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:21.763427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f72f324-02ea-4e89-81df-5d14a8b30386 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:21.763898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f72f324-02ea-4e89-81df-5d14a8b30386 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:21.764777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f72f324-02ea-4e89-81df-5d14a8b30386 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:21.765193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f72f324-02ea-4e89-81df-5d14a8b30386 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:21.899636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8f72f324-02ea-4e89-81df-5d14a8b30386 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:21.907470 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8f72f324-02ea-4e89-81df-5d14a8b30386 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1695 microversion: 2.1 time: 0.156527 Jul 14 15:13:21.908076 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3185/6331] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:21 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:22.925737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7fb61338-94e9-428b-b8ff-af903a13faf9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:22.926354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7fb61338-94e9-428b-b8ff-af903a13faf9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:22.934152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fb61338-94e9-428b-b8ff-af903a13faf9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:22.934609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fb61338-94e9-428b-b8ff-af903a13faf9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:22.935381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fb61338-94e9-428b-b8ff-af903a13faf9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:22.935822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7fb61338-94e9-428b-b8ff-af903a13faf9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:23.076922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7fb61338-94e9-428b-b8ff-af903a13faf9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:23.085859 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7fb61338-94e9-428b-b8ff-af903a13faf9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1695 microversion: 2.1 time: 0.163762 Jul 14 15:13:23.086383 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3147/6332] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:22 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:24.105117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b014bcbd-4bc9-4353-b4f6-becf9babe2df tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:24.105737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b014bcbd-4bc9-4353-b4f6-becf9babe2df tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:24.112113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b014bcbd-4bc9-4353-b4f6-becf9babe2df tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:24.112616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b014bcbd-4bc9-4353-b4f6-becf9babe2df tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:24.113475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b014bcbd-4bc9-4353-b4f6-becf9babe2df tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:24.113929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b014bcbd-4bc9-4353-b4f6-becf9babe2df tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:24.252853 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b014bcbd-4bc9-4353-b4f6-becf9babe2df tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:24.260907 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b014bcbd-4bc9-4353-b4f6-becf9babe2df tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1695 microversion: 2.1 time: 0.161412 Jul 14 15:13:24.261531 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3186/6333] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:24 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:25.279197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-297d8a81-8f9e-4cfb-834d-a1ca719a4df6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:25.279821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-297d8a81-8f9e-4cfb-834d-a1ca719a4df6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:25.287248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-297d8a81-8f9e-4cfb-834d-a1ca719a4df6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:25.287785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-297d8a81-8f9e-4cfb-834d-a1ca719a4df6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:25.289652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-297d8a81-8f9e-4cfb-834d-a1ca719a4df6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:25.290247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-297d8a81-8f9e-4cfb-834d-a1ca719a4df6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:25.430614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-297d8a81-8f9e-4cfb-834d-a1ca719a4df6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:25.438857 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-297d8a81-8f9e-4cfb-834d-a1ca719a4df6 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1695 microversion: 2.1 time: 0.163752 Jul 14 15:13:25.439452 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3148/6334] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:25 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:26.456886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ef34257c-8433-45c2-bd92-13e5a032751d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:26.457533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ef34257c-8433-45c2-bd92-13e5a032751d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:26.465323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef34257c-8433-45c2-bd92-13e5a032751d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:26.465796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef34257c-8433-45c2-bd92-13e5a032751d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:26.466583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef34257c-8433-45c2-bd92-13e5a032751d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:26.467042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef34257c-8433-45c2-bd92-13e5a032751d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:26.608090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ef34257c-8433-45c2-bd92-13e5a032751d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:26.615779 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ef34257c-8433-45c2-bd92-13e5a032751d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1695 microversion: 2.1 time: 0.162858 Jul 14 15:13:26.616353 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3187/6335] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:26 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:27.595764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b37465b2-8618-4860-85dd-9de6685a324f req-6301dfc0-f38e-4a07-9b04-99c00ad825ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e8e1f8-a400-4d55-afd6-32d97f8e10de", "name": "network-vif-unplugged", "status": "completed", "tag": "b1f2ab2e-6755-4360-a82b-094874ac71c4"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:27.606038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b37465b2-8618-4860-85dd-9de6685a324f req-6301dfc0-f38e-4a07-9b04-99c00ad825ee service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:27.606497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b37465b2-8618-4860-85dd-9de6685a324f req-6301dfc0-f38e-4a07-9b04-99c00ad825ee service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:27.621845 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b37465b2-8618-4860-85dd-9de6685a324f req-6301dfc0-f38e-4a07-9b04-99c00ad825ee service nova] Creating event network-vif-unplugged:b1f2ab2e-6755-4360-a82b-094874ac71c4 for instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de on n-h1-767704-28 Jul 14 15:13:27.627921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-b37465b2-8618-4860-85dd-9de6685a324f req-6301dfc0-f38e-4a07-9b04-99c00ad825ee service nova] Instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:13:27.634292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-07be7f47-add1-4338-b5fc-227e3a5d7591 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:27.635707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-07be7f47-add1-4338-b5fc-227e3a5d7591 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:27.641726 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b37465b2-8618-4860-85dd-9de6685a324f req-6301dfc0-f38e-4a07-9b04-99c00ad825ee service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049990 Jul 14 15:13:27.642661 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3149/6336] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:27.643191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-07be7f47-add1-4338-b5fc-227e3a5d7591 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:27.643669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-07be7f47-add1-4338-b5fc-227e3a5d7591 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:27.644585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-07be7f47-add1-4338-b5fc-227e3a5d7591 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:27.645462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-07be7f47-add1-4338-b5fc-227e3a5d7591 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:28.237252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-07be7f47-add1-4338-b5fc-227e3a5d7591 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:28.246656 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-07be7f47-add1-4338-b5fc-227e3a5d7591 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1694 microversion: 2.1 time: 0.616862 Jul 14 15:13:28.247247 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3188/6337] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:27 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1694 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:29.266241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-47ccaff1-1dac-4604-9486-bc02ce9bd9f0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:29.266948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-47ccaff1-1dac-4604-9486-bc02ce9bd9f0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:29.274097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47ccaff1-1dac-4604-9486-bc02ce9bd9f0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:29.274834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47ccaff1-1dac-4604-9486-bc02ce9bd9f0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:29.275629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47ccaff1-1dac-4604-9486-bc02ce9bd9f0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:29.276077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47ccaff1-1dac-4604-9486-bc02ce9bd9f0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:29.417354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-47ccaff1-1dac-4604-9486-bc02ce9bd9f0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:29.425039 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-47ccaff1-1dac-4604-9486-bc02ce9bd9f0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1692 microversion: 2.1 time: 0.163625 Jul 14 15:13:29.425620 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3150/6338] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:29 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:29.657700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0be92b93-27cd-48fe-a2e6-34f2e3a0ec0f req-31ef6b6c-a334-4706-8d41-78924d7adf34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e8e1f8-a400-4d55-afd6-32d97f8e10de", "tag": "b1f2ab2e-6755-4360-a82b-094874ac71c4"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:29.667655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0be92b93-27cd-48fe-a2e6-34f2e3a0ec0f req-31ef6b6c-a334-4706-8d41-78924d7adf34 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:29.668107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0be92b93-27cd-48fe-a2e6-34f2e3a0ec0f req-31ef6b6c-a334-4706-8d41-78924d7adf34 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:29.679761 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0be92b93-27cd-48fe-a2e6-34f2e3a0ec0f req-31ef6b6c-a334-4706-8d41-78924d7adf34 service nova] Creating event network-changed:b1f2ab2e-6755-4360-a82b-094874ac71c4 for instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de on n-h1-767704-28 Jul 14 15:13:29.685463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-0be92b93-27cd-48fe-a2e6-34f2e3a0ec0f req-31ef6b6c-a334-4706-8d41-78924d7adf34 service nova] Instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:13:29.697403 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0be92b93-27cd-48fe-a2e6-34f2e3a0ec0f req-31ef6b6c-a334-4706-8d41-78924d7adf34 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043119 Jul 14 15:13:29.698038 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3189/6339] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:30.443709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ad5ec18e-3e7c-49f9-82b7-7a8c24aa87db tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:30.444268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ad5ec18e-3e7c-49f9-82b7-7a8c24aa87db tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:30.452328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad5ec18e-3e7c-49f9-82b7-7a8c24aa87db tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:30.452790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad5ec18e-3e7c-49f9-82b7-7a8c24aa87db tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:30.453593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad5ec18e-3e7c-49f9-82b7-7a8c24aa87db tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:30.454047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad5ec18e-3e7c-49f9-82b7-7a8c24aa87db tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:30.595891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ad5ec18e-3e7c-49f9-82b7-7a8c24aa87db tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:30.603581 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ad5ec18e-3e7c-49f9-82b7-7a8c24aa87db tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1692 microversion: 2.1 time: 0.163798 Jul 14 15:13:30.604187 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3151/6340] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:30 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:31.622485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-278491a3-ca4c-421b-bc15-b255e1a63261 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:31.623204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-278491a3-ca4c-421b-bc15-b255e1a63261 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:31.629952 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-278491a3-ca4c-421b-bc15-b255e1a63261 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:31.630428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-278491a3-ca4c-421b-bc15-b255e1a63261 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:31.631219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-278491a3-ca4c-421b-bc15-b255e1a63261 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:31.631680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-278491a3-ca4c-421b-bc15-b255e1a63261 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:31.771680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-278491a3-ca4c-421b-bc15-b255e1a63261 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:31.780905 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-278491a3-ca4c-421b-bc15-b255e1a63261 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1689 microversion: 2.1 time: 0.164292 Jul 14 15:13:31.781528 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3190/6341] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:31 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:31.798166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-607355af-723f-4c03-9ac6-34530b98a6e7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:31.798755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-607355af-723f-4c03-9ac6-34530b98a6e7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:31.806420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-607355af-723f-4c03-9ac6-34530b98a6e7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:31.806900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-607355af-723f-4c03-9ac6-34530b98a6e7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:31.807699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-607355af-723f-4c03-9ac6-34530b98a6e7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:31.808148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-607355af-723f-4c03-9ac6-34530b98a6e7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:31.926704 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-607355af-723f-4c03-9ac6-34530b98a6e7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de/action" status: 202 len: 0 microversion: 2.1 time: 0.132341 Jul 14 15:13:31.931215 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3152/6342] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:13:31 2022] POST /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:13:31.936473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b69a1efa-c625-4842-ad19-ebb5c053378a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:31.937311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b69a1efa-c625-4842-ad19-ebb5c053378a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:31.943592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b69a1efa-c625-4842-ad19-ebb5c053378a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:31.943948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b69a1efa-c625-4842-ad19-ebb5c053378a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:31.944904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b69a1efa-c625-4842-ad19-ebb5c053378a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:31.945333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b69a1efa-c625-4842-ad19-ebb5c053378a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:32.151018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b69a1efa-c625-4842-ad19-ebb5c053378a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:32.158719 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b69a1efa-c625-4842-ad19-ebb5c053378a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1688 microversion: 2.1 time: 0.226338 Jul 14 15:13:32.159225 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3191/6343] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:31 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1688 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:33.177587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a779825a-d20e-4220-a059-661dd301b164 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:33.178209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a779825a-d20e-4220-a059-661dd301b164 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:33.186269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a779825a-d20e-4220-a059-661dd301b164 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:33.186725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a779825a-d20e-4220-a059-661dd301b164 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:33.187503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a779825a-d20e-4220-a059-661dd301b164 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:33.187943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a779825a-d20e-4220-a059-661dd301b164 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:33.325936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a779825a-d20e-4220-a059-661dd301b164 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:33.333492 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a779825a-d20e-4220-a059-661dd301b164 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1688 microversion: 2.1 time: 0.160428 Jul 14 15:13:33.334064 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3153/6344] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:33 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:34.045611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-146e2a84-b403-4701-9988-17884cd0021b req-e89eea5f-c3fa-4d1b-8cb2-25f0fdeb7b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e8e1f8-a400-4d55-afd6-32d97f8e10de", "name": "network-vif-plugged", "status": "completed", "tag": "b1f2ab2e-6755-4360-a82b-094874ac71c4"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:34.053964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-146e2a84-b403-4701-9988-17884cd0021b req-e89eea5f-c3fa-4d1b-8cb2-25f0fdeb7b2f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:34.054426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-146e2a84-b403-4701-9988-17884cd0021b req-e89eea5f-c3fa-4d1b-8cb2-25f0fdeb7b2f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:34.066603 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-146e2a84-b403-4701-9988-17884cd0021b req-e89eea5f-c3fa-4d1b-8cb2-25f0fdeb7b2f service nova] Creating event network-vif-plugged:b1f2ab2e-6755-4360-a82b-094874ac71c4 for instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de on n-h1-767704-28 Jul 14 15:13:34.072646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-146e2a84-b403-4701-9988-17884cd0021b req-e89eea5f-c3fa-4d1b-8cb2-25f0fdeb7b2f service nova] Instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:13:34.083370 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-146e2a84-b403-4701-9988-17884cd0021b req-e89eea5f-c3fa-4d1b-8cb2-25f0fdeb7b2f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114147 Jul 14 15:13:34.083980 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3192/6345] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:34.353098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f1a697c-4435-4d56-9b93-66e2bb589a15 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:34.353705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3f1a697c-4435-4d56-9b93-66e2bb589a15 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:34.361403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f1a697c-4435-4d56-9b93-66e2bb589a15 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:34.361857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f1a697c-4435-4d56-9b93-66e2bb589a15 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:34.362821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f1a697c-4435-4d56-9b93-66e2bb589a15 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:34.363408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f1a697c-4435-4d56-9b93-66e2bb589a15 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:34.385609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:34.523098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3f1a697c-4435-4d56-9b93-66e2bb589a15 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:34.532037 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3f1a697c-4435-4d56-9b93-66e2bb589a15 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1688 microversion: 2.1 time: 0.183975 Jul 14 15:13:34.532623 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3154/6346] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:34 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:35.452865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-13b20607-d4c3-405f-bc53-575a351eccbb req-bcb09d6d-9eac-40d3-bad1-d8fc7dd85aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e8e1f8-a400-4d55-afd6-32d97f8e10de", "name": "network-vif-unplugged", "status": "completed", "tag": "b1f2ab2e-6755-4360-a82b-094874ac71c4"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:35.463311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-13b20607-d4c3-405f-bc53-575a351eccbb req-bcb09d6d-9eac-40d3-bad1-d8fc7dd85aec service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:35.463311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-13b20607-d4c3-405f-bc53-575a351eccbb req-bcb09d6d-9eac-40d3-bad1-d8fc7dd85aec service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:35.481009 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-13b20607-d4c3-405f-bc53-575a351eccbb req-bcb09d6d-9eac-40d3-bad1-d8fc7dd85aec service nova] Creating event network-vif-unplugged:b1f2ab2e-6755-4360-a82b-094874ac71c4 for instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de on n-h2-767704-28 Jul 14 15:13:35.487662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-13b20607-d4c3-405f-bc53-575a351eccbb req-bcb09d6d-9eac-40d3-bad1-d8fc7dd85aec service nova] Instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:13:35.503289 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-13b20607-d4c3-405f-bc53-575a351eccbb req-bcb09d6d-9eac-40d3-bad1-d8fc7dd85aec service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055676 Jul 14 15:13:35.503793 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3193/6347] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:35.552245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba3b8179-418e-4f80-891b-498617f54518 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:35.553928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ba3b8179-418e-4f80-891b-498617f54518 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:35.565879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba3b8179-418e-4f80-891b-498617f54518 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:35.567141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba3b8179-418e-4f80-891b-498617f54518 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:35.567992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba3b8179-418e-4f80-891b-498617f54518 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:35.568713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba3b8179-418e-4f80-891b-498617f54518 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:35.851385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ba3b8179-418e-4f80-891b-498617f54518 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:35.860285 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ba3b8179-418e-4f80-891b-498617f54518 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1688 microversion: 2.1 time: 0.313121 Jul 14 15:13:35.860975 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3155/6348] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:35 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1688 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:36.879936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2c7889b4-da85-4fc2-9fb8-97b69d341c49 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:36.880692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2c7889b4-da85-4fc2-9fb8-97b69d341c49 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:36.888698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c7889b4-da85-4fc2-9fb8-97b69d341c49 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:36.889208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c7889b4-da85-4fc2-9fb8-97b69d341c49 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:36.889994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c7889b4-da85-4fc2-9fb8-97b69d341c49 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:36.890450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c7889b4-da85-4fc2-9fb8-97b69d341c49 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:37.037124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2c7889b4-da85-4fc2-9fb8-97b69d341c49 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:37.046961 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2c7889b4-da85-4fc2-9fb8-97b69d341c49 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1688 microversion: 2.1 time: 0.171507 Jul 14 15:13:37.047639 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3194/6349] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:36 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:37.520410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1a543051-f320-485d-bdd5-a668703ef8c6 req-177a9031-ffb8-43b7-8acc-abb68dbeea4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e8e1f8-a400-4d55-afd6-32d97f8e10de", "tag": "b1f2ab2e-6755-4360-a82b-094874ac71c4"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:37.530263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1a543051-f320-485d-bdd5-a668703ef8c6 req-177a9031-ffb8-43b7-8acc-abb68dbeea4d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:37.530710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1a543051-f320-485d-bdd5-a668703ef8c6 req-177a9031-ffb8-43b7-8acc-abb68dbeea4d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:37.543574 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1a543051-f320-485d-bdd5-a668703ef8c6 req-177a9031-ffb8-43b7-8acc-abb68dbeea4d service nova] Creating event network-changed:b1f2ab2e-6755-4360-a82b-094874ac71c4 for instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de on n-h2-767704-28 Jul 14 15:13:37.549221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-1a543051-f320-485d-bdd5-a668703ef8c6 req-177a9031-ffb8-43b7-8acc-abb68dbeea4d service nova] Instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:13:37.560494 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1a543051-f320-485d-bdd5-a668703ef8c6 req-177a9031-ffb8-43b7-8acc-abb68dbeea4d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043662 Jul 14 15:13:37.561147 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3156/6350] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:38.066624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d9af758e-bd0d-4e3a-9be6-310599aa91ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:38.067540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d9af758e-bd0d-4e3a-9be6-310599aa91ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:38.076328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9af758e-bd0d-4e3a-9be6-310599aa91ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:38.076794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9af758e-bd0d-4e3a-9be6-310599aa91ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:38.077610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9af758e-bd0d-4e3a-9be6-310599aa91ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:38.078062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9af758e-bd0d-4e3a-9be6-310599aa91ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:38.710178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d9af758e-bd0d-4e3a-9be6-310599aa91ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:38.718716 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d9af758e-bd0d-4e3a-9be6-310599aa91ab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1688 microversion: 2.1 time: 0.656584 Jul 14 15:13:38.719314 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3195/6351] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:38 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1688 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:39.739130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fed1efaa-50af-42d3-8584-1a1ed582120d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:39.739829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fed1efaa-50af-42d3-8584-1a1ed582120d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:39.746911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fed1efaa-50af-42d3-8584-1a1ed582120d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:39.747360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fed1efaa-50af-42d3-8584-1a1ed582120d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:39.748128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fed1efaa-50af-42d3-8584-1a1ed582120d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:39.748919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fed1efaa-50af-42d3-8584-1a1ed582120d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:39.891659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fed1efaa-50af-42d3-8584-1a1ed582120d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:39.901052 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fed1efaa-50af-42d3-8584-1a1ed582120d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1681 microversion: 2.1 time: 0.167403 Jul 14 15:13:39.912711 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3157/6352] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:39 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:41.973254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-8c9745e3-7aeb-479c-bfd1-cde9936e9733 req-3b052590-5223-4648-bde1-ee0d4d5382bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e8e1f8-a400-4d55-afd6-32d97f8e10de", "name": "network-vif-plugged", "status": "completed", "tag": "b1f2ab2e-6755-4360-a82b-094874ac71c4"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:41.978762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=35 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:41.984178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8c9745e3-7aeb-479c-bfd1-cde9936e9733 req-3b052590-5223-4648-bde1-ee0d4d5382bc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:41.984643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8c9745e3-7aeb-479c-bfd1-cde9936e9733 req-3b052590-5223-4648-bde1-ee0d4d5382bc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:41.989006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=95 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:42.001232 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-8c9745e3-7aeb-479c-bfd1-cde9936e9733 req-3b052590-5223-4648-bde1-ee0d4d5382bc service nova] Creating event network-vif-plugged:b1f2ab2e-6755-4360-a82b-094874ac71c4 for instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de on n-h2-767704-28 Jul 14 15:13:42.006513 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-8c9745e3-7aeb-479c-bfd1-cde9936e9733 req-3b052590-5223-4648-bde1-ee0d4d5382bc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037027 Jul 14 15:13:42.007361 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3196/6353] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:08.111478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aebf5399-a2a1-4f7e-aa23-3b81b93b031a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:08.112402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aebf5399-a2a1-4f7e-aa23-3b81b93b031a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:08.114865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=40 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:08.115522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=19 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:08.123260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aebf5399-a2a1-4f7e-aa23-3b81b93b031a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:08.123714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aebf5399-a2a1-4f7e-aa23-3b81b93b031a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:08.124493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aebf5399-a2a1-4f7e-aa23-3b81b93b031a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:08.124933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aebf5399-a2a1-4f7e-aa23-3b81b93b031a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:08.186963 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aebf5399-a2a1-4f7e-aa23-3b81b93b031a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de/action" status: 200 len: 62100 microversion: 2.1 time: 0.079254 Jul 14 15:14:08.187541 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3158/6354] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:14:08 2022] POST /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de/action => generated 62100 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:14:14.574806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:14.575566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:14.579772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-12acc95a-f877-46ab-8f68-b89e0ca8b06d tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:14.580488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-12acc95a-f877-46ab-8f68-b89e0ca8b06d tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:14.587670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-12acc95a-f877-46ab-8f68-b89e0ca8b06d tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:14.588129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-12acc95a-f877-46ab-8f68-b89e0ca8b06d tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:14.588908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-12acc95a-f877-46ab-8f68-b89e0ca8b06d tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:14.589400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-12acc95a-f877-46ab-8f68-b89e0ca8b06d tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:14.733226 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-12acc95a-f877-46ab-8f68-b89e0ca8b06d tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1834 microversion: 2.1 time: 0.160727 Jul 14 15:14:14.733836 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3197/6355] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:14 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1834 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:15.628221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7c4ce451-df03-4e23-9388-ddfc2159dbeb tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:15.629757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7c4ce451-df03-4e23-9388-ddfc2159dbeb tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:15.635456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2cdb74fc-aa41-48da-9c84-d19def29ca72 req-c91d503a-2f20-4c46-a55d-033bfe9225f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e8e1f8-a400-4d55-afd6-32d97f8e10de", "tag": "b1f2ab2e-6755-4360-a82b-094874ac71c4"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:15.640785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c4ce451-df03-4e23-9388-ddfc2159dbeb tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:15.641766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c4ce451-df03-4e23-9388-ddfc2159dbeb tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:15.643132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c4ce451-df03-4e23-9388-ddfc2159dbeb tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:15.644056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7c4ce451-df03-4e23-9388-ddfc2159dbeb tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:15.648718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2cdb74fc-aa41-48da-9c84-d19def29ca72 req-c91d503a-2f20-4c46-a55d-033bfe9225f7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:15.649411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2cdb74fc-aa41-48da-9c84-d19def29ca72 req-c91d503a-2f20-4c46-a55d-033bfe9225f7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:15.661690 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2cdb74fc-aa41-48da-9c84-d19def29ca72 req-c91d503a-2f20-4c46-a55d-033bfe9225f7 service nova] Creating event network-changed:b1f2ab2e-6755-4360-a82b-094874ac71c4 for instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de on n-h2-767704-28 Jul 14 15:14:15.667916 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2cdb74fc-aa41-48da-9c84-d19def29ca72 req-c91d503a-2f20-4c46-a55d-033bfe9225f7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037495 Jul 14 15:14:15.668986 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3198/6356] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:15.675523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7c4ce451-df03-4e23-9388-ddfc2159dbeb tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:14:15.769964 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7c4ce451-df03-4e23-9388-ddfc2159dbeb tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "DELETE /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 204 len: 0 microversion: 2.1 time: 0.147830 Jul 14 15:14:15.774525 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3159/6357] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:14:15 2022] DELETE /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:14:15.780971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac840e89-6e83-4d1d-b111-5d164ab7e6ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:15.781814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac840e89-6e83-4d1d-b111-5d164ab7e6ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:15.789463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac840e89-6e83-4d1d-b111-5d164ab7e6ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:15.790114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac840e89-6e83-4d1d-b111-5d164ab7e6ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:15.791582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac840e89-6e83-4d1d-b111-5d164ab7e6ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:15.792122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac840e89-6e83-4d1d-b111-5d164ab7e6ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:15.953835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac840e89-6e83-4d1d-b111-5d164ab7e6ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:15.963348 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac840e89-6e83-4d1d-b111-5d164ab7e6ac tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1687 microversion: 2.1 time: 0.186581 Jul 14 15:14:15.964690 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3199/6358] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:15 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:16.986199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-70b1ecc6-d43f-4a53-a1e1-b236fcd5e141 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:16.987038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-70b1ecc6-d43f-4a53-a1e1-b236fcd5e141 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:16.995218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-70b1ecc6-d43f-4a53-a1e1-b236fcd5e141 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:16.995679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-70b1ecc6-d43f-4a53-a1e1-b236fcd5e141 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:16.996500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-70b1ecc6-d43f-4a53-a1e1-b236fcd5e141 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:16.996976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-70b1ecc6-d43f-4a53-a1e1-b236fcd5e141 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:17.201794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-70b1ecc6-d43f-4a53-a1e1-b236fcd5e141 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:17.209881 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-70b1ecc6-d43f-4a53-a1e1-b236fcd5e141 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1687 microversion: 2.1 time: 0.229641 Jul 14 15:14:17.210558 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3160/6359] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:16 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1687 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:18.132665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0d44d5a2-bb5d-4076-9076-08e1f65463b0 req-7bb40389-cfe8-4b82-a71c-fb378d6d2dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e8e1f8-a400-4d55-afd6-32d97f8e10de", "name": "network-vif-deleted", "tag": "b1f2ab2e-6755-4360-a82b-094874ac71c4"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:18.141963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0d44d5a2-bb5d-4076-9076-08e1f65463b0 req-7bb40389-cfe8-4b82-a71c-fb378d6d2dae service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:18.142431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0d44d5a2-bb5d-4076-9076-08e1f65463b0 req-7bb40389-cfe8-4b82-a71c-fb378d6d2dae service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:18.155680 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0d44d5a2-bb5d-4076-9076-08e1f65463b0 req-7bb40389-cfe8-4b82-a71c-fb378d6d2dae service nova] Creating event network-vif-deleted:b1f2ab2e-6755-4360-a82b-094874ac71c4 for instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de on n-h2-767704-28 Jul 14 15:14:18.161183 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0d44d5a2-bb5d-4076-9076-08e1f65463b0 req-7bb40389-cfe8-4b82-a71c-fb378d6d2dae service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134198 Jul 14 15:14:18.161906 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3200/6360] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:18.228635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a4dfbdea-34fd-48a6-8d4e-628ad515f457 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:18.229209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a4dfbdea-34fd-48a6-8d4e-628ad515f457 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:18.236389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4dfbdea-34fd-48a6-8d4e-628ad515f457 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:18.236848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4dfbdea-34fd-48a6-8d4e-628ad515f457 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:18.237660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4dfbdea-34fd-48a6-8d4e-628ad515f457 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:18.238108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4dfbdea-34fd-48a6-8d4e-628ad515f457 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:18.275471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4dfbdea-34fd-48a6-8d4e-628ad515f457 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:18.275834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a4dfbdea-34fd-48a6-8d4e-628ad515f457 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:18.276298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-a4dfbdea-34fd-48a6-8d4e-628ad515f457 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lazy-loading 'fault' on Instance uuid 16e8e1f8-a400-4d55-afd6-32d97f8e10de {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:14:18.331251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a4dfbdea-34fd-48a6-8d4e-628ad515f457 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:18.339535 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a4dfbdea-34fd-48a6-8d4e-628ad515f457 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 200 len: 1356 microversion: 2.1 time: 0.115671 Jul 14 15:14:18.340152 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3161/6361] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:18 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 1356 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:19.358323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-07618302-db56-470c-abda-88425726a045 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:19.359037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-07618302-db56-470c-abda-88425726a045 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 16e8e1f8-a400-4d55-afd6-32d97f8e10de] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:19.365419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-07618302-db56-470c-abda-88425726a045 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:19.365890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-07618302-db56-470c-abda-88425726a045 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:19.366669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-07618302-db56-470c-abda-88425726a045 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:19.367121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-07618302-db56-470c-abda-88425726a045 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:19.384149 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-07618302-db56-470c-abda-88425726a045 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] HTTP exception thrown: Instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de could not be found. Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-07618302-db56-470c-abda-88425726a045 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Request method failure captured: Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de HTTP/1.1 Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DHFbUVubDuVF53yv_hAYoRSg03MNLuaI6bcv8WHLK023TaoiaaNU4yFpijpq2LrcAAQelnsE31SulB5eXwDSO_UCvUxMum-xZRFYpLdlCTFeCSgR_tLStNg3XZcIgUo7xuqh7ojaAOn_gWBQ2r_asoQUBer3Pl4ERYsBV9nV3cW5m0 Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 24625820309f4411bb0b517b6ebb6583 Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-752443759 Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24625820309f4411bb0b517b6ebb6583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24625820309f4411bb0b517b6ebb6583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24625820309f4411bb0b517b6ebb6583", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24625820309f4411bb0b517b6ebb6583"}]}] Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestNetworkAdvancedServerOps-752443759 Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 24625820309f4411bb0b517b6ebb6583 Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-752443759 Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestNetworkAdvancedServerOps-752443759-project Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 2c0f965a2f344bd69b0fc157fe02ffda Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestNetworkAdvancedServerOps-752443759-project Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de could not be found. Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '16e8e1f8-a400-4d55-afd6-32d97f8e10de'} Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de could not be found. Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de could not be found. Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:19.385874 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:14:19.391443 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:19.391443 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:19.391443 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:19.391443 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:14:19.391443 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:14:19.391443 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de could not be found. Jul 14 15:14:19.391443 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:14:19.391443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-07618302-db56-470c-abda-88425726a045 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Returning 404 to user: Instance 16e8e1f8-a400-4d55-afd6-32d97f8e10de could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:14:19.391443 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-07618302-db56-470c-abda-88425726a045 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de" status: 404 len: 111 microversion: 2.1 time: 0.034079 Jul 14 15:14:19.391443 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3201/6362] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:19 2022] GET /compute/v2.1/servers/16e8e1f8-a400-4d55-afd6-32d97f8e10de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:14:22.835815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-96bd7bb9-2dc9-4cbc-bd4b-25da69a9c7fc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '.version_select at 0x7fd6c43a80d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:22.859768 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-96bd7bb9-2dc9-4cbc-bd4b-25da69a9c7fc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-826565196" status: 202 len: 0 microversion: 2.1 time: 0.027752 Jul 14 15:14:22.860536 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3162/6363] 10.222.0.81 () {58 vars in 1280 bytes} [Thu Jul 14 15:14:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-826565196 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:14:22.897756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fa490e37-c54b-442c-93c5-622c75636e1d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'create', calling method: .version_select at 0x7fd6c569eaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-982345853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHymjRp3U5qImqXjAFqxYucC+38niXKPw09gjfwOGSFxAvsge1W17++IwIOJtjCnSbGbVYUH+bkF23ma2kzqbkighJJDo/dyDvhmQ99lvqprbmgJFQi8OUzm2ZioAX7qBg=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:22.914208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-fa490e37-c54b-442c-93c5-622c75636e1d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for project 24625820309f4411bb0b517b6ebb6583. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:14:22.921537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-fa490e37-c54b-442c-93c5-622c75636e1d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for user 2c0f965a2f344bd69b0fc157fe02ffda and project 24625820309f4411bb0b517b6ebb6583. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:14:22.946384 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fa490e37-c54b-442c-93c5-622c75636e1d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052223 Jul 14 15:14:22.946991 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3202/6364] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:14:22 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:28.864222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:28.869542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-675645491", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "f1f4c76a-8c71-45cf-b091-f70a6bfeb6b2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-982345853", "security_groups": [{"name": "tempest-secgroup-smoke-463357243"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:28.995118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] validate_networks() for [('f1f4c76a-8c71-45cf-b091-f70a6bfeb6b2', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:14:29.560670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:14:29.561974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:14:29.562602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:14:29.563126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:14:29.563620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:14:29.575171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:29.576867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:29.580026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:29.587999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:29.634992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for project 24625820309f4411bb0b517b6ebb6583. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:14:29.642778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for user 2c0f965a2f344bd69b0fc157fe02ffda and project 24625820309f4411bb0b517b6ebb6583. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:14:29.658923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:14:29.661348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:14:29.735990 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a93c2638-732f-4295-98e3-9e5cbb912b5b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.873613 Jul 14 15:14:29.743276 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3163/6365] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:14:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:14:29.752110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=18 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:29.761779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8d5c63df-2dfc-4f73-8d97-f782bb9089f8 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:29.762403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8d5c63df-2dfc-4f73-8d97-f782bb9089f8 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:29.848892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8d5c63df-2dfc-4f73-8d97-f782bb9089f8 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:29.856900 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8d5c63df-2dfc-4f73-8d97-f782bb9089f8 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1265 microversion: 2.1 time: 0.106832 Jul 14 15:14:29.864285 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3203/6366] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:29 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:30.877263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a01fa571-0264-4c74-a46c-e2b0dd667274 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:30.878436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a01fa571-0264-4c74-a46c-e2b0dd667274 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:30.888189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a01fa571-0264-4c74-a46c-e2b0dd667274 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:30.888646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a01fa571-0264-4c74-a46c-e2b0dd667274 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:30.889784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a01fa571-0264-4c74-a46c-e2b0dd667274 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:30.890432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a01fa571-0264-4c74-a46c-e2b0dd667274 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:31.035479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a01fa571-0264-4c74-a46c-e2b0dd667274 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:31.049970 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a01fa571-0264-4c74-a46c-e2b0dd667274 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1317 microversion: 2.1 time: 0.178954 Jul 14 15:14:31.051490 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3164/6367] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:30 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:32.070459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-40253a51-84f8-4d7b-bcad-de51d8afa486 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:32.072113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-40253a51-84f8-4d7b-bcad-de51d8afa486 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:32.088068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40253a51-84f8-4d7b-bcad-de51d8afa486 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:32.090452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40253a51-84f8-4d7b-bcad-de51d8afa486 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:32.094939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40253a51-84f8-4d7b-bcad-de51d8afa486 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:32.095672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40253a51-84f8-4d7b-bcad-de51d8afa486 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:32.350564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-40253a51-84f8-4d7b-bcad-de51d8afa486 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:32.358883 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-40253a51-84f8-4d7b-bcad-de51d8afa486 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1390 microversion: 2.1 time: 0.294713 Jul 14 15:14:32.359471 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3204/6368] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:32 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1390 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:32.979369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6aebda77-dd4a-420c-a492-11fb654c7bfa req-66029408-06f0-46f2-8806-b4b5986bbbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ae1e31-e426-4453-b80d-d42cd115b137", "tag": "9023bf3a-83c4-4ac7-bc84-da12796546f2"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:32.990923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6aebda77-dd4a-420c-a492-11fb654c7bfa req-66029408-06f0-46f2-8806-b4b5986bbbd7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:32.991391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6aebda77-dd4a-420c-a492-11fb654c7bfa req-66029408-06f0-46f2-8806-b4b5986bbbd7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:33.006973 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6aebda77-dd4a-420c-a492-11fb654c7bfa req-66029408-06f0-46f2-8806-b4b5986bbbd7 service nova] Creating event network-changed:9023bf3a-83c4-4ac7-bc84-da12796546f2 for instance e9ae1e31-e426-4453-b80d-d42cd115b137 on n-h2-767704-28 Jul 14 15:14:33.012793 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6aebda77-dd4a-420c-a492-11fb654c7bfa req-66029408-06f0-46f2-8806-b4b5986bbbd7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046532 Jul 14 15:14:33.013458 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3165/6369] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:33.377112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f3c6c94d-bc9c-46dd-a8a6-158e7b4bca46 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:33.377755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f3c6c94d-bc9c-46dd-a8a6-158e7b4bca46 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:33.386317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3c6c94d-bc9c-46dd-a8a6-158e7b4bca46 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:33.386792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3c6c94d-bc9c-46dd-a8a6-158e7b4bca46 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:33.387597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3c6c94d-bc9c-46dd-a8a6-158e7b4bca46 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:33.388060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3c6c94d-bc9c-46dd-a8a6-158e7b4bca46 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:33.532040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f3c6c94d-bc9c-46dd-a8a6-158e7b4bca46 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:33.539721 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f3c6c94d-bc9c-46dd-a8a6-158e7b4bca46 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1390 microversion: 2.1 time: 0.166808 Jul 14 15:14:33.540301 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3205/6370] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:33 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:34.558769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c7d73c6-2f19-4596-b73b-563bb6302b22 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:34.559485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3c7d73c6-2f19-4596-b73b-563bb6302b22 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:34.565956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c7d73c6-2f19-4596-b73b-563bb6302b22 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:34.566416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c7d73c6-2f19-4596-b73b-563bb6302b22 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:34.567197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c7d73c6-2f19-4596-b73b-563bb6302b22 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:34.567641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c7d73c6-2f19-4596-b73b-563bb6302b22 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:34.793873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3c7d73c6-2f19-4596-b73b-563bb6302b22 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:34.801694 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3c7d73c6-2f19-4596-b73b-563bb6302b22 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1390 microversion: 2.1 time: 0.248303 Jul 14 15:14:34.802281 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3166/6371] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:34 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1390 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:35.819336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2cba2b54-0224-4385-b430-25260c623fab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:35.819970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2cba2b54-0224-4385-b430-25260c623fab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:35.827635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2cba2b54-0224-4385-b430-25260c623fab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:35.828106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2cba2b54-0224-4385-b430-25260c623fab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:35.828909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2cba2b54-0224-4385-b430-25260c623fab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:35.829381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2cba2b54-0224-4385-b430-25260c623fab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:35.969703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2cba2b54-0224-4385-b430-25260c623fab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:35.977315 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2cba2b54-0224-4385-b430-25260c623fab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1390 microversion: 2.1 time: 0.161912 Jul 14 15:14:35.977888 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3206/6372] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:35 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:36.996000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6bc37809-353f-4e64-84dd-d8e203cbb6a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:36.996626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6bc37809-353f-4e64-84dd-d8e203cbb6a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:37.005439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6bc37809-353f-4e64-84dd-d8e203cbb6a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:37.005904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6bc37809-353f-4e64-84dd-d8e203cbb6a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:37.006735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6bc37809-353f-4e64-84dd-d8e203cbb6a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:37.007149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6bc37809-353f-4e64-84dd-d8e203cbb6a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:37.146075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6bc37809-353f-4e64-84dd-d8e203cbb6a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:37.153949 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6bc37809-353f-4e64-84dd-d8e203cbb6a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1390 microversion: 2.1 time: 0.163522 Jul 14 15:14:37.154531 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3167/6373] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:36 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:38.160744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0e0cd681-b7b1-4602-abd4-c007b24a787a req-ef601c63-f256-406c-a8e2-553ba00f9614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ae1e31-e426-4453-b80d-d42cd115b137", "name": "network-vif-plugged", "status": "completed", "tag": "9023bf3a-83c4-4ac7-bc84-da12796546f2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:38.171058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0e0cd681-b7b1-4602-abd4-c007b24a787a req-ef601c63-f256-406c-a8e2-553ba00f9614 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:38.171663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0e0cd681-b7b1-4602-abd4-c007b24a787a req-ef601c63-f256-406c-a8e2-553ba00f9614 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:38.172093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f6678fda-b5e8-45c0-8dd0-ead51583bb88 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:38.172704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f6678fda-b5e8-45c0-8dd0-ead51583bb88 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:38.179146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:38.181974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6678fda-b5e8-45c0-8dd0-ead51583bb88 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:38.182773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6678fda-b5e8-45c0-8dd0-ead51583bb88 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:38.183751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6678fda-b5e8-45c0-8dd0-ead51583bb88 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:38.184363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f6678fda-b5e8-45c0-8dd0-ead51583bb88 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:38.190632 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0e0cd681-b7b1-4602-abd4-c007b24a787a req-ef601c63-f256-406c-a8e2-553ba00f9614 service nova] Creating event network-vif-plugged:9023bf3a-83c4-4ac7-bc84-da12796546f2 for instance e9ae1e31-e426-4453-b80d-d42cd115b137 on n-h2-767704-28 Jul 14 15:14:38.199691 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0e0cd681-b7b1-4602-abd4-c007b24a787a req-ef601c63-f256-406c-a8e2-553ba00f9614 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043010 Jul 14 15:14:38.201134 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3207/6374] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:38.382326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f6678fda-b5e8-45c0-8dd0-ead51583bb88 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:38.390665 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f6678fda-b5e8-45c0-8dd0-ead51583bb88 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1390 microversion: 2.1 time: 0.223217 Jul 14 15:14:38.391261 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3168/6375] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:38 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1390 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:14:39.408959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-66e9ae4e-dbc1-4ccf-a72e-a99da5da888d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:39.409740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-66e9ae4e-dbc1-4ccf-a72e-a99da5da888d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:39.418349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66e9ae4e-dbc1-4ccf-a72e-a99da5da888d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:39.418826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66e9ae4e-dbc1-4ccf-a72e-a99da5da888d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:39.419621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66e9ae4e-dbc1-4ccf-a72e-a99da5da888d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:39.420085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66e9ae4e-dbc1-4ccf-a72e-a99da5da888d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:39.557904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-66e9ae4e-dbc1-4ccf-a72e-a99da5da888d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:39.565537 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-66e9ae4e-dbc1-4ccf-a72e-a99da5da888d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1390 microversion: 2.1 time: 0.160855 Jul 14 15:14:39.566127 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3208/6376] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:39 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:40.583444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e650f0fd-ed43-4bf4-b584-bdaeaa004bdc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:40.584047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e650f0fd-ed43-4bf4-b584-bdaeaa004bdc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:40.586767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:40.587959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:40.594252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e650f0fd-ed43-4bf4-b584-bdaeaa004bdc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:40.594703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e650f0fd-ed43-4bf4-b584-bdaeaa004bdc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:40.595488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e650f0fd-ed43-4bf4-b584-bdaeaa004bdc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:40.595921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e650f0fd-ed43-4bf4-b584-bdaeaa004bdc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:40.741570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e650f0fd-ed43-4bf4-b584-bdaeaa004bdc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:40.749371 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e650f0fd-ed43-4bf4-b584-bdaeaa004bdc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1562 microversion: 2.1 time: 0.170001 Jul 14 15:14:40.749955 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3169/6377] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:40 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:40.766281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c0247a8d-b586-42da-a3bc-882d9153d5b8 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:40.766913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c0247a8d-b586-42da-a3bc-882d9153d5b8 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:40.769027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:40.776254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0247a8d-b586-42da-a3bc-882d9153d5b8 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:40.776727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0247a8d-b586-42da-a3bc-882d9153d5b8 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:40.777554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0247a8d-b586-42da-a3bc-882d9153d5b8 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:40.778017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0247a8d-b586-42da-a3bc-882d9153d5b8 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:40.919984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c0247a8d-b586-42da-a3bc-882d9153d5b8 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:40.927744 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c0247a8d-b586-42da-a3bc-882d9153d5b8 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1562 microversion: 2.1 time: 0.165422 Jul 14 15:14:40.928333 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3209/6378] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:40 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:42.689525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0e48a72e-97cf-4334-a97a-08d26dd2d0bb req-0e66d177-64c1-4c8b-a779-804eb5083378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ae1e31-e426-4453-b80d-d42cd115b137", "tag": "9023bf3a-83c4-4ac7-bc84-da12796546f2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:42.695732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6fe5887c-d9fe-4a33-9236-19f0b4175624 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:42.696574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6fe5887c-d9fe-4a33-9236-19f0b4175624 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:42.705284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fe5887c-d9fe-4a33-9236-19f0b4175624 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:42.705743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fe5887c-d9fe-4a33-9236-19f0b4175624 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:42.706526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fe5887c-d9fe-4a33-9236-19f0b4175624 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:42.706962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6fe5887c-d9fe-4a33-9236-19f0b4175624 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:42.715557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0e48a72e-97cf-4334-a97a-08d26dd2d0bb req-0e66d177-64c1-4c8b-a779-804eb5083378 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:42.715809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0e48a72e-97cf-4334-a97a-08d26dd2d0bb req-0e66d177-64c1-4c8b-a779-804eb5083378 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:42.730079 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0e48a72e-97cf-4334-a97a-08d26dd2d0bb req-0e66d177-64c1-4c8b-a779-804eb5083378 service nova] Creating event network-changed:9023bf3a-83c4-4ac7-bc84-da12796546f2 for instance e9ae1e31-e426-4453-b80d-d42cd115b137 on n-h2-767704-28 Jul 14 15:14:42.737725 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0e48a72e-97cf-4334-a97a-08d26dd2d0bb req-0e66d177-64c1-4c8b-a779-804eb5083378 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051295 Jul 14 15:14:42.739171 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3210/6379] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:43.057679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6fe5887c-d9fe-4a33-9236-19f0b4175624 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:43.065658 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6fe5887c-d9fe-4a33-9236-19f0b4175624 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1562 microversion: 2.1 time: 0.384784 Jul 14 15:14:43.066503 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3170/6380] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:42 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1562 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:48.468450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-28b528b4-68fe-462f-90f3-fa741559425a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:48.469376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-28b528b4-68fe-462f-90f3-fa741559425a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:48.470376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6825507f-bb92-417e-8f2d-663831fc8296 req-5d24a09a-bdf5-4479-8783-62ad7fd81739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e99786-d56c-4847-90e0-948ef26fe51c", "tag": "62956400-473b-4bdf-89e0-cfc7c625af30"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:48.474639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:48.479006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28b528b4-68fe-462f-90f3-fa741559425a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:48.479486 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28b528b4-68fe-462f-90f3-fa741559425a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:48.480486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6825507f-bb92-417e-8f2d-663831fc8296 req-5d24a09a-bdf5-4479-8783-62ad7fd81739 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:48.481059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6825507f-bb92-417e-8f2d-663831fc8296 req-5d24a09a-bdf5-4479-8783-62ad7fd81739 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:48.481294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28b528b4-68fe-462f-90f3-fa741559425a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:48.481969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28b528b4-68fe-462f-90f3-fa741559425a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:48.497113 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6825507f-bb92-417e-8f2d-663831fc8296 req-5d24a09a-bdf5-4479-8783-62ad7fd81739 service nova] Creating event network-changed:62956400-473b-4bdf-89e0-cfc7c625af30 for instance c9e99786-d56c-4847-90e0-948ef26fe51c on n-h1-767704-28 Jul 14 15:14:48.502857 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6825507f-bb92-417e-8f2d-663831fc8296 req-5d24a09a-bdf5-4479-8783-62ad7fd81739 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037677 Jul 14 15:14:48.503888 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3171/6381] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:14:48.514549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-28b528b4-68fe-462f-90f3-fa741559425a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:14:48.614053 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-28b528b4-68fe-462f-90f3-fa741559425a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 204 len: 0 microversion: 2.1 time: 0.151067 Jul 14 15:14:48.618239 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3211/6382] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:14:48 2022] DELETE /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:14:48.626560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7e58fe17-9d3d-4b2f-b31f-aa0320c51f1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:48.627304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7e58fe17-9d3d-4b2f-b31f-aa0320c51f1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:48.635718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e58fe17-9d3d-4b2f-b31f-aa0320c51f1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:48.636217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e58fe17-9d3d-4b2f-b31f-aa0320c51f1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:48.637388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e58fe17-9d3d-4b2f-b31f-aa0320c51f1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:48.638101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e58fe17-9d3d-4b2f-b31f-aa0320c51f1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:48.785960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7e58fe17-9d3d-4b2f-b31f-aa0320c51f1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:48.794006 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7e58fe17-9d3d-4b2f-b31f-aa0320c51f1a tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1575 microversion: 2.1 time: 0.173041 Jul 14 15:14:48.794663 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3172/6383] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:48 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:49.812299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-453d0b00-c5ea-4332-afa3-8d92250484b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:49.813050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-453d0b00-c5ea-4332-afa3-8d92250484b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:49.819982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-453d0b00-c5ea-4332-afa3-8d92250484b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:49.820447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-453d0b00-c5ea-4332-afa3-8d92250484b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:49.821259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-453d0b00-c5ea-4332-afa3-8d92250484b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:49.821717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-453d0b00-c5ea-4332-afa3-8d92250484b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:50.019816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-453d0b00-c5ea-4332-afa3-8d92250484b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:50.027633 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-453d0b00-c5ea-4332-afa3-8d92250484b7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1575 microversion: 2.1 time: 0.219690 Jul 14 15:14:50.028227 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3212/6384] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:49 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:51.046232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eaf24757-875c-4b3e-856f-e1e885bdb22c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:51.046890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eaf24757-875c-4b3e-856f-e1e885bdb22c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:51.056070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eaf24757-875c-4b3e-856f-e1e885bdb22c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:51.056573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eaf24757-875c-4b3e-856f-e1e885bdb22c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:51.057926 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eaf24757-875c-4b3e-856f-e1e885bdb22c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:51.058657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eaf24757-875c-4b3e-856f-e1e885bdb22c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:51.262107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eaf24757-875c-4b3e-856f-e1e885bdb22c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:51.270428 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eaf24757-875c-4b3e-856f-e1e885bdb22c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1456 microversion: 2.1 time: 0.228330 Jul 14 15:14:51.271021 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3173/6385] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:51 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1456 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:51.418681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b869ccd5-04aa-4faf-b707-70954b426a47 req-c6d3deea-bd77-425b-a16f-9c245b3dc849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e99786-d56c-4847-90e0-948ef26fe51c", "name": "network-vif-deleted", "tag": "62956400-473b-4bdf-89e0-cfc7c625af30"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:51.429803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b869ccd5-04aa-4faf-b707-70954b426a47 req-c6d3deea-bd77-425b-a16f-9c245b3dc849 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:51.430266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b869ccd5-04aa-4faf-b707-70954b426a47 req-c6d3deea-bd77-425b-a16f-9c245b3dc849 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:51.444284 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b869ccd5-04aa-4faf-b707-70954b426a47 req-c6d3deea-bd77-425b-a16f-9c245b3dc849 service nova] Creating event network-vif-deleted:62956400-473b-4bdf-89e0-cfc7c625af30 for instance c9e99786-d56c-4847-90e0-948ef26fe51c on n-h1-767704-28 Jul 14 15:14:51.450775 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b869ccd5-04aa-4faf-b707-70954b426a47 req-c6d3deea-bd77-425b-a16f-9c245b3dc849 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036407 Jul 14 15:14:51.451785 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3213/6386] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:52.291939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-42f71e7b-2076-409b-8e7f-ffae1fae320c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:52.292596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-42f71e7b-2076-409b-8e7f-ffae1fae320c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:52.300665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42f71e7b-2076-409b-8e7f-ffae1fae320c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:52.301158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42f71e7b-2076-409b-8e7f-ffae1fae320c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:52.301944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42f71e7b-2076-409b-8e7f-ffae1fae320c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:52.302382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-42f71e7b-2076-409b-8e7f-ffae1fae320c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:52.372529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-42f71e7b-2076-409b-8e7f-ffae1fae320c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:52.380791 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-42f71e7b-2076-409b-8e7f-ffae1fae320c tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1224 microversion: 2.1 time: 0.092850 Jul 14 15:14:52.381433 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3174/6387] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:52 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:53.400235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5fdef65e-9ec4-47c4-9a72-00c0675d5dcc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:53.400865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5fdef65e-9ec4-47c4-9a72-00c0675d5dcc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:53.410656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fdef65e-9ec4-47c4-9a72-00c0675d5dcc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:53.410873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fdef65e-9ec4-47c4-9a72-00c0675d5dcc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:53.411835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fdef65e-9ec4-47c4-9a72-00c0675d5dcc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:53.412303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fdef65e-9ec4-47c4-9a72-00c0675d5dcc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:53.489508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5fdef65e-9ec4-47c4-9a72-00c0675d5dcc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:53.497614 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5fdef65e-9ec4-47c4-9a72-00c0675d5dcc tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1224 microversion: 2.1 time: 0.101690 Jul 14 15:14:53.498204 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3214/6388] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:53 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:54.515119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-db95dc79-28ae-49f7-90c8-a4ac75be7bf5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:54.515714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-db95dc79-28ae-49f7-90c8-a4ac75be7bf5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:54.522566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db95dc79-28ae-49f7-90c8-a4ac75be7bf5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:54.523046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db95dc79-28ae-49f7-90c8-a4ac75be7bf5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:54.523840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db95dc79-28ae-49f7-90c8-a4ac75be7bf5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:54.524307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db95dc79-28ae-49f7-90c8-a4ac75be7bf5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:54.595120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-db95dc79-28ae-49f7-90c8-a4ac75be7bf5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:54.603048 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-db95dc79-28ae-49f7-90c8-a4ac75be7bf5 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1224 microversion: 2.1 time: 0.092036 Jul 14 15:14:54.603636 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3175/6389] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:54 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:55.623027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-96fd6750-9be8-463d-9dbd-2f97ca3e6765 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:55.623649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-96fd6750-9be8-463d-9dbd-2f97ca3e6765 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:55.632223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96fd6750-9be8-463d-9dbd-2f97ca3e6765 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:55.632726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96fd6750-9be8-463d-9dbd-2f97ca3e6765 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:55.633718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96fd6750-9be8-463d-9dbd-2f97ca3e6765 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:55.634199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96fd6750-9be8-463d-9dbd-2f97ca3e6765 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:55.706967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-96fd6750-9be8-463d-9dbd-2f97ca3e6765 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:55.716405 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-96fd6750-9be8-463d-9dbd-2f97ca3e6765 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 200 len: 1224 microversion: 2.1 time: 0.098513 Jul 14 15:14:55.717109 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3215/6390] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:55 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:56.733839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7f279480-a546-4f48-a456-1b2e2f16e3dd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:56.734441 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7f279480-a546-4f48-a456-1b2e2f16e3dd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: c9e99786-d56c-4847-90e0-948ef26fe51c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:56.741397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f279480-a546-4f48-a456-1b2e2f16e3dd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:56.741849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f279480-a546-4f48-a456-1b2e2f16e3dd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:56.742608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f279480-a546-4f48-a456-1b2e2f16e3dd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:56.743047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f279480-a546-4f48-a456-1b2e2f16e3dd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:56.757309 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-7f279480-a546-4f48-a456-1b2e2f16e3dd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance c9e99786-d56c-4847-90e0-948ef26fe51c could not be found. Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7f279480-a546-4f48-a456-1b2e2f16e3dd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c HTTP/1.1 Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance c9e99786-d56c-4847-90e0-948ef26fe51c could not be found. Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'c9e99786-d56c-4847-90e0-948ef26fe51c'} Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e99786-d56c-4847-90e0-948ef26fe51c could not be found. Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e99786-d56c-4847-90e0-948ef26fe51c could not be found. Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:56.758999 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:14:56.763990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:56.763990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:56.763990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:56.763990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:14:56.763990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:14:56.763990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e99786-d56c-4847-90e0-948ef26fe51c could not be found. Jul 14 15:14:56.763990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:14:56.763990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7f279480-a546-4f48-a456-1b2e2f16e3dd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance c9e99786-d56c-4847-90e0-948ef26fe51c could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:14:56.763990 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7f279480-a546-4f48-a456-1b2e2f16e3dd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c" status: 404 len: 111 microversion: 2.1 time: 0.031124 Jul 14 15:14:56.763990 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3176/6391] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:56 2022] GET /compute/v2.1/servers/c9e99786-d56c-4847-90e0-948ef26fe51c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:02.998934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-20870471-6acb-4fe4-a549-a86e0708b2db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:02.999495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-20870471-6acb-4fe4-a549-a86e0708b2db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:03.009188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20870471-6acb-4fe4-a549-a86e0708b2db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:03.009747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20870471-6acb-4fe4-a549-a86e0708b2db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:03.010560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20870471-6acb-4fe4-a549-a86e0708b2db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:03.011164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20870471-6acb-4fe4-a549-a86e0708b2db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:03.016144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:03.051734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-20870471-6acb-4fe4-a549-a86e0708b2db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:15:03.080999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-334b8189-be40-4cd3-a0bb-b02f9542d9f1 req-b7513a5c-b1f2-43dc-aec1-a1ee7fbc32f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab371da2-5cbd-4ec5-b5e1-c016e221738b", "tag": "27c9fe9c-e43f-4879-92c1-03edd95a45e5"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:03.091164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-334b8189-be40-4cd3-a0bb-b02f9542d9f1 req-b7513a5c-b1f2-43dc-aec1-a1ee7fbc32f1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:03.092149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-334b8189-be40-4cd3-a0bb-b02f9542d9f1 req-b7513a5c-b1f2-43dc-aec1-a1ee7fbc32f1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:03.096823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=69 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:03.107004 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-334b8189-be40-4cd3-a0bb-b02f9542d9f1 req-b7513a5c-b1f2-43dc-aec1-a1ee7fbc32f1 service nova] Creating event network-changed:27c9fe9c-e43f-4879-92c1-03edd95a45e5 for instance ab371da2-5cbd-4ec5-b5e1-c016e221738b on n-h1-767704-28 Jul 14 15:15:03.112926 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-334b8189-be40-4cd3-a0bb-b02f9542d9f1 req-b7513a5c-b1f2-43dc-aec1-a1ee7fbc32f1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115847 Jul 14 15:15:03.113716 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3177/6392] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:15:03.140207 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-20870471-6acb-4fe4-a549-a86e0708b2db tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 204 len: 0 microversion: 2.1 time: 0.145412 Jul 14 15:15:03.140885 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3216/6393] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:02 2022] DELETE /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:15:03.151184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5b61b7fe-9cd2-4144-bcf2-a60c2e3fcc05 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:03.152036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5b61b7fe-9cd2-4144-bcf2-a60c2e3fcc05 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:03.158968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b61b7fe-9cd2-4144-bcf2-a60c2e3fcc05 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:03.159426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b61b7fe-9cd2-4144-bcf2-a60c2e3fcc05 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:03.160202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b61b7fe-9cd2-4144-bcf2-a60c2e3fcc05 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:03.160649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b61b7fe-9cd2-4144-bcf2-a60c2e3fcc05 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:03.307329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5b61b7fe-9cd2-4144-bcf2-a60c2e3fcc05 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:03.315810 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5b61b7fe-9cd2-4144-bcf2-a60c2e3fcc05 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1575 microversion: 2.1 time: 0.170375 Jul 14 15:15:03.316385 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3178/6394] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:03 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:04.334058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c82aeecc-e9bf-4570-9702-89010c0103d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:04.334818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c82aeecc-e9bf-4570-9702-89010c0103d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:04.342145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c82aeecc-e9bf-4570-9702-89010c0103d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.342631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c82aeecc-e9bf-4570-9702-89010c0103d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.343434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c82aeecc-e9bf-4570-9702-89010c0103d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.343895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c82aeecc-e9bf-4570-9702-89010c0103d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.492843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c82aeecc-e9bf-4570-9702-89010c0103d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:04.501488 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c82aeecc-e9bf-4570-9702-89010c0103d7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1575 microversion: 2.1 time: 0.171746 Jul 14 15:15:04.502085 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3217/6395] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:04 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:05.521330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a680f6f8-7e85-4a4a-9883-96c3d0d20ed8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:05.522015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a680f6f8-7e85-4a4a-9883-96c3d0d20ed8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:05.529849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a680f6f8-7e85-4a4a-9883-96c3d0d20ed8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:05.530309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a680f6f8-7e85-4a4a-9883-96c3d0d20ed8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:05.531103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a680f6f8-7e85-4a4a-9883-96c3d0d20ed8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:05.531547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a680f6f8-7e85-4a4a-9883-96c3d0d20ed8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:05.771434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a680f6f8-7e85-4a4a-9883-96c3d0d20ed8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:05.780367 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a680f6f8-7e85-4a4a-9883-96c3d0d20ed8 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1575 microversion: 2.1 time: 0.264241 Jul 14 15:15:05.780968 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3179/6396] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:05 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1575 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:06.027228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-162ab703-37f1-4be7-8a5a-17956432e1d0 req-212aa98c-d9a4-42fe-a9a5-5c7dd85425dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab371da2-5cbd-4ec5-b5e1-c016e221738b", "name": "network-vif-deleted", "tag": "27c9fe9c-e43f-4879-92c1-03edd95a45e5"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:06.039140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-162ab703-37f1-4be7-8a5a-17956432e1d0 req-212aa98c-d9a4-42fe-a9a5-5c7dd85425dc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:06.039595 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-162ab703-37f1-4be7-8a5a-17956432e1d0 req-212aa98c-d9a4-42fe-a9a5-5c7dd85425dc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:06.052711 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-162ab703-37f1-4be7-8a5a-17956432e1d0 req-212aa98c-d9a4-42fe-a9a5-5c7dd85425dc service nova] Creating event network-vif-deleted:27c9fe9c-e43f-4879-92c1-03edd95a45e5 for instance ab371da2-5cbd-4ec5-b5e1-c016e221738b on n-h1-767704-28 Jul 14 15:15:06.057957 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-162ab703-37f1-4be7-8a5a-17956432e1d0 req-212aa98c-d9a4-42fe-a9a5-5c7dd85425dc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035000 Jul 14 15:15:06.058933 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3218/6397] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:15:06.798402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-27359339-b5a5-44a5-bab8-886b797673f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:06.799047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-27359339-b5a5-44a5-bab8-886b797673f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:06.806013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27359339-b5a5-44a5-bab8-886b797673f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:06.806468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27359339-b5a5-44a5-bab8-886b797673f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:06.807243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27359339-b5a5-44a5-bab8-886b797673f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:06.807747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27359339-b5a5-44a5-bab8-886b797673f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:06.873090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-27359339-b5a5-44a5-bab8-886b797673f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:06.882166 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-27359339-b5a5-44a5-bab8-886b797673f0 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1225 microversion: 2.1 time: 0.087650 Jul 14 15:15:06.882758 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3180/6398] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:06 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:15:07.906888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9af45d3f-23ba-49df-8d07-42aeb89957d9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:07.907629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9af45d3f-23ba-49df-8d07-42aeb89957d9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:07.915651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9af45d3f-23ba-49df-8d07-42aeb89957d9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:07.916083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9af45d3f-23ba-49df-8d07-42aeb89957d9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:07.918476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9af45d3f-23ba-49df-8d07-42aeb89957d9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:07.918476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9af45d3f-23ba-49df-8d07-42aeb89957d9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:07.987426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9af45d3f-23ba-49df-8d07-42aeb89957d9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:07.995540 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9af45d3f-23ba-49df-8d07-42aeb89957d9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1225 microversion: 2.1 time: 0.098682 Jul 14 15:15:07.996210 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3219/6399] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:07 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:08.397958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-194ec337-bbbc-48ce-a79f-7624d8abac19 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:08.398929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-194ec337-bbbc-48ce-a79f-7624d8abac19 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:08.400981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=26 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:08.407116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-194ec337-bbbc-48ce-a79f-7624d8abac19 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:08.407578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-194ec337-bbbc-48ce-a79f-7624d8abac19 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:08.408358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-194ec337-bbbc-48ce-a79f-7624d8abac19 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:08.408799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-194ec337-bbbc-48ce-a79f-7624d8abac19 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:08.463101 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-194ec337-bbbc-48ce-a79f-7624d8abac19 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137/action" status: 200 len: 24567 microversion: 2.1 time: 0.126333 Jul 14 15:15:08.463733 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3181/6400] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:15:08 2022] POST /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137/action => generated 24567 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:15:08.971134 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:15:08.971729 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:15:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:15:09.014050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5723c770-2fd6-4e19-bd12-2ce59b609959 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:09.015036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5723c770-2fd6-4e19-bd12-2ce59b609959 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:09.022307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5723c770-2fd6-4e19-bd12-2ce59b609959 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:09.023077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5723c770-2fd6-4e19-bd12-2ce59b609959 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:09.023864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5723c770-2fd6-4e19-bd12-2ce59b609959 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:09.024315 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5723c770-2fd6-4e19-bd12-2ce59b609959 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:09.092438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5723c770-2fd6-4e19-bd12-2ce59b609959 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:09.100223 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5723c770-2fd6-4e19-bd12-2ce59b609959 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1225 microversion: 2.1 time: 0.091151 Jul 14 15:15:09.100793 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3220/6401] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:09 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:10.119040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-269e7f59-7ff6-4850-8158-d2f2f472e5f7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:10.119659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-269e7f59-7ff6-4850-8158-d2f2f472e5f7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:10.128735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-269e7f59-7ff6-4850-8158-d2f2f472e5f7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:10.129246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-269e7f59-7ff6-4850-8158-d2f2f472e5f7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:10.130039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-269e7f59-7ff6-4850-8158-d2f2f472e5f7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:10.130485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-269e7f59-7ff6-4850-8158-d2f2f472e5f7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:10.205923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-269e7f59-7ff6-4850-8158-d2f2f472e5f7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77523cc1cca458eb2a1b553aff072be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a357b38aa86347a68c4135066aef2786', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:10.213641 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-269e7f59-7ff6-4850-8158-d2f2f472e5f7 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 200 len: 1225 microversion: 2.1 time: 0.099090 Jul 14 15:15:10.215139 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3182/6402] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:10 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:11.231750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-07fdb6e8-77a5-4481-ae53-3ee67ce6feae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:11.232375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-07fdb6e8-77a5-4481-ae53-3ee67ce6feae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: ab371da2-5cbd-4ec5-b5e1-c016e221738b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:11.239484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-07fdb6e8-77a5-4481-ae53-3ee67ce6feae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:11.239943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-07fdb6e8-77a5-4481-ae53-3ee67ce6feae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:11.240722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-07fdb6e8-77a5-4481-ae53-3ee67ce6feae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:11.241206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-07fdb6e8-77a5-4481-ae53-3ee67ce6feae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:11.255873 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-07fdb6e8-77a5-4481-ae53-3ee67ce6feae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance ab371da2-5cbd-4ec5-b5e1-c016e221738b could not be found. Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-07fdb6e8-77a5-4481-ae53-3ee67ce6feae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b HTTP/1.1 Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance ab371da2-5cbd-4ec5-b5e1-c016e221738b could not be found. Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'ab371da2-5cbd-4ec5-b5e1-c016e221738b'} Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab371da2-5cbd-4ec5-b5e1-c016e221738b could not be found. Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab371da2-5cbd-4ec5-b5e1-c016e221738b could not be found. Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:11.257566 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.263973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:11.263973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:11.263973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:11.263973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:11.263973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:11.263973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab371da2-5cbd-4ec5-b5e1-c016e221738b could not be found. Jul 14 15:15:11.263973 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.263973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-07fdb6e8-77a5-4481-ae53-3ee67ce6feae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance ab371da2-5cbd-4ec5-b5e1-c016e221738b could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:11.263973 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-07fdb6e8-77a5-4481-ae53-3ee67ce6feae tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b" status: 404 len: 111 microversion: 2.1 time: 0.031323 Jul 14 15:15:11.263973 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3221/6403] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:11 2022] GET /compute/v2.1/servers/ab371da2-5cbd-4ec5-b5e1-c016e221738b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:11.712684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0a5e1b23-c623-49b0-a4f6-e208db844cd9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:11.713269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0a5e1b23-c623-49b0-a4f6-e208db844cd9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:11.720470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a5e1b23-c623-49b0-a4f6-e208db844cd9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:11.720931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a5e1b23-c623-49b0-a4f6-e208db844cd9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:11.721742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a5e1b23-c623-49b0-a4f6-e208db844cd9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:11.722188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a5e1b23-c623-49b0-a4f6-e208db844cd9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:11.736906 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-0a5e1b23-c623-49b0-a4f6-e208db844cd9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0a5e1b23-c623-49b0-a4f6-e208db844cd9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 HTTP/1.1 Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '31932a71-c4d3-4b24-9574-859abc712fd4'} Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:11.738653 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0a5e1b23-c623-49b0-a4f6-e208db844cd9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0a5e1b23-c623-49b0-a4f6-e208db844cd9 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "DELETE /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 404 len: 111 microversion: 2.1 time: 0.031479 Jul 14 15:15:11.743289 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3183/6404] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:11 2022] DELETE /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:11.750361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ebf97334-eb9b-434f-8ef8-f7efe8d655bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:11.750998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ebf97334-eb9b-434f-8ef8-f7efe8d655bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] [instance: 31932a71-c4d3-4b24-9574-859abc712fd4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:11.757133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebf97334-eb9b-434f-8ef8-f7efe8d655bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:11.757894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebf97334-eb9b-434f-8ef8-f7efe8d655bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:11.758680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebf97334-eb9b-434f-8ef8-f7efe8d655bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:11.759144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebf97334-eb9b-434f-8ef8-f7efe8d655bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:11.772861 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-ebf97334-eb9b-434f-8ef8-f7efe8d655bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] HTTP exception thrown: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ebf97334-eb9b-434f-8ef8-f7efe8d655bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Request method failure captured: Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 HTTP/1.1 Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0C963W8bR08ZUqyNXrmwDyiauXr8KlD0SCCdO_v0tdYxufeRzDUp-R8l8ytADtVAnYDnAyMD2k98OrnfFRai2MOSIs5xKPTajKPGcGGV81bzvoQXnCBTfZlke2dN8GHo_Ry5nl7SOR0P6ZAHekrsYokfBJ_CnjVVW3YZG0vGSEsevKo Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a357b38aa86347a68c4135066aef2786"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a357b38aa86347a68c4135066aef2786", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a357b38aa86347a68c4135066aef2786"}]}] Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestVolumeBootPattern-754773811 Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: a357b38aa86347a68c4135066aef2786 Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestVolumeBootPattern-754773811 Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: e77523cc1cca458eb2a1b553aff072be Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestVolumeBootPattern-754773811-project Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '31932a71-c4d3-4b24-9574-859abc712fd4'} Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:11.774446 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.780346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:11.780346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:11.780346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:11.780346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:11.780346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:11.780346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. Jul 14 15:15:11.780346 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:11.780346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ebf97334-eb9b-434f-8ef8-f7efe8d655bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Returning 404 to user: Instance 31932a71-c4d3-4b24-9574-859abc712fd4 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:11.780346 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ebf97334-eb9b-434f-8ef8-f7efe8d655bd tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4" status: 404 len: 111 microversion: 2.1 time: 0.031423 Jul 14 15:15:11.781249 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3222/6405] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:11 2022] GET /compute/v2.1/servers/31932a71-c4d3-4b24-9574-859abc712fd4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:15.186848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0136c6a3-d1c7-4bfd-9c67-336f84cb4309 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] Calling method '.version_select at 0x7fd6c43a80d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:15.210917 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0136c6a3-d1c7-4bfd-9c67-336f84cb4309 tempest-TestVolumeBootPattern-754773811 tempest-TestVolumeBootPattern-754773811-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-296175840" status: 202 len: 0 microversion: 2.1 time: 0.028751 Jul 14 15:15:15.219229 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3184/6406] 10.222.0.81 () {58 vars in 1259 bytes} [Thu Jul 14 15:15:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-296175840 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:15:19.470813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9012abd4-4e3c-437a-8e45-f95eb85e101b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:19.471567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9012abd4-4e3c-437a-8e45-f95eb85e101b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:19.475459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:19.481287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9012abd4-4e3c-437a-8e45-f95eb85e101b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:19.481759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9012abd4-4e3c-437a-8e45-f95eb85e101b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:19.482709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9012abd4-4e3c-437a-8e45-f95eb85e101b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:19.483167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9012abd4-4e3c-437a-8e45-f95eb85e101b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:19.797461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9012abd4-4e3c-437a-8e45-f95eb85e101b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:19.805648 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9012abd4-4e3c-437a-8e45-f95eb85e101b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1681 microversion: 2.1 time: 0.338378 Jul 14 15:15:19.806046 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3223/6407] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:19 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1681 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:19.954694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1b4b0c3c-6b06-486e-ba1e-3b626fe519c3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:19.955634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1b4b0c3c-6b06-486e-ba1e-3b626fe519c3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:19.963836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b4b0c3c-6b06-486e-ba1e-3b626fe519c3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:19.965773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b4b0c3c-6b06-486e-ba1e-3b626fe519c3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:19.966662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b4b0c3c-6b06-486e-ba1e-3b626fe519c3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:19.967116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b4b0c3c-6b06-486e-ba1e-3b626fe519c3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:20.020494 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1b4b0c3c-6b06-486e-ba1e-3b626fe519c3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137/action" status: 200 len: 32640 microversion: 2.1 time: 0.069477 Jul 14 15:15:20.028119 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3185/6408] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:15:19 2022] POST /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137/action => generated 32640 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:15:20.363751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-22a8f624-227b-4e21-a89b-861e0e11f2c7 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:20.364379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-22a8f624-227b-4e21-a89b-861e0e11f2c7 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:20.371252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22a8f624-227b-4e21-a89b-861e0e11f2c7 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:20.371720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22a8f624-227b-4e21-a89b-861e0e11f2c7 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:20.372510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22a8f624-227b-4e21-a89b-861e0e11f2c7 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:20.372988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-22a8f624-227b-4e21-a89b-861e0e11f2c7 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:20.579837 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-22a8f624-227b-4e21-a89b-861e0e11f2c7 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1834 microversion: 2.1 time: 0.347231 Jul 14 15:15:20.580507 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3224/6409] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:20 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1834 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:20.605695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bc87985e-3a70-4b7d-89f3-514820c60b2a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:20.607303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bc87985e-3a70-4b7d-89f3-514820c60b2a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:20.614698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc87985e-3a70-4b7d-89f3-514820c60b2a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:20.615147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc87985e-3a70-4b7d-89f3-514820c60b2a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:20.615927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc87985e-3a70-4b7d-89f3-514820c60b2a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:20.616363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc87985e-3a70-4b7d-89f3-514820c60b2a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:20.644355 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-bc87985e-3a70-4b7d-89f3-514820c60b2a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lazy-loading 'flavor' on Instance uuid e9ae1e31-e426-4453-b80d-d42cd115b137 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:15:20.657470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bc87985e-3a70-4b7d-89f3-514820c60b2a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Going to try to live migrate instance to another host {{(pid=119511) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 15:15:22.641673 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bc87985e-3a70-4b7d-89f3-514820c60b2a tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137/action" status: 202 len: 0 microversion: 2.1 time: 2.040990 Jul 14 15:15:22.646148 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3186/6410] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:15:20 2022] POST /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137/action => generated 0 bytes in 2043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:15:22.652502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-49a26592-3648-437d-847f-7e41e5100f75 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:22.653497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-49a26592-3648-437d-847f-7e41e5100f75 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:22.662422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49a26592-3648-437d-847f-7e41e5100f75 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:22.662901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49a26592-3648-437d-847f-7e41e5100f75 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:22.663703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49a26592-3648-437d-847f-7e41e5100f75 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:22.664179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49a26592-3648-437d-847f-7e41e5100f75 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:22.847611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-49a26592-3648-437d-847f-7e41e5100f75 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:22.857583 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-49a26592-3648-437d-847f-7e41e5100f75 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1691 microversion: 2.1 time: 0.209776 Jul 14 15:15:22.858093 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3225/6411] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:22 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1691 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:23.876982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-87f262f7-83b7-4ef0-8aea-167cbb4f0b59 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:23.877634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-87f262f7-83b7-4ef0-8aea-167cbb4f0b59 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:23.887528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87f262f7-83b7-4ef0-8aea-167cbb4f0b59 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:23.888470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87f262f7-83b7-4ef0-8aea-167cbb4f0b59 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:23.889077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87f262f7-83b7-4ef0-8aea-167cbb4f0b59 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:23.889592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87f262f7-83b7-4ef0-8aea-167cbb4f0b59 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:24.040918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-77f6c567-7165-4529-bff6-364b0a0544fe req-f737a6c8-c2ae-4165-a982-6cd70b7c76fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ae1e31-e426-4453-b80d-d42cd115b137", "name": "network-vif-unplugged", "status": "completed", "tag": "9023bf3a-83c4-4ac7-bc84-da12796546f2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:24.052682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-77f6c567-7165-4529-bff6-364b0a0544fe req-f737a6c8-c2ae-4165-a982-6cd70b7c76fd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:24.053659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-77f6c567-7165-4529-bff6-364b0a0544fe req-f737a6c8-c2ae-4165-a982-6cd70b7c76fd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:24.066352 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-77f6c567-7165-4529-bff6-364b0a0544fe req-f737a6c8-c2ae-4165-a982-6cd70b7c76fd service nova] Creating event network-vif-unplugged:9023bf3a-83c4-4ac7-bc84-da12796546f2 for instance e9ae1e31-e426-4453-b80d-d42cd115b137 on n-h2-767704-28 Jul 14 15:15:24.071700 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-77f6c567-7165-4529-bff6-364b0a0544fe req-f737a6c8-c2ae-4165-a982-6cd70b7c76fd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034622 Jul 14 15:15:24.072458 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3226/6412] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:15:24.148186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-87f262f7-83b7-4ef0-8aea-167cbb4f0b59 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:24.159861 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-87f262f7-83b7-4ef0-8aea-167cbb4f0b59 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1691 microversion: 2.1 time: 0.287618 Jul 14 15:15:24.168375 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3187/6413] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:23 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1691 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:25.181312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-497c5a71-a0ad-4a98-bfd6-3cf64ed980b4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:25.182047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-497c5a71-a0ad-4a98-bfd6-3cf64ed980b4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:25.189348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-497c5a71-a0ad-4a98-bfd6-3cf64ed980b4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:25.189830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-497c5a71-a0ad-4a98-bfd6-3cf64ed980b4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:25.190634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-497c5a71-a0ad-4a98-bfd6-3cf64ed980b4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:25.191097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-497c5a71-a0ad-4a98-bfd6-3cf64ed980b4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:25.329585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-497c5a71-a0ad-4a98-bfd6-3cf64ed980b4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:25.337286 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-497c5a71-a0ad-4a98-bfd6-3cf64ed980b4 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1691 microversion: 2.1 time: 0.161256 Jul 14 15:15:25.337859 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3227/6414] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:25 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:26.102038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a58ec0c4-c7d8-43bc-bc24-def107dd563f req-37555675-d320-4ea2-bb01-95d1e9bb665f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ae1e31-e426-4453-b80d-d42cd115b137", "tag": "9023bf3a-83c4-4ac7-bc84-da12796546f2"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:26.112756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a58ec0c4-c7d8-43bc-bc24-def107dd563f req-37555675-d320-4ea2-bb01-95d1e9bb665f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:26.113230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a58ec0c4-c7d8-43bc-bc24-def107dd563f req-37555675-d320-4ea2-bb01-95d1e9bb665f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:26.123765 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a58ec0c4-c7d8-43bc-bc24-def107dd563f req-37555675-d320-4ea2-bb01-95d1e9bb665f service nova] Creating event network-changed:9023bf3a-83c4-4ac7-bc84-da12796546f2 for instance e9ae1e31-e426-4453-b80d-d42cd115b137 on n-h2-767704-28 Jul 14 15:15:26.129158 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a58ec0c4-c7d8-43bc-bc24-def107dd563f req-37555675-d320-4ea2-bb01-95d1e9bb665f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030839 Jul 14 15:15:26.129746 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3188/6415] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:15:26.355687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-baaa980b-dc7b-40a9-bab4-cea7c15be18c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:26.356325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-baaa980b-dc7b-40a9-bab4-cea7c15be18c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:26.362826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-baaa980b-dc7b-40a9-bab4-cea7c15be18c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:26.363290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-baaa980b-dc7b-40a9-bab4-cea7c15be18c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:26.364084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-baaa980b-dc7b-40a9-bab4-cea7c15be18c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:26.364536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-baaa980b-dc7b-40a9-bab4-cea7c15be18c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:26.571247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-baaa980b-dc7b-40a9-bab4-cea7c15be18c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:26.580528 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-baaa980b-dc7b-40a9-bab4-cea7c15be18c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1691 microversion: 2.1 time: 0.229772 Jul 14 15:15:26.581144 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3228/6416] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:26 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1691 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:27.602147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b487dab0-f7ca-4460-a438-369c0e0fa897 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:27.602891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b487dab0-f7ca-4460-a438-369c0e0fa897 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:27.610155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b487dab0-f7ca-4460-a438-369c0e0fa897 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:27.610615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b487dab0-f7ca-4460-a438-369c0e0fa897 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:27.611397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b487dab0-f7ca-4460-a438-369c0e0fa897 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:27.611841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b487dab0-f7ca-4460-a438-369c0e0fa897 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:27.759889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b487dab0-f7ca-4460-a438-369c0e0fa897 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:27.770067 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b487dab0-f7ca-4460-a438-369c0e0fa897 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1691 microversion: 2.1 time: 0.174286 Jul 14 15:15:27.770680 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3189/6417] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:27 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:28.787861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bddb50b4-cf3f-4e2f-9196-998bc6c4188d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:28.788492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bddb50b4-cf3f-4e2f-9196-998bc6c4188d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:28.796624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bddb50b4-cf3f-4e2f-9196-998bc6c4188d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:28.797126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bddb50b4-cf3f-4e2f-9196-998bc6c4188d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:28.797930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bddb50b4-cf3f-4e2f-9196-998bc6c4188d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:28.798388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bddb50b4-cf3f-4e2f-9196-998bc6c4188d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:28.936744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bddb50b4-cf3f-4e2f-9196-998bc6c4188d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:28.944443 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bddb50b4-cf3f-4e2f-9196-998bc6c4188d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1691 microversion: 2.1 time: 0.160566 Jul 14 15:15:28.945037 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3229/6418] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:28 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:29.962783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4c04d280-bebf-492d-852e-479cad79a47e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:29.963414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4c04d280-bebf-492d-852e-479cad79a47e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:29.970860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c04d280-bebf-492d-852e-479cad79a47e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:29.971315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c04d280-bebf-492d-852e-479cad79a47e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:29.972107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c04d280-bebf-492d-852e-479cad79a47e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:29.972535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c04d280-bebf-492d-852e-479cad79a47e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:30.390959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4c04d280-bebf-492d-852e-479cad79a47e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:30.398590 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4c04d280-bebf-492d-852e-479cad79a47e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1691 microversion: 2.1 time: 0.439748 Jul 14 15:15:30.399265 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3190/6419] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:29 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1691 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:30.580161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-327e2781-cc85-44d2-97b2-bb964ae47dd5 req-be8b4ea0-2d05-44f6-bd24-676721416a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ae1e31-e426-4453-b80d-d42cd115b137", "name": "network-vif-unplugged", "status": "completed", "tag": "9023bf3a-83c4-4ac7-bc84-da12796546f2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:30.588960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-327e2781-cc85-44d2-97b2-bb964ae47dd5 req-be8b4ea0-2d05-44f6-bd24-676721416a48 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:30.589442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-327e2781-cc85-44d2-97b2-bb964ae47dd5 req-be8b4ea0-2d05-44f6-bd24-676721416a48 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:30.603026 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-327e2781-cc85-44d2-97b2-bb964ae47dd5 req-be8b4ea0-2d05-44f6-bd24-676721416a48 service nova] Creating event network-vif-unplugged:9023bf3a-83c4-4ac7-bc84-da12796546f2 for instance e9ae1e31-e426-4453-b80d-d42cd115b137 on n-h2-767704-28 Jul 14 15:15:30.609715 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-327e2781-cc85-44d2-97b2-bb964ae47dd5 req-be8b4ea0-2d05-44f6-bd24-676721416a48 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033668 Jul 14 15:15:30.610479 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3230/6420] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:15:31.416821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-27367f44-2306-4d7a-844d-f02e3b2d4b5f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:31.417597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-27367f44-2306-4d7a-844d-f02e3b2d4b5f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:31.425415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27367f44-2306-4d7a-844d-f02e3b2d4b5f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:31.425870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27367f44-2306-4d7a-844d-f02e3b2d4b5f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:31.426660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27367f44-2306-4d7a-844d-f02e3b2d4b5f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:31.427108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27367f44-2306-4d7a-844d-f02e3b2d4b5f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:32.077165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-27367f44-2306-4d7a-844d-f02e3b2d4b5f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:32.085833 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-27367f44-2306-4d7a-844d-f02e3b2d4b5f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1691 microversion: 2.1 time: 0.672873 Jul 14 15:15:32.086921 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3191/6421] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:31 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1691 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:33.104612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4d61616a-7ce0-48e9-b652-9fd3db72f1b9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:33.105391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4d61616a-7ce0-48e9-b652-9fd3db72f1b9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:33.112591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d61616a-7ce0-48e9-b652-9fd3db72f1b9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:33.113107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d61616a-7ce0-48e9-b652-9fd3db72f1b9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:33.113899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d61616a-7ce0-48e9-b652-9fd3db72f1b9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:33.114359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d61616a-7ce0-48e9-b652-9fd3db72f1b9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:33.118584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:33.269193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4d61616a-7ce0-48e9-b652-9fd3db72f1b9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:33.277017 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4d61616a-7ce0-48e9-b652-9fd3db72f1b9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1681 microversion: 2.1 time: 0.176591 Jul 14 15:15:33.277628 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3231/6422] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:33 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:33.294020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a9cc1827-06fd-434f-983d-68f8a544aef3 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:33.294645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a9cc1827-06fd-434f-983d-68f8a544aef3 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:33.302590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9cc1827-06fd-434f-983d-68f8a544aef3 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:33.303252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9cc1827-06fd-434f-983d-68f8a544aef3 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:33.304086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9cc1827-06fd-434f-983d-68f8a544aef3 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:33.304526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9cc1827-06fd-434f-983d-68f8a544aef3 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:33.308586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:33.439891 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a9cc1827-06fd-434f-983d-68f8a544aef3 tempest-TestNetworkAdvancedServerOps-255264027 tempest-TestNetworkAdvancedServerOps-255264027-project-admin] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1834 microversion: 2.1 time: 0.149593 Jul 14 15:15:33.440489 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3192/6423] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:33 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1834 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:15:33.461710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-32b9ac18-8c3a-462a-a6d5-c77fa230673c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:33.462334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-32b9ac18-8c3a-462a-a6d5-c77fa230673c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:33.470577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32b9ac18-8c3a-462a-a6d5-c77fa230673c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:33.471097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32b9ac18-8c3a-462a-a6d5-c77fa230673c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:33.471839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32b9ac18-8c3a-462a-a6d5-c77fa230673c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:33.472329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32b9ac18-8c3a-462a-a6d5-c77fa230673c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:33.615765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-32b9ac18-8c3a-462a-a6d5-c77fa230673c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:33.624216 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-32b9ac18-8c3a-462a-a6d5-c77fa230673c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1681 microversion: 2.1 time: 0.167902 Jul 14 15:15:33.624799 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3232/6424] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:33 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:33.722439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fd45d8d1-91b6-4d8b-9555-aab1224c8ce0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:33.723601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fd45d8d1-91b6-4d8b-9555-aab1224c8ce0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:33.733126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd45d8d1-91b6-4d8b-9555-aab1224c8ce0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:33.733734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd45d8d1-91b6-4d8b-9555-aab1224c8ce0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:33.734794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd45d8d1-91b6-4d8b-9555-aab1224c8ce0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:33.735342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd45d8d1-91b6-4d8b-9555-aab1224c8ce0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:33.802613 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fd45d8d1-91b6-4d8b-9555-aab1224c8ce0 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137/action" status: 200 len: 38522 microversion: 2.1 time: 0.084616 Jul 14 15:15:33.803281 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3193/6425] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:15:33 2022] POST /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137/action => generated 38522 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:15:34.799320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb101ff8-177a-49d8-ba84-e4f86fab789f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:34.799942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bb101ff8-177a-49d8-ba84-e4f86fab789f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:34.800186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-cc41db0a-a06b-4e24-bef5-50af70d926bd req-9a8cf348-8a07-4d1d-85d6-1a59763d5ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ae1e31-e426-4453-b80d-d42cd115b137", "tag": "9023bf3a-83c4-4ac7-bc84-da12796546f2"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:34.807568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb101ff8-177a-49d8-ba84-e4f86fab789f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:34.808040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb101ff8-177a-49d8-ba84-e4f86fab789f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:34.808841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb101ff8-177a-49d8-ba84-e4f86fab789f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:34.809656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb101ff8-177a-49d8-ba84-e4f86fab789f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:34.812380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cc41db0a-a06b-4e24-bef5-50af70d926bd req-9a8cf348-8a07-4d1d-85d6-1a59763d5ad7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:34.813191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cc41db0a-a06b-4e24-bef5-50af70d926bd req-9a8cf348-8a07-4d1d-85d6-1a59763d5ad7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:34.827218 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-cc41db0a-a06b-4e24-bef5-50af70d926bd req-9a8cf348-8a07-4d1d-85d6-1a59763d5ad7 service nova] Creating event network-changed:9023bf3a-83c4-4ac7-bc84-da12796546f2 for instance e9ae1e31-e426-4453-b80d-d42cd115b137 on n-h1-767704-28 Jul 14 15:15:34.832551 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-cc41db0a-a06b-4e24-bef5-50af70d926bd req-9a8cf348-8a07-4d1d-85d6-1a59763d5ad7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036701 Jul 14 15:15:34.833616 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3194/6426] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:15:34.843208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bb101ff8-177a-49d8-ba84-e4f86fab789f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:15:34.929086 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bb101ff8-177a-49d8-ba84-e4f86fab789f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 204 len: 0 microversion: 2.1 time: 0.135322 Jul 14 15:15:34.933219 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3233/6427] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:34 2022] DELETE /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:15:34.944064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d835f23d-b22b-451a-948b-3fc34f60f8d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:34.945207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d835f23d-b22b-451a-948b-3fc34f60f8d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:34.959374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d835f23d-b22b-451a-948b-3fc34f60f8d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:34.960116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d835f23d-b22b-451a-948b-3fc34f60f8d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:34.961587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d835f23d-b22b-451a-948b-3fc34f60f8d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:34.962387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d835f23d-b22b-451a-948b-3fc34f60f8d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:35.147960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d835f23d-b22b-451a-948b-3fc34f60f8d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:35.157107 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d835f23d-b22b-451a-948b-3fc34f60f8d2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1687 microversion: 2.1 time: 0.220248 Jul 14 15:15:35.157803 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3195/6428] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:34 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1687 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:36.175683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e90e9e04-323d-421c-b937-68b8f84abf2b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:36.176533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e90e9e04-323d-421c-b937-68b8f84abf2b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:36.183961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e90e9e04-323d-421c-b937-68b8f84abf2b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:36.184532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e90e9e04-323d-421c-b937-68b8f84abf2b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:36.185454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e90e9e04-323d-421c-b937-68b8f84abf2b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:36.185909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e90e9e04-323d-421c-b937-68b8f84abf2b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:36.286541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e90e9e04-323d-421c-b937-68b8f84abf2b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:36.297476 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e90e9e04-323d-421c-b937-68b8f84abf2b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 200 len: 1501 microversion: 2.1 time: 0.125689 Jul 14 15:15:36.301493 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3234/6429] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:36 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 1501 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:36.847951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a0ef9bbc-8142-4ae3-9dec-cdca85d3623e req-7d9cbe72-dabc-4884-9f3e-aa6017037f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ae1e31-e426-4453-b80d-d42cd115b137", "name": "network-vif-deleted", "tag": "9023bf3a-83c4-4ac7-bc84-da12796546f2"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:36.857038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a0ef9bbc-8142-4ae3-9dec-cdca85d3623e req-7d9cbe72-dabc-4884-9f3e-aa6017037f24 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:36.857488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a0ef9bbc-8142-4ae3-9dec-cdca85d3623e req-7d9cbe72-dabc-4884-9f3e-aa6017037f24 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:36.869151 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a0ef9bbc-8142-4ae3-9dec-cdca85d3623e req-7d9cbe72-dabc-4884-9f3e-aa6017037f24 service nova] Creating event network-vif-deleted:9023bf3a-83c4-4ac7-bc84-da12796546f2 for instance e9ae1e31-e426-4453-b80d-d42cd115b137 on n-h1-767704-28 Jul 14 15:15:36.875417 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a0ef9bbc-8142-4ae3-9dec-cdca85d3623e req-7d9cbe72-dabc-4884-9f3e-aa6017037f24 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030770 Jul 14 15:15:36.876028 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3196/6430] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:15:37.315687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-33ae1702-31d0-41bf-b3af-320732c391bd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:37.316316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-33ae1702-31d0-41bf-b3af-320732c391bd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: e9ae1e31-e426-4453-b80d-d42cd115b137] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:37.324682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33ae1702-31d0-41bf-b3af-320732c391bd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:37.325284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33ae1702-31d0-41bf-b3af-320732c391bd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:37.326099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33ae1702-31d0-41bf-b3af-320732c391bd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:37.326730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-33ae1702-31d0-41bf-b3af-320732c391bd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:37.340993 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-33ae1702-31d0-41bf-b3af-320732c391bd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] HTTP exception thrown: Instance e9ae1e31-e426-4453-b80d-d42cd115b137 could not be found. Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-33ae1702-31d0-41bf-b3af-320732c391bd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Request method failure captured: Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 HTTP/1.1 Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DHFbUVubDuVF53yv_hAYoRSg03MNLuaI6bcv8WHLK023TaoiaaNU4yFpijpq2LrcAAQelnsE31SulB5eXwDSO_UCvUxMum-xZRFYpLdlCTFeCSgR_tLStNg3XZcIgUo7xuqh7ojaAOn_gWBQ2r_asoQUBer3Pl4ERYsBV9nV3cW5m0 Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 24625820309f4411bb0b517b6ebb6583 Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-752443759 Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24625820309f4411bb0b517b6ebb6583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24625820309f4411bb0b517b6ebb6583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24625820309f4411bb0b517b6ebb6583", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24625820309f4411bb0b517b6ebb6583"}]}] Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestNetworkAdvancedServerOps-752443759 Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 24625820309f4411bb0b517b6ebb6583 Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-752443759 Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestNetworkAdvancedServerOps-752443759-project Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 2c0f965a2f344bd69b0fc157fe02ffda Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestNetworkAdvancedServerOps-752443759-project Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance e9ae1e31-e426-4453-b80d-d42cd115b137 could not be found. Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'e9ae1e31-e426-4453-b80d-d42cd115b137'} Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9ae1e31-e426-4453-b80d-d42cd115b137 could not be found. Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9ae1e31-e426-4453-b80d-d42cd115b137 could not be found. Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:37.343226 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:37.348121 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:37.348121 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:37.348121 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:37.348121 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:37.348121 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:37.348121 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9ae1e31-e426-4453-b80d-d42cd115b137 could not be found. Jul 14 15:15:37.348121 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:15:37.348121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-33ae1702-31d0-41bf-b3af-320732c391bd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Returning 404 to user: Instance e9ae1e31-e426-4453-b80d-d42cd115b137 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:37.348121 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-33ae1702-31d0-41bf-b3af-320732c391bd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137" status: 404 len: 111 microversion: 2.1 time: 0.033013 Jul 14 15:15:37.348121 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3235/6431] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:37 2022] GET /compute/v2.1/servers/e9ae1e31-e426-4453-b80d-d42cd115b137 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:40.694996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-84f76341-b552-4885-97e1-399eb1d78acf tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '.version_select at 0x7fd6c42c03a0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:40.702899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:40.719053 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-84f76341-b552-4885-97e1-399eb1d78acf tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-982345853" status: 202 len: 0 microversion: 2.1 time: 0.029448 Jul 14 15:15:40.720224 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3197/6432] 10.222.0.81 () {58 vars in 1280 bytes} [Thu Jul 14 15:15:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-982345853 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:15:40.750430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-01f31665-d7da-4217-af36-f2b350e2431f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'create', calling method: .version_select at 0x7fd6c4c9b430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1811425857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNREuCLIuw2DuMIePns5cBuLy93iOq0fzhjCRzzgXe7bEaLDqn3fD9w4U6+Ht3PhC0G0PnzN2RGcASOS87MMIjuDrjTRS2KKLAqJbAeLQm4tC0zxufIexRgVuH5EZtUgKQ=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:40.766784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-01f31665-d7da-4217-af36-f2b350e2431f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for project 24625820309f4411bb0b517b6ebb6583. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:15:40.773129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-01f31665-d7da-4217-af36-f2b350e2431f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for user 2c0f965a2f344bd69b0fc157fe02ffda and project 24625820309f4411bb0b517b6ebb6583. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:15:40.800452 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-01f31665-d7da-4217-af36-f2b350e2431f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054182 Jul 14 15:15:40.801004 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3236/6433] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:15:40 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:15:46.595687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-698874462", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "3023fd55-4bd5-4a40-9512-1b42ece9de81"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1811425857", "security_groups": [{"name": "tempest-secgroup-smoke-296024465"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:46.716697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] validate_networks() for [('3023fd55-4bd5-4a40-9512-1b42ece9de81', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:15:46.862785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=19 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:47.128172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:15:47.128702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:15:47.129117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:15:47.129560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:15:47.130143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:15:47.139681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:47.140288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:47.141142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:47.141592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:47.159943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for project 24625820309f4411bb0b517b6ebb6583. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:15:47.165521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Getting quotas for user 2c0f965a2f344bd69b0fc157fe02ffda and project 24625820309f4411bb0b517b6ebb6583. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:15:47.179637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:15:47.182131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:15:47.234289 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4bef77d0-d9ab-41ec-9c66-b8fb64932c18 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.643749 Jul 14 15:15:47.235307 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3198/6434] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:15:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:15:47.245555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-542adc36-5e96-4cf8-a0d2-4d45c943b385 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:47.246462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-542adc36-5e96-4cf8-a0d2-4d45c943b385 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:47.320827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-542adc36-5e96-4cf8-a0d2-4d45c943b385 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:47.329952 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-542adc36-5e96-4cf8-a0d2-4d45c943b385 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1266 microversion: 2.1 time: 0.087986 Jul 14 15:15:47.330855 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3237/6435] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:47 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:48.347577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c715b910-4bf6-4201-b923-8337ce40749b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:48.348988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c715b910-4bf6-4201-b923-8337ce40749b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:48.357962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c715b910-4bf6-4201-b923-8337ce40749b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:48.358916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c715b910-4bf6-4201-b923-8337ce40749b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:48.360473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c715b910-4bf6-4201-b923-8337ce40749b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:48.361540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c715b910-4bf6-4201-b923-8337ce40749b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:48.449696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c715b910-4bf6-4201-b923-8337ce40749b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:48.460828 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c715b910-4bf6-4201-b923-8337ce40749b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1336 microversion: 2.1 time: 0.117284 Jul 14 15:15:48.471921 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3199/6436] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:48 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1336 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:49.484568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac6d8879-f3f7-4b29-8ba1-6f704c60e9ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:49.485795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac6d8879-f3f7-4b29-8ba1-6f704c60e9ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:49.489559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:49.502331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:49.514273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac6d8879-f3f7-4b29-8ba1-6f704c60e9ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:49.515653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac6d8879-f3f7-4b29-8ba1-6f704c60e9ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:49.518262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac6d8879-f3f7-4b29-8ba1-6f704c60e9ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:49.525033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac6d8879-f3f7-4b29-8ba1-6f704c60e9ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:49.885532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac6d8879-f3f7-4b29-8ba1-6f704c60e9ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:49.896244 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac6d8879-f3f7-4b29-8ba1-6f704c60e9ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1391 microversion: 2.1 time: 0.420937 Jul 14 15:15:49.902653 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3238/6437] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:49 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1391 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:50.445871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3a271a1a-05c2-464c-a90b-02dd7158e059 req-c8e6807d-15b3-4eb6-a91d-3a693154b4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7edda7dd-051a-45d3-9862-f858493d2c54", "tag": "22cba1d8-bd10-4617-b2f4-301cc554e2a1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:50.458224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3a271a1a-05c2-464c-a90b-02dd7158e059 req-c8e6807d-15b3-4eb6-a91d-3a693154b4ac service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:50.458776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3a271a1a-05c2-464c-a90b-02dd7158e059 req-c8e6807d-15b3-4eb6-a91d-3a693154b4ac service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:50.471531 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3a271a1a-05c2-464c-a90b-02dd7158e059 req-c8e6807d-15b3-4eb6-a91d-3a693154b4ac service nova] Creating event network-changed:22cba1d8-bd10-4617-b2f4-301cc554e2a1 for instance 7edda7dd-051a-45d3-9862-f858493d2c54 on n-h2-767704-28 Jul 14 15:15:50.478813 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3a271a1a-05c2-464c-a90b-02dd7158e059 req-c8e6807d-15b3-4eb6-a91d-3a693154b4ac service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036654 Jul 14 15:15:50.480176 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3200/6438] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:15:50.917025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c96500fe-9b36-4960-9702-a3bee45ba977 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:50.917661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c96500fe-9b36-4960-9702-a3bee45ba977 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:50.925304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c96500fe-9b36-4960-9702-a3bee45ba977 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:50.925768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c96500fe-9b36-4960-9702-a3bee45ba977 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:50.926578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c96500fe-9b36-4960-9702-a3bee45ba977 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:50.927020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c96500fe-9b36-4960-9702-a3bee45ba977 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:51.095314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c96500fe-9b36-4960-9702-a3bee45ba977 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:51.103011 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c96500fe-9b36-4960-9702-a3bee45ba977 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1391 microversion: 2.1 time: 0.190704 Jul 14 15:15:51.103601 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3239/6439] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:50 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1391 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:52.121448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c0ea4236-6d43-4212-966e-8dba071183e2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:52.122187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c0ea4236-6d43-4212-966e-8dba071183e2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:52.130042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0ea4236-6d43-4212-966e-8dba071183e2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:52.130505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0ea4236-6d43-4212-966e-8dba071183e2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:52.131304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0ea4236-6d43-4212-966e-8dba071183e2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:52.131752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0ea4236-6d43-4212-966e-8dba071183e2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:52.360800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c0ea4236-6d43-4212-966e-8dba071183e2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:52.368989 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c0ea4236-6d43-4212-966e-8dba071183e2 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1391 microversion: 2.1 time: 0.252639 Jul 14 15:15:52.369711 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3201/6440] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:52 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1391 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:53.386739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-20647dcd-9efc-4e42-b995-792db7488093 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:53.387348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-20647dcd-9efc-4e42-b995-792db7488093 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:53.394965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20647dcd-9efc-4e42-b995-792db7488093 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:53.395439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20647dcd-9efc-4e42-b995-792db7488093 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:53.396245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20647dcd-9efc-4e42-b995-792db7488093 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:53.396711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-20647dcd-9efc-4e42-b995-792db7488093 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:53.538126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-20647dcd-9efc-4e42-b995-792db7488093 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:53.547295 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-20647dcd-9efc-4e42-b995-792db7488093 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1391 microversion: 2.1 time: 0.163676 Jul 14 15:15:53.547898 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3240/6441] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:53 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:54.565339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed1ee209-e5f5-47e1-a0fd-8e35c9a67a34 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:54.566044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ed1ee209-e5f5-47e1-a0fd-8e35c9a67a34 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:54.573941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed1ee209-e5f5-47e1-a0fd-8e35c9a67a34 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:54.574563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed1ee209-e5f5-47e1-a0fd-8e35c9a67a34 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:54.575359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed1ee209-e5f5-47e1-a0fd-8e35c9a67a34 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:54.575829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed1ee209-e5f5-47e1-a0fd-8e35c9a67a34 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:54.719682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ed1ee209-e5f5-47e1-a0fd-8e35c9a67a34 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:54.727718 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed1ee209-e5f5-47e1-a0fd-8e35c9a67a34 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1391 microversion: 2.1 time: 0.167007 Jul 14 15:15:54.728310 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3202/6442] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:54 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:55.745614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-233d14d7-adcb-450d-af44-51986607ef7d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:55.746248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-233d14d7-adcb-450d-af44-51986607ef7d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:55.753653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-233d14d7-adcb-450d-af44-51986607ef7d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:55.754125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-233d14d7-adcb-450d-af44-51986607ef7d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:55.754920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-233d14d7-adcb-450d-af44-51986607ef7d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:55.755382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-233d14d7-adcb-450d-af44-51986607ef7d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:55.893811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-233d14d7-adcb-450d-af44-51986607ef7d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:55.901676 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-233d14d7-adcb-450d-af44-51986607ef7d tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1391 microversion: 2.1 time: 0.159987 Jul 14 15:15:55.902261 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3241/6443] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:55 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:56.578472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1dbf9b4d-465b-4c3d-9da9-b81a2048ae66 req-23ec235f-6e36-46f0-a3b8-f1fbbfa2f69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7edda7dd-051a-45d3-9862-f858493d2c54", "name": "network-vif-plugged", "status": "completed", "tag": "22cba1d8-bd10-4617-b2f4-301cc554e2a1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:56.588556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1dbf9b4d-465b-4c3d-9da9-b81a2048ae66 req-23ec235f-6e36-46f0-a3b8-f1fbbfa2f69d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:56.589327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1dbf9b4d-465b-4c3d-9da9-b81a2048ae66 req-23ec235f-6e36-46f0-a3b8-f1fbbfa2f69d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:56.602482 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1dbf9b4d-465b-4c3d-9da9-b81a2048ae66 req-23ec235f-6e36-46f0-a3b8-f1fbbfa2f69d service nova] Creating event network-vif-plugged:22cba1d8-bd10-4617-b2f4-301cc554e2a1 for instance 7edda7dd-051a-45d3-9862-f858493d2c54 on n-h2-767704-28 Jul 14 15:15:56.609235 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1dbf9b4d-465b-4c3d-9da9-b81a2048ae66 req-23ec235f-6e36-46f0-a3b8-f1fbbfa2f69d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034858 Jul 14 15:15:56.610359 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3203/6444] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:15:56.920605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-406d3a86-3401-4b72-adcf-1be9cd58f41a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:56.921290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-406d3a86-3401-4b72-adcf-1be9cd58f41a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:56.928536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-406d3a86-3401-4b72-adcf-1be9cd58f41a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:56.929033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-406d3a86-3401-4b72-adcf-1be9cd58f41a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:56.929825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-406d3a86-3401-4b72-adcf-1be9cd58f41a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:56.930297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-406d3a86-3401-4b72-adcf-1be9cd58f41a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:57.069225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-406d3a86-3401-4b72-adcf-1be9cd58f41a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:57.077650 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-406d3a86-3401-4b72-adcf-1be9cd58f41a tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1391 microversion: 2.1 time: 0.161788 Jul 14 15:15:57.078267 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3242/6445] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:56 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:58.092795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:58.093623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:58.099029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6936d1d8-0ff2-4a59-92aa-6759479800ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:58.099737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6936d1d8-0ff2-4a59-92aa-6759479800ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:58.107836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6936d1d8-0ff2-4a59-92aa-6759479800ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:58.108324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6936d1d8-0ff2-4a59-92aa-6759479800ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:58.109140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6936d1d8-0ff2-4a59-92aa-6759479800ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:58.109692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6936d1d8-0ff2-4a59-92aa-6759479800ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:58.255272 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6936d1d8-0ff2-4a59-92aa-6759479800ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:58.263943 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6936d1d8-0ff2-4a59-92aa-6759479800ca tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1561 microversion: 2.1 time: 0.172188 Jul 14 15:15:58.264551 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3204/6446] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:58 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:58.289785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d17f1c6c-8473-4ab4-824c-9c080c5770cc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:58.290563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d17f1c6c-8473-4ab4-824c-9c080c5770cc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:58.292646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:58.299362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d17f1c6c-8473-4ab4-824c-9c080c5770cc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:58.299829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d17f1c6c-8473-4ab4-824c-9c080c5770cc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:58.300637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d17f1c6c-8473-4ab4-824c-9c080c5770cc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:58.301431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d17f1c6c-8473-4ab4-824c-9c080c5770cc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:58.456932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d17f1c6c-8473-4ab4-824c-9c080c5770cc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:58.464970 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d17f1c6c-8473-4ab4-824c-9c080c5770cc tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1561 microversion: 2.1 time: 0.179165 Jul 14 15:15:58.465567 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3243/6447] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:58 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:00.698221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b1b88f98-12c0-42f8-8a25-3e32f4cfcc25 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:00.698854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b1b88f98-12c0-42f8-8a25-3e32f4cfcc25 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:00.708434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-67ed5ee4-76f3-489f-b17f-99f0dec4247a req-b1d4b596-a594-4a4b-9e8b-31665a99f648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7edda7dd-051a-45d3-9862-f858493d2c54", "tag": "22cba1d8-bd10-4617-b2f4-301cc554e2a1"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:00.717677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1b88f98-12c0-42f8-8a25-3e32f4cfcc25 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:00.718056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1b88f98-12c0-42f8-8a25-3e32f4cfcc25 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:00.718489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-67ed5ee4-76f3-489f-b17f-99f0dec4247a req-b1d4b596-a594-4a4b-9e8b-31665a99f648 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:00.718859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1b88f98-12c0-42f8-8a25-3e32f4cfcc25 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:00.719153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-67ed5ee4-76f3-489f-b17f-99f0dec4247a req-b1d4b596-a594-4a4b-9e8b-31665a99f648 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:00.719314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b1b88f98-12c0-42f8-8a25-3e32f4cfcc25 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:00.733740 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-67ed5ee4-76f3-489f-b17f-99f0dec4247a req-b1d4b596-a594-4a4b-9e8b-31665a99f648 service nova] Creating event network-changed:22cba1d8-bd10-4617-b2f4-301cc554e2a1 for instance 7edda7dd-051a-45d3-9862-f858493d2c54 on n-h2-767704-28 Jul 14 15:16:00.739778 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-67ed5ee4-76f3-489f-b17f-99f0dec4247a req-b1d4b596-a594-4a4b-9e8b-31665a99f648 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035091 Jul 14 15:16:00.740878 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3244/6448] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:16:00.971960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b1b88f98-12c0-42f8-8a25-3e32f4cfcc25 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:00.980614 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b1b88f98-12c0-42f8-8a25-3e32f4cfcc25 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1561 microversion: 2.1 time: 0.286488 Jul 14 15:16:00.981387 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3205/6449] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:00 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1561 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:27.354866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cb49b8af-7d8f-487e-a7a5-624f6d392916 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:27.356563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cb49b8af-7d8f-487e-a7a5-624f6d392916 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:27.359694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=13 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:27.360365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=38 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:27.366481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb49b8af-7d8f-487e-a7a5-624f6d392916 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:27.366950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb49b8af-7d8f-487e-a7a5-624f6d392916 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:27.368080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb49b8af-7d8f-487e-a7a5-624f6d392916 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:27.368537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb49b8af-7d8f-487e-a7a5-624f6d392916 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:27.428082 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cb49b8af-7d8f-487e-a7a5-624f6d392916 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54/action" status: 200 len: 24572 microversion: 2.1 time: 0.077762 Jul 14 15:16:27.429114 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3245/6450] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:16:27 2022] POST /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54/action => generated 24572 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:16:38.353025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:38.354513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:38.356808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:38.357523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=36 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:38.363879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:38.364266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:38.365066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:38.365512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:38.447590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:16:38.448021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:16:38.448502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:16:38.448916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:16:38.450473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:16:38.510778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:38.518514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:38.518984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:38.519773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:38.520222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:38.548498 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-421cb10e-37dc-44e9-962d-a0a477cec07b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54/action" status: 202 len: 1135 microversion: 2.1 time: 0.199636 Jul 14 15:16:38.549193 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3206/6451] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:16:38 2022] POST /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54/action => generated 1135 bytes in 201 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 14 15:16:38.564913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af5401fc-c12b-4b68-b5e5-a66029834a83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:38.565683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-af5401fc-c12b-4b68-b5e5-a66029834a83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:38.568445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:38.569264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:38.576828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af5401fc-c12b-4b68-b5e5-a66029834a83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:38.577339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af5401fc-c12b-4b68-b5e5-a66029834a83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:38.578153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af5401fc-c12b-4b68-b5e5-a66029834a83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:38.578615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af5401fc-c12b-4b68-b5e5-a66029834a83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:38.726191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-af5401fc-c12b-4b68-b5e5-a66029834a83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:38.733864 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af5401fc-c12b-4b68-b5e5-a66029834a83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1689 microversion: 2.1 time: 0.173626 Jul 14 15:16:38.734434 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3246/6452] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:38 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:39.750802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9396c661-cf45-499a-8d22-dab95b2c5689 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:39.751438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9396c661-cf45-499a-8d22-dab95b2c5689 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:39.758596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9396c661-cf45-499a-8d22-dab95b2c5689 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:39.759048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9396c661-cf45-499a-8d22-dab95b2c5689 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:39.759813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9396c661-cf45-499a-8d22-dab95b2c5689 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:39.760252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9396c661-cf45-499a-8d22-dab95b2c5689 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:39.895487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9396c661-cf45-499a-8d22-dab95b2c5689 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:39.904162 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9396c661-cf45-499a-8d22-dab95b2c5689 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1689 microversion: 2.1 time: 0.157421 Jul 14 15:16:39.904755 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3207/6453] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:39 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:40.922716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb791d39-4389-4a3c-a140-6e326f56a937 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:40.923352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bb791d39-4389-4a3c-a140-6e326f56a937 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:40.930338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb791d39-4389-4a3c-a140-6e326f56a937 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:40.930814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb791d39-4389-4a3c-a140-6e326f56a937 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:40.931612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb791d39-4389-4a3c-a140-6e326f56a937 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:40.932071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb791d39-4389-4a3c-a140-6e326f56a937 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:41.067679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bb791d39-4389-4a3c-a140-6e326f56a937 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:41.075711 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bb791d39-4389-4a3c-a140-6e326f56a937 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1689 microversion: 2.1 time: 0.158003 Jul 14 15:16:41.076286 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3247/6454] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:40 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:42.093134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-84cbed9d-bab0-482c-95b9-3a829fa0ec51 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:42.093720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-84cbed9d-bab0-482c-95b9-3a829fa0ec51 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:42.100465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84cbed9d-bab0-482c-95b9-3a829fa0ec51 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:42.100927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84cbed9d-bab0-482c-95b9-3a829fa0ec51 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:42.101737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84cbed9d-bab0-482c-95b9-3a829fa0ec51 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:42.102194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84cbed9d-bab0-482c-95b9-3a829fa0ec51 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:42.237770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-84cbed9d-bab0-482c-95b9-3a829fa0ec51 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:42.245340 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-84cbed9d-bab0-482c-95b9-3a829fa0ec51 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1689 microversion: 2.1 time: 0.156241 Jul 14 15:16:42.245914 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3208/6455] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:42 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:43.263720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-abb8b1c8-8eb3-477f-8381-e17ca1e1bfab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:43.264347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-abb8b1c8-8eb3-477f-8381-e17ca1e1bfab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:43.271505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abb8b1c8-8eb3-477f-8381-e17ca1e1bfab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:43.272040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abb8b1c8-8eb3-477f-8381-e17ca1e1bfab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:43.272841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abb8b1c8-8eb3-477f-8381-e17ca1e1bfab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:43.273420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abb8b1c8-8eb3-477f-8381-e17ca1e1bfab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:43.414331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-abb8b1c8-8eb3-477f-8381-e17ca1e1bfab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:43.423002 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-abb8b1c8-8eb3-477f-8381-e17ca1e1bfab tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1689 microversion: 2.1 time: 0.163306 Jul 14 15:16:43.423585 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3248/6456] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:43 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:44.444548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f32d9c95-e49f-4e3f-aaa0-7a14060de80b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:44.445132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f32d9c95-e49f-4e3f-aaa0-7a14060de80b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:44.453954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f32d9c95-e49f-4e3f-aaa0-7a14060de80b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:44.454417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f32d9c95-e49f-4e3f-aaa0-7a14060de80b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:44.455211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f32d9c95-e49f-4e3f-aaa0-7a14060de80b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:44.455661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f32d9c95-e49f-4e3f-aaa0-7a14060de80b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:44.592634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f32d9c95-e49f-4e3f-aaa0-7a14060de80b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:44.600216 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f32d9c95-e49f-4e3f-aaa0-7a14060de80b tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1689 microversion: 2.1 time: 0.159719 Jul 14 15:16:44.600790 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3209/6457] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:44 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:45.617954 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7475beeb-473a-4b4a-b6dc-c10b33c7e83c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:45.618515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7475beeb-473a-4b4a-b6dc-c10b33c7e83c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:45.626374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7475beeb-473a-4b4a-b6dc-c10b33c7e83c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:45.626842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7475beeb-473a-4b4a-b6dc-c10b33c7e83c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:45.627627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7475beeb-473a-4b4a-b6dc-c10b33c7e83c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:45.628129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7475beeb-473a-4b4a-b6dc-c10b33c7e83c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:45.765138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7475beeb-473a-4b4a-b6dc-c10b33c7e83c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:45.772830 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7475beeb-473a-4b4a-b6dc-c10b33c7e83c tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1689 microversion: 2.1 time: 0.158854 Jul 14 15:16:45.773451 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3249/6458] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:45 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:46.791716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b5168e33-1973-451f-b9fe-5a4efe4cbbef tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:46.792406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5168e33-1973-451f-b9fe-5a4efe4cbbef tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:46.799504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5168e33-1973-451f-b9fe-5a4efe4cbbef tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:46.799959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5168e33-1973-451f-b9fe-5a4efe4cbbef tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:46.800729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5168e33-1973-451f-b9fe-5a4efe4cbbef tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:46.801198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5168e33-1973-451f-b9fe-5a4efe4cbbef tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:46.936836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b5168e33-1973-451f-b9fe-5a4efe4cbbef tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:46.944441 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b5168e33-1973-451f-b9fe-5a4efe4cbbef tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1689 microversion: 2.1 time: 0.157605 Jul 14 15:16:46.945036 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3210/6459] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:46 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:47.962365 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a6a47eda-f9d7-4aba-b27b-b43cf8e9f509 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:47.963026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a6a47eda-f9d7-4aba-b27b-b43cf8e9f509 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:47.970699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6a47eda-f9d7-4aba-b27b-b43cf8e9f509 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:47.971115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6a47eda-f9d7-4aba-b27b-b43cf8e9f509 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:47.971918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6a47eda-f9d7-4aba-b27b-b43cf8e9f509 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:47.972378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6a47eda-f9d7-4aba-b27b-b43cf8e9f509 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:48.108511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a6a47eda-f9d7-4aba-b27b-b43cf8e9f509 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:48.116176 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a6a47eda-f9d7-4aba-b27b-b43cf8e9f509 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1689 microversion: 2.1 time: 0.157731 Jul 14 15:16:48.116749 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3250/6460] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:47 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:49.134283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0fb2ae7d-afe0-4a7c-9ad3-c985e1f77e1e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:49.135062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0fb2ae7d-afe0-4a7c-9ad3-c985e1f77e1e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:49.143466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0fb2ae7d-afe0-4a7c-9ad3-c985e1f77e1e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:49.143930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0fb2ae7d-afe0-4a7c-9ad3-c985e1f77e1e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:49.144733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0fb2ae7d-afe0-4a7c-9ad3-c985e1f77e1e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:49.145212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0fb2ae7d-afe0-4a7c-9ad3-c985e1f77e1e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:49.285509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0fb2ae7d-afe0-4a7c-9ad3-c985e1f77e1e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:49.293520 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0fb2ae7d-afe0-4a7c-9ad3-c985e1f77e1e tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1689 microversion: 2.1 time: 0.162904 Jul 14 15:16:49.294122 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3211/6461] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:49 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:50.312370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ef42d1ab-a0ce-4c22-9039-bac933addce3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:50.313123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ef42d1ab-a0ce-4c22-9039-bac933addce3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:50.320390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef42d1ab-a0ce-4c22-9039-bac933addce3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:50.320865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef42d1ab-a0ce-4c22-9039-bac933addce3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:50.321676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef42d1ab-a0ce-4c22-9039-bac933addce3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:50.322129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef42d1ab-a0ce-4c22-9039-bac933addce3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:50.462739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ef42d1ab-a0ce-4c22-9039-bac933addce3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:50.471262 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ef42d1ab-a0ce-4c22-9039-bac933addce3 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1689 microversion: 2.1 time: 0.164624 Jul 14 15:16:50.472242 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3251/6462] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:50 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:51.489838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-16be89a9-f3bf-44bd-a303-d4707b8b59a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:51.490440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-16be89a9-f3bf-44bd-a303-d4707b8b59a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:51.497784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16be89a9-f3bf-44bd-a303-d4707b8b59a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:51.498245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16be89a9-f3bf-44bd-a303-d4707b8b59a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:51.499029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16be89a9-f3bf-44bd-a303-d4707b8b59a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:51.499500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16be89a9-f3bf-44bd-a303-d4707b8b59a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:51.637832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-16be89a9-f3bf-44bd-a303-d4707b8b59a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:51.647991 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-16be89a9-f3bf-44bd-a303-d4707b8b59a7 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1695 microversion: 2.1 time: 0.162184 Jul 14 15:16:51.648579 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3212/6463] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:51 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:52.666510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-97e910a0-e090-4d62-9d4d-b63c844740d9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:52.667170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-97e910a0-e090-4d62-9d4d-b63c844740d9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:52.674786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97e910a0-e090-4d62-9d4d-b63c844740d9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:52.675260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97e910a0-e090-4d62-9d4d-b63c844740d9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:52.676048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97e910a0-e090-4d62-9d4d-b63c844740d9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:52.676531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97e910a0-e090-4d62-9d4d-b63c844740d9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:52.820966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-97e910a0-e090-4d62-9d4d-b63c844740d9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:52.829449 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-97e910a0-e090-4d62-9d4d-b63c844740d9 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1695 microversion: 2.1 time: 0.166652 Jul 14 15:16:52.830030 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3252/6464] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:52 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:53.847428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-62b0eb54-ca59-4e19-a0c7-82b91241db96 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:53.848046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-62b0eb54-ca59-4e19-a0c7-82b91241db96 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:53.855027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62b0eb54-ca59-4e19-a0c7-82b91241db96 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:53.855632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62b0eb54-ca59-4e19-a0c7-82b91241db96 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:53.856609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62b0eb54-ca59-4e19-a0c7-82b91241db96 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:53.857089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62b0eb54-ca59-4e19-a0c7-82b91241db96 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:53.994594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-62b0eb54-ca59-4e19-a0c7-82b91241db96 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:54.003950 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-62b0eb54-ca59-4e19-a0c7-82b91241db96 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1680 microversion: 2.1 time: 0.160439 Jul 14 15:16:54.004635 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3213/6465] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:53 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:54.865896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-96f37e1d-cca1-4662-8154-a8447273637b req-c992d643-013d-4687-938d-679e4f7b44c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7edda7dd-051a-45d3-9862-f858493d2c54", "name": "network-vif-plugged", "status": "completed", "tag": "22cba1d8-bd10-4617-b2f4-301cc554e2a1"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:54.876695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-96f37e1d-cca1-4662-8154-a8447273637b req-c992d643-013d-4687-938d-679e4f7b44c0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:54.877207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-96f37e1d-cca1-4662-8154-a8447273637b req-c992d643-013d-4687-938d-679e4f7b44c0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:54.890339 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-96f37e1d-cca1-4662-8154-a8447273637b req-c992d643-013d-4687-938d-679e4f7b44c0 service nova] Creating event network-vif-plugged:22cba1d8-bd10-4617-b2f4-301cc554e2a1 for instance 7edda7dd-051a-45d3-9862-f858493d2c54 on n-h2-767704-28 Jul 14 15:16:54.902202 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-96f37e1d-cca1-4662-8154-a8447273637b req-c992d643-013d-4687-938d-679e4f7b44c0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034642 Jul 14 15:16:54.902202 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3253/6466] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:22.211217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4365106e-ca94-498c-a703-1addc6b89a0f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:22.212203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4365106e-ca94-498c-a703-1addc6b89a0f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:22.214742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=20 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:22.215595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:22.223339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4365106e-ca94-498c-a703-1addc6b89a0f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:22.223797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4365106e-ca94-498c-a703-1addc6b89a0f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:22.224577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4365106e-ca94-498c-a703-1addc6b89a0f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:22.225050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4365106e-ca94-498c-a703-1addc6b89a0f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:22.279030 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4365106e-ca94-498c-a703-1addc6b89a0f tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "POST /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54/action" status: 200 len: 24565 microversion: 2.1 time: 0.071743 Jul 14 15:17:22.279942 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3214/6467] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:17:22 2022] POST /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54/action => generated 24565 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:17:34.520778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=16 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:34.527578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-67ab89ea-2240-402e-8ccd-9580e96bba51 req-3752bca1-56f9-4a40-9bc1-0bb3152d3ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7edda7dd-051a-45d3-9862-f858493d2c54", "tag": "22cba1d8-bd10-4617-b2f4-301cc554e2a1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:34.532015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:34.533029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=44 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:34.537855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8647068-a59d-4254-b6d6-74304b0bf8ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:34.538463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8647068-a59d-4254-b6d6-74304b0bf8ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:34.545213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:34.552180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8647068-a59d-4254-b6d6-74304b0bf8ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:34.552645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8647068-a59d-4254-b6d6-74304b0bf8ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:34.553479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8647068-a59d-4254-b6d6-74304b0bf8ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:34.553932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8647068-a59d-4254-b6d6-74304b0bf8ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:34.562495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-67ab89ea-2240-402e-8ccd-9580e96bba51 req-3752bca1-56f9-4a40-9bc1-0bb3152d3ea7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:34.563169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-67ab89ea-2240-402e-8ccd-9580e96bba51 req-3752bca1-56f9-4a40-9bc1-0bb3152d3ea7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:34.576771 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-67ab89ea-2240-402e-8ccd-9580e96bba51 req-3752bca1-56f9-4a40-9bc1-0bb3152d3ea7 service nova] Creating event network-changed:22cba1d8-bd10-4617-b2f4-301cc554e2a1 for instance 7edda7dd-051a-45d3-9862-f858493d2c54 on n-h2-767704-28 Jul 14 15:17:34.582407 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-67ab89ea-2240-402e-8ccd-9580e96bba51 req-3752bca1-56f9-4a40-9bc1-0bb3152d3ea7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059567 Jul 14 15:17:34.583243 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3215/6468] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:17:34.586092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8647068-a59d-4254-b6d6-74304b0bf8ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:17:34.682069 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8647068-a59d-4254-b6d6-74304b0bf8ff tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 204 len: 0 microversion: 2.1 time: 0.163374 Jul 14 15:17:34.683406 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3254/6469] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:17:34 2022] DELETE /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:17:34.692753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9c4adc2c-029e-46ca-a59e-04ee42b37e83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:34.693517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9c4adc2c-029e-46ca-a59e-04ee42b37e83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:34.699979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c4adc2c-029e-46ca-a59e-04ee42b37e83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:34.700687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c4adc2c-029e-46ca-a59e-04ee42b37e83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:34.701513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c4adc2c-029e-46ca-a59e-04ee42b37e83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:34.701950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c4adc2c-029e-46ca-a59e-04ee42b37e83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:34.860663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9c4adc2c-029e-46ca-a59e-04ee42b37e83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:34.868299 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9c4adc2c-029e-46ca-a59e-04ee42b37e83 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1686 microversion: 2.1 time: 0.180524 Jul 14 15:17:34.868883 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3216/6470] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:34 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:35.889284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-10c99649-8aa7-40f7-beba-bea98ff2f0ed tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:35.890356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-10c99649-8aa7-40f7-beba-bea98ff2f0ed tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:35.896989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10c99649-8aa7-40f7-beba-bea98ff2f0ed tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:35.897473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10c99649-8aa7-40f7-beba-bea98ff2f0ed tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:35.898270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10c99649-8aa7-40f7-beba-bea98ff2f0ed tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:35.898726 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-10c99649-8aa7-40f7-beba-bea98ff2f0ed tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:36.104094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-10c99649-8aa7-40f7-beba-bea98ff2f0ed tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:36.113337 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-10c99649-8aa7-40f7-beba-bea98ff2f0ed tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1686 microversion: 2.1 time: 0.229799 Jul 14 15:17:36.113937 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3255/6471] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:35 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1686 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:17:36.877007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a5396b81-a729-4779-9d8c-88405df6e31c req-9be60c5f-ae59-4831-bc47-8ec2cdf34775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7edda7dd-051a-45d3-9862-f858493d2c54", "name": "network-vif-deleted", "tag": "22cba1d8-bd10-4617-b2f4-301cc554e2a1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:36.887368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a5396b81-a729-4779-9d8c-88405df6e31c req-9be60c5f-ae59-4831-bc47-8ec2cdf34775 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:36.892433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a5396b81-a729-4779-9d8c-88405df6e31c req-9be60c5f-ae59-4831-bc47-8ec2cdf34775 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:36.906833 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a5396b81-a729-4779-9d8c-88405df6e31c req-9be60c5f-ae59-4831-bc47-8ec2cdf34775 service nova] Creating event network-vif-deleted:22cba1d8-bd10-4617-b2f4-301cc554e2a1 for instance 7edda7dd-051a-45d3-9862-f858493d2c54 on n-h2-767704-28 Jul 14 15:17:36.911703 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a5396b81-a729-4779-9d8c-88405df6e31c req-9be60c5f-ae59-4831-bc47-8ec2cdf34775 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038719 Jul 14 15:17:36.912541 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3217/6472] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:37.132352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8cae4c7-db9d-416a-bd41-d2ffb698b9a1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:37.137359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8cae4c7-db9d-416a-bd41-d2ffb698b9a1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:37.144840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8cae4c7-db9d-416a-bd41-d2ffb698b9a1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:37.145379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8cae4c7-db9d-416a-bd41-d2ffb698b9a1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:37.146186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8cae4c7-db9d-416a-bd41-d2ffb698b9a1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:37.146648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8cae4c7-db9d-416a-bd41-d2ffb698b9a1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:37.181768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8cae4c7-db9d-416a-bd41-d2ffb698b9a1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:37.183062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8cae4c7-db9d-416a-bd41-d2ffb698b9a1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:37.184437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-f8cae4c7-db9d-416a-bd41-d2ffb698b9a1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lazy-loading 'fault' on Instance uuid 7edda7dd-051a-45d3-9862-f858493d2c54 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:17:37.227121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f8cae4c7-db9d-416a-bd41-d2ffb698b9a1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0f965a2f344bd69b0fc157fe02ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24625820309f4411bb0b517b6ebb6583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:37.235732 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8cae4c7-db9d-416a-bd41-d2ffb698b9a1 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 200 len: 1356 microversion: 2.1 time: 0.107989 Jul 14 15:17:37.236331 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3256/6473] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:37 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 1356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:38.254654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a9c1e15e-5485-42a0-afa5-3232126f50dd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:38.255364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a9c1e15e-5485-42a0-afa5-3232126f50dd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] [instance: 7edda7dd-051a-45d3-9862-f858493d2c54] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:38.262603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9c1e15e-5485-42a0-afa5-3232126f50dd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:38.263057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9c1e15e-5485-42a0-afa5-3232126f50dd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:38.263825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9c1e15e-5485-42a0-afa5-3232126f50dd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:38.264260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9c1e15e-5485-42a0-afa5-3232126f50dd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:38.280438 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-a9c1e15e-5485-42a0-afa5-3232126f50dd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] HTTP exception thrown: Instance 7edda7dd-051a-45d3-9862-f858493d2c54 could not be found. Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a9c1e15e-5485-42a0-afa5-3232126f50dd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Request method failure captured: Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 HTTP/1.1 Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DHFbUVubDuVF53yv_hAYoRSg03MNLuaI6bcv8WHLK023TaoiaaNU4yFpijpq2LrcAAQelnsE31SulB5eXwDSO_UCvUxMum-xZRFYpLdlCTFeCSgR_tLStNg3XZcIgUo7xuqh7ojaAOn_gWBQ2r_asoQUBer3Pl4ERYsBV9nV3cW5m0 Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 24625820309f4411bb0b517b6ebb6583 Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-752443759 Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24625820309f4411bb0b517b6ebb6583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/24625820309f4411bb0b517b6ebb6583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_24625820309f4411bb0b517b6ebb6583", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/24625820309f4411bb0b517b6ebb6583"}]}] Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestNetworkAdvancedServerOps-752443759 Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 24625820309f4411bb0b517b6ebb6583 Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-752443759 Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestNetworkAdvancedServerOps-752443759-project Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 2c0f965a2f344bd69b0fc157fe02ffda Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestNetworkAdvancedServerOps-752443759-project Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 7edda7dd-051a-45d3-9862-f858493d2c54 could not be found. Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '7edda7dd-051a-45d3-9862-f858493d2c54'} Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7edda7dd-051a-45d3-9862-f858493d2c54 could not be found. Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7edda7dd-051a-45d3-9862-f858493d2c54 could not be found. Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:17:38.282222 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:17:38.287698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:17:38.287698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:17:38.287698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:17:38.287698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:17:38.287698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:17:38.287698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7edda7dd-051a-45d3-9862-f858493d2c54 could not be found. Jul 14 15:17:38.287698 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:17:38.287698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a9c1e15e-5485-42a0-afa5-3232126f50dd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Returning 404 to user: Instance 7edda7dd-051a-45d3-9862-f858493d2c54 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:17:38.287698 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a9c1e15e-5485-42a0-afa5-3232126f50dd tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54" status: 404 len: 111 microversion: 2.1 time: 0.033489 Jul 14 15:17:38.287698 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3218/6474] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:38 2022] GET /compute/v2.1/servers/7edda7dd-051a-45d3-9862-f858493d2c54 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:17:41.320565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1d5baf7b-9ed3-49a6-b626-b2f3a75f1b69 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] Calling method '.version_select at 0x7fd6c569e940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:41.346771 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1d5baf7b-9ed3-49a6-b626-b2f3a75f1b69 tempest-TestNetworkAdvancedServerOps-752443759 tempest-TestNetworkAdvancedServerOps-752443759-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1811425857" status: 202 len: 0 microversion: 2.1 time: 0.029980 Jul 14 15:17:41.347822 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3257/6475] 10.222.0.81 () {58 vars in 1283 bytes} [Thu Jul 14 15:17:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1811425857 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:17:53.537495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:53.538230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:53.660103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-466814400", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:53.713990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] validate_networks() for None {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:17:54.346064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:17:54.346488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:17:54.346965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:17:54.347378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:17:54.347791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:17:54.357394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:54.357854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:54.358659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:54.359099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:54.376224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Getting quotas for project cc014aa21f1f45429fd4d0511aeb8644. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:17:54.381542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Getting quotas for user d27cfa94f0024d5b9b31a22b60aea15c and project cc014aa21f1f45429fd4d0511aeb8644. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:17:54.394091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:17:54.396362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:17:54.441994 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eff8e106-7dee-48a9-ab59-32f9fdca572c tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909893 Jul 14 15:17:54.442839 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3219/6476] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:17:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:17:54.453964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d0ec0c40-4325-4754-a428-ec852b3d3997 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:54.455204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d0ec0c40-4325-4754-a428-ec852b3d3997 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:54.460105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:54.460783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:54.520965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d0ec0c40-4325-4754-a428-ec852b3d3997 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:54.528770 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d0ec0c40-4325-4754-a428-ec852b3d3997 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1221 microversion: 2.1 time: 0.078990 Jul 14 15:17:54.529445 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3258/6477] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:54 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:55.548823 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-021a5a19-16a6-427d-81e7-23eb13b29e44 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:55.549468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-021a5a19-16a6-427d-81e7-23eb13b29e44 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:55.556196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021a5a19-16a6-427d-81e7-23eb13b29e44 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:55.556653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021a5a19-16a6-427d-81e7-23eb13b29e44 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:55.558608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021a5a19-16a6-427d-81e7-23eb13b29e44 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:55.558795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-021a5a19-16a6-427d-81e7-23eb13b29e44 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:55.655260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-021a5a19-16a6-427d-81e7-23eb13b29e44 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:55.662821 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-021a5a19-16a6-427d-81e7-23eb13b29e44 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1281 microversion: 2.1 time: 0.119197 Jul 14 15:17:55.663403 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3220/6478] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:55 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1281 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:56.683616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77e7b4af-e3cf-4558-86d5-181998d76793 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:56.684178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-77e7b4af-e3cf-4558-86d5-181998d76793 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:56.691611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77e7b4af-e3cf-4558-86d5-181998d76793 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:56.692793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77e7b4af-e3cf-4558-86d5-181998d76793 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:56.693795 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77e7b4af-e3cf-4558-86d5-181998d76793 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:56.695674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77e7b4af-e3cf-4558-86d5-181998d76793 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:56.935538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-77e7b4af-e3cf-4558-86d5-181998d76793 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:56.943425 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-77e7b4af-e3cf-4558-86d5-181998d76793 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1321 microversion: 2.1 time: 0.266309 Jul 14 15:17:56.944132 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3259/6479] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:56 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:57.367152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1b0c5bad-8223-42f2-ae1c-48d995fd4633 req-dccc759d-63b7-4ce2-8a59-2d19b5160e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898d83c8-9710-402a-ac02-06bb4dab4f3d", "tag": "7bbf59b0-abfc-4667-ada4-a40a301255e1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:57.384587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1b0c5bad-8223-42f2-ae1c-48d995fd4633 req-dccc759d-63b7-4ce2-8a59-2d19b5160e59 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:57.385306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1b0c5bad-8223-42f2-ae1c-48d995fd4633 req-dccc759d-63b7-4ce2-8a59-2d19b5160e59 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:57.407031 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1b0c5bad-8223-42f2-ae1c-48d995fd4633 req-dccc759d-63b7-4ce2-8a59-2d19b5160e59 service nova] Creating event network-changed:7bbf59b0-abfc-4667-ada4-a40a301255e1 for instance 898d83c8-9710-402a-ac02-06bb4dab4f3d on n-h1-767704-28 Jul 14 15:17:57.412488 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1b0c5bad-8223-42f2-ae1c-48d995fd4633 req-dccc759d-63b7-4ce2-8a59-2d19b5160e59 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055866 Jul 14 15:17:57.413129 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3221/6480] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:57.961147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-28dd6365-d93b-42e3-b577-ee8ee2bf390e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:57.962560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-28dd6365-d93b-42e3-b577-ee8ee2bf390e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:57.971817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28dd6365-d93b-42e3-b577-ee8ee2bf390e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:57.972295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28dd6365-d93b-42e3-b577-ee8ee2bf390e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:57.973169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28dd6365-d93b-42e3-b577-ee8ee2bf390e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:57.973761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28dd6365-d93b-42e3-b577-ee8ee2bf390e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:58.118794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-28dd6365-d93b-42e3-b577-ee8ee2bf390e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:58.126730 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-28dd6365-d93b-42e3-b577-ee8ee2bf390e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1321 microversion: 2.1 time: 0.169772 Jul 14 15:17:58.127312 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3260/6481] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:57 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:59.144577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-38252ea0-ea7d-49c2-b71a-2b48c31e6f42 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:59.145463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-38252ea0-ea7d-49c2-b71a-2b48c31e6f42 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:59.152513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38252ea0-ea7d-49c2-b71a-2b48c31e6f42 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:59.152985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38252ea0-ea7d-49c2-b71a-2b48c31e6f42 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:59.153768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38252ea0-ea7d-49c2-b71a-2b48c31e6f42 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:59.154270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38252ea0-ea7d-49c2-b71a-2b48c31e6f42 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:59.290010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-38252ea0-ea7d-49c2-b71a-2b48c31e6f42 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:59.298451 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-38252ea0-ea7d-49c2-b71a-2b48c31e6f42 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1321 microversion: 2.1 time: 0.159005 Jul 14 15:17:59.299029 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3222/6482] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:59 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:00.316308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ef038b46-20a3-4b99-9872-7dc77a727c01 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:00.316938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ef038b46-20a3-4b99-9872-7dc77a727c01 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:00.324576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef038b46-20a3-4b99-9872-7dc77a727c01 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:00.325097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef038b46-20a3-4b99-9872-7dc77a727c01 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:00.325889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef038b46-20a3-4b99-9872-7dc77a727c01 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:00.326344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef038b46-20a3-4b99-9872-7dc77a727c01 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:00.477937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ef038b46-20a3-4b99-9872-7dc77a727c01 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:00.485750 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ef038b46-20a3-4b99-9872-7dc77a727c01 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1321 microversion: 2.1 time: 0.173495 Jul 14 15:18:00.486342 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3261/6483] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:00 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:01.503208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d02aba10-bf0c-4a85-a641-f3361a964dc8 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:01.503834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d02aba10-bf0c-4a85-a641-f3361a964dc8 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:01.511929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d02aba10-bf0c-4a85-a641-f3361a964dc8 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:01.512391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d02aba10-bf0c-4a85-a641-f3361a964dc8 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:01.513211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d02aba10-bf0c-4a85-a641-f3361a964dc8 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:01.513660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d02aba10-bf0c-4a85-a641-f3361a964dc8 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:01.652808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d02aba10-bf0c-4a85-a641-f3361a964dc8 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:01.660880 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d02aba10-bf0c-4a85-a641-f3361a964dc8 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1321 microversion: 2.1 time: 0.161744 Jul 14 15:18:01.661423 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3223/6484] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:01 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:02.679472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-de4f6094-fbf7-4596-bf03-d89d2b59f2de tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:02.680050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-de4f6094-fbf7-4596-bf03-d89d2b59f2de tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:02.687030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de4f6094-fbf7-4596-bf03-d89d2b59f2de tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:02.687501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de4f6094-fbf7-4596-bf03-d89d2b59f2de tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:02.688294 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de4f6094-fbf7-4596-bf03-d89d2b59f2de tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:02.688747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de4f6094-fbf7-4596-bf03-d89d2b59f2de tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:02.817313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-de4f6094-fbf7-4596-bf03-d89d2b59f2de tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:02.827320 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-de4f6094-fbf7-4596-bf03-d89d2b59f2de tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1321 microversion: 2.1 time: 0.152098 Jul 14 15:18:02.827910 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3262/6485] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:02 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:03.349123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-5bac2291-94fe-42cc-a4dd-da10a00cabda req-ecb73a4d-6a30-4416-93d5-72db6248c34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898d83c8-9710-402a-ac02-06bb4dab4f3d", "name": "network-vif-plugged", "status": "completed", "tag": "7bbf59b0-abfc-4667-ada4-a40a301255e1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:03.358639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5bac2291-94fe-42cc-a4dd-da10a00cabda req-ecb73a4d-6a30-4416-93d5-72db6248c34c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:03.359091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-5bac2291-94fe-42cc-a4dd-da10a00cabda req-ecb73a4d-6a30-4416-93d5-72db6248c34c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:03.370928 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-5bac2291-94fe-42cc-a4dd-da10a00cabda req-ecb73a4d-6a30-4416-93d5-72db6248c34c service nova] Creating event network-vif-plugged:7bbf59b0-abfc-4667-ada4-a40a301255e1 for instance 898d83c8-9710-402a-ac02-06bb4dab4f3d on n-h1-767704-28 Jul 14 15:18:03.376386 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-5bac2291-94fe-42cc-a4dd-da10a00cabda req-ecb73a4d-6a30-4416-93d5-72db6248c34c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031020 Jul 14 15:18:03.377017 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3224/6486] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:03.846399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d6fd1e75-f3fe-4650-95fc-5bdd0e5fa2c2 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:03.847092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d6fd1e75-f3fe-4650-95fc-5bdd0e5fa2c2 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:03.854980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6fd1e75-f3fe-4650-95fc-5bdd0e5fa2c2 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:03.855457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6fd1e75-f3fe-4650-95fc-5bdd0e5fa2c2 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:03.856404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6fd1e75-f3fe-4650-95fc-5bdd0e5fa2c2 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:03.856868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d6fd1e75-f3fe-4650-95fc-5bdd0e5fa2c2 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:03.997980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d6fd1e75-f3fe-4650-95fc-5bdd0e5fa2c2 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:04.005952 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d6fd1e75-f3fe-4650-95fc-5bdd0e5fa2c2 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1321 microversion: 2.1 time: 0.163431 Jul 14 15:18:04.006456 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3263/6487] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:03 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:05.021848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:05.022633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:05.028282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d678a4b1-d92c-406d-98ca-def3727658e4 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:05.029022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d678a4b1-d92c-406d-98ca-def3727658e4 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:05.036311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d678a4b1-d92c-406d-98ca-def3727658e4 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:05.036771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d678a4b1-d92c-406d-98ca-def3727658e4 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:05.037645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d678a4b1-d92c-406d-98ca-def3727658e4 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:05.038089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d678a4b1-d92c-406d-98ca-def3727658e4 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:05.186803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d678a4b1-d92c-406d-98ca-def3727658e4 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:05.194621 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d678a4b1-d92c-406d-98ca-def3727658e4 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1321 microversion: 2.1 time: 0.174706 Jul 14 15:18:05.195212 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3225/6488] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:05 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:06.211936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e4008559-a606-46b6-ac9d-59369cd83554 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:06.212591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e4008559-a606-46b6-ac9d-59369cd83554 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:06.214590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:06.220897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4008559-a606-46b6-ac9d-59369cd83554 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:06.221393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4008559-a606-46b6-ac9d-59369cd83554 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:06.222179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4008559-a606-46b6-ac9d-59369cd83554 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:06.222631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4008559-a606-46b6-ac9d-59369cd83554 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:06.354661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e4008559-a606-46b6-ac9d-59369cd83554 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:06.362414 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e4008559-a606-46b6-ac9d-59369cd83554 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1471 microversion: 2.1 time: 0.154329 Jul 14 15:18:06.362999 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3264/6489] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:06 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:06.432610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d034f237-973a-402f-b16a-f48ffc279c27 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Calling method '.version_select at 0x7fd6c42340d0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:06.502534 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d034f237-973a-402f-b16a-f48ffc279c27 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/2ed2db7b3b1e43239163629240c2146e" status: 200 len: 371 microversion: 2.1 time: 0.124144 Jul 14 15:18:06.503116 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3226/6490] 10.222.0.81 () {58 vars in 1241 bytes} [Thu Jul 14 15:18:06 2022] GET /compute/v2.1/os-quota-sets/2ed2db7b3b1e43239163629240c2146e => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:06.514089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4c3fa71d-2a01-46db-98eb-8fcd51d0175f tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-75116553", "id": 758386734, "os-flavor-access:is_public": "True"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:06.515671 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:18:06.515671 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 15:18:06.531141 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4c3fa71d-2a01-46db-98eb-8fcd51d0175f tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021465 Jul 14 15:18:06.531797 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3265/6491] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:18:06 2022] POST /compute/v2.1/flavors => generated 433 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:06.542376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "758386734"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:06.543414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:06.550088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:06.550542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:06.551357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:06.551792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:06.639305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9067c9dc9c2b4dee914ee6eb23f64cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed2db7b3b1e43239163629240c2146e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:06.646030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-75116553 {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:18:06.653171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:06.653625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:06.654418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:06.654861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:06.675021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Getting quotas for project cc014aa21f1f45429fd4d0511aeb8644. Resources: {'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:18:06.680058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Getting quotas for user d27cfa94f0024d5b9b31a22b60aea15c and project cc014aa21f1f45429fd4d0511aeb8644. Resources: {'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:18:06.692764 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.compute.api [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] ram quota exceeded for 2ed2db7b3b1e43239163629240c2146e, tried to resize instance. Jul 14 15:18:06.693344 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Request method failure captured: Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d/action HTTP/1.1 Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 38 Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DOhPUA07XwPkM0URLVPrP-sHE-y-N8lwxKpCCsqa32Kn7-gRXtEtoebJnJs5Y1BVp_MsU_5jkKTp2VUZeF-UCU6aQyt1njOj1bzWNP5bl1RtOFQfwzW8uKC288ijKQ2qLh4PC2LIPhuK5PV5nfgD_3NbE9w8TeUHWKze_eVthOTWcg Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 2ed2db7b3b1e43239163629240c2146e Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1762525681 Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member,admin Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member,admin Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ed2db7b3b1e43239163629240c2146e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2ed2db7b3b1e43239163629240c2146e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2ed2db7b3b1e43239163629240c2146e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ed2db7b3b1e43239163629240c2146e"}]}] Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1762525681 Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 2ed2db7b3b1e43239163629240c2146e Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1762525681 Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersAdminNegativeTestJSON-1762525681-project-admin Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9067c9dc9c2b4dee914ee6eb23f64cb8 Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1762525681-project-admin Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: {"resize": {"flavorRef": "758386734"}} Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '898d83c8-9710-402a-ac02-06bb4dab4f3d', 'body': {'resize': {'flavorRef': '758386734'}}} Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1055, in _resize Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:18:06.708215 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1141, in _action_resize Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1058, in _resize Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-065948bb-e172-4bc1-a643-b246ab0dfe4d tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d/action" status: 403 len: 118 microversion: 2.1 time: 0.171210 Jul 14 15:18:06.714339 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3227/6492] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:18:06 2022] POST /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d/action => generated 118 bytes in 172 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:18:06.719807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-46c505a7-170f-4459-ba9c-8b8737230f97 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:06.720590 n-d-767704-28 devstack@n-api.service[119512]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:18:06.720590 n-d-767704-28 devstack@n-api.service[119512]: warnings.warn(msg) Jul 14 15:18:06.738876 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-46c505a7-170f-4459-ba9c-8b8737230f97 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/758386734" status: 202 len: 0 microversion: 2.1 time: 0.023017 Jul 14 15:18:06.739502 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3266/6493] 10.222.0.81 () {58 vars in 1157 bytes} [Thu Jul 14 15:18:06 2022] DELETE /compute/v2.1/flavors/758386734 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:18:06.748377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-382c4681-7854-404b-8038-26d5764e5425 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:06.768964 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-382c4681-7854-404b-8038-26d5764e5425 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025137 Jul 14 15:18:06.769611 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3228/6494] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 15:18:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:06.787445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e8a98d34-6c85-4f0b-8e3a-889af8b4e87c tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Calling method '.version_select at 0x7fd6c4db4670>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:06.862673 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e8a98d34-6c85-4f0b-8e3a-889af8b4e87c tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] 10.222.0.81 "GET /compute/v2.1/os-quota-sets/2ed2db7b3b1e43239163629240c2146e" status: 200 len: 371 microversion: 2.1 time: 0.079035 Jul 14 15:18:06.863256 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3267/6495] 10.222.0.81 () {58 vars in 1241 bytes} [Thu Jul 14 15:18:06 2022] GET /compute/v2.1/os-quota-sets/2ed2db7b3b1e43239163629240c2146e => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:06.874049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dfb592a3-4c6b-4710-8498-4b3eeb28edb2 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-57700751", "id": 2090968572, "os-flavor-access:is_public": "True"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:06.875872 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:18:06.875872 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 15:18:06.891904 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dfb592a3-4c6b-4710-8498-4b3eeb28edb2 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.021484 Jul 14 15:18:06.892722 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3229/6496] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:18:06 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:06.903613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2090968572"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:06.904650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:06.911009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:06.911460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:06.912247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:06.912702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:07.053839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9067c9dc9c2b4dee914ee6eb23f64cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed2db7b3b1e43239163629240c2146e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:07.061067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-57700751 {{(pid=119512) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:18:07.067677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:07.068171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:07.069006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:07.069457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:07.096089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Getting quotas for project cc014aa21f1f45429fd4d0511aeb8644. Resources: {'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:18:07.101306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Getting quotas for user d27cfa94f0024d5b9b31a22b60aea15c and project cc014aa21f1f45429fd4d0511aeb8644. Resources: {'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:18:07.115385 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.compute.api [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] cores quota exceeded for 2ed2db7b3b1e43239163629240c2146e, tried to resize instance. Jul 14 15:18:07.115937 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Request method failure captured: Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d/action HTTP/1.1 Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 39 Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DOhPUA07XwPkM0URLVPrP-sHE-y-N8lwxKpCCsqa32Kn7-gRXtEtoebJnJs5Y1BVp_MsU_5jkKTp2VUZeF-UCU6aQyt1njOj1bzWNP5bl1RtOFQfwzW8uKC288ijKQ2qLh4PC2LIPhuK5PV5nfgD_3NbE9w8TeUHWKze_eVthOTWcg Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 2ed2db7b3b1e43239163629240c2146e Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1762525681 Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member,admin Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member,admin Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ed2db7b3b1e43239163629240c2146e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2ed2db7b3b1e43239163629240c2146e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2ed2db7b3b1e43239163629240c2146e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2ed2db7b3b1e43239163629240c2146e"}]}] Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1762525681 Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 2ed2db7b3b1e43239163629240c2146e Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1762525681 Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersAdminNegativeTestJSON-1762525681-project-admin Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9067c9dc9c2b4dee914ee6eb23f64cb8 Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1762525681-project-admin Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: {"resize": {"flavorRef": "2090968572"}} Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '898d83c8-9710-402a-ac02-06bb4dab4f3d', 'body': {'resize': {'flavorRef': '2090968572'}}} Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1055, in _resize Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:18:07.118248 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1141, in _action_resize Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1058, in _resize Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b831bf2-d125-479d-b373-35714b3b6e56 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] 10.222.0.81 "POST /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d/action" status: 403 len: 113 microversion: 2.1 time: 0.222269 Jul 14 15:18:07.124701 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3268/6497] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:18:06 2022] POST /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d/action => generated 113 bytes in 224 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:18:07.131185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ab9f2ccf-90f2-4da3-bfdf-63cefc89d349 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:07.131942 n-d-767704-28 devstack@n-api.service[119511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:18:07.131942 n-d-767704-28 devstack@n-api.service[119511]: warnings.warn(msg) Jul 14 15:18:07.149743 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ab9f2ccf-90f2-4da3-bfdf-63cefc89d349 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] 10.222.0.81 "DELETE /compute/v2.1/flavors/2090968572" status: 202 len: 0 microversion: 2.1 time: 0.022212 Jul 14 15:18:07.151084 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3230/6498] 10.222.0.81 () {58 vars in 1160 bytes} [Thu Jul 14 15:18:07 2022] DELETE /compute/v2.1/flavors/2090968572 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:18:07.159118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-34373fe2-835f-47a4-9116-06b16fa04301 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:07.179325 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-34373fe2-835f-47a4-9116-06b16fa04301 tempest-ServersAdminNegativeTestJSON-1762525681 tempest-ServersAdminNegativeTestJSON-1762525681-project-admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023839 Jul 14 15:18:07.179910 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3269/6499] 10.222.0.81 () {58 vars in 1145 bytes} [Thu Jul 14 15:18:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:07.197942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4c1caa45-649c-4c3e-989c-b78bb2601d85 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:07.198454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4c1caa45-649c-4c3e-989c-b78bb2601d85 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:07.204688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c1caa45-649c-4c3e-989c-b78bb2601d85 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:07.205194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c1caa45-649c-4c3e-989c-b78bb2601d85 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:07.205973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c1caa45-649c-4c3e-989c-b78bb2601d85 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:07.206413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c1caa45-649c-4c3e-989c-b78bb2601d85 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:07.233761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4c1caa45-649c-4c3e-989c-b78bb2601d85 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:18:07.314658 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4c1caa45-649c-4c3e-989c-b78bb2601d85 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "DELETE /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 204 len: 0 microversion: 2.1 time: 0.121011 Jul 14 15:18:07.315345 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3231/6500] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:18:07 2022] DELETE /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:18:07.323565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0e9457aa-e0ea-497f-a7f6-98d43437db74 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:07.324300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0e9457aa-e0ea-497f-a7f6-98d43437db74 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:07.332156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e9457aa-e0ea-497f-a7f6-98d43437db74 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:07.332575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e9457aa-e0ea-497f-a7f6-98d43437db74 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:07.333601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e9457aa-e0ea-497f-a7f6-98d43437db74 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:07.334095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0e9457aa-e0ea-497f-a7f6-98d43437db74 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:07.473099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0e9457aa-e0ea-497f-a7f6-98d43437db74 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:07.481269 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0e9457aa-e0ea-497f-a7f6-98d43437db74 tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1477 microversion: 2.1 time: 0.161612 Jul 14 15:18:07.481840 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3270/6501] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:07 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1477 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:08.500658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9bb99d8e-4a0b-4391-b880-2eec9a87f56f tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:08.501414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9bb99d8e-4a0b-4391-b880-2eec9a87f56f tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:08.508304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bb99d8e-4a0b-4391-b880-2eec9a87f56f tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:08.508765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bb99d8e-4a0b-4391-b880-2eec9a87f56f tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:08.510326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bb99d8e-4a0b-4391-b880-2eec9a87f56f tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:08.510775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bb99d8e-4a0b-4391-b880-2eec9a87f56f tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:08.644212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9bb99d8e-4a0b-4391-b880-2eec9a87f56f tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:08.652067 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9bb99d8e-4a0b-4391-b880-2eec9a87f56f tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1477 microversion: 2.1 time: 0.156033 Jul 14 15:18:08.652641 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3232/6502] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:08 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:09.672623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7e54afb9-9c9b-47ad-977b-69404c82d5be tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:09.678580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7e54afb9-9c9b-47ad-977b-69404c82d5be tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:09.686536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e54afb9-9c9b-47ad-977b-69404c82d5be tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:09.687148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e54afb9-9c9b-47ad-977b-69404c82d5be tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:09.688212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e54afb9-9c9b-47ad-977b-69404c82d5be tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:09.688844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e54afb9-9c9b-47ad-977b-69404c82d5be tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:09.727681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3d3fe4f7-547e-4cdc-acc4-9d1977039211 req-c02fe575-c5d5-45aa-8d7c-96a867548576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898d83c8-9710-402a-ac02-06bb4dab4f3d", "name": "network-vif-deleted", "tag": "7bbf59b0-abfc-4667-ada4-a40a301255e1"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:09.741456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3d3fe4f7-547e-4cdc-acc4-9d1977039211 req-c02fe575-c5d5-45aa-8d7c-96a867548576 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:09.742001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3d3fe4f7-547e-4cdc-acc4-9d1977039211 req-c02fe575-c5d5-45aa-8d7c-96a867548576 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:09.755296 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3d3fe4f7-547e-4cdc-acc4-9d1977039211 req-c02fe575-c5d5-45aa-8d7c-96a867548576 service nova] Creating event network-vif-deleted:7bbf59b0-abfc-4667-ada4-a40a301255e1 for instance 898d83c8-9710-402a-ac02-06bb4dab4f3d on n-h1-767704-28 Jul 14 15:18:09.766970 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3d3fe4f7-547e-4cdc-acc4-9d1977039211 req-c02fe575-c5d5-45aa-8d7c-96a867548576 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042903 Jul 14 15:18:09.768735 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3233/6503] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:09.787506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7e54afb9-9c9b-47ad-977b-69404c82d5be tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27cfa94f0024d5b9b31a22b60aea15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc014aa21f1f45429fd4d0511aeb8644', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:09.796052 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7e54afb9-9c9b-47ad-977b-69404c82d5be tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 200 len: 1435 microversion: 2.1 time: 0.130710 Jul 14 15:18:09.797567 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3271/6504] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:09 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 1435 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:10.815872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45b4c6ec-0f4e-4382-9bf0-c46aad950e2e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:10.816574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-45b4c6ec-0f4e-4382-9bf0-c46aad950e2e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] [instance: 898d83c8-9710-402a-ac02-06bb4dab4f3d] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:10.822925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45b4c6ec-0f4e-4382-9bf0-c46aad950e2e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:10.823384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45b4c6ec-0f4e-4382-9bf0-c46aad950e2e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:10.824337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45b4c6ec-0f4e-4382-9bf0-c46aad950e2e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:10.824780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-45b4c6ec-0f4e-4382-9bf0-c46aad950e2e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:10.841394 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-45b4c6ec-0f4e-4382-9bf0-c46aad950e2e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] HTTP exception thrown: Instance 898d83c8-9710-402a-ac02-06bb4dab4f3d could not be found. Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45b4c6ec-0f4e-4382-9bf0-c46aad950e2e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Request method failure captured: Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d HTTP/1.1 Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DOg365V5L24rWv850bVjr2fBUe6g9YW7Tw0egnq8yYslHnDwgU2vHiGVvyEL7LeEEWTR7sTPAjyCT9zFMesUKxm27rt1k7juiQVlTOQdilu-68zOUyjk3A5m_Dcc14OKy5BLhYfoOocvIkLg289DloaYP3mwGMjF6_uqPZZt67Eug4 Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: cc014aa21f1f45429fd4d0511aeb8644 Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-682788225 Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cc014aa21f1f45429fd4d0511aeb8644"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cc014aa21f1f45429fd4d0511aeb8644"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cc014aa21f1f45429fd4d0511aeb8644", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cc014aa21f1f45429fd4d0511aeb8644"}]}] Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersAdminNegativeTestJSON-682788225 Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: cc014aa21f1f45429fd4d0511aeb8644 Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-682788225 Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersAdminNegativeTestJSON-682788225-project Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: d27cfa94f0024d5b9b31a22b60aea15c Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersAdminNegativeTestJSON-682788225-project Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 898d83c8-9710-402a-ac02-06bb4dab4f3d could not be found. Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '898d83c8-9710-402a-ac02-06bb4dab4f3d'} Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 898d83c8-9710-402a-ac02-06bb4dab4f3d could not be found. Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 898d83c8-9710-402a-ac02-06bb4dab4f3d could not be found. Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:18:10.843052 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:18:10.848443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:10.848443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:18:10.848443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:18:10.848443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:18:10.848443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:18:10.848443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 898d83c8-9710-402a-ac02-06bb4dab4f3d could not be found. Jul 14 15:18:10.848443 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:18:10.848443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-45b4c6ec-0f4e-4382-9bf0-c46aad950e2e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] Returning 404 to user: Instance 898d83c8-9710-402a-ac02-06bb4dab4f3d could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:18:10.848443 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-45b4c6ec-0f4e-4382-9bf0-c46aad950e2e tempest-ServersAdminNegativeTestJSON-682788225 tempest-ServersAdminNegativeTestJSON-682788225-project] 10.222.0.81 "GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d" status: 404 len: 111 microversion: 2.1 time: 0.033771 Jul 14 15:18:10.848443 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3234/6505] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:10 2022] GET /compute/v2.1/servers/898d83c8-9710-402a-ac02-06bb4dab4f3d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:18:17.273831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:17.274628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:17.412999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1164802092", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "6b92a02d-d164-44f4-aecc-3d6bfd594c1f"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:17.474630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] validate_networks() for [('6b92a02d-d164-44f4-aecc-3d6bfd594c1f', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:18:17.896029 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:18:17.896560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:18:17.897096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:18:17.897610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:18:17.898088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:18:17.913645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:17.914118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:17.914937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:17.915390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:17.937666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Getting quotas for project 684a114467154f1e936f8cd85f0aaa3f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:18:17.944702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Getting quotas for user 7890c5a3428d431ca4e6fb6972f80418 and project 684a114467154f1e936f8cd85f0aaa3f. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:18:17.958532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:18:17.961133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:18:18.008093 n-d-767704-28 devstack@n-api.service[119512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [d4998366-8610-4443-9347-e496645857e2] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:18:19.017501 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [d4998366-8610-4443-9347-e496645857e2] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 51192. Jul 14 15:18:19.031910 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6d706000-4e22-4816-a71f-3cc58f43e51c tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.763429 Jul 14 15:18:19.032668 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3272/6506] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:18:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:18:19.042702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2d8f8b50-cd9c-479f-b5d1-14180ca16378 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:19.053482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2d8f8b50-cd9c-479f-b5d1-14180ca16378 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:19.056166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:19.056853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:19.119870 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2d8f8b50-cd9c-479f-b5d1-14180ca16378 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:19.128528 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2d8f8b50-cd9c-479f-b5d1-14180ca16378 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1215 microversion: 2.1 time: 0.089741 Jul 14 15:18:19.129230 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3235/6507] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:19 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:18:20.147362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b68675b7-20fd-4822-b78f-45458d231229 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:20.147985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b68675b7-20fd-4822-b78f-45458d231229 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:20.155190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b68675b7-20fd-4822-b78f-45458d231229 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:20.156203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b68675b7-20fd-4822-b78f-45458d231229 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:20.157026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b68675b7-20fd-4822-b78f-45458d231229 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:20.157480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b68675b7-20fd-4822-b78f-45458d231229 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:20.232588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b68675b7-20fd-4822-b78f-45458d231229 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:20.240934 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b68675b7-20fd-4822-b78f-45458d231229 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1267 microversion: 2.1 time: 0.098415 Jul 14 15:18:20.241548 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3273/6508] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:20 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:21.258300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-04732620-1b65-473c-af3c-832f137a31e6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:21.258917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-04732620-1b65-473c-af3c-832f137a31e6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:21.263566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:21.270342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04732620-1b65-473c-af3c-832f137a31e6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:21.271093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04732620-1b65-473c-af3c-832f137a31e6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:21.272174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04732620-1b65-473c-af3c-832f137a31e6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:21.272551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-04732620-1b65-473c-af3c-832f137a31e6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:21.508550 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-04732620-1b65-473c-af3c-832f137a31e6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:21.517360 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-04732620-1b65-473c-af3c-832f137a31e6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1315 microversion: 2.1 time: 0.262759 Jul 14 15:18:21.517960 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3236/6509] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:21 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:21.972930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5f5b5cdc-9cca-40ad-90f7-1092cb377d9e req-f7b76124-7b5b-473e-8bd7-a490a2da8149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9", "tag": "d2f2d767-5852-47c5-8650-f622363d1cea"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:21.984917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5f5b5cdc-9cca-40ad-90f7-1092cb377d9e req-f7b76124-7b5b-473e-8bd7-a490a2da8149 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:21.985466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5f5b5cdc-9cca-40ad-90f7-1092cb377d9e req-f7b76124-7b5b-473e-8bd7-a490a2da8149 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:22.003016 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5f5b5cdc-9cca-40ad-90f7-1092cb377d9e req-f7b76124-7b5b-473e-8bd7-a490a2da8149 service nova] Creating event network-changed:d2f2d767-5852-47c5-8650-f622363d1cea for instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 on n-h1-767704-28 Jul 14 15:18:22.019017 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5f5b5cdc-9cca-40ad-90f7-1092cb377d9e req-f7b76124-7b5b-473e-8bd7-a490a2da8149 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052001 Jul 14 15:18:22.021266 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3274/6510] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:22.548185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b3b4aebe-2848-41c4-85d0-fe6429eb30bb tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:22.549344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b3b4aebe-2848-41c4-85d0-fe6429eb30bb tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:22.557335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3b4aebe-2848-41c4-85d0-fe6429eb30bb tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:22.557802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3b4aebe-2848-41c4-85d0-fe6429eb30bb tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:22.558567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3b4aebe-2848-41c4-85d0-fe6429eb30bb tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:22.559978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3b4aebe-2848-41c4-85d0-fe6429eb30bb tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:22.697145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b3b4aebe-2848-41c4-85d0-fe6429eb30bb tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:22.704709 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b3b4aebe-2848-41c4-85d0-fe6429eb30bb tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1315 microversion: 2.1 time: 0.173088 Jul 14 15:18:22.705326 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3237/6511] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:22 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:23.724679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1e826b4f-657d-4ff2-851e-41b558061662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:23.725604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1e826b4f-657d-4ff2-851e-41b558061662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:23.734049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e826b4f-657d-4ff2-851e-41b558061662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:23.734519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e826b4f-657d-4ff2-851e-41b558061662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:23.735318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e826b4f-657d-4ff2-851e-41b558061662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:23.735771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e826b4f-657d-4ff2-851e-41b558061662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:23.941645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1e826b4f-657d-4ff2-851e-41b558061662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:23.949655 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1e826b4f-657d-4ff2-851e-41b558061662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1315 microversion: 2.1 time: 0.230592 Jul 14 15:18:23.950380 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3275/6512] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:23 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:24.968000 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9bd7e3be-f980-4b43-b486-dad2e76d7efa tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:24.968873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9bd7e3be-f980-4b43-b486-dad2e76d7efa tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:24.971312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:24.977561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bd7e3be-f980-4b43-b486-dad2e76d7efa tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:24.978041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bd7e3be-f980-4b43-b486-dad2e76d7efa tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:24.978830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bd7e3be-f980-4b43-b486-dad2e76d7efa tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:24.979277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9bd7e3be-f980-4b43-b486-dad2e76d7efa tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:25.118547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9bd7e3be-f980-4b43-b486-dad2e76d7efa tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:25.127483 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9bd7e3be-f980-4b43-b486-dad2e76d7efa tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1315 microversion: 2.1 time: 0.164495 Jul 14 15:18:25.128069 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3238/6513] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:24 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:26.144622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc883401-84ca-4bff-8027-319acea6718e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:26.145276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dc883401-84ca-4bff-8027-319acea6718e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:26.147848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:26.153461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc883401-84ca-4bff-8027-319acea6718e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:26.153931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc883401-84ca-4bff-8027-319acea6718e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:26.154720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc883401-84ca-4bff-8027-319acea6718e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:26.155173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc883401-84ca-4bff-8027-319acea6718e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:26.158574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=78 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:26.286986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dc883401-84ca-4bff-8027-319acea6718e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:26.295095 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dc883401-84ca-4bff-8027-319acea6718e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1315 microversion: 2.1 time: 0.154521 Jul 14 15:18:26.295673 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3276/6514] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:26 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:27.311809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9cdf9ae8-9a3d-4e33-bb41-0f750d24f1ce tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:27.312558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9cdf9ae8-9a3d-4e33-bb41-0f750d24f1ce tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:27.320181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cdf9ae8-9a3d-4e33-bb41-0f750d24f1ce tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:27.320655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cdf9ae8-9a3d-4e33-bb41-0f750d24f1ce tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:27.321457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cdf9ae8-9a3d-4e33-bb41-0f750d24f1ce tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:27.321896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9cdf9ae8-9a3d-4e33-bb41-0f750d24f1ce tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:27.459286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9cdf9ae8-9a3d-4e33-bb41-0f750d24f1ce tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:27.467455 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9cdf9ae8-9a3d-4e33-bb41-0f750d24f1ce tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1315 microversion: 2.1 time: 0.159650 Jul 14 15:18:27.468061 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3239/6515] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:27 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:28.483928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac439817-ee68-470b-ae94-e3d06f2da28b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:28.484563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac439817-ee68-470b-ae94-e3d06f2da28b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:28.487426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:28.488256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:28.494398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac439817-ee68-470b-ae94-e3d06f2da28b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:28.494860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac439817-ee68-470b-ae94-e3d06f2da28b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:28.495653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac439817-ee68-470b-ae94-e3d06f2da28b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:28.496098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac439817-ee68-470b-ae94-e3d06f2da28b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:28.632830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac439817-ee68-470b-ae94-e3d06f2da28b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:28.640669 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac439817-ee68-470b-ae94-e3d06f2da28b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1315 microversion: 2.1 time: 0.160710 Jul 14 15:18:28.641281 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3277/6516] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:28 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:29.442685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b4ce2fe9-f3e8-44d1-999f-3f5c919e1cd0 req-5efacac1-2dca-4bfc-a4eb-16436f96476b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9", "name": "network-vif-plugged", "status": "completed", "tag": "d2f2d767-5852-47c5-8650-f622363d1cea"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:29.447603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:29.455901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b4ce2fe9-f3e8-44d1-999f-3f5c919e1cd0 req-5efacac1-2dca-4bfc-a4eb-16436f96476b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:29.456352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b4ce2fe9-f3e8-44d1-999f-3f5c919e1cd0 req-5efacac1-2dca-4bfc-a4eb-16436f96476b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:29.468555 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b4ce2fe9-f3e8-44d1-999f-3f5c919e1cd0 req-5efacac1-2dca-4bfc-a4eb-16436f96476b service nova] Creating event network-vif-plugged:d2f2d767-5852-47c5-8650-f622363d1cea for instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 on n-h1-767704-28 Jul 14 15:18:29.473752 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b4ce2fe9-f3e8-44d1-999f-3f5c919e1cd0 req-5efacac1-2dca-4bfc-a4eb-16436f96476b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034831 Jul 14 15:18:29.474418 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3240/6517] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:29.658000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d041bc47-f671-4361-afa3-be874cc2d3df tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:29.658629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d041bc47-f671-4361-afa3-be874cc2d3df tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:29.665527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d041bc47-f671-4361-afa3-be874cc2d3df tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:29.665990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d041bc47-f671-4361-afa3-be874cc2d3df tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:29.666768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d041bc47-f671-4361-afa3-be874cc2d3df tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:29.667219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d041bc47-f671-4361-afa3-be874cc2d3df tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:29.806689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d041bc47-f671-4361-afa3-be874cc2d3df tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:29.814582 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d041bc47-f671-4361-afa3-be874cc2d3df tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1315 microversion: 2.1 time: 0.160393 Jul 14 15:18:29.815165 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3278/6518] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:29 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:18:30.833803 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fb6d8c85-c27b-4ecb-aaf3-7a8f9dac8df0 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:30.834543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fb6d8c85-c27b-4ecb-aaf3-7a8f9dac8df0 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:30.841873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb6d8c85-c27b-4ecb-aaf3-7a8f9dac8df0 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:30.842335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb6d8c85-c27b-4ecb-aaf3-7a8f9dac8df0 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:30.843116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb6d8c85-c27b-4ecb-aaf3-7a8f9dac8df0 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:30.843563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb6d8c85-c27b-4ecb-aaf3-7a8f9dac8df0 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:30.979001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fb6d8c85-c27b-4ecb-aaf3-7a8f9dac8df0 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:30.987418 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fb6d8c85-c27b-4ecb-aaf3-7a8f9dac8df0 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1315 microversion: 2.1 time: 0.157610 Jul 14 15:18:30.987728 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3241/6519] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:30 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:32.004594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a69340d-21a3-47bb-9301-84cd28b37593 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:32.005242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0a69340d-21a3-47bb-9301-84cd28b37593 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:32.011811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a69340d-21a3-47bb-9301-84cd28b37593 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:32.013175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a69340d-21a3-47bb-9301-84cd28b37593 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:32.014091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a69340d-21a3-47bb-9301-84cd28b37593 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:32.014555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a69340d-21a3-47bb-9301-84cd28b37593 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:32.033833 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:18:32.034393 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 15:18:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:18:32.147328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0a69340d-21a3-47bb-9301-84cd28b37593 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:32.154956 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0a69340d-21a3-47bb-9301-84cd28b37593 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1503 microversion: 2.1 time: 0.154822 Jul 14 15:18:32.155523 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3279/6520] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:31 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:32.172249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:32.173572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:32.180523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:32.181012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:32.182155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:32.182615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:32.214607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:32.221311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Old instance type m1.heat2, new instance type m1.heat {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:18:32.227952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:18:32.228382 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:18:32.228860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:18:32.229300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:18:32.229716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:18:32.294088 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8434c761-d0be-4c72-a863-0743ebc4218a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "POST /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.125645 Jul 14 15:18:32.294875 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3242/6521] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:18:32 2022] POST /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:18:32.302661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a2cf9eac-1a6c-4311-b05a-8d14595e575b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:32.303293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a2cf9eac-1a6c-4311-b05a-8d14595e575b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:32.310221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2cf9eac-1a6c-4311-b05a-8d14595e575b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:32.310794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2cf9eac-1a6c-4311-b05a-8d14595e575b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:32.311665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2cf9eac-1a6c-4311-b05a-8d14595e575b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:32.312199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a2cf9eac-1a6c-4311-b05a-8d14595e575b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:32.476904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a2cf9eac-1a6c-4311-b05a-8d14595e575b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:32.485561 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a2cf9eac-1a6c-4311-b05a-8d14595e575b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1512 microversion: 2.1 time: 0.186663 Jul 14 15:18:32.486353 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3280/6522] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:32 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:33.504400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-351431c5-4b89-450e-8fa7-7cbaf189bb38 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:33.505034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-351431c5-4b89-450e-8fa7-7cbaf189bb38 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:33.511221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-351431c5-4b89-450e-8fa7-7cbaf189bb38 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:33.511674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-351431c5-4b89-450e-8fa7-7cbaf189bb38 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:33.513249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-351431c5-4b89-450e-8fa7-7cbaf189bb38 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:33.513764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-351431c5-4b89-450e-8fa7-7cbaf189bb38 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:33.649278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-351431c5-4b89-450e-8fa7-7cbaf189bb38 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:33.657108 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-351431c5-4b89-450e-8fa7-7cbaf189bb38 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1512 microversion: 2.1 time: 0.157866 Jul 14 15:18:33.657754 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3243/6523] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:33 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:18:34.673374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4f7f187b-1ea6-40cd-a655-f2f8045d11ba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:34.673911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4f7f187b-1ea6-40cd-a655-f2f8045d11ba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:34.680817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f7f187b-1ea6-40cd-a655-f2f8045d11ba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:34.681313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f7f187b-1ea6-40cd-a655-f2f8045d11ba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:34.682096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f7f187b-1ea6-40cd-a655-f2f8045d11ba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:34.682550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4f7f187b-1ea6-40cd-a655-f2f8045d11ba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:34.825886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4f7f187b-1ea6-40cd-a655-f2f8045d11ba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:34.833682 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4f7f187b-1ea6-40cd-a655-f2f8045d11ba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.164203 Jul 14 15:18:34.834255 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3281/6524] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:34 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:18:35.851632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3db690b0-e57c-403a-aaf5-f493b8248e87 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:35.852246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3db690b0-e57c-403a-aaf5-f493b8248e87 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:35.859939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3db690b0-e57c-403a-aaf5-f493b8248e87 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:35.860388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3db690b0-e57c-403a-aaf5-f493b8248e87 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:35.861199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3db690b0-e57c-403a-aaf5-f493b8248e87 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:35.861645 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3db690b0-e57c-403a-aaf5-f493b8248e87 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:35.993772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3db690b0-e57c-403a-aaf5-f493b8248e87 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:36.001745 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3db690b0-e57c-403a-aaf5-f493b8248e87 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.154043 Jul 14 15:18:36.002311 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3244/6525] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:35 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:37.018510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f38b802-8a66-4272-b98c-cd97a4fe122a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:37.019157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2f38b802-8a66-4272-b98c-cd97a4fe122a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:37.026403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f38b802-8a66-4272-b98c-cd97a4fe122a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:37.026864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f38b802-8a66-4272-b98c-cd97a4fe122a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:37.027646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f38b802-8a66-4272-b98c-cd97a4fe122a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:37.028251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2f38b802-8a66-4272-b98c-cd97a4fe122a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:37.164885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2f38b802-8a66-4272-b98c-cd97a4fe122a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:37.173660 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f38b802-8a66-4272-b98c-cd97a4fe122a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.158885 Jul 14 15:18:37.174245 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3282/6526] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:37 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:38.190181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6018af08-f790-4d0b-9d7c-0213fe067fba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:38.190742 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6018af08-f790-4d0b-9d7c-0213fe067fba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:38.197627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6018af08-f790-4d0b-9d7c-0213fe067fba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:38.198076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6018af08-f790-4d0b-9d7c-0213fe067fba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:38.198840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6018af08-f790-4d0b-9d7c-0213fe067fba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:38.199333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6018af08-f790-4d0b-9d7c-0213fe067fba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:38.333683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6018af08-f790-4d0b-9d7c-0213fe067fba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:38.342050 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6018af08-f790-4d0b-9d7c-0213fe067fba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.155768 Jul 14 15:18:38.342626 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3245/6527] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:38 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:39.359613 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4fba27a0-da71-41d4-a366-bb00f3c5a662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:39.360240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4fba27a0-da71-41d4-a366-bb00f3c5a662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:39.367286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fba27a0-da71-41d4-a366-bb00f3c5a662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:39.367752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fba27a0-da71-41d4-a366-bb00f3c5a662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:39.368525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fba27a0-da71-41d4-a366-bb00f3c5a662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:39.368996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fba27a0-da71-41d4-a366-bb00f3c5a662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:39.502140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4fba27a0-da71-41d4-a366-bb00f3c5a662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:39.509850 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4fba27a0-da71-41d4-a366-bb00f3c5a662 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.154692 Jul 14 15:18:39.510463 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3283/6528] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:39 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:40.526847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-11a23811-35c3-49b7-b8b5-7f54b468d54f tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:40.527612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-11a23811-35c3-49b7-b8b5-7f54b468d54f tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:40.535017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11a23811-35c3-49b7-b8b5-7f54b468d54f tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:40.535475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11a23811-35c3-49b7-b8b5-7f54b468d54f tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:40.536254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11a23811-35c3-49b7-b8b5-7f54b468d54f tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:40.536691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-11a23811-35c3-49b7-b8b5-7f54b468d54f tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:40.675021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-11a23811-35c3-49b7-b8b5-7f54b468d54f tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:40.682587 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-11a23811-35c3-49b7-b8b5-7f54b468d54f tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.159618 Jul 14 15:18:40.683159 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3246/6529] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:40 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:41.699699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-97bc9a19-f7b3-4eef-909c-4f147ccf29a1 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:41.700326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-97bc9a19-f7b3-4eef-909c-4f147ccf29a1 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:41.707414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97bc9a19-f7b3-4eef-909c-4f147ccf29a1 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:41.707888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97bc9a19-f7b3-4eef-909c-4f147ccf29a1 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:41.708678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97bc9a19-f7b3-4eef-909c-4f147ccf29a1 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:41.709167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97bc9a19-f7b3-4eef-909c-4f147ccf29a1 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:41.841135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-97bc9a19-f7b3-4eef-909c-4f147ccf29a1 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:41.848707 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-97bc9a19-f7b3-4eef-909c-4f147ccf29a1 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.152936 Jul 14 15:18:41.849318 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3284/6530] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:41 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:42.865934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7dd16c65-9037-4cc4-9afa-080676149a79 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:42.866525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7dd16c65-9037-4cc4-9afa-080676149a79 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:42.873901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7dd16c65-9037-4cc4-9afa-080676149a79 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:42.874460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7dd16c65-9037-4cc4-9afa-080676149a79 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:42.875498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7dd16c65-9037-4cc4-9afa-080676149a79 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:42.875936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7dd16c65-9037-4cc4-9afa-080676149a79 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:43.015006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7dd16c65-9037-4cc4-9afa-080676149a79 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:43.022659 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7dd16c65-9037-4cc4-9afa-080676149a79 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.160800 Jul 14 15:18:43.023226 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3247/6531] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:42 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:44.040144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f86da92f-9cd0-46fb-8bb8-cec1c3441b88 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:44.040827 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f86da92f-9cd0-46fb-8bb8-cec1c3441b88 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:44.048472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f86da92f-9cd0-46fb-8bb8-cec1c3441b88 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:44.048965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f86da92f-9cd0-46fb-8bb8-cec1c3441b88 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:44.049762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f86da92f-9cd0-46fb-8bb8-cec1c3441b88 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:44.050223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f86da92f-9cd0-46fb-8bb8-cec1c3441b88 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:44.186489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f86da92f-9cd0-46fb-8bb8-cec1c3441b88 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:44.194008 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f86da92f-9cd0-46fb-8bb8-cec1c3441b88 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.158177 Jul 14 15:18:44.194585 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3285/6532] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:44 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:45.211563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d91eda76-ed6e-44f0-a837-1ce9b7c4d4d2 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:45.212212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d91eda76-ed6e-44f0-a837-1ce9b7c4d4d2 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:45.221025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d91eda76-ed6e-44f0-a837-1ce9b7c4d4d2 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:45.221488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d91eda76-ed6e-44f0-a837-1ce9b7c4d4d2 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:45.222294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d91eda76-ed6e-44f0-a837-1ce9b7c4d4d2 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:45.222702 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d91eda76-ed6e-44f0-a837-1ce9b7c4d4d2 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:45.356765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d91eda76-ed6e-44f0-a837-1ce9b7c4d4d2 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:45.364424 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d91eda76-ed6e-44f0-a837-1ce9b7c4d4d2 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.156700 Jul 14 15:18:45.365030 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3248/6533] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:45 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:46.382440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-03732f0c-b0f3-4888-8ea2-8d5572f0b77e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:46.383081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-03732f0c-b0f3-4888-8ea2-8d5572f0b77e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:46.389261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03732f0c-b0f3-4888-8ea2-8d5572f0b77e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:46.389727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03732f0c-b0f3-4888-8ea2-8d5572f0b77e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:46.390508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03732f0c-b0f3-4888-8ea2-8d5572f0b77e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:46.390964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03732f0c-b0f3-4888-8ea2-8d5572f0b77e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:46.530922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-03732f0c-b0f3-4888-8ea2-8d5572f0b77e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:46.538509 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-03732f0c-b0f3-4888-8ea2-8d5572f0b77e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.160780 Jul 14 15:18:46.539100 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3286/6534] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:46 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:47.555857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9398387-6fec-4a29-bf27-43d1757dc244 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:47.556459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c9398387-6fec-4a29-bf27-43d1757dc244 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:47.564474 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9398387-6fec-4a29-bf27-43d1757dc244 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:47.564924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9398387-6fec-4a29-bf27-43d1757dc244 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:47.565737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9398387-6fec-4a29-bf27-43d1757dc244 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:47.566171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9398387-6fec-4a29-bf27-43d1757dc244 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:47.697513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c9398387-6fec-4a29-bf27-43d1757dc244 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:47.705030 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c9398387-6fec-4a29-bf27-43d1757dc244 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.153156 Jul 14 15:18:47.705609 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3249/6535] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:47 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:18:48.723260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-355a58a7-5578-4e7a-b7f9-ef342ee2b7c6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:48.723877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-355a58a7-5578-4e7a-b7f9-ef342ee2b7c6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:48.731112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-355a58a7-5578-4e7a-b7f9-ef342ee2b7c6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:48.731584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-355a58a7-5578-4e7a-b7f9-ef342ee2b7c6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:48.732372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-355a58a7-5578-4e7a-b7f9-ef342ee2b7c6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:48.732824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-355a58a7-5578-4e7a-b7f9-ef342ee2b7c6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:48.869479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-355a58a7-5578-4e7a-b7f9-ef342ee2b7c6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:48.878220 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-355a58a7-5578-4e7a-b7f9-ef342ee2b7c6 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.158828 Jul 14 15:18:48.878800 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3287/6536] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:48 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:49.896594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b5a85b63-2dc4-4f5f-907f-c0727670c0a5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:49.897232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5a85b63-2dc4-4f5f-907f-c0727670c0a5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:49.905337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5a85b63-2dc4-4f5f-907f-c0727670c0a5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:49.905798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5a85b63-2dc4-4f5f-907f-c0727670c0a5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:49.906830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5a85b63-2dc4-4f5f-907f-c0727670c0a5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:49.907346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5a85b63-2dc4-4f5f-907f-c0727670c0a5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:50.038636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b5a85b63-2dc4-4f5f-907f-c0727670c0a5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:50.046430 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b5a85b63-2dc4-4f5f-907f-c0727670c0a5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.154429 Jul 14 15:18:50.047012 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3250/6537] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:49 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:51.066680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5f4f5250-1f57-4d21-8650-bec76d51c0dd tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:51.067776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5f4f5250-1f57-4d21-8650-bec76d51c0dd tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:51.078440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f4f5250-1f57-4d21-8650-bec76d51c0dd tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:51.079121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f4f5250-1f57-4d21-8650-bec76d51c0dd tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:51.080298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f4f5250-1f57-4d21-8650-bec76d51c0dd tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:51.081045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f4f5250-1f57-4d21-8650-bec76d51c0dd tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:51.236659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5f4f5250-1f57-4d21-8650-bec76d51c0dd tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:51.258806 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5f4f5250-1f57-4d21-8650-bec76d51c0dd tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.197643 Jul 14 15:18:51.259496 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3288/6538] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:51 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:52.285725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bab568de-4d09-4ac2-b8ff-a7f8ad8058be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:52.286494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bab568de-4d09-4ac2-b8ff-a7f8ad8058be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:52.295010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bab568de-4d09-4ac2-b8ff-a7f8ad8058be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:52.295468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bab568de-4d09-4ac2-b8ff-a7f8ad8058be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:52.296265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bab568de-4d09-4ac2-b8ff-a7f8ad8058be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:52.296708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bab568de-4d09-4ac2-b8ff-a7f8ad8058be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:52.299429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:52.436790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bab568de-4d09-4ac2-b8ff-a7f8ad8058be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:52.444541 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bab568de-4d09-4ac2-b8ff-a7f8ad8058be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.162782 Jul 14 15:18:52.445167 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3251/6539] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:52 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:53.461897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ef274422-40e7-4b95-8b0d-ed7b4a949e19 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:53.462530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ef274422-40e7-4b95-8b0d-ed7b4a949e19 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:53.469722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef274422-40e7-4b95-8b0d-ed7b4a949e19 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:53.470172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef274422-40e7-4b95-8b0d-ed7b4a949e19 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:53.470977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef274422-40e7-4b95-8b0d-ed7b4a949e19 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:53.471405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ef274422-40e7-4b95-8b0d-ed7b4a949e19 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:53.607851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ef274422-40e7-4b95-8b0d-ed7b4a949e19 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:53.615470 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ef274422-40e7-4b95-8b0d-ed7b4a949e19 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.157515 Jul 14 15:18:53.616044 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3289/6540] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:53 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:54.633046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-72557738-50a2-4d62-9314-50ea96662f85 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:54.633663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-72557738-50a2-4d62-9314-50ea96662f85 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:54.641040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72557738-50a2-4d62-9314-50ea96662f85 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:54.641496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72557738-50a2-4d62-9314-50ea96662f85 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:54.642263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72557738-50a2-4d62-9314-50ea96662f85 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:54.642698 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72557738-50a2-4d62-9314-50ea96662f85 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:54.779488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-72557738-50a2-4d62-9314-50ea96662f85 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:54.787167 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-72557738-50a2-4d62-9314-50ea96662f85 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.158220 Jul 14 15:18:54.787764 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3252/6541] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:54 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:55.804876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-94c4180d-769a-4fb9-9865-91cd24a5380e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:55.805535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-94c4180d-769a-4fb9-9865-91cd24a5380e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:55.812437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94c4180d-769a-4fb9-9865-91cd24a5380e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:55.812904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94c4180d-769a-4fb9-9865-91cd24a5380e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:55.813718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94c4180d-769a-4fb9-9865-91cd24a5380e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:55.814173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94c4180d-769a-4fb9-9865-91cd24a5380e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:55.947490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-94c4180d-769a-4fb9-9865-91cd24a5380e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:55.955207 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-94c4180d-769a-4fb9-9865-91cd24a5380e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.154315 Jul 14 15:18:55.955785 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3290/6542] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:55 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:56.973369 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0c9069cf-83e9-4967-a1c7-b532de1133ca tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:56.973986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0c9069cf-83e9-4967-a1c7-b532de1133ca tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:56.976701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=34 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:56.983199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c9069cf-83e9-4967-a1c7-b532de1133ca tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:56.983686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c9069cf-83e9-4967-a1c7-b532de1133ca tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:56.984478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c9069cf-83e9-4967-a1c7-b532de1133ca tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:56.984925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c9069cf-83e9-4967-a1c7-b532de1133ca tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:57.126809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0c9069cf-83e9-4967-a1c7-b532de1133ca tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:57.134701 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0c9069cf-83e9-4967-a1c7-b532de1133ca tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.165363 Jul 14 15:18:57.135282 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3253/6543] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:56 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:58.153218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b27803ad-828e-471d-8c29-f87a00336236 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:58.153785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b27803ad-828e-471d-8c29-f87a00336236 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:58.156463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=30 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:58.161957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b27803ad-828e-471d-8c29-f87a00336236 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:58.162420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b27803ad-828e-471d-8c29-f87a00336236 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:58.163201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b27803ad-828e-471d-8c29-f87a00336236 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:58.163647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b27803ad-828e-471d-8c29-f87a00336236 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:58.166544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=90 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:58.302084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b27803ad-828e-471d-8c29-f87a00336236 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:58.310725 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b27803ad-828e-471d-8c29-f87a00336236 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.161958 Jul 14 15:18:58.311317 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3291/6544] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:58 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:59.329655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b79dbf52-e799-4054-a623-7a03a34a1d6b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:59.330296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b79dbf52-e799-4054-a623-7a03a34a1d6b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:59.337381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b79dbf52-e799-4054-a623-7a03a34a1d6b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:59.337842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b79dbf52-e799-4054-a623-7a03a34a1d6b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:59.338617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b79dbf52-e799-4054-a623-7a03a34a1d6b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:59.339069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b79dbf52-e799-4054-a623-7a03a34a1d6b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:59.760432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b79dbf52-e799-4054-a623-7a03a34a1d6b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:59.769104 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b79dbf52-e799-4054-a623-7a03a34a1d6b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.443291 Jul 14 15:18:59.769708 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3254/6545] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:59 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:00.786546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ae75947-3543-424f-89a8-7270eeb1558b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:00.787792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ae75947-3543-424f-89a8-7270eeb1558b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:00.800092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ae75947-3543-424f-89a8-7270eeb1558b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:00.800516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ae75947-3543-424f-89a8-7270eeb1558b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:00.801352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ae75947-3543-424f-89a8-7270eeb1558b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:00.801818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ae75947-3543-424f-89a8-7270eeb1558b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:00.955930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ae75947-3543-424f-89a8-7270eeb1558b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:00.963856 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ae75947-3543-424f-89a8-7270eeb1558b tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.181137 Jul 14 15:19:00.965108 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3292/6546] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:00 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:01.984303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6684b0f5-7c2b-4fa0-896e-a26d42b4eeef tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:01.984924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6684b0f5-7c2b-4fa0-896e-a26d42b4eeef tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:01.992231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6684b0f5-7c2b-4fa0-896e-a26d42b4eeef tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:01.992696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6684b0f5-7c2b-4fa0-896e-a26d42b4eeef tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:01.993585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6684b0f5-7c2b-4fa0-896e-a26d42b4eeef tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:01.994030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6684b0f5-7c2b-4fa0-896e-a26d42b4eeef tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:02.128620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6684b0f5-7c2b-4fa0-896e-a26d42b4eeef tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:02.136251 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6684b0f5-7c2b-4fa0-896e-a26d42b4eeef tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.156494 Jul 14 15:19:02.136811 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3255/6547] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:01 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:03.153998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-edaf076e-b543-4118-8b1f-bdb023d75aba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:03.154674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-edaf076e-b543-4118-8b1f-bdb023d75aba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:03.161678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-edaf076e-b543-4118-8b1f-bdb023d75aba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:03.162147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-edaf076e-b543-4118-8b1f-bdb023d75aba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:03.162938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-edaf076e-b543-4118-8b1f-bdb023d75aba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:03.163389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-edaf076e-b543-4118-8b1f-bdb023d75aba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:03.305357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-edaf076e-b543-4118-8b1f-bdb023d75aba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:03.313098 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-edaf076e-b543-4118-8b1f-bdb023d75aba tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.163634 Jul 14 15:19:03.313695 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3293/6548] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:03 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:04.331067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-44a9fc95-3b05-484e-bf49-58731340ae3d tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:04.331680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-44a9fc95-3b05-484e-bf49-58731340ae3d tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:04.339585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44a9fc95-3b05-484e-bf49-58731340ae3d tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:04.340055 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44a9fc95-3b05-484e-bf49-58731340ae3d tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:04.340840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44a9fc95-3b05-484e-bf49-58731340ae3d tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:04.341309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-44a9fc95-3b05-484e-bf49-58731340ae3d tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:04.494100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-44a9fc95-3b05-484e-bf49-58731340ae3d tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:04.503300 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-44a9fc95-3b05-484e-bf49-58731340ae3d tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.175322 Jul 14 15:19:04.503942 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3256/6549] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:04 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:05.521146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ec3c8e5-2498-402f-b88f-dde71194d1d5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:05.521775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ec3c8e5-2498-402f-b88f-dde71194d1d5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:05.530237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ec3c8e5-2498-402f-b88f-dde71194d1d5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:05.530635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ec3c8e5-2498-402f-b88f-dde71194d1d5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:05.531202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ec3c8e5-2498-402f-b88f-dde71194d1d5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:05.531661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ec3c8e5-2498-402f-b88f-dde71194d1d5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:05.665578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ec3c8e5-2498-402f-b88f-dde71194d1d5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:05.674846 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ec3c8e5-2498-402f-b88f-dde71194d1d5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.157502 Jul 14 15:19:05.675349 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3294/6550] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:05 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:06.692287 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e41920b4-2867-42de-be5b-5fb3ce3159be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:06.692842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e41920b4-2867-42de-be5b-5fb3ce3159be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:06.700524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e41920b4-2867-42de-be5b-5fb3ce3159be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:06.701011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e41920b4-2867-42de-be5b-5fb3ce3159be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:06.701789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e41920b4-2867-42de-be5b-5fb3ce3159be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:06.702229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e41920b4-2867-42de-be5b-5fb3ce3159be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:06.839142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e41920b4-2867-42de-be5b-5fb3ce3159be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:06.847962 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e41920b4-2867-42de-be5b-5fb3ce3159be tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1517 microversion: 2.1 time: 0.159632 Jul 14 15:19:06.848552 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3257/6551] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:06 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:07.748149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-74532319-178b-400a-9c33-8eb82d89a2b4 req-8de04617-af43-423f-9473-497c4f1eff9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9", "name": "network-vif-unplugged", "status": "completed", "tag": "d2f2d767-5852-47c5-8650-f622363d1cea"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:07.757905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-74532319-178b-400a-9c33-8eb82d89a2b4 req-8de04617-af43-423f-9473-497c4f1eff9e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:07.758410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-74532319-178b-400a-9c33-8eb82d89a2b4 req-8de04617-af43-423f-9473-497c4f1eff9e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:07.771399 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-74532319-178b-400a-9c33-8eb82d89a2b4 req-8de04617-af43-423f-9473-497c4f1eff9e service nova] Creating event network-vif-unplugged:d2f2d767-5852-47c5-8650-f622363d1cea for instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 on n-h2-767704-28 Jul 14 15:19:07.777302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-74532319-178b-400a-9c33-8eb82d89a2b4 req-8de04617-af43-423f-9473-497c4f1eff9e service nova] Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:19:07.789021 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-74532319-178b-400a-9c33-8eb82d89a2b4 req-8de04617-af43-423f-9473-497c4f1eff9e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044693 Jul 14 15:19:07.789286 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3295/6552] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:19:07.870169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f1e2141-1265-44e1-a1c0-2a55968d3373 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:07.871556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8f1e2141-1265-44e1-a1c0-2a55968d3373 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:07.879668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f1e2141-1265-44e1-a1c0-2a55968d3373 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:07.880141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f1e2141-1265-44e1-a1c0-2a55968d3373 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:07.881096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f1e2141-1265-44e1-a1c0-2a55968d3373 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:07.881566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f1e2141-1265-44e1-a1c0-2a55968d3373 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:08.097248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f1e2141-1265-44e1-a1c0-2a55968d3373 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:08.106361 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8f1e2141-1265-44e1-a1c0-2a55968d3373 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1516 microversion: 2.1 time: 0.242672 Jul 14 15:19:08.106962 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3258/6553] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:07 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:09.124320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e5cfd2f1-db3a-4909-8882-23b2572339f7 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:09.124959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e5cfd2f1-db3a-4909-8882-23b2572339f7 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:09.131512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5cfd2f1-db3a-4909-8882-23b2572339f7 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:09.131977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5cfd2f1-db3a-4909-8882-23b2572339f7 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:09.132748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5cfd2f1-db3a-4909-8882-23b2572339f7 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:09.133225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e5cfd2f1-db3a-4909-8882-23b2572339f7 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:09.272490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e5cfd2f1-db3a-4909-8882-23b2572339f7 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:09.281167 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e5cfd2f1-db3a-4909-8882-23b2572339f7 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1514 microversion: 2.1 time: 0.161998 Jul 14 15:19:09.281755 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3296/6554] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:09 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:09.810410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-fe879f83-641f-4fa3-ac29-2470d51fa8e8 req-158fd035-bdb9-419e-b99e-d9b5294fa44d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9", "tag": "d2f2d767-5852-47c5-8650-f622363d1cea"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:09.819357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-fe879f83-641f-4fa3-ac29-2470d51fa8e8 req-158fd035-bdb9-419e-b99e-d9b5294fa44d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:09.819810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-fe879f83-641f-4fa3-ac29-2470d51fa8e8 req-158fd035-bdb9-419e-b99e-d9b5294fa44d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:09.831725 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-fe879f83-641f-4fa3-ac29-2470d51fa8e8 req-158fd035-bdb9-419e-b99e-d9b5294fa44d service nova] Creating event network-changed:d2f2d767-5852-47c5-8650-f622363d1cea for instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 on n-h2-767704-28 Jul 14 15:19:09.837072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-fe879f83-641f-4fa3-ac29-2470d51fa8e8 req-158fd035-bdb9-419e-b99e-d9b5294fa44d service nova] Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:19:09.847896 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-fe879f83-641f-4fa3-ac29-2470d51fa8e8 req-158fd035-bdb9-419e-b99e-d9b5294fa44d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041933 Jul 14 15:19:09.848501 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3259/6555] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:19:10.298458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d037b5be-3244-43f2-a44b-75ad634331f5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:10.299050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d037b5be-3244-43f2-a44b-75ad634331f5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:10.305948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d037b5be-3244-43f2-a44b-75ad634331f5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:10.306414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d037b5be-3244-43f2-a44b-75ad634331f5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:10.307192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d037b5be-3244-43f2-a44b-75ad634331f5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:10.308210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d037b5be-3244-43f2-a44b-75ad634331f5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:10.900651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d037b5be-3244-43f2-a44b-75ad634331f5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:10.912391 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d037b5be-3244-43f2-a44b-75ad634331f5 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1514 microversion: 2.1 time: 0.617777 Jul 14 15:19:10.913165 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3297/6556] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:10 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1514 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:11.931499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a1d17747-92c9-4f80-bd87-b87f7a57f37a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:11.932217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a1d17747-92c9-4f80-bd87-b87f7a57f37a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:11.938588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1d17747-92c9-4f80-bd87-b87f7a57f37a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:11.939052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1d17747-92c9-4f80-bd87-b87f7a57f37a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:11.939836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1d17747-92c9-4f80-bd87-b87f7a57f37a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:11.940286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1d17747-92c9-4f80-bd87-b87f7a57f37a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:12.076383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a1d17747-92c9-4f80-bd87-b87f7a57f37a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:12.084001 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a1d17747-92c9-4f80-bd87-b87f7a57f37a tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1511 microversion: 2.1 time: 0.157706 Jul 14 15:19:12.084575 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3260/6557] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:11 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:12.101347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-62b05c38-b640-48a0-b0e2-14ffca85505e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:12.101919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-62b05c38-b640-48a0-b0e2-14ffca85505e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:12.109683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62b05c38-b640-48a0-b0e2-14ffca85505e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:12.110155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62b05c38-b640-48a0-b0e2-14ffca85505e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:12.110994 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62b05c38-b640-48a0-b0e2-14ffca85505e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:12.111435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62b05c38-b640-48a0-b0e2-14ffca85505e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:12.140112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-62b05c38-b640-48a0-b0e2-14ffca85505e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:19:12.195710 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.compute.api [None req-62b05c38-b640-48a0-b0e2-14ffca85505e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Found an unconfirmed migration during delete, id: 16, status: finished Jul 14 15:19:13.469916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3d3573ed-8fe0-431c-8f13-0d0970d1322d req-c4d5f8a9-e6fb-408d-ab73-5d3ab65a61b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9", "name": "network-vif-plugged", "status": "completed", "tag": "d2f2d767-5852-47c5-8650-f622363d1cea"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:13.478326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3d3573ed-8fe0-431c-8f13-0d0970d1322d req-c4d5f8a9-e6fb-408d-ab73-5d3ab65a61b0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:13.478777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3d3573ed-8fe0-431c-8f13-0d0970d1322d req-c4d5f8a9-e6fb-408d-ab73-5d3ab65a61b0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:13.491373 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3d3573ed-8fe0-431c-8f13-0d0970d1322d req-c4d5f8a9-e6fb-408d-ab73-5d3ab65a61b0 service nova] Creating event network-vif-plugged:d2f2d767-5852-47c5-8650-f622363d1cea for instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 on n-h2-767704-28 Jul 14 15:19:13.497133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-3d3573ed-8fe0-431c-8f13-0d0970d1322d req-c4d5f8a9-e6fb-408d-ab73-5d3ab65a61b0 service nova] Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:19:13.507974 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3d3573ed-8fe0-431c-8f13-0d0970d1322d req-c4d5f8a9-e6fb-408d-ab73-5d3ab65a61b0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111838 Jul 14 15:19:13.508575 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3261/6558] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:19:13.848892 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-62b05c38-b640-48a0-b0e2-14ffca85505e tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 204 len: 0 microversion: 2.1 time: 1.751413 Jul 14 15:19:13.849844 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3298/6559] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:19:12 2022] DELETE /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 0 bytes in 1753 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:19:13.861284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4d5ee03c-77ab-4f2d-97df-5b54d474a504 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:13.861927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4d5ee03c-77ab-4f2d-97df-5b54d474a504 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:13.868232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d5ee03c-77ab-4f2d-97df-5b54d474a504 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:13.868701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d5ee03c-77ab-4f2d-97df-5b54d474a504 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:13.869511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d5ee03c-77ab-4f2d-97df-5b54d474a504 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:13.869965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d5ee03c-77ab-4f2d-97df-5b54d474a504 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:14.005845 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4d5ee03c-77ab-4f2d-97df-5b54d474a504 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:14.013811 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4d5ee03c-77ab-4f2d-97df-5b54d474a504 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1503 microversion: 2.1 time: 0.159309 Jul 14 15:19:14.014416 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3262/6560] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:13 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:15.032096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c4f67ba-d358-4ae1-b6d9-b025bb053749 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:15.032847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1c4f67ba-d358-4ae1-b6d9-b025bb053749 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:15.039962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c4f67ba-d358-4ae1-b6d9-b025bb053749 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:15.040422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c4f67ba-d358-4ae1-b6d9-b025bb053749 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:15.041284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c4f67ba-d358-4ae1-b6d9-b025bb053749 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:15.041814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c4f67ba-d358-4ae1-b6d9-b025bb053749 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:15.191154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1c4f67ba-d358-4ae1-b6d9-b025bb053749 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7890c5a3428d431ca4e6fb6972f80418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684a114467154f1e936f8cd85f0aaa3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:15.202229 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1c4f67ba-d358-4ae1-b6d9-b025bb053749 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 200 len: 1503 microversion: 2.1 time: 0.174096 Jul 14 15:19:15.203301 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3299/6561] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:15 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:15.926419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-84c6cab3-4cfa-4951-a85b-d4a081887e90 req-fd7a8a8b-4990-40fa-9faf-f41782e9e3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9", "name": "network-vif-deleted", "tag": "d2f2d767-5852-47c5-8650-f622363d1cea"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:15.936514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-84c6cab3-4cfa-4951-a85b-d4a081887e90 req-fd7a8a8b-4990-40fa-9faf-f41782e9e3b6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:15.937019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-84c6cab3-4cfa-4951-a85b-d4a081887e90 req-fd7a8a8b-4990-40fa-9faf-f41782e9e3b6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:15.962825 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-84c6cab3-4cfa-4951-a85b-d4a081887e90 req-fd7a8a8b-4990-40fa-9faf-f41782e9e3b6 service nova] Creating event network-vif-deleted:d2f2d767-5852-47c5-8650-f622363d1cea for instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 on n-h2-767704-28 Jul 14 15:19:15.967365 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-84c6cab3-4cfa-4951-a85b-d4a081887e90 req-fd7a8a8b-4990-40fa-9faf-f41782e9e3b6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044588 Jul 14 15:19:15.968184 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3263/6562] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:19:16.222256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5fd9e90e-504c-41b5-b954-753022249b30 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:16.222898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5fd9e90e-504c-41b5-b954-753022249b30 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:16.230787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fd9e90e-504c-41b5-b954-753022249b30 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:16.231261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fd9e90e-504c-41b5-b954-753022249b30 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:16.232061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fd9e90e-504c-41b5-b954-753022249b30 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:16.232518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5fd9e90e-504c-41b5-b954-753022249b30 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:16.247478 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-5fd9e90e-504c-41b5-b954-753022249b30 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] HTTP exception thrown: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5fd9e90e-504c-41b5-b954-753022249b30 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Request method failure captured: Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 HTTP/1.1 Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DO5hzBfzcJSyjmFnqn-nmBqq9ayGXvrYiZ7_kEnwa49100JT3FiDst6P3Wi1hZFqhCi6OUSS1jVaBj6nUjDsoq1mE4HUjk-e0wmyv5fFDk0dOTMrN497LJuICOnkcAdWb4eSjnOPE29UZouz_nU-18CcXUwi-Gu6nuWGrtrpwwzZTI Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 684a114467154f1e936f8cd85f0aaa3f Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-672141491 Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/684a114467154f1e936f8cd85f0aaa3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/684a114467154f1e936f8cd85f0aaa3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_684a114467154f1e936f8cd85f0aaa3f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/684a114467154f1e936f8cd85f0aaa3f"}]}] Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-672141491 Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 684a114467154f1e936f8cd85f0aaa3f Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-672141491 Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-672141491-project Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 7890c5a3428d431ca4e6fb6972f80418 Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-672141491-project Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9'} Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:16.249219 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.258937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:16.258937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:16.258937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:16.258937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:19:16.258937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:19:16.258937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.258937 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.258937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5fd9e90e-504c-41b5-b954-753022249b30 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Returning 404 to user: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:19:16.258937 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5fd9e90e-504c-41b5-b954-753022249b30 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 404 len: 111 microversion: 2.1 time: 0.033596 Jul 14 15:19:16.258937 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3300/6563] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:16 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:19:16.273592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-43985851-d995-40ec-9843-c7f4d024e819 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:16.274190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-43985851-d995-40ec-9843-c7f4d024e819 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:16.281407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43985851-d995-40ec-9843-c7f4d024e819 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:16.281867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43985851-d995-40ec-9843-c7f4d024e819 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:16.282658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43985851-d995-40ec-9843-c7f4d024e819 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:16.283103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-43985851-d995-40ec-9843-c7f4d024e819 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:16.297006 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-43985851-d995-40ec-9843-c7f4d024e819 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] HTTP exception thrown: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-43985851-d995-40ec-9843-c7f4d024e819 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Request method failure captured: Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 HTTP/1.1 Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DO5hzBfzcJSyjmFnqn-nmBqq9ayGXvrYiZ7_kEnwa49100JT3FiDst6P3Wi1hZFqhCi6OUSS1jVaBj6nUjDsoq1mE4HUjk-e0wmyv5fFDk0dOTMrN497LJuICOnkcAdWb4eSjnOPE29UZouz_nU-18CcXUwi-Gu6nuWGrtrpwwzZTI Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 684a114467154f1e936f8cd85f0aaa3f Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-DeleteServersTestJSON-672141491 Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/684a114467154f1e936f8cd85f0aaa3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/684a114467154f1e936f8cd85f0aaa3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_684a114467154f1e936f8cd85f0aaa3f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/684a114467154f1e936f8cd85f0aaa3f"}]}] Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-DeleteServersTestJSON-672141491 Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 684a114467154f1e936f8cd85f0aaa3f Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-DeleteServersTestJSON-672141491 Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-DeleteServersTestJSON-672141491-project Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 7890c5a3428d431ca4e6fb6972f80418 Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-DeleteServersTestJSON-672141491-project Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9'} Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:19:16.298801 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-43985851-d995-40ec-9843-c7f4d024e819 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Returning 404 to user: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-43985851-d995-40ec-9843-c7f4d024e819 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 404 len: 111 microversion: 2.1 time: 0.032021 Jul 14 15:19:16.304378 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3264/6564] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:19:16 2022] DELETE /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:19:16.309631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6899001e-0019-4842-b486-aaa6b38487e8 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:16.310257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6899001e-0019-4842-b486-aaa6b38487e8 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] [instance: 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:16.316277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6899001e-0019-4842-b486-aaa6b38487e8 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:16.316860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6899001e-0019-4842-b486-aaa6b38487e8 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:16.317798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6899001e-0019-4842-b486-aaa6b38487e8 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:16.318356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6899001e-0019-4842-b486-aaa6b38487e8 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:16.332260 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-6899001e-0019-4842-b486-aaa6b38487e8 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] HTTP exception thrown: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6899001e-0019-4842-b486-aaa6b38487e8 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Request method failure captured: Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 HTTP/1.1 Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DO5hzBfzcJSyjmFnqn-nmBqq9ayGXvrYiZ7_kEnwa49100JT3FiDst6P3Wi1hZFqhCi6OUSS1jVaBj6nUjDsoq1mE4HUjk-e0wmyv5fFDk0dOTMrN497LJuICOnkcAdWb4eSjnOPE29UZouz_nU-18CcXUwi-Gu6nuWGrtrpwwzZTI Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 684a114467154f1e936f8cd85f0aaa3f Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-DeleteServersTestJSON-672141491 Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/684a114467154f1e936f8cd85f0aaa3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/684a114467154f1e936f8cd85f0aaa3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_684a114467154f1e936f8cd85f0aaa3f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/684a114467154f1e936f8cd85f0aaa3f"}]}] Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-DeleteServersTestJSON-672141491 Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 684a114467154f1e936f8cd85f0aaa3f Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-DeleteServersTestJSON-672141491 Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-DeleteServersTestJSON-672141491-project Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 7890c5a3428d431ca4e6fb6972f80418 Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-DeleteServersTestJSON-672141491-project Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9'} Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:16.333809 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.340126 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:16.340126 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:16.340126 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:16.340126 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:19:16.340126 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:19:16.340126 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. Jul 14 15:19:16.340126 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:19:16.340126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6899001e-0019-4842-b486-aaa6b38487e8 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] Returning 404 to user: Instance 3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:19:16.340126 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6899001e-0019-4842-b486-aaa6b38487e8 tempest-DeleteServersTestJSON-672141491 tempest-DeleteServersTestJSON-672141491-project] 10.222.0.81 "GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9" status: 404 len: 111 microversion: 2.1 time: 0.030286 Jul 14 15:19:16.340126 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3301/6565] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:16 2022] GET /compute/v2.1/servers/3e7a3ccb-489f-43d7-bcfe-a7adfd59c9b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:19:26.273866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1086773180", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "c6a35351-8dae-4622-a8f4-5d4428c9bf57"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:26.287096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=23 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:26.292429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=71 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:26.348587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] validate_networks() for [('c6a35351-8dae-4622-a8f4-5d4428c9bf57', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:19:26.833667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:19:26.834128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:19:26.834684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:19:26.835190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:19:26.835658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:19:26.846207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:26.846672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:26.847494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:26.847945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:26.867313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Getting quotas for project 44a8784d7f434649b58efbe94304dfe5. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:19:26.874326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Getting quotas for user 1ab95edeb6324b2f8b85830114148dc0 and project 44a8784d7f434649b58efbe94304dfe5. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:19:26.889895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:19:26.892335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:19:26.941384 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-924600af-a475-4e20-92d3-902325d9840f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.881215 Jul 14 15:19:26.942721 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3265/6566] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:19:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:19:26.956912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dd0481bd-1ea7-4d5e-8ecb-d0feefb55ff3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:26.959804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dd0481bd-1ea7-4d5e-8ecb-d0feefb55ff3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:26.961121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:26.962575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:27.043437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dd0481bd-1ea7-4d5e-8ecb-d0feefb55ff3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:27.059645 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dd0481bd-1ea7-4d5e-8ecb-d0feefb55ff3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1218 microversion: 2.1 time: 0.106820 Jul 14 15:19:27.060800 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3302/6567] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:26 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:28.079513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac330406-9959-408c-8958-c21b34d48965 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:28.080279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ac330406-9959-408c-8958-c21b34d48965 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:28.090269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac330406-9959-408c-8958-c21b34d48965 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:28.090723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac330406-9959-408c-8958-c21b34d48965 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:28.091802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac330406-9959-408c-8958-c21b34d48965 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:28.092347 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac330406-9959-408c-8958-c21b34d48965 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:28.559755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ac330406-9959-408c-8958-c21b34d48965 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:28.569379 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ac330406-9959-408c-8958-c21b34d48965 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1270 microversion: 2.1 time: 0.494835 Jul 14 15:19:28.570932 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3266/6568] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:28 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1270 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:29.599155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-abc59c01-9aba-4912-a937-5716f5bd5e0f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:29.602168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-abc59c01-9aba-4912-a937-5716f5bd5e0f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:29.621057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abc59c01-9aba-4912-a937-5716f5bd5e0f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:29.634470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abc59c01-9aba-4912-a937-5716f5bd5e0f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:29.637433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abc59c01-9aba-4912-a937-5716f5bd5e0f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:29.643300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-abc59c01-9aba-4912-a937-5716f5bd5e0f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:29.865834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-abc59c01-9aba-4912-a937-5716f5bd5e0f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:29.874624 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-abc59c01-9aba-4912-a937-5716f5bd5e0f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1318 microversion: 2.1 time: 0.281212 Jul 14 15:19:29.880760 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3303/6569] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:29 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:30.363196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-00ffcb14-058a-4ce6-89a2-832ad5e1cf1a req-9a5a98ab-f5d0-4f89-b5a5-592291f92635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30f29f3b-edc5-4744-bf3b-282c8429d33a", "tag": "f78cdb47-f810-4217-823c-0a9e5125a15f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:30.382778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-00ffcb14-058a-4ce6-89a2-832ad5e1cf1a req-9a5a98ab-f5d0-4f89-b5a5-592291f92635 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:30.383333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-00ffcb14-058a-4ce6-89a2-832ad5e1cf1a req-9a5a98ab-f5d0-4f89-b5a5-592291f92635 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:30.401568 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-00ffcb14-058a-4ce6-89a2-832ad5e1cf1a req-9a5a98ab-f5d0-4f89-b5a5-592291f92635 service nova] Creating event network-changed:f78cdb47-f810-4217-823c-0a9e5125a15f for instance 30f29f3b-edc5-4744-bf3b-282c8429d33a on n-h2-767704-28 Jul 14 15:19:30.407167 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-00ffcb14-058a-4ce6-89a2-832ad5e1cf1a req-9a5a98ab-f5d0-4f89-b5a5-592291f92635 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140867 Jul 14 15:19:30.408206 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3267/6570] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:19:30.899112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-04ed003a-2089-4cd1-828f-b564ec03531a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:30.900201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-04ed003a-2089-4cd1-828f-b564ec03531a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:30.910082 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04ed003a-2089-4cd1-828f-b564ec03531a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:30.910614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04ed003a-2089-4cd1-828f-b564ec03531a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:30.911414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04ed003a-2089-4cd1-828f-b564ec03531a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:30.912009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-04ed003a-2089-4cd1-828f-b564ec03531a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:31.069602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-04ed003a-2089-4cd1-828f-b564ec03531a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:31.081401 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-04ed003a-2089-4cd1-828f-b564ec03531a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1318 microversion: 2.1 time: 0.187307 Jul 14 15:19:31.082029 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3304/6571] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:30 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:19:32.105435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b8c77be1-4a33-4e4a-aba5-eca431537597 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:32.106432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b8c77be1-4a33-4e4a-aba5-eca431537597 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:32.114367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8c77be1-4a33-4e4a-aba5-eca431537597 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:32.114836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8c77be1-4a33-4e4a-aba5-eca431537597 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:32.115649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8c77be1-4a33-4e4a-aba5-eca431537597 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:32.116100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b8c77be1-4a33-4e4a-aba5-eca431537597 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:32.420458 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b8c77be1-4a33-4e4a-aba5-eca431537597 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:32.430643 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b8c77be1-4a33-4e4a-aba5-eca431537597 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1318 microversion: 2.1 time: 0.331768 Jul 14 15:19:32.431455 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3268/6572] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:32 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:33.455730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cdd8411e-b9f5-4eaa-a2f0-b02ba0f8d8ff tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:33.456464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cdd8411e-b9f5-4eaa-a2f0-b02ba0f8d8ff tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:33.464086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdd8411e-b9f5-4eaa-a2f0-b02ba0f8d8ff tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:33.464554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdd8411e-b9f5-4eaa-a2f0-b02ba0f8d8ff tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:33.465384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdd8411e-b9f5-4eaa-a2f0-b02ba0f8d8ff tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:33.465836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cdd8411e-b9f5-4eaa-a2f0-b02ba0f8d8ff tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:33.637198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cdd8411e-b9f5-4eaa-a2f0-b02ba0f8d8ff tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:33.646726 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cdd8411e-b9f5-4eaa-a2f0-b02ba0f8d8ff tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1318 microversion: 2.1 time: 0.194715 Jul 14 15:19:33.647784 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3305/6573] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:33 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:34.664062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cc1dc9bc-31d2-461f-960d-9bc019284492 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:34.664733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cc1dc9bc-31d2-461f-960d-9bc019284492 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:34.672674 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc1dc9bc-31d2-461f-960d-9bc019284492 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:34.673180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc1dc9bc-31d2-461f-960d-9bc019284492 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:34.673974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc1dc9bc-31d2-461f-960d-9bc019284492 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:34.674408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cc1dc9bc-31d2-461f-960d-9bc019284492 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:34.825160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cc1dc9bc-31d2-461f-960d-9bc019284492 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:34.833167 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cc1dc9bc-31d2-461f-960d-9bc019284492 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1318 microversion: 2.1 time: 0.172899 Jul 14 15:19:34.833784 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3269/6574] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:34 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:35.519477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b6347275-e87b-4974-8195-89754aa6f129 req-bc008d6d-0b62-4566-a078-244d87841cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f29f3b-edc5-4744-bf3b-282c8429d33a", "name": "network-vif-plugged", "status": "completed", "tag": "f78cdb47-f810-4217-823c-0a9e5125a15f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:35.530184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b6347275-e87b-4974-8195-89754aa6f129 req-bc008d6d-0b62-4566-a078-244d87841cb0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:35.530644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b6347275-e87b-4974-8195-89754aa6f129 req-bc008d6d-0b62-4566-a078-244d87841cb0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:35.546991 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b6347275-e87b-4974-8195-89754aa6f129 req-bc008d6d-0b62-4566-a078-244d87841cb0 service nova] Creating event network-vif-plugged:f78cdb47-f810-4217-823c-0a9e5125a15f for instance 30f29f3b-edc5-4744-bf3b-282c8429d33a on n-h2-767704-28 Jul 14 15:19:35.552267 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b6347275-e87b-4974-8195-89754aa6f129 req-bc008d6d-0b62-4566-a078-244d87841cb0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036650 Jul 14 15:19:35.553144 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3306/6575] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:19:35.850586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c785e3c9-bf36-416f-8a0f-82f5b4e1a809 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:35.851289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c785e3c9-bf36-416f-8a0f-82f5b4e1a809 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:35.859562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c785e3c9-bf36-416f-8a0f-82f5b4e1a809 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:35.860025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c785e3c9-bf36-416f-8a0f-82f5b4e1a809 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:35.860822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c785e3c9-bf36-416f-8a0f-82f5b4e1a809 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:35.861592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c785e3c9-bf36-416f-8a0f-82f5b4e1a809 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:36.009181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c785e3c9-bf36-416f-8a0f-82f5b4e1a809 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:36.018243 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c785e3c9-bf36-416f-8a0f-82f5b4e1a809 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1318 microversion: 2.1 time: 0.171684 Jul 14 15:19:36.018956 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3270/6576] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:35 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:37.037915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-81a203fb-8c61-409c-801f-65c8c0108d63 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:37.039350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-81a203fb-8c61-409c-801f-65c8c0108d63 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:37.048621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81a203fb-8c61-409c-801f-65c8c0108d63 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.049137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81a203fb-8c61-409c-801f-65c8c0108d63 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:37.049956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81a203fb-8c61-409c-801f-65c8c0108d63 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.050415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81a203fb-8c61-409c-801f-65c8c0108d63 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:37.053750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:37.216234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-81a203fb-8c61-409c-801f-65c8c0108d63 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:37.224366 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-81a203fb-8c61-409c-801f-65c8c0108d63 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1507 microversion: 2.1 time: 0.192672 Jul 14 15:19:37.224978 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3307/6577] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:37 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:37.239495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:37.240395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:37.244610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a06947f6-6deb-46ec-b46b-f8f85972f233 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:37.245585 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a06947f6-6deb-46ec-b46b-f8f85972f233 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:37.255331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a06947f6-6deb-46ec-b46b-f8f85972f233 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.255981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a06947f6-6deb-46ec-b46b-f8f85972f233 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:37.257242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a06947f6-6deb-46ec-b46b-f8f85972f233 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.257943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a06947f6-6deb-46ec-b46b-f8f85972f233 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:37.407993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a06947f6-6deb-46ec-b46b-f8f85972f233 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:37.417638 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a06947f6-6deb-46ec-b46b-f8f85972f233 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1507 microversion: 2.1 time: 0.179256 Jul 14 15:19:37.418246 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3271/6578] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:37 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:37.437190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-60bbffb2-c68d-45d3-ac1d-549df4a91a9e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:37.438539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-60bbffb2-c68d-45d3-ac1d-549df4a91a9e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:37.445339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60bbffb2-c68d-45d3-ac1d-549df4a91a9e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.445890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60bbffb2-c68d-45d3-ac1d-549df4a91a9e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:37.446697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60bbffb2-c68d-45d3-ac1d-549df4a91a9e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.447156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-60bbffb2-c68d-45d3-ac1d-549df4a91a9e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:37.520689 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-60bbffb2-c68d-45d3-ac1d-549df4a91a9e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "PUT /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1079 microversion: 2.1 time: 0.087623 Jul 14 15:19:37.521381 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3308/6579] 10.222.0.81 () {60 vars in 1255 bytes} [Thu Jul 14 15:19:37 2022] PUT /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1079 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:37.536640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b2f88683-77a2-4a2b-b1b6-89a74b31bfc4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:37.537319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b2f88683-77a2-4a2b-b1b6-89a74b31bfc4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:37.544970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2f88683-77a2-4a2b-b1b6-89a74b31bfc4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.545470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2f88683-77a2-4a2b-b1b6-89a74b31bfc4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:37.546274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2f88683-77a2-4a2b-b1b6-89a74b31bfc4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.546722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2f88683-77a2-4a2b-b1b6-89a74b31bfc4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:37.702688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b2f88683-77a2-4a2b-b1b6-89a74b31bfc4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:37.710716 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b2f88683-77a2-4a2b-b1b6-89a74b31bfc4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1505 microversion: 2.1 time: 0.177890 Jul 14 15:19:37.712391 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3272/6580] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:37 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:37.727893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b13b9655-e99f-4aeb-8ec8-52d36dbb0aea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:37.728521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b13b9655-e99f-4aeb-8ec8-52d36dbb0aea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:37.735196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b13b9655-e99f-4aeb-8ec8-52d36dbb0aea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.735529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b13b9655-e99f-4aeb-8ec8-52d36dbb0aea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:37.736257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b13b9655-e99f-4aeb-8ec8-52d36dbb0aea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.736711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b13b9655-e99f-4aeb-8ec8-52d36dbb0aea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:37.908654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b13b9655-e99f-4aeb-8ec8-52d36dbb0aea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:37.923013 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b13b9655-e99f-4aeb-8ec8-52d36dbb0aea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1505 microversion: 2.1 time: 0.198781 Jul 14 15:19:37.923999 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3309/6581] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:37 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:37.941400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:37.942472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:37.958353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.959122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:37.960448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.961307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:38.001289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:38.009490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Old instance type m1.heat2, new instance type m1.heat {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:19:38.021315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:19:38.021745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:19:38.022225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:19:38.022639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:19:38.023058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:19:38.092262 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1b34e241-074b-4b79-bf74-5e26dbb1e4ec tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "POST /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a/action" status: 202 len: 0 microversion: 2.1 time: 0.154951 Jul 14 15:19:38.092893 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3273/6582] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:19:37 2022] POST /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:19:38.101196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-307e9880-4810-4e7e-a8c4-d2b71048c165 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:38.102065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-307e9880-4810-4e7e-a8c4-d2b71048c165 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:38.111272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-307e9880-4810-4e7e-a8c4-d2b71048c165 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:38.111834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-307e9880-4810-4e7e-a8c4-d2b71048c165 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:38.112659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-307e9880-4810-4e7e-a8c4-d2b71048c165 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:38.113165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-307e9880-4810-4e7e-a8c4-d2b71048c165 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:38.303387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-307e9880-4810-4e7e-a8c4-d2b71048c165 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:38.312589 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-307e9880-4810-4e7e-a8c4-d2b71048c165 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1516 microversion: 2.1 time: 0.214975 Jul 14 15:19:38.313399 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3310/6583] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:38 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:19:39.332523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c28ef92d-d6b0-4b40-9b5f-8863c193baad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:39.333333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c28ef92d-d6b0-4b40-9b5f-8863c193baad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:39.344512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c28ef92d-d6b0-4b40-9b5f-8863c193baad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:39.345011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c28ef92d-d6b0-4b40-9b5f-8863c193baad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:39.346218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c28ef92d-d6b0-4b40-9b5f-8863c193baad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:39.347159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c28ef92d-d6b0-4b40-9b5f-8863c193baad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:39.498102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c28ef92d-d6b0-4b40-9b5f-8863c193baad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:39.506384 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c28ef92d-d6b0-4b40-9b5f-8863c193baad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1516 microversion: 2.1 time: 0.179318 Jul 14 15:19:39.506986 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3274/6584] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:39 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:40.523851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d2862e3a-25c6-435b-a3b7-4ba9f44a9ea9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:40.524482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d2862e3a-25c6-435b-a3b7-4ba9f44a9ea9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:40.532737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d2862e3a-25c6-435b-a3b7-4ba9f44a9ea9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:40.533243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d2862e3a-25c6-435b-a3b7-4ba9f44a9ea9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:40.534031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d2862e3a-25c6-435b-a3b7-4ba9f44a9ea9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:40.534488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d2862e3a-25c6-435b-a3b7-4ba9f44a9ea9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:40.669542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d2862e3a-25c6-435b-a3b7-4ba9f44a9ea9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:40.677326 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d2862e3a-25c6-435b-a3b7-4ba9f44a9ea9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.157362 Jul 14 15:19:40.677919 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3311/6585] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:40 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:41.694988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1c804d4c-a376-424c-bbec-a4c7b945ae73 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:41.695599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1c804d4c-a376-424c-bbec-a4c7b945ae73 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:41.702978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c804d4c-a376-424c-bbec-a4c7b945ae73 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:41.703438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c804d4c-a376-424c-bbec-a4c7b945ae73 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:41.704207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c804d4c-a376-424c-bbec-a4c7b945ae73 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:41.704647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1c804d4c-a376-424c-bbec-a4c7b945ae73 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:41.836313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1c804d4c-a376-424c-bbec-a4c7b945ae73 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:41.844153 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1c804d4c-a376-424c-bbec-a4c7b945ae73 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.153297 Jul 14 15:19:41.844747 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3275/6586] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:41 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:42.861200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a6b987e-88fc-4b8e-a243-580e28c19721 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:42.861813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2a6b987e-88fc-4b8e-a243-580e28c19721 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:42.868790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a6b987e-88fc-4b8e-a243-580e28c19721 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:42.869312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a6b987e-88fc-4b8e-a243-580e28c19721 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:42.870515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a6b987e-88fc-4b8e-a243-580e28c19721 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:42.871307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a6b987e-88fc-4b8e-a243-580e28c19721 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:43.005383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2a6b987e-88fc-4b8e-a243-580e28c19721 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:43.014251 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a6b987e-88fc-4b8e-a243-580e28c19721 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.156970 Jul 14 15:19:43.014824 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3312/6587] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:42 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:44.031759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77bf2a87-700f-42a3-9188-c63356417904 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:44.032465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-77bf2a87-700f-42a3-9188-c63356417904 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:44.039741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77bf2a87-700f-42a3-9188-c63356417904 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:44.040205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77bf2a87-700f-42a3-9188-c63356417904 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:44.041028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77bf2a87-700f-42a3-9188-c63356417904 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:44.042254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77bf2a87-700f-42a3-9188-c63356417904 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:44.185484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-77bf2a87-700f-42a3-9188-c63356417904 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:44.193255 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-77bf2a87-700f-42a3-9188-c63356417904 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.165370 Jul 14 15:19:44.193843 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3276/6588] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:44 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:45.211177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7a2b9559-efb2-463a-b0db-59d2d2cce6b1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:45.211789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7a2b9559-efb2-463a-b0db-59d2d2cce6b1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:45.219464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a2b9559-efb2-463a-b0db-59d2d2cce6b1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:45.219922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a2b9559-efb2-463a-b0db-59d2d2cce6b1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:45.220707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a2b9559-efb2-463a-b0db-59d2d2cce6b1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:45.221189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7a2b9559-efb2-463a-b0db-59d2d2cce6b1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:45.359584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7a2b9559-efb2-463a-b0db-59d2d2cce6b1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:45.367170 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7a2b9559-efb2-463a-b0db-59d2d2cce6b1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.160040 Jul 14 15:19:45.367750 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3313/6589] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:45 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:46.386578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-56e37323-f71f-4f62-97e7-a30a54c5b585 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:46.387200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-56e37323-f71f-4f62-97e7-a30a54c5b585 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:46.394147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56e37323-f71f-4f62-97e7-a30a54c5b585 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:46.394620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56e37323-f71f-4f62-97e7-a30a54c5b585 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:46.395406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56e37323-f71f-4f62-97e7-a30a54c5b585 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:46.395860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-56e37323-f71f-4f62-97e7-a30a54c5b585 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:46.530156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-56e37323-f71f-4f62-97e7-a30a54c5b585 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:46.537914 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-56e37323-f71f-4f62-97e7-a30a54c5b585 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.156652 Jul 14 15:19:46.538491 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3277/6590] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:46 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:47.556159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5f690397-6836-477a-85f4-3e8f6b2b266a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:47.556986 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5f690397-6836-477a-85f4-3e8f6b2b266a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:47.565183 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f690397-6836-477a-85f4-3e8f6b2b266a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:47.565658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f690397-6836-477a-85f4-3e8f6b2b266a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:47.566456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f690397-6836-477a-85f4-3e8f6b2b266a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:47.566910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5f690397-6836-477a-85f4-3e8f6b2b266a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:47.709063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5f690397-6836-477a-85f4-3e8f6b2b266a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:47.716873 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5f690397-6836-477a-85f4-3e8f6b2b266a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.164657 Jul 14 15:19:47.717496 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3314/6591] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:47 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:48.734166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-58830b81-5f3b-44bd-9e77-279670540a9d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:48.734917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-58830b81-5f3b-44bd-9e77-279670540a9d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:48.742720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58830b81-5f3b-44bd-9e77-279670540a9d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:48.743183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58830b81-5f3b-44bd-9e77-279670540a9d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:48.743963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58830b81-5f3b-44bd-9e77-279670540a9d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:48.745391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-58830b81-5f3b-44bd-9e77-279670540a9d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:48.887149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-58830b81-5f3b-44bd-9e77-279670540a9d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:48.895075 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-58830b81-5f3b-44bd-9e77-279670540a9d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.164890 Jul 14 15:19:48.895659 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3278/6592] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:48 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:49.911656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b48c98e-0f4f-4204-82a3-12bf36e551f7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:49.912283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3b48c98e-0f4f-4204-82a3-12bf36e551f7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:49.919783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b48c98e-0f4f-4204-82a3-12bf36e551f7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:49.920238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b48c98e-0f4f-4204-82a3-12bf36e551f7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:49.921042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b48c98e-0f4f-4204-82a3-12bf36e551f7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:49.921494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b48c98e-0f4f-4204-82a3-12bf36e551f7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:50.053754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3b48c98e-0f4f-4204-82a3-12bf36e551f7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:50.062151 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b48c98e-0f4f-4204-82a3-12bf36e551f7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.154204 Jul 14 15:19:50.062775 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3315/6593] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:49 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:51.081080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-891d77d4-fd3a-4857-8217-7a1239fdd3d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:51.081713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-891d77d4-fd3a-4857-8217-7a1239fdd3d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:51.089301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-891d77d4-fd3a-4857-8217-7a1239fdd3d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:51.089769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-891d77d4-fd3a-4857-8217-7a1239fdd3d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:51.090575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-891d77d4-fd3a-4857-8217-7a1239fdd3d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:51.091029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-891d77d4-fd3a-4857-8217-7a1239fdd3d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:51.261504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-891d77d4-fd3a-4857-8217-7a1239fdd3d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:51.275780 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-891d77d4-fd3a-4857-8217-7a1239fdd3d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.199695 Jul 14 15:19:51.276819 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3279/6594] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:51 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:52.293421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e12a6ba3-34e6-4015-9061-eee09d7569e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:52.294057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e12a6ba3-34e6-4015-9061-eee09d7569e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:52.300965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e12a6ba3-34e6-4015-9061-eee09d7569e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:52.301438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e12a6ba3-34e6-4015-9061-eee09d7569e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:52.302210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e12a6ba3-34e6-4015-9061-eee09d7569e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:52.302657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e12a6ba3-34e6-4015-9061-eee09d7569e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:52.442889 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e12a6ba3-34e6-4015-9061-eee09d7569e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:52.451450 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e12a6ba3-34e6-4015-9061-eee09d7569e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.161923 Jul 14 15:19:52.452027 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3316/6595] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:52 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:53.468461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c1c0e265-8874-479e-ab91-3cf9b077d523 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:53.469112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c1c0e265-8874-479e-ab91-3cf9b077d523 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:53.476135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1c0e265-8874-479e-ab91-3cf9b077d523 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:53.476602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1c0e265-8874-479e-ab91-3cf9b077d523 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:53.477427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1c0e265-8874-479e-ab91-3cf9b077d523 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:53.477882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1c0e265-8874-479e-ab91-3cf9b077d523 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:53.618783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c1c0e265-8874-479e-ab91-3cf9b077d523 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:53.629088 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c1c0e265-8874-479e-ab91-3cf9b077d523 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.164516 Jul 14 15:19:53.629831 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3280/6596] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:53 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:54.646524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a84ea454-59df-4933-a1b4-41a13c5c9fe1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:54.647151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a84ea454-59df-4933-a1b4-41a13c5c9fe1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:54.654672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a84ea454-59df-4933-a1b4-41a13c5c9fe1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:54.655139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a84ea454-59df-4933-a1b4-41a13c5c9fe1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:54.655929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a84ea454-59df-4933-a1b4-41a13c5c9fe1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:54.656382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a84ea454-59df-4933-a1b4-41a13c5c9fe1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:54.800169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a84ea454-59df-4933-a1b4-41a13c5c9fe1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:54.808652 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a84ea454-59df-4933-a1b4-41a13c5c9fe1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.165997 Jul 14 15:19:54.809273 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3317/6597] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:54 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:55.825632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-62131e8e-5a8d-40be-824d-7c962553281c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:55.826254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-62131e8e-5a8d-40be-824d-7c962553281c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:55.833294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62131e8e-5a8d-40be-824d-7c962553281c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:55.833750 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62131e8e-5a8d-40be-824d-7c962553281c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:55.834534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62131e8e-5a8d-40be-824d-7c962553281c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:55.834978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-62131e8e-5a8d-40be-824d-7c962553281c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:55.854620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:55.976910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-62131e8e-5a8d-40be-824d-7c962553281c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:55.985084 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-62131e8e-5a8d-40be-824d-7c962553281c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.164120 Jul 14 15:19:55.985686 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3281/6598] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:55 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:57.003831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7f3adb6f-3313-4640-afcc-6b162a5a5448 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:57.004459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7f3adb6f-3313-4640-afcc-6b162a5a5448 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:57.006860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=35 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:57.013565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f3adb6f-3313-4640-afcc-6b162a5a5448 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:57.014032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f3adb6f-3313-4640-afcc-6b162a5a5448 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:57.014836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f3adb6f-3313-4640-afcc-6b162a5a5448 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:57.015284 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f3adb6f-3313-4640-afcc-6b162a5a5448 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:57.018159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:57.150921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7f3adb6f-3313-4640-afcc-6b162a5a5448 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:57.158541 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7f3adb6f-3313-4640-afcc-6b162a5a5448 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.159040 Jul 14 15:19:57.159059 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3318/6599] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:56 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:58.176280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3ad226f5-f75d-4b75-bc86-55f88bf5ffcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:58.176970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3ad226f5-f75d-4b75-bc86-55f88bf5ffcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:58.179634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:58.186229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ad226f5-f75d-4b75-bc86-55f88bf5ffcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:58.186685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ad226f5-f75d-4b75-bc86-55f88bf5ffcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:58.187465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ad226f5-f75d-4b75-bc86-55f88bf5ffcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:58.187907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ad226f5-f75d-4b75-bc86-55f88bf5ffcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:58.324675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3ad226f5-f75d-4b75-bc86-55f88bf5ffcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:58.332235 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3ad226f5-f75d-4b75-bc86-55f88bf5ffcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.160012 Jul 14 15:19:58.332804 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3282/6600] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:58 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:59.349660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-18897241-b44f-416d-b705-b84016536293 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:59.350285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-18897241-b44f-416d-b705-b84016536293 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:59.358120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18897241-b44f-416d-b705-b84016536293 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:59.358585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18897241-b44f-416d-b705-b84016536293 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:59.359367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18897241-b44f-416d-b705-b84016536293 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:59.359825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-18897241-b44f-416d-b705-b84016536293 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:59.489591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-18897241-b44f-416d-b705-b84016536293 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:59.497894 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-18897241-b44f-416d-b705-b84016536293 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.152186 Jul 14 15:19:59.498464 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3319/6601] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:59 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:00.515760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-50f9a4fb-1af4-4b1e-9ce0-c24555cae7e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:00.516835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-50f9a4fb-1af4-4b1e-9ce0-c24555cae7e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:00.526515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50f9a4fb-1af4-4b1e-9ce0-c24555cae7e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:00.526977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50f9a4fb-1af4-4b1e-9ce0-c24555cae7e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:00.527761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50f9a4fb-1af4-4b1e-9ce0-c24555cae7e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:00.528206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50f9a4fb-1af4-4b1e-9ce0-c24555cae7e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:00.662569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-50f9a4fb-1af4-4b1e-9ce0-c24555cae7e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:00.671604 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-50f9a4fb-1af4-4b1e-9ce0-c24555cae7e4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.159813 Jul 14 15:20:00.672205 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3283/6602] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:00 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:01.689239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-583ae072-039b-4f24-97c1-b098f18dfca8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:01.689911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-583ae072-039b-4f24-97c1-b098f18dfca8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:01.696835 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-583ae072-039b-4f24-97c1-b098f18dfca8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:01.697330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-583ae072-039b-4f24-97c1-b098f18dfca8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:01.698127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-583ae072-039b-4f24-97c1-b098f18dfca8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:01.698625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-583ae072-039b-4f24-97c1-b098f18dfca8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:01.833526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-583ae072-039b-4f24-97c1-b098f18dfca8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:01.841478 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-583ae072-039b-4f24-97c1-b098f18dfca8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.156607 Jul 14 15:20:01.842070 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3320/6603] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:01 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:20:02.858321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f3341c8a-f9da-4dd0-821c-cb9785592746 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:02.858949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f3341c8a-f9da-4dd0-821c-cb9785592746 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:02.866044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3341c8a-f9da-4dd0-821c-cb9785592746 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:02.866504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3341c8a-f9da-4dd0-821c-cb9785592746 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:02.867279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3341c8a-f9da-4dd0-821c-cb9785592746 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:02.867725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3341c8a-f9da-4dd0-821c-cb9785592746 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:03.001732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f3341c8a-f9da-4dd0-821c-cb9785592746 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:03.009357 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f3341c8a-f9da-4dd0-821c-cb9785592746 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.155108 Jul 14 15:20:03.009925 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3284/6604] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:02 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:04.027704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b23fc715-c717-4943-993c-16ab2ec605c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:04.028408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b23fc715-c717-4943-993c-16ab2ec605c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:04.035396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b23fc715-c717-4943-993c-16ab2ec605c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:04.035867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b23fc715-c717-4943-993c-16ab2ec605c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:04.036657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b23fc715-c717-4943-993c-16ab2ec605c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:04.037147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b23fc715-c717-4943-993c-16ab2ec605c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:04.175572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b23fc715-c717-4943-993c-16ab2ec605c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:04.183989 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b23fc715-c717-4943-993c-16ab2ec605c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.160738 Jul 14 15:20:04.184561 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3321/6605] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:04 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:05.201636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f3eff1e3-db76-4e8e-919e-2616e353a08d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:05.202264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f3eff1e3-db76-4e8e-919e-2616e353a08d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:05.209534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3eff1e3-db76-4e8e-919e-2616e353a08d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:05.209999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3eff1e3-db76-4e8e-919e-2616e353a08d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:05.210833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3eff1e3-db76-4e8e-919e-2616e353a08d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:05.211285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3eff1e3-db76-4e8e-919e-2616e353a08d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:05.349285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f3eff1e3-db76-4e8e-919e-2616e353a08d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:05.357083 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f3eff1e3-db76-4e8e-919e-2616e353a08d tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.159960 Jul 14 15:20:05.357663 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3285/6606] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:05 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:06.374400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8a54a1f8-191e-477d-9e31-71b1732e6531 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:06.375026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8a54a1f8-191e-477d-9e31-71b1732e6531 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:06.382262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a54a1f8-191e-477d-9e31-71b1732e6531 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:06.382738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a54a1f8-191e-477d-9e31-71b1732e6531 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:06.383506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a54a1f8-191e-477d-9e31-71b1732e6531 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:06.383963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a54a1f8-191e-477d-9e31-71b1732e6531 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:06.523359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8a54a1f8-191e-477d-9e31-71b1732e6531 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:06.531251 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8a54a1f8-191e-477d-9e31-71b1732e6531 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.161666 Jul 14 15:20:06.531841 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3322/6607] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:06 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:07.547445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac948fd8-7f61-46ab-8c96-c963d0390c28 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:07.548071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ac948fd8-7f61-46ab-8c96-c963d0390c28 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:07.555083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac948fd8-7f61-46ab-8c96-c963d0390c28 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:07.555543 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac948fd8-7f61-46ab-8c96-c963d0390c28 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:07.556327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac948fd8-7f61-46ab-8c96-c963d0390c28 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:07.556776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac948fd8-7f61-46ab-8c96-c963d0390c28 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:07.694652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ac948fd8-7f61-46ab-8c96-c963d0390c28 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:07.703015 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ac948fd8-7f61-46ab-8c96-c963d0390c28 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.159505 Jul 14 15:20:07.703603 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3286/6608] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:07 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:08.721411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2d76b60e-c4cf-4d30-8d29-ffc441735675 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:08.722047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2d76b60e-c4cf-4d30-8d29-ffc441735675 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:08.729233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d76b60e-c4cf-4d30-8d29-ffc441735675 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:08.730425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d76b60e-c4cf-4d30-8d29-ffc441735675 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:08.731227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d76b60e-c4cf-4d30-8d29-ffc441735675 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:08.731686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d76b60e-c4cf-4d30-8d29-ffc441735675 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:08.865615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2d76b60e-c4cf-4d30-8d29-ffc441735675 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:08.873304 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2d76b60e-c4cf-4d30-8d29-ffc441735675 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.155808 Jul 14 15:20:08.873878 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3323/6609] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:08 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:08.945805 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:20:08.946150 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:20:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:20:09.891891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-27bc5650-1964-4fc6-bc27-001eff91d669 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:09.892435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-27bc5650-1964-4fc6-bc27-001eff91d669 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:09.899524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27bc5650-1964-4fc6-bc27-001eff91d669 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:09.900025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27bc5650-1964-4fc6-bc27-001eff91d669 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:09.900769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27bc5650-1964-4fc6-bc27-001eff91d669 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:09.901388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27bc5650-1964-4fc6-bc27-001eff91d669 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:10.033718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-27bc5650-1964-4fc6-bc27-001eff91d669 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:10.041181 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-27bc5650-1964-4fc6-bc27-001eff91d669 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.153314 Jul 14 15:20:10.041768 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3287/6610] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:09 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:20:11.059605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-54ffbc5b-9ed6-4cda-bae7-c23c0858bc1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:11.060236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-54ffbc5b-9ed6-4cda-bae7-c23c0858bc1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:11.067362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54ffbc5b-9ed6-4cda-bae7-c23c0858bc1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:11.067830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54ffbc5b-9ed6-4cda-bae7-c23c0858bc1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:11.068616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54ffbc5b-9ed6-4cda-bae7-c23c0858bc1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:11.069120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-54ffbc5b-9ed6-4cda-bae7-c23c0858bc1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:11.212700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-54ffbc5b-9ed6-4cda-bae7-c23c0858bc1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:11.225761 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-54ffbc5b-9ed6-4cda-bae7-c23c0858bc1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.170949 Jul 14 15:20:11.226294 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3324/6611] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:11 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:12.244418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-364e33f2-057a-403b-9562-59bcfe4cf27c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:12.245655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-364e33f2-057a-403b-9562-59bcfe4cf27c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:12.252826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-364e33f2-057a-403b-9562-59bcfe4cf27c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:12.253319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-364e33f2-057a-403b-9562-59bcfe4cf27c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:12.254136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-364e33f2-057a-403b-9562-59bcfe4cf27c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:12.254583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-364e33f2-057a-403b-9562-59bcfe4cf27c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:12.389496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-364e33f2-057a-403b-9562-59bcfe4cf27c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:12.397051 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-364e33f2-057a-403b-9562-59bcfe4cf27c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1521 microversion: 2.1 time: 0.156599 Jul 14 15:20:12.397641 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3288/6612] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:12 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:13.204303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f788c428-b94f-4280-9d59-547b443a0a47 req-39820b28-1521-471c-bf16-ff839d8f6b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f29f3b-edc5-4744-bf3b-282c8429d33a", "name": "network-vif-unplugged", "status": "completed", "tag": "f78cdb47-f810-4217-823c-0a9e5125a15f"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:13.215941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f788c428-b94f-4280-9d59-547b443a0a47 req-39820b28-1521-471c-bf16-ff839d8f6b87 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:13.216463 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f788c428-b94f-4280-9d59-547b443a0a47 req-39820b28-1521-471c-bf16-ff839d8f6b87 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:13.415270 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bd65bfb9-983a-422b-a931-30c3a4ac7661 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:13.417213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bd65bfb9-983a-422b-a931-30c3a4ac7661 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:13.426193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd65bfb9-983a-422b-a931-30c3a4ac7661 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:13.426983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd65bfb9-983a-422b-a931-30c3a4ac7661 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:13.427986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd65bfb9-983a-422b-a931-30c3a4ac7661 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:13.428903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bd65bfb9-983a-422b-a931-30c3a4ac7661 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:13.480607 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f788c428-b94f-4280-9d59-547b443a0a47 req-39820b28-1521-471c-bf16-ff839d8f6b87 service nova] Creating event network-vif-unplugged:f78cdb47-f810-4217-823c-0a9e5125a15f for instance 30f29f3b-edc5-4744-bf3b-282c8429d33a on n-h1-767704-28 Jul 14 15:20:13.486592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-f788c428-b94f-4280-9d59-547b443a0a47 req-39820b28-1521-471c-bf16-ff839d8f6b87 service nova] Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:20:13.498207 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f788c428-b94f-4280-9d59-547b443a0a47 req-39820b28-1521-471c-bf16-ff839d8f6b87 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.298081 Jul 14 15:20:13.498817 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3325/6613] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:20:13.743792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bd65bfb9-983a-422b-a931-30c3a4ac7661 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:13.752024 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bd65bfb9-983a-422b-a931-30c3a4ac7661 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1520 microversion: 2.1 time: 0.341007 Jul 14 15:20:13.761970 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3289/6614] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:13 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:14.771321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b79b7030-34b4-48d6-8a40-d0d93776628c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:14.772033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b79b7030-34b4-48d6-8a40-d0d93776628c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:14.778481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b79b7030-34b4-48d6-8a40-d0d93776628c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:14.778961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b79b7030-34b4-48d6-8a40-d0d93776628c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:14.779716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b79b7030-34b4-48d6-8a40-d0d93776628c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:14.780163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b79b7030-34b4-48d6-8a40-d0d93776628c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:14.915608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b79b7030-34b4-48d6-8a40-d0d93776628c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:14.923858 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b79b7030-34b4-48d6-8a40-d0d93776628c tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1518 microversion: 2.1 time: 0.157675 Jul 14 15:20:14.924421 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3326/6615] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:14 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:15.549284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-9f491352-7b3f-4b3a-8610-4a17a4311df0 req-65390b0a-2ab0-4295-81da-70a02d61bbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30f29f3b-edc5-4744-bf3b-282c8429d33a", "tag": "f78cdb47-f810-4217-823c-0a9e5125a15f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:15.559430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9f491352-7b3f-4b3a-8610-4a17a4311df0 req-65390b0a-2ab0-4295-81da-70a02d61bbd5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:15.559884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-9f491352-7b3f-4b3a-8610-4a17a4311df0 req-65390b0a-2ab0-4295-81da-70a02d61bbd5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:15.571586 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-9f491352-7b3f-4b3a-8610-4a17a4311df0 req-65390b0a-2ab0-4295-81da-70a02d61bbd5 service nova] Creating event network-changed:f78cdb47-f810-4217-823c-0a9e5125a15f for instance 30f29f3b-edc5-4744-bf3b-282c8429d33a on n-h1-767704-28 Jul 14 15:20:15.578015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-9f491352-7b3f-4b3a-8610-4a17a4311df0 req-65390b0a-2ab0-4295-81da-70a02d61bbd5 service nova] Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:20:15.590327 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-9f491352-7b3f-4b3a-8610-4a17a4311df0 req-65390b0a-2ab0-4295-81da-70a02d61bbd5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043620 Jul 14 15:20:15.590954 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3290/6616] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:20:15.943165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-188ee3ac-44dd-47f5-9375-d558010ff883 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:15.943794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-188ee3ac-44dd-47f5-9375-d558010ff883 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:15.951468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-188ee3ac-44dd-47f5-9375-d558010ff883 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:15.951958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-188ee3ac-44dd-47f5-9375-d558010ff883 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:15.952763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-188ee3ac-44dd-47f5-9375-d558010ff883 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:15.953253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-188ee3ac-44dd-47f5-9375-d558010ff883 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:16.154399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-188ee3ac-44dd-47f5-9375-d558010ff883 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:16.161968 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-188ee3ac-44dd-47f5-9375-d558010ff883 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1518 microversion: 2.1 time: 0.222724 Jul 14 15:20:16.162536 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3327/6617] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:15 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1518 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:17.180665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5d4f884d-cd2a-45a6-8902-a7ea6360d892 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:17.181395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5d4f884d-cd2a-45a6-8902-a7ea6360d892 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:17.188545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d4f884d-cd2a-45a6-8902-a7ea6360d892 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:17.189100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d4f884d-cd2a-45a6-8902-a7ea6360d892 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:17.189951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d4f884d-cd2a-45a6-8902-a7ea6360d892 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:17.190467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5d4f884d-cd2a-45a6-8902-a7ea6360d892 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:17.330948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5d4f884d-cd2a-45a6-8902-a7ea6360d892 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:17.338906 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5d4f884d-cd2a-45a6-8902-a7ea6360d892 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1515 microversion: 2.1 time: 0.163329 Jul 14 15:20:17.339495 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3291/6618] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:17 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:17.356276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7d11ac04-d978-4c22-980d-c97e5c5e8bc6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:17.357057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7d11ac04-d978-4c22-980d-c97e5c5e8bc6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:17.364651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d11ac04-d978-4c22-980d-c97e5c5e8bc6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:17.365157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d11ac04-d978-4c22-980d-c97e5c5e8bc6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:17.365961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d11ac04-d978-4c22-980d-c97e5c5e8bc6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:17.366420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d11ac04-d978-4c22-980d-c97e5c5e8bc6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:17.428243 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7d11ac04-d978-4c22-980d-c97e5c5e8bc6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "POST /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a/action" status: 204 len: 0 microversion: 2.1 time: 0.076469 Jul 14 15:20:17.428988 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3328/6619] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:20:17 2022] POST /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:20:17.437887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-80a569c7-e3a0-49c5-b058-4ee0686d51d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:17.438568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-80a569c7-e3a0-49c5-b058-4ee0686d51d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:17.444972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a569c7-e3a0-49c5-b058-4ee0686d51d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:17.445535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a569c7-e3a0-49c5-b058-4ee0686d51d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:17.446337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a569c7-e3a0-49c5-b058-4ee0686d51d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:17.446879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-80a569c7-e3a0-49c5-b058-4ee0686d51d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:17.679707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-80a569c7-e3a0-49c5-b058-4ee0686d51d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:17.689337 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-80a569c7-e3a0-49c5-b058-4ee0686d51d4 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1515 microversion: 2.1 time: 0.255363 Jul 14 15:20:17.689937 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3292/6620] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:17 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:18.708682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c127da10-298e-4fd5-b72e-5bec98c7f1f6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:18.709505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c127da10-298e-4fd5-b72e-5bec98c7f1f6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:18.717909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c127da10-298e-4fd5-b72e-5bec98c7f1f6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:18.718524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c127da10-298e-4fd5-b72e-5bec98c7f1f6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:18.719343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c127da10-298e-4fd5-b72e-5bec98c7f1f6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:18.719809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c127da10-298e-4fd5-b72e-5bec98c7f1f6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:18.868898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c127da10-298e-4fd5-b72e-5bec98c7f1f6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:18.877630 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c127da10-298e-4fd5-b72e-5bec98c7f1f6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1507 microversion: 2.1 time: 0.174051 Jul 14 15:20:18.878273 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3329/6621] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:18 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:18.894846 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-954b3497-c522-42e3-8265-4922a38ef726 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:18.895476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-954b3497-c522-42e3-8265-4922a38ef726 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:18.903485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-954b3497-c522-42e3-8265-4922a38ef726 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:18.903955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-954b3497-c522-42e3-8265-4922a38ef726 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:18.904791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-954b3497-c522-42e3-8265-4922a38ef726 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:18.905578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-954b3497-c522-42e3-8265-4922a38ef726 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:19.037589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-954b3497-c522-42e3-8265-4922a38ef726 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:19.046416 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-954b3497-c522-42e3-8265-4922a38ef726 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1507 microversion: 2.1 time: 0.155534 Jul 14 15:20:19.046996 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3293/6622] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:18 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:19.065527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9a3000d3-8a1f-4278-b502-e6fffad484cd tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Action: 'create', calling method: .version_select at 0x7fd6c42d5dc0>, body: {"keypair": {"name": "tempest-keypair-1831235410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2ktfja/WqRFnrZqEN3FKQkk/cW3T97Wm5bSiuA6AoOkm1/tUN9NQejA9G+R8Sy44NPrPOygd9PZ0J1/W8j+8YBZLa0Ql8iNf/YgVtfsf1E0H8+uesLIWGsayM3LTZ8ww=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:19.080163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-9a3000d3-8a1f-4278-b502-e6fffad484cd tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Getting quotas for project 44a8784d7f434649b58efbe94304dfe5. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:20:19.085259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-9a3000d3-8a1f-4278-b502-e6fffad484cd tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Getting quotas for user 1ab95edeb6324b2f8b85830114148dc0 and project 44a8784d7f434649b58efbe94304dfe5. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:20:19.113991 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9a3000d3-8a1f-4278-b502-e6fffad484cd tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052321 Jul 14 15:20:19.114602 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3330/6623] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:20:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:20:20.084180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-2a688088-05a3-4970-b996-49c1e076a74a req-7bf06d41-a11b-455b-b290-ff8ec5e056b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f29f3b-edc5-4744-bf3b-282c8429d33a", "name": "network-vif-plugged", "status": "completed", "tag": "f78cdb47-f810-4217-823c-0a9e5125a15f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:20.095878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2a688088-05a3-4970-b996-49c1e076a74a req-7bf06d41-a11b-455b-b290-ff8ec5e056b2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:20.097238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2a688088-05a3-4970-b996-49c1e076a74a req-7bf06d41-a11b-455b-b290-ff8ec5e056b2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:20.111651 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-2a688088-05a3-4970-b996-49c1e076a74a req-7bf06d41-a11b-455b-b290-ff8ec5e056b2 service nova] Creating event network-vif-plugged:f78cdb47-f810-4217-823c-0a9e5125a15f for instance 30f29f3b-edc5-4744-bf3b-282c8429d33a on n-h1-767704-28 Jul 14 15:20:20.117304 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-2a688088-05a3-4970-b996-49c1e076a74a req-7bf06d41-a11b-455b-b290-ff8ec5e056b2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037605 Jul 14 15:20:20.118972 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3294/6624] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:20:20.370429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b2788cfa-195e-4d91-940e-eb1c443f9ef3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:20.370966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b2788cfa-195e-4d91-940e-eb1c443f9ef3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:20.378026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2788cfa-195e-4d91-940e-eb1c443f9ef3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:20.378502 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2788cfa-195e-4d91-940e-eb1c443f9ef3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:20.379291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2788cfa-195e-4d91-940e-eb1c443f9ef3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:20.379784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2788cfa-195e-4d91-940e-eb1c443f9ef3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:20.577572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b2788cfa-195e-4d91-940e-eb1c443f9ef3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:20.585155 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b2788cfa-195e-4d91-940e-eb1c443f9ef3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 200 len: 1507 microversion: 2.1 time: 0.220061 Jul 14 15:20:20.585739 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3331/6625] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:20 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:20.602502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d95134a2-8503-4dc8-8190-69d668e9f3cb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:20.603095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d95134a2-8503-4dc8-8190-69d668e9f3cb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:20.610555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d95134a2-8503-4dc8-8190-69d668e9f3cb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:20.611012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d95134a2-8503-4dc8-8190-69d668e9f3cb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:20.611793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d95134a2-8503-4dc8-8190-69d668e9f3cb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:20.612243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d95134a2-8503-4dc8-8190-69d668e9f3cb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:20.639250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d95134a2-8503-4dc8-8190-69d668e9f3cb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:20:20.720806 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d95134a2-8503-4dc8-8190-69d668e9f3cb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "DELETE /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 204 len: 0 microversion: 2.1 time: 0.122419 Jul 14 15:20:20.721451 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3295/6626] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:20:20 2022] DELETE /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:20:20.779008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1346823913", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "c6a35351-8dae-4622-a8f4-5d4428c9bf57"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:20.830006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] validate_networks() for [('c6a35351-8dae-4622-a8f4-5d4428c9bf57', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:20:21.215366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:20:21.215812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:20:21.216493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:20:21.216920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:20:21.217375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:20:21.226683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:21.227152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:21.227964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:21.228416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:21.246562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Getting quotas for project 44a8784d7f434649b58efbe94304dfe5. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:20:21.252067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Getting quotas for user 1ab95edeb6324b2f8b85830114148dc0 and project 44a8784d7f434649b58efbe94304dfe5. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:20:21.265564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:20:21.267869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:20:21.313104 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5c6e244d-df51-482c-bde7-920d20fb6946 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538706 Jul 14 15:20:21.313761 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3332/6627] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:20:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:20:21.325643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-72a18964-4fa9-422f-8f8c-07d76693234e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:21.326534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-72a18964-4fa9-422f-8f8c-07d76693234e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:21.385956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-72a18964-4fa9-422f-8f8c-07d76693234e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:21.394727 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-72a18964-4fa9-422f-8f8c-07d76693234e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1218 microversion: 2.1 time: 0.074730 Jul 14 15:20:21.395300 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3296/6628] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:21 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:22.412153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-301a8ca0-05b7-47fd-aaa1-5e066526a637 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:22.412785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-301a8ca0-05b7-47fd-aaa1-5e066526a637 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:22.421590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-301a8ca0-05b7-47fd-aaa1-5e066526a637 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:22.422900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-301a8ca0-05b7-47fd-aaa1-5e066526a637 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:22.424360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-301a8ca0-05b7-47fd-aaa1-5e066526a637 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:22.425612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-301a8ca0-05b7-47fd-aaa1-5e066526a637 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:22.492178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-301a8ca0-05b7-47fd-aaa1-5e066526a637 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:22.499988 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-301a8ca0-05b7-47fd-aaa1-5e066526a637 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1214 microversion: 2.1 time: 0.092751 Jul 14 15:20:22.500881 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3333/6629] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:22 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:23.284722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-35cc6f21-f3a7-4bed-9fe3-90c05feadca4 req-974cbba2-8298-452f-816d-d119524c26e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f29f3b-edc5-4744-bf3b-282c8429d33a", "name": "network-vif-deleted", "tag": "f78cdb47-f810-4217-823c-0a9e5125a15f"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:23.296788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-35cc6f21-f3a7-4bed-9fe3-90c05feadca4 req-974cbba2-8298-452f-816d-d119524c26e2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:23.297343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-35cc6f21-f3a7-4bed-9fe3-90c05feadca4 req-974cbba2-8298-452f-816d-d119524c26e2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:23.324454 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-35cc6f21-f3a7-4bed-9fe3-90c05feadca4 req-974cbba2-8298-452f-816d-d119524c26e2 service nova] Creating event network-vif-deleted:f78cdb47-f810-4217-823c-0a9e5125a15f for instance 30f29f3b-edc5-4744-bf3b-282c8429d33a on n-h1-767704-28 Jul 14 15:20:23.331223 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-35cc6f21-f3a7-4bed-9fe3-90c05feadca4 req-974cbba2-8298-452f-816d-d119524c26e2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050116 Jul 14 15:20:23.332718 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3297/6630] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:20:23.517716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f6f9df96-8efe-4e26-80fe-4778d8d38760 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:23.518359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f6f9df96-8efe-4e26-80fe-4778d8d38760 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:23.526405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6f9df96-8efe-4e26-80fe-4778d8d38760 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:23.526877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6f9df96-8efe-4e26-80fe-4778d8d38760 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:23.527696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6f9df96-8efe-4e26-80fe-4778d8d38760 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:23.528159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6f9df96-8efe-4e26-80fe-4778d8d38760 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:23.599679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6f9df96-8efe-4e26-80fe-4778d8d38760 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:23.609744 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f6f9df96-8efe-4e26-80fe-4778d8d38760 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1276 microversion: 2.1 time: 0.095222 Jul 14 15:20:23.610246 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3334/6631] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:23 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:24.628577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-09b90cd5-7be8-477e-a520-7d0380f29d21 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:24.629375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-09b90cd5-7be8-477e-a520-7d0380f29d21 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:24.643041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09b90cd5-7be8-477e-a520-7d0380f29d21 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:24.643510 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09b90cd5-7be8-477e-a520-7d0380f29d21 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:24.644326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09b90cd5-7be8-477e-a520-7d0380f29d21 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:24.644781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-09b90cd5-7be8-477e-a520-7d0380f29d21 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:24.848824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-09b90cd5-7be8-477e-a520-7d0380f29d21 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:24.856630 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-09b90cd5-7be8-477e-a520-7d0380f29d21 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1318 microversion: 2.1 time: 0.233861 Jul 14 15:20:24.857418 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3298/6632] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:24 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:25.375574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a6a44732-f168-424c-b7c4-aaf7fdce05cf req-3a5cd9ec-704c-40c4-a88d-59c5dd707a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df0f3f3-cf92-489e-a1c8-93fba535a608", "tag": "0edc8cc4-76d8-4ad6-bd6d-70fdec338e6b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:25.385783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a6a44732-f168-424c-b7c4-aaf7fdce05cf req-3a5cd9ec-704c-40c4-a88d-59c5dd707a16 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:25.386245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a6a44732-f168-424c-b7c4-aaf7fdce05cf req-3a5cd9ec-704c-40c4-a88d-59c5dd707a16 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:25.397224 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a6a44732-f168-424c-b7c4-aaf7fdce05cf req-3a5cd9ec-704c-40c4-a88d-59c5dd707a16 service nova] Creating event network-changed:0edc8cc4-76d8-4ad6-bd6d-70fdec338e6b for instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 on n-h1-767704-28 Jul 14 15:20:25.402242 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a6a44732-f168-424c-b7c4-aaf7fdce05cf req-3a5cd9ec-704c-40c4-a88d-59c5dd707a16 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032208 Jul 14 15:20:25.402846 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3335/6633] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:20:25.874273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-743bca68-1782-461e-acaf-b61e4defb7b3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:25.874893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-743bca68-1782-461e-acaf-b61e4defb7b3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:25.882138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-743bca68-1782-461e-acaf-b61e4defb7b3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:25.882594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-743bca68-1782-461e-acaf-b61e4defb7b3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:25.883362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-743bca68-1782-461e-acaf-b61e4defb7b3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:25.883805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-743bca68-1782-461e-acaf-b61e4defb7b3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:25.887044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:26.023545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-743bca68-1782-461e-acaf-b61e4defb7b3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:26.031942 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-743bca68-1782-461e-acaf-b61e4defb7b3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1318 microversion: 2.1 time: 0.162107 Jul 14 15:20:26.032550 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3299/6634] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:25 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:27.050700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b6726f5-0258-49af-a7c2-72925339c8a7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:27.051484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5b6726f5-0258-49af-a7c2-72925339c8a7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:27.053566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:27.060925 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b6726f5-0258-49af-a7c2-72925339c8a7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:27.061439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b6726f5-0258-49af-a7c2-72925339c8a7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:27.062242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b6726f5-0258-49af-a7c2-72925339c8a7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:27.062700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b6726f5-0258-49af-a7c2-72925339c8a7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:27.066519 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:27.311752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5b6726f5-0258-49af-a7c2-72925339c8a7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:27.319566 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b6726f5-0258-49af-a7c2-72925339c8a7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1318 microversion: 2.1 time: 0.274124 Jul 14 15:20:27.320143 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3336/6635] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:27 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:28.337531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7e3ccaf8-e822-4bc8-9103-87c667a83e01 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:28.338151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7e3ccaf8-e822-4bc8-9103-87c667a83e01 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:28.340878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:28.346692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e3ccaf8-e822-4bc8-9103-87c667a83e01 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:28.347152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e3ccaf8-e822-4bc8-9103-87c667a83e01 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:28.347922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e3ccaf8-e822-4bc8-9103-87c667a83e01 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:28.348364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e3ccaf8-e822-4bc8-9103-87c667a83e01 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:28.487445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7e3ccaf8-e822-4bc8-9103-87c667a83e01 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:28.496150 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7e3ccaf8-e822-4bc8-9103-87c667a83e01 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1318 microversion: 2.1 time: 0.162048 Jul 14 15:20:28.496736 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3300/6636] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:28 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:29.514171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-36627afd-0d1c-4936-8eda-8d871e505bd1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:29.514759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-36627afd-0d1c-4936-8eda-8d871e505bd1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:29.521844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36627afd-0d1c-4936-8eda-8d871e505bd1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:29.522321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36627afd-0d1c-4936-8eda-8d871e505bd1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:29.523118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36627afd-0d1c-4936-8eda-8d871e505bd1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:29.523583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-36627afd-0d1c-4936-8eda-8d871e505bd1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:29.663907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-36627afd-0d1c-4936-8eda-8d871e505bd1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:29.672569 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-36627afd-0d1c-4936-8eda-8d871e505bd1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1318 microversion: 2.1 time: 0.163200 Jul 14 15:20:29.673189 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3337/6637] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:29 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:30.690178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6b7dd088-62b5-42fd-9284-d757306050ad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:30.690710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6b7dd088-62b5-42fd-9284-d757306050ad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:30.697943 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b7dd088-62b5-42fd-9284-d757306050ad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:30.698564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b7dd088-62b5-42fd-9284-d757306050ad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:30.699337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b7dd088-62b5-42fd-9284-d757306050ad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:30.699778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b7dd088-62b5-42fd-9284-d757306050ad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:30.890607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6b7dd088-62b5-42fd-9284-d757306050ad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:30.898243 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6b7dd088-62b5-42fd-9284-d757306050ad tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1318 microversion: 2.1 time: 0.212605 Jul 14 15:20:30.898822 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3301/6638] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:30 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:31.915782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8c6a7498-4aec-4662-ab8d-194034706b5a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:31.916920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8c6a7498-4aec-4662-ab8d-194034706b5a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:31.919935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:31.920995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=10 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:31.927131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c6a7498-4aec-4662-ab8d-194034706b5a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:31.927596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c6a7498-4aec-4662-ab8d-194034706b5a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:31.928385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c6a7498-4aec-4662-ab8d-194034706b5a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:31.928836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c6a7498-4aec-4662-ab8d-194034706b5a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:31.990010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1a6aeee9-a24c-4667-ba42-8f83d94cd943 req-ec848d64-8bc7-418d-b259-38819492e334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df0f3f3-cf92-489e-a1c8-93fba535a608", "name": "network-vif-plugged", "status": "completed", "tag": "0edc8cc4-76d8-4ad6-bd6d-70fdec338e6b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:31.995462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:32.001463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1a6aeee9-a24c-4667-ba42-8f83d94cd943 req-ec848d64-8bc7-418d-b259-38819492e334 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:32.001934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1a6aeee9-a24c-4667-ba42-8f83d94cd943 req-ec848d64-8bc7-418d-b259-38819492e334 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:32.014835 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1a6aeee9-a24c-4667-ba42-8f83d94cd943 req-ec848d64-8bc7-418d-b259-38819492e334 service nova] Creating event network-vif-plugged:0edc8cc4-76d8-4ad6-bd6d-70fdec338e6b for instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 on n-h1-767704-28 Jul 14 15:20:32.020119 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1a6aeee9-a24c-4667-ba42-8f83d94cd943 req-ec848d64-8bc7-418d-b259-38819492e334 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034049 Jul 14 15:20:32.020729 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3302/6639] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:20:32.082191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8c6a7498-4aec-4662-ab8d-194034706b5a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:32.090992 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8c6a7498-4aec-4662-ab8d-194034706b5a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1318 microversion: 2.1 time: 0.179059 Jul 14 15:20:32.091606 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3338/6640] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:31 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:33.109923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-132efe7e-4ae7-46f7-8daf-da5e17e26df1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:33.110635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-132efe7e-4ae7-46f7-8daf-da5e17e26df1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:33.116963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-132efe7e-4ae7-46f7-8daf-da5e17e26df1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:33.117433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-132efe7e-4ae7-46f7-8daf-da5e17e26df1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:33.118212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-132efe7e-4ae7-46f7-8daf-da5e17e26df1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:33.118659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-132efe7e-4ae7-46f7-8daf-da5e17e26df1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:33.254688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-132efe7e-4ae7-46f7-8daf-da5e17e26df1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:33.263236 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-132efe7e-4ae7-46f7-8daf-da5e17e26df1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1318 microversion: 2.1 time: 0.159249 Jul 14 15:20:33.263836 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3303/6641] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:33 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:34.280007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-709668c1-3157-4962-bf2a-cc649d6530c3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:34.280635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-709668c1-3157-4962-bf2a-cc649d6530c3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:34.287738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-709668c1-3157-4962-bf2a-cc649d6530c3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:34.288204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-709668c1-3157-4962-bf2a-cc649d6530c3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:34.289025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-709668c1-3157-4962-bf2a-cc649d6530c3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:34.289478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-709668c1-3157-4962-bf2a-cc649d6530c3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:34.426213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-709668c1-3157-4962-bf2a-cc649d6530c3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:34.434725 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-709668c1-3157-4962-bf2a-cc649d6530c3 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1507 microversion: 2.1 time: 0.158633 Jul 14 15:20:34.435298 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3339/6642] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:34 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:34.450848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ae71c63-5917-4fd6-8b3b-393bbb542d06 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:34.451472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8ae71c63-5917-4fd6-8b3b-393bbb542d06 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:34.460599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ae71c63-5917-4fd6-8b3b-393bbb542d06 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:34.461090 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ae71c63-5917-4fd6-8b3b-393bbb542d06 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:34.461934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ae71c63-5917-4fd6-8b3b-393bbb542d06 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:34.462658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ae71c63-5917-4fd6-8b3b-393bbb542d06 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:34.599842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8ae71c63-5917-4fd6-8b3b-393bbb542d06 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:34.608362 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8ae71c63-5917-4fd6-8b3b-393bbb542d06 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1507 microversion: 2.1 time: 0.161359 Jul 14 15:20:34.609049 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3304/6643] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:34 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:34.624460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:34.625494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:34.632038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:34.632508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:34.633331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:34.633787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:34.708801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:34.715650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Old instance type m1.heat2, new instance type m1.heat {{(pid=119512) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:20:34.722225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:20:34.722667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:20:34.723166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:20:34.723594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:20:34.724022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:20:34.839461 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1cad1337-f0f7-45a9-8638-8dabf3794a6f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "POST /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608/action" status: 202 len: 0 microversion: 2.1 time: 0.218774 Jul 14 15:20:34.839854 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3340/6644] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:20:34 2022] POST /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:20:34.848587 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5fbf112e-90b2-4c65-a663-cdb42a788819 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:34.849338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5fbf112e-90b2-4c65-a663-cdb42a788819 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:34.856453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fbf112e-90b2-4c65-a663-cdb42a788819 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:34.856938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fbf112e-90b2-4c65-a663-cdb42a788819 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:34.857748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fbf112e-90b2-4c65-a663-cdb42a788819 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:34.858206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fbf112e-90b2-4c65-a663-cdb42a788819 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:35.023976 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5fbf112e-90b2-4c65-a663-cdb42a788819 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:35.032404 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5fbf112e-90b2-4c65-a663-cdb42a788819 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1514 microversion: 2.1 time: 0.187944 Jul 14 15:20:35.033320 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3305/6645] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:34 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:36.050845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dd93e821-ef93-403f-b7fc-2e59df0e00d6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:36.051685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dd93e821-ef93-403f-b7fc-2e59df0e00d6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:36.059459 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd93e821-ef93-403f-b7fc-2e59df0e00d6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:36.059933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd93e821-ef93-403f-b7fc-2e59df0e00d6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:36.061108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd93e821-ef93-403f-b7fc-2e59df0e00d6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:36.061573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd93e821-ef93-403f-b7fc-2e59df0e00d6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:36.194770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dd93e821-ef93-403f-b7fc-2e59df0e00d6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:36.203239 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dd93e821-ef93-403f-b7fc-2e59df0e00d6 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1514 microversion: 2.1 time: 0.157254 Jul 14 15:20:36.203813 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3341/6646] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:36 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:37.221246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9b67ffc-e15a-4780-9b82-c93dfea82bab tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:37.221898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c9b67ffc-e15a-4780-9b82-c93dfea82bab tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:37.229157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9b67ffc-e15a-4780-9b82-c93dfea82bab tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:37.229617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9b67ffc-e15a-4780-9b82-c93dfea82bab tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:37.230409 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9b67ffc-e15a-4780-9b82-c93dfea82bab tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:37.230852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9b67ffc-e15a-4780-9b82-c93dfea82bab tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:37.376777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c9b67ffc-e15a-4780-9b82-c93dfea82bab tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:37.384459 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c9b67ffc-e15a-4780-9b82-c93dfea82bab tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.167345 Jul 14 15:20:37.385650 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3306/6647] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:37 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:38.403258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-50355a05-f6be-4791-9ba5-eb964ba0a128 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:38.403888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-50355a05-f6be-4791-9ba5-eb964ba0a128 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:38.411728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50355a05-f6be-4791-9ba5-eb964ba0a128 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:38.412449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50355a05-f6be-4791-9ba5-eb964ba0a128 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:38.413389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50355a05-f6be-4791-9ba5-eb964ba0a128 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:38.413869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50355a05-f6be-4791-9ba5-eb964ba0a128 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:38.547896 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-50355a05-f6be-4791-9ba5-eb964ba0a128 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:38.555435 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-50355a05-f6be-4791-9ba5-eb964ba0a128 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.156719 Jul 14 15:20:38.556002 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3342/6648] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:38 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:20:39.573431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-92388a7d-9147-4be7-9492-860273ef5cea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:39.574048 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-92388a7d-9147-4be7-9492-860273ef5cea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:39.581130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92388a7d-9147-4be7-9492-860273ef5cea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:39.581594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92388a7d-9147-4be7-9492-860273ef5cea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:39.582376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92388a7d-9147-4be7-9492-860273ef5cea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:39.582833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-92388a7d-9147-4be7-9492-860273ef5cea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:39.720288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-92388a7d-9147-4be7-9492-860273ef5cea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:39.728350 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-92388a7d-9147-4be7-9492-860273ef5cea tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.158940 Jul 14 15:20:39.729738 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3307/6649] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:39 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:40.747687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3cb1aba8-b9fc-4379-afb2-ee09c0686a75 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:40.748433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3cb1aba8-b9fc-4379-afb2-ee09c0686a75 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:40.755864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cb1aba8-b9fc-4379-afb2-ee09c0686a75 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:40.756338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cb1aba8-b9fc-4379-afb2-ee09c0686a75 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:40.757175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cb1aba8-b9fc-4379-afb2-ee09c0686a75 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:40.757638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cb1aba8-b9fc-4379-afb2-ee09c0686a75 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:40.892560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3cb1aba8-b9fc-4379-afb2-ee09c0686a75 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:40.900156 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3cb1aba8-b9fc-4379-afb2-ee09c0686a75 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.157496 Jul 14 15:20:40.900777 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3343/6650] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:40 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:41.917241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f5b177de-85cc-42a2-bf7d-f2fd22b9e13a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:41.918671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f5b177de-85cc-42a2-bf7d-f2fd22b9e13a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:41.925519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5b177de-85cc-42a2-bf7d-f2fd22b9e13a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:41.925980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5b177de-85cc-42a2-bf7d-f2fd22b9e13a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:41.926768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5b177de-85cc-42a2-bf7d-f2fd22b9e13a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:41.927209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f5b177de-85cc-42a2-bf7d-f2fd22b9e13a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:42.058618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f5b177de-85cc-42a2-bf7d-f2fd22b9e13a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:42.066452 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f5b177de-85cc-42a2-bf7d-f2fd22b9e13a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.154100 Jul 14 15:20:42.067079 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3308/6651] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:41 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:43.084341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a88b5bc0-7dc9-4a21-9804-3a494c99371a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:43.085041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a88b5bc0-7dc9-4a21-9804-3a494c99371a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:43.095844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a88b5bc0-7dc9-4a21-9804-3a494c99371a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:43.096271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a88b5bc0-7dc9-4a21-9804-3a494c99371a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:43.097143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a88b5bc0-7dc9-4a21-9804-3a494c99371a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:43.097752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a88b5bc0-7dc9-4a21-9804-3a494c99371a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:43.235124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a88b5bc0-7dc9-4a21-9804-3a494c99371a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:43.242851 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a88b5bc0-7dc9-4a21-9804-3a494c99371a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.162532 Jul 14 15:20:43.243423 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3344/6652] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:43 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:44.260880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3d56b4fc-3961-4140-affd-a6258ee54bcb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:44.261536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3d56b4fc-3961-4140-affd-a6258ee54bcb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:44.268875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3d56b4fc-3961-4140-affd-a6258ee54bcb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:44.269368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3d56b4fc-3961-4140-affd-a6258ee54bcb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:44.270180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3d56b4fc-3961-4140-affd-a6258ee54bcb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:44.270634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3d56b4fc-3961-4140-affd-a6258ee54bcb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:44.405323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3d56b4fc-3961-4140-affd-a6258ee54bcb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:44.412962 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3d56b4fc-3961-4140-affd-a6258ee54bcb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.156632 Jul 14 15:20:44.413558 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3309/6653] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:44 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:45.430194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ebed342b-f16c-4f97-bbcb-437e634c4f89 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:45.430860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ebed342b-f16c-4f97-bbcb-437e634c4f89 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:45.438805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebed342b-f16c-4f97-bbcb-437e634c4f89 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:45.439278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebed342b-f16c-4f97-bbcb-437e634c4f89 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:45.440266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebed342b-f16c-4f97-bbcb-437e634c4f89 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:45.440981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ebed342b-f16c-4f97-bbcb-437e634c4f89 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:45.578244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ebed342b-f16c-4f97-bbcb-437e634c4f89 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:45.588628 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ebed342b-f16c-4f97-bbcb-437e634c4f89 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.161811 Jul 14 15:20:45.588987 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3345/6654] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:45 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:46.605359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3911e081-9a8f-4fe0-aa9c-6b31c000cf6e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:46.605982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3911e081-9a8f-4fe0-aa9c-6b31c000cf6e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:46.613187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3911e081-9a8f-4fe0-aa9c-6b31c000cf6e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:46.613643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3911e081-9a8f-4fe0-aa9c-6b31c000cf6e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:46.614426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3911e081-9a8f-4fe0-aa9c-6b31c000cf6e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:46.614862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3911e081-9a8f-4fe0-aa9c-6b31c000cf6e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:46.757235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3911e081-9a8f-4fe0-aa9c-6b31c000cf6e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:46.766075 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3911e081-9a8f-4fe0-aa9c-6b31c000cf6e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.164921 Jul 14 15:20:46.766671 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3310/6655] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:46 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:47.783216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-315b5b87-38e1-48d7-a368-c23f80f7cbe8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:47.783863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-315b5b87-38e1-48d7-a368-c23f80f7cbe8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:47.790962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-315b5b87-38e1-48d7-a368-c23f80f7cbe8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:47.791635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-315b5b87-38e1-48d7-a368-c23f80f7cbe8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:47.792228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-315b5b87-38e1-48d7-a368-c23f80f7cbe8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:47.792688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-315b5b87-38e1-48d7-a368-c23f80f7cbe8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:47.927995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-315b5b87-38e1-48d7-a368-c23f80f7cbe8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:47.936231 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-315b5b87-38e1-48d7-a368-c23f80f7cbe8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.157046 Jul 14 15:20:47.936827 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3346/6656] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:47 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:48.952892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c59cd798-1386-4d00-b009-3780b872b460 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:48.953539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c59cd798-1386-4d00-b009-3780b872b460 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:48.960654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c59cd798-1386-4d00-b009-3780b872b460 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:48.961167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c59cd798-1386-4d00-b009-3780b872b460 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:48.961954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c59cd798-1386-4d00-b009-3780b872b460 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:48.962481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c59cd798-1386-4d00-b009-3780b872b460 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:49.097493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c59cd798-1386-4d00-b009-3780b872b460 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:49.105933 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c59cd798-1386-4d00-b009-3780b872b460 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.157040 Jul 14 15:20:49.106513 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3311/6657] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:48 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:50.123434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a402a62b-fc93-47ae-9cd3-a3a66fc2f73f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:50.124065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a402a62b-fc93-47ae-9cd3-a3a66fc2f73f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:50.131618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a402a62b-fc93-47ae-9cd3-a3a66fc2f73f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:50.132088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a402a62b-fc93-47ae-9cd3-a3a66fc2f73f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:50.132910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a402a62b-fc93-47ae-9cd3-a3a66fc2f73f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:50.133468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a402a62b-fc93-47ae-9cd3-a3a66fc2f73f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:50.264318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a402a62b-fc93-47ae-9cd3-a3a66fc2f73f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:50.272045 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a402a62b-fc93-47ae-9cd3-a3a66fc2f73f tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.153043 Jul 14 15:20:50.272627 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3347/6658] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:50 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:51.289216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2a9a8f76-8c96-4ed9-9152-34447b4a29bb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:51.289844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2a9a8f76-8c96-4ed9-9152-34447b4a29bb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:51.297317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a9a8f76-8c96-4ed9-9152-34447b4a29bb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:51.297786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a9a8f76-8c96-4ed9-9152-34447b4a29bb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:51.298627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a9a8f76-8c96-4ed9-9152-34447b4a29bb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:51.299083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a9a8f76-8c96-4ed9-9152-34447b4a29bb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:51.446633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2a9a8f76-8c96-4ed9-9152-34447b4a29bb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:51.455049 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2a9a8f76-8c96-4ed9-9152-34447b4a29bb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.169873 Jul 14 15:20:51.455637 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3312/6659] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:51 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:52.471354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff29ad34-6d16-4f32-b43e-2f1e1a1e58c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:52.471995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ff29ad34-6d16-4f32-b43e-2f1e1a1e58c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:52.479161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff29ad34-6d16-4f32-b43e-2f1e1a1e58c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:52.479632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff29ad34-6d16-4f32-b43e-2f1e1a1e58c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:52.480433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff29ad34-6d16-4f32-b43e-2f1e1a1e58c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:52.480870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff29ad34-6d16-4f32-b43e-2f1e1a1e58c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:52.616184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ff29ad34-6d16-4f32-b43e-2f1e1a1e58c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:52.624677 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ff29ad34-6d16-4f32-b43e-2f1e1a1e58c0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.157269 Jul 14 15:20:52.625288 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3348/6660] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:52 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:53.641661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ee3aaf73-6251-482a-9cf2-90e23beaf39b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:53.642277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ee3aaf73-6251-482a-9cf2-90e23beaf39b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:53.649471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee3aaf73-6251-482a-9cf2-90e23beaf39b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:53.649937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee3aaf73-6251-482a-9cf2-90e23beaf39b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:53.651404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee3aaf73-6251-482a-9cf2-90e23beaf39b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:53.651854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee3aaf73-6251-482a-9cf2-90e23beaf39b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:53.791575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ee3aaf73-6251-482a-9cf2-90e23beaf39b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:53.799380 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ee3aaf73-6251-482a-9cf2-90e23beaf39b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.161676 Jul 14 15:20:53.799956 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3313/6661] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:53 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:54.817286 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77a92249-a4dd-41fc-ad15-4d826a3ad139 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:54.817917 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-77a92249-a4dd-41fc-ad15-4d826a3ad139 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:54.826425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77a92249-a4dd-41fc-ad15-4d826a3ad139 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:54.826899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77a92249-a4dd-41fc-ad15-4d826a3ad139 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:54.827695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77a92249-a4dd-41fc-ad15-4d826a3ad139 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:54.828158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77a92249-a4dd-41fc-ad15-4d826a3ad139 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:54.964166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-77a92249-a4dd-41fc-ad15-4d826a3ad139 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:54.971900 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-77a92249-a4dd-41fc-ad15-4d826a3ad139 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.158623 Jul 14 15:20:54.972478 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3349/6662] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:54 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:55.989285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b6249814-6d6b-435f-b0e4-f3b811a3475b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:55.989912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b6249814-6d6b-435f-b0e4-f3b811a3475b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:55.997921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6249814-6d6b-435f-b0e4-f3b811a3475b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:55.997921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6249814-6d6b-435f-b0e4-f3b811a3475b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:55.998680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6249814-6d6b-435f-b0e4-f3b811a3475b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:55.999131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b6249814-6d6b-435f-b0e4-f3b811a3475b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:56.002156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=86 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:56.132398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b6249814-6d6b-435f-b0e4-f3b811a3475b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:56.140898 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b6249814-6d6b-435f-b0e4-f3b811a3475b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.155572 Jul 14 15:20:56.141509 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3314/6663] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:55 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:57.162179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8bc1e6f7-6147-4d09-90f0-5788e92fd3d9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:57.162818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8bc1e6f7-6147-4d09-90f0-5788e92fd3d9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:57.165253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=32 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:57.172099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bc1e6f7-6147-4d09-90f0-5788e92fd3d9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:57.172601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bc1e6f7-6147-4d09-90f0-5788e92fd3d9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:57.173453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bc1e6f7-6147-4d09-90f0-5788e92fd3d9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:57.173937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bc1e6f7-6147-4d09-90f0-5788e92fd3d9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:57.176761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:57.308492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8bc1e6f7-6147-4d09-90f0-5788e92fd3d9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:57.316042 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8bc1e6f7-6147-4d09-90f0-5788e92fd3d9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.157974 Jul 14 15:20:57.316614 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3350/6664] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:57 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:58.333083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c71bb7f-c0e4-48b6-b662-a9dd99b9e213 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:58.333713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3c71bb7f-c0e4-48b6-b662-a9dd99b9e213 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:58.341323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c71bb7f-c0e4-48b6-b662-a9dd99b9e213 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:58.341781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c71bb7f-c0e4-48b6-b662-a9dd99b9e213 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:58.342704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c71bb7f-c0e4-48b6-b662-a9dd99b9e213 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:58.343147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c71bb7f-c0e4-48b6-b662-a9dd99b9e213 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:58.479175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3c71bb7f-c0e4-48b6-b662-a9dd99b9e213 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:58.488515 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3c71bb7f-c0e4-48b6-b662-a9dd99b9e213 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.159396 Jul 14 15:20:58.489141 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3315/6665] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:58 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:59.507786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e6afe557-e196-47e2-b6a3-74947859dba7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:59.508460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e6afe557-e196-47e2-b6a3-74947859dba7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:59.515719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6afe557-e196-47e2-b6a3-74947859dba7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:59.516189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6afe557-e196-47e2-b6a3-74947859dba7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:59.517005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6afe557-e196-47e2-b6a3-74947859dba7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:59.517464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e6afe557-e196-47e2-b6a3-74947859dba7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:59.651738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e6afe557-e196-47e2-b6a3-74947859dba7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:59.659655 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e6afe557-e196-47e2-b6a3-74947859dba7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.155792 Jul 14 15:20:59.660247 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3351/6666] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:59 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:00.676843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b636abf-d9aa-44ac-942a-42af115c7426 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:00.677486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0b636abf-d9aa-44ac-942a-42af115c7426 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:00.680165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=32 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:00.685942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b636abf-d9aa-44ac-942a-42af115c7426 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:00.686400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b636abf-d9aa-44ac-942a-42af115c7426 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:00.687178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b636abf-d9aa-44ac-942a-42af115c7426 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:00.687621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b636abf-d9aa-44ac-942a-42af115c7426 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:00.834406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0b636abf-d9aa-44ac-942a-42af115c7426 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:00.842616 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0b636abf-d9aa-44ac-942a-42af115c7426 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.169618 Jul 14 15:21:00.843221 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3316/6667] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:00 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:01.859841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4262bbec-27f3-4110-8f3f-24a35db6ed70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:01.860541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4262bbec-27f3-4110-8f3f-24a35db6ed70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:01.867523 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4262bbec-27f3-4110-8f3f-24a35db6ed70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:01.868000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4262bbec-27f3-4110-8f3f-24a35db6ed70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:01.868808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4262bbec-27f3-4110-8f3f-24a35db6ed70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:01.869314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4262bbec-27f3-4110-8f3f-24a35db6ed70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:02.006152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4262bbec-27f3-4110-8f3f-24a35db6ed70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:02.014524 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4262bbec-27f3-4110-8f3f-24a35db6ed70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.158588 Jul 14 15:21:02.015121 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3352/6668] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:01 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:21:03.032599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5e6a4f75-7f9e-47db-896d-71d09a5cc441 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:03.033281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5e6a4f75-7f9e-47db-896d-71d09a5cc441 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:03.040315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e6a4f75-7f9e-47db-896d-71d09a5cc441 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:03.040831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e6a4f75-7f9e-47db-896d-71d09a5cc441 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:03.041704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e6a4f75-7f9e-47db-896d-71d09a5cc441 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:03.042161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5e6a4f75-7f9e-47db-896d-71d09a5cc441 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:03.176532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5e6a4f75-7f9e-47db-896d-71d09a5cc441 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:03.184769 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5e6a4f75-7f9e-47db-896d-71d09a5cc441 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.156143 Jul 14 15:21:03.185396 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3317/6669] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:03 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:04.202793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7d86ea5e-467b-4844-8209-8ad899d816d1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:04.203466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7d86ea5e-467b-4844-8209-8ad899d816d1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:04.210544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d86ea5e-467b-4844-8209-8ad899d816d1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:04.211012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d86ea5e-467b-4844-8209-8ad899d816d1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:04.211798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d86ea5e-467b-4844-8209-8ad899d816d1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:04.212438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d86ea5e-467b-4844-8209-8ad899d816d1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:04.348735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7d86ea5e-467b-4844-8209-8ad899d816d1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:04.361164 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7d86ea5e-467b-4844-8209-8ad899d816d1 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.162268 Jul 14 15:21:04.361775 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3353/6670] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:04 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:05.379937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e6ca8052-204e-4fc6-a396-3314370a9c23 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:05.380588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e6ca8052-204e-4fc6-a396-3314370a9c23 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:05.388479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6ca8052-204e-4fc6-a396-3314370a9c23 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:05.388958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6ca8052-204e-4fc6-a396-3314370a9c23 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:05.389752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6ca8052-204e-4fc6-a396-3314370a9c23 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:05.390205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6ca8052-204e-4fc6-a396-3314370a9c23 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:05.541654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e6ca8052-204e-4fc6-a396-3314370a9c23 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:05.549306 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e6ca8052-204e-4fc6-a396-3314370a9c23 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.173858 Jul 14 15:21:05.549892 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3318/6671] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:05 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:06.567425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fed9a2a7-6a6d-4b3f-9d4a-ee79611b87e0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:06.568055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fed9a2a7-6a6d-4b3f-9d4a-ee79611b87e0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:06.576054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fed9a2a7-6a6d-4b3f-9d4a-ee79611b87e0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:06.576525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fed9a2a7-6a6d-4b3f-9d4a-ee79611b87e0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:06.577343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fed9a2a7-6a6d-4b3f-9d4a-ee79611b87e0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:06.577799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fed9a2a7-6a6d-4b3f-9d4a-ee79611b87e0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:06.717858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fed9a2a7-6a6d-4b3f-9d4a-ee79611b87e0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:06.725351 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fed9a2a7-6a6d-4b3f-9d4a-ee79611b87e0 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.161824 Jul 14 15:21:06.725936 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3354/6672] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:06 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:07.741773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1feed5a7-89e5-470c-ae08-af5c68ca550b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:07.742395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1feed5a7-89e5-470c-ae08-af5c68ca550b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:07.749592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1feed5a7-89e5-470c-ae08-af5c68ca550b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:07.750057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1feed5a7-89e5-470c-ae08-af5c68ca550b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:07.750843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1feed5a7-89e5-470c-ae08-af5c68ca550b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:07.751561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1feed5a7-89e5-470c-ae08-af5c68ca550b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:07.883036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1feed5a7-89e5-470c-ae08-af5c68ca550b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:07.895335 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1feed5a7-89e5-470c-ae08-af5c68ca550b tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.157461 Jul 14 15:21:07.895929 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3319/6673] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:07 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:08.913281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f2e4d3c6-6a4b-4ca8-a6c5-b1ef909c9100 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:08.914005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f2e4d3c6-6a4b-4ca8-a6c5-b1ef909c9100 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:08.923298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f2e4d3c6-6a4b-4ca8-a6c5-b1ef909c9100 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:08.923768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f2e4d3c6-6a4b-4ca8-a6c5-b1ef909c9100 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:08.924570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f2e4d3c6-6a4b-4ca8-a6c5-b1ef909c9100 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:08.925055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f2e4d3c6-6a4b-4ca8-a6c5-b1ef909c9100 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:09.062181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f2e4d3c6-6a4b-4ca8-a6c5-b1ef909c9100 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:09.069746 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f2e4d3c6-6a4b-4ca8-a6c5-b1ef909c9100 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1519 microversion: 2.1 time: 0.160511 Jul 14 15:21:09.070318 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3355/6674] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:08 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:09.828819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-257cd1c3-6123-457b-be10-a5783e68006a req-986ce66a-d539-4a43-829d-a73efef3b2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df0f3f3-cf92-489e-a1c8-93fba535a608", "name": "network-vif-unplugged", "status": "completed", "tag": "0edc8cc4-76d8-4ad6-bd6d-70fdec338e6b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:09.839148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-257cd1c3-6123-457b-be10-a5783e68006a req-986ce66a-d539-4a43-829d-a73efef3b2f2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:09.839697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-257cd1c3-6123-457b-be10-a5783e68006a req-986ce66a-d539-4a43-829d-a73efef3b2f2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:09.851755 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-257cd1c3-6123-457b-be10-a5783e68006a req-986ce66a-d539-4a43-829d-a73efef3b2f2 service nova] Creating event network-vif-unplugged:0edc8cc4-76d8-4ad6-bd6d-70fdec338e6b for instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 on n-h2-767704-28 Jul 14 15:21:09.858517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-257cd1c3-6123-457b-be10-a5783e68006a req-986ce66a-d539-4a43-829d-a73efef3b2f2 service nova] Instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:21:09.869889 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-257cd1c3-6123-457b-be10-a5783e68006a req-986ce66a-d539-4a43-829d-a73efef3b2f2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044750 Jul 14 15:21:09.870516 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3320/6675] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:21:10.089435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-48c2832c-3dce-46e0-9353-229f7beed324 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:10.090281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-48c2832c-3dce-46e0-9353-229f7beed324 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:10.098118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48c2832c-3dce-46e0-9353-229f7beed324 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:10.099135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48c2832c-3dce-46e0-9353-229f7beed324 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:10.101313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48c2832c-3dce-46e0-9353-229f7beed324 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:10.101860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-48c2832c-3dce-46e0-9353-229f7beed324 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:10.349387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-48c2832c-3dce-46e0-9353-229f7beed324 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:10.357077 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-48c2832c-3dce-46e0-9353-229f7beed324 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1518 microversion: 2.1 time: 0.273979 Jul 14 15:21:10.357666 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3356/6676] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:10 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1518 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:11.376471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cce6134d-662e-4b23-8716-72de694e1c1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:11.377235 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cce6134d-662e-4b23-8716-72de694e1c1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:11.383601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cce6134d-662e-4b23-8716-72de694e1c1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:11.384071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cce6134d-662e-4b23-8716-72de694e1c1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:11.384854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cce6134d-662e-4b23-8716-72de694e1c1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:11.385336 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cce6134d-662e-4b23-8716-72de694e1c1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:11.519095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cce6134d-662e-4b23-8716-72de694e1c1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:11.530090 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cce6134d-662e-4b23-8716-72de694e1c1a tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1516 microversion: 2.1 time: 0.159060 Jul 14 15:21:11.530684 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3321/6677] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:11 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:11.887041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-677a34e7-4b37-4d93-95cc-153c355d043d req-e18584f2-db83-45af-9c56-a78f5d8b5536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df0f3f3-cf92-489e-a1c8-93fba535a608", "tag": "0edc8cc4-76d8-4ad6-bd6d-70fdec338e6b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:11.895160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-677a34e7-4b37-4d93-95cc-153c355d043d req-e18584f2-db83-45af-9c56-a78f5d8b5536 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:11.895646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-677a34e7-4b37-4d93-95cc-153c355d043d req-e18584f2-db83-45af-9c56-a78f5d8b5536 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:11.909253 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-677a34e7-4b37-4d93-95cc-153c355d043d req-e18584f2-db83-45af-9c56-a78f5d8b5536 service nova] Creating event network-changed:0edc8cc4-76d8-4ad6-bd6d-70fdec338e6b for instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 on n-h2-767704-28 Jul 14 15:21:11.914894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-677a34e7-4b37-4d93-95cc-153c355d043d req-e18584f2-db83-45af-9c56-a78f5d8b5536 service nova] Instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:21:11.931962 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-677a34e7-4b37-4d93-95cc-153c355d043d req-e18584f2-db83-45af-9c56-a78f5d8b5536 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050213 Jul 14 15:21:11.932773 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3357/6678] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:21:12.552440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-38fdb061-c976-499c-a42b-5ba19d38e4ac tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:12.553100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-38fdb061-c976-499c-a42b-5ba19d38e4ac tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:12.561147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38fdb061-c976-499c-a42b-5ba19d38e4ac tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:12.561901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38fdb061-c976-499c-a42b-5ba19d38e4ac tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:12.562708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38fdb061-c976-499c-a42b-5ba19d38e4ac tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:12.563154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-38fdb061-c976-499c-a42b-5ba19d38e4ac tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:12.914758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-38fdb061-c976-499c-a42b-5ba19d38e4ac tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:12.923384 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-38fdb061-c976-499c-a42b-5ba19d38e4ac tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1513 microversion: 2.1 time: 0.375033 Jul 14 15:21:12.924012 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3322/6679] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:12 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1513 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:12.942342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2e072861-5cc3-46ea-9a9e-83b6eede6274 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:12.943203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2e072861-5cc3-46ea-9a9e-83b6eede6274 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:12.952369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e072861-5cc3-46ea-9a9e-83b6eede6274 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:12.952933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e072861-5cc3-46ea-9a9e-83b6eede6274 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:12.953921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e072861-5cc3-46ea-9a9e-83b6eede6274 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:12.954386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e072861-5cc3-46ea-9a9e-83b6eede6274 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:13.018960 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2e072861-5cc3-46ea-9a9e-83b6eede6274 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "POST /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608/action" status: 204 len: 0 microversion: 2.1 time: 0.082185 Jul 14 15:21:13.019996 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3358/6680] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:21:12 2022] POST /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:21:13.028961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9d92b932-4073-4c04-93df-020c093fada9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:13.029651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9d92b932-4073-4c04-93df-020c093fada9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:13.037047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d92b932-4073-4c04-93df-020c093fada9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:13.037517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d92b932-4073-4c04-93df-020c093fada9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:13.038371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d92b932-4073-4c04-93df-020c093fada9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:13.038758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d92b932-4073-4c04-93df-020c093fada9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:13.385036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9d92b932-4073-4c04-93df-020c093fada9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:13.395317 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9d92b932-4073-4c04-93df-020c093fada9 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1513 microversion: 2.1 time: 0.370908 Jul 14 15:21:13.401255 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3323/6681] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:13 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1513 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:13.992813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6f5cdff3-abd8-4555-87d8-647644ac4d78 req-a2f9a5dd-751f-4d73-8cd3-f0497aba2d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df0f3f3-cf92-489e-a1c8-93fba535a608", "name": "network-vif-plugged", "status": "completed", "tag": "0edc8cc4-76d8-4ad6-bd6d-70fdec338e6b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:14.004483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6f5cdff3-abd8-4555-87d8-647644ac4d78 req-a2f9a5dd-751f-4d73-8cd3-f0497aba2d1a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:14.005189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6f5cdff3-abd8-4555-87d8-647644ac4d78 req-a2f9a5dd-751f-4d73-8cd3-f0497aba2d1a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:14.021275 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6f5cdff3-abd8-4555-87d8-647644ac4d78 req-a2f9a5dd-751f-4d73-8cd3-f0497aba2d1a service nova] Creating event network-vif-plugged:0edc8cc4-76d8-4ad6-bd6d-70fdec338e6b for instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 on n-h2-767704-28 Jul 14 15:21:14.028532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-6f5cdff3-abd8-4555-87d8-647644ac4d78 req-a2f9a5dd-751f-4d73-8cd3-f0497aba2d1a service nova] Instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:21:14.040000 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6f5cdff3-abd8-4555-87d8-647644ac4d78 req-a2f9a5dd-751f-4d73-8cd3-f0497aba2d1a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053868 Jul 14 15:21:14.040678 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3359/6682] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:21:14.413670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0c9df922-8ebb-4866-bfc8-8ff552b221af tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:14.414297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0c9df922-8ebb-4866-bfc8-8ff552b221af tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:14.422491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c9df922-8ebb-4866-bfc8-8ff552b221af tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:14.422959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c9df922-8ebb-4866-bfc8-8ff552b221af tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:14.423780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c9df922-8ebb-4866-bfc8-8ff552b221af tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:14.424231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c9df922-8ebb-4866-bfc8-8ff552b221af tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:14.563772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0c9df922-8ebb-4866-bfc8-8ff552b221af tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:14.571585 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0c9df922-8ebb-4866-bfc8-8ff552b221af tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1513 microversion: 2.1 time: 0.161789 Jul 14 15:21:14.572712 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3324/6683] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:14 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:21:15.592014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8204a376-664c-4fed-a0f5-c7f5a6c9e2df tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:15.592793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8204a376-664c-4fed-a0f5-c7f5a6c9e2df tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:15.599196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8204a376-664c-4fed-a0f5-c7f5a6c9e2df tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:15.599660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8204a376-664c-4fed-a0f5-c7f5a6c9e2df tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:15.600446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8204a376-664c-4fed-a0f5-c7f5a6c9e2df tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:15.600895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8204a376-664c-4fed-a0f5-c7f5a6c9e2df tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:15.737607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8204a376-664c-4fed-a0f5-c7f5a6c9e2df tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:15.745445 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8204a376-664c-4fed-a0f5-c7f5a6c9e2df tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1505 microversion: 2.1 time: 0.159564 Jul 14 15:21:15.746024 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3360/6684] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:15 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:15.762390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-02586ed3-0df6-40a6-8cb2-e795f1302ef8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:15.763011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-02586ed3-0df6-40a6-8cb2-e795f1302ef8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:15.770039 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02586ed3-0df6-40a6-8cb2-e795f1302ef8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:15.770501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02586ed3-0df6-40a6-8cb2-e795f1302ef8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:15.771275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02586ed3-0df6-40a6-8cb2-e795f1302ef8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:15.771721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-02586ed3-0df6-40a6-8cb2-e795f1302ef8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:15.907246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-02586ed3-0df6-40a6-8cb2-e795f1302ef8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:15.914945 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-02586ed3-0df6-40a6-8cb2-e795f1302ef8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1505 microversion: 2.1 time: 0.156970 Jul 14 15:21:15.916143 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3325/6685] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:15 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:15.932100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-409a9773-356b-4a7b-ab40-28b99a52430e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:15.932563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-409a9773-356b-4a7b-ab40-28b99a52430e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:15.939264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-409a9773-356b-4a7b-ab40-28b99a52430e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:15.939732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-409a9773-356b-4a7b-ab40-28b99a52430e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:15.940517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-409a9773-356b-4a7b-ab40-28b99a52430e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:15.940987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-409a9773-356b-4a7b-ab40-28b99a52430e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:16.077426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-409a9773-356b-4a7b-ab40-28b99a52430e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:16.085094 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-409a9773-356b-4a7b-ab40-28b99a52430e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1505 microversion: 2.1 time: 0.157541 Jul 14 15:21:16.085675 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3361/6686] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:15 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:16.101356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d80f7a29-1949-4050-a024-a23cb1bee4c7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:16.101862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d80f7a29-1949-4050-a024-a23cb1bee4c7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:16.109925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d80f7a29-1949-4050-a024-a23cb1bee4c7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:16.110387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d80f7a29-1949-4050-a024-a23cb1bee4c7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:16.111175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d80f7a29-1949-4050-a024-a23cb1bee4c7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:16.111614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d80f7a29-1949-4050-a024-a23cb1bee4c7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:16.138257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d80f7a29-1949-4050-a024-a23cb1bee4c7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:21:16.215306 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d80f7a29-1949-4050-a024-a23cb1bee4c7 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 204 len: 0 microversion: 2.1 time: 0.117559 Jul 14 15:21:16.215910 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3326/6687] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:21:16 2022] DELETE /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:21:16.234605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e4d2b0f2-8123-4bec-afb5-cb3d6e85bf34 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:16.235133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e4d2b0f2-8123-4bec-afb5-cb3d6e85bf34 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:16.247282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4d2b0f2-8123-4bec-afb5-cb3d6e85bf34 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:16.247761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4d2b0f2-8123-4bec-afb5-cb3d6e85bf34 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:16.248573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4d2b0f2-8123-4bec-afb5-cb3d6e85bf34 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:16.249070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e4d2b0f2-8123-4bec-afb5-cb3d6e85bf34 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:16.278854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e4d2b0f2-8123-4bec-afb5-cb3d6e85bf34 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:21:16.325525 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.compute.api [None req-e4d2b0f2-8123-4bec-afb5-cb3d6e85bf34 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Instance is already in deleting state, ignoring this request Jul 14 15:21:16.326590 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e4d2b0f2-8123-4bec-afb5-cb3d6e85bf34 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 204 len: 0 microversion: 2.1 time: 0.096012 Jul 14 15:21:16.327182 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3362/6688] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:21:16 2022] DELETE /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:21:16.336206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1161f584-ccdb-4019-ba74-ef289cfeef70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:16.337067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1161f584-ccdb-4019-ba74-ef289cfeef70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:16.343338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1161f584-ccdb-4019-ba74-ef289cfeef70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:16.343793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1161f584-ccdb-4019-ba74-ef289cfeef70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:16.344664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1161f584-ccdb-4019-ba74-ef289cfeef70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:16.345151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1161f584-ccdb-4019-ba74-ef289cfeef70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:16.485703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1161f584-ccdb-4019-ba74-ef289cfeef70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:16.493988 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1161f584-ccdb-4019-ba74-ef289cfeef70 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1511 microversion: 2.1 time: 0.161408 Jul 14 15:21:16.494605 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3327/6689] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:16 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:17.512451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f5687de9-7b51-4ef3-9421-fc4b262082f8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:17.513120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f5687de9-7b51-4ef3-9421-fc4b262082f8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:17.520423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5687de9-7b51-4ef3-9421-fc4b262082f8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:17.520893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5687de9-7b51-4ef3-9421-fc4b262082f8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:17.521712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5687de9-7b51-4ef3-9421-fc4b262082f8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:17.522168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f5687de9-7b51-4ef3-9421-fc4b262082f8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:17.658218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f5687de9-7b51-4ef3-9421-fc4b262082f8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ab95edeb6324b2f8b85830114148dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a8784d7f434649b58efbe94304dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:17.667186 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f5687de9-7b51-4ef3-9421-fc4b262082f8 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 200 len: 1511 microversion: 2.1 time: 0.159763 Jul 14 15:21:17.667771 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3363/6690] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:17 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:21:18.286047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-2bb477d6-07c9-43ec-8874-61d12c1f9491 req-8b3573e1-22e6-4ff2-9858-67586df47080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df0f3f3-cf92-489e-a1c8-93fba535a608", "name": "network-vif-deleted", "tag": "0edc8cc4-76d8-4ad6-bd6d-70fdec338e6b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:18.296815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2bb477d6-07c9-43ec-8874-61d12c1f9491 req-8b3573e1-22e6-4ff2-9858-67586df47080 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:18.297333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2bb477d6-07c9-43ec-8874-61d12c1f9491 req-8b3573e1-22e6-4ff2-9858-67586df47080 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:18.310147 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-2bb477d6-07c9-43ec-8874-61d12c1f9491 req-8b3573e1-22e6-4ff2-9858-67586df47080 service nova] Creating event network-vif-deleted:0edc8cc4-76d8-4ad6-bd6d-70fdec338e6b for instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 on n-h2-767704-28 Jul 14 15:21:18.315905 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-2bb477d6-07c9-43ec-8874-61d12c1f9491 req-8b3573e1-22e6-4ff2-9858-67586df47080 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033450 Jul 14 15:21:18.316846 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3328/6691] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:21:18.684563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-03044382-d2c5-44a4-8a1c-97445a13eaeb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:18.685214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-03044382-d2c5-44a4-8a1c-97445a13eaeb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 3df0f3f3-cf92-489e-a1c8-93fba535a608] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:18.692680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03044382-d2c5-44a4-8a1c-97445a13eaeb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:18.693184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03044382-d2c5-44a4-8a1c-97445a13eaeb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:18.693980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03044382-d2c5-44a4-8a1c-97445a13eaeb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:18.694500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-03044382-d2c5-44a4-8a1c-97445a13eaeb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:18.709686 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-03044382-d2c5-44a4-8a1c-97445a13eaeb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] HTTP exception thrown: Instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 could not be found. Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-03044382-d2c5-44a4-8a1c-97445a13eaeb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Request method failure captured: Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 HTTP/1.1 Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DP9Fejpq4W6ZnDmXsqh5s1kagnrHHSW9fQj7jYb23RAZZGjkKkD1Iozf7tLoecwOKFNH-tnHt-P5zhxzHfcW3PdZ5YNH6zwZ54mKogoV7fdcA0c1I7Tpj_T4tCs3D_2V0Rv2hRIqR8gsNWDs7bMbZph0BRZV7GB0f2-GIeHvy1qxpQ Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 44a8784d7f434649b58efbe94304dfe5 Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerDiskConfigTestJSON-802091479 Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/44a8784d7f434649b58efbe94304dfe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/44a8784d7f434649b58efbe94304dfe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_44a8784d7f434649b58efbe94304dfe5", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/44a8784d7f434649b58efbe94304dfe5"}]}] Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerDiskConfigTestJSON-802091479 Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 44a8784d7f434649b58efbe94304dfe5 Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-802091479 Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerDiskConfigTestJSON-802091479-project Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1ab95edeb6324b2f8b85830114148dc0 Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerDiskConfigTestJSON-802091479-project Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 could not be found. Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '3df0f3f3-cf92-489e-a1c8-93fba535a608'} Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 could not be found. Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 could not be found. Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:21:18.711475 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:21:18.716873 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:21:18.716873 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:21:18.716873 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:21:18.716873 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:21:18.716873 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:21:18.716873 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 could not be found. Jul 14 15:21:18.716873 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:21:18.716873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-03044382-d2c5-44a4-8a1c-97445a13eaeb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Returning 404 to user: Instance 3df0f3f3-cf92-489e-a1c8-93fba535a608 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:21:18.716873 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-03044382-d2c5-44a4-8a1c-97445a13eaeb tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608" status: 404 len: 111 microversion: 2.1 time: 0.032701 Jul 14 15:21:18.716873 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3364/6692] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:18 2022] GET /compute/v2.1/servers/3df0f3f3-cf92-489e-a1c8-93fba535a608 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:21:18.723231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1e0ee37b-c589-4db9-b195-1df5d90b8a77 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '.version_select at 0x7fd6c62ac700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:18.747552 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1e0ee37b-c589-4db9-b195-1df5d90b8a77 tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831235410" status: 202 len: 0 microversion: 2.1 time: 0.028449 Jul 14 15:21:18.748170 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3329/6693] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 15:21:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831235410 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:21:19.407707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a8aeae41-facb-4c48-b8d9-28bfa2240dcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:19.408331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a8aeae41-facb-4c48-b8d9-28bfa2240dcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:19.414820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8aeae41-facb-4c48-b8d9-28bfa2240dcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:19.416543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8aeae41-facb-4c48-b8d9-28bfa2240dcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:19.417393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8aeae41-facb-4c48-b8d9-28bfa2240dcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:19.417862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8aeae41-facb-4c48-b8d9-28bfa2240dcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:19.432599 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-a8aeae41-facb-4c48-b8d9-28bfa2240dcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] HTTP exception thrown: Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a could not be found. Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a8aeae41-facb-4c48-b8d9-28bfa2240dcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Request method failure captured: Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a HTTP/1.1 Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DP9Fejpq4W6ZnDmXsqh5s1kagnrHHSW9fQj7jYb23RAZZGjkKkD1Iozf7tLoecwOKFNH-tnHt-P5zhxzHfcW3PdZ5YNH6zwZ54mKogoV7fdcA0c1I7Tpj_T4tCs3D_2V0Rv2hRIqR8gsNWDs7bMbZph0BRZV7GB0f2-GIeHvy1qxpQ Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 44a8784d7f434649b58efbe94304dfe5 Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerDiskConfigTestJSON-802091479 Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/44a8784d7f434649b58efbe94304dfe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/44a8784d7f434649b58efbe94304dfe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_44a8784d7f434649b58efbe94304dfe5", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/44a8784d7f434649b58efbe94304dfe5"}]}] Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerDiskConfigTestJSON-802091479 Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 44a8784d7f434649b58efbe94304dfe5 Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-802091479 Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerDiskConfigTestJSON-802091479-project Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 1ab95edeb6324b2f8b85830114148dc0 Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerDiskConfigTestJSON-802091479-project Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a could not be found. Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '30f29f3b-edc5-4744-bf3b-282c8429d33a'} Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a could not be found. Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:21:19.434242 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a could not be found. Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a could not be found. Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a8aeae41-facb-4c48-b8d9-28bfa2240dcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Returning 404 to user: Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a8aeae41-facb-4c48-b8d9-28bfa2240dcf tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "DELETE /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 404 len: 111 microversion: 2.1 time: 0.032366 Jul 14 15:21:19.437699 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3365/6694] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:21:19 2022] DELETE /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:21:19.445257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c66db367-392f-4217-8376-408ec4dc405e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:19.445995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c66db367-392f-4217-8376-408ec4dc405e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] [instance: 30f29f3b-edc5-4744-bf3b-282c8429d33a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:19.452788 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c66db367-392f-4217-8376-408ec4dc405e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:19.453273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c66db367-392f-4217-8376-408ec4dc405e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:19.454047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c66db367-392f-4217-8376-408ec4dc405e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:19.454492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c66db367-392f-4217-8376-408ec4dc405e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:19.468185 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-c66db367-392f-4217-8376-408ec4dc405e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] HTTP exception thrown: Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a could not be found. Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c66db367-392f-4217-8376-408ec4dc405e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Request method failure captured: Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a HTTP/1.1 Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DP9Fejpq4W6ZnDmXsqh5s1kagnrHHSW9fQj7jYb23RAZZGjkKkD1Iozf7tLoecwOKFNH-tnHt-P5zhxzHfcW3PdZ5YNH6zwZ54mKogoV7fdcA0c1I7Tpj_T4tCs3D_2V0Rv2hRIqR8gsNWDs7bMbZph0BRZV7GB0f2-GIeHvy1qxpQ Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 44a8784d7f434649b58efbe94304dfe5 Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerDiskConfigTestJSON-802091479 Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/44a8784d7f434649b58efbe94304dfe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/44a8784d7f434649b58efbe94304dfe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_44a8784d7f434649b58efbe94304dfe5", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/44a8784d7f434649b58efbe94304dfe5"}]}] Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerDiskConfigTestJSON-802091479 Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 44a8784d7f434649b58efbe94304dfe5 Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-802091479 Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerDiskConfigTestJSON-802091479-project Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 1ab95edeb6324b2f8b85830114148dc0 Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerDiskConfigTestJSON-802091479-project Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a could not be found. Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '30f29f3b-edc5-4744-bf3b-282c8429d33a'} Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a could not be found. Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a could not be found. Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:21:19.470004 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:21:19.473292 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:21:19.473292 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:21:19.473292 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:21:19.473292 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:21:19.473292 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:21:19.473292 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a could not be found. Jul 14 15:21:19.473292 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:21:19.473292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c66db367-392f-4217-8376-408ec4dc405e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] Returning 404 to user: Instance 30f29f3b-edc5-4744-bf3b-282c8429d33a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:21:19.473292 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c66db367-392f-4217-8376-408ec4dc405e tempest-ServerDiskConfigTestJSON-802091479 tempest-ServerDiskConfigTestJSON-802091479-project] 10.222.0.81 "GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a" status: 404 len: 111 microversion: 2.1 time: 0.031077 Jul 14 15:21:19.473292 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3330/6695] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:19 2022] GET /compute/v2.1/servers/30f29f3b-edc5-4744-bf3b-282c8429d33a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:21:28.340034 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f612126a-1458-4b34-bba1-4eeaf23dd615 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'create', calling method: .version_select at 0x7fd6c4c5daf0>, body: {"keypair": {"name": "tempest-keypair-1805277302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUixsEcGeZcmtkZjzUbL8Saxj8QtfW4P/5P3GY5UZiXDmqUlU8gS0+ofuVprwbxoveNxfkBtvVxVi9XpuK7m4w/DEzPMvEGnhowyhtwbj4PZOkI97KbMSJvZpi0aDkvgA=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:28.344368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=32 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:28.357325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f612126a-1458-4b34-bba1-4eeaf23dd615 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:21:28.363290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f612126a-1458-4b34-bba1-4eeaf23dd615 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for user cdf1867943324a83b94bef9d185e84eb and project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:21:28.391660 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f612126a-1458-4b34-bba1-4eeaf23dd615 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194414 Jul 14 15:21:28.392538 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3366/6696] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:21:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:21:29.769780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1934075440", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d556b15-c13c-4735-a578-3af46588d8d3"}], "security_groups": [{"name": "tempest-securitygroup--1082746555"}], "key_name": "tempest-keypair-1805277302", "user_data": "}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:29.778078 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:29.778728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:29.888618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] validate_networks() for [('3d556b15-c13c-4735-a578-3af46588d8d3', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:21:30.368871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:21:30.369469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:21:30.369959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:21:30.370380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:21:30.370804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:21:30.381523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:30.382093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:30.383012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:30.383556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:30.403267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:21:30.408583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for user cdf1867943324a83b94bef9d185e84eb and project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:21:30.421864 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:21:30.424175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:21:30.472752 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d017fb89-3e69-4a15-a499-2af7307a005a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.707334 Jul 14 15:21:30.473652 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3331/6697] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:21:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:21:30.481895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:30.486594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-326ecc3c-2d7e-4a52-b68f-e3ef7d5a69bb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:30.487266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-326ecc3c-2d7e-4a52-b68f-e3ef7d5a69bb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:30.578564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-326ecc3c-2d7e-4a52-b68f-e3ef7d5a69bb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:30.586409 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-326ecc3c-2d7e-4a52-b68f-e3ef7d5a69bb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1239 microversion: 2.1 time: 0.106055 Jul 14 15:21:30.587383 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3367/6698] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:30 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1239 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:31.606112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-14cbac5d-24a1-47a5-abe0-982c1a03e3c7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:31.606953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-14cbac5d-24a1-47a5-abe0-982c1a03e3c7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:31.615023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14cbac5d-24a1-47a5-abe0-982c1a03e3c7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:31.615712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14cbac5d-24a1-47a5-abe0-982c1a03e3c7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:31.616699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14cbac5d-24a1-47a5-abe0-982c1a03e3c7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:31.617299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14cbac5d-24a1-47a5-abe0-982c1a03e3c7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:31.718356 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-14cbac5d-24a1-47a5-abe0-982c1a03e3c7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:31.730618 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-14cbac5d-24a1-47a5-abe0-982c1a03e3c7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1299 microversion: 2.1 time: 0.129986 Jul 14 15:21:31.740838 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3332/6699] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:31 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:32.748809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1d9951d8-398f-4109-a031-7e6040e9654c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:32.749386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1d9951d8-398f-4109-a031-7e6040e9654c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:32.757213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d9951d8-398f-4109-a031-7e6040e9654c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:32.757694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d9951d8-398f-4109-a031-7e6040e9654c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:32.758484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d9951d8-398f-4109-a031-7e6040e9654c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:32.759627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1d9951d8-398f-4109-a031-7e6040e9654c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:33.265122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1d9951d8-398f-4109-a031-7e6040e9654c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:33.273994 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1d9951d8-398f-4109-a031-7e6040e9654c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1365 microversion: 2.1 time: 0.529830 Jul 14 15:21:33.275461 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3368/6700] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:32 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1365 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:33.495076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-cb458281-828f-4f37-bd1f-22c33adade05 req-9781dcff-c909-4d17-bb95-c88dd97ca967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc", "tag": "7c84b199-9a63-465b-abf5-e15a518a3b94"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:33.515784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cb458281-828f-4f37-bd1f-22c33adade05 req-9781dcff-c909-4d17-bb95-c88dd97ca967 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:33.520820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cb458281-828f-4f37-bd1f-22c33adade05 req-9781dcff-c909-4d17-bb95-c88dd97ca967 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:33.550172 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-cb458281-828f-4f37-bd1f-22c33adade05 req-9781dcff-c909-4d17-bb95-c88dd97ca967 service nova] Creating event network-changed:7c84b199-9a63-465b-abf5-e15a518a3b94 for instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc on n-h2-767704-28 Jul 14 15:21:33.555855 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-cb458281-828f-4f37-bd1f-22c33adade05 req-9781dcff-c909-4d17-bb95-c88dd97ca967 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065415 Jul 14 15:21:33.557536 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3333/6701] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:21:34.292013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-59087642-32d5-4cc3-adc6-0a1ef6cd9dee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:34.292646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-59087642-32d5-4cc3-adc6-0a1ef6cd9dee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:34.299631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59087642-32d5-4cc3-adc6-0a1ef6cd9dee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:34.300101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59087642-32d5-4cc3-adc6-0a1ef6cd9dee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:34.300894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59087642-32d5-4cc3-adc6-0a1ef6cd9dee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:34.301380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-59087642-32d5-4cc3-adc6-0a1ef6cd9dee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:34.438808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-59087642-32d5-4cc3-adc6-0a1ef6cd9dee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:34.447168 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-59087642-32d5-4cc3-adc6-0a1ef6cd9dee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1365 microversion: 2.1 time: 0.159196 Jul 14 15:21:34.447750 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3369/6702] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:34 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:35.465656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bfa30e2e-ea61-4fa3-99a5-16796a676fe6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:35.466373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bfa30e2e-ea61-4fa3-99a5-16796a676fe6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:35.472636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfa30e2e-ea61-4fa3-99a5-16796a676fe6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:35.473136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfa30e2e-ea61-4fa3-99a5-16796a676fe6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:35.473915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfa30e2e-ea61-4fa3-99a5-16796a676fe6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:35.474403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfa30e2e-ea61-4fa3-99a5-16796a676fe6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:35.615463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bfa30e2e-ea61-4fa3-99a5-16796a676fe6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:35.624094 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bfa30e2e-ea61-4fa3-99a5-16796a676fe6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1365 microversion: 2.1 time: 0.164341 Jul 14 15:21:35.624670 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3334/6703] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:35 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:36.642031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab49285a-0bd9-4abf-b7d9-39b1e20a1c54 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:36.642670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ab49285a-0bd9-4abf-b7d9-39b1e20a1c54 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:36.650527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab49285a-0bd9-4abf-b7d9-39b1e20a1c54 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:36.650998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab49285a-0bd9-4abf-b7d9-39b1e20a1c54 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:36.651788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab49285a-0bd9-4abf-b7d9-39b1e20a1c54 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:36.652244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab49285a-0bd9-4abf-b7d9-39b1e20a1c54 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:36.785061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab49285a-0bd9-4abf-b7d9-39b1e20a1c54 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:36.792796 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ab49285a-0bd9-4abf-b7d9-39b1e20a1c54 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1365 microversion: 2.1 time: 0.154708 Jul 14 15:21:36.793408 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3370/6704] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:36 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:37.809661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-474640c8-b225-4a73-9221-c28f736f392a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:37.810276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-474640c8-b225-4a73-9221-c28f736f392a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:37.817468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-474640c8-b225-4a73-9221-c28f736f392a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:37.817924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-474640c8-b225-4a73-9221-c28f736f392a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:37.818693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-474640c8-b225-4a73-9221-c28f736f392a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:37.819135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-474640c8-b225-4a73-9221-c28f736f392a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:37.956035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-474640c8-b225-4a73-9221-c28f736f392a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:37.965622 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-474640c8-b225-4a73-9221-c28f736f392a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1365 microversion: 2.1 time: 0.159778 Jul 14 15:21:37.966232 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3335/6705] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:37 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:38.982380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d32e25ca-be50-4aae-b6ab-e5358294de57 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:38.983006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d32e25ca-be50-4aae-b6ab-e5358294de57 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:38.990387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d32e25ca-be50-4aae-b6ab-e5358294de57 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:38.990870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d32e25ca-be50-4aae-b6ab-e5358294de57 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:38.991673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d32e25ca-be50-4aae-b6ab-e5358294de57 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:38.992193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d32e25ca-be50-4aae-b6ab-e5358294de57 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:39.125413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d32e25ca-be50-4aae-b6ab-e5358294de57 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:39.133300 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d32e25ca-be50-4aae-b6ab-e5358294de57 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1365 microversion: 2.1 time: 0.154863 Jul 14 15:21:39.134602 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3371/6706] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:38 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:40.091224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-57152b92-6327-4bf2-b117-1e12c77e1ba9 req-908c6c4c-85c0-4d02-bc0c-8e11793fc211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc", "name": "network-vif-plugged", "status": "completed", "tag": "7c84b199-9a63-465b-abf5-e15a518a3b94"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:40.100349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-57152b92-6327-4bf2-b117-1e12c77e1ba9 req-908c6c4c-85c0-4d02-bc0c-8e11793fc211 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:40.100815 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-57152b92-6327-4bf2-b117-1e12c77e1ba9 req-908c6c4c-85c0-4d02-bc0c-8e11793fc211 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:40.113646 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-57152b92-6327-4bf2-b117-1e12c77e1ba9 req-908c6c4c-85c0-4d02-bc0c-8e11793fc211 service nova] Creating event network-vif-plugged:7c84b199-9a63-465b-abf5-e15a518a3b94 for instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc on n-h2-767704-28 Jul 14 15:21:40.118712 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-57152b92-6327-4bf2-b117-1e12c77e1ba9 req-908c6c4c-85c0-4d02-bc0c-8e11793fc211 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031906 Jul 14 15:21:40.119548 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3336/6707] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:21:40.153473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f1268a81-3c44-4353-a068-5a85597efb3d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:40.154620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f1268a81-3c44-4353-a068-5a85597efb3d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:40.162353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1268a81-3c44-4353-a068-5a85597efb3d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:40.162826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1268a81-3c44-4353-a068-5a85597efb3d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:40.163626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1268a81-3c44-4353-a068-5a85597efb3d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:40.164085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f1268a81-3c44-4353-a068-5a85597efb3d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:40.354767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f1268a81-3c44-4353-a068-5a85597efb3d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:40.362526 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f1268a81-3c44-4353-a068-5a85597efb3d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1365 microversion: 2.1 time: 0.215308 Jul 14 15:21:40.363089 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3372/6708] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:40 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:41.376088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:41.377134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:41.382739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b51622ef-2ecc-47b1-8c15-8581a19c6d14 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:41.383475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b51622ef-2ecc-47b1-8c15-8581a19c6d14 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:41.390673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b51622ef-2ecc-47b1-8c15-8581a19c6d14 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:41.391126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b51622ef-2ecc-47b1-8c15-8581a19c6d14 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:41.391894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b51622ef-2ecc-47b1-8c15-8581a19c6d14 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:41.392331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b51622ef-2ecc-47b1-8c15-8581a19c6d14 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:41.527089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b51622ef-2ecc-47b1-8c15-8581a19c6d14 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:41.534667 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b51622ef-2ecc-47b1-8c15-8581a19c6d14 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1365 microversion: 2.1 time: 0.159546 Jul 14 15:21:41.535248 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3337/6709] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:41 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:42.552899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e05a8084-2795-4038-8e72-80af0e213fa3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:42.553511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e05a8084-2795-4038-8e72-80af0e213fa3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:42.556011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:42.562818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e05a8084-2795-4038-8e72-80af0e213fa3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:42.563291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e05a8084-2795-4038-8e72-80af0e213fa3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:42.564077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e05a8084-2795-4038-8e72-80af0e213fa3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:42.564528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e05a8084-2795-4038-8e72-80af0e213fa3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:42.702238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e05a8084-2795-4038-8e72-80af0e213fa3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:42.710007 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e05a8084-2795-4038-8e72-80af0e213fa3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1552 microversion: 2.1 time: 0.161120 Jul 14 15:21:42.710640 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3373/6710] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:42 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:42.726512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ceab7160-754f-4566-b43e-e72de2048f2c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:42.727723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ceab7160-754f-4566-b43e-e72de2048f2c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:42.734431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ceab7160-754f-4566-b43e-e72de2048f2c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:42.734884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ceab7160-754f-4566-b43e-e72de2048f2c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:42.735689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ceab7160-754f-4566-b43e-e72de2048f2c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:42.737425 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ceab7160-754f-4566-b43e-e72de2048f2c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:42.820510 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ceab7160-754f-4566-b43e-e72de2048f2c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097918 Jul 14 15:21:42.821859 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3338/6711] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 15:21:42 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:21:43.767390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-197b1fc9-f39a-4e3e-b8fa-d1c91e77d5c3 req-9a543800-aac9-4446-996d-b3b08c98c322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc", "tag": "7c84b199-9a63-465b-abf5-e15a518a3b94"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:43.776616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-197b1fc9-f39a-4e3e-b8fa-d1c91e77d5c3 req-9a543800-aac9-4446-996d-b3b08c98c322 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:43.777146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-197b1fc9-f39a-4e3e-b8fa-d1c91e77d5c3 req-9a543800-aac9-4446-996d-b3b08c98c322 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:43.788861 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-197b1fc9-f39a-4e3e-b8fa-d1c91e77d5c3 req-9a543800-aac9-4446-996d-b3b08c98c322 service nova] Creating event network-changed:7c84b199-9a63-465b-abf5-e15a518a3b94 for instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc on n-h2-767704-28 Jul 14 15:21:43.794867 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-197b1fc9-f39a-4e3e-b8fa-d1c91e77d5c3 req-9a543800-aac9-4446-996d-b3b08c98c322 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031198 Jul 14 15:21:43.795546 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3374/6712] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:20.116455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:20.117284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=34 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:20.121790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e594fb77-f33e-43ed-bd3c-b36463bbdd85 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:20.122407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e594fb77-f33e-43ed-bd3c-b36463bbdd85 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:20.131691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e594fb77-f33e-43ed-bd3c-b36463bbdd85 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:20.132153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e594fb77-f33e-43ed-bd3c-b36463bbdd85 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:20.133904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e594fb77-f33e-43ed-bd3c-b36463bbdd85 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:20.134353 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e594fb77-f33e-43ed-bd3c-b36463bbdd85 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:20.291952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e594fb77-f33e-43ed-bd3c-b36463bbdd85 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:20.300569 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e594fb77-f33e-43ed-bd3c-b36463bbdd85 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1671 microversion: 2.1 time: 0.186008 Jul 14 15:22:20.301204 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3339/6713] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:20 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1671 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:20.318252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f3a992ae-e43b-448f-8a78-a9f1233c2ddf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:20.318990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f3a992ae-e43b-448f-8a78-a9f1233c2ddf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:20.322683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:20.323383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=38 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:20.330485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3a992ae-e43b-448f-8a78-a9f1233c2ddf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:20.330953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3a992ae-e43b-448f-8a78-a9f1233c2ddf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:20.331755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3a992ae-e43b-448f-8a78-a9f1233c2ddf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:20.332217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f3a992ae-e43b-448f-8a78-a9f1233c2ddf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:20.485208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f3a992ae-e43b-448f-8a78-a9f1233c2ddf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:20.493679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f3a992ae-e43b-448f-8a78-a9f1233c2ddf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1671 microversion: 2.1 time: 0.179669 Jul 14 15:22:20.494297 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3375/6714] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:20 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1671 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:20.510980 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e7113ade-e92c-47d2-9b1a-752e148df731 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:20.511625 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e7113ade-e92c-47d2-9b1a-752e148df731 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:20.518553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7113ade-e92c-47d2-9b1a-752e148df731 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:20.519021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7113ade-e92c-47d2-9b1a-752e148df731 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:20.519860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7113ade-e92c-47d2-9b1a-752e148df731 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:20.520308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7113ade-e92c-47d2-9b1a-752e148df731 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:20.670818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e7113ade-e92c-47d2-9b1a-752e148df731 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:20.678832 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e7113ade-e92c-47d2-9b1a-752e148df731 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1671 microversion: 2.1 time: 0.172465 Jul 14 15:22:20.679358 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3340/6715] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:20 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:20.700517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:20.701590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:20.708442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:20.708904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:20.709880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:20.710345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:20.747544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:20.754964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Old instance type m1.heat2, new instance type m1.heat {{(pid=119512) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:22:20.766036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:22:20.766588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:22:20.766993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:22:20.767426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:22:20.767864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:22:20.866861 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ab8a0c12-97d7-44d5-b806-2bf2589e8faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc/action" status: 202 len: 0 microversion: 2.1 time: 0.169986 Jul 14 15:22:20.868600 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3376/6716] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:22:20 2022] POST /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:22:20.878748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-51c3cd39-7585-4f94-a737-ad9a19fee50a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:20.879494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-51c3cd39-7585-4f94-a737-ad9a19fee50a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:20.888212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51c3cd39-7585-4f94-a737-ad9a19fee50a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:20.888686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51c3cd39-7585-4f94-a737-ad9a19fee50a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:20.889514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51c3cd39-7585-4f94-a737-ad9a19fee50a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:20.889955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51c3cd39-7585-4f94-a737-ad9a19fee50a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:21.102434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-51c3cd39-7585-4f94-a737-ad9a19fee50a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:21.114122 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-51c3cd39-7585-4f94-a737-ad9a19fee50a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1680 microversion: 2.1 time: 0.239478 Jul 14 15:22:21.114998 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3341/6717] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:20 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:22.139517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-81bc1568-d5f1-4197-90b5-88650b5f5b5a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:22.142984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-81bc1568-d5f1-4197-90b5-88650b5f5b5a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:22.151136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81bc1568-d5f1-4197-90b5-88650b5f5b5a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:22.151630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81bc1568-d5f1-4197-90b5-88650b5f5b5a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:22.152460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81bc1568-d5f1-4197-90b5-88650b5f5b5a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:22.153076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81bc1568-d5f1-4197-90b5-88650b5f5b5a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:22.308161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-81bc1568-d5f1-4197-90b5-88650b5f5b5a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:22.316131 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-81bc1568-d5f1-4197-90b5-88650b5f5b5a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1680 microversion: 2.1 time: 0.186447 Jul 14 15:22:22.316734 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3377/6718] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:22 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:23.339732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b3a5cf6b-649f-40e4-8b2b-020e87ca1b19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:23.340881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b3a5cf6b-649f-40e4-8b2b-020e87ca1b19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:23.352811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3a5cf6b-649f-40e4-8b2b-020e87ca1b19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:23.353631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3a5cf6b-649f-40e4-8b2b-020e87ca1b19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:23.354978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3a5cf6b-649f-40e4-8b2b-020e87ca1b19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:23.355790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b3a5cf6b-649f-40e4-8b2b-020e87ca1b19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:23.528932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b3a5cf6b-649f-40e4-8b2b-020e87ca1b19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:23.537132 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b3a5cf6b-649f-40e4-8b2b-020e87ca1b19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1685 microversion: 2.1 time: 0.205704 Jul 14 15:22:23.537725 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3342/6719] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:23 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1685 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:24.562870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c0cae1fb-bd1d-4d7a-aa76-74b0db7fe37f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:24.564193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c0cae1fb-bd1d-4d7a-aa76-74b0db7fe37f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:24.571112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0cae1fb-bd1d-4d7a-aa76-74b0db7fe37f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:24.571714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0cae1fb-bd1d-4d7a-aa76-74b0db7fe37f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:24.572542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0cae1fb-bd1d-4d7a-aa76-74b0db7fe37f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:24.573037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0cae1fb-bd1d-4d7a-aa76-74b0db7fe37f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:24.724013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c0cae1fb-bd1d-4d7a-aa76-74b0db7fe37f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:24.732964 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c0cae1fb-bd1d-4d7a-aa76-74b0db7fe37f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1685 microversion: 2.1 time: 0.174294 Jul 14 15:22:24.733577 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3378/6720] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:24 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:25.760922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c255d99b-b3c2-4957-8828-223ab3e2a4ad tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:25.761825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c255d99b-b3c2-4957-8828-223ab3e2a4ad tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:25.769966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c255d99b-b3c2-4957-8828-223ab3e2a4ad tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:25.770439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c255d99b-b3c2-4957-8828-223ab3e2a4ad tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:25.771326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c255d99b-b3c2-4957-8828-223ab3e2a4ad tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:25.771816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c255d99b-b3c2-4957-8828-223ab3e2a4ad tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:25.919376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c255d99b-b3c2-4957-8828-223ab3e2a4ad tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:25.927289 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c255d99b-b3c2-4957-8828-223ab3e2a4ad tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1685 microversion: 2.1 time: 0.171378 Jul 14 15:22:25.927895 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3343/6721] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:25 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:26.947418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-32511986-fe1b-4f5d-b85a-363a29a358af tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:26.948089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-32511986-fe1b-4f5d-b85a-363a29a358af tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:26.955487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32511986-fe1b-4f5d-b85a-363a29a358af tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:26.955968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32511986-fe1b-4f5d-b85a-363a29a358af tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:26.956864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32511986-fe1b-4f5d-b85a-363a29a358af tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:26.957813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-32511986-fe1b-4f5d-b85a-363a29a358af tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:27.111533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-32511986-fe1b-4f5d-b85a-363a29a358af tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:27.120039 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-32511986-fe1b-4f5d-b85a-363a29a358af tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1685 microversion: 2.1 time: 0.178156 Jul 14 15:22:27.120647 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3379/6722] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:26 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:28.138650 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f38c228-8098-4003-b344-75883f6f9e06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:28.139212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8f38c228-8098-4003-b344-75883f6f9e06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:28.146640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f38c228-8098-4003-b344-75883f6f9e06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:28.147101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f38c228-8098-4003-b344-75883f6f9e06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:28.147889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f38c228-8098-4003-b344-75883f6f9e06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:28.148992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f38c228-8098-4003-b344-75883f6f9e06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:28.294695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f38c228-8098-4003-b344-75883f6f9e06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:28.303155 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8f38c228-8098-4003-b344-75883f6f9e06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1685 microversion: 2.1 time: 0.168549 Jul 14 15:22:28.303798 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3344/6723] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:28 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:29.321159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bb626cfc-44df-4c48-9dfc-7af00a53f6d0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:29.321789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bb626cfc-44df-4c48-9dfc-7af00a53f6d0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:29.328757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb626cfc-44df-4c48-9dfc-7af00a53f6d0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:29.329250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb626cfc-44df-4c48-9dfc-7af00a53f6d0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:29.330039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb626cfc-44df-4c48-9dfc-7af00a53f6d0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:29.330494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bb626cfc-44df-4c48-9dfc-7af00a53f6d0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:29.482442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bb626cfc-44df-4c48-9dfc-7af00a53f6d0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:29.490742 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bb626cfc-44df-4c48-9dfc-7af00a53f6d0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1685 microversion: 2.1 time: 0.173616 Jul 14 15:22:29.491336 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3380/6724] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:29 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:30.509178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-de75501d-6cb3-4f26-acfb-d8a004d74a2b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:30.510009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-de75501d-6cb3-4f26-acfb-d8a004d74a2b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:30.517194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de75501d-6cb3-4f26-acfb-d8a004d74a2b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:30.517652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de75501d-6cb3-4f26-acfb-d8a004d74a2b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:30.518440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de75501d-6cb3-4f26-acfb-d8a004d74a2b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:30.518883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de75501d-6cb3-4f26-acfb-d8a004d74a2b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:30.657258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-de75501d-6cb3-4f26-acfb-d8a004d74a2b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:30.664900 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-de75501d-6cb3-4f26-acfb-d8a004d74a2b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1685 microversion: 2.1 time: 0.160307 Jul 14 15:22:30.665503 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3345/6725] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:30 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:31.683339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0de4dffa-6e4b-4259-a477-0f1096e45763 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:31.683973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0de4dffa-6e4b-4259-a477-0f1096e45763 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:31.690854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0de4dffa-6e4b-4259-a477-0f1096e45763 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:31.691314 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0de4dffa-6e4b-4259-a477-0f1096e45763 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:31.692106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0de4dffa-6e4b-4259-a477-0f1096e45763 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:31.692560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0de4dffa-6e4b-4259-a477-0f1096e45763 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:31.848457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0de4dffa-6e4b-4259-a477-0f1096e45763 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:31.857275 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0de4dffa-6e4b-4259-a477-0f1096e45763 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1685 microversion: 2.1 time: 0.178771 Jul 14 15:22:31.857891 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3381/6726] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:31 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:32.874586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6e8ca0bf-a618-4d87-8189-3a30331e4664 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:32.875215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6e8ca0bf-a618-4d87-8189-3a30331e4664 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:32.882442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e8ca0bf-a618-4d87-8189-3a30331e4664 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:32.883395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e8ca0bf-a618-4d87-8189-3a30331e4664 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:32.884185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e8ca0bf-a618-4d87-8189-3a30331e4664 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:32.884641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e8ca0bf-a618-4d87-8189-3a30331e4664 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:33.016928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6e8ca0bf-a618-4d87-8189-3a30331e4664 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:33.025251 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6e8ca0bf-a618-4d87-8189-3a30331e4664 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1685 microversion: 2.1 time: 0.154575 Jul 14 15:22:33.025828 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3346/6727] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:32 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:34.043350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3869d11e-3abd-47b3-8d4e-f09b5a1ba223 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:34.044397 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3869d11e-3abd-47b3-8d4e-f09b5a1ba223 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:34.051488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3869d11e-3abd-47b3-8d4e-f09b5a1ba223 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:34.051957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3869d11e-3abd-47b3-8d4e-f09b5a1ba223 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:34.052763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3869d11e-3abd-47b3-8d4e-f09b5a1ba223 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:34.053260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3869d11e-3abd-47b3-8d4e-f09b5a1ba223 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:34.460296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3869d11e-3abd-47b3-8d4e-f09b5a1ba223 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:34.468814 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3869d11e-3abd-47b3-8d4e-f09b5a1ba223 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1685 microversion: 2.1 time: 0.430108 Jul 14 15:22:34.469456 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3382/6728] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:34 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1685 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:35.487223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6a5cfb4b-6ac4-476b-8766-2c9669f579b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:35.487848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6a5cfb4b-6ac4-476b-8766-2c9669f579b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:35.496433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a5cfb4b-6ac4-476b-8766-2c9669f579b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:35.496894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a5cfb4b-6ac4-476b-8766-2c9669f579b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:35.497717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a5cfb4b-6ac4-476b-8766-2c9669f579b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:35.498169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a5cfb4b-6ac4-476b-8766-2c9669f579b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:35.688263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6a5cfb4b-6ac4-476b-8766-2c9669f579b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:35.696159 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6a5cfb4b-6ac4-476b-8766-2c9669f579b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1685 microversion: 2.1 time: 0.212842 Jul 14 15:22:35.696782 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3347/6729] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:35 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1685 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:36.335309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-219a79f6-8684-40fd-82fb-379d5e29d37c req-dad44f39-a5c1-4843-9c66-c9a79365d5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc", "name": "network-vif-unplugged", "status": "completed", "tag": "7c84b199-9a63-465b-abf5-e15a518a3b94"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:36.346347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-219a79f6-8684-40fd-82fb-379d5e29d37c req-dad44f39-a5c1-4843-9c66-c9a79365d5b1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:36.346872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-219a79f6-8684-40fd-82fb-379d5e29d37c req-dad44f39-a5c1-4843-9c66-c9a79365d5b1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:36.361097 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-219a79f6-8684-40fd-82fb-379d5e29d37c req-dad44f39-a5c1-4843-9c66-c9a79365d5b1 service nova] Creating event network-vif-unplugged:7c84b199-9a63-465b-abf5-e15a518a3b94 for instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc on n-h1-767704-28 Jul 14 15:22:36.367325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-219a79f6-8684-40fd-82fb-379d5e29d37c req-dad44f39-a5c1-4843-9c66-c9a79365d5b1 service nova] Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:22:36.379562 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-219a79f6-8684-40fd-82fb-379d5e29d37c req-dad44f39-a5c1-4843-9c66-c9a79365d5b1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048064 Jul 14 15:22:36.380193 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3383/6730] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:36.717949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-14804fa3-cb67-4183-95a2-1af6bc8f2b06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:36.719576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-14804fa3-cb67-4183-95a2-1af6bc8f2b06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:36.730695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14804fa3-cb67-4183-95a2-1af6bc8f2b06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:36.731161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14804fa3-cb67-4183-95a2-1af6bc8f2b06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:36.732922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14804fa3-cb67-4183-95a2-1af6bc8f2b06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:36.733414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-14804fa3-cb67-4183-95a2-1af6bc8f2b06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:37.039883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-14804fa3-cb67-4183-95a2-1af6bc8f2b06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:37.048864 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-14804fa3-cb67-4183-95a2-1af6bc8f2b06 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1684 microversion: 2.1 time: 0.338342 Jul 14 15:22:37.049555 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3348/6731] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:36 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1684 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:38.073241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-78efb84a-61d3-4fb1-b614-87566ac89666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:38.073950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-78efb84a-61d3-4fb1-b614-87566ac89666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:38.080398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78efb84a-61d3-4fb1-b614-87566ac89666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.080869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78efb84a-61d3-4fb1-b614-87566ac89666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.081695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78efb84a-61d3-4fb1-b614-87566ac89666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.082158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-78efb84a-61d3-4fb1-b614-87566ac89666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.225228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-78efb84a-61d3-4fb1-b614-87566ac89666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:38.233909 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-78efb84a-61d3-4fb1-b614-87566ac89666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1682 microversion: 2.1 time: 0.166605 Jul 14 15:22:38.234503 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3384/6732] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:38 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:38.404219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-54321264-e7e7-4696-948b-a283148b38b9 req-5f1582b9-a576-44f6-99f3-80f26d5a84fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc", "tag": "7c84b199-9a63-465b-abf5-e15a518a3b94"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:38.415274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-54321264-e7e7-4696-948b-a283148b38b9 req-5f1582b9-a576-44f6-99f3-80f26d5a84fd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.415730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-54321264-e7e7-4696-948b-a283148b38b9 req-5f1582b9-a576-44f6-99f3-80f26d5a84fd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.428079 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-54321264-e7e7-4696-948b-a283148b38b9 req-5f1582b9-a576-44f6-99f3-80f26d5a84fd service nova] Creating event network-changed:7c84b199-9a63-465b-abf5-e15a518a3b94 for instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc on n-h1-767704-28 Jul 14 15:22:38.434348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-54321264-e7e7-4696-948b-a283148b38b9 req-5f1582b9-a576-44f6-99f3-80f26d5a84fd service nova] Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:22:38.446442 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-54321264-e7e7-4696-948b-a283148b38b9 req-5f1582b9-a576-44f6-99f3-80f26d5a84fd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046381 Jul 14 15:22:38.447073 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3349/6733] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:39.253277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f6ca09af-2767-45d9-96e9-4a5e5469dd74 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:39.253930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f6ca09af-2767-45d9-96e9-4a5e5469dd74 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:39.262267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6ca09af-2767-45d9-96e9-4a5e5469dd74 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:39.262760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6ca09af-2767-45d9-96e9-4a5e5469dd74 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:39.263544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6ca09af-2767-45d9-96e9-4a5e5469dd74 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:39.264013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6ca09af-2767-45d9-96e9-4a5e5469dd74 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:39.460052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6ca09af-2767-45d9-96e9-4a5e5469dd74 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:39.468835 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f6ca09af-2767-45d9-96e9-4a5e5469dd74 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1682 microversion: 2.1 time: 0.219990 Jul 14 15:22:39.469472 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3385/6734] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:39 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:40.488572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-63c58eaa-0655-4e79-bd64-a33d1f42880c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:40.489238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-63c58eaa-0655-4e79-bd64-a33d1f42880c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:40.496888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-63c58eaa-0655-4e79-bd64-a33d1f42880c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:40.497394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-63c58eaa-0655-4e79-bd64-a33d1f42880c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:40.498173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-63c58eaa-0655-4e79-bd64-a33d1f42880c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:40.498620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-63c58eaa-0655-4e79-bd64-a33d1f42880c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:40.660876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-63c58eaa-0655-4e79-bd64-a33d1f42880c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:40.674861 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-63c58eaa-0655-4e79-bd64-a33d1f42880c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1679 microversion: 2.1 time: 0.191334 Jul 14 15:22:40.675896 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3350/6735] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:40 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:40.693637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4da8551e-efa8-4cbd-ac9d-de42f73afb0a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:40.694289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4da8551e-efa8-4cbd-ac9d-de42f73afb0a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:40.702707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4da8551e-efa8-4cbd-ac9d-de42f73afb0a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:40.703181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4da8551e-efa8-4cbd-ac9d-de42f73afb0a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:40.703991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4da8551e-efa8-4cbd-ac9d-de42f73afb0a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:40.704456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4da8551e-efa8-4cbd-ac9d-de42f73afb0a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:40.775788 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4da8551e-efa8-4cbd-ac9d-de42f73afb0a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc/action" status: 204 len: 0 microversion: 2.1 time: 0.086025 Jul 14 15:22:40.777121 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3386/6736] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:22:40 2022] POST /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:22:40.787987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b23f2bf2-44d2-4f96-ad18-66761eb177b4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:40.788931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b23f2bf2-44d2-4f96-ad18-66761eb177b4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:40.796518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b23f2bf2-44d2-4f96-ad18-66761eb177b4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:40.797104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b23f2bf2-44d2-4f96-ad18-66761eb177b4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:40.799483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b23f2bf2-44d2-4f96-ad18-66761eb177b4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:40.800401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b23f2bf2-44d2-4f96-ad18-66761eb177b4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:41.031711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b23f2bf2-44d2-4f96-ad18-66761eb177b4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:41.039868 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b23f2bf2-44d2-4f96-ad18-66761eb177b4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1679 microversion: 2.1 time: 0.257667 Jul 14 15:22:41.040462 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3351/6737] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:40 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1679 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:42.059164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3e213d04-3b8d-490e-a17b-90c554951000 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:42.059915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3e213d04-3b8d-490e-a17b-90c554951000 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:42.067771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e213d04-3b8d-490e-a17b-90c554951000 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.068366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e213d04-3b8d-490e-a17b-90c554951000 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.069222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e213d04-3b8d-490e-a17b-90c554951000 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.069691 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e213d04-3b8d-490e-a17b-90c554951000 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.224868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3e213d04-3b8d-490e-a17b-90c554951000 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:42.234182 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3e213d04-3b8d-490e-a17b-90c554951000 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1671 microversion: 2.1 time: 0.180918 Jul 14 15:22:42.234803 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3387/6738] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:42 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1671 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:42.252709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9d23478e-51be-4821-8a3f-66c184b133ac tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:42.253453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9d23478e-51be-4821-8a3f-66c184b133ac tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:42.261418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d23478e-51be-4821-8a3f-66c184b133ac tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.261883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d23478e-51be-4821-8a3f-66c184b133ac tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.262679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d23478e-51be-4821-8a3f-66c184b133ac tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.263126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9d23478e-51be-4821-8a3f-66c184b133ac tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.402938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9d23478e-51be-4821-8a3f-66c184b133ac tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:42.410665 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9d23478e-51be-4821-8a3f-66c184b133ac tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1671 microversion: 2.1 time: 0.162319 Jul 14 15:22:42.411241 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3352/6739] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:42 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:42.427210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7580af96-d7eb-48a9-9d79-56328068ccaa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:42.427766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7580af96-d7eb-48a9-9d79-56328068ccaa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:42.435550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7580af96-d7eb-48a9-9d79-56328068ccaa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.435910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7580af96-d7eb-48a9-9d79-56328068ccaa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.436701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7580af96-d7eb-48a9-9d79-56328068ccaa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.437195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7580af96-d7eb-48a9-9d79-56328068ccaa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.583359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7580af96-d7eb-48a9-9d79-56328068ccaa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:42.594596 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7580af96-d7eb-48a9-9d79-56328068ccaa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1671 microversion: 2.1 time: 0.169897 Jul 14 15:22:42.594596 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3388/6740] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:42 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:42.610105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fbe55cbf-b3b6-4b3a-895f-8d0b83d795bc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:42.610603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fbe55cbf-b3b6-4b3a-895f-8d0b83d795bc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:42.617249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbe55cbf-b3b6-4b3a-895f-8d0b83d795bc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.617772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbe55cbf-b3b6-4b3a-895f-8d0b83d795bc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.618941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbe55cbf-b3b6-4b3a-895f-8d0b83d795bc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.619107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbe55cbf-b3b6-4b3a-895f-8d0b83d795bc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.652204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fbe55cbf-b3b6-4b3a-895f-8d0b83d795bc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:22:42.738788 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fbe55cbf-b3b6-4b3a-895f-8d0b83d795bc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 204 len: 0 microversion: 2.1 time: 0.132318 Jul 14 15:22:42.739537 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3353/6741] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:22:42 2022] DELETE /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:42.760405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-73580f0c-6567-4c7d-af27-8ed52012dc99 req-7b1f99f0-64e4-4860-9d93-7e33fbc94e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc", "name": "network-vif-plugged", "status": "completed", "tag": "7c84b199-9a63-465b-abf5-e15a518a3b94"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:42.767784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d8e6aa68-1c63-4d56-9a6f-ee0ca282bca6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:42.770335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d8e6aa68-1c63-4d56-9a6f-ee0ca282bca6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:42.771295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-73580f0c-6567-4c7d-af27-8ed52012dc99 req-7b1f99f0-64e4-4860-9d93-7e33fbc94e1f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.772001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-73580f0c-6567-4c7d-af27-8ed52012dc99 req-7b1f99f0-64e4-4860-9d93-7e33fbc94e1f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.782348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8e6aa68-1c63-4d56-9a6f-ee0ca282bca6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.782820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8e6aa68-1c63-4d56-9a6f-ee0ca282bca6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.784647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:42.787237 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-73580f0c-6567-4c7d-af27-8ed52012dc99 req-7b1f99f0-64e4-4860-9d93-7e33fbc94e1f service nova] Creating event network-vif-plugged:7c84b199-9a63-465b-abf5-e15a518a3b94 for instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc on n-h1-767704-28 Jul 14 15:22:42.787802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8e6aa68-1c63-4d56-9a6f-ee0ca282bca6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.788344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d8e6aa68-1c63-4d56-9a6f-ee0ca282bca6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.795812 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-73580f0c-6567-4c7d-af27-8ed52012dc99 req-7b1f99f0-64e4-4860-9d93-7e33fbc94e1f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040082 Jul 14 15:22:42.795812 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3354/6742] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:42.809204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:42.937705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d8e6aa68-1c63-4d56-9a6f-ee0ca282bca6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:42.951099 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d8e6aa68-1c63-4d56-9a6f-ee0ca282bca6 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1677 microversion: 2.1 time: 0.199045 Jul 14 15:22:42.952323 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3389/6743] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:42 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1677 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:43.973129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b0e32a88-8560-4dcc-b1e4-f120be540692 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:43.973865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b0e32a88-8560-4dcc-b1e4-f120be540692 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:43.982080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0e32a88-8560-4dcc-b1e4-f120be540692 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:43.982544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0e32a88-8560-4dcc-b1e4-f120be540692 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:43.983340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0e32a88-8560-4dcc-b1e4-f120be540692 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:43.983780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0e32a88-8560-4dcc-b1e4-f120be540692 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:44.133610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b0e32a88-8560-4dcc-b1e4-f120be540692 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:44.142118 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b0e32a88-8560-4dcc-b1e4-f120be540692 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1677 microversion: 2.1 time: 0.174906 Jul 14 15:22:44.142810 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3355/6744] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:43 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:45.161602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1be344ab-51fb-425a-9660-ddb981c2e3fe tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:45.162470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1be344ab-51fb-425a-9660-ddb981c2e3fe tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:45.178969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1be344ab-51fb-425a-9660-ddb981c2e3fe tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:45.179951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1be344ab-51fb-425a-9660-ddb981c2e3fe tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:45.180766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1be344ab-51fb-425a-9660-ddb981c2e3fe tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:45.181249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1be344ab-51fb-425a-9660-ddb981c2e3fe tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:45.577819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1be344ab-51fb-425a-9660-ddb981c2e3fe tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:45.587826 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1be344ab-51fb-425a-9660-ddb981c2e3fe tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 200 len: 1677 microversion: 2.1 time: 0.430145 Jul 14 15:22:45.588426 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3390/6745] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:45 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 1677 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:45.972174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-befe1ba8-a036-4998-bd18-1d7ee08ae91d req-7dbd07cb-c112-4a05-b375-832793592410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc", "name": "network-vif-deleted", "tag": "7c84b199-9a63-465b-abf5-e15a518a3b94"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:45.989923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-befe1ba8-a036-4998-bd18-1d7ee08ae91d req-7dbd07cb-c112-4a05-b375-832793592410 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:45.990490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-befe1ba8-a036-4998-bd18-1d7ee08ae91d req-7dbd07cb-c112-4a05-b375-832793592410 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:46.007406 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-befe1ba8-a036-4998-bd18-1d7ee08ae91d req-7dbd07cb-c112-4a05-b375-832793592410 service nova] Creating event network-vif-deleted:7c84b199-9a63-465b-abf5-e15a518a3b94 for instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc on n-h1-767704-28 Jul 14 15:22:46.013329 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-befe1ba8-a036-4998-bd18-1d7ee08ae91d req-7dbd07cb-c112-4a05-b375-832793592410 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044925 Jul 14 15:22:46.014042 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3356/6746] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:46.606388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a264aa9-c97b-47d9-8285-a065d942c482 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:46.607080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2a264aa9-c97b-47d9-8285-a065d942c482 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:46.615540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a264aa9-c97b-47d9-8285-a065d942c482 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:46.616070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a264aa9-c97b-47d9-8285-a065d942c482 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:46.617930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a264aa9-c97b-47d9-8285-a065d942c482 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:46.618477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a264aa9-c97b-47d9-8285-a065d942c482 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:46.634886 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-2a264aa9-c97b-47d9-8285-a065d942c482 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a264aa9-c97b-47d9-8285-a065d942c482 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc HTTP/1.1 Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc'} Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:46.636641 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:22:46.640371 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:46.640371 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:46.640371 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:46.640371 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:22:46.640371 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:22:46.640371 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:22:46.640371 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:22:46.640371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a264aa9-c97b-47d9-8285-a065d942c482 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:22:46.640371 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a264aa9-c97b-47d9-8285-a065d942c482 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 404 len: 111 microversion: 2.1 time: 0.035939 Jul 14 15:22:46.640371 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3391/6747] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:46 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:22:46.651472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-675efef3-c1fd-449e-986f-338bd2c21438 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:46.652201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-675efef3-c1fd-449e-986f-338bd2c21438 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:46.658924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-675efef3-c1fd-449e-986f-338bd2c21438 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:46.659470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-675efef3-c1fd-449e-986f-338bd2c21438 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:46.660199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-675efef3-c1fd-449e-986f-338bd2c21438 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:46.660653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-675efef3-c1fd-449e-986f-338bd2c21438 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:46.675637 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-675efef3-c1fd-449e-986f-338bd2c21438 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-675efef3-c1fd-449e-986f-338bd2c21438 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc HTTP/1.1 Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc'} Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:46.677323 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:22:46.681419 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:46.681419 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:46.681419 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:46.681419 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:22:46.681419 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:22:46.681419 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:22:46.681419 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:22:46.681419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-675efef3-c1fd-449e-986f-338bd2c21438 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:22:46.681419 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-675efef3-c1fd-449e-986f-338bd2c21438 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 404 len: 111 microversion: 2.1 time: 0.031950 Jul 14 15:22:46.681419 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3357/6748] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:46 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:22:46.737121 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-861484717", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "3d556b15-c13c-4735-a578-3af46588d8d3"}], "security_groups": [{"name": "tempest-securitygroup--1082746555"}], "key_name": "tempest-keypair-1805277302", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:46.851543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] validate_networks() for [('3d556b15-c13c-4735-a578-3af46588d8d3', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:22:47.253351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:22:47.253816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:22:47.254308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:22:47.254729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:22:47.255154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:22:47.265645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:47.266115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:47.266941 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:47.267396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:47.286791 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:22:47.293361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for user cdf1867943324a83b94bef9d185e84eb and project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:22:47.306872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:22:47.309205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:22:47.356359 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4aeacade-d5a3-48e4-ad54-a216c3133faf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.623236 Jul 14 15:22:47.357037 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3392/6749] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:22:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:22:47.369027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cc5cbf35-2373-4ba4-b183-0c923aeae58f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:47.370344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cc5cbf35-2373-4ba4-b183-0c923aeae58f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:47.435399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cc5cbf35-2373-4ba4-b183-0c923aeae58f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:47.443727 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cc5cbf35-2373-4ba4-b183-0c923aeae58f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1238 microversion: 2.1 time: 0.080324 Jul 14 15:22:47.444298 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3358/6750] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:47 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:48.468755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5e74c458-458d-4240-9df1-a535d20d78aa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:48.469960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5e74c458-458d-4240-9df1-a535d20d78aa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:48.482702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e74c458-458d-4240-9df1-a535d20d78aa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:48.483527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e74c458-458d-4240-9df1-a535d20d78aa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:48.484902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e74c458-458d-4240-9df1-a535d20d78aa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:48.485751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e74c458-458d-4240-9df1-a535d20d78aa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:48.591776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5e74c458-458d-4240-9df1-a535d20d78aa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:48.599826 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5e74c458-458d-4240-9df1-a535d20d78aa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1308 microversion: 2.1 time: 0.140157 Jul 14 15:22:48.600467 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3393/6751] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:48 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:49.621578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-016a6b37-e729-493f-802c-0b0a7a320501 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:49.622653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-016a6b37-e729-493f-802c-0b0a7a320501 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:49.635478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-016a6b37-e729-493f-802c-0b0a7a320501 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:49.636276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-016a6b37-e729-493f-802c-0b0a7a320501 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:49.637611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-016a6b37-e729-493f-802c-0b0a7a320501 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:49.638294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-016a6b37-e729-493f-802c-0b0a7a320501 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:49.862195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-016a6b37-e729-493f-802c-0b0a7a320501 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:49.870369 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-016a6b37-e729-493f-802c-0b0a7a320501 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1364 microversion: 2.1 time: 0.256411 Jul 14 15:22:49.870960 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3359/6752] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:49 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:50.189293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-69bf9a3d-6626-46b1-a650-890c1e3e5f3f req-5989d5aa-830a-4e7c-9e2f-b146c1313d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0682cc-00fc-42b7-bce6-865c2088f72b", "tag": "c82cf88b-248e-4e22-9df1-a410f48013e2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:50.205978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-69bf9a3d-6626-46b1-a650-890c1e3e5f3f req-5989d5aa-830a-4e7c-9e2f-b146c1313d96 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:50.206713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-69bf9a3d-6626-46b1-a650-890c1e3e5f3f req-5989d5aa-830a-4e7c-9e2f-b146c1313d96 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:50.233796 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-69bf9a3d-6626-46b1-a650-890c1e3e5f3f req-5989d5aa-830a-4e7c-9e2f-b146c1313d96 service nova] Creating event network-changed:c82cf88b-248e-4e22-9df1-a410f48013e2 for instance 6c0682cc-00fc-42b7-bce6-865c2088f72b on n-h2-767704-28 Jul 14 15:22:50.240183 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-69bf9a3d-6626-46b1-a650-890c1e3e5f3f req-5989d5aa-830a-4e7c-9e2f-b146c1313d96 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061326 Jul 14 15:22:50.241175 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3394/6753] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:50.889209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8c658e82-fc52-429a-8d90-bd02160ec567 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:50.889748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8c658e82-fc52-429a-8d90-bd02160ec567 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:50.892679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:50.902751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c658e82-fc52-429a-8d90-bd02160ec567 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:50.902751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c658e82-fc52-429a-8d90-bd02160ec567 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:50.902751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c658e82-fc52-429a-8d90-bd02160ec567 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:50.902751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8c658e82-fc52-429a-8d90-bd02160ec567 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:51.034398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8c658e82-fc52-429a-8d90-bd02160ec567 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:51.042167 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8c658e82-fc52-429a-8d90-bd02160ec567 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1364 microversion: 2.1 time: 0.157193 Jul 14 15:22:51.042753 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3360/6754] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:50 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:52.060565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a10ad97f-1bc8-49a9-8369-4cf4ef32e169 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:52.061261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a10ad97f-1bc8-49a9-8369-4cf4ef32e169 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:52.064401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:52.068630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a10ad97f-1bc8-49a9-8369-4cf4ef32e169 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:52.069141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a10ad97f-1bc8-49a9-8369-4cf4ef32e169 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:52.070135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a10ad97f-1bc8-49a9-8369-4cf4ef32e169 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:52.070725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a10ad97f-1bc8-49a9-8369-4cf4ef32e169 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:52.283692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a10ad97f-1bc8-49a9-8369-4cf4ef32e169 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:52.292540 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a10ad97f-1bc8-49a9-8369-4cf4ef32e169 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1364 microversion: 2.1 time: 0.237320 Jul 14 15:22:52.293164 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3395/6755] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:52 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:53.310957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-943aef0b-b20c-4eac-ae22-c9284f785b6a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:53.311572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-943aef0b-b20c-4eac-ae22-c9284f785b6a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:53.319154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-943aef0b-b20c-4eac-ae22-c9284f785b6a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:53.320799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-943aef0b-b20c-4eac-ae22-c9284f785b6a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:53.321475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-943aef0b-b20c-4eac-ae22-c9284f785b6a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:53.322133 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-943aef0b-b20c-4eac-ae22-c9284f785b6a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:53.463461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-943aef0b-b20c-4eac-ae22-c9284f785b6a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:53.472048 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-943aef0b-b20c-4eac-ae22-c9284f785b6a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1364 microversion: 2.1 time: 0.165013 Jul 14 15:22:53.472609 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3361/6756] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:53 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:54.489582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8bbae3e5-1fe8-4946-bcff-1101283c576d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:54.490224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8bbae3e5-1fe8-4946-bcff-1101283c576d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:54.499458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bbae3e5-1fe8-4946-bcff-1101283c576d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:54.499995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bbae3e5-1fe8-4946-bcff-1101283c576d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:54.501013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bbae3e5-1fe8-4946-bcff-1101283c576d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:54.501582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bbae3e5-1fe8-4946-bcff-1101283c576d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:54.642626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8bbae3e5-1fe8-4946-bcff-1101283c576d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:54.650230 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8bbae3e5-1fe8-4946-bcff-1101283c576d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1364 microversion: 2.1 time: 0.164642 Jul 14 15:22:54.650802 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3396/6757] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:54 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:55.668134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2835d2ed-1ef1-4112-98ae-3b496846571b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:55.668781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2835d2ed-1ef1-4112-98ae-3b496846571b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:55.675602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2835d2ed-1ef1-4112-98ae-3b496846571b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:55.676056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2835d2ed-1ef1-4112-98ae-3b496846571b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:55.676829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2835d2ed-1ef1-4112-98ae-3b496846571b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:55.677286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2835d2ed-1ef1-4112-98ae-3b496846571b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:55.809081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2835d2ed-1ef1-4112-98ae-3b496846571b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:55.816782 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2835d2ed-1ef1-4112-98ae-3b496846571b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1364 microversion: 2.1 time: 0.153313 Jul 14 15:22:55.817384 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3362/6758] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:55 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:56.494464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-2525f5ee-66fd-4b23-a4a9-06679218c948 req-4b68ecbf-5724-4e57-bae6-39d439f75a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0682cc-00fc-42b7-bce6-865c2088f72b", "name": "network-vif-plugged", "status": "completed", "tag": "c82cf88b-248e-4e22-9df1-a410f48013e2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:56.504993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2525f5ee-66fd-4b23-a4a9-06679218c948 req-4b68ecbf-5724-4e57-bae6-39d439f75a92 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:56.505482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-2525f5ee-66fd-4b23-a4a9-06679218c948 req-4b68ecbf-5724-4e57-bae6-39d439f75a92 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:56.518607 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-2525f5ee-66fd-4b23-a4a9-06679218c948 req-4b68ecbf-5724-4e57-bae6-39d439f75a92 service nova] Creating event network-vif-plugged:c82cf88b-248e-4e22-9df1-a410f48013e2 for instance 6c0682cc-00fc-42b7-bce6-865c2088f72b on n-h2-767704-28 Jul 14 15:22:56.524408 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-2525f5ee-66fd-4b23-a4a9-06679218c948 req-4b68ecbf-5724-4e57-bae6-39d439f75a92 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034710 Jul 14 15:22:56.525207 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3397/6759] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:22:56.834487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4db48451-206d-42d4-bf50-830639bb862d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:56.835139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4db48451-206d-42d4-bf50-830639bb862d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:56.842309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4db48451-206d-42d4-bf50-830639bb862d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:56.842777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4db48451-206d-42d4-bf50-830639bb862d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:56.843554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4db48451-206d-42d4-bf50-830639bb862d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:56.844005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4db48451-206d-42d4-bf50-830639bb862d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:56.980805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4db48451-206d-42d4-bf50-830639bb862d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:56.988353 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4db48451-206d-42d4-bf50-830639bb862d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1364 microversion: 2.1 time: 0.157811 Jul 14 15:22:56.988925 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3363/6760] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:56 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:58.010126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-570c15a2-2332-4bbb-8c75-710a3a0d2a44 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:58.010777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-570c15a2-2332-4bbb-8c75-710a3a0d2a44 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:58.012855 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:58.013573 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:58.021063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-570c15a2-2332-4bbb-8c75-710a3a0d2a44 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:58.021536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-570c15a2-2332-4bbb-8c75-710a3a0d2a44 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:58.022336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-570c15a2-2332-4bbb-8c75-710a3a0d2a44 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:58.023313 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-570c15a2-2332-4bbb-8c75-710a3a0d2a44 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:58.154863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-570c15a2-2332-4bbb-8c75-710a3a0d2a44 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:58.162476 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-570c15a2-2332-4bbb-8c75-710a3a0d2a44 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1551 microversion: 2.1 time: 0.158343 Jul 14 15:22:58.163050 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3398/6761] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:58 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:58.179326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-31f11f8b-8df5-4c6c-a0d9-9608790810d4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:58.179869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-31f11f8b-8df5-4c6c-a0d9-9608790810d4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:58.181746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:58.188123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-31f11f8b-8df5-4c6c-a0d9-9608790810d4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:58.188588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-31f11f8b-8df5-4c6c-a0d9-9608790810d4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:58.189405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-31f11f8b-8df5-4c6c-a0d9-9608790810d4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:58.189858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-31f11f8b-8df5-4c6c-a0d9-9608790810d4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:58.270156 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-31f11f8b-8df5-4c6c-a0d9-9608790810d4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094817 Jul 14 15:22:58.270758 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3364/6762] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 15:22:58 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:59.520730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-919b6660-5256-4d8a-81ab-12a919d217db req-25f1a04a-ac8b-4427-857a-d75349981146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0682cc-00fc-42b7-bce6-865c2088f72b", "tag": "c82cf88b-248e-4e22-9df1-a410f48013e2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:59.530528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-919b6660-5256-4d8a-81ab-12a919d217db req-25f1a04a-ac8b-4427-857a-d75349981146 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:59.530993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-919b6660-5256-4d8a-81ab-12a919d217db req-25f1a04a-ac8b-4427-857a-d75349981146 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:59.542897 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-919b6660-5256-4d8a-81ab-12a919d217db req-25f1a04a-ac8b-4427-857a-d75349981146 service nova] Creating event network-changed:c82cf88b-248e-4e22-9df1-a410f48013e2 for instance 6c0682cc-00fc-42b7-bce6-865c2088f72b on n-h2-767704-28 Jul 14 15:22:59.547869 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-919b6660-5256-4d8a-81ab-12a919d217db req-25f1a04a-ac8b-4427-857a-d75349981146 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030930 Jul 14 15:22:59.548502 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3399/6763] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:23:32.045814 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:23:32.046394 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 15:23:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:23:39.994416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=9 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:39.995237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=44 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:39.999622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-beac407b-c916-46e8-b8ac-a2d948fd3ef7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:23:40.006877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-beac407b-c916-46e8-b8ac-a2d948fd3ef7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:40.007346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-beac407b-c916-46e8-b8ac-a2d948fd3ef7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:40.031016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-beac407b-c916-46e8-b8ac-a2d948fd3ef7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Going to try to stop instance {{(pid=119511) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 15:23:40.074444 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-beac407b-c916-46e8-b8ac-a2d948fd3ef7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b/action" status: 202 len: 0 microversion: 2.1 time: 0.082385 Jul 14 15:23:40.075056 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3365/6764] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:23:39 2022] POST /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:23:40.081944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=9 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:40.083031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=43 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:40.087956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-97dcb67a-a8ae-44a0-9d1e-5a5c55c21274 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:40.088931 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-97dcb67a-a8ae-44a0-9d1e-5a5c55c21274 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:40.096648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97dcb67a-a8ae-44a0-9d1e-5a5c55c21274 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:40.097129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97dcb67a-a8ae-44a0-9d1e-5a5c55c21274 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:40.097918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97dcb67a-a8ae-44a0-9d1e-5a5c55c21274 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:40.098382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97dcb67a-a8ae-44a0-9d1e-5a5c55c21274 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:40.409367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-97dcb67a-a8ae-44a0-9d1e-5a5c55c21274 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:40.417097 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-97dcb67a-a8ae-44a0-9d1e-5a5c55c21274 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.337367 Jul 14 15:23:40.417678 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3400/6765] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:40 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:41.437300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7297f454-d704-481f-a6a4-0a3b5d56a3bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:41.438023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7297f454-d704-481f-a6a4-0a3b5d56a3bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:41.444339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7297f454-d704-481f-a6a4-0a3b5d56a3bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:41.444806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7297f454-d704-481f-a6a4-0a3b5d56a3bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:41.445613 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7297f454-d704-481f-a6a4-0a3b5d56a3bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:41.446059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7297f454-d704-481f-a6a4-0a3b5d56a3bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:41.705572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7297f454-d704-481f-a6a4-0a3b5d56a3bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:41.713622 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7297f454-d704-481f-a6a4-0a3b5d56a3bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.282611 Jul 14 15:23:41.714222 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3366/6766] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:41 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:42.731489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0d6b54c0-7f41-41f0-8856-9fccf7217d19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:42.732162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0d6b54c0-7f41-41f0-8856-9fccf7217d19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:42.740804 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d6b54c0-7f41-41f0-8856-9fccf7217d19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:42.741360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d6b54c0-7f41-41f0-8856-9fccf7217d19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:42.742367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d6b54c0-7f41-41f0-8856-9fccf7217d19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:42.742887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0d6b54c0-7f41-41f0-8856-9fccf7217d19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:42.879796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0d6b54c0-7f41-41f0-8856-9fccf7217d19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:42.888279 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0d6b54c0-7f41-41f0-8856-9fccf7217d19 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.160930 Jul 14 15:23:42.888859 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3401/6767] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:42 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:43.907184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-71385417-3459-4e4a-a309-ad40077dfabc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:43.908131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-71385417-3459-4e4a-a309-ad40077dfabc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:43.917179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71385417-3459-4e4a-a309-ad40077dfabc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:43.917648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71385417-3459-4e4a-a309-ad40077dfabc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:43.918454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71385417-3459-4e4a-a309-ad40077dfabc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:43.918921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71385417-3459-4e4a-a309-ad40077dfabc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:44.057297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-71385417-3459-4e4a-a309-ad40077dfabc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:44.064985 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-71385417-3459-4e4a-a309-ad40077dfabc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.162762 Jul 14 15:23:44.065644 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3367/6768] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:43 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:45.083199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e49e279b-353f-4d99-8603-f239dbeca52f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:45.083856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e49e279b-353f-4d99-8603-f239dbeca52f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:45.091018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e49e279b-353f-4d99-8603-f239dbeca52f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:45.091503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e49e279b-353f-4d99-8603-f239dbeca52f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:45.092310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e49e279b-353f-4d99-8603-f239dbeca52f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:45.092769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e49e279b-353f-4d99-8603-f239dbeca52f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:45.228493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e49e279b-353f-4d99-8603-f239dbeca52f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:45.236119 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e49e279b-353f-4d99-8603-f239dbeca52f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.156954 Jul 14 15:23:45.236695 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3402/6769] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:45 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:46.256069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b7bc6077-77a7-40dd-89ef-309eb9c54590 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:46.256694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b7bc6077-77a7-40dd-89ef-309eb9c54590 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:46.263993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7bc6077-77a7-40dd-89ef-309eb9c54590 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:46.264459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7bc6077-77a7-40dd-89ef-309eb9c54590 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:46.265293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7bc6077-77a7-40dd-89ef-309eb9c54590 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:46.265738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b7bc6077-77a7-40dd-89ef-309eb9c54590 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:46.404821 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b7bc6077-77a7-40dd-89ef-309eb9c54590 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:46.412525 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b7bc6077-77a7-40dd-89ef-309eb9c54590 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.160720 Jul 14 15:23:46.413140 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3368/6770] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:46 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:47.430697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-449c6cb0-426c-4262-a44d-434ba18daabb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:47.432509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-449c6cb0-426c-4262-a44d-434ba18daabb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:47.439614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-449c6cb0-426c-4262-a44d-434ba18daabb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:47.440084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-449c6cb0-426c-4262-a44d-434ba18daabb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:47.440906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-449c6cb0-426c-4262-a44d-434ba18daabb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:47.441391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-449c6cb0-426c-4262-a44d-434ba18daabb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:47.586653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-449c6cb0-426c-4262-a44d-434ba18daabb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:47.595450 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-449c6cb0-426c-4262-a44d-434ba18daabb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.168776 Jul 14 15:23:47.596042 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3403/6771] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:47 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:48.613811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c9fad011-886c-4db7-8c6b-2875d7c1102a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:48.614428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c9fad011-886c-4db7-8c6b-2875d7c1102a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:48.622710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9fad011-886c-4db7-8c6b-2875d7c1102a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:48.623171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9fad011-886c-4db7-8c6b-2875d7c1102a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:48.623951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9fad011-886c-4db7-8c6b-2875d7c1102a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:48.624395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c9fad011-886c-4db7-8c6b-2875d7c1102a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:48.761451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c9fad011-886c-4db7-8c6b-2875d7c1102a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:48.769463 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c9fad011-886c-4db7-8c6b-2875d7c1102a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.159637 Jul 14 15:23:48.770039 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3369/6772] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:48 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:49.786903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d14be639-d5f8-4dfa-a30d-fcae1c0ddc63 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:49.787522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d14be639-d5f8-4dfa-a30d-fcae1c0ddc63 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:49.794639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d14be639-d5f8-4dfa-a30d-fcae1c0ddc63 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:49.795101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d14be639-d5f8-4dfa-a30d-fcae1c0ddc63 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:49.795880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d14be639-d5f8-4dfa-a30d-fcae1c0ddc63 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:49.796326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d14be639-d5f8-4dfa-a30d-fcae1c0ddc63 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:49.930209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d14be639-d5f8-4dfa-a30d-fcae1c0ddc63 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:49.938321 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d14be639-d5f8-4dfa-a30d-fcae1c0ddc63 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.155364 Jul 14 15:23:49.938916 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3404/6773] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:49 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:50.955124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-78d10840-d261-44b3-9f61-9a3c9bd395be tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:50.955749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-78d10840-d261-44b3-9f61-9a3c9bd395be tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:50.963056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78d10840-d261-44b3-9f61-9a3c9bd395be tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:50.963826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78d10840-d261-44b3-9f61-9a3c9bd395be tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:50.964732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78d10840-d261-44b3-9f61-9a3c9bd395be tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:50.965215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78d10840-d261-44b3-9f61-9a3c9bd395be tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:51.099443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-78d10840-d261-44b3-9f61-9a3c9bd395be tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:51.107595 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-78d10840-d261-44b3-9f61-9a3c9bd395be tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.156439 Jul 14 15:23:51.108174 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3370/6774] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:50 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:52.125285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f86c57b4-ee2b-4498-9b7a-09a88c228d78 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:52.125920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f86c57b4-ee2b-4498-9b7a-09a88c228d78 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:52.133417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f86c57b4-ee2b-4498-9b7a-09a88c228d78 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:52.133891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f86c57b4-ee2b-4498-9b7a-09a88c228d78 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:52.134866 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f86c57b4-ee2b-4498-9b7a-09a88c228d78 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:52.135916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f86c57b4-ee2b-4498-9b7a-09a88c228d78 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:52.267556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f86c57b4-ee2b-4498-9b7a-09a88c228d78 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:52.275651 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f86c57b4-ee2b-4498-9b7a-09a88c228d78 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.154287 Jul 14 15:23:52.276381 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3405/6775] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:52 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:53.293689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e3d4a6cd-f530-4f07-aa09-39d38aa312b3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:53.294337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e3d4a6cd-f530-4f07-aa09-39d38aa312b3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:53.301379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3d4a6cd-f530-4f07-aa09-39d38aa312b3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:53.301838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3d4a6cd-f530-4f07-aa09-39d38aa312b3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:53.302618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3d4a6cd-f530-4f07-aa09-39d38aa312b3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:53.303064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e3d4a6cd-f530-4f07-aa09-39d38aa312b3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:53.446893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e3d4a6cd-f530-4f07-aa09-39d38aa312b3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:53.456180 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e3d4a6cd-f530-4f07-aa09-39d38aa312b3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.166778 Jul 14 15:23:53.456785 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3371/6776] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:53 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:54.474026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31c8c50f-6c4f-4b9b-91d9-e5bc228d8b8c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:54.474697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-31c8c50f-6c4f-4b9b-91d9-e5bc228d8b8c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:54.482325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31c8c50f-6c4f-4b9b-91d9-e5bc228d8b8c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:54.482788 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31c8c50f-6c4f-4b9b-91d9-e5bc228d8b8c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:54.483565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31c8c50f-6c4f-4b9b-91d9-e5bc228d8b8c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:54.484012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31c8c50f-6c4f-4b9b-91d9-e5bc228d8b8c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:54.622473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-31c8c50f-6c4f-4b9b-91d9-e5bc228d8b8c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:54.630602 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-31c8c50f-6c4f-4b9b-91d9-e5bc228d8b8c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.160465 Jul 14 15:23:54.631183 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3406/6777] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:54 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:55.648091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6b9cb8cd-81f7-47ba-aeb7-e662bb6cc0a2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:55.648701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6b9cb8cd-81f7-47ba-aeb7-e662bb6cc0a2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:55.655824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b9cb8cd-81f7-47ba-aeb7-e662bb6cc0a2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:55.656284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b9cb8cd-81f7-47ba-aeb7-e662bb6cc0a2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:55.657102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b9cb8cd-81f7-47ba-aeb7-e662bb6cc0a2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:55.657551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6b9cb8cd-81f7-47ba-aeb7-e662bb6cc0a2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:55.790126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6b9cb8cd-81f7-47ba-aeb7-e662bb6cc0a2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:55.798564 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6b9cb8cd-81f7-47ba-aeb7-e662bb6cc0a2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1657 microversion: 2.1 time: 0.154663 Jul 14 15:23:55.799143 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3372/6778] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:55 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:55.815346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:23:55.816342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:55.824301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:55.824785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:55.825604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:55.826068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:55.855900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:55.861839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Old instance type m1.heat2, new instance type m1.heat {{(pid=119512) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:23:55.868071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:23:55.868512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:23:55.869045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:23:55.869473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:23:55.870103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:23:55.940643 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b2100450-2823-4185-a964-26f615042b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b/action" status: 202 len: 0 microversion: 2.1 time: 0.129093 Jul 14 15:23:55.941325 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3407/6779] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:23:55 2022] POST /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:23:55.950371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a7ae48c6-c7da-4b99-9c45-2118bad0aa80 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:55.951083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a7ae48c6-c7da-4b99-9c45-2118bad0aa80 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:55.957884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7ae48c6-c7da-4b99-9c45-2118bad0aa80 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:55.958340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7ae48c6-c7da-4b99-9c45-2118bad0aa80 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:55.959127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7ae48c6-c7da-4b99-9c45-2118bad0aa80 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:55.959564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7ae48c6-c7da-4b99-9c45-2118bad0aa80 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:56.134693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a7ae48c6-c7da-4b99-9c45-2118bad0aa80 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:56.143534 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a7ae48c6-c7da-4b99-9c45-2118bad0aa80 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.197965 Jul 14 15:23:56.144116 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3373/6780] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:55 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:57.161724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-66bc47fa-bc5d-4803-aa50-02163d9ea762 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:57.162279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-66bc47fa-bc5d-4803-aa50-02163d9ea762 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:57.170672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66bc47fa-bc5d-4803-aa50-02163d9ea762 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:57.171148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66bc47fa-bc5d-4803-aa50-02163d9ea762 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:57.171950 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66bc47fa-bc5d-4803-aa50-02163d9ea762 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:57.172408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66bc47fa-bc5d-4803-aa50-02163d9ea762 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:57.310807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-66bc47fa-bc5d-4803-aa50-02163d9ea762 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:57.318621 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-66bc47fa-bc5d-4803-aa50-02163d9ea762 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1680 microversion: 2.1 time: 0.161080 Jul 14 15:23:57.319190 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3408/6781] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:57 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:58.335724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c4479b61-1f7b-4902-8acd-eb23a67aab94 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:58.336343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c4479b61-1f7b-4902-8acd-eb23a67aab94 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:58.344281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4479b61-1f7b-4902-8acd-eb23a67aab94 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:58.344736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4479b61-1f7b-4902-8acd-eb23a67aab94 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:58.345555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4479b61-1f7b-4902-8acd-eb23a67aab94 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:58.346030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4479b61-1f7b-4902-8acd-eb23a67aab94 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:58.489035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c4479b61-1f7b-4902-8acd-eb23a67aab94 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:58.497210 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c4479b61-1f7b-4902-8acd-eb23a67aab94 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1685 microversion: 2.1 time: 0.165377 Jul 14 15:23:58.497799 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3374/6782] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:58 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:59.515352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8bfad92a-b476-412c-8a00-a7c566879516 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:59.516018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8bfad92a-b476-412c-8a00-a7c566879516 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:59.523239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bfad92a-b476-412c-8a00-a7c566879516 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:59.523712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bfad92a-b476-412c-8a00-a7c566879516 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:59.524497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bfad92a-b476-412c-8a00-a7c566879516 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:59.524968 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8bfad92a-b476-412c-8a00-a7c566879516 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:59.656700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8bfad92a-b476-412c-8a00-a7c566879516 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:59.664367 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8bfad92a-b476-412c-8a00-a7c566879516 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1685 microversion: 2.1 time: 0.154025 Jul 14 15:23:59.664962 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3409/6783] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:59 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:00.683385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fda56562-fe6d-4497-88de-ab7a40761e62 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:00.684077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fda56562-fe6d-4497-88de-ab7a40761e62 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:00.690277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fda56562-fe6d-4497-88de-ab7a40761e62 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:00.690733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fda56562-fe6d-4497-88de-ab7a40761e62 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:00.691503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fda56562-fe6d-4497-88de-ab7a40761e62 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:00.691946 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fda56562-fe6d-4497-88de-ab7a40761e62 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:00.891157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fda56562-fe6d-4497-88de-ab7a40761e62 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:00.898996 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fda56562-fe6d-4497-88de-ab7a40761e62 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1684 microversion: 2.1 time: 0.221342 Jul 14 15:24:00.899811 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3375/6784] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:00 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1684 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:00.923936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-7a67596d-ef7b-400f-a730-4d7984206117 req-37b81342-3d2b-4482-af63-c35fab4c8f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0682cc-00fc-42b7-bce6-865c2088f72b", "name": "network-vif-unplugged", "status": "completed", "tag": "c82cf88b-248e-4e22-9df1-a410f48013e2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:00.934253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7a67596d-ef7b-400f-a730-4d7984206117 req-37b81342-3d2b-4482-af63-c35fab4c8f15 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:00.934586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7a67596d-ef7b-400f-a730-4d7984206117 req-37b81342-3d2b-4482-af63-c35fab4c8f15 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:00.947182 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-7a67596d-ef7b-400f-a730-4d7984206117 req-37b81342-3d2b-4482-af63-c35fab4c8f15 service nova] Creating event network-vif-unplugged:c82cf88b-248e-4e22-9df1-a410f48013e2 for instance 6c0682cc-00fc-42b7-bce6-865c2088f72b on n-h1-767704-28 Jul 14 15:24:00.953706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-7a67596d-ef7b-400f-a730-4d7984206117 req-37b81342-3d2b-4482-af63-c35fab4c8f15 service nova] Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:24:00.966171 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-7a67596d-ef7b-400f-a730-4d7984206117 req-37b81342-3d2b-4482-af63-c35fab4c8f15 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046043 Jul 14 15:24:00.967272 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3410/6785] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:24:01.915947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d65a7965-9db1-4f7a-9034-927d6d25f2c1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:01.917647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d65a7965-9db1-4f7a-9034-927d6d25f2c1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:01.925422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d65a7965-9db1-4f7a-9034-927d6d25f2c1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:01.925891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d65a7965-9db1-4f7a-9034-927d6d25f2c1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:01.926718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d65a7965-9db1-4f7a-9034-927d6d25f2c1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:01.927177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d65a7965-9db1-4f7a-9034-927d6d25f2c1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:02.096286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d65a7965-9db1-4f7a-9034-927d6d25f2c1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:02.106113 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d65a7965-9db1-4f7a-9034-927d6d25f2c1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1684 microversion: 2.1 time: 0.194133 Jul 14 15:24:02.118818 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3376/6786] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:01 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1684 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:02.983624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0e2bf910-54a6-4061-9c4e-762e9da0039d req-2ff0c8c9-93fb-4dbd-8ccd-02903d1241ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0682cc-00fc-42b7-bce6-865c2088f72b", "tag": "c82cf88b-248e-4e22-9df1-a410f48013e2"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:02.992103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0e2bf910-54a6-4061-9c4e-762e9da0039d req-2ff0c8c9-93fb-4dbd-8ccd-02903d1241ee service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:02.992564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0e2bf910-54a6-4061-9c4e-762e9da0039d req-2ff0c8c9-93fb-4dbd-8ccd-02903d1241ee service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:03.004857 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0e2bf910-54a6-4061-9c4e-762e9da0039d req-2ff0c8c9-93fb-4dbd-8ccd-02903d1241ee service nova] Creating event network-changed:c82cf88b-248e-4e22-9df1-a410f48013e2 for instance 6c0682cc-00fc-42b7-bce6-865c2088f72b on n-h1-767704-28 Jul 14 15:24:03.010904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-0e2bf910-54a6-4061-9c4e-762e9da0039d req-2ff0c8c9-93fb-4dbd-8ccd-02903d1241ee service nova] Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:24:03.021655 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0e2bf910-54a6-4061-9c4e-762e9da0039d req-2ff0c8c9-93fb-4dbd-8ccd-02903d1241ee service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043244 Jul 14 15:24:03.022260 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3411/6787] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:24:03.125229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-db1866f6-e43f-430b-a3bf-352e9b617053 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:03.125858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-db1866f6-e43f-430b-a3bf-352e9b617053 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:03.133171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db1866f6-e43f-430b-a3bf-352e9b617053 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:03.133690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db1866f6-e43f-430b-a3bf-352e9b617053 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:03.134474 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db1866f6-e43f-430b-a3bf-352e9b617053 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:03.134927 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-db1866f6-e43f-430b-a3bf-352e9b617053 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:03.342033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-db1866f6-e43f-430b-a3bf-352e9b617053 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:03.350301 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-db1866f6-e43f-430b-a3bf-352e9b617053 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1682 microversion: 2.1 time: 0.228974 Jul 14 15:24:03.350892 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3377/6788] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:03 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:24:04.369215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-82358187-eab8-46e7-9258-eac556ac1de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:04.369997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-82358187-eab8-46e7-9258-eac556ac1de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:04.376628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82358187-eab8-46e7-9258-eac556ac1de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:04.377153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82358187-eab8-46e7-9258-eac556ac1de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:04.378216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82358187-eab8-46e7-9258-eac556ac1de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:04.378729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-82358187-eab8-46e7-9258-eac556ac1de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:04.609967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-82358187-eab8-46e7-9258-eac556ac1de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:04.618272 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-82358187-eab8-46e7-9258-eac556ac1de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1678 microversion: 2.1 time: 0.254208 Jul 14 15:24:04.618858 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3412/6789] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:04 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:04.635866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f8fe6011-61f5-401f-85d8-11279fee0c11 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:04.636430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f8fe6011-61f5-401f-85d8-11279fee0c11 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:04.643546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8fe6011-61f5-401f-85d8-11279fee0c11 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:04.643998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8fe6011-61f5-401f-85d8-11279fee0c11 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:04.644791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8fe6011-61f5-401f-85d8-11279fee0c11 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:04.645245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f8fe6011-61f5-401f-85d8-11279fee0c11 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:04.710371 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f8fe6011-61f5-401f-85d8-11279fee0c11 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b/action" status: 204 len: 0 microversion: 2.1 time: 0.078391 Jul 14 15:24:04.711072 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3378/6790] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:24:04 2022] POST /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:04.719801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8887796e-e72d-4926-8b74-b4540f8e164e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:04.720438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8887796e-e72d-4926-8b74-b4540f8e164e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:04.728229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8887796e-e72d-4926-8b74-b4540f8e164e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:04.728734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8887796e-e72d-4926-8b74-b4540f8e164e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:04.730973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8887796e-e72d-4926-8b74-b4540f8e164e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:04.731460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8887796e-e72d-4926-8b74-b4540f8e164e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:04.955636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8887796e-e72d-4926-8b74-b4540f8e164e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:04.977059 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8887796e-e72d-4926-8b74-b4540f8e164e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1678 microversion: 2.1 time: 0.261039 Jul 14 15:24:04.978039 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3413/6791] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:04 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:05.996661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5cc8d3b8-3f42-448c-8c50-e3133a15a728 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:05.997796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5cc8d3b8-3f42-448c-8c50-e3133a15a728 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:06.007298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5cc8d3b8-3f42-448c-8c50-e3133a15a728 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:06.007942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5cc8d3b8-3f42-448c-8c50-e3133a15a728 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:06.009197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5cc8d3b8-3f42-448c-8c50-e3133a15a728 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:06.009665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5cc8d3b8-3f42-448c-8c50-e3133a15a728 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:06.029752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:06.167919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5cc8d3b8-3f42-448c-8c50-e3133a15a728 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:06.176968 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5cc8d3b8-3f42-448c-8c50-e3133a15a728 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1657 microversion: 2.1 time: 0.184844 Jul 14 15:24:06.177621 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3379/6792] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:05 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1657 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:06.194355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c210ff69-feeb-4826-b24d-3d6ba54ab74a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:06.194982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c210ff69-feeb-4826-b24d-3d6ba54ab74a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:06.203177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c210ff69-feeb-4826-b24d-3d6ba54ab74a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:06.203744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c210ff69-feeb-4826-b24d-3d6ba54ab74a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:06.204794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c210ff69-feeb-4826-b24d-3d6ba54ab74a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:06.205262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c210ff69-feeb-4826-b24d-3d6ba54ab74a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:06.339528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c210ff69-feeb-4826-b24d-3d6ba54ab74a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:06.349916 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c210ff69-feeb-4826-b24d-3d6ba54ab74a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1657 microversion: 2.1 time: 0.159337 Jul 14 15:24:06.350678 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3414/6793] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:06 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:06.366540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2c1bf71b-6fef-40a4-b0e6-c2e735dba57e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:06.373575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c1bf71b-6fef-40a4-b0e6-c2e735dba57e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:06.374037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2c1bf71b-6fef-40a4-b0e6-c2e735dba57e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:06.396456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2c1bf71b-6fef-40a4-b0e6-c2e735dba57e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Going to try to start instance {{(pid=119511) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 15:24:06.439645 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2c1bf71b-6fef-40a4-b0e6-c2e735dba57e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b/action" status: 202 len: 0 microversion: 2.1 time: 0.076772 Jul 14 15:24:06.440234 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3380/6794] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:24:06 2022] POST /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:24:06.448720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b8c047d-9ca6-4424-a33b-159f6216a16b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:06.449402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5b8c047d-9ca6-4424-a33b-159f6216a16b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:06.456699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b8c047d-9ca6-4424-a33b-159f6216a16b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:06.457187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b8c047d-9ca6-4424-a33b-159f6216a16b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:06.457991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b8c047d-9ca6-4424-a33b-159f6216a16b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:06.458454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b8c047d-9ca6-4424-a33b-159f6216a16b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:06.635963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5b8c047d-9ca6-4424-a33b-159f6216a16b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:06.639724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:06.644827 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b8c047d-9ca6-4424-a33b-159f6216a16b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1666 microversion: 2.1 time: 0.200064 Jul 14 15:24:06.645462 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3415/6795] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:06 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1666 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:07.154386 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1df2ed2f-715a-4a34-8460-ded66ab294f5 req-91170e0e-1ad5-4544-a1e4-7bf8e21e45e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0682cc-00fc-42b7-bce6-865c2088f72b", "name": "network-vif-plugged", "status": "completed", "tag": "c82cf88b-248e-4e22-9df1-a410f48013e2"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:07.163154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1df2ed2f-715a-4a34-8460-ded66ab294f5 req-91170e0e-1ad5-4544-a1e4-7bf8e21e45e8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:07.163600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1df2ed2f-715a-4a34-8460-ded66ab294f5 req-91170e0e-1ad5-4544-a1e4-7bf8e21e45e8 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:07.175449 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1df2ed2f-715a-4a34-8460-ded66ab294f5 req-91170e0e-1ad5-4544-a1e4-7bf8e21e45e8 service nova] Creating event network-vif-plugged:c82cf88b-248e-4e22-9df1-a410f48013e2 for instance 6c0682cc-00fc-42b7-bce6-865c2088f72b on n-h1-767704-28 Jul 14 15:24:07.180451 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1df2ed2f-715a-4a34-8460-ded66ab294f5 req-91170e0e-1ad5-4544-a1e4-7bf8e21e45e8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094460 Jul 14 15:24:07.181071 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3381/6796] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:24:07.664999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-50f7ac38-1dc9-4846-960b-8b9de90134d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:07.665624 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-50f7ac38-1dc9-4846-960b-8b9de90134d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:07.674667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50f7ac38-1dc9-4846-960b-8b9de90134d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:07.675403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50f7ac38-1dc9-4846-960b-8b9de90134d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:07.676209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50f7ac38-1dc9-4846-960b-8b9de90134d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:07.676663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-50f7ac38-1dc9-4846-960b-8b9de90134d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:07.814598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-50f7ac38-1dc9-4846-960b-8b9de90134d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:07.822337 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-50f7ac38-1dc9-4846-960b-8b9de90134d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1670 microversion: 2.1 time: 0.162018 Jul 14 15:24:07.823830 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3416/6797] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:07 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:07.845912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed596d59-9b31-4cef-9340-3678397d4aaf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:07.846512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ed596d59-9b31-4cef-9340-3678397d4aaf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:07.853059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed596d59-9b31-4cef-9340-3678397d4aaf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:07.853523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed596d59-9b31-4cef-9340-3678397d4aaf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:07.860724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed596d59-9b31-4cef-9340-3678397d4aaf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:07.861223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed596d59-9b31-4cef-9340-3678397d4aaf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:07.888220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ed596d59-9b31-4cef-9340-3678397d4aaf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:24:07.973370 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed596d59-9b31-4cef-9340-3678397d4aaf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 204 len: 0 microversion: 2.1 time: 0.131384 Jul 14 15:24:07.974059 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3382/6798] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:24:07 2022] DELETE /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:07.983224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3e6d9f3c-161e-4e7e-abd2-003ac555e226 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:07.983872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3e6d9f3c-161e-4e7e-abd2-003ac555e226 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:07.991489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e6d9f3c-161e-4e7e-abd2-003ac555e226 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:07.991967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e6d9f3c-161e-4e7e-abd2-003ac555e226 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:07.992783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e6d9f3c-161e-4e7e-abd2-003ac555e226 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:07.993269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3e6d9f3c-161e-4e7e-abd2-003ac555e226 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:08.124534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3e6d9f3c-161e-4e7e-abd2-003ac555e226 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:08.132604 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3e6d9f3c-161e-4e7e-abd2-003ac555e226 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1676 microversion: 2.1 time: 0.153861 Jul 14 15:24:08.133228 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3417/6799] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:07 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:09.151263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9600c24f-dda5-4d93-afb0-affcfbf8a28a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:09.151971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9600c24f-dda5-4d93-afb0-affcfbf8a28a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:09.159018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9600c24f-dda5-4d93-afb0-affcfbf8a28a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:09.159420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9600c24f-dda5-4d93-afb0-affcfbf8a28a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:09.160192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9600c24f-dda5-4d93-afb0-affcfbf8a28a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:09.160635 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9600c24f-dda5-4d93-afb0-affcfbf8a28a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:09.297718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9600c24f-dda5-4d93-afb0-affcfbf8a28a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:09.305505 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9600c24f-dda5-4d93-afb0-affcfbf8a28a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1676 microversion: 2.1 time: 0.158661 Jul 14 15:24:09.306094 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3383/6800] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:09 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:10.322693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cf437c28-a049-42ec-b5ab-087b410d125f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:10.323487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cf437c28-a049-42ec-b5ab-087b410d125f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:10.326753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=41 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:10.332918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf437c28-a049-42ec-b5ab-087b410d125f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:10.333424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf437c28-a049-42ec-b5ab-087b410d125f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:10.334224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf437c28-a049-42ec-b5ab-087b410d125f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:10.334712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cf437c28-a049-42ec-b5ab-087b410d125f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:10.562406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cf437c28-a049-42ec-b5ab-087b410d125f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:10.571198 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cf437c28-a049-42ec-b5ab-087b410d125f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 200 len: 1676 microversion: 2.1 time: 0.252454 Jul 14 15:24:10.571913 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3418/6801] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:10 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 1676 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:10.803996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1496d3f4-9ac7-4be5-b75a-8255942af745 req-8249a64c-0883-4497-8fdb-3be5986dec14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0682cc-00fc-42b7-bce6-865c2088f72b", "name": "network-vif-deleted", "tag": "c82cf88b-248e-4e22-9df1-a410f48013e2"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:10.808748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:10.815168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1496d3f4-9ac7-4be5-b75a-8255942af745 req-8249a64c-0883-4497-8fdb-3be5986dec14 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:10.815616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1496d3f4-9ac7-4be5-b75a-8255942af745 req-8249a64c-0883-4497-8fdb-3be5986dec14 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:10.828722 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1496d3f4-9ac7-4be5-b75a-8255942af745 req-8249a64c-0883-4497-8fdb-3be5986dec14 service nova] Creating event network-vif-deleted:c82cf88b-248e-4e22-9df1-a410f48013e2 for instance 6c0682cc-00fc-42b7-bce6-865c2088f72b on n-h1-767704-28 Jul 14 15:24:10.834057 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1496d3f4-9ac7-4be5-b75a-8255942af745 req-8249a64c-0883-4497-8fdb-3be5986dec14 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033647 Jul 14 15:24:10.834731 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3384/6802] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:24:11.589440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bde0b830-152b-4ac2-8cd7-08db009ec895 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:11.590067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bde0b830-152b-4ac2-8cd7-08db009ec895 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:11.598072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bde0b830-152b-4ac2-8cd7-08db009ec895 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:11.598549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bde0b830-152b-4ac2-8cd7-08db009ec895 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:11.599363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bde0b830-152b-4ac2-8cd7-08db009ec895 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:11.599830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bde0b830-152b-4ac2-8cd7-08db009ec895 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:11.615231 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-bde0b830-152b-4ac2-8cd7-08db009ec895 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bde0b830-152b-4ac2-8cd7-08db009ec895 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b HTTP/1.1 Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6c0682cc-00fc-42b7-bce6-865c2088f72b'} Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:24:11.617188 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:24:11.620789 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:24:11.620789 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:24:11.620789 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:24:11.620789 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:24:11.620789 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:24:11.620789 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:24:11.620789 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:24:11.620789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bde0b830-152b-4ac2-8cd7-08db009ec895 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:24:11.620789 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bde0b830-152b-4ac2-8cd7-08db009ec895 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 404 len: 111 microversion: 2.1 time: 0.034108 Jul 14 15:24:11.620789 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3419/6803] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:11 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:24:11.639708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-532aa193-2a48-4252-ac59-74a56ec4c204 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:11.640433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-532aa193-2a48-4252-ac59-74a56ec4c204 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:11.647935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-532aa193-2a48-4252-ac59-74a56ec4c204 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:11.647935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-532aa193-2a48-4252-ac59-74a56ec4c204 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:11.648672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-532aa193-2a48-4252-ac59-74a56ec4c204 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:11.649152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-532aa193-2a48-4252-ac59-74a56ec4c204 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:11.665277 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-532aa193-2a48-4252-ac59-74a56ec4c204 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-532aa193-2a48-4252-ac59-74a56ec4c204 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b HTTP/1.1 Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6c0682cc-00fc-42b7-bce6-865c2088f72b'} Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:24:11.667569 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:24:11.672481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:24:11.672481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:24:11.672481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:24:11.672481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:24:11.672481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:24:11.672481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:24:11.672481 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:24:11.672481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-532aa193-2a48-4252-ac59-74a56ec4c204 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:24:11.672481 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-532aa193-2a48-4252-ac59-74a56ec4c204 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 404 len: 111 microversion: 2.1 time: 0.035061 Jul 14 15:24:11.672481 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3385/6804] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:11 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:24:11.718403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-95473202", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "3d556b15-c13c-4735-a578-3af46588d8d3"}], "security_groups": [{"name": "tempest-securitygroup--1082746555"}], "key_name": "tempest-keypair-1805277302", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:11.825910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] validate_networks() for [('3d556b15-c13c-4735-a578-3af46588d8d3', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:24:12.255090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:24:12.255525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:24:12.256036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:24:12.256454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:24:12.256875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:24:12.268247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:12.268737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:12.269575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:12.270056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:12.288898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:24:12.295180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for user cdf1867943324a83b94bef9d185e84eb and project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:24:12.308045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:24:12.310381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:24:12.355905 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ffa6663a-6d22-4f6c-ae71-217a1af030e0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.641460 Jul 14 15:24:12.356734 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3420/6805] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:24:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:24:12.366644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d153950-6496-4afb-8a6c-c63cc7e5e3cc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:12.367393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6d153950-6496-4afb-8a6c-c63cc7e5e3cc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:12.429593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6d153950-6496-4afb-8a6c-c63cc7e5e3cc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:12.437970 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6d153950-6496-4afb-8a6c-c63cc7e5e3cc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1237 microversion: 2.1 time: 0.075136 Jul 14 15:24:12.438598 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3386/6806] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:12 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:13.458979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-adc699c3-acc8-4921-bd51-cccf95eedb0b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:13.459627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-adc699c3-acc8-4921-bd51-cccf95eedb0b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:13.467118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-adc699c3-acc8-4921-bd51-cccf95eedb0b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:13.467711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-adc699c3-acc8-4921-bd51-cccf95eedb0b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:13.468589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-adc699c3-acc8-4921-bd51-cccf95eedb0b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:13.469169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-adc699c3-acc8-4921-bd51-cccf95eedb0b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:13.543637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-adc699c3-acc8-4921-bd51-cccf95eedb0b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:13.553292 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-adc699c3-acc8-4921-bd51-cccf95eedb0b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1297 microversion: 2.1 time: 0.101149 Jul 14 15:24:13.554123 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3421/6807] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:13 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:14.571863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fbb3613e-ea41-4fac-ac7b-90c8866a6639 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:14.573018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fbb3613e-ea41-4fac-ac7b-90c8866a6639 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:14.581361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbb3613e-ea41-4fac-ac7b-90c8866a6639 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:14.581824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbb3613e-ea41-4fac-ac7b-90c8866a6639 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:14.582612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbb3613e-ea41-4fac-ac7b-90c8866a6639 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:14.583063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbb3613e-ea41-4fac-ac7b-90c8866a6639 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:14.814088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fbb3613e-ea41-4fac-ac7b-90c8866a6639 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:14.830788 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fbb3613e-ea41-4fac-ac7b-90c8866a6639 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1363 microversion: 2.1 time: 0.261810 Jul 14 15:24:14.837293 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3387/6808] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:14 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:15.050825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e09b9c9a-69e9-4a86-a20a-40b8fed6267a req-1ff25b8a-7d41-4214-8c4a-121bedc930c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb05a4f3-116b-4937-bf8c-41bfba922fd7", "tag": "ef38b2e5-d93c-440b-b10a-83942a85aa83"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:15.071491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e09b9c9a-69e9-4a86-a20a-40b8fed6267a req-1ff25b8a-7d41-4214-8c4a-121bedc930c4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:15.071963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e09b9c9a-69e9-4a86-a20a-40b8fed6267a req-1ff25b8a-7d41-4214-8c4a-121bedc930c4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:15.087412 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e09b9c9a-69e9-4a86-a20a-40b8fed6267a req-1ff25b8a-7d41-4214-8c4a-121bedc930c4 service nova] Creating event network-changed:ef38b2e5-d93c-440b-b10a-83942a85aa83 for instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 on n-h1-767704-28 Jul 14 15:24:15.094085 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e09b9c9a-69e9-4a86-a20a-40b8fed6267a req-1ff25b8a-7d41-4214-8c4a-121bedc930c4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049824 Jul 14 15:24:15.094702 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3422/6809] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:24:15.849443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6d5bb352-6eba-4341-863c-c956fad359a3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:15.850064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6d5bb352-6eba-4341-863c-c956fad359a3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:15.857323 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d5bb352-6eba-4341-863c-c956fad359a3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:15.857811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d5bb352-6eba-4341-863c-c956fad359a3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:15.858744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d5bb352-6eba-4341-863c-c956fad359a3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:15.859194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6d5bb352-6eba-4341-863c-c956fad359a3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:15.990542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6d5bb352-6eba-4341-863c-c956fad359a3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:15.998819 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6d5bb352-6eba-4341-863c-c956fad359a3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1363 microversion: 2.1 time: 0.153315 Jul 14 15:24:15.999410 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3388/6810] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:15 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:17.017122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6e278c78-dcdf-47dd-9487-6686d80ab104 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:17.017884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6e278c78-dcdf-47dd-9487-6686d80ab104 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:17.026280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e278c78-dcdf-47dd-9487-6686d80ab104 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:17.027498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e278c78-dcdf-47dd-9487-6686d80ab104 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:17.028356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e278c78-dcdf-47dd-9487-6686d80ab104 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:17.028821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6e278c78-dcdf-47dd-9487-6686d80ab104 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:17.250097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6e278c78-dcdf-47dd-9487-6686d80ab104 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:17.258030 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6e278c78-dcdf-47dd-9487-6686d80ab104 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1363 microversion: 2.1 time: 0.245324 Jul 14 15:24:17.258631 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3423/6811] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:17 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:18.277047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-71b33ba9-dcd2-4f27-a144-5f3d096cb48d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:18.277675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-71b33ba9-dcd2-4f27-a144-5f3d096cb48d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:18.289559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71b33ba9-dcd2-4f27-a144-5f3d096cb48d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:18.290024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71b33ba9-dcd2-4f27-a144-5f3d096cb48d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:18.290816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71b33ba9-dcd2-4f27-a144-5f3d096cb48d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:18.292186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-71b33ba9-dcd2-4f27-a144-5f3d096cb48d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:18.426154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-71b33ba9-dcd2-4f27-a144-5f3d096cb48d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:18.435259 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-71b33ba9-dcd2-4f27-a144-5f3d096cb48d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1363 microversion: 2.1 time: 0.163026 Jul 14 15:24:18.435858 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3389/6812] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:18 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:19.453774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cbd193d3-073d-4b93-a3b2-a42eeaff2c91 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:19.454571 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cbd193d3-073d-4b93-a3b2-a42eeaff2c91 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:19.462073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cbd193d3-073d-4b93-a3b2-a42eeaff2c91 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:19.462696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cbd193d3-073d-4b93-a3b2-a42eeaff2c91 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:19.464151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cbd193d3-073d-4b93-a3b2-a42eeaff2c91 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:19.464614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cbd193d3-073d-4b93-a3b2-a42eeaff2c91 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:19.602724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cbd193d3-073d-4b93-a3b2-a42eeaff2c91 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:19.611235 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cbd193d3-073d-4b93-a3b2-a42eeaff2c91 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1363 microversion: 2.1 time: 0.161884 Jul 14 15:24:19.611796 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3424/6813] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:19 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:20.629223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7f60cf06-96df-461e-811b-64811b18958a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:20.629959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7f60cf06-96df-461e-811b-64811b18958a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:20.638230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f60cf06-96df-461e-811b-64811b18958a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:20.638690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f60cf06-96df-461e-811b-64811b18958a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:20.639476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f60cf06-96df-461e-811b-64811b18958a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:20.639928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f60cf06-96df-461e-811b-64811b18958a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:20.775197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7f60cf06-96df-461e-811b-64811b18958a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:20.783484 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7f60cf06-96df-461e-811b-64811b18958a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1363 microversion: 2.1 time: 0.158589 Jul 14 15:24:20.784079 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3390/6814] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:20 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:21.058700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-9f651fa3-c86a-404a-a5f0-f5793252981a req-b5fc88fa-0639-43bc-b696-6b244a293b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb05a4f3-116b-4937-bf8c-41bfba922fd7", "name": "network-vif-plugged", "status": "completed", "tag": "ef38b2e5-d93c-440b-b10a-83942a85aa83"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:21.071298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9f651fa3-c86a-404a-a5f0-f5793252981a req-b5fc88fa-0639-43bc-b696-6b244a293b4b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:21.071914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-9f651fa3-c86a-404a-a5f0-f5793252981a req-b5fc88fa-0639-43bc-b696-6b244a293b4b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:21.084148 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-9f651fa3-c86a-404a-a5f0-f5793252981a req-b5fc88fa-0639-43bc-b696-6b244a293b4b service nova] Creating event network-vif-plugged:ef38b2e5-d93c-440b-b10a-83942a85aa83 for instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 on n-h1-767704-28 Jul 14 15:24:21.089592 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-9f651fa3-c86a-404a-a5f0-f5793252981a req-b5fc88fa-0639-43bc-b696-6b244a293b4b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035103 Jul 14 15:24:21.090583 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3425/6815] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:24:21.801103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a2817898-4cfd-44da-81b4-42a2cf6d07f2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:21.801722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a2817898-4cfd-44da-81b4-42a2cf6d07f2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:21.809179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2817898-4cfd-44da-81b4-42a2cf6d07f2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:21.809651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2817898-4cfd-44da-81b4-42a2cf6d07f2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:21.811094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2817898-4cfd-44da-81b4-42a2cf6d07f2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:21.811910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2817898-4cfd-44da-81b4-42a2cf6d07f2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:21.947676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a2817898-4cfd-44da-81b4-42a2cf6d07f2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:21.955480 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a2817898-4cfd-44da-81b4-42a2cf6d07f2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1363 microversion: 2.1 time: 0.158376 Jul 14 15:24:21.956104 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3391/6816] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:21 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:22.971112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.972054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.976309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d4c07e69-c806-4403-ad33-59b11325faf2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:22.977047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d4c07e69-c806-4403-ad33-59b11325faf2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:22.984723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4c07e69-c806-4403-ad33-59b11325faf2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:22.985221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4c07e69-c806-4403-ad33-59b11325faf2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:22.985997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4c07e69-c806-4403-ad33-59b11325faf2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:22.986450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d4c07e69-c806-4403-ad33-59b11325faf2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:23.116728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d4c07e69-c806-4403-ad33-59b11325faf2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:23.125453 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d4c07e69-c806-4403-ad33-59b11325faf2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1549 microversion: 2.1 time: 0.156073 Jul 14 15:24:23.126123 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3426/6817] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:22 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:23.142721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b91fe3bc-c438-4a2d-b45d-4cc54b6de421 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:23.143206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b91fe3bc-c438-4a2d-b45d-4cc54b6de421 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:23.145274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:23.152401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b91fe3bc-c438-4a2d-b45d-4cc54b6de421 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:23.153160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b91fe3bc-c438-4a2d-b45d-4cc54b6de421 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:23.154393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b91fe3bc-c438-4a2d-b45d-4cc54b6de421 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:23.154860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b91fe3bc-c438-4a2d-b45d-4cc54b6de421 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:23.236339 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b91fe3bc-c438-4a2d-b45d-4cc54b6de421 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097060 Jul 14 15:24:23.236980 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3392/6818] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 15:24:23 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:24:24.188280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e9448731-fac8-40f8-af6c-a82cc41a549f req-b59b5aa4-4f06-44e4-879a-7f7c78288501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb05a4f3-116b-4937-bf8c-41bfba922fd7", "tag": "ef38b2e5-d93c-440b-b10a-83942a85aa83"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:24.198214 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e9448731-fac8-40f8-af6c-a82cc41a549f req-b59b5aa4-4f06-44e4-879a-7f7c78288501 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:24.198773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e9448731-fac8-40f8-af6c-a82cc41a549f req-b59b5aa4-4f06-44e4-879a-7f7c78288501 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:24.210586 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e9448731-fac8-40f8-af6c-a82cc41a549f req-b59b5aa4-4f06-44e4-879a-7f7c78288501 service nova] Creating event network-changed:ef38b2e5-d93c-440b-b10a-83942a85aa83 for instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 on n-h1-767704-28 Jul 14 15:24:24.219575 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e9448731-fac8-40f8-af6c-a82cc41a549f req-b59b5aa4-4f06-44e4-879a-7f7c78288501 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034950 Jul 14 15:24:24.220559 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3427/6819] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:08.004618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=19 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.005727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.010278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:08.011309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:08.020825 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:08.021321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:08.022143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:08.022576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:08.056860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:08.069600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Old instance type m1.heat2, new instance type m1.heat {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:25:08.076551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:25:08.077029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:25:08.077501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:25:08.078644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:25:08.079439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:25:08.143167 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-816eb61a-1556-4838-8a83-8a3cd5912ac9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7/action" status: 202 len: 0 microversion: 2.1 time: 0.141165 Jul 14 15:25:08.143847 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3393/6820] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:25:07 2022] POST /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:25:08.151749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.152977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=52 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.158619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-904f80f4-45f9-4ab0-bf23-2ba454955feb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:08.159487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-904f80f4-45f9-4ab0-bf23-2ba454955feb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:08.170799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-904f80f4-45f9-4ab0-bf23-2ba454955feb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:08.171483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-904f80f4-45f9-4ab0-bf23-2ba454955feb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:08.173110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-904f80f4-45f9-4ab0-bf23-2ba454955feb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:08.173735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-904f80f4-45f9-4ab0-bf23-2ba454955feb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:08.370028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-904f80f4-45f9-4ab0-bf23-2ba454955feb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:08.377845 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-904f80f4-45f9-4ab0-bf23-2ba454955feb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1677 microversion: 2.1 time: 0.229085 Jul 14 15:25:08.378450 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3428/6821] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:08 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:09.396851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-632e69e0-10c5-4794-abf6-964779b183d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:09.397596 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-632e69e0-10c5-4794-abf6-964779b183d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:09.403682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-632e69e0-10c5-4794-abf6-964779b183d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:09.404141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-632e69e0-10c5-4794-abf6-964779b183d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:09.404921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-632e69e0-10c5-4794-abf6-964779b183d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:09.405398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-632e69e0-10c5-4794-abf6-964779b183d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:09.542996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-632e69e0-10c5-4794-abf6-964779b183d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:09.550981 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-632e69e0-10c5-4794-abf6-964779b183d3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1677 microversion: 2.1 time: 0.158887 Jul 14 15:25:09.551581 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3394/6822] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:09 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:10.568733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5278abae-2504-4277-8780-35d735a86666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:10.569433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5278abae-2504-4277-8780-35d735a86666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:10.576359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5278abae-2504-4277-8780-35d735a86666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:10.576821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5278abae-2504-4277-8780-35d735a86666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:10.578149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5278abae-2504-4277-8780-35d735a86666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:10.578625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5278abae-2504-4277-8780-35d735a86666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:10.713382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5278abae-2504-4277-8780-35d735a86666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:10.721921 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5278abae-2504-4277-8780-35d735a86666 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.157185 Jul 14 15:25:10.722488 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3429/6823] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:10 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:25:11.740128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-73e32956-b729-46bf-8006-b122a67fb353 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:11.740751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-73e32956-b729-46bf-8006-b122a67fb353 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:11.747416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73e32956-b729-46bf-8006-b122a67fb353 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:11.747883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73e32956-b729-46bf-8006-b122a67fb353 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:11.748660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73e32956-b729-46bf-8006-b122a67fb353 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:11.749243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-73e32956-b729-46bf-8006-b122a67fb353 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:11.885904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-73e32956-b729-46bf-8006-b122a67fb353 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:11.893407 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-73e32956-b729-46bf-8006-b122a67fb353 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.157503 Jul 14 15:25:11.893979 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3395/6824] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:11 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:12.911019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d72ca05d-fdd2-4716-a6ab-395038bf5db3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:12.911646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d72ca05d-fdd2-4716-a6ab-395038bf5db3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:12.918697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d72ca05d-fdd2-4716-a6ab-395038bf5db3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:12.919160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d72ca05d-fdd2-4716-a6ab-395038bf5db3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:12.919936 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d72ca05d-fdd2-4716-a6ab-395038bf5db3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:12.920385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d72ca05d-fdd2-4716-a6ab-395038bf5db3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:13.056361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d72ca05d-fdd2-4716-a6ab-395038bf5db3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:13.064548 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d72ca05d-fdd2-4716-a6ab-395038bf5db3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.157433 Jul 14 15:25:13.065236 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3430/6825] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:12 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:14.081867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4d9531cd-7b22-48f5-bd78-7929ff994376 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:14.082479 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4d9531cd-7b22-48f5-bd78-7929ff994376 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:14.089470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d9531cd-7b22-48f5-bd78-7929ff994376 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:14.089924 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d9531cd-7b22-48f5-bd78-7929ff994376 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:14.090695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d9531cd-7b22-48f5-bd78-7929ff994376 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:14.091136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4d9531cd-7b22-48f5-bd78-7929ff994376 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:14.241545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4d9531cd-7b22-48f5-bd78-7929ff994376 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:14.249503 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4d9531cd-7b22-48f5-bd78-7929ff994376 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.171523 Jul 14 15:25:14.250798 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3396/6826] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:14 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:15.268044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ed23cdee-be60-4f21-94dd-e05636e1e967 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:15.268730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ed23cdee-be60-4f21-94dd-e05636e1e967 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:15.275766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed23cdee-be60-4f21-94dd-e05636e1e967 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:15.276233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed23cdee-be60-4f21-94dd-e05636e1e967 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:15.277056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed23cdee-be60-4f21-94dd-e05636e1e967 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:15.277516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed23cdee-be60-4f21-94dd-e05636e1e967 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:15.409859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ed23cdee-be60-4f21-94dd-e05636e1e967 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:15.417455 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ed23cdee-be60-4f21-94dd-e05636e1e967 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.153540 Jul 14 15:25:15.418038 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3431/6827] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:15 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:16.435344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d7ed4bfd-2434-44e2-9646-132011a66f1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:16.435962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d7ed4bfd-2434-44e2-9646-132011a66f1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:16.443551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7ed4bfd-2434-44e2-9646-132011a66f1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:16.444010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7ed4bfd-2434-44e2-9646-132011a66f1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:16.444786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7ed4bfd-2434-44e2-9646-132011a66f1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:16.445258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7ed4bfd-2434-44e2-9646-132011a66f1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:16.582789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d7ed4bfd-2434-44e2-9646-132011a66f1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:16.591158 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d7ed4bfd-2434-44e2-9646-132011a66f1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.159060 Jul 14 15:25:16.591158 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3397/6828] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:16 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:17.607318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-79670922-d078-470a-ade9-4b0dc90535b2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:17.607948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-79670922-d078-470a-ade9-4b0dc90535b2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:17.615090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79670922-d078-470a-ade9-4b0dc90535b2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:17.615555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79670922-d078-470a-ade9-4b0dc90535b2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:17.616329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79670922-d078-470a-ade9-4b0dc90535b2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:17.616781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-79670922-d078-470a-ade9-4b0dc90535b2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:17.747942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-79670922-d078-470a-ade9-4b0dc90535b2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:17.756973 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-79670922-d078-470a-ade9-4b0dc90535b2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.153574 Jul 14 15:25:17.757543 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3432/6829] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:17 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:18.774931 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-285f96d1-2d3b-490e-8eb2-96966b316760 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:18.775542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-285f96d1-2d3b-490e-8eb2-96966b316760 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:18.783524 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285f96d1-2d3b-490e-8eb2-96966b316760 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:18.783985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285f96d1-2d3b-490e-8eb2-96966b316760 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:18.784775 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285f96d1-2d3b-490e-8eb2-96966b316760 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:18.785259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285f96d1-2d3b-490e-8eb2-96966b316760 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:19.206836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-285f96d1-2d3b-490e-8eb2-96966b316760 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:19.214544 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-285f96d1-2d3b-490e-8eb2-96966b316760 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.443632 Jul 14 15:25:19.215128 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3398/6830] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:18 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:20.232094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37a25e17-6f46-416b-a5a9-afd3d18cbdd0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:20.232672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-37a25e17-6f46-416b-a5a9-afd3d18cbdd0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:20.240558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37a25e17-6f46-416b-a5a9-afd3d18cbdd0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:20.241062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37a25e17-6f46-416b-a5a9-afd3d18cbdd0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:20.241850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37a25e17-6f46-416b-a5a9-afd3d18cbdd0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:20.242309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37a25e17-6f46-416b-a5a9-afd3d18cbdd0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:20.379582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-37a25e17-6f46-416b-a5a9-afd3d18cbdd0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:20.387222 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-37a25e17-6f46-416b-a5a9-afd3d18cbdd0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.159197 Jul 14 15:25:20.387792 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3433/6831] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:20 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:21.405176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5c1a6b5b-4f18-48a1-a67a-7fe98b896f40 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:21.405781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5c1a6b5b-4f18-48a1-a67a-7fe98b896f40 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:21.413189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c1a6b5b-4f18-48a1-a67a-7fe98b896f40 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:21.413646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c1a6b5b-4f18-48a1-a67a-7fe98b896f40 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:21.414411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c1a6b5b-4f18-48a1-a67a-7fe98b896f40 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:21.414848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c1a6b5b-4f18-48a1-a67a-7fe98b896f40 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:21.559178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5c1a6b5b-4f18-48a1-a67a-7fe98b896f40 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:21.567437 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5c1a6b5b-4f18-48a1-a67a-7fe98b896f40 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.166168 Jul 14 15:25:21.568020 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3399/6832] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:21 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:22.584841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-157db218-6835-4504-a280-97cc2fab6a52 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:22.585536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-157db218-6835-4504-a280-97cc2fab6a52 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:22.592607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-157db218-6835-4504-a280-97cc2fab6a52 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:22.593826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-157db218-6835-4504-a280-97cc2fab6a52 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:22.595191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-157db218-6835-4504-a280-97cc2fab6a52 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:22.595656 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-157db218-6835-4504-a280-97cc2fab6a52 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:22.725849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-157db218-6835-4504-a280-97cc2fab6a52 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:22.733753 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-157db218-6835-4504-a280-97cc2fab6a52 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.152775 Jul 14 15:25:22.734869 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3434/6833] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:22 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:23.753452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c974a235-3df7-4b1f-8618-1d15a828ceef tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:23.754333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c974a235-3df7-4b1f-8618-1d15a828ceef tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:23.763921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c974a235-3df7-4b1f-8618-1d15a828ceef tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:23.764376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c974a235-3df7-4b1f-8618-1d15a828ceef tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:23.765944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c974a235-3df7-4b1f-8618-1d15a828ceef tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:23.766397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c974a235-3df7-4b1f-8618-1d15a828ceef tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:23.903065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c974a235-3df7-4b1f-8618-1d15a828ceef tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:23.911110 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c974a235-3df7-4b1f-8618-1d15a828ceef tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.162915 Jul 14 15:25:23.913090 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3400/6834] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:23 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:24.928069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0929625e-2616-4b94-a015-50170936ffcb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:24.928699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0929625e-2616-4b94-a015-50170936ffcb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:24.935711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0929625e-2616-4b94-a015-50170936ffcb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:24.936180 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0929625e-2616-4b94-a015-50170936ffcb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:24.937549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0929625e-2616-4b94-a015-50170936ffcb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:24.938075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0929625e-2616-4b94-a015-50170936ffcb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:25.076071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0929625e-2616-4b94-a015-50170936ffcb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:25.084605 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0929625e-2616-4b94-a015-50170936ffcb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.160507 Jul 14 15:25:25.085221 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3435/6835] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:24 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:26.102183 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-91ff07a5-3d8a-451c-a1c6-f5071960c335 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:26.102794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-91ff07a5-3d8a-451c-a1c6-f5071960c335 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:26.110195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91ff07a5-3d8a-451c-a1c6-f5071960c335 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:26.110651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91ff07a5-3d8a-451c-a1c6-f5071960c335 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:26.111419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91ff07a5-3d8a-451c-a1c6-f5071960c335 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:26.111863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-91ff07a5-3d8a-451c-a1c6-f5071960c335 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:26.246869 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-91ff07a5-3d8a-451c-a1c6-f5071960c335 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:26.255770 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-91ff07a5-3d8a-451c-a1c6-f5071960c335 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.157716 Jul 14 15:25:26.256366 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3401/6836] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:26 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:25:27.275151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7448db57-3ac0-4d76-90fa-5cdaf57af332 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:27.275794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7448db57-3ac0-4d76-90fa-5cdaf57af332 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:27.284821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7448db57-3ac0-4d76-90fa-5cdaf57af332 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:27.285325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7448db57-3ac0-4d76-90fa-5cdaf57af332 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:27.286142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7448db57-3ac0-4d76-90fa-5cdaf57af332 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:27.286604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7448db57-3ac0-4d76-90fa-5cdaf57af332 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:27.437929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7448db57-3ac0-4d76-90fa-5cdaf57af332 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:27.445535 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7448db57-3ac0-4d76-90fa-5cdaf57af332 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1682 microversion: 2.1 time: 0.174973 Jul 14 15:25:27.446113 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3436/6837] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:27 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:28.358482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-589322e2-8c3f-44c0-88f9-4b53816da71c req-744ee643-cc6e-48c7-80b4-cec14a969a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb05a4f3-116b-4937-bf8c-41bfba922fd7", "name": "network-vif-unplugged", "status": "completed", "tag": "ef38b2e5-d93c-440b-b10a-83942a85aa83"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:28.367383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-589322e2-8c3f-44c0-88f9-4b53816da71c req-744ee643-cc6e-48c7-80b4-cec14a969a2f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:28.367755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-589322e2-8c3f-44c0-88f9-4b53816da71c req-744ee643-cc6e-48c7-80b4-cec14a969a2f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:28.381652 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-589322e2-8c3f-44c0-88f9-4b53816da71c req-744ee643-cc6e-48c7-80b4-cec14a969a2f service nova] Creating event network-vif-unplugged:ef38b2e5-d93c-440b-b10a-83942a85aa83 for instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 on n-h2-767704-28 Jul 14 15:25:28.388621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-589322e2-8c3f-44c0-88f9-4b53816da71c req-744ee643-cc6e-48c7-80b4-cec14a969a2f service nova] Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:25:28.401973 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-589322e2-8c3f-44c0-88f9-4b53816da71c req-744ee643-cc6e-48c7-80b4-cec14a969a2f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107629 Jul 14 15:25:28.402804 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3402/6838] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:28.462934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-246ce9fb-548d-49af-a168-795787572de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:28.463697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-246ce9fb-548d-49af-a168-795787572de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:28.470891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-246ce9fb-548d-49af-a168-795787572de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:28.471399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-246ce9fb-548d-49af-a168-795787572de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:28.472258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-246ce9fb-548d-49af-a168-795787572de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:28.472790 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-246ce9fb-548d-49af-a168-795787572de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:28.675801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-246ce9fb-548d-49af-a168-795787572de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:28.684061 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-246ce9fb-548d-49af-a168-795787572de3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1681 microversion: 2.1 time: 0.225091 Jul 14 15:25:28.684713 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3437/6839] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:28 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:29.704730 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-87447d91-a868-46c5-a501-34619a59356b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:29.705538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-87447d91-a868-46c5-a501-34619a59356b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:29.712020 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87447d91-a868-46c5-a501-34619a59356b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:29.712477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87447d91-a868-46c5-a501-34619a59356b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:29.713285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87447d91-a868-46c5-a501-34619a59356b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:29.713732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87447d91-a868-46c5-a501-34619a59356b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:29.854050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-87447d91-a868-46c5-a501-34619a59356b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:29.862444 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-87447d91-a868-46c5-a501-34619a59356b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1679 microversion: 2.1 time: 0.163795 Jul 14 15:25:29.863033 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3403/6840] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:29 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:30.418659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-51ebe5f6-13b5-489b-bf85-569139466588 req-0df7c2fe-c23d-4ce1-b2ed-863e5994e918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb05a4f3-116b-4937-bf8c-41bfba922fd7", "tag": "ef38b2e5-d93c-440b-b10a-83942a85aa83"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:30.428763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-51ebe5f6-13b5-489b-bf85-569139466588 req-0df7c2fe-c23d-4ce1-b2ed-863e5994e918 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:30.429466 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-51ebe5f6-13b5-489b-bf85-569139466588 req-0df7c2fe-c23d-4ce1-b2ed-863e5994e918 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:30.441983 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-51ebe5f6-13b5-489b-bf85-569139466588 req-0df7c2fe-c23d-4ce1-b2ed-863e5994e918 service nova] Creating event network-changed:ef38b2e5-d93c-440b-b10a-83942a85aa83 for instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 on n-h2-767704-28 Jul 14 15:25:30.447555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-51ebe5f6-13b5-489b-bf85-569139466588 req-0df7c2fe-c23d-4ce1-b2ed-863e5994e918 service nova] Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:25:30.460201 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-51ebe5f6-13b5-489b-bf85-569139466588 req-0df7c2fe-c23d-4ce1-b2ed-863e5994e918 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045036 Jul 14 15:25:30.460934 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3438/6841] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:30.881309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4320810b-6b49-4c64-baa2-019ded43b85e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:30.882132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4320810b-6b49-4c64-baa2-019ded43b85e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:30.889706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4320810b-6b49-4c64-baa2-019ded43b85e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:30.890333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4320810b-6b49-4c64-baa2-019ded43b85e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:30.892832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4320810b-6b49-4c64-baa2-019ded43b85e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:30.892832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4320810b-6b49-4c64-baa2-019ded43b85e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:31.147360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4320810b-6b49-4c64-baa2-019ded43b85e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:31.156245 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4320810b-6b49-4c64-baa2-019ded43b85e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1679 microversion: 2.1 time: 0.278747 Jul 14 15:25:31.166284 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3404/6842] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:30 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1679 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:32.176088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c824ef26-c446-41fa-9bc2-de35beb23151 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:32.176735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c824ef26-c446-41fa-9bc2-de35beb23151 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:32.183389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c824ef26-c446-41fa-9bc2-de35beb23151 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:32.183864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c824ef26-c446-41fa-9bc2-de35beb23151 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:32.184654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c824ef26-c446-41fa-9bc2-de35beb23151 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:32.185147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c824ef26-c446-41fa-9bc2-de35beb23151 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:32.324386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c824ef26-c446-41fa-9bc2-de35beb23151 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:32.332506 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c824ef26-c446-41fa-9bc2-de35beb23151 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1676 microversion: 2.1 time: 0.162393 Jul 14 15:25:32.333118 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3439/6843] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:32 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:32.349165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:32.349875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:32.357026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:32.357507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:32.358313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:32.359297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:32.400126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:32.400576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:32.401396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:32.401874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:32.425913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:25:32.432486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for user cdf1867943324a83b94bef9d185e84eb and project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:25:32.519646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:32.543228 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1e78f1a4-56de-4f6e-b120-516178db6a9b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7/action" status: 202 len: 0 microversion: 2.1 time: 0.198120 Jul 14 15:25:32.543922 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3405/6844] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:25:32 2022] POST /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:25:32.553553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b22d35ef-94d8-4d57-840d-1eb9409fc2fa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:32.554182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b22d35ef-94d8-4d57-840d-1eb9409fc2fa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:32.560350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b22d35ef-94d8-4d57-840d-1eb9409fc2fa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:32.560848 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b22d35ef-94d8-4d57-840d-1eb9409fc2fa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:32.561681 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b22d35ef-94d8-4d57-840d-1eb9409fc2fa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:32.562793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b22d35ef-94d8-4d57-840d-1eb9409fc2fa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:32.775391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b22d35ef-94d8-4d57-840d-1eb9409fc2fa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:32.784883 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b22d35ef-94d8-4d57-840d-1eb9409fc2fa tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1675 microversion: 2.1 time: 0.236099 Jul 14 15:25:32.785506 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3440/6845] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:32 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1675 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:33.803634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c58e1bf2-417e-4cfc-8de2-566fe14cdad4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:33.804266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c58e1bf2-417e-4cfc-8de2-566fe14cdad4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:33.813923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c58e1bf2-417e-4cfc-8de2-566fe14cdad4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:33.814426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c58e1bf2-417e-4cfc-8de2-566fe14cdad4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:33.815547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c58e1bf2-417e-4cfc-8de2-566fe14cdad4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:33.815894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c58e1bf2-417e-4cfc-8de2-566fe14cdad4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:33.955320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c58e1bf2-417e-4cfc-8de2-566fe14cdad4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:33.963330 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c58e1bf2-417e-4cfc-8de2-566fe14cdad4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1675 microversion: 2.1 time: 0.164325 Jul 14 15:25:33.963929 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3406/6846] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:33 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:34.980387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5e1dd027-f15f-49fe-8836-2be4519db229 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:34.981052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5e1dd027-f15f-49fe-8836-2be4519db229 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:34.990202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e1dd027-f15f-49fe-8836-2be4519db229 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:34.990829 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e1dd027-f15f-49fe-8836-2be4519db229 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:34.991820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e1dd027-f15f-49fe-8836-2be4519db229 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:34.992367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e1dd027-f15f-49fe-8836-2be4519db229 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:35.167018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5e1dd027-f15f-49fe-8836-2be4519db229 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:35.176927 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5e1dd027-f15f-49fe-8836-2be4519db229 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1675 microversion: 2.1 time: 0.200447 Jul 14 15:25:35.177858 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3441/6847] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:34 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:35.183721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-52fc56ca-db43-49a8-8a82-4fb818905a00 req-d0146a8c-b328-44c4-ade5-82ecaebef352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb05a4f3-116b-4937-bf8c-41bfba922fd7", "name": "network-vif-plugged", "status": "completed", "tag": "ef38b2e5-d93c-440b-b10a-83942a85aa83"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:35.196037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-52fc56ca-db43-49a8-8a82-4fb818905a00 req-d0146a8c-b328-44c4-ade5-82ecaebef352 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:35.196489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-52fc56ca-db43-49a8-8a82-4fb818905a00 req-d0146a8c-b328-44c4-ade5-82ecaebef352 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:35.210529 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-52fc56ca-db43-49a8-8a82-4fb818905a00 req-d0146a8c-b328-44c4-ade5-82ecaebef352 service nova] Creating event network-vif-plugged:ef38b2e5-d93c-440b-b10a-83942a85aa83 for instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 on n-h2-767704-28 Jul 14 15:25:35.216204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-52fc56ca-db43-49a8-8a82-4fb818905a00 req-d0146a8c-b328-44c4-ade5-82ecaebef352 service nova] Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:25:35.231634 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-52fc56ca-db43-49a8-8a82-4fb818905a00 req-d0146a8c-b328-44c4-ade5-82ecaebef352 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052216 Jul 14 15:25:35.232433 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3407/6848] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:36.064209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-7d329c6e-712a-49ac-8f9f-86f344d05dfe req-e346e6f1-adab-4e98-928b-bb76676b798c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb05a4f3-116b-4937-bf8c-41bfba922fd7", "name": "network-vif-unplugged", "status": "completed", "tag": "ef38b2e5-d93c-440b-b10a-83942a85aa83"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:36.073590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7d329c6e-712a-49ac-8f9f-86f344d05dfe req-e346e6f1-adab-4e98-928b-bb76676b798c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:36.074072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7d329c6e-712a-49ac-8f9f-86f344d05dfe req-e346e6f1-adab-4e98-928b-bb76676b798c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:36.087300 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-7d329c6e-712a-49ac-8f9f-86f344d05dfe req-e346e6f1-adab-4e98-928b-bb76676b798c service nova] Creating event network-vif-unplugged:ef38b2e5-d93c-440b-b10a-83942a85aa83 for instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 on n-h1-767704-28 Jul 14 15:25:36.093428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-7d329c6e-712a-49ac-8f9f-86f344d05dfe req-e346e6f1-adab-4e98-928b-bb76676b798c service nova] Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:25:36.105415 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-7d329c6e-712a-49ac-8f9f-86f344d05dfe req-e346e6f1-adab-4e98-928b-bb76676b798c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045742 Jul 14 15:25:36.106058 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3442/6849] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:36.196245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99388bd6-4605-4947-a2a3-f9ab3c36cba9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:36.197768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-99388bd6-4605-4947-a2a3-f9ab3c36cba9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:36.204530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99388bd6-4605-4947-a2a3-f9ab3c36cba9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:36.205085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99388bd6-4605-4947-a2a3-f9ab3c36cba9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:36.205805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99388bd6-4605-4947-a2a3-f9ab3c36cba9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:36.206247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99388bd6-4605-4947-a2a3-f9ab3c36cba9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:36.427832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-99388bd6-4605-4947-a2a3-f9ab3c36cba9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:36.435643 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99388bd6-4605-4947-a2a3-f9ab3c36cba9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1675 microversion: 2.1 time: 0.245180 Jul 14 15:25:36.436275 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3408/6850] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:36 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1675 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:37.455821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f6270c32-2cfd-4ed7-9ea5-08ef93818266 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:37.456542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f6270c32-2cfd-4ed7-9ea5-08ef93818266 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:37.462967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6270c32-2cfd-4ed7-9ea5-08ef93818266 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:37.463435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6270c32-2cfd-4ed7-9ea5-08ef93818266 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:37.464217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6270c32-2cfd-4ed7-9ea5-08ef93818266 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:37.464671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6270c32-2cfd-4ed7-9ea5-08ef93818266 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:37.608562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f6270c32-2cfd-4ed7-9ea5-08ef93818266 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:37.616826 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f6270c32-2cfd-4ed7-9ea5-08ef93818266 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1675 microversion: 2.1 time: 0.166955 Jul 14 15:25:37.617443 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3443/6851] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:37 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:38.121032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3050480d-cd87-49bc-8d74-bd621dc64853 req-fc107f01-b64e-4eaa-8c6b-498fdfe4070b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb05a4f3-116b-4937-bf8c-41bfba922fd7", "tag": "ef38b2e5-d93c-440b-b10a-83942a85aa83"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:38.126188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:38.133061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3050480d-cd87-49bc-8d74-bd621dc64853 req-fc107f01-b64e-4eaa-8c6b-498fdfe4070b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:38.133519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3050480d-cd87-49bc-8d74-bd621dc64853 req-fc107f01-b64e-4eaa-8c6b-498fdfe4070b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:38.146316 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3050480d-cd87-49bc-8d74-bd621dc64853 req-fc107f01-b64e-4eaa-8c6b-498fdfe4070b service nova] Creating event network-changed:ef38b2e5-d93c-440b-b10a-83942a85aa83 for instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 on n-h1-767704-28 Jul 14 15:25:38.151609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-3050480d-cd87-49bc-8d74-bd621dc64853 req-fc107f01-b64e-4eaa-8c6b-498fdfe4070b service nova] Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:25:38.163791 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3050480d-cd87-49bc-8d74-bd621dc64853 req-fc107f01-b64e-4eaa-8c6b-498fdfe4070b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046408 Jul 14 15:25:38.164525 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3409/6852] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:38.634633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0cf51c30-bb0f-42e3-9809-74e8aaf908de tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:38.635279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0cf51c30-bb0f-42e3-9809-74e8aaf908de tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:38.640836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=33 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:38.646666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0cf51c30-bb0f-42e3-9809-74e8aaf908de tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:38.647165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0cf51c30-bb0f-42e3-9809-74e8aaf908de tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:38.648099 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0cf51c30-bb0f-42e3-9809-74e8aaf908de tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:38.648555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0cf51c30-bb0f-42e3-9809-74e8aaf908de tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:38.651587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=93 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:38.950107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0cf51c30-bb0f-42e3-9809-74e8aaf908de tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:38.958702 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0cf51c30-bb0f-42e3-9809-74e8aaf908de tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1675 microversion: 2.1 time: 0.328207 Jul 14 15:25:38.959475 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3444/6853] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:38 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1675 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:39.977361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e2c537eb-d6b0-4181-9563-1d8184814528 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:39.978109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e2c537eb-d6b0-4181-9563-1d8184814528 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:39.985872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2c537eb-d6b0-4181-9563-1d8184814528 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:39.986335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2c537eb-d6b0-4181-9563-1d8184814528 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:39.987134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2c537eb-d6b0-4181-9563-1d8184814528 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:39.987586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2c537eb-d6b0-4181-9563-1d8184814528 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:40.123753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e2c537eb-d6b0-4181-9563-1d8184814528 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:40.132301 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e2c537eb-d6b0-4181-9563-1d8184814528 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1668 microversion: 2.1 time: 0.159338 Jul 14 15:25:40.133018 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3410/6854] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:39 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:40.148783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2a912912-52ed-4daf-af30-7c9a49654244 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:40.149438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2a912912-52ed-4daf-af30-7c9a49654244 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:40.156597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a912912-52ed-4daf-af30-7c9a49654244 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:40.157112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a912912-52ed-4daf-af30-7c9a49654244 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:40.157914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a912912-52ed-4daf-af30-7c9a49654244 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:40.158375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2a912912-52ed-4daf-af30-7c9a49654244 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:40.291592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2a912912-52ed-4daf-af30-7c9a49654244 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:40.300149 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2a912912-52ed-4daf-af30-7c9a49654244 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1668 microversion: 2.1 time: 0.155239 Jul 14 15:25:40.300734 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3445/6855] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:40 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:40.317146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b92dbe4b-2bb2-4dc9-945f-c1f5d430d426 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:40.317769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b92dbe4b-2bb2-4dc9-945f-c1f5d430d426 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:40.323809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b92dbe4b-2bb2-4dc9-945f-c1f5d430d426 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:40.324265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b92dbe4b-2bb2-4dc9-945f-c1f5d430d426 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:40.325061 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b92dbe4b-2bb2-4dc9-945f-c1f5d430d426 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:40.325701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b92dbe4b-2bb2-4dc9-945f-c1f5d430d426 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:40.462516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b92dbe4b-2bb2-4dc9-945f-c1f5d430d426 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:40.470369 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b92dbe4b-2bb2-4dc9-945f-c1f5d430d426 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1668 microversion: 2.1 time: 0.157436 Jul 14 15:25:40.470953 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3411/6856] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:40 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:40.486842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a118520c-a70e-4ce0-986d-ec96282c9db9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:40.487366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a118520c-a70e-4ce0-986d-ec96282c9db9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:40.493783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a118520c-a70e-4ce0-986d-ec96282c9db9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:40.494264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a118520c-a70e-4ce0-986d-ec96282c9db9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:40.495059 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a118520c-a70e-4ce0-986d-ec96282c9db9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:40.495517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a118520c-a70e-4ce0-986d-ec96282c9db9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:40.521600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a118520c-a70e-4ce0-986d-ec96282c9db9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:25:40.599317 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a118520c-a70e-4ce0-986d-ec96282c9db9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "DELETE /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 204 len: 0 microversion: 2.1 time: 0.116521 Jul 14 15:25:40.599914 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3446/6857] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:25:40 2022] DELETE /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:25:40.610142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cf0fe064-12cc-4ccd-8df4-136ac5470f7c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:40.611051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cf0fe064-12cc-4ccd-8df4-136ac5470f7c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:40.617706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf0fe064-12cc-4ccd-8df4-136ac5470f7c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:40.618164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf0fe064-12cc-4ccd-8df4-136ac5470f7c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:40.618941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf0fe064-12cc-4ccd-8df4-136ac5470f7c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:40.619385 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf0fe064-12cc-4ccd-8df4-136ac5470f7c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:40.756019 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cf0fe064-12cc-4ccd-8df4-136ac5470f7c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:40.763943 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cf0fe064-12cc-4ccd-8df4-136ac5470f7c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1674 microversion: 2.1 time: 0.159410 Jul 14 15:25:40.764594 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3412/6858] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:40 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:41.506688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-271860c1-2b8f-419b-8f44-12e60b62378f req-d919c537-cb22-4866-8dcc-0336d5275e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb05a4f3-116b-4937-bf8c-41bfba922fd7", "name": "network-vif-plugged", "status": "completed", "tag": "ef38b2e5-d93c-440b-b10a-83942a85aa83"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:41.517483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-271860c1-2b8f-419b-8f44-12e60b62378f req-d919c537-cb22-4866-8dcc-0336d5275e70 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:41.517945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-271860c1-2b8f-419b-8f44-12e60b62378f req-d919c537-cb22-4866-8dcc-0336d5275e70 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:41.528872 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-271860c1-2b8f-419b-8f44-12e60b62378f req-d919c537-cb22-4866-8dcc-0336d5275e70 service nova] Creating event network-vif-plugged:ef38b2e5-d93c-440b-b10a-83942a85aa83 for instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 on n-h1-767704-28 Jul 14 15:25:41.533894 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-271860c1-2b8f-419b-8f44-12e60b62378f req-d919c537-cb22-4866-8dcc-0336d5275e70 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031737 Jul 14 15:25:41.534503 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3447/6859] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:41.782049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77662263-e7c4-46f9-9b73-223accab3307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:41.782672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-77662263-e7c4-46f9-9b73-223accab3307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:41.789500 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77662263-e7c4-46f9-9b73-223accab3307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:41.789956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77662263-e7c4-46f9-9b73-223accab3307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:41.790736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77662263-e7c4-46f9-9b73-223accab3307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:41.791182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77662263-e7c4-46f9-9b73-223accab3307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:41.925854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-77662263-e7c4-46f9-9b73-223accab3307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:41.933478 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-77662263-e7c4-46f9-9b73-223accab3307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1674 microversion: 2.1 time: 0.156079 Jul 14 15:25:41.934054 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3413/6860] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:41 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:42.951710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5b1af748-6016-4ff8-9300-b6e0789dc96e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:42.953618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5b1af748-6016-4ff8-9300-b6e0789dc96e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:42.965297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b1af748-6016-4ff8-9300-b6e0789dc96e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:42.965776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b1af748-6016-4ff8-9300-b6e0789dc96e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:42.966580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b1af748-6016-4ff8-9300-b6e0789dc96e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:42.967036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5b1af748-6016-4ff8-9300-b6e0789dc96e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:43.060269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5b1af748-6016-4ff8-9300-b6e0789dc96e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:43.069924 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5b1af748-6016-4ff8-9300-b6e0789dc96e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 200 len: 1606 microversion: 2.1 time: 0.122604 Jul 14 15:25:43.071386 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3448/6861] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:42 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 1606 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:43.250986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1c4dad4f-41e2-4b74-8359-e5e56052f73d req-cdc4ebff-0e1b-4a13-b9e6-2d35d939c149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb05a4f3-116b-4937-bf8c-41bfba922fd7", "name": "network-vif-deleted", "tag": "ef38b2e5-d93c-440b-b10a-83942a85aa83"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:43.256208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:43.264816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1c4dad4f-41e2-4b74-8359-e5e56052f73d req-cdc4ebff-0e1b-4a13-b9e6-2d35d939c149 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:43.265526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1c4dad4f-41e2-4b74-8359-e5e56052f73d req-cdc4ebff-0e1b-4a13-b9e6-2d35d939c149 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:43.279260 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1c4dad4f-41e2-4b74-8359-e5e56052f73d req-cdc4ebff-0e1b-4a13-b9e6-2d35d939c149 service nova] Creating event network-vif-deleted:ef38b2e5-d93c-440b-b10a-83942a85aa83 for instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 on n-h1-767704-28 Jul 14 15:25:43.286747 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1c4dad4f-41e2-4b74-8359-e5e56052f73d req-cdc4ebff-0e1b-4a13-b9e6-2d35d939c149 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040134 Jul 14 15:25:43.287902 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3414/6862] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:44.089408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dd7a6549-62db-4674-9d84-275bcc59304b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:44.089860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dd7a6549-62db-4674-9d84-275bcc59304b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:44.097647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd7a6549-62db-4674-9d84-275bcc59304b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:44.098200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd7a6549-62db-4674-9d84-275bcc59304b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:44.099003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd7a6549-62db-4674-9d84-275bcc59304b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:44.099452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dd7a6549-62db-4674-9d84-275bcc59304b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:44.114194 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-dd7a6549-62db-4674-9d84-275bcc59304b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dd7a6549-62db-4674-9d84-275bcc59304b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 HTTP/1.1 Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'bb05a4f3-116b-4937-bf8c-41bfba922fd7'} Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:25:44.115887 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:25:44.121815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:25:44.121815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:25:44.121815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:25:44.121815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:25:44.121815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:25:44.121815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:25:44.121815 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:25:44.121815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dd7a6549-62db-4674-9d84-275bcc59304b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:25:44.121815 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dd7a6549-62db-4674-9d84-275bcc59304b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 404 len: 111 microversion: 2.1 time: 0.032283 Jul 14 15:25:44.121815 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3449/6863] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:44 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:25:44.138021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf19d5c0-9e33-4bcd-90ab-c475ca8aa2b0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:44.138731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bf19d5c0-9e33-4bcd-90ab-c475ca8aa2b0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:44.145979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf19d5c0-9e33-4bcd-90ab-c475ca8aa2b0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:44.146432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf19d5c0-9e33-4bcd-90ab-c475ca8aa2b0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:44.147226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf19d5c0-9e33-4bcd-90ab-c475ca8aa2b0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:44.147745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf19d5c0-9e33-4bcd-90ab-c475ca8aa2b0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:44.161875 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-bf19d5c0-9e33-4bcd-90ab-c475ca8aa2b0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf19d5c0-9e33-4bcd-90ab-c475ca8aa2b0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 HTTP/1.1 Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'bb05a4f3-116b-4937-bf8c-41bfba922fd7'} Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:25:44.163280 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:25:44.166991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:25:44.166991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:25:44.166991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:25:44.166991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:25:44.166991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:25:44.166991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:25:44.166991 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:25:44.166991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf19d5c0-9e33-4bcd-90ab-c475ca8aa2b0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:25:44.166991 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf19d5c0-9e33-4bcd-90ab-c475ca8aa2b0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 404 len: 111 microversion: 2.1 time: 0.031722 Jul 14 15:25:44.166991 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3415/6864] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:44 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:25:44.221698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-309174587", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "3d556b15-c13c-4735-a578-3af46588d8d3"}], "security_groups": [{"name": "tempest-securitygroup--1082746555"}], "key_name": "tempest-keypair-1805277302", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:44.337065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] validate_networks() for [('3d556b15-c13c-4735-a578-3af46588d8d3', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:25:44.788242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:25:44.788709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:25:44.789308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:25:44.789732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:25:44.790176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:25:44.802597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:44.803061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:44.803888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:44.804345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:44.824472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:25:44.830106 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for user cdf1867943324a83b94bef9d185e84eb and project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:25:44.842955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:25:44.845391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:25:44.895179 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-155a6b03-a1fc-4eb0-99b5-1730d9d29ccd tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.680989 Jul 14 15:25:44.896019 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3450/6865] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:25:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:25:44.906588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-68e00112-5264-4486-b77a-f0b8382afd0b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:44.907214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-68e00112-5264-4486-b77a-f0b8382afd0b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:44.967029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-68e00112-5264-4486-b77a-f0b8382afd0b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:44.978165 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-68e00112-5264-4486-b77a-f0b8382afd0b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1238 microversion: 2.1 time: 0.075776 Jul 14 15:25:44.978748 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3416/6866] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:44 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:45.997929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-42c7d918-f559-4e98-ba53-07176b00d596 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:46.000797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-42c7d918-f559-4e98-ba53-07176b00d596 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:46.012120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42c7d918-f559-4e98-ba53-07176b00d596 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:46.012687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42c7d918-f559-4e98-ba53-07176b00d596 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:46.013615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42c7d918-f559-4e98-ba53-07176b00d596 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:46.014144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42c7d918-f559-4e98-ba53-07176b00d596 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:46.097909 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-42c7d918-f559-4e98-ba53-07176b00d596 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:46.105834 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-42c7d918-f559-4e98-ba53-07176b00d596 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1298 microversion: 2.1 time: 0.113636 Jul 14 15:25:46.106419 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3451/6867] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:45 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:47.124578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2e201f88-846c-4b8c-b9f6-cce778743429 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:47.125238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2e201f88-846c-4b8c-b9f6-cce778743429 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:47.133391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e201f88-846c-4b8c-b9f6-cce778743429 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:47.133856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e201f88-846c-4b8c-b9f6-cce778743429 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:47.134647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e201f88-846c-4b8c-b9f6-cce778743429 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:47.135091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e201f88-846c-4b8c-b9f6-cce778743429 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:47.362853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2e201f88-846c-4b8c-b9f6-cce778743429 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:47.375035 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2e201f88-846c-4b8c-b9f6-cce778743429 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1364 microversion: 2.1 time: 0.253848 Jul 14 15:25:47.376118 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3417/6868] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:47 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:47.515468 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-bfa37c6f-bdf9-4be3-aa9f-a8a3c7a46661 req-3443cc04-102d-463f-abe3-26eeedd73849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75427d60-5953-49c5-a976-6053cf7ef090", "tag": "76494747-2cb8-41bd-82bf-05a4b9e0dfb7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:47.531291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bfa37c6f-bdf9-4be3-aa9f-a8a3c7a46661 req-3443cc04-102d-463f-abe3-26eeedd73849 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:47.531393 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bfa37c6f-bdf9-4be3-aa9f-a8a3c7a46661 req-3443cc04-102d-463f-abe3-26eeedd73849 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:47.546759 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-bfa37c6f-bdf9-4be3-aa9f-a8a3c7a46661 req-3443cc04-102d-463f-abe3-26eeedd73849 service nova] Creating event network-changed:76494747-2cb8-41bd-82bf-05a4b9e0dfb7 for instance 75427d60-5953-49c5-a976-6053cf7ef090 on n-h2-767704-28 Jul 14 15:25:47.552103 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-bfa37c6f-bdf9-4be3-aa9f-a8a3c7a46661 req-3443cc04-102d-463f-abe3-26eeedd73849 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041097 Jul 14 15:25:47.552717 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3452/6869] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:48.394162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f39b2af-c1ad-42ba-b04c-2ed4b0337b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:48.394686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8f39b2af-c1ad-42ba-b04c-2ed4b0337b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:48.401654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f39b2af-c1ad-42ba-b04c-2ed4b0337b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:48.402114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f39b2af-c1ad-42ba-b04c-2ed4b0337b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:48.402888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f39b2af-c1ad-42ba-b04c-2ed4b0337b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:48.403332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f39b2af-c1ad-42ba-b04c-2ed4b0337b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:48.540116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f39b2af-c1ad-42ba-b04c-2ed4b0337b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:48.548495 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8f39b2af-c1ad-42ba-b04c-2ed4b0337b65 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1364 microversion: 2.1 time: 0.159052 Jul 14 15:25:48.549099 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3418/6870] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:48 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:49.568102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bcf2530a-3250-4047-8717-fe0894072acf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:49.568820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bcf2530a-3250-4047-8717-fe0894072acf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:49.575243 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcf2530a-3250-4047-8717-fe0894072acf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:49.575705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcf2530a-3250-4047-8717-fe0894072acf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:49.576497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcf2530a-3250-4047-8717-fe0894072acf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:49.577107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bcf2530a-3250-4047-8717-fe0894072acf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:49.743338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bcf2530a-3250-4047-8717-fe0894072acf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:49.751031 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bcf2530a-3250-4047-8717-fe0894072acf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1364 microversion: 2.1 time: 0.188156 Jul 14 15:25:49.751606 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3453/6871] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:49 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:50.769533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ee784f7-c5c3-40a7-9119-b846ae573f25 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:50.770155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ee784f7-c5c3-40a7-9119-b846ae573f25 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:50.777177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ee784f7-c5c3-40a7-9119-b846ae573f25 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:50.777636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ee784f7-c5c3-40a7-9119-b846ae573f25 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:50.778411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ee784f7-c5c3-40a7-9119-b846ae573f25 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:50.778847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ee784f7-c5c3-40a7-9119-b846ae573f25 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:50.909900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ee784f7-c5c3-40a7-9119-b846ae573f25 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:50.917376 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ee784f7-c5c3-40a7-9119-b846ae573f25 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1364 microversion: 2.1 time: 0.152746 Jul 14 15:25:50.917948 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3419/6872] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:50 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:51.935129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-92490937-1bc2-4d59-a1f1-7dadd6986211 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:51.935751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-92490937-1bc2-4d59-a1f1-7dadd6986211 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:51.943521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92490937-1bc2-4d59-a1f1-7dadd6986211 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:51.943993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92490937-1bc2-4d59-a1f1-7dadd6986211 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:51.944775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92490937-1bc2-4d59-a1f1-7dadd6986211 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:51.945283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-92490937-1bc2-4d59-a1f1-7dadd6986211 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:52.084080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-92490937-1bc2-4d59-a1f1-7dadd6986211 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:52.092552 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-92490937-1bc2-4d59-a1f1-7dadd6986211 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1364 microversion: 2.1 time: 0.161242 Jul 14 15:25:52.093352 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3454/6873] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:51 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:53.111132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-48278855-bbb7-49e4-9586-665828983314 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:53.111752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-48278855-bbb7-49e4-9586-665828983314 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:53.118849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48278855-bbb7-49e4-9586-665828983314 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:53.119310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48278855-bbb7-49e4-9586-665828983314 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:53.120095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48278855-bbb7-49e4-9586-665828983314 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:53.120540 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48278855-bbb7-49e4-9586-665828983314 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:53.246250 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a9d2d317-c070-4272-bbb7-01c3d1317c23 req-4b6c4c4e-3ccd-49c5-99b6-5f4e17727e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75427d60-5953-49c5-a976-6053cf7ef090", "name": "network-vif-plugged", "status": "completed", "tag": "76494747-2cb8-41bd-82bf-05a4b9e0dfb7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:53.257470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a9d2d317-c070-4272-bbb7-01c3d1317c23 req-4b6c4c4e-3ccd-49c5-99b6-5f4e17727e4c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:53.257984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a9d2d317-c070-4272-bbb7-01c3d1317c23 req-4b6c4c4e-3ccd-49c5-99b6-5f4e17727e4c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:53.263686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-48278855-bbb7-49e4-9586-665828983314 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:53.272008 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-48278855-bbb7-49e4-9586-665828983314 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1364 microversion: 2.1 time: 0.165307 Jul 14 15:25:53.272839 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3420/6874] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:53 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:53.278979 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a9d2d317-c070-4272-bbb7-01c3d1317c23 req-4b6c4c4e-3ccd-49c5-99b6-5f4e17727e4c service nova] Creating event network-vif-plugged:76494747-2cb8-41bd-82bf-05a4b9e0dfb7 for instance 75427d60-5953-49c5-a976-6053cf7ef090 on n-h2-767704-28 Jul 14 15:25:53.285881 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a9d2d317-c070-4272-bbb7-01c3d1317c23 req-4b6c4c4e-3ccd-49c5-99b6-5f4e17727e4c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042930 Jul 14 15:25:53.286381 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3455/6875] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:54.291357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4da92fab-3cef-411d-909f-61d7f72e6304 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:54.291995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4da92fab-3cef-411d-909f-61d7f72e6304 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:54.299021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4da92fab-3cef-411d-909f-61d7f72e6304 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:54.299473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4da92fab-3cef-411d-909f-61d7f72e6304 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:54.300248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4da92fab-3cef-411d-909f-61d7f72e6304 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:54.300688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4da92fab-3cef-411d-909f-61d7f72e6304 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:54.443239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4da92fab-3cef-411d-909f-61d7f72e6304 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:54.450880 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4da92fab-3cef-411d-909f-61d7f72e6304 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1364 microversion: 2.1 time: 0.163607 Jul 14 15:25:54.451463 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3421/6876] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:54 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:55.468996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:55.469761 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:55.475422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7f1200fe-4397-465d-80ad-115ff8fb60d8 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:55.476168 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7f1200fe-4397-465d-80ad-115ff8fb60d8 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:55.486422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f1200fe-4397-465d-80ad-115ff8fb60d8 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:55.486893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f1200fe-4397-465d-80ad-115ff8fb60d8 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:55.487695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f1200fe-4397-465d-80ad-115ff8fb60d8 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:55.488148 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7f1200fe-4397-465d-80ad-115ff8fb60d8 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:55.649147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7f1200fe-4397-465d-80ad-115ff8fb60d8 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:55.657291 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7f1200fe-4397-465d-80ad-115ff8fb60d8 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1550 microversion: 2.1 time: 0.191102 Jul 14 15:25:55.657879 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3456/6877] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:55 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1550 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:55.675286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ce0a42d8-f43c-4410-85de-177628244b86 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:55.675286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ce0a42d8-f43c-4410-85de-177628244b86 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:55.677155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:55.683450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce0a42d8-f43c-4410-85de-177628244b86 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:55.683903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce0a42d8-f43c-4410-85de-177628244b86 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:55.684680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce0a42d8-f43c-4410-85de-177628244b86 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:55.685162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce0a42d8-f43c-4410-85de-177628244b86 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:55.786282 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ce0a42d8-f43c-4410-85de-177628244b86 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115822 Jul 14 15:25:55.786912 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3422/6878] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jul 14 15:25:55 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:56.847098 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0ea41e5f-e2d0-4c75-8b9d-ccfd575f1947 req-7d404e23-c794-4932-ae56-639c7db1615b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75427d60-5953-49c5-a976-6053cf7ef090", "tag": "76494747-2cb8-41bd-82bf-05a4b9e0dfb7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:56.855699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0ea41e5f-e2d0-4c75-8b9d-ccfd575f1947 req-7d404e23-c794-4932-ae56-639c7db1615b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:56.856157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0ea41e5f-e2d0-4c75-8b9d-ccfd575f1947 req-7d404e23-c794-4932-ae56-639c7db1615b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:56.867697 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0ea41e5f-e2d0-4c75-8b9d-ccfd575f1947 req-7d404e23-c794-4932-ae56-639c7db1615b service nova] Creating event network-changed:76494747-2cb8-41bd-82bf-05a4b9e0dfb7 for instance 75427d60-5953-49c5-a976-6053cf7ef090 on n-h2-767704-28 Jul 14 15:25:56.872713 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0ea41e5f-e2d0-4c75-8b9d-ccfd575f1947 req-7d404e23-c794-4932-ae56-639c7db1615b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030299 Jul 14 15:25:56.873435 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3457/6879] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:38.912568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=29 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:38.913435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:38.917414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d2287272-37ba-443f-b17a-495128c9487d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:38.918038 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d2287272-37ba-443f-b17a-495128c9487d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:38.926208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2287272-37ba-443f-b17a-495128c9487d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:38.926672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2287272-37ba-443f-b17a-495128c9487d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:38.927444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2287272-37ba-443f-b17a-495128c9487d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:38.927890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2287272-37ba-443f-b17a-495128c9487d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:39.065118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d2287272-37ba-443f-b17a-495128c9487d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:39.072772 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d2287272-37ba-443f-b17a-495128c9487d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1669 microversion: 2.1 time: 0.162197 Jul 14 15:26:39.073390 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3423/6880] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:38 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:39.089364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:39.090555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:39.095679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2968f17c-0a68-40b0-8b8d-b64ebcc1c12f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f1f290b-b96a-4b24-aed4-3f9c2b9c8d08"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:39.096837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2968f17c-0a68-40b0-8b8d-b64ebcc1c12f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:39.105852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2968f17c-0a68-40b0-8b8d-b64ebcc1c12f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:39.106321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2968f17c-0a68-40b0-8b8d-b64ebcc1c12f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:39.107109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2968f17c-0a68-40b0-8b8d-b64ebcc1c12f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:39.107566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2968f17c-0a68-40b0-8b8d-b64ebcc1c12f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:39.356448 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2968f17c-0a68-40b0-8b8d-b64ebcc1c12f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269744 Jul 14 15:26:39.359174 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3458/6881] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 15:26:39 2022] POST /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:48.959278 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:26:48.959909 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:26:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:26:51.075102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:51.076134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:51.079710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:51.080375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:51.086178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:51.086666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:51.087446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:51.087892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:51.116066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:51.122327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Old instance type m1.heat2, new instance type m1.heat {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:26:51.130011 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:26:51.130687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:26:51.131160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:26:51.131569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:26:51.131978 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:26:51.196171 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1278bd81-ea3a-41cd-94ec-9575572e6344 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090/action" status: 202 len: 0 microversion: 2.1 time: 0.124883 Jul 14 15:26:51.196804 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3424/6882] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:26:51 2022] POST /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:26:51.203743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:51.204546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:51.209473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2e6f4634-dbcc-42f8-b12d-06f83e9e0108 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:51.210207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2e6f4634-dbcc-42f8-b12d-06f83e9e0108 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:51.218482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e6f4634-dbcc-42f8-b12d-06f83e9e0108 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:51.219274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e6f4634-dbcc-42f8-b12d-06f83e9e0108 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:51.220088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e6f4634-dbcc-42f8-b12d-06f83e9e0108 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:51.220548 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e6f4634-dbcc-42f8-b12d-06f83e9e0108 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:51.390237 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2e6f4634-dbcc-42f8-b12d-06f83e9e0108 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:51.400411 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2e6f4634-dbcc-42f8-b12d-06f83e9e0108 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1724 microversion: 2.1 time: 0.198855 Jul 14 15:26:51.400690 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3459/6883] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:51 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:52.054117 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:26:52.054327 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 15:26:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:26:52.419509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bbf52d6d-24d7-49d1-9c49-5d7d5f673549 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:52.420148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bbf52d6d-24d7-49d1-9c49-5d7d5f673549 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:52.428230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bbf52d6d-24d7-49d1-9c49-5d7d5f673549 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:52.428692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bbf52d6d-24d7-49d1-9c49-5d7d5f673549 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:52.429501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bbf52d6d-24d7-49d1-9c49-5d7d5f673549 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:52.429953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bbf52d6d-24d7-49d1-9c49-5d7d5f673549 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:52.563860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bbf52d6d-24d7-49d1-9c49-5d7d5f673549 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:52.572000 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bbf52d6d-24d7-49d1-9c49-5d7d5f673549 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1724 microversion: 2.1 time: 0.157490 Jul 14 15:26:52.572576 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3425/6884] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:52 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:53.589479 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c056b2c8-0f7f-4fc0-9be9-c1fdd3cc07bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:53.590117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c056b2c8-0f7f-4fc0-9be9-c1fdd3cc07bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:53.597934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c056b2c8-0f7f-4fc0-9be9-c1fdd3cc07bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:53.598408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c056b2c8-0f7f-4fc0-9be9-c1fdd3cc07bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:53.599210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c056b2c8-0f7f-4fc0-9be9-c1fdd3cc07bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:53.599669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c056b2c8-0f7f-4fc0-9be9-c1fdd3cc07bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:53.789665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c056b2c8-0f7f-4fc0-9be9-c1fdd3cc07bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:53.798215 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c056b2c8-0f7f-4fc0-9be9-c1fdd3cc07bf tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1724 microversion: 2.1 time: 0.212636 Jul 14 15:26:53.799142 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3460/6885] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:53 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:54.815773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7f9fa9cf-c0ea-41ec-9e4e-7789f1542b83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:54.816377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7f9fa9cf-c0ea-41ec-9e4e-7789f1542b83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:54.823009 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f9fa9cf-c0ea-41ec-9e4e-7789f1542b83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:54.823468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f9fa9cf-c0ea-41ec-9e4e-7789f1542b83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:54.824244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f9fa9cf-c0ea-41ec-9e4e-7789f1542b83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:54.824692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7f9fa9cf-c0ea-41ec-9e4e-7789f1542b83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:54.963300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7f9fa9cf-c0ea-41ec-9e4e-7789f1542b83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:54.972092 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7f9fa9cf-c0ea-41ec-9e4e-7789f1542b83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.160415 Jul 14 15:26:54.972671 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3426/6886] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:54 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:55.990323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-66abee97-7b5a-4b91-be24-65a282cfc01c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:55.990964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-66abee97-7b5a-4b91-be24-65a282cfc01c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:55.997982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66abee97-7b5a-4b91-be24-65a282cfc01c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:55.998457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66abee97-7b5a-4b91-be24-65a282cfc01c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:55.999249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66abee97-7b5a-4b91-be24-65a282cfc01c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:55.999709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66abee97-7b5a-4b91-be24-65a282cfc01c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:56.131811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-66abee97-7b5a-4b91-be24-65a282cfc01c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:56.139865 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-66abee97-7b5a-4b91-be24-65a282cfc01c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.153622 Jul 14 15:26:56.140466 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3461/6887] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:55 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:57.158232 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-542a6fd7-0119-4f83-ab8f-d5feb4bc6442 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:57.158786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-542a6fd7-0119-4f83-ab8f-d5feb4bc6442 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:57.166486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-542a6fd7-0119-4f83-ab8f-d5feb4bc6442 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:57.167097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-542a6fd7-0119-4f83-ab8f-d5feb4bc6442 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:57.167998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-542a6fd7-0119-4f83-ab8f-d5feb4bc6442 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:57.168449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-542a6fd7-0119-4f83-ab8f-d5feb4bc6442 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:57.305896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-542a6fd7-0119-4f83-ab8f-d5feb4bc6442 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:57.315015 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-542a6fd7-0119-4f83-ab8f-d5feb4bc6442 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.161340 Jul 14 15:26:57.315585 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3427/6888] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:57 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:58.336454 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8659e926-763f-4f7e-aaba-9e6ba82bdcfb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:58.337120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8659e926-763f-4f7e-aaba-9e6ba82bdcfb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:58.344085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8659e926-763f-4f7e-aaba-9e6ba82bdcfb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:58.344682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8659e926-763f-4f7e-aaba-9e6ba82bdcfb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:58.345507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8659e926-763f-4f7e-aaba-9e6ba82bdcfb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:58.345972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8659e926-763f-4f7e-aaba-9e6ba82bdcfb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:58.477152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8659e926-763f-4f7e-aaba-9e6ba82bdcfb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:58.486103 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8659e926-763f-4f7e-aaba-9e6ba82bdcfb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.153567 Jul 14 15:26:58.486847 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3462/6889] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:58 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:59.504405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed752942-4ae1-4709-88e2-64bbba3b7f83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:59.505063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ed752942-4ae1-4709-88e2-64bbba3b7f83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:59.512279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed752942-4ae1-4709-88e2-64bbba3b7f83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:59.512732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed752942-4ae1-4709-88e2-64bbba3b7f83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:59.513518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed752942-4ae1-4709-88e2-64bbba3b7f83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:59.513957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed752942-4ae1-4709-88e2-64bbba3b7f83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:59.647932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ed752942-4ae1-4709-88e2-64bbba3b7f83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:59.656199 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed752942-4ae1-4709-88e2-64bbba3b7f83 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.156563 Jul 14 15:26:59.657414 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3428/6890] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:59 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:00.674870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-56afe376-cdb2-4197-bf85-4b527696a330 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:00.675416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-56afe376-cdb2-4197-bf85-4b527696a330 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:00.682244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56afe376-cdb2-4197-bf85-4b527696a330 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:00.682725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56afe376-cdb2-4197-bf85-4b527696a330 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:00.683513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56afe376-cdb2-4197-bf85-4b527696a330 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:00.683973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-56afe376-cdb2-4197-bf85-4b527696a330 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:00.817448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-56afe376-cdb2-4197-bf85-4b527696a330 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:00.825580 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-56afe376-cdb2-4197-bf85-4b527696a330 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.155356 Jul 14 15:27:00.826184 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3463/6891] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:00 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:01.843306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-efb109a7-688c-4a24-a10d-29b747771f77 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:01.844609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-efb109a7-688c-4a24-a10d-29b747771f77 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:01.852269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efb109a7-688c-4a24-a10d-29b747771f77 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:01.852724 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efb109a7-688c-4a24-a10d-29b747771f77 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:01.853525 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efb109a7-688c-4a24-a10d-29b747771f77 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:01.853964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efb109a7-688c-4a24-a10d-29b747771f77 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:01.990091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-efb109a7-688c-4a24-a10d-29b747771f77 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:01.998513 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-efb109a7-688c-4a24-a10d-29b747771f77 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.159077 Jul 14 15:27:01.999104 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3429/6892] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:01 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:03.016196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6d07aac9-0b33-41a5-9748-bb11989fafcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:03.017208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6d07aac9-0b33-41a5-9748-bb11989fafcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:03.025865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d07aac9-0b33-41a5-9748-bb11989fafcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:03.026747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d07aac9-0b33-41a5-9748-bb11989fafcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:03.028377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d07aac9-0b33-41a5-9748-bb11989fafcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:03.029239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d07aac9-0b33-41a5-9748-bb11989fafcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:03.173381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6d07aac9-0b33-41a5-9748-bb11989fafcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:03.181446 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6d07aac9-0b33-41a5-9748-bb11989fafcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.169448 Jul 14 15:27:03.182032 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3464/6893] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:03 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:04.199320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7e075b1f-ab0f-43c8-a9f4-ddb60172cc1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:04.199945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7e075b1f-ab0f-43c8-a9f4-ddb60172cc1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:04.207826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e075b1f-ab0f-43c8-a9f4-ddb60172cc1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:04.208293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e075b1f-ab0f-43c8-a9f4-ddb60172cc1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:04.209097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e075b1f-ab0f-43c8-a9f4-ddb60172cc1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:04.209542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e075b1f-ab0f-43c8-a9f4-ddb60172cc1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:04.349661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7e075b1f-ab0f-43c8-a9f4-ddb60172cc1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:04.358323 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7e075b1f-ab0f-43c8-a9f4-ddb60172cc1d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.162792 Jul 14 15:27:04.358899 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3430/6894] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:04 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:05.376711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-319349ca-7ff7-42f3-b5b3-20ac68010729 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:05.377372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-319349ca-7ff7-42f3-b5b3-20ac68010729 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:05.384672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-319349ca-7ff7-42f3-b5b3-20ac68010729 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:05.385191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-319349ca-7ff7-42f3-b5b3-20ac68010729 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:05.385990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-319349ca-7ff7-42f3-b5b3-20ac68010729 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:05.386446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-319349ca-7ff7-42f3-b5b3-20ac68010729 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:05.524205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-319349ca-7ff7-42f3-b5b3-20ac68010729 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:05.533149 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-319349ca-7ff7-42f3-b5b3-20ac68010729 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.160766 Jul 14 15:27:05.533738 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3465/6895] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:05 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:06.551113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1d6c360c-0657-4e6f-851c-88a972f1012e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:06.551765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1d6c360c-0657-4e6f-851c-88a972f1012e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:06.558756 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d6c360c-0657-4e6f-851c-88a972f1012e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:06.559220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d6c360c-0657-4e6f-851c-88a972f1012e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:06.560007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d6c360c-0657-4e6f-851c-88a972f1012e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:06.560461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1d6c360c-0657-4e6f-851c-88a972f1012e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:06.694563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1d6c360c-0657-4e6f-851c-88a972f1012e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:06.702758 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1d6c360c-0657-4e6f-851c-88a972f1012e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.156261 Jul 14 15:27:06.703843 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3431/6896] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:06 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:07.720796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4efb473a-b29c-4a64-a15b-6a0a282c7641 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:07.721460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4efb473a-b29c-4a64-a15b-6a0a282c7641 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:07.728501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4efb473a-b29c-4a64-a15b-6a0a282c7641 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:07.728995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4efb473a-b29c-4a64-a15b-6a0a282c7641 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:07.729786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4efb473a-b29c-4a64-a15b-6a0a282c7641 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:07.730245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4efb473a-b29c-4a64-a15b-6a0a282c7641 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:07.860981 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4efb473a-b29c-4a64-a15b-6a0a282c7641 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:07.869098 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4efb473a-b29c-4a64-a15b-6a0a282c7641 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.153303 Jul 14 15:27:07.869680 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3466/6897] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:07 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:08.887279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0848be7b-fe01-4700-8b55-d64550d6d971 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:08.887898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0848be7b-fe01-4700-8b55-d64550d6d971 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:08.896162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0848be7b-fe01-4700-8b55-d64550d6d971 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:08.896607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0848be7b-fe01-4700-8b55-d64550d6d971 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:08.897602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0848be7b-fe01-4700-8b55-d64550d6d971 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:08.897877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0848be7b-fe01-4700-8b55-d64550d6d971 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:09.045857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0848be7b-fe01-4700-8b55-d64550d6d971 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:09.054107 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0848be7b-fe01-4700-8b55-d64550d6d971 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.170784 Jul 14 15:27:09.054692 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3432/6898] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:08 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:10.071943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-00b9f42e-ba3a-4e29-a39e-a5f4888b0307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:10.072574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-00b9f42e-ba3a-4e29-a39e-a5f4888b0307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:10.080439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00b9f42e-ba3a-4e29-a39e-a5f4888b0307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:10.080903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00b9f42e-ba3a-4e29-a39e-a5f4888b0307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:10.081714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00b9f42e-ba3a-4e29-a39e-a5f4888b0307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:10.082171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00b9f42e-ba3a-4e29-a39e-a5f4888b0307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:10.213786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-00b9f42e-ba3a-4e29-a39e-a5f4888b0307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:10.222819 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-00b9f42e-ba3a-4e29-a39e-a5f4888b0307 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.155005 Jul 14 15:27:10.223714 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3467/6899] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:10 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:11.240886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-13d0f9f9-dc7f-4680-9cf0-698e359246f0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:11.241535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-13d0f9f9-dc7f-4680-9cf0-698e359246f0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:11.248466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13d0f9f9-dc7f-4680-9cf0-698e359246f0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:11.248932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13d0f9f9-dc7f-4680-9cf0-698e359246f0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:11.249740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13d0f9f9-dc7f-4680-9cf0-698e359246f0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:11.251093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13d0f9f9-dc7f-4680-9cf0-698e359246f0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:11.386675 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-13d0f9f9-dc7f-4680-9cf0-698e359246f0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:11.396210 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-13d0f9f9-dc7f-4680-9cf0-698e359246f0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.159333 Jul 14 15:27:11.396795 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3433/6900] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:11 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:12.414247 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7dbd9316-1fc7-4a5c-bc1d-342ae0c35680 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:12.414858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7dbd9316-1fc7-4a5c-bc1d-342ae0c35680 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:12.422493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7dbd9316-1fc7-4a5c-bc1d-342ae0c35680 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:12.422969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7dbd9316-1fc7-4a5c-bc1d-342ae0c35680 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:12.423767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7dbd9316-1fc7-4a5c-bc1d-342ae0c35680 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:12.424228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7dbd9316-1fc7-4a5c-bc1d-342ae0c35680 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:12.557219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7dbd9316-1fc7-4a5c-bc1d-342ae0c35680 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:12.566917 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7dbd9316-1fc7-4a5c-bc1d-342ae0c35680 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1729 microversion: 2.1 time: 0.156590 Jul 14 15:27:12.567509 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3468/6901] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:12 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:27:13.585023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-035a7752-0e49-4c41-b3c3-fd6fb9f88734 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:13.585654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-035a7752-0e49-4c41-b3c3-fd6fb9f88734 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:13.592772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-035a7752-0e49-4c41-b3c3-fd6fb9f88734 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:13.593264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-035a7752-0e49-4c41-b3c3-fd6fb9f88734 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:13.594076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-035a7752-0e49-4c41-b3c3-fd6fb9f88734 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:13.594619 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-035a7752-0e49-4c41-b3c3-fd6fb9f88734 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:14.125579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-035a7752-0e49-4c41-b3c3-fd6fb9f88734 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:14.134952 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-035a7752-0e49-4c41-b3c3-fd6fb9f88734 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1728 microversion: 2.1 time: 0.553372 Jul 14 15:27:14.134952 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3434/6902] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:13 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1728 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:14.223517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a215f059-e922-4da0-b33f-0b7c55248fe1 req-fc6bedcb-cedb-4e2d-bf85-afc71aae89ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75427d60-5953-49c5-a976-6053cf7ef090", "name": "network-vif-unplugged", "status": "completed", "tag": "76494747-2cb8-41bd-82bf-05a4b9e0dfb7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:14.234703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a215f059-e922-4da0-b33f-0b7c55248fe1 req-fc6bedcb-cedb-4e2d-bf85-afc71aae89ac service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:14.235647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a215f059-e922-4da0-b33f-0b7c55248fe1 req-fc6bedcb-cedb-4e2d-bf85-afc71aae89ac service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:14.254308 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a215f059-e922-4da0-b33f-0b7c55248fe1 req-fc6bedcb-cedb-4e2d-bf85-afc71aae89ac service nova] Creating event network-vif-unplugged:76494747-2cb8-41bd-82bf-05a4b9e0dfb7 for instance 75427d60-5953-49c5-a976-6053cf7ef090 on n-h1-767704-28 Jul 14 15:27:14.260170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-a215f059-e922-4da0-b33f-0b7c55248fe1 req-fc6bedcb-cedb-4e2d-bf85-afc71aae89ac service nova] Instance 75427d60-5953-49c5-a976-6053cf7ef090 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:27:14.272442 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a215f059-e922-4da0-b33f-0b7c55248fe1 req-fc6bedcb-cedb-4e2d-bf85-afc71aae89ac service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054641 Jul 14 15:27:14.273352 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3469/6903] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:15.151995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0b9d912d-f82b-4040-8600-4d9ded440534 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:15.152666 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0b9d912d-f82b-4040-8600-4d9ded440534 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:15.160699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b9d912d-f82b-4040-8600-4d9ded440534 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:15.161205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b9d912d-f82b-4040-8600-4d9ded440534 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:15.162029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b9d912d-f82b-4040-8600-4d9ded440534 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:15.162490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0b9d912d-f82b-4040-8600-4d9ded440534 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:15.301026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0b9d912d-f82b-4040-8600-4d9ded440534 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:15.309629 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0b9d912d-f82b-4040-8600-4d9ded440534 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1728 microversion: 2.1 time: 0.161753 Jul 14 15:27:15.310322 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3435/6904] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:15 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:16.290927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3d263d66-0190-471f-b419-39114e0a4dc3 req-6ded2bd1-e9d5-47c1-811f-b81b6dd55073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75427d60-5953-49c5-a976-6053cf7ef090", "tag": "76494747-2cb8-41bd-82bf-05a4b9e0dfb7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:16.300280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3d263d66-0190-471f-b419-39114e0a4dc3 req-6ded2bd1-e9d5-47c1-811f-b81b6dd55073 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:16.300736 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3d263d66-0190-471f-b419-39114e0a4dc3 req-6ded2bd1-e9d5-47c1-811f-b81b6dd55073 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:16.313148 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3d263d66-0190-471f-b419-39114e0a4dc3 req-6ded2bd1-e9d5-47c1-811f-b81b6dd55073 service nova] Creating event network-changed:76494747-2cb8-41bd-82bf-05a4b9e0dfb7 for instance 75427d60-5953-49c5-a976-6053cf7ef090 on n-h1-767704-28 Jul 14 15:27:16.318702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-3d263d66-0190-471f-b419-39114e0a4dc3 req-6ded2bd1-e9d5-47c1-811f-b81b6dd55073 service nova] Instance 75427d60-5953-49c5-a976-6053cf7ef090 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:27:16.328827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-16a36947-2a7b-4ffa-b98a-a46e23a67e7a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:16.329824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-16a36947-2a7b-4ffa-b98a-a46e23a67e7a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:16.330319 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3d263d66-0190-471f-b419-39114e0a4dc3 req-6ded2bd1-e9d5-47c1-811f-b81b6dd55073 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044197 Jul 14 15:27:16.331264 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3470/6905] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:16.337445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16a36947-2a7b-4ffa-b98a-a46e23a67e7a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:16.337908 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16a36947-2a7b-4ffa-b98a-a46e23a67e7a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:16.338694 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16a36947-2a7b-4ffa-b98a-a46e23a67e7a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:16.339141 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-16a36947-2a7b-4ffa-b98a-a46e23a67e7a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:16.697629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-16a36947-2a7b-4ffa-b98a-a46e23a67e7a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:16.709393 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-16a36947-2a7b-4ffa-b98a-a46e23a67e7a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1726 microversion: 2.1 time: 0.385728 Jul 14 15:27:16.711515 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3436/6906] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:16 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1726 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:27:17.729658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-209f5f69-a468-4b11-a753-b2cfc66aef05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:17.730391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-209f5f69-a468-4b11-a753-b2cfc66aef05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:17.737611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-209f5f69-a468-4b11-a753-b2cfc66aef05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:17.738084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-209f5f69-a468-4b11-a753-b2cfc66aef05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:17.738885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-209f5f69-a468-4b11-a753-b2cfc66aef05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:17.739346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-209f5f69-a468-4b11-a753-b2cfc66aef05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:17.879458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-209f5f69-a468-4b11-a753-b2cfc66aef05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:17.888866 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-209f5f69-a468-4b11-a753-b2cfc66aef05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1726 microversion: 2.1 time: 0.164494 Jul 14 15:27:17.889590 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3471/6907] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:17 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:18.907528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ef279f0e-31c7-4950-bb69-d7598d32a3cc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:18.908170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ef279f0e-31c7-4950-bb69-d7598d32a3cc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:18.915443 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef279f0e-31c7-4950-bb69-d7598d32a3cc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:18.915893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef279f0e-31c7-4950-bb69-d7598d32a3cc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:18.916665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef279f0e-31c7-4950-bb69-d7598d32a3cc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:18.917149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef279f0e-31c7-4950-bb69-d7598d32a3cc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:19.066001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ef279f0e-31c7-4950-bb69-d7598d32a3cc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:19.074144 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ef279f0e-31c7-4950-bb69-d7598d32a3cc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1726 microversion: 2.1 time: 0.171148 Jul 14 15:27:19.074725 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3437/6908] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:18 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:20.091836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-53a4e8c6-bdf5-4596-8f09-3c5cb8426d35 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:20.092469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-53a4e8c6-bdf5-4596-8f09-3c5cb8426d35 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:20.101209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-53a4e8c6-bdf5-4596-8f09-3c5cb8426d35 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:20.101687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-53a4e8c6-bdf5-4596-8f09-3c5cb8426d35 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:20.102483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-53a4e8c6-bdf5-4596-8f09-3c5cb8426d35 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:20.102948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-53a4e8c6-bdf5-4596-8f09-3c5cb8426d35 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:20.245223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-53a4e8c6-bdf5-4596-8f09-3c5cb8426d35 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:20.253975 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-53a4e8c6-bdf5-4596-8f09-3c5cb8426d35 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1726 microversion: 2.1 time: 0.166072 Jul 14 15:27:20.254570 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3472/6909] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:20 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:21.272597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eae05db9-37e2-4e1a-920d-acf0ca04b723 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:21.273255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eae05db9-37e2-4e1a-920d-acf0ca04b723 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:21.276194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=33 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:21.282477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eae05db9-37e2-4e1a-920d-acf0ca04b723 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:21.283236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eae05db9-37e2-4e1a-920d-acf0ca04b723 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:21.284570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eae05db9-37e2-4e1a-920d-acf0ca04b723 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:21.285398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eae05db9-37e2-4e1a-920d-acf0ca04b723 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:21.288433 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:21.432859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eae05db9-37e2-4e1a-920d-acf0ca04b723 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:21.441826 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eae05db9-37e2-4e1a-920d-acf0ca04b723 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1726 microversion: 2.1 time: 0.173329 Jul 14 15:27:21.442418 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3438/6910] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:21 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:22.459666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fb1882df-7ffa-4c69-b60f-0ce3551a5531 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:22.460285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fb1882df-7ffa-4c69-b60f-0ce3551a5531 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:22.463174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=29 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:22.469715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb1882df-7ffa-4c69-b60f-0ce3551a5531 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:22.469989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb1882df-7ffa-4c69-b60f-0ce3551a5531 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:22.470792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb1882df-7ffa-4c69-b60f-0ce3551a5531 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:22.471256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fb1882df-7ffa-4c69-b60f-0ce3551a5531 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:22.474225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=81 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:22.609484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fb1882df-7ffa-4c69-b60f-0ce3551a5531 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:22.617734 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fb1882df-7ffa-4c69-b60f-0ce3551a5531 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1726 microversion: 2.1 time: 0.162110 Jul 14 15:27:22.618309 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3473/6911] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:22 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:23.636015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f0f303e4-713e-49f7-bbc9-eb8d8bfd7c79 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:23.636552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f0f303e4-713e-49f7-bbc9-eb8d8bfd7c79 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:23.643776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0f303e4-713e-49f7-bbc9-eb8d8bfd7c79 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:23.644244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0f303e4-713e-49f7-bbc9-eb8d8bfd7c79 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:23.645042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0f303e4-713e-49f7-bbc9-eb8d8bfd7c79 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:23.645486 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f0f303e4-713e-49f7-bbc9-eb8d8bfd7c79 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:23.777895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f0f303e4-713e-49f7-bbc9-eb8d8bfd7c79 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:23.786667 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f0f303e4-713e-49f7-bbc9-eb8d8bfd7c79 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1726 microversion: 2.1 time: 0.154739 Jul 14 15:27:23.787251 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3439/6912] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:23 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:24.803501 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f459fdc-0133-4410-8b0d-2d8051c94d1f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:24.804167 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3f459fdc-0133-4410-8b0d-2d8051c94d1f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:24.811609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f459fdc-0133-4410-8b0d-2d8051c94d1f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:24.812640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f459fdc-0133-4410-8b0d-2d8051c94d1f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:24.813490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f459fdc-0133-4410-8b0d-2d8051c94d1f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:24.813954 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f459fdc-0133-4410-8b0d-2d8051c94d1f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:24.953436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3f459fdc-0133-4410-8b0d-2d8051c94d1f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:24.961674 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f459fdc-0133-4410-8b0d-2d8051c94d1f tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1726 microversion: 2.1 time: 0.162094 Jul 14 15:27:24.962265 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3474/6913] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:24 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:25.979800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9506b3c7-ac1a-4db4-a99b-5321cda51086 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:25.980421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9506b3c7-ac1a-4db4-a99b-5321cda51086 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:25.988424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9506b3c7-ac1a-4db4-a99b-5321cda51086 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:25.988888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9506b3c7-ac1a-4db4-a99b-5321cda51086 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:25.990107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9506b3c7-ac1a-4db4-a99b-5321cda51086 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:25.990227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9506b3c7-ac1a-4db4-a99b-5321cda51086 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:26.123480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9506b3c7-ac1a-4db4-a99b-5321cda51086 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:26.132555 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9506b3c7-ac1a-4db4-a99b-5321cda51086 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1726 microversion: 2.1 time: 0.156744 Jul 14 15:27:26.133167 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3440/6914] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:25 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:27.150638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-67120a10-a377-436c-88f5-79fa75926c28 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:27.151307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-67120a10-a377-436c-88f5-79fa75926c28 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:27.159217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67120a10-a377-436c-88f5-79fa75926c28 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:27.159636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67120a10-a377-436c-88f5-79fa75926c28 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:27.160427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67120a10-a377-436c-88f5-79fa75926c28 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:27.160885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-67120a10-a377-436c-88f5-79fa75926c28 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:27.298821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-67120a10-a377-436c-88f5-79fa75926c28 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:27.307294 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-67120a10-a377-436c-88f5-79fa75926c28 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1726 microversion: 2.1 time: 0.160769 Jul 14 15:27:27.307881 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3475/6915] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:27 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:28.324397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0858e7bc-318b-4a6d-8c1e-526b257afa90 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:28.325081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0858e7bc-318b-4a6d-8c1e-526b257afa90 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:28.332493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0858e7bc-318b-4a6d-8c1e-526b257afa90 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:28.332880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0858e7bc-318b-4a6d-8c1e-526b257afa90 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:28.333689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0858e7bc-318b-4a6d-8c1e-526b257afa90 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:28.334135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0858e7bc-318b-4a6d-8c1e-526b257afa90 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:28.474834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0858e7bc-318b-4a6d-8c1e-526b257afa90 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:28.483728 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0858e7bc-318b-4a6d-8c1e-526b257afa90 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1723 microversion: 2.1 time: 0.163211 Jul 14 15:27:28.485433 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3441/6916] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:28 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:28.501735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:28.502301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:28.510017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:28.510590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:28.511403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:28.511863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:28.553617 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:28.554089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:28.554911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:28.555369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:28.580019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:27:28.585591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Getting quotas for user cdf1867943324a83b94bef9d185e84eb and project 3e44d74d04804f09b17d02ec80f654fa. Resources: {'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:27:28.694577 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f68c1e61-32c8-4a74-8538-49101b3f0fcc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "POST /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090/action" status: 202 len: 0 microversion: 2.1 time: 0.197078 Jul 14 15:27:28.695216 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3476/6917] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:27:28 2022] POST /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:27:28.703710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6382ba54-a076-4c4f-afc6-aaba54c9e2eb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:28.705004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6382ba54-a076-4c4f-afc6-aaba54c9e2eb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:28.711574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6382ba54-a076-4c4f-afc6-aaba54c9e2eb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:28.712029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6382ba54-a076-4c4f-afc6-aaba54c9e2eb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:28.712987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6382ba54-a076-4c4f-afc6-aaba54c9e2eb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:28.713505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6382ba54-a076-4c4f-afc6-aaba54c9e2eb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:28.919560 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6382ba54-a076-4c4f-afc6-aaba54c9e2eb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:28.927711 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6382ba54-a076-4c4f-afc6-aaba54c9e2eb tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.227999 Jul 14 15:27:28.928294 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3442/6918] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:28 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:29.945934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-035e88cb-8a9c-481a-9b89-5026dff0302a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:29.946661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-035e88cb-8a9c-481a-9b89-5026dff0302a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:29.954811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-035e88cb-8a9c-481a-9b89-5026dff0302a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:29.955288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-035e88cb-8a9c-481a-9b89-5026dff0302a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:29.956090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-035e88cb-8a9c-481a-9b89-5026dff0302a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:29.956550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-035e88cb-8a9c-481a-9b89-5026dff0302a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:30.076628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-75daf83d-bf1d-4a5b-96d5-9445d6849f17 req-e1213702-9ce9-47f0-b94d-8062dfc36444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75427d60-5953-49c5-a976-6053cf7ef090", "name": "network-vif-plugged", "status": "completed", "tag": "76494747-2cb8-41bd-82bf-05a4b9e0dfb7"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:30.087123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-75daf83d-bf1d-4a5b-96d5-9445d6849f17 req-e1213702-9ce9-47f0-b94d-8062dfc36444 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:30.088003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-75daf83d-bf1d-4a5b-96d5-9445d6849f17 req-e1213702-9ce9-47f0-b94d-8062dfc36444 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:30.100643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-035e88cb-8a9c-481a-9b89-5026dff0302a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:30.101405 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-75daf83d-bf1d-4a5b-96d5-9445d6849f17 req-e1213702-9ce9-47f0-b94d-8062dfc36444 service nova] Creating event network-vif-plugged:76494747-2cb8-41bd-82bf-05a4b9e0dfb7 for instance 75427d60-5953-49c5-a976-6053cf7ef090 on n-h1-767704-28 Jul 14 15:27:30.107309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-75daf83d-bf1d-4a5b-96d5-9445d6849f17 req-e1213702-9ce9-47f0-b94d-8062dfc36444 service nova] Instance 75427d60-5953-49c5-a976-6053cf7ef090 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-767704-28', 'n-h2-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:27:30.109833 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-035e88cb-8a9c-481a-9b89-5026dff0302a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.168209 Jul 14 15:27:30.112980 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3477/6919] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:29 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:30.128062 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-75daf83d-bf1d-4a5b-96d5-9445d6849f17 req-e1213702-9ce9-47f0-b94d-8062dfc36444 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055233 Jul 14 15:27:30.128695 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3443/6920] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:31.127465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-af660bb4-c3bb-43be-a779-23259b69a066 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:31.128103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-af660bb4-c3bb-43be-a779-23259b69a066 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:31.135292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af660bb4-c3bb-43be-a779-23259b69a066 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:31.135763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af660bb4-c3bb-43be-a779-23259b69a066 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:31.136554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af660bb4-c3bb-43be-a779-23259b69a066 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:31.137048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-af660bb4-c3bb-43be-a779-23259b69a066 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:31.284746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-af660bb4-c3bb-43be-a779-23259b69a066 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:31.293113 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-af660bb4-c3bb-43be-a779-23259b69a066 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.169576 Jul 14 15:27:31.293718 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3478/6921] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:31 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:32.311905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2710a86f-95db-470a-a7e1-6ac63fc145a1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:32.313169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2710a86f-95db-470a-a7e1-6ac63fc145a1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:32.319589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2710a86f-95db-470a-a7e1-6ac63fc145a1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:32.320056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2710a86f-95db-470a-a7e1-6ac63fc145a1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:32.320831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2710a86f-95db-470a-a7e1-6ac63fc145a1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:32.321304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2710a86f-95db-470a-a7e1-6ac63fc145a1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:32.458867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2710a86f-95db-470a-a7e1-6ac63fc145a1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:32.467538 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2710a86f-95db-470a-a7e1-6ac63fc145a1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.160873 Jul 14 15:27:32.468116 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3444/6922] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:32 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:33.487013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab5d4549-500e-462a-8deb-faa9c938d804 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:33.487773 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ab5d4549-500e-462a-8deb-faa9c938d804 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:33.496126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab5d4549-500e-462a-8deb-faa9c938d804 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:33.496606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab5d4549-500e-462a-8deb-faa9c938d804 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:33.497473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab5d4549-500e-462a-8deb-faa9c938d804 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:33.498584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab5d4549-500e-462a-8deb-faa9c938d804 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:33.643921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab5d4549-500e-462a-8deb-faa9c938d804 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:33.652911 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ab5d4549-500e-462a-8deb-faa9c938d804 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.171419 Jul 14 15:27:33.656794 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3479/6923] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:33 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:34.670657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f4ff59be-13fb-4ecc-bf58-a926e015a4b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:34.671482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f4ff59be-13fb-4ecc-bf58-a926e015a4b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:34.679448 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4ff59be-13fb-4ecc-bf58-a926e015a4b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:34.679901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4ff59be-13fb-4ecc-bf58-a926e015a4b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:34.680711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4ff59be-13fb-4ecc-bf58-a926e015a4b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:34.681236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4ff59be-13fb-4ecc-bf58-a926e015a4b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:34.727156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-0bfc31fd-4586-4967-8caa-6f1ecf4d1eba req-afea6942-8f40-451e-a193-7c730c90329d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75427d60-5953-49c5-a976-6053cf7ef090", "name": "network-vif-unplugged", "status": "completed", "tag": "76494747-2cb8-41bd-82bf-05a4b9e0dfb7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:34.737727 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0bfc31fd-4586-4967-8caa-6f1ecf4d1eba req-afea6942-8f40-451e-a193-7c730c90329d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:34.738196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-0bfc31fd-4586-4967-8caa-6f1ecf4d1eba req-afea6942-8f40-451e-a193-7c730c90329d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:34.751803 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-0bfc31fd-4586-4967-8caa-6f1ecf4d1eba req-afea6942-8f40-451e-a193-7c730c90329d service nova] Creating event network-vif-unplugged:76494747-2cb8-41bd-82bf-05a4b9e0dfb7 for instance 75427d60-5953-49c5-a976-6053cf7ef090 on n-h2-767704-28 Jul 14 15:27:34.758452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-0bfc31fd-4586-4967-8caa-6f1ecf4d1eba req-afea6942-8f40-451e-a193-7c730c90329d service nova] Instance 75427d60-5953-49c5-a976-6053cf7ef090 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:27:34.770657 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-0bfc31fd-4586-4967-8caa-6f1ecf4d1eba req-afea6942-8f40-451e-a193-7c730c90329d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047107 Jul 14 15:27:34.771368 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3480/6924] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:27:34.932872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f4ff59be-13fb-4ecc-bf58-a926e015a4b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:34.943145 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f4ff59be-13fb-4ecc-bf58-a926e015a4b5 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.276305 Jul 14 15:27:34.944146 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3445/6925] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:34 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:35.961894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-25c9555d-a1f9-4628-af4e-85c8433b342c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:35.964013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-25c9555d-a1f9-4628-af4e-85c8433b342c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:35.973333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25c9555d-a1f9-4628-af4e-85c8433b342c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:35.973924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25c9555d-a1f9-4628-af4e-85c8433b342c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:35.975054 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25c9555d-a1f9-4628-af4e-85c8433b342c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:35.975601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25c9555d-a1f9-4628-af4e-85c8433b342c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:36.181103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-25c9555d-a1f9-4628-af4e-85c8433b342c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:36.189849 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-25c9555d-a1f9-4628-af4e-85c8433b342c tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.232808 Jul 14 15:27:36.190723 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3481/6926] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:35 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:36.787865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-40a2beff-f82e-4f0c-a692-d8fc3a0fbf64 req-f64a0b54-863d-4ea2-8ac8-cd28ae70628a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75427d60-5953-49c5-a976-6053cf7ef090", "tag": "76494747-2cb8-41bd-82bf-05a4b9e0dfb7"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:36.797669 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-40a2beff-f82e-4f0c-a692-d8fc3a0fbf64 req-f64a0b54-863d-4ea2-8ac8-cd28ae70628a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:36.798052 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-40a2beff-f82e-4f0c-a692-d8fc3a0fbf64 req-f64a0b54-863d-4ea2-8ac8-cd28ae70628a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:36.811218 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-40a2beff-f82e-4f0c-a692-d8fc3a0fbf64 req-f64a0b54-863d-4ea2-8ac8-cd28ae70628a service nova] Creating event network-changed:76494747-2cb8-41bd-82bf-05a4b9e0dfb7 for instance 75427d60-5953-49c5-a976-6053cf7ef090 on n-h2-767704-28 Jul 14 15:27:36.818512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-40a2beff-f82e-4f0c-a692-d8fc3a0fbf64 req-f64a0b54-863d-4ea2-8ac8-cd28ae70628a service nova] Instance 75427d60-5953-49c5-a976-6053cf7ef090 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:27:36.830302 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-40a2beff-f82e-4f0c-a692-d8fc3a0fbf64 req-f64a0b54-863d-4ea2-8ac8-cd28ae70628a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046032 Jul 14 15:27:36.830914 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3446/6927] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:37.207238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-528c3835-3e34-4632-af04-574a595b01a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:37.208090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-528c3835-3e34-4632-af04-574a595b01a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:37.215810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-528c3835-3e34-4632-af04-574a595b01a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:37.216357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-528c3835-3e34-4632-af04-574a595b01a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:37.217252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-528c3835-3e34-4632-af04-574a595b01a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:37.217843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-528c3835-3e34-4632-af04-574a595b01a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:37.510690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-528c3835-3e34-4632-af04-574a595b01a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:37.520632 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-528c3835-3e34-4632-af04-574a595b01a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.317619 Jul 14 15:27:37.521343 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3482/6928] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:37 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:38.540149 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6a051fd4-8ee7-48be-a0c6-ac386d4ccc2d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:38.540856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6a051fd4-8ee7-48be-a0c6-ac386d4ccc2d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:38.547286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a051fd4-8ee7-48be-a0c6-ac386d4ccc2d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:38.547745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a051fd4-8ee7-48be-a0c6-ac386d4ccc2d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:38.548520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a051fd4-8ee7-48be-a0c6-ac386d4ccc2d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:38.548992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6a051fd4-8ee7-48be-a0c6-ac386d4ccc2d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:38.699988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6a051fd4-8ee7-48be-a0c6-ac386d4ccc2d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:38.708609 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6a051fd4-8ee7-48be-a0c6-ac386d4ccc2d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.173649 Jul 14 15:27:38.709239 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3447/6929] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:38 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:39.726118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a1c25bad-c521-4101-8b2f-21c025f0c074 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:39.726751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a1c25bad-c521-4101-8b2f-21c025f0c074 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:39.730018 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:39.736742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1c25bad-c521-4101-8b2f-21c025f0c074 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:39.737244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1c25bad-c521-4101-8b2f-21c025f0c074 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:39.738049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1c25bad-c521-4101-8b2f-21c025f0c074 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:39.738507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a1c25bad-c521-4101-8b2f-21c025f0c074 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:39.878484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a1c25bad-c521-4101-8b2f-21c025f0c074 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:39.886985 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a1c25bad-c521-4101-8b2f-21c025f0c074 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.164744 Jul 14 15:27:39.887581 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3483/6930] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:39 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:40.903729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-83b25705-2eb3-4f46-902b-c0bb01520c96 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:40.904511 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-83b25705-2eb3-4f46-902b-c0bb01520c96 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:40.911758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83b25705-2eb3-4f46-902b-c0bb01520c96 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:40.912219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83b25705-2eb3-4f46-902b-c0bb01520c96 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:40.913036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83b25705-2eb3-4f46-902b-c0bb01520c96 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:40.913481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-83b25705-2eb3-4f46-902b-c0bb01520c96 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:41.054468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-83b25705-2eb3-4f46-902b-c0bb01520c96 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:41.063509 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-83b25705-2eb3-4f46-902b-c0bb01520c96 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.163687 Jul 14 15:27:41.064100 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3448/6931] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:40 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:42.080606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac5bc2de-1438-4f98-be65-55c39f2281a0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:42.081271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac5bc2de-1438-4f98-be65-55c39f2281a0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:42.088262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac5bc2de-1438-4f98-be65-55c39f2281a0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:42.088738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac5bc2de-1438-4f98-be65-55c39f2281a0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:42.089633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac5bc2de-1438-4f98-be65-55c39f2281a0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:42.090094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac5bc2de-1438-4f98-be65-55c39f2281a0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:42.227344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac5bc2de-1438-4f98-be65-55c39f2281a0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:42.236407 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac5bc2de-1438-4f98-be65-55c39f2281a0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.159640 Jul 14 15:27:42.237014 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3484/6932] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:42 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:43.254509 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0aa36921-6523-49a2-8c73-5828c9ba219d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:43.255189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0aa36921-6523-49a2-8c73-5828c9ba219d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:43.261966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0aa36921-6523-49a2-8c73-5828c9ba219d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:43.262428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0aa36921-6523-49a2-8c73-5828c9ba219d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:43.263210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0aa36921-6523-49a2-8c73-5828c9ba219d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:43.263660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0aa36921-6523-49a2-8c73-5828c9ba219d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:43.406797 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0aa36921-6523-49a2-8c73-5828c9ba219d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:43.415043 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0aa36921-6523-49a2-8c73-5828c9ba219d tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.165257 Jul 14 15:27:43.415633 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3449/6933] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:43 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:44.432305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-297f18a6-3bfb-4d95-a768-4a4f39aa4b05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:44.433055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-297f18a6-3bfb-4d95-a768-4a4f39aa4b05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:44.440538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-297f18a6-3bfb-4d95-a768-4a4f39aa4b05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:44.441031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-297f18a6-3bfb-4d95-a768-4a4f39aa4b05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:44.441816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-297f18a6-3bfb-4d95-a768-4a4f39aa4b05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:44.442266 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-297f18a6-3bfb-4d95-a768-4a4f39aa4b05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:44.583258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-297f18a6-3bfb-4d95-a768-4a4f39aa4b05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:44.592153 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-297f18a6-3bfb-4d95-a768-4a4f39aa4b05 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.163836 Jul 14 15:27:44.592741 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3485/6934] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:44 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:45.609884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a9fbf719-ce9b-4d4b-bd06-fb5256aff0d1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:45.610503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a9fbf719-ce9b-4d4b-bd06-fb5256aff0d1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:45.617656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9fbf719-ce9b-4d4b-bd06-fb5256aff0d1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:45.618137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9fbf719-ce9b-4d4b-bd06-fb5256aff0d1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:45.618963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9fbf719-ce9b-4d4b-bd06-fb5256aff0d1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:45.619400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a9fbf719-ce9b-4d4b-bd06-fb5256aff0d1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:45.753077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a9fbf719-ce9b-4d4b-bd06-fb5256aff0d1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:45.761425 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a9fbf719-ce9b-4d4b-bd06-fb5256aff0d1 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.155789 Jul 14 15:27:45.762006 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3450/6935] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:45 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:46.778851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3459c362-5684-4872-95d8-018281520fdc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:46.779457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3459c362-5684-4872-95d8-018281520fdc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:46.787191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3459c362-5684-4872-95d8-018281520fdc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:46.787652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3459c362-5684-4872-95d8-018281520fdc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:46.788436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3459c362-5684-4872-95d8-018281520fdc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:46.788888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3459c362-5684-4872-95d8-018281520fdc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:46.924067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3459c362-5684-4872-95d8-018281520fdc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:46.932223 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3459c362-5684-4872-95d8-018281520fdc tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.157513 Jul 14 15:27:46.932790 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3486/6936] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:46 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:47.948914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d4da484-53a0-406b-82fa-ca791931ae4a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:47.949546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d4da484-53a0-406b-82fa-ca791931ae4a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:47.957228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d4da484-53a0-406b-82fa-ca791931ae4a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:47.957688 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d4da484-53a0-406b-82fa-ca791931ae4a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:47.958466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d4da484-53a0-406b-82fa-ca791931ae4a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:47.958900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d4da484-53a0-406b-82fa-ca791931ae4a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:48.101376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7d4da484-53a0-406b-82fa-ca791931ae4a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:48.110371 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d4da484-53a0-406b-82fa-ca791931ae4a tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1722 microversion: 2.1 time: 0.165288 Jul 14 15:27:48.111008 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3451/6937] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:47 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:49.128147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f4bd90ed-f23d-41dd-97ce-092d10516c48 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:49.128777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f4bd90ed-f23d-41dd-97ce-092d10516c48 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:49.136031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4bd90ed-f23d-41dd-97ce-092d10516c48 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:49.136497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4bd90ed-f23d-41dd-97ce-092d10516c48 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:49.137317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4bd90ed-f23d-41dd-97ce-092d10516c48 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:49.137775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f4bd90ed-f23d-41dd-97ce-092d10516c48 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:49.140991 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:49.275409 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f4bd90ed-f23d-41dd-97ce-092d10516c48 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:49.284504 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f4bd90ed-f23d-41dd-97ce-092d10516c48 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1715 microversion: 2.1 time: 0.160680 Jul 14 15:27:49.285128 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3487/6938] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:49 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:49.300819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-affb7571-bc0c-4e6f-bd36-d469fd99bdb0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:49.301461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-affb7571-bc0c-4e6f-bd36-d469fd99bdb0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:49.308431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-affb7571-bc0c-4e6f-bd36-d469fd99bdb0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:49.308882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-affb7571-bc0c-4e6f-bd36-d469fd99bdb0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:49.309744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-affb7571-bc0c-4e6f-bd36-d469fd99bdb0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:49.310184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-affb7571-bc0c-4e6f-bd36-d469fd99bdb0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:49.448258 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-affb7571-bc0c-4e6f-bd36-d469fd99bdb0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:49.456930 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-affb7571-bc0c-4e6f-bd36-d469fd99bdb0 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1715 microversion: 2.1 time: 0.160053 Jul 14 15:27:49.457527 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3452/6939] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:49 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:49.473810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab242f96-2e78-4954-b5a4-b85a14ec7035 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:49.474370 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ab242f96-2e78-4954-b5a4-b85a14ec7035 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:49.480546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab242f96-2e78-4954-b5a4-b85a14ec7035 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:49.481041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab242f96-2e78-4954-b5a4-b85a14ec7035 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:49.481820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab242f96-2e78-4954-b5a4-b85a14ec7035 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:49.482268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab242f96-2e78-4954-b5a4-b85a14ec7035 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:49.618497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab242f96-2e78-4954-b5a4-b85a14ec7035 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:49.626705 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ab242f96-2e78-4954-b5a4-b85a14ec7035 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1715 microversion: 2.1 time: 0.156767 Jul 14 15:27:49.627279 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3488/6940] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:49 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:27:49.643248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d2606128-732e-4a9c-939e-64e3af0ee9ca tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:49.643754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d2606128-732e-4a9c-939e-64e3af0ee9ca tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:49.649802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2606128-732e-4a9c-939e-64e3af0ee9ca tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:49.650261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2606128-732e-4a9c-939e-64e3af0ee9ca tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:49.651065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2606128-732e-4a9c-939e-64e3af0ee9ca tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:49.651508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d2606128-732e-4a9c-939e-64e3af0ee9ca tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:49.678194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d2606128-732e-4a9c-939e-64e3af0ee9ca tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:27:49.731996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:49.761344 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d2606128-732e-4a9c-939e-64e3af0ee9ca tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "DELETE /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 204 len: 0 microversion: 2.1 time: 0.121752 Jul 14 15:27:49.762139 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3453/6941] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:27:49 2022] DELETE /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:27:49.771249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b66f8bb0-fd7d-44f4-8f6e-d219fcb5294b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:49.771894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b66f8bb0-fd7d-44f4-8f6e-d219fcb5294b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:49.778089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b66f8bb0-fd7d-44f4-8f6e-d219fcb5294b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:49.778560 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b66f8bb0-fd7d-44f4-8f6e-d219fcb5294b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:49.779350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b66f8bb0-fd7d-44f4-8f6e-d219fcb5294b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:49.779809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b66f8bb0-fd7d-44f4-8f6e-d219fcb5294b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:49.919281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b66f8bb0-fd7d-44f4-8f6e-d219fcb5294b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:49.929772 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b66f8bb0-fd7d-44f4-8f6e-d219fcb5294b tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1721 microversion: 2.1 time: 0.162374 Jul 14 15:27:49.930543 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3489/6942] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:49 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:27:50.948902 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-285f5548-7406-4805-8edc-b98300ca1dd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:50.949655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-285f5548-7406-4805-8edc-b98300ca1dd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:50.957840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285f5548-7406-4805-8edc-b98300ca1dd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:50.958431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285f5548-7406-4805-8edc-b98300ca1dd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:50.959260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285f5548-7406-4805-8edc-b98300ca1dd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:50.959712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-285f5548-7406-4805-8edc-b98300ca1dd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:51.097446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-285f5548-7406-4805-8edc-b98300ca1dd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:51.105667 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-285f5548-7406-4805-8edc-b98300ca1dd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1721 microversion: 2.1 time: 0.161068 Jul 14 15:27:51.106253 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3454/6943] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:50 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:51.842318 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b9b307e8-71b9-483c-abc4-4a2cb084f9b0 req-30a92ae4-c6a0-4042-a693-d69abea5eaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75427d60-5953-49c5-a976-6053cf7ef090", "name": "network-vif-plugged", "status": "completed", "tag": "76494747-2cb8-41bd-82bf-05a4b9e0dfb7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:51.856070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b9b307e8-71b9-483c-abc4-4a2cb084f9b0 req-30a92ae4-c6a0-4042-a693-d69abea5eaf2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:51.856627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b9b307e8-71b9-483c-abc4-4a2cb084f9b0 req-30a92ae4-c6a0-4042-a693-d69abea5eaf2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:51.870243 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b9b307e8-71b9-483c-abc4-4a2cb084f9b0 req-30a92ae4-c6a0-4042-a693-d69abea5eaf2 service nova] Creating event network-vif-plugged:76494747-2cb8-41bd-82bf-05a4b9e0dfb7 for instance 75427d60-5953-49c5-a976-6053cf7ef090 on n-h2-767704-28 Jul 14 15:27:51.876467 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b9b307e8-71b9-483c-abc4-4a2cb084f9b0 req-30a92ae4-c6a0-4042-a693-d69abea5eaf2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037982 Jul 14 15:27:51.877860 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3490/6944] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:52.124091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dc4fa971-325a-4a42-a9de-1bc3455c14e2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:52.125871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dc4fa971-325a-4a42-a9de-1bc3455c14e2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:52.128732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:52.134541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc4fa971-325a-4a42-a9de-1bc3455c14e2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:52.135002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc4fa971-325a-4a42-a9de-1bc3455c14e2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:52.135779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc4fa971-325a-4a42-a9de-1bc3455c14e2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:52.136219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc4fa971-325a-4a42-a9de-1bc3455c14e2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:52.374934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dc4fa971-325a-4a42-a9de-1bc3455c14e2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:52.386901 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dc4fa971-325a-4a42-a9de-1bc3455c14e2 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1721 microversion: 2.1 time: 0.266697 Jul 14 15:27:52.396577 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3455/6945] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:52 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:52.894508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b811482d-d263-47e2-be6b-9a793446b82b req-3cd9a866-a53a-498f-8a58-862d342a3f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75427d60-5953-49c5-a976-6053cf7ef090", "name": "network-vif-deleted", "tag": "76494747-2cb8-41bd-82bf-05a4b9e0dfb7"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:52.900338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:52.910232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b811482d-d263-47e2-be6b-9a793446b82b req-3cd9a866-a53a-498f-8a58-862d342a3f39 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:52.910699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b811482d-d263-47e2-be6b-9a793446b82b req-3cd9a866-a53a-498f-8a58-862d342a3f39 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:52.924382 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b811482d-d263-47e2-be6b-9a793446b82b req-3cd9a866-a53a-498f-8a58-862d342a3f39 service nova] Creating event network-vif-deleted:76494747-2cb8-41bd-82bf-05a4b9e0dfb7 for instance 75427d60-5953-49c5-a976-6053cf7ef090 on n-h2-767704-28 Jul 14 15:27:52.930126 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b811482d-d263-47e2-be6b-9a793446b82b req-3cd9a866-a53a-498f-8a58-862d342a3f39 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041735 Jul 14 15:27:52.931306 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3491/6946] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:53.403816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-50f84b02-50e8-48f8-a274-a03b36e4e4a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:53.405190 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-50f84b02-50e8-48f8-a274-a03b36e4e4a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:53.413219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50f84b02-50e8-48f8-a274-a03b36e4e4a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:53.414045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50f84b02-50e8-48f8-a274-a03b36e4e4a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:53.415124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50f84b02-50e8-48f8-a274-a03b36e4e4a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:53.415785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50f84b02-50e8-48f8-a274-a03b36e4e4a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:53.482893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-50f84b02-50e8-48f8-a274-a03b36e4e4a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:53.493967 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-50f84b02-50e8-48f8-a274-a03b36e4e4a7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1369 microversion: 2.1 time: 0.093277 Jul 14 15:27:53.494583 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3456/6947] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:53 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:54.513892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b16be625-6c0b-4eb8-959d-e5da14fcbce9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:54.514616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b16be625-6c0b-4eb8-959d-e5da14fcbce9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:54.521859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b16be625-6c0b-4eb8-959d-e5da14fcbce9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:54.522326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b16be625-6c0b-4eb8-959d-e5da14fcbce9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:54.523116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b16be625-6c0b-4eb8-959d-e5da14fcbce9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:54.523566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b16be625-6c0b-4eb8-959d-e5da14fcbce9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:54.590870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b16be625-6c0b-4eb8-959d-e5da14fcbce9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:54.600225 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b16be625-6c0b-4eb8-959d-e5da14fcbce9 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1369 microversion: 2.1 time: 0.091452 Jul 14 15:27:54.600858 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3492/6948] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:54 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:55.618184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8426345f-40be-4379-aff5-e9f2c9e44753 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:55.618867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8426345f-40be-4379-aff5-e9f2c9e44753 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:55.626213 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8426345f-40be-4379-aff5-e9f2c9e44753 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:55.626671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8426345f-40be-4379-aff5-e9f2c9e44753 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:55.627459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8426345f-40be-4379-aff5-e9f2c9e44753 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:55.627907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8426345f-40be-4379-aff5-e9f2c9e44753 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:55.699457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8426345f-40be-4379-aff5-e9f2c9e44753 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:55.708570 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8426345f-40be-4379-aff5-e9f2c9e44753 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1369 microversion: 2.1 time: 0.094464 Jul 14 15:27:55.709188 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3457/6949] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:55 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:56.726078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c8bcd4f3-14fa-4546-8ef5-9f1dfecfb4b7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:56.727966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c8bcd4f3-14fa-4546-8ef5-9f1dfecfb4b7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:56.734821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8bcd4f3-14fa-4546-8ef5-9f1dfecfb4b7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:56.735526 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8bcd4f3-14fa-4546-8ef5-9f1dfecfb4b7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:56.736419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8bcd4f3-14fa-4546-8ef5-9f1dfecfb4b7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:56.736915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c8bcd4f3-14fa-4546-8ef5-9f1dfecfb4b7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:56.802182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c8bcd4f3-14fa-4546-8ef5-9f1dfecfb4b7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf1867943324a83b94bef9d185e84eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44d74d04804f09b17d02ec80f654fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:56.810399 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c8bcd4f3-14fa-4546-8ef5-9f1dfecfb4b7 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 200 len: 1369 microversion: 2.1 time: 0.088260 Jul 14 15:27:56.810984 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3493/6950] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:56 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:57.828399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4fb3b9fc-9e1e-42f7-bac0-7534e2b363ee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:57.828925 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4fb3b9fc-9e1e-42f7-bac0-7534e2b363ee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:57.835895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fb3b9fc-9e1e-42f7-bac0-7534e2b363ee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:57.836357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fb3b9fc-9e1e-42f7-bac0-7534e2b363ee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:57.837305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fb3b9fc-9e1e-42f7-bac0-7534e2b363ee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:57.837749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4fb3b9fc-9e1e-42f7-bac0-7534e2b363ee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:57.851638 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-4fb3b9fc-9e1e-42f7-bac0-7534e2b363ee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4fb3b9fc-9e1e-42f7-bac0-7534e2b363ee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 HTTP/1.1 Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '75427d60-5953-49c5-a976-6053cf7ef090'} Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:27:57.853328 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:27:57.857436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:27:57.857436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:27:57.857436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:27:57.857436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:27:57.857436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:27:57.857436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:27:57.857436 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:27:57.857436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4fb3b9fc-9e1e-42f7-bac0-7534e2b363ee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:27:57.857436 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4fb3b9fc-9e1e-42f7-bac0-7534e2b363ee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 404 len: 111 microversion: 2.1 time: 0.031171 Jul 14 15:27:57.857436 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3458/6951] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:57 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:27:57.912146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37756cf1-e517-4651-a381-28cda136c06e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:57.913129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-37756cf1-e517-4651-a381-28cda136c06e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:57.920356 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37756cf1-e517-4651-a381-28cda136c06e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:57.920822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37756cf1-e517-4651-a381-28cda136c06e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:57.922206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37756cf1-e517-4651-a381-28cda136c06e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:57.922668 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37756cf1-e517-4651-a381-28cda136c06e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:57.935509 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-37756cf1-e517-4651-a381-28cda136c06e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37756cf1-e517-4651-a381-28cda136c06e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090/os-volume_attachments HTTP/1.1 Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'server_id': '75427d60-5953-49c5-a976-6053cf7ef090'} Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:27:57.938581 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37756cf1-e517-4651-a381-28cda136c06e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-37756cf1-e517-4651-a381-28cda136c06e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032091 Jul 14 15:27:57.942770 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3494/6952] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:27:57 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:01.259910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-222e7cc2-eb2c-4152-ba02-e0f14b7e1f33 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:01.260473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-222e7cc2-eb2c-4152-ba02-e0f14b7e1f33 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:01.267634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-222e7cc2-eb2c-4152-ba02-e0f14b7e1f33 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.268091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-222e7cc2-eb2c-4152-ba02-e0f14b7e1f33 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.268894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-222e7cc2-eb2c-4152-ba02-e0f14b7e1f33 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.269375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-222e7cc2-eb2c-4152-ba02-e0f14b7e1f33 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.285157 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-222e7cc2-eb2c-4152-ba02-e0f14b7e1f33 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-222e7cc2-eb2c-4152-ba02-e0f14b7e1f33 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 HTTP/1.1 Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '75427d60-5953-49c5-a976-6053cf7ef090'} Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:01.286759 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-222e7cc2-eb2c-4152-ba02-e0f14b7e1f33 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-222e7cc2-eb2c-4152-ba02-e0f14b7e1f33 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "DELETE /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 404 len: 111 microversion: 2.1 time: 0.032481 Jul 14 15:28:01.290274 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3459/6953] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:28:01 2022] DELETE /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:28:01.298013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b42616a4-3b49-45b3-81a9-d249d880c29e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:01.298547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b42616a4-3b49-45b3-81a9-d249d880c29e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 75427d60-5953-49c5-a976-6053cf7ef090] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:01.305923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b42616a4-3b49-45b3-81a9-d249d880c29e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.306395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b42616a4-3b49-45b3-81a9-d249d880c29e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.307192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b42616a4-3b49-45b3-81a9-d249d880c29e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.307977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b42616a4-3b49-45b3-81a9-d249d880c29e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.324536 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-b42616a4-3b49-45b3-81a9-d249d880c29e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b42616a4-3b49-45b3-81a9-d249d880c29e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 HTTP/1.1 Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '75427d60-5953-49c5-a976-6053cf7ef090'} Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.326165 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.330609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.330609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.330609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.330609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:01.330609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:01.330609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. Jul 14 15:28:01.330609 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.330609 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b42616a4-3b49-45b3-81a9-d249d880c29e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance 75427d60-5953-49c5-a976-6053cf7ef090 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:01.330609 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b42616a4-3b49-45b3-81a9-d249d880c29e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090" status: 404 len: 111 microversion: 2.1 time: 0.034489 Jul 14 15:28:01.330609 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3495/6954] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:01 2022] GET /compute/v2.1/servers/75427d60-5953-49c5-a976-6053cf7ef090 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:01.337112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c793b3d-1451-4fcb-8632-9ee75063acd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:01.337792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3c793b3d-1451-4fcb-8632-9ee75063acd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:01.345411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c793b3d-1451-4fcb-8632-9ee75063acd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.345880 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c793b3d-1451-4fcb-8632-9ee75063acd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.346661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c793b3d-1451-4fcb-8632-9ee75063acd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.347108 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3c793b3d-1451-4fcb-8632-9ee75063acd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.361913 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-3c793b3d-1451-4fcb-8632-9ee75063acd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c793b3d-1451-4fcb-8632-9ee75063acd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 HTTP/1.1 Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'bb05a4f3-116b-4937-bf8c-41bfba922fd7'} Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:01.364010 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3c793b3d-1451-4fcb-8632-9ee75063acd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:01.368387 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3c793b3d-1451-4fcb-8632-9ee75063acd4 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "DELETE /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 404 len: 111 microversion: 2.1 time: 0.032304 Jul 14 15:28:01.369811 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3460/6955] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:28:01 2022] DELETE /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:01.374620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c4e610d2-ffb5-49eb-aa16-d947bc45aaed tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:01.375279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c4e610d2-ffb5-49eb-aa16-d947bc45aaed tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: bb05a4f3-116b-4937-bf8c-41bfba922fd7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:01.381792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c4e610d2-ffb5-49eb-aa16-d947bc45aaed tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.382257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c4e610d2-ffb5-49eb-aa16-d947bc45aaed tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.383033 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c4e610d2-ffb5-49eb-aa16-d947bc45aaed tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.383481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c4e610d2-ffb5-49eb-aa16-d947bc45aaed tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.398005 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-c4e610d2-ffb5-49eb-aa16-d947bc45aaed tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c4e610d2-ffb5-49eb-aa16-d947bc45aaed tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 HTTP/1.1 Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'bb05a4f3-116b-4937-bf8c-41bfba922fd7'} Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.399551 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.407396 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.407396 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.407396 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.407396 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:01.407396 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:01.407396 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. Jul 14 15:28:01.407396 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.407396 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c4e610d2-ffb5-49eb-aa16-d947bc45aaed tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance bb05a4f3-116b-4937-bf8c-41bfba922fd7 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:01.407396 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c4e610d2-ffb5-49eb-aa16-d947bc45aaed tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7" status: 404 len: 111 microversion: 2.1 time: 0.030413 Jul 14 15:28:01.407396 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3496/6956] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:01 2022] GET /compute/v2.1/servers/bb05a4f3-116b-4937-bf8c-41bfba922fd7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:01.410135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5209bbdc-ff74-445c-8cdf-44c91e45dfee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:01.410637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5209bbdc-ff74-445c-8cdf-44c91e45dfee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:01.416887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5209bbdc-ff74-445c-8cdf-44c91e45dfee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.417368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5209bbdc-ff74-445c-8cdf-44c91e45dfee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.418171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5209bbdc-ff74-445c-8cdf-44c91e45dfee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.418609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5209bbdc-ff74-445c-8cdf-44c91e45dfee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.432918 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-5209bbdc-ff74-445c-8cdf-44c91e45dfee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5209bbdc-ff74-445c-8cdf-44c91e45dfee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b HTTP/1.1 Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '6c0682cc-00fc-42b7-bce6-865c2088f72b'} Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:01.434551 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5209bbdc-ff74-445c-8cdf-44c91e45dfee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5209bbdc-ff74-445c-8cdf-44c91e45dfee tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 404 len: 111 microversion: 2.1 time: 0.030356 Jul 14 15:28:01.438828 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3461/6957] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:28:01 2022] DELETE /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:01.445051 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5ec80163-306f-48fb-8065-89474a7b0bb3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:01.445683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5ec80163-306f-48fb-8065-89474a7b0bb3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 6c0682cc-00fc-42b7-bce6-865c2088f72b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:01.452020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ec80163-306f-48fb-8065-89474a7b0bb3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.453155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ec80163-306f-48fb-8065-89474a7b0bb3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.454166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ec80163-306f-48fb-8065-89474a7b0bb3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.454625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ec80163-306f-48fb-8065-89474a7b0bb3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.469083 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-5ec80163-306f-48fb-8065-89474a7b0bb3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5ec80163-306f-48fb-8065-89474a7b0bb3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b HTTP/1.1 Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '6c0682cc-00fc-42b7-bce6-865c2088f72b'} Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.470686 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.475069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.475069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.475069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.475069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:01.475069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:01.475069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. Jul 14 15:28:01.475069 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.475069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5ec80163-306f-48fb-8065-89474a7b0bb3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance 6c0682cc-00fc-42b7-bce6-865c2088f72b could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:01.475069 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5ec80163-306f-48fb-8065-89474a7b0bb3 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b" status: 404 len: 111 microversion: 2.1 time: 0.031038 Jul 14 15:28:01.475069 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3497/6958] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:01 2022] GET /compute/v2.1/servers/6c0682cc-00fc-42b7-bce6-865c2088f72b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:01.480722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba5451bc-2b24-40f8-badc-df16a2859012 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:01.481259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ba5451bc-2b24-40f8-badc-df16a2859012 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:01.487558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba5451bc-2b24-40f8-badc-df16a2859012 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.488006 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba5451bc-2b24-40f8-badc-df16a2859012 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.488762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba5451bc-2b24-40f8-badc-df16a2859012 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.489254 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ba5451bc-2b24-40f8-badc-df16a2859012 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.503970 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-ba5451bc-2b24-40f8-badc-df16a2859012 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba5451bc-2b24-40f8-badc-df16a2859012 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc HTTP/1.1 Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc'} Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:01.505584 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ba5451bc-2b24-40f8-badc-df16a2859012 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ba5451bc-2b24-40f8-badc-df16a2859012 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 404 len: 111 microversion: 2.1 time: 0.030393 Jul 14 15:28:01.509919 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3462/6959] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:28:01 2022] DELETE /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:01.516525 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-533f5e60-ac8f-43da-bf8f-6f2fb9041c70 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:01.517181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-533f5e60-ac8f-43da-bf8f-6f2fb9041c70 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] [instance: 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:01.523428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-533f5e60-ac8f-43da-bf8f-6f2fb9041c70 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.523899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-533f5e60-ac8f-43da-bf8f-6f2fb9041c70 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.524701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-533f5e60-ac8f-43da-bf8f-6f2fb9041c70 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:01.525179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-533f5e60-ac8f-43da-bf8f-6f2fb9041c70 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:01.540150 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-533f5e60-ac8f-43da-bf8f-6f2fb9041c70 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] HTTP exception thrown: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-533f5e60-ac8f-43da-bf8f-6f2fb9041c70 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Request method failure captured: Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc HTTP/1.1 Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DR4agWeFAxKREl1CUtZeXroScqbWe5kNIH7alg3J0LEcgesyEbEwUcS50Trj4CXtmC9sN2qMYwQEyes8XuPMfym-e5plJ1acidiD5wu6HjbLrhc9xtvnX58tpOTrFW7C-P0aP3yJMIi8LOSGJmrKPnDtfckZSX1qSyxJu6rDPTkeIc Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3e44d74d04804f09b17d02ec80f654fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3e44d74d04804f09b17d02ec80f654fa", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3e44d74d04804f09b17d02ec80f654fa"}]}] Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 3e44d74d04804f09b17d02ec80f654fa Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServerActionsTestJSON-2054181605 Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: cdf1867943324a83b94bef9d185e84eb Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServerActionsTestJSON-2054181605-project Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc'} Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:01.541793 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.549505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:01.549505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:01.549505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:01.549505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:01.549505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:01.549505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. Jul 14 15:28:01.549505 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:01.549505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-533f5e60-ac8f-43da-bf8f-6f2fb9041c70 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Returning 404 to user: Instance 8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:01.549505 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-533f5e60-ac8f-43da-bf8f-6f2fb9041c70 tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc" status: 404 len: 111 microversion: 2.1 time: 0.031425 Jul 14 15:28:01.549505 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3498/6960] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:01 2022] GET /compute/v2.1/servers/8be23c4f-6dbc-4eb2-8cd6-ef31cadb17fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:28:01.553101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fcd4dfb7-9ca7-462e-bf40-970c1b54187e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] Calling method '.version_select at 0x7fd6c52e55e0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:01.576648 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fcd4dfb7-9ca7-462e-bf40-970c1b54187e tempest-ServerActionsTestJSON-2054181605 tempest-ServerActionsTestJSON-2054181605-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805277302" status: 202 len: 0 microversion: 2.1 time: 0.027788 Jul 14 15:28:01.577992 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3463/6961] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jul 14 15:28:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805277302 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:28:11.451395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-671513641", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "ee0a17f8-8e55-47a4-8ee9-469660fa8397"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:11.508188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] validate_networks() for [('ee0a17f8-8e55-47a4-8ee9-469660fa8397', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:28:11.530831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=43 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:11.891622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:28:11.892078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:28:11.892571 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:28:11.893032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:28:11.893473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:28:11.902712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:11.903189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:11.904030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:11.904517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:11.923382 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Getting quotas for project 07da73d2274649049ad958521581bce2. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:28:11.929096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Getting quotas for user a1956377faf04c8f93891d130889b278 and project 07da73d2274649049ad958521581bce2. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:28:11.943598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:28:11.945973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:28:12.000392 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-88690d21-8b44-4cb0-9e1f-0eac19a2f67b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688906 Jul 14 15:28:12.001102 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3499/6962] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:28:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:28:12.009161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=34 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:12.010024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:12.014017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-46f4ebd2-6495-48a6-b139-c266f79beca6 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:12.014649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-46f4ebd2-6495-48a6-b139-c266f79beca6 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:12.084624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-46f4ebd2-6495-48a6-b139-c266f79beca6 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:12.095444 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-46f4ebd2-6495-48a6-b139-c266f79beca6 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1216 microversion: 2.1 time: 0.087983 Jul 14 15:28:12.109889 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3464/6963] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:12 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:13.113189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ea265376-78ff-4188-92f5-204079d86eb0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:13.113723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ea265376-78ff-4188-92f5-204079d86eb0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:13.120816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea265376-78ff-4188-92f5-204079d86eb0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:13.121542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea265376-78ff-4188-92f5-204079d86eb0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:13.122487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea265376-78ff-4188-92f5-204079d86eb0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:13.123104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ea265376-78ff-4188-92f5-204079d86eb0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:13.225715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ea265376-78ff-4188-92f5-204079d86eb0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:13.250484 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ea265376-78ff-4188-92f5-204079d86eb0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1268 microversion: 2.1 time: 0.139927 Jul 14 15:28:13.254406 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3500/6964] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:13 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:14.276492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2a6b290b-920b-4dea-ba0a-4930bd0ec2be tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:14.277139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2a6b290b-920b-4dea-ba0a-4930bd0ec2be tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:14.289215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a6b290b-920b-4dea-ba0a-4930bd0ec2be tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:14.295074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a6b290b-920b-4dea-ba0a-4930bd0ec2be tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:14.297265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a6b290b-920b-4dea-ba0a-4930bd0ec2be tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:14.297965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a6b290b-920b-4dea-ba0a-4930bd0ec2be tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:14.598634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2a6b290b-920b-4dea-ba0a-4930bd0ec2be tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:14.612183 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2a6b290b-920b-4dea-ba0a-4930bd0ec2be tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1316 microversion: 2.1 time: 0.347019 Jul 14 15:28:14.612822 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3465/6965] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:14 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:15.023698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5aa83234-d42d-4209-af93-01f47636b831 req-044dc6b2-a6f2-4518-bf28-980ad8f7ca68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b15fdb56-b171-4a60-8281-bbc0b9aa7d80", "tag": "e92f6811-a260-42ce-85ce-48a75f97d29b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:15.042651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5aa83234-d42d-4209-af93-01f47636b831 req-044dc6b2-a6f2-4518-bf28-980ad8f7ca68 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:15.044009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5aa83234-d42d-4209-af93-01f47636b831 req-044dc6b2-a6f2-4518-bf28-980ad8f7ca68 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:15.088538 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5aa83234-d42d-4209-af93-01f47636b831 req-044dc6b2-a6f2-4518-bf28-980ad8f7ca68 service nova] Creating event network-changed:e92f6811-a260-42ce-85ce-48a75f97d29b for instance b15fdb56-b171-4a60-8281-bbc0b9aa7d80 on n-h1-767704-28 Jul 14 15:28:15.100142 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5aa83234-d42d-4209-af93-01f47636b831 req-044dc6b2-a6f2-4518-bf28-980ad8f7ca68 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092611 Jul 14 15:28:15.105330 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3501/6966] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:15.630453 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e6af26ab-430d-4987-a511-949a7a254177 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:15.631017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e6af26ab-430d-4987-a511-949a7a254177 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:15.638700 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6af26ab-430d-4987-a511-949a7a254177 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:15.639158 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6af26ab-430d-4987-a511-949a7a254177 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:15.640549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6af26ab-430d-4987-a511-949a7a254177 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:15.641013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6af26ab-430d-4987-a511-949a7a254177 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:15.881999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e6af26ab-430d-4987-a511-949a7a254177 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:15.889335 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e6af26ab-430d-4987-a511-949a7a254177 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1316 microversion: 2.1 time: 0.262984 Jul 14 15:28:15.891067 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3466/6967] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:15 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:16.910217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8c703204-f954-4905-886c-c2589980f93a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:16.910974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8c703204-f954-4905-886c-c2589980f93a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:16.917588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c703204-f954-4905-886c-c2589980f93a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:16.918063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c703204-f954-4905-886c-c2589980f93a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:16.918863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c703204-f954-4905-886c-c2589980f93a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:16.919357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c703204-f954-4905-886c-c2589980f93a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:17.139182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8c703204-f954-4905-886c-c2589980f93a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:17.150269 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8c703204-f954-4905-886c-c2589980f93a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1316 microversion: 2.1 time: 0.246513 Jul 14 15:28:17.150902 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3502/6968] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:16 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:18.167427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ad58c2a8-f373-47fc-a85b-b71f283060f2 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:18.168008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ad58c2a8-f373-47fc-a85b-b71f283060f2 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:18.176004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad58c2a8-f373-47fc-a85b-b71f283060f2 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:18.176467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad58c2a8-f373-47fc-a85b-b71f283060f2 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:18.177285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad58c2a8-f373-47fc-a85b-b71f283060f2 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:18.177733 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad58c2a8-f373-47fc-a85b-b71f283060f2 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:18.319851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ad58c2a8-f373-47fc-a85b-b71f283060f2 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:18.328030 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ad58c2a8-f373-47fc-a85b-b71f283060f2 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1316 microversion: 2.1 time: 0.164757 Jul 14 15:28:18.337218 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3467/6969] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:18 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:19.344279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1a110372-81e4-4c64-886a-cbdf43f2cc0b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:19.344982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1a110372-81e4-4c64-886a-cbdf43f2cc0b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:19.351978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a110372-81e4-4c64-886a-cbdf43f2cc0b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:19.352443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a110372-81e4-4c64-886a-cbdf43f2cc0b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:19.353260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a110372-81e4-4c64-886a-cbdf43f2cc0b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:19.353722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1a110372-81e4-4c64-886a-cbdf43f2cc0b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:19.489450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1a110372-81e4-4c64-886a-cbdf43f2cc0b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:19.497179 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1a110372-81e4-4c64-886a-cbdf43f2cc0b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1316 microversion: 2.1 time: 0.156981 Jul 14 15:28:19.497753 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3503/6970] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:19 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:20.291296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0a8de76f-5f48-4dba-bced-c786014b7dbe req-581706d0-3df9-4abc-8e70-5e2daba77ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15fdb56-b171-4a60-8281-bbc0b9aa7d80", "name": "network-vif-plugged", "status": "completed", "tag": "e92f6811-a260-42ce-85ce-48a75f97d29b"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:20.302437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0a8de76f-5f48-4dba-bced-c786014b7dbe req-581706d0-3df9-4abc-8e70-5e2daba77ef3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:20.302932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0a8de76f-5f48-4dba-bced-c786014b7dbe req-581706d0-3df9-4abc-8e70-5e2daba77ef3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:20.317238 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0a8de76f-5f48-4dba-bced-c786014b7dbe req-581706d0-3df9-4abc-8e70-5e2daba77ef3 service nova] Creating event network-vif-plugged:e92f6811-a260-42ce-85ce-48a75f97d29b for instance b15fdb56-b171-4a60-8281-bbc0b9aa7d80 on n-h1-767704-28 Jul 14 15:28:20.322726 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0a8de76f-5f48-4dba-bced-c786014b7dbe req-581706d0-3df9-4abc-8e70-5e2daba77ef3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035197 Jul 14 15:28:20.323747 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3468/6971] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:20.515920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-06b18420-8199-48a4-9acc-485e96139112 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:20.516556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-06b18420-8199-48a4-9acc-485e96139112 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:20.523728 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06b18420-8199-48a4-9acc-485e96139112 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:20.524201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06b18420-8199-48a4-9acc-485e96139112 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:20.525026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06b18420-8199-48a4-9acc-485e96139112 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:20.525487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06b18420-8199-48a4-9acc-485e96139112 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:20.659587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-06b18420-8199-48a4-9acc-485e96139112 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:20.667147 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-06b18420-8199-48a4-9acc-485e96139112 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1316 microversion: 2.1 time: 0.155339 Jul 14 15:28:20.667727 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3504/6972] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:20 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:21.685971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fb4c3ed6-6102-4f53-88fe-1496c4fd73ee tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:21.687208 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fb4c3ed6-6102-4f53-88fe-1496c4fd73ee tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:21.695239 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb4c3ed6-6102-4f53-88fe-1496c4fd73ee tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:21.695696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb4c3ed6-6102-4f53-88fe-1496c4fd73ee tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:21.696482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb4c3ed6-6102-4f53-88fe-1496c4fd73ee tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:21.696928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fb4c3ed6-6102-4f53-88fe-1496c4fd73ee tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:21.833488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fb4c3ed6-6102-4f53-88fe-1496c4fd73ee tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:21.841834 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fb4c3ed6-6102-4f53-88fe-1496c4fd73ee tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1316 microversion: 2.1 time: 0.160213 Jul 14 15:28:21.842514 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3469/6973] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:21 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:22.860662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c0207426-48ef-467a-b207-5cfdee0b3f48 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:22.861346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c0207426-48ef-467a-b207-5cfdee0b3f48 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:22.864202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:22.864898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:22.870820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0207426-48ef-467a-b207-5cfdee0b3f48 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:22.871291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0207426-48ef-467a-b207-5cfdee0b3f48 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:22.872088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0207426-48ef-467a-b207-5cfdee0b3f48 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:22.872544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c0207426-48ef-467a-b207-5cfdee0b3f48 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:23.012705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c0207426-48ef-467a-b207-5cfdee0b3f48 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:23.020338 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c0207426-48ef-467a-b207-5cfdee0b3f48 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1504 microversion: 2.1 time: 0.164438 Jul 14 15:28:23.020913 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3505/6974] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:22 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:23.075944 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-754495407", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "ee0a17f8-8e55-47a4-8ee9-469660fa8397"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:23.083025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:23.130712 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] validate_networks() for [('ee0a17f8-8e55-47a4-8ee9-469660fa8397', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:28:23.602478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:28:23.602919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:28:23.603406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:28:23.603819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:28:23.604241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:28:23.614679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:23.615280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:23.615957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:23.616406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:23.634903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Getting quotas for project 07da73d2274649049ad958521581bce2. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:28:23.641045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Getting quotas for user a1956377faf04c8f93891d130889b278 and project 07da73d2274649049ad958521581bce2. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:28:23.653643 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:28:23.656549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:28:23.703008 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d422a582-57ac-458f-8e21-3f5918c401e8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630980 Jul 14 15:28:23.703665 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3470/6975] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:28:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:28:23.713817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-225997e7-89d7-4adf-867b-14dec3a60336 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:23.714713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-225997e7-89d7-4adf-867b-14dec3a60336 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:23.716747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:23.776014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-225997e7-89d7-4adf-867b-14dec3a60336 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:23.784249 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-225997e7-89d7-4adf-867b-14dec3a60336 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1216 microversion: 2.1 time: 0.074474 Jul 14 15:28:23.784853 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3506/6976] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:23 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:24.805062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0451efc6-6ef5-4ec1-988c-54cca7dc06e4 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:24.805731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0451efc6-6ef5-4ec1-988c-54cca7dc06e4 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:24.815059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0451efc6-6ef5-4ec1-988c-54cca7dc06e4 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:24.815535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0451efc6-6ef5-4ec1-988c-54cca7dc06e4 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:24.816640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0451efc6-6ef5-4ec1-988c-54cca7dc06e4 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:24.817187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0451efc6-6ef5-4ec1-988c-54cca7dc06e4 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:24.905792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0451efc6-6ef5-4ec1-988c-54cca7dc06e4 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:24.913256 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0451efc6-6ef5-4ec1-988c-54cca7dc06e4 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1274 microversion: 2.1 time: 0.114377 Jul 14 15:28:24.913825 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3471/6977] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:24 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:25.931009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c5f735c8-057f-4b38-98a0-aeb7572045b9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:25.931657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c5f735c8-057f-4b38-98a0-aeb7572045b9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:25.940199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5f735c8-057f-4b38-98a0-aeb7572045b9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:25.940582 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5f735c8-057f-4b38-98a0-aeb7572045b9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:25.941426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5f735c8-057f-4b38-98a0-aeb7572045b9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:25.942108 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c5f735c8-057f-4b38-98a0-aeb7572045b9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:26.185578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ff947040-b110-4ed4-b17a-a7756e25052d req-dcb2dabd-ad37-4be8-8b59-b6e7d1c88c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b", "tag": "68e14573-3fa4-402b-a387-f9f5cab44496"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:26.200696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ff947040-b110-4ed4-b17a-a7756e25052d req-dcb2dabd-ad37-4be8-8b59-b6e7d1c88c7a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:26.201178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ff947040-b110-4ed4-b17a-a7756e25052d req-dcb2dabd-ad37-4be8-8b59-b6e7d1c88c7a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:26.212377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c5f735c8-057f-4b38-98a0-aeb7572045b9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:26.216609 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ff947040-b110-4ed4-b17a-a7756e25052d req-dcb2dabd-ad37-4be8-8b59-b6e7d1c88c7a service nova] Creating event network-changed:68e14573-3fa4-402b-a387-f9f5cab44496 for instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b on n-h2-767704-28 Jul 14 15:28:26.222697 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c5f735c8-057f-4b38-98a0-aeb7572045b9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1316 microversion: 2.1 time: 0.295519 Jul 14 15:28:26.224591 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ff947040-b110-4ed4-b17a-a7756e25052d req-dcb2dabd-ad37-4be8-8b59-b6e7d1c88c7a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046777 Jul 14 15:28:26.225729 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3472/6978] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:26.232058 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3507/6979] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:25 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:27.241808 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-908f3d6d-900b-4d91-bfbf-04a897f9fdec tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:27.242614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-908f3d6d-900b-4d91-bfbf-04a897f9fdec tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:27.249461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-908f3d6d-900b-4d91-bfbf-04a897f9fdec tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:27.249920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-908f3d6d-900b-4d91-bfbf-04a897f9fdec tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:27.250701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-908f3d6d-900b-4d91-bfbf-04a897f9fdec tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:27.251140 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-908f3d6d-900b-4d91-bfbf-04a897f9fdec tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:27.384676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-908f3d6d-900b-4d91-bfbf-04a897f9fdec tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:27.392839 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-908f3d6d-900b-4d91-bfbf-04a897f9fdec tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1316 microversion: 2.1 time: 0.156184 Jul 14 15:28:27.393455 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3473/6980] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:27 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:28.410882 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-efe5248f-b605-482f-85ea-636250a55e6b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:28.411430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-efe5248f-b605-482f-85ea-636250a55e6b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:28.418682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efe5248f-b605-482f-85ea-636250a55e6b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:28.419153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efe5248f-b605-482f-85ea-636250a55e6b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:28.419938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efe5248f-b605-482f-85ea-636250a55e6b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:28.420400 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-efe5248f-b605-482f-85ea-636250a55e6b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:28.554372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-efe5248f-b605-482f-85ea-636250a55e6b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:28.562586 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-efe5248f-b605-482f-85ea-636250a55e6b tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1316 microversion: 2.1 time: 0.155767 Jul 14 15:28:28.563160 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3508/6981] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:28 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:28:29.580114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7d45a945-90cb-4058-b0ad-1da24253b8f3 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:29.580783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7d45a945-90cb-4058-b0ad-1da24253b8f3 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:29.587711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d45a945-90cb-4058-b0ad-1da24253b8f3 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:29.588167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d45a945-90cb-4058-b0ad-1da24253b8f3 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:29.588933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d45a945-90cb-4058-b0ad-1da24253b8f3 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:29.589394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7d45a945-90cb-4058-b0ad-1da24253b8f3 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:29.724489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7d45a945-90cb-4058-b0ad-1da24253b8f3 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:29.732015 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7d45a945-90cb-4058-b0ad-1da24253b8f3 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1316 microversion: 2.1 time: 0.156662 Jul 14 15:28:29.732583 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3474/6982] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:29 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:30.749040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c6fe81a9-e043-408a-b492-d8748690fcc0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:30.749867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c6fe81a9-e043-408a-b492-d8748690fcc0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:30.756758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6fe81a9-e043-408a-b492-d8748690fcc0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:30.757522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6fe81a9-e043-408a-b492-d8748690fcc0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:30.758309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6fe81a9-e043-408a-b492-d8748690fcc0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:30.758758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c6fe81a9-e043-408a-b492-d8748690fcc0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:30.904489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c6fe81a9-e043-408a-b492-d8748690fcc0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:30.913048 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c6fe81a9-e043-408a-b492-d8748690fcc0 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1316 microversion: 2.1 time: 0.168010 Jul 14 15:28:30.913641 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3509/6983] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:30 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:31.930013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e52e7472-9305-4599-a625-ebd136b37347 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:31.930653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e52e7472-9305-4599-a625-ebd136b37347 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:31.937749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e52e7472-9305-4599-a625-ebd136b37347 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:31.938100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e52e7472-9305-4599-a625-ebd136b37347 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:31.938865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e52e7472-9305-4599-a625-ebd136b37347 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:31.939305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e52e7472-9305-4599-a625-ebd136b37347 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:32.079293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e52e7472-9305-4599-a625-ebd136b37347 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:32.087501 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e52e7472-9305-4599-a625-ebd136b37347 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1316 microversion: 2.1 time: 0.161412 Jul 14 15:28:32.088488 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3475/6984] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:31 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:32.177256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6171cc4c-1f56-4307-8905-0ab0d05f9190 req-72598d57-6f6d-4972-9b5c-bc460a1cd27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b", "name": "network-vif-plugged", "status": "completed", "tag": "68e14573-3fa4-402b-a387-f9f5cab44496"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:32.190249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6171cc4c-1f56-4307-8905-0ab0d05f9190 req-72598d57-6f6d-4972-9b5c-bc460a1cd27a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:32.190745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6171cc4c-1f56-4307-8905-0ab0d05f9190 req-72598d57-6f6d-4972-9b5c-bc460a1cd27a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:32.203634 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6171cc4c-1f56-4307-8905-0ab0d05f9190 req-72598d57-6f6d-4972-9b5c-bc460a1cd27a service nova] Creating event network-vif-plugged:68e14573-3fa4-402b-a387-f9f5cab44496 for instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b on n-h2-767704-28 Jul 14 15:28:32.208927 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6171cc4c-1f56-4307-8905-0ab0d05f9190 req-72598d57-6f6d-4972-9b5c-bc460a1cd27a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035668 Jul 14 15:28:32.209576 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3510/6985] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:33.105682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5717b2eb-cb2d-4e8f-8462-ca5eab93e19e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:33.106202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5717b2eb-cb2d-4e8f-8462-ca5eab93e19e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:33.114123 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5717b2eb-cb2d-4e8f-8462-ca5eab93e19e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:33.114586 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5717b2eb-cb2d-4e8f-8462-ca5eab93e19e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:33.115413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5717b2eb-cb2d-4e8f-8462-ca5eab93e19e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:33.115896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5717b2eb-cb2d-4e8f-8462-ca5eab93e19e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:33.261351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5717b2eb-cb2d-4e8f-8462-ca5eab93e19e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:33.269205 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5717b2eb-cb2d-4e8f-8462-ca5eab93e19e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1316 microversion: 2.1 time: 0.167765 Jul 14 15:28:33.269790 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3476/6986] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:33 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:34.288087 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-25e863a4-da8c-432c-86f6-f3fdeba8d18a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:34.288838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-25e863a4-da8c-432c-86f6-f3fdeba8d18a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:34.291800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:34.298693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25e863a4-da8c-432c-86f6-f3fdeba8d18a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:34.299163 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25e863a4-da8c-432c-86f6-f3fdeba8d18a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:34.299960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25e863a4-da8c-432c-86f6-f3fdeba8d18a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:34.300421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-25e863a4-da8c-432c-86f6-f3fdeba8d18a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:34.433839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-25e863a4-da8c-432c-86f6-f3fdeba8d18a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:34.442337 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-25e863a4-da8c-432c-86f6-f3fdeba8d18a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1504 microversion: 2.1 time: 0.158636 Jul 14 15:28:34.442910 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3511/6987] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:34 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:34.458437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0fcfd709-86df-481d-8a2e-db4077ae4473 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:34.458975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0fcfd709-86df-481d-8a2e-db4077ae4473 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:34.461062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:34.461760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:34.469691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0fcfd709-86df-481d-8a2e-db4077ae4473 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:34.470153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0fcfd709-86df-481d-8a2e-db4077ae4473 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:34.470936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0fcfd709-86df-481d-8a2e-db4077ae4473 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:34.471381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0fcfd709-86df-481d-8a2e-db4077ae4473 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:34.498402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0fcfd709-86df-481d-8a2e-db4077ae4473 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:28:34.579563 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0fcfd709-86df-481d-8a2e-db4077ae4473 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 204 len: 0 microversion: 2.1 time: 0.124742 Jul 14 15:28:34.580176 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3477/6988] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:28:34 2022] DELETE /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:28:34.592651 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f347253f-5c8f-46b3-af1a-939b1d1c18fd tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:34.594038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f347253f-5c8f-46b3-af1a-939b1d1c18fd tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:34.600902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f347253f-5c8f-46b3-af1a-939b1d1c18fd tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:34.601429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f347253f-5c8f-46b3-af1a-939b1d1c18fd tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:34.602240 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f347253f-5c8f-46b3-af1a-939b1d1c18fd tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:34.602701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f347253f-5c8f-46b3-af1a-939b1d1c18fd tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:34.743089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f347253f-5c8f-46b3-af1a-939b1d1c18fd tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:34.751274 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f347253f-5c8f-46b3-af1a-939b1d1c18fd tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1510 microversion: 2.1 time: 0.165229 Jul 14 15:28:34.751864 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3512/6989] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:34 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:35.769632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-135f60a0-ac0f-42f6-95f7-0bf8bba3ec9c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:35.770252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-135f60a0-ac0f-42f6-95f7-0bf8bba3ec9c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:35.777204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-135f60a0-ac0f-42f6-95f7-0bf8bba3ec9c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:35.777664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-135f60a0-ac0f-42f6-95f7-0bf8bba3ec9c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:35.778431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-135f60a0-ac0f-42f6-95f7-0bf8bba3ec9c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:35.778867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-135f60a0-ac0f-42f6-95f7-0bf8bba3ec9c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:35.916779 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-135f60a0-ac0f-42f6-95f7-0bf8bba3ec9c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:35.925316 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-135f60a0-ac0f-42f6-95f7-0bf8bba3ec9c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1510 microversion: 2.1 time: 0.160239 Jul 14 15:28:35.925904 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3478/6990] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:35 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:36.626740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-bc5a943c-28f4-410f-b535-0c6ccf61b498 req-ccb3730a-2bcd-4c38-ac7b-d555f0f314dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b", "name": "network-vif-deleted", "tag": "68e14573-3fa4-402b-a387-f9f5cab44496"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:36.644659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bc5a943c-28f4-410f-b535-0c6ccf61b498 req-ccb3730a-2bcd-4c38-ac7b-d555f0f314dc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:36.645292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bc5a943c-28f4-410f-b535-0c6ccf61b498 req-ccb3730a-2bcd-4c38-ac7b-d555f0f314dc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:36.660105 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-bc5a943c-28f4-410f-b535-0c6ccf61b498 req-ccb3730a-2bcd-4c38-ac7b-d555f0f314dc service nova] Creating event network-vif-deleted:68e14573-3fa4-402b-a387-f9f5cab44496 for instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b on n-h2-767704-28 Jul 14 15:28:36.672704 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-bc5a943c-28f4-410f-b535-0c6ccf61b498 req-ccb3730a-2bcd-4c38-ac7b-d555f0f314dc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050784 Jul 14 15:28:36.673811 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3513/6991] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:36.944266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-def42b2b-7443-414c-97e1-083d190143e1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:36.945037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-def42b2b-7443-414c-97e1-083d190143e1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:36.952109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-def42b2b-7443-414c-97e1-083d190143e1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:36.952762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-def42b2b-7443-414c-97e1-083d190143e1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:36.953627 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-def42b2b-7443-414c-97e1-083d190143e1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:36.954072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-def42b2b-7443-414c-97e1-083d190143e1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:36.986561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-def42b2b-7443-414c-97e1-083d190143e1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:36.987015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-def42b2b-7443-414c-97e1-083d190143e1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:36.987472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-def42b2b-7443-414c-97e1-083d190143e1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lazy-loading 'fault' on Instance uuid d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:28:37.032406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-def42b2b-7443-414c-97e1-083d190143e1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:37.040264 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-def42b2b-7443-414c-97e1-083d190143e1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 200 len: 1306 microversion: 2.1 time: 0.100039 Jul 14 15:28:37.040869 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3479/6992] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:36 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:28:38.059442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-536abcd3-c4da-44c2-a7fc-049cc601dda1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:38.060201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-536abcd3-c4da-44c2-a7fc-049cc601dda1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:38.068201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-536abcd3-c4da-44c2-a7fc-049cc601dda1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.068669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-536abcd3-c4da-44c2-a7fc-049cc601dda1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.069491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-536abcd3-c4da-44c2-a7fc-049cc601dda1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.069960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-536abcd3-c4da-44c2-a7fc-049cc601dda1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.086622 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-536abcd3-c4da-44c2-a7fc-049cc601dda1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] HTTP exception thrown: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-536abcd3-c4da-44c2-a7fc-049cc601dda1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Request method failure captured: Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b HTTP/1.1 Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DYLQB_YzZZWbxfGe1sHslxMXBVeQXUOYdep51SGnMYYpNzNNxB-I8gayntStstWdqy1GztcbtlZP7Gof0vudyZpKqHwGeReRG2iQMqdm9EwX6OA7go7xYHOjoFFHl1CIk1aI4VIkhZAmheAOwMrE_Eh92G9vlLnfF0--VVUDDSSeQQ Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07da73d2274649049ad958521581bce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07da73d2274649049ad958521581bce2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}] Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: a1956377faf04c8f93891d130889b278 Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'd2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b'} Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:38.088753 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.093251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:38.093251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:38.093251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:38.093251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:38.093251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:38.093251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:38.093251 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.093251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-536abcd3-c4da-44c2-a7fc-049cc601dda1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Returning 404 to user: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:38.093251 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-536abcd3-c4da-44c2-a7fc-049cc601dda1 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 404 len: 111 microversion: 2.1 time: 0.035122 Jul 14 15:28:38.093251 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3514/6993] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:38 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:38.100244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-955daf35-ba29-4f4c-9e62-64b2319ef0b8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:38.100901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-955daf35-ba29-4f4c-9e62-64b2319ef0b8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:38.108206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-955daf35-ba29-4f4c-9e62-64b2319ef0b8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.109317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-955daf35-ba29-4f4c-9e62-64b2319ef0b8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.110462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-955daf35-ba29-4f4c-9e62-64b2319ef0b8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.110911 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-955daf35-ba29-4f4c-9e62-64b2319ef0b8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.251882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-955daf35-ba29-4f4c-9e62-64b2319ef0b8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:38.260881 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-955daf35-ba29-4f4c-9e62-64b2319ef0b8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1504 microversion: 2.1 time: 0.164690 Jul 14 15:28:38.261506 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3480/6994] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:38 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:38.277456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a31eac85-16bb-410b-b6c3-975a12701e17 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:38.278441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a31eac85-16bb-410b-b6c3-975a12701e17 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: c13edfba-3a9b-4c06-aedd-99ed1b20d2df] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:38.284883 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-a31eac85-16bb-410b-b6c3-975a12701e17 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] HTTP exception thrown: Instance c13edfba-3a9b-4c06-aedd-99ed1b20d2df could not be found. Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a31eac85-16bb-410b-b6c3-975a12701e17 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Request method failure captured: Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/c13edfba-3a9b-4c06-aedd-99ed1b20d2df/action HTTP/1.1 Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 32 Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DYLQB_YzZZWbxfGe1sHslxMXBVeQXUOYdep51SGnMYYpNzNNxB-I8gayntStstWdqy1GztcbtlZP7Gof0vudyZpKqHwGeReRG2iQMqdm9EwX6OA7go7xYHOjoFFHl1CIk1aI4VIkhZAmheAOwMrE_Eh92G9vlLnfF0--VVUDDSSeQQ Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07da73d2274649049ad958521581bce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07da73d2274649049ad958521581bce2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}] Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: a1956377faf04c8f93891d130889b278 Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: {"resize": {"flavorRef": "452"}} Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance c13edfba-3a9b-4c06-aedd-99ed1b20d2df could not be found. Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'c13edfba-3a9b-4c06-aedd-99ed1b20d2df', 'body': {'resize': {'flavorRef': '452'}}} Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13edfba-3a9b-4c06-aedd-99ed1b20d2df could not be found. Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1141, in _action_resize Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1048, in _resize Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:38.286556 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13edfba-3a9b-4c06-aedd-99ed1b20d2df could not be found. Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13edfba-3a9b-4c06-aedd-99ed1b20d2df could not be found. Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a31eac85-16bb-410b-b6c3-975a12701e17 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Returning 404 to user: Instance c13edfba-3a9b-4c06-aedd-99ed1b20d2df could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a31eac85-16bb-410b-b6c3-975a12701e17 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "POST /compute/v2.1/servers/c13edfba-3a9b-4c06-aedd-99ed1b20d2df/action" status: 404 len: 111 microversion: 2.1 time: 0.014537 Jul 14 15:28:38.290934 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3515/6995] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:28:38 2022] POST /compute/v2.1/servers/c13edfba-3a9b-4c06-aedd-99ed1b20d2df/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:38.297677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-75d1f33a-608e-4800-90ae-59d5b260dfba tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:38.298301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-75d1f33a-608e-4800-90ae-59d5b260dfba tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:38.304622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75d1f33a-608e-4800-90ae-59d5b260dfba tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.305127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75d1f33a-608e-4800-90ae-59d5b260dfba tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.305910 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75d1f33a-608e-4800-90ae-59d5b260dfba tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.306349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-75d1f33a-608e-4800-90ae-59d5b260dfba tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.324617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:38.443544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-75d1f33a-608e-4800-90ae-59d5b260dfba tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:38.451309 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-75d1f33a-608e-4800-90ae-59d5b260dfba tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1504 microversion: 2.1 time: 0.158159 Jul 14 15:28:38.451822 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3481/6996] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:38 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:38.468974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7ecf625b-4de6-46ef-95a2-1bfae9ed5dfe tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:38.469776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7ecf625b-4de6-46ef-95a2-1bfae9ed5dfe tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:38.476969 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ecf625b-4de6-46ef-95a2-1bfae9ed5dfe tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.477442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ecf625b-4de6-46ef-95a2-1bfae9ed5dfe tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.478227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ecf625b-4de6-46ef-95a2-1bfae9ed5dfe tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.478689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7ecf625b-4de6-46ef-95a2-1bfae9ed5dfe tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.614155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7ecf625b-4de6-46ef-95a2-1bfae9ed5dfe tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:38.623926 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7ecf625b-4de6-46ef-95a2-1bfae9ed5dfe tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1504 microversion: 2.1 time: 0.157631 Jul 14 15:28:38.623926 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3516/6997] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:38 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:38.639824 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15a8b50e-3bab-4209-b6ed-e98a1d850e5d tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "67bee6e7-6bb5-4ab4-b87f-029ad4a6e353"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:38.641222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-15a8b50e-3bab-4209-b6ed-e98a1d850e5d tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:38.647637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15a8b50e-3bab-4209-b6ed-e98a1d850e5d tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.648102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15a8b50e-3bab-4209-b6ed-e98a1d850e5d tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.648936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15a8b50e-3bab-4209-b6ed-e98a1d850e5d tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.649413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15a8b50e-3bab-4209-b6ed-e98a1d850e5d tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.692447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-15a8b50e-3bab-4209-b6ed-e98a1d850e5d tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:38.698375 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-15a8b50e-3bab-4209-b6ed-e98a1d850e5d tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] HTTP exception thrown: Flavor 67bee6e7-6bb5-4ab4-b87f-029ad4a6e353 could not be found. Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15a8b50e-3bab-4209-b6ed-e98a1d850e5d tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Request method failure captured: Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: request: POST /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80/action HTTP/1.1 Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 65 Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DYLQB_YzZZWbxfGe1sHslxMXBVeQXUOYdep51SGnMYYpNzNNxB-I8gayntStstWdqy1GztcbtlZP7Gof0vudyZpKqHwGeReRG2iQMqdm9EwX6OA7go7xYHOjoFFHl1CIk1aI4VIkhZAmheAOwMrE_Eh92G9vlLnfF0--VVUDDSSeQQ Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07da73d2274649049ad958521581bce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07da73d2274649049ad958521581bce2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}] Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: a1956377faf04c8f93891d130889b278 Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: {"resize": {"flavorRef": "67bee6e7-6bb5-4ab4-b87f-029ad4a6e353"}} Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: exception: Flavor 67bee6e7-6bb5-4ab4-b87f-029ad4a6e353 could not be found. Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'b15fdb56-b171-4a60-8281-bbc0b9aa7d80', 'body': {'resize': {'flavorRef': '67bee6e7-6bb5-4ab4-b87f-029ad4a6e353'}}} Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1055, in _resize Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:28:38.700335 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 67bee6e7-6bb5-4ab4-b87f-029ad4a6e353 could not be found. Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1141, in _action_resize Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1085, in _resize Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 67bee6e7-6bb5-4ab4-b87f-029ad4a6e353 could not be found. Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 67bee6e7-6bb5-4ab4-b87f-029ad4a6e353 could not be found. Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15a8b50e-3bab-4209-b6ed-e98a1d850e5d tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Returning 400 to user: Flavor 67bee6e7-6bb5-4ab4-b87f-029ad4a6e353 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-15a8b50e-3bab-4209-b6ed-e98a1d850e5d tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "POST /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80/action" status: 400 len: 107 microversion: 2.1 time: 0.066041 Jul 14 15:28:38.704914 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3482/6998] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:28:38 2022] POST /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80/action => generated 107 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:28:38.711016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9f655978-e447-403e-a65d-340289b57dd9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:38.711652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9f655978-e447-403e-a65d-340289b57dd9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:38.717723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f655978-e447-403e-a65d-340289b57dd9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.718231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f655978-e447-403e-a65d-340289b57dd9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.719023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f655978-e447-403e-a65d-340289b57dd9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.719477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9f655978-e447-403e-a65d-340289b57dd9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.859955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9f655978-e447-403e-a65d-340289b57dd9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:38.867680 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9f655978-e447-403e-a65d-340289b57dd9 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1504 microversion: 2.1 time: 0.160610 Jul 14 15:28:38.868269 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3517/6999] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:38 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:38.886071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e71497ba-0c48-470c-95f0-665fe716be86 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:38.886685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e71497ba-0c48-470c-95f0-665fe716be86 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:38.892728 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e71497ba-0c48-470c-95f0-665fe716be86 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.893214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e71497ba-0c48-470c-95f0-665fe716be86 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.893979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e71497ba-0c48-470c-95f0-665fe716be86 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.894419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e71497ba-0c48-470c-95f0-665fe716be86 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.029067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e71497ba-0c48-470c-95f0-665fe716be86 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:39.036824 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e71497ba-0c48-470c-95f0-665fe716be86 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1504 microversion: 2.1 time: 0.154994 Jul 14 15:28:39.037441 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3483/7000] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:38 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:39.052885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e34ab7bb-408c-4cbf-8b14-df2be9457986 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e34ab7bb-408c-4cbf-8b14-df2be9457986 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Request method failure captured: Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: request: POST /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80/action HTTP/1.1 Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 29 Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DYLQB_YzZZWbxfGe1sHslxMXBVeQXUOYdep51SGnMYYpNzNNxB-I8gayntStstWdqy1GztcbtlZP7Gof0vudyZpKqHwGeReRG2iQMqdm9EwX6OA7go7xYHOjoFFHl1CIk1aI4VIkhZAmheAOwMrE_Eh92G9vlLnfF0--VVUDDSSeQQ Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07da73d2274649049ad958521581bce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07da73d2274649049ad958521581bce2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}] Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: a1956377faf04c8f93891d130889b278 Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: {"resize": {"flavorRef": ""}} Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'b15fdb56-b171-4a60-8281-bbc0b9aa7d80', 'body': {'resize': {'flavorRef': ''}}} Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi '' Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:39.055267 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.060113 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:39.060113 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:39.060113 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:39.060113 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:28:39.060113 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:28:39.060113 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 14 15:28:39.060113 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.060113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e34ab7bb-408c-4cbf-8b14-df2be9457986 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:39.060113 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e34ab7bb-408c-4cbf-8b14-df2be9457986 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "POST /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80/action" status: 400 len: 113 microversion: 2.1 time: 0.007792 Jul 14 15:28:39.060113 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3518/7001] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:28:39 2022] POST /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:28:39.065640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-77b5b9c2-7868-4caa-9819-4b786bf898f8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:39.066267 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-77b5b9c2-7868-4caa-9819-4b786bf898f8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:39.072384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77b5b9c2-7868-4caa-9819-4b786bf898f8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:39.072847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77b5b9c2-7868-4caa-9819-4b786bf898f8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.073659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77b5b9c2-7868-4caa-9819-4b786bf898f8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:39.074114 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-77b5b9c2-7868-4caa-9819-4b786bf898f8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.209532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-77b5b9c2-7868-4caa-9819-4b786bf898f8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:39.217074 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-77b5b9c2-7868-4caa-9819-4b786bf898f8 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1504 microversion: 2.1 time: 0.155852 Jul 14 15:28:39.217679 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3484/7002] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:39 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:39.238145 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9e2db0ac-e6e6-4542-97f7-fc4e94ecd26a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:39.238591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9e2db0ac-e6e6-4542-97f7-fc4e94ecd26a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:39.245593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e2db0ac-e6e6-4542-97f7-fc4e94ecd26a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:39.246070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e2db0ac-e6e6-4542-97f7-fc4e94ecd26a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.246862 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e2db0ac-e6e6-4542-97f7-fc4e94ecd26a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:39.247320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9e2db0ac-e6e6-4542-97f7-fc4e94ecd26a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.261443 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-9e2db0ac-e6e6-4542-97f7-fc4e94ecd26a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] HTTP exception thrown: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9e2db0ac-e6e6-4542-97f7-fc4e94ecd26a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Request method failure captured: Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b HTTP/1.1 Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DYLQB_YzZZWbxfGe1sHslxMXBVeQXUOYdep51SGnMYYpNzNNxB-I8gayntStstWdqy1GztcbtlZP7Gof0vudyZpKqHwGeReRG2iQMqdm9EwX6OA7go7xYHOjoFFHl1CIk1aI4VIkhZAmheAOwMrE_Eh92G9vlLnfF0--VVUDDSSeQQ Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07da73d2274649049ad958521581bce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07da73d2274649049ad958521581bce2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}] Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: a1956377faf04c8f93891d130889b278 Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'd2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b'} Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:39.263040 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9e2db0ac-e6e6-4542-97f7-fc4e94ecd26a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Returning 404 to user: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9e2db0ac-e6e6-4542-97f7-fc4e94ecd26a tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 404 len: 111 microversion: 2.1 time: 0.031282 Jul 14 15:28:39.267633 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3519/7003] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:28:39 2022] DELETE /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:39.274769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7340dace-ea2d-4c1a-859b-773d086f785c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:39.275392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7340dace-ea2d-4c1a-859b-773d086f785c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:39.281834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7340dace-ea2d-4c1a-859b-773d086f785c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:39.282295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7340dace-ea2d-4c1a-859b-773d086f785c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.283081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7340dace-ea2d-4c1a-859b-773d086f785c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:39.283523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7340dace-ea2d-4c1a-859b-773d086f785c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.297788 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-7340dace-ea2d-4c1a-859b-773d086f785c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] HTTP exception thrown: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7340dace-ea2d-4c1a-859b-773d086f785c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Request method failure captured: Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b HTTP/1.1 Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DYLQB_YzZZWbxfGe1sHslxMXBVeQXUOYdep51SGnMYYpNzNNxB-I8gayntStstWdqy1GztcbtlZP7Gof0vudyZpKqHwGeReRG2iQMqdm9EwX6OA7go7xYHOjoFFHl1CIk1aI4VIkhZAmheAOwMrE_Eh92G9vlLnfF0--VVUDDSSeQQ Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07da73d2274649049ad958521581bce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07da73d2274649049ad958521581bce2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}] Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: a1956377faf04c8f93891d130889b278 Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'd2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b'} Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:39.299375 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.303642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:39.303642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:39.303642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:39.303642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:39.303642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:39.303642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. Jul 14 15:28:39.303642 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:28:39.303642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7340dace-ea2d-4c1a-859b-773d086f785c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Returning 404 to user: Instance d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:39.303642 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7340dace-ea2d-4c1a-859b-773d086f785c tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b" status: 404 len: 111 microversion: 2.1 time: 0.030014 Jul 14 15:28:39.303642 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3485/7004] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:39 2022] GET /compute/v2.1/servers/d2dcacd2-9e3b-4f43-b5bc-5769b8d89e3b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:39.309540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4d7c359b-06e6-4c4c-a13c-c00cfb0fb004 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:39.310063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4d7c359b-06e6-4c4c-a13c-c00cfb0fb004 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:39.317095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d7c359b-06e6-4c4c-a13c-c00cfb0fb004 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:39.317568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d7c359b-06e6-4c4c-a13c-c00cfb0fb004 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.318352 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d7c359b-06e6-4c4c-a13c-c00cfb0fb004 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:39.318810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d7c359b-06e6-4c4c-a13c-c00cfb0fb004 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.346152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4d7c359b-06e6-4c4c-a13c-c00cfb0fb004 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:28:39.399376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:39.427070 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4d7c359b-06e6-4c4c-a13c-c00cfb0fb004 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 204 len: 0 microversion: 2.1 time: 0.121127 Jul 14 15:28:39.428007 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3520/7005] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:28:39 2022] DELETE /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:28:39.435737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ec33f71-6543-46d9-8ebd-d72c7f3e5eaf tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:39.436349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ec33f71-6543-46d9-8ebd-d72c7f3e5eaf tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:39.444964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ec33f71-6543-46d9-8ebd-d72c7f3e5eaf tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:39.445519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ec33f71-6543-46d9-8ebd-d72c7f3e5eaf tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.446312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ec33f71-6543-46d9-8ebd-d72c7f3e5eaf tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:39.446749 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ec33f71-6543-46d9-8ebd-d72c7f3e5eaf tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.585364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ec33f71-6543-46d9-8ebd-d72c7f3e5eaf tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:39.593199 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ec33f71-6543-46d9-8ebd-d72c7f3e5eaf tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1510 microversion: 2.1 time: 0.161221 Jul 14 15:28:39.593705 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3486/7006] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:39 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:40.611783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3300515c-3861-4a0a-b5b9-e7498f0dba3e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:40.612511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3300515c-3861-4a0a-b5b9-e7498f0dba3e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:40.619587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3300515c-3861-4a0a-b5b9-e7498f0dba3e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:40.620060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3300515c-3861-4a0a-b5b9-e7498f0dba3e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:40.620854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3300515c-3861-4a0a-b5b9-e7498f0dba3e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:40.621337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3300515c-3861-4a0a-b5b9-e7498f0dba3e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:40.806043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3300515c-3861-4a0a-b5b9-e7498f0dba3e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:40.813892 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3300515c-3861-4a0a-b5b9-e7498f0dba3e tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1510 microversion: 2.1 time: 0.207156 Jul 14 15:28:40.814466 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3521/7007] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:40 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:41.831561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac756535-13f9-4dae-aa1d-ff035be19044 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:41.832193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ac756535-13f9-4dae-aa1d-ff035be19044 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:41.839755 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac756535-13f9-4dae-aa1d-ff035be19044 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:41.840224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac756535-13f9-4dae-aa1d-ff035be19044 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:41.841065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac756535-13f9-4dae-aa1d-ff035be19044 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:41.841513 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac756535-13f9-4dae-aa1d-ff035be19044 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:42.181821 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6575273d-97ad-4391-b400-ef2cd9b57ac5 req-2f74be01-074c-43b4-ae8a-66969e5a8a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15fdb56-b171-4a60-8281-bbc0b9aa7d80", "name": "network-vif-deleted", "tag": "e92f6811-a260-42ce-85ce-48a75f97d29b"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:42.192345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6575273d-97ad-4391-b400-ef2cd9b57ac5 req-2f74be01-074c-43b4-ae8a-66969e5a8a6a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:42.192904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6575273d-97ad-4391-b400-ef2cd9b57ac5 req-2f74be01-074c-43b4-ae8a-66969e5a8a6a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:42.208163 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6575273d-97ad-4391-b400-ef2cd9b57ac5 req-2f74be01-074c-43b4-ae8a-66969e5a8a6a service nova] Creating event network-vif-deleted:e92f6811-a260-42ce-85ce-48a75f97d29b for instance b15fdb56-b171-4a60-8281-bbc0b9aa7d80 on n-h1-767704-28 Jul 14 15:28:42.217401 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6575273d-97ad-4391-b400-ef2cd9b57ac5 req-2f74be01-074c-43b4-ae8a-66969e5a8a6a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040726 Jul 14 15:28:42.218723 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3522/7008] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:28:42.236546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ac756535-13f9-4dae-aa1d-ff035be19044 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1956377faf04c8f93891d130889b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da73d2274649049ad958521581bce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:42.244325 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ac756535-13f9-4dae-aa1d-ff035be19044 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 200 len: 1468 microversion: 2.1 time: 0.416940 Jul 14 15:28:42.244909 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3487/7009] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:41 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 1468 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:43.262261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05dac51d-0ebe-48fa-b6d8-cc57bb155743 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:43.262983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-05dac51d-0ebe-48fa-b6d8-cc57bb155743 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] [instance: b15fdb56-b171-4a60-8281-bbc0b9aa7d80] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:43.269584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05dac51d-0ebe-48fa-b6d8-cc57bb155743 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:43.270052 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05dac51d-0ebe-48fa-b6d8-cc57bb155743 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:43.270838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05dac51d-0ebe-48fa-b6d8-cc57bb155743 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:43.271306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-05dac51d-0ebe-48fa-b6d8-cc57bb155743 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:43.285126 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-05dac51d-0ebe-48fa-b6d8-cc57bb155743 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] HTTP exception thrown: Instance b15fdb56-b171-4a60-8281-bbc0b9aa7d80 could not be found. Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05dac51d-0ebe-48fa-b6d8-cc57bb155743 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Request method failure captured: Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 HTTP/1.1 Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DYLQB_YzZZWbxfGe1sHslxMXBVeQXUOYdep51SGnMYYpNzNNxB-I8gayntStstWdqy1GztcbtlZP7Gof0vudyZpKqHwGeReRG2iQMqdm9EwX6OA7go7xYHOjoFFHl1CIk1aI4VIkhZAmheAOwMrE_Eh92G9vlLnfF0--VVUDDSSeQQ Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/07da73d2274649049ad958521581bce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_07da73d2274649049ad958521581bce2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/07da73d2274649049ad958521581bce2"}]}] Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 07da73d2274649049ad958521581bce2 Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-332959072 Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: a1956377faf04c8f93891d130889b278 Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-ServersNegativeTestJSON-332959072-project Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance b15fdb56-b171-4a60-8281-bbc0b9aa7d80 could not be found. Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'b15fdb56-b171-4a60-8281-bbc0b9aa7d80'} Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b15fdb56-b171-4a60-8281-bbc0b9aa7d80 could not be found. Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b15fdb56-b171-4a60-8281-bbc0b9aa7d80 could not be found. Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:43.286838 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:43.290834 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:43.290834 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:43.290834 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:43.290834 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:43.290834 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:43.290834 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b15fdb56-b171-4a60-8281-bbc0b9aa7d80 could not be found. Jul 14 15:28:43.290834 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:28:43.290834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-05dac51d-0ebe-48fa-b6d8-cc57bb155743 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] Returning 404 to user: Instance b15fdb56-b171-4a60-8281-bbc0b9aa7d80 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:43.290834 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-05dac51d-0ebe-48fa-b6d8-cc57bb155743 tempest-ServersNegativeTestJSON-332959072 tempest-ServersNegativeTestJSON-332959072-project] 10.222.0.81 "GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80" status: 404 len: 111 microversion: 2.1 time: 0.031489 Jul 14 15:28:43.290834 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3523/7010] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:43 2022] GET /compute/v2.1/servers/b15fdb56-b171-4a60-8281-bbc0b9aa7d80 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:29:17.806735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:17.807138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=32 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:17.998667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-30ede25f-06ae-4383-b2b5-5601fdb12798 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Action: 'create', calling method: .version_select at 0x7fd6c453b430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1487241762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoUHAXabTQ6b7HO8TxfglPs89cuGHYjm2a/WtsLiwCOSzpvMQGDDShPyHj2FiZ5rFUJ92pM4p9J6Nzg+4J/4wf8yVIwNZ7YBWuJNPH4ow5aUIDl9j1pRCBCd0Lfsr9TUQ=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:18.013497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-30ede25f-06ae-4383-b2b5-5601fdb12798 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Getting quotas for project ee2d7518e7364b5197544ee3c9d4b718. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:29:18.020074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-30ede25f-06ae-4383-b2b5-5601fdb12798 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Getting quotas for user cbb20211af2d4d22bbd7ec8e9646d86c and project ee2d7518e7364b5197544ee3c9d4b718. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:29:18.054177 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-30ede25f-06ae-4383-b2b5-5601fdb12798 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.253664 Jul 14 15:29:18.055450 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3488/7011] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:29:17 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:18.104639 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-696464328", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1487241762", "networks": [{"uuid": "833c87f3-42a0-4cad-bd96-40440f2a26c9"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:18.112596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:18.113427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=10 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:18.167003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] validate_networks() for [('833c87f3-42a0-4cad-bd96-40440f2a26c9', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:29:18.573737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:29:18.574252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:29:18.574850 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:29:18.575380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:29:18.575905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:29:18.586395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:18.586955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:18.587846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:18.588378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:18.609678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Getting quotas for project ee2d7518e7364b5197544ee3c9d4b718. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:29:18.615749 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Getting quotas for user cbb20211af2d4d22bbd7ec8e9646d86c and project ee2d7518e7364b5197544ee3c9d4b718. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:29:18.630754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:29:18.633908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:29:18.687431 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2d4dc922-a0c0-4888-9490-005ea9a3290f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585965 Jul 14 15:29:18.688286 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3524/7012] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:29:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:29:18.705459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4ac7a74c-bb8a-4b46-9103-63924c542e74 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:18.706148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4ac7a74c-bb8a-4b46-9103-63924c542e74 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:18.787782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4ac7a74c-bb8a-4b46-9103-63924c542e74 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:18.800155 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4ac7a74c-bb8a-4b46-9103-63924c542e74 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1262 microversion: 2.1 time: 0.098315 Jul 14 15:29:18.804962 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3489/7013] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:18 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1262 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:19.822693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-809d727c-a66f-4305-a56d-be3d85f8bef8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:19.823323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-809d727c-a66f-4305-a56d-be3d85f8bef8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:19.830975 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-809d727c-a66f-4305-a56d-be3d85f8bef8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:19.831445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-809d727c-a66f-4305-a56d-be3d85f8bef8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:19.832389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-809d727c-a66f-4305-a56d-be3d85f8bef8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:19.833063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-809d727c-a66f-4305-a56d-be3d85f8bef8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:19.904841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-809d727c-a66f-4305-a56d-be3d85f8bef8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:19.913495 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-809d727c-a66f-4305-a56d-be3d85f8bef8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1314 microversion: 2.1 time: 0.095605 Jul 14 15:29:19.924189 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3525/7014] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:19 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1314 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:20.931867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7e0031cb-fcb4-4f04-ac9d-c48aaea9f574 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:20.932647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7e0031cb-fcb4-4f04-ac9d-c48aaea9f574 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:20.942879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e0031cb-fcb4-4f04-ac9d-c48aaea9f574 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:20.943264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e0031cb-fcb4-4f04-ac9d-c48aaea9f574 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:20.944238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e0031cb-fcb4-4f04-ac9d-c48aaea9f574 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:20.944689 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7e0031cb-fcb4-4f04-ac9d-c48aaea9f574 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:21.195907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7e0031cb-fcb4-4f04-ac9d-c48aaea9f574 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:21.208469 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7e0031cb-fcb4-4f04-ac9d-c48aaea9f574 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1362 microversion: 2.1 time: 0.279803 Jul 14 15:29:21.219501 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3490/7015] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:20 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:21.681345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-60e8868a-73ab-4645-8b08-4b491279842f req-cd1b05e2-ddee-458f-9f77-eae1250c1678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c173f845-13be-4c58-8319-02b5427fcad3", "tag": "5ef28e5e-a006-4766-ba8b-70e466152ca0"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:21.701229 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-60e8868a-73ab-4645-8b08-4b491279842f req-cd1b05e2-ddee-458f-9f77-eae1250c1678 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:21.701610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-60e8868a-73ab-4645-8b08-4b491279842f req-cd1b05e2-ddee-458f-9f77-eae1250c1678 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:21.726753 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-60e8868a-73ab-4645-8b08-4b491279842f req-cd1b05e2-ddee-458f-9f77-eae1250c1678 service nova] Creating event network-changed:5ef28e5e-a006-4766-ba8b-70e466152ca0 for instance c173f845-13be-4c58-8319-02b5427fcad3 on n-h1-767704-28 Jul 14 15:29:21.739759 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-60e8868a-73ab-4645-8b08-4b491279842f req-cd1b05e2-ddee-458f-9f77-eae1250c1678 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062529 Jul 14 15:29:21.745343 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3526/7016] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:22.229348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a67d635f-0343-41f2-b613-bc263cebce6f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:22.230079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a67d635f-0343-41f2-b613-bc263cebce6f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:22.239495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a67d635f-0343-41f2-b613-bc263cebce6f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:22.239959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a67d635f-0343-41f2-b613-bc263cebce6f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:22.240930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a67d635f-0343-41f2-b613-bc263cebce6f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:22.241404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a67d635f-0343-41f2-b613-bc263cebce6f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:22.420198 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a67d635f-0343-41f2-b613-bc263cebce6f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:22.429936 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a67d635f-0343-41f2-b613-bc263cebce6f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1362 microversion: 2.1 time: 0.205097 Jul 14 15:29:22.430539 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3491/7017] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:22 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:23.449287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-13f8f90c-b60d-49b0-ad6e-8be091257ab7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:23.450009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-13f8f90c-b60d-49b0-ad6e-8be091257ab7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:23.459426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13f8f90c-b60d-49b0-ad6e-8be091257ab7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:23.459426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13f8f90c-b60d-49b0-ad6e-8be091257ab7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:23.459426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13f8f90c-b60d-49b0-ad6e-8be091257ab7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:23.459759 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13f8f90c-b60d-49b0-ad6e-8be091257ab7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:23.674490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-13f8f90c-b60d-49b0-ad6e-8be091257ab7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:23.682439 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-13f8f90c-b60d-49b0-ad6e-8be091257ab7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1362 microversion: 2.1 time: 0.238348 Jul 14 15:29:23.683016 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3527/7018] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:23 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:24.700683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d1108f7-aacd-4cb5-8de8-da8de191dcd3 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:24.701354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0d1108f7-aacd-4cb5-8de8-da8de191dcd3 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:24.709567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d1108f7-aacd-4cb5-8de8-da8de191dcd3 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:24.710035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d1108f7-aacd-4cb5-8de8-da8de191dcd3 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:24.710833 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d1108f7-aacd-4cb5-8de8-da8de191dcd3 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:24.711286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d1108f7-aacd-4cb5-8de8-da8de191dcd3 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:24.844919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0d1108f7-aacd-4cb5-8de8-da8de191dcd3 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:24.852574 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0d1108f7-aacd-4cb5-8de8-da8de191dcd3 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1362 microversion: 2.1 time: 0.156961 Jul 14 15:29:24.853180 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3492/7019] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:24 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:25.869765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3891d339-3282-49d8-8f7c-844ca630b53e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:25.870399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3891d339-3282-49d8-8f7c-844ca630b53e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:25.878509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3891d339-3282-49d8-8f7c-844ca630b53e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:25.878915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3891d339-3282-49d8-8f7c-844ca630b53e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:25.879712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3891d339-3282-49d8-8f7c-844ca630b53e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:25.880173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3891d339-3282-49d8-8f7c-844ca630b53e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:26.017216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3891d339-3282-49d8-8f7c-844ca630b53e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:26.024787 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3891d339-3282-49d8-8f7c-844ca630b53e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1362 microversion: 2.1 time: 0.159173 Jul 14 15:29:26.025391 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3528/7020] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:25 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:26.721119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-7fc153e8-5c42-4b82-97fb-ab600e8c6970 req-afde151e-8a9a-488e-96e8-3e7417e5e262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c173f845-13be-4c58-8319-02b5427fcad3", "name": "network-vif-plugged", "status": "completed", "tag": "5ef28e5e-a006-4766-ba8b-70e466152ca0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:26.730119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7fc153e8-5c42-4b82-97fb-ab600e8c6970 req-afde151e-8a9a-488e-96e8-3e7417e5e262 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:26.730601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7fc153e8-5c42-4b82-97fb-ab600e8c6970 req-afde151e-8a9a-488e-96e8-3e7417e5e262 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:26.741754 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-7fc153e8-5c42-4b82-97fb-ab600e8c6970 req-afde151e-8a9a-488e-96e8-3e7417e5e262 service nova] Creating event network-vif-plugged:5ef28e5e-a006-4766-ba8b-70e466152ca0 for instance c173f845-13be-4c58-8319-02b5427fcad3 on n-h1-767704-28 Jul 14 15:29:26.747077 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-7fc153e8-5c42-4b82-97fb-ab600e8c6970 req-afde151e-8a9a-488e-96e8-3e7417e5e262 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086736 Jul 14 15:29:26.747637 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3493/7021] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:27.042192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ab7b353a-d895-4f65-9b5d-772729e0f548 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:27.042731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ab7b353a-d895-4f65-9b5d-772729e0f548 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:27.049785 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab7b353a-d895-4f65-9b5d-772729e0f548 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:27.050245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab7b353a-d895-4f65-9b5d-772729e0f548 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:27.051022 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab7b353a-d895-4f65-9b5d-772729e0f548 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:27.051472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ab7b353a-d895-4f65-9b5d-772729e0f548 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:27.187096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ab7b353a-d895-4f65-9b5d-772729e0f548 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:27.194689 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ab7b353a-d895-4f65-9b5d-772729e0f548 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1362 microversion: 2.1 time: 0.156539 Jul 14 15:29:27.195287 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3529/7022] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:27 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:28.212318 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6e15edaa-8752-461a-8e50-03636b5d7226 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:28.213047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6e15edaa-8752-461a-8e50-03636b5d7226 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:28.220713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e15edaa-8752-461a-8e50-03636b5d7226 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:28.221206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e15edaa-8752-461a-8e50-03636b5d7226 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:28.221988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e15edaa-8752-461a-8e50-03636b5d7226 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:28.222436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6e15edaa-8752-461a-8e50-03636b5d7226 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:28.356673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6e15edaa-8752-461a-8e50-03636b5d7226 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:28.365236 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6e15edaa-8752-461a-8e50-03636b5d7226 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1362 microversion: 2.1 time: 0.157196 Jul 14 15:29:28.365867 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3494/7023] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:28 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:29.384010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ce63c677-2703-4a9f-b24f-8c10145d6342 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:29.384647 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ce63c677-2703-4a9f-b24f-8c10145d6342 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:29.387536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:29.388231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:29.396032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce63c677-2703-4a9f-b24f-8c10145d6342 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:29.396510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce63c677-2703-4a9f-b24f-8c10145d6342 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:29.397344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce63c677-2703-4a9f-b24f-8c10145d6342 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:29.397808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ce63c677-2703-4a9f-b24f-8c10145d6342 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:29.539333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ce63c677-2703-4a9f-b24f-8c10145d6342 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:29.547206 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ce63c677-2703-4a9f-b24f-8c10145d6342 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1555 microversion: 2.1 time: 0.167448 Jul 14 15:29:29.547794 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3530/7024] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:29 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:29.565311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2f3979ce-a022-4ef8-8b75-d0c105650f22 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:29.565936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2f3979ce-a022-4ef8-8b75-d0c105650f22 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:29.568005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:29.574611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f3979ce-a022-4ef8-8b75-d0c105650f22 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:29.575074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f3979ce-a022-4ef8-8b75-d0c105650f22 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:29.575853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f3979ce-a022-4ef8-8b75-d0c105650f22 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:29.576295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2f3979ce-a022-4ef8-8b75-d0c105650f22 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:29.709098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2f3979ce-a022-4ef8-8b75-d0c105650f22 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:29.716746 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2f3979ce-a022-4ef8-8b75-d0c105650f22 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1555 microversion: 2.1 time: 0.156705 Jul 14 15:29:29.717962 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3495/7025] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:29 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:31.301164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-13c57260-0e09-4796-b367-0273104e5364 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b160630-27c2-4a39-842c-bd043aea4d2f"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:31.302143 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-13c57260-0e09-4796-b367-0273104e5364 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:31.308916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13c57260-0e09-4796-b367-0273104e5364 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:31.309410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13c57260-0e09-4796-b367-0273104e5364 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:31.310191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13c57260-0e09-4796-b367-0273104e5364 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:31.310645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13c57260-0e09-4796-b367-0273104e5364 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:31.588220 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-13c57260-0e09-4796-b367-0273104e5364 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "POST /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291279 Jul 14 15:29:31.588993 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3531/7026] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 15:29:31 2022] POST /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:43.324655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bdcd8340-b888-4451-ae1e-75f6f4072fa2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:43.325251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bdcd8340-b888-4451-ae1e-75f6f4072fa2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:43.327948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:43.328985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=32 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:43.335653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdcd8340-b888-4451-ae1e-75f6f4072fa2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:43.336105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdcd8340-b888-4451-ae1e-75f6f4072fa2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:43.337216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdcd8340-b888-4451-ae1e-75f6f4072fa2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:43.337661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bdcd8340-b888-4451-ae1e-75f6f4072fa2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:43.425646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-bdcd8340-b888-4451-ae1e-75f6f4072fa2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lazy-loading 'services' on Instance uuid c173f845-13be-4c58-8319-02b5427fcad3 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:29:43.498242 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bdcd8340-b888-4451-ae1e-75f6f4072fa2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments/6b160630-27c2-4a39-842c-bd043aea4d2f" status: 202 len: 0 microversion: 2.1 time: 0.177759 Jul 14 15:29:43.498885 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3496/7027] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:29:43 2022] DELETE /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments/6b160630-27c2-4a39-842c-bd043aea4d2f => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:29:43.506006 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:43.507140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:43.511312 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6bb849df-d03c-46c9-8644-ecad515d219c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:43.512366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6bb849df-d03c-46c9-8644-ecad515d219c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:43.520412 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6bb849df-d03c-46c9-8644-ecad515d219c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:43.520886 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6bb849df-d03c-46c9-8644-ecad515d219c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:43.521717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6bb849df-d03c-46c9-8644-ecad515d219c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:43.522178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6bb849df-d03c-46c9-8644-ecad515d219c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:43.554795 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6bb849df-d03c-46c9-8644-ecad515d219c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050713 Jul 14 15:29:43.555378 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3532/7028] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:29:43 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:44.569030 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-12b3a0c4-1d6d-4a93-b587-b7dca92b9dcf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:44.570043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-12b3a0c4-1d6d-4a93-b587-b7dca92b9dcf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:44.580428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-12b3a0c4-1d6d-4a93-b587-b7dca92b9dcf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:44.580889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-12b3a0c4-1d6d-4a93-b587-b7dca92b9dcf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:44.581743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-12b3a0c4-1d6d-4a93-b587-b7dca92b9dcf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:44.582188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-12b3a0c4-1d6d-4a93-b587-b7dca92b9dcf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:44.614991 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-12b3a0c4-1d6d-4a93-b587-b7dca92b9dcf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051330 Jul 14 15:29:44.615590 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3497/7029] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:29:44 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:45.627053 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fea9f8d5-4e02-4f97-8e69-da50e294636a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:45.628009 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fea9f8d5-4e02-4f97-8e69-da50e294636a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:45.635204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fea9f8d5-4e02-4f97-8e69-da50e294636a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:45.635663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fea9f8d5-4e02-4f97-8e69-da50e294636a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:45.636438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fea9f8d5-4e02-4f97-8e69-da50e294636a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:45.636890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fea9f8d5-4e02-4f97-8e69-da50e294636a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:45.668884 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fea9f8d5-4e02-4f97-8e69-da50e294636a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045954 Jul 14 15:29:45.669483 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3533/7030] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:29:45 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:46.680076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d4155b23-4d01-4006-b317-a24a81c7f3a7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:46.681031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d4155b23-4d01-4006-b317-a24a81c7f3a7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:46.688580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4155b23-4d01-4006-b317-a24a81c7f3a7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:46.689068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4155b23-4d01-4006-b317-a24a81c7f3a7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:46.689851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4155b23-4d01-4006-b317-a24a81c7f3a7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:46.690297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d4155b23-4d01-4006-b317-a24a81c7f3a7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:46.721908 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d4155b23-4d01-4006-b317-a24a81c7f3a7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045966 Jul 14 15:29:46.722503 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3498/7031] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:29:46 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:47.733927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c341bae5-691f-4ba9-9827-8103e1bbbd46 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:47.734838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c341bae5-691f-4ba9-9827-8103e1bbbd46 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:47.742688 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c341bae5-691f-4ba9-9827-8103e1bbbd46 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:47.743158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c341bae5-691f-4ba9-9827-8103e1bbbd46 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:47.743946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c341bae5-691f-4ba9-9827-8103e1bbbd46 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:47.744405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c341bae5-691f-4ba9-9827-8103e1bbbd46 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:47.775952 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c341bae5-691f-4ba9-9827-8103e1bbbd46 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046184 Jul 14 15:29:47.776476 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3534/7032] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:29:47 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:48.788085 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ef3472e2-0ddd-4a91-a65e-8264c42e16b2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:48.788936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ef3472e2-0ddd-4a91-a65e-8264c42e16b2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:48.795884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef3472e2-0ddd-4a91-a65e-8264c42e16b2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:48.796994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef3472e2-0ddd-4a91-a65e-8264c42e16b2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:48.797900 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef3472e2-0ddd-4a91-a65e-8264c42e16b2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:48.798352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef3472e2-0ddd-4a91-a65e-8264c42e16b2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:48.827142 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ef3472e2-0ddd-4a91-a65e-8264c42e16b2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043148 Jul 14 15:29:48.827804 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3499/7033] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:29:48 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:29:48.837775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3816b0b7-3a98-4983-9fea-4f60dc9e0c61 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:48.838289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3816b0b7-3a98-4983-9fea-4f60dc9e0c61 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:48.846072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3816b0b7-3a98-4983-9fea-4f60dc9e0c61 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:48.846544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3816b0b7-3a98-4983-9fea-4f60dc9e0c61 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:48.847334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3816b0b7-3a98-4983-9fea-4f60dc9e0c61 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:48.847794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3816b0b7-3a98-4983-9fea-4f60dc9e0c61 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:48.926815 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3816b0b7-3a98-4983-9fea-4f60dc9e0c61 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] HTTP exception thrown: Instance c173f845-13be-4c58-8319-02b5427fcad3 is not attached to volume 6b160630-27c2-4a39-842c-bd043aea4d2f Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3816b0b7-3a98-4983-9fea-4f60dc9e0c61 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Request method failure captured: Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments/6b160630-27c2-4a39-842c-bd043aea4d2f HTTP/1.1 Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DZI-OHqGfB9STlxoWerkfEX_NsUQ3ODHnG45W3LoLmU0vWqAghqjtriRphJj7tiFTaiV7mE5hE3M4hpShpDGdOLGeaemFsuPUVwKKjEDGL0eEPns0mCFxIkWXASrvM1kLBFSO8ka3W7eKwbwuLhRnxmc-y00LDT02ILTB7eC5AFqqg Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ee2d7518e7364b5197544ee3c9d4b718 Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1774943261 Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee2d7518e7364b5197544ee3c9d4b718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ee2d7518e7364b5197544ee3c9d4b718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ee2d7518e7364b5197544ee3c9d4b718", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee2d7518e7364b5197544ee3c9d4b718"}]}] Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestEncryptedCinderVolumes-1774943261 Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ee2d7518e7364b5197544ee3c9d4b718 Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1774943261 Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestEncryptedCinderVolumes-1774943261-project Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: cbb20211af2d4d22bbd7ec8e9646d86c Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestEncryptedCinderVolumes-1774943261-project Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance c173f845-13be-4c58-8319-02b5427fcad3 is not attached to volume 6b160630-27c2-4a39-842c-bd043aea4d2f Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'server_id': 'c173f845-13be-4c58-8319-02b5427fcad3', 'id': '6b160630-27c2-4a39-842c-bd043aea4d2f'} Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6b160630-27c2-4a39-842c-bd043aea4d2f. Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c173f845-13be-4c58-8319-02b5427fcad3 is not attached to volume 6b160630-27c2-4a39-842c-bd043aea4d2f Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:48.934983 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:48.939738 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:29:48.939738 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:29:48.939738 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c173f845-13be-4c58-8319-02b5427fcad3 is not attached to volume 6b160630-27c2-4a39-842c-bd043aea4d2f Jul 14 15:29:48.939738 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:29:48.939738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3816b0b7-3a98-4983-9fea-4f60dc9e0c61 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Returning 404 to user: Instance c173f845-13be-4c58-8319-02b5427fcad3 is not attached to volume 6b160630-27c2-4a39-842c-bd043aea4d2f {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:29:48.939738 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3816b0b7-3a98-4983-9fea-4f60dc9e0c61 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments/6b160630-27c2-4a39-842c-bd043aea4d2f" status: 404 len: 154 microversion: 2.1 time: 0.103027 Jul 14 15:29:48.939738 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3535/7034] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:29:48 2022] DELETE /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3/os-volume_attachments/6b160630-27c2-4a39-842c-bd043aea4d2f => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:29:52.276295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5c5bb1e9-b64b-4cbc-b882-1ad6b220caf8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:52.277411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5c5bb1e9-b64b-4cbc-b882-1ad6b220caf8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:52.285806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c5bb1e9-b64b-4cbc-b882-1ad6b220caf8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:52.286266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c5bb1e9-b64b-4cbc-b882-1ad6b220caf8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:52.287058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c5bb1e9-b64b-4cbc-b882-1ad6b220caf8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:52.287504 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5c5bb1e9-b64b-4cbc-b882-1ad6b220caf8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:52.315967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5c5bb1e9-b64b-4cbc-b882-1ad6b220caf8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:29:52.396013 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5c5bb1e9-b64b-4cbc-b882-1ad6b220caf8 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 204 len: 0 microversion: 2.1 time: 0.123371 Jul 14 15:29:52.396765 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3500/7035] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:29:52 2022] DELETE /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:29:52.406046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7b3b715e-5074-45c5-8189-68fb2738258d tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:52.407626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7b3b715e-5074-45c5-8189-68fb2738258d tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:52.416064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b3b715e-5074-45c5-8189-68fb2738258d tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:52.416531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b3b715e-5074-45c5-8189-68fb2738258d tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:52.417364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b3b715e-5074-45c5-8189-68fb2738258d tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:52.417815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b3b715e-5074-45c5-8189-68fb2738258d tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:52.561516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7b3b715e-5074-45c5-8189-68fb2738258d tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:52.569825 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7b3b715e-5074-45c5-8189-68fb2738258d tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1561 microversion: 2.1 time: 0.168607 Jul 14 15:29:52.570419 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3536/7036] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:52 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:53.588501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b5a2ebe2-6b3f-4997-ad8e-446c1d2d54cf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:53.589257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5a2ebe2-6b3f-4997-ad8e-446c1d2d54cf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:53.596901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5a2ebe2-6b3f-4997-ad8e-446c1d2d54cf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:53.597402 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5a2ebe2-6b3f-4997-ad8e-446c1d2d54cf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:53.598186 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5a2ebe2-6b3f-4997-ad8e-446c1d2d54cf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:53.598626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5a2ebe2-6b3f-4997-ad8e-446c1d2d54cf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:53.738219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b5a2ebe2-6b3f-4997-ad8e-446c1d2d54cf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:53.745976 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b5a2ebe2-6b3f-4997-ad8e-446c1d2d54cf tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1561 microversion: 2.1 time: 0.161782 Jul 14 15:29:53.746584 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3501/7037] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:53 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:54.766228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-68115a23-eba8-4e28-bd2f-b7a744468955 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:54.766714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-68115a23-eba8-4e28-bd2f-b7a744468955 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:54.773928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68115a23-eba8-4e28-bd2f-b7a744468955 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:54.774401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68115a23-eba8-4e28-bd2f-b7a744468955 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:54.775203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68115a23-eba8-4e28-bd2f-b7a744468955 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:54.775659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68115a23-eba8-4e28-bd2f-b7a744468955 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:54.995906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-68115a23-eba8-4e28-bd2f-b7a744468955 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:55.004915 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-68115a23-eba8-4e28-bd2f-b7a744468955 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 200 len: 1561 microversion: 2.1 time: 0.243484 Jul 14 15:29:55.005530 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3537/7038] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:54 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 1561 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:55.184004 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-edaf5d4f-bb7d-462e-82fb-d68959c0fc5b req-ee57f467-5655-45ef-97fb-f86981db5f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c173f845-13be-4c58-8319-02b5427fcad3", "name": "network-vif-deleted", "tag": "5ef28e5e-a006-4766-ba8b-70e466152ca0"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:55.196423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-edaf5d4f-bb7d-462e-82fb-d68959c0fc5b req-ee57f467-5655-45ef-97fb-f86981db5f8d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:55.196883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-edaf5d4f-bb7d-462e-82fb-d68959c0fc5b req-ee57f467-5655-45ef-97fb-f86981db5f8d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:55.213991 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-edaf5d4f-bb7d-462e-82fb-d68959c0fc5b req-ee57f467-5655-45ef-97fb-f86981db5f8d service nova] Creating event network-vif-deleted:5ef28e5e-a006-4766-ba8b-70e466152ca0 for instance c173f845-13be-4c58-8319-02b5427fcad3 on n-h1-767704-28 Jul 14 15:29:55.220308 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-edaf5d4f-bb7d-462e-82fb-d68959c0fc5b req-ee57f467-5655-45ef-97fb-f86981db5f8d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041069 Jul 14 15:29:55.221764 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3502/7039] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:56.022977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61042320-2041-4aeb-ab94-2afa40e4aeca tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:56.023612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-61042320-2041-4aeb-ab94-2afa40e4aeca tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: c173f845-13be-4c58-8319-02b5427fcad3] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:56.031430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61042320-2041-4aeb-ab94-2afa40e4aeca tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:56.031912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61042320-2041-4aeb-ab94-2afa40e4aeca tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:56.032705 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61042320-2041-4aeb-ab94-2afa40e4aeca tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:56.033200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-61042320-2041-4aeb-ab94-2afa40e4aeca tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:56.046479 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-61042320-2041-4aeb-ab94-2afa40e4aeca tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] HTTP exception thrown: Instance c173f845-13be-4c58-8319-02b5427fcad3 could not be found. Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61042320-2041-4aeb-ab94-2afa40e4aeca tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Request method failure captured: Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 HTTP/1.1 Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DZI-OHqGfB9STlxoWerkfEX_NsUQ3ODHnG45W3LoLmU0vWqAghqjtriRphJj7tiFTaiV7mE5hE3M4hpShpDGdOLGeaemFsuPUVwKKjEDGL0eEPns0mCFxIkWXASrvM1kLBFSO8ka3W7eKwbwuLhRnxmc-y00LDT02ILTB7eC5AFqqg Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ee2d7518e7364b5197544ee3c9d4b718 Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1774943261 Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee2d7518e7364b5197544ee3c9d4b718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ee2d7518e7364b5197544ee3c9d4b718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ee2d7518e7364b5197544ee3c9d4b718", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee2d7518e7364b5197544ee3c9d4b718"}]}] Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestEncryptedCinderVolumes-1774943261 Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ee2d7518e7364b5197544ee3c9d4b718 Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1774943261 Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestEncryptedCinderVolumes-1774943261-project Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: cbb20211af2d4d22bbd7ec8e9646d86c Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestEncryptedCinderVolumes-1774943261-project Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance c173f845-13be-4c58-8319-02b5427fcad3 could not be found. Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'c173f845-13be-4c58-8319-02b5427fcad3'} Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c173f845-13be-4c58-8319-02b5427fcad3 could not be found. Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c173f845-13be-4c58-8319-02b5427fcad3 could not be found. Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:56.048060 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:29:56.052204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:56.052204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:56.052204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:56.052204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:29:56.052204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:29:56.052204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c173f845-13be-4c58-8319-02b5427fcad3 could not be found. Jul 14 15:29:56.052204 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:29:56.052204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-61042320-2041-4aeb-ab94-2afa40e4aeca tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Returning 404 to user: Instance c173f845-13be-4c58-8319-02b5427fcad3 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:29:56.052204 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-61042320-2041-4aeb-ab94-2afa40e4aeca tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3" status: 404 len: 111 microversion: 2.1 time: 0.030568 Jul 14 15:29:56.052204 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3538/7040] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:56 2022] GET /compute/v2.1/servers/c173f845-13be-4c58-8319-02b5427fcad3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:29:56.058778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fcd65553-5f46-43c2-a081-b423b6a59bb7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '.version_select at 0x7fd6c45cdee0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:56.078683 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fcd65553-5f46-43c2-a081-b423b6a59bb7 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1487241762" status: 202 len: 0 microversion: 2.1 time: 0.024087 Jul 14 15:29:56.079282 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3503/7041] 10.222.0.81 () {58 vars in 1277 bytes} [Thu Jul 14 15:29:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1487241762 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:29:56.098123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2f063e77-07f1-48b4-8d1c-254751ea2dc0 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Action: 'create', calling method: .version_select at 0x7fd6c4e67040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-81231232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPAUlK0Uw1AdwDZv2TIMDle0Vnad3VKGIodjp3DQlIIW+MntC6a/a+1mlqkna+2M+8fTST69jp3NoFLQX6y6y6kdtGfk6nABtZCYK1/BDx1XbGjCBmhtskgydzrblYo7g=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:56.112712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2f063e77-07f1-48b4-8d1c-254751ea2dc0 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Getting quotas for project ee2d7518e7364b5197544ee3c9d4b718. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:29:56.117940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2f063e77-07f1-48b4-8d1c-254751ea2dc0 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Getting quotas for user cbb20211af2d4d22bbd7ec8e9646d86c and project ee2d7518e7364b5197544ee3c9d4b718. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:29:56.132141 n-d-767704-28 devstack@n-api.service[119512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2f063e77-07f1-48b4-8d1c-254751ea2dc0 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [f429ae4b-6107-4dd5-a3e1-bb32c73ed5eb] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:29:57.141212 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [None req-2f063e77-07f1-48b4-8d1c-254751ea2dc0 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [f429ae4b-6107-4dd5-a3e1-bb32c73ed5eb] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 53470. Jul 14 15:29:57.157409 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2f063e77-07f1-48b4-8d1c-254751ea2dc0 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.063796 Jul 14 15:29:57.157950 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3539/7042] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:29:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:57.210776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1566326251", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-81231232", "networks": [{"uuid": "833c87f3-42a0-4cad-bd96-40440f2a26c9"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:57.263578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] validate_networks() for [('833c87f3-42a0-4cad-bd96-40440f2a26c9', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:29:57.650972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:29:57.651406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:29:57.651887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:29:57.652312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:29:57.652765 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:29:57.662787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:57.663249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:57.664071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:57.664516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:57.682538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Getting quotas for project ee2d7518e7364b5197544ee3c9d4b718. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:29:57.688533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Getting quotas for user cbb20211af2d4d22bbd7ec8e9646d86c and project ee2d7518e7364b5197544ee3c9d4b718. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:29:57.701135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:29:57.704309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:29:57.755373 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5b9c8304-000b-4833-a0fa-4330dcb8479c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548562 Jul 14 15:29:57.756031 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3504/7043] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:29:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:29:57.766633 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-efe1d589-696f-4bcf-a811-59ca03a110da tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:57.767264 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-efe1d589-696f-4bcf-a811-59ca03a110da tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:57.824248 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-efe1d589-696f-4bcf-a811-59ca03a110da tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:57.833096 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-efe1d589-696f-4bcf-a811-59ca03a110da tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1261 microversion: 2.1 time: 0.070621 Jul 14 15:29:57.833691 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3540/7044] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:57 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1261 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:58.851469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-94f3f02d-c9f4-4183-a1ad-8bab3ff4c2f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:58.852271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-94f3f02d-c9f4-4183-a1ad-8bab3ff4c2f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:58.860667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94f3f02d-c9f4-4183-a1ad-8bab3ff4c2f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:58.861148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94f3f02d-c9f4-4183-a1ad-8bab3ff4c2f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:58.861932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94f3f02d-c9f4-4183-a1ad-8bab3ff4c2f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:58.862374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-94f3f02d-c9f4-4183-a1ad-8bab3ff4c2f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:58.954860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-94f3f02d-c9f4-4183-a1ad-8bab3ff4c2f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:58.964097 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-94f3f02d-c9f4-4183-a1ad-8bab3ff4c2f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1321 microversion: 2.1 time: 0.117470 Jul 14 15:29:58.964695 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3505/7045] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:58 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1321 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:59.981997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ced45b88-eb7b-4d44-b4e2-c41e9a76be02 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:59.982636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ced45b88-eb7b-4d44-b4e2-c41e9a76be02 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:59.995780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ced45b88-eb7b-4d44-b4e2-c41e9a76be02 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:59.996253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ced45b88-eb7b-4d44-b4e2-c41e9a76be02 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:59.997103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ced45b88-eb7b-4d44-b4e2-c41e9a76be02 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:59.997566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ced45b88-eb7b-4d44-b4e2-c41e9a76be02 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:00.221631 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ced45b88-eb7b-4d44-b4e2-c41e9a76be02 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:00.230823 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ced45b88-eb7b-4d44-b4e2-c41e9a76be02 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1361 microversion: 2.1 time: 0.252662 Jul 14 15:30:00.232403 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3541/7046] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:59 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:00.463615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-028f4ce4-4350-4fcc-93f9-e3b58646fabe req-aa32cc02-935d-4f01-aae9-486f01e3af42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb57000b-0161-458b-a80c-731b29b9f482", "tag": "133857de-3550-4bb7-9725-542113b70d49"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:00.473658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-028f4ce4-4350-4fcc-93f9-e3b58646fabe req-aa32cc02-935d-4f01-aae9-486f01e3af42 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:00.489772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-028f4ce4-4350-4fcc-93f9-e3b58646fabe req-aa32cc02-935d-4f01-aae9-486f01e3af42 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:00.504408 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-028f4ce4-4350-4fcc-93f9-e3b58646fabe req-aa32cc02-935d-4f01-aae9-486f01e3af42 service nova] Creating event network-changed:133857de-3550-4bb7-9725-542113b70d49 for instance cb57000b-0161-458b-a80c-731b29b9f482 on n-h1-767704-28 Jul 14 15:30:00.515361 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-028f4ce4-4350-4fcc-93f9-e3b58646fabe req-aa32cc02-935d-4f01-aae9-486f01e3af42 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055516 Jul 14 15:30:00.517153 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3506/7047] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:01.250279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-71df41f9-2679-4e69-87dd-0af45abca330 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:01.251601 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-71df41f9-2679-4e69-87dd-0af45abca330 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:01.258290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71df41f9-2679-4e69-87dd-0af45abca330 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:01.259151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71df41f9-2679-4e69-87dd-0af45abca330 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:01.259944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71df41f9-2679-4e69-87dd-0af45abca330 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:01.260395 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71df41f9-2679-4e69-87dd-0af45abca330 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:01.402150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-71df41f9-2679-4e69-87dd-0af45abca330 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:01.410566 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-71df41f9-2679-4e69-87dd-0af45abca330 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1361 microversion: 2.1 time: 0.165416 Jul 14 15:30:01.411150 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3542/7048] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:01 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:02.429320 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dc264410-4fce-4331-acd6-9ca78835f30a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:02.430068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dc264410-4fce-4331-acd6-9ca78835f30a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:02.439185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc264410-4fce-4331-acd6-9ca78835f30a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:02.440142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc264410-4fce-4331-acd6-9ca78835f30a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:02.440469 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc264410-4fce-4331-acd6-9ca78835f30a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:02.440899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dc264410-4fce-4331-acd6-9ca78835f30a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:02.654610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dc264410-4fce-4331-acd6-9ca78835f30a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:02.662507 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dc264410-4fce-4331-acd6-9ca78835f30a tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1361 microversion: 2.1 time: 0.237566 Jul 14 15:30:02.663107 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3507/7049] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:02 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:03.680208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-68f62c1e-3bf0-4734-925d-340060830425 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:03.680980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-68f62c1e-3bf0-4734-925d-340060830425 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:03.689513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68f62c1e-3bf0-4734-925d-340060830425 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:03.690003 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68f62c1e-3bf0-4734-925d-340060830425 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:03.690825 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68f62c1e-3bf0-4734-925d-340060830425 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:03.691287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68f62c1e-3bf0-4734-925d-340060830425 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:03.868129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-68f62c1e-3bf0-4734-925d-340060830425 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:03.880848 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-68f62c1e-3bf0-4734-925d-340060830425 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1361 microversion: 2.1 time: 0.204432 Jul 14 15:30:03.881766 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3543/7050] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:03 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:04.884859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f76d4377-c55c-486f-adc3-200e4abcad45 req-0c72f4a2-5dab-49ca-806e-93b9272e5cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb57000b-0161-458b-a80c-731b29b9f482", "name": "network-vif-plugged", "status": "completed", "tag": "133857de-3550-4bb7-9725-542113b70d49"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:04.895378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f76d4377-c55c-486f-adc3-200e4abcad45 req-0c72f4a2-5dab-49ca-806e-93b9272e5cc6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:04.896012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f76d4377-c55c-486f-adc3-200e4abcad45 req-0c72f4a2-5dab-49ca-806e-93b9272e5cc6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:04.903506 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-785b5e88-97d7-4a9f-9c9f-a789a89fde01 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:04.904304 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-785b5e88-97d7-4a9f-9c9f-a789a89fde01 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:04.911672 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f76d4377-c55c-486f-adc3-200e4abcad45 req-0c72f4a2-5dab-49ca-806e-93b9272e5cc6 service nova] Creating event network-vif-plugged:133857de-3550-4bb7-9725-542113b70d49 for instance cb57000b-0161-458b-a80c-731b29b9f482 on n-h1-767704-28 Jul 14 15:30:04.912750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-785b5e88-97d7-4a9f-9c9f-a789a89fde01 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:04.913280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-785b5e88-97d7-4a9f-9c9f-a789a89fde01 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:04.914088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-785b5e88-97d7-4a9f-9c9f-a789a89fde01 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:04.914549 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-785b5e88-97d7-4a9f-9c9f-a789a89fde01 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:04.916783 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f76d4377-c55c-486f-adc3-200e4abcad45 req-0c72f4a2-5dab-49ca-806e-93b9272e5cc6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035915 Jul 14 15:30:04.917840 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3508/7051] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:05.095612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-785b5e88-97d7-4a9f-9c9f-a789a89fde01 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:05.105226 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-785b5e88-97d7-4a9f-9c9f-a789a89fde01 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1361 microversion: 2.1 time: 0.209633 Jul 14 15:30:05.106178 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3544/7052] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:04 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:06.125737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2a054360-0417-4a94-9c01-f9971667630f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:06.126457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2a054360-0417-4a94-9c01-f9971667630f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:06.132875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a054360-0417-4a94-9c01-f9971667630f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:06.133370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a054360-0417-4a94-9c01-f9971667630f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:06.134410 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a054360-0417-4a94-9c01-f9971667630f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:06.134866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2a054360-0417-4a94-9c01-f9971667630f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:06.271283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2a054360-0417-4a94-9c01-f9971667630f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:06.278707 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2a054360-0417-4a94-9c01-f9971667630f tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1361 microversion: 2.1 time: 0.159097 Jul 14 15:30:06.279279 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3509/7053] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:06 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:07.295760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4fcdfa76-ae05-46ca-a630-c88bfa7d3902 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:07.296511 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4fcdfa76-ae05-46ca-a630-c88bfa7d3902 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:07.303897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fcdfa76-ae05-46ca-a630-c88bfa7d3902 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:07.304366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fcdfa76-ae05-46ca-a630-c88bfa7d3902 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:07.305210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fcdfa76-ae05-46ca-a630-c88bfa7d3902 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:07.305665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fcdfa76-ae05-46ca-a630-c88bfa7d3902 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:07.444045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4fcdfa76-ae05-46ca-a630-c88bfa7d3902 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:07.454074 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4fcdfa76-ae05-46ca-a630-c88bfa7d3902 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1553 microversion: 2.1 time: 0.162104 Jul 14 15:30:07.454732 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3545/7054] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:07 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:07.471017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-87b72e49-1343-480c-9d0e-b7e540bc3ba9 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:07.471638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-87b72e49-1343-480c-9d0e-b7e540bc3ba9 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:07.482431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87b72e49-1343-480c-9d0e-b7e540bc3ba9 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:07.482751 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87b72e49-1343-480c-9d0e-b7e540bc3ba9 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:07.483719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87b72e49-1343-480c-9d0e-b7e540bc3ba9 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:07.484398 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-87b72e49-1343-480c-9d0e-b7e540bc3ba9 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:07.624781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-87b72e49-1343-480c-9d0e-b7e540bc3ba9 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:07.632586 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-87b72e49-1343-480c-9d0e-b7e540bc3ba9 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1553 microversion: 2.1 time: 0.165975 Jul 14 15:30:07.633198 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3510/7055] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:07 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:30:09.128293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-96465b36-16c3-461b-9ea5-651d57f6d385 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3af3df34-c43a-4036-b666-941e53b6f711"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:09.129509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-96465b36-16c3-461b-9ea5-651d57f6d385 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:09.131545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:09.138580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96465b36-16c3-461b-9ea5-651d57f6d385 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:09.139047 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96465b36-16c3-461b-9ea5-651d57f6d385 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:09.140558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96465b36-16c3-461b-9ea5-651d57f6d385 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:09.141049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-96465b36-16c3-461b-9ea5-651d57f6d385 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:09.423612 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-96465b36-16c3-461b-9ea5-651d57f6d385 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "POST /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300219 Jul 14 15:30:09.424230 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3546/7056] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 15:30:09 2022] POST /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:21.149246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-13756b6e-d076-40d4-b30f-6c09b1835dbe tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:21.149771 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-13756b6e-d076-40d4-b30f-6c09b1835dbe tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:21.151904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:21.152579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:21.153811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:21.154544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:21.162571 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13756b6e-d076-40d4-b30f-6c09b1835dbe tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:21.163034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13756b6e-d076-40d4-b30f-6c09b1835dbe tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:21.163819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13756b6e-d076-40d4-b30f-6c09b1835dbe tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:21.164271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-13756b6e-d076-40d4-b30f-6c09b1835dbe tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:21.252785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-13756b6e-d076-40d4-b30f-6c09b1835dbe tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lazy-loading 'services' on Instance uuid cb57000b-0161-458b-a80c-731b29b9f482 {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:30:21.325965 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-13756b6e-d076-40d4-b30f-6c09b1835dbe tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments/3af3df34-c43a-4036-b666-941e53b6f711" status: 202 len: 0 microversion: 2.1 time: 0.180513 Jul 14 15:30:21.326588 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3511/7057] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:30:21 2022] DELETE /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments/3af3df34-c43a-4036-b666-941e53b6f711 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:30:21.333970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:21.335044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:21.340271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-236d07d5-6aa5-4728-99b7-2bfcf385c56e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:21.341333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-236d07d5-6aa5-4728-99b7-2bfcf385c56e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:21.351755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-236d07d5-6aa5-4728-99b7-2bfcf385c56e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:21.352222 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-236d07d5-6aa5-4728-99b7-2bfcf385c56e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:21.353035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-236d07d5-6aa5-4728-99b7-2bfcf385c56e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:21.353488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-236d07d5-6aa5-4728-99b7-2bfcf385c56e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:21.389235 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-236d07d5-6aa5-4728-99b7-2bfcf385c56e tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058020 Jul 14 15:30:21.390082 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3547/7058] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:30:21 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:30:22.403572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3ebd3875-a944-4e29-865e-03ac2d7c7659 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:22.404527 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3ebd3875-a944-4e29-865e-03ac2d7c7659 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:22.412867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ebd3875-a944-4e29-865e-03ac2d7c7659 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:22.413383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ebd3875-a944-4e29-865e-03ac2d7c7659 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:22.414159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ebd3875-a944-4e29-865e-03ac2d7c7659 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:22.415512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ebd3875-a944-4e29-865e-03ac2d7c7659 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:22.450074 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3ebd3875-a944-4e29-865e-03ac2d7c7659 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052104 Jul 14 15:30:22.450664 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3512/7059] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:30:22 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:23.462534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-655e25c3-28d3-4379-b1b2-5618134808f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:23.463600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-655e25c3-28d3-4379-b1b2-5618134808f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:23.471940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-655e25c3-28d3-4379-b1b2-5618134808f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:23.472411 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-655e25c3-28d3-4379-b1b2-5618134808f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:23.473246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-655e25c3-28d3-4379-b1b2-5618134808f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:23.473702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-655e25c3-28d3-4379-b1b2-5618134808f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:23.509890 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-655e25c3-28d3-4379-b1b2-5618134808f6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051422 Jul 14 15:30:23.510667 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3548/7060] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:30:23 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:30:24.522653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9de8367a-54a2-4d02-84a2-b896b353e426 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:24.523614 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9de8367a-54a2-4d02-84a2-b896b353e426 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:24.530984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9de8367a-54a2-4d02-84a2-b896b353e426 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:24.531890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9de8367a-54a2-4d02-84a2-b896b353e426 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:24.532343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9de8367a-54a2-4d02-84a2-b896b353e426 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:24.532799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9de8367a-54a2-4d02-84a2-b896b353e426 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:24.564514 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9de8367a-54a2-4d02-84a2-b896b353e426 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046231 Jul 14 15:30:24.565126 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3513/7061] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:30:24 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:25.576206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8621a67a-bdd6-4ab4-a915-984f206e3d7c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:25.577101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8621a67a-bdd6-4ab4-a915-984f206e3d7c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:25.584368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8621a67a-bdd6-4ab4-a915-984f206e3d7c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:25.584836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8621a67a-bdd6-4ab4-a915-984f206e3d7c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:25.585642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8621a67a-bdd6-4ab4-a915-984f206e3d7c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:25.586129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8621a67a-bdd6-4ab4-a915-984f206e3d7c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:25.617270 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8621a67a-bdd6-4ab4-a915-984f206e3d7c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045121 Jul 14 15:30:25.617842 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3549/7062] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:30:25 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:26.628563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ac340554-4563-4948-a0b8-40c30a2be3dc tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:26.629558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ac340554-4563-4948-a0b8-40c30a2be3dc tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:26.636798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac340554-4563-4948-a0b8-40c30a2be3dc tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:26.637298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac340554-4563-4948-a0b8-40c30a2be3dc tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:26.638079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac340554-4563-4948-a0b8-40c30a2be3dc tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:26.638529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ac340554-4563-4948-a0b8-40c30a2be3dc tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:26.668780 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ac340554-4563-4948-a0b8-40c30a2be3dc tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044816 Jul 14 15:30:26.669395 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3514/7063] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:30:26 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:30:26.679686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a15f5fdb-d0a2-4170-8c00-a25748787507 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:26.680289 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a15f5fdb-d0a2-4170-8c00-a25748787507 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:26.688131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a15f5fdb-d0a2-4170-8c00-a25748787507 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:26.688598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a15f5fdb-d0a2-4170-8c00-a25748787507 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:26.689494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a15f5fdb-d0a2-4170-8c00-a25748787507 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:26.689867 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a15f5fdb-d0a2-4170-8c00-a25748787507 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:26.769939 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-a15f5fdb-d0a2-4170-8c00-a25748787507 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] HTTP exception thrown: Instance cb57000b-0161-458b-a80c-731b29b9f482 is not attached to volume 3af3df34-c43a-4036-b666-941e53b6f711 Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a15f5fdb-d0a2-4170-8c00-a25748787507 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Request method failure captured: Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments/3af3df34-c43a-4036-b666-941e53b6f711 HTTP/1.1 Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DZI-OHqGfB9STlxoWerkfEX_NsUQ3ODHnG45W3LoLmU0vWqAghqjtriRphJj7tiFTaiV7mE5hE3M4hpShpDGdOLGeaemFsuPUVwKKjEDGL0eEPns0mCFxIkWXASrvM1kLBFSO8ka3W7eKwbwuLhRnxmc-y00LDT02ILTB7eC5AFqqg Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ee2d7518e7364b5197544ee3c9d4b718 Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1774943261 Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee2d7518e7364b5197544ee3c9d4b718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ee2d7518e7364b5197544ee3c9d4b718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ee2d7518e7364b5197544ee3c9d4b718", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee2d7518e7364b5197544ee3c9d4b718"}]}] Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestEncryptedCinderVolumes-1774943261 Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ee2d7518e7364b5197544ee3c9d4b718 Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1774943261 Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestEncryptedCinderVolumes-1774943261-project Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: cbb20211af2d4d22bbd7ec8e9646d86c Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestEncryptedCinderVolumes-1774943261-project Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance cb57000b-0161-458b-a80c-731b29b9f482 is not attached to volume 3af3df34-c43a-4036-b666-941e53b6f711 Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'server_id': 'cb57000b-0161-458b-a80c-731b29b9f482', 'id': '3af3df34-c43a-4036-b666-941e53b6f711'} Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3af3df34-c43a-4036-b666-941e53b6f711. Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb57000b-0161-458b-a80c-731b29b9f482 is not attached to volume 3af3df34-c43a-4036-b666-941e53b6f711 Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:30:26.771610 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:30:26.775951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:30:26.775951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:30:26.775951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb57000b-0161-458b-a80c-731b29b9f482 is not attached to volume 3af3df34-c43a-4036-b666-941e53b6f711 Jul 14 15:30:26.775951 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:30:26.775951 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a15f5fdb-d0a2-4170-8c00-a25748787507 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Returning 404 to user: Instance cb57000b-0161-458b-a80c-731b29b9f482 is not attached to volume 3af3df34-c43a-4036-b666-941e53b6f711 {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:30:26.775951 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a15f5fdb-d0a2-4170-8c00-a25748787507 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments/3af3df34-c43a-4036-b666-941e53b6f711" status: 404 len: 154 microversion: 2.1 time: 0.097481 Jul 14 15:30:26.775951 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3550/7064] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:30:26 2022] DELETE /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482/os-volume_attachments/3af3df34-c43a-4036-b666-941e53b6f711 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:30:30.109532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d011f585-2587-42ad-ab61-620b0c11a67c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:30.110036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d011f585-2587-42ad-ab61-620b0c11a67c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:30.117077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d011f585-2587-42ad-ab61-620b0c11a67c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:30.117542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d011f585-2587-42ad-ab61-620b0c11a67c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:30.118301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d011f585-2587-42ad-ab61-620b0c11a67c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:30.118736 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d011f585-2587-42ad-ab61-620b0c11a67c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:30.145179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d011f585-2587-42ad-ab61-620b0c11a67c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:30:30.228175 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d011f585-2587-42ad-ab61-620b0c11a67c tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 204 len: 0 microversion: 2.1 time: 0.122722 Jul 14 15:30:30.229078 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3515/7065] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:30:30 2022] DELETE /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:30:30.238854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ca3a0f4e-1d12-4ff3-a04c-84120b6843c6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:30.239575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ca3a0f4e-1d12-4ff3-a04c-84120b6843c6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:30.246888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ca3a0f4e-1d12-4ff3-a04c-84120b6843c6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:30.247662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ca3a0f4e-1d12-4ff3-a04c-84120b6843c6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:30.248762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ca3a0f4e-1d12-4ff3-a04c-84120b6843c6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:30.250403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ca3a0f4e-1d12-4ff3-a04c-84120b6843c6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:30.393667 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ca3a0f4e-1d12-4ff3-a04c-84120b6843c6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:30.401513 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ca3a0f4e-1d12-4ff3-a04c-84120b6843c6 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1559 microversion: 2.1 time: 0.168371 Jul 14 15:30:30.402191 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3551/7066] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:30 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:31.420167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-955d271c-c388-427e-96a4-627ba6227ee2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:31.421357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-955d271c-c388-427e-96a4-627ba6227ee2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:31.428452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-955d271c-c388-427e-96a4-627ba6227ee2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:31.428904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-955d271c-c388-427e-96a4-627ba6227ee2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:31.429721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-955d271c-c388-427e-96a4-627ba6227ee2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:31.430150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-955d271c-c388-427e-96a4-627ba6227ee2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:31.566227 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-955d271c-c388-427e-96a4-627ba6227ee2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:31.573902 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-955d271c-c388-427e-96a4-627ba6227ee2 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1559 microversion: 2.1 time: 0.158108 Jul 14 15:30:31.574480 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3516/7067] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:31 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:32.590960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8eab0754-f146-49bc-8103-ec0aa7591651 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:32.591586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8eab0754-f146-49bc-8103-ec0aa7591651 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:32.598658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8eab0754-f146-49bc-8103-ec0aa7591651 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:32.599119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8eab0754-f146-49bc-8103-ec0aa7591651 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:32.599902 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8eab0754-f146-49bc-8103-ec0aa7591651 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:32.600351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8eab0754-f146-49bc-8103-ec0aa7591651 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:32.839663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8eab0754-f146-49bc-8103-ec0aa7591651 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb20211af2d4d22bbd7ec8e9646d86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2d7518e7364b5197544ee3c9d4b718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:32.849522 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8eab0754-f146-49bc-8103-ec0aa7591651 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 200 len: 1559 microversion: 2.1 time: 0.262486 Jul 14 15:30:32.850202 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3552/7068] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:32 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 1559 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:33.169193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0914c650-c8ab-4b19-ab62-d855ffc06eca req-3f5aaa94-1f8b-4bb4-91f6-077acba97d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb57000b-0161-458b-a80c-731b29b9f482", "name": "network-vif-deleted", "tag": "133857de-3550-4bb7-9725-542113b70d49"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:33.180047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0914c650-c8ab-4b19-ab62-d855ffc06eca req-3f5aaa94-1f8b-4bb4-91f6-077acba97d1a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:33.180754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0914c650-c8ab-4b19-ab62-d855ffc06eca req-3f5aaa94-1f8b-4bb4-91f6-077acba97d1a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:33.196701 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0914c650-c8ab-4b19-ab62-d855ffc06eca req-3f5aaa94-1f8b-4bb4-91f6-077acba97d1a service nova] Creating event network-vif-deleted:133857de-3550-4bb7-9725-542113b70d49 for instance cb57000b-0161-458b-a80c-731b29b9f482 on n-h1-767704-28 Jul 14 15:30:33.204099 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0914c650-c8ab-4b19-ab62-d855ffc06eca req-3f5aaa94-1f8b-4bb4-91f6-077acba97d1a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103494 Jul 14 15:30:33.204996 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3517/7069] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:33.867083 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b30556a-4c3e-4f76-a49f-e48b88103efb tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:33.867616 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3b30556a-4c3e-4f76-a49f-e48b88103efb tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] [instance: cb57000b-0161-458b-a80c-731b29b9f482] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:33.874664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b30556a-4c3e-4f76-a49f-e48b88103efb tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:33.875131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b30556a-4c3e-4f76-a49f-e48b88103efb tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:33.875920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b30556a-4c3e-4f76-a49f-e48b88103efb tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:33.876373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b30556a-4c3e-4f76-a49f-e48b88103efb tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:33.890476 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3b30556a-4c3e-4f76-a49f-e48b88103efb tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] HTTP exception thrown: Instance cb57000b-0161-458b-a80c-731b29b9f482 could not be found. Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b30556a-4c3e-4f76-a49f-e48b88103efb tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Request method failure captured: Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 HTTP/1.1 Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DZI-OHqGfB9STlxoWerkfEX_NsUQ3ODHnG45W3LoLmU0vWqAghqjtriRphJj7tiFTaiV7mE5hE3M4hpShpDGdOLGeaemFsuPUVwKKjEDGL0eEPns0mCFxIkWXASrvM1kLBFSO8ka3W7eKwbwuLhRnxmc-y00LDT02ILTB7eC5AFqqg Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: ee2d7518e7364b5197544ee3c9d4b718 Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1774943261 Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee2d7518e7364b5197544ee3c9d4b718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ee2d7518e7364b5197544ee3c9d4b718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ee2d7518e7364b5197544ee3c9d4b718", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ee2d7518e7364b5197544ee3c9d4b718"}]}] Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestEncryptedCinderVolumes-1774943261 Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: ee2d7518e7364b5197544ee3c9d4b718 Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1774943261 Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestEncryptedCinderVolumes-1774943261-project Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: cbb20211af2d4d22bbd7ec8e9646d86c Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestEncryptedCinderVolumes-1774943261-project Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance cb57000b-0161-458b-a80c-731b29b9f482 could not be found. Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'cb57000b-0161-458b-a80c-731b29b9f482'} Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb57000b-0161-458b-a80c-731b29b9f482 could not be found. Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb57000b-0161-458b-a80c-731b29b9f482 could not be found. Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:30:33.892041 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:30:33.896360 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:30:33.896360 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:30:33.896360 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:30:33.896360 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:30:33.896360 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:30:33.896360 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb57000b-0161-458b-a80c-731b29b9f482 could not be found. Jul 14 15:30:33.896360 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:30:33.896360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b30556a-4c3e-4f76-a49f-e48b88103efb tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Returning 404 to user: Instance cb57000b-0161-458b-a80c-731b29b9f482 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:30:33.896360 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b30556a-4c3e-4f76-a49f-e48b88103efb tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482" status: 404 len: 111 microversion: 2.1 time: 0.030483 Jul 14 15:30:33.896360 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3553/7070] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:33 2022] GET /compute/v2.1/servers/cb57000b-0161-458b-a80c-731b29b9f482 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:30:33.902996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5d2953a5-8c8a-4fa7-a76e-1cbae0471245 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] Calling method '.version_select at 0x7fd6c533bca0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:33.922324 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5d2953a5-8c8a-4fa7-a76e-1cbae0471245 tempest-TestEncryptedCinderVolumes-1774943261 tempest-TestEncryptedCinderVolumes-1774943261-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-81231232" status: 202 len: 0 microversion: 2.1 time: 0.023551 Jul 14 15:30:33.922910 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3518/7071] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jul 14 15:30:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-81231232 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:31:01.071276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-80c073cf-eff2-4279-9596-f29dbe1479d8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Action: 'create', calling method: .version_select at 0x7fd6c4e27700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-352619543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFOUgK1dVk9b0PfB4RpbjqgJ9y6Aod28ppFBEepEpPXloLJ6utcwZXoWEGyUVscD6sm6iEaANBx1hfCVJeNLfzrkKN1ifFBH0f/9qtGoFWKRFHy/ve7UtRcAxtzNqDYqA=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:01.076146 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=14 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:01.076707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=38 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:01.090165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-80c073cf-eff2-4279-9596-f29dbe1479d8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Getting quotas for project 74218b29767c4c5d8822efdc7002f988. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:31:01.096228 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-80c073cf-eff2-4279-9596-f29dbe1479d8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Getting quotas for user fc298b584fa34bd6bc80c43300821e3b and project 74218b29767c4c5d8822efdc7002f988. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:31:01.122733 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-80c073cf-eff2-4279-9596-f29dbe1479d8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055259 Jul 14 15:31:01.123388 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3554/7072] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:31:01 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:31:01.168928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:01.170308 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:01.175609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-627325494", "imageRef": "4f48e6c1-1ecc-4e2d-94d2-073c6b3d07e6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-352619543", "networks": [{"uuid": "dc0bcd61-dba1-4a9a-a971-c6a87c8840e5"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:01.232439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] validate_networks() for [('dc0bcd61-dba1-4a9a-a971-c6a87c8840e5', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:31:01.641985 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:31:01.642408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:31:01.642885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:31:01.643354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:31:01.643716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:31:01.653073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:01.653554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:01.654364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:01.654990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:01.673348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Getting quotas for project 74218b29767c4c5d8822efdc7002f988. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:31:01.678889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Getting quotas for user fc298b584fa34bd6bc80c43300821e3b and project 74218b29767c4c5d8822efdc7002f988. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:31:01.692646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:31:01.695099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f48e6c1-1ecc-4e2d-94d2-073c6b3d07e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:31:01.751044 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a92f10cb-4658-448d-ab3d-7471d3203102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583971 Jul 14 15:31:01.752222 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3519/7073] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:31:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:31:01.764692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a16e86d6-46a5-45af-b685-147e25507d61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:01.765820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a16e86d6-46a5-45af-b685-147e25507d61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:01.850574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a16e86d6-46a5-45af-b685-147e25507d61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:01.859808 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a16e86d6-46a5-45af-b685-147e25507d61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1257 microversion: 2.1 time: 0.099946 Jul 14 15:31:01.860488 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3555/7074] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:01 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1257 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:02.879111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d7e18d24-368a-4eca-bbfd-db2efa3b597c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:02.880010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d7e18d24-368a-4eca-bbfd-db2efa3b597c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:02.888638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7e18d24-368a-4eca-bbfd-db2efa3b597c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:02.890002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7e18d24-368a-4eca-bbfd-db2efa3b597c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:02.890885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7e18d24-368a-4eca-bbfd-db2efa3b597c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:02.891334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7e18d24-368a-4eca-bbfd-db2efa3b597c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:02.971889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d7e18d24-368a-4eca-bbfd-db2efa3b597c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:02.980395 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d7e18d24-368a-4eca-bbfd-db2efa3b597c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1317 microversion: 2.1 time: 0.107496 Jul 14 15:31:02.981863 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3520/7075] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:02 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1317 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:04.001259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-81d8ade5-45a8-41e0-a36a-17ec5399ca89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:04.002587 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-81d8ade5-45a8-41e0-a36a-17ec5399ca89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:04.027538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81d8ade5-45a8-41e0-a36a-17ec5399ca89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:04.028450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81d8ade5-45a8-41e0-a36a-17ec5399ca89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:04.030485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81d8ade5-45a8-41e0-a36a-17ec5399ca89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:04.031300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81d8ade5-45a8-41e0-a36a-17ec5399ca89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:04.221292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-81d8ade5-45a8-41e0-a36a-17ec5399ca89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:04.232088 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-81d8ade5-45a8-41e0-a36a-17ec5399ca89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.236188 Jul 14 15:31:04.247981 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3556/7076] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:03 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:05.252192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c110ab44-f0b2-43a3-bf69-00a2928df19c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:05.252836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c110ab44-f0b2-43a3-bf69-00a2928df19c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:05.260236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c110ab44-f0b2-43a3-bf69-00a2928df19c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:05.260695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c110ab44-f0b2-43a3-bf69-00a2928df19c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:05.261515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c110ab44-f0b2-43a3-bf69-00a2928df19c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:05.261959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c110ab44-f0b2-43a3-bf69-00a2928df19c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:05.404795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c110ab44-f0b2-43a3-bf69-00a2928df19c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:05.414016 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c110ab44-f0b2-43a3-bf69-00a2928df19c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.166366 Jul 14 15:31:05.414606 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3521/7077] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:05 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:06.431655 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8a551099-3d1c-4fd0-947b-bade5fe3a76a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:06.432333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8a551099-3d1c-4fd0-947b-bade5fe3a76a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:06.441416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a551099-3d1c-4fd0-947b-bade5fe3a76a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:06.442131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a551099-3d1c-4fd0-947b-bade5fe3a76a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:06.443331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a551099-3d1c-4fd0-947b-bade5fe3a76a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:06.443881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8a551099-3d1c-4fd0-947b-bade5fe3a76a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:06.586626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8a551099-3d1c-4fd0-947b-bade5fe3a76a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:06.595810 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8a551099-3d1c-4fd0-947b-bade5fe3a76a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.168119 Jul 14 15:31:06.596403 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3557/7078] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:06 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:07.613767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f4e5e25-59d9-435c-a49c-9e8a177beade tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:07.614440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9f4e5e25-59d9-435c-a49c-9e8a177beade tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:07.621967 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f4e5e25-59d9-435c-a49c-9e8a177beade tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:07.622611 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f4e5e25-59d9-435c-a49c-9e8a177beade tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:07.624346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f4e5e25-59d9-435c-a49c-9e8a177beade tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:07.624921 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f4e5e25-59d9-435c-a49c-9e8a177beade tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:07.763638 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9f4e5e25-59d9-435c-a49c-9e8a177beade tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:07.772736 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9f4e5e25-59d9-435c-a49c-9e8a177beade tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.162753 Jul 14 15:31:07.774109 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3522/7079] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:07 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:08.791011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4362be4c-887f-455d-b482-e061b6206335 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:08.791776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4362be4c-887f-455d-b482-e061b6206335 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:08.799718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4362be4c-887f-455d-b482-e061b6206335 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:08.800273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4362be4c-887f-455d-b482-e061b6206335 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:08.801187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4362be4c-887f-455d-b482-e061b6206335 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:08.801718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4362be4c-887f-455d-b482-e061b6206335 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:08.943436 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4362be4c-887f-455d-b482-e061b6206335 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:08.952415 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4362be4c-887f-455d-b482-e061b6206335 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.164517 Jul 14 15:31:08.952899 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3558/7080] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:08 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:31:09.969444 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d75334e4-c9a9-4ebc-8384-67631e6a6393 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:09.970079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d75334e4-c9a9-4ebc-8384-67631e6a6393 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:09.977565 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d75334e4-c9a9-4ebc-8384-67631e6a6393 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:09.978018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d75334e4-c9a9-4ebc-8384-67631e6a6393 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:09.978798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d75334e4-c9a9-4ebc-8384-67631e6a6393 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:09.979236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d75334e4-c9a9-4ebc-8384-67631e6a6393 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:10.118761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d75334e4-c9a9-4ebc-8384-67631e6a6393 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:10.126843 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d75334e4-c9a9-4ebc-8384-67631e6a6393 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.161244 Jul 14 15:31:10.127776 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3523/7081] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:09 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:11.150092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc769d88-e410-4ce8-ba32-8a949febf7e1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:11.150762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dc769d88-e410-4ce8-ba32-8a949febf7e1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:11.157150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc769d88-e410-4ce8-ba32-8a949febf7e1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:11.157565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc769d88-e410-4ce8-ba32-8a949febf7e1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:11.158355 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc769d88-e410-4ce8-ba32-8a949febf7e1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:11.158814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc769d88-e410-4ce8-ba32-8a949febf7e1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:11.292604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dc769d88-e410-4ce8-ba32-8a949febf7e1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:11.300893 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dc769d88-e410-4ce8-ba32-8a949febf7e1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.157842 Jul 14 15:31:11.301495 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3559/7082] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:11 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:12.321930 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-224e6cf5-6b6d-4200-aa0d-1fd119029487 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:12.322592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-224e6cf5-6b6d-4200-aa0d-1fd119029487 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:12.325119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:12.325796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:12.332644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-224e6cf5-6b6d-4200-aa0d-1fd119029487 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:12.333142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-224e6cf5-6b6d-4200-aa0d-1fd119029487 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:12.333923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-224e6cf5-6b6d-4200-aa0d-1fd119029487 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:12.334548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-224e6cf5-6b6d-4200-aa0d-1fd119029487 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:12.383985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-f056a541-617d-4f41-a6a6-6d597f6bf623 req-a94309de-6122-4a36-9607-1f6074681406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a", "tag": "2b17ef51-b7b6-4ffd-956e-7422cce545d3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:12.388089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:12.406326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f056a541-617d-4f41-a6a6-6d597f6bf623 req-a94309de-6122-4a36-9607-1f6074681406 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:12.406779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-f056a541-617d-4f41-a6a6-6d597f6bf623 req-a94309de-6122-4a36-9607-1f6074681406 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:12.418816 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-f056a541-617d-4f41-a6a6-6d597f6bf623 req-a94309de-6122-4a36-9607-1f6074681406 service nova] Creating event network-changed:2b17ef51-b7b6-4ffd-956e-7422cce545d3 for instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a on n-h2-767704-28 Jul 14 15:31:12.424094 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-f056a541-617d-4f41-a6a6-6d597f6bf623 req-a94309de-6122-4a36-9607-1f6074681406 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046239 Jul 14 15:31:12.424983 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3560/7083] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:31:12.610460 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-224e6cf5-6b6d-4200-aa0d-1fd119029487 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:12.617980 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-224e6cf5-6b6d-4200-aa0d-1fd119029487 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.300358 Jul 14 15:31:12.618569 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3524/7084] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:12 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:13.636976 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a22b376f-83c9-4005-937e-b4204029903c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:13.637738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a22b376f-83c9-4005-937e-b4204029903c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:13.644755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a22b376f-83c9-4005-937e-b4204029903c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:13.645269 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a22b376f-83c9-4005-937e-b4204029903c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:13.646058 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a22b376f-83c9-4005-937e-b4204029903c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:13.646513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a22b376f-83c9-4005-937e-b4204029903c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:13.775610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a22b376f-83c9-4005-937e-b4204029903c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:13.784071 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a22b376f-83c9-4005-937e-b4204029903c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.152446 Jul 14 15:31:13.784650 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3561/7085] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:13 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:14.800420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2cd71d80-ffec-4e06-8289-f71b2028d1c9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:14.801617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2cd71d80-ffec-4e06-8289-f71b2028d1c9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:14.808579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cd71d80-ffec-4e06-8289-f71b2028d1c9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:14.809151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cd71d80-ffec-4e06-8289-f71b2028d1c9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:14.809895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cd71d80-ffec-4e06-8289-f71b2028d1c9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:14.810289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2cd71d80-ffec-4e06-8289-f71b2028d1c9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:14.944569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2cd71d80-ffec-4e06-8289-f71b2028d1c9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:14.952749 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2cd71d80-ffec-4e06-8289-f71b2028d1c9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.156232 Jul 14 15:31:14.953391 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3525/7086] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:14 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:15.969671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-40583189-92e4-4df9-b04b-740de304648f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:15.970306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-40583189-92e4-4df9-b04b-740de304648f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:15.977278 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40583189-92e4-4df9-b04b-740de304648f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:15.977752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40583189-92e4-4df9-b04b-740de304648f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:15.978538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40583189-92e4-4df9-b04b-740de304648f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:15.979027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-40583189-92e4-4df9-b04b-740de304648f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:16.110686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-40583189-92e4-4df9-b04b-740de304648f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:16.118176 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-40583189-92e4-4df9-b04b-740de304648f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.152446 Jul 14 15:31:16.118751 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3562/7087] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:15 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:16.839251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-4b7e0173-8391-4d33-8a3a-98f6ac73ae20 req-fc2ffaf3-67ca-4bb6-b3bf-3b84803c2e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a", "name": "network-vif-plugged", "status": "completed", "tag": "2b17ef51-b7b6-4ffd-956e-7422cce545d3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:16.850176 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4b7e0173-8391-4d33-8a3a-98f6ac73ae20 req-fc2ffaf3-67ca-4bb6-b3bf-3b84803c2e09 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:16.850649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-4b7e0173-8391-4d33-8a3a-98f6ac73ae20 req-fc2ffaf3-67ca-4bb6-b3bf-3b84803c2e09 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:16.863241 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-4b7e0173-8391-4d33-8a3a-98f6ac73ae20 req-fc2ffaf3-67ca-4bb6-b3bf-3b84803c2e09 service nova] Creating event network-vif-plugged:2b17ef51-b7b6-4ffd-956e-7422cce545d3 for instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a on n-h2-767704-28 Jul 14 15:31:16.868271 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-4b7e0173-8391-4d33-8a3a-98f6ac73ae20 req-fc2ffaf3-67ca-4bb6-b3bf-3b84803c2e09 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033417 Jul 14 15:31:16.868882 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3526/7088] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:31:17.135270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-74fc9cfe-f6ea-45e6-b05a-a1bfc35c4d89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:17.135897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-74fc9cfe-f6ea-45e6-b05a-a1bfc35c4d89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:17.143068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74fc9cfe-f6ea-45e6-b05a-a1bfc35c4d89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:17.143545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74fc9cfe-f6ea-45e6-b05a-a1bfc35c4d89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:17.144338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74fc9cfe-f6ea-45e6-b05a-a1bfc35c4d89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:17.144799 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-74fc9cfe-f6ea-45e6-b05a-a1bfc35c4d89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:17.279210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-74fc9cfe-f6ea-45e6-b05a-a1bfc35c4d89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:17.288041 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-74fc9cfe-f6ea-45e6-b05a-a1bfc35c4d89 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.157037 Jul 14 15:31:17.288622 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3563/7089] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:17 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:18.308977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4df6195-9fe9-442e-a4da-08bd3e7820ea tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:18.309816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b4df6195-9fe9-442e-a4da-08bd3e7820ea tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:18.316963 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4df6195-9fe9-442e-a4da-08bd3e7820ea tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:18.317439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4df6195-9fe9-442e-a4da-08bd3e7820ea tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:18.318222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4df6195-9fe9-442e-a4da-08bd3e7820ea tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:18.318676 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4df6195-9fe9-442e-a4da-08bd3e7820ea tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:18.454322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b4df6195-9fe9-442e-a4da-08bd3e7820ea tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:18.461819 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b4df6195-9fe9-442e-a4da-08bd3e7820ea tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1357 microversion: 2.1 time: 0.159282 Jul 14 15:31:18.462395 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3527/7090] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:18 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:19.478531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ae985b6-b51b-4c0e-a6f4-309ac0391c2b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:19.479176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6ae985b6-b51b-4c0e-a6f4-309ac0391c2b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:19.486767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ae985b6-b51b-4c0e-a6f4-309ac0391c2b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:19.487244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ae985b6-b51b-4c0e-a6f4-309ac0391c2b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:19.488031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ae985b6-b51b-4c0e-a6f4-309ac0391c2b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:19.488492 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ae985b6-b51b-4c0e-a6f4-309ac0391c2b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:19.616298 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6ae985b6-b51b-4c0e-a6f4-309ac0391c2b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:19.625190 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6ae985b6-b51b-4c0e-a6f4-309ac0391c2b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1548 microversion: 2.1 time: 0.150535 Jul 14 15:31:19.625775 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3564/7091] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:19 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:19.641555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-36ee42af-2a77-4c63-a7da-954a85b30ad8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:19.642174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-36ee42af-2a77-4c63-a7da-954a85b30ad8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:19.649010 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36ee42af-2a77-4c63-a7da-954a85b30ad8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:19.649465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36ee42af-2a77-4c63-a7da-954a85b30ad8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:19.650225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36ee42af-2a77-4c63-a7da-954a85b30ad8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:19.650661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36ee42af-2a77-4c63-a7da-954a85b30ad8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:19.787652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-36ee42af-2a77-4c63-a7da-954a85b30ad8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:19.795925 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-36ee42af-2a77-4c63-a7da-954a85b30ad8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1548 microversion: 2.1 time: 0.157883 Jul 14 15:31:19.796508 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3528/7092] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:19 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:19.812066 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b67cf717-73a1-4608-8ead-a807a41acab9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:19.815451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b67cf717-73a1-4608-8ead-a807a41acab9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:19.816270 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b67cf717-73a1-4608-8ead-a807a41acab9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Searching by: {'deleted': False, 'project_id': '74218b29767c4c5d8822efdc7002f988'} {{(pid=119512) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 15:31:19.821744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b67cf717-73a1-4608-8ead-a807a41acab9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:19.822841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b67cf717-73a1-4608-8ead-a807a41acab9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:19.823671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b67cf717-73a1-4608-8ead-a807a41acab9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:19.824131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b67cf717-73a1-4608-8ead-a807a41acab9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:19.848097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.multi_cell_list [None req-b67cf717-73a1-4608-8ead-a807a41acab9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 15:31:19.878193 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b67cf717-73a1-4608-8ead-a807a41acab9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070624 Jul 14 15:31:19.878787 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3565/7093] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 15:31:19 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:31:19.889545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5bf7be00-5e31-408a-b803-b0358e86f157 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:19.890426 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5bf7be00-5e31-408a-b803-b0358e86f157 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:19.896544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bf7be00-5e31-408a-b803-b0358e86f157 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:19.897034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bf7be00-5e31-408a-b803-b0358e86f157 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:19.897827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bf7be00-5e31-408a-b803-b0358e86f157 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:19.898276 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5bf7be00-5e31-408a-b803-b0358e86f157 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:20.027697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5bf7be00-5e31-408a-b803-b0358e86f157 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:20.035764 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5bf7be00-5e31-408a-b803-b0358e86f157 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1548 microversion: 2.1 time: 0.150707 Jul 14 15:31:20.036343 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3529/7094] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:19 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:21.553891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-870ec460-4d47-402d-a3d2-05c43f4d36dd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0f52ac5-a458-4a53-8d78-4422f49714cb"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:21.554974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-870ec460-4d47-402d-a3d2-05c43f4d36dd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:21.562239 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-870ec460-4d47-402d-a3d2-05c43f4d36dd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:21.562712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-870ec460-4d47-402d-a3d2-05c43f4d36dd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:21.563497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-870ec460-4d47-402d-a3d2-05c43f4d36dd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:21.563962 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-870ec460-4d47-402d-a3d2-05c43f4d36dd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:21.804586 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-870ec460-4d47-402d-a3d2-05c43f4d36dd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "POST /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254455 Jul 14 15:31:21.806214 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3566/7095] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 15:31:21 2022] POST /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:31:34.782839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cab8651b-12a5-4ef1-94b7-079317ce025a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:34.783501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cab8651b-12a5-4ef1-94b7-079317ce025a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:34.786397 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:34.787131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=58 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:34.793491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cab8651b-12a5-4ef1-94b7-079317ce025a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:34.793938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cab8651b-12a5-4ef1-94b7-079317ce025a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:34.795465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cab8651b-12a5-4ef1-94b7-079317ce025a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:34.796069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cab8651b-12a5-4ef1-94b7-079317ce025a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:34.933685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cab8651b-12a5-4ef1-94b7-079317ce025a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:34.941694 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cab8651b-12a5-4ef1-94b7-079317ce025a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1594 microversion: 2.1 time: 0.163209 Jul 14 15:31:34.942271 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3530/7096] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:34 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1594 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:36.881420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-7a327541-1974-466b-a055-e866280b3d3d req-e83e0112-559c-46ab-9534-1c6a31fd1a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a", "tag": "2b17ef51-b7b6-4ffd-956e-7422cce545d3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:36.889169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:36.890265 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:36.890961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:36.893043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7a327541-1974-466b-a055-e866280b3d3d req-e83e0112-559c-46ab-9534-1c6a31fd1a3f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:36.893513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-7a327541-1974-466b-a055-e866280b3d3d req-e83e0112-559c-46ab-9534-1c6a31fd1a3f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:36.906819 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-7a327541-1974-466b-a055-e866280b3d3d req-e83e0112-559c-46ab-9534-1c6a31fd1a3f service nova] Creating event network-changed:2b17ef51-b7b6-4ffd-956e-7422cce545d3 for instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a on n-h2-767704-28 Jul 14 15:31:36.913582 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-7a327541-1974-466b-a055-e866280b3d3d req-e83e0112-559c-46ab-9534-1c6a31fd1a3f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036565 Jul 14 15:31:36.914173 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3567/7097] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:31:37.892368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ce11164-ba2f-483f-b17c-5f771e7f01cd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1359370218"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:37.892915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8ce11164-ba2f-483f-b17c-5f771e7f01cd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:37.906965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ce11164-ba2f-483f-b17c-5f771e7f01cd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:37.907633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ce11164-ba2f-483f-b17c-5f771e7f01cd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:37.908431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ce11164-ba2f-483f-b17c-5f771e7f01cd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:37.908888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ce11164-ba2f-483f-b17c-5f771e7f01cd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:38.053773 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.network.security_group_api [None req-8ce11164-ba2f-483f-b17c-5f771e7f01cd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Adding security group e91bbba0-57c8-4730-a002-75b941234958 to port 2b17ef51-b7b6-4ffd-956e-7422cce545d3 Jul 14 15:31:38.418558 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8ce11164-ba2f-483f-b17c-5f771e7f01cd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "POST /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/action" status: 202 len: 0 microversion: 2.1 time: 0.529480 Jul 14 15:31:38.425777 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3531/7098] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:31:37 2022] POST /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:31:38.429437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c97743d4-e2e0-4010-a3d4-db0d2e4663c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:38.430171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c97743d4-e2e0-4010-a3d4-db0d2e4663c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:38.439562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c97743d4-e2e0-4010-a3d4-db0d2e4663c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:38.444854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c97743d4-e2e0-4010-a3d4-db0d2e4663c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:38.446197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c97743d4-e2e0-4010-a3d4-db0d2e4663c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:38.446833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c97743d4-e2e0-4010-a3d4-db0d2e4663c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:38.626019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c97743d4-e2e0-4010-a3d4-db0d2e4663c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:38.634730 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c97743d4-e2e0-4010-a3d4-db0d2e4663c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1758 microversion: 2.1 time: 0.209786 Jul 14 15:31:38.635707 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3568/7099] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:38 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1758 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:31:38.928800 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-7170b416-90ab-46f4-8bc9-06e338a9d474 req-c3873596-3402-4ab2-adaf-b94bc59a70ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a", "tag": "2b17ef51-b7b6-4ffd-956e-7422cce545d3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:38.937766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7170b416-90ab-46f4-8bc9-06e338a9d474 req-c3873596-3402-4ab2-adaf-b94bc59a70ac service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:38.938307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7170b416-90ab-46f4-8bc9-06e338a9d474 req-c3873596-3402-4ab2-adaf-b94bc59a70ac service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:38.949654 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-7170b416-90ab-46f4-8bc9-06e338a9d474 req-c3873596-3402-4ab2-adaf-b94bc59a70ac service nova] Creating event network-changed:2b17ef51-b7b6-4ffd-956e-7422cce545d3 for instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a on n-h2-767704-28 Jul 14 15:31:38.955195 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-7170b416-90ab-46f4-8bc9-06e338a9d474 req-c3873596-3402-4ab2-adaf-b94bc59a70ac service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030918 Jul 14 15:31:38.955739 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3532/7100] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:31:48.992070 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:31:48.992792 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:31:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:33:21.796686 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:21.798080 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:21.802842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-31128592-5d7b-46e6-887c-fa66563eee98 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:33:21.803861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-31128592-5d7b-46e6-887c-fa66563eee98 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:21.811922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31128592-5d7b-46e6-887c-fa66563eee98 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:21.812392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31128592-5d7b-46e6-887c-fa66563eee98 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:21.814037 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31128592-5d7b-46e6-887c-fa66563eee98 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:21.814528 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-31128592-5d7b-46e6-887c-fa66563eee98 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:21.888651 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-31128592-5d7b-46e6-887c-fa66563eee98 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "POST /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/action" status: 202 len: 0 microversion: 2.1 time: 0.093597 Jul 14 15:33:21.889335 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3569/7101] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:33:21 2022] POST /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:33:21.897442 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a22d85c6-ae9d-41d6-a69e-ea6ad90634fc] AMQP server on 10.222.0.81:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 15:33:21.898708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:21.899829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:21.905322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b158104b-f6ff-4046-aa08-a96bc8fd0bd5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:21.905767 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b158104b-f6ff-4046-aa08-a96bc8fd0bd5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:21.913820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b158104b-f6ff-4046-aa08-a96bc8fd0bd5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:21.914371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b158104b-f6ff-4046-aa08-a96bc8fd0bd5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:21.915144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b158104b-f6ff-4046-aa08-a96bc8fd0bd5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:21.915583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b158104b-f6ff-4046-aa08-a96bc8fd0bd5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:22.163215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b158104b-f6ff-4046-aa08-a96bc8fd0bd5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:22.171664 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b158104b-f6ff-4046-aa08-a96bc8fd0bd5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1760 microversion: 2.1 time: 0.277819 Jul 14 15:33:22.173674 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3533/7102] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:21 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1760 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:23.191881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0ad7c102-1435-45b1-ae26-7fe838acf4d7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:23.192522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0ad7c102-1435-45b1-ae26-7fe838acf4d7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:23.198953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ad7c102-1435-45b1-ae26-7fe838acf4d7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:23.199426 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ad7c102-1435-45b1-ae26-7fe838acf4d7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:23.200217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ad7c102-1435-45b1-ae26-7fe838acf4d7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:23.200678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ad7c102-1435-45b1-ae26-7fe838acf4d7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:23.344075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0ad7c102-1435-45b1-ae26-7fe838acf4d7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:23.352255 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0ad7c102-1435-45b1-ae26-7fe838acf4d7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1758 microversion: 2.1 time: 0.166527 Jul 14 15:33:23.352830 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3570/7103] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:23 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:32.067720 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:33:32.068232 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 15:33:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:33:33.433680 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:33:33.434281 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 15:33:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:34:44.978954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:44.979716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:44.984017 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d79d99f1-ae75-4f2b-998f-631f35cd70ac tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1359370218"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:34:44.984559 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d79d99f1-ae75-4f2b-998f-631f35cd70ac tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:44.995165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d79d99f1-ae75-4f2b-998f-631f35cd70ac tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:44.996024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d79d99f1-ae75-4f2b-998f-631f35cd70ac tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:44.996859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d79d99f1-ae75-4f2b-998f-631f35cd70ac tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:44.997337 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d79d99f1-ae75-4f2b-998f-631f35cd70ac tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:45.004114 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a22d85c6-ae9d-41d6-a69e-ea6ad90634fc] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 54034. Jul 14 15:34:45.308564 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.network.security_group_api [None req-d79d99f1-ae75-4f2b-998f-631f35cd70ac tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Removing security group e91bbba0-57c8-4730-a002-75b941234958 from port 2b17ef51-b7b6-4ffd-956e-7422cce545d3 Jul 14 15:34:45.645098 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d79d99f1-ae75-4f2b-998f-631f35cd70ac tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "POST /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/action" status: 202 len: 0 microversion: 2.1 time: 0.667934 Jul 14 15:34:45.650031 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3534/7104] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:34:44 2022] POST /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:34:45.662300 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ef1d03cb-81f2-45f1-8418-22dd79123901 req-450557a1-0b41-41dd-a47c-722e32b807dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a", "tag": "2b17ef51-b7b6-4ffd-956e-7422cce545d3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:34:45.687692 n-d-767704-28 devstack@n-api.service[119512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [18fa8ee7-2e4b-4257-83cb-9dead624f713] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 15:34:45.688891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:45.689832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:45.693783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ef1d03cb-81f2-45f1-8418-22dd79123901 req-450557a1-0b41-41dd-a47c-722e32b807dd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:45.694540 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ef1d03cb-81f2-45f1-8418-22dd79123901 req-450557a1-0b41-41dd-a47c-722e32b807dd service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:45.730156 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ef1d03cb-81f2-45f1-8418-22dd79123901 req-450557a1-0b41-41dd-a47c-722e32b807dd service nova] Creating event network-changed:2b17ef51-b7b6-4ffd-956e-7422cce545d3 for instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a on n-h2-767704-28 Jul 14 15:34:45.736740 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ef1d03cb-81f2-45f1-8418-22dd79123901 req-450557a1-0b41-41dd-a47c-722e32b807dd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082341 Jul 14 15:34:45.738102 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3571/7105] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:46.781789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f3c05cc9-28f9-4c76-b413-91fbfee0a09e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:46.782951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f3c05cc9-28f9-4c76-b413-91fbfee0a09e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:46.790973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3c05cc9-28f9-4c76-b413-91fbfee0a09e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:46.791519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3c05cc9-28f9-4c76-b413-91fbfee0a09e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:46.792215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3c05cc9-28f9-4c76-b413-91fbfee0a09e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:46.792662 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f3c05cc9-28f9-4c76-b413-91fbfee0a09e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:46.811815 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] [18fa8ee7-2e4b-4257-83cb-9dead624f713] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 54064. Jul 14 15:34:46.865462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-eeca9b96-1e8c-4a23-b416-ebfd22046ee6 req-d446a48a-1fa3-4c64-aa53-868e9d320932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a", "tag": "2b17ef51-b7b6-4ffd-956e-7422cce545d3"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:34:46.873618 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-eeca9b96-1e8c-4a23-b416-ebfd22046ee6 req-d446a48a-1fa3-4c64-aa53-868e9d320932 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:46.874079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-eeca9b96-1e8c-4a23-b416-ebfd22046ee6 req-d446a48a-1fa3-4c64-aa53-868e9d320932 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:46.886015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-f3c05cc9-28f9-4c76-b413-91fbfee0a09e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lazy-loading 'services' on Instance uuid b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:34:46.890902 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-eeca9b96-1e8c-4a23-b416-ebfd22046ee6 req-d446a48a-1fa3-4c64-aa53-868e9d320932 service nova] Creating event network-changed:2b17ef51-b7b6-4ffd-956e-7422cce545d3 for instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a on n-h2-767704-28 Jul 14 15:34:46.896620 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-eeca9b96-1e8c-4a23-b416-ebfd22046ee6 req-d446a48a-1fa3-4c64-aa53-868e9d320932 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101197 Jul 14 15:34:46.897553 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3572/7106] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:34:46.975121 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f3c05cc9-28f9-4c76-b413-91fbfee0a09e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments/f0f52ac5-a458-4a53-8d78-4422f49714cb" status: 202 len: 0 microversion: 2.1 time: 0.196678 Jul 14 15:34:46.976036 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3535/7107] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:34:46 2022] DELETE /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments/f0f52ac5-a458-4a53-8d78-4422f49714cb => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:34:46.984744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e1bbb542-d42d-4784-84a1-7c6bf65b459f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:46.986178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e1bbb542-d42d-4784-84a1-7c6bf65b459f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:46.993196 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1bbb542-d42d-4784-84a1-7c6bf65b459f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:46.993664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1bbb542-d42d-4784-84a1-7c6bf65b459f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:46.994654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1bbb542-d42d-4784-84a1-7c6bf65b459f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:46.995104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e1bbb542-d42d-4784-84a1-7c6bf65b459f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:47.031241 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e1bbb542-d42d-4784-84a1-7c6bf65b459f tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050750 Jul 14 15:34:47.036347 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3573/7108] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:34:46 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:48.044261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-df756aa7-f482-45da-986f-7d1260c357d5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:48.045317 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-df756aa7-f482-45da-986f-7d1260c357d5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:48.052690 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df756aa7-f482-45da-986f-7d1260c357d5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:48.053171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df756aa7-f482-45da-986f-7d1260c357d5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:48.053992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df756aa7-f482-45da-986f-7d1260c357d5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:48.054435 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df756aa7-f482-45da-986f-7d1260c357d5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:48.084608 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-df756aa7-f482-45da-986f-7d1260c357d5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044836 Jul 14 15:34:48.085209 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3536/7109] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:34:48 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:49.096464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0de84cd0-83d7-4c81-bc20-1b167dc19175 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:49.097627 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0de84cd0-83d7-4c81-bc20-1b167dc19175 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:49.104966 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0de84cd0-83d7-4c81-bc20-1b167dc19175 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:49.105470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0de84cd0-83d7-4c81-bc20-1b167dc19175 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:49.106283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0de84cd0-83d7-4c81-bc20-1b167dc19175 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:49.106767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0de84cd0-83d7-4c81-bc20-1b167dc19175 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:49.140084 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0de84cd0-83d7-4c81-bc20-1b167dc19175 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047551 Jul 14 15:34:49.140789 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3574/7110] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:34:49 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:50.152151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0d69eeb2-1434-4fe9-8a57-9db160ab0ccd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:50.153150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0d69eeb2-1434-4fe9-8a57-9db160ab0ccd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:50.160816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d69eeb2-1434-4fe9-8a57-9db160ab0ccd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:50.161594 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d69eeb2-1434-4fe9-8a57-9db160ab0ccd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:50.162101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d69eeb2-1434-4fe9-8a57-9db160ab0ccd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:50.162545 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0d69eeb2-1434-4fe9-8a57-9db160ab0ccd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:50.192532 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0d69eeb2-1434-4fe9-8a57-9db160ab0ccd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Jul 14 15:34:50.193133 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3537/7111] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:34:50 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:51.203923 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ec4f41a8-90ba-45ee-bf13-d50d8d811b6a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:51.204907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ec4f41a8-90ba-45ee-bf13-d50d8d811b6a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:51.213073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec4f41a8-90ba-45ee-bf13-d50d8d811b6a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:51.213542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec4f41a8-90ba-45ee-bf13-d50d8d811b6a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:51.214329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec4f41a8-90ba-45ee-bf13-d50d8d811b6a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:51.214779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ec4f41a8-90ba-45ee-bf13-d50d8d811b6a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:51.245810 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ec4f41a8-90ba-45ee-bf13-d50d8d811b6a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045870 Jul 14 15:34:51.246639 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3575/7112] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:34:51 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:52.258007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-daa90b92-6378-41b1-baf5-184f50618905 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:52.258947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-daa90b92-6378-41b1-baf5-184f50618905 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:52.266155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daa90b92-6378-41b1-baf5-184f50618905 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:52.266617 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daa90b92-6378-41b1-baf5-184f50618905 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:52.267390 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daa90b92-6378-41b1-baf5-184f50618905 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:52.267835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-daa90b92-6378-41b1-baf5-184f50618905 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:52.297951 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-daa90b92-6378-41b1-baf5-184f50618905 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044466 Jul 14 15:34:52.298520 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3538/7113] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:34:52 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:34:52.309144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fee1c12a-2240-4b6b-8220-3f529bf7128b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:52.309673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fee1c12a-2240-4b6b-8220-3f529bf7128b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:52.316460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fee1c12a-2240-4b6b-8220-3f529bf7128b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:52.316922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fee1c12a-2240-4b6b-8220-3f529bf7128b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:52.317721 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fee1c12a-2240-4b6b-8220-3f529bf7128b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:52.318170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fee1c12a-2240-4b6b-8220-3f529bf7128b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:52.493175 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-fee1c12a-2240-4b6b-8220-3f529bf7128b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] HTTP exception thrown: Instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a is not attached to volume f0f52ac5-a458-4a53-8d78-4422f49714cb Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fee1c12a-2240-4b6b-8220-3f529bf7128b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Request method failure captured: Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: request: DELETE /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments/f0f52ac5-a458-4a53-8d78-4422f49714cb HTTP/1.1 Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DamEl2e8iJoYQDBqvDUzyCsqcRwuZAA-7GoeQPXMuiClILmiW2BC4m7GTQBgTvDywbaC3POe0K37oR55z38K44QHDPTNf_YlYTYd28YdhTVQz4WEI98m_E-yUhaQ0ZwMOv6lYfB--F8ksnrCtofshjH6qTQ3ztI-25VwWR4rj7sgTo Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 74218b29767c4c5d8822efdc7002f988 Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestMinimumBasicScenario-1945485415 Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/74218b29767c4c5d8822efdc7002f988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/74218b29767c4c5d8822efdc7002f988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_74218b29767c4c5d8822efdc7002f988", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/74218b29767c4c5d8822efdc7002f988"}]}] Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestMinimumBasicScenario-1945485415 Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 74218b29767c4c5d8822efdc7002f988 Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1945485415 Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestMinimumBasicScenario-1945485415-project Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: fc298b584fa34bd6bc80c43300821e3b Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestMinimumBasicScenario-1945485415-project Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a is not attached to volume f0f52ac5-a458-4a53-8d78-4422f49714cb Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'server_id': 'b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a', 'id': 'f0f52ac5-a458-4a53-8d78-4422f49714cb'} Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f0f52ac5-a458-4a53-8d78-4422f49714cb. Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a is not attached to volume f0f52ac5-a458-4a53-8d78-4422f49714cb Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:34:52.494806 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:34:52.499342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:34:52.499342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:34:52.499342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a is not attached to volume f0f52ac5-a458-4a53-8d78-4422f49714cb Jul 14 15:34:52.499342 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:34:52.499342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fee1c12a-2240-4b6b-8220-3f529bf7128b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Returning 404 to user: Instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a is not attached to volume f0f52ac5-a458-4a53-8d78-4422f49714cb {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:34:52.499342 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fee1c12a-2240-4b6b-8220-3f529bf7128b tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments/f0f52ac5-a458-4a53-8d78-4422f49714cb" status: 404 len: 154 microversion: 2.1 time: 0.191184 Jul 14 15:34:52.499342 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3576/7114] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:34:52 2022] DELETE /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a/os-volume_attachments/f0f52ac5-a458-4a53-8d78-4422f49714cb => generated 154 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:34:55.732818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-78751047-a457-4dbe-916f-69d6add9cbf4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:55.733373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-78751047-a457-4dbe-916f-69d6add9cbf4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:55.740289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78751047-a457-4dbe-916f-69d6add9cbf4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:55.740746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78751047-a457-4dbe-916f-69d6add9cbf4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:55.741554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78751047-a457-4dbe-916f-69d6add9cbf4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:55.741995 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78751047-a457-4dbe-916f-69d6add9cbf4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:55.767786 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-78751047-a457-4dbe-916f-69d6add9cbf4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:34:55.845718 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-78751047-a457-4dbe-916f-69d6add9cbf4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 204 len: 0 microversion: 2.1 time: 0.116404 Jul 14 15:34:55.846298 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3539/7115] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:34:55 2022] DELETE /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:34:55.855467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a8b53cf5-263d-4282-9f35-6dd47870d0da tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:55.856102 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a8b53cf5-263d-4282-9f35-6dd47870d0da tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:55.862661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8b53cf5-263d-4282-9f35-6dd47870d0da tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:55.863126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8b53cf5-263d-4282-9f35-6dd47870d0da tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:55.864207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8b53cf5-263d-4282-9f35-6dd47870d0da tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:55.864561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a8b53cf5-263d-4282-9f35-6dd47870d0da tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:56.001960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a8b53cf5-263d-4282-9f35-6dd47870d0da tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:56.010396 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a8b53cf5-263d-4282-9f35-6dd47870d0da tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1554 microversion: 2.1 time: 0.159135 Jul 14 15:34:56.010978 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3577/7116] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:55 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:57.028282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-82ea4e57-9644-40ac-b8ad-c996eb9cef2d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:57.029015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-82ea4e57-9644-40ac-b8ad-c996eb9cef2d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:57.036516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82ea4e57-9644-40ac-b8ad-c996eb9cef2d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:57.036962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82ea4e57-9644-40ac-b8ad-c996eb9cef2d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:57.037734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82ea4e57-9644-40ac-b8ad-c996eb9cef2d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:57.038173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-82ea4e57-9644-40ac-b8ad-c996eb9cef2d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:57.170132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-82ea4e57-9644-40ac-b8ad-c996eb9cef2d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:57.177702 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-82ea4e57-9644-40ac-b8ad-c996eb9cef2d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1554 microversion: 2.1 time: 0.153785 Jul 14 15:34:57.178270 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3540/7117] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:57 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:58.194187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d442e481-9a2f-4429-bb4f-fe25b004fee3 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:58.194822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d442e481-9a2f-4429-bb4f-fe25b004fee3 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:58.201924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d442e481-9a2f-4429-bb4f-fe25b004fee3 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:58.202405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d442e481-9a2f-4429-bb4f-fe25b004fee3 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:58.203203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d442e481-9a2f-4429-bb4f-fe25b004fee3 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:58.203661 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d442e481-9a2f-4429-bb4f-fe25b004fee3 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:58.216895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f4734c39-70bb-484c-a032-3986e4b55489 req-cf4d3343-8d5d-4c57-8f4c-22d67669c89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a", "name": "network-vif-deleted", "tag": "2b17ef51-b7b6-4ffd-956e-7422cce545d3"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:34:58.227542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f4734c39-70bb-484c-a032-3986e4b55489 req-cf4d3343-8d5d-4c57-8f4c-22d67669c89f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:58.228841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f4734c39-70bb-484c-a032-3986e4b55489 req-cf4d3343-8d5d-4c57-8f4c-22d67669c89f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:58.241059 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f4734c39-70bb-484c-a032-3986e4b55489 req-cf4d3343-8d5d-4c57-8f4c-22d67669c89f service nova] Creating event network-vif-deleted:2b17ef51-b7b6-4ffd-956e-7422cce545d3 for instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a on n-h2-767704-28 Jul 14 15:34:58.246159 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f4734c39-70bb-484c-a032-3986e4b55489 req-cf4d3343-8d5d-4c57-8f4c-22d67669c89f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032858 Jul 14 15:34:58.246770 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3541/7118] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:58.281115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d442e481-9a2f-4429-bb4f-fe25b004fee3 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:58.291156 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d442e481-9a2f-4429-bb4f-fe25b004fee3 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 200 len: 1512 microversion: 2.1 time: 0.100912 Jul 14 15:34:58.291747 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3578/7119] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:58 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 1512 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:59.309187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0c2f5531-85ae-4f48-9b08-e98925b3a9fd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:59.309899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0c2f5531-85ae-4f48-9b08-e98925b3a9fd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:59.316179 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c2f5531-85ae-4f48-9b08-e98925b3a9fd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:59.317263 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c2f5531-85ae-4f48-9b08-e98925b3a9fd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:59.318062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c2f5531-85ae-4f48-9b08-e98925b3a9fd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:59.318501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c2f5531-85ae-4f48-9b08-e98925b3a9fd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:59.331678 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-0c2f5531-85ae-4f48-9b08-e98925b3a9fd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] HTTP exception thrown: Instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a could not be found. Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0c2f5531-85ae-4f48-9b08-e98925b3a9fd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Request method failure captured: Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a HTTP/1.1 Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DamEl2e8iJoYQDBqvDUzyCsqcRwuZAA-7GoeQPXMuiClILmiW2BC4m7GTQBgTvDywbaC3POe0K37oR55z38K44QHDPTNf_YlYTYd28YdhTVQz4WEI98m_E-yUhaQ0ZwMOv6lYfB--F8ksnrCtofshjH6qTQ3ztI-25VwWR4rj7sgTo Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 74218b29767c4c5d8822efdc7002f988 Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestMinimumBasicScenario-1945485415 Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/74218b29767c4c5d8822efdc7002f988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/74218b29767c4c5d8822efdc7002f988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_74218b29767c4c5d8822efdc7002f988", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/74218b29767c4c5d8822efdc7002f988"}]}] Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestMinimumBasicScenario-1945485415 Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 74218b29767c4c5d8822efdc7002f988 Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1945485415 Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestMinimumBasicScenario-1945485415-project Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: fc298b584fa34bd6bc80c43300821e3b Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestMinimumBasicScenario-1945485415-project Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a could not be found. Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': 'b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a'} Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a could not be found. Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a could not be found. Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:34:59.334169 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:34:59.338766 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:59.338766 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:34:59.338766 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:34:59.338766 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:34:59.338766 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:34:59.338766 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a could not be found. Jul 14 15:34:59.338766 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:34:59.338766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0c2f5531-85ae-4f48-9b08-e98925b3a9fd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Returning 404 to user: Instance b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:34:59.338766 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0c2f5531-85ae-4f48-9b08-e98925b3a9fd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a" status: 404 len: 111 microversion: 2.1 time: 0.031596 Jul 14 15:34:59.338766 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3542/7120] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:59 2022] GET /compute/v2.1/servers/b64c10eb-e423-4d0a-9ac8-f3a1c6fb333a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:34:59.344375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c974a2ee-ca60-4a38-b5a5-6ca38245858d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '.version_select at 0x7fd6c5ad4940>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:59.364061 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c974a2ee-ca60-4a38-b5a5-6ca38245858d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-352619543" status: 202 len: 0 microversion: 2.1 time: 0.022893 Jul 14 15:34:59.367920 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3579/7121] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 15:34:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-352619543 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:35:08.319251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d3c57ca9-5ffc-4d6e-b1a1-26c6f06282b6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Action: 'create', calling method: .version_select at 0x7fd6c4540430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-359401948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKa4/Dz/hNJC/ihPah4yzLedcuvVgCdru4evbvrBWfIDREzZO/hDeuBEMoN33kvwID+7gObn71h/yRvutHug3fyafkqIZYUvlTLNUM4zN7L8xWaC+a/k9UKqye1POpCMg=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:08.335228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d3c57ca9-5ffc-4d6e-b1a1-26c6f06282b6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Getting quotas for project 74218b29767c4c5d8822efdc7002f988. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:35:08.341228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-d3c57ca9-5ffc-4d6e-b1a1-26c6f06282b6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Getting quotas for user fc298b584fa34bd6bc80c43300821e3b and project 74218b29767c4c5d8822efdc7002f988. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:35:08.368059 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d3c57ca9-5ffc-4d6e-b1a1-26c6f06282b6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053414 Jul 14 15:35:08.368797 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3543/7122] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:35:08 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:35:08.416012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=40 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:08.420078 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1003984197", "imageRef": "72b16128-bc7f-422f-b8c9-62780f843928", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-359401948", "networks": [{"uuid": "dc0bcd61-dba1-4a9a-a971-c6a87c8840e5"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:08.471872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] validate_networks() for [('dc0bcd61-dba1-4a9a-a971-c6a87c8840e5', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:35:08.920513 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:35:08.920980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:35:08.921482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:35:08.921935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:35:08.922362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:35:08.932401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:08.932873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:08.933729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:08.934188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:08.953635 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Getting quotas for project 74218b29767c4c5d8822efdc7002f988. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:35:08.959111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Getting quotas for user fc298b584fa34bd6bc80c43300821e3b and project 74218b29767c4c5d8822efdc7002f988. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:35:08.971679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:35:08.975174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72b16128-bc7f-422f-b8c9-62780f843928',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:35:09.005565 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:35:09.005807 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:35:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.81) !!! Jul 14 15:35:09.028585 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3f11cc66-23c1-42c9-9e44-8c912e9a0c47 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614298 Jul 14 15:35:09.029463 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3580/7123] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:35:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:35:09.039375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-439ec85d-a644-4ad5-b985-b7e11d231122 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:09.039994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-439ec85d-a644-4ad5-b985-b7e11d231122 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:09.093935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-439ec85d-a644-4ad5-b985-b7e11d231122 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:09.100874 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-439ec85d-a644-4ad5-b985-b7e11d231122 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1258 microversion: 2.1 time: 0.065552 Jul 14 15:35:09.101468 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3544/7124] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:09 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:10.119809 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-16a5f207-07ce-46b6-bdac-d2431845fe96 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:10.120435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-16a5f207-07ce-46b6-bdac-d2431845fe96 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:10.173868 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-16a5f207-07ce-46b6-bdac-d2431845fe96 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:10.181524 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-16a5f207-07ce-46b6-bdac-d2431845fe96 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1258 microversion: 2.1 time: 0.066558 Jul 14 15:35:10.182098 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3581/7125] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:10 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:11.198703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-de20ec88-a89f-4e93-8133-a363f2388c68 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:11.199322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-de20ec88-a89f-4e93-8133-a363f2388c68 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:11.201342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:11.259709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-de20ec88-a89f-4e93-8133-a363f2388c68 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:11.266685 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-de20ec88-a89f-4e93-8133-a363f2388c68 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1258 microversion: 2.1 time: 0.072007 Jul 14 15:35:11.267245 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3545/7126] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:11 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:12.283939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dcf757ce-477a-4703-8c44-9eb63363cea6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:12.284570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dcf757ce-477a-4703-8c44-9eb63363cea6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:12.341690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dcf757ce-477a-4703-8c44-9eb63363cea6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:12.348413 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dcf757ce-477a-4703-8c44-9eb63363cea6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1258 microversion: 2.1 time: 0.068383 Jul 14 15:35:12.349009 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3582/7127] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:12 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:13.365284 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5cea2ab6-910e-436a-b5eb-34b1fe3774ef tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:13.365909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5cea2ab6-910e-436a-b5eb-34b1fe3774ef tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:13.372891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5cea2ab6-910e-436a-b5eb-34b1fe3774ef tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:13.373384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5cea2ab6-910e-436a-b5eb-34b1fe3774ef tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:13.374164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5cea2ab6-910e-436a-b5eb-34b1fe3774ef tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:13.374610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5cea2ab6-910e-436a-b5eb-34b1fe3774ef tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:13.436898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5cea2ab6-910e-436a-b5eb-34b1fe3774ef tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:13.445953 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5cea2ab6-910e-436a-b5eb-34b1fe3774ef tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1262 microversion: 2.1 time: 0.084658 Jul 14 15:35:13.446598 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3546/7128] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:13 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:14.463806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a129d237-458d-4c9d-b77e-f8d061744ca5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:14.464713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a129d237-458d-4c9d-b77e-f8d061744ca5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:14.473124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a129d237-458d-4c9d-b77e-f8d061744ca5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:14.474323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a129d237-458d-4c9d-b77e-f8d061744ca5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:14.475132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a129d237-458d-4c9d-b77e-f8d061744ca5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:14.475598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a129d237-458d-4c9d-b77e-f8d061744ca5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:14.539678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a129d237-458d-4c9d-b77e-f8d061744ca5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:14.547283 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a129d237-458d-4c9d-b77e-f8d061744ca5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1328 microversion: 2.1 time: 0.087435 Jul 14 15:35:14.547862 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3583/7129] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:14 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1328 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:15.565301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-84611b24-1c5f-4195-ae84-67d3cfa3faa7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:15.565920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-84611b24-1c5f-4195-ae84-67d3cfa3faa7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:15.568888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:15.574886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84611b24-1c5f-4195-ae84-67d3cfa3faa7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:15.575599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84611b24-1c5f-4195-ae84-67d3cfa3faa7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:15.576389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84611b24-1c5f-4195-ae84-67d3cfa3faa7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:15.576828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-84611b24-1c5f-4195-ae84-67d3cfa3faa7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:15.722919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-84611b24-1c5f-4195-ae84-67d3cfa3faa7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:15.731668 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-84611b24-1c5f-4195-ae84-67d3cfa3faa7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.170063 Jul 14 15:35:15.732484 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3547/7130] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:15 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:16.751443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bccc9a34-90b9-4ec0-8d41-ac86fd4afe22 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:16.752089 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bccc9a34-90b9-4ec0-8d41-ac86fd4afe22 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:16.755309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:16.761444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bccc9a34-90b9-4ec0-8d41-ac86fd4afe22 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:16.761938 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bccc9a34-90b9-4ec0-8d41-ac86fd4afe22 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:16.762740 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bccc9a34-90b9-4ec0-8d41-ac86fd4afe22 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:16.763204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bccc9a34-90b9-4ec0-8d41-ac86fd4afe22 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:16.915583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bccc9a34-90b9-4ec0-8d41-ac86fd4afe22 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:16.929315 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bccc9a34-90b9-4ec0-8d41-ac86fd4afe22 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.182186 Jul 14 15:35:16.930208 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3584/7131] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:16 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:17.948131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1eb84ce3-c61e-4684-93cb-2b36e7927269 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:17.949070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1eb84ce3-c61e-4684-93cb-2b36e7927269 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:17.956277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1eb84ce3-c61e-4684-93cb-2b36e7927269 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:17.956729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1eb84ce3-c61e-4684-93cb-2b36e7927269 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:17.957745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1eb84ce3-c61e-4684-93cb-2b36e7927269 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:17.958226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1eb84ce3-c61e-4684-93cb-2b36e7927269 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:18.114834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1eb84ce3-c61e-4684-93cb-2b36e7927269 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:18.122582 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1eb84ce3-c61e-4684-93cb-2b36e7927269 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.179705 Jul 14 15:35:18.123189 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3548/7132] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:17 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:19.140413 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7786fbd2-e152-4825-9140-75a28ac983dc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:19.141251 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7786fbd2-e152-4825-9140-75a28ac983dc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:19.151636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:19.154578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7786fbd2-e152-4825-9140-75a28ac983dc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:19.155394 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7786fbd2-e152-4825-9140-75a28ac983dc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:19.156857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7786fbd2-e152-4825-9140-75a28ac983dc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:19.157757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7786fbd2-e152-4825-9140-75a28ac983dc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:19.307296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7786fbd2-e152-4825-9140-75a28ac983dc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:19.315146 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7786fbd2-e152-4825-9140-75a28ac983dc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.179114 Jul 14 15:35:19.324737 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3585/7133] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:19 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:20.333101 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-48ebbae3-9243-4d07-a1a3-75c893e68bf9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:20.333782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-48ebbae3-9243-4d07-a1a3-75c893e68bf9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:20.340971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48ebbae3-9243-4d07-a1a3-75c893e68bf9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:20.341423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48ebbae3-9243-4d07-a1a3-75c893e68bf9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:20.342193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48ebbae3-9243-4d07-a1a3-75c893e68bf9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:20.342628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-48ebbae3-9243-4d07-a1a3-75c893e68bf9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:20.483439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-48ebbae3-9243-4d07-a1a3-75c893e68bf9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:20.492560 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-48ebbae3-9243-4d07-a1a3-75c893e68bf9 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.163249 Jul 14 15:35:20.493164 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3549/7134] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:20 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:21.511676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2514ff76-c26b-4704-8dcc-983e8638befd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:21.512325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2514ff76-c26b-4704-8dcc-983e8638befd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:21.518999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2514ff76-c26b-4704-8dcc-983e8638befd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:21.519469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2514ff76-c26b-4704-8dcc-983e8638befd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:21.520262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2514ff76-c26b-4704-8dcc-983e8638befd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:21.520710 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2514ff76-c26b-4704-8dcc-983e8638befd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:21.665097 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2514ff76-c26b-4704-8dcc-983e8638befd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:21.672614 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2514ff76-c26b-4704-8dcc-983e8638befd tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.166775 Jul 14 15:35:21.673214 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3586/7135] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:21 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:22.690725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-926b2072-c531-40aa-a0ba-0d12794239ae tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:22.691418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-926b2072-c531-40aa-a0ba-0d12794239ae tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:22.693487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:22.699657 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-926b2072-c531-40aa-a0ba-0d12794239ae tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:22.700118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-926b2072-c531-40aa-a0ba-0d12794239ae tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:22.700901 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-926b2072-c531-40aa-a0ba-0d12794239ae tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:22.701373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-926b2072-c531-40aa-a0ba-0d12794239ae tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:22.837608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-926b2072-c531-40aa-a0ba-0d12794239ae tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:22.845229 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-926b2072-c531-40aa-a0ba-0d12794239ae tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.158766 Jul 14 15:35:22.846032 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3550/7136] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:22 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:23.863118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d45f0632-28c7-4c08-904d-651020fee3c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:23.863783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d45f0632-28c7-4c08-904d-651020fee3c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:23.865988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=10 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:23.874885 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d45f0632-28c7-4c08-904d-651020fee3c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:23.875675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d45f0632-28c7-4c08-904d-651020fee3c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:23.876517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d45f0632-28c7-4c08-904d-651020fee3c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:23.876988 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d45f0632-28c7-4c08-904d-651020fee3c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:24.045505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d45f0632-28c7-4c08-904d-651020fee3c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:24.054445 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d45f0632-28c7-4c08-904d-651020fee3c7 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.195429 Jul 14 15:35:24.055255 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3587/7137] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:23 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:25.070090 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d4f9fe7-d901-4181-b484-84a90bcc1a95] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 15:35:25.073636 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7600a1b5-8c66-4a9e-88f7-94ab2c26ffec tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:25.074255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7600a1b5-8c66-4a9e-88f7-94ab2c26ffec tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:25.080787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7600a1b5-8c66-4a9e-88f7-94ab2c26ffec tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:25.081288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7600a1b5-8c66-4a9e-88f7-94ab2c26ffec tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:25.082335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7600a1b5-8c66-4a9e-88f7-94ab2c26ffec tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:25.082538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7600a1b5-8c66-4a9e-88f7-94ab2c26ffec tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:25.218266 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7600a1b5-8c66-4a9e-88f7-94ab2c26ffec tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:25.226188 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7600a1b5-8c66-4a9e-88f7-94ab2c26ffec tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.158481 Jul 14 15:35:25.226779 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3551/7138] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:25 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:25.919418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-797c7bf4-d117-4afc-9e41-eae7bd5ea02d req-9af91361-90d1-4678-afaa-204396f399c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916cc6db-7b43-42e7-966f-93f3d449494c", "tag": "e28fe733-cfbf-4d22-9b30-6aeae2273659"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:25.939184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-797c7bf4-d117-4afc-9e41-eae7bd5ea02d req-9af91361-90d1-4678-afaa-204396f399c7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:25.939658 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-797c7bf4-d117-4afc-9e41-eae7bd5ea02d req-9af91361-90d1-4678-afaa-204396f399c7 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:25.955948 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-797c7bf4-d117-4afc-9e41-eae7bd5ea02d req-9af91361-90d1-4678-afaa-204396f399c7 service nova] Creating event network-changed:e28fe733-cfbf-4d22-9b30-6aeae2273659 for instance 916cc6db-7b43-42e7-966f-93f3d449494c on n-h1-767704-28 Jul 14 15:35:25.963256 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-797c7bf4-d117-4afc-9e41-eae7bd5ea02d req-9af91361-90d1-4678-afaa-204396f399c7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050904 Jul 14 15:35:25.966949 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3588/7139] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:35:26.243136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e8580b5a-6ef4-400d-bfc0-f291293a19a8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:26.243760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e8580b5a-6ef4-400d-bfc0-f291293a19a8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:26.256137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8580b5a-6ef4-400d-bfc0-f291293a19a8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:26.256602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8580b5a-6ef4-400d-bfc0-f291293a19a8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:26.257430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8580b5a-6ef4-400d-bfc0-f291293a19a8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:26.258022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e8580b5a-6ef4-400d-bfc0-f291293a19a8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:26.263142 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d4f9fe7-d901-4181-b484-84a90bcc1a95] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 54290. Jul 14 15:35:26.455306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e8580b5a-6ef4-400d-bfc0-f291293a19a8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:26.463523 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e8580b5a-6ef4-400d-bfc0-f291293a19a8 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.224385 Jul 14 15:35:26.464104 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3552/7140] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:26 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:27.481592 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2ff57606-adb4-4ff6-84b7-24ab2c37dd55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:27.482316 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2ff57606-adb4-4ff6-84b7-24ab2c37dd55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:27.489495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ff57606-adb4-4ff6-84b7-24ab2c37dd55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:27.489996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ff57606-adb4-4ff6-84b7-24ab2c37dd55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:27.491470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ff57606-adb4-4ff6-84b7-24ab2c37dd55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:27.491956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2ff57606-adb4-4ff6-84b7-24ab2c37dd55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:27.638014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2ff57606-adb4-4ff6-84b7-24ab2c37dd55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:27.645857 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2ff57606-adb4-4ff6-84b7-24ab2c37dd55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.168600 Jul 14 15:35:27.646434 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3589/7141] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:27 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:35:28.663285 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-79b3afab-c295-4099-8dae-6ed30277bb38 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:28.663867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-79b3afab-c295-4099-8dae-6ed30277bb38 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:28.670793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79b3afab-c295-4099-8dae-6ed30277bb38 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:28.671249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79b3afab-c295-4099-8dae-6ed30277bb38 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:28.672008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79b3afab-c295-4099-8dae-6ed30277bb38 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:28.672447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-79b3afab-c295-4099-8dae-6ed30277bb38 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:28.804400 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-79b3afab-c295-4099-8dae-6ed30277bb38 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:28.811984 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-79b3afab-c295-4099-8dae-6ed30277bb38 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.153174 Jul 14 15:35:28.812562 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3553/7142] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:28 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:29.828538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-44563eeb-2b7c-4a60-8470-184b06eeb073 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:29.829256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-44563eeb-2b7c-4a60-8470-184b06eeb073 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:29.836532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44563eeb-2b7c-4a60-8470-184b06eeb073 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:29.837046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44563eeb-2b7c-4a60-8470-184b06eeb073 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:29.837844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44563eeb-2b7c-4a60-8470-184b06eeb073 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:29.838306 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-44563eeb-2b7c-4a60-8470-184b06eeb073 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:29.970133 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-44563eeb-2b7c-4a60-8470-184b06eeb073 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:29.978407 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-44563eeb-2b7c-4a60-8470-184b06eeb073 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.153766 Jul 14 15:35:29.978986 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3590/7143] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:29 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:30.996777 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6967032f-acc6-4101-acbc-66674df50af6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:30.997438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6967032f-acc6-4101-acbc-66674df50af6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:31.004471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6967032f-acc6-4101-acbc-66674df50af6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:31.004935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6967032f-acc6-4101-acbc-66674df50af6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:31.005747 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6967032f-acc6-4101-acbc-66674df50af6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:31.006863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6967032f-acc6-4101-acbc-66674df50af6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:31.144558 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6967032f-acc6-4101-acbc-66674df50af6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:31.152636 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6967032f-acc6-4101-acbc-66674df50af6 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.160037 Jul 14 15:35:31.153261 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3554/7144] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:30 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:32.169542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc342a6b-fd4d-4cbd-a00c-493637c93c2a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:32.170091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc342a6b-fd4d-4cbd-a00c-493637c93c2a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:32.177272 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc342a6b-fd4d-4cbd-a00c-493637c93c2a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:32.177741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc342a6b-fd4d-4cbd-a00c-493637c93c2a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:32.179151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc342a6b-fd4d-4cbd-a00c-493637c93c2a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:32.179614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc342a6b-fd4d-4cbd-a00c-493637c93c2a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:32.308025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bc342a6b-fd4d-4cbd-a00c-493637c93c2a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:32.315474 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc342a6b-fd4d-4cbd-a00c-493637c93c2a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.149909 Jul 14 15:35:32.316084 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3591/7145] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:32 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:32.569463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f44a8155-6c3a-4b4c-bf01-712702344581 req-45280409-1eca-4b75-bc25-a255e6a3c1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916cc6db-7b43-42e7-966f-93f3d449494c", "name": "network-vif-plugged", "status": "completed", "tag": "e28fe733-cfbf-4d22-9b30-6aeae2273659"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:32.577475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f44a8155-6c3a-4b4c-bf01-712702344581 req-45280409-1eca-4b75-bc25-a255e6a3c1f9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:32.577922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f44a8155-6c3a-4b4c-bf01-712702344581 req-45280409-1eca-4b75-bc25-a255e6a3c1f9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:32.588987 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f44a8155-6c3a-4b4c-bf01-712702344581 req-45280409-1eca-4b75-bc25-a255e6a3c1f9 service nova] Creating event network-vif-plugged:e28fe733-cfbf-4d22-9b30-6aeae2273659 for instance 916cc6db-7b43-42e7-966f-93f3d449494c on n-h1-767704-28 Jul 14 15:35:32.594161 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f44a8155-6c3a-4b4c-bf01-712702344581 req-45280409-1eca-4b75-bc25-a255e6a3c1f9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123686 Jul 14 15:35:32.594939 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3555/7146] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:35:33.333330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4b777516-8afa-41b0-ba64-0835b596099d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:33.333883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4b777516-8afa-41b0-ba64-0835b596099d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:33.341446 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b777516-8afa-41b0-ba64-0835b596099d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:33.341947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b777516-8afa-41b0-ba64-0835b596099d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:33.342732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b777516-8afa-41b0-ba64-0835b596099d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:33.343215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4b777516-8afa-41b0-ba64-0835b596099d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:33.473042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4b777516-8afa-41b0-ba64-0835b596099d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:33.481327 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4b777516-8afa-41b0-ba64-0835b596099d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1358 microversion: 2.1 time: 0.152055 Jul 14 15:35:33.481903 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3592/7147] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:33 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:35:34.498768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bfcf9a2d-affd-4ebd-9629-4adf13366e7d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:34.499468 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bfcf9a2d-affd-4ebd-9629-4adf13366e7d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:34.507170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfcf9a2d-affd-4ebd-9629-4adf13366e7d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:34.507620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfcf9a2d-affd-4ebd-9629-4adf13366e7d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:34.508377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfcf9a2d-affd-4ebd-9629-4adf13366e7d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:34.508812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bfcf9a2d-affd-4ebd-9629-4adf13366e7d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:34.640168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bfcf9a2d-affd-4ebd-9629-4adf13366e7d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:34.647672 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bfcf9a2d-affd-4ebd-9629-4adf13366e7d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1548 microversion: 2.1 time: 0.153174 Jul 14 15:35:34.648246 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3556/7148] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:34 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:34.663998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4aa3ce24-66e5-4cf8-ba77-fc06af6d9a9a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:34.664619 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4aa3ce24-66e5-4cf8-ba77-fc06af6d9a9a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:34.671605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aa3ce24-66e5-4cf8-ba77-fc06af6d9a9a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:34.672071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aa3ce24-66e5-4cf8-ba77-fc06af6d9a9a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:34.672845 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aa3ce24-66e5-4cf8-ba77-fc06af6d9a9a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:34.673334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aa3ce24-66e5-4cf8-ba77-fc06af6d9a9a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:34.805144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4aa3ce24-66e5-4cf8-ba77-fc06af6d9a9a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:34.812931 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4aa3ce24-66e5-4cf8-ba77-fc06af6d9a9a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1548 microversion: 2.1 time: 0.153328 Jul 14 15:35:34.813533 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3593/7149] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:34 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:34.829063 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-357f1f68-8ee7-4697-bc72-e017f681791a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:34.832371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-357f1f68-8ee7-4697-bc72-e017f681791a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:34.833211 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-357f1f68-8ee7-4697-bc72-e017f681791a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Searching by: {'deleted': False, 'project_id': '74218b29767c4c5d8822efdc7002f988'} {{(pid=119511) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 15:35:34.838679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-357f1f68-8ee7-4697-bc72-e017f681791a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:34.839162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-357f1f68-8ee7-4697-bc72-e017f681791a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:34.839988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-357f1f68-8ee7-4697-bc72-e017f681791a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:34.840432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-357f1f68-8ee7-4697-bc72-e017f681791a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:34.864679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.multi_cell_list [None req-357f1f68-8ee7-4697-bc72-e017f681791a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 15:35:34.892083 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-357f1f68-8ee7-4697-bc72-e017f681791a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066870 Jul 14 15:35:34.892670 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3557/7150] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jul 14 15:35:34 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:35:34.903134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b5a20362-cb8e-41b4-ab78-53a670518ed1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:34.903769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b5a20362-cb8e-41b4-ab78-53a670518ed1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:34.909955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5a20362-cb8e-41b4-ab78-53a670518ed1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:34.910433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5a20362-cb8e-41b4-ab78-53a670518ed1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:34.911219 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5a20362-cb8e-41b4-ab78-53a670518ed1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:34.911679 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b5a20362-cb8e-41b4-ab78-53a670518ed1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:35.043598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b5a20362-cb8e-41b4-ab78-53a670518ed1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:35.051430 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b5a20362-cb8e-41b4-ab78-53a670518ed1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1548 microversion: 2.1 time: 0.152267 Jul 14 15:35:35.052018 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3594/7151] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:34 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:36.544374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-102da33e-016d-445b-b3c8-45f2c8b87a19 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7276e5e8-aa47-4016-a4ab-9851dd7d3f64"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:36.545483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-102da33e-016d-445b-b3c8-45f2c8b87a19 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:36.552374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-102da33e-016d-445b-b3c8-45f2c8b87a19 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:36.553419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-102da33e-016d-445b-b3c8-45f2c8b87a19 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:36.554192 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-102da33e-016d-445b-b3c8-45f2c8b87a19 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:36.554637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-102da33e-016d-445b-b3c8-45f2c8b87a19 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:36.823634 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-102da33e-016d-445b-b3c8-45f2c8b87a19 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "POST /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283011 Jul 14 15:35:36.824262 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3558/7152] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jul 14 15:35:36 2022] POST /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:35:48.594808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6729053a-a0e0-4024-934b-444f50a9f953 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:48.595449 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6729053a-a0e0-4024-934b-444f50a9f953 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:48.598743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=21 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:48.599557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=70 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:48.605610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6729053a-a0e0-4024-934b-444f50a9f953 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:48.606086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6729053a-a0e0-4024-934b-444f50a9f953 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:48.606881 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6729053a-a0e0-4024-934b-444f50a9f953 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:48.607341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6729053a-a0e0-4024-934b-444f50a9f953 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:48.739031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6729053a-a0e0-4024-934b-444f50a9f953 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:48.747604 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6729053a-a0e0-4024-934b-444f50a9f953 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1594 microversion: 2.1 time: 0.156668 Jul 14 15:35:48.748185 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3595/7153] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:48 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:50.668194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:50.669237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=23 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:50.669726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:50.737731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-b04aed20-9609-4e2f-8069-77f05154770e req-6d7054d1-700d-4bbe-8d90-44886c3cfcc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916cc6db-7b43-42e7-966f-93f3d449494c", "tag": "e28fe733-cfbf-4d22-9b30-6aeae2273659"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:50.751217 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b04aed20-9609-4e2f-8069-77f05154770e req-6d7054d1-700d-4bbe-8d90-44886c3cfcc6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:50.752111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-b04aed20-9609-4e2f-8069-77f05154770e req-6d7054d1-700d-4bbe-8d90-44886c3cfcc6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:50.766232 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-b04aed20-9609-4e2f-8069-77f05154770e req-6d7054d1-700d-4bbe-8d90-44886c3cfcc6 service nova] Creating event network-changed:e28fe733-cfbf-4d22-9b30-6aeae2273659 for instance 916cc6db-7b43-42e7-966f-93f3d449494c on n-h1-767704-28 Jul 14 15:35:50.772381 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-b04aed20-9609-4e2f-8069-77f05154770e req-6d7054d1-700d-4bbe-8d90-44886c3cfcc6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111710 Jul 14 15:35:50.773241 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3559/7154] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:35:51.892310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5d05f411-a953-4e9c-96c2-622d333dd338 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1815151640"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:51.892863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5d05f411-a953-4e9c-96c2-622d333dd338 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:51.900914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d05f411-a953-4e9c-96c2-622d333dd338 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:51.901423 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d05f411-a953-4e9c-96c2-622d333dd338 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:51.902334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d05f411-a953-4e9c-96c2-622d333dd338 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:51.902807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5d05f411-a953-4e9c-96c2-622d333dd338 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:52.078739 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.network.security_group_api [None req-5d05f411-a953-4e9c-96c2-622d333dd338 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Adding security group 80c4a27a-a2ae-4c7a-a048-9141eb364f94 to port e28fe733-cfbf-4d22-9b30-6aeae2273659 Jul 14 15:35:52.442086 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5d05f411-a953-4e9c-96c2-622d333dd338 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "POST /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/action" status: 202 len: 0 microversion: 2.1 time: 0.554087 Jul 14 15:35:52.446526 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3596/7155] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:35:51 2022] POST /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:35:52.455538 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-47cdcd9c-e16e-4643-b5de-bf239a7df525 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:52.456167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-47cdcd9c-e16e-4643-b5de-bf239a7df525 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:52.464537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47cdcd9c-e16e-4643-b5de-bf239a7df525 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:52.465044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47cdcd9c-e16e-4643-b5de-bf239a7df525 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:52.465847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47cdcd9c-e16e-4643-b5de-bf239a7df525 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:52.466519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-47cdcd9c-e16e-4643-b5de-bf239a7df525 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:52.632334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-47cdcd9c-e16e-4643-b5de-bf239a7df525 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:52.642021 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-47cdcd9c-e16e-4643-b5de-bf239a7df525 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1760 microversion: 2.1 time: 0.193139 Jul 14 15:35:52.642611 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3560/7156] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:52 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1760 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:52.789495 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-5f5a9ecc-18e4-483c-b492-341efb287ed8 req-96d96e81-2fd5-403a-9cf7-81b5be946299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916cc6db-7b43-42e7-966f-93f3d449494c", "tag": "e28fe733-cfbf-4d22-9b30-6aeae2273659"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:52.797672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5f5a9ecc-18e4-483c-b492-341efb287ed8 req-96d96e81-2fd5-403a-9cf7-81b5be946299 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:52.798142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-5f5a9ecc-18e4-483c-b492-341efb287ed8 req-96d96e81-2fd5-403a-9cf7-81b5be946299 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:52.810808 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-5f5a9ecc-18e4-483c-b492-341efb287ed8 req-96d96e81-2fd5-403a-9cf7-81b5be946299 service nova] Creating event network-changed:e28fe733-cfbf-4d22-9b30-6aeae2273659 for instance 916cc6db-7b43-42e7-966f-93f3d449494c on n-h1-767704-28 Jul 14 15:35:52.815910 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-5f5a9ecc-18e4-483c-b492-341efb287ed8 req-96d96e81-2fd5-403a-9cf7-81b5be946299 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031971 Jul 14 15:35:52.816520 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3597/7157] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:15.240256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c728745a-00c3-4ab5-ba91-b59532cf46eb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:15.241358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c728745a-00c3-4ab5-ba91-b59532cf46eb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:15.244710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:15.245498 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=8 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:15.251300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c728745a-00c3-4ab5-ba91-b59532cf46eb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:15.251764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c728745a-00c3-4ab5-ba91-b59532cf46eb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:15.252546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c728745a-00c3-4ab5-ba91-b59532cf46eb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:15.253021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c728745a-00c3-4ab5-ba91-b59532cf46eb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:15.332241 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c728745a-00c3-4ab5-ba91-b59532cf46eb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "POST /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/action" status: 202 len: 0 microversion: 2.1 time: 0.096016 Jul 14 15:36:15.333086 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3561/7158] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:36:15 2022] POST /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:36:15.340347 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:15.341336 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=12 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:15.345659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b0d1a5ea-5f13-4f28-8b8e-8a0fda9fbc2e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:15.346390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b0d1a5ea-5f13-4f28-8b8e-8a0fda9fbc2e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:15.355035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0d1a5ea-5f13-4f28-8b8e-8a0fda9fbc2e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:15.355516 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0d1a5ea-5f13-4f28-8b8e-8a0fda9fbc2e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:15.356342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0d1a5ea-5f13-4f28-8b8e-8a0fda9fbc2e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:15.356782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b0d1a5ea-5f13-4f28-8b8e-8a0fda9fbc2e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:15.591823 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b0d1a5ea-5f13-4f28-8b8e-8a0fda9fbc2e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:15.600025 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b0d1a5ea-5f13-4f28-8b8e-8a0fda9fbc2e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1752 microversion: 2.1 time: 0.261716 Jul 14 15:36:15.600702 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3598/7159] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:15 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1752 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:16.619744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c8b4c3fe-7e9f-4b70-bc2c-3108951185bb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:16.620919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c8b4c3fe-7e9f-4b70-bc2c-3108951185bb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:16.628523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8b4c3fe-7e9f-4b70-bc2c-3108951185bb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:16.628999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8b4c3fe-7e9f-4b70-bc2c-3108951185bb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:16.629780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8b4c3fe-7e9f-4b70-bc2c-3108951185bb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:16.630245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8b4c3fe-7e9f-4b70-bc2c-3108951185bb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:16.778016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c8b4c3fe-7e9f-4b70-bc2c-3108951185bb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:16.786091 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c8b4c3fe-7e9f-4b70-bc2c-3108951185bb tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1757 microversion: 2.1 time: 0.171614 Jul 14 15:36:16.786671 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3562/7160] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:16 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:17.803682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1c2812ac-c3bc-441c-91b9-094759fcf633 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:17.804343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1c2812ac-c3bc-441c-91b9-094759fcf633 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:17.811321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c2812ac-c3bc-441c-91b9-094759fcf633 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:17.811792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c2812ac-c3bc-441c-91b9-094759fcf633 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:17.812575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c2812ac-c3bc-441c-91b9-094759fcf633 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:17.813070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1c2812ac-c3bc-441c-91b9-094759fcf633 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:17.954338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1c2812ac-c3bc-441c-91b9-094759fcf633 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:17.963216 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1c2812ac-c3bc-441c-91b9-094759fcf633 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1757 microversion: 2.1 time: 0.163454 Jul 14 15:36:17.963805 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3599/7161] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:17 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:18.980517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-49652368-183d-4750-8811-4b49f1e87f3a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:18.981083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-49652368-183d-4750-8811-4b49f1e87f3a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:18.987964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49652368-183d-4750-8811-4b49f1e87f3a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:18.988422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49652368-183d-4750-8811-4b49f1e87f3a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:18.989209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49652368-183d-4750-8811-4b49f1e87f3a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:18.989654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49652368-183d-4750-8811-4b49f1e87f3a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:19.137361 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-49652368-183d-4750-8811-4b49f1e87f3a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:19.145646 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-49652368-183d-4750-8811-4b49f1e87f3a tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1757 microversion: 2.1 time: 0.169094 Jul 14 15:36:19.146225 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3563/7162] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:18 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:20.162918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d0f99430-b17b-44b8-b0b0-804aa68fa62c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:20.163469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d0f99430-b17b-44b8-b0b0-804aa68fa62c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:20.170551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0f99430-b17b-44b8-b0b0-804aa68fa62c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:20.171014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0f99430-b17b-44b8-b0b0-804aa68fa62c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:20.171794 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0f99430-b17b-44b8-b0b0-804aa68fa62c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:20.172241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d0f99430-b17b-44b8-b0b0-804aa68fa62c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:20.319155 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d0f99430-b17b-44b8-b0b0-804aa68fa62c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:20.327284 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d0f99430-b17b-44b8-b0b0-804aa68fa62c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1757 microversion: 2.1 time: 0.168393 Jul 14 15:36:20.327857 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3600/7163] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:20 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:21.344670 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1532fa4b-6c3d-4731-91d9-8915bf342752 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:21.345313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1532fa4b-6c3d-4731-91d9-8915bf342752 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:21.352377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1532fa4b-6c3d-4731-91d9-8915bf342752 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:21.352968 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1532fa4b-6c3d-4731-91d9-8915bf342752 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:21.353867 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1532fa4b-6c3d-4731-91d9-8915bf342752 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:21.354315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1532fa4b-6c3d-4731-91d9-8915bf342752 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:21.502194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1532fa4b-6c3d-4731-91d9-8915bf342752 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:21.511092 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1532fa4b-6c3d-4731-91d9-8915bf342752 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1757 microversion: 2.1 time: 0.170595 Jul 14 15:36:21.511864 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3564/7164] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:21 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:36:22.528334 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-14580a58-2c73-4454-9ee0-a0e41f796a55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:22.529021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-14580a58-2c73-4454-9ee0-a0e41f796a55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:22.536000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14580a58-2c73-4454-9ee0-a0e41f796a55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:22.536473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14580a58-2c73-4454-9ee0-a0e41f796a55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:22.537291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14580a58-2c73-4454-9ee0-a0e41f796a55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:22.537752 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-14580a58-2c73-4454-9ee0-a0e41f796a55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:22.681671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-14580a58-2c73-4454-9ee0-a0e41f796a55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:22.689735 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-14580a58-2c73-4454-9ee0-a0e41f796a55 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1757 microversion: 2.1 time: 0.165811 Jul 14 15:36:22.690312 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3601/7165] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:22 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:23.710499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ed86e09e-3187-4151-9852-4d89d6733f7c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:23.711182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ed86e09e-3187-4151-9852-4d89d6733f7c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:23.718827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed86e09e-3187-4151-9852-4d89d6733f7c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:23.719280 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed86e09e-3187-4151-9852-4d89d6733f7c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:23.720051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed86e09e-3187-4151-9852-4d89d6733f7c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:23.720489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ed86e09e-3187-4151-9852-4d89d6733f7c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:23.873091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ed86e09e-3187-4151-9852-4d89d6733f7c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:23.881208 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ed86e09e-3187-4151-9852-4d89d6733f7c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1757 microversion: 2.1 time: 0.176959 Jul 14 15:36:23.881784 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3565/7166] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:23 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:24.900410 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9b9c6257-0a1e-4910-a4b9-2a26f5fc08ab tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:24.901068 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9b9c6257-0a1e-4910-a4b9-2a26f5fc08ab tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:24.908103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b9c6257-0a1e-4910-a4b9-2a26f5fc08ab tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:24.908571 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b9c6257-0a1e-4910-a4b9-2a26f5fc08ab tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:24.909385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b9c6257-0a1e-4910-a4b9-2a26f5fc08ab tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:24.909839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9b9c6257-0a1e-4910-a4b9-2a26f5fc08ab tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:25.058940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9b9c6257-0a1e-4910-a4b9-2a26f5fc08ab tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:25.067073 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9b9c6257-0a1e-4910-a4b9-2a26f5fc08ab tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1757 microversion: 2.1 time: 0.170636 Jul 14 15:36:25.067669 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3602/7167] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:24 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:26.084185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b21a5db4-dd45-4d98-a294-aed0981867e0 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:26.084840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b21a5db4-dd45-4d98-a294-aed0981867e0 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:26.091953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b21a5db4-dd45-4d98-a294-aed0981867e0 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:26.092415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b21a5db4-dd45-4d98-a294-aed0981867e0 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:26.093226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b21a5db4-dd45-4d98-a294-aed0981867e0 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:26.093679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b21a5db4-dd45-4d98-a294-aed0981867e0 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:26.240193 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b21a5db4-dd45-4d98-a294-aed0981867e0 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:26.250295 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b21a5db4-dd45-4d98-a294-aed0981867e0 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1757 microversion: 2.1 time: 0.170014 Jul 14 15:36:26.250889 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3566/7168] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:26 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:27.268161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-77bbbd85-b4d3-4fef-bf8a-52f9bcc9fc51 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:27.268780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-77bbbd85-b4d3-4fef-bf8a-52f9bcc9fc51 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:27.276447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77bbbd85-b4d3-4fef-bf8a-52f9bcc9fc51 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:27.276910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77bbbd85-b4d3-4fef-bf8a-52f9bcc9fc51 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:27.277820 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77bbbd85-b4d3-4fef-bf8a-52f9bcc9fc51 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:27.278349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-77bbbd85-b4d3-4fef-bf8a-52f9bcc9fc51 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:27.427972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-77bbbd85-b4d3-4fef-bf8a-52f9bcc9fc51 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:27.437050 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-77bbbd85-b4d3-4fef-bf8a-52f9bcc9fc51 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1760 microversion: 2.1 time: 0.173069 Jul 14 15:36:27.437632 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3603/7169] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:27 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1760 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:53.444590 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:36:53.445260 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 15:36:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:37:13.815692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2e219a80-49fb-42dd-8778-97ca0bfae44d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1815151640"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:13.816358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2e219a80-49fb-42dd-8778-97ca0bfae44d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:13.818455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:13.819295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:13.826022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e219a80-49fb-42dd-8778-97ca0bfae44d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:13.827070 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e219a80-49fb-42dd-8778-97ca0bfae44d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:13.827896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e219a80-49fb-42dd-8778-97ca0bfae44d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:13.828346 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2e219a80-49fb-42dd-8778-97ca0bfae44d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:13.960257 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.network.security_group_api [None req-2e219a80-49fb-42dd-8778-97ca0bfae44d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Removing security group 80c4a27a-a2ae-4c7a-a048-9141eb364f94 from port e28fe733-cfbf-4d22-9b30-6aeae2273659 Jul 14 15:37:14.574750 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2e219a80-49fb-42dd-8778-97ca0bfae44d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "POST /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/action" status: 202 len: 0 microversion: 2.1 time: 0.763260 Jul 14 15:37:14.576023 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3567/7170] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:37:13 2022] POST /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/action => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:37:14.587706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4398e3aa-222e-4d7a-bea0-623f68f8fac6 req-1e0a62fb-e791-4528-9592-9d567a1254af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916cc6db-7b43-42e7-966f-93f3d449494c", "tag": "e28fe733-cfbf-4d22-9b30-6aeae2273659"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:14.591822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=12 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:14.592484 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=36 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:14.615934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4398e3aa-222e-4d7a-bea0-623f68f8fac6 req-1e0a62fb-e791-4528-9592-9d567a1254af service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:14.616420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4398e3aa-222e-4d7a-bea0-623f68f8fac6 req-1e0a62fb-e791-4528-9592-9d567a1254af service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:14.631513 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4398e3aa-222e-4d7a-bea0-623f68f8fac6 req-1e0a62fb-e791-4528-9592-9d567a1254af service nova] Creating event network-changed:e28fe733-cfbf-4d22-9b30-6aeae2273659 for instance 916cc6db-7b43-42e7-966f-93f3d449494c on n-h1-767704-28 Jul 14 15:37:14.637984 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4398e3aa-222e-4d7a-bea0-623f68f8fac6 req-1e0a62fb-e791-4528-9592-9d567a1254af service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056761 Jul 14 15:37:14.639640 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3604/7171] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:16.025966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-52bad9aa-5fd9-44cf-a1d8-18f9e01ed6e5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:16.026539 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-52bad9aa-5fd9-44cf-a1d8-18f9e01ed6e5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:16.033118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52bad9aa-5fd9-44cf-a1d8-18f9e01ed6e5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.033654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52bad9aa-5fd9-44cf-a1d8-18f9e01ed6e5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:16.034496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52bad9aa-5fd9-44cf-a1d8-18f9e01ed6e5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.035319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52bad9aa-5fd9-44cf-a1d8-18f9e01ed6e5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:16.121210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-52bad9aa-5fd9-44cf-a1d8-18f9e01ed6e5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lazy-loading 'services' on Instance uuid 916cc6db-7b43-42e7-966f-93f3d449494c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:37:16.197286 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-52bad9aa-5fd9-44cf-a1d8-18f9e01ed6e5 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "DELETE /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments/7276e5e8-aa47-4016-a4ab-9851dd7d3f64" status: 202 len: 0 microversion: 2.1 time: 0.176300 Jul 14 15:37:16.197925 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3568/7172] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:37:16 2022] DELETE /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments/7276e5e8-aa47-4016-a4ab-9851dd7d3f64 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:37:16.207645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-09d027c4-c6c6-4d7f-a1f2-d490fa816f08 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:16.208682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-09d027c4-c6c6-4d7f-a1f2-d490fa816f08 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:16.218420 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09d027c4-c6c6-4d7f-a1f2-d490fa816f08 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.218892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09d027c4-c6c6-4d7f-a1f2-d490fa816f08 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:16.219880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09d027c4-c6c6-4d7f-a1f2-d490fa816f08 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.220348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09d027c4-c6c6-4d7f-a1f2-d490fa816f08 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:16.252041 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-09d027c4-c6c6-4d7f-a1f2-d490fa816f08 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048721 Jul 14 15:37:16.252859 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3605/7173] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:37:16 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:37:16.656912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-96c5ae2d-681a-442a-8fb7-7fa4d8288acc req-4175e8f7-5255-4407-a5a5-80320006437f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916cc6db-7b43-42e7-966f-93f3d449494c", "tag": "e28fe733-cfbf-4d22-9b30-6aeae2273659"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:16.665642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-96c5ae2d-681a-442a-8fb7-7fa4d8288acc req-4175e8f7-5255-4407-a5a5-80320006437f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.666100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-96c5ae2d-681a-442a-8fb7-7fa4d8288acc req-4175e8f7-5255-4407-a5a5-80320006437f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:16.679285 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-96c5ae2d-681a-442a-8fb7-7fa4d8288acc req-4175e8f7-5255-4407-a5a5-80320006437f service nova] Creating event network-changed:e28fe733-cfbf-4d22-9b30-6aeae2273659 for instance 916cc6db-7b43-42e7-966f-93f3d449494c on n-h1-767704-28 Jul 14 15:37:16.684071 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-96c5ae2d-681a-442a-8fb7-7fa4d8288acc req-4175e8f7-5255-4407-a5a5-80320006437f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032413 Jul 14 15:37:16.684628 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3569/7174] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:17.264775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-88a96b70-0eea-4ae0-8e46-706986592389 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:17.265839 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-88a96b70-0eea-4ae0-8e46-706986592389 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:17.272527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88a96b70-0eea-4ae0-8e46-706986592389 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:17.273023 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88a96b70-0eea-4ae0-8e46-706986592389 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:17.273819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88a96b70-0eea-4ae0-8e46-706986592389 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:17.274276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-88a96b70-0eea-4ae0-8e46-706986592389 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:17.305843 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-88a96b70-0eea-4ae0-8e46-706986592389 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045261 Jul 14 15:37:17.309942 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3606/7175] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:37:17 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:18.319679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-39c611b4-3d58-442e-b3e7-992a6b2ce6ce tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:18.320723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-39c611b4-3d58-442e-b3e7-992a6b2ce6ce tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:18.327119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39c611b4-3d58-442e-b3e7-992a6b2ce6ce tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:18.327578 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39c611b4-3d58-442e-b3e7-992a6b2ce6ce tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:18.328358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39c611b4-3d58-442e-b3e7-992a6b2ce6ce tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:18.328829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-39c611b4-3d58-442e-b3e7-992a6b2ce6ce tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:18.357907 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-39c611b4-3d58-442e-b3e7-992a6b2ce6ce tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043417 Jul 14 15:37:18.359047 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3570/7176] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:37:18 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:19.370399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-01867bca-1465-4b61-9aa0-1643725c6337 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:19.371380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-01867bca-1465-4b61-9aa0-1643725c6337 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:19.379317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01867bca-1465-4b61-9aa0-1643725c6337 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:19.379786 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01867bca-1465-4b61-9aa0-1643725c6337 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:19.380589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01867bca-1465-4b61-9aa0-1643725c6337 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:19.381075 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01867bca-1465-4b61-9aa0-1643725c6337 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:19.418544 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-01867bca-1465-4b61-9aa0-1643725c6337 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052145 Jul 14 15:37:19.419316 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3607/7177] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:37:19 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:20.430305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-57a16585-f2d8-45b7-a474-5babdfdad11d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:20.431332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-57a16585-f2d8-45b7-a474-5babdfdad11d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:20.438919 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57a16585-f2d8-45b7-a474-5babdfdad11d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:20.439374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57a16585-f2d8-45b7-a474-5babdfdad11d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:20.440143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57a16585-f2d8-45b7-a474-5babdfdad11d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:20.440580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57a16585-f2d8-45b7-a474-5babdfdad11d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:20.469965 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-57a16585-f2d8-45b7-a474-5babdfdad11d tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043600 Jul 14 15:37:20.470527 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3571/7178] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:37:20 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:21.481768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bc51485a-8bb3-4d3b-abfc-528caaabc736 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:21.482708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bc51485a-8bb3-4d3b-abfc-528caaabc736 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:21.489822 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc51485a-8bb3-4d3b-abfc-528caaabc736 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:21.490162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc51485a-8bb3-4d3b-abfc-528caaabc736 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:21.490943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc51485a-8bb3-4d3b-abfc-528caaabc736 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:21.491398 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bc51485a-8bb3-4d3b-abfc-528caaabc736 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:21.520450 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bc51485a-8bb3-4d3b-abfc-528caaabc736 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042756 Jul 14 15:37:21.521033 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3608/7179] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jul 14 15:37:21 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:37:21.531583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e115dfe9-4f90-410a-aaa0-82f0e8224b61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:21.532069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e115dfe9-4f90-410a-aaa0-82f0e8224b61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:21.538932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e115dfe9-4f90-410a-aaa0-82f0e8224b61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:21.539406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e115dfe9-4f90-410a-aaa0-82f0e8224b61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:21.540153 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e115dfe9-4f90-410a-aaa0-82f0e8224b61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:21.540593 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e115dfe9-4f90-410a-aaa0-82f0e8224b61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:21.614479 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-e115dfe9-4f90-410a-aaa0-82f0e8224b61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] HTTP exception thrown: Instance 916cc6db-7b43-42e7-966f-93f3d449494c is not attached to volume 7276e5e8-aa47-4016-a4ab-9851dd7d3f64 Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e115dfe9-4f90-410a-aaa0-82f0e8224b61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Request method failure captured: Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: request: DELETE /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments/7276e5e8-aa47-4016-a4ab-9851dd7d3f64 HTTP/1.1 Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DamEl2e8iJoYQDBqvDUzyCsqcRwuZAA-7GoeQPXMuiClILmiW2BC4m7GTQBgTvDywbaC3POe0K37oR55z38K44QHDPTNf_YlYTYd28YdhTVQz4WEI98m_E-yUhaQ0ZwMOv6lYfB--F8ksnrCtofshjH6qTQ3ztI-25VwWR4rj7sgTo Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 74218b29767c4c5d8822efdc7002f988 Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestMinimumBasicScenario-1945485415 Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/74218b29767c4c5d8822efdc7002f988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/74218b29767c4c5d8822efdc7002f988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_74218b29767c4c5d8822efdc7002f988", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/74218b29767c4c5d8822efdc7002f988"}]}] Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestMinimumBasicScenario-1945485415 Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 74218b29767c4c5d8822efdc7002f988 Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1945485415 Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestMinimumBasicScenario-1945485415-project Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: fc298b584fa34bd6bc80c43300821e3b Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestMinimumBasicScenario-1945485415-project Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 916cc6db-7b43-42e7-966f-93f3d449494c is not attached to volume 7276e5e8-aa47-4016-a4ab-9851dd7d3f64 Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'server_id': '916cc6db-7b43-42e7-966f-93f3d449494c', 'id': '7276e5e8-aa47-4016-a4ab-9851dd7d3f64'} Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7276e5e8-aa47-4016-a4ab-9851dd7d3f64. Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 916cc6db-7b43-42e7-966f-93f3d449494c is not attached to volume 7276e5e8-aa47-4016-a4ab-9851dd7d3f64 Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:37:21.616414 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:37:21.620990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:37:21.620990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:37:21.620990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 916cc6db-7b43-42e7-966f-93f3d449494c is not attached to volume 7276e5e8-aa47-4016-a4ab-9851dd7d3f64 Jul 14 15:37:21.620990 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:37:21.620990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e115dfe9-4f90-410a-aaa0-82f0e8224b61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Returning 404 to user: Instance 916cc6db-7b43-42e7-966f-93f3d449494c is not attached to volume 7276e5e8-aa47-4016-a4ab-9851dd7d3f64 {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:37:21.620990 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e115dfe9-4f90-410a-aaa0-82f0e8224b61 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "DELETE /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments/7276e5e8-aa47-4016-a4ab-9851dd7d3f64" status: 404 len: 154 microversion: 2.1 time: 0.091184 Jul 14 15:37:21.620990 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3572/7180] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jul 14 15:37:21 2022] DELETE /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c/os-volume_attachments/7276e5e8-aa47-4016-a4ab-9851dd7d3f64 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:37:24.855442 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a9e33ff8-76f1-46c5-98ad-53963980526e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:24.855955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a9e33ff8-76f1-46c5-98ad-53963980526e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:24.863861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9e33ff8-76f1-46c5-98ad-53963980526e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:24.864307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9e33ff8-76f1-46c5-98ad-53963980526e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:24.865114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9e33ff8-76f1-46c5-98ad-53963980526e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:24.865562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a9e33ff8-76f1-46c5-98ad-53963980526e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:24.890421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a9e33ff8-76f1-46c5-98ad-53963980526e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:37:24.978633 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a9e33ff8-76f1-46c5-98ad-53963980526e tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "DELETE /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 204 len: 0 microversion: 2.1 time: 0.126539 Jul 14 15:37:24.979480 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3609/7181] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:37:24 2022] DELETE /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:37:24.989809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21a35cdc-556f-4f74-9cce-451c1e75e9fc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:24.990430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-21a35cdc-556f-4f74-9cce-451c1e75e9fc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:24.999306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21a35cdc-556f-4f74-9cce-451c1e75e9fc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:24.999691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21a35cdc-556f-4f74-9cce-451c1e75e9fc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:25.001374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21a35cdc-556f-4f74-9cce-451c1e75e9fc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:25.002025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21a35cdc-556f-4f74-9cce-451c1e75e9fc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:25.140640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-21a35cdc-556f-4f74-9cce-451c1e75e9fc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:25.148602 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21a35cdc-556f-4f74-9cce-451c1e75e9fc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1554 microversion: 2.1 time: 0.164166 Jul 14 15:37:25.149212 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3573/7182] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:24 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:26.167911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-de217088-5328-429a-863b-350591228ff4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:26.168580 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-de217088-5328-429a-863b-350591228ff4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:26.175874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de217088-5328-429a-863b-350591228ff4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:26.176335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de217088-5328-429a-863b-350591228ff4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:26.177140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de217088-5328-429a-863b-350591228ff4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:26.177594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de217088-5328-429a-863b-350591228ff4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:26.307338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-de217088-5328-429a-863b-350591228ff4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:26.315880 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-de217088-5328-429a-863b-350591228ff4 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1554 microversion: 2.1 time: 0.152469 Jul 14 15:37:26.316469 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3610/7183] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:26 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:27.333572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8914bb9c-88d6-4d0b-bcfb-5fc1dddb1a0c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:27.334236 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8914bb9c-88d6-4d0b-bcfb-5fc1dddb1a0c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:27.341067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8914bb9c-88d6-4d0b-bcfb-5fc1dddb1a0c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:27.341530 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8914bb9c-88d6-4d0b-bcfb-5fc1dddb1a0c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:27.342306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8914bb9c-88d6-4d0b-bcfb-5fc1dddb1a0c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:27.343714 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8914bb9c-88d6-4d0b-bcfb-5fc1dddb1a0c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:27.477984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8914bb9c-88d6-4d0b-bcfb-5fc1dddb1a0c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:27.487429 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8914bb9c-88d6-4d0b-bcfb-5fc1dddb1a0c tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1554 microversion: 2.1 time: 0.157941 Jul 14 15:37:27.488328 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3574/7184] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:27 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:28.346482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-cc789bef-8966-4784-8adb-c217dba992a1 req-47efcc94-e4e1-4703-bc29-76f3b835e30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916cc6db-7b43-42e7-966f-93f3d449494c", "name": "network-vif-deleted", "tag": "e28fe733-cfbf-4d22-9b30-6aeae2273659"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:28.357594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-cc789bef-8966-4784-8adb-c217dba992a1 req-47efcc94-e4e1-4703-bc29-76f3b835e30e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:28.358104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-cc789bef-8966-4784-8adb-c217dba992a1 req-47efcc94-e4e1-4703-bc29-76f3b835e30e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:28.370193 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-cc789bef-8966-4784-8adb-c217dba992a1 req-47efcc94-e4e1-4703-bc29-76f3b835e30e service nova] Creating event network-vif-deleted:e28fe733-cfbf-4d22-9b30-6aeae2273659 for instance 916cc6db-7b43-42e7-966f-93f3d449494c on n-h1-767704-28 Jul 14 15:37:28.376280 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-cc789bef-8966-4784-8adb-c217dba992a1 req-47efcc94-e4e1-4703-bc29-76f3b835e30e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035430 Jul 14 15:37:28.376880 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3611/7185] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:28.506366 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1648ef26-f3f7-447b-9615-d17d600c7102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:28.507005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1648ef26-f3f7-447b-9615-d17d600c7102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:28.513948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1648ef26-f3f7-447b-9615-d17d600c7102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:28.515066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1648ef26-f3f7-447b-9615-d17d600c7102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:28.515834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1648ef26-f3f7-447b-9615-d17d600c7102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:28.516275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1648ef26-f3f7-447b-9615-d17d600c7102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:28.547914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1648ef26-f3f7-447b-9615-d17d600c7102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:28.548481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1648ef26-f3f7-447b-9615-d17d600c7102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:28.548860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-1648ef26-f3f7-447b-9615-d17d600c7102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lazy-loading 'fault' on Instance uuid 916cc6db-7b43-42e7-966f-93f3d449494c {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:37:28.591082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1648ef26-f3f7-447b-9615-d17d600c7102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc298b584fa34bd6bc80c43300821e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74218b29767c4c5d8822efdc7002f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:28.598552 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1648ef26-f3f7-447b-9615-d17d600c7102 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 200 len: 1348 microversion: 2.1 time: 0.096146 Jul 14 15:37:28.599118 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3575/7186] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:28 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:29.617160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4a2dadf4-6531-496b-a721-62d0f9aa3ddc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:29.617905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4a2dadf4-6531-496b-a721-62d0f9aa3ddc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] [instance: 916cc6db-7b43-42e7-966f-93f3d449494c] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:29.624337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a2dadf4-6531-496b-a721-62d0f9aa3ddc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:29.624898 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a2dadf4-6531-496b-a721-62d0f9aa3ddc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:29.625732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a2dadf4-6531-496b-a721-62d0f9aa3ddc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:29.626187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a2dadf4-6531-496b-a721-62d0f9aa3ddc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:29.639962 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-4a2dadf4-6531-496b-a721-62d0f9aa3ddc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] HTTP exception thrown: Instance 916cc6db-7b43-42e7-966f-93f3d449494c could not be found. Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4a2dadf4-6531-496b-a721-62d0f9aa3ddc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Request method failure captured: Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c HTTP/1.1 Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DamEl2e8iJoYQDBqvDUzyCsqcRwuZAA-7GoeQPXMuiClILmiW2BC4m7GTQBgTvDywbaC3POe0K37oR55z38K44QHDPTNf_YlYTYd28YdhTVQz4WEI98m_E-yUhaQ0ZwMOv6lYfB--F8ksnrCtofshjH6qTQ3ztI-25VwWR4rj7sgTo Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 74218b29767c4c5d8822efdc7002f988 Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestMinimumBasicScenario-1945485415 Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/74218b29767c4c5d8822efdc7002f988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/74218b29767c4c5d8822efdc7002f988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_74218b29767c4c5d8822efdc7002f988", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/74218b29767c4c5d8822efdc7002f988"}]}] Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestMinimumBasicScenario-1945485415 Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 74218b29767c4c5d8822efdc7002f988 Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1945485415 Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestMinimumBasicScenario-1945485415-project Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: fc298b584fa34bd6bc80c43300821e3b Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestMinimumBasicScenario-1945485415-project Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 916cc6db-7b43-42e7-966f-93f3d449494c could not be found. Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '916cc6db-7b43-42e7-966f-93f3d449494c'} Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 916cc6db-7b43-42e7-966f-93f3d449494c could not be found. Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 916cc6db-7b43-42e7-966f-93f3d449494c could not be found. Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:37:29.641744 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:37:29.647120 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:37:29.647120 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:37:29.647120 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:37:29.647120 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:37:29.647120 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:37:29.647120 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 916cc6db-7b43-42e7-966f-93f3d449494c could not be found. Jul 14 15:37:29.647120 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:37:29.647120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4a2dadf4-6531-496b-a721-62d0f9aa3ddc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Returning 404 to user: Instance 916cc6db-7b43-42e7-966f-93f3d449494c could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:37:29.647120 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4a2dadf4-6531-496b-a721-62d0f9aa3ddc tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c" status: 404 len: 111 microversion: 2.1 time: 0.031431 Jul 14 15:37:29.647120 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3612/7187] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:29 2022] GET /compute/v2.1/servers/916cc6db-7b43-42e7-966f-93f3d449494c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:37:29.652134 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3ce6e64b-82f8-4601-93a5-bf624579abb1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] Calling method '.version_select at 0x7fd6c5d48a60>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:29.671740 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3ce6e64b-82f8-4601-93a5-bf624579abb1 tempest-TestMinimumBasicScenario-1945485415 tempest-TestMinimumBasicScenario-1945485415-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-359401948" status: 202 len: 0 microversion: 2.1 time: 0.023537 Jul 14 15:37:29.672320 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3576/7188] 10.222.0.81 () {58 vars in 1268 bytes} [Thu Jul 14 15:37:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-359401948 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:37:38.885715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e4422b52-a7ac-4b6c-88e9-74759d89dddb tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'create', calling method: .version_select at 0x7fd6c4e0a5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-625873651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgkn+UpStsj3E/iL6oZ4XKXHblYAKT6MJjAQhmbp9fLafw1GpRtc2L8FBpGPO3ih5p+oDc7TRjpQ598QvUnWDk8npkbMkzCHsJ0RUnPPvFqkx+kjfyWLrj97/uRx2XDYA=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:38.900329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e4422b52-a7ac-4b6c-88e9-74759d89dddb tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for project 0ded8733e086447782856661597d52f0. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:37:38.906732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-e4422b52-a7ac-4b6c-88e9-74759d89dddb tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for user 65b6268287b54c8d8a9fda65c04f278b and project 0ded8733e086447782856661597d52f0. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:37:38.929572 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e4422b52-a7ac-4b6c-88e9-74759d89dddb tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.213002 Jul 14 15:37:38.930166 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3613/7189] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:37:38 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:44.646522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:44.647601 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:44.652519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1388735507", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "e4c3bf3a-3d53-4756-bc06-0a6db22c2702"}], "key_name": "tempest-TestNetworkAdvancedServerOps-625873651", "security_groups": [{"name": "tempest-secgroup-smoke-1161751798"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:44.776933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] validate_networks() for [('e4c3bf3a-3d53-4756-bc06-0a6db22c2702', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:37:45.332045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:37:45.332432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:37:45.332913 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:37:45.333358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:37:45.333782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:37:45.346312 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:45.347125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:45.348548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:45.349407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:45.377959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for project 0ded8733e086447782856661597d52f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:37:45.385075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for user 65b6268287b54c8d8a9fda65c04f278b and project 0ded8733e086447782856661597d52f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:37:45.409851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:37:45.414164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:37:45.494124 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b5e7c2f0-10f8-49a8-b1d5-d6e107c21776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.849499 Jul 14 15:37:45.495167 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3577/7190] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:37:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:37:45.504231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:45.512754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3e7b13bc-cc7d-4869-87cc-023dba837a12 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:45.515628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3e7b13bc-cc7d-4869-87cc-023dba837a12 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:45.537292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:45.627110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3e7b13bc-cc7d-4869-87cc-023dba837a12 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:45.637581 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3e7b13bc-cc7d-4869-87cc-023dba837a12 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1266 microversion: 2.1 time: 0.134239 Jul 14 15:37:45.638845 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3614/7191] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:45 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:46.656883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-eba5c50b-8ae6-4645-bc55-29975949c9b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:46.657522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-eba5c50b-8ae6-4645-bc55-29975949c9b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:46.664760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eba5c50b-8ae6-4645-bc55-29975949c9b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:46.665240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eba5c50b-8ae6-4645-bc55-29975949c9b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:46.666111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eba5c50b-8ae6-4645-bc55-29975949c9b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:46.666442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-eba5c50b-8ae6-4645-bc55-29975949c9b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:46.757373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-eba5c50b-8ae6-4645-bc55-29975949c9b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:46.773016 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-eba5c50b-8ae6-4645-bc55-29975949c9b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1318 microversion: 2.1 time: 0.121103 Jul 14 15:37:46.774139 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3578/7192] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:46 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1318 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:47.798606 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f77af94c-ea90-4cc8-92fc-9e1aa7449bcd tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:47.800103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f77af94c-ea90-4cc8-92fc-9e1aa7449bcd tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:47.817371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f77af94c-ea90-4cc8-92fc-9e1aa7449bcd tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:47.818476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f77af94c-ea90-4cc8-92fc-9e1aa7449bcd tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:47.820031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f77af94c-ea90-4cc8-92fc-9e1aa7449bcd tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:47.820830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f77af94c-ea90-4cc8-92fc-9e1aa7449bcd tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:48.111263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f77af94c-ea90-4cc8-92fc-9e1aa7449bcd tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:48.118759 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f77af94c-ea90-4cc8-92fc-9e1aa7449bcd tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1392 microversion: 2.1 time: 0.330096 Jul 14 15:37:48.119348 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3615/7193] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:47 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1392 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:48.494012 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-06c62bd1-982e-4c28-8111-27275c790441 req-a1ffcdff-3a92-408e-a13f-080d5079f6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42ad02a-5234-4913-8c2d-b32d17ff6ee4", "tag": "6fe192b9-2834-42b7-a95c-2bff8057f4f8"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:48.505512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-06c62bd1-982e-4c28-8111-27275c790441 req-a1ffcdff-3a92-408e-a13f-080d5079f6bf service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:48.506332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-06c62bd1-982e-4c28-8111-27275c790441 req-a1ffcdff-3a92-408e-a13f-080d5079f6bf service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:48.535039 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-06c62bd1-982e-4c28-8111-27275c790441 req-a1ffcdff-3a92-408e-a13f-080d5079f6bf service nova] Creating event network-changed:6fe192b9-2834-42b7-a95c-2bff8057f4f8 for instance a42ad02a-5234-4913-8c2d-b32d17ff6ee4 on n-h2-767704-28 Jul 14 15:37:48.541208 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-06c62bd1-982e-4c28-8111-27275c790441 req-a1ffcdff-3a92-408e-a13f-080d5079f6bf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053523 Jul 14 15:37:48.541834 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3579/7194] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:37:49.136113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-84693a15-e897-443f-9d2c-e20ad9a23954 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:49.136687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-84693a15-e897-443f-9d2c-e20ad9a23954 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:49.147894 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84693a15-e897-443f-9d2c-e20ad9a23954 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:49.148364 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84693a15-e897-443f-9d2c-e20ad9a23954 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:49.149184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84693a15-e897-443f-9d2c-e20ad9a23954 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:49.149638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-84693a15-e897-443f-9d2c-e20ad9a23954 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:49.284914 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-84693a15-e897-443f-9d2c-e20ad9a23954 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:49.292323 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-84693a15-e897-443f-9d2c-e20ad9a23954 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1392 microversion: 2.1 time: 0.160529 Jul 14 15:37:49.292885 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3616/7195] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:49 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:50.310271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a7575c11-f3ed-49b4-b09f-e3f710360338 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:50.310971 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a7575c11-f3ed-49b4-b09f-e3f710360338 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:50.318961 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7575c11-f3ed-49b4-b09f-e3f710360338 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:50.319415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7575c11-f3ed-49b4-b09f-e3f710360338 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:50.320189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7575c11-f3ed-49b4-b09f-e3f710360338 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:50.320626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a7575c11-f3ed-49b4-b09f-e3f710360338 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:50.526094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a7575c11-f3ed-49b4-b09f-e3f710360338 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:50.533767 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a7575c11-f3ed-49b4-b09f-e3f710360338 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1392 microversion: 2.1 time: 0.227673 Jul 14 15:37:50.534352 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3580/7196] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:50 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:51.550604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a06adc4d-c601-4812-9647-b006ff506099 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:51.551263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a06adc4d-c601-4812-9647-b006ff506099 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:51.558274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a06adc4d-c601-4812-9647-b006ff506099 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:51.558750 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a06adc4d-c601-4812-9647-b006ff506099 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:51.559535 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a06adc4d-c601-4812-9647-b006ff506099 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:51.559990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a06adc4d-c601-4812-9647-b006ff506099 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:51.698817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a06adc4d-c601-4812-9647-b006ff506099 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:51.706343 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a06adc4d-c601-4812-9647-b006ff506099 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1392 microversion: 2.1 time: 0.159684 Jul 14 15:37:51.706925 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3617/7197] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:51 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:52.723271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8bf3d3d0-3cf4-406c-b60e-7175776daefc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:52.723806 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8bf3d3d0-3cf4-406c-b60e-7175776daefc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:52.730695 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bf3d3d0-3cf4-406c-b60e-7175776daefc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:52.731163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bf3d3d0-3cf4-406c-b60e-7175776daefc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:52.731936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bf3d3d0-3cf4-406c-b60e-7175776daefc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:52.732383 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8bf3d3d0-3cf4-406c-b60e-7175776daefc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:52.867588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8bf3d3d0-3cf4-406c-b60e-7175776daefc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:52.875724 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8bf3d3d0-3cf4-406c-b60e-7175776daefc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1392 microversion: 2.1 time: 0.156505 Jul 14 15:37:52.876312 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3581/7198] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:52 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:53.892730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-757fffe7-0fd6-4b81-8e3d-fcbfe0e63e7d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:53.893414 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-757fffe7-0fd6-4b81-8e3d-fcbfe0e63e7d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:53.900301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-757fffe7-0fd6-4b81-8e3d-fcbfe0e63e7d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:53.900763 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-757fffe7-0fd6-4b81-8e3d-fcbfe0e63e7d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:53.901640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-757fffe7-0fd6-4b81-8e3d-fcbfe0e63e7d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:53.902092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-757fffe7-0fd6-4b81-8e3d-fcbfe0e63e7d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:54.042789 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-757fffe7-0fd6-4b81-8e3d-fcbfe0e63e7d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:54.050636 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-757fffe7-0fd6-4b81-8e3d-fcbfe0e63e7d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1392 microversion: 2.1 time: 0.162876 Jul 14 15:37:54.051220 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3618/7199] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:53 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:54.369717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-e25e6f70-6a42-4ca1-915c-52cecf0666de req-fc75f46a-bf34-46d3-b8ea-414bb8617296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42ad02a-5234-4913-8c2d-b32d17ff6ee4", "name": "network-vif-plugged", "status": "completed", "tag": "6fe192b9-2834-42b7-a95c-2bff8057f4f8"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:54.380197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e25e6f70-6a42-4ca1-915c-52cecf0666de req-fc75f46a-bf34-46d3-b8ea-414bb8617296 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:54.380740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-e25e6f70-6a42-4ca1-915c-52cecf0666de req-fc75f46a-bf34-46d3-b8ea-414bb8617296 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:54.393958 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-e25e6f70-6a42-4ca1-915c-52cecf0666de req-fc75f46a-bf34-46d3-b8ea-414bb8617296 service nova] Creating event network-vif-plugged:6fe192b9-2834-42b7-a95c-2bff8057f4f8 for instance a42ad02a-5234-4913-8c2d-b32d17ff6ee4 on n-h2-767704-28 Jul 14 15:37:54.399123 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-e25e6f70-6a42-4ca1-915c-52cecf0666de req-fc75f46a-bf34-46d3-b8ea-414bb8617296 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033609 Jul 14 15:37:54.400069 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3582/7200] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:55.067982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4aeb0dfe-efcc-42e7-84f9-1dfc23c86776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:55.068563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4aeb0dfe-efcc-42e7-84f9-1dfc23c86776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:55.075464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aeb0dfe-efcc-42e7-84f9-1dfc23c86776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:55.075926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aeb0dfe-efcc-42e7-84f9-1dfc23c86776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:55.076695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aeb0dfe-efcc-42e7-84f9-1dfc23c86776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:55.077696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aeb0dfe-efcc-42e7-84f9-1dfc23c86776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:55.215390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4aeb0dfe-efcc-42e7-84f9-1dfc23c86776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:55.224029 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4aeb0dfe-efcc-42e7-84f9-1dfc23c86776 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1392 microversion: 2.1 time: 0.159963 Jul 14 15:37:55.224602 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3619/7201] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:55 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:56.241476 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ef34dda1-7251-4b78-a2e6-4a26b994ac32 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:56.242180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ef34dda1-7251-4b78-a2e6-4a26b994ac32 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:56.244247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:56.245734 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:56.251885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef34dda1-7251-4b78-a2e6-4a26b994ac32 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:56.252341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef34dda1-7251-4b78-a2e6-4a26b994ac32 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:56.253151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef34dda1-7251-4b78-a2e6-4a26b994ac32 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:56.253599 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef34dda1-7251-4b78-a2e6-4a26b994ac32 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:56.383977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ef34dda1-7251-4b78-a2e6-4a26b994ac32 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:56.392956 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ef34dda1-7251-4b78-a2e6-4a26b994ac32 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1563 microversion: 2.1 time: 0.155501 Jul 14 15:37:56.393582 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3583/7202] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:56 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:56.410225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5091a0f1-e040-44bb-973c-dc511baf3bed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:56.410832 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5091a0f1-e040-44bb-973c-dc511baf3bed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:56.412933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:56.418818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5091a0f1-e040-44bb-973c-dc511baf3bed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:56.419299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5091a0f1-e040-44bb-973c-dc511baf3bed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:56.420096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5091a0f1-e040-44bb-973c-dc511baf3bed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:56.420588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5091a0f1-e040-44bb-973c-dc511baf3bed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:56.558775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5091a0f1-e040-44bb-973c-dc511baf3bed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:56.568343 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5091a0f1-e040-44bb-973c-dc511baf3bed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1563 microversion: 2.1 time: 0.163202 Jul 14 15:37:56.568926 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3620/7203] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:56 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:58.487029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d308ee2a-fdc1-45a8-b304-10b30bc2e57d req-948b17c5-0ad0-40f7-b6dc-0b4b713213b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42ad02a-5234-4913-8c2d-b32d17ff6ee4", "tag": "6fe192b9-2834-42b7-a95c-2bff8057f4f8"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:58.488127 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f06783e8-c3cc-4a1e-af25-0dd21e7ef2b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:58.488817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f06783e8-c3cc-4a1e-af25-0dd21e7ef2b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:58.495618 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d308ee2a-fdc1-45a8-b304-10b30bc2e57d req-948b17c5-0ad0-40f7-b6dc-0b4b713213b1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:58.496016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f06783e8-c3cc-4a1e-af25-0dd21e7ef2b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:58.496163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d308ee2a-fdc1-45a8-b304-10b30bc2e57d req-948b17c5-0ad0-40f7-b6dc-0b4b713213b1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:58.496507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f06783e8-c3cc-4a1e-af25-0dd21e7ef2b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:58.497339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f06783e8-c3cc-4a1e-af25-0dd21e7ef2b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:58.497803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f06783e8-c3cc-4a1e-af25-0dd21e7ef2b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:58.508078 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d308ee2a-fdc1-45a8-b304-10b30bc2e57d req-948b17c5-0ad0-40f7-b6dc-0b4b713213b1 service nova] Creating event network-changed:6fe192b9-2834-42b7-a95c-2bff8057f4f8 for instance a42ad02a-5234-4913-8c2d-b32d17ff6ee4 on n-h2-767704-28 Jul 14 15:37:58.513151 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d308ee2a-fdc1-45a8-b304-10b30bc2e57d req-948b17c5-0ad0-40f7-b6dc-0b4b713213b1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032762 Jul 14 15:37:58.513948 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3584/7204] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:58.723282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f06783e8-c3cc-4a1e-af25-0dd21e7ef2b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:58.732816 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f06783e8-c3cc-4a1e-af25-0dd21e7ef2b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1563 microversion: 2.1 time: 0.252449 Jul 14 15:37:58.734023 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3621/7205] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:58 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:26.034783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:26.035566 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=32 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:26.040813 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0a4d80dd-bbd3-4f28-8d7a-75f819df07e4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:26.042062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0a4d80dd-bbd3-4f28-8d7a-75f819df07e4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:26.051704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a4d80dd-bbd3-4f28-8d7a-75f819df07e4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:26.052160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a4d80dd-bbd3-4f28-8d7a-75f819df07e4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:26.052933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a4d80dd-bbd3-4f28-8d7a-75f819df07e4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:26.053427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0a4d80dd-bbd3-4f28-8d7a-75f819df07e4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:26.111402 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0a4d80dd-bbd3-4f28-8d7a-75f819df07e4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4/action" status: 200 len: 24571 microversion: 2.1 time: 0.079323 Jul 14 15:38:26.112099 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3585/7206] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:38:26 2022] POST /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4/action => generated 24571 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:38:29.026985 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:38:29.027515 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:38:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:38:37.087493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fcd44724-05f3-458e-90bf-66bdbf966b3c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:37.088141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fcd44724-05f3-458e-90bf-66bdbf966b3c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:37.090057 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=17 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:37.090723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=42 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:37.097910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fcd44724-05f3-458e-90bf-66bdbf966b3c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:37.098392 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fcd44724-05f3-458e-90bf-66bdbf966b3c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:37.099194 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fcd44724-05f3-458e-90bf-66bdbf966b3c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:37.099689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fcd44724-05f3-458e-90bf-66bdbf966b3c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:37.169963 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fcd44724-05f3-458e-90bf-66bdbf966b3c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4/action" status: 202 len: 0 microversion: 2.1 time: 0.086567 Jul 14 15:38:37.170806 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3622/7207] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:38:37 2022] POST /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:38:37.180163 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6dc45bb0-a708-4993-a555-057d114516e2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:37.180871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6dc45bb0-a708-4993-a555-057d114516e2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:37.183858 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:37.184654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:37.192043 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6dc45bb0-a708-4993-a555-057d114516e2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:37.192508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6dc45bb0-a708-4993-a555-057d114516e2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:37.193335 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6dc45bb0-a708-4993-a555-057d114516e2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:37.193757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6dc45bb0-a708-4993-a555-057d114516e2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:37.344616 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6dc45bb0-a708-4993-a555-057d114516e2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:37.353467 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6dc45bb0-a708-4993-a555-057d114516e2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1687 microversion: 2.1 time: 0.177422 Jul 14 15:38:37.354068 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3586/7208] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:37 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:38.372996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5a7d6c1c-5da5-4821-95b4-fd2cb49eb734 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:38.373717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5a7d6c1c-5da5-4821-95b4-fd2cb49eb734 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:38.380139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a7d6c1c-5da5-4821-95b4-fd2cb49eb734 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:38.380611 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a7d6c1c-5da5-4821-95b4-fd2cb49eb734 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:38.381431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a7d6c1c-5da5-4821-95b4-fd2cb49eb734 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:38.382954 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5a7d6c1c-5da5-4821-95b4-fd2cb49eb734 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:38.516220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5a7d6c1c-5da5-4821-95b4-fd2cb49eb734 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:38.525077 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5a7d6c1c-5da5-4821-95b4-fd2cb49eb734 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1667 microversion: 2.1 time: 0.157406 Jul 14 15:38:38.525654 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3623/7209] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:38 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:39.614406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ef07cc21-45e0-4e67-8acd-fd6cdec1ebd7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:39.615340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ef07cc21-45e0-4e67-8acd-fd6cdec1ebd7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:39.623434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef07cc21-45e0-4e67-8acd-fd6cdec1ebd7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:39.623897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef07cc21-45e0-4e67-8acd-fd6cdec1ebd7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:39.624672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef07cc21-45e0-4e67-8acd-fd6cdec1ebd7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:39.625151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ef07cc21-45e0-4e67-8acd-fd6cdec1ebd7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:39.680896 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ef07cc21-45e0-4e67-8acd-fd6cdec1ebd7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4/action" status: 200 len: 32635 microversion: 2.1 time: 0.070926 Jul 14 15:38:39.681485 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3587/7210] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:38:39 2022] POST /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4/action => generated 32635 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:38:39.692978 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a42e1e43-9f80-4bdb-98a2-bb475bf109b2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:39.693542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a42e1e43-9f80-4bdb-98a2-bb475bf109b2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:39.700461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a42e1e43-9f80-4bdb-98a2-bb475bf109b2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:39.700933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a42e1e43-9f80-4bdb-98a2-bb475bf109b2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:39.701756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a42e1e43-9f80-4bdb-98a2-bb475bf109b2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:39.702215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a42e1e43-9f80-4bdb-98a2-bb475bf109b2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:39.772653 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a42e1e43-9f80-4bdb-98a2-bb475bf109b2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4/action" status: 202 len: 0 microversion: 2.1 time: 0.084007 Jul 14 15:38:39.773333 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3624/7211] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:38:39 2022] POST /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:38:39.782127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d7e6cb51-c857-410f-826f-388922847399 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:39.783490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d7e6cb51-c857-410f-826f-388922847399 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:39.791519 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7e6cb51-c857-410f-826f-388922847399 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:39.792138 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7e6cb51-c857-410f-826f-388922847399 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:39.793067 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7e6cb51-c857-410f-826f-388922847399 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:39.794249 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7e6cb51-c857-410f-826f-388922847399 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:40.223196 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d7e6cb51-c857-410f-826f-388922847399 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:40.230930 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d7e6cb51-c857-410f-826f-388922847399 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1674 microversion: 2.1 time: 0.453104 Jul 14 15:38:40.231535 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3588/7212] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:39 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1674 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:41.250232 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cd5853bc-f353-4e33-a1ab-07559b2f18b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:41.250963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cd5853bc-f353-4e33-a1ab-07559b2f18b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:41.257932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd5853bc-f353-4e33-a1ab-07559b2f18b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:41.258403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd5853bc-f353-4e33-a1ab-07559b2f18b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:41.259188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd5853bc-f353-4e33-a1ab-07559b2f18b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:41.259644 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cd5853bc-f353-4e33-a1ab-07559b2f18b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:41.389637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cd5853bc-f353-4e33-a1ab-07559b2f18b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:41.398238 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cd5853bc-f353-4e33-a1ab-07559b2f18b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1682 microversion: 2.1 time: 0.153122 Jul 14 15:38:41.398804 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3625/7213] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:41 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:41.496047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8503eb9c-bb89-4805-ace0-ca24e88dbef4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:41.497016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8503eb9c-bb89-4805-ace0-ca24e88dbef4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:41.505501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8503eb9c-bb89-4805-ace0-ca24e88dbef4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:41.505895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8503eb9c-bb89-4805-ace0-ca24e88dbef4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:41.506655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8503eb9c-bb89-4805-ace0-ca24e88dbef4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:41.507093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8503eb9c-bb89-4805-ace0-ca24e88dbef4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:41.569513 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8503eb9c-bb89-4805-ace0-ca24e88dbef4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4/action" status: 200 len: 38170 microversion: 2.1 time: 0.077148 Jul 14 15:38:41.570199 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3589/7214] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:38:41 2022] POST /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4/action => generated 38170 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:38:42.563331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-21816bb3-5b4e-4af3-9b26-b71eb40d1f66 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:42.563861 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-21816bb3-5b4e-4af3-9b26-b71eb40d1f66 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:42.570457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-7929d978-0ca9-4604-8e14-8e26f66ad36c req-e5bb2adb-6009-49f6-872c-e07c340c65a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42ad02a-5234-4913-8c2d-b32d17ff6ee4", "tag": "6fe192b9-2834-42b7-a95c-2bff8057f4f8"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:42.583064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21816bb3-5b4e-4af3-9b26-b71eb40d1f66 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:42.583912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21816bb3-5b4e-4af3-9b26-b71eb40d1f66 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:42.584716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21816bb3-5b4e-4af3-9b26-b71eb40d1f66 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:42.585033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7929d978-0ca9-4604-8e14-8e26f66ad36c req-e5bb2adb-6009-49f6-872c-e07c340c65a4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:42.585406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21816bb3-5b4e-4af3-9b26-b71eb40d1f66 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:42.585626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-7929d978-0ca9-4604-8e14-8e26f66ad36c req-e5bb2adb-6009-49f6-872c-e07c340c65a4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:42.597770 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-7929d978-0ca9-4604-8e14-8e26f66ad36c req-e5bb2adb-6009-49f6-872c-e07c340c65a4 service nova] Creating event network-changed:6fe192b9-2834-42b7-a95c-2bff8057f4f8 for instance a42ad02a-5234-4913-8c2d-b32d17ff6ee4 on n-h2-767704-28 Jul 14 15:38:42.602845 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-7929d978-0ca9-4604-8e14-8e26f66ad36c req-e5bb2adb-6009-49f6-872c-e07c340c65a4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036335 Jul 14 15:38:42.603455 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3590/7215] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:38:42.613342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-21816bb3-5b4e-4af3-9b26-b71eb40d1f66 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:38:42.694649 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-21816bb3-5b4e-4af3-9b26-b71eb40d1f66 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 204 len: 0 microversion: 2.1 time: 0.134907 Jul 14 15:38:42.696192 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3626/7216] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:38:42 2022] DELETE /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:38:42.707735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fd1ca20c-c8b4-499e-8f1a-fd30171c736c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:42.708732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fd1ca20c-c8b4-499e-8f1a-fd30171c736c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:42.722881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd1ca20c-c8b4-499e-8f1a-fd30171c736c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:42.724157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd1ca20c-c8b4-499e-8f1a-fd30171c736c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:42.725556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd1ca20c-c8b4-499e-8f1a-fd30171c736c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:42.726501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fd1ca20c-c8b4-499e-8f1a-fd30171c736c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:42.882656 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fd1ca20c-c8b4-499e-8f1a-fd30171c736c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:42.890313 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fd1ca20c-c8b4-499e-8f1a-fd30171c736c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1688 microversion: 2.1 time: 0.189331 Jul 14 15:38:42.890896 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3591/7217] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:42 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:43.909805 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-09cf5027-f0a8-412f-8f8a-0aeca328752e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:43.910539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-09cf5027-f0a8-412f-8f8a-0aeca328752e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:43.917590 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09cf5027-f0a8-412f-8f8a-0aeca328752e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:43.918064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09cf5027-f0a8-412f-8f8a-0aeca328752e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:43.918857 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09cf5027-f0a8-412f-8f8a-0aeca328752e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:43.919320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09cf5027-f0a8-412f-8f8a-0aeca328752e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:44.061254 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-09cf5027-f0a8-412f-8f8a-0aeca328752e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:44.069477 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-09cf5027-f0a8-412f-8f8a-0aeca328752e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1688 microversion: 2.1 time: 0.164640 Jul 14 15:38:44.070045 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3627/7218] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:43 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:45.087367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bf266194-3c11-4cae-82c4-5d9551919a0f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:45.087979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bf266194-3c11-4cae-82c4-5d9551919a0f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:45.095128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf266194-3c11-4cae-82c4-5d9551919a0f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:45.095912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf266194-3c11-4cae-82c4-5d9551919a0f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:45.096691 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf266194-3c11-4cae-82c4-5d9551919a0f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:45.097161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bf266194-3c11-4cae-82c4-5d9551919a0f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:45.139473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-528de3cc-7c2d-4985-9a42-d05e499fb6e3 req-4cb34517-3863-499a-a34b-6e94104fc2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42ad02a-5234-4913-8c2d-b32d17ff6ee4", "name": "network-vif-deleted", "tag": "6fe192b9-2834-42b7-a95c-2bff8057f4f8"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:45.151227 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-528de3cc-7c2d-4985-9a42-d05e499fb6e3 req-4cb34517-3863-499a-a34b-6e94104fc2b3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:45.151701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-528de3cc-7c2d-4985-9a42-d05e499fb6e3 req-4cb34517-3863-499a-a34b-6e94104fc2b3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:45.165886 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-528de3cc-7c2d-4985-9a42-d05e499fb6e3 req-4cb34517-3863-499a-a34b-6e94104fc2b3 service nova] Creating event network-vif-deleted:6fe192b9-2834-42b7-a95c-2bff8057f4f8 for instance a42ad02a-5234-4913-8c2d-b32d17ff6ee4 on n-h2-767704-28 Jul 14 15:38:45.176092 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-528de3cc-7c2d-4985-9a42-d05e499fb6e3 req-4cb34517-3863-499a-a34b-6e94104fc2b3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041171 Jul 14 15:38:45.176710 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3628/7219] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:38:45.186430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bf266194-3c11-4cae-82c4-5d9551919a0f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:45.196776 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bf266194-3c11-4cae-82c4-5d9551919a0f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 200 len: 1501 microversion: 2.1 time: 0.113165 Jul 14 15:38:45.207209 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3592/7220] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:45 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 1501 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:46.216186 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3460129a-ac9a-4441-8d59-99ace57f05dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:46.216907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3460129a-ac9a-4441-8d59-99ace57f05dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: a42ad02a-5234-4913-8c2d-b32d17ff6ee4] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:46.223769 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3460129a-ac9a-4441-8d59-99ace57f05dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:46.224235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3460129a-ac9a-4441-8d59-99ace57f05dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:46.225065 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3460129a-ac9a-4441-8d59-99ace57f05dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:46.225517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3460129a-ac9a-4441-8d59-99ace57f05dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:46.239456 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-3460129a-ac9a-4441-8d59-99ace57f05dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] HTTP exception thrown: Instance a42ad02a-5234-4913-8c2d-b32d17ff6ee4 could not be found. Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3460129a-ac9a-4441-8d59-99ace57f05dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Request method failure captured: Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 HTTP/1.1 Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DhCepsiUWzN2OBwVX62tUnpeM1pyuIHDeIvNigBeq67uN5XhDOMg_x_ZuIPETSWUT5YFW5LI1dL28GnGHCKqpBDIC9rM5qpCdbuGSc-8EcEdMoNXXJMpjprGKmuRcOOLKJ7kZYCzuJ7RPBJBMt-ss4WG-LmoDsWpBE8-dCFT4MyCzg Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 0ded8733e086447782856661597d52f0 Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0ded8733e086447782856661597d52f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0ded8733e086447782856661597d52f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0ded8733e086447782856661597d52f0", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0ded8733e086447782856661597d52f0"}]}] Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 0ded8733e086447782856661597d52f0 Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestNetworkAdvancedServerOps-1565740765-project Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 65b6268287b54c8d8a9fda65c04f278b Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1565740765-project Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance a42ad02a-5234-4913-8c2d-b32d17ff6ee4 could not be found. Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'a42ad02a-5234-4913-8c2d-b32d17ff6ee4'} Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42ad02a-5234-4913-8c2d-b32d17ff6ee4 could not be found. Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42ad02a-5234-4913-8c2d-b32d17ff6ee4 could not be found. Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:38:46.241117 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:38:46.248386 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:38:46.248386 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:46.248386 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:38:46.248386 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:38:46.248386 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:38:46.248386 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:38:46.248386 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42ad02a-5234-4913-8c2d-b32d17ff6ee4 could not be found. Jul 14 15:38:46.248386 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:38:46.248386 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3460129a-ac9a-4441-8d59-99ace57f05dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Returning 404 to user: Instance a42ad02a-5234-4913-8c2d-b32d17ff6ee4 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:38:46.248386 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3460129a-ac9a-4441-8d59-99ace57f05dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4" status: 404 len: 111 microversion: 2.1 time: 0.031562 Jul 14 15:38:46.248386 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3629/7221] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:46 2022] GET /compute/v2.1/servers/a42ad02a-5234-4913-8c2d-b32d17ff6ee4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:38:49.223251 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d8a05c1b-381d-4964-b2d2-e67b4397e73f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '.version_select at 0x7fd6c432b160>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:49.249380 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d8a05c1b-381d-4964-b2d2-e67b4397e73f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-625873651" status: 202 len: 0 microversion: 2.1 time: 0.030738 Jul 14 15:38:49.249987 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3593/7222] 10.222.0.81 () {58 vars in 1280 bytes} [Thu Jul 14 15:38:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-625873651 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:38:49.280085 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-db07bc64-1e72-4ac6-9af4-5579c4e0fa49 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'create', calling method: .version_select at 0x7fd6c4e274c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2023394346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxrZvX17ctKwY8/2hBChe2Nj2kbMlgSR+QHI+PY4NVapluZqJz1E2j/2B4KScKOrsLltoa6HrNdAzxzfYdocq+9Lmfjxl5urgjlRwaxb+yBq6pVn7WLmOEV+MXpzqVE/A=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:49.298202 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-db07bc64-1e72-4ac6-9af4-5579c4e0fa49 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for project 0ded8733e086447782856661597d52f0. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:38:49.304779 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-db07bc64-1e72-4ac6-9af4-5579c4e0fa49 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for user 65b6268287b54c8d8a9fda65c04f278b and project 0ded8733e086447782856661597d52f0. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:38:49.327426 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-db07bc64-1e72-4ac6-9af4-5579c4e0fa49 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051417 Jul 14 15:38:49.328018 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3630/7223] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:38:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:38:55.211024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-399944545", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "96e6cb1e-86ef-4ed7-a79b-9bcd66fcdcdd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2023394346", "security_groups": [{"name": "tempest-secgroup-smoke-617175163"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:55.233152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=34 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:55.353403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] validate_networks() for [('96e6cb1e-86ef-4ed7-a79b-9bcd66fcdcdd', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:38:55.746242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:38:55.746852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:38:55.747405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:38:55.748051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:38:55.748626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:38:55.758633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:55.759084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:55.759879 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:55.760316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:55.778379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for project 0ded8733e086447782856661597d52f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:38:55.784244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for user 65b6268287b54c8d8a9fda65c04f278b and project 0ded8733e086447782856661597d52f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:38:55.796794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:38:55.799148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:38:55.846374 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-545434d9-30d0-499d-afa2-f91d0e881958 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.639174 Jul 14 15:38:55.847094 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3594/7224] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:38:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:38:55.857989 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b39b3fd1-39df-4ba2-b2fc-2323fbf98467 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:55.858615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b39b3fd1-39df-4ba2-b2fc-2323fbf98467 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:55.921173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b39b3fd1-39df-4ba2-b2fc-2323fbf98467 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:55.929062 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b39b3fd1-39df-4ba2-b2fc-2323fbf98467 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1266 microversion: 2.1 time: 0.075888 Jul 14 15:38:55.929635 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3631/7225] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:55 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:56.948299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c8513a63-1a26-4fcb-9115-be9391f37f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:56.948872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c8513a63-1a26-4fcb-9115-be9391f37f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:56.958051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8513a63-1a26-4fcb-9115-be9391f37f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:56.958768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8513a63-1a26-4fcb-9115-be9391f37f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:56.959572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8513a63-1a26-4fcb-9115-be9391f37f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:56.960027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c8513a63-1a26-4fcb-9115-be9391f37f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:57.033737 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c8513a63-1a26-4fcb-9115-be9391f37f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:57.042928 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c8513a63-1a26-4fcb-9115-be9391f37f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1318 microversion: 2.1 time: 0.100766 Jul 14 15:38:57.043520 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3595/7226] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:56 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:58.063819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e00d1fe1-7335-4644-8f9f-e78226acc326 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:58.065958 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e00d1fe1-7335-4644-8f9f-e78226acc326 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:58.072056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:58.075217 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e00d1fe1-7335-4644-8f9f-e78226acc326 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:58.075766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e00d1fe1-7335-4644-8f9f-e78226acc326 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:58.076642 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e00d1fe1-7335-4644-8f9f-e78226acc326 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:58.084130 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e00d1fe1-7335-4644-8f9f-e78226acc326 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:58.328888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e00d1fe1-7335-4644-8f9f-e78226acc326 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:58.341819 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e00d1fe1-7335-4644-8f9f-e78226acc326 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1391 microversion: 2.1 time: 0.283122 Jul 14 15:38:58.342426 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3632/7227] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:58 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1391 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:58.863092 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c16229fc-5598-4095-a317-9f5bc2ebea63 req-2d7463d4-c8e5-4d22-80b3-9cdf77a4b084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e51551-6c0b-4194-a811-94ce72b29df5", "tag": "d58e932d-e304-4e6f-aca9-25e4f419537d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:58.879735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c16229fc-5598-4095-a317-9f5bc2ebea63 req-2d7463d4-c8e5-4d22-80b3-9cdf77a4b084 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:58.880297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c16229fc-5598-4095-a317-9f5bc2ebea63 req-2d7463d4-c8e5-4d22-80b3-9cdf77a4b084 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:58.903593 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c16229fc-5598-4095-a317-9f5bc2ebea63 req-2d7463d4-c8e5-4d22-80b3-9cdf77a4b084 service nova] Creating event network-changed:d58e932d-e304-4e6f-aca9-25e4f419537d for instance d7e51551-6c0b-4194-a811-94ce72b29df5 on n-h1-767704-28 Jul 14 15:38:58.910367 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c16229fc-5598-4095-a317-9f5bc2ebea63 req-2d7463d4-c8e5-4d22-80b3-9cdf77a4b084 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053468 Jul 14 15:38:58.915128 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3596/7228] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:38:59.359554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8f358573-5065-4c73-91d0-5d62c6f41453 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:59.360184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8f358573-5065-4c73-91d0-5d62c6f41453 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:59.367781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f358573-5065-4c73-91d0-5d62c6f41453 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:59.368242 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f358573-5065-4c73-91d0-5d62c6f41453 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:59.369049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f358573-5065-4c73-91d0-5d62c6f41453 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:59.369531 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f358573-5065-4c73-91d0-5d62c6f41453 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:59.509325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8f358573-5065-4c73-91d0-5d62c6f41453 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:59.516893 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8f358573-5065-4c73-91d0-5d62c6f41453 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1391 microversion: 2.1 time: 0.161229 Jul 14 15:38:59.518279 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3633/7229] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:59 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:00.537230 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-72deca33-92f6-4363-bdf9-19649b817d62 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:00.537937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-72deca33-92f6-4363-bdf9-19649b817d62 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:00.544229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72deca33-92f6-4363-bdf9-19649b817d62 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:00.544687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72deca33-92f6-4363-bdf9-19649b817d62 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:00.545490 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72deca33-92f6-4363-bdf9-19649b817d62 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:00.545933 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-72deca33-92f6-4363-bdf9-19649b817d62 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:00.681027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-72deca33-92f6-4363-bdf9-19649b817d62 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:00.688429 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-72deca33-92f6-4363-bdf9-19649b817d62 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1391 microversion: 2.1 time: 0.157013 Jul 14 15:39:00.689034 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3597/7230] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:00 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:01.706476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8c603742-cf0b-4019-8fb4-aadda7657d16 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:01.707120 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8c603742-cf0b-4019-8fb4-aadda7657d16 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:01.714469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c603742-cf0b-4019-8fb4-aadda7657d16 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:01.714943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c603742-cf0b-4019-8fb4-aadda7657d16 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:01.715745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c603742-cf0b-4019-8fb4-aadda7657d16 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:01.716201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c603742-cf0b-4019-8fb4-aadda7657d16 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:01.858689 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8c603742-cf0b-4019-8fb4-aadda7657d16 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:01.866575 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8c603742-cf0b-4019-8fb4-aadda7657d16 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1391 microversion: 2.1 time: 0.164709 Jul 14 15:39:01.867168 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3634/7231] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:01 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:02.883457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0ef6e40c-f61b-447f-ac1b-d028e8ab9dac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:02.884073 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0ef6e40c-f61b-447f-ac1b-d028e8ab9dac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:02.891139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ef6e40c-f61b-447f-ac1b-d028e8ab9dac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:02.891595 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ef6e40c-f61b-447f-ac1b-d028e8ab9dac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:02.892960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ef6e40c-f61b-447f-ac1b-d028e8ab9dac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:02.893570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0ef6e40c-f61b-447f-ac1b-d028e8ab9dac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:03.027894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0ef6e40c-f61b-447f-ac1b-d028e8ab9dac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:03.035361 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0ef6e40c-f61b-447f-ac1b-d028e8ab9dac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1391 microversion: 2.1 time: 0.155901 Jul 14 15:39:03.035936 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3598/7232] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:02 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:04.052970 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-37c55bac-bb36-4bb0-9de7-30d87eadf3c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:04.053615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-37c55bac-bb36-4bb0-9de7-30d87eadf3c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:04.060260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37c55bac-bb36-4bb0-9de7-30d87eadf3c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:04.060741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37c55bac-bb36-4bb0-9de7-30d87eadf3c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:04.061554 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37c55bac-bb36-4bb0-9de7-30d87eadf3c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:04.062013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-37c55bac-bb36-4bb0-9de7-30d87eadf3c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:04.202128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-37c55bac-bb36-4bb0-9de7-30d87eadf3c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:04.211069 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-37c55bac-bb36-4bb0-9de7-30d87eadf3c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1391 microversion: 2.1 time: 0.162020 Jul 14 15:39:04.211657 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3635/7233] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:04 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:05.227649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7af41959-b24b-43d6-9d34-9e1f7c0e795d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:05.228268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7af41959-b24b-43d6-9d34-9e1f7c0e795d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:05.235137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7af41959-b24b-43d6-9d34-9e1f7c0e795d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:05.235600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7af41959-b24b-43d6-9d34-9e1f7c0e795d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:05.236436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7af41959-b24b-43d6-9d34-9e1f7c0e795d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:05.236785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7af41959-b24b-43d6-9d34-9e1f7c0e795d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:05.367884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7af41959-b24b-43d6-9d34-9e1f7c0e795d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:05.376849 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7af41959-b24b-43d6-9d34-9e1f7c0e795d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1391 microversion: 2.1 time: 0.152857 Jul 14 15:39:05.377487 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3599/7234] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:05 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:05.485649 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-ec091f4a-c6c1-4fd7-a021-fd24554e52ee req-16373622-5309-44fd-80a7-00e10b90041f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e51551-6c0b-4194-a811-94ce72b29df5", "name": "network-vif-plugged", "status": "completed", "tag": "d58e932d-e304-4e6f-aca9-25e4f419537d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:05.495637 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ec091f4a-c6c1-4fd7-a021-fd24554e52ee req-16373622-5309-44fd-80a7-00e10b90041f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:05.496112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-ec091f4a-c6c1-4fd7-a021-fd24554e52ee req-16373622-5309-44fd-80a7-00e10b90041f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:05.508131 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-ec091f4a-c6c1-4fd7-a021-fd24554e52ee req-16373622-5309-44fd-80a7-00e10b90041f service nova] Creating event network-vif-plugged:d58e932d-e304-4e6f-aca9-25e4f419537d for instance d7e51551-6c0b-4194-a811-94ce72b29df5 on n-h1-767704-28 Jul 14 15:39:05.514821 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-ec091f4a-c6c1-4fd7-a021-fd24554e52ee req-16373622-5309-44fd-80a7-00e10b90041f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032490 Jul 14 15:39:05.515938 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3636/7235] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:06.395514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7882e301-c977-44ae-8469-01e6b478ef48 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:06.396050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7882e301-c977-44ae-8469-01e6b478ef48 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:06.398082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:06.398753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:06.406028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7882e301-c977-44ae-8469-01e6b478ef48 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:06.406497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7882e301-c977-44ae-8469-01e6b478ef48 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:06.407278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7882e301-c977-44ae-8469-01e6b478ef48 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:06.408226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7882e301-c977-44ae-8469-01e6b478ef48 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:06.543562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7882e301-c977-44ae-8469-01e6b478ef48 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:06.551237 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7882e301-c977-44ae-8469-01e6b478ef48 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1391 microversion: 2.1 time: 0.161014 Jul 14 15:39:06.551824 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3600/7236] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:06 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:07.565235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:07.570366 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b799b489-3358-47de-ac57-4e5556234a0b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:07.571077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b799b489-3358-47de-ac57-4e5556234a0b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:07.572870 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:07.580031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b799b489-3358-47de-ac57-4e5556234a0b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:07.580498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b799b489-3358-47de-ac57-4e5556234a0b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:07.581305 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b799b489-3358-47de-ac57-4e5556234a0b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:07.581754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b799b489-3358-47de-ac57-4e5556234a0b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:07.715383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b799b489-3358-47de-ac57-4e5556234a0b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:07.723504 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b799b489-3358-47de-ac57-4e5556234a0b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1563 microversion: 2.1 time: 0.159315 Jul 14 15:39:07.724084 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3637/7237] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:07 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:07.739810 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-69531df6-7a75-4da6-a961-0ef401610c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:07.740429 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-69531df6-7a75-4da6-a961-0ef401610c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:07.743286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:07.749483 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69531df6-7a75-4da6-a961-0ef401610c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:07.749952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69531df6-7a75-4da6-a961-0ef401610c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:07.750778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69531df6-7a75-4da6-a961-0ef401610c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:07.751226 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-69531df6-7a75-4da6-a961-0ef401610c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:07.893389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-69531df6-7a75-4da6-a961-0ef401610c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:07.901805 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-69531df6-7a75-4da6-a961-0ef401610c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1563 microversion: 2.1 time: 0.165633 Jul 14 15:39:07.901930 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3601/7238] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:07 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:09.489086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-aaecb78e-ec87-453d-9eea-17bfe4f42279 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:09.489733 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-aaecb78e-ec87-453d-9eea-17bfe4f42279 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:09.490817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-76e6a71a-dc46-4682-b43b-94b2ec1fa358 req-09a4ebcf-ffe0-42d8-a0e7-b138de222f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e51551-6c0b-4194-a811-94ce72b29df5", "tag": "d58e932d-e304-4e6f-aca9-25e4f419537d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:09.496569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aaecb78e-ec87-453d-9eea-17bfe4f42279 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:09.497215 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aaecb78e-ec87-453d-9eea-17bfe4f42279 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:09.498156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aaecb78e-ec87-453d-9eea-17bfe4f42279 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:09.498629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-aaecb78e-ec87-453d-9eea-17bfe4f42279 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:09.501148 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-76e6a71a-dc46-4682-b43b-94b2ec1fa358 req-09a4ebcf-ffe0-42d8-a0e7-b138de222f35 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:09.502245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-76e6a71a-dc46-4682-b43b-94b2ec1fa358 req-09a4ebcf-ffe0-42d8-a0e7-b138de222f35 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:09.514815 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-76e6a71a-dc46-4682-b43b-94b2ec1fa358 req-09a4ebcf-ffe0-42d8-a0e7-b138de222f35 service nova] Creating event network-changed:d58e932d-e304-4e6f-aca9-25e4f419537d for instance d7e51551-6c0b-4194-a811-94ce72b29df5 on n-h1-767704-28 Jul 14 15:39:09.520822 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-76e6a71a-dc46-4682-b43b-94b2ec1fa358 req-09a4ebcf-ffe0-42d8-a0e7-b138de222f35 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034882 Jul 14 15:39:09.521588 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3602/7239] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:39:09.975904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-aaecb78e-ec87-453d-9eea-17bfe4f42279 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:09.983978 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-aaecb78e-ec87-453d-9eea-17bfe4f42279 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1563 microversion: 2.1 time: 0.500586 Jul 14 15:39:09.985136 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3638/7240] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:09 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1563 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:51.297549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:51.298297 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=42 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:51.302533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-33f6c628-6dc3-4ad0-866c-f8034527f403 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:51.303572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-33f6c628-6dc3-4ad0-866c-f8034527f403 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:51.311802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33f6c628-6dc3-4ad0-866c-f8034527f403 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:51.312264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33f6c628-6dc3-4ad0-866c-f8034527f403 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:51.313069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33f6c628-6dc3-4ad0-866c-f8034527f403 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:51.313520 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-33f6c628-6dc3-4ad0-866c-f8034527f403 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:51.404182 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-33f6c628-6dc3-4ad0-866c-f8034527f403 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5/action" status: 200 len: 24568 microversion: 2.1 time: 0.108680 Jul 14 15:39:51.404994 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3603/7241] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:39:51 2022] POST /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5/action => generated 24568 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:40:08.000380 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-db0c5470-98ce-4310-9461-fd0468beb505 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:08.001378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-db0c5470-98ce-4310-9461-fd0468beb505 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:08.003406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:08.004203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=38 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:08.011002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db0c5470-98ce-4310-9461-fd0468beb505 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:08.011478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db0c5470-98ce-4310-9461-fd0468beb505 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:08.012267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db0c5470-98ce-4310-9461-fd0468beb505 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:08.012725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-db0c5470-98ce-4310-9461-fd0468beb505 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:08.085132 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-db0c5470-98ce-4310-9461-fd0468beb505 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5/action" status: 202 len: 0 microversion: 2.1 time: 0.088833 Jul 14 15:40:08.085806 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3639/7242] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:40:07 2022] POST /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:40:08.094874 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-18458572-fdf8-4ef6-919d-f34c17c3c48c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:08.095610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-18458572-fdf8-4ef6-919d-f34c17c3c48c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:08.098602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:08.099452 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:08.107381 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18458572-fdf8-4ef6-919d-f34c17c3c48c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:08.107848 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18458572-fdf8-4ef6-919d-f34c17c3c48c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:08.108661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18458572-fdf8-4ef6-919d-f34c17c3c48c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:08.109144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-18458572-fdf8-4ef6-919d-f34c17c3c48c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:08.386420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-18458572-fdf8-4ef6-919d-f34c17c3c48c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:08.394139 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-18458572-fdf8-4ef6-919d-f34c17c3c48c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1673 microversion: 2.1 time: 0.303600 Jul 14 15:40:08.394913 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3604/7243] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:08 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1673 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:09.414175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d3a73d7b-5e70-4545-8e0a-cb33f4eef9b7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:09.414937 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d3a73d7b-5e70-4545-8e0a-cb33f4eef9b7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:09.423680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d3a73d7b-5e70-4545-8e0a-cb33f4eef9b7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:09.424553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d3a73d7b-5e70-4545-8e0a-cb33f4eef9b7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:09.425810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d3a73d7b-5e70-4545-8e0a-cb33f4eef9b7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:09.426536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d3a73d7b-5e70-4545-8e0a-cb33f4eef9b7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:09.614200 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d3a73d7b-5e70-4545-8e0a-cb33f4eef9b7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:09.622521 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d3a73d7b-5e70-4545-8e0a-cb33f4eef9b7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.213967 Jul 14 15:40:09.623094 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3640/7244] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:09 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:10.640683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-57c95406-cdd5-4f8b-a679-6e6cafd82ff0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:10.641359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-57c95406-cdd5-4f8b-a679-6e6cafd82ff0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:10.649342 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57c95406-cdd5-4f8b-a679-6e6cafd82ff0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:10.649805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57c95406-cdd5-4f8b-a679-6e6cafd82ff0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:10.650794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57c95406-cdd5-4f8b-a679-6e6cafd82ff0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:10.651250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-57c95406-cdd5-4f8b-a679-6e6cafd82ff0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:10.789341 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-57c95406-cdd5-4f8b-a679-6e6cafd82ff0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:10.797073 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-57c95406-cdd5-4f8b-a679-6e6cafd82ff0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.160376 Jul 14 15:40:10.797641 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3605/7245] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:10 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:11.814714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ffd3246c-803f-4046-a9f2-5fa561955dda tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:11.815343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ffd3246c-803f-4046-a9f2-5fa561955dda tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:11.823105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ffd3246c-803f-4046-a9f2-5fa561955dda tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:11.823575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ffd3246c-803f-4046-a9f2-5fa561955dda tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:11.824357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ffd3246c-803f-4046-a9f2-5fa561955dda tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:11.824815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ffd3246c-803f-4046-a9f2-5fa561955dda tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:11.954675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ffd3246c-803f-4046-a9f2-5fa561955dda tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:11.963308 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ffd3246c-803f-4046-a9f2-5fa561955dda tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.151791 Jul 14 15:40:11.964003 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3641/7246] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:11 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:12.983093 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c4c10cca-2069-4c2d-9df8-c13c2433e66c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:12.983723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c4c10cca-2069-4c2d-9df8-c13c2433e66c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:12.992600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4c10cca-2069-4c2d-9df8-c13c2433e66c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:12.993094 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4c10cca-2069-4c2d-9df8-c13c2433e66c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:12.994422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4c10cca-2069-4c2d-9df8-c13c2433e66c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:12.994871 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4c10cca-2069-4c2d-9df8-c13c2433e66c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:13.132466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c4c10cca-2069-4c2d-9df8-c13c2433e66c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:13.141346 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c4c10cca-2069-4c2d-9df8-c13c2433e66c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.165565 Jul 14 15:40:13.141936 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3606/7247] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:12 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:14.159109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-80d0722e-a997-4298-9ab8-1432ce9efb30 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:14.159663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-80d0722e-a997-4298-9ab8-1432ce9efb30 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:14.167343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80d0722e-a997-4298-9ab8-1432ce9efb30 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:14.167818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80d0722e-a997-4298-9ab8-1432ce9efb30 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:14.168607 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80d0722e-a997-4298-9ab8-1432ce9efb30 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:14.169132 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-80d0722e-a997-4298-9ab8-1432ce9efb30 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:14.302556 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-80d0722e-a997-4298-9ab8-1432ce9efb30 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:14.310793 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-80d0722e-a997-4298-9ab8-1432ce9efb30 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.155755 Jul 14 15:40:14.311359 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3642/7248] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:14 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:15.328303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-df6f3b81-a82c-43aa-9b43-3500f63dd2e8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:15.328920 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-df6f3b81-a82c-43aa-9b43-3500f63dd2e8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:15.335608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df6f3b81-a82c-43aa-9b43-3500f63dd2e8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:15.336065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df6f3b81-a82c-43aa-9b43-3500f63dd2e8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:15.336837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df6f3b81-a82c-43aa-9b43-3500f63dd2e8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:15.337882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df6f3b81-a82c-43aa-9b43-3500f63dd2e8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:15.473859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-df6f3b81-a82c-43aa-9b43-3500f63dd2e8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:15.481549 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-df6f3b81-a82c-43aa-9b43-3500f63dd2e8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.157457 Jul 14 15:40:15.482136 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3607/7249] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:15 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:16.499854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-65fe7ca4-7ff6-4037-8899-8e873bb17785 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:16.500481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-65fe7ca4-7ff6-4037-8899-8e873bb17785 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:16.507507 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65fe7ca4-7ff6-4037-8899-8e873bb17785 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:16.507973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65fe7ca4-7ff6-4037-8899-8e873bb17785 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:16.508753 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65fe7ca4-7ff6-4037-8899-8e873bb17785 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:16.509310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-65fe7ca4-7ff6-4037-8899-8e873bb17785 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:16.647060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-65fe7ca4-7ff6-4037-8899-8e873bb17785 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:16.655516 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-65fe7ca4-7ff6-4037-8899-8e873bb17785 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.159724 Jul 14 15:40:16.656101 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3643/7250] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:16 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:17.673923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-36945329-24c7-4c3a-b678-06dc96def4ff tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:17.674588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-36945329-24c7-4c3a-b678-06dc96def4ff tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:17.681584 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36945329-24c7-4c3a-b678-06dc96def4ff tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:17.682042 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36945329-24c7-4c3a-b678-06dc96def4ff tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:17.683046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36945329-24c7-4c3a-b678-06dc96def4ff tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:17.683501 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-36945329-24c7-4c3a-b678-06dc96def4ff tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:17.817125 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-36945329-24c7-4c3a-b678-06dc96def4ff tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:17.825554 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-36945329-24c7-4c3a-b678-06dc96def4ff tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.155630 Jul 14 15:40:17.826130 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3608/7251] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:17 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:18.843429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-13afca79-3fde-4899-962c-b842efbeebed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:18.844069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-13afca79-3fde-4899-962c-b842efbeebed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:18.850849 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13afca79-3fde-4899-962c-b842efbeebed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:18.851324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13afca79-3fde-4899-962c-b842efbeebed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:18.852110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13afca79-3fde-4899-962c-b842efbeebed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:18.852575 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-13afca79-3fde-4899-962c-b842efbeebed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:18.991263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-13afca79-3fde-4899-962c-b842efbeebed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:18.999503 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-13afca79-3fde-4899-962c-b842efbeebed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.160122 Jul 14 15:40:19.000078 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3644/7252] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:18 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:20.016780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-faec46f3-104b-43e0-a248-a54ae435979f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:20.017424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-faec46f3-104b-43e0-a248-a54ae435979f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:20.024887 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-faec46f3-104b-43e0-a248-a54ae435979f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:20.025489 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-faec46f3-104b-43e0-a248-a54ae435979f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:20.026261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-faec46f3-104b-43e0-a248-a54ae435979f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:20.026706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-faec46f3-104b-43e0-a248-a54ae435979f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:20.157993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-faec46f3-104b-43e0-a248-a54ae435979f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:20.166263 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-faec46f3-104b-43e0-a248-a54ae435979f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.152833 Jul 14 15:40:20.166856 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3609/7253] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:20 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:21.185427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b5d7d7a-3366-4ece-a602-240dc16cd68c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:21.185980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1b5d7d7a-3366-4ece-a602-240dc16cd68c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:21.192972 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b5d7d7a-3366-4ece-a602-240dc16cd68c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:21.195376 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b5d7d7a-3366-4ece-a602-240dc16cd68c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:21.196173 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b5d7d7a-3366-4ece-a602-240dc16cd68c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:21.196650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b5d7d7a-3366-4ece-a602-240dc16cd68c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:21.336993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1b5d7d7a-3366-4ece-a602-240dc16cd68c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:21.345364 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1b5d7d7a-3366-4ece-a602-240dc16cd68c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.165795 Jul 14 15:40:21.345949 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3645/7254] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:21 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:22.363716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e92a27ee-13d4-4c3a-96b7-36884cba7185 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:22.364328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e92a27ee-13d4-4c3a-96b7-36884cba7185 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:22.372577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e92a27ee-13d4-4c3a-96b7-36884cba7185 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:22.373091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e92a27ee-13d4-4c3a-96b7-36884cba7185 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:22.373861 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e92a27ee-13d4-4c3a-96b7-36884cba7185 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:22.374305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e92a27ee-13d4-4c3a-96b7-36884cba7185 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:22.509958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e92a27ee-13d4-4c3a-96b7-36884cba7185 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:22.518387 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e92a27ee-13d4-4c3a-96b7-36884cba7185 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.159010 Jul 14 15:40:22.518968 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3610/7255] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:22 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:23.537064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8f253749-783c-4412-a52c-614d0dab59c3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:23.537696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8f253749-783c-4412-a52c-614d0dab59c3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:23.545760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f253749-783c-4412-a52c-614d0dab59c3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:23.546235 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f253749-783c-4412-a52c-614d0dab59c3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:23.547026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f253749-783c-4412-a52c-614d0dab59c3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:23.547489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8f253749-783c-4412-a52c-614d0dab59c3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:23.679136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8f253749-783c-4412-a52c-614d0dab59c3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:23.686935 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8f253749-783c-4412-a52c-614d0dab59c3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.153803 Jul 14 15:40:23.687508 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3646/7256] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:23 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:24.703983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b0a38f45-62dd-4c5a-bac8-7962d1612f54 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:24.704603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b0a38f45-62dd-4c5a-bac8-7962d1612f54 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:24.711655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0a38f45-62dd-4c5a-bac8-7962d1612f54 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:24.712119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0a38f45-62dd-4c5a-bac8-7962d1612f54 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:24.712891 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0a38f45-62dd-4c5a-bac8-7962d1612f54 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:24.713855 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b0a38f45-62dd-4c5a-bac8-7962d1612f54 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:24.850145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b0a38f45-62dd-4c5a-bac8-7962d1612f54 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:24.858557 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b0a38f45-62dd-4c5a-bac8-7962d1612f54 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.158483 Jul 14 15:40:24.859226 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3611/7257] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:24 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:25.875921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7b116a25-db24-4fb7-8fa5-45af692bc27f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:25.876583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7b116a25-db24-4fb7-8fa5-45af692bc27f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:25.883324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b116a25-db24-4fb7-8fa5-45af692bc27f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:25.883800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b116a25-db24-4fb7-8fa5-45af692bc27f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:25.884589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b116a25-db24-4fb7-8fa5-45af692bc27f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:25.885096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7b116a25-db24-4fb7-8fa5-45af692bc27f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:26.018193 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7b116a25-db24-4fb7-8fa5-45af692bc27f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:26.026652 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7b116a25-db24-4fb7-8fa5-45af692bc27f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.154224 Jul 14 15:40:26.027298 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3647/7258] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:25 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:27.044334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8a03ed8f-6c92-47c9-ba00-0c1fbdc83b89 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:27.044966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8a03ed8f-6c92-47c9-ba00-0c1fbdc83b89 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:27.051782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a03ed8f-6c92-47c9-ba00-0c1fbdc83b89 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:27.052245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a03ed8f-6c92-47c9-ba00-0c1fbdc83b89 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:27.053058 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a03ed8f-6c92-47c9-ba00-0c1fbdc83b89 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:27.053505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8a03ed8f-6c92-47c9-ba00-0c1fbdc83b89 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:27.187170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8a03ed8f-6c92-47c9-ba00-0c1fbdc83b89 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:27.195478 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8a03ed8f-6c92-47c9-ba00-0c1fbdc83b89 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.155844 Jul 14 15:40:27.196195 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3612/7259] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:27 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:28.212765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-68b9f249-bb67-41cd-a001-4cb6bfa1b564 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:28.213419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-68b9f249-bb67-41cd-a001-4cb6bfa1b564 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:28.220368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68b9f249-bb67-41cd-a001-4cb6bfa1b564 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:28.220838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68b9f249-bb67-41cd-a001-4cb6bfa1b564 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:28.221648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68b9f249-bb67-41cd-a001-4cb6bfa1b564 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:28.222107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68b9f249-bb67-41cd-a001-4cb6bfa1b564 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:28.356385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-68b9f249-bb67-41cd-a001-4cb6bfa1b564 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:28.364042 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-68b9f249-bb67-41cd-a001-4cb6bfa1b564 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.155144 Jul 14 15:40:28.364622 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3648/7260] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:28 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:29.382758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3ce17052-ec0c-4541-9dcc-1932a8bdfa06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:29.383374 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3ce17052-ec0c-4541-9dcc-1932a8bdfa06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:29.391189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ce17052-ec0c-4541-9dcc-1932a8bdfa06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:29.391647 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ce17052-ec0c-4541-9dcc-1932a8bdfa06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:29.392422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ce17052-ec0c-4541-9dcc-1932a8bdfa06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:29.392866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3ce17052-ec0c-4541-9dcc-1932a8bdfa06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:29.529569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3ce17052-ec0c-4541-9dcc-1932a8bdfa06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:29.537263 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3ce17052-ec0c-4541-9dcc-1932a8bdfa06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1678 microversion: 2.1 time: 0.158504 Jul 14 15:40:29.538066 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3613/7261] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:29 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:30.555477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3cf679f1-b858-49ea-8e1e-5798bcb0a5fe tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:30.556207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3cf679f1-b858-49ea-8e1e-5798bcb0a5fe tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:30.564050 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cf679f1-b858-49ea-8e1e-5798bcb0a5fe tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:30.564518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cf679f1-b858-49ea-8e1e-5798bcb0a5fe tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:30.565345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cf679f1-b858-49ea-8e1e-5798bcb0a5fe tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:30.565803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3cf679f1-b858-49ea-8e1e-5798bcb0a5fe tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:30.700586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3cf679f1-b858-49ea-8e1e-5798bcb0a5fe tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:30.708209 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3cf679f1-b858-49ea-8e1e-5798bcb0a5fe tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1681 microversion: 2.1 time: 0.156649 Jul 14 15:40:30.708790 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3649/7262] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:30 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:10.968024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b67f0fc-000a-4f2a-975e-2405169d9948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:10.968974 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8b67f0fc-000a-4f2a-975e-2405169d9948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:10.971066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=20 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:10.971720 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=60 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:10.977532 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b67f0fc-000a-4f2a-975e-2405169d9948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:10.977989 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b67f0fc-000a-4f2a-975e-2405169d9948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:10.978758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b67f0fc-000a-4f2a-975e-2405169d9948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:10.979199 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8b67f0fc-000a-4f2a-975e-2405169d9948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:11.068492 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8b67f0fc-000a-4f2a-975e-2405169d9948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5/action" status: 200 len: 69259 microversion: 2.1 time: 0.104566 Jul 14 15:41:11.069502 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3614/7263] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:41:10 2022] POST /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5/action => generated 69259 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:41:23.029610 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e82c2eca-819e-499f-a445-79cf44902433 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:23.030125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e82c2eca-819e-499f-a445-79cf44902433 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:23.032704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=22 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:23.033452 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:23.033840 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:23.034776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:23.041123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e82c2eca-819e-499f-a445-79cf44902433 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:23.041596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e82c2eca-819e-499f-a445-79cf44902433 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:23.042478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e82c2eca-819e-499f-a445-79cf44902433 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:23.043069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e82c2eca-819e-499f-a445-79cf44902433 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:23.075744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e82c2eca-819e-499f-a445-79cf44902433 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:41:23.104379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3b05fc22-c2d3-467f-9b6d-89cfeb993da6 req-c59e8462-e971-4a6e-aea5-53eb89a6508e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e51551-6c0b-4194-a811-94ce72b29df5", "tag": "d58e932d-e304-4e6f-aca9-25e4f419537d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:23.114945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3b05fc22-c2d3-467f-9b6d-89cfeb993da6 req-c59e8462-e971-4a6e-aea5-53eb89a6508e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:23.115314 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3b05fc22-c2d3-467f-9b6d-89cfeb993da6 req-c59e8462-e971-4a6e-aea5-53eb89a6508e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:23.127100 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3b05fc22-c2d3-467f-9b6d-89cfeb993da6 req-c59e8462-e971-4a6e-aea5-53eb89a6508e service nova] Creating event network-changed:d58e932d-e304-4e6f-aca9-25e4f419537d for instance d7e51551-6c0b-4194-a811-94ce72b29df5 on n-h1-767704-28 Jul 14 15:41:23.132286 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3b05fc22-c2d3-467f-9b6d-89cfeb993da6 req-c59e8462-e971-4a6e-aea5-53eb89a6508e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103879 Jul 14 15:41:23.133225 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3615/7264] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:41:23.161181 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e82c2eca-819e-499f-a445-79cf44902433 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 204 len: 0 microversion: 2.1 time: 0.135303 Jul 14 15:41:23.161891 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3650/7265] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:41:23 2022] DELETE /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:41:23.171418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a1c09588-065e-4d21-86d6-35d5d942df9f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:23.172794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a1c09588-065e-4d21-86d6-35d5d942df9f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:23.179415 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1c09588-065e-4d21-86d6-35d5d942df9f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:23.179875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1c09588-065e-4d21-86d6-35d5d942df9f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:23.180667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1c09588-065e-4d21-86d6-35d5d942df9f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:23.181139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a1c09588-065e-4d21-86d6-35d5d942df9f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:23.360738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a1c09588-065e-4d21-86d6-35d5d942df9f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:23.368806 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a1c09588-065e-4d21-86d6-35d5d942df9f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1687 microversion: 2.1 time: 0.202052 Jul 14 15:41:23.369334 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3616/7266] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:23 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1687 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:24.387660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0da25aac-e7c8-406a-9be6-6b329b93bdd9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:24.388389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0da25aac-e7c8-406a-9be6-6b329b93bdd9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:24.396585 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0da25aac-e7c8-406a-9be6-6b329b93bdd9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:24.397092 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0da25aac-e7c8-406a-9be6-6b329b93bdd9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:24.397891 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0da25aac-e7c8-406a-9be6-6b329b93bdd9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:24.398353 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0da25aac-e7c8-406a-9be6-6b329b93bdd9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:24.534793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0da25aac-e7c8-406a-9be6-6b329b93bdd9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:24.542426 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0da25aac-e7c8-406a-9be6-6b329b93bdd9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1687 microversion: 2.1 time: 0.159049 Jul 14 15:41:24.542997 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3651/7267] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:24 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:25.561403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-182934bd-de07-443d-b3b3-88e2b11e6594 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:25.562170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-182934bd-de07-443d-b3b3-88e2b11e6594 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:25.569099 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-182934bd-de07-443d-b3b3-88e2b11e6594 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:25.569554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-182934bd-de07-443d-b3b3-88e2b11e6594 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:25.570339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-182934bd-de07-443d-b3b3-88e2b11e6594 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:25.570778 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-182934bd-de07-443d-b3b3-88e2b11e6594 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:25.702408 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-182934bd-de07-443d-b3b3-88e2b11e6594 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:25.709978 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-182934bd-de07-443d-b3b3-88e2b11e6594 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1687 microversion: 2.1 time: 0.152433 Jul 14 15:41:25.710556 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3617/7268] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:25 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:26.732819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6816b47e-adf8-4db3-b095-94d02c1bd37a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:26.733793 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6816b47e-adf8-4db3-b095-94d02c1bd37a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:26.741212 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6816b47e-adf8-4db3-b095-94d02c1bd37a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:26.741965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6816b47e-adf8-4db3-b095-94d02c1bd37a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:26.742965 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6816b47e-adf8-4db3-b095-94d02c1bd37a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:26.743494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6816b47e-adf8-4db3-b095-94d02c1bd37a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:26.814069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6816b47e-adf8-4db3-b095-94d02c1bd37a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:26.824420 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6816b47e-adf8-4db3-b095-94d02c1bd37a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 200 len: 1620 microversion: 2.1 time: 0.100365 Jul 14 15:41:26.825443 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3652/7269] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:26 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 1620 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:26.856462 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-876e2351-f012-4442-b3aa-fac26f1dc44f req-5721cd8f-2212-41ad-897d-8e7e5caf9c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e51551-6c0b-4194-a811-94ce72b29df5", "name": "network-vif-deleted", "tag": "d58e932d-e304-4e6f-aca9-25e4f419537d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:26.865334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-876e2351-f012-4442-b3aa-fac26f1dc44f req-5721cd8f-2212-41ad-897d-8e7e5caf9c16 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:26.865795 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-876e2351-f012-4442-b3aa-fac26f1dc44f req-5721cd8f-2212-41ad-897d-8e7e5caf9c16 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:26.879614 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-876e2351-f012-4442-b3aa-fac26f1dc44f req-5721cd8f-2212-41ad-897d-8e7e5caf9c16 service nova] Creating event network-vif-deleted:d58e932d-e304-4e6f-aca9-25e4f419537d for instance d7e51551-6c0b-4194-a811-94ce72b29df5 on n-h1-767704-28 Jul 14 15:41:26.885778 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-876e2351-f012-4442-b3aa-fac26f1dc44f req-5721cd8f-2212-41ad-897d-8e7e5caf9c16 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093580 Jul 14 15:41:26.886882 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3618/7270] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:41:27.845341 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a6043ef8-93c8-426f-9fe0-c9f41c89410f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:27.845897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a6043ef8-93c8-426f-9fe0-c9f41c89410f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: d7e51551-6c0b-4194-a811-94ce72b29df5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:27.852844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6043ef8-93c8-426f-9fe0-c9f41c89410f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:27.853363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6043ef8-93c8-426f-9fe0-c9f41c89410f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:27.854147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6043ef8-93c8-426f-9fe0-c9f41c89410f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:27.854604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6043ef8-93c8-426f-9fe0-c9f41c89410f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:27.869300 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-a6043ef8-93c8-426f-9fe0-c9f41c89410f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] HTTP exception thrown: Instance d7e51551-6c0b-4194-a811-94ce72b29df5 could not be found. Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a6043ef8-93c8-426f-9fe0-c9f41c89410f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Request method failure captured: Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 HTTP/1.1 Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DhCepsiUWzN2OBwVX62tUnpeM1pyuIHDeIvNigBeq67uN5XhDOMg_x_ZuIPETSWUT5YFW5LI1dL28GnGHCKqpBDIC9rM5qpCdbuGSc-8EcEdMoNXXJMpjprGKmuRcOOLKJ7kZYCzuJ7RPBJBMt-ss4WG-LmoDsWpBE8-dCFT4MyCzg Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 0ded8733e086447782856661597d52f0 Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0ded8733e086447782856661597d52f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0ded8733e086447782856661597d52f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0ded8733e086447782856661597d52f0", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0ded8733e086447782856661597d52f0"}]}] Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 0ded8733e086447782856661597d52f0 Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestNetworkAdvancedServerOps-1565740765-project Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 65b6268287b54c8d8a9fda65c04f278b Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1565740765-project Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance d7e51551-6c0b-4194-a811-94ce72b29df5 could not be found. Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'd7e51551-6c0b-4194-a811-94ce72b29df5'} Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e51551-6c0b-4194-a811-94ce72b29df5 could not be found. Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e51551-6c0b-4194-a811-94ce72b29df5 could not be found. Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:41:27.871252 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:41:27.876177 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:41:27.876177 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:41:27.876177 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:41:27.876177 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:41:27.876177 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:41:27.876177 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:41:27.876177 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e51551-6c0b-4194-a811-94ce72b29df5 could not be found. Jul 14 15:41:27.876177 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:41:27.876177 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a6043ef8-93c8-426f-9fe0-c9f41c89410f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Returning 404 to user: Instance d7e51551-6c0b-4194-a811-94ce72b29df5 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:41:27.876177 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a6043ef8-93c8-426f-9fe0-c9f41c89410f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5" status: 404 len: 111 microversion: 2.1 time: 0.032456 Jul 14 15:41:27.876177 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3653/7271] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:27 2022] GET /compute/v2.1/servers/d7e51551-6c0b-4194-a811-94ce72b29df5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:41:31.156303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d1c8c28-cb47-4934-a605-d080d57db4e8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '.version_select at 0x7fd6c463b160>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:31.182787 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8d1c8c28-cb47-4934-a605-d080d57db4e8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2023394346" status: 202 len: 0 microversion: 2.1 time: 0.031600 Jul 14 15:41:31.183479 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3619/7272] 10.222.0.81 () {58 vars in 1283 bytes} [Thu Jul 14 15:41:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2023394346 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:41:31.208351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4fd061ef-0582-40e7-9641-fdef19b1f2e1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'create', calling method: .version_select at 0x7fd6c4e0a310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2088333161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRyI2ZBg5VZC6QqxkCl0HgQROxRli83KUizYrU7MA6bft/MSe38dtBtEORfB6VsQZtbGnujgxcIsgFxPJ4k9fjmPpICkWUs2n6+gD1A7wii5DN8ki174HkSPE8co8Y2xg=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:31.226840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4fd061ef-0582-40e7-9641-fdef19b1f2e1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for project 0ded8733e086447782856661597d52f0. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:41:31.232993 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4fd061ef-0582-40e7-9641-fdef19b1f2e1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for user 65b6268287b54c8d8a9fda65c04f278b and project 0ded8733e086447782856661597d52f0. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:41:31.247031 n-d-767704-28 devstack@n-api.service[119512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4fd061ef-0582-40e7-9641-fdef19b1f2e1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [f429ae4b-6107-4dd5-a3e1-bb32c73ed5eb] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:41:32.255207 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [None req-4fd061ef-0582-40e7-9641-fdef19b1f2e1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [f429ae4b-6107-4dd5-a3e1-bb32c73ed5eb] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 55050. Jul 14 15:41:32.271165 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4fd061ef-0582-40e7-9641-fdef19b1f2e1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.067418 Jul 14 15:41:32.271772 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3654/7273] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:41:31 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:37.757447 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1384026728", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "806c4846-5004-413c-a9ad-3aff40906695"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2088333161", "security_groups": [{"name": "tempest-secgroup-smoke-1779385342"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:37.766773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=16 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:37.876709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] validate_networks() for [('806c4846-5004-413c-a9ad-3aff40906695', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:41:38.612368 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:41:38.612805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:41:38.613321 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:41:38.613740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:41:38.614651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:41:38.624938 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:38.625514 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:38.626496 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:38.626953 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:38.646853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for project 0ded8733e086447782856661597d52f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:41:38.652451 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for user 65b6268287b54c8d8a9fda65c04f278b and project 0ded8733e086447782856661597d52f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:41:38.666457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:41:38.669175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:41:38.721222 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b413e3b2-12f1-4407-bb40-63c85a89871b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.967611 Jul 14 15:41:38.722474 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3620/7274] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:41:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:41:38.730279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:38.735091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a0577a6d-0057-4aa3-aa1b-1fc908a39127 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:38.735964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a0577a6d-0057-4aa3-aa1b-1fc908a39127 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:38.850135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a0577a6d-0057-4aa3-aa1b-1fc908a39127 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:38.871335 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a0577a6d-0057-4aa3-aa1b-1fc908a39127 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1267 microversion: 2.1 time: 0.142713 Jul 14 15:41:38.877677 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3655/7275] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:38 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:39.889194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0c5ac547-d5e0-444f-9edb-02381db78f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:39.889898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0c5ac547-d5e0-444f-9edb-02381db78f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:39.898329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c5ac547-d5e0-444f-9edb-02381db78f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:39.898793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c5ac547-d5e0-444f-9edb-02381db78f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:39.899569 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c5ac547-d5e0-444f-9edb-02381db78f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:39.900231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0c5ac547-d5e0-444f-9edb-02381db78f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:39.973135 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0c5ac547-d5e0-444f-9edb-02381db78f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:39.981079 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0c5ac547-d5e0-444f-9edb-02381db78f63 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1319 microversion: 2.1 time: 0.096024 Jul 14 15:41:39.981867 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3621/7276] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:39 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1319 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:41.001285 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-62667e3b-6d4b-42be-9665-e6698391c2c5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:41.003852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-62667e3b-6d4b-42be-9665-e6698391c2c5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:41.013757 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62667e3b-6d4b-42be-9665-e6698391c2c5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:41.014236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62667e3b-6d4b-42be-9665-e6698391c2c5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:41.015271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62667e3b-6d4b-42be-9665-e6698391c2c5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:41.015878 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-62667e3b-6d4b-42be-9665-e6698391c2c5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:41.246404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-62667e3b-6d4b-42be-9665-e6698391c2c5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:41.257747 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-62667e3b-6d4b-42be-9665-e6698391c2c5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1393 microversion: 2.1 time: 0.261733 Jul 14 15:41:41.258683 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3656/7277] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:40 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1393 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:41.909013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-f7dd2833-58da-448c-87d0-e5fdee0e75d0 req-9eed54ec-74fe-4a70-ad14-e7ab5b8682b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33cb43f0-caee-4453-8f52-898ea36ca1d7", "tag": "844c9d36-9718-470a-bcc6-a6ada0dd4ba6"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:41.918546 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f7dd2833-58da-448c-87d0-e5fdee0e75d0 req-9eed54ec-74fe-4a70-ad14-e7ab5b8682b6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:41.919240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-f7dd2833-58da-448c-87d0-e5fdee0e75d0 req-9eed54ec-74fe-4a70-ad14-e7ab5b8682b6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:41.933277 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-f7dd2833-58da-448c-87d0-e5fdee0e75d0 req-9eed54ec-74fe-4a70-ad14-e7ab5b8682b6 service nova] Creating event network-changed:844c9d36-9718-470a-bcc6-a6ada0dd4ba6 for instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 on n-h1-767704-28 Jul 14 15:41:41.938577 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-f7dd2833-58da-448c-87d0-e5fdee0e75d0 req-9eed54ec-74fe-4a70-ad14-e7ab5b8682b6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033236 Jul 14 15:41:41.939224 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3622/7278] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:42.276615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5ef43c3d-2323-4d44-994c-3c4efd31a530 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:42.277427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5ef43c3d-2323-4d44-994c-3c4efd31a530 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:42.284765 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ef43c3d-2323-4d44-994c-3c4efd31a530 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:42.285320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ef43c3d-2323-4d44-994c-3c4efd31a530 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:42.286156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ef43c3d-2323-4d44-994c-3c4efd31a530 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:42.286685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5ef43c3d-2323-4d44-994c-3c4efd31a530 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:42.487329 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5ef43c3d-2323-4d44-994c-3c4efd31a530 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:42.496456 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5ef43c3d-2323-4d44-994c-3c4efd31a530 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1393 microversion: 2.1 time: 0.223795 Jul 14 15:41:42.497061 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3657/7279] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:42 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1393 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:43.516898 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ef400c4-42a1-46dd-af26-efa2a8df06e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:43.517784 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8ef400c4-42a1-46dd-af26-efa2a8df06e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:43.524326 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ef400c4-42a1-46dd-af26-efa2a8df06e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:43.524790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ef400c4-42a1-46dd-af26-efa2a8df06e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:43.525597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ef400c4-42a1-46dd-af26-efa2a8df06e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:43.526047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ef400c4-42a1-46dd-af26-efa2a8df06e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:43.661034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8ef400c4-42a1-46dd-af26-efa2a8df06e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:43.668548 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8ef400c4-42a1-46dd-af26-efa2a8df06e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1393 microversion: 2.1 time: 0.157419 Jul 14 15:41:43.669154 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3623/7280] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:43 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:44.686116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-94d20f1f-618b-47eb-baf3-708511633529 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:44.686748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-94d20f1f-618b-47eb-baf3-708511633529 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:44.694437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94d20f1f-618b-47eb-baf3-708511633529 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:44.694905 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94d20f1f-618b-47eb-baf3-708511633529 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:44.695693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94d20f1f-618b-47eb-baf3-708511633529 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:44.696150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94d20f1f-618b-47eb-baf3-708511633529 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:44.833819 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-94d20f1f-618b-47eb-baf3-708511633529 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:44.841731 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-94d20f1f-618b-47eb-baf3-708511633529 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1393 microversion: 2.1 time: 0.159464 Jul 14 15:41:44.842331 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3658/7281] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:44 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:45.859843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0544995d-b0d0-4b08-af46-75417f338b07 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:45.861311 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0544995d-b0d0-4b08-af46-75417f338b07 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:45.868068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0544995d-b0d0-4b08-af46-75417f338b07 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:45.868537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0544995d-b0d0-4b08-af46-75417f338b07 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:45.869354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0544995d-b0d0-4b08-af46-75417f338b07 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:45.870168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0544995d-b0d0-4b08-af46-75417f338b07 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:46.012485 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0544995d-b0d0-4b08-af46-75417f338b07 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:46.021996 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0544995d-b0d0-4b08-af46-75417f338b07 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1393 microversion: 2.1 time: 0.166167 Jul 14 15:41:46.022584 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3624/7282] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:45 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:46.328873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-124f2388-787e-4d37-bca2-1c34566e3467 req-19a31d9f-df8c-459d-9ace-b765b44d8bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cb43f0-caee-4453-8f52-898ea36ca1d7", "name": "network-vif-plugged", "status": "completed", "tag": "844c9d36-9718-470a-bcc6-a6ada0dd4ba6"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:46.338150 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-124f2388-787e-4d37-bca2-1c34566e3467 req-19a31d9f-df8c-459d-9ace-b765b44d8bb3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:46.338602 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-124f2388-787e-4d37-bca2-1c34566e3467 req-19a31d9f-df8c-459d-9ace-b765b44d8bb3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:46.350448 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-124f2388-787e-4d37-bca2-1c34566e3467 req-19a31d9f-df8c-459d-9ace-b765b44d8bb3 service nova] Creating event network-vif-plugged:844c9d36-9718-470a-bcc6-a6ada0dd4ba6 for instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 on n-h1-767704-28 Jul 14 15:41:46.355921 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-124f2388-787e-4d37-bca2-1c34566e3467 req-19a31d9f-df8c-459d-9ace-b765b44d8bb3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090279 Jul 14 15:41:46.356511 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3659/7283] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:47.039473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-17bab7dc-4457-409c-8118-c573bb97b76c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:47.040082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-17bab7dc-4457-409c-8118-c573bb97b76c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:47.047056 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17bab7dc-4457-409c-8118-c573bb97b76c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:47.047508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17bab7dc-4457-409c-8118-c573bb97b76c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:47.048816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17bab7dc-4457-409c-8118-c573bb97b76c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:47.049282 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-17bab7dc-4457-409c-8118-c573bb97b76c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:47.179207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-17bab7dc-4457-409c-8118-c573bb97b76c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:47.186652 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-17bab7dc-4457-409c-8118-c573bb97b76c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1393 microversion: 2.1 time: 0.151031 Jul 14 15:41:47.187220 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3625/7284] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:47 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:48.207110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-bfb4bfa1-4c7f-4fc5-bff6-bb11a83a9a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:48.208100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-bfb4bfa1-4c7f-4fc5-bff6-bb11a83a9a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:48.215562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfb4bfa1-4c7f-4fc5-bff6-bb11a83a9a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:48.216038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfb4bfa1-4c7f-4fc5-bff6-bb11a83a9a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:48.216837 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfb4bfa1-4c7f-4fc5-bff6-bb11a83a9a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:48.217326 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-bfb4bfa1-4c7f-4fc5-bff6-bb11a83a9a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:48.366550 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-bfb4bfa1-4c7f-4fc5-bff6-bb11a83a9a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:48.374110 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-bfb4bfa1-4c7f-4fc5-bff6-bb11a83a9a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1393 microversion: 2.1 time: 0.174162 Jul 14 15:41:48.374688 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3660/7285] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:48 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:49.035718 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:41:49.036002 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:41:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:41:49.392420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a54d2a4e-6f25-4f25-8d1f-c1eb9854b75c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:49.393348 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a54d2a4e-6f25-4f25-8d1f-c1eb9854b75c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:49.396131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:49.396929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:49.402717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a54d2a4e-6f25-4f25-8d1f-c1eb9854b75c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:49.403177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a54d2a4e-6f25-4f25-8d1f-c1eb9854b75c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:49.403958 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a54d2a4e-6f25-4f25-8d1f-c1eb9854b75c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:49.404405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a54d2a4e-6f25-4f25-8d1f-c1eb9854b75c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:49.537299 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a54d2a4e-6f25-4f25-8d1f-c1eb9854b75c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:49.544836 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a54d2a4e-6f25-4f25-8d1f-c1eb9854b75c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1565 microversion: 2.1 time: 0.157002 Jul 14 15:41:49.545447 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3626/7286] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:49 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:49.561049 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4fc5b3ee-579c-4be5-958c-fb4fa19e0b2c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:49.561687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4fc5b3ee-579c-4be5-958c-fb4fa19e0b2c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:49.564268 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:49.570605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fc5b3ee-579c-4be5-958c-fb4fa19e0b2c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:49.571084 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fc5b3ee-579c-4be5-958c-fb4fa19e0b2c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:49.571872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fc5b3ee-579c-4be5-958c-fb4fa19e0b2c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:49.572335 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4fc5b3ee-579c-4be5-958c-fb4fa19e0b2c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:49.708241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4fc5b3ee-579c-4be5-958c-fb4fa19e0b2c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:49.715948 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4fc5b3ee-579c-4be5-958c-fb4fa19e0b2c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1565 microversion: 2.1 time: 0.158770 Jul 14 15:41:49.716510 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3661/7287] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:49 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:51.290548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-60dff723-f423-410e-80e2-b7289ed957c0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:51.291168 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-60dff723-f423-410e-80e2-b7289ed957c0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:51.292982 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-bfaee482-c7ae-4da1-aa21-a8fb9a6fead0 req-65d83c97-e379-4d53-b20f-0356153ac9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33cb43f0-caee-4453-8f52-898ea36ca1d7", "tag": "844c9d36-9718-470a-bcc6-a6ada0dd4ba6"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:51.298307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60dff723-f423-410e-80e2-b7289ed957c0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:51.298984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60dff723-f423-410e-80e2-b7289ed957c0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:51.299535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60dff723-f423-410e-80e2-b7289ed957c0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:51.299977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-60dff723-f423-410e-80e2-b7289ed957c0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:51.302543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bfaee482-c7ae-4da1-aa21-a8fb9a6fead0 req-65d83c97-e379-4d53-b20f-0356153ac9f4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:51.303017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bfaee482-c7ae-4da1-aa21-a8fb9a6fead0 req-65d83c97-e379-4d53-b20f-0356153ac9f4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:51.314564 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-bfaee482-c7ae-4da1-aa21-a8fb9a6fead0 req-65d83c97-e379-4d53-b20f-0356153ac9f4 service nova] Creating event network-changed:844c9d36-9718-470a-bcc6-a6ada0dd4ba6 for instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 on n-h1-767704-28 Jul 14 15:41:51.319677 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-bfaee482-c7ae-4da1-aa21-a8fb9a6fead0 req-65d83c97-e379-4d53-b20f-0356153ac9f4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030298 Jul 14 15:41:51.320521 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3662/7288] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:41:51.476713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-60dff723-f423-410e-80e2-b7289ed957c0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:51.485541 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-60dff723-f423-410e-80e2-b7289ed957c0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1565 microversion: 2.1 time: 0.198800 Jul 14 15:41:51.486530 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3627/7289] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:51 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1565 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:42:30.789373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:30.790139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=34 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:30.795323 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f6af09d8-d9e6-4cf3-8e93-bd6c33142811 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:42:30.796704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f6af09d8-d9e6-4cf3-8e93-bd6c33142811 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:30.804939 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6af09d8-d9e6-4cf3-8e93-bd6c33142811 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:30.805448 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6af09d8-d9e6-4cf3-8e93-bd6c33142811 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:30.806238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6af09d8-d9e6-4cf3-8e93-bd6c33142811 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:30.806690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f6af09d8-d9e6-4cf3-8e93-bd6c33142811 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:30.894445 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f6af09d8-d9e6-4cf3-8e93-bd6c33142811 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7/action" status: 200 len: 24563 microversion: 2.1 time: 0.107050 Jul 14 15:42:30.895881 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3663/7290] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:42:30 2022] POST /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7/action => generated 24563 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:42:47.551079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:47.551838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=40 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:47.600371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:42:47.601432 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:47.607600 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:47.608069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:47.608849 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:47.609325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:47.693516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:47.700025 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Old instance type m1.heat2, new instance type m1.heat {{(pid=119511) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:42:47.707088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:42:47.707516 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:42:47.707996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:42:47.708412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:42:47.708839 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:42:47.773699 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-f4274bf8-7097-4e21-9c5a-5a4e65b40e85 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7/action" status: 202 len: 0 microversion: 2.1 time: 0.227857 Jul 14 15:42:47.774546 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3628/7291] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:42:47 2022] POST /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:42:47.783221 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1b689aeb-9471-4719-aa08-2666ddb5a69d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:47.784665 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1b689aeb-9471-4719-aa08-2666ddb5a69d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:47.788141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:47.788892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:47.793669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b689aeb-9471-4719-aa08-2666ddb5a69d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:47.794195 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b689aeb-9471-4719-aa08-2666ddb5a69d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:47.794947 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b689aeb-9471-4719-aa08-2666ddb5a69d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:47.795491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1b689aeb-9471-4719-aa08-2666ddb5a69d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:47.946869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1b689aeb-9471-4719-aa08-2666ddb5a69d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:47.955099 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1b689aeb-9471-4719-aa08-2666ddb5a69d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1693 microversion: 2.1 time: 0.176280 Jul 14 15:42:47.956239 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3664/7292] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:47 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:42:48.975445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3b756446-56c1-4997-a396-4fb623041729 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:48.976065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3b756446-56c1-4997-a396-4fb623041729 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:48.982875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b756446-56c1-4997-a396-4fb623041729 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:48.983332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b756446-56c1-4997-a396-4fb623041729 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:48.984107 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b756446-56c1-4997-a396-4fb623041729 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:48.984551 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b756446-56c1-4997-a396-4fb623041729 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:49.115682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3b756446-56c1-4997-a396-4fb623041729 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:49.123312 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3b756446-56c1-4997-a396-4fb623041729 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1693 microversion: 2.1 time: 0.154153 Jul 14 15:42:49.123883 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3629/7293] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:48 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:42:50.141128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dad92288-a462-43ba-8b9a-bd857b477084 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:50.142014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dad92288-a462-43ba-8b9a-bd857b477084 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:50.152888 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dad92288-a462-43ba-8b9a-bd857b477084 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:50.153503 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dad92288-a462-43ba-8b9a-bd857b477084 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:50.154245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dad92288-a462-43ba-8b9a-bd857b477084 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:50.154730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dad92288-a462-43ba-8b9a-bd857b477084 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:50.290517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dad92288-a462-43ba-8b9a-bd857b477084 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:50.298224 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dad92288-a462-43ba-8b9a-bd857b477084 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.161063 Jul 14 15:42:50.298810 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3665/7294] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:50 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:42:51.316178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-98adea4c-f5d3-4dbe-a697-67a4333fa19a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:51.316791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-98adea4c-f5d3-4dbe-a697-67a4333fa19a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:51.323746 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98adea4c-f5d3-4dbe-a697-67a4333fa19a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:51.324200 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98adea4c-f5d3-4dbe-a697-67a4333fa19a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:51.324981 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98adea4c-f5d3-4dbe-a697-67a4333fa19a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:51.325420 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-98adea4c-f5d3-4dbe-a697-67a4333fa19a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:51.457480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-98adea4c-f5d3-4dbe-a697-67a4333fa19a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:51.464904 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-98adea4c-f5d3-4dbe-a697-67a4333fa19a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.153155 Jul 14 15:42:51.465502 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3630/7295] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:51 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:42:52.483182 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-656ea2d2-f6d9-4f1c-9e28-abcd4d352235 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:52.483831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-656ea2d2-f6d9-4f1c-9e28-abcd4d352235 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:52.491664 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-656ea2d2-f6d9-4f1c-9e28-abcd4d352235 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:52.492144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-656ea2d2-f6d9-4f1c-9e28-abcd4d352235 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:52.492961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-656ea2d2-f6d9-4f1c-9e28-abcd4d352235 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:52.493430 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-656ea2d2-f6d9-4f1c-9e28-abcd4d352235 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:52.629418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-656ea2d2-f6d9-4f1c-9e28-abcd4d352235 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:52.637041 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-656ea2d2-f6d9-4f1c-9e28-abcd4d352235 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.157754 Jul 14 15:42:52.637618 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3666/7296] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:52 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:42:53.653678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-edc2fab6-a538-44d4-ac0c-4fd43fe6e331 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:53.654277 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-edc2fab6-a538-44d4-ac0c-4fd43fe6e331 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:53.661364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-edc2fab6-a538-44d4-ac0c-4fd43fe6e331 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:53.661820 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-edc2fab6-a538-44d4-ac0c-4fd43fe6e331 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:53.662583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-edc2fab6-a538-44d4-ac0c-4fd43fe6e331 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:53.663021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-edc2fab6-a538-44d4-ac0c-4fd43fe6e331 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:53.797295 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-edc2fab6-a538-44d4-ac0c-4fd43fe6e331 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:53.805976 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-edc2fab6-a538-44d4-ac0c-4fd43fe6e331 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.156168 Jul 14 15:42:53.806557 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3631/7297] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:53 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:42:54.823564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-804bca90-b7bf-4e1e-9b92-28746ff85519 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:54.824197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-804bca90-b7bf-4e1e-9b92-28746ff85519 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:54.831343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-804bca90-b7bf-4e1e-9b92-28746ff85519 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:54.832425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-804bca90-b7bf-4e1e-9b92-28746ff85519 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:54.833263 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-804bca90-b7bf-4e1e-9b92-28746ff85519 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:54.833724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-804bca90-b7bf-4e1e-9b92-28746ff85519 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:54.963929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-804bca90-b7bf-4e1e-9b92-28746ff85519 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:54.971635 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-804bca90-b7bf-4e1e-9b92-28746ff85519 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.151959 Jul 14 15:42:54.972209 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3667/7298] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:54 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:42:55.989384 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d8900171-c601-41b5-ab41-35be49efb5b3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:55.990005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d8900171-c601-41b5-ab41-35be49efb5b3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:55.996903 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8900171-c601-41b5-ab41-35be49efb5b3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:55.997394 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8900171-c601-41b5-ab41-35be49efb5b3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:55.998164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8900171-c601-41b5-ab41-35be49efb5b3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:55.998608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d8900171-c601-41b5-ab41-35be49efb5b3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:56.135673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d8900171-c601-41b5-ab41-35be49efb5b3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:56.143397 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d8900171-c601-41b5-ab41-35be49efb5b3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.158674 Jul 14 15:42:56.143969 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3632/7299] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:55 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:42:57.160873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-49dd0de3-4da2-45f5-bb06-7bf5a6a911b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:57.161499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-49dd0de3-4da2-45f5-bb06-7bf5a6a911b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:57.168399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49dd0de3-4da2-45f5-bb06-7bf5a6a911b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:57.168915 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49dd0de3-4da2-45f5-bb06-7bf5a6a911b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:57.169735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49dd0de3-4da2-45f5-bb06-7bf5a6a911b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:57.170192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-49dd0de3-4da2-45f5-bb06-7bf5a6a911b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:57.306566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-49dd0de3-4da2-45f5-bb06-7bf5a6a911b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:57.314555 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-49dd0de3-4da2-45f5-bb06-7bf5a6a911b9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.158029 Jul 14 15:42:57.315134 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3668/7300] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:57 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:42:58.333534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e7ff633b-9415-46a8-a078-3f0057ce9ade tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:58.334155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e7ff633b-9415-46a8-a078-3f0057ce9ade tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:58.340776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7ff633b-9415-46a8-a078-3f0057ce9ade tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:58.341260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7ff633b-9415-46a8-a078-3f0057ce9ade tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:58.342028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7ff633b-9415-46a8-a078-3f0057ce9ade tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:58.342467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e7ff633b-9415-46a8-a078-3f0057ce9ade tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:58.478950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e7ff633b-9415-46a8-a078-3f0057ce9ade tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:58.486441 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e7ff633b-9415-46a8-a078-3f0057ce9ade tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.157652 Jul 14 15:42:58.487019 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3633/7301] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:58 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:42:59.503714 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d70a2e19-6c30-49c5-976b-29bc6e85013b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:59.504346 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d70a2e19-6c30-49c5-976b-29bc6e85013b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:59.511384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d70a2e19-6c30-49c5-976b-29bc6e85013b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:59.511851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d70a2e19-6c30-49c5-976b-29bc6e85013b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:59.512630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d70a2e19-6c30-49c5-976b-29bc6e85013b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:59.513116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d70a2e19-6c30-49c5-976b-29bc6e85013b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:59.642373 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d70a2e19-6c30-49c5-976b-29bc6e85013b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:59.652175 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d70a2e19-6c30-49c5-976b-29bc6e85013b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.152432 Jul 14 15:42:59.652764 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3669/7302] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:59 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:00.669940 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6ef40c05-d469-46f8-9fbb-765dabacf24c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:00.670552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6ef40c05-d469-46f8-9fbb-765dabacf24c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:00.678419 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ef40c05-d469-46f8-9fbb-765dabacf24c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:00.678875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ef40c05-d469-46f8-9fbb-765dabacf24c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:00.679641 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ef40c05-d469-46f8-9fbb-765dabacf24c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:00.680084 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6ef40c05-d469-46f8-9fbb-765dabacf24c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:00.811269 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6ef40c05-d469-46f8-9fbb-765dabacf24c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:00.818893 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6ef40c05-d469-46f8-9fbb-765dabacf24c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.152892 Jul 14 15:43:00.819472 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3634/7303] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:00 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:01.836836 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1abca4ee-df17-45bc-8c45-ce2d74530b00 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:01.837498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1abca4ee-df17-45bc-8c45-ce2d74530b00 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:01.844538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1abca4ee-df17-45bc-8c45-ce2d74530b00 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:01.845032 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1abca4ee-df17-45bc-8c45-ce2d74530b00 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:01.845813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1abca4ee-df17-45bc-8c45-ce2d74530b00 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:01.846262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1abca4ee-df17-45bc-8c45-ce2d74530b00 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:01.986205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1abca4ee-df17-45bc-8c45-ce2d74530b00 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:01.994795 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1abca4ee-df17-45bc-8c45-ce2d74530b00 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.161926 Jul 14 15:43:01.995375 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3670/7304] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:01 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:03.012544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-24a01dd2-8fe8-4964-a9ce-f06405449d5e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:03.013202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-24a01dd2-8fe8-4964-a9ce-f06405449d5e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:03.021436 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24a01dd2-8fe8-4964-a9ce-f06405449d5e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:03.021894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24a01dd2-8fe8-4964-a9ce-f06405449d5e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:03.022673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24a01dd2-8fe8-4964-a9ce-f06405449d5e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:03.023120 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-24a01dd2-8fe8-4964-a9ce-f06405449d5e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:03.154888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-24a01dd2-8fe8-4964-a9ce-f06405449d5e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:03.162464 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-24a01dd2-8fe8-4964-a9ce-f06405449d5e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.153835 Jul 14 15:43:03.163046 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3635/7305] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:03 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:04.182494 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3ca7a53a-2873-48e0-ab6b-7422edb30c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:04.183035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3ca7a53a-2873-48e0-ab6b-7422edb30c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:04.190011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ca7a53a-2873-48e0-ab6b-7422edb30c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:04.190537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ca7a53a-2873-48e0-ab6b-7422edb30c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:04.191470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ca7a53a-2873-48e0-ab6b-7422edb30c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:04.191926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3ca7a53a-2873-48e0-ab6b-7422edb30c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:04.327191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3ca7a53a-2873-48e0-ab6b-7422edb30c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:04.335840 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3ca7a53a-2873-48e0-ab6b-7422edb30c01 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.157368 Jul 14 15:43:04.336423 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3671/7306] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:04 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:05.353563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8dcbdfd3-ad5a-4b28-a4d9-494ca4d3a6c6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:05.354184 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8dcbdfd3-ad5a-4b28-a4d9-494ca4d3a6c6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:05.361229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dcbdfd3-ad5a-4b28-a4d9-494ca4d3a6c6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:05.361687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dcbdfd3-ad5a-4b28-a4d9-494ca4d3a6c6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:05.362935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dcbdfd3-ad5a-4b28-a4d9-494ca4d3a6c6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:05.363175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8dcbdfd3-ad5a-4b28-a4d9-494ca4d3a6c6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:05.809313 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8dcbdfd3-ad5a-4b28-a4d9-494ca4d3a6c6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:05.817145 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8dcbdfd3-ad5a-4b28-a4d9-494ca4d3a6c6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.467654 Jul 14 15:43:05.817722 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3636/7307] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:05 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:06.834277 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b6165f5-ad59-4b1b-a8d9-ab711c2fb138 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:06.834890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b6165f5-ad59-4b1b-a8d9-ab711c2fb138 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:06.841758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b6165f5-ad59-4b1b-a8d9-ab711c2fb138 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:06.842220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b6165f5-ad59-4b1b-a8d9-ab711c2fb138 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:06.842990 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b6165f5-ad59-4b1b-a8d9-ab711c2fb138 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:06.843439 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b6165f5-ad59-4b1b-a8d9-ab711c2fb138 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:06.977872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2b6165f5-ad59-4b1b-a8d9-ab711c2fb138 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:06.985510 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b6165f5-ad59-4b1b-a8d9-ab711c2fb138 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1698 microversion: 2.1 time: 0.155155 Jul 14 15:43:06.986089 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3672/7308] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:06 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:08.003962 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-120c9dc2-5839-4baf-bdf2-4d00f7b1383c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:08.004497 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-120c9dc2-5839-4baf-bdf2-4d00f7b1383c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:08.011450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-120c9dc2-5839-4baf-bdf2-4d00f7b1383c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:08.011934 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-120c9dc2-5839-4baf-bdf2-4d00f7b1383c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:08.012762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-120c9dc2-5839-4baf-bdf2-4d00f7b1383c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:08.013316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-120c9dc2-5839-4baf-bdf2-4d00f7b1383c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:08.147345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-120c9dc2-5839-4baf-bdf2-4d00f7b1383c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:08.158003 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-120c9dc2-5839-4baf-bdf2-4d00f7b1383c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1697 microversion: 2.1 time: 0.157787 Jul 14 15:43:08.160046 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3637/7309] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:07 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:08.749604 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-4f2d6e84-b2e2-459d-87aa-c619dcfa9f77 req-3bf45a46-07ee-436a-9933-2b0c6ad7c36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cb43f0-caee-4453-8f52-898ea36ca1d7", "name": "network-vif-unplugged", "status": "completed", "tag": "844c9d36-9718-470a-bcc6-a6ada0dd4ba6"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:08.760019 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4f2d6e84-b2e2-459d-87aa-c619dcfa9f77 req-3bf45a46-07ee-436a-9933-2b0c6ad7c36d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:08.760654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-4f2d6e84-b2e2-459d-87aa-c619dcfa9f77 req-3bf45a46-07ee-436a-9933-2b0c6ad7c36d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:08.774317 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-4f2d6e84-b2e2-459d-87aa-c619dcfa9f77 req-3bf45a46-07ee-436a-9933-2b0c6ad7c36d service nova] Creating event network-vif-unplugged:844c9d36-9718-470a-bcc6-a6ada0dd4ba6 for instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 on n-h2-767704-28 Jul 14 15:43:08.780559 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [req-4f2d6e84-b2e2-459d-87aa-c619dcfa9f77 req-3bf45a46-07ee-436a-9933-2b0c6ad7c36d service nova] Instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119512) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:43:08.793261 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-4f2d6e84-b2e2-459d-87aa-c619dcfa9f77 req-3bf45a46-07ee-436a-9933-2b0c6ad7c36d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047188 Jul 14 15:43:08.793836 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3673/7310] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:43:09.178812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ffc2930d-6ddb-465e-97e6-fdeaf1429029 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:09.179609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ffc2930d-6ddb-465e-97e6-fdeaf1429029 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:09.186883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffc2930d-6ddb-465e-97e6-fdeaf1429029 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:09.187345 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffc2930d-6ddb-465e-97e6-fdeaf1429029 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:09.188137 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffc2930d-6ddb-465e-97e6-fdeaf1429029 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:09.188580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ffc2930d-6ddb-465e-97e6-fdeaf1429029 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:09.355707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ffc2930d-6ddb-465e-97e6-fdeaf1429029 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:09.364051 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ffc2930d-6ddb-465e-97e6-fdeaf1429029 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1697 microversion: 2.1 time: 0.190117 Jul 14 15:43:09.364990 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3638/7311] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:09 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:10.382417 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6ff5edcb-0b58-4027-91d2-7c49e958d111 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:10.383073 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6ff5edcb-0b58-4027-91d2-7c49e958d111 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:10.389349 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ff5edcb-0b58-4027-91d2-7c49e958d111 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:10.389814 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ff5edcb-0b58-4027-91d2-7c49e958d111 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:10.390593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ff5edcb-0b58-4027-91d2-7c49e958d111 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:10.391039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6ff5edcb-0b58-4027-91d2-7c49e958d111 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:10.523907 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6ff5edcb-0b58-4027-91d2-7c49e958d111 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:10.531492 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6ff5edcb-0b58-4027-91d2-7c49e958d111 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1695 microversion: 2.1 time: 0.154523 Jul 14 15:43:10.532075 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3674/7312] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:10 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:10.825984 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-cf08ca37-e82a-46f3-ac27-e04a3f4b3c78 req-6d09ceb2-2ad8-430a-91ee-afc9c0793ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33cb43f0-caee-4453-8f52-898ea36ca1d7", "tag": "844c9d36-9718-470a-bcc6-a6ada0dd4ba6"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:10.835811 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cf08ca37-e82a-46f3-ac27-e04a3f4b3c78 req-6d09ceb2-2ad8-430a-91ee-afc9c0793ea3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:10.836261 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-cf08ca37-e82a-46f3-ac27-e04a3f4b3c78 req-6d09ceb2-2ad8-430a-91ee-afc9c0793ea3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:10.847690 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-cf08ca37-e82a-46f3-ac27-e04a3f4b3c78 req-6d09ceb2-2ad8-430a-91ee-afc9c0793ea3 service nova] Creating event network-changed:844c9d36-9718-470a-bcc6-a6ada0dd4ba6 for instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 on n-h2-767704-28 Jul 14 15:43:10.853059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [req-cf08ca37-e82a-46f3-ac27-e04a3f4b3c78 req-6d09ceb2-2ad8-430a-91ee-afc9c0793ea3 service nova] Instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-767704-28', 'n-h1-767704-28'} {{(pid=119511) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:43:10.863848 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-cf08ca37-e82a-46f3-ac27-e04a3f4b3c78 req-6d09ceb2-2ad8-430a-91ee-afc9c0793ea3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041552 Jul 14 15:43:10.864451 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3639/7313] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:43:11.550384 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e57c6da1-c12e-4d51-b023-195b519b3c38 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:11.551026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e57c6da1-c12e-4d51-b023-195b519b3c38 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:11.558165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e57c6da1-c12e-4d51-b023-195b519b3c38 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:11.558641 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e57c6da1-c12e-4d51-b023-195b519b3c38 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:11.559433 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e57c6da1-c12e-4d51-b023-195b519b3c38 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:11.559897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e57c6da1-c12e-4d51-b023-195b519b3c38 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:11.691844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e57c6da1-c12e-4d51-b023-195b519b3c38 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:11.699467 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e57c6da1-c12e-4d51-b023-195b519b3c38 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1695 microversion: 2.1 time: 0.153707 Jul 14 15:43:11.700037 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3675/7314] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:11 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:12.719177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dd3aff8f-6698-4504-ac17-e90ff9bbe6e7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:12.719878 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dd3aff8f-6698-4504-ac17-e90ff9bbe6e7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:12.726766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd3aff8f-6698-4504-ac17-e90ff9bbe6e7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:12.727215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd3aff8f-6698-4504-ac17-e90ff9bbe6e7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:12.727977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd3aff8f-6698-4504-ac17-e90ff9bbe6e7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:12.728412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dd3aff8f-6698-4504-ac17-e90ff9bbe6e7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:12.869116 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dd3aff8f-6698-4504-ac17-e90ff9bbe6e7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:12.876769 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dd3aff8f-6698-4504-ac17-e90ff9bbe6e7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1692 microversion: 2.1 time: 0.163204 Jul 14 15:43:12.877396 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3640/7315] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:12 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:12.894441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7325fea9-d2cc-4063-b178-219880773280 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:12.895046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7325fea9-d2cc-4063-b178-219880773280 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:12.902090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7325fea9-d2cc-4063-b178-219880773280 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:12.902558 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7325fea9-d2cc-4063-b178-219880773280 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:12.903348 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7325fea9-d2cc-4063-b178-219880773280 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:12.903803 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7325fea9-d2cc-4063-b178-219880773280 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:12.961071 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7325fea9-d2cc-4063-b178-219880773280 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7/action" status: 204 len: 0 microversion: 2.1 time: 0.071170 Jul 14 15:43:12.962054 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3676/7316] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:43:12 2022] POST /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:43:12.970189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8f7b2e52-6d32-49ea-8158-3c0dcabdee6e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:12.970719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8f7b2e52-6d32-49ea-8158-3c0dcabdee6e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:12.977862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f7b2e52-6d32-49ea-8158-3c0dcabdee6e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:12.978555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f7b2e52-6d32-49ea-8158-3c0dcabdee6e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:12.979338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f7b2e52-6d32-49ea-8158-3c0dcabdee6e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:12.979812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8f7b2e52-6d32-49ea-8158-3c0dcabdee6e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:13.180222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8f7b2e52-6d32-49ea-8158-3c0dcabdee6e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:13.188217 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8f7b2e52-6d32-49ea-8158-3c0dcabdee6e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1692 microversion: 2.1 time: 0.222098 Jul 14 15:43:13.188808 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3641/7317] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:12 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1692 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:13.205255 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-730ac01e-5880-4c12-b119-737f2613e762 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:13.206594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-730ac01e-5880-4c12-b119-737f2613e762 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:13.213205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-730ac01e-5880-4c12-b119-737f2613e762 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:13.213678 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-730ac01e-5880-4c12-b119-737f2613e762 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:13.214460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-730ac01e-5880-4c12-b119-737f2613e762 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:13.214918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-730ac01e-5880-4c12-b119-737f2613e762 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:13.442443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-730ac01e-5880-4c12-b119-737f2613e762 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:13.450196 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-730ac01e-5880-4c12-b119-737f2613e762 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1692 microversion: 2.1 time: 0.249417 Jul 14 15:43:13.450780 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3677/7318] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:13 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1692 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:43:14.468495 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b4d980f2-9959-46a5-b7dd-c74b98806766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:14.469023 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b4d980f2-9959-46a5-b7dd-c74b98806766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:14.475996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4d980f2-9959-46a5-b7dd-c74b98806766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:14.476456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4d980f2-9959-46a5-b7dd-c74b98806766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:14.477260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4d980f2-9959-46a5-b7dd-c74b98806766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:14.477703 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b4d980f2-9959-46a5-b7dd-c74b98806766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:14.619916 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b4d980f2-9959-46a5-b7dd-c74b98806766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:14.628052 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b4d980f2-9959-46a5-b7dd-c74b98806766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1684 microversion: 2.1 time: 0.163250 Jul 14 15:43:14.628630 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3642/7319] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:14 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:15.779542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-34e9756c-def2-4994-af43-d581057a1657 req-f2c3cdd9-e108-46b4-8c7d-03ce684b8b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cb43f0-caee-4453-8f52-898ea36ca1d7", "name": "network-vif-plugged", "status": "completed", "tag": "844c9d36-9718-470a-bcc6-a6ada0dd4ba6"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:15.789218 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-34e9756c-def2-4994-af43-d581057a1657 req-f2c3cdd9-e108-46b4-8c7d-03ce684b8b57 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:15.789692 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-34e9756c-def2-4994-af43-d581057a1657 req-f2c3cdd9-e108-46b4-8c7d-03ce684b8b57 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:15.801377 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-34e9756c-def2-4994-af43-d581057a1657 req-f2c3cdd9-e108-46b4-8c7d-03ce684b8b57 service nova] Creating event network-vif-plugged:844c9d36-9718-470a-bcc6-a6ada0dd4ba6 for instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 on n-h2-767704-28 Jul 14 15:43:15.806391 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-34e9756c-def2-4994-af43-d581057a1657 req-f2c3cdd9-e108-46b4-8c7d-03ce684b8b57 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030510 Jul 14 15:43:15.807011 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3678/7320] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:43:32.083114 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:43:32.083793 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 15:43:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:43:40.822973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-647adae1-ca7c-4cfe-a4c8-a44f06071f9a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:40.823947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-647adae1-ca7c-4cfe-a4c8-a44f06071f9a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:40.826349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=34 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:40.827152 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:40.833952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-647adae1-ca7c-4cfe-a4c8-a44f06071f9a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:40.834421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-647adae1-ca7c-4cfe-a4c8-a44f06071f9a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:40.835204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-647adae1-ca7c-4cfe-a4c8-a44f06071f9a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:40.835653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-647adae1-ca7c-4cfe-a4c8-a44f06071f9a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:40.887767 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-647adae1-ca7c-4cfe-a4c8-a44f06071f9a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7/action" status: 200 len: 24562 microversion: 2.1 time: 0.068827 Jul 14 15:43:40.888409 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3643/7321] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:43:40 2022] POST /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7/action => generated 24562 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:48.119893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=30 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:48.121000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:48.125702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-649f4eb0-d24a-4dc8-87c0-6e9e317bc199 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:48.125972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a3e6a6a8-f6a3-4494-9d9b-ec97c58d13fc req-1b74622b-4fc4-43c5-a9f5-b15c4ceca778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33cb43f0-caee-4453-8f52-898ea36ca1d7", "tag": "844c9d36-9718-470a-bcc6-a6ada0dd4ba6"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:48.126387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-649f4eb0-d24a-4dc8-87c0-6e9e317bc199 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:48.135537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-649f4eb0-d24a-4dc8-87c0-6e9e317bc199 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:48.135537 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-649f4eb0-d24a-4dc8-87c0-6e9e317bc199 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:48.135859 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a3e6a6a8-f6a3-4494-9d9b-ec97c58d13fc req-1b74622b-4fc4-43c5-a9f5-b15c4ceca778 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:48.136317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-649f4eb0-d24a-4dc8-87c0-6e9e317bc199 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:48.136564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a3e6a6a8-f6a3-4494-9d9b-ec97c58d13fc req-1b74622b-4fc4-43c5-a9f5-b15c4ceca778 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:48.136771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-649f4eb0-d24a-4dc8-87c0-6e9e317bc199 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:48.150264 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a3e6a6a8-f6a3-4494-9d9b-ec97c58d13fc req-1b74622b-4fc4-43c5-a9f5-b15c4ceca778 service nova] Creating event network-changed:844c9d36-9718-470a-bcc6-a6ada0dd4ba6 for instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 on n-h2-767704-28 Jul 14 15:43:48.156216 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a3e6a6a8-f6a3-4494-9d9b-ec97c58d13fc req-1b74622b-4fc4-43c5-a9f5-b15c4ceca778 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035829 Jul 14 15:43:48.157626 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3644/7322] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:43:48.169101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-649f4eb0-d24a-4dc8-87c0-6e9e317bc199 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:43:48.269623 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-649f4eb0-d24a-4dc8-87c0-6e9e317bc199 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "DELETE /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 204 len: 0 microversion: 2.1 time: 0.151427 Jul 14 15:43:48.273014 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3679/7323] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:43:48 2022] DELETE /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:43:48.280626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-de05c3bf-6a69-4897-a2d1-552499821da3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:48.281654 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-de05c3bf-6a69-4897-a2d1-552499821da3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:48.289463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de05c3bf-6a69-4897-a2d1-552499821da3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:48.290262 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de05c3bf-6a69-4897-a2d1-552499821da3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:48.291373 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de05c3bf-6a69-4897-a2d1-552499821da3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:48.291997 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de05c3bf-6a69-4897-a2d1-552499821da3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:48.438677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-de05c3bf-6a69-4897-a2d1-552499821da3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:48.446955 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-de05c3bf-6a69-4897-a2d1-552499821da3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1690 microversion: 2.1 time: 0.171433 Jul 14 15:43:48.447535 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3645/7324] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:48 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:49.465880 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-71e45798-1df1-4ef9-9daa-b73178f0725c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:49.466632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-71e45798-1df1-4ef9-9daa-b73178f0725c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:49.474008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71e45798-1df1-4ef9-9daa-b73178f0725c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:49.474473 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71e45798-1df1-4ef9-9daa-b73178f0725c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:49.475275 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71e45798-1df1-4ef9-9daa-b73178f0725c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:49.475747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71e45798-1df1-4ef9-9daa-b73178f0725c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:49.611984 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-71e45798-1df1-4ef9-9daa-b73178f0725c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:49.620216 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-71e45798-1df1-4ef9-9daa-b73178f0725c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1690 microversion: 2.1 time: 0.158623 Jul 14 15:43:49.620781 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3680/7325] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:49 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:50.292243 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a7e653a1-f776-4499-b72a-397ec31e9cd5 req-c92f3690-00dc-4468-9d9d-b78770cc40cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cb43f0-caee-4453-8f52-898ea36ca1d7", "name": "network-vif-deleted", "tag": "844c9d36-9718-470a-bcc6-a6ada0dd4ba6"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:50.301556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a7e653a1-f776-4499-b72a-397ec31e9cd5 req-c92f3690-00dc-4468-9d9d-b78770cc40cf service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:50.301830 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a7e653a1-f776-4499-b72a-397ec31e9cd5 req-c92f3690-00dc-4468-9d9d-b78770cc40cf service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:50.313038 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a7e653a1-f776-4499-b72a-397ec31e9cd5 req-c92f3690-00dc-4468-9d9d-b78770cc40cf service nova] Creating event network-vif-deleted:844c9d36-9718-470a-bcc6-a6ada0dd4ba6 for instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 on n-h2-767704-28 Jul 14 15:43:50.318398 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a7e653a1-f776-4499-b72a-397ec31e9cd5 req-c92f3690-00dc-4468-9d9d-b78770cc40cf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029759 Jul 14 15:43:50.319073 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3646/7326] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:43:50.638206 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-42f9e8dd-bd2f-48a1-92c1-b346127a54be tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:50.638828 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-42f9e8dd-bd2f-48a1-92c1-b346127a54be tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:50.647458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42f9e8dd-bd2f-48a1-92c1-b346127a54be tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:50.647924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42f9e8dd-bd2f-48a1-92c1-b346127a54be tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:50.648717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42f9e8dd-bd2f-48a1-92c1-b346127a54be tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:50.649260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42f9e8dd-bd2f-48a1-92c1-b346127a54be tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:50.682113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42f9e8dd-bd2f-48a1-92c1-b346127a54be tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:50.682913 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-42f9e8dd-bd2f-48a1-92c1-b346127a54be tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:50.683039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-42f9e8dd-bd2f-48a1-92c1-b346127a54be tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lazy-loading 'fault' on Instance uuid 33cb43f0-caee-4453-8f52-898ea36ca1d7 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:43:50.730107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-42f9e8dd-bd2f-48a1-92c1-b346127a54be tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:50.737921 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-42f9e8dd-bd2f-48a1-92c1-b346127a54be tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 200 len: 1357 microversion: 2.1 time: 0.103569 Jul 14 15:43:50.738608 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3681/7327] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:50 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:51.758071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f4e5aa9-b263-431e-a29b-e8ad289d1fcc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:51.758809 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3f4e5aa9-b263-431e-a29b-e8ad289d1fcc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 33cb43f0-caee-4453-8f52-898ea36ca1d7] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:51.765206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f4e5aa9-b263-431e-a29b-e8ad289d1fcc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:51.765922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f4e5aa9-b263-431e-a29b-e8ad289d1fcc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:51.766763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f4e5aa9-b263-431e-a29b-e8ad289d1fcc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:51.767205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3f4e5aa9-b263-431e-a29b-e8ad289d1fcc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:51.784867 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-3f4e5aa9-b263-431e-a29b-e8ad289d1fcc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] HTTP exception thrown: Instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 could not be found. Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f4e5aa9-b263-431e-a29b-e8ad289d1fcc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Request method failure captured: Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 HTTP/1.1 Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DhCepsiUWzN2OBwVX62tUnpeM1pyuIHDeIvNigBeq67uN5XhDOMg_x_ZuIPETSWUT5YFW5LI1dL28GnGHCKqpBDIC9rM5qpCdbuGSc-8EcEdMoNXXJMpjprGKmuRcOOLKJ7kZYCzuJ7RPBJBMt-ss4WG-LmoDsWpBE8-dCFT4MyCzg Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 0ded8733e086447782856661597d52f0 Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0ded8733e086447782856661597d52f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0ded8733e086447782856661597d52f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0ded8733e086447782856661597d52f0", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0ded8733e086447782856661597d52f0"}]}] Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 0ded8733e086447782856661597d52f0 Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestNetworkAdvancedServerOps-1565740765-project Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 65b6268287b54c8d8a9fda65c04f278b Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1565740765-project Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 could not be found. Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '33cb43f0-caee-4453-8f52-898ea36ca1d7'} Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 could not be found. Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 could not be found. Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:43:51.786904 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:43:51.791360 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:43:51.791360 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:51.791360 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:43:51.791360 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:43:51.791360 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:43:51.791360 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:43:51.791360 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 could not be found. Jul 14 15:43:51.791360 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:43:51.791360 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3f4e5aa9-b263-431e-a29b-e8ad289d1fcc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Returning 404 to user: Instance 33cb43f0-caee-4453-8f52-898ea36ca1d7 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:43:51.791360 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3f4e5aa9-b263-431e-a29b-e8ad289d1fcc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7" status: 404 len: 111 microversion: 2.1 time: 0.036460 Jul 14 15:43:51.791360 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3647/7328] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:51 2022] GET /compute/v2.1/servers/33cb43f0-caee-4453-8f52-898ea36ca1d7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:43:55.098283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6c872190-50ca-430a-8ab2-473ac491ed12 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '.version_select at 0x7fd6c4ce2ca0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:55.118139 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6c872190-50ca-430a-8ab2-473ac491ed12 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2088333161" status: 202 len: 0 microversion: 2.1 time: 0.023822 Jul 14 15:43:55.118975 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3682/7329] 10.222.0.81 () {58 vars in 1283 bytes} [Thu Jul 14 15:43:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2088333161 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:43:55.142286 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c88e420a-ebec-4e01-85a1-c824d3a81739 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'create', calling method: .version_select at 0x7fd6c432b160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1620911275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDGj8PdAa5pMlrCxGX7UEvS6knRbngPzCj/CG7rpUbhE6C6v89/x4X3B1L2IB93QuZwuVVlyTF6kRQW9hKbYqFdGzek82nbHptliXwoSY2BOvmAVsO9G86TMLdhk+3YGg=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:55.162194 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-c88e420a-ebec-4e01-85a1-c824d3a81739 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for project 0ded8733e086447782856661597d52f0. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:43:55.167493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-c88e420a-ebec-4e01-85a1-c824d3a81739 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for user 65b6268287b54c8d8a9fda65c04f278b and project 0ded8733e086447782856661597d52f0. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:43:55.195361 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c88e420a-ebec-4e01-85a1-c824d3a81739 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057240 Jul 14 15:43:55.195984 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3648/7330] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:43:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:44:00.748070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1906144664", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "9f91fee3-73aa-4b4f-b04f-e60863f95af1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1620911275", "security_groups": [{"name": "tempest-secgroup-smoke-1609350398"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:00.758551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:00.879372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] validate_networks() for [('9f91fee3-73aa-4b4f-b04f-e60863f95af1', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:44:01.400114 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:44:01.401056 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:44:01.401621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:44:01.402160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:44:01.402666 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:44:01.412874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:01.413672 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:01.414717 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:01.415552 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:01.435699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for project 0ded8733e086447782856661597d52f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:44:01.444233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for user 65b6268287b54c8d8a9fda65c04f278b and project 0ded8733e086447782856661597d52f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:44:01.460310 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:44:01.463147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:44:01.519105 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2bf85960-e2de-4313-ab49-a105ce7c8f4e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.788433 Jul 14 15:44:01.520775 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3683/7331] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:44:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:44:01.532349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6897f184-5bd6-44f6-9538-4e45c9e2dd5e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:01.534013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6897f184-5bd6-44f6-9538-4e45c9e2dd5e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:01.603998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6897f184-5bd6-44f6-9538-4e45c9e2dd5e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:01.611478 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6897f184-5bd6-44f6-9538-4e45c9e2dd5e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1267 microversion: 2.1 time: 0.085005 Jul 14 15:44:01.613515 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3649/7332] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:01 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:02.629720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-68ba7ecb-53b9-4e23-8033-b55f7ec6b48b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:02.631039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-68ba7ecb-53b9-4e23-8033-b55f7ec6b48b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:02.639842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68ba7ecb-53b9-4e23-8033-b55f7ec6b48b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:02.641118 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68ba7ecb-53b9-4e23-8033-b55f7ec6b48b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:02.642419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68ba7ecb-53b9-4e23-8033-b55f7ec6b48b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:02.644425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-68ba7ecb-53b9-4e23-8033-b55f7ec6b48b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:02.719165 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-68ba7ecb-53b9-4e23-8033-b55f7ec6b48b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:02.730962 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-68ba7ecb-53b9-4e23-8033-b55f7ec6b48b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1319 microversion: 2.1 time: 0.105679 Jul 14 15:44:02.731563 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3684/7333] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:02 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1319 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:03.751207 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-20255edf-6d09-412b-9a9f-c494ce164079 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:03.751789 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-20255edf-6d09-412b-9a9f-c494ce164079 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:03.756098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=16 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:03.762999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20255edf-6d09-412b-9a9f-c494ce164079 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:03.763842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20255edf-6d09-412b-9a9f-c494ce164079 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:03.764875 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20255edf-6d09-412b-9a9f-c494ce164079 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:03.766018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-20255edf-6d09-412b-9a9f-c494ce164079 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:04.023996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-20255edf-6d09-412b-9a9f-c494ce164079 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:04.032375 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-20255edf-6d09-412b-9a9f-c494ce164079 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1393 microversion: 2.1 time: 0.287435 Jul 14 15:44:04.033742 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3650/7334] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:03 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1393 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:04.498142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-05c9e891-5507-4e8b-aa02-d65862aca1ad req-e4baebf4-0444-423a-b974-627f5875db70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d2dbc7-a4d1-448d-b826-2f6a49a01c62", "tag": "7efcac4d-6a15-4e9d-98f4-7a0ebbb624bb"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:04.509308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-05c9e891-5507-4e8b-aa02-d65862aca1ad req-e4baebf4-0444-423a-b974-627f5875db70 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:04.510320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-05c9e891-5507-4e8b-aa02-d65862aca1ad req-e4baebf4-0444-423a-b974-627f5875db70 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:04.526757 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-05c9e891-5507-4e8b-aa02-d65862aca1ad req-e4baebf4-0444-423a-b974-627f5875db70 service nova] Creating event network-changed:7efcac4d-6a15-4e9d-98f4-7a0ebbb624bb for instance 24d2dbc7-a4d1-448d-b826-2f6a49a01c62 on n-h1-767704-28 Jul 14 15:44:04.531666 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-05c9e891-5507-4e8b-aa02-d65862aca1ad req-e4baebf4-0444-423a-b974-627f5875db70 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037266 Jul 14 15:44:04.532338 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3685/7335] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:44:05.051918 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c0e366ef-dbaf-4b77-a83d-393de18cdce1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:05.053503 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c0e366ef-dbaf-4b77-a83d-393de18cdce1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:05.061115 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0e366ef-dbaf-4b77-a83d-393de18cdce1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:05.061589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0e366ef-dbaf-4b77-a83d-393de18cdce1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:05.062391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0e366ef-dbaf-4b77-a83d-393de18cdce1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:05.063089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c0e366ef-dbaf-4b77-a83d-393de18cdce1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:05.202223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c0e366ef-dbaf-4b77-a83d-393de18cdce1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:05.210060 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c0e366ef-dbaf-4b77-a83d-393de18cdce1 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1393 microversion: 2.1 time: 0.162959 Jul 14 15:44:05.210636 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3651/7336] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:05 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:06.228374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-11f71421-0417-4cad-9e34-23c5cb9a9426 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:06.229124 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-11f71421-0417-4cad-9e34-23c5cb9a9426 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:06.235489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11f71421-0417-4cad-9e34-23c5cb9a9426 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.235960 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11f71421-0417-4cad-9e34-23c5cb9a9426 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.236743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11f71421-0417-4cad-9e34-23c5cb9a9426 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.237233 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-11f71421-0417-4cad-9e34-23c5cb9a9426 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.427815 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-11f71421-0417-4cad-9e34-23c5cb9a9426 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:06.435409 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-11f71421-0417-4cad-9e34-23c5cb9a9426 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1393 microversion: 2.1 time: 0.212232 Jul 14 15:44:06.435988 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3686/7337] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:06 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1393 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:07.453629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-821faacb-497b-4cef-af40-005d9ec5b4a7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:07.454478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-821faacb-497b-4cef-af40-005d9ec5b4a7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:07.461942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-821faacb-497b-4cef-af40-005d9ec5b4a7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:07.462430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-821faacb-497b-4cef-af40-005d9ec5b4a7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:07.463221 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-821faacb-497b-4cef-af40-005d9ec5b4a7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:07.463660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-821faacb-497b-4cef-af40-005d9ec5b4a7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:07.602333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-821faacb-497b-4cef-af40-005d9ec5b4a7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:07.609876 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-821faacb-497b-4cef-af40-005d9ec5b4a7 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1393 microversion: 2.1 time: 0.160229 Jul 14 15:44:07.610458 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3652/7338] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:07 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:08.626628 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-01f5f953-a3fc-4d3e-9989-4db151671bf6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:08.627282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-01f5f953-a3fc-4d3e-9989-4db151671bf6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:08.634908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01f5f953-a3fc-4d3e-9989-4db151671bf6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:08.635372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01f5f953-a3fc-4d3e-9989-4db151671bf6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:08.636149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01f5f953-a3fc-4d3e-9989-4db151671bf6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:08.636598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-01f5f953-a3fc-4d3e-9989-4db151671bf6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:08.767158 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-01f5f953-a3fc-4d3e-9989-4db151671bf6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:08.775285 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-01f5f953-a3fc-4d3e-9989-4db151671bf6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1393 microversion: 2.1 time: 0.152555 Jul 14 15:44:08.775859 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3687/7339] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:08 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:09.792195 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be094692-b629-4d3e-8925-f7d63c75305f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:09.792763 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-be094692-b629-4d3e-8925-f7d63c75305f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:09.799729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be094692-b629-4d3e-8925-f7d63c75305f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:09.800793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be094692-b629-4d3e-8925-f7d63c75305f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:09.801605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be094692-b629-4d3e-8925-f7d63c75305f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:09.802053 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be094692-b629-4d3e-8925-f7d63c75305f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:09.933324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-be094692-b629-4d3e-8925-f7d63c75305f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:09.940917 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-be094692-b629-4d3e-8925-f7d63c75305f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1393 microversion: 2.1 time: 0.152729 Jul 14 15:44:09.941540 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3653/7340] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:09 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:10.958669 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-436bbaf4-6734-4fe5-9b80-eab97ae6692a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:10.959447 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-436bbaf4-6734-4fe5-9b80-eab97ae6692a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:10.966622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-436bbaf4-6734-4fe5-9b80-eab97ae6692a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:10.967350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-436bbaf4-6734-4fe5-9b80-eab97ae6692a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:10.968160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-436bbaf4-6734-4fe5-9b80-eab97ae6692a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:10.968625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-436bbaf4-6734-4fe5-9b80-eab97ae6692a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:11.013279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d982936a-41fb-49f9-9c55-6129bd8dce01 req-b25940ef-e980-47c5-be6e-aa2facc815dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d2dbc7-a4d1-448d-b826-2f6a49a01c62", "name": "network-vif-plugged", "status": "completed", "tag": "7efcac4d-6a15-4e9d-98f4-7a0ebbb624bb"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:11.024189 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:11.033016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d982936a-41fb-49f9-9c55-6129bd8dce01 req-b25940ef-e980-47c5-be6e-aa2facc815dc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:11.033761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d982936a-41fb-49f9-9c55-6129bd8dce01 req-b25940ef-e980-47c5-be6e-aa2facc815dc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:11.047857 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d982936a-41fb-49f9-9c55-6129bd8dce01 req-b25940ef-e980-47c5-be6e-aa2facc815dc service nova] Creating event network-vif-plugged:7efcac4d-6a15-4e9d-98f4-7a0ebbb624bb for instance 24d2dbc7-a4d1-448d-b826-2f6a49a01c62 on n-h1-767704-28 Jul 14 15:44:11.062334 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d982936a-41fb-49f9-9c55-6129bd8dce01 req-b25940ef-e980-47c5-be6e-aa2facc815dc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051356 Jul 14 15:44:11.063436 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3654/7341] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:44:11.139605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-436bbaf4-6734-4fe5-9b80-eab97ae6692a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:11.149444 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-436bbaf4-6734-4fe5-9b80-eab97ae6692a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1393 microversion: 2.1 time: 0.195259 Jul 14 15:44:11.150145 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3688/7342] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:10 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1393 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:12.163883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:12.168804 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8d3de015-b0e0-40b6-8a85-aec1ee720b80 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:12.169542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8d3de015-b0e0-40b6-8a85-aec1ee720b80 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:12.177446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d3de015-b0e0-40b6-8a85-aec1ee720b80 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:12.177909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d3de015-b0e0-40b6-8a85-aec1ee720b80 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:12.179171 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d3de015-b0e0-40b6-8a85-aec1ee720b80 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:12.179983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8d3de015-b0e0-40b6-8a85-aec1ee720b80 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:12.322275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8d3de015-b0e0-40b6-8a85-aec1ee720b80 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:12.329868 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8d3de015-b0e0-40b6-8a85-aec1ee720b80 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1393 microversion: 2.1 time: 0.167008 Jul 14 15:44:12.330453 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3655/7343] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:12 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:13.346904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-81e467be-2f18-4567-9e0a-cadf12b2955e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:13.347638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-81e467be-2f18-4567-9e0a-cadf12b2955e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:13.349690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:13.350518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:13.357271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81e467be-2f18-4567-9e0a-cadf12b2955e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:13.357748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81e467be-2f18-4567-9e0a-cadf12b2955e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:13.358532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81e467be-2f18-4567-9e0a-cadf12b2955e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:13.358999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81e467be-2f18-4567-9e0a-cadf12b2955e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:13.493704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-81e467be-2f18-4567-9e0a-cadf12b2955e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:13.501283 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-81e467be-2f18-4567-9e0a-cadf12b2955e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1565 microversion: 2.1 time: 0.158342 Jul 14 15:44:13.501863 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3689/7344] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:13 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:13.518201 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-99a8e90e-05dd-4b90-898a-e098ce5d898a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:13.519352 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-99a8e90e-05dd-4b90-898a-e098ce5d898a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:13.526021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99a8e90e-05dd-4b90-898a-e098ce5d898a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:13.526481 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99a8e90e-05dd-4b90-898a-e098ce5d898a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:13.527256 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99a8e90e-05dd-4b90-898a-e098ce5d898a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:13.527834 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-99a8e90e-05dd-4b90-898a-e098ce5d898a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:13.662405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-99a8e90e-05dd-4b90-898a-e098ce5d898a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:13.670014 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-99a8e90e-05dd-4b90-898a-e098ce5d898a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1565 microversion: 2.1 time: 0.156074 Jul 14 15:44:13.670588 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3656/7345] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:13 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:15.538472 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ac09c864-e545-42fa-a26f-5df46046c974 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:15.539101 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ac09c864-e545-42fa-a26f-5df46046c974 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:15.541142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-1443e07a-352c-49ce-8cf5-9007fddab725 req-74752cfa-bc6f-42b4-8fb1-d5750a0b15c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d2dbc7-a4d1-448d-b826-2f6a49a01c62", "tag": "7efcac4d-6a15-4e9d-98f4-7a0ebbb624bb"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:15.546339 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac09c864-e545-42fa-a26f-5df46046c974 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:15.547060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac09c864-e545-42fa-a26f-5df46046c974 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:15.547851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac09c864-e545-42fa-a26f-5df46046c974 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:15.548391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ac09c864-e545-42fa-a26f-5df46046c974 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:15.551143 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1443e07a-352c-49ce-8cf5-9007fddab725 req-74752cfa-bc6f-42b4-8fb1-d5750a0b15c4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:15.551607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-1443e07a-352c-49ce-8cf5-9007fddab725 req-74752cfa-bc6f-42b4-8fb1-d5750a0b15c4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:15.562979 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-1443e07a-352c-49ce-8cf5-9007fddab725 req-74752cfa-bc6f-42b4-8fb1-d5750a0b15c4 service nova] Creating event network-changed:7efcac4d-6a15-4e9d-98f4-7a0ebbb624bb for instance 24d2dbc7-a4d1-448d-b826-2f6a49a01c62 on n-h1-767704-28 Jul 14 15:44:15.568993 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-1443e07a-352c-49ce-8cf5-9007fddab725 req-74752cfa-bc6f-42b4-8fb1-d5750a0b15c4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031994 Jul 14 15:44:15.569967 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3657/7346] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:44:15.751858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ac09c864-e545-42fa-a26f-5df46046c974 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:15.760939 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ac09c864-e545-42fa-a26f-5df46046c974 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1565 microversion: 2.1 time: 0.226964 Jul 14 15:44:15.772969 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3690/7347] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:15 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1565 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:45.049723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=7 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:45.050472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=40 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:45.054726 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ff6d5a7d-f212-45c1-acef-90e878f91254 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:45.055758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ff6d5a7d-f212-45c1-acef-90e878f91254 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:45.062799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff6d5a7d-f212-45c1-acef-90e878f91254 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:45.063257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff6d5a7d-f212-45c1-acef-90e878f91254 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:45.064029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff6d5a7d-f212-45c1-acef-90e878f91254 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:45.064475 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ff6d5a7d-f212-45c1-acef-90e878f91254 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:45.133758 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ff6d5a7d-f212-45c1-acef-90e878f91254 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62/action" status: 200 len: 24571 microversion: 2.1 time: 0.085900 Jul 14 15:44:45.134459 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3658/7348] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:44:45 2022] POST /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62/action => generated 24571 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:56.296307 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1cbb625e-0d19-4fa8-8533-2c96a1a02716 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:56.298756 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:56.299572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=40 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:56.305904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cbb625e-0d19-4fa8-8533-2c96a1a02716 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:56.306378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1cbb625e-0d19-4fa8-8533-2c96a1a02716 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:56.332402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1cbb625e-0d19-4fa8-8533-2c96a1a02716 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Going to try to stop instance {{(pid=119512) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 15:44:56.373464 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1cbb625e-0d19-4fa8-8533-2c96a1a02716 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62/action" status: 202 len: 0 microversion: 2.1 time: 0.083481 Jul 14 15:44:56.374124 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3691/7349] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:44:56 2022] POST /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:44:56.383592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9c71ef22-38f1-444f-8d43-759935715437 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:56.384304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9c71ef22-38f1-444f-8d43-759935715437 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:56.387488 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:56.388151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:56.394289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c71ef22-38f1-444f-8d43-759935715437 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:56.394753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c71ef22-38f1-444f-8d43-759935715437 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:56.395753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c71ef22-38f1-444f-8d43-759935715437 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:56.396188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9c71ef22-38f1-444f-8d43-759935715437 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:56.531449 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9c71ef22-38f1-444f-8d43-759935715437 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:56.539940 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9c71ef22-38f1-444f-8d43-759935715437 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1693 microversion: 2.1 time: 0.161368 Jul 14 15:44:56.540525 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3659/7350] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:56 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:57.559515 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2e21eb3b-86eb-4f53-8572-5566b7f6c17a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:57.560154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2e21eb3b-86eb-4f53-8572-5566b7f6c17a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:57.566441 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e21eb3b-86eb-4f53-8572-5566b7f6c17a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:57.567440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e21eb3b-86eb-4f53-8572-5566b7f6c17a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:57.568223 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e21eb3b-86eb-4f53-8572-5566b7f6c17a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:57.568674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e21eb3b-86eb-4f53-8572-5566b7f6c17a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:57.707301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2e21eb3b-86eb-4f53-8572-5566b7f6c17a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:57.715256 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2e21eb3b-86eb-4f53-8572-5566b7f6c17a tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1693 microversion: 2.1 time: 0.161087 Jul 14 15:44:57.715837 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3692/7351] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:57 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:58.731547 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a8f154f8-5f6f-42f5-a4bd-00d0ffc01026 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:58.732159 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a8f154f8-5f6f-42f5-a4bd-00d0ffc01026 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:58.739167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8f154f8-5f6f-42f5-a4bd-00d0ffc01026 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:58.739624 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8f154f8-5f6f-42f5-a4bd-00d0ffc01026 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:58.740391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8f154f8-5f6f-42f5-a4bd-00d0ffc01026 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:58.740832 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a8f154f8-5f6f-42f5-a4bd-00d0ffc01026 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:58.875026 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a8f154f8-5f6f-42f5-a4bd-00d0ffc01026 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:58.885612 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a8f154f8-5f6f-42f5-a4bd-00d0ffc01026 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1693 microversion: 2.1 time: 0.157967 Jul 14 15:44:58.886200 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3660/7352] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:58 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:59.903162 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9c688519-6203-4ca4-83a2-f202d2de152f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:59.904192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9c688519-6203-4ca4-83a2-f202d2de152f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:59.911390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9c688519-6203-4ca4-83a2-f202d2de152f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:59.911863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9c688519-6203-4ca4-83a2-f202d2de152f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:59.912659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9c688519-6203-4ca4-83a2-f202d2de152f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:59.913161 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9c688519-6203-4ca4-83a2-f202d2de152f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:00.046129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9c688519-6203-4ca4-83a2-f202d2de152f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:00.058299 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9c688519-6203-4ca4-83a2-f202d2de152f tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1693 microversion: 2.1 time: 0.158569 Jul 14 15:45:00.059208 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3693/7353] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:59 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:01.079118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9a02a30c-1fa9-4712-bc7b-4b55fb0233e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:01.079731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9a02a30c-1fa9-4712-bc7b-4b55fb0233e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:01.086802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a02a30c-1fa9-4712-bc7b-4b55fb0233e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:01.087275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a02a30c-1fa9-4712-bc7b-4b55fb0233e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:01.088029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a02a30c-1fa9-4712-bc7b-4b55fb0233e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:01.088473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9a02a30c-1fa9-4712-bc7b-4b55fb0233e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:01.233271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9a02a30c-1fa9-4712-bc7b-4b55fb0233e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:01.241706 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9a02a30c-1fa9-4712-bc7b-4b55fb0233e6 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1693 microversion: 2.1 time: 0.166571 Jul 14 15:45:01.242283 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3661/7354] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:01 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:02.260105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cb83e16a-f47c-4a4e-9f26-d7697f1363a2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:02.260739 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cb83e16a-f47c-4a4e-9f26-d7697f1363a2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:02.268249 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb83e16a-f47c-4a4e-9f26-d7697f1363a2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:02.268723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb83e16a-f47c-4a4e-9f26-d7697f1363a2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:02.269547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb83e16a-f47c-4a4e-9f26-d7697f1363a2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:02.270584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cb83e16a-f47c-4a4e-9f26-d7697f1363a2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:02.409660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cb83e16a-f47c-4a4e-9f26-d7697f1363a2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:02.418145 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cb83e16a-f47c-4a4e-9f26-d7697f1363a2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1693 microversion: 2.1 time: 0.161922 Jul 14 15:45:02.418724 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3694/7355] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:02 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:03.437124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-78929f22-f794-4446-9c10-9a30a5b99755 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:03.437671 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-78929f22-f794-4446-9c10-9a30a5b99755 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:03.445679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78929f22-f794-4446-9c10-9a30a5b99755 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:03.446145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78929f22-f794-4446-9c10-9a30a5b99755 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:03.446928 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78929f22-f794-4446-9c10-9a30a5b99755 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:03.447370 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78929f22-f794-4446-9c10-9a30a5b99755 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:03.588853 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-78929f22-f794-4446-9c10-9a30a5b99755 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:03.596375 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-78929f22-f794-4446-9c10-9a30a5b99755 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1693 microversion: 2.1 time: 0.165268 Jul 14 15:45:03.596970 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3662/7356] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:03 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:04.615636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ae606612-4beb-48ff-9afe-b64d9efa1739 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:04.616303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ae606612-4beb-48ff-9afe-b64d9efa1739 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:04.623338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae606612-4beb-48ff-9afe-b64d9efa1739 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.623816 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae606612-4beb-48ff-9afe-b64d9efa1739 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.624612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae606612-4beb-48ff-9afe-b64d9efa1739 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.625111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ae606612-4beb-48ff-9afe-b64d9efa1739 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.757350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ae606612-4beb-48ff-9afe-b64d9efa1739 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:04.765132 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ae606612-4beb-48ff-9afe-b64d9efa1739 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1693 microversion: 2.1 time: 0.153818 Jul 14 15:45:04.765706 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3695/7357] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:04 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:05.782298 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-52b66fdf-7d7e-4ed2-b117-a5460e78d66d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:05.782917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-52b66fdf-7d7e-4ed2-b117-a5460e78d66d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:05.790215 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52b66fdf-7d7e-4ed2-b117-a5460e78d66d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:05.790682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52b66fdf-7d7e-4ed2-b117-a5460e78d66d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:05.791463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52b66fdf-7d7e-4ed2-b117-a5460e78d66d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:05.791915 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52b66fdf-7d7e-4ed2-b117-a5460e78d66d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:05.928937 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-52b66fdf-7d7e-4ed2-b117-a5460e78d66d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:05.936589 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-52b66fdf-7d7e-4ed2-b117-a5460e78d66d tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1693 microversion: 2.1 time: 0.158206 Jul 14 15:45:05.937209 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3663/7358] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:05 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:06.954191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-070fcbbd-7738-4cf9-be53-0e6bbb8ff9c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:06.954903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-070fcbbd-7738-4cf9-be53-0e6bbb8ff9c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:06.962959 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-070fcbbd-7738-4cf9-be53-0e6bbb8ff9c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:06.963434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-070fcbbd-7738-4cf9-be53-0e6bbb8ff9c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:06.964529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-070fcbbd-7738-4cf9-be53-0e6bbb8ff9c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:06.965027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-070fcbbd-7738-4cf9-be53-0e6bbb8ff9c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:07.174782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-070fcbbd-7738-4cf9-be53-0e6bbb8ff9c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:07.191509 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-070fcbbd-7738-4cf9-be53-0e6bbb8ff9c4 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1670 microversion: 2.1 time: 0.241181 Jul 14 15:45:07.197695 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3696/7359] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:06 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1670 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:08.289769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-956ea4ec-549b-4b60-9b3d-eb76570fcb6b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:08.290739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-956ea4ec-549b-4b60-9b3d-eb76570fcb6b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:08.297863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-956ea4ec-549b-4b60-9b3d-eb76570fcb6b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:08.298324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-956ea4ec-549b-4b60-9b3d-eb76570fcb6b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:08.299096 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-956ea4ec-549b-4b60-9b3d-eb76570fcb6b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:08.299577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-956ea4ec-549b-4b60-9b3d-eb76570fcb6b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:08.360456 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-956ea4ec-549b-4b60-9b3d-eb76570fcb6b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62/action" status: 200 len: 38170 microversion: 2.1 time: 0.075592 Jul 14 15:45:08.361213 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3664/7360] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:45:08 2022] POST /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62/action => generated 38170 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:08.372685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3c0a94ab-c31d-4751-bb34-8499c1d64473 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:08.379704 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c0a94ab-c31d-4751-bb34-8499c1d64473 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:08.380176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3c0a94ab-c31d-4751-bb34-8499c1d64473 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:08.405693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3c0a94ab-c31d-4751-bb34-8499c1d64473 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Going to try to start instance {{(pid=119512) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 15:45:08.447084 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3c0a94ab-c31d-4751-bb34-8499c1d64473 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62/action" status: 202 len: 0 microversion: 2.1 time: 0.078141 Jul 14 15:45:08.447767 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3697/7361] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:45:08 2022] POST /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:45:08.456673 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4ebc123d-4db8-4c0f-908a-6b8955c35315 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:08.457478 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4ebc123d-4db8-4c0f-908a-6b8955c35315 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:08.465203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ebc123d-4db8-4c0f-908a-6b8955c35315 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:08.465710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ebc123d-4db8-4c0f-908a-6b8955c35315 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:08.466508 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ebc123d-4db8-4c0f-908a-6b8955c35315 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:08.467013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ebc123d-4db8-4c0f-908a-6b8955c35315 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:08.787028 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4ebc123d-4db8-4c0f-908a-6b8955c35315 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:08.795757 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4ebc123d-4db8-4c0f-908a-6b8955c35315 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1679 microversion: 2.1 time: 0.343358 Jul 14 15:45:08.796270 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3665/7362] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:08 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1679 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:09.814854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4d5c8deb-89c4-4349-a06a-607a9733efc8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:09.815570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4d5c8deb-89c4-4349-a06a-607a9733efc8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:09.822271 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d5c8deb-89c4-4349-a06a-607a9733efc8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:09.822742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d5c8deb-89c4-4349-a06a-607a9733efc8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:09.823524 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d5c8deb-89c4-4349-a06a-607a9733efc8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:09.823980 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d5c8deb-89c4-4349-a06a-607a9733efc8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:10.022593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4d5c8deb-89c4-4349-a06a-607a9733efc8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:10.030119 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4d5c8deb-89c4-4349-a06a-607a9733efc8 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1679 microversion: 2.1 time: 0.220317 Jul 14 15:45:10.030688 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3698/7363] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:09 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:11.047089 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e94a2c4e-088c-44be-8761-29fcd0eb8674 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:11.047722 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e94a2c4e-088c-44be-8761-29fcd0eb8674 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:11.055349 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e94a2c4e-088c-44be-8761-29fcd0eb8674 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:11.055799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e94a2c4e-088c-44be-8761-29fcd0eb8674 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:11.056561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e94a2c4e-088c-44be-8761-29fcd0eb8674 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:11.057031 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e94a2c4e-088c-44be-8761-29fcd0eb8674 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:11.188785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e94a2c4e-088c-44be-8761-29fcd0eb8674 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:11.197473 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e94a2c4e-088c-44be-8761-29fcd0eb8674 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1683 microversion: 2.1 time: 0.154284 Jul 14 15:45:11.198053 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3666/7364] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:11 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:13.461724 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:45:13.462408 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 15:45:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:45:41.404743 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-51a3c80c-5bf3-4790-969b-0df749a3178b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:41.405730 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-51a3c80c-5bf3-4790-969b-0df749a3178b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:41.408095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=16 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:41.408775 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:41.415220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51a3c80c-5bf3-4790-969b-0df749a3178b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:41.416112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51a3c80c-5bf3-4790-969b-0df749a3178b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:41.416916 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51a3c80c-5bf3-4790-969b-0df749a3178b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:41.417405 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-51a3c80c-5bf3-4790-969b-0df749a3178b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:41.492658 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-51a3c80c-5bf3-4790-969b-0df749a3178b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62/action" status: 200 len: 62723 microversion: 2.1 time: 0.091774 Jul 14 15:45:41.493384 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3699/7365] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:45:41 2022] POST /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62/action => generated 62723 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:48.931710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4f4609f8-8dc0-4cac-9c8c-fab0336261ed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:48.932577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4f4609f8-8dc0-4cac-9c8c-fab0336261ed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:48.933744 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-89f5d450-f43a-4e2f-8caa-b61a31ddc6eb req-c2b33e11-756d-4ca3-b1f6-f8106a3dde08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d2dbc7-a4d1-448d-b826-2f6a49a01c62", "tag": "7efcac4d-6a15-4e9d-98f4-7a0ebbb624bb"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:48.936591 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=16 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:48.937389 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=46 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:48.943027 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f4609f8-8dc0-4cac-9c8c-fab0336261ed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:48.943538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-89f5d450-f43a-4e2f-8caa-b61a31ddc6eb req-c2b33e11-756d-4ca3-b1f6-f8106a3dde08 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:48.943658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f4609f8-8dc0-4cac-9c8c-fab0336261ed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:48.944008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-89f5d450-f43a-4e2f-8caa-b61a31ddc6eb req-c2b33e11-756d-4ca3-b1f6-f8106a3dde08 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:48.944502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f4609f8-8dc0-4cac-9c8c-fab0336261ed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:48.945047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4f4609f8-8dc0-4cac-9c8c-fab0336261ed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:48.956977 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-89f5d450-f43a-4e2f-8caa-b61a31ddc6eb req-c2b33e11-756d-4ca3-b1f6-f8106a3dde08 service nova] Creating event network-changed:7efcac4d-6a15-4e9d-98f4-7a0ebbb624bb for instance 24d2dbc7-a4d1-448d-b826-2f6a49a01c62 on n-h1-767704-28 Jul 14 15:45:48.965696 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-89f5d450-f43a-4e2f-8caa-b61a31ddc6eb req-c2b33e11-756d-4ca3-b1f6-f8106a3dde08 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035804 Jul 14 15:45:48.966317 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3700/7366] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:45:48.977801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4f4609f8-8dc0-4cac-9c8c-fab0336261ed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:45:49.062762 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4f4609f8-8dc0-4cac-9c8c-fab0336261ed tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "DELETE /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 204 len: 0 microversion: 2.1 time: 0.135511 Jul 14 15:45:49.063577 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3667/7367] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:45:48 2022] DELETE /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:45:49.074184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7e8c6cdc-a296-485a-9171-11addc5b2842 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:49.075462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7e8c6cdc-a296-485a-9171-11addc5b2842 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:49.082004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e8c6cdc-a296-485a-9171-11addc5b2842 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:49.082483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e8c6cdc-a296-485a-9171-11addc5b2842 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:49.083293 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e8c6cdc-a296-485a-9171-11addc5b2842 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:49.083758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7e8c6cdc-a296-485a-9171-11addc5b2842 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:49.221363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7e8c6cdc-a296-485a-9171-11addc5b2842 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:49.230320 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7e8c6cdc-a296-485a-9171-11addc5b2842 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1689 microversion: 2.1 time: 0.162220 Jul 14 15:45:49.230896 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3701/7368] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:49 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:50.248424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-266b0415-10f1-47b8-9c82-e7adc16b949e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:50.249225 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-266b0415-10f1-47b8-9c82-e7adc16b949e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:50.256371 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-266b0415-10f1-47b8-9c82-e7adc16b949e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:50.256829 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-266b0415-10f1-47b8-9c82-e7adc16b949e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:50.257640 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-266b0415-10f1-47b8-9c82-e7adc16b949e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:50.258710 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-266b0415-10f1-47b8-9c82-e7adc16b949e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:50.396725 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-266b0415-10f1-47b8-9c82-e7adc16b949e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:50.405338 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-266b0415-10f1-47b8-9c82-e7adc16b949e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1689 microversion: 2.1 time: 0.161156 Jul 14 15:45:50.405917 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3668/7369] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:50 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:51.422401 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-86b10f69-10ee-430b-92d2-ffabcad276dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:51.423311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-86b10f69-10ee-430b-92d2-ffabcad276dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:51.430593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86b10f69-10ee-430b-92d2-ffabcad276dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:51.431135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86b10f69-10ee-430b-92d2-ffabcad276dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:51.432013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86b10f69-10ee-430b-92d2-ffabcad276dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:51.432539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-86b10f69-10ee-430b-92d2-ffabcad276dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:51.573360 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-86b10f69-10ee-430b-92d2-ffabcad276dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:51.580914 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-86b10f69-10ee-430b-92d2-ffabcad276dc tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 200 len: 1689 microversion: 2.1 time: 0.162621 Jul 14 15:45:51.585059 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3702/7370] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:51 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:51.811949 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-490ba7b2-2af6-439f-970c-bad3b37d3628 req-828e394f-3c00-4b72-90a4-dd704bad93f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d2dbc7-a4d1-448d-b826-2f6a49a01c62", "name": "network-vif-deleted", "tag": "7efcac4d-6a15-4e9d-98f4-7a0ebbb624bb"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:51.823109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-490ba7b2-2af6-439f-970c-bad3b37d3628 req-828e394f-3c00-4b72-90a4-dd704bad93f4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:51.823557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-490ba7b2-2af6-439f-970c-bad3b37d3628 req-828e394f-3c00-4b72-90a4-dd704bad93f4 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:51.834782 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-490ba7b2-2af6-439f-970c-bad3b37d3628 req-828e394f-3c00-4b72-90a4-dd704bad93f4 service nova] Creating event network-vif-deleted:7efcac4d-6a15-4e9d-98f4-7a0ebbb624bb for instance 24d2dbc7-a4d1-448d-b826-2f6a49a01c62 on n-h1-767704-28 Jul 14 15:45:51.840167 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-490ba7b2-2af6-439f-970c-bad3b37d3628 req-828e394f-3c00-4b72-90a4-dd704bad93f4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032155 Jul 14 15:45:51.840876 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3669/7371] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:45:52.598456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-90b90a5e-bc5f-416e-af27-5991c77a9cb2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:52.598999 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-90b90a5e-bc5f-416e-af27-5991c77a9cb2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 24d2dbc7-a4d1-448d-b826-2f6a49a01c62] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:52.606188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90b90a5e-bc5f-416e-af27-5991c77a9cb2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:52.606653 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90b90a5e-bc5f-416e-af27-5991c77a9cb2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:52.607425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90b90a5e-bc5f-416e-af27-5991c77a9cb2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:52.607875 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90b90a5e-bc5f-416e-af27-5991c77a9cb2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:52.621072 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-90b90a5e-bc5f-416e-af27-5991c77a9cb2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] HTTP exception thrown: Instance 24d2dbc7-a4d1-448d-b826-2f6a49a01c62 could not be found. Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-90b90a5e-bc5f-416e-af27-5991c77a9cb2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Request method failure captured: Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 HTTP/1.1 Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DhCepsiUWzN2OBwVX62tUnpeM1pyuIHDeIvNigBeq67uN5XhDOMg_x_ZuIPETSWUT5YFW5LI1dL28GnGHCKqpBDIC9rM5qpCdbuGSc-8EcEdMoNXXJMpjprGKmuRcOOLKJ7kZYCzuJ7RPBJBMt-ss4WG-LmoDsWpBE8-dCFT4MyCzg Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 0ded8733e086447782856661597d52f0 Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0ded8733e086447782856661597d52f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0ded8733e086447782856661597d52f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0ded8733e086447782856661597d52f0", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0ded8733e086447782856661597d52f0"}]}] Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 0ded8733e086447782856661597d52f0 Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestNetworkAdvancedServerOps-1565740765-project Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 65b6268287b54c8d8a9fda65c04f278b Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1565740765-project Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 24d2dbc7-a4d1-448d-b826-2f6a49a01c62 could not be found. Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '24d2dbc7-a4d1-448d-b826-2f6a49a01c62'} Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d2dbc7-a4d1-448d-b826-2f6a49a01c62 could not be found. Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d2dbc7-a4d1-448d-b826-2f6a49a01c62 could not be found. Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:45:52.622707 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:45:52.627389 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:45:52.627389 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:45:52.627389 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:45:52.627389 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:45:52.627389 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:45:52.627389 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:45:52.627389 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d2dbc7-a4d1-448d-b826-2f6a49a01c62 could not be found. Jul 14 15:45:52.627389 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:45:52.627389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-90b90a5e-bc5f-416e-af27-5991c77a9cb2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Returning 404 to user: Instance 24d2dbc7-a4d1-448d-b826-2f6a49a01c62 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:45:52.627389 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-90b90a5e-bc5f-416e-af27-5991c77a9cb2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62" status: 404 len: 111 microversion: 2.1 time: 0.029620 Jul 14 15:45:52.627389 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3703/7372] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:52 2022] GET /compute/v2.1/servers/24d2dbc7-a4d1-448d-b826-2f6a49a01c62 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:45:55.608097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ec181553-c817-4e46-961b-ce775e33236e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '.version_select at 0x7fd6c42ae700>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:55.638483 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ec181553-c817-4e46-961b-ce775e33236e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1620911275" status: 202 len: 0 microversion: 2.1 time: 0.036163 Jul 14 15:45:55.639084 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3670/7373] 10.222.0.81 () {58 vars in 1283 bytes} [Thu Jul 14 15:45:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1620911275 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:45:55.673578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1d1d1c20-e610-4f14-9d1b-5d73754ba6f2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'create', calling method: .version_select at 0x7fd6c42b9af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-523834471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoORtUMXAbyVA6Ss0Rvq9lm3qR0zsGOlkJ4npw+PWs6jloEtx+bsu4ZjCJiilZ0lYpjqcjsUdVvNiIfnEcjEny/t6K6RXpqIkgcK+3/PiAnNMjhs/mejjHUlWmbtkV/CA=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:55.690061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1d1d1c20-e610-4f14-9d1b-5d73754ba6f2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for project 0ded8733e086447782856661597d52f0. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:45:55.695273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1d1d1c20-e610-4f14-9d1b-5d73754ba6f2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for user 65b6268287b54c8d8a9fda65c04f278b and project 0ded8733e086447782856661597d52f0. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:45:55.721060 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1d1d1c20-e610-4f14-9d1b-5d73754ba6f2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054174 Jul 14 15:45:55.721591 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3704/7374] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:45:55 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:46:01.530188 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1433847228", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "networks": [{"uuid": "8c381b07-cf22-4f4b-a32e-2cb1853765f7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-523834471", "security_groups": [{"name": "tempest-secgroup-smoke-1422956131"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:01.688732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] validate_networks() for [('8c381b07-cf22-4f4b-a32e-2cb1853765f7', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:46:01.830316 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:02.138404 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:46:02.138836 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:46:02.139580 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:46:02.139996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:46:02.140411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:46:02.151814 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:02.151954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:02.152740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:02.153288 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:02.173424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for project 0ded8733e086447782856661597d52f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:46:02.179790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Getting quotas for user 65b6268287b54c8d8a9fda65c04f278b and project 0ded8733e086447782856661597d52f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:46:02.194744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:46:02.197854 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:46:02.275235 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-af0d6a5e-b731-49ae-b07a-eec835c380d9 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749975 Jul 14 15:46:02.281797 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3671/7375] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:46:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:46:02.288154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-835b3735-5d9e-4c5a-b628-a162131c448b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:02.288802 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-835b3735-5d9e-4c5a-b628-a162131c448b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:02.425594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-835b3735-5d9e-4c5a-b628-a162131c448b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:02.434675 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-835b3735-5d9e-4c5a-b628-a162131c448b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1266 microversion: 2.1 time: 0.151956 Jul 14 15:46:02.435268 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3705/7376] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:02 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:46:03.455343 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a89979b5-a561-4859-a894-46da2c2d07ba tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:03.461936 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a89979b5-a561-4859-a894-46da2c2d07ba tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:03.483388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a89979b5-a561-4859-a894-46da2c2d07ba tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:03.485637 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a89979b5-a561-4859-a894-46da2c2d07ba tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:03.486632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a89979b5-a561-4859-a894-46da2c2d07ba tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:03.491983 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a89979b5-a561-4859-a894-46da2c2d07ba tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:03.659274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a89979b5-a561-4859-a894-46da2c2d07ba tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:03.676863 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a89979b5-a561-4859-a894-46da2c2d07ba tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1326 microversion: 2.1 time: 0.226676 Jul 14 15:46:03.692909 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3672/7377] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:03 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1326 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:04.700324 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2fa9ff90-c8a2-48f6-953f-bacebc94fa64 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:04.701971 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2fa9ff90-c8a2-48f6-953f-bacebc94fa64 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:04.705476 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=20 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:04.717784 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fa9ff90-c8a2-48f6-953f-bacebc94fa64 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:04.718260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fa9ff90-c8a2-48f6-953f-bacebc94fa64 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:04.719070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fa9ff90-c8a2-48f6-953f-bacebc94fa64 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:04.719532 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2fa9ff90-c8a2-48f6-953f-bacebc94fa64 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:05.000062 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2fa9ff90-c8a2-48f6-953f-bacebc94fa64 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:05.009246 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2fa9ff90-c8a2-48f6-953f-bacebc94fa64 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1392 microversion: 2.1 time: 0.312725 Jul 14 15:46:05.010065 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3706/7378] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:04 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1392 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:05.405112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-a2a77f56-1e58-4b2e-89cc-7ba68c9450ca req-9bd84c51-7f12-4f99-8283-52ab9c848b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a", "tag": "dfb6c18c-f91b-4aee-9e6c-0c3227cc141e"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:05.422242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a2a77f56-1e58-4b2e-89cc-7ba68c9450ca req-9bd84c51-7f12-4f99-8283-52ab9c848b7f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:05.422757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-a2a77f56-1e58-4b2e-89cc-7ba68c9450ca req-9bd84c51-7f12-4f99-8283-52ab9c848b7f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:05.438119 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-a2a77f56-1e58-4b2e-89cc-7ba68c9450ca req-9bd84c51-7f12-4f99-8283-52ab9c848b7f service nova] Creating event network-changed:dfb6c18c-f91b-4aee-9e6c-0c3227cc141e for instance 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a on n-h2-767704-28 Jul 14 15:46:05.443561 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-a2a77f56-1e58-4b2e-89cc-7ba68c9450ca req-9bd84c51-7f12-4f99-8283-52ab9c848b7f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042140 Jul 14 15:46:05.444179 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3673/7379] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:46:06.027557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e518de36-38cd-48d6-90da-ef8881b3a766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:06.028198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e518de36-38cd-48d6-90da-ef8881b3a766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:06.035201 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e518de36-38cd-48d6-90da-ef8881b3a766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:06.035674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e518de36-38cd-48d6-90da-ef8881b3a766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:06.036460 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e518de36-38cd-48d6-90da-ef8881b3a766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:06.036920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e518de36-38cd-48d6-90da-ef8881b3a766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:06.172216 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e518de36-38cd-48d6-90da-ef8881b3a766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:06.181010 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e518de36-38cd-48d6-90da-ef8881b3a766 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1392 microversion: 2.1 time: 0.157831 Jul 14 15:46:06.181590 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3707/7380] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:06 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:07.200392 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-21abac5c-f467-4875-a42e-308fad144baa tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:07.201228 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-21abac5c-f467-4875-a42e-308fad144baa tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:07.207697 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21abac5c-f467-4875-a42e-308fad144baa tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:07.208166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21abac5c-f467-4875-a42e-308fad144baa tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:07.209032 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21abac5c-f467-4875-a42e-308fad144baa tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:07.209445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-21abac5c-f467-4875-a42e-308fad144baa tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:07.414743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-21abac5c-f467-4875-a42e-308fad144baa tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:07.422431 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-21abac5c-f467-4875-a42e-308fad144baa tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1392 microversion: 2.1 time: 0.228034 Jul 14 15:46:07.423019 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3674/7381] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:07 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1392 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:08.441547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0baeed05-e61c-4163-8f9d-df4930d1964c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:08.442897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0baeed05-e61c-4163-8f9d-df4930d1964c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:08.451955 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0baeed05-e61c-4163-8f9d-df4930d1964c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:08.452424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0baeed05-e61c-4163-8f9d-df4930d1964c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:08.453253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0baeed05-e61c-4163-8f9d-df4930d1964c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:08.453903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0baeed05-e61c-4163-8f9d-df4930d1964c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:08.592557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0baeed05-e61c-4163-8f9d-df4930d1964c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:08.600231 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0baeed05-e61c-4163-8f9d-df4930d1964c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1392 microversion: 2.1 time: 0.164154 Jul 14 15:46:08.600803 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3708/7382] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:08 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:09.617932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5fb26807-9080-4735-a93f-a25c064513f5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:09.618582 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5fb26807-9080-4735-a93f-a25c064513f5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:09.625681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fb26807-9080-4735-a93f-a25c064513f5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:09.626174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fb26807-9080-4735-a93f-a25c064513f5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:09.626956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fb26807-9080-4735-a93f-a25c064513f5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:09.627403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5fb26807-9080-4735-a93f-a25c064513f5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:09.761203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5fb26807-9080-4735-a93f-a25c064513f5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:09.769008 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5fb26807-9080-4735-a93f-a25c064513f5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1392 microversion: 2.1 time: 0.155638 Jul 14 15:46:09.769576 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3675/7383] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:09 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:10.725245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-6a73e278-fc2b-4e26-b9b3-bb06aa95c062 req-b8e85988-dcea-4586-9171-d81a3d637d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a", "name": "network-vif-plugged", "status": "completed", "tag": "dfb6c18c-f91b-4aee-9e6c-0c3227cc141e"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:10.735332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6a73e278-fc2b-4e26-b9b3-bb06aa95c062 req-b8e85988-dcea-4586-9171-d81a3d637d35 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:10.735798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-6a73e278-fc2b-4e26-b9b3-bb06aa95c062 req-b8e85988-dcea-4586-9171-d81a3d637d35 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:10.748207 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-6a73e278-fc2b-4e26-b9b3-bb06aa95c062 req-b8e85988-dcea-4586-9171-d81a3d637d35 service nova] Creating event network-vif-plugged:dfb6c18c-f91b-4aee-9e6c-0c3227cc141e for instance 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a on n-h2-767704-28 Jul 14 15:46:10.753294 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-6a73e278-fc2b-4e26-b9b3-bb06aa95c062 req-b8e85988-dcea-4586-9171-d81a3d637d35 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031862 Jul 14 15:46:10.753971 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3709/7384] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:46:10.787884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8919987b-54e4-46bc-832e-ecab4e0365a5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:10.789592 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8919987b-54e4-46bc-832e-ecab4e0365a5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:10.797816 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8919987b-54e4-46bc-832e-ecab4e0365a5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:10.798367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8919987b-54e4-46bc-832e-ecab4e0365a5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:10.799268 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8919987b-54e4-46bc-832e-ecab4e0365a5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:10.799781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8919987b-54e4-46bc-832e-ecab4e0365a5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:10.993252 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8919987b-54e4-46bc-832e-ecab4e0365a5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:11.000885 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8919987b-54e4-46bc-832e-ecab4e0365a5 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1392 microversion: 2.1 time: 0.217632 Jul 14 15:46:11.001499 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3676/7385] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:10 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1392 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:12.019142 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d3710d9a-9447-41b1-9480-5e3e2383a166 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:12.019856 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d3710d9a-9447-41b1-9480-5e3e2383a166 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:12.022565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:12.028745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d3710d9a-9447-41b1-9480-5e3e2383a166 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:12.029303 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d3710d9a-9447-41b1-9480-5e3e2383a166 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:12.030112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d3710d9a-9447-41b1-9480-5e3e2383a166 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:12.030576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d3710d9a-9447-41b1-9480-5e3e2383a166 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:12.166574 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d3710d9a-9447-41b1-9480-5e3e2383a166 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:12.174244 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d3710d9a-9447-41b1-9480-5e3e2383a166 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1392 microversion: 2.1 time: 0.160340 Jul 14 15:46:12.174813 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3710/7386] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:12 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:13.192081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b946a624-bd7b-41a5-9e5f-0f4bb43d881e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:13.192620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b946a624-bd7b-41a5-9e5f-0f4bb43d881e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:13.196086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:13.196932 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:13.203174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b946a624-bd7b-41a5-9e5f-0f4bb43d881e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:13.203626 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b946a624-bd7b-41a5-9e5f-0f4bb43d881e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:13.204401 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b946a624-bd7b-41a5-9e5f-0f4bb43d881e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:13.204844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b946a624-bd7b-41a5-9e5f-0f4bb43d881e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:13.341224 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b946a624-bd7b-41a5-9e5f-0f4bb43d881e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:13.348740 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b946a624-bd7b-41a5-9e5f-0f4bb43d881e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1563 microversion: 2.1 time: 0.160744 Jul 14 15:46:13.349346 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3677/7387] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:13 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:13.365175 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-87c9517f-379c-4650-a9fe-83050bafdfac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:13.365813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-87c9517f-379c-4650-a9fe-83050bafdfac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:13.368657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:13.375104 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-87c9517f-379c-4650-a9fe-83050bafdfac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:13.375578 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-87c9517f-379c-4650-a9fe-83050bafdfac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:13.376363 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-87c9517f-379c-4650-a9fe-83050bafdfac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:13.376831 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-87c9517f-379c-4650-a9fe-83050bafdfac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:13.512319 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-87c9517f-379c-4650-a9fe-83050bafdfac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:13.520255 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-87c9517f-379c-4650-a9fe-83050bafdfac tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1563 microversion: 2.1 time: 0.159053 Jul 14 15:46:13.520825 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3711/7388] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:13 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:15.115935 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-dac14e2e-2e28-4458-9bb3-8c9bac45c101 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:15.116743 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-dac14e2e-2e28-4458-9bb3-8c9bac45c101 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:15.121824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e166c76b-22f5-48b7-8b19-b93ac4ef25de req-abb9a09e-94fd-42a1-a9e3-d1348eb842a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a", "tag": "dfb6c18c-f91b-4aee-9e6c-0c3227cc141e"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:15.125069 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dac14e2e-2e28-4458-9bb3-8c9bac45c101 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:15.125541 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dac14e2e-2e28-4458-9bb3-8c9bac45c101 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:15.126567 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dac14e2e-2e28-4458-9bb3-8c9bac45c101 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:15.127062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-dac14e2e-2e28-4458-9bb3-8c9bac45c101 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:15.135140 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e166c76b-22f5-48b7-8b19-b93ac4ef25de req-abb9a09e-94fd-42a1-a9e3-d1348eb842a9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:15.135767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e166c76b-22f5-48b7-8b19-b93ac4ef25de req-abb9a09e-94fd-42a1-a9e3-d1348eb842a9 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:15.148583 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e166c76b-22f5-48b7-8b19-b93ac4ef25de req-abb9a09e-94fd-42a1-a9e3-d1348eb842a9 service nova] Creating event network-changed:dfb6c18c-f91b-4aee-9e6c-0c3227cc141e for instance 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a on n-h2-767704-28 Jul 14 15:46:15.155530 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e166c76b-22f5-48b7-8b19-b93ac4ef25de req-abb9a09e-94fd-42a1-a9e3-d1348eb842a9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040390 Jul 14 15:46:15.156417 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3712/7389] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:46:15.265174 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-dac14e2e-2e28-4458-9bb3-8c9bac45c101 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:15.273388 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-dac14e2e-2e28-4458-9bb3-8c9bac45c101 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1563 microversion: 2.1 time: 0.161152 Jul 14 15:46:15.274261 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3678/7390] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:15 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:40.522035 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ff7fdfb8-e0fe-4850-ae6c-d28a2d68eec3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:40.523060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ff7fdfb8-e0fe-4850-ae6c-d28a2d68eec3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:40.526179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=5 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:40.526838 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=34 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:40.533014 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff7fdfb8-e0fe-4850-ae6c-d28a2d68eec3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:40.533489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff7fdfb8-e0fe-4850-ae6c-d28a2d68eec3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:40.534276 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff7fdfb8-e0fe-4850-ae6c-d28a2d68eec3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:40.534732 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ff7fdfb8-e0fe-4850-ae6c-d28a2d68eec3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:40.597212 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ff7fdfb8-e0fe-4850-ae6c-d28a2d68eec3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a/action" status: 200 len: 24566 microversion: 2.1 time: 0.079341 Jul 14 15:46:40.597854 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3713/7391] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:46:40 2022] POST /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a/action => generated 24566 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:46:49.046068 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:46:49.046644 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:46:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:46:51.570088 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-25f9f74f-4cd5-422e-a3bd-a7d15f86fd37 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:51.570707 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-25f9f74f-4cd5-422e-a3bd-a7d15f86fd37 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:51.572838 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:51.573740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=40 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:51.579482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25f9f74f-4cd5-422e-a3bd-a7d15f86fd37 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:51.579945 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25f9f74f-4cd5-422e-a3bd-a7d15f86fd37 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:51.580729 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25f9f74f-4cd5-422e-a3bd-a7d15f86fd37 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:51.581205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25f9f74f-4cd5-422e-a3bd-a7d15f86fd37 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:51.606790 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.objects.instance [None req-25f9f74f-4cd5-422e-a3bd-a7d15f86fd37 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lazy-loading 'flavor' on Instance uuid 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a {{(pid=119511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:46:51.674519 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-25f9f74f-4cd5-422e-a3bd-a7d15f86fd37 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a/action" status: 202 len: 0 microversion: 2.1 time: 0.108474 Jul 14 15:46:51.675175 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3679/7392] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:46:51 2022] POST /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:46:51.683842 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cca02424-0832-4d94-9131-90332a43703c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:51.684547 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cca02424-0832-4d94-9131-90332a43703c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:51.687134 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:51.687927 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=4 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:51.694847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cca02424-0832-4d94-9131-90332a43703c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:51.695308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cca02424-0832-4d94-9131-90332a43703c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:51.696957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cca02424-0832-4d94-9131-90332a43703c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:51.697471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cca02424-0832-4d94-9131-90332a43703c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:51.834945 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cca02424-0832-4d94-9131-90332a43703c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:51.843454 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cca02424-0832-4d94-9131-90332a43703c tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1690 microversion: 2.1 time: 0.163851 Jul 14 15:46:51.844021 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3714/7393] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:51 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:52.862132 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2583dad1-6d1f-46a9-a0ed-ec3b008fd49b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:52.862862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2583dad1-6d1f-46a9-a0ed-ec3b008fd49b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:52.870231 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2583dad1-6d1f-46a9-a0ed-ec3b008fd49b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:52.870682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2583dad1-6d1f-46a9-a0ed-ec3b008fd49b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:52.871445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2583dad1-6d1f-46a9-a0ed-ec3b008fd49b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:52.871883 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2583dad1-6d1f-46a9-a0ed-ec3b008fd49b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:53.002860 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2583dad1-6d1f-46a9-a0ed-ec3b008fd49b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:53.011175 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2583dad1-6d1f-46a9-a0ed-ec3b008fd49b tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1673 microversion: 2.1 time: 0.153297 Jul 14 15:46:53.011757 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3680/7394] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:52 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:54.101208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1bc04e1d-3c4b-4880-895b-d7dd6507c948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:54.102695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1bc04e1d-3c4b-4880-895b-d7dd6507c948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:54.110703 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1bc04e1d-3c4b-4880-895b-d7dd6507c948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:54.111151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1bc04e1d-3c4b-4880-895b-d7dd6507c948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:54.111928 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1bc04e1d-3c4b-4880-895b-d7dd6507c948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:54.112381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1bc04e1d-3c4b-4880-895b-d7dd6507c948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:54.176358 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1bc04e1d-3c4b-4880-895b-d7dd6507c948 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a/action" status: 200 len: 36877 microversion: 2.1 time: 0.078868 Jul 14 15:46:54.176982 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3715/7395] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:46:54 2022] POST /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a/action => generated 36877 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:46:54.188131 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ce15605f-1ff7-4d17-aa83-017ab1b3a4d2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:54.188678 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ce15605f-1ff7-4d17-aa83-017ab1b3a4d2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:54.195843 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce15605f-1ff7-4d17-aa83-017ab1b3a4d2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:54.196319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce15605f-1ff7-4d17-aa83-017ab1b3a4d2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:54.197005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce15605f-1ff7-4d17-aa83-017ab1b3a4d2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:54.197457 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ce15605f-1ff7-4d17-aa83-017ab1b3a4d2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:54.264303 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ce15605f-1ff7-4d17-aa83-017ab1b3a4d2 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a/action" status: 202 len: 0 microversion: 2.1 time: 0.079670 Jul 14 15:46:54.265122 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3681/7396] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:46:54 2022] POST /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:46:54.273591 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2c439293-e831-420e-a0f7-9a2e59454a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:54.275088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2c439293-e831-420e-a0f7-9a2e59454a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:54.282244 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c439293-e831-420e-a0f7-9a2e59454a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:54.282723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c439293-e831-420e-a0f7-9a2e59454a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:54.283650 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c439293-e831-420e-a0f7-9a2e59454a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:54.284207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2c439293-e831-420e-a0f7-9a2e59454a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:54.507361 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2c439293-e831-420e-a0f7-9a2e59454a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:54.515837 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2c439293-e831-420e-a0f7-9a2e59454a77 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1679 microversion: 2.1 time: 0.246442 Jul 14 15:46:54.516416 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3716/7397] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:54 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1679 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:55.534882 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e086b441-80d0-4927-a3a7-3775f6a2a454 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:55.535632 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e086b441-80d0-4927-a3a7-3775f6a2a454 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:55.542549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e086b441-80d0-4927-a3a7-3775f6a2a454 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:55.543034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e086b441-80d0-4927-a3a7-3775f6a2a454 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:55.543793 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e086b441-80d0-4927-a3a7-3775f6a2a454 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:55.544229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e086b441-80d0-4927-a3a7-3775f6a2a454 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:55.678283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e086b441-80d0-4927-a3a7-3775f6a2a454 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:55.686419 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e086b441-80d0-4927-a3a7-3775f6a2a454 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1679 microversion: 2.1 time: 0.156490 Jul 14 15:46:55.687008 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3682/7398] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:55 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:56.703576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-70cc9195-6f1d-47e3-9f15-b049ec9e7a90 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:56.704207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-70cc9195-6f1d-47e3-9f15-b049ec9e7a90 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:56.712107 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70cc9195-6f1d-47e3-9f15-b049ec9e7a90 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:56.712583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70cc9195-6f1d-47e3-9f15-b049ec9e7a90 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:56.713415 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70cc9195-6f1d-47e3-9f15-b049ec9e7a90 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:56.713876 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-70cc9195-6f1d-47e3-9f15-b049ec9e7a90 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:56.853064 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-70cc9195-6f1d-47e3-9f15-b049ec9e7a90 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:56.860635 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-70cc9195-6f1d-47e3-9f15-b049ec9e7a90 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1682 microversion: 2.1 time: 0.161014 Jul 14 15:46:56.861235 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3717/7399] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:56 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:56.957049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fdb41876-90ed-4a18-8102-301d25a3bb06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:56.957914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fdb41876-90ed-4a18-8102-301d25a3bb06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:56.965439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdb41876-90ed-4a18-8102-301d25a3bb06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:56.965899 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdb41876-90ed-4a18-8102-301d25a3bb06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:56.966668 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdb41876-90ed-4a18-8102-301d25a3bb06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:56.967104 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fdb41876-90ed-4a18-8102-301d25a3bb06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:57.010050 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fdb41876-90ed-4a18-8102-301d25a3bb06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "POST /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a/action" status: 200 len: 36877 microversion: 2.1 time: 0.057085 Jul 14 15:46:57.010724 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3683/7400] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:46:56 2022] POST /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a/action => generated 36877 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:46:58.414015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b52a1465-03ea-4800-b2a3-10f860cc8e0e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:58.414567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b52a1465-03ea-4800-b2a3-10f860cc8e0e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:58.421906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b52a1465-03ea-4800-b2a3-10f860cc8e0e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:58.422383 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b52a1465-03ea-4800-b2a3-10f860cc8e0e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:58.423178 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b52a1465-03ea-4800-b2a3-10f860cc8e0e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:58.423636 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b52a1465-03ea-4800-b2a3-10f860cc8e0e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:58.453005 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b52a1465-03ea-4800-b2a3-10f860cc8e0e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:46:58.502405 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3581436a-e30c-4da4-90db-c4cb34502e22 req-0cc8f860-039d-4e7b-b4e2-85267f9ecc6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a", "tag": "dfb6c18c-f91b-4aee-9e6c-0c3227cc141e"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:58.516068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3581436a-e30c-4da4-90db-c4cb34502e22 req-0cc8f860-039d-4e7b-b4e2-85267f9ecc6d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:58.516716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3581436a-e30c-4da4-90db-c4cb34502e22 req-0cc8f860-039d-4e7b-b4e2-85267f9ecc6d service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:58.531230 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3581436a-e30c-4da4-90db-c4cb34502e22 req-0cc8f860-039d-4e7b-b4e2-85267f9ecc6d service nova] Creating event network-changed:dfb6c18c-f91b-4aee-9e6c-0c3227cc141e for instance 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a on n-h2-767704-28 Jul 14 15:46:58.536356 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3581436a-e30c-4da4-90db-c4cb34502e22 req-0cc8f860-039d-4e7b-b4e2-85267f9ecc6d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123525 Jul 14 15:46:58.537131 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3684/7401] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:46:58.543750 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b52a1465-03ea-4800-b2a3-10f860cc8e0e tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "DELETE /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 204 len: 0 microversion: 2.1 time: 0.133348 Jul 14 15:46:58.544744 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3718/7402] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:46:58 2022] DELETE /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:46:58.553576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-15335a52-f438-4a02-ae46-04937e40f140 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:58.554428 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-15335a52-f438-4a02-ae46-04937e40f140 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:58.561783 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15335a52-f438-4a02-ae46-04937e40f140 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:58.562372 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15335a52-f438-4a02-ae46-04937e40f140 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:58.563283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15335a52-f438-4a02-ae46-04937e40f140 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:58.563819 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-15335a52-f438-4a02-ae46-04937e40f140 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:58.706315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-15335a52-f438-4a02-ae46-04937e40f140 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:58.714773 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-15335a52-f438-4a02-ae46-04937e40f140 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1688 microversion: 2.1 time: 0.165591 Jul 14 15:46:58.715351 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3685/7403] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:58 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:46:59.732904 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-90237af9-6973-448e-b537-f4c7e8bd4b17 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:59.733645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-90237af9-6973-448e-b537-f4c7e8bd4b17 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:59.740536 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90237af9-6973-448e-b537-f4c7e8bd4b17 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:59.741030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90237af9-6973-448e-b537-f4c7e8bd4b17 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:59.741833 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90237af9-6973-448e-b537-f4c7e8bd4b17 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:59.742282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-90237af9-6973-448e-b537-f4c7e8bd4b17 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:59.879509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-90237af9-6973-448e-b537-f4c7e8bd4b17 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:59.888097 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-90237af9-6973-448e-b537-f4c7e8bd4b17 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1688 microversion: 2.1 time: 0.159339 Jul 14 15:46:59.888666 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3719/7404] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:59 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:00.909146 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-89d6b539-9d41-4f98-ba63-9a4b14a33aa3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:00.909776 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-89d6b539-9d41-4f98-ba63-9a4b14a33aa3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:00.917705 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89d6b539-9d41-4f98-ba63-9a4b14a33aa3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:00.918167 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89d6b539-9d41-4f98-ba63-9a4b14a33aa3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:00.918951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89d6b539-9d41-4f98-ba63-9a4b14a33aa3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:00.919395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-89d6b539-9d41-4f98-ba63-9a4b14a33aa3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:01.064369 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-45f13dcc-acc7-48a9-832e-5474b7336ef9 req-920cc89f-ff48-4152-8cbf-bbad36be6a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a", "name": "network-vif-deleted", "tag": "dfb6c18c-f91b-4aee-9e6c-0c3227cc141e"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:01.073873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-89d6b539-9d41-4f98-ba63-9a4b14a33aa3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b6268287b54c8d8a9fda65c04f278b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ded8733e086447782856661597d52f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:01.074072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-45f13dcc-acc7-48a9-832e-5474b7336ef9 req-920cc89f-ff48-4152-8cbf-bbad36be6a36 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:01.074478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-45f13dcc-acc7-48a9-832e-5474b7336ef9 req-920cc89f-ff48-4152-8cbf-bbad36be6a36 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:01.083725 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-89d6b539-9d41-4f98-ba63-9a4b14a33aa3 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 200 len: 1569 microversion: 2.1 time: 0.181415 Jul 14 15:47:01.084578 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3686/7405] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:00 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:01.086583 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-45f13dcc-acc7-48a9-832e-5474b7336ef9 req-920cc89f-ff48-4152-8cbf-bbad36be6a36 service nova] Creating event network-vif-deleted:dfb6c18c-f91b-4aee-9e6c-0c3227cc141e for instance 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a on n-h2-767704-28 Jul 14 15:47:01.098146 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-45f13dcc-acc7-48a9-832e-5474b7336ef9 req-920cc89f-ff48-4152-8cbf-bbad36be6a36 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036802 Jul 14 15:47:01.099551 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3720/7406] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:47:02.111764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-019ac6c7-8c48-4569-8aa1-89d825a7de06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:02.112304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-019ac6c7-8c48-4569-8aa1-89d825a7de06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] [instance: 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:02.120480 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-019ac6c7-8c48-4569-8aa1-89d825a7de06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:02.120955 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-019ac6c7-8c48-4569-8aa1-89d825a7de06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:02.121738 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-019ac6c7-8c48-4569-8aa1-89d825a7de06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:02.122185 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-019ac6c7-8c48-4569-8aa1-89d825a7de06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:02.135770 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-019ac6c7-8c48-4569-8aa1-89d825a7de06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] HTTP exception thrown: Instance 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a could not be found. Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-019ac6c7-8c48-4569-8aa1-89d825a7de06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Request method failure captured: Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a HTTP/1.1 Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0DhCepsiUWzN2OBwVX62tUnpeM1pyuIHDeIvNigBeq67uN5XhDOMg_x_ZuIPETSWUT5YFW5LI1dL28GnGHCKqpBDIC9rM5qpCdbuGSc-8EcEdMoNXXJMpjprGKmuRcOOLKJ7kZYCzuJ7RPBJBMt-ss4WG-LmoDsWpBE8-dCFT4MyCzg Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 0ded8733e086447782856661597d52f0 Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0ded8733e086447782856661597d52f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0ded8733e086447782856661597d52f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0ded8733e086447782856661597d52f0", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0ded8733e086447782856661597d52f0"}]}] Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 0ded8733e086447782856661597d52f0 Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1565740765 Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestNetworkAdvancedServerOps-1565740765-project Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 65b6268287b54c8d8a9fda65c04f278b Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1565740765-project Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a could not be found. Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a'} Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a could not be found. Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a could not be found. Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:47:02.137473 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:47:02.142271 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:47:02.142271 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:47:02.142271 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:47:02.142271 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:47:02.142271 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:47:02.142271 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:47:02.142271 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a could not be found. Jul 14 15:47:02.142271 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:47:02.142271 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-019ac6c7-8c48-4569-8aa1-89d825a7de06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Returning 404 to user: Instance 21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:47:02.142271 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-019ac6c7-8c48-4569-8aa1-89d825a7de06 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a" status: 404 len: 111 microversion: 2.1 time: 0.031197 Jul 14 15:47:02.142271 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3687/7407] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:02 2022] GET /compute/v2.1/servers/21bd16fe-04a3-43d8-a5ba-c1fc0ea68c8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:47:05.428160 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ed568d52-3475-463e-adef-815bc2764fa0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] Calling method '.version_select at 0x7fd6c4fd2a60>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:05.447836 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ed568d52-3475-463e-adef-815bc2764fa0 tempest-TestNetworkAdvancedServerOps-1565740765 tempest-TestNetworkAdvancedServerOps-1565740765-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-523834471" status: 202 len: 0 microversion: 2.1 time: 0.024983 Jul 14 15:47:05.448429 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3721/7408] 10.222.0.81 () {58 vars in 1280 bytes} [Thu Jul 14 15:47:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-523834471 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:47:16.552417 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=18 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:16.553590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:16.824293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-04d89f56-ff21-41b4-ac13-99d37e7ba26d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Action: 'create', calling method: .version_select at 0x7fd6c459bf70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1176728654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwVkfZddF7gbmMDdAMX0SFw/VIvKbQ8bqYeS5csBgvCJ3PgWZdRUZf2GPKpY2sBtMzNg/muyiOB6FGoTnlgk+1dTYGF4NI+2GLdgS4s8YG033lg7UuUdOw9xZWYSvX5ag=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:16.839711 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-04d89f56-ff21-41b4-ac13-99d37e7ba26d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Getting quotas for project 96db3341b9c747eba0451cbd45afabf4. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:47:16.845393 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-04d89f56-ff21-41b4-ac13-99d37e7ba26d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Getting quotas for user 9dd4c1e8688a446baef7fcb7b7f9c1ec and project 96db3341b9c747eba0451cbd45afabf4. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:47:16.873409 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-04d89f56-ff21-41b4-ac13-99d37e7ba26d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.326657 Jul 14 15:47:16.874198 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3688/7409] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:47:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:17.961977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:17.962912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:17.967288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-294472346", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1176728654", "security_groups": [{"name": "tempest-secgroup-smoke-971830515"}], "networks": [{"uuid": "27ec2d4a-f4e7-4e31-a02d-01601c6d91d2"}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:18.081116 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] validate_networks() for [('27ec2d4a-f4e7-4e31-a02d-01601c6d91d2', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:47:18.473325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:47:18.473776 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:47:18.480553 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:47:18.481039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:47:18.481489 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:47:18.490694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:18.491204 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:18.492067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:18.492593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:18.511399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Getting quotas for project 96db3341b9c747eba0451cbd45afabf4. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:47:18.516557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Getting quotas for user 9dd4c1e8688a446baef7fcb7b7f9c1ec and project 96db3341b9c747eba0451cbd45afabf4. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:47:18.530874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:47:18.533435 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:47:18.581242 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4647030c-de57-40d8-836a-73d6865ad198 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.621592 Jul 14 15:47:18.587158 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3722/7410] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:47:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:47:18.593542 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cc40867c-46fb-4a11-bf82-e94cbab86db2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:18.594304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cc40867c-46fb-4a11-bf82-e94cbab86db2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:18.652029 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cc40867c-46fb-4a11-bf82-e94cbab86db2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:18.659478 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cc40867c-46fb-4a11-bf82-e94cbab86db2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1246 microversion: 2.1 time: 0.070970 Jul 14 15:47:18.660063 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3689/7411] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:18 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:19.679371 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e03dd756-69c8-4944-acdf-dc23b3604b24 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:19.680767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e03dd756-69c8-4944-acdf-dc23b3604b24 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:19.689943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e03dd756-69c8-4944-acdf-dc23b3604b24 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:19.691016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e03dd756-69c8-4944-acdf-dc23b3604b24 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:19.692111 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e03dd756-69c8-4944-acdf-dc23b3604b24 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:19.694478 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e03dd756-69c8-4944-acdf-dc23b3604b24 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:19.778238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e03dd756-69c8-4944-acdf-dc23b3604b24 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:19.786260 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e03dd756-69c8-4944-acdf-dc23b3604b24 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1298 microversion: 2.1 time: 0.111854 Jul 14 15:47:19.786676 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3723/7412] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:19 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:20.806713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-124634e8-8aab-4362-a446-0410a378776f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:20.807952 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-124634e8-8aab-4362-a446-0410a378776f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:20.817233 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-124634e8-8aab-4362-a446-0410a378776f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:20.818040 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-124634e8-8aab-4362-a446-0410a378776f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:20.819113 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-124634e8-8aab-4362-a446-0410a378776f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:20.819805 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-124634e8-8aab-4362-a446-0410a378776f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:20.985608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-124634e8-8aab-4362-a446-0410a378776f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:20.995215 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-124634e8-8aab-4362-a446-0410a378776f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1371 microversion: 2.1 time: 0.194771 Jul 14 15:47:20.995819 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3690/7413] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:20 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:21.877906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-062d69a2-1856-475c-988c-b6ef9c2255fc req-04b1ba5d-2988-48ab-9a37-43d3bb0443ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f3ccc6-e654-4f73-aa27-eb24e616eed5", "tag": "66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:21.891974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-062d69a2-1856-475c-988c-b6ef9c2255fc req-04b1ba5d-2988-48ab-9a37-43d3bb0443ea service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:21.892461 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-062d69a2-1856-475c-988c-b6ef9c2255fc req-04b1ba5d-2988-48ab-9a37-43d3bb0443ea service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:21.912747 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-062d69a2-1856-475c-988c-b6ef9c2255fc req-04b1ba5d-2988-48ab-9a37-43d3bb0443ea service nova] Creating event network-changed:66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78 for instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 on n-h1-767704-28 Jul 14 15:47:21.923656 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-062d69a2-1856-475c-988c-b6ef9c2255fc req-04b1ba5d-2988-48ab-9a37-43d3bb0443ea service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049291 Jul 14 15:47:21.925538 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3724/7414] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:22.012642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9959435a-3f8f-40a0-b4ee-3531d89da645 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:22.013575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9959435a-3f8f-40a0-b4ee-3531d89da645 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:22.021807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9959435a-3f8f-40a0-b4ee-3531d89da645 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:22.022615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9959435a-3f8f-40a0-b4ee-3531d89da645 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:22.024831 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9959435a-3f8f-40a0-b4ee-3531d89da645 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:22.025562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9959435a-3f8f-40a0-b4ee-3531d89da645 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:22.205327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9959435a-3f8f-40a0-b4ee-3531d89da645 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:22.213593 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9959435a-3f8f-40a0-b4ee-3531d89da645 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1371 microversion: 2.1 time: 0.204732 Jul 14 15:47:22.214225 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3691/7415] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:22 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:47:23.233783 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-97774df3-bcc0-4f88-a4d6-99e004a82a3d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:23.234538 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-97774df3-bcc0-4f88-a4d6-99e004a82a3d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:23.240810 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97774df3-bcc0-4f88-a4d6-99e004a82a3d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:23.241438 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97774df3-bcc0-4f88-a4d6-99e004a82a3d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:23.242700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97774df3-bcc0-4f88-a4d6-99e004a82a3d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:23.243042 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-97774df3-bcc0-4f88-a4d6-99e004a82a3d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:23.377350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-97774df3-bcc0-4f88-a4d6-99e004a82a3d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:23.385913 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-97774df3-bcc0-4f88-a4d6-99e004a82a3d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1371 microversion: 2.1 time: 0.157220 Jul 14 15:47:23.386490 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3725/7416] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:23 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:24.403761 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-115fe9b4-0e82-464b-b715-fd15b3f6e672 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:24.404375 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-115fe9b4-0e82-464b-b715-fd15b3f6e672 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:24.411210 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-115fe9b4-0e82-464b-b715-fd15b3f6e672 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:24.411663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-115fe9b4-0e82-464b-b715-fd15b3f6e672 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:24.412422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-115fe9b4-0e82-464b-b715-fd15b3f6e672 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:24.412857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-115fe9b4-0e82-464b-b715-fd15b3f6e672 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:24.550102 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-115fe9b4-0e82-464b-b715-fd15b3f6e672 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:24.558893 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-115fe9b4-0e82-464b-b715-fd15b3f6e672 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1371 microversion: 2.1 time: 0.159038 Jul 14 15:47:24.559475 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3692/7417] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:24 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:25.576475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d9d396a9-6819-4927-b4aa-446628632cc1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:25.577144 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d9d396a9-6819-4927-b4aa-446628632cc1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:25.584181 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9d396a9-6819-4927-b4aa-446628632cc1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:25.584597 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9d396a9-6819-4927-b4aa-446628632cc1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:25.585942 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9d396a9-6819-4927-b4aa-446628632cc1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:25.586419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d9d396a9-6819-4927-b4aa-446628632cc1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:25.719510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d9d396a9-6819-4927-b4aa-446628632cc1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:25.729500 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d9d396a9-6819-4927-b4aa-446628632cc1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1371 microversion: 2.1 time: 0.156931 Jul 14 15:47:25.730074 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3726/7418] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:25 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:26.746334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-51ea6a79-5211-4307-9b94-e7e64e6a54ba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:26.746957 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-51ea6a79-5211-4307-9b94-e7e64e6a54ba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:26.753929 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51ea6a79-5211-4307-9b94-e7e64e6a54ba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:26.754388 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51ea6a79-5211-4307-9b94-e7e64e6a54ba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:26.755162 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51ea6a79-5211-4307-9b94-e7e64e6a54ba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:26.755605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-51ea6a79-5211-4307-9b94-e7e64e6a54ba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:26.893473 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-51ea6a79-5211-4307-9b94-e7e64e6a54ba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:26.901827 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-51ea6a79-5211-4307-9b94-e7e64e6a54ba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1371 microversion: 2.1 time: 0.159328 Jul 14 15:47:26.902415 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3693/7419] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:26 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:27.921414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0f80f0f7-acb0-460d-a46a-b29b8c952c09 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:27.922136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0f80f0f7-acb0-460d-a46a-b29b8c952c09 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:27.931863 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f80f0f7-acb0-460d-a46a-b29b8c952c09 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:27.932329 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f80f0f7-acb0-460d-a46a-b29b8c952c09 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:27.933161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f80f0f7-acb0-460d-a46a-b29b8c952c09 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:27.933609 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f80f0f7-acb0-460d-a46a-b29b8c952c09 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:27.992534 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-80d67215-64e7-4174-abcf-93e896ac5530 req-65d93628-96bc-4dc4-afaa-4766906b6fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f3ccc6-e654-4f73-aa27-eb24e616eed5", "name": "network-vif-plugged", "status": "completed", "tag": "66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:28.008096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-80d67215-64e7-4174-abcf-93e896ac5530 req-65d93628-96bc-4dc4-afaa-4766906b6fd3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:28.008864 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-80d67215-64e7-4174-abcf-93e896ac5530 req-65d93628-96bc-4dc4-afaa-4766906b6fd3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:28.020689 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-80d67215-64e7-4174-abcf-93e896ac5530 req-65d93628-96bc-4dc4-afaa-4766906b6fd3 service nova] Creating event network-vif-plugged:66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78 for instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 on n-h1-767704-28 Jul 14 15:47:28.026057 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-80d67215-64e7-4174-abcf-93e896ac5530 req-65d93628-96bc-4dc4-afaa-4766906b6fd3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111154 Jul 14 15:47:28.026667 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3727/7420] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:28.075292 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0f80f0f7-acb0-460d-a46a-b29b8c952c09 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:28.083053 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0f80f0f7-acb0-460d-a46a-b29b8c952c09 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1371 microversion: 2.1 time: 0.165601 Jul 14 15:47:28.083740 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3694/7421] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:27 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:29.098772 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:29.099491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:29.105094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-de25a04f-51a9-49c6-a2a2-aef300b0a540 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:29.105813 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-de25a04f-51a9-49c6-a2a2-aef300b0a540 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:29.113377 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de25a04f-51a9-49c6-a2a2-aef300b0a540 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:29.114230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de25a04f-51a9-49c6-a2a2-aef300b0a540 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:29.115648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de25a04f-51a9-49c6-a2a2-aef300b0a540 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:29.116246 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-de25a04f-51a9-49c6-a2a2-aef300b0a540 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:29.256462 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-de25a04f-51a9-49c6-a2a2-aef300b0a540 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:29.265097 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-de25a04f-51a9-49c6-a2a2-aef300b0a540 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1371 microversion: 2.1 time: 0.167354 Jul 14 15:47:29.265663 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3728/7422] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:29 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:30.281948 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ee95850-8738-4621-9b97-40653919de98 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:30.282561 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8ee95850-8738-4621-9b97-40653919de98 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:30.284577 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:30.291684 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ee95850-8738-4621-9b97-40653919de98 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:30.292142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ee95850-8738-4621-9b97-40653919de98 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:30.292972 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ee95850-8738-4621-9b97-40653919de98 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:30.293412 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ee95850-8738-4621-9b97-40653919de98 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:30.432570 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8ee95850-8738-4621-9b97-40653919de98 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:30.440250 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8ee95850-8738-4621-9b97-40653919de98 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1555 microversion: 2.1 time: 0.162138 Jul 14 15:47:30.440827 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3695/7423] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:30 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:30.456045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2701f044-3641-48cf-9b58-02081cd0639e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:30.456674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2701f044-3641-48cf-9b58-02081cd0639e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:30.463716 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2701f044-3641-48cf-9b58-02081cd0639e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:30.464188 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2701f044-3641-48cf-9b58-02081cd0639e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:30.465004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2701f044-3641-48cf-9b58-02081cd0639e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:30.465467 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2701f044-3641-48cf-9b58-02081cd0639e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:30.600589 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2701f044-3641-48cf-9b58-02081cd0639e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:30.609661 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2701f044-3641-48cf-9b58-02081cd0639e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1555 microversion: 2.1 time: 0.157460 Jul 14 15:47:30.610234 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3729/7424] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:30 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:32.272223 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-0a10c98b-0d50-4c3d-82ab-879bcf1a5085 req-9bc2fb0d-5997-468f-aadb-55934b59b3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f3ccc6-e654-4f73-aa27-eb24e616eed5", "tag": "66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:32.281534 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0a10c98b-0d50-4c3d-82ab-879bcf1a5085 req-9bc2fb0d-5997-468f-aadb-55934b59b3d6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:32.282083 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-0a10c98b-0d50-4c3d-82ab-879bcf1a5085 req-9bc2fb0d-5997-468f-aadb-55934b59b3d6 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:32.293658 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-0a10c98b-0d50-4c3d-82ab-879bcf1a5085 req-9bc2fb0d-5997-468f-aadb-55934b59b3d6 service nova] Creating event network-changed:66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78 for instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 on n-h1-767704-28 Jul 14 15:47:32.298697 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-0a10c98b-0d50-4c3d-82ab-879bcf1a5085 req-9bc2fb0d-5997-468f-aadb-55934b59b3d6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030159 Jul 14 15:47:32.299378 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3696/7425] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:33.470273 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:48:33.470972 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 15:48:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:49:37.483309 n-d-767704-28 devstack@n-api.service[119512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [26449759-db35-49d5-85de-1ac97211f6c5] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 15:49:37.484039 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:37.484893 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=36 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:37.488817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-21ad96ea-ea48-44fe-a65b-f0e6911a9064 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:37.489418 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-21ad96ea-ea48-44fe-a65b-f0e6911a9064 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:37.497684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21ad96ea-ea48-44fe-a65b-f0e6911a9064 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:37.498157 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21ad96ea-ea48-44fe-a65b-f0e6911a9064 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:37.498944 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21ad96ea-ea48-44fe-a65b-f0e6911a9064 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:37.499404 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-21ad96ea-ea48-44fe-a65b-f0e6911a9064 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:37.522321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-21ad96ea-ea48-44fe-a65b-f0e6911a9064 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lazy-loading 'flavor' on Instance uuid 40f3ccc6-e654-4f73-aa27-eb24e616eed5 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:49:37.778931 n-d-767704-28 devstack@n-api.service[119512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-21ad96ea-ea48-44fe-a65b-f0e6911a9064 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [fcf68bfb-c10e-44ae-930e-fea204a8b79a] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:49:38.492198 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] [26449759-db35-49d5-85de-1ac97211f6c5] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 55914. Jul 14 15:49:38.786464 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [None req-21ad96ea-ea48-44fe-a65b-f0e6911a9064 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [fcf68bfb-c10e-44ae-930e-fea204a8b79a] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 55916. Jul 14 15:49:38.790098 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-21ad96ea-ea48-44fe-a65b-f0e6911a9064 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "POST /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5/action" status: 202 len: 0 microversion: 2.1 time: 1.309040 Jul 14 15:49:38.790908 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3730/7426] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:49:37 2022] POST /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5/action => generated 0 bytes in 1310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:49:38.799862 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a22d85c6-ae9d-41d6-a69e-ea6ad90634fc] AMQP server on 10.222.0.81:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 15:49:38.801235 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d4f9fe7-d901-4181-b484-84a90bcc1a95] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:49:38.802310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:38.803518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=38 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:38.812255 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4c5967e7-2ff1-45b5-a0e6-a186730f251b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:38.813521 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4c5967e7-2ff1-45b5-a0e6-a186730f251b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:38.822760 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c5967e7-2ff1-45b5-a0e6-a186730f251b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:38.823214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c5967e7-2ff1-45b5-a0e6-a186730f251b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:38.823990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c5967e7-2ff1-45b5-a0e6-a186730f251b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:38.824427 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4c5967e7-2ff1-45b5-a0e6-a186730f251b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:38.959049 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4c5967e7-2ff1-45b5-a0e6-a186730f251b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:38.967406 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4c5967e7-2ff1-45b5-a0e6-a186730f251b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1679 microversion: 2.1 time: 0.171356 Jul 14 15:49:38.967978 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3697/7427] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:38 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:39.986771 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-30b9a069-7872-49b6-8839-c10d80497f5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:39.987500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-30b9a069-7872-49b6-8839-c10d80497f5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:39.993946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30b9a069-7872-49b6-8839-c10d80497f5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:39.995147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30b9a069-7872-49b6-8839-c10d80497f5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:39.995943 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30b9a069-7872-49b6-8839-c10d80497f5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:39.996431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30b9a069-7872-49b6-8839-c10d80497f5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:40.127095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-30b9a069-7872-49b6-8839-c10d80497f5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:40.134616 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-30b9a069-7872-49b6-8839-c10d80497f5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1679 microversion: 2.1 time: 0.152954 Jul 14 15:49:40.136222 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3731/7428] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:39 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:41.153340 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-27451e21-3ea1-45a6-99cd-0b0b02359af8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:41.154034 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-27451e21-3ea1-45a6-99cd-0b0b02359af8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:41.164847 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27451e21-3ea1-45a6-99cd-0b0b02359af8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:41.165334 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27451e21-3ea1-45a6-99cd-0b0b02359af8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:41.166717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27451e21-3ea1-45a6-99cd-0b0b02359af8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:41.167161 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-27451e21-3ea1-45a6-99cd-0b0b02359af8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:41.187780 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d4f9fe7-d901-4181-b484-84a90bcc1a95] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 55930. Jul 14 15:49:41.188486 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a22d85c6-ae9d-41d6-a69e-ea6ad90634fc] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 55928. Jul 14 15:49:41.309773 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-27451e21-3ea1-45a6-99cd-0b0b02359af8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:41.317345 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-27451e21-3ea1-45a6-99cd-0b0b02359af8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1679 microversion: 2.1 time: 0.168118 Jul 14 15:49:41.317919 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3698/7429] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:41 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:42.333854 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-47e7b6bd-986f-49f2-aa5a-bb49d5f16606 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:42.334488 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-47e7b6bd-986f-49f2-aa5a-bb49d5f16606 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:42.341471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47e7b6bd-986f-49f2-aa5a-bb49d5f16606 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:42.341935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47e7b6bd-986f-49f2-aa5a-bb49d5f16606 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:42.342718 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47e7b6bd-986f-49f2-aa5a-bb49d5f16606 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:42.343174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-47e7b6bd-986f-49f2-aa5a-bb49d5f16606 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:42.474883 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-47e7b6bd-986f-49f2-aa5a-bb49d5f16606 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:42.483311 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-47e7b6bd-986f-49f2-aa5a-bb49d5f16606 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1679 microversion: 2.1 time: 0.153310 Jul 14 15:49:42.483886 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3732/7430] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:42 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:43.501294 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-4ebb8ead-7872-483b-b245-03ec4ad889bb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:43.501886 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-4ebb8ead-7872-483b-b245-03ec4ad889bb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:43.508699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ebb8ead-7872-483b-b245-03ec4ad889bb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:43.509191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ebb8ead-7872-483b-b245-03ec4ad889bb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:43.510112 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ebb8ead-7872-483b-b245-03ec4ad889bb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:43.510552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-4ebb8ead-7872-483b-b245-03ec4ad889bb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:43.646762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-4ebb8ead-7872-483b-b245-03ec4ad889bb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:43.655819 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-4ebb8ead-7872-483b-b245-03ec4ad889bb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1679 microversion: 2.1 time: 0.158468 Jul 14 15:49:43.656389 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3699/7431] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:43 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:44.674291 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-803142c2-afdb-4a5e-bc24-ad51ffc49b5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:44.674920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-803142c2-afdb-4a5e-bc24-ad51ffc49b5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:44.682918 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-803142c2-afdb-4a5e-bc24-ad51ffc49b5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:44.683385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-803142c2-afdb-4a5e-bc24-ad51ffc49b5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:44.684170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-803142c2-afdb-4a5e-bc24-ad51ffc49b5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:44.684625 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-803142c2-afdb-4a5e-bc24-ad51ffc49b5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:44.820491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-803142c2-afdb-4a5e-bc24-ad51ffc49b5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:44.828053 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-803142c2-afdb-4a5e-bc24-ad51ffc49b5c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1679 microversion: 2.1 time: 0.157711 Jul 14 15:49:44.828626 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3733/7432] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:44 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:45.845086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5255e215-b409-4a7c-a15e-8149560cf8f3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:45.845719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5255e215-b409-4a7c-a15e-8149560cf8f3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:45.852719 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5255e215-b409-4a7c-a15e-8149560cf8f3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:45.853219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5255e215-b409-4a7c-a15e-8149560cf8f3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:45.854181 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5255e215-b409-4a7c-a15e-8149560cf8f3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:45.854633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5255e215-b409-4a7c-a15e-8149560cf8f3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:45.988300 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5255e215-b409-4a7c-a15e-8149560cf8f3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:45.996479 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5255e215-b409-4a7c-a15e-8149560cf8f3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1679 microversion: 2.1 time: 0.155387 Jul 14 15:49:45.997079 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3700/7433] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:45 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:47.014824 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-fe8600f9-4886-4e72-8015-9ba7d36a4ba0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:47.015450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-fe8600f9-4886-4e72-8015-9ba7d36a4ba0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:47.022088 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe8600f9-4886-4e72-8015-9ba7d36a4ba0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:47.022557 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe8600f9-4886-4e72-8015-9ba7d36a4ba0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:47.023344 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe8600f9-4886-4e72-8015-9ba7d36a4ba0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:47.023797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-fe8600f9-4886-4e72-8015-9ba7d36a4ba0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:47.157698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-fe8600f9-4886-4e72-8015-9ba7d36a4ba0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:47.165187 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-fe8600f9-4886-4e72-8015-9ba7d36a4ba0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1679 microversion: 2.1 time: 0.155572 Jul 14 15:49:47.165899 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3734/7434] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:47 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:48.182455 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c1aee7f8-9d52-49ab-b4cb-8f52fcf5b1a1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:48.182999 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c1aee7f8-9d52-49ab-b4cb-8f52fcf5b1a1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:48.190018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1aee7f8-9d52-49ab-b4cb-8f52fcf5b1a1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:48.190464 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1aee7f8-9d52-49ab-b4cb-8f52fcf5b1a1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:48.191219 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1aee7f8-9d52-49ab-b4cb-8f52fcf5b1a1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:48.191655 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c1aee7f8-9d52-49ab-b4cb-8f52fcf5b1a1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:48.320620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c1aee7f8-9d52-49ab-b4cb-8f52fcf5b1a1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:48.328262 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c1aee7f8-9d52-49ab-b4cb-8f52fcf5b1a1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1679 microversion: 2.1 time: 0.149902 Jul 14 15:49:48.328835 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3701/7435] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:48 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:49.346429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ed92fd0e-27ac-4cea-83ae-1b88bf78ee26 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:49.347302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ed92fd0e-27ac-4cea-83ae-1b88bf78ee26 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:49.357021 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed92fd0e-27ac-4cea-83ae-1b88bf78ee26 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:49.357510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed92fd0e-27ac-4cea-83ae-1b88bf78ee26 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:49.358317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed92fd0e-27ac-4cea-83ae-1b88bf78ee26 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:49.358778 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ed92fd0e-27ac-4cea-83ae-1b88bf78ee26 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:49.497615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ed92fd0e-27ac-4cea-83ae-1b88bf78ee26 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:49.505133 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ed92fd0e-27ac-4cea-83ae-1b88bf78ee26 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1700 microversion: 2.1 time: 0.163086 Jul 14 15:49:49.505699 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3735/7436] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:49 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1700 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:50.522807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ee0aeeac-b3f1-40fd-b7cf-bbb1b4614886 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:50.523424 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ee0aeeac-b3f1-40fd-b7cf-bbb1b4614886 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:50.530683 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee0aeeac-b3f1-40fd-b7cf-bbb1b4614886 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:50.531145 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee0aeeac-b3f1-40fd-b7cf-bbb1b4614886 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:50.531922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee0aeeac-b3f1-40fd-b7cf-bbb1b4614886 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:50.532380 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee0aeeac-b3f1-40fd-b7cf-bbb1b4614886 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:50.669659 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ee0aeeac-b3f1-40fd-b7cf-bbb1b4614886 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:50.677529 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ee0aeeac-b3f1-40fd-b7cf-bbb1b4614886 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1700 microversion: 2.1 time: 0.158628 Jul 14 15:49:50.678107 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3702/7437] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:50 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:51.695208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-09cb7364-83b0-466c-a688-9982c89d4bea tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:51.695840 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-09cb7364-83b0-466c-a688-9982c89d4bea tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:51.703440 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09cb7364-83b0-466c-a688-9982c89d4bea tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:51.703912 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09cb7364-83b0-466c-a688-9982c89d4bea tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:51.704695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09cb7364-83b0-466c-a688-9982c89d4bea tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:51.705190 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-09cb7364-83b0-466c-a688-9982c89d4bea tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:51.845694 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-09cb7364-83b0-466c-a688-9982c89d4bea tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:51.854167 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-09cb7364-83b0-466c-a688-9982c89d4bea tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1700 microversion: 2.1 time: 0.161948 Jul 14 15:49:51.854885 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3736/7438] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:51 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1700 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:52.630330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-963c588b-490a-4bc2-8a9b-861c8d2ee6c9 req-57d22cc9-7b85-4714-bbb5-91e68cadae94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f3ccc6-e654-4f73-aa27-eb24e616eed5", "name": "network-vif-plugged", "status": "completed", "tag": "66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:52.646482 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-963c588b-490a-4bc2-8a9b-861c8d2ee6c9 req-57d22cc9-7b85-4714-bbb5-91e68cadae94 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:52.647857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-963c588b-490a-4bc2-8a9b-861c8d2ee6c9 req-57d22cc9-7b85-4714-bbb5-91e68cadae94 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:52.667064 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-963c588b-490a-4bc2-8a9b-861c8d2ee6c9 req-57d22cc9-7b85-4714-bbb5-91e68cadae94 service nova] Creating event network-vif-plugged:66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78 for instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 on n-h1-767704-28 Jul 14 15:49:52.678536 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-963c588b-490a-4bc2-8a9b-861c8d2ee6c9 req-57d22cc9-7b85-4714-bbb5-91e68cadae94 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054917 Jul 14 15:49:52.680406 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3703/7439] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:52.872046 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-da09127c-91e0-47ed-8cb2-1dc0f955f3a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:52.873333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-da09127c-91e0-47ed-8cb2-1dc0f955f3a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:52.880735 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da09127c-91e0-47ed-8cb2-1dc0f955f3a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:52.881283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da09127c-91e0-47ed-8cb2-1dc0f955f3a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:52.882105 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da09127c-91e0-47ed-8cb2-1dc0f955f3a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:52.882562 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-da09127c-91e0-47ed-8cb2-1dc0f955f3a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:53.048273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-da09127c-91e0-47ed-8cb2-1dc0f955f3a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:53.058108 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-da09127c-91e0-47ed-8cb2-1dc0f955f3a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1695 microversion: 2.1 time: 0.189980 Jul 14 15:49:53.058696 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3737/7440] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:52 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:54.090456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be4be91a-5a1c-4144-9353-a7f65d2737c6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:54.092799 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-be4be91a-5a1c-4144-9353-a7f65d2737c6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:54.102395 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be4be91a-5a1c-4144-9353-a7f65d2737c6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:54.102950 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be4be91a-5a1c-4144-9353-a7f65d2737c6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:54.103970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be4be91a-5a1c-4144-9353-a7f65d2737c6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:54.104487 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be4be91a-5a1c-4144-9353-a7f65d2737c6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:54.260692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-be4be91a-5a1c-4144-9353-a7f65d2737c6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:54.269145 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-be4be91a-5a1c-4144-9353-a7f65d2737c6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1695 microversion: 2.1 time: 0.197019 Jul 14 15:49:54.270424 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3704/7441] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:54 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1695 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:55.288572 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-543c2b0e-123b-49cc-9544-36cd1d24efba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:55.289357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-543c2b0e-123b-49cc-9544-36cd1d24efba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:55.297367 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-543c2b0e-123b-49cc-9544-36cd1d24efba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:55.298048 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-543c2b0e-123b-49cc-9544-36cd1d24efba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:55.299197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-543c2b0e-123b-49cc-9544-36cd1d24efba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:55.300374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-543c2b0e-123b-49cc-9544-36cd1d24efba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:55.469330 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-543c2b0e-123b-49cc-9544-36cd1d24efba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:55.482679 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-543c2b0e-123b-49cc-9544-36cd1d24efba tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1695 microversion: 2.1 time: 0.199537 Jul 14 15:49:55.483545 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3738/7442] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:55 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1695 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:56.500856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-479c4e30-8804-4d19-a92d-4badc35abb15 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:56.502439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-479c4e30-8804-4d19-a92d-4badc35abb15 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:56.509463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-479c4e30-8804-4d19-a92d-4badc35abb15 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:56.510119 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-479c4e30-8804-4d19-a92d-4badc35abb15 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:56.511077 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-479c4e30-8804-4d19-a92d-4badc35abb15 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:56.515075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-479c4e30-8804-4d19-a92d-4badc35abb15 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:56.670118 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-479c4e30-8804-4d19-a92d-4badc35abb15 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:56.678233 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-479c4e30-8804-4d19-a92d-4badc35abb15 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1695 microversion: 2.1 time: 0.181294 Jul 14 15:49:56.690188 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3705/7443] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:56 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:57.698530 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4d69560c-761f-4ecb-9f74-1ab15464e48b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:57.700638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4d69560c-761f-4ecb-9f74-1ab15464e48b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:57.710646 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d69560c-761f-4ecb-9f74-1ab15464e48b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:57.711444 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d69560c-761f-4ecb-9f74-1ab15464e48b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:57.713345 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d69560c-761f-4ecb-9f74-1ab15464e48b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:57.714000 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4d69560c-761f-4ecb-9f74-1ab15464e48b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:57.880741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4d69560c-761f-4ecb-9f74-1ab15464e48b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:57.889899 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4d69560c-761f-4ecb-9f74-1ab15464e48b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1695 microversion: 2.1 time: 0.195918 Jul 14 15:49:57.890472 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3739/7444] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:57 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1695 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:58.911923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3d84315c-934b-4800-8dbd-d5944fdbaff4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:58.912536 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3d84315c-934b-4800-8dbd-d5944fdbaff4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:58.921630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3d84315c-934b-4800-8dbd-d5944fdbaff4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:58.922074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3d84315c-934b-4800-8dbd-d5944fdbaff4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:58.922890 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3d84315c-934b-4800-8dbd-d5944fdbaff4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:58.923378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3d84315c-934b-4800-8dbd-d5944fdbaff4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:59.081139 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3d84315c-934b-4800-8dbd-d5944fdbaff4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:59.089609 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3d84315c-934b-4800-8dbd-d5944fdbaff4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1695 microversion: 2.1 time: 0.181735 Jul 14 15:49:59.090445 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3706/7445] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:58 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:00.107890 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b1792fdb-351b-44ba-95fe-c118b036847e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:00.108520 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b1792fdb-351b-44ba-95fe-c118b036847e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:00.115623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1792fdb-351b-44ba-95fe-c118b036847e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:00.116090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1792fdb-351b-44ba-95fe-c118b036847e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:00.117288 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1792fdb-351b-44ba-95fe-c118b036847e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:00.117387 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b1792fdb-351b-44ba-95fe-c118b036847e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:00.269764 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b1792fdb-351b-44ba-95fe-c118b036847e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:00.279799 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b1792fdb-351b-44ba-95fe-c118b036847e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1695 microversion: 2.1 time: 0.176768 Jul 14 15:50:00.280674 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3740/7446] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:00 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:50:01.297782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-aecafde4-c926-4a87-ad08-9009d5afc31a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:01.298387 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-aecafde4-c926-4a87-ad08-9009d5afc31a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:01.305877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aecafde4-c926-4a87-ad08-9009d5afc31a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:01.306651 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aecafde4-c926-4a87-ad08-9009d5afc31a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:01.307274 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aecafde4-c926-4a87-ad08-9009d5afc31a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:01.307727 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-aecafde4-c926-4a87-ad08-9009d5afc31a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:01.452248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-aecafde4-c926-4a87-ad08-9009d5afc31a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:01.460038 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-aecafde4-c926-4a87-ad08-9009d5afc31a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1695 microversion: 2.1 time: 0.166481 Jul 14 15:50:01.460616 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3707/7447] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:01 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:02.478566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-73b6e3c1-db33-4919-8d66-52d232c395ee tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:02.479199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-73b6e3c1-db33-4919-8d66-52d232c395ee tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:02.486934 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73b6e3c1-db33-4919-8d66-52d232c395ee tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:02.487455 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73b6e3c1-db33-4919-8d66-52d232c395ee tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:02.488113 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73b6e3c1-db33-4919-8d66-52d232c395ee tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:02.488568 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-73b6e3c1-db33-4919-8d66-52d232c395ee tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:02.620422 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-73b6e3c1-db33-4919-8d66-52d232c395ee tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:02.627958 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-73b6e3c1-db33-4919-8d66-52d232c395ee tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1677 microversion: 2.1 time: 0.154011 Jul 14 15:50:02.628530 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3741/7448] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:02 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:03.646471 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7a324568-8786-4641-8da6-954fd413b2c8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:03.647072 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7a324568-8786-4641-8da6-954fd413b2c8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:03.654044 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a324568-8786-4641-8da6-954fd413b2c8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:03.654491 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a324568-8786-4641-8da6-954fd413b2c8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:03.655283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a324568-8786-4641-8da6-954fd413b2c8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:03.655723 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7a324568-8786-4641-8da6-954fd413b2c8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:03.799203 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7a324568-8786-4641-8da6-954fd413b2c8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:03.806949 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7a324568-8786-4641-8da6-954fd413b2c8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1677 microversion: 2.1 time: 0.164375 Jul 14 15:50:03.807528 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3708/7449] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:03 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:04.824674 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-00a910f3-be18-43a6-acf8-5369bd7a1b7f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:04.825325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-00a910f3-be18-43a6-acf8-5369bd7a1b7f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:04.832231 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00a910f3-be18-43a6-acf8-5369bd7a1b7f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:04.832690 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00a910f3-be18-43a6-acf8-5369bd7a1b7f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:04.833500 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00a910f3-be18-43a6-acf8-5369bd7a1b7f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:04.833949 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-00a910f3-be18-43a6-acf8-5369bd7a1b7f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:04.965072 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-00a910f3-be18-43a6-acf8-5369bd7a1b7f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:04.972800 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-00a910f3-be18-43a6-acf8-5369bd7a1b7f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1620 microversion: 2.1 time: 0.152642 Jul 14 15:50:04.973406 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3742/7450] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:04 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1620 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:04.990265 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ad55ff5f-131f-4c3e-bedb-7a89280cf003 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:50:04.990841 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ad55ff5f-131f-4c3e-bedb-7a89280cf003 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:04.999024 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad55ff5f-131f-4c3e-bedb-7a89280cf003 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:04.999484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad55ff5f-131f-4c3e-bedb-7a89280cf003 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:05.000257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad55ff5f-131f-4c3e-bedb-7a89280cf003 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:05.000701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ad55ff5f-131f-4c3e-bedb-7a89280cf003 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:05.141534 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ad55ff5f-131f-4c3e-bedb-7a89280cf003 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "POST /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5/action" status: 202 len: 0 microversion: 2.1 time: 0.154702 Jul 14 15:50:05.142168 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3709/7451] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:50:04 2022] POST /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:50:05.151308 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4a4f0792-bdcc-406e-a83f-d75185e9ecf6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:05.152210 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4a4f0792-bdcc-406e-a83f-d75185e9ecf6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:05.158007 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a4f0792-bdcc-406e-a83f-d75185e9ecf6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:05.158482 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a4f0792-bdcc-406e-a83f-d75185e9ecf6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:05.159283 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a4f0792-bdcc-406e-a83f-d75185e9ecf6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:05.159987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4a4f0792-bdcc-406e-a83f-d75185e9ecf6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:05.305010 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4a4f0792-bdcc-406e-a83f-d75185e9ecf6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:05.313676 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4a4f0792-bdcc-406e-a83f-d75185e9ecf6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1628 microversion: 2.1 time: 0.167412 Jul 14 15:50:05.314349 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3743/7452] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:05 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1628 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:06.332484 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ddeab0ce-60d4-445b-a204-07b5f9e8c882 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:06.333165 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ddeab0ce-60d4-445b-a204-07b5f9e8c882 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:06.339884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddeab0ce-60d4-445b-a204-07b5f9e8c882 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:06.340338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddeab0ce-60d4-445b-a204-07b5f9e8c882 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:06.341142 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddeab0ce-60d4-445b-a204-07b5f9e8c882 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:06.341583 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ddeab0ce-60d4-445b-a204-07b5f9e8c882 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:06.472717 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ddeab0ce-60d4-445b-a204-07b5f9e8c882 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:06.480787 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ddeab0ce-60d4-445b-a204-07b5f9e8c882 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.153097 Jul 14 15:50:06.481400 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3710/7453] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:06 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:06.708670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-8b2626b4-214c-46fc-baf5-0fb52f137491 req-cb7ececc-84f0-471c-a6b2-ae0f27527c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f3ccc6-e654-4f73-aa27-eb24e616eed5", "name": "network-vif-unplugged", "status": "completed", "tag": "66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:50:06.720600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8b2626b4-214c-46fc-baf5-0fb52f137491 req-cb7ececc-84f0-471c-a6b2-ae0f27527c44 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:06.721187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-8b2626b4-214c-46fc-baf5-0fb52f137491 req-cb7ececc-84f0-471c-a6b2-ae0f27527c44 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:06.733924 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-8b2626b4-214c-46fc-baf5-0fb52f137491 req-cb7ececc-84f0-471c-a6b2-ae0f27527c44 service nova] Creating event network-vif-unplugged:66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78 for instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 on n-h2-767704-28 Jul 14 15:50:06.739336 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-8b2626b4-214c-46fc-baf5-0fb52f137491 req-cb7ececc-84f0-471c-a6b2-ae0f27527c44 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034343 Jul 14 15:50:06.739948 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3744/7454] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:50:07.498970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-85669377-4afa-470d-9b9a-3f3ec9fb77a6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:07.499682 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-85669377-4afa-470d-9b9a-3f3ec9fb77a6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:07.506572 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85669377-4afa-470d-9b9a-3f3ec9fb77a6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:07.507033 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85669377-4afa-470d-9b9a-3f3ec9fb77a6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:07.507807 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85669377-4afa-470d-9b9a-3f3ec9fb77a6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:07.508245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-85669377-4afa-470d-9b9a-3f3ec9fb77a6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:07.724792 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-85669377-4afa-470d-9b9a-3f3ec9fb77a6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:07.731635 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-85669377-4afa-470d-9b9a-3f3ec9fb77a6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.236576 Jul 14 15:50:07.732403 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3711/7455] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:07 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:50:08.275512 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-dde00070-3345-470d-8cce-62836a82bf16 req-4af0f36f-5e31-48ac-a19f-7f6584297937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f3ccc6-e654-4f73-aa27-eb24e616eed5", "tag": "66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:50:08.286332 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=31 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:08.289253 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-dde00070-3345-470d-8cce-62836a82bf16 req-4af0f36f-5e31-48ac-a19f-7f6584297937 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:08.289724 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-dde00070-3345-470d-8cce-62836a82bf16 req-4af0f36f-5e31-48ac-a19f-7f6584297937 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:08.295257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:08.304611 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-dde00070-3345-470d-8cce-62836a82bf16 req-4af0f36f-5e31-48ac-a19f-7f6584297937 service nova] Creating event network-changed:66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78 for instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 on n-h2-767704-28 Jul 14 15:50:08.311100 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-dde00070-3345-470d-8cce-62836a82bf16 req-4af0f36f-5e31-48ac-a19f-7f6584297937 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039981 Jul 14 15:50:08.311736 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3745/7456] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:50:08.748708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d47a79ba-2086-4b69-8f7a-7346fc665083 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:08.749959 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d47a79ba-2086-4b69-8f7a-7346fc665083 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:08.756766 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d47a79ba-2086-4b69-8f7a-7346fc665083 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:08.757245 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d47a79ba-2086-4b69-8f7a-7346fc665083 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:08.758016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d47a79ba-2086-4b69-8f7a-7346fc665083 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:08.758456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d47a79ba-2086-4b69-8f7a-7346fc665083 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:08.920557 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d47a79ba-2086-4b69-8f7a-7346fc665083 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:08.926180 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:08.934116 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d47a79ba-2086-4b69-8f7a-7346fc665083 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.189292 Jul 14 15:50:08.946051 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3712/7457] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:08 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:08.997236 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:50:08.997446 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:50:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:50:09.053916 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:50:09.054144 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:50:09.954545 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-38c3075d-8985-41aa-bcb0-03a06485f53b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:09.955274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-38c3075d-8985-41aa-bcb0-03a06485f53b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:09.964858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38c3075d-8985-41aa-bcb0-03a06485f53b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:09.965358 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38c3075d-8985-41aa-bcb0-03a06485f53b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:09.966166 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38c3075d-8985-41aa-bcb0-03a06485f53b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:09.966630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-38c3075d-8985-41aa-bcb0-03a06485f53b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:10.182464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-38c3075d-8985-41aa-bcb0-03a06485f53b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:10.191347 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-38c3075d-8985-41aa-bcb0-03a06485f53b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.241340 Jul 14 15:50:10.192168 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3746/7458] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:09 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:11.209066 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-59fe1e71-2ed2-4ae3-a271-70b546f4924a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:11.209679 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-59fe1e71-2ed2-4ae3-a271-70b546f4924a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:11.212769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=35 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:11.218716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59fe1e71-2ed2-4ae3-a271-70b546f4924a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:11.219170 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59fe1e71-2ed2-4ae3-a271-70b546f4924a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:11.219939 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59fe1e71-2ed2-4ae3-a271-70b546f4924a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:11.220377 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-59fe1e71-2ed2-4ae3-a271-70b546f4924a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:11.659407 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-59fe1e71-2ed2-4ae3-a271-70b546f4924a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:11.667729 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-59fe1e71-2ed2-4ae3-a271-70b546f4924a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.462444 Jul 14 15:50:11.668324 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3713/7459] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:11 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:12.094656 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:50:12.094887 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 15:50:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:50:12.689725 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dda4346c-9111-448a-a3ce-12587df4b49a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:12.690569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dda4346c-9111-448a-a3ce-12587df4b49a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:12.699812 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dda4346c-9111-448a-a3ce-12587df4b49a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:12.700290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dda4346c-9111-448a-a3ce-12587df4b49a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:12.701109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dda4346c-9111-448a-a3ce-12587df4b49a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:12.701588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dda4346c-9111-448a-a3ce-12587df4b49a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:12.850700 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dda4346c-9111-448a-a3ce-12587df4b49a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:12.858354 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dda4346c-9111-448a-a3ce-12587df4b49a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.177511 Jul 14 15:50:12.858928 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3747/7460] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:12 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:13.875744 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a2e756bf-4dc7-4111-8226-747957653ebb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:13.876363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a2e756bf-4dc7-4111-8226-747957653ebb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:13.883466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2e756bf-4dc7-4111-8226-747957653ebb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:13.884434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2e756bf-4dc7-4111-8226-747957653ebb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:13.885439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2e756bf-4dc7-4111-8226-747957653ebb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:13.885873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a2e756bf-4dc7-4111-8226-747957653ebb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:14.038917 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a2e756bf-4dc7-4111-8226-747957653ebb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:14.048350 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a2e756bf-4dc7-4111-8226-747957653ebb tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.176391 Jul 14 15:50:14.052987 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3714/7461] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:13 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:15.066095 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-94d19953-2eb6-4abc-b58d-03962c6650c0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:15.067445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-94d19953-2eb6-4abc-b58d-03962c6650c0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:15.076372 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94d19953-2eb6-4abc-b58d-03962c6650c0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:15.077230 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94d19953-2eb6-4abc-b58d-03962c6650c0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:15.078403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94d19953-2eb6-4abc-b58d-03962c6650c0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:15.079069 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-94d19953-2eb6-4abc-b58d-03962c6650c0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:15.225780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-94d19953-2eb6-4abc-b58d-03962c6650c0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:15.235819 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-94d19953-2eb6-4abc-b58d-03962c6650c0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.173662 Jul 14 15:50:15.236604 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3748/7462] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:15 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:16.254080 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c7b5abb3-fdb0-40f9-94f6-149fc0f63248 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:16.254687 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c7b5abb3-fdb0-40f9-94f6-149fc0f63248 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:16.262289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7b5abb3-fdb0-40f9-94f6-149fc0f63248 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:16.262754 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7b5abb3-fdb0-40f9-94f6-149fc0f63248 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:16.263794 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7b5abb3-fdb0-40f9-94f6-149fc0f63248 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:16.264242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c7b5abb3-fdb0-40f9-94f6-149fc0f63248 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:16.407753 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c7b5abb3-fdb0-40f9-94f6-149fc0f63248 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:16.415834 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c7b5abb3-fdb0-40f9-94f6-149fc0f63248 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.165131 Jul 14 15:50:16.416406 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3715/7463] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:16 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:17.432701 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7d791bd7-5080-4a6a-a1e3-bd856be8f35c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:17.433350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7d791bd7-5080-4a6a-a1e3-bd856be8f35c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:17.439996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d791bd7-5080-4a6a-a1e3-bd856be8f35c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:17.440458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d791bd7-5080-4a6a-a1e3-bd856be8f35c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:17.441259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d791bd7-5080-4a6a-a1e3-bd856be8f35c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:17.441711 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7d791bd7-5080-4a6a-a1e3-bd856be8f35c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:17.588390 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7d791bd7-5080-4a6a-a1e3-bd856be8f35c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:17.597833 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7d791bd7-5080-4a6a-a1e3-bd856be8f35c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.169156 Jul 14 15:50:17.598415 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3749/7464] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:17 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:18.615721 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6906fe74-472e-4532-94dc-d81e97fb20ca tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:18.616437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6906fe74-472e-4532-94dc-d81e97fb20ca tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:18.624206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6906fe74-472e-4532-94dc-d81e97fb20ca tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:18.624745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6906fe74-472e-4532-94dc-d81e97fb20ca tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:18.625555 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6906fe74-472e-4532-94dc-d81e97fb20ca tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:18.626005 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6906fe74-472e-4532-94dc-d81e97fb20ca tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:18.762951 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6906fe74-472e-4532-94dc-d81e97fb20ca tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:18.770746 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6906fe74-472e-4532-94dc-d81e97fb20ca tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.159042 Jul 14 15:50:18.771316 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3716/7465] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:18 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:19.787774 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-06557f24-7ce8-4e2f-9063-d97d38cc0bd8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:19.788427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-06557f24-7ce8-4e2f-9063-d97d38cc0bd8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:19.796675 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06557f24-7ce8-4e2f-9063-d97d38cc0bd8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:19.797191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06557f24-7ce8-4e2f-9063-d97d38cc0bd8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:19.797985 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06557f24-7ce8-4e2f-9063-d97d38cc0bd8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:19.798469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-06557f24-7ce8-4e2f-9063-d97d38cc0bd8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:19.947350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-06557f24-7ce8-4e2f-9063-d97d38cc0bd8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:19.955190 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-06557f24-7ce8-4e2f-9063-d97d38cc0bd8 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.171336 Jul 14 15:50:19.955958 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3750/7466] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:19 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:50:20.972467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d7dbecf4-5a63-43e3-a552-34871981ecff tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:20.973128 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d7dbecf4-5a63-43e3-a552-34871981ecff tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:20.981209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7dbecf4-5a63-43e3-a552-34871981ecff tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:20.981658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7dbecf4-5a63-43e3-a552-34871981ecff tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:20.982430 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7dbecf4-5a63-43e3-a552-34871981ecff tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:20.982866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d7dbecf4-5a63-43e3-a552-34871981ecff tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:21.115996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d7dbecf4-5a63-43e3-a552-34871981ecff tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:21.123453 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d7dbecf4-5a63-43e3-a552-34871981ecff tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.154954 Jul 14 15:50:21.124019 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3717/7467] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:20 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:22.140457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ee6e296a-cd0a-48a4-9145-72cd713a07ab tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:22.141136 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ee6e296a-cd0a-48a4-9145-72cd713a07ab tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:22.148208 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee6e296a-cd0a-48a4-9145-72cd713a07ab tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:22.148676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee6e296a-cd0a-48a4-9145-72cd713a07ab tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:22.150159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee6e296a-cd0a-48a4-9145-72cd713a07ab tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:22.150621 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ee6e296a-cd0a-48a4-9145-72cd713a07ab tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:22.287147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ee6e296a-cd0a-48a4-9145-72cd713a07ab tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:22.295540 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ee6e296a-cd0a-48a4-9145-72cd713a07ab tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.159273 Jul 14 15:50:22.296121 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3751/7468] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:22 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:23.312630 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0063213f-3ab2-4e6d-8a3a-d6dd85674bc6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:23.313279 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0063213f-3ab2-4e6d-8a3a-d6dd85674bc6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:23.320248 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0063213f-3ab2-4e6d-8a3a-d6dd85674bc6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:23.320693 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0063213f-3ab2-4e6d-8a3a-d6dd85674bc6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:23.321704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0063213f-3ab2-4e6d-8a3a-d6dd85674bc6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:23.322169 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0063213f-3ab2-4e6d-8a3a-d6dd85674bc6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:23.451758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-0063213f-3ab2-4e6d-8a3a-d6dd85674bc6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:23.459200 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0063213f-3ab2-4e6d-8a3a-d6dd85674bc6 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.150458 Jul 14 15:50:23.459770 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3718/7469] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:23 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:23.753738 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-a8a6b0d6-f689-4533-80b1-fa9723546342 req-b3ef6aa3-cd6c-416e-a144-cfd7f81f1c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f3ccc6-e654-4f73-aa27-eb24e616eed5", "name": "network-vif-plugged", "status": "completed", "tag": "66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:50:23.766437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a8a6b0d6-f689-4533-80b1-fa9723546342 req-b3ef6aa3-cd6c-416e-a144-cfd7f81f1c7c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:23.766908 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-a8a6b0d6-f689-4533-80b1-fa9723546342 req-b3ef6aa3-cd6c-416e-a144-cfd7f81f1c7c service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:23.778828 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-a8a6b0d6-f689-4533-80b1-fa9723546342 req-b3ef6aa3-cd6c-416e-a144-cfd7f81f1c7c service nova] Creating event network-vif-plugged:66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78 for instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 on n-h2-767704-28 Jul 14 15:50:23.783903 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-a8a6b0d6-f689-4533-80b1-fa9723546342 req-b3ef6aa3-cd6c-416e-a144-cfd7f81f1c7c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033937 Jul 14 15:50:23.784575 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3752/7470] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:50:24.476998 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-50fbc6ec-0f39-436b-8231-aee537373b91 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:24.478214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-50fbc6ec-0f39-436b-8231-aee537373b91 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:24.485071 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50fbc6ec-0f39-436b-8231-aee537373b91 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:24.485533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50fbc6ec-0f39-436b-8231-aee537373b91 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:24.486301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50fbc6ec-0f39-436b-8231-aee537373b91 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:24.486745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-50fbc6ec-0f39-436b-8231-aee537373b91 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:24.616218 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-50fbc6ec-0f39-436b-8231-aee537373b91 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:24.624440 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-50fbc6ec-0f39-436b-8231-aee537373b91 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.151377 Jul 14 15:50:24.625051 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3719/7471] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:24 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:25.644706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a6d43741-62b1-4847-98fb-9bda263d4ce2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:25.645933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a6d43741-62b1-4847-98fb-9bda263d4ce2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:25.653926 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6d43741-62b1-4847-98fb-9bda263d4ce2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:25.654403 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6d43741-62b1-4847-98fb-9bda263d4ce2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:25.655687 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6d43741-62b1-4847-98fb-9bda263d4ce2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:25.656236 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a6d43741-62b1-4847-98fb-9bda263d4ce2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:25.816863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a6d43741-62b1-4847-98fb-9bda263d4ce2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:25.826313 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a6d43741-62b1-4847-98fb-9bda263d4ce2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1686 microversion: 2.1 time: 0.188052 Jul 14 15:50:25.827242 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3753/7472] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:25 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1686 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:26.845518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-d34a20b3-ffbd-4b02-b17e-84710732cc10 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:26.846130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-d34a20b3-ffbd-4b02-b17e-84710732cc10 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:26.853573 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d34a20b3-ffbd-4b02-b17e-84710732cc10 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:26.854022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d34a20b3-ffbd-4b02-b17e-84710732cc10 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:26.854868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d34a20b3-ffbd-4b02-b17e-84710732cc10 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:26.855305 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-d34a20b3-ffbd-4b02-b17e-84710732cc10 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:26.986866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-d34a20b3-ffbd-4b02-b17e-84710732cc10 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:26.995011 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-d34a20b3-ffbd-4b02-b17e-84710732cc10 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1673 microversion: 2.1 time: 0.153420 Jul 14 15:50:26.995674 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3720/7473] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:26 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:41.849754 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=17 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:41.851159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=45 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:41.853893 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-2622c726-d8a6-4ddf-b60a-ee855123f76a req-184fc589-9824-4ba6-8b23-1bd7597dc4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f3ccc6-e654-4f73-aa27-eb24e616eed5", "tag": "66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:51:41.856480 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0881062c-9bf8-41ef-a059-caa5276f0fc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:41.857096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0881062c-9bf8-41ef-a059-caa5276f0fc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:41.859422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=15 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:41.860191 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=49 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:41.864807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0881062c-9bf8-41ef-a059-caa5276f0fc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:41.865330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2622c726-d8a6-4ddf-b60a-ee855123f76a req-184fc589-9824-4ba6-8b23-1bd7597dc4b5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:41.865456 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0881062c-9bf8-41ef-a059-caa5276f0fc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:41.865781 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-2622c726-d8a6-4ddf-b60a-ee855123f76a req-184fc589-9824-4ba6-8b23-1bd7597dc4b5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:41.866273 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0881062c-9bf8-41ef-a059-caa5276f0fc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:41.866811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0881062c-9bf8-41ef-a059-caa5276f0fc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:41.877995 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-2622c726-d8a6-4ddf-b60a-ee855123f76a req-184fc589-9824-4ba6-8b23-1bd7597dc4b5 service nova] Creating event network-changed:66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78 for instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 on n-h2-767704-28 Jul 14 15:51:41.884563 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-2622c726-d8a6-4ddf-b60a-ee855123f76a req-184fc589-9824-4ba6-8b23-1bd7597dc4b5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034406 Jul 14 15:51:41.885389 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3721/7474] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:51:41.894734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0881062c-9bf8-41ef-a059-caa5276f0fc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:51:41.986681 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0881062c-9bf8-41ef-a059-caa5276f0fc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "DELETE /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 204 len: 0 microversion: 2.1 time: 0.139166 Jul 14 15:51:41.991087 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3754/7475] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:51:41 2022] DELETE /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:51:41.997411 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-044e9609-659f-4084-8912-0a86fb435b2d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:41.999051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-044e9609-659f-4084-8912-0a86fb435b2d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:42.006822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-044e9609-659f-4084-8912-0a86fb435b2d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:42.007325 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-044e9609-659f-4084-8912-0a86fb435b2d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:42.008399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-044e9609-659f-4084-8912-0a86fb435b2d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:42.010046 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-044e9609-659f-4084-8912-0a86fb435b2d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:42.157126 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-044e9609-659f-4084-8912-0a86fb435b2d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:42.164636 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-044e9609-659f-4084-8912-0a86fb435b2d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1679 microversion: 2.1 time: 0.172116 Jul 14 15:51:42.166102 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3722/7476] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:41 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:51:43.183910 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c480df95-91fa-4cac-aee1-25faa2ce9f4c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:43.184623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c480df95-91fa-4cac-aee1-25faa2ce9f4c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:43.191782 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c480df95-91fa-4cac-aee1-25faa2ce9f4c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:43.192241 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c480df95-91fa-4cac-aee1-25faa2ce9f4c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:43.193040 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c480df95-91fa-4cac-aee1-25faa2ce9f4c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:43.193497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c480df95-91fa-4cac-aee1-25faa2ce9f4c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:43.327301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c480df95-91fa-4cac-aee1-25faa2ce9f4c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:43.335110 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c480df95-91fa-4cac-aee1-25faa2ce9f4c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1679 microversion: 2.1 time: 0.156154 Jul 14 15:51:43.335686 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3755/7477] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:43 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:44.133151 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-79fed92d-0f6b-4820-8610-1ffd6fc19ebc req-8b9d4a6e-5761-400d-bbcd-00805106f44f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f3ccc6-e654-4f73-aa27-eb24e616eed5", "name": "network-vif-deleted", "tag": "66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:51:44.142791 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-79fed92d-0f6b-4820-8610-1ffd6fc19ebc req-8b9d4a6e-5761-400d-bbcd-00805106f44f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:44.143332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-79fed92d-0f6b-4820-8610-1ffd6fc19ebc req-8b9d4a6e-5761-400d-bbcd-00805106f44f service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:44.158261 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-79fed92d-0f6b-4820-8610-1ffd6fc19ebc req-8b9d4a6e-5761-400d-bbcd-00805106f44f service nova] Creating event network-vif-deleted:66003bf1-0b2e-4cb9-b6da-ff35d1e2cd78 for instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 on n-h2-767704-28 Jul 14 15:51:44.163417 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-79fed92d-0f6b-4820-8610-1ffd6fc19ebc req-8b9d4a6e-5761-400d-bbcd-00805106f44f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099407 Jul 14 15:51:44.164021 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3723/7478] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:51:44.354317 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-41e57043-026a-4eec-8604-30e88beb1bad tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:44.354953 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-41e57043-026a-4eec-8604-30e88beb1bad tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:44.362152 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41e57043-026a-4eec-8604-30e88beb1bad tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:44.362630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41e57043-026a-4eec-8604-30e88beb1bad tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:44.363431 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41e57043-026a-4eec-8604-30e88beb1bad tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:44.363895 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41e57043-026a-4eec-8604-30e88beb1bad tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:44.398457 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41e57043-026a-4eec-8604-30e88beb1bad tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:44.398924 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-41e57043-026a-4eec-8604-30e88beb1bad tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:44.399652 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-41e57043-026a-4eec-8604-30e88beb1bad tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lazy-loading 'fault' on Instance uuid 40f3ccc6-e654-4f73-aa27-eb24e616eed5 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:51:44.442682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-41e57043-026a-4eec-8604-30e88beb1bad tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:44.451711 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-41e57043-026a-4eec-8604-30e88beb1bad tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 200 len: 1336 microversion: 2.1 time: 0.101789 Jul 14 15:51:44.452457 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3756/7479] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:44 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:45.470579 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0f284e1e-41a3-4dd5-8f1f-05aa00f4957f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:45.471304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-0f284e1e-41a3-4dd5-8f1f-05aa00f4957f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: 40f3ccc6-e654-4f73-aa27-eb24e616eed5] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:45.478748 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f284e1e-41a3-4dd5-8f1f-05aa00f4957f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:45.479212 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f284e1e-41a3-4dd5-8f1f-05aa00f4957f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:45.479993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f284e1e-41a3-4dd5-8f1f-05aa00f4957f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:45.480439 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-0f284e1e-41a3-4dd5-8f1f-05aa00f4957f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:45.494631 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.wsgi [None req-0f284e1e-41a3-4dd5-8f1f-05aa00f4957f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] HTTP exception thrown: Instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 could not be found. Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0f284e1e-41a3-4dd5-8f1f-05aa00f4957f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Request method failure captured: Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: request: GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 HTTP/1.1 Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: Accept: application/json Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: Accept-Encoding: identity Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: Connection: close Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: Content-Length: 0 Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: Content-Type: application/json Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: Host: 10.222.0.81 Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: Openstack-System-Scope: None Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: User-Agent: python-urllib3/1.26.9 Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Auth-Token: gAAAAABi0Dp_RrYIvbDxL5KVtZdDGg24ojn1r-BHjZSgBTFS7DJWQch6sY8I5frAf7wvZGi7tRxpovLhDAySP4w37Ss_0wyw-P-nGJm2JA-Y4O9GVPXs4D82di2oeWRYNuOAWvVcnaGlDC1Mv-OHJAGfZQ7YiXhzIpzVENZo_Wmaf8ijnEVRqFQ Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Id: None Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Domain-Name: None Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Identity-Status: Confirmed Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Is-Admin-Project: True Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Id: default Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Domain-Name: Default Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Id: 96db3341b9c747eba0451cbd45afabf4 Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Project-Name: tempest-TestShelveInstance-1535730201 Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Role: reader,member Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Roles: reader,member Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/96db3341b9c747eba0451cbd45afabf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/96db3341b9c747eba0451cbd45afabf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_96db3341b9c747eba0451cbd45afabf4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/96db3341b9c747eba0451cbd45afabf4"}]}] Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant: tempest-TestShelveInstance-1535730201 Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Id: 96db3341b9c747eba0451cbd45afabf4 Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-Tenant-Name: tempest-TestShelveInstance-1535730201 Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-User: tempest-TestShelveInstance-1535730201-project Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Id: default Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-User-Domain-Name: Default Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-User-Id: 9dd4c1e8688a446baef7fcb7b7f9c1ec Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: X-User-Name: tempest-TestShelveInstance-1535730201-project Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: method: > Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: exception: Instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 could not be found. Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: action_args: {'id': '40f3ccc6-e654-4f73-aa27-eb24e616eed5'} Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 could not be found. Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 could not be found. Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:51:45.496259 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:51:45.501477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:51:45.501477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:51:45.501477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:51:45.501477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:51:45.501477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:51:45.501477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 could not be found. Jul 14 15:51:45.501477 n-d-767704-28 devstack@n-api.service[119511]: ERROR nova.api.openstack.wsgi Jul 14 15:51:45.501477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-0f284e1e-41a3-4dd5-8f1f-05aa00f4957f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Returning 404 to user: Instance 40f3ccc6-e654-4f73-aa27-eb24e616eed5 could not be found. {{(pid=119511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:51:45.501477 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-0f284e1e-41a3-4dd5-8f1f-05aa00f4957f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5" status: 404 len: 111 microversion: 2.1 time: 0.032477 Jul 14 15:51:45.501477 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3724/7480] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:45 2022] GET /compute/v2.1/servers/40f3ccc6-e654-4f73-aa27-eb24e616eed5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:51:45.660722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8af83a93-2d39-426f-9cd4-598f5f56eb73 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '.version_select at 0x7fd6c569e0d0>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:45.686465 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8af83a93-2d39-426f-9cd4-598f5f56eb73 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1176728654" status: 202 len: 0 microversion: 2.1 time: 0.029743 Jul 14 15:51:45.687052 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3757/7481] 10.222.0.81 () {58 vars in 1253 bytes} [Thu Jul 14 15:51:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1176728654 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:51:45.709079 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e5adfcd8-c8aa-4f0a-bd99-b58144dabb3f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Action: 'create', calling method: .version_select at 0x7fd6c43f8b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-616586407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfFmIUMFsryEhsqY/jCbf9j8Zsvt3n8vK9BaEAIItm+vRykrz7BXtJ/32D6v+fuVM0TsBOroNcPFo0zvLJILJitWCVl5zCXoKbpdif2LkxFxs0Ez0CS3wKfuE6P6tYJCw=="}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:51:45.723633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e5adfcd8-c8aa-4f0a-bd99-b58144dabb3f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Getting quotas for project 96db3341b9c747eba0451cbd45afabf4. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:51:45.730431 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-e5adfcd8-c8aa-4f0a-bd99-b58144dabb3f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Getting quotas for user 9dd4c1e8688a446baef7fcb7b7f9c1ec and project 96db3341b9c747eba0451cbd45afabf4. Resources: {'key_pairs'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:51:45.758244 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e5adfcd8-c8aa-4f0a-bd99-b58144dabb3f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.053195 Jul 14 15:51:45.759253 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3725/7482] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:51:45 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:52:01.868505 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:01.869290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:01.874027 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1271063848", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-616586407", "security_groups": [{"name": "tempest-secgroup-smoke-1847577006"}], "networks": [{"uuid": "27ec2d4a-f4e7-4e31-a02d-01601c6d91d2"}], "block_device_mapping_v2": [{"uuid": "1ad5bb7f-5ce9-46c2-94f8-7235f001411e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:52:01.995198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.network.neutron [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] validate_networks() for [('27ec2d4a-f4e7-4e31-a02d-01601c6d91d2', None, None, None, None, None)] {{(pid=119512) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:52:02.423025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Flavor limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:52:02.423465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Image limits 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:52:02.423954 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Flavor pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:52:02.424374 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Image pref 0:0:0 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:52:02.424796 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.virt.hardware [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:52:02.434766 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.435225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.436028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.436475 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.454378 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Getting quotas for project 96db3341b9c747eba0451cbd45afabf4. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:52:02.460008 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Getting quotas for user 9dd4c1e8688a446baef7fcb7b7f9c1ec and project 96db3341b9c747eba0451cbd45afabf4. Resources: {'instances', 'cores', 'ram'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:52:02.518569 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Going to run 1 instances... {{(pid=119512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:52:02.520712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ad5bb7f-5ce9-46c2-94f8-7235f001411e',volume_size=None,volume_type=None)] {{(pid=119512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:52:02.659195 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b10f325b-7c45-43d7-b2cc-36647017d182 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.792549 Jul 14 15:52:02.659914 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3758/7483] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:52:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:52:02.670144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7bfb85c6-80bc-4bea-a29e-4e30ceed8f08 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:02.670772 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7bfb85c6-80bc-4bea-a29e-4e30ceed8f08 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:02.673665 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=12 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:02.674494 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=4 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:02.675250 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:02.739154 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7bfb85c6-80bc-4bea-a29e-4e30ceed8f08 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:02.746747 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7bfb85c6-80bc-4bea-a29e-4e30ceed8f08 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1088 microversion: 2.1 time: 0.080587 Jul 14 15:52:02.747597 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3726/7484] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:02 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:03.766640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4cb1db71-29f4-4370-82d4-804ea936080f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:03.767274 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4cb1db71-29f4-4370-82d4-804ea936080f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:03.775026 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cb1db71-29f4-4370-82d4-804ea936080f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:03.775498 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cb1db71-29f4-4370-82d4-804ea936080f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:03.776325 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cb1db71-29f4-4370-82d4-804ea936080f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:03.776797 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4cb1db71-29f4-4370-82d4-804ea936080f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:03.844499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4cb1db71-29f4-4370-82d4-804ea936080f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:03.852895 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4cb1db71-29f4-4370-82d4-804ea936080f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1194 microversion: 2.1 time: 0.091779 Jul 14 15:52:03.853516 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3759/7485] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:03 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:04.870782 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-78ac6e3c-41ae-4d13-b557-464c6dc5988f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:04.871399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-78ac6e3c-41ae-4d13-b557-464c6dc5988f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:04.881892 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78ac6e3c-41ae-4d13-b557-464c6dc5988f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:04.882615 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78ac6e3c-41ae-4d13-b557-464c6dc5988f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:04.883769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78ac6e3c-41ae-4d13-b557-464c6dc5988f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:04.883769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-78ac6e3c-41ae-4d13-b557-464c6dc5988f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:05.043681 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-78ac6e3c-41ae-4d13-b557-464c6dc5988f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:05.052035 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-78ac6e3c-41ae-4d13-b557-464c6dc5988f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1272 microversion: 2.1 time: 0.185909 Jul 14 15:52:05.053118 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3727/7486] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:04 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:05.365663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-d7d54ba7-2ecb-4c4f-a889-4a0c6ce970ca req-148568c0-fa43-4e83-8498-8eeaec5373a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4eddd9-7050-4a53-8435-7e187dffa855", "tag": "4557781d-1088-44fa-bb14-4849cb614aac"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:52:05.376205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d7d54ba7-2ecb-4c4f-a889-4a0c6ce970ca req-148568c0-fa43-4e83-8498-8eeaec5373a1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:05.376693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-d7d54ba7-2ecb-4c4f-a889-4a0c6ce970ca req-148568c0-fa43-4e83-8498-8eeaec5373a1 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:05.389355 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-d7d54ba7-2ecb-4c4f-a889-4a0c6ce970ca req-148568c0-fa43-4e83-8498-8eeaec5373a1 service nova] Creating event network-changed:4557781d-1088-44fa-bb14-4849cb614aac for instance cb4eddd9-7050-4a53-8435-7e187dffa855 on n-h1-767704-28 Jul 14 15:52:05.394866 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-d7d54ba7-2ecb-4c4f-a889-4a0c6ce970ca req-148568c0-fa43-4e83-8498-8eeaec5373a1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134793 Jul 14 15:52:05.395922 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3760/7487] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:52:06.069677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7243ac63-2111-4803-8f4c-45391f303b2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:06.070979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7243ac63-2111-4803-8f4c-45391f303b2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:06.078466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7243ac63-2111-4803-8f4c-45391f303b2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:06.079002 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7243ac63-2111-4803-8f4c-45391f303b2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:06.079852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7243ac63-2111-4803-8f4c-45391f303b2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:06.080359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7243ac63-2111-4803-8f4c-45391f303b2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:06.223155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7243ac63-2111-4803-8f4c-45391f303b2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:06.232223 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7243ac63-2111-4803-8f4c-45391f303b2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1272 microversion: 2.1 time: 0.166671 Jul 14 15:52:06.232809 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3728/7488] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:06 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:07.250983 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1189eef5-a9ff-436a-b6fd-fd2fa163992f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:07.251731 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1189eef5-a9ff-436a-b6fd-fd2fa163992f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:07.259940 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1189eef5-a9ff-436a-b6fd-fd2fa163992f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:07.260203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1189eef5-a9ff-436a-b6fd-fd2fa163992f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:07.261135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1189eef5-a9ff-436a-b6fd-fd2fa163992f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:07.261598 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1189eef5-a9ff-436a-b6fd-fd2fa163992f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:07.411811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1189eef5-a9ff-436a-b6fd-fd2fa163992f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:07.421298 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1189eef5-a9ff-436a-b6fd-fd2fa163992f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1272 microversion: 2.1 time: 0.175418 Jul 14 15:52:07.422194 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3761/7489] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:07 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:08.438502 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2b44e8f9-9b99-46a9-9838-c7054a82b20c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:08.439051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2b44e8f9-9b99-46a9-9838-c7054a82b20c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:08.447001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b44e8f9-9b99-46a9-9838-c7054a82b20c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:08.447461 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b44e8f9-9b99-46a9-9838-c7054a82b20c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:08.448242 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b44e8f9-9b99-46a9-9838-c7054a82b20c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:08.448685 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2b44e8f9-9b99-46a9-9838-c7054a82b20c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:08.592827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2b44e8f9-9b99-46a9-9838-c7054a82b20c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:08.600446 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2b44e8f9-9b99-46a9-9838-c7054a82b20c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1272 microversion: 2.1 time: 0.165942 Jul 14 15:52:08.609591 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3729/7490] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:08 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:09.617911 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-971fe17d-cc92-4e2c-ac69-f4b472527f29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:09.618539 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-971fe17d-cc92-4e2c-ac69-f4b472527f29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:09.625260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-971fe17d-cc92-4e2c-ac69-f4b472527f29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:09.625729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-971fe17d-cc92-4e2c-ac69-f4b472527f29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:09.626510 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-971fe17d-cc92-4e2c-ac69-f4b472527f29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:09.626961 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-971fe17d-cc92-4e2c-ac69-f4b472527f29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:09.757081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-971fe17d-cc92-4e2c-ac69-f4b472527f29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:09.765577 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-971fe17d-cc92-4e2c-ac69-f4b472527f29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1260 microversion: 2.1 time: 0.152358 Jul 14 15:52:09.766146 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3762/7491] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:09 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:10.783362 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bc460943-4216-41b7-a176-516898f8a51a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:10.783977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bc460943-4216-41b7-a176-516898f8a51a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:10.791648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc460943-4216-41b7-a176-516898f8a51a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:10.792098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc460943-4216-41b7-a176-516898f8a51a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:10.792865 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc460943-4216-41b7-a176-516898f8a51a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:10.793338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bc460943-4216-41b7-a176-516898f8a51a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:10.929992 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bc460943-4216-41b7-a176-516898f8a51a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:10.937572 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bc460943-4216-41b7-a176-516898f8a51a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1260 microversion: 2.1 time: 0.158184 Jul 14 15:52:10.938132 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3730/7492] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:10 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:11.954192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8c92cb24-832a-47bf-b130-f6ac46afc4f4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:11.954818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8c92cb24-832a-47bf-b130-f6ac46afc4f4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:11.961834 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c92cb24-832a-47bf-b130-f6ac46afc4f4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:11.962933 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c92cb24-832a-47bf-b130-f6ac46afc4f4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:11.963808 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c92cb24-832a-47bf-b130-f6ac46afc4f4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:11.964257 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8c92cb24-832a-47bf-b130-f6ac46afc4f4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:12.102138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8c92cb24-832a-47bf-b130-f6ac46afc4f4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:12.109913 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8c92cb24-832a-47bf-b130-f6ac46afc4f4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1260 microversion: 2.1 time: 0.159628 Jul 14 15:52:12.110488 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3763/7493] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:11 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:13.126993 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-be166544-d967-48ae-b2bc-9562044b9c3a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:13.127699 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-be166544-d967-48ae-b2bc-9562044b9c3a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:13.129672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:13.135301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be166544-d967-48ae-b2bc-9562044b9c3a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:13.135757 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be166544-d967-48ae-b2bc-9562044b9c3a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:13.136526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be166544-d967-48ae-b2bc-9562044b9c3a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:13.136987 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-be166544-d967-48ae-b2bc-9562044b9c3a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:13.270406 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-be166544-d967-48ae-b2bc-9562044b9c3a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:13.278424 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-be166544-d967-48ae-b2bc-9562044b9c3a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1260 microversion: 2.1 time: 0.155565 Jul 14 15:52:13.278928 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3731/7494] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:13 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:14.295077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8ff5b3fe-36c6-4f7f-b665-2486bd109d19 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:14.295684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8ff5b3fe-36c6-4f7f-b665-2486bd109d19 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:14.297693 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:14.298490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=6 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:14.305297 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ff5b3fe-36c6-4f7f-b665-2486bd109d19 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:14.305762 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ff5b3fe-36c6-4f7f-b665-2486bd109d19 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:14.306583 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ff5b3fe-36c6-4f7f-b665-2486bd109d19 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:14.307015 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8ff5b3fe-36c6-4f7f-b665-2486bd109d19 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:14.437659 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8ff5b3fe-36c6-4f7f-b665-2486bd109d19 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:14.445246 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8ff5b3fe-36c6-4f7f-b665-2486bd109d19 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1260 microversion: 2.1 time: 0.154065 Jul 14 15:52:14.445842 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3764/7495] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:14 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:15.463523 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-49d4be82-0d04-4958-ad33-db8ffe44e8cc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:15.464127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-49d4be82-0d04-4958-ad33-db8ffe44e8cc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:15.470954 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49d4be82-0d04-4958-ad33-db8ffe44e8cc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:15.471403 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49d4be82-0d04-4958-ad33-db8ffe44e8cc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:15.472155 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49d4be82-0d04-4958-ad33-db8ffe44e8cc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:15.472590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-49d4be82-0d04-4958-ad33-db8ffe44e8cc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:15.602378 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-49d4be82-0d04-4958-ad33-db8ffe44e8cc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:15.610684 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-49d4be82-0d04-4958-ad33-db8ffe44e8cc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1260 microversion: 2.1 time: 0.151516 Jul 14 15:52:15.611270 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3732/7496] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:15 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:16.627777 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0bfa84c0-ea3b-41d5-a473-c9d16d16c389 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:16.628408 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0bfa84c0-ea3b-41d5-a473-c9d16d16c389 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:16.637002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bfa84c0-ea3b-41d5-a473-c9d16d16c389 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:16.637497 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bfa84c0-ea3b-41d5-a473-c9d16d16c389 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:16.638281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bfa84c0-ea3b-41d5-a473-c9d16d16c389 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:16.638734 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0bfa84c0-ea3b-41d5-a473-c9d16d16c389 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:16.773362 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0bfa84c0-ea3b-41d5-a473-c9d16d16c389 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:16.780867 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0bfa84c0-ea3b-41d5-a473-c9d16d16c389 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1260 microversion: 2.1 time: 0.157372 Jul 14 15:52:16.781470 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3765/7497] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:16 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:17.846512 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-de47e0b7-0c18-480b-834f-95d80fc42d75 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:17.847129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-de47e0b7-0c18-480b-834f-95d80fc42d75 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:17.853909 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de47e0b7-0c18-480b-834f-95d80fc42d75 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:17.854358 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de47e0b7-0c18-480b-834f-95d80fc42d75 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:17.855330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de47e0b7-0c18-480b-834f-95d80fc42d75 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:17.855769 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-de47e0b7-0c18-480b-834f-95d80fc42d75 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:17.994304 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-de47e0b7-0c18-480b-834f-95d80fc42d75 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:18.001994 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-de47e0b7-0c18-480b-834f-95d80fc42d75 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1260 microversion: 2.1 time: 0.209103 Jul 14 15:52:18.002583 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3733/7498] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:17 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:19.019596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2b0fa396-1649-4885-abb1-3c32db7a90a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:19.020224 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2b0fa396-1649-4885-abb1-3c32db7a90a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:19.027149 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b0fa396-1649-4885-abb1-3c32db7a90a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:19.027614 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b0fa396-1649-4885-abb1-3c32db7a90a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:19.028391 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b0fa396-1649-4885-abb1-3c32db7a90a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:19.028844 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2b0fa396-1649-4885-abb1-3c32db7a90a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:19.164451 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2b0fa396-1649-4885-abb1-3c32db7a90a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:19.172809 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2b0fa396-1649-4885-abb1-3c32db7a90a4 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1260 microversion: 2.1 time: 0.157120 Jul 14 15:52:19.173421 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3766/7499] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:19 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:19.400575 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-41a30ae6-07ca-435a-955d-c75de164e9cf req-c59de04e-9e21-419f-88e9-f66f8f18b54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4eddd9-7050-4a53-8435-7e187dffa855", "name": "network-vif-plugged", "status": "completed", "tag": "4557781d-1088-44fa-bb14-4849cb614aac"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:52:19.410897 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-41a30ae6-07ca-435a-955d-c75de164e9cf req-c59de04e-9e21-419f-88e9-f66f8f18b54e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:19.411357 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-41a30ae6-07ca-435a-955d-c75de164e9cf req-c59de04e-9e21-419f-88e9-f66f8f18b54e service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:19.423335 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-41a30ae6-07ca-435a-955d-c75de164e9cf req-c59de04e-9e21-419f-88e9-f66f8f18b54e service nova] Creating event network-vif-plugged:4557781d-1088-44fa-bb14-4849cb614aac for instance cb4eddd9-7050-4a53-8435-7e187dffa855 on n-h1-767704-28 Jul 14 15:52:19.428882 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-41a30ae6-07ca-435a-955d-c75de164e9cf req-c59de04e-9e21-419f-88e9-f66f8f18b54e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032035 Jul 14 15:52:19.429883 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3734/7500] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:52:20.190995 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7376f707-f9ab-45a4-b329-036ddab9ec2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:20.191544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7376f707-f9ab-45a4-b329-036ddab9ec2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:20.199671 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7376f707-f9ab-45a4-b329-036ddab9ec2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:20.200139 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7376f707-f9ab-45a4-b329-036ddab9ec2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:20.200921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7376f707-f9ab-45a4-b329-036ddab9ec2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:20.201421 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7376f707-f9ab-45a4-b329-036ddab9ec2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:20.337643 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7376f707-f9ab-45a4-b329-036ddab9ec2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:20.345193 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7376f707-f9ab-45a4-b329-036ddab9ec2b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1260 microversion: 2.1 time: 0.158239 Jul 14 15:52:20.345761 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3767/7501] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:20 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:21.362324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-cf0835e6-8ad5-46de-a6d7-339163eb6f55 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:21.363036 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-cf0835e6-8ad5-46de-a6d7-339163eb6f55 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:21.371062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf0835e6-8ad5-46de-a6d7-339163eb6f55 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:21.371522 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf0835e6-8ad5-46de-a6d7-339163eb6f55 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:21.372296 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf0835e6-8ad5-46de-a6d7-339163eb6f55 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:21.372741 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-cf0835e6-8ad5-46de-a6d7-339163eb6f55 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:21.505947 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-cf0835e6-8ad5-46de-a6d7-339163eb6f55 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:21.514194 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-cf0835e6-8ad5-46de-a6d7-339163eb6f55 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1444 microversion: 2.1 time: 0.155888 Jul 14 15:52:21.514770 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3735/7502] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:21 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:21.530487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-71ec53e9-aba6-4bf0-89cb-472b57fdd289 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:21.531119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-71ec53e9-aba6-4bf0-89cb-472b57fdd289 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:21.538017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71ec53e9-aba6-4bf0-89cb-472b57fdd289 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:21.538481 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71ec53e9-aba6-4bf0-89cb-472b57fdd289 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:21.539259 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71ec53e9-aba6-4bf0-89cb-472b57fdd289 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:21.539713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-71ec53e9-aba6-4bf0-89cb-472b57fdd289 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:21.671179 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-71ec53e9-aba6-4bf0-89cb-472b57fdd289 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:21.678663 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-71ec53e9-aba6-4bf0-89cb-472b57fdd289 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1444 microversion: 2.1 time: 0.152066 Jul 14 15:52:21.679232 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3768/7503] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:21 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:23.319701 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-50a7d0de-f838-4645-aadc-74725b58ba46 req-a09470ee-dd67-46c1-93c8-d21d51e3fff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4eddd9-7050-4a53-8435-7e187dffa855", "tag": "4557781d-1088-44fa-bb14-4849cb614aac"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:52:23.329259 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-50a7d0de-f838-4645-aadc-74725b58ba46 req-a09470ee-dd67-46c1-93c8-d21d51e3fff5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:23.329704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-50a7d0de-f838-4645-aadc-74725b58ba46 req-a09470ee-dd67-46c1-93c8-d21d51e3fff5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:23.341050 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-50a7d0de-f838-4645-aadc-74725b58ba46 req-a09470ee-dd67-46c1-93c8-d21d51e3fff5 service nova] Creating event network-changed:4557781d-1088-44fa-bb14-4849cb614aac for instance cb4eddd9-7050-4a53-8435-7e187dffa855 on n-h1-767704-28 Jul 14 15:52:23.346058 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-50a7d0de-f838-4645-aadc-74725b58ba46 req-a09470ee-dd67-46c1-93c8-d21d51e3fff5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029969 Jul 14 15:52:23.347040 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3736/7504] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:28.650498 n-d-767704-28 devstack@n-api.service[119512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [18fa8ee7-2e4b-4257-83cb-9dead624f713] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 15:54:28.651321 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:28.652077 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=58 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:28.656220 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a04a5f41-b5f1-46a5-9e98-932561eb8fda tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:28.656767 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a04a5f41-b5f1-46a5-9e98-932561eb8fda tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:28.663996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a04a5f41-b5f1-46a5-9e98-932561eb8fda tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:28.664464 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a04a5f41-b5f1-46a5-9e98-932561eb8fda tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:28.665280 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a04a5f41-b5f1-46a5-9e98-932561eb8fda tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:28.665741 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a04a5f41-b5f1-46a5-9e98-932561eb8fda tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:28.691998 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.objects.instance [None req-a04a5f41-b5f1-46a5-9e98-932561eb8fda tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lazy-loading 'flavor' on Instance uuid cb4eddd9-7050-4a53-8435-7e187dffa855 {{(pid=119512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:54:28.764542 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a04a5f41-b5f1-46a5-9e98-932561eb8fda tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "POST /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855/action" status: 202 len: 0 microversion: 2.1 time: 0.115906 Jul 14 15:54:28.765445 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3769/7505] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:54:28 2022] POST /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:54:28.773203 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a22d85c6-ae9d-41d6-a69e-ea6ad90634fc] AMQP server on 10.222.0.81:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 15:54:28.775572 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d4f9fe7-d901-4181-b484-84a90bcc1a95] AMQP server on 10.222.0.81:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 15:54:28.776172 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=24 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:28.777003 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=52 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:28.782106 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-784b9e8a-4225-4dde-a6a8-c37e0e65fa04 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:28.782857 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-784b9e8a-4225-4dde-a6a8-c37e0e65fa04 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:28.790117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-784b9e8a-4225-4dde-a6a8-c37e0e65fa04 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:28.790562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-784b9e8a-4225-4dde-a6a8-c37e0e65fa04 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:28.791327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-784b9e8a-4225-4dde-a6a8-c37e0e65fa04 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:28.791764 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-784b9e8a-4225-4dde-a6a8-c37e0e65fa04 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:28.929785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-784b9e8a-4225-4dde-a6a8-c37e0e65fa04 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:28.937325 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-784b9e8a-4225-4dde-a6a8-c37e0e65fa04 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.167441 Jul 14 15:54:28.937887 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3737/7506] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:28 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:29.959103 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dbdc3cc8-161f-4665-8900-d256904e78df tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:29.959826 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dbdc3cc8-161f-4665-8900-d256904e78df tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:29.970351 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dbdc3cc8-161f-4665-8900-d256904e78df tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:29.970817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dbdc3cc8-161f-4665-8900-d256904e78df tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:29.971903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dbdc3cc8-161f-4665-8900-d256904e78df tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:29.972359 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dbdc3cc8-161f-4665-8900-d256904e78df tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:29.976255 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] [18fa8ee7-2e4b-4257-83cb-9dead624f713] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 56476. Jul 14 15:54:30.123147 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dbdc3cc8-161f-4665-8900-d256904e78df tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:30.134017 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dbdc3cc8-161f-4665-8900-d256904e78df tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.181495 Jul 14 15:54:30.134615 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3770/7507] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:29 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:31.152075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-a6815644-5f32-4530-8b6e-574da82587fc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:31.152620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-a6815644-5f32-4530-8b6e-574da82587fc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:31.163639 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6815644-5f32-4530-8b6e-574da82587fc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:31.164091 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6815644-5f32-4530-8b6e-574da82587fc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:31.164872 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6815644-5f32-4530-8b6e-574da82587fc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:31.165338 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-a6815644-5f32-4530-8b6e-574da82587fc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:31.169318 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d4f9fe7-d901-4181-b484-84a90bcc1a95] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 56482. Jul 14 15:54:31.170008 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a22d85c6-ae9d-41d6-a69e-ea6ad90634fc] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 56480. Jul 14 15:54:31.311175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-a6815644-5f32-4530-8b6e-574da82587fc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:31.322829 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-a6815644-5f32-4530-8b6e-574da82587fc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.174760 Jul 14 15:54:31.323975 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3738/7508] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:31 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:54:32.341138 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1be5a9e4-4ead-494f-b1f2-36fe78be6977 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:32.341801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1be5a9e4-4ead-494f-b1f2-36fe78be6977 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:32.349877 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1be5a9e4-4ead-494f-b1f2-36fe78be6977 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:32.350343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1be5a9e4-4ead-494f-b1f2-36fe78be6977 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:32.351151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1be5a9e4-4ead-494f-b1f2-36fe78be6977 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:32.351605 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1be5a9e4-4ead-494f-b1f2-36fe78be6977 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:32.488632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1be5a9e4-4ead-494f-b1f2-36fe78be6977 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:32.497159 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1be5a9e4-4ead-494f-b1f2-36fe78be6977 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.159942 Jul 14 15:54:32.497729 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3771/7509] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:32 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:33.513649 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e6f8c180-3d81-459e-857c-092509370da0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:33.514177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e6f8c180-3d81-459e-857c-092509370da0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:33.521434 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6f8c180-3d81-459e-857c-092509370da0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:33.521884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6f8c180-3d81-459e-857c-092509370da0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:33.522642 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6f8c180-3d81-459e-857c-092509370da0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:33.523075 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e6f8c180-3d81-459e-857c-092509370da0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:33.655780 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e6f8c180-3d81-459e-857c-092509370da0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:33.665044 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e6f8c180-3d81-459e-857c-092509370da0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.155360 Jul 14 15:54:33.665627 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3739/7510] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:33 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:34.682620 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9d9300d3-651f-4a6c-8bde-80cecd482f1b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:34.683187 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9d9300d3-651f-4a6c-8bde-80cecd482f1b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:34.690859 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d9300d3-651f-4a6c-8bde-80cecd482f1b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:34.691331 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d9300d3-651f-4a6c-8bde-80cecd482f1b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:34.692115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d9300d3-651f-4a6c-8bde-80cecd482f1b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:34.692645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9d9300d3-651f-4a6c-8bde-80cecd482f1b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:34.825887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-9d9300d3-651f-4a6c-8bde-80cecd482f1b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:34.833649 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9d9300d3-651f-4a6c-8bde-80cecd482f1b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.155194 Jul 14 15:54:34.834218 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3772/7511] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:34 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:35.851319 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3159d664-8285-43ec-a9e3-2dec5154389b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:35.851960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3159d664-8285-43ec-a9e3-2dec5154389b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:35.859065 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3159d664-8285-43ec-a9e3-2dec5154389b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:35.859518 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3159d664-8285-43ec-a9e3-2dec5154389b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:35.860283 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3159d664-8285-43ec-a9e3-2dec5154389b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:35.860718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3159d664-8285-43ec-a9e3-2dec5154389b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:35.997354 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3159d664-8285-43ec-a9e3-2dec5154389b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:36.005539 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3159d664-8285-43ec-a9e3-2dec5154389b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.158346 Jul 14 15:54:36.006127 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3740/7512] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:35 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:37.024153 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a28dab75-3c33-4cb6-b255-a54b571fdb84 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:37.024865 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a28dab75-3c33-4cb6-b255-a54b571fdb84 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:37.032424 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a28dab75-3c33-4cb6-b255-a54b571fdb84 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:37.033586 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a28dab75-3c33-4cb6-b255-a54b571fdb84 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:37.034584 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a28dab75-3c33-4cb6-b255-a54b571fdb84 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:37.035038 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a28dab75-3c33-4cb6-b255-a54b571fdb84 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:37.422884 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a28dab75-3c33-4cb6-b255-a54b571fdb84 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:37.430921 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a28dab75-3c33-4cb6-b255-a54b571fdb84 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.411090 Jul 14 15:54:37.431544 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3773/7513] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:37 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:38.447652 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-01fd0ca6-11e9-4bc2-9a7d-5dc2e423eec0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:38.448257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-01fd0ca6-11e9-4bc2-9a7d-5dc2e423eec0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:38.456156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-01fd0ca6-11e9-4bc2-9a7d-5dc2e423eec0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:38.456603 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-01fd0ca6-11e9-4bc2-9a7d-5dc2e423eec0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:38.457418 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-01fd0ca6-11e9-4bc2-9a7d-5dc2e423eec0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:38.457835 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-01fd0ca6-11e9-4bc2-9a7d-5dc2e423eec0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:38.592837 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-01fd0ca6-11e9-4bc2-9a7d-5dc2e423eec0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:38.601266 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-01fd0ca6-11e9-4bc2-9a7d-5dc2e423eec0 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.157399 Jul 14 15:54:38.601839 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3741/7514] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:38 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:39.619170 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c75012dd-2a3a-4508-a366-5f9563194122 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:39.619800 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c75012dd-2a3a-4508-a366-5f9563194122 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:39.626863 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c75012dd-2a3a-4508-a366-5f9563194122 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:39.627328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c75012dd-2a3a-4508-a366-5f9563194122 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:39.628115 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c75012dd-2a3a-4508-a366-5f9563194122 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:39.628615 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c75012dd-2a3a-4508-a366-5f9563194122 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:39.764977 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c75012dd-2a3a-4508-a366-5f9563194122 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:39.772904 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c75012dd-2a3a-4508-a366-5f9563194122 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.157870 Jul 14 15:54:39.773497 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3774/7515] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:39 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:40.789894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8ca23ffc-3842-43e8-b947-112f6737ad9c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:40.790544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8ca23ffc-3842-43e8-b947-112f6737ad9c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:40.797515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ca23ffc-3842-43e8-b947-112f6737ad9c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:40.797965 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ca23ffc-3842-43e8-b947-112f6737ad9c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:40.799275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ca23ffc-3842-43e8-b947-112f6737ad9c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:40.799709 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8ca23ffc-3842-43e8-b947-112f6737ad9c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:40.933257 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8ca23ffc-3842-43e8-b947-112f6737ad9c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:40.941683 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8ca23ffc-3842-43e8-b947-112f6737ad9c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.155738 Jul 14 15:54:40.942246 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3742/7516] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:40 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:41.958897 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5e171601-e60a-437d-a95f-5420931f28b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:41.959648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5e171601-e60a-437d-a95f-5420931f28b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:41.966458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e171601-e60a-437d-a95f-5420931f28b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:41.966847 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e171601-e60a-437d-a95f-5420931f28b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:41.967630 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e171601-e60a-437d-a95f-5420931f28b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:41.968079 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5e171601-e60a-437d-a95f-5420931f28b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:42.102746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5e171601-e60a-437d-a95f-5420931f28b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:42.110271 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5e171601-e60a-437d-a95f-5420931f28b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.155501 Jul 14 15:54:42.110848 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3775/7517] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:41 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:43.127244 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6300b1c9-a993-46aa-8411-e7628bc7bdf7 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:43.127988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6300b1c9-a993-46aa-8411-e7628bc7bdf7 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:43.135051 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6300b1c9-a993-46aa-8411-e7628bc7bdf7 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:43.135507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6300b1c9-a993-46aa-8411-e7628bc7bdf7 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:43.136291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6300b1c9-a993-46aa-8411-e7628bc7bdf7 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:43.136732 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6300b1c9-a993-46aa-8411-e7628bc7bdf7 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:43.285008 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6300b1c9-a993-46aa-8411-e7628bc7bdf7 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:43.293063 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6300b1c9-a993-46aa-8411-e7628bc7bdf7 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.169645 Jul 14 15:54:43.293735 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3743/7518] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:43 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:44.310708 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e51ae7a1-b876-43fe-9fbf-ceec54e28d63 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:44.311342 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e51ae7a1-b876-43fe-9fbf-ceec54e28d63 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:44.318997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e51ae7a1-b876-43fe-9fbf-ceec54e28d63 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:44.319471 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e51ae7a1-b876-43fe-9fbf-ceec54e28d63 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:44.320262 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e51ae7a1-b876-43fe-9fbf-ceec54e28d63 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:44.320729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e51ae7a1-b876-43fe-9fbf-ceec54e28d63 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:44.456450 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e51ae7a1-b876-43fe-9fbf-ceec54e28d63 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:44.464194 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e51ae7a1-b876-43fe-9fbf-ceec54e28d63 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1509 microversion: 2.1 time: 0.157393 Jul 14 15:54:44.464712 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3776/7519] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:44 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:44.481068 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-982cca9a-f0df-4b50-8d73-26b28cf8ce29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:44.481644 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-982cca9a-f0df-4b50-8d73-26b28cf8ce29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:44.489328 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-982cca9a-f0df-4b50-8d73-26b28cf8ce29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:44.489812 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-982cca9a-f0df-4b50-8d73-26b28cf8ce29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:44.490605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-982cca9a-f0df-4b50-8d73-26b28cf8ce29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:44.491238 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-982cca9a-f0df-4b50-8d73-26b28cf8ce29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:44.565422 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [None req-982cca9a-f0df-4b50-8d73-26b28cf8ce29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [7de44eb1-bcae-46d3-b3a9-301f2b384d94] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:54:45.572802 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [None req-982cca9a-f0df-4b50-8d73-26b28cf8ce29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [7de44eb1-bcae-46d3-b3a9-301f2b384d94] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 56512. Jul 14 15:54:45.575824 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-982cca9a-f0df-4b50-8d73-26b28cf8ce29 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "POST /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855/action" status: 202 len: 0 microversion: 2.1 time: 1.098862 Jul 14 15:54:45.576450 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3744/7520] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:54:44 2022] POST /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855/action => generated 0 bytes in 1100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:54:45.585081 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7721fda9-1049-4954-842d-a38ad903cdaf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:45.585722 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7721fda9-1049-4954-842d-a38ad903cdaf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:45.592445 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7721fda9-1049-4954-842d-a38ad903cdaf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:45.592920 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7721fda9-1049-4954-842d-a38ad903cdaf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:45.593747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7721fda9-1049-4954-842d-a38ad903cdaf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:45.594207 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7721fda9-1049-4954-842d-a38ad903cdaf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:45.729698 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7721fda9-1049-4954-842d-a38ad903cdaf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:45.737888 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7721fda9-1049-4954-842d-a38ad903cdaf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1517 microversion: 2.1 time: 0.156712 Jul 14 15:54:45.738680 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3777/7521] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:45 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:46.213602 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-96dc38ee-0820-4684-8d4d-820ec5d34221 req-1fd5f793-4e3b-4831-8c08-6862153a6eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4eddd9-7050-4a53-8435-7e187dffa855", "name": "network-vif-unplugged", "status": "completed", "tag": "4557781d-1088-44fa-bb14-4849cb614aac"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:46.223977 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-96dc38ee-0820-4684-8d4d-820ec5d34221 req-1fd5f793-4e3b-4831-8c08-6862153a6eb2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:46.224493 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-96dc38ee-0820-4684-8d4d-820ec5d34221 req-1fd5f793-4e3b-4831-8c08-6862153a6eb2 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:46.235097 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.compute.server_external_events [req-96dc38ee-0820-4684-8d4d-820ec5d34221 req-1fd5f793-4e3b-4831-8c08-6862153a6eb2 service nova] Unable to find a host for instance cb4eddd9-7050-4a53-8435-7e187dffa855. Dropping event network-vif-unplugged {{(pid=119511) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 15:54:46.236809 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-96dc38ee-0820-4684-8d4d-820ec5d34221 req-1fd5f793-4e3b-4831-8c08-6862153a6eb2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.078623 Jul 14 15:54:46.237699 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3745/7522] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 81 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 15:54:46.755564 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8d33ca32-0d8b-4334-9689-70a2dcf12316 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:46.756197 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8d33ca32-0d8b-4334-9689-70a2dcf12316 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:46.763279 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d33ca32-0d8b-4334-9689-70a2dcf12316 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:46.763746 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d33ca32-0d8b-4334-9689-70a2dcf12316 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:46.764541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d33ca32-0d8b-4334-9689-70a2dcf12316 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:46.765295 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8d33ca32-0d8b-4334-9689-70a2dcf12316 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:46.900091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8d33ca32-0d8b-4334-9689-70a2dcf12316 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:46.908720 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8d33ca32-0d8b-4334-9689-70a2dcf12316 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1517 microversion: 2.1 time: 0.157624 Jul 14 15:54:46.909364 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3778/7523] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:46 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:47.926124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-5002209c-8719-4314-83d1-15c9e557d4ce tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:47.926923 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-5002209c-8719-4314-83d1-15c9e557d4ce tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:47.934076 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5002209c-8719-4314-83d1-15c9e557d4ce tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:47.934528 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5002209c-8719-4314-83d1-15c9e557d4ce tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:47.935306 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5002209c-8719-4314-83d1-15c9e557d4ce tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:47.935752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-5002209c-8719-4314-83d1-15c9e557d4ce tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:48.077229 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-5002209c-8719-4314-83d1-15c9e557d4ce tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:48.085643 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-5002209c-8719-4314-83d1-15c9e557d4ce tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1517 microversion: 2.1 time: 0.163627 Jul 14 15:54:48.086219 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3746/7524] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:47 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:49.102872 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-66790c4e-93b7-4990-b66c-f7323494a1c3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:49.103509 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-66790c4e-93b7-4990-b66c-f7323494a1c3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:49.110419 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66790c4e-93b7-4990-b66c-f7323494a1c3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:49.110892 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66790c4e-93b7-4990-b66c-f7323494a1c3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:49.111682 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66790c4e-93b7-4990-b66c-f7323494a1c3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:49.112141 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-66790c4e-93b7-4990-b66c-f7323494a1c3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:49.244487 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-66790c4e-93b7-4990-b66c-f7323494a1c3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:49.252856 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-66790c4e-93b7-4990-b66c-f7323494a1c3 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1517 microversion: 2.1 time: 0.153909 Jul 14 15:54:49.253475 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3779/7525] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:49 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:50.270713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b2a5fd92-b0cf-40dc-86e0-8d2fef61454f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:50.271422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b2a5fd92-b0cf-40dc-86e0-8d2fef61454f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:50.277822 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2a5fd92-b0cf-40dc-86e0-8d2fef61454f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:50.278273 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2a5fd92-b0cf-40dc-86e0-8d2fef61454f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:50.279035 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2a5fd92-b0cf-40dc-86e0-8d2fef61454f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:50.279477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b2a5fd92-b0cf-40dc-86e0-8d2fef61454f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:50.416465 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b2a5fd92-b0cf-40dc-86e0-8d2fef61454f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:50.424254 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b2a5fd92-b0cf-40dc-86e0-8d2fef61454f tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1519 microversion: 2.1 time: 0.157728 Jul 14 15:54:50.424958 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3747/7526] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:50 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:51.443541 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b37a2784-6533-47b5-b682-5fa27bca8a52 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:51.444171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b37a2784-6533-47b5-b682-5fa27bca8a52 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:51.451381 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b37a2784-6533-47b5-b682-5fa27bca8a52 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:51.451851 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b37a2784-6533-47b5-b682-5fa27bca8a52 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:51.452640 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b37a2784-6533-47b5-b682-5fa27bca8a52 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:51.453137 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b37a2784-6533-47b5-b682-5fa27bca8a52 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:51.590159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b37a2784-6533-47b5-b682-5fa27bca8a52 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:51.598698 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b37a2784-6533-47b5-b682-5fa27bca8a52 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1519 microversion: 2.1 time: 0.160321 Jul 14 15:54:51.599410 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3780/7527] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:51 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:52.615774 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-536af2ce-670c-4ca2-b3e0-54751ed4748b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:52.616416 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-536af2ce-670c-4ca2-b3e0-54751ed4748b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:52.623588 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-536af2ce-670c-4ca2-b3e0-54751ed4748b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:52.624045 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-536af2ce-670c-4ca2-b3e0-54751ed4748b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:52.624817 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-536af2ce-670c-4ca2-b3e0-54751ed4748b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:52.625289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-536af2ce-670c-4ca2-b3e0-54751ed4748b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:52.761472 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-536af2ce-670c-4ca2-b3e0-54751ed4748b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:52.770040 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-536af2ce-670c-4ca2-b3e0-54751ed4748b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1519 microversion: 2.1 time: 0.158166 Jul 14 15:54:52.770620 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3748/7528] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:52 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:53.788123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-dc2272aa-04e8-4468-aa28-e7199ea74f14 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:53.788841 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-dc2272aa-04e8-4468-aa28-e7199ea74f14 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:53.795869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc2272aa-04e8-4468-aa28-e7199ea74f14 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:53.796357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc2272aa-04e8-4468-aa28-e7199ea74f14 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:53.797164 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc2272aa-04e8-4468-aa28-e7199ea74f14 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:53.797622 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-dc2272aa-04e8-4468-aa28-e7199ea74f14 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:53.937126 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-dc2272aa-04e8-4468-aa28-e7199ea74f14 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:53.946564 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-dc2272aa-04e8-4468-aa28-e7199ea74f14 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1519 microversion: 2.1 time: 0.162645 Jul 14 15:54:53.947173 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3781/7529] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:53 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:54.965015 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ee2139ba-db0d-4cab-aa01-343be779ebc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:54.965762 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ee2139ba-db0d-4cab-aa01-343be779ebc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:54.974322 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee2139ba-db0d-4cab-aa01-343be779ebc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:54.974796 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee2139ba-db0d-4cab-aa01-343be779ebc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:54.975718 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee2139ba-db0d-4cab-aa01-343be779ebc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:54.976157 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ee2139ba-db0d-4cab-aa01-343be779ebc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:55.116021 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ee2139ba-db0d-4cab-aa01-343be779ebc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:55.124270 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ee2139ba-db0d-4cab-aa01-343be779ebc2 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1519 microversion: 2.1 time: 0.164453 Jul 14 15:54:55.124861 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3749/7530] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:54 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:56.143518 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a07db1f9-4f7d-4ccc-ab67-ca39b86de98a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:56.144076 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a07db1f9-4f7d-4ccc-ab67-ca39b86de98a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:56.150205 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a07db1f9-4f7d-4ccc-ab67-ca39b86de98a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:56.150685 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a07db1f9-4f7d-4ccc-ab67-ca39b86de98a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:56.151470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a07db1f9-4f7d-4ccc-ab67-ca39b86de98a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:56.151930 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a07db1f9-4f7d-4ccc-ab67-ca39b86de98a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:56.284579 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a07db1f9-4f7d-4ccc-ab67-ca39b86de98a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:56.292222 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a07db1f9-4f7d-4ccc-ab67-ca39b86de98a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1575 microversion: 2.1 time: 0.154215 Jul 14 15:54:56.292804 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3782/7531] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:56 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:57.309001 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fbe2a91f-20fd-4fc2-adf5-fbde66ad5657 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:57.309612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fbe2a91f-20fd-4fc2-adf5-fbde66ad5657 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:57.316505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbe2a91f-20fd-4fc2-adf5-fbde66ad5657 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:57.316964 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbe2a91f-20fd-4fc2-adf5-fbde66ad5657 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:57.317739 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbe2a91f-20fd-4fc2-adf5-fbde66ad5657 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:57.318173 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fbe2a91f-20fd-4fc2-adf5-fbde66ad5657 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:57.455529 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fbe2a91f-20fd-4fc2-adf5-fbde66ad5657 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:57.463329 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fbe2a91f-20fd-4fc2-adf5-fbde66ad5657 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1575 microversion: 2.1 time: 0.158212 Jul 14 15:54:57.463904 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3750/7532] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:57 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:58.481128 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0608ae50-e93a-4dec-8258-3ed0880999cf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:58.481737 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0608ae50-e93a-4dec-8258-3ed0880999cf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:58.488638 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0608ae50-e93a-4dec-8258-3ed0880999cf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:58.489151 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0608ae50-e93a-4dec-8258-3ed0880999cf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:58.489929 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0608ae50-e93a-4dec-8258-3ed0880999cf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:58.490379 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0608ae50-e93a-4dec-8258-3ed0880999cf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:58.510071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:58.629096 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0608ae50-e93a-4dec-8258-3ed0880999cf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:58.636707 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0608ae50-e93a-4dec-8258-3ed0880999cf tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1575 microversion: 2.1 time: 0.159519 Jul 14 15:54:58.637327 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3783/7533] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:58 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:59.654164 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-efb20579-a40b-46a5-a56e-6068a1d66ad9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:59.654787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-efb20579-a40b-46a5-a56e-6068a1d66ad9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:59.658147 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=31 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:59.663517 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efb20579-a40b-46a5-a56e-6068a1d66ad9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:59.663975 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efb20579-a40b-46a5-a56e-6068a1d66ad9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:59.664745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efb20579-a40b-46a5-a56e-6068a1d66ad9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:59.665214 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-efb20579-a40b-46a5-a56e-6068a1d66ad9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:59.668166 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:00.091182 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-efb20579-a40b-46a5-a56e-6068a1d66ad9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:00.101421 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-efb20579-a40b-46a5-a56e-6068a1d66ad9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1575 microversion: 2.1 time: 0.451194 Jul 14 15:55:00.102504 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3751/7534] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:59 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1575 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:01.120125 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4117c779-a5fc-4ba6-972b-ef066eb05580 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:01.120755 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4117c779-a5fc-4ba6-972b-ef066eb05580 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:01.123172 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=31 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:01.128843 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4117c779-a5fc-4ba6-972b-ef066eb05580 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:01.129322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4117c779-a5fc-4ba6-972b-ef066eb05580 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:01.130112 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4117c779-a5fc-4ba6-972b-ef066eb05580 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:01.130570 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4117c779-a5fc-4ba6-972b-ef066eb05580 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:01.283695 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4117c779-a5fc-4ba6-972b-ef066eb05580 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:01.291585 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4117c779-a5fc-4ba6-972b-ef066eb05580 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1575 microversion: 2.1 time: 0.175520 Jul 14 15:55:01.292177 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3784/7535] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:01 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:02.310059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-55adb2b7-70b9-428f-beaf-2afec648903e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:02.310664 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-55adb2b7-70b9-428f-beaf-2afec648903e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:02.318631 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-55adb2b7-70b9-428f-beaf-2afec648903e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:02.319095 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-55adb2b7-70b9-428f-beaf-2afec648903e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:02.319881 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-55adb2b7-70b9-428f-beaf-2afec648903e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:02.320324 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-55adb2b7-70b9-428f-beaf-2afec648903e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:02.457220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-55adb2b7-70b9-428f-beaf-2afec648903e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:02.465079 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-55adb2b7-70b9-428f-beaf-2afec648903e tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1575 microversion: 2.1 time: 0.159044 Jul 14 15:55:02.465656 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3752/7536] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:02 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:03.481402 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2313cd52-5d18-41f3-a1de-758cf5956611 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:03.482036 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2313cd52-5d18-41f3-a1de-758cf5956611 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:03.489830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2313cd52-5d18-41f3-a1de-758cf5956611 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:03.490287 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2313cd52-5d18-41f3-a1de-758cf5956611 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:03.491119 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2313cd52-5d18-41f3-a1de-758cf5956611 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:03.491657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2313cd52-5d18-41f3-a1de-758cf5956611 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:03.627131 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2313cd52-5d18-41f3-a1de-758cf5956611 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:03.635651 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2313cd52-5d18-41f3-a1de-758cf5956611 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1575 microversion: 2.1 time: 0.158075 Jul 14 15:55:03.636242 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3785/7537] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:03 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:04.653446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-ae148f7c-eb47-492a-be91-c4220405bc8c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:04.654062 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-ae148f7c-eb47-492a-be91-c4220405bc8c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:04.662310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae148f7c-eb47-492a-be91-c4220405bc8c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:04.662768 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae148f7c-eb47-492a-be91-c4220405bc8c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:04.664160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae148f7c-eb47-492a-be91-c4220405bc8c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:04.664770 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-ae148f7c-eb47-492a-be91-c4220405bc8c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:04.804828 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-ae148f7c-eb47-492a-be91-c4220405bc8c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:04.812725 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-ae148f7c-eb47-492a-be91-c4220405bc8c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1575 microversion: 2.1 time: 0.163125 Jul 14 15:55:04.813348 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3753/7538] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:04 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:05.832350 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0a0f9d55-544b-4eaf-be04-8b43dc775f41 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:05.833012 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0a0f9d55-544b-4eaf-be04-8b43dc775f41 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:05.839967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a0f9d55-544b-4eaf-be04-8b43dc775f41 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:05.840443 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a0f9d55-544b-4eaf-be04-8b43dc775f41 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:05.841292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a0f9d55-544b-4eaf-be04-8b43dc775f41 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:05.841758 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0a0f9d55-544b-4eaf-be04-8b43dc775f41 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:05.975751 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0a0f9d55-544b-4eaf-be04-8b43dc775f41 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:05.983338 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0a0f9d55-544b-4eaf-be04-8b43dc775f41 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1575 microversion: 2.1 time: 0.156183 Jul 14 15:55:05.983908 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3786/7539] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:05 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:06.328597 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-18fff436-0a67-4e0d-9270-b4cbe4f53587 req-495f2b72-6d77-43bb-b176-e05887cd69a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4eddd9-7050-4a53-8435-7e187dffa855", "name": "network-vif-plugged", "status": "completed", "tag": "4557781d-1088-44fa-bb14-4849cb614aac"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:06.339333 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-18fff436-0a67-4e0d-9270-b4cbe4f53587 req-495f2b72-6d77-43bb-b176-e05887cd69a3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:06.340574 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-18fff436-0a67-4e0d-9270-b4cbe4f53587 req-495f2b72-6d77-43bb-b176-e05887cd69a3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:06.352854 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-18fff436-0a67-4e0d-9270-b4cbe4f53587 req-495f2b72-6d77-43bb-b176-e05887cd69a3 service nova] Creating event network-vif-plugged:4557781d-1088-44fa-bb14-4849cb614aac for instance cb4eddd9-7050-4a53-8435-7e187dffa855 on n-h1-767704-28 Jul 14 15:55:06.356464 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [req-18fff436-0a67-4e0d-9270-b4cbe4f53587 req-495f2b72-6d77-43bb-b176-e05887cd69a3 service nova] [9fdc2e62-f0c7-400a-8d62-bed9b9dbd036] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:55:07.000267 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7792b5d2-a614-4248-bac7-3e6a42d8975c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:07.000900 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7792b5d2-a614-4248-bac7-3e6a42d8975c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:07.008719 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7792b5d2-a614-4248-bac7-3e6a42d8975c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:07.009225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7792b5d2-a614-4248-bac7-3e6a42d8975c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:07.010044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7792b5d2-a614-4248-bac7-3e6a42d8975c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:07.010504 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7792b5d2-a614-4248-bac7-3e6a42d8975c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:07.146632 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7792b5d2-a614-4248-bac7-3e6a42d8975c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:07.154289 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7792b5d2-a614-4248-bac7-3e6a42d8975c tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1575 microversion: 2.1 time: 0.157928 Jul 14 15:55:07.154796 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3787/7540] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:06 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:55:07.365310 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [req-18fff436-0a67-4e0d-9270-b4cbe4f53587 req-495f2b72-6d77-43bb-b176-e05887cd69a3 service nova] [9fdc2e62-f0c7-400a-8d62-bed9b9dbd036] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 56572. Jul 14 15:55:07.369412 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-18fff436-0a67-4e0d-9270-b4cbe4f53587 req-495f2b72-6d77-43bb-b176-e05887cd69a3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.044719 Jul 14 15:55:07.370039 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3754/7541] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:08.172045 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-28de1a51-aae6-44e6-b37c-5454f58f83b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:08.172600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-28de1a51-aae6-44e6-b37c-5454f58f83b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:08.180292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28de1a51-aae6-44e6-b37c-5454f58f83b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:08.180760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28de1a51-aae6-44e6-b37c-5454f58f83b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:08.181566 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28de1a51-aae6-44e6-b37c-5454f58f83b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:08.182017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-28de1a51-aae6-44e6-b37c-5454f58f83b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:08.334292 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-28de1a51-aae6-44e6-b37c-5454f58f83b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:08.342127 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-28de1a51-aae6-44e6-b37c-5454f58f83b1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1575 microversion: 2.1 time: 0.174062 Jul 14 15:55:08.342706 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3788/7542] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:08 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:09.067475 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:55:09.067713 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:55:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:55:09.362507 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8285c17c-a127-4914-acde-edfdb3e7136b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:09.363275 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8285c17c-a127-4914-acde-edfdb3e7136b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:09.369660 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8285c17c-a127-4914-acde-edfdb3e7136b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:09.370117 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8285c17c-a127-4914-acde-edfdb3e7136b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:09.370888 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8285c17c-a127-4914-acde-edfdb3e7136b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:09.371330 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-8285c17c-a127-4914-acde-edfdb3e7136b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:09.589103 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8285c17c-a127-4914-acde-edfdb3e7136b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:09.596726 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8285c17c-a127-4914-acde-edfdb3e7136b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1562 microversion: 2.1 time: 0.240701 Jul 14 15:55:09.597325 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3755/7543] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:09 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1562 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:30.070723 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-9ace1383-d443-4905-9937-ad977ab5bcf1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:30.071608 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9ace1383-d443-4905-9937-ad977ab5bcf1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:30.076505 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-ba1e1af4-9330-4f76-bb17-18aa82b6554d req-fd739fec-3737-4ece-8e81-45d0df02d39a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4eddd9-7050-4a53-8435-7e187dffa855", "tag": "4557781d-1088-44fa-bb14-4849cb614aac"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:30.078645 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=9 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:30.079477 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=32 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:30.082337 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ace1383-d443-4905-9937-ad977ab5bcf1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:30.082935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ace1383-d443-4905-9937-ad977ab5bcf1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:30.084533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ace1383-d443-4905-9937-ad977ab5bcf1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:30.085596 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-9ace1383-d443-4905-9937-ad977ab5bcf1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:30.091866 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=9 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:30.093607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=25 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:30.098156 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ba1e1af4-9330-4f76-bb17-18aa82b6554d req-fd739fec-3737-4ece-8e81-45d0df02d39a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:30.099175 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-ba1e1af4-9330-4f76-bb17-18aa82b6554d req-fd739fec-3737-4ece-8e81-45d0df02d39a service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:30.120974 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-9ace1383-d443-4905-9937-ad977ab5bcf1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:56:30.124557 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-ba1e1af4-9330-4f76-bb17-18aa82b6554d req-fd739fec-3737-4ece-8e81-45d0df02d39a service nova] Creating event network-changed:4557781d-1088-44fa-bb14-4849cb614aac for instance cb4eddd9-7050-4a53-8435-7e187dffa855 on n-h1-767704-28 Jul 14 15:56:30.134638 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-ba1e1af4-9330-4f76-bb17-18aa82b6554d req-fd739fec-3737-4ece-8e81-45d0df02d39a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066653 Jul 14 15:56:30.136180 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3756/7544] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:56:30.235025 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-9ace1383-d443-4905-9937-ad977ab5bcf1 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 204 len: 0 microversion: 2.1 time: 0.169960 Jul 14 15:56:30.235696 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3789/7545] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 15:56:30 2022] DELETE /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:56:30.255310 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-3b8cc61d-c9c3-4699-b495-890757a0a801 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:30.256037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-3b8cc61d-c9c3-4699-b495-890757a0a801 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:30.263423 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b8cc61d-c9c3-4699-b495-890757a0a801 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:30.263852 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b8cc61d-c9c3-4699-b495-890757a0a801 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:30.264663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b8cc61d-c9c3-4699-b495-890757a0a801 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:30.265122 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-3b8cc61d-c9c3-4699-b495-890757a0a801 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:30.435877 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-3b8cc61d-c9c3-4699-b495-890757a0a801 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:30.443873 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-3b8cc61d-c9c3-4699-b495-890757a0a801 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.194554 Jul 14 15:56:30.444564 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3757/7546] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:30 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:56:31.469683 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-30fb50f6-c25c-4656-8daf-3a1c14b31aed tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:31.471567 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-30fb50f6-c25c-4656-8daf-3a1c14b31aed tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:31.482261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30fb50f6-c25c-4656-8daf-3a1c14b31aed tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:31.482817 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30fb50f6-c25c-4656-8daf-3a1c14b31aed tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:31.484185 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30fb50f6-c25c-4656-8daf-3a1c14b31aed tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:31.484660 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-30fb50f6-c25c-4656-8daf-3a1c14b31aed tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:31.769017 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-30fb50f6-c25c-4656-8daf-3a1c14b31aed tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:31.779268 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-30fb50f6-c25c-4656-8daf-3a1c14b31aed tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1568 microversion: 2.1 time: 0.315037 Jul 14 15:56:31.779976 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3790/7547] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:31 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1568 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:32.801648 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2ae0ff36-3d99-441a-a9c4-ca5d34f5958a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:32.802391 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2ae0ff36-3d99-441a-a9c4-ca5d34f5958a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:32.809440 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ae0ff36-3d99-441a-a9c4-ca5d34f5958a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:32.809896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ae0ff36-3d99-441a-a9c4-ca5d34f5958a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:32.810658 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ae0ff36-3d99-441a-a9c4-ca5d34f5958a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:32.811260 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2ae0ff36-3d99-441a-a9c4-ca5d34f5958a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:32.850343 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-1867382b-835e-4fc4-9e44-aa27e018a4bd req-fbfbf7c5-7436-4204-8df8-efb3702770dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4eddd9-7050-4a53-8435-7e187dffa855", "name": "network-vif-deleted", "tag": "4557781d-1088-44fa-bb14-4849cb614aac"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:32.869154 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1867382b-835e-4fc4-9e44-aa27e018a4bd req-fbfbf7c5-7436-4204-8df8-efb3702770dc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:32.869987 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-1867382b-835e-4fc4-9e44-aa27e018a4bd req-fbfbf7c5-7436-4204-8df8-efb3702770dc service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:32.894953 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-1867382b-835e-4fc4-9e44-aa27e018a4bd req-fbfbf7c5-7436-4204-8df8-efb3702770dc service nova] Creating event network-vif-deleted:4557781d-1088-44fa-bb14-4849cb614aac for instance cb4eddd9-7050-4a53-8435-7e187dffa855 on n-h1-767704-28 Jul 14 15:56:32.906776 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-1867382b-835e-4fc4-9e44-aa27e018a4bd req-fbfbf7c5-7436-4204-8df8-efb3702770dc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060635 Jul 14 15:56:32.907447 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3791/7548] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:56:32.908554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2ae0ff36-3d99-441a-a9c4-ca5d34f5958a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:32.919556 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2ae0ff36-3d99-441a-a9c4-ca5d34f5958a tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1382 microversion: 2.1 time: 0.123187 Jul 14 15:56:32.920333 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3758/7549] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:32 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1382 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:33.945715 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-707b6e26-d906-42fa-9a84-2be04a7c73bc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:33.946470 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-707b6e26-d906-42fa-9a84-2be04a7c73bc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:33.952801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-707b6e26-d906-42fa-9a84-2be04a7c73bc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:33.953301 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-707b6e26-d906-42fa-9a84-2be04a7c73bc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:33.954090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-707b6e26-d906-42fa-9a84-2be04a7c73bc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:33.954551 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-707b6e26-d906-42fa-9a84-2be04a7c73bc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:34.032090 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-707b6e26-d906-42fa-9a84-2be04a7c73bc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:34.040345 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-707b6e26-d906-42fa-9a84-2be04a7c73bc tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1219 microversion: 2.1 time: 0.099725 Jul 14 15:56:34.040961 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3792/7550] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:33 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:35.057716 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-28889818-57d8-444c-b7a1-062312faf2e9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:35.058247 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-28889818-57d8-444c-b7a1-062312faf2e9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:35.065988 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28889818-57d8-444c-b7a1-062312faf2e9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:35.066446 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28889818-57d8-444c-b7a1-062312faf2e9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:35.067291 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28889818-57d8-444c-b7a1-062312faf2e9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:35.067653 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-28889818-57d8-444c-b7a1-062312faf2e9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:35.132109 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-28889818-57d8-444c-b7a1-062312faf2e9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:35.139802 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-28889818-57d8-444c-b7a1-062312faf2e9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1219 microversion: 2.1 time: 0.086146 Jul 14 15:56:35.140376 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3759/7551] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:35 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:36.156546 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-f8b22702-f8b8-4a30-8d07-71790e4d3d37 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:36.157189 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-f8b22702-f8b8-4a30-8d07-71790e4d3d37 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:36.166309 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8b22702-f8b8-4a30-8d07-71790e4d3d37 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:36.166801 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8b22702-f8b8-4a30-8d07-71790e4d3d37 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:36.167612 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8b22702-f8b8-4a30-8d07-71790e4d3d37 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:36.168071 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-f8b22702-f8b8-4a30-8d07-71790e4d3d37 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:36.238490 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-f8b22702-f8b8-4a30-8d07-71790e4d3d37 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:36.246398 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-f8b22702-f8b8-4a30-8d07-71790e4d3d37 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1219 microversion: 2.1 time: 0.093886 Jul 14 15:56:36.246975 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3793/7552] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:36 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:37.263956 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-61de9faa-c496-4df1-b7af-1ae8e86346b9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:37.264535 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-61de9faa-c496-4df1-b7af-1ae8e86346b9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:37.273237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61de9faa-c496-4df1-b7af-1ae8e86346b9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:37.273237 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61de9faa-c496-4df1-b7af-1ae8e86346b9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:37.274844 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61de9faa-c496-4df1-b7af-1ae8e86346b9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:37.275787 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-61de9faa-c496-4df1-b7af-1ae8e86346b9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:37.374629 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-61de9faa-c496-4df1-b7af-1ae8e86346b9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd4c1e8688a446baef7fcb7b7f9c1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96db3341b9c747eba0451cbd45afabf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:37.390187 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-61de9faa-c496-4df1-b7af-1ae8e86346b9 tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 200 len: 1219 microversion: 2.1 time: 0.130024 Jul 14 15:56:37.391507 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3760/7553] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:37 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:38.408798 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-81f8e276-9d69-4411-a07d-5f1f5787468d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:38.409458 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-81f8e276-9d69-4411-a07d-5f1f5787468d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [instance: cb4eddd9-7050-4a53-8435-7e187dffa855] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:38.417654 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81f8e276-9d69-4411-a07d-5f1f5787468d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:38.418555 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81f8e276-9d69-4411-a07d-5f1f5787468d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:38.418922 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81f8e276-9d69-4411-a07d-5f1f5787468d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:38.419368 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-81f8e276-9d69-4411-a07d-5f1f5787468d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:38.437107 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-81f8e276-9d69-4411-a07d-5f1f5787468d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] HTTP exception thrown: Instance cb4eddd9-7050-4a53-8435-7e187dffa855 could not be found. Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-81f8e276-9d69-4411-a07d-5f1f5787468d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Request method failure captured: Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 HTTP/1.1 Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0Dp_RrYIvbDxL5KVtZdDGg24ojn1r-BHjZSgBTFS7DJWQch6sY8I5frAf7wvZGi7tRxpovLhDAySP4w37Ss_0wyw-P-nGJm2JA-Y4O9GVPXs4D82di2oeWRYNuOAWvVcnaGlDC1Mv-OHJAGfZQ7YiXhzIpzVENZo_Wmaf8ijnEVRqFQ Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: 96db3341b9c747eba0451cbd45afabf4 Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestShelveInstance-1535730201 Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/96db3341b9c747eba0451cbd45afabf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/96db3341b9c747eba0451cbd45afabf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_96db3341b9c747eba0451cbd45afabf4", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/96db3341b9c747eba0451cbd45afabf4"}]}] Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestShelveInstance-1535730201 Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: 96db3341b9c747eba0451cbd45afabf4 Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestShelveInstance-1535730201 Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestShelveInstance-1535730201-project Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 9dd4c1e8688a446baef7fcb7b7f9c1ec Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestShelveInstance-1535730201-project Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance cb4eddd9-7050-4a53-8435-7e187dffa855 could not be found. Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': 'cb4eddd9-7050-4a53-8435-7e187dffa855'} Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4eddd9-7050-4a53-8435-7e187dffa855 could not be found. Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4eddd9-7050-4a53-8435-7e187dffa855 could not be found. Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:38.440768 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:56:38.452713 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:38.452713 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:38.452713 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:38.452713 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:56:38.452713 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:56:38.452713 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4eddd9-7050-4a53-8435-7e187dffa855 could not be found. Jul 14 15:56:38.452713 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 15:56:38.452713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-81f8e276-9d69-4411-a07d-5f1f5787468d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Returning 404 to user: Instance cb4eddd9-7050-4a53-8435-7e187dffa855 could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:38.452713 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-81f8e276-9d69-4411-a07d-5f1f5787468d tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855" status: 404 len: 111 microversion: 2.1 time: 0.038150 Jul 14 15:56:38.452713 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3794/7554] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:38 2022] GET /compute/v2.1/servers/cb4eddd9-7050-4a53-8435-7e187dffa855 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:56:38.709301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c2c9fe5f-bb09-46ec-9114-287bb030795b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] Calling method '.version_select at 0x7fd6c4300dc0>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:38.712832 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c2c9fe5f-bb09-46ec-9114-287bb030795b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [dc42b563-e4b2-4de7-822e-cf9b03c28017] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:56:39.723785 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [None req-c2c9fe5f-bb09-46ec-9114-287bb030795b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] [dc42b563-e4b2-4de7-822e-cf9b03c28017] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 56644. Jul 14 15:56:39.746168 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c2c9fe5f-bb09-46ec-9114-287bb030795b tempest-TestShelveInstance-1535730201 tempest-TestShelveInstance-1535730201-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-616586407" status: 202 len: 0 microversion: 2.1 time: 1.040747 Jul 14 15:56:39.746757 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3761/7555] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jul 14 15:56:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-616586407 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:56:49.011129 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:56:49.011739 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:56:58.710016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:58.710697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:58.975522 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1260b5a7-f9c4-4cdc-8ec8-c93addf4cbf9 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Action: 'create', calling method: .version_select at 0x7fd6c4eb84c0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1030402537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSCYkOC96sg9BB3ezWwY1gTROotH66IkK3dZCQyPG+jxKFzKXVrWW1KSg1oDdpIKpBoSBa9ZxLOhfZqU4OWw2XCQFJ1lNv6XLXH1TXGr/Rzc7rIy9Iq6TEhOs5rKpv7kg=="}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:58.991760 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1260b5a7-f9c4-4cdc-8ec8-c93addf4cbf9 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Getting quotas for project f89f0e220b804f929c5f03d32e97cceb. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:56:58.997406 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.quota [None req-1260b5a7-f9c4-4cdc-8ec8-c93addf4cbf9 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Getting quotas for user 773b8b1c90e14ab984b6d8d4859ed144 and project f89f0e220b804f929c5f03d32e97cceb. Resources: {'key_pairs'} {{(pid=119512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:56:59.031360 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1260b5a7-f9c4-4cdc-8ec8-c93addf4cbf9 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.327827 Jul 14 15:56:59.031654 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3795/7556] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jul 14 15:56:58 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:00.094785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-145318104", "imageRef": "4f5e5af0-d72c-4006-a62b-d41e489facb7", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1030402537", "security_groups": [{"name": "tempest-secgroup-smoke-954185995"}], "networks": [{"uuid": "a4a7c22a-0f87-4117-a5b4-e594c10e61f6"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:00.103745 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=26 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:00.104499 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:00.214554 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] validate_networks() for [('a4a7c22a-0f87-4117-a5b4-e594c10e61f6', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:57:00.715129 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:57:00.715563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:57:00.716047 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:57:00.716463 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:57:00.716884 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:57:00.726802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.727264 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.728082 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:00.728531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:00.745459 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Getting quotas for project f89f0e220b804f929c5f03d32e97cceb. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:57:00.750827 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Getting quotas for user 773b8b1c90e14ab984b6d8d4859ed144 and project f89f0e220b804f929c5f03d32e97cceb. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:57:00.764007 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:57:00.766531 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f5e5af0-d72c-4006-a62b-d41e489facb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:57:00.815512 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-52a7ec4e-7168-4cd0-9d84-dfe137781cad tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.724586 Jul 14 15:57:00.816200 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3762/7557] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:57:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:57:00.827061 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3cade7bc-cf6f-4d2e-aea3-6a99ee1e7c36 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:00.827702 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3cade7bc-cf6f-4d2e-aea3-6a99ee1e7c36 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:00.887818 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-3cade7bc-cf6f-4d2e-aea3-6a99ee1e7c36 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:00.895715 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3cade7bc-cf6f-4d2e-aea3-6a99ee1e7c36 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1248 microversion: 2.1 time: 0.073377 Jul 14 15:57:00.896304 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3796/7558] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:00 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:01.914470 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-792bcde5-a6cc-41e1-87ff-c13d55ab6771 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:01.916568 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-792bcde5-a6cc-41e1-87ff-c13d55ab6771 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:01.990986 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-792bcde5-a6cc-41e1-87ff-c13d55ab6771 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:01.998916 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-792bcde5-a6cc-41e1-87ff-c13d55ab6771 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1248 microversion: 2.1 time: 0.089420 Jul 14 15:57:01.999641 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3763/7559] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:01 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1248 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:03.015720 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a3b2828e-bab2-47ce-92c8-45ece87df12c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:03.016626 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a3b2828e-bab2-47ce-92c8-45ece87df12c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:03.076354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-a3b2828e-bab2-47ce-92c8-45ece87df12c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:03.083886 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a3b2828e-bab2-47ce-92c8-45ece87df12c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1248 microversion: 2.1 time: 0.072081 Jul 14 15:57:03.084462 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3797/7560] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:03 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:04.101590 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-8b4b17d6-9898-4755-a944-721223df18be tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:04.102187 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-8b4b17d6-9898-4755-a944-721223df18be tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:04.159862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-8b4b17d6-9898-4755-a944-721223df18be tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:04.167179 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-8b4b17d6-9898-4755-a944-721223df18be tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1248 microversion: 2.1 time: 0.069704 Jul 14 15:57:04.167738 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3764/7561] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:04 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1248 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:05.184594 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-068479a9-efee-4377-a409-e8be9d2dc01d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:05.185245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-068479a9-efee-4377-a409-e8be9d2dc01d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:05.192561 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-068479a9-efee-4377-a409-e8be9d2dc01d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.193063 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-068479a9-efee-4377-a409-e8be9d2dc01d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:05.193873 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-068479a9-efee-4377-a409-e8be9d2dc01d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:05.194322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-068479a9-efee-4377-a409-e8be9d2dc01d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:05.255340 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-068479a9-efee-4377-a409-e8be9d2dc01d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:05.262832 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-068479a9-efee-4377-a409-e8be9d2dc01d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1252 microversion: 2.1 time: 0.082225 Jul 14 15:57:05.263397 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3798/7562] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:05 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1252 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:06.280607 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-23aa4a02-4f71-4173-af6d-829ab42c575b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:06.281396 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-23aa4a02-4f71-4173-af6d-829ab42c575b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:06.288996 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23aa4a02-4f71-4173-af6d-829ab42c575b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:06.289454 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23aa4a02-4f71-4173-af6d-829ab42c575b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:06.290344 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23aa4a02-4f71-4173-af6d-829ab42c575b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:06.290785 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-23aa4a02-4f71-4173-af6d-829ab42c575b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:06.358982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-23aa4a02-4f71-4173-af6d-829ab42c575b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:06.366671 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-23aa4a02-4f71-4173-af6d-829ab42c575b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1306 microversion: 2.1 time: 0.090380 Jul 14 15:57:06.367247 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3765/7563] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:06 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1306 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:07.384588 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-016fc927-63db-4409-9dd3-1dacb6bdd283 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:07.385946 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-016fc927-63db-4409-9dd3-1dacb6bdd283 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:07.398225 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-016fc927-63db-4409-9dd3-1dacb6bdd283 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:07.398935 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-016fc927-63db-4409-9dd3-1dacb6bdd283 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:07.400209 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-016fc927-63db-4409-9dd3-1dacb6bdd283 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:07.401453 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-016fc927-63db-4409-9dd3-1dacb6bdd283 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:07.613437 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-016fc927-63db-4409-9dd3-1dacb6bdd283 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:07.620984 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-016fc927-63db-4409-9dd3-1dacb6bdd283 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1373 microversion: 2.1 time: 0.241186 Jul 14 15:57:07.621574 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3799/7564] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:07 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1373 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:07.817982 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-3346761f-1d27-4edf-8923-a043ceefe0ab req-4ccf7da7-bb3a-4d0a-a3c7-e3d9f2bce906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3430bf3e-d9f6-493e-a5a5-193694e4f22e", "tag": "029c4d30-529d-4cb1-9cc0-792f190f1e10"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:07.827205 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3346761f-1d27-4edf-8923-a043ceefe0ab req-4ccf7da7-bb3a-4d0a-a3c7-e3d9f2bce906 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:07.828022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-3346761f-1d27-4edf-8923-a043ceefe0ab req-4ccf7da7-bb3a-4d0a-a3c7-e3d9f2bce906 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:07.839748 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-3346761f-1d27-4edf-8923-a043ceefe0ab req-4ccf7da7-bb3a-4d0a-a3c7-e3d9f2bce906 service nova] Creating event network-changed:029c4d30-529d-4cb1-9cc0-792f190f1e10 for instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e on n-h1-767704-28 Jul 14 15:57:07.844837 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-3346761f-1d27-4edf-8923-a043ceefe0ab req-4ccf7da7-bb3a-4d0a-a3c7-e3d9f2bce906 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129883 Jul 14 15:57:07.846021 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3766/7565] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:57:08.638499 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-7619c85a-ed77-4f49-b191-19c502b3835d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:08.639129 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-7619c85a-ed77-4f49-b191-19c502b3835d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:08.647156 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7619c85a-ed77-4f49-b191-19c502b3835d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.647634 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7619c85a-ed77-4f49-b191-19c502b3835d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.648425 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7619c85a-ed77-4f49-b191-19c502b3835d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:08.648887 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-7619c85a-ed77-4f49-b191-19c502b3835d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:08.787011 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-7619c85a-ed77-4f49-b191-19c502b3835d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:08.794685 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-7619c85a-ed77-4f49-b191-19c502b3835d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1373 microversion: 2.1 time: 0.160244 Jul 14 15:57:08.795291 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3800/7566] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:08 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:09.816278 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-7dad3530-02c4-4cda-92a3-926631c2d675 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:09.817098 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-7dad3530-02c4-4cda-92a3-926631c2d675 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:09.823895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7dad3530-02c4-4cda-92a3-926631c2d675 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:09.824364 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7dad3530-02c4-4cda-92a3-926631c2d675 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:09.825197 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7dad3530-02c4-4cda-92a3-926631c2d675 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:09.825646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-7dad3530-02c4-4cda-92a3-926631c2d675 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:09.970456 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-7dad3530-02c4-4cda-92a3-926631c2d675 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:09.979050 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-7dad3530-02c4-4cda-92a3-926631c2d675 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1373 microversion: 2.1 time: 0.169106 Jul 14 15:57:09.979628 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3767/7567] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:09 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:10.995830 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-ddd61b74-8558-41ff-b4ec-ba299cb424da tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:10.996493 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-ddd61b74-8558-41ff-b4ec-ba299cb424da tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:11.004044 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddd61b74-8558-41ff-b4ec-ba299cb424da tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:11.004576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddd61b74-8558-41ff-b4ec-ba299cb424da tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.005399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddd61b74-8558-41ff-b4ec-ba299cb424da tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:11.005860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-ddd61b74-8558-41ff-b4ec-ba299cb424da tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:11.440290 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-ddd61b74-8558-41ff-b4ec-ba299cb424da tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:11.447911 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-ddd61b74-8558-41ff-b4ec-ba299cb424da tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1373 microversion: 2.1 time: 0.455978 Jul 14 15:57:11.448494 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3801/7568] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:10 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1373 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:12.465564 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-2dada28e-c197-42ee-97cf-71a58357b4f7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:12.466178 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-2dada28e-c197-42ee-97cf-71a58357b4f7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:12.468177 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:12.475731 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2dada28e-c197-42ee-97cf-71a58357b4f7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.476216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2dada28e-c197-42ee-97cf-71a58357b4f7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.476991 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2dada28e-c197-42ee-97cf-71a58357b4f7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:12.477437 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-2dada28e-c197-42ee-97cf-71a58357b4f7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:12.611050 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-2dada28e-c197-42ee-97cf-71a58357b4f7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:12.618668 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-2dada28e-c197-42ee-97cf-71a58357b4f7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1373 microversion: 2.1 time: 0.157063 Jul 14 15:57:12.619234 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3768/7569] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:12 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:13.635375 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-4aaf3c7e-67a1-4474-b08a-5928a3e43e79 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:13.636002 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-4aaf3c7e-67a1-4474-b08a-5928a3e43e79 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:13.638742 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=8 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:13.645699 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aaf3c7e-67a1-4474-b08a-5928a3e43e79 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.646169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aaf3c7e-67a1-4474-b08a-5928a3e43e79 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.646957 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aaf3c7e-67a1-4474-b08a-5928a3e43e79 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:13.647416 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-4aaf3c7e-67a1-4474-b08a-5928a3e43e79 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:13.781258 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-4aaf3c7e-67a1-4474-b08a-5928a3e43e79 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:13.789603 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-4aaf3c7e-67a1-4474-b08a-5928a3e43e79 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1373 microversion: 2.1 time: 0.158154 Jul 14 15:57:13.790394 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3802/7570] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:13 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:14.806826 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c75f2025-a1e3-4a61-96a2-aadfedd60c35 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:14.807445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c75f2025-a1e3-4a61-96a2-aadfedd60c35 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:14.810220 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=10 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:14.815646 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c75f2025-a1e3-4a61-96a2-aadfedd60c35 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.816105 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c75f2025-a1e3-4a61-96a2-aadfedd60c35 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.816885 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c75f2025-a1e3-4a61-96a2-aadfedd60c35 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.817351 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c75f2025-a1e3-4a61-96a2-aadfedd60c35 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.960752 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-c75f2025-a1e3-4a61-96a2-aadfedd60c35 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:14.969956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-bdaf33af-c2da-4c1d-bdf9-be8225643268 req-dc9d6c53-2ed8-4a58-a326-c2bdf8efccb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3430bf3e-d9f6-493e-a5a5-193694e4f22e", "name": "network-vif-plugged", "status": "completed", "tag": "029c4d30-529d-4cb1-9cc0-792f190f1e10"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:14.970523 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c75f2025-a1e3-4a61-96a2-aadfedd60c35 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1373 microversion: 2.1 time: 0.167047 Jul 14 15:57:14.981296 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bdaf33af-c2da-4c1d-bdf9-be8225643268 req-dc9d6c53-2ed8-4a58-a326-c2bdf8efccb0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:14.981890 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3769/7571] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:14 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:14.982031 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bdaf33af-c2da-4c1d-bdf9-be8225643268 req-dc9d6c53-2ed8-4a58-a326-c2bdf8efccb0 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:14.993557 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-bdaf33af-c2da-4c1d-bdf9-be8225643268 req-dc9d6c53-2ed8-4a58-a326-c2bdf8efccb0 service nova] Creating event network-vif-plugged:029c4d30-529d-4cb1-9cc0-792f190f1e10 for instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e on n-h1-767704-28 Jul 14 15:57:14.998512 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-bdaf33af-c2da-4c1d-bdf9-be8225643268 req-dc9d6c53-2ed8-4a58-a326-c2bdf8efccb0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032967 Jul 14 15:57:14.999290 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3803/7572] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:57:15.988074 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-06c911ee-19f6-4f8d-bf19-7cfe02c2e056 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:15.988692 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-06c911ee-19f6-4f8d-bf19-7cfe02c2e056 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:15.995622 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06c911ee-19f6-4f8d-bf19-7cfe02c2e056 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.996086 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06c911ee-19f6-4f8d-bf19-7cfe02c2e056 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:15.996856 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06c911ee-19f6-4f8d-bf19-7cfe02c2e056 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:15.997331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-06c911ee-19f6-4f8d-bf19-7cfe02c2e056 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:16.129331 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-06c911ee-19f6-4f8d-bf19-7cfe02c2e056 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:16.138233 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-06c911ee-19f6-4f8d-bf19-7cfe02c2e056 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1373 microversion: 2.1 time: 0.154502 Jul 14 15:57:16.138811 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3770/7573] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:15 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:17.159159 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-1e57d29e-e761-43be-ad40-a69008583963 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:17.159899 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-1e57d29e-e761-43be-ad40-a69008583963 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:17.166320 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e57d29e-e761-43be-ad40-a69008583963 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.166858 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e57d29e-e761-43be-ad40-a69008583963 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.167600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e57d29e-e761-43be-ad40-a69008583963 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.168060 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-1e57d29e-e761-43be-ad40-a69008583963 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.360663 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-1e57d29e-e761-43be-ad40-a69008583963 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.369152 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-1e57d29e-e761-43be-ad40-a69008583963 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1558 microversion: 2.1 time: 0.216056 Jul 14 15:57:17.369729 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3804/7574] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:17 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:17.386293 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-1aeb551c-019c-4361-8882-f34a3c949f6f tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:57:17.386912 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-1aeb551c-019c-4361-8882-f34a3c949f6f tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:57:17.394628 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1aeb551c-019c-4361-8882-f34a3c949f6f tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.395087 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1aeb551c-019c-4361-8882-f34a3c949f6f tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.395862 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1aeb551c-019c-4361-8882-f34a3c949f6f tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:17.396309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-1aeb551c-019c-4361-8882-f34a3c949f6f tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:17.527281 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-1aeb551c-019c-4361-8882-f34a3c949f6f tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:57:17.535415 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-1aeb551c-019c-4361-8882-f34a3c949f6f tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1558 microversion: 2.1 time: 0.152860 Jul 14 15:57:17.535929 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3771/7575] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:57:17 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:57:19.195543 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-b1b668f1-0871-4faf-a0b0-16e0ca337eeb req-04c6de2c-0cc3-4966-ac39-48f16e050e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3430bf3e-d9f6-493e-a5a5-193694e4f22e", "tag": "029c4d30-529d-4cb1-9cc0-792f190f1e10"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:57:19.205792 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b1b668f1-0871-4faf-a0b0-16e0ca337eeb req-04c6de2c-0cc3-4966-ac39-48f16e050e1b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:57:19.206299 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-b1b668f1-0871-4faf-a0b0-16e0ca337eeb req-04c6de2c-0cc3-4966-ac39-48f16e050e1b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:57:19.219725 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-b1b668f1-0871-4faf-a0b0-16e0ca337eeb req-04c6de2c-0cc3-4966-ac39-48f16e050e1b service nova] Creating event network-changed:029c4d30-529d-4cb1-9cc0-792f190f1e10 for instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e on n-h1-767704-28 Jul 14 15:57:19.225305 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-b1b668f1-0871-4faf-a0b0-16e0ca337eeb req-04c6de2c-0cc3-4966-ac39-48f16e050e1b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033460 Jul 14 15:57:19.225995 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3805/7576] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:29.075232 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:58:29.076023 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 15:58:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:59:24.403621 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:24.404376 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=40 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:24.408914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-30585206-96aa-4d03-a99e-1cf1e4f8ab21 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-776731509"}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:24.410016 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-30585206-96aa-4d03-a99e-1cf1e4f8ab21 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:24.417438 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30585206-96aa-4d03-a99e-1cf1e4f8ab21 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:24.417894 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30585206-96aa-4d03-a99e-1cf1e4f8ab21 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:24.418667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30585206-96aa-4d03-a99e-1cf1e4f8ab21 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:24.419111 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-30585206-96aa-4d03-a99e-1cf1e4f8ab21 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:24.685707 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-30585206-96aa-4d03-a99e-1cf1e4f8ab21 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "POST /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e/action" status: 202 len: 0 microversion: 2.1 time: 0.283858 Jul 14 15:59:24.686261 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3772/7577] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 15:59:24 2022] POST /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 15:59:31.601750 n-d-767704-28 devstack@n-api.service[119512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [26449759-db35-49d5-85de-1ac97211f6c5] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:59:31.603976 n-d-767704-28 devstack@n-api.service[119512]: ERROR oslo.messaging._drivers.impl_rabbit [-] [18fa8ee7-2e4b-4257-83cb-9dead624f713] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:59:31.604657 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:31.605745 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=40 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:31.610712 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-3c6b8160-b3c1-4a05-99cc-a0fba996081e req-e56bf4b6-a5cc-436f-af7f-1510a890bc66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3430bf3e-d9f6-493e-a5a5-193694e4f22e", "name": "network-vif-plugged", "status": "completed", "tag": "029c4d30-529d-4cb1-9cc0-792f190f1e10"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:31.622174 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3c6b8160-b3c1-4a05-99cc-a0fba996081e req-e56bf4b6-a5cc-436f-af7f-1510a890bc66 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:31.622948 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-3c6b8160-b3c1-4a05-99cc-a0fba996081e req-e56bf4b6-a5cc-436f-af7f-1510a890bc66 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:31.638073 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-3c6b8160-b3c1-4a05-99cc-a0fba996081e req-e56bf4b6-a5cc-436f-af7f-1510a890bc66 service nova] Creating event network-vif-plugged:029c4d30-529d-4cb1-9cc0-792f190f1e10 for instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e on n-h1-767704-28 Jul 14 15:59:31.647962 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-3c6b8160-b3c1-4a05-99cc-a0fba996081e req-e56bf4b6-a5cc-436f-af7f-1510a890bc66 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047859 Jul 14 15:59:31.648672 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3806/7578] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:38.213134 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a22d85c6-ae9d-41d6-a69e-ea6ad90634fc] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:59:38.213941 n-d-767704-28 devstack@n-api.service[119511]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d4f9fe7-d901-4181-b484-84a90bcc1a95] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:59:38.214466 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:38.215222 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:38.219973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1366045595", "imageRef": "8af366bc-5a3a-48a9-b91d-9688945be607", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1030402537", "security_groups": [{"name": "tempest-secgroup-smoke-954185995"}], "networks": [{"uuid": "a4a7c22a-0f87-4117-a5b4-e594c10e61f6"}]}} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:38.327896 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.network.neutron [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] validate_networks() for [('a4a7c22a-0f87-4117-a5b4-e594c10e61f6', None, None, None, None, None)] {{(pid=119511) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:59:38.700876 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Flavor limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:59:38.701332 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Image limits 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:59:38.701802 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Flavor pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:59:38.702206 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Image pref 0:0:0 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:59:38.702612 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.virt.hardware [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:59:38.712246 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:38.712696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:38.713553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:38.713990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:38.730960 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Getting quotas for project f89f0e220b804f929c5f03d32e97cceb. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:38.736696 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.quota [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Getting quotas for user 773b8b1c90e14ab984b6d8d4859ed144 and project f89f0e220b804f929c5f03d32e97cceb. Resources: {'instances', 'cores', 'ram'} {{(pid=119511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:38.749013 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Going to run 1 instances... {{(pid=119511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:59:38.751467 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8af366bc-5a3a-48a9-b91d-9688945be607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:59:38.800605 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-035a8438-ad00-47f0-ac58-ff24946dba5e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.588837 Jul 14 15:59:38.801477 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3773/7579] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jul 14 15:59:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:59:38.815932 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8ee38fea-a73d-4711-a060-770f2c52b988 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:38.816811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8ee38fea-a73d-4711-a060-770f2c52b988 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:38.836987 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] [26449759-db35-49d5-85de-1ac97211f6c5] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 57030. Jul 14 15:59:38.838374 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] [18fa8ee7-2e4b-4257-83cb-9dead624f713] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 57032. Jul 14 15:59:38.886256 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-8ee38fea-a73d-4711-a060-770f2c52b988 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:38.894003 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8ee38fea-a73d-4711-a060-770f2c52b988 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1249 microversion: 2.1 time: 0.085608 Jul 14 15:59:38.894659 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3807/7580] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:38 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:39.917608 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-25d42edc-36fe-4c6a-afc0-9c5e0b0c0346 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:39.918851 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-25d42edc-36fe-4c6a-afc0-9c5e0b0c0346 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:39.928081 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25d42edc-36fe-4c6a-afc0-9c5e0b0c0346 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:39.928537 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25d42edc-36fe-4c6a-afc0-9c5e0b0c0346 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:39.929363 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25d42edc-36fe-4c6a-afc0-9c5e0b0c0346 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:39.929801 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-25d42edc-36fe-4c6a-afc0-9c5e0b0c0346 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:39.938028 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d4f9fe7-d901-4181-b484-84a90bcc1a95] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 57048. Jul 14 15:59:39.952414 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] [a22d85c6-ae9d-41d6-a69e-ea6ad90634fc] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 57046. Jul 14 15:59:40.012204 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-25d42edc-36fe-4c6a-afc0-9c5e0b0c0346 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:40.023491 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-25d42edc-36fe-4c6a-afc0-9c5e0b0c0346 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1309 microversion: 2.1 time: 0.114799 Jul 14 15:59:40.024845 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3774/7581] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:39 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:41.042198 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-d63e77e0-d281-4b39-91ee-4b8b92d6adf5 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:41.043521 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-d63e77e0-d281-4b39-91ee-4b8b92d6adf5 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:41.051388 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d63e77e0-d281-4b39-91ee-4b8b92d6adf5 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:41.051869 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d63e77e0-d281-4b39-91ee-4b8b92d6adf5 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:41.052684 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d63e77e0-d281-4b39-91ee-4b8b92d6adf5 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:41.053184 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-d63e77e0-d281-4b39-91ee-4b8b92d6adf5 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:41.292281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-d63e77e0-d281-4b39-91ee-4b8b92d6adf5 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:41.301352 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-d63e77e0-d281-4b39-91ee-4b8b92d6adf5 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.263734 Jul 14 15:59:41.310202 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3808/7582] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:41 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:41.750620 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-05a6e699-beb3-4d18-82f8-5430b63ff35e req-2cf032b8-bf84-4e55-a39d-93d1f24b1cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3430bf3e-d9f6-493e-a5a5-193694e4f22e", "name": "network-vif-unplugged", "status": "completed", "tag": "029c4d30-529d-4cb1-9cc0-792f190f1e10"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:41.761610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-05a6e699-beb3-4d18-82f8-5430b63ff35e req-2cf032b8-bf84-4e55-a39d-93d1f24b1cac service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:41.762450 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-05a6e699-beb3-4d18-82f8-5430b63ff35e req-2cf032b8-bf84-4e55-a39d-93d1f24b1cac service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:41.787404 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-05a6e699-beb3-4d18-82f8-5430b63ff35e req-2cf032b8-bf84-4e55-a39d-93d1f24b1cac service nova] Creating event network-vif-unplugged:029c4d30-529d-4cb1-9cc0-792f190f1e10 for instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e on n-h1-767704-28 Jul 14 15:59:41.795981 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-05a6e699-beb3-4d18-82f8-5430b63ff35e req-2cf032b8-bf84-4e55-a39d-93d1f24b1cac service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048034 Jul 14 15:59:41.796722 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3775/7583] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:42.327709 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e195526b-8f2a-451b-891f-39db75fb6e41 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:42.328338 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e195526b-8f2a-451b-891f-39db75fb6e41 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:42.335996 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e195526b-8f2a-451b-891f-39db75fb6e41 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.336577 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e195526b-8f2a-451b-891f-39db75fb6e41 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.337427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e195526b-8f2a-451b-891f-39db75fb6e41 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.337956 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e195526b-8f2a-451b-891f-39db75fb6e41 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.490281 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e195526b-8f2a-451b-891f-39db75fb6e41 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:42.499124 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e195526b-8f2a-451b-891f-39db75fb6e41 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.175230 Jul 14 15:59:42.499713 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3809/7584] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:42 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:43.516301 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-6c426b8d-f5e0-4d25-bf3c-104b35f4327e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:43.517041 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-6c426b8d-f5e0-4d25-bf3c-104b35f4327e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:43.526240 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6c426b8d-f5e0-4d25-bf3c-104b35f4327e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:43.526735 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6c426b8d-f5e0-4d25-bf3c-104b35f4327e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:43.527492 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6c426b8d-f5e0-4d25-bf3c-104b35f4327e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:43.527941 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-6c426b8d-f5e0-4d25-bf3c-104b35f4327e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:43.669367 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-6c426b8d-f5e0-4d25-bf3c-104b35f4327e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:43.681933 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-6c426b8d-f5e0-4d25-bf3c-104b35f4327e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.169847 Jul 14 15:59:43.682807 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3776/7585] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:43 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:44.700427 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-5084a54e-5727-4502-a1b2-e4d14464b40b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:44.701100 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-5084a54e-5727-4502-a1b2-e4d14464b40b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:44.707527 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5084a54e-5727-4502-a1b2-e4d14464b40b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:44.708016 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5084a54e-5727-4502-a1b2-e4d14464b40b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:44.709055 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5084a54e-5727-4502-a1b2-e4d14464b40b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:44.709533 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-5084a54e-5727-4502-a1b2-e4d14464b40b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:44.856648 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-5084a54e-5727-4502-a1b2-e4d14464b40b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:44.864587 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-5084a54e-5727-4502-a1b2-e4d14464b40b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.170259 Jul 14 15:59:44.865200 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3810/7586] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:44 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:45.888315 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-e2ea982c-35b5-4017-97e9-5241ef241756 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:45.889552 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-e2ea982c-35b5-4017-97e9-5241ef241756 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:45.903605 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2ea982c-35b5-4017-97e9-5241ef241756 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.904414 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2ea982c-35b5-4017-97e9-5241ef241756 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.905623 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2ea982c-35b5-4017-97e9-5241ef241756 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.908994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-e2ea982c-35b5-4017-97e9-5241ef241756 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:46.062704 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-e2ea982c-35b5-4017-97e9-5241ef241756 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:46.074309 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-e2ea982c-35b5-4017-97e9-5241ef241756 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.195442 Jul 14 15:59:46.074901 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3777/7587] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:45 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:47.092028 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-6d2323d7-63a4-4a97-b904-0711c6fda0b0 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:47.092807 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-6d2323d7-63a4-4a97-b904-0711c6fda0b0 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:47.099787 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d2323d7-63a4-4a97-b904-0711c6fda0b0 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:47.100260 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d2323d7-63a4-4a97-b904-0711c6fda0b0 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:47.101086 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d2323d7-63a4-4a97-b904-0711c6fda0b0 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:47.101544 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-6d2323d7-63a4-4a97-b904-0711c6fda0b0 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:47.254485 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-6d2323d7-63a4-4a97-b904-0711c6fda0b0 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:47.264046 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-6d2323d7-63a4-4a97-b904-0711c6fda0b0 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.176116 Jul 14 15:59:47.264642 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3811/7588] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:47 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:48.281421 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-b09df4e2-31b1-4ea9-bcee-4437b3991209 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:48.281994 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-b09df4e2-31b1-4ea9-bcee-4437b3991209 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:48.288966 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b09df4e2-31b1-4ea9-bcee-4437b3991209 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:48.289818 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b09df4e2-31b1-4ea9-bcee-4437b3991209 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:48.290289 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b09df4e2-31b1-4ea9-bcee-4437b3991209 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:48.290740 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-b09df4e2-31b1-4ea9-bcee-4437b3991209 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:48.421144 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-b09df4e2-31b1-4ea9-bcee-4437b3991209 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:48.428572 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-b09df4e2-31b1-4ea9-bcee-4437b3991209 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.151247 Jul 14 15:59:48.429171 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3778/7589] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:48 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:49.266191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-689c985e-39a0-4dc0-96d8-d1015373fe8f req-350da06d-2b57-43d7-9ec2-fabebc3c415b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25e44b4c-a762-4ad5-877b-917140067d8b", "tag": "33c98784-1696-41ea-a116-21522a89378d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:49.278901 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell0:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:49.285074 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-689c985e-39a0-4dc0-96d8-d1015373fe8f req-350da06d-2b57-43d7-9ec2-fabebc3c415b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.285491 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-689c985e-39a0-4dc0-96d8-d1015373fe8f req-350da06d-2b57-43d7-9ec2-fabebc3c415b service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.300685 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-689c985e-39a0-4dc0-96d8-d1015373fe8f req-350da06d-2b57-43d7-9ec2-fabebc3c415b service nova] Creating event network-changed:33c98784-1696-41ea-a116-21522a89378d for instance 25e44b4c-a762-4ad5-877b-917140067d8b on n-h2-767704-28 Jul 14 15:59:49.307331 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-689c985e-39a0-4dc0-96d8-d1015373fe8f req-350da06d-2b57-43d7-9ec2-fabebc3c415b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047201 Jul 14 15:59:49.308553 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3812/7590] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:49.449548 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-fe40686f-9577-4ea1-bc71-b2d319925404 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:49.450889 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-fe40686f-9577-4ea1-bc71-b2d319925404 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:49.452990 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:49.453663 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell0:SELECT=6 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:49.464895 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe40686f-9577-4ea1-bc71-b2d319925404 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.465413 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe40686f-9577-4ea1-bc71-b2d319925404 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.468610 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe40686f-9577-4ea1-bc71-b2d319925404 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:49.469150 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-fe40686f-9577-4ea1-bc71-b2d319925404 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:49.682905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-fe40686f-9577-4ea1-bc71-b2d319925404 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:49.690631 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-fe40686f-9577-4ea1-bc71-b2d319925404 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.248567 Jul 14 15:59:49.691212 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3779/7591] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:49 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:50.709067 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-188f0b88-33f1-4e94-b48d-afe05aa15a88 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:50.709780 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-188f0b88-33f1-4e94-b48d-afe05aa15a88 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:50.716203 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-188f0b88-33f1-4e94-b48d-afe05aa15a88 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.716670 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-188f0b88-33f1-4e94-b48d-afe05aa15a88 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.717469 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-188f0b88-33f1-4e94-b48d-afe05aa15a88 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:50.717954 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-188f0b88-33f1-4e94-b48d-afe05aa15a88 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:50.854004 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-188f0b88-33f1-4e94-b48d-afe05aa15a88 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:50.862106 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-188f0b88-33f1-4e94-b48d-afe05aa15a88 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.158100 Jul 14 15:59:50.862696 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3813/7592] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:50 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:51.880018 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-9f52bccf-806c-4acd-9a55-c134cdd87492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:51.880634 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-9f52bccf-806c-4acd-9a55-c134cdd87492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:51.887667 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f52bccf-806c-4acd-9a55-c134cdd87492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.888124 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f52bccf-806c-4acd-9a55-c134cdd87492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:51.888970 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f52bccf-806c-4acd-9a55-c134cdd87492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:51.889359 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-9f52bccf-806c-4acd-9a55-c134cdd87492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:52.030379 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-9f52bccf-806c-4acd-9a55-c134cdd87492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:52.037812 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-9f52bccf-806c-4acd-9a55-c134cdd87492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.161771 Jul 14 15:59:52.038396 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3780/7593] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:51 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:53.066043 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-2e980a0b-d833-4131-a8c4-80bc2202e64a tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:53.067680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-2e980a0b-d833-4131-a8c4-80bc2202e64a tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:53.092997 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e980a0b-d833-4131-a8c4-80bc2202e64a tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:53.093576 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e980a0b-d833-4131-a8c4-80bc2202e64a tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:53.096328 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e980a0b-d833-4131-a8c4-80bc2202e64a tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:53.096879 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-2e980a0b-d833-4131-a8c4-80bc2202e64a tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:53.249171 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-2e980a0b-d833-4131-a8c4-80bc2202e64a tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:53.256641 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-2e980a0b-d833-4131-a8c4-80bc2202e64a tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.205196 Jul 14 15:59:53.257287 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3814/7594] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:53 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:54.274914 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-df1796c8-9fc0-4613-b997-90c22edb3cd7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:54.275533 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-df1796c8-9fc0-4613-b997-90c22edb3cd7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:54.282556 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df1796c8-9fc0-4613-b997-90c22edb3cd7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:54.283022 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df1796c8-9fc0-4613-b997-90c22edb3cd7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:54.283798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df1796c8-9fc0-4613-b997-90c22edb3cd7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:54.284241 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-df1796c8-9fc0-4613-b997-90c22edb3cd7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:54.469429 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-e13a6ca8-698e-4159-aba5-2a943214f4ac req-3ffdc969-9d76-4d59-bc6c-7b26217d5ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e44b4c-a762-4ad5-877b-917140067d8b", "name": "network-vif-plugged", "status": "completed", "tag": "33c98784-1696-41ea-a116-21522a89378d"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:54.479706 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e13a6ca8-698e-4159-aba5-2a943214f4ac req-3ffdc969-9d76-4d59-bc6c-7b26217d5ee3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:54.480176 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-e13a6ca8-698e-4159-aba5-2a943214f4ac req-3ffdc969-9d76-4d59-bc6c-7b26217d5ee3 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:54.493888 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-e13a6ca8-698e-4159-aba5-2a943214f4ac req-3ffdc969-9d76-4d59-bc6c-7b26217d5ee3 service nova] Creating event network-vif-plugged:33c98784-1696-41ea-a116-21522a89378d for instance 25e44b4c-a762-4ad5-877b-917140067d8b on n-h2-767704-28 Jul 14 15:59:54.499674 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-e13a6ca8-698e-4159-aba5-2a943214f4ac req-3ffdc969-9d76-4d59-bc6c-7b26217d5ee3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119008 Jul 14 15:59:54.500614 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3815/7595] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:54.746064 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-df1796c8-9fc0-4613-b997-90c22edb3cd7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:54.753517 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-df1796c8-9fc0-4613-b997-90c22edb3cd7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.483101 Jul 14 15:59:54.754082 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3781/7596] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:54 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:55.772781 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-420a398d-1a2b-4b60-b0da-0d6069e76b85 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:55.773529 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-420a398d-1a2b-4b60-b0da-0d6069e76b85 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:55.780483 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-420a398d-1a2b-4b60-b0da-0d6069e76b85 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.780963 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-420a398d-1a2b-4b60-b0da-0d6069e76b85 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.781747 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-420a398d-1a2b-4b60-b0da-0d6069e76b85 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:55.782199 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-420a398d-1a2b-4b60-b0da-0d6069e76b85 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:55.919110 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-420a398d-1a2b-4b60-b0da-0d6069e76b85 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:55.926706 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-420a398d-1a2b-4b60-b0da-0d6069e76b85 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1374 microversion: 2.1 time: 0.159356 Jul 14 15:59:55.927580 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3816/7597] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:55 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:56.943686 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-bb089b00-9eff-463f-8633-87e0451e6cb3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:56.944307 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-bb089b00-9eff-463f-8633-87e0451e6cb3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:56.951445 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb089b00-9eff-463f-8633-87e0451e6cb3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.951907 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb089b00-9eff-463f-8633-87e0451e6cb3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.952677 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb089b00-9eff-463f-8633-87e0451e6cb3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.953160 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-bb089b00-9eff-463f-8633-87e0451e6cb3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.088059 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-bb089b00-9eff-463f-8633-87e0451e6cb3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:57.095861 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-bb089b00-9eff-463f-8633-87e0451e6cb3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1558 microversion: 2.1 time: 0.156063 Jul 14 15:59:57.096420 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3782/7598] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:56 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:57.112322 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-c2ae75b4-f2f2-4d7a-aed2-bee0c3190e59 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:57.112973 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-c2ae75b4-f2f2-4d7a-aed2-bee0c3190e59 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:57.120542 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2ae75b4-f2f2-4d7a-aed2-bee0c3190e59 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.121030 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2ae75b4-f2f2-4d7a-aed2-bee0c3190e59 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.121811 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2ae75b4-f2f2-4d7a-aed2-bee0c3190e59 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.122261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-c2ae75b4-f2f2-4d7a-aed2-bee0c3190e59 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.254662 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-c2ae75b4-f2f2-4d7a-aed2-bee0c3190e59 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:57.262965 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-c2ae75b4-f2f2-4d7a-aed2-bee0c3190e59 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1558 microversion: 2.1 time: 0.154491 Jul 14 15:59:57.263545 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3817/7599] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:57 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:58.857708 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-d6c31a30-4b16-45b1-90ea-877141a93915 req-0def7da1-7970-4ea1-82c2-114a7d2cc955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25e44b4c-a762-4ad5-877b-917140067d8b", "tag": "33c98784-1696-41ea-a116-21522a89378d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:58.867216 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d6c31a30-4b16-45b1-90ea-877141a93915 req-0def7da1-7970-4ea1-82c2-114a7d2cc955 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:58.867672 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-d6c31a30-4b16-45b1-90ea-877141a93915 req-0def7da1-7970-4ea1-82c2-114a7d2cc955 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:58.880671 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-d6c31a30-4b16-45b1-90ea-877141a93915 req-0def7da1-7970-4ea1-82c2-114a7d2cc955 service nova] Creating event network-changed:33c98784-1696-41ea-a116-21522a89378d for instance 25e44b4c-a762-4ad5-877b-917140067d8b on n-h2-767704-28 Jul 14 15:59:58.886522 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-d6c31a30-4b16-45b1-90ea-877141a93915 req-0def7da1-7970-4ea1-82c2-114a7d2cc955 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033130 Jul 14 15:59:58.887339 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3783/7600] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:09.021353 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:00:09.021879 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 16:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:01:28.428213 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=26 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:28.429013 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=54 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:28.433676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-a305c410-9052-4b62-9cac-d53820f83492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1200469419"}} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:28.434748 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-a305c410-9052-4b62-9cac-d53820f83492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:28.441600 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a305c410-9052-4b62-9cac-d53820f83492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:28.442070 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a305c410-9052-4b62-9cac-d53820f83492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:28.442852 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a305c410-9052-4b62-9cac-d53820f83492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:28.443311 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-a305c410-9052-4b62-9cac-d53820f83492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:28.722501 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-a305c410-9052-4b62-9cac-d53820f83492 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "POST /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b/action" status: 202 len: 0 microversion: 2.1 time: 0.295981 Jul 14 16:01:28.723157 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3818/7601] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jul 14 16:01:28 2022] POST /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 16:01:32.747136 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:32.748713 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=54 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:32.756202 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-30a85bcd-39e8-4a7a-9c97-a72c9e47eacd req-7209c2da-49d9-4277-ab2a-4d8348321bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e44b4c-a762-4ad5-877b-917140067d8b", "name": "network-vif-plugged", "status": "completed", "tag": "33c98784-1696-41ea-a116-21522a89378d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:32.772868 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-30a85bcd-39e8-4a7a-9c97-a72c9e47eacd req-7209c2da-49d9-4277-ab2a-4d8348321bc5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:32.773758 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-30a85bcd-39e8-4a7a-9c97-a72c9e47eacd req-7209c2da-49d9-4277-ab2a-4d8348321bc5 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:32.790417 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-30a85bcd-39e8-4a7a-9c97-a72c9e47eacd req-7209c2da-49d9-4277-ab2a-4d8348321bc5 service nova] Creating event network-vif-plugged:33c98784-1696-41ea-a116-21522a89378d for instance 25e44b4c-a762-4ad5-877b-917140067d8b on n-h2-767704-28 Jul 14 16:01:32.800555 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-30a85bcd-39e8-4a7a-9c97-a72c9e47eacd req-7209c2da-49d9-4277-ab2a-4d8348321bc5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059036 Jul 14 16:01:32.801775 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3784/7602] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:44.524563 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-6b7367be-1905-4563-b027-ac33ed84ad0e req-c43028e3-ad64-4623-b03f-6f45587b2e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25e44b4c-a762-4ad5-877b-917140067d8b", "tag": "33c98784-1696-41ea-a116-21522a89378d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:44.527122 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_api:SELECT=2 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:44.528091 n-d-767704-28 devstack@n-api.service[119512]: DEBUG dbcounter [-] [119512] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:44.535057 n-d-767704-28 devstack@n-api.service[119511]: DEBUG dbcounter [-] [119511] Writing DB stats nova_cell1:SELECT=2 {{(pid=119511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:44.539109 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-3b7bbd54-d0c6-4d95-be8a-2835bef285ba tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.539729 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3b7bbd54-d0c6-4d95-be8a-2835bef285ba tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.547515 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6b7367be-1905-4563-b027-ac33ed84ad0e req-c43028e3-ad64-4623-b03f-6f45587b2e89 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.547973 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-6b7367be-1905-4563-b027-ac33ed84ad0e req-c43028e3-ad64-4623-b03f-6f45587b2e89 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.553860 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b7bbd54-d0c6-4d95-be8a-2835bef285ba tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.554680 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b7bbd54-d0c6-4d95-be8a-2835bef285ba tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.555517 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b7bbd54-d0c6-4d95-be8a-2835bef285ba tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.556238 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-3b7bbd54-d0c6-4d95-be8a-2835bef285ba tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.564800 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-6b7367be-1905-4563-b027-ac33ed84ad0e req-c43028e3-ad64-4623-b03f-6f45587b2e89 service nova] Creating event network-changed:33c98784-1696-41ea-a116-21522a89378d for instance 25e44b4c-a762-4ad5-877b-917140067d8b on n-h2-767704-28 Jul 14 16:01:44.572513 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-6b7367be-1905-4563-b027-ac33ed84ad0e req-c43028e3-ad64-4623-b03f-6f45587b2e89 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049794 Jul 14 16:01:44.572513 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3785/7603] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:44.593593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-3b7bbd54-d0c6-4d95-be8a-2835bef285ba tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Going to try to terminate instance {{(pid=119512) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:01:44.683349 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-3b7bbd54-d0c6-4d95-be8a-2835bef285ba tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "DELETE /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 204 len: 0 microversion: 2.1 time: 0.165587 Jul 14 16:01:44.684509 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3819/7604] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 16:01:44 2022] DELETE /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 16:01:44.696303 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-52c6bd1b-a12d-4a3e-9ad2-31c179293571 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.697309 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-52c6bd1b-a12d-4a3e-9ad2-31c179293571 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.706589 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52c6bd1b-a12d-4a3e-9ad2-31c179293571 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.707327 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52c6bd1b-a12d-4a3e-9ad2-31c179293571 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.708399 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52c6bd1b-a12d-4a3e-9ad2-31c179293571 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.709442 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-52c6bd1b-a12d-4a3e-9ad2-31c179293571 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.925544 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-52c6bd1b-a12d-4a3e-9ad2-31c179293571 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:44.934507 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-52c6bd1b-a12d-4a3e-9ad2-31c179293571 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1681 microversion: 2.1 time: 0.244905 Jul 14 16:01:44.935107 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3786/7605] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:44 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:45.953563 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-0ea83697-f2d3-4324-99ba-b92f3106952d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:45.954508 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-0ea83697-f2d3-4324-99ba-b92f3106952d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:45.962399 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ea83697-f2d3-4324-99ba-b92f3106952d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.962874 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ea83697-f2d3-4324-99ba-b92f3106952d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.963676 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ea83697-f2d3-4324-99ba-b92f3106952d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.964135 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-0ea83697-f2d3-4324-99ba-b92f3106952d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.150025 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-0ea83697-f2d3-4324-99ba-b92f3106952d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:46.158080 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-0ea83697-f2d3-4324-99ba-b92f3106952d tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1681 microversion: 2.1 time: 0.209678 Jul 14 16:01:46.158844 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3820/7606] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:45 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:46.765422 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-c1a5f825-0f35-4b89-a4c3-a64de44b9695 req-57eecbe8-9e58-4183-8dd1-806dff450061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e44b4c-a762-4ad5-877b-917140067d8b", "name": "network-vif-unplugged", "status": "completed", "tag": "33c98784-1696-41ea-a116-21522a89378d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:46.786477 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c1a5f825-0f35-4b89-a4c3-a64de44b9695 req-57eecbe8-9e58-4183-8dd1-806dff450061 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.788526 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-c1a5f825-0f35-4b89-a4c3-a64de44b9695 req-57eecbe8-9e58-4183-8dd1-806dff450061 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.810609 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-c1a5f825-0f35-4b89-a4c3-a64de44b9695 req-57eecbe8-9e58-4183-8dd1-806dff450061 service nova] Creating event network-vif-unplugged:33c98784-1696-41ea-a116-21522a89378d for instance 25e44b4c-a762-4ad5-877b-917140067d8b on n-h2-767704-28 Jul 14 16:01:46.820071 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-c1a5f825-0f35-4b89-a4c3-a64de44b9695 req-57eecbe8-9e58-4183-8dd1-806dff450061 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059299 Jul 14 16:01:46.821565 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3787/7607] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:47.176979 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-cfa12894-bb94-4b5f-b8f5-807efc6045a6 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:47.177696 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-cfa12894-bb94-4b5f-b8f5-807efc6045a6 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:47.184921 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cfa12894-bb94-4b5f-b8f5-807efc6045a6 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.185434 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cfa12894-bb94-4b5f-b8f5-807efc6045a6 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.186234 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cfa12894-bb94-4b5f-b8f5-807efc6045a6 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.186697 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-cfa12894-bb94-4b5f-b8f5-807efc6045a6 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.248905 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-8d1fa9e5-1835-4102-b499-2e67ff25db7c req-3d8b2ea9-469b-4669-9e7a-e9404f31e641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e44b4c-a762-4ad5-877b-917140067d8b", "name": "network-vif-deleted", "tag": "33c98784-1696-41ea-a116-21522a89378d"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:47.258680 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8d1fa9e5-1835-4102-b499-2e67ff25db7c req-3d8b2ea9-469b-4669-9e7a-e9404f31e641 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.258798 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-8d1fa9e5-1835-4102-b499-2e67ff25db7c req-3d8b2ea9-469b-4669-9e7a-e9404f31e641 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.262673 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-cfa12894-bb94-4b5f-b8f5-807efc6045a6 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:47.271986 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-cfa12894-bb94-4b5f-b8f5-807efc6045a6 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 200 len: 1497 microversion: 2.1 time: 0.100085 Jul 14 16:01:47.272291 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-8d1fa9e5-1835-4102-b499-2e67ff25db7c req-3d8b2ea9-469b-4669-9e7a-e9404f31e641 service nova] Creating event network-vif-deleted:33c98784-1696-41ea-a116-21522a89378d for instance 25e44b4c-a762-4ad5-877b-917140067d8b on n-h2-767704-28 Jul 14 16:01:47.272864 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3821/7608] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:47 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 1497 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:47.277557 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-8d1fa9e5-1835-4102-b499-2e67ff25db7c req-3d8b2ea9-469b-4669-9e7a-e9404f31e641 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093770 Jul 14 16:01:47.278847 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3788/7609] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:48.289967 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8585646b-5a24-4160-ab0f-776e5fbd4d1c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.290593 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-8585646b-5a24-4160-ab0f-776e5fbd4d1c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 25e44b4c-a762-4ad5-877b-917140067d8b] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:48.297623 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8585646b-5a24-4160-ab0f-776e5fbd4d1c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.298123 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8585646b-5a24-4160-ab0f-776e5fbd4d1c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.298906 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8585646b-5a24-4160-ab0f-776e5fbd4d1c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.299357 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-8585646b-5a24-4160-ab0f-776e5fbd4d1c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.313115 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-8585646b-5a24-4160-ab0f-776e5fbd4d1c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] HTTP exception thrown: Instance 25e44b4c-a762-4ad5-877b-917140067d8b could not be found. Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8585646b-5a24-4160-ab0f-776e5fbd4d1c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Request method failure captured: Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b HTTP/1.1 Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DzFu5Bm1NffPc3-kriJur7oP9_4N_nnQAThTVIXjERuiYsZy0a0HroRJyPW2rmXFiyFOZ2mpkkAMIg1HL0aSsbUNeWjN5oLCXLq6dr51kg5TSo8mQOj_LKmHGmbFCALDc3zYdSV3inRASBhiLnkctCKu8K4rbV25TYirlDQuIpbRus Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: f89f0e220b804f929c5f03d32e97cceb Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestSnapshotPattern-1326723122 Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f89f0e220b804f929c5f03d32e97cceb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f89f0e220b804f929c5f03d32e97cceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f89f0e220b804f929c5f03d32e97cceb", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f89f0e220b804f929c5f03d32e97cceb"}]}] Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestSnapshotPattern-1326723122 Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: f89f0e220b804f929c5f03d32e97cceb Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestSnapshotPattern-1326723122 Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestSnapshotPattern-1326723122-project Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 773b8b1c90e14ab984b6d8d4859ed144 Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestSnapshotPattern-1326723122-project Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 25e44b4c-a762-4ad5-877b-917140067d8b could not be found. Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '25e44b4c-a762-4ad5-877b-917140067d8b'} Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25e44b4c-a762-4ad5-877b-917140067d8b could not be found. Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25e44b4c-a762-4ad5-877b-917140067d8b could not be found. Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:48.315354 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 16:01:48.323677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:48.323677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:48.323677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:48.323677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:01:48.323677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:01:48.323677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25e44b4c-a762-4ad5-877b-917140067d8b could not be found. Jul 14 16:01:48.323677 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 16:01:48.323677 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-8585646b-5a24-4160-ab0f-776e5fbd4d1c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Returning 404 to user: Instance 25e44b4c-a762-4ad5-877b-917140067d8b could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:01:48.323677 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-8585646b-5a24-4160-ab0f-776e5fbd4d1c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b" status: 404 len: 111 microversion: 2.1 time: 0.030998 Jul 14 16:01:48.323677 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3822/7610] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:48 2022] GET /compute/v2.1/servers/25e44b4c-a762-4ad5-877b-917140067d8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:01:49.083448 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:01:49.083448 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 16:01:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:01:49.749942 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-c4f43984-8b01-4c14-a903-758e4db8b77b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:49.750549 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c4f43984-8b01-4c14-a903-758e4db8b77b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:49.753261 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [req-bc17594d-3706-4f26-a016-7bf29d14a41a req-07153f48-7316-4d53-bca8-f35449ceb958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3430bf3e-d9f6-493e-a5a5-193694e4f22e", "tag": "029c4d30-529d-4cb1-9cc0-792f190f1e10"}]} {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:49.758661 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4f43984-8b01-4c14-a903-758e4db8b77b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.759130 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4f43984-8b01-4c14-a903-758e4db8b77b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.759922 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4f43984-8b01-4c14-a903-758e4db8b77b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.760633 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-c4f43984-8b01-4c14-a903-758e4db8b77b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.762964 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bc17594d-3706-4f26-a016-7bf29d14a41a req-07153f48-7316-4d53-bca8-f35449ceb958 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.763428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [req-bc17594d-3706-4f26-a016-7bf29d14a41a req-07153f48-7316-4d53-bca8-f35449ceb958 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.780646 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.compute.server_external_events [req-bc17594d-3706-4f26-a016-7bf29d14a41a req-07153f48-7316-4d53-bca8-f35449ceb958 service nova] Creating event network-changed:029c4d30-529d-4cb1-9cc0-792f190f1e10 for instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e on n-h1-767704-28 Jul 14 16:01:49.787200 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [req-bc17594d-3706-4f26-a016-7bf29d14a41a req-07153f48-7316-4d53-bca8-f35449ceb958 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038285 Jul 14 16:01:49.787793 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3823/7611] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:49.791706 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-c4f43984-8b01-4c14-a903-758e4db8b77b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Going to try to terminate instance {{(pid=119511) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:01:49.876781 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-c4f43984-8b01-4c14-a903-758e4db8b77b tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 204 len: 0 microversion: 2.1 time: 0.130169 Jul 14 16:01:49.878259 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3789/7612] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jul 14 16:01:49 2022] DELETE /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:01:49.887385 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e012faf7-b346-4dfa-8f14-ffa532ccf54e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:49.888169 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e012faf7-b346-4dfa-8f14-ffa532ccf54e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:49.898565 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e012faf7-b346-4dfa-8f14-ffa532ccf54e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.899333 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e012faf7-b346-4dfa-8f14-ffa532ccf54e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.900713 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e012faf7-b346-4dfa-8f14-ffa532ccf54e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.901389 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e012faf7-b346-4dfa-8f14-ffa532ccf54e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.071192 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-e012faf7-b346-4dfa-8f14-ffa532ccf54e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:50.078853 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e012faf7-b346-4dfa-8f14-ffa532ccf54e tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1683 microversion: 2.1 time: 0.196347 Jul 14 16:01:50.079496 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3824/7613] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:49 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1683 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:51.097979 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-883c9120-e84a-465c-b947-65597515308c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:51.098842 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.compute.api [None req-883c9120-e84a-465c-b947-65597515308c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119511) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:51.105873 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-883c9120-e84a-465c-b947-65597515308c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:51.106339 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-883c9120-e84a-465c-b947-65597515308c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:51.107127 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-883c9120-e84a-465c-b947-65597515308c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:51.107576 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [None req-883c9120-e84a-465c-b947-65597515308c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:51.242209 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.policy [None req-883c9120-e84a-465c-b947-65597515308c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119511) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:51.249829 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-883c9120-e84a-465c-b947-65597515308c tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1683 microversion: 2.1 time: 0.157267 Jul 14 16:01:51.250405 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3790/7614] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:51 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:52.112697 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:01:52.113359 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 16:01:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:01:52.270282 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-b6451e45-3d45-45b0-80d4-f08fc257bce7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:52.270919 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-b6451e45-3d45-45b0-80d4-f08fc257bce7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:52.281094 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6451e45-3d45-45b0-80d4-f08fc257bce7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.281871 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6451e45-3d45-45b0-80d4-f08fc257bce7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.283465 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6451e45-3d45-45b0-80d4-f08fc257bce7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.284020 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-b6451e45-3d45-45b0-80d4-f08fc257bce7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.432428 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.policy [None req-b6451e45-3d45-45b0-80d4-f08fc257bce7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '773b8b1c90e14ab984b6d8d4859ed144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f0e220b804f929c5f03d32e97cceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119512) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:52.441860 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-b6451e45-3d45-45b0-80d4-f08fc257bce7 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 200 len: 1564 microversion: 2.1 time: 0.176504 Jul 14 16:01:52.442458 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3825/7615] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:52 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:52.477562 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [req-99d1e4b0-5744-44ad-bcf0-bd04e5e4e588 req-15d3998a-3e31-4e87-a49e-76b54c026706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3430bf3e-d9f6-493e-a5a5-193694e4f22e", "name": "network-vif-deleted", "tag": "029c4d30-529d-4cb1-9cc0-792f190f1e10"}]} {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:52.488553 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-99d1e4b0-5744-44ad-bcf0-bd04e5e4e588 req-15d3998a-3e31-4e87-a49e-76b54c026706 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.489037 n-d-767704-28 devstack@n-api.service[119511]: DEBUG oslo_concurrency.lockutils [req-99d1e4b0-5744-44ad-bcf0-bd04e5e4e588 req-15d3998a-3e31-4e87-a49e-76b54c026706 service nova] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.500636 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.compute.server_external_events [req-99d1e4b0-5744-44ad-bcf0-bd04e5e4e588 req-15d3998a-3e31-4e87-a49e-76b54c026706 service nova] Creating event network-vif-deleted:029c4d30-529d-4cb1-9cc0-792f190f1e10 for instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e on n-h1-767704-28 Jul 14 16:01:52.506754 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [req-99d1e4b0-5744-44ad-bcf0-bd04e5e4e588 req-15d3998a-3e31-4e87-a49e-76b54c026706 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032541 Jul 14 16:01:52.507348 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3791/7616] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:53.461245 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e45f19b4-bd65-470a-b23e-a36b4290d1f3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '>' {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:53.461903 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.compute.api [None req-e45f19b4-bd65-470a-b23e-a36b4290d1f3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] [instance: 3430bf3e-d9f6-493e-a5a5-193694e4f22e] Fetching instance by UUID {{(pid=119512) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:53.468806 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e45f19b4-bd65-470a-b23e-a36b4290d1f3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:53.469302 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e45f19b4-bd65-470a-b23e-a36b4290d1f3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:53.470629 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e45f19b4-bd65-470a-b23e-a36b4290d1f3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:53.471191 n-d-767704-28 devstack@n-api.service[119512]: DEBUG oslo_concurrency.lockutils [None req-e45f19b4-bd65-470a-b23e-a36b4290d1f3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Lock "e4faef3f-6327-46a1-98b4-fcbca87641b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:53.484406 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.wsgi [None req-e45f19b4-bd65-470a-b23e-a36b4290d1f3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] HTTP exception thrown: Instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e could not be found. Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e45f19b4-bd65-470a-b23e-a36b4290d1f3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Request method failure captured: Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: request: GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e HTTP/1.1 Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: Accept: application/json Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: Accept-Encoding: identity Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: Connection: close Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: Content-Length: 0 Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: Content-Type: application/json Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: Host: 10.222.0.81 Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: Openstack-System-Scope: None Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: User-Agent: python-urllib3/1.26.9 Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Auth-Token: gAAAAABi0DzFu5Bm1NffPc3-kriJur7oP9_4N_nnQAThTVIXjERuiYsZy0a0HroRJyPW2rmXFiyFOZ2mpkkAMIg1HL0aSsbUNeWjN5oLCXLq6dr51kg5TSo8mQOj_LKmHGmbFCALDc3zYdSV3inRASBhiLnkctCKu8K4rbV25TYirlDQuIpbRus Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Id: None Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Domain-Name: None Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Identity-Status: Confirmed Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Is-Admin-Project: True Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Id: default Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Domain-Name: Default Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Id: f89f0e220b804f929c5f03d32e97cceb Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Project-Name: tempest-TestSnapshotPattern-1326723122 Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Role: reader,member Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Roles: reader,member Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f89f0e220b804f929c5f03d32e97cceb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f89f0e220b804f929c5f03d32e97cceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f89f0e220b804f929c5f03d32e97cceb", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f89f0e220b804f929c5f03d32e97cceb"}]}] Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant: tempest-TestSnapshotPattern-1326723122 Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Id: f89f0e220b804f929c5f03d32e97cceb Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-Tenant-Name: tempest-TestSnapshotPattern-1326723122 Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-User: tempest-TestSnapshotPattern-1326723122-project Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Id: default Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-User-Domain-Name: Default Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-User-Id: 773b8b1c90e14ab984b6d8d4859ed144 Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: X-User-Name: tempest-TestSnapshotPattern-1326723122-project Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: method: > Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: exception: Instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e could not be found. Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: action_args: {'id': '3430bf3e-d9f6-493e-a5a5-193694e4f22e'} Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: {{(pid=119512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e could not be found. Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e could not be found. Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:53.486846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 16:01:53.491846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:53.491846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:53.491846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:53.491846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:01:53.491846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:01:53.491846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e could not be found. Jul 14 16:01:53.491846 n-d-767704-28 devstack@n-api.service[119512]: ERROR nova.api.openstack.wsgi Jul 14 16:01:53.491846 n-d-767704-28 devstack@n-api.service[119512]: DEBUG nova.api.openstack.wsgi [None req-e45f19b4-bd65-470a-b23e-a36b4290d1f3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Returning 404 to user: Instance 3430bf3e-d9f6-493e-a5a5-193694e4f22e could not be found. {{(pid=119512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:01:53.491846 n-d-767704-28 devstack@n-api.service[119512]: INFO nova.api.openstack.requestlog [None req-e45f19b4-bd65-470a-b23e-a36b4290d1f3 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e" status: 404 len: 111 microversion: 2.1 time: 0.031103 Jul 14 16:01:53.492540 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:01:53.492540 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 16:01:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:01:53.493814 n-d-767704-28 devstack@n-api.service[119512]: [pid: 119512|app: 0|req: 3826/7617] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:53 2022] GET /compute/v2.1/servers/3430bf3e-d9f6-493e-a5a5-193694e4f22e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:01:53.666100 n-d-767704-28 devstack@n-api.service[119511]: DEBUG nova.api.openstack.wsgi [None req-75cce767-18a4-4b02-bfe5-839de4b40847 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] Calling method '.version_select at 0x7fd6c4322f70>' {{(pid=119511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:53.690772 n-d-767704-28 devstack@n-api.service[119511]: INFO nova.api.openstack.requestlog [None req-75cce767-18a4-4b02-bfe5-839de4b40847 tempest-TestSnapshotPattern-1326723122 tempest-TestSnapshotPattern-1326723122-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1030402537" status: 202 len: 0 microversion: 2.1 time: 0.028023 Jul 14 16:01:53.691841 n-d-767704-28 devstack@n-api.service[119511]: [pid: 119511|app: 0|req: 3792/7618] 10.222.0.81 () {58 vars in 1256 bytes} [Thu Jul 14 16:01:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1030402537 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:29.030000 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:03:29.030622 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 16:03:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:05:09.092417 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:05:09.093488 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 16:05:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:05:12.124268 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:05:12.124898 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 16:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:05:13.501072 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:05:13.501975 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 16:05:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:06:49.045302 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:06:49.045944 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 16:06:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:07:03.953038 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:07:03.953649 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 16:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:07:10.432205 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:07:10.432798 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 16:07:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:08:29.102236 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:08:29.102952 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 16:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:08:32.134265 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:08:32.134871 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 16:08:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:08:33.510571 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:08:33.511258 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 16:08:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:10:09.054710 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:10:09.055327 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 16:10:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:10:23.966775 n-d-767704-28 devstack@n-api.service[119511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:10:23.967453 n-d-767704-28 devstack@n-api.service[119511]: Thu Jul 14 16:10:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:10:30.442003 n-d-767704-28 devstack@n-api.service[119512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:10:30.442522 n-d-767704-28 devstack@n-api.service[119512]: Thu Jul 14 16:10:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!